| *** dave-mccowan has quit IRC | 00:23 | |
| *** sapd1_ has joined #openstack-cinder | 00:36 | |
| *** Liang__ has joined #openstack-cinder | 00:37 | |
| *** sapd1_ has quit IRC | 00:44 | |
| *** brinzhang has joined #openstack-cinder | 00:53 | |
| *** dave-mccowan has joined #openstack-cinder | 00:56 | |
| *** lixiaoy1 has joined #openstack-cinder | 01:00 | |
| *** Nel1x has quit IRC | 01:02 | |
| *** sapd1_ has joined #openstack-cinder | 01:07 | |
| *** Liang__ is now known as LiangFang | 01:10 | |
| openstackgerrit | Yikun Jiang proposed openstack/cinder master: Support volume re-image https://review.openstack.org/606346 | 01:14 |
|---|---|---|
| *** sapd1_ has quit IRC | 01:19 | |
| *** markvoelker has quit IRC | 01:21 | |
| *** markvoelker has joined #openstack-cinder | 01:22 | |
| *** markvoelker has quit IRC | 01:26 | |
| *** sapd1_ has joined #openstack-cinder | 01:50 | |
| openstackgerrit | Yikun Jiang proposed openstack/cinder master: Add policy test for volume create policy https://review.openstack.org/617542 | 01:53 |
| openstackgerrit | Yikun Jiang proposed openstack/cinder master: Add policy test for volume update/del policy https://review.openstack.org/617543 | 01:53 |
| openstackgerrit | Yikun Jiang proposed openstack/cinder master: Add policy test for volume action policy https://review.openstack.org/617544 | 01:53 |
| openstackgerrit | Yikun Jiang proposed openstack/cinder master: Add policy test for volume metadata policy https://review.openstack.org/619977 | 01:54 |
| openstackgerrit | Yikun Jiang proposed openstack/cinder master: Add policy test for volume extend/retype/update_ro policy https://review.openstack.org/619978 | 01:54 |
| *** lbragstad has quit IRC | 02:13 | |
| *** Dinesh_Bhor has joined #openstack-cinder | 02:15 | |
| *** lbragstad has joined #openstack-cinder | 02:16 | |
| openstackgerrit | zhufl proposed openstack/cinder master: api-ref: add response body for set-image-metadata-for-a-volume https://review.openstack.org/615774 | 02:16 |
| *** Dinesh_Bhor has quit IRC | 02:17 | |
| *** bhagyashris has joined #openstack-cinder | 02:21 | |
| *** itlinux has quit IRC | 02:29 | |
| *** mhen has quit IRC | 02:32 | |
| *** mhen has joined #openstack-cinder | 02:34 | |
| *** Dinesh_Bhor has joined #openstack-cinder | 02:35 | |
| openstackgerrit | 98k proposed openstack/python-brick-cinderclient-ext master: Change openstack-dev to openstack-discuss https://review.openstack.org/622085 | 02:37 |
| *** wxy-xiyuan has joined #openstack-cinder | 02:54 | |
| *** psachin has joined #openstack-cinder | 02:58 | |
| openstackgerrit | Yingxin Cheng proposed openstack/cinder master: [wip] Cinder RSD Driver https://review.openstack.org/621465 | 03:13 |
| *** lbragstad has quit IRC | 03:38 | |
| *** udesale has joined #openstack-cinder | 03:40 | |
| *** Dinesh_Bhor has quit IRC | 03:46 | |
| *** Dinesh_Bhor has joined #openstack-cinder | 03:55 | |
| *** zzzeek has quit IRC | 04:41 | |
| *** zzzeek has joined #openstack-cinder | 04:41 | |
| *** dave-mccowan has quit IRC | 04:53 | |
| *** bhagyashris has quit IRC | 05:00 | |
| *** sapd1_ has quit IRC | 05:05 | |
| *** sapd1_ has joined #openstack-cinder | 05:18 | |
| *** sapd1_ has quit IRC | 05:23 | |
| *** khomesh has joined #openstack-cinder | 05:24 | |
| *** brinzhang_ has joined #openstack-cinder | 06:01 | |
| *** sapd1_ has joined #openstack-cinder | 06:03 | |
| *** brinzhang has quit IRC | 06:13 | |
| openstackgerrit | Mayur Indalkar proposed openstack/cinder master: Code refactoring for existing veritas access cinder iSCSI driver. https://review.openstack.org/611791 | 06:16 |
| *** _alastor_ has joined #openstack-cinder | 06:29 | |
| *** sapd1_ has quit IRC | 06:48 | |
| *** sapd__ has joined #openstack-cinder | 06:48 | |
| *** sapd__ has quit IRC | 06:55 | |
| *** Luzi has joined #openstack-cinder | 06:58 | |
| *** dpawlik has joined #openstack-cinder | 07:22 | |
| *** rcernin has quit IRC | 07:23 | |
| *** udesale has quit IRC | 07:24 | |
| *** gkadam has joined #openstack-cinder | 07:52 | |
| *** Dinesh_Bhor has quit IRC | 07:57 | |
| *** _alastor_ has quit IRC | 08:00 | |
| openstackgerrit | Yikun Jiang proposed openstack/cinder-specs master: Appending change for improve-volume-transfer-records bp https://review.openstack.org/624012 | 08:00 |
| openstackgerrit | Yikun Jiang proposed openstack/cinder master: Add x_project_id, accepted to transfers https://review.openstack.org/615487 | 08:06 |
| openstackgerrit | Yikun Jiang proposed openstack/cinder master: Improve volume transfer records https://review.openstack.org/615716 | 08:06 |
| *** trident has quit IRC | 08:10 | |
| *** trident has joined #openstack-cinder | 08:13 | |
| openstackgerrit | Francois Deppierraz proposed openstack/cinder master: cinder-volume: Stop masking IOError different than ENOSPC https://review.openstack.org/612393 | 08:13 |
| *** imacdonn has quit IRC | 08:22 | |
| *** imacdonn has joined #openstack-cinder | 08:22 | |
| *** bhagyashris has joined #openstack-cinder | 08:22 | |
| *** udesale has joined #openstack-cinder | 08:49 | |
| *** bhagyashris has quit IRC | 08:51 | |
| *** lixiaoy1 has quit IRC | 08:54 | |
| *** Dinesh_Bhor has joined #openstack-cinder | 09:00 | |
| *** Dinesh_Bhor has quit IRC | 09:09 | |
| *** Dinesh_Bhor has joined #openstack-cinder | 09:46 | |
| *** Dinesh_Bhor has quit IRC | 09:47 | |
| *** sapd1_ has joined #openstack-cinder | 09:54 | |
| *** e0ne has joined #openstack-cinder | 10:03 | |
| *** sapd1_ has quit IRC | 10:06 | |
| *** LiangFang has quit IRC | 10:14 | |
| *** udesale has quit IRC | 10:18 | |
| *** e0ne has quit IRC | 10:30 | |
| *** e0ne has joined #openstack-cinder | 10:36 | |
| *** dpawlik has quit IRC | 10:39 | |
| *** dpawlik has joined #openstack-cinder | 10:45 | |
| *** luizbag has joined #openstack-cinder | 10:47 | |
| *** luizbag_ has joined #openstack-cinder | 10:49 | |
| *** sapd1_ has joined #openstack-cinder | 10:52 | |
| *** luizbag has quit IRC | 10:52 | |
| *** sapd1_ has quit IRC | 10:58 | |
| *** udesale has joined #openstack-cinder | 11:11 | |
| *** erlon has joined #openstack-cinder | 11:18 | |
| openstackgerrit | Arne Wiebalck proposed openstack/cinder master: Support deferred deletion in RBD https://review.openstack.org/608984 | 11:22 |
| openstackgerrit | Gorka Eguileor proposed openstack/cinder master: Revert "Ceph driver should respect the `--incremental` option for backups" https://review.openstack.org/624056 | 11:28 |
| geguileo | brinzhang_: You are right, I have added some comments to that review and proposed a revert of the patch https://review.openstack.org/624056 | 11:29 |
| *** ganso has joined #openstack-cinder | 11:30 | |
| geguileo | erlon: how can I get the NetApp logs from this patch? https://review.openstack.org/#/c/621575 | 11:36 |
| brinzhang_ | geguileo: Yeah, thanks :P | 11:38 |
| geguileo | brinzhang_: sorry about my poor review :-( | 11:38 |
| *** sapd1_ has joined #openstack-cinder | 11:39 | |
| brinzhang_ | geguileo: Nono... I just test it, not your problem :-( | 11:39 |
| geguileo | brinzhang_: it's trully my problem... Because I had analyzed the problem a couple of months ago and noticed that the solution wasn't trivial | 11:40 |
| brinzhang_ | geguileo: I also encountered the same problem in our R&D environment. This method is also used, but it can't solve the problem. | 11:40 |
| geguileo | brinzhang_: and then when I reviewed enriquetaso 's patch I assumed I had missed something in my previous analysis and hadn't noticed the trivial solution | 11:40 |
| geguileo | brinzhang_: when in reality that wasn't a proper solution :-( | 11:40 |
| geguileo | brinzhang_: yeah, it cannot solve it because it's meant for non RBD volumes :-( | 11:41 |
| brinzhang_ | geguileo: Yeah, *this* need to investigate in depth :P | 11:41 |
| geguileo | brinzhang_: I have an idea on how this can be fixed, it's just a bit of a pain to fix it | 11:43 |
| *** sapd1_ has quit IRC | 11:43 | |
| geguileo | we need to change the _get_backup_base_name for one | 11:44 |
| geguileo | because we may have multiple base images, something that's not currently supported | 11:44 |
| brinzhang_ | Yes, if we do full backup firstly, there will be some base images | 11:45 |
| geguileo | and we have to forcefully create one in the _backup_rbd method whenever it's not an incremental backup | 11:45 |
| geguileo | and we have to be careful on the restore process | 11:46 |
| geguileo | I believe that's all we would need to do to fix the issue | 11:46 |
| brinzhang_ | Can we use the most recent full backup file as a base image? | 11:46 |
| geguileo | brinzhang_: the problem is that the RBD driver doesn't know which backup that is | 11:46 |
| brinzhang_ | base on ''created_at" time | 11:47 |
| geguileo | brinzhang_: a driver cannot check the database | 11:47 |
| geguileo | oh!!! | 11:47 |
| geguileo | we may not need to know the base!!! | 11:48 |
| geguileo | we know the parent backup | 11:48 |
| geguileo | so we just need to match it to the snapshot of the source volume | 11:48 |
| geguileo | and then do the diff | 11:48 |
| brinzhang_ | yeah, maybe it's better | 11:49 |
| geguileo | the problem will probably be around keeping it compatible with already existing backups | 11:49 |
| geguileo | like you said, this requires more in depth analysis | 11:50 |
| brinzhang_ | I think this exist another problem, if you do the incremental backup, do you want to allow it to create a full backup again? | 11:51 |
| geguileo | it would only create a full backup if somebody had gone to the Ceph backend and messed up things directly | 11:51 |
| brinzhang_ | Yeah. | 11:53 |
| geguileo | in that sense you can consider it "self healing" as it won't require user or admin interaction to get it working again | 11:53 |
| *** phasespace has joined #openstack-cinder | 11:54 | |
| brinzhang_ | Yes, I know, think about it again :) | 11:55 |
| *** tpsilva has joined #openstack-cinder | 11:55 | |
| phasespace | Question. When using Ceph as a Cinder backend does the nova instances talk directly to the ceph cluster, or somehow via the storage host running cinder-volume? | 11:56 |
| geguileo | phasespace: directly | 11:57 |
| phasespace | so the storage host is just for setting up the direct connection between an instance and ceph? | 11:57 |
| *** e0ne has quit IRC | 11:58 | |
| geguileo | phasespace: what "storage host"? | 11:58 |
| geguileo | oh, the conf in Nova | 11:58 |
| phasespace | the host running the cinder-volume service | 11:58 |
| phasespace | sorry, storage host is openstack ansible terminology, i guess | 11:59 |
| brinzhang_ | I think his means *ceph* as a 'storage host'. Is this storage host directly accessed by instance? | 12:00 |
| geguileo | ok, then the cinder-volume service node is used to pass the connection info to the Nova nodes | 12:00 |
| *** e0ne has joined #openstack-cinder | 12:00 | |
| geguileo | and the nova nodes use libvirt to make the hypervisor connect directly to the Ceph cluster | 12:00 |
| geguileo | so the host doesn't see the volume at any moment | 12:00 |
| phasespace | ok, understood. thanks! | 12:00 |
| *** e0ne has quit IRC | 12:00 | |
| geguileo | so it's a direct connection | 12:00 |
| geguileo | no problem | 12:01 |
| *** brinzhang_ has quit IRC | 12:20 | |
| *** dpawlik has quit IRC | 12:23 | |
| *** dpawlik has joined #openstack-cinder | 12:23 | |
| *** rosmaita has joined #openstack-cinder | 12:34 | |
| openstackgerrit | Jay Rubenstein proposed openstack/cinder master: SF: Handle qos values on extend volume https://review.openstack.org/606959 | 12:46 |
| *** abishop has joined #openstack-cinder | 12:56 | |
| *** jistr is now known as jistr|medchk | 12:57 | |
| *** psachin has quit IRC | 13:05 | |
| openstackgerrit | Brian Rosmaita proposed openstack/cinder master: Make policy config docs consistent https://review.openstack.org/621296 | 13:08 |
| *** dave-mccowan has joined #openstack-cinder | 13:14 | |
| *** dpawlik has quit IRC | 13:17 | |
| *** dpawlik has joined #openstack-cinder | 13:20 | |
| *** dpawlik has quit IRC | 13:30 | |
| *** sapd1_ has joined #openstack-cinder | 13:32 | |
| *** dpawlik has joined #openstack-cinder | 13:32 | |
| *** sapd1_ has quit IRC | 13:36 | |
| *** jmlowe has quit IRC | 13:45 | |
| openstackgerrit | Silvan Kaiser proposed openstack/cinder master: Lock on snapshot_id w/o f_name in delete_snapshot of volume manager https://review.openstack.org/584282 | 13:45 |
| *** lemko has joined #openstack-cinder | 13:47 | |
| *** jistr|medchk is now known as jistr | 13:56 | |
| *** s10 has joined #openstack-cinder | 13:56 | |
| *** mriedem has joined #openstack-cinder | 14:00 | |
| *** e0ne has joined #openstack-cinder | 14:15 | |
| *** openstackstatus has joined #openstack-cinder | 14:17 | |
| *** ChanServ sets mode: +v openstackstatus | 14:17 | |
| *** lbragstad has joined #openstack-cinder | 14:17 | |
| *** jmlowe has joined #openstack-cinder | 14:24 | |
| *** jmlowe has quit IRC | 14:24 | |
| *** gkadam has quit IRC | 14:24 | |
| *** jmlowe has joined #openstack-cinder | 14:25 | |
| *** aspiers has quit IRC | 14:26 | |
| *** s10 has quit IRC | 14:28 | |
| *** jmlowe has quit IRC | 14:30 | |
| *** jmlowe has joined #openstack-cinder | 14:36 | |
| *** sapd1_ has joined #openstack-cinder | 14:51 | |
| openstackgerrit | Yingxin Cheng proposed openstack/cinder master: [wip] Cinder RSD Driver https://review.openstack.org/621465 | 14:54 |
| *** KeithMnemonic has joined #openstack-cinder | 14:54 | |
| *** aspiers has joined #openstack-cinder | 14:55 | |
| *** mvkr has quit IRC | 14:55 | |
| openstackgerrit | Yingxin Cheng proposed openstack/cinder master: [wip] Cinder RSD Driver https://review.openstack.org/621465 | 15:02 |
| *** KeithMnemonic has quit IRC | 15:10 | |
| *** alkhodos has quit IRC | 15:17 | |
| *** Luzi has quit IRC | 15:18 | |
| *** alkhodos has joined #openstack-cinder | 15:18 | |
| *** mvkr has joined #openstack-cinder | 15:25 | |
| *** itlinux has joined #openstack-cinder | 15:44 | |
| *** jmlowe has quit IRC | 15:46 | |
| *** mmethot has quit IRC | 15:46 | |
| *** itlinux has quit IRC | 15:46 | |
| *** lpetrut has joined #openstack-cinder | 16:12 | |
| *** mmethot has joined #openstack-cinder | 16:17 | |
| *** mmethot has quit IRC | 16:24 | |
| *** jmlowe has joined #openstack-cinder | 16:24 | |
| *** mmethot has joined #openstack-cinder | 16:26 | |
| *** jmlowe has quit IRC | 16:34 | |
| *** openstackgerrit has quit IRC | 16:35 | |
| *** openstackgerrit has joined #openstack-cinder | 16:38 | |
| openstackgerrit | Merged openstack/cinder stable/queens: Correct default policy file https://review.openstack.org/623340 | 16:38 |
| *** psachin has joined #openstack-cinder | 16:42 | |
| mriedem | i'm seeing some strange intermittent failures during swap volume of a multiattach volume and am at the point that i need some cinder help, it looks like a race cleaning up targets | 16:43 |
| mriedem | https://bugs.launchpad.net/cinder/+bug/1807723 | 16:43 |
| openstack | Launchpad bug 1807723 in OpenStack Compute (nova) "swap multiattach volume intermittently fails when servers are on different hosts" [Medium,Confirmed] | 16:43 |
| mriedem | the volume and server are on different hosts | 16:44 |
| mriedem | during the swap, we logout successfully from the host that the server is on: | 16:44 |
| mriedem | Dec 08 01:45:37.336156 ubuntu-xenial-ovh-gra1-0001066278 nova-compute[20206]: Logout of [sid: 1, target: iqn.2010-10.org.openstack:volume-2a48ae08-2833-488c-8771-eea86f41c7b8, portal: 149.202.185.218,3260] successful. | 16:44 |
| mriedem | then nova tries to delete the attachment record for that connection. that request goes to the host where the volume is, which is different from that logout, and the forced target delete there fails: | 16:45 |
| mriedem | Dec 08 01:45:41.381386 ubuntu-xenial-ovh-gra1-0001066161 cinder-volume[1776]: Stderr: u'tgtadm: this target is still active\n': ProcessExecutionError: Unexpected error while running command. | 16:45 |
| mriedem | with an lvm backend and volume connected across multiple hosts, is it possible there is a lag where the logout on the subnode isn't being reflected in time for the delete on the primary node? | 16:46 |
| mriedem | this only started showing up once this test moved from a single node job to a multinode job | 16:48 |
| mriedem | jgriffith: any thoughts here? ^ there is also an old fixme in the code that's failing: https://github.com/openstack/cinder/blob/9d4fd16bcd8eca930910798cc519cb5bc5846c59/cinder/volume/manager.py#L4530 | 16:49 |
| mriedem | but that might just be more about reporting, not this particular issue | 16:50 |
| *** itlinux has joined #openstack-cinder | 16:56 | |
| *** udesale has quit IRC | 16:58 | |
| *** _alastor_ has joined #openstack-cinder | 17:17 | |
| *** khomesh has quit IRC | 17:18 | |
| *** e0ne has quit IRC | 17:22 | |
| *** e0ne has joined #openstack-cinder | 17:22 | |
| *** e0ne has quit IRC | 17:23 | |
| *** s10 has joined #openstack-cinder | 17:24 | |
| *** e0ne has joined #openstack-cinder | 17:26 | |
| *** hedvig_01 has joined #openstack-cinder | 17:41 | |
| *** e0ne has quit IRC | 18:09 | |
| *** e0ne has joined #openstack-cinder | 18:11 | |
| *** e0ne has quit IRC | 18:11 | |
| *** jmlowe has joined #openstack-cinder | 18:12 | |
| mriedem | nevermind, after more debugging i think it's something on the nova side not cleaning up properly which is why when we delete the volume the target connection is still active | 18:21 |
| mriedem | not sure where the hell this race is happening though | 18:21 |
| *** psachin has quit IRC | 18:23 | |
| *** sapd1_ has quit IRC | 18:24 | |
| *** e0ne has joined #openstack-cinder | 18:34 | |
| *** sapd1_ has joined #openstack-cinder | 18:51 | |
| *** sapd1_ has quit IRC | 18:55 | |
| *** sapd1_ has joined #openstack-cinder | 18:58 | |
| *** e0ne has quit IRC | 19:06 | |
| *** mvkr has quit IRC | 19:09 | |
| *** N3l1x has joined #openstack-cinder | 19:16 | |
| *** _alastor_ has quit IRC | 20:00 | |
| *** mvkr has joined #openstack-cinder | 20:16 | |
| openstackgerrit | Brian Rosmaita proposed openstack/cinder master: Correct default policy_file in the sample config https://review.openstack.org/623126 | 20:24 |
| *** jmlowe has quit IRC | 20:26 | |
| *** lpetrut has quit IRC | 20:27 | |
| *** e0ne has joined #openstack-cinder | 20:28 | |
| *** e0ne has quit IRC | 20:28 | |
| openstackgerrit | Alan Bishop proposed openstack/cinder master: Fix permissions with NFS-backed snapshots and backups https://review.openstack.org/624193 | 20:30 |
| *** jmlowe has joined #openstack-cinder | 20:32 | |
| *** jmlowe has quit IRC | 20:33 | |
| *** luizbag_ has quit IRC | 20:34 | |
| *** ganso has quit IRC | 20:35 | |
| *** erlon has quit IRC | 20:40 | |
| *** noonedeadpunk has joined #openstack-cinder | 20:42 | |
| noonedeadpunk | hi everyone. | 20:42 |
| noonedeadpunk | I have pretty weired situation with cinder. I have 2 servers with cinder-api/cinder scheduler and 2 servers with cinder-volumes. Cinder-api is being balanced through haproxy. But both API containers have different "cinder-manage service list" statuses: http://paste.openstack.org/show/736930/ | 20:44 |
| noonedeadpunk | I've tried to set rabbit_ha_queues to true, flush rabbitmq, but without much result (maybe missed smth). And rabbit has HA policy (however, cinder has it's own vhost, so I'm not sure if policy is correct) http://paste.openstack.org/show/736931/ | 20:46 |
| noonedeadpunk | Also tried to use zookeeper as a coordination service, but it didn't help | 20:46 |
| noonedeadpunk | I suppose, that issue in pretty trivial, but I even don't know where to start | 20:47 |
| noonedeadpunk | would be really gratefull if someone could point me at least to the correct direction | 20:47 |
| *** jmlowe has joined #openstack-cinder | 20:58 | |
| *** sapd1_ has quit IRC | 21:21 | |
| *** sapd1_ has joined #openstack-cinder | 21:24 | |
| *** s10 has quit IRC | 21:30 | |
| *** markguz_ has joined #openstack-cinder | 21:48 | |
| *** markguz_ has left #openstack-cinder | 21:48 | |
| *** markguz_ has joined #openstack-cinder | 21:48 | |
| *** markguz_ has quit IRC | 21:49 | |
| *** markguz_ has joined #openstack-cinder | 21:50 | |
| *** sapd1_ has quit IRC | 21:58 | |
| *** abishop has quit IRC | 21:58 | |
| *** tpsilva has quit IRC | 22:02 | |
| *** sapd1_ has joined #openstack-cinder | 22:03 | |
| *** _alastor_ has joined #openstack-cinder | 22:06 | |
| openstackgerrit | Merged openstack/cinder master: Revert "Ceph driver should respect the `--incremental` option for backups" https://review.openstack.org/624056 | 22:07 |
| *** sapd1_ has quit IRC | 22:07 | |
| *** markguz_ has quit IRC | 22:26 | |
| *** itlinux has quit IRC | 22:43 | |
| openstackgerrit | Woojay Poynter proposed openstack/cinder master: Update DRBD (drbdmanagedrv) Driver to LINSTOR (linstordrv) https://review.openstack.org/624233 | 22:45 |
| *** alkhodos has quit IRC | 22:46 | |
| *** alkhodos has joined #openstack-cinder | 22:47 | |
| *** _alastor_ has quit IRC | 22:55 | |
| *** rcernin has joined #openstack-cinder | 22:59 | |
| *** lemko has quit IRC | 23:02 | |
| *** dave-mccowan has quit IRC | 23:19 | |
| *** N3l1x has quit IRC | 23:38 | |
| *** itlinux has joined #openstack-cinder | 23:49 | |
| *** mmethot has quit IRC | 23:58 | |
| *** mriedem is now known as mriedem_away | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!