Monday, 2017-07-10

*** sticker has joined #openstack-cinder00:01
*** ircuser-1 has quit IRC00:08
*** wxy- has joined #openstack-cinder00:11
*** diablo_rojo has quit IRC00:18
*** iceyao has joined #openstack-cinder00:19
*** iceyao has quit IRC00:23
*** wanghao has joined #openstack-cinder00:32
*** wxy-_ has joined #openstack-cinder00:33
*** wxy- has quit IRC00:33
*** wxy-_ has quit IRC00:37
*** s-shiono has joined #openstack-cinder00:40
*** mriedem has quit IRC00:42
*** zhurong has joined #openstack-cinder00:48
*** zhangguoqing has joined #openstack-cinder00:57
*** iceyao has joined #openstack-cinder00:57
*** iceyao has quit IRC01:02
*** Rick_ has joined #openstack-cinder01:09
*** iceyao has joined #openstack-cinder01:12
*** gouthamr has quit IRC01:13
*** Rick_ has quit IRC01:24
*** dave-mccowan has joined #openstack-cinder01:33
openstackgerritwangxiyuan proposed openstack/python-cinderclient master: Support volume summary command  https://review.openstack.org/47440901:37
*** zhaochao has joined #openstack-cinder01:46
*** iceyao has quit IRC01:56
openstackgerritwangxiyuan proposed openstack/cinder-specs master: Inspection Mechanism For Capacity Limited Host  https://review.openstack.org/30886901:59
*** wanghao_ has joined #openstack-cinder02:01
*** lhx_ has joined #openstack-cinder02:02
*** wanghao has quit IRC02:03
*** lbragstad has joined #openstack-cinder02:10
openstackgerritDou Rui Yuan proposed openstack/cinder master: Update contents of attach_detach_conventions_v2.rst  https://review.openstack.org/48198102:18
*** wxy- has joined #openstack-cinder02:30
*** zzzeek_ has joined #openstack-cinder02:30
*** zhurong has quit IRC02:43
*** stvnoyes has quit IRC03:04
*** vivsoni has joined #openstack-cinder03:11
*** gcb has joined #openstack-cinder03:12
openstackgerritklyang proposed openstack/cinder-specs master: switch from oslosphinx to openstackdocstheme  https://review.openstack.org/48198903:17
openstackgerritzheng yin proposed openstack/cinder master: eventlet.green.subprocess replace subprocess  https://review.openstack.org/46660703:23
openstackgerritjunbo.li proposed openstack/cinder master: Keep consistent of naming convention  https://review.openstack.org/47491303:30
*** zhonghua has joined #openstack-cinder03:45
*** Dinesh_Bhor has joined #openstack-cinder03:52
*** psachin has joined #openstack-cinder03:56
*** lbragstad has quit IRC04:04
*** dave-mccowan has quit IRC04:05
*** iceyao has joined #openstack-cinder04:07
*** adisky__ has joined #openstack-cinder04:07
*** iceyao has quit IRC04:12
*** wxy- has joined #openstack-cinder04:19
*** wanghao_ has quit IRC04:20
*** wanghao has joined #openstack-cinder04:20
openstackgerritSofie Huang proposed openstack/cinder master: FalconStor: Support generic group  https://review.openstack.org/46411204:21
*** lhx_ has quit IRC04:21
*** wxy- has quit IRC04:24
*** gcb has quit IRC04:30
openstackgerritHuang Zhiteng proposed openstack/cinder master: VolumeManager: Check available capacity before creating resources  https://review.openstack.org/43767704:35
*** arnewiebalck_ has joined #openstack-cinder04:45
*** stakeda has joined #openstack-cinder04:46
*** zhurong has joined #openstack-cinder04:46
*** arnewiebalck_ has quit IRC05:00
*** wxy- has joined #openstack-cinder05:02
*** arnewiebalck_ has joined #openstack-cinder05:02
*** wxy- has quit IRC05:07
*** mlakat has quit IRC05:10
*** mlakat has joined #openstack-cinder05:10
*** bhagyashris has quit IRC05:24
*** pgadiya has joined #openstack-cinder05:28
*** lkuchlan has joined #openstack-cinder05:39
openstackgerritbhavani proposed openstack/cinder-specs master: Remove pbr warnerrors in favor of sphinx check  https://review.openstack.org/47887505:47
openstackgerritRikimaru Honjo proposed openstack/os-brick master: Update node.startup value without target  https://review.openstack.org/46614605:52
openstackgerritbhavani proposed openstack/cinder-specs master: Remove pbr warnerrors in favor of sphinx check  https://review.openstack.org/47887505:52
*** Poornima has joined #openstack-cinder05:57
*** Poornima has quit IRC05:57
openstackgerritklyang proposed openstack/python-cinderclient master: switch from oslosphinx to openstackdocstheme ref:https://docs.openstack.org/openstackdocstheme/latest/  https://review.openstack.org/48200906:06
*** bhagyashris has joined #openstack-cinder06:11
*** isaacb has joined #openstack-cinder06:22
*** bkopilov has joined #openstack-cinder06:25
*** ociuhandu has quit IRC06:26
*** ociuhandu has joined #openstack-cinder06:27
*** lpetrut has joined #openstack-cinder06:37
*** s-shiono has quit IRC06:38
*** lkuchlan has quit IRC06:38
*** iceyao has joined #openstack-cinder06:39
*** ChubYann has quit IRC06:40
*** lpetrut has quit IRC06:43
*** iceyao has quit IRC06:43
*** abhitechie has joined #openstack-cinder06:47
*** rcernin has joined #openstack-cinder06:47
*** e0ne has joined #openstack-cinder06:48
*** belmoreira has joined #openstack-cinder06:54
*** Shunli has joined #openstack-cinder06:59
*** isaacb has quit IRC07:00
*** iceyao has joined #openstack-cinder07:00
*** iceyao has quit IRC07:05
*** abhitechie has quit IRC07:06
*** abhitechie has joined #openstack-cinder07:07
*** harlowja has quit IRC07:11
*** zsli_ has joined #openstack-cinder07:14
*** wanghao_ has joined #openstack-cinder07:15
*** Shunli has quit IRC07:17
*** wanghao has quit IRC07:17
*** iceyao has joined #openstack-cinder07:20
*** lkuchlan has joined #openstack-cinder07:23
*** iceyao has quit IRC07:25
*** kiennt has joined #openstack-cinder07:32
*** tesseract has joined #openstack-cinder07:36
*** kiennt has left #openstack-cinder07:37
*** nicolasbock has joined #openstack-cinder07:37
openstackgerritkongxiangyun proposed openstack/cinder master: Cinder volume revert to snapshot with Ceph  https://review.openstack.org/48156607:39
openstackgerritLiu Qing proposed openstack/cinder master: Fix SSHPool current_size not work correctly  https://review.openstack.org/46863407:39
openstackgerritSofie Huang proposed openstack/cinder master: FalconStor: Support generic group  https://review.openstack.org/46411207:41
*** iceyao has joined #openstack-cinder07:41
*** iceyao has quit IRC07:46
*** e0ne has quit IRC07:47
*** zhangguoqing has quit IRC07:51
openstackgerritSofie Huang proposed openstack/cinder master: FalconStor: Support generic group  https://review.openstack.org/46411207:53
*** iceyao has joined #openstack-cinder07:56
*** e0ne has joined #openstack-cinder07:56
*** zzzeek has quit IRC08:00
*** zzzeek has joined #openstack-cinder08:02
*** abhitechie has quit IRC08:06
*** abhitechie has joined #openstack-cinder08:08
*** _pewp_ has quit IRC08:10
openstackgerritYingzhe Zeng proposed openstack/cinder master: Not use admin metadata in Huawei driver anymore  https://review.openstack.org/47577408:11
*** e0ne has quit IRC08:13
*** _pewp_ has joined #openstack-cinder08:14
*** e0ne has joined #openstack-cinder08:15
*** wanghao_ has quit IRC08:18
*** wanghao has joined #openstack-cinder08:18
*** wanghao has quit IRC08:19
*** wanghao has joined #openstack-cinder08:19
*** wanghao has quit IRC08:20
*** wanghao has joined #openstack-cinder08:20
*** wanghao has quit IRC08:21
*** wanghao has joined #openstack-cinder08:21
*** wanghao has quit IRC08:21
*** wanghao has joined #openstack-cinder08:22
*** wanghao has quit IRC08:22
*** wanghao has joined #openstack-cinder08:22
*** wanghao has quit IRC08:23
*** wanghao has joined #openstack-cinder08:23
*** wanghao has quit IRC08:24
*** wanghao has joined #openstack-cinder08:24
*** wanghao has quit IRC08:25
*** wanghao has joined #openstack-cinder08:25
*** jistr|off is now known as jistr08:25
*** afazekas|away is now known as afazekas08:34
*** felipemonteiro has joined #openstack-cinder08:56
*** slunkad has joined #openstack-cinder08:59
*** felipemonteiro has quit IRC09:01
*** mdavidson has joined #openstack-cinder09:04
*** lpetrut has joined #openstack-cinder09:07
*** zhangguoqing has joined #openstack-cinder09:12
*** kiennt has joined #openstack-cinder09:15
openstackgerritkongxiangyun proposed openstack/cinder master: add exception check for lvm_type  https://review.openstack.org/48145409:20
*** mvk has joined #openstack-cinder09:21
*** kiennt has left #openstack-cinder09:21
openstackgerritDai Dang Van proposed openstack/cinder-specs master: Manual update sphinx version  https://review.openstack.org/48206809:23
openstackgerritDai Dang Van proposed openstack/cinder-specs master: switch from oslosphinx to openstackdocstheme  https://review.openstack.org/48198909:23
*** ociuhandu has quit IRC09:27
*** zsli_ has quit IRC09:27
openstackgerritjunbo.li proposed openstack/cinder master: Api-ref: Reorganize volumes versions  https://review.openstack.org/48207209:31
*** isaacb has joined #openstack-cinder09:46
*** dalgaaf has quit IRC09:46
*** dalgaaf has joined #openstack-cinder09:48
*** iceyao has quit IRC09:48
*** lhx_ has joined #openstack-cinder10:00
openstackgerritChason Chan proposed openstack/python-cinderclient master: import content from cli-reference in openstack-manuals  https://review.openstack.org/48208310:02
*** sdague has joined #openstack-cinder10:21
*** arnewiebalck_ has quit IRC10:27
*** stakeda has quit IRC10:29
*** isaacb has quit IRC10:41
*** abhinavtechie has joined #openstack-cinder10:48
*** abhinavtechie has quit IRC10:51
*** abhitechie has quit IRC10:52
*** edmondsw has joined #openstack-cinder11:25
*** edmondsw has quit IRC11:25
*** edmondsw has joined #openstack-cinder11:25
*** jwcroppe_ has quit IRC11:28
*** jwcroppe has joined #openstack-cinder11:29
openstackgerritVivek Soni proposed openstack/cinder master: 3PAR: Get host from os-brick  https://review.openstack.org/48210311:35
*** abhitechie has joined #openstack-cinder11:37
*** isaacb has joined #openstack-cinder11:43
*** danpawlik has quit IRC11:48
*** danpawlik has joined #openstack-cinder11:54
*** dave-mccowan has joined #openstack-cinder11:55
*** abishop has joined #openstack-cinder11:58
*** liverpooler has joined #openstack-cinder12:23
*** lhx__ has joined #openstack-cinder12:25
*** lhx_ has quit IRC12:26
dimssmcginnis : the latest os-brick release does not seem good - https://review.openstack.org/#/c/481129/12:26
dimsgeguileo : are you looking at it? i see a recheck from you12:27
geguileodims: yes, I've looked into it right now12:28
geguileodims: I've hit recheck because I believe this is not an os-brick problem12:28
dimsgeguileo : ack, please let me know. i issued several rechecks before and all ended up in failure (did not succeed even once)12:28
geguileodims: I'm checking the diff between 1.14 and 1.15 now, because it worked on 1.14 and I don't think we've changed anything that would break it12:29
geguileodims: Yes, I saw it  :-(12:29
geguileodims: After I check the delta between versions I'll write a comment with my findings12:29
geguileodims: Right now it looks like a problem between the portal-initiator-udev rules12:30
geguileodims: because wwn detection is timing out12:30
dimsgotcha geguileo12:30
geguileodims: thanks for following this closely  :-)12:31
*** lhx__ has quit IRC12:32
openstackgerritiswarya vakati proposed openstack/cinder master: Stop using deprecated 'message' attribute in Exception  https://review.openstack.org/48212512:35
*** zhurong has quit IRC12:36
*** jmlowe has quit IRC12:40
openstackgerritHelen Walsh proposed openstack/cinder master: VMAX driver - None connector object in a terminate_connection in Pike  https://review.openstack.org/48213012:55
openstackgerritArnon Yaari proposed openstack/cinder master: INFINIDAT: Add QoS support  https://review.openstack.org/48213212:56
openstackgerritArnon Yaari proposed openstack/cinder master: INFINIDAT: support for volume compression  https://review.openstack.org/46871513:02
*** catintheroof has joined #openstack-cinder13:04
*** lbragstad has joined #openstack-cinder13:08
openstackgerritGorka Eguileor proposed openstack/python-cinderclient master: Add service cleanup command  https://review.openstack.org/36300713:10
openstackgerritGorka Eguileor proposed openstack/python-cinderclient master: Add cluster support in migration and manage  https://review.openstack.org/38750013:10
openstackgerritGorka Eguileor proposed openstack/python-cinderclient master: Add cluster support in manage listings  https://review.openstack.org/38750113:10
openstackgerritHelen Walsh proposed openstack/cinder master: VMAX driver - seamless upgrade from SMI-S to REST  https://review.openstack.org/48213813:14
*** eharney has joined #openstack-cinder13:15
openstackgerritGorka Eguileor proposed openstack/python-cinderclient master: Dynamic log level support  https://review.openstack.org/44588613:16
*** abhitechie has quit IRC13:17
openstackgerritlihaijing proposed openstack/cinder master: Api-ref: add 'os-services' v3 api doc  https://review.openstack.org/47878913:22
sbezverkeharney: ping13:24
eharneysbezverk: hi13:24
sbezverkeharney : I am working on brining lioadm to kolla-k8s13:24
*** wxy- has joined #openstack-cinder13:25
*** dustins has joined #openstack-cinder13:25
eharneysbezverk: great13:25
eharneysbezverk: anything i can help with there?13:26
*** wxy- has quit IRC13:26
sbezverkand I got a bit of prgress, but hit a strange issue13:26
*** stvnoyes has joined #openstack-cinder13:26
eharneywhat are you seeing?13:27
sbezverkeharney : well I see targets gets created , but when I try to attach the volume to running instance I see authorization failure13:28
sbezverkI checked created targets and they do have authentication enabled13:28
sbezverkbut I do not see userid and password stored in the target definition..13:29
*** sdague has quit IRC13:30
sbezverkanother thing which is not done is allow generate_node_acls13:30
*** gcb has joined #openstack-cinder13:31
sbezverkbasically if I disable authentication and enable generate_node_acls then I can attach to target manually13:31
sbezverkusing iscsiadm13:31
*** belmorei_ has joined #openstack-cinder13:32
*** belmoreira has quit IRC13:32
*** sdague has joined #openstack-cinder13:33
*** arnewiebalck_ has joined #openstack-cinder13:33
eharneythe username and password should be in the volume's provider_location in the cinder db, and get added to the target during initialize_connection13:33
sbezverkeharney : if you have some time today I could setup a meeting to show you logs I collect, it looks like a bug to me13:33
eharneysbezverk: what OS are you trying this on?13:33
*** felipemonteiro has joined #openstack-cinder13:34
sbezverkeharney : centos13:34
*** zzzeek_ has quit IRC13:34
eharneysbezverk: with devstack?13:34
*** xyang1 has joined #openstack-cinder13:34
sbezverkeharney: no kolla-k8s13:34
eharneyah ok13:35
sbezverkeharney : when I create target manually and specify user/password I do see it in savetarget.json13:35
eharneysbezverk: you should see calls via rootwrap to "cinder-rtstool add-initiator" that set the password, are those in the cinder-volume log?13:35
*** felipemonteiro_ has joined #openstack-cinder13:36
sbezverkeharney : Yep I do see that in cinder-volume, what I do not see them saved somewhere on target side13:36
sbezverkif I do 'info' on target it should that authentication is 1 but no user name or password defined13:37
sbezverkit shows13:38
sbezverkso next call to attach fails because of authentication failure13:38
*** felipemonteiro has quit IRC13:39
eharneysbezverk: you'll also need to check whether the initiator's iqn passed to the "add-initiator" call matches that of the initiator13:40
sbezverkeharney: it does, I could see that iqn is the same between add-initiator and create target13:41
sbezverkeharney and there is still issue with generate_node_acls13:41
sbezverkeven if authentication will succeed then without it, authorization will fail..13:42
eharneyi'm looking at docs on that option now -- haven't used it before13:44
eharneyit's not clear to me why we'd want to use it13:45
sbezverkeharney : I noticed even when I disable authentication, I cannot attach manually, acl on target is empty and it denies everything13:47
eharneythe add_initiator method in Cinder's LIO target code should be creating ACLs on the TPG13:47
_pewp_hemna (*´・д・)ノ13:48
eharneycan you pastebin a full "targetcli ls" output when this is failing?13:49
hemnamornin13:49
openstackgerritIvan Kolodyazhny proposed openstack/cinder master: Do not fail if RBD image is broken  https://review.openstack.org/47540013:50
sbezverkeharney : http://paste.openstack.org/show/614919/13:51
sbezverkeharney : if you have some time later today I can do a live demonstration of the issue..13:54
*** jwcroppe has quit IRC13:59
eharneysbezverk: i'm not sure i understand enough about how kolla-k8s works for me to know what to look at there...14:00
eharneysbezverk: can you see what version of rtslib-fb you have?14:00
eharneyand is there some special handling for mounting configfs in this scenario?14:01
sbezverkeharney I would not ask you to look from kolla-k8s perspective ;) I would like you to validate from cinder perspective14:01
*** arnewiebalck_ has quit IRC14:02
*** superdan is now known as dansmith14:02
sbezverkeharney : python-rtslib-2.1.fb57-5.el7.noarch14:02
*** arnewiebalck_ has joined #openstack-cinder14:03
sbezverkeharney : for now the main issue is on the target side, I do not see any user/password saved.14:04
*** wxy- has joined #openstack-cinder14:04
sbezverkeharney : if you have working setup could you find where on the target side username and password are stored..14:06
*** lhx_ has joined #openstack-cinder14:06
eharneysbezverk: let me find one, i think they're supposed to be stored under tpg1/acls/ but that is empty in yours14:07
eharneysbezverk: can you get cinder-volume debug logs around initialize_connection?  (and probably nova-compute too)14:09
*** gouthamr has joined #openstack-cinder14:10
openstackgerritTuan Luong-Anh proposed openstack/python-cinderclient master: Switch from oslosphinx to openstackdocstheme  https://review.openstack.org/47966214:10
eharneysbezverk: i'd be up for looking at your system with you but i'm not sure i can today14:11
*** xyang has joined #openstack-cinder14:15
*** jdillaman has joined #openstack-cinder14:15
*** mriedem has joined #openstack-cinder14:15
*** jwcroppe has joined #openstack-cinder14:15
openstackgerritSean McGinnis proposed openstack/cinder-specs master: Implement policies in code  https://review.openstack.org/36155414:17
*** isaacb_ has joined #openstack-cinder14:22
*** isaacb has quit IRC14:24
openstackgerritChaynika Saikia proposed openstack/python-cinderclient master: Add cinder create --poll  https://review.openstack.org/47591914:24
*** chlong_ has joined #openstack-cinder14:24
sbezverkeharney : yep, one sec..14:25
*** pgadiya has quit IRC14:25
*** isaacb_ has quit IRC14:26
*** lkuchlan has quit IRC14:26
*** zzzeek_ has joined #openstack-cinder14:28
*** isaacb has joined #openstack-cinder14:28
*** psachin has quit IRC14:28
*** zhurong has joined #openstack-cinder14:29
sbezverkeharney : do you mind sharing your email? the log is large, it does not fit in paste bin..14:33
eharneysbezverk: sure, eharney@redhat.com14:33
sbezverkeharney : sent.. cinder-volume grepped for volume id and nova-compute14:37
*** lhx_ has quit IRC14:38
openstackgerritMerged openstack/cinder master: Migrate the blockstorage admin-guide to Cinder  https://review.openstack.org/48175014:40
*** chenying_ has quit IRC14:40
*** belmorei_ has quit IRC14:41
*** arnewiebalck_ has quit IRC14:42
*** Apoorva has joined #openstack-cinder14:43
*** zhangguoqing has quit IRC14:43
eharneysbezverk: can you confirm that iqn.1994-05.com.redhat:ca59ee3421ef matches /etc/iscsi/initiatorname.iscsi on the compute?14:44
sbezverkeharney : [root@kube-1 tools(keystone_admin)]$ docker exec -tu root 0444a2c99c03 cat /etc/iscsi/initiatorname.iscsi14:52
sbezverkInitiatorName=iqn.1994-05.com.redhat:ca59ee3421ef14:52
sbezverkeharney : this is from nova-compute container14:52
eharneysbezverk: does that container have an iscsid service in it too?14:53
sbezverkeharney there is another iscsi container which acts upon nova-compute requests14:55
eharneysbezverk: i'm wondering if that file was written after the iscsi service was started and it needs to be reloaded14:56
*** zhurong has quit IRC14:56
*** rcernin has quit IRC14:57
sbezverkeharney : initiator name for nova-compute and iscsd process do not need to match right?14:59
*** isaacb has quit IRC14:59
eharneysbezverk: nova compute reads that file to know what initiator iqn to send to Cinder -- if it doesn't match what's used in the running iscsid then the auth would fail14:59
*** zhonghua has quit IRC15:02
*** zhonghua has joined #openstack-cinder15:02
*** lhx_ has joined #openstack-cinder15:03
*** ircuser-1 has joined #openstack-cinder15:05
smcginnisgeguileo: We've had several rechecks on that UC patch. I don't think it's just a transient thing.15:06
sbezverkeharney: hmm, it looks like you are right I see authorization deny for iqn of iscsid contianer and not nova-compute15:06
geguileosmcginnis: I'm deploying now to try to test it15:06
smcginnisgeguileo: Great!15:07
eharneysbezverk: that makes sense15:07
geguileosmcginnis: It could be related to this new test https://review.openstack.org/#/c/472219/15:07
*** zhaochao has quit IRC15:07
geguileosmcginnis: because after that wwn discovery doesn't work15:07
sbezverkeharney : just curious why it worked with tgtd, there is no authentication with tgtd?15:08
smcginnisgeguileo: Always problems with encryption it seems.15:08
*** diablo_rojo has joined #openstack-cinder15:08
eharneysbezverk: i believe the auth there is only username/password and not username/password/iqn -- still does auth, just a weaker form of it15:09
sbezverkeharney: got it15:09
*** jessegler has joined #openstack-cinder15:10
openstackgerritYu Shengzuo proposed openstack/cinder master: Fix no feature to enable 'exclusive-lock' of image in ceph  https://review.openstack.org/48147215:15
*** wxy- has quit IRC15:15
*** chlong_ has quit IRC15:16
sbezverkeharney : one more thing, iqn used by cinder-volume and and iqn used by nova-compute/iscsi, should not be the same right?15:18
eharneysbezverk: they're the same only if using the same iscsi initiator (i.e. connecting from the same node)15:18
jgriffithsbezverk no, they are different nodes, different iqn's; unless you're sharing the iscsiadm container15:18
jgriffitheharney sorry, didn't mean to jump in; just interested in the thread here :)15:19
sbezverkeharney jgriffith each container where initiator tools are installed generate its own iqn15:20
*** markstur has joined #openstack-cinder15:20
sbezverkso we end up with 3 different iqn in kolla-k8s as we have 3 containers iscsd, cinder-volume and nova-compute15:21
jgriffithsbezverk ack15:21
eharneythat makes sense.  i guess the trick then is to figure out how to have nova know the iqn from the right iscsid container15:21
sbezverkeharney : I can make iscsid as a side car container for nova compute and then they will share iqn15:22
sbezverkbut that would not work if cinder-volume also needs it15:23
eharneysbezverk: cinder volume will also need to share it when doing things like connecting to download an image from glance to the volume15:23
SwansonAny storage vendors support FCoE for Cinder?15:23
jgriffithSwanson you need to leave NOW!15:23
smcginnis:)15:23
Swansonjgriffith, iSCSI fascist!15:23
jgriffithSwanson meeee?  No way, I like all kinds of SCSI, I and the other kind15:24
sbezverkeharney : but it does not have to be the same as nova-compute? I mean why would it have to be??15:24
eharneysbezverk: no, generally nova compute and cinder volumes will be on different "nodes" with different iqns15:25
eharneyi was referring to sharing between the c-vol and iscsid container15:25
sbezverkeharney : ok then side car solution might work.. I will give it a try today and let you know..15:25
* eharney wonders if we could use "qemu-img convert iscsi://" yet for those downloads15:27
jgriffitheharney that'd be nice to look at again; wouldn't remove the need for the iscsid for c-vol though15:28
*** chlong_ has joined #openstack-cinder15:30
openstackgerritHelen Walsh proposed openstack/cinder master: VMAX driver - Replication, replacing SMI-S with REST  https://review.openstack.org/46602715:30
openstackgerritYu Shengzuo proposed openstack/cinder master: Fix no feature to enable 'exclusive-lock' of image in ceph  https://review.openstack.org/48147215:36
*** isaacb has joined #openstack-cinder15:38
*** chenying_ has joined #openstack-cinder15:40
*** isaacb has quit IRC15:40
*** isaacb has joined #openstack-cinder15:41
*** e0ne has quit IRC15:41
openstackgerritHelen Walsh proposed openstack/cinder master: VMAX driver - Replication, replacing SMI-S with REST  https://review.openstack.org/46602715:45
openstackgerritHelen Walsh proposed openstack/cinder master: VMAX driver - Live Migration, replacing SMI-S with REST  https://review.openstack.org/47227915:51
openstackgerritHelen Walsh proposed openstack/cinder master: VMAX driver - implement Generic Volume Group feature  https://review.openstack.org/47454615:54
*** Apoorva has quit IRC15:55
*** Apoorva has joined #openstack-cinder15:56
openstackgerritHelen Walsh proposed openstack/cinder master: VMAX driver - bootable volume errors  https://review.openstack.org/47267416:00
*** Apoorva has quit IRC16:01
*** lhx_ has quit IRC16:03
openstackgerritHelen Walsh proposed openstack/cinder master: VMAX driver - None connector object in a terminate_connection in Pike  https://review.openstack.org/48213016:03
*** Julien-zte has quit IRC16:04
*** Julien-zte has joined #openstack-cinder16:05
*** Julien-zte has quit IRC16:05
*** Julien-zte has joined #openstack-cinder16:06
*** Julien-zte has quit IRC16:06
*** chlong_ has quit IRC16:06
*** Julien-zte has joined #openstack-cinder16:07
*** Julien-zte has quit IRC16:07
*** Julien-zte has joined #openstack-cinder16:07
*** Julien-zte has quit IRC16:07
openstackgerritHelen Walsh proposed openstack/cinder master: VMAX driver - seamless upgrade from SMI-S to REST  https://review.openstack.org/48213816:08
*** Julien-zte has joined #openstack-cinder16:08
*** Julien-zte has quit IRC16:08
*** Apoorva has joined #openstack-cinder16:08
*** Julien-zte has joined #openstack-cinder16:09
*** Julien-zte has quit IRC16:09
*** Apoorva has quit IRC16:10
*** Apoorva has joined #openstack-cinder16:10
*** Apoorva_ has joined #openstack-cinder16:11
openstackgerritHelen Walsh proposed openstack/cinder master: VMAX driver - seamless upgrade from SMI-S to REST  https://review.openstack.org/48213816:13
*** Apoorva has quit IRC16:14
*** isaacb has quit IRC16:16
Apoorva_dulek ping16:17
geguileosmcginnis: eharney I have reproduced the issue locally, and it's that test that breaks it16:19
*** chlong_ has joined #openstack-cinder16:21
Apoorva_dulek Tintri CI started failing with following error http://paste.openstack.org/show/614950/. Is it related to driver config option changes?16:22
smcginnisgeguileo: It's an issue with the test itself? Or the test puts things into a bad state?16:23
geguileosmcginnis: I'm trying to figure that out16:23
smcginnisgeguileo: OK, cool. Thanks for digging in to that.16:23
sbezverkeharney : you were right, when iqn for nova-compute and iscsid containers are the same, I can attach volume to the instance :) thank you very much!!!16:24
eharneysbezverk: excellent16:24
*** linlan has quit IRC16:26
*** linlan has joined #openstack-cinder16:27
openstackgerritHelen Walsh proposed openstack/cinder master: VMAX driver - Replication, replacing SMI-S with REST  https://review.openstack.org/46602716:29
*** harlowja has joined #openstack-cinder16:37
*** chlong_ has quit IRC16:38
*** jwcroppe has quit IRC16:39
*** jwcroppe has joined #openstack-cinder16:47
*** jwcroppe has quit IRC16:49
openstackgerritxing-yang proposed openstack/cinder master: Tiramisu: Add groups param to failover_host  https://review.openstack.org/47768816:49
*** xyang has quit IRC16:51
openstackgerritSean McGinnis proposed openstack/cinder master: Test: Disable API v2  https://review.openstack.org/48221316:52
*** xyang1 has quit IRC16:59
*** tesseract has quit IRC17:01
openstackgerritSean McGinnis proposed openstack/cinder master: Test: Disable API v2  https://review.openstack.org/48221317:05
*** xyang1 has joined #openstack-cinder17:09
openstackgerritMerged openstack/cinder master: IBM Storage: Fix for misidentification of QoS type  https://review.openstack.org/47742417:19
*** jessegler has quit IRC17:24
*** lpetrut has quit IRC17:26
*** dustins has quit IRC17:33
*** MVenesio has joined #openstack-cinder17:47
*** gnufied has joined #openstack-cinder17:55
*** jmlowe has joined #openstack-cinder17:58
*** dmellado has quit IRC18:02
*** dmellado has joined #openstack-cinder18:02
*** lpetrut has joined #openstack-cinder18:15
*** diablo_rojo has quit IRC18:18
*** diablo_rojo has joined #openstack-cinder18:20
openstackgerritHelen Walsh proposed openstack/cinder master: VMAX driver - Live Migration, replacing SMI-S with REST  https://review.openstack.org/47227918:29
*** anish_ is now known as anish18:30
openstackgerritHelen Walsh proposed openstack/cinder master: VMAX driver - implement Generic Volume Group feature  https://review.openstack.org/47454618:32
*** ChubYann has joined #openstack-cinder18:34
*** lpetrut has quit IRC18:35
*** lpetrut has joined #openstack-cinder18:42
*** dustins has joined #openstack-cinder18:55
openstackgerritMerged openstack/python-cinderclient master: Dynamic log level support  https://review.openstack.org/44588618:58
patrickeastApoorva_: yea thats related to the config changes, you can't be looking in the "DEFAULT" section for driver options anymore, instead of CONF.whatever use the configuration object passed in by the volume manager when it initializes the driver19:00
*** arnewiebalck_ has joined #openstack-cinder19:02
*** xyang has joined #openstack-cinder19:03
*** liverpooler has quit IRC19:06
*** liverpooler has joined #openstack-cinder19:11
Apoorva_thanks patrickeast. So in my case instead of CONF.<whatever> will be self.configuration.<whatever>?19:11
patrickeastApoorva_: yep19:11
Apoorva_patrickeast thanks!19:13
*** jbernard has quit IRC19:13
*** jbernard has joined #openstack-cinder19:13
*** jmlowe has quit IRC19:14
*** arnewiebalck_ has quit IRC19:19
openstackgerritHelen Walsh proposed openstack/cinder master: VMAX driver - bootable volume errors  https://review.openstack.org/47267419:23
openstackgerritHelen Walsh proposed openstack/cinder master: VMAX driver - None connector object in a terminate_connection in Pike  https://review.openstack.org/48213019:27
openstackgerritHelen Walsh proposed openstack/cinder master: VMAX driver - seamless upgrade from SMI-S to REST  https://review.openstack.org/48213819:30
*** eharney has quit IRC19:39
*** jessegler has joined #openstack-cinder19:42
*** xyang has quit IRC19:49
*** e0ne has joined #openstack-cinder19:49
*** edmondsw_ has joined #openstack-cinder19:53
*** eharney has joined #openstack-cinder19:54
*** edmondsw has quit IRC19:56
*** edmondsw has joined #openstack-cinder19:57
*** edmondsw_ has quit IRC19:59
*** markstur_ has joined #openstack-cinder20:00
*** xyang has joined #openstack-cinder20:01
*** markstur has quit IRC20:03
*** liverpooler has quit IRC20:04
*** gnufied has quit IRC20:10
*** dfisher has joined #openstack-cinder20:12
dfisherhey folks … I've got some 3rd-party CI questions20:13
patrickeastsure, whats up?20:14
dfisheri'm working on trying to get the Oracle ZFSSA CI functional.  I'm trying to move the entire thing to a whole new rig with much more recent hardware.  anyway, running the volume tests ends up with about a dozen failures.  I know I can use the —regex flag to prevent tempest from running those tests20:14
*** e0ne has quit IRC20:15
dfishersome of the other 3PCI rigs do this20:15
dfisherso I assume that's mostly ok20:15
dfisherhow does the cinder community feel about having the CI system manually re-run individual failing tests and glomming those results on?  When I run the 200+ volume tests, I sometimes get 3 tests which fail.  If I go back and re-run those 3 tests individually, they succeed every time.20:16
hemnaautomatically running tests that failed is a recipe to just eating up resources20:17
hemnawe fail more than we pass :P20:17
dfisherwhen I say "manually", I mean, have a script which reads the output from tempest, find the failing tests, re-run them and record their output20:17
dfishernot that we'd hire an intern to watch the queue :)20:17
hemnawe are actually trying to cut down on the # of 3rd party CI runs20:17
*** lpetrut has quit IRC20:17
dfisherthe ZFSSA 3PCI has been a disaster for months now.20:18
hemnayah....20:18
dfisherthe old team in charge of it has had to move it to the back burner for other projects.20:18
dfishernow it's on my team.20:18
dfisherfor that, I apologize.20:18
dfisheri'm *trying* to get it fixed but tempest, devstack, cinder, the zfssa driver …e verything … can be so incredibly flakey20:18
*** arnewiebalck_ has joined #openstack-cinder20:19
dfisherso, ok, coming back to the top .. it's usually the same 3 tests that fail due to timing issues in the driver20:19
dfishershould I just turn those tests off until I can get them fixed in the driver code?20:19
dfisherI still get > 200 tests run.20:19
smcginnisdfisher: Sounds like it's maybe pointing out a legitimate issue in the driver though.20:20
hemnawell, if  you know they are failing for a reason but are working on it, you can simply disable the CI and update the wiki saying "working through CI failures...."20:20
dfisherso, we have a chicken and egg problem here.20:20
smcginnisdfisher: Maybe you need to add some locking for certain operations?20:20
dfisherit's likely, yes20:21
dfisherso I can't get driver fixes into the gate … without the driver fixes.20:21
dfisherbecause the tests fail20:21
smcginnisdfisher: You can also set the test run concurrency to 1 to basically serialize everything.20:21
dfishersmcginnis: it already is :(20:21
smcginnisdfisher: Which of course takes a little longer, but... oh?20:21
dfisheryeah.20:21
smcginnisdfisher: Seems odd you would get failures like that then.20:21
openstackgerritApoorva Deshpande proposed openstack/cinder master: Accessing driver config options  https://review.openstack.org/48227820:21
dfisherit's the driver, not tempest.20:21
scottdaMaybe something is not getting cleaned up properly20:22
dfisherthings like this:20:22
dfisherif you have a volume (v1) and you snapsnot (s1) and make a volume (v2) from s120:22
dfisherif you delete v220:22
dfisherwe're fine20:22
dfisherif you try to delete v1, the driver errors, because of the existence of s120:22
dfisherif you delete s1 before v1, there's a race condition20:22
smcginnisdfisher: You can't mark volumes for deletion like that?20:23
dfisherin that *sometimes* v1 is ok to be deleted because s1 is gone.  sometimes not.20:23
hemnayah that's how almost all cinder drivers work afaik20:23
dfisherit's a ZFS-ism20:23
dfishernot cinder.20:23
dfishernot tempest.20:23
hemnaI think the volume manager prevents you from deleting volumes that have snapshots20:23
smcginnisI think ceph had/has the same issue.20:23
dfisheralso, my team just inherited all this work.20:23
dfisherso, we're all trying to come up to speed on these 2 drivers (iscsi and nfs)20:23
*** gnufied has joined #openstack-cinder20:24
hemnanfs, the filesystem that just can't die20:24
smcginnisdfisher: Well, sounds like some things to look in to. But for the time being, I'm thinking it may be best if you do just skip those tests so there's at least some good coverage for the rest of it.20:24
dfisherthe major issue we have is that there are ZFSSA driver patches in flight that simply can not land because the existing code base has broken stuff.20:24
smcginnisdfisher: Then try to work through the issues with that to be able to unskip them in the hopefully near future.20:24
dfisherhttps://review.openstack.org/351413 and https://review.openstack.org/37119920:25
dfishersmcginnis, ok.  I can do this.  Our team is trying very hard to get this stuff fixed but there have been some … changes … here at Oracle WRT priority.20:26
smcginnisdfisher: Yeah... thanks for working on it. Mostly covered is better than not covered at all at this point. :)20:27
dfisheri know.  i know this makes Oracle look bad (well, no better than normal … /sigh) but we're trying to do the right thing.20:27
dfisherat least I've got the run time down from hours to about 30 minutes.20:28
smcginnisdfisher: Yeah, looks like you are at least trying, so that's worth a lot to me.20:29
*** nicolasbock has quit IRC20:34
smcginnisdfisher: Oh, remembered one other optimization a lot of CI maintainers skip for some reason.20:37
smcginnisdfisher: You don't have to run tests against a patch until Jenkins gives a +1.20:38
smcginnisdfisher: I see a lot of wasted time running CI against patches that don't even pass Jenkins.20:38
dfisherhmm. ok20:38
dfisheryeah, i'll have to look at how to read the gerrit stream20:39
dfisherfor that20:39
dfisheri'm going the jenkins route20:39
*** lpetrut has joined #openstack-cinder20:40
openstackgerritApoorva Deshpande proposed openstack/cinder master: Accessing driver config options  https://review.openstack.org/48227820:43
*** arnewiebalck_ has quit IRC20:44
*** lpetrut has quit IRC20:47
*** abishop has quit IRC20:50
*** wN has joined #openstack-cinder20:51
*** wN has quit IRC20:51
*** wN has joined #openstack-cinder20:51
*** catintheroof has quit IRC20:53
*** MVenesio has quit IRC20:53
*** lpetrut has joined #openstack-cinder20:54
dfishersmcginnis: looking at the raw gerrit stream … there's nothing here about jenkins.  would it be a separate query ?21:01
smcginnisdfisher: You need to watch for event['change']['project'] == 'cinder' and event['author'] == 'jenkins' and event['comment'] == 'Verified+1'21:03
smcginnisdfisher: I forget how you do that with the Jenkins CI setup.21:04
dfisherk21:04
dfisheri can poke.21:04
dfisherthanks.21:04
smcginnisdfisher: Maybe just something to put on the list for a future optimization.21:04
dfisherwell, in theory, the ssh CLI has a query mode.21:05
dfisherjust gotta figure out the proper mojo21:05
*** eharney has quit IRC21:13
dfishersmcginnis: i think it's something close to:21:13
dfisherssh review-openstack gerrit query --current-patch-set --format text project:openstack/cinder change:I7e0d9cc382a75148ecd53c48f8b2e4e69a68163c reviewer:Jenkins21:13
dfisherobv. change:<XYZ> is per commit21:13
dfisherand —format text should be —format json + parsing.21:14
dfisherala: http://paste.openstack.org/show/614965/21:15
*** gary-smith has joined #openstack-cinder21:24
*** gary-smith has left #openstack-cinder21:25
*** zzzeek_ has quit IRC21:37
*** zzzeek_ has joined #openstack-cinder21:40
mriedemjgriffith: am i understanding your request correctly here? https://review.openstack.org/#/c/454287/21/cinder/volume/api.py@129221:40
openstackgerritApoorva Deshpande proposed openstack/cinder master: Tintri: Fix config option access  https://review.openstack.org/48227821:45
*** xyang has quit IRC21:51
*** xyang has joined #openstack-cinder21:56
*** lpetrut has quit IRC21:58
*** dustins has quit IRC22:03
*** xyang1 has quit IRC22:07
*** gheorghe_ has joined #openstack-cinder22:08
*** dillaman has joined #openstack-cinder22:14
*** deep-book-gk_ has joined #openstack-cinder22:18
*** dillaman has quit IRC22:19
*** deep-book-gk_ has left #openstack-cinder22:20
*** xyang has quit IRC22:20
*** felipemonteiro_ has quit IRC22:22
*** dfisher has quit IRC22:31
*** zzzeek_ has quit IRC22:32
*** catintheroof has joined #openstack-cinder22:43
*** Julien-zte has joined #openstack-cinder22:43
*** zzzeek_ has joined #openstack-cinder22:50
*** markstur_ has quit IRC22:52
gheorghe_https://paste.gnome.org/pvaoufykr22:56
gheorghe_gnome generated that link so that I don't spam irc, lol. the question is there: can anybody please help me understand why cinder.conf is configure with an IP address and the services use another IP address?22:57
*** Julien-zte has quit IRC23:04
*** Julien-zte has joined #openstack-cinder23:06
*** takedakn has joined #openstack-cinder23:07
*** markstur has joined #openstack-cinder23:19
*** edmondsw has quit IRC23:40
*** wanghao has quit IRC23:52
*** wanghao has joined #openstack-cinder23:53
*** takedakn has quit IRC23:55
openstackgerritKendall Nelson proposed openstack/cinder-specs master: Update Dynamic Reconfig Spec  https://review.openstack.org/44613223:56
*** bkopilov has quit IRC23:57
*** catintheroof has quit IRC23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!