Monday, 2017-11-20

*** stakeda has joined #openstack-cinder00:06
*** salv-orlando has quit IRC00:14
*** wanghao has joined #openstack-cinder00:19
*** wanghao has quit IRC00:19
*** wanghao has joined #openstack-cinder00:20
*** wN has joined #openstack-cinder00:22
*** wN has quit IRC00:22
*** wN has joined #openstack-cinder00:22
*** Apoorva has joined #openstack-cinder00:24
*** wanghao has quit IRC00:34
*** wanghao has joined #openstack-cinder00:34
*** itlinux has quit IRC00:37
*** Apoorva has quit IRC00:45
*** Apoorva has joined #openstack-cinder00:46
*** Apoorva_ has joined #openstack-cinder00:48
*** Apoorva has quit IRC00:52
*** junboli has joined #openstack-cinder00:52
*** itlinux has joined #openstack-cinder00:56
*** itlinux has quit IRC01:06
*** Anticimex has quit IRC01:14
*** salv-orlando has joined #openstack-cinder01:15
*** Anticimex has joined #openstack-cinder01:15
*** Apoorva_ has quit IRC01:24
*** dhinesh has joined #openstack-cinder01:27
*** itlinux has joined #openstack-cinder01:30
*** abishop has quit IRC01:30
*** moshele has joined #openstack-cinder01:34
*** moshele has quit IRC01:39
*** dhinesh has quit IRC01:40
*** dhinesh has joined #openstack-cinder01:41
*** lbragstad has joined #openstack-cinder01:45
*** salv-orlando has quit IRC01:49
*** zhaochao has joined #openstack-cinder01:49
*** zengyingzhe has quit IRC01:50
*** gcb has joined #openstack-cinder01:52
tommylikehuwinston-d: pong, sure! will ping you when I upload the patch:)02:02
*** moshele has joined #openstack-cinder02:04
*** armax has joined #openstack-cinder02:07
*** zengyingzhe has joined #openstack-cinder02:10
*** dalgaaf has quit IRC02:33
*** dalgaaf has joined #openstack-cinder02:33
*** armax has quit IRC02:42
openstackgerritXiaojun Liao proposed openstack/cinder master: Fix v3 api-ref for restoring backup are wrongly described  https://review.openstack.org/52037502:44
*** salv-orlando has joined #openstack-cinder02:46
*** moshele has quit IRC03:18
*** akekane has joined #openstack-cinder03:29
*** akekane is now known as abhishekk03:30
*** dave-mccowan has quit IRC03:39
*** armax has joined #openstack-cinder03:48
*** rcernin has quit IRC03:50
*** rcernin has joined #openstack-cinder03:52
*** psachin has joined #openstack-cinder04:03
*** links has joined #openstack-cinder04:13
*** abhitechie has joined #openstack-cinder04:22
*** yangyapeng has joined #openstack-cinder04:26
*** gmann is now known as gmann_lunch04:35
*** pgadiya has joined #openstack-cinder05:13
*** pgadiya has quit IRC05:13
*** sticker has quit IRC05:35
*** eharney has quit IRC05:35
*** rcernin has quit IRC05:38
*** moshele has joined #openstack-cinder05:51
openstackgerritXiaojun Liao proposed openstack/cinder master: Fix v3 api-ref for restoring backup are wrongly described  https://review.openstack.org/52037505:51
*** kwathore_ has joined #openstack-cinder05:53
*** kwathore has quit IRC05:53
*** maestropandy has joined #openstack-cinder05:56
*** threestrands has quit IRC06:03
*** wanghao_ has joined #openstack-cinder06:13
*** wanghao has quit IRC06:17
*** eharney has joined #openstack-cinder06:19
*** gouthamr has quit IRC06:20
*** msno has joined #openstack-cinder06:23
msnocan someone help me in https://ask.openstack.org/en/question/111203/cinder-backup-create-failing-in-openstack-liberty/?answer=111211#post-id-11121106:24
*** lpetrut has joined #openstack-cinder06:27
*** youzp has joined #openstack-cinder06:37
*** salv-orlando has quit IRC06:37
*** salv-orlando has joined #openstack-cinder06:38
*** hoonetorg has quit IRC06:41
*** hoonetorg has joined #openstack-cinder06:54
*** e0ne has joined #openstack-cinder06:55
*** gouthamr has joined #openstack-cinder06:55
*** dhinesh has quit IRC07:00
*** maestropandy has quit IRC07:01
openstackgerritTommyLike proposed openstack/cinder master: Handle quota in 2 phases when managing resource.  https://review.openstack.org/52104407:08
*** lpetrut has quit IRC07:08
*** lpetrut has joined #openstack-cinder07:08
openstackgerritTommyLike proposed openstack/cinder master: Handle quota in 2 phases when managing resource  https://review.openstack.org/52104407:10
*** lpetrut has quit IRC07:14
*** itlinux has quit IRC07:15
*** youzp has quit IRC07:21
*** youzp has joined #openstack-cinder07:22
*** lpetrut has joined #openstack-cinder07:22
*** gcb has quit IRC07:25
*** gcb has joined #openstack-cinder07:26
*** abhitechie has quit IRC07:32
*** abhitechie has joined #openstack-cinder07:32
*** lkuchlan has joined #openstack-cinder07:34
*** nsingh has quit IRC07:35
*** nsingh has joined #openstack-cinder07:35
*** abhitechie has quit IRC07:37
*** abhishekk is now known as abhishekk|lunch07:37
*** belmoreira has joined #openstack-cinder07:38
*** AlexeyAbashkin has joined #openstack-cinder07:47
*** maestropandy has joined #openstack-cinder07:48
*** e0ne has quit IRC07:48
*** youzp_ has joined #openstack-cinder07:49
*** youzp_ has quit IRC07:50
*** youzp has quit IRC07:50
*** youzp has joined #openstack-cinder07:50
*** lpetrut has quit IRC07:53
*** maestropandy has quit IRC07:58
*** haobing has joined #openstack-cinder07:59
*** dhinesh has joined #openstack-cinder08:01
*** youzp_ has joined #openstack-cinder08:03
*** pcaruana has joined #openstack-cinder08:04
*** niraj_singh has joined #openstack-cinder08:05
*** nsingh has quit IRC08:05
*** dhinesh has quit IRC08:06
*** youzp has quit IRC08:08
*** kwathore_ has quit IRC08:08
*** josecastroleon has joined #openstack-cinder08:08
*** kwathore has joined #openstack-cinder08:08
*** youzp_ has quit IRC08:10
*** alexchadin has joined #openstack-cinder08:11
*** alexchadin has quit IRC08:16
*** alexchadin has joined #openstack-cinder08:17
*** alexchadin has quit IRC08:19
*** danpawlik has quit IRC08:19
*** alexchadin has joined #openstack-cinder08:19
*** gouthamr has quit IRC08:25
*** gkadam has joined #openstack-cinder08:26
*** ircuser-1 has joined #openstack-cinder08:28
*** amoralej|off is now known as amoralej08:38
*** abhishekk|lunch is now known as abhishekk08:39
*** maestropandy has joined #openstack-cinder08:39
*** salv-orlando has quit IRC08:42
*** gmann_lunch is now known as gmann08:42
*** salv-orlando has joined #openstack-cinder08:43
*** salv-orlando has quit IRC08:47
openstackgerritTommyLike proposed openstack/cinder master: Try Fetching value from 'cluster' when raise exception  https://review.openstack.org/52145908:48
openstackgerritMerged openstack/cinder master: Remove setting of version/release from releasenotes  https://review.openstack.org/52063808:53
*** belmoreira has quit IRC08:58
*** salv-orlando has joined #openstack-cinder08:58
*** e0ne has joined #openstack-cinder09:05
*** spectr has joined #openstack-cinder09:07
*** spectr has quit IRC09:07
*** spectr has joined #openstack-cinder09:11
*** spectr has quit IRC09:12
*** hoonetorg has quit IRC09:13
*** wanghao_ has quit IRC09:14
openstackgerritMerged openstack/cinder master: NetApp E-series: Fix provisioned_capacity_gb  https://review.openstack.org/51840609:17
*** danpawlik has joined #openstack-cinder09:18
*** wanghao has joined #openstack-cinder09:24
*** wanghao_ has joined #openstack-cinder09:25
*** wanghao_ has quit IRC09:28
*** wanghao_ has joined #openstack-cinder09:28
*** wanghao_ has quit IRC09:28
*** wanghao has quit IRC09:28
*** wanghao has joined #openstack-cinder09:29
*** wanghao has quit IRC09:29
*** wanghao has joined #openstack-cinder09:29
*** wanghao has quit IRC09:30
*** wanghao has joined #openstack-cinder09:30
*** wanghao has quit IRC09:31
*** wanghao has joined #openstack-cinder09:31
*** lkuchlan has quit IRC09:32
*** wanghao has quit IRC09:32
*** wanghao has joined #openstack-cinder09:32
*** wanghao has quit IRC09:33
*** wanghao has joined #openstack-cinder09:33
openstackgerritMerged openstack/os-brick master: Remove setting of version/release from releasenotes  https://review.openstack.org/52064709:33
*** wanghao has quit IRC09:33
*** wanghao has joined #openstack-cinder09:34
*** junboli has quit IRC09:34
*** wanghao has quit IRC09:34
*** gmann is now known as gmann_afk09:37
*** lkuchlan has joined #openstack-cinder09:44
*** maestropandy has quit IRC09:44
*** maestropandy has joined #openstack-cinder09:46
*** lpetrut has joined #openstack-cinder09:50
*** e0ne has quit IRC09:52
*** belmoreira has joined #openstack-cinder09:52
*** lkuchlan_ has joined #openstack-cinder09:53
*** e0ne has joined #openstack-cinder09:54
*** lkuchlan has quit IRC09:56
*** lpetrut has quit IRC09:56
*** kwathore has quit IRC10:05
*** maestropandy has quit IRC10:08
*** lpetrut has joined #openstack-cinder10:13
openstackgerritMerged openstack/cinder master: SMBFS: Enable reverting snapshots  https://review.openstack.org/51254510:14
*** kwathore has joined #openstack-cinder10:15
*** maestropandy has joined #openstack-cinder10:37
*** maestropandy has quit IRC10:47
openstackgerritLucian Petrut proposed openstack/cinder master: SMBFS: manageable volumes  https://review.openstack.org/52115810:50
*** abhishekk has quit IRC10:53
openstackgerritlihaijing proposed openstack/cinder master: Add unmanage_snapshot method for RBD driver  https://review.openstack.org/52148611:00
*** lkuchlan_ has quit IRC11:10
*** moshele has quit IRC11:13
*** haobing has quit IRC11:15
*** haobing has joined #openstack-cinder11:16
*** belmoreira has quit IRC11:21
*** gcb has quit IRC11:24
*** alexchadin has quit IRC11:28
openstackgerritCiara Stacke proposed openstack/cinder master: VMAX driver - Fix error handling and checks for generic volume groups  https://review.openstack.org/52108011:30
*** openstackgerrit has quit IRC11:32
*** maestropandy has joined #openstack-cinder11:38
*** maestropandy has left #openstack-cinder12:00
*** moshele has joined #openstack-cinder12:00
*** belmoreira has joined #openstack-cinder12:06
*** lkuchlan_ has joined #openstack-cinder12:24
*** sdague has joined #openstack-cinder12:28
*** links has quit IRC12:31
*** takedakn has joined #openstack-cinder12:50
*** haobing has quit IRC12:52
*** josecastroleon has quit IRC12:59
*** salv-orlando has quit IRC12:59
*** gcb has joined #openstack-cinder12:59
*** salv-orlando has joined #openstack-cinder13:00
*** salv-orlando has quit IRC13:04
*** abishop has joined #openstack-cinder13:07
*** alexchadin has joined #openstack-cinder13:13
*** openstackgerrit has joined #openstack-cinder13:15
openstackgerritzhangchangfeng proposed openstack/cinder master: [WIP] Fix wrong quota deduction when concurrent deletion for volumes which host is None.  https://review.openstack.org/52136413:15
*** lhx_ has joined #openstack-cinder13:15
*** josecastroleon has joined #openstack-cinder13:16
*** links has joined #openstack-cinder13:18
*** liverpooler has joined #openstack-cinder13:22
*** markvoelker has quit IRC13:23
*** markvoelker has joined #openstack-cinder13:24
*** gnufied has joined #openstack-cinder13:24
*** dhinesh has joined #openstack-cinder13:28
*** dpawlik has joined #openstack-cinder13:29
*** danpawlik has quit IRC13:30
*** takedakn has quit IRC13:31
*** dhinesh has quit IRC13:33
*** dave-mccowan has joined #openstack-cinder13:36
*** dave-mcc_ has joined #openstack-cinder13:46
*** dave-mccowan has quit IRC13:48
*** josecastroleon has quit IRC13:56
*** yangyapeng has quit IRC13:59
*** salv-orlando has joined #openstack-cinder13:59
*** eharney has quit IRC14:00
*** lkuchlan_ has quit IRC14:04
*** ik__ has joined #openstack-cinder14:06
ik__How do we generally debug cinder services?14:06
*** schmots has joined #openstack-cinder14:06
ik__I was trying to debug through Pycharm's remote debugger, but it fails to start. Not sure what I'm missing.14:07
smcginnisik__: You can use pdb. Or print statements can go a long way.14:07
smcginnisik__: I haven't used the pycharm remote debugging myself, but I know others have successfully.14:08
ik__smcginnis: Hmm. Old school until others offer their help.14:08
smcginnis;)14:09
ik__smcginnis: Any idea if they had to do any changes with the way service starts? :)14:09
e0neik__: I didn't use pycharm. rpd/rpdb works good for me14:09
ik__e0ne: rpdb, remote pdb? which ide do you use at the other end? any project configuration I can quickly put to use?14:13
openstackgerritLucian Petrut proposed openstack/cinder master: SMBFS: manageable volumes  https://review.openstack.org/52115814:13
e0neik__: it's like pdb, but works for (remote) services too. I use vim and submlime only14:13
*** mriedem has joined #openstack-cinder14:14
*** josecastroleon has joined #openstack-cinder14:14
ik__e0ne: Ah, okay. I've sublime too. Let me checkout rpdb, but the question is still open if anyone can help with remote debugging through pycharm.14:15
*** liverpoo1er has joined #openstack-cinder14:16
*** liverpoo1er has quit IRC14:16
*** shvepsy_ has joined #openstack-cinder14:17
*** bkopilov has quit IRC14:19
*** shvepsy has quit IRC14:19
*** bkopilov has joined #openstack-cinder14:22
*** yangyapeng has joined #openstack-cinder14:24
*** yangyapeng has quit IRC14:29
*** gouthamr has joined #openstack-cinder14:32
*** josecastroleon has quit IRC14:32
*** alexchadin has quit IRC14:32
*** belmoreira has quit IRC14:34
*** dhinesh has joined #openstack-cinder14:35
*** ik__ has quit IRC14:41
*** yangyapeng has joined #openstack-cinder14:42
*** yangyapeng has quit IRC14:46
*** dhinesh has quit IRC14:48
*** bkopilov has quit IRC14:54
*** eharney has joined #openstack-cinder14:55
*** KeithMnemonic has joined #openstack-cinder14:57
openstackgerritSean McGinnis proposed openstack/cinder master: Suppress UT log messages  https://review.openstack.org/52155514:59
*** lkuchlan_ has joined #openstack-cinder15:00
*** links has quit IRC15:01
*** yangyapeng has joined #openstack-cinder15:04
*** dave-mcc_ is now known as dave-mccowan15:06
*** gcb has quit IRC15:08
*** yangyapeng has quit IRC15:08
openstackgerritTommyLike proposed openstack/cinder master: Try Fetching value from 'cluster' when raise exception  https://review.openstack.org/52145915:09
*** links has joined #openstack-cinder15:13
openstackgerritSean McGinnis proposed openstack/cinder master: Suppress UT log messages  https://review.openstack.org/52155515:16
*** moshele has quit IRC15:18
*** yangyapeng has joined #openstack-cinder15:24
*** abhitechie has joined #openstack-cinder15:26
*** links has quit IRC15:27
*** yangyapeng has quit IRC15:28
*** edmondsw has joined #openstack-cinder15:47
*** schmots_ has joined #openstack-cinder15:48
*** dhinesh has joined #openstack-cinder15:49
*** schmots has quit IRC15:50
*** schmots_ is now known as schmots15:50
*** mvk has quit IRC15:51
*** dhinesh has quit IRC15:54
*** hoonetorg has joined #openstack-cinder15:59
*** itlinux has joined #openstack-cinder15:59
*** jmlowe has joined #openstack-cinder16:00
smcginnismtreinish: That seems very odd to me that you don't get the failure.16:09
smcginnismtreinish: jgriffith and I both were seeing the failure due to large amounts of log output during the test.16:09
smcginnismtreinish: And removing that output would then get it to pass.16:09
mtreinishsmcginnis: I got it to fail by looping the test with --until-failure16:11
mtreinishbut it wasn't a 100% thing16:11
smcginnismtreinish: Mine was 100% on that.16:11
smcginnismtreinish: How much ram do you have?16:11
mtreinishin my laptop 16GB16:12
smcginnisOK, me too. Was just a hunch.16:12
mtreinishit could be because I'm using py36 instead of 35 (I don't have 35 installed locally)16:13
smcginnismtreinish: And wouldn't you know, now I'm not getting the output and it's passing for me.16:15
smcginnismtreinish: But that is really odd, since I should be getting some output from those log.errors.16:15
*** josecastroleon has joined #openstack-cinder16:23
mtreinishsmcginnis: I'm on my desktop now and running it with --until-failure and can't get it to fail at all (it's at 110 iterations already)16:23
smcginnismtreinish: Probably no point in looping until failure. It should fail immediately.16:24
smcginnismtreinish: Trying to understand now why it's no longer capturing that log output.16:24
*** AlexeyAbashkin has quit IRC16:25
mtreinishthis bug is evil...16:25
smcginnisWe've seen some wonkiness with self.flags(fatal_exception_format_errors=False)16:25
smcginnisIt appears that maybe it's actually working now, where it wasn't last week. Maybe?16:25
*** lkuchlan_ has quit IRC16:26
smcginnisNo, that's not it...16:26
eharneysmcginnis: i can't get your test case on 521201 to produce a failure on my machine with the single test16:28
*** josecastroleon has quit IRC16:28
smcginniseharney: I can't either now. And I'm not getting the log output that the test should be generating (which is what causes the failure).16:29
smcginnisSo somehow now, LOG.exception is getting magically suppressed, so it doesn't accumulate the test log output and doesn't fail.16:30
eharneysmcginnis: it just failed for me running ExceptionTestCase instead of running it with just that one test name16:34
smcginniseharney: Did you get a lot of captured log output from missing formatting args?16:35
*** pcaruana has quit IRC16:35
*** josecastroleon has joined #openstack-cinder16:36
*** moshele has joined #openstack-cinder16:36
*** salv-orlando has quit IRC16:38
*** salv-orlando has joined #openstack-cinder16:39
*** moshele has quit IRC16:41
*** psachin has quit IRC16:43
*** salv-orlando has quit IRC16:43
*** Apoorva has joined #openstack-cinder16:44
openstackgerritLucian Petrut proposed openstack/cinder master: SMBFS: manageable volumes  https://review.openstack.org/52115816:48
*** Apoorva has quit IRC16:51
*** ntpttr_laptop has joined #openstack-cinder16:51
*** itlinux has quit IRC16:53
*** Apoorva has joined #openstack-cinder16:53
*** itlinux has joined #openstack-cinder16:54
*** armax has quit IRC16:59
*** Apoorva has quit IRC17:15
*** hemna_ has quit IRC17:17
*** gkadam has quit IRC17:17
*** hemna_ has joined #openstack-cinder17:17
*** lhx_ has quit IRC17:19
*** lpetrut has quit IRC17:23
*** dhinesh has joined #openstack-cinder17:28
eharneysmcginnis: yes17:33
*** armax has joined #openstack-cinder17:36
*** edmondsw has quit IRC17:37
*** edmondsw has joined #openstack-cinder17:38
eharneytommylikehu: do you recall the reason for this change?  https://review.openstack.org/#/c/506976/8/cinder/test.py17:39
*** bkopilov has joined #openstack-cinder17:39
*** salv-orlando has joined #openstack-cinder17:39
eharneylooks odd to no longer be setting cleanup for overridden conf values... which is used for fatal_exception_format_errors ^17:39
eharneysmcginnis: that may explain at least part of the fatal_exception_format_errors wonkiness17:41
smcginniseharney: Yeah, didn't notice at the time reviewing that patch, but that doesn't seem right.17:41
*** edmondsw has quit IRC17:42
*** moshele has joined #openstack-cinder17:42
*** ntpttr_laptop has quit IRC17:42
*** ntpttr_laptop__ has joined #openstack-cinder17:42
smcginniseharney: Should be easy enough to change that back to self.override_config17:42
*** yangyapeng has joined #openstack-cinder17:43
*** Apoorva has joined #openstack-cinder17:44
*** salv-orlando has quit IRC17:45
*** Apoorva has quit IRC17:45
*** yangyapeng has quit IRC17:50
*** Apoorva has joined #openstack-cinder17:50
*** msno has quit IRC17:51
*** ntpttr_laptop__ has quit IRC17:52
*** Apoorva_ has joined #openstack-cinder17:59
*** pcaruana has joined #openstack-cinder18:00
openstackgerritGoutham Pacha Ravi proposed openstack/cinder master: NetApp ONTAP: Fix delayed snapshot deletion call  https://review.openstack.org/52161618:02
*** Apoorva has quit IRC18:02
openstackgerritEric Harney proposed openstack/cinder master: Fix TestCase.flags()  https://review.openstack.org/52161918:07
*** yangyapeng has joined #openstack-cinder18:12
*** moshele has quit IRC18:14
*** yangyapeng has quit IRC18:17
*** lpetrut has joined #openstack-cinder18:29
*** yangyapeng has joined #openstack-cinder18:31
*** yangyapeng has quit IRC18:34
*** Apoorva_ has quit IRC18:35
*** Apoorva has joined #openstack-cinder18:36
*** e0ne has quit IRC18:36
*** salv-orlando has joined #openstack-cinder18:40
*** salv-orlando has quit IRC18:42
*** salv-orlando has joined #openstack-cinder18:42
*** imacdonn has joined #openstack-cinder18:45
*** liverpooler has quit IRC18:45
*** lpetrut has quit IRC18:51
*** lpetrut has joined #openstack-cinder18:55
*** yangyapeng has joined #openstack-cinder18:57
*** lkuchlan_ has joined #openstack-cinder19:00
*** lpetrut has quit IRC19:01
*** yangyapeng has quit IRC19:01
*** lpetrut has joined #openstack-cinder19:01
*** itlinux has quit IRC19:03
*** yangyapeng has joined #openstack-cinder19:15
*** yangyapeng has quit IRC19:20
*** schmots_ has joined #openstack-cinder19:23
*** schmots has quit IRC19:23
*** schmots_ is now known as schmots19:23
*** lkuchlan_ has quit IRC19:28
*** itlinux has joined #openstack-cinder19:31
*** schmots_ has joined #openstack-cinder19:32
*** schmots has quit IRC19:33
*** schmots_ is now known as schmots19:33
*** lkuchlan_ has joined #openstack-cinder19:34
*** yangyapeng has joined #openstack-cinder19:36
openstackgerritMerged openstack/cinder master: Suppress UT log messages  https://review.openstack.org/52155519:36
openstackgerritMerged openstack/cinder master: Inspur Cinder iSCSI driver  https://review.openstack.org/50245519:37
smcginnisLet the rechecks... begin.19:37
*** jmlowe has quit IRC19:37
*** yangyapeng has quit IRC19:41
jungleboyjsmcginnis:  Wheee!19:49
*** amoralej is now known as amoralej|off19:50
*** yangyapeng has joined #openstack-cinder19:57
*** lkuchlan_ has quit IRC20:01
*** yangyapeng has quit IRC20:01
ildikovsmcginnis: we have a very quick Upstream Institute meeting on #openstack-meeting-3 if you're interested :)20:09
*** e0ne has joined #openstack-cinder20:11
*** yangyapeng has joined #openstack-cinder20:17
*** yangyapeng has quit IRC20:22
*** salv-orlando has quit IRC20:24
*** salv-orlando has joined #openstack-cinder20:25
*** salv-orlando has quit IRC20:28
*** edmondsw has joined #openstack-cinder20:29
*** schmots has quit IRC20:30
*** schmots has joined #openstack-cinder20:30
*** edmondsw has quit IRC20:33
*** liverpooler has joined #openstack-cinder20:33
*** salv-orlando has joined #openstack-cinder20:36
*** pcaruana has quit IRC20:39
*** yangyapeng has joined #openstack-cinder20:41
*** yangyapeng has quit IRC20:45
*** schmots has quit IRC20:48
openstackgerritSean McGinnis proposed openstack/cinder master: Move legacy-cinder-tox-* jobs in-tree  https://review.openstack.org/52165420:49
*** schmots has joined #openstack-cinder20:51
openstackgerritSean McGinnis proposed openstack/cinder master: Move legacy-cinder-tox-* jobs in-tree  https://review.openstack.org/52165420:53
*** felipemonteiro has joined #openstack-cinder20:57
openstackgerritSean McGinnis proposed openstack/cinder master: Move legacy-cinder-tox-* jobs in-tree  https://review.openstack.org/52165420:58
abishopsmcginnis: do you think there's any hope for https://review.openstack.org/49685820:58
abishopsmcginnis: I gather it's needed for https://review.openstack.org/48523220:59
smcginnisabishop: I do think we still need it. We are testing against v2 right now, and that's deprecated. We really need to get to v3.20:59
smcginnisabishop: I don't think it's necessarily required for the v1 endpoint removal. IIRC, there are just a few spots that need to be updated for that one.20:59
abishopsmcginnis: I couldn't follow the details, but somehow it's related to removing v1 endpoint ?20:59
smcginnisabishop: Not really.21:00
smcginnisabishop: Just switching from running tests against v2 by default to running against v3.21:00
abishopsmcginnis: looks like I need to study some details. I'm on the hook to do some TripleO cleanup in this area21:01
smcginnisabishop: Cool. If I can help, let me know.21:01
abishopwill do, thx21:02
smcginnisabishop: And if you can pressure qa to get that through, I would love some help there. ;)21:02
*** Apoorva_ has joined #openstack-cinder21:02
*** Apoorva has quit IRC21:06
ildikovsmcginnis: jungleboyj: so I'm trying to figure out how to do the check in Nova not to allow having the same volume attached to the same instance on the same host twice21:07
ildikovsmcginnis: jungleboyj: so I was looking into the volume attachment details and found an attached_host field21:08
ildikovsmcginnis: jungleboyj: and was wondering what that is exactly? :)21:09
jungleboyjildikov:  Good question.21:09
jungleboyjIt is used in 'migrate_volume_completion'21:12
*** e0ne has quit IRC21:12
*** erlon has joined #openstack-cinder21:12
*** AlexeyAbashkin has joined #openstack-cinder21:12
mtreinishsmcginnis: I just added another comment https://github.com/mtreinish/stestr/pull/127 with comparisons of that section to testr21:13
jungleboyjjgriffith: ^^21:13
mtreinishI did try changing the character encoding to latin-1 (from utf8) in case it wasn't able to handle some unicode character in the logs (which seemed unlikely)21:13
mtreinishbut that didn't seem to fix it either21:13
jungleboyjildikov: Is your question if that can be used to determine if the host is already attached?21:15
*** AlexeyAbashkin has quit IRC21:17
*** dave-mccowan has quit IRC21:18
ildikovjungleboyj: so we don't want to allow the same volume attached to the same in stance on the same host twice21:20
jungleboyjildikov:  Right.21:20
ildikovjungleboyj: and as we always say that Cinder should be the source of truth, I try to find a way to figure out the host for the instance the volume is already attached to21:20
jungleboyjRight.21:21
*** markstur has joined #openstack-cinder21:22
ildikovand the only thing I saw was that fiels21:23
jungleboyjYeah, looking here.21:23
ildikovbut wasn't sure whether that's a uuid, a hostname, if it's the instance's host even21:23
smcginnismtreinish: Maybe that's not the right place?21:23
ildikovthe other option is the BDM in Nova of course, but the flows are a bit messy there...21:23
mtreinishsmcginnis: I replaced all six.binary_type() casts and encode('utf8') calls to be encode('latin-1') iirc21:24
mtreinishI'll revive the patch and test it again21:25
smcginnismtreinish: FYI, since merging a patch to limit the amount of logger output captured per test, we are now getting good results running py35 unit tests.21:26
mtreinishsmcginnis: ok cool, but it still doesn't help me understand what's going on :)21:27
mtreinishand this is really bothering me that I can't figure out why it only fails on cinder logging and py321:27
mtreinishand it's not hitting the attachment size limit in subunit21:27
smcginnismtreinish: Yeah, this one has been really frustrating.21:27
smcginnismtreinish: Must be large enough to trigger some condition, but small enough to be under the attachment size limit.21:28
mtreinishsmcginnis: sure, but you'd think if I injected random strings in an attachment right under the size limit it would trip it21:29
mtreinishbut I couldn't reproduce that by just printing random data in a loop21:29
jungleboyjildikov: So, I just was playing with it on the system I am on and it shows the name of the host where the instance is running.21:29
openstackgerritSean McGinnis proposed openstack/cinder master: DNM: Test for in-tree compliance test  https://review.openstack.org/52166121:29
jungleboyjildikov:  Oh wait.21:30
jungleboyjInteresting 'attached_host' is NULL if there is an attached_instance it appears.21:31
jgriffithjungleboyj: ildikov https://github.com/openstack/cinder/blob/master/cinder/db/sqlalchemy/models.py#L91521:31
jgriffithThat exists for every attachment, and includes the connector for each attachment21:32
jgriffithand the connector requires things like instance and host21:32
openstackgerritLouie Kwan proposed openstack/cinder master: Allow purging of records less than 1 day old  https://review.openstack.org/51156721:32
jgriffithattached_host in the main volumeattachment column is also a *thing*21:33
mtreinishsmcginnis: fwiw, this is what I was testing: http://paste.openstack.org/show/626864/ (and I just ran it locally again and it failed)21:33
jgriffithas is InstanceUUID21:33
jgriffithso I'm unclear what the question is?21:33
mtreinishsmcginnis: this totally feels like a mutliprocess failure to me. Like multiple output streams interfering with each other.21:33
mtreinishbut the simple reproduce cases basically ruled that out21:34
jungleboyjWell, my question at the moment is why attachment_host is null when instance_uuid is set.21:35
jungleboyjWhy are both not set?21:35
jungleboyjjgriffith:  The main question goes back to ildikov 's question of how to determine if a volume is already attached once to an instance on the same host and if attached_host can help.21:36
smcginnismtreinish: Yeah, I was hitting it running a single test.21:36
jgriffithjungleboyj: attached_host and instance_uuid are the crazy old db-api/object routines db:volume_attached()21:37
smcginnismtreinish: Some conversion issue somewhere in the flow still seems likely. The output is always truncated, and it's always b'' even though other output is not.21:37
jgriffithit's an update mechanism21:37
jgriffithjungleboyj: I believe they are both set when an actual attachment is made/connected.21:38
jungleboyjjgriffith: Hmmm, I am probably using the old attachment flow here.21:38
jgriffithwell, you definitely are21:39
jgriffithbut regardless, the old flow should be setting that21:39
jungleboyjjgriffith:  Yes.21:39
jgriffithif not, skip it and in the new code use the new attachmentspecs data to retrieve the connector that was used21:39
jgriffithjungleboyj: looks something like this:  http://paste.openstack.org/show/626866/21:40
jgriffithif you want a "real" full view you should run it locally and dump it to the logs :)21:41
jungleboyjjgriffith:  Oh duh!  We have to know the host from the connector.  That is how the storage knows who to set up the target for.21:41
jungleboyjildikov:  ^^^21:41
jgriffithjungleboyj: right21:42
jungleboyjI have only looked at that at least once today.21:42
* jungleboyj is on cold medicine.21:42
jgriffithjungleboyj: mmmmmm... drugs man, drugs... far out21:43
jungleboyjYeah ... *cough cough*  They are only working so well.21:43
jgriffithI can spin up devstack and look at some of this in a little bit here21:43
jgriffithI don't have a full running devstack at the moment, all standalone stuff21:44
mriedemjungleboyj: i suppose we won't get an os-brick release until next week aye?21:44
jungleboyjmriedem:  Well, I can spin one whenever we need one.  Though, I am thinking waiting until next week is probably best.  :-)21:44
*** felipemonteiro has quit IRC21:44
*** eharney has quit IRC21:45
smcginnisjungleboyj, mriedem: I think we just had a requirements update I wanted to see go through.21:45
smcginnisWe could probably get one going.21:45
* smcginnis checks the queue again21:45
mriedemthere is a nova libvirt volume driver change depending on a new brick connector21:45
*** linkmark has joined #openstack-cinder21:45
jungleboyjmriedem:  Oh yeah I saw a note on that.21:46
smcginnisA cinder volume driver too.21:46
jgriffithjungleboyj: ildikov By the way..   https://github.com/openstack/cinder/blob/master/doc/source/contributor/attach_detach_conventions.rst21:46
jgriffithand https://github.com/openstack/cinder/blob/master/doc/source/contributor/attach_detach_conventions_v2.rst21:46
jgriffithmight be useful as well21:46
jgriffithhmm... although21:47
jgriffiththere's a bunch of stuff that's been removed there?21:47
*** rcernin has joined #openstack-cinder21:48
SwansonCharles Manson is dead. That just leaves Paul and Ringo.21:48
SwansonCarry on.21:48
jgriffithThere used to be a pretty comprehensive doc in tree that walked through attach/detach and included all of the inputs and responses21:48
jgriffithSwanson: he's not really dead ya know21:48
smcginnismriedem: I'm not familiar with these nova config settings. Does this look OK to you? https://review.openstack.org/#/c/510776/21:49
jgriffithSwanson: it's a conspiracy21:49
smcginnisHah21:49
jgriffithHe's running for office in 202021:49
SwansonVery surprised he didn't get the DHS spot before he died.21:50
jungleboyjjgriffith:  hemna  had that I thought.21:50
mtreinishsmcginnis: I'll keep playing with this in a bit (need to change locations now) https://github.com/mtreinish/stestr/commit/a0ef15a27d3202d60c32d465d7c24e50e69f82a021:51
ildikovjungleboyj: jgriffith: sorry, I'm back21:51
mtreinishsmcginnis: but in my local testing it didn't make any difference21:51
jgriffithjungleboyj: https://j-griffith.github.io/articles/2015-07/volume-attach-code-flow-in-cinder21:51
mriedemsmcginnis: i'm not familiar with the libvirt.iscsi_iface option either, but i see our help text on that option doesn't mention iser or tcp21:51
jungleboyjildikov:  Welcome.  I think jgriffith  answered your question.  :-)21:52
mriedemooo we have a doc21:52
jgriffithjungleboyj: I also merged that into tree at one point but looks like it's gone with the doc migration stuff21:52
smcginnisbrb21:52
mriedemhttps://docs.openstack.org/nova/pike/admin/configuration/iscsi-offload.html21:52
*** schmots has quit IRC21:54
jungleboyjsmcginnis:  Looks like we have one os-brick patch working through the gate and one that hit a gate failure.21:55
mriedemsmcginnis: commented inline21:56
ildikovjungleboyj: jgriffith: my bad, too many moving parts here...21:56
jungleboyjildikov:  Why your bad?21:57
ildikovjungleboyj: jgriffith: I'm also getting a little confused on what gets returned with the volume info now that we have the two attachment flows, but I guess that didn't fundamentally changed?21:57
jgriffithildikov: well, it was vastly different initially21:58
jgriffithoh wait.. volume info?21:58
ildikovjgriffith: there's attachment info in the volume info21:58
ildikovjgriffith: or well, used to be at least :)21:59
jgriffithildikov: maybe start at the beginning.. what are you trying to do?21:59
ildikovjgriffith: trying to add the check in Nova to prevent attaching the smae volume to the same instance on the same host twice with the principle of Cinder is the ultimate source of truth22:00
jgriffithildikov: using the new attachment api's?22:01
*** itlinux has quit IRC22:01
ildikovjgriffith: I thought to save a few calls to Cinder if I have the info in the volume info available too22:02
ildikovjgriffith: as we do a volume get before attach in the Nova API22:02
jgriffithildikov: can't really do that from the volume22:04
*** itlinux has joined #openstack-cinder22:04
jgriffithildikov: you could look at attach_status, if already attached then get attachments-for-volume and go from there22:04
jgriffithor even filter on host and instance and if nothing comes back then proceed22:04
jgriffithbut the attachment details are decoupled from the volume22:04
*** Apoorva_ has quit IRC22:06
ildikovjgriffith: I would just get the attachments and go through them to see whether the host appears in any of them22:07
jgriffithildikov: you don't need to do that though, no need to iterate when the db query will get what you want anyway22:09
jgriffithildikov: also if it's helpful there's this data too:  https://gist.github.com/j-griffith/fe0cbe90d7fd8c067d0568b8e9313d5722:09
smcginnismriedem: Thanks for taking a look.22:09
jgriffithildikov: I mean, it depends on what you mean by "just get the attachments and go through them"22:09
jgriffithildikov: if you mean for that volume, that's not so bad22:10
smcginnisjungleboyj: The gate failure one doesn't look critical, so we could wait to pick that one up in the next rev.22:10
jungleboyjOk.22:10
jgriffithildikov: but you could just specify exactly what you want with filters on things like volume and host which makes it pretty simple I think22:10
smcginnisjungleboyj: Oh, actually that's a backport to stable/ocata, so doesn't even matter.22:10
ildikovjgriffith: if I can get a list of attachments for a given volume that contains the info I can get the host from, that's what I would need22:11
ildikovI guess :)22:11
jungleboyjsmcginnis:  Right you are.  So just wait for ignoreskipactivation ?22:12
openstackgerritMerged openstack/cinder master: [Trivial] set min max_over_subscription_ratio to 1  https://review.openstack.org/52004922:13
openstackgerritMerged openstack/cinder master: Fix qos-spec-v2-qos-specs error  https://review.openstack.org/52134822:13
openstackgerritMerged openstack/cinder master: Add v3 api-ref for showing encryption specs item  https://review.openstack.org/52123922:13
jgriffithildikov: there's probably not a filter option in the api yet for attachments, but you can do volume-id like you said; or you can just look at the bdm's for the host and avoid the call otu to Cinder altogether22:14
jgriffithseems like there are multiple ways to do it, not sure what might be best22:14
*** mvk has joined #openstack-cinder22:14
* jgriffith looking at api/v3/attachments.py22:15
jgriffithYeah, not sure you're going to have what you want directly exposed there other than generic list and show22:16
ildikovjgriffith: I thought to add the check to check_attach_and_reserve_volume in Nova, but by then we create a new BDM, which might make things messy on that front...22:16
jgriffithildikov: you could just check nova BDM's for the host you're on *before* the new attach22:16
*** e0ne has joined #openstack-cinder22:16
jgriffithif one exists on that host for that volume already then you refuse to proceed22:17
jgriffithotherwise, continue on22:17
ildikovjgriffith: yeah, I guess I'll need to do that22:17
*** edmondsw has joined #openstack-cinder22:17
jungleboyjjgriffith:  That makes sense.22:17
jgriffithI still think we should just enforce it on the Cinder side though.22:17
jgriffithI mean... the behavior currently is a bug, and has to be fixed22:18
ildikovjgriffith: well, we only have connection_info in the BDM22:18
jgriffithI just can't fix it until I know what is happening on the other side :)22:18
jgriffithildikov: that's all you need though no?22:18
ildikovjgriffith: so I guess I can figure it out from the Instance...22:18
jgriffithildikov: you don't need that much info.. just a volume-id and the nova host (which you're on so you already have that)22:19
ildikovjgriffith: yeah, I would be happy if it could be fixed on the Cinder side :)22:19
ildikovjgriffith: when the request comes in to the Nova API, I think I only have the info of the Instance22:19
jgriffithonly if it's boot from volume22:20
ildikovjgriffith: as if we go down to the compute we might as well have Cinder to tell we're stupid22:20
jgriffithif it's not BFV you're in the manager layer anyway and the instance has been scheduled22:21
*** rtjure has quit IRC22:21
ildikovyeah, running actually22:21
jgriffithand even BFV, finalization of the attachment/connection to cinder doesn't happen til after scheduling the instance either22:21
ildikovI guess I should've just asked a BDM advice from mriedem :)22:21
*** edmondsw has quit IRC22:22
jgriffithildikov: what.. my advice isn't good enough?  :)22:22
ildikovand get a lecture on how simple it is before I got into my complicated thoughts, lol22:22
jungleboyjjgriffith:  Is better than mine. :-)22:22
ildikovjgriffith: I just meant to save you and everyone here from a Nova BDM discussion22:23
*** rtjure has joined #openstack-cinder22:23
ildikovjgriffith: I always like your advices :)22:23
*** yangyapeng has joined #openstack-cinder22:23
jungleboyjGroup hug!22:23
*** liverpooler has quit IRC22:24
jgriffithildikov: :)  I was just teasing ya22:24
jgriffithbesides, mriedem has enough on his plate, like reviewing my patch updates :)22:25
ildikovjgriffith: so, when we do calls like chakc_attach_and_reserve_volume we don't call down to the manager yet22:25
jgriffithsee what I did there....  tricky :)22:25
ildikovjgriffith: fingers crossed it works ;)22:25
*** abishop has quit IRC22:27
*** yangyapeng has quit IRC22:28
ildikovjgriffith: I'm still confused wit the BDM though :)22:31
*** e0ne has quit IRC22:32
*** e0ne has joined #openstack-cinder22:33
ildikovjgriffith: hmm, ok, I guess I could just say that if the BDM for the volume and instance exists already then fail as we only attach the same volume to the same instance twice for live_migrate and that's a different path anyway22:36
ildikovjgriffith: and then someone will eat me alive in the review for this, but oh well, I'm a big girl, I can take it...22:36
jgriffithildikov: I thought the scenario you described there was exactly what we talked about before22:37
jgriffithseems like a good idea to me22:37
ildikovjgriffith: the only problem I guess is that in Nova there are ghost BDM's every now and then IIUC, which means I might fail the call over an invalid BDM22:38
ildikovjgriffith: shouldn't be my problem for now though :)22:38
ildikovjgriffith: and things like swap_volume can still give me a headache...22:39
*** Apoorva has joined #openstack-cinder22:39
jgriffithildikov: they shouldn't, because it's a new volume22:39
*** Apoorva has quit IRC22:40
jgriffithat least in this context it shouldn't22:40
jgriffithit *should* hover give you a headache because it's sort of nutty22:40
*** Apoorva has joined #openstack-cinder22:40
ildikovnew volume?22:40
*** yangyapeng has joined #openstack-cinder22:44
*** e0ne has quit IRC22:49
*** yangyapeng has quit IRC22:49
*** itlinux has quit IRC22:49
*** itlinux has joined #openstack-cinder22:50
*** lbragstad has quit IRC22:51
ildikovhmm, one more thing22:55
ildikovif I just do a BDM check before everything else, I cannot easily differentiate between the old new flows22:55
ildikovand we need this only for the new flow22:56
ildikovor maybe it's the same error in both cases anyway and that'll hide it well enough22:56
jgriffithildikov: hmmm22:57
jgriffithildikov: well, actually if you find a BDM with the volume-id of interest you can just check it to see if it has an attachment id no?22:58
jgriffithildikov: so the same way we are doing it everywhere else on the Nova side currently22:58
ildikovjgriffith: but if we try to attach the volume with the new flow now as the new Cinder version is available and I let this go because the old flow is handling it in Cinder, then I'm screwed, so I guess if I check something that would be the Cinder microversion22:59
jgriffithildikov: ?22:59
jgriffiththat made no sense to me at all23:00
ildikovso the check is at places like a normal attach_volume right now23:00
ildikovwhere we decide on how to attach a volume based on the available Cinder microversion23:00
jgriffithildikov: you mean if they like did an upgrade while a volume was attached?  Then fine, check it and behave the same regardless23:00
jgriffithwe're not supporting multi-attach in the old API anyway so it's sort of easy to just punch out before even getting that far I'd think23:01
ildikovthe more I think about it the more it gets a microversion check whether or not to check the BDM in Nova23:02
jgriffithbut that's where we started I think23:02
jgriffithand that got nixed23:02
ildikovI can upload what I've just done for now and you can tell how many places it's fundamentally wrong23:03
jgriffithildikov: maybe it's not wrong at all... maybe it's perfect?23:03
*** lbragstad has joined #openstack-cinder23:04
ildikovjgriffith: yeah, it's already Tuesday here, so maybe :)23:05
ildikovjgriffith: https://review.openstack.org/#/c/330285/148..149/nova/compute/api.py23:06
ildikovjgriffith: need to test it still whether it does what I want, but something like this was the idea23:07
ildikovthe problem with the old flow is that if we're changing an error message with this, that's a problem...23:07
jgriffiththat looks sane to me23:08
jgriffithif you're worried about that then add a check for bdm.attachment_id around line #353023:09
ildikovok, I will ask Matt to take a look too then and if he thinks the same I will fix/add tests23:09
jgriffithI don't know.. not sure I follow the problem exactly but yeah, the Nova cores will certainly be better resources than I for this23:09
*** sdague has quit IRC23:09
ildikovin this case the old attachment doesn't determine which flow we plan to attach the volume23:10
ildikovjgriffith: no offense really, I just remember a couple of cases we thought things are sane, but they turned out not be when it came to reviews...23:10
ildikovso I'm not putting too much effort into anything now before validating the idea... :)23:11
ildikovcall me lazy, I probably am, but still :)23:12
ildikovjgriffith: ok, my soul is saved, and we're both sane today :)23:19
*** lpetrut has quit IRC23:32
*** mriedem is now known as mriedem_away23:36
*** linkmark has quit IRC23:38
*** armax has quit IRC23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!