Wednesday, 2019-04-03

*** dviroel_ has quit IRC00:24
*** brinzhang has joined #openstack-cinder00:26
*** Liang__ has joined #openstack-cinder00:46
jungleboyj+W01:02
smcginnisjungleboyj: Thanks01:07
jungleboyjWelcome.  Thanks for getting it fixed.01:07
smcginnisLuckily it was a fairly easy one.01:08
*** benj_- has joined #openstack-cinder01:11
*** mszwed has quit IRC01:12
*** benj_ has quit IRC01:12
*** kklimonda has quit IRC01:12
*** spotz has quit IRC01:12
*** kklimonda has joined #openstack-cinder01:12
*** mmethot has quit IRC01:19
*** Liang__ is now known as LiangFang01:20
*** thingee has quit IRC01:26
*** whoami-rajat has joined #openstack-cinder01:57
*** mriedem has quit IRC02:07
*** spsurya has joined #openstack-cinder02:12
*** gkadam has joined #openstack-cinder02:37
openstackgerritJay Bryant proposed openstack/cinder master: Remove scanning upgrade checker from opts generation  https://review.openstack.org/64949402:51
openstackgerritJay Bryant proposed openstack/cinder master: Remove scanning upgrade checker from opts generation  https://review.openstack.org/64949403:01
openstackgerritJay Bryant proposed openstack/cinder master: Add upgrade check for Windows iSCSI driver.  https://review.openstack.org/64919303:01
openstackgerritJay Bryant proposed openstack/cinder master: Add Upgrade Check for Drivers Removed in Stein  https://review.openstack.org/64920903:01
*** psachin has joined #openstack-cinder03:16
*** zhubx has joined #openstack-cinder03:17
*** zhubx has quit IRC03:30
*** zhubx has joined #openstack-cinder03:31
*** udesale has joined #openstack-cinder04:00
*** brinzhang has quit IRC04:11
*** brinzhang has joined #openstack-cinder04:11
*** whoami-rajat has quit IRC04:57
*** abhishekk has joined #openstack-cinder05:26
*** lemko has joined #openstack-cinder05:42
*** mszwed has joined #openstack-cinder06:16
openstackgerritMerged openstack/cinder master: Fix code-block JSON format issues  https://review.openstack.org/64945806:18
openstackgerritYong Huang proposed openstack/cinder master: Convert float type value of QoS specs to interger  https://review.openstack.org/61612506:34
*** pcaruana has joined #openstack-cinder06:36
*** pcaruana has quit IRC06:38
*** pcaruana has joined #openstack-cinder06:38
*** dpawlik has joined #openstack-cinder06:47
*** luksky has joined #openstack-cinder06:50
*** tkajinam has quit IRC06:58
openstackgerritYong Huang proposed openstack/cinder master: Add create, delete server volume methods for nova api  https://review.openstack.org/64951507:00
*** tkajinam has joined #openstack-cinder07:03
*** whoami-rajat has joined #openstack-cinder07:13
*** jistr is now known as jistr|afk07:22
*** e0ne has joined #openstack-cinder07:27
*** sahid has joined #openstack-cinder07:28
*** sdinescu has joined #openstack-cinder07:35
*** sdin has joined #openstack-cinder07:35
*** helenafm has joined #openstack-cinder07:44
*** lennyb has joined #openstack-cinder08:04
*** e0ne has quit IRC08:07
*** sdinescu has quit IRC08:11
*** sdin has quit IRC08:11
*** sdinescu has joined #openstack-cinder08:12
*** sdin has joined #openstack-cinder08:12
*** e0ne has joined #openstack-cinder08:15
*** e0ne has quit IRC08:17
*** e0ne has joined #openstack-cinder08:24
*** e0ne has quit IRC08:26
*** lemko has quit IRC08:31
*** abhishekk has quit IRC08:33
*** tkajinam has quit IRC08:45
*** luksky has quit IRC08:46
*** LiangFang has quit IRC08:59
*** luksky has joined #openstack-cinder09:18
*** whoami-rajat has quit IRC09:37
*** luizbag has quit IRC09:40
*** markvoelker has joined #openstack-cinder09:55
openstackgerritGorka Eguileor proposed openstack/cinderlib master: Fix get_connector_properties  https://review.openstack.org/64955210:00
*** e0ne has joined #openstack-cinder10:03
*** e0ne has quit IRC10:11
*** e0ne has joined #openstack-cinder10:15
*** markvoelker has quit IRC10:27
*** Dinesh_Bhor has quit IRC10:34
*** erlon has joined #openstack-cinder10:38
*** e0ne has quit IRC10:53
*** mvkr has quit IRC11:01
*** jistr|afk is now known as jistr11:02
*** helenafm has quit IRC11:04
*** hoonetorg has joined #openstack-cinder11:16
*** markvoelker has joined #openstack-cinder11:24
*** brinzhang has quit IRC11:24
*** dviroel_ has joined #openstack-cinder11:25
*** udesale has quit IRC11:26
openstackgerritBrian Rosmaita proposed openstack/cinder master: Remove non-exception from EXCEPTION_DETAIL_MAPPINGS  https://review.openstack.org/64830911:34
*** rcernin has quit IRC11:38
*** abishop has joined #openstack-cinder11:40
*** mvkr has joined #openstack-cinder11:54
*** markvoelker has quit IRC11:57
openstackgerritSean McGinnis proposed openstack/cinder master: Add upgrade checker for backup driver path  https://review.openstack.org/64792711:58
*** luizbag has joined #openstack-cinder12:02
*** odyssey4me has quit IRC12:12
*** whoami-rajat has joined #openstack-cinder12:19
*** e0ne has joined #openstack-cinder12:20
*** odyssey4me has joined #openstack-cinder12:26
openstackgerritIvan Kolodyazhny proposed openstack/cinder master: Publish backup capabilities to a scheduler  https://review.openstack.org/62088112:27
openstackgerritIvan Kolodyazhny proposed openstack/cinder master: Create backups via scheduler  https://review.openstack.org/63030512:27
*** eharney has quit IRC12:33
*** mmethot has joined #openstack-cinder12:36
*** enriquetaso has joined #openstack-cinder12:45
*** helenafm has joined #openstack-cinder12:54
*** jmlowe has quit IRC12:57
*** gaoyan has joined #openstack-cinder13:00
*** Alon_KS has joined #openstack-cinder13:09
Alon_KSHi, i think i just hit a bug with cinder13:10
*** lemko has joined #openstack-cinder13:10
whoami-rajatAlon_KS: Hi, can you elaborate?13:10
Alon_KS"Deadlock found when trying to get lock; try restarting transaction" when trying to delete/create multiple volumes at the same time13:10
*** mriedem has joined #openstack-cinder13:10
*** lseki has joined #openstack-cinder13:11
Alon_KSrunning openstack queens (cinder-17.1.9)13:11
Alon_KShttps://pastebin.com/Hp6Ztg8K13:15
whoami-rajatAlon_KS: Hmm, it shouldn't occur, the fix was backported to queens [1]13:16
whoami-rajat[1] https://github.com/openstack/cinder/blob/stable/queens/cinder/db/sqlalchemy/api.py#L161113:16
whoami-rajatbut looks like it isn't the most efficient solution13:16
smcginniswhoami-rajat, Alon_KS: That might not have made it out to a stable release yet?13:18
smcginnisNot sure what Cinder 17.1.9 is though. We're only on 14 for stein.13:19
Alon_KSshould i look into cinder-api also and search for the trigger? the main issue is that the cinder fails and affect the whole openstack environment13:19
Alon_KS17.1.9 is the latest version of queens, the cinder is just the venv created via openstack-ansible13:20
*** erlon has quit IRC13:20
whoami-rajatsmcginnis: yeah, that might be the possibility.13:21
*** thgcorrea has joined #openstack-cinder13:22
smcginnisThe latest version of ansible for cinder?13:24
Alon_KSthe latest version of openstack-ansible which include whole openstack services13:24
openstackgerritwanghao proposed openstack/cinder master: Support Incremental Backup Completion In RBD  https://review.openstack.org/62794113:26
*** dklyle has quit IRC13:30
smcginnisAlon_KS, whoami-rajat: Looks like the fix was included in Cinder 12.0.5. Ansible probably needs to be updated to pull in a newer stable release.13:30
*** dklyle has joined #openstack-cinder13:31
Alon_KSi think the fix is just for allowing retry performing the task 5 times, not really fixing the root cause13:34
Alon_KSand this fix is for "creating a large amount of volumes simultaneously", the same task that im trying to do13:35
*** e0ne has quit IRC13:35
smcginnisWhen there a lot of simultaneous create requests, there ends up being some DB contention. So those retries have been shown to make that more robust and not fail right away on deadlocking.13:36
Alon_KSmmm i understand13:37
Alon_KSwhat could be the cause for failing the cinder? although its retry a few times before failing the delete/create task.13:38
whoami-rajatsmcginnis: ++, not really sure which tag of openstack ansible updates the cinder tag but since 17.1.9 is fairly old, i would also recommend updating it.13:39
Alon_KSi thought it may also be related to ceph limitations (?), ceph is my cinder backend13:39
jungleboyjsmcginnis: Ugh, your backup driver check hit a problem in test boot pattern.13:45
*** Liang__ has joined #openstack-cinder13:45
jungleboyjI am losing faith that we can get these in to Stein without backput.13:45
smcginnisjungleboyj: I should just write a bot that automatically comments recheck these days.13:45
* jungleboyj laughs13:45
rosmaitai wonder if you make 'recheck' the topic, what would happen13:46
smcginnisHah. I think the regex for that specifically looks at just new comments.13:46
jungleboyj:-)13:47
*** e0ne has joined #openstack-cinder13:48
jungleboyjI am in meetings solid until 2 today but will work on getting UT put together for my patches.13:48
*** jmlowe has joined #openstack-cinder13:49
Alon_KS<smcginnis>, checked my cinder version and it running on 12.0.5, also i looked into api.py and saw the fix in there :/13:51
whoami-rajatjungleboyj: since we're discussing upgrade checks only, i would like to ask my query here rather on patch if its ok,13:52
whoami-rajatso we create a check for stein for things changed between rocky-stein from rocky releasenotes13:52
whoami-rajatso stein releasenotes (stein-train changes) should create a check for train right?13:52
jungleboyjwhoami-rajat:  No, the checks we are creating are for the things changed in Stein, so when upgrading from rocky->stein.13:53
*** eharney has joined #openstack-cinder13:55
*** udesale has joined #openstack-cinder13:56
whoami-rajatjungleboyj: we created the policy check from rocky releasenotes ?13:56
smcginnisStein release notes. We care about what changed in stein since rocky.13:57
jungleboyjwhoami-rajat:  From Stein release notes.  It is what changed in Stein and we check it as they are upgrading to it.13:58
whoami-rajatsmcginnis: jungleboyj ok. got confused a bit there. Thanks for the clarity.14:01
*** abishop has quit IRC14:01
jungleboyjwhoami-rajat:  You are welcome.  I understand the confusion.  You had me scared for a minute.14:02
*** Liang__ has quit IRC14:03
whoami-rajatjungleboyj: hah, i'm still curious why we keep the same policy point in both rocky and stein upgrade notes[1] [2]14:14
whoami-rajat[1] https://docs.openstack.org/releasenotes/cinder/stein.html#upgrade-notes14:14
whoami-rajat[2] https://docs.openstack.org/releasenotes/cinder/rocky.html#upgrade-notes14:14
rosmaitawhoami-rajat: that's because it was a backport14:15
*** dklyle has quit IRC14:15
whoami-rajatrosmaita: oh, feature of queens, releasenote added in stein backported to rocky and queens. that had me confused. Thanks.14:22
*** e0ne has quit IRC14:22
*** e0ne has joined #openstack-cinder14:23
rosmaitanp, the only reason i'm aware of it is that i did the backports!14:24
openstackgerritRajat Dhasmana proposed openstack/cinder master: VNX: delete the LUN from VNX backend  https://review.openstack.org/60590414:32
openstackgerritEric Harney proposed openstack/cinder stable/rocky: Tests: Fix up migrate notify tests  https://review.openstack.org/64963414:33
*** e0ne has quit IRC14:37
*** dklyle has joined #openstack-cinder14:41
*** dpawlik has quit IRC14:44
*** e0ne has joined #openstack-cinder14:44
*** luksky has quit IRC14:47
openstackgerritEric Harney proposed openstack/cinder master: Reserve migrations for DB backports  https://review.openstack.org/64943614:58
*** abishop has joined #openstack-cinder15:03
eharneydo upgrade checkers get removed at some point in the future?15:06
jungleboyjeharney: Hmmm, that is a good question.15:07
jungleboyjThink it depends on the check?  For the ones I have put in I don't think they would ever be removed unless one of the drivers was added back in.15:07
smcginnisWe can probably drop some after some time.15:13
*** zhubx has quit IRC15:16
*** zhubx has joined #openstack-cinder15:16
*** gaoyan has quit IRC15:25
*** mvkr has quit IRC15:28
openstackgerritEric Harney proposed openstack/python-cinderclient master: Fix shell upload-to-image with no volume type  https://review.openstack.org/64815715:36
*** e0ne has quit IRC15:37
*** e0ne has joined #openstack-cinder15:37
openstackgerritEric Harney proposed openstack/python-cinderclient master: Bump default shell API version  https://review.openstack.org/64787115:41
openstackgerritVadym Markov proposed openstack/cinder stable/ocata: cinder incremental backup with ceph fails if last one deleted  https://review.openstack.org/64965215:51
*** e0ne has quit IRC15:59
*** erlon has joined #openstack-cinder16:02
*** dpawlik has joined #openstack-cinder16:02
smcginniseharney: Not sure if this could end up an issue for Red Hat: https://review.openstack.org/#/c/647481/16:03
eharneysmcginnis: iirc, our Nova team hit this problem16:04
*** e0ne has joined #openstack-cinder16:05
*** e0ne has quit IRC16:05
*** e0ne has joined #openstack-cinder16:06
*** imacdonn has quit IRC16:12
*** imacdonn has joined #openstack-cinder16:13
*** sahid has quit IRC16:16
*** udesale has quit IRC16:19
*** psachin has quit IRC16:34
*** gkadam has quit IRC16:42
*** spsurya has quit IRC16:46
*** e0ne has quit IRC16:51
*** helenafm has quit IRC16:54
*** luksky has joined #openstack-cinder16:55
*** dviroel_ is now known as dviroel17:01
*** carlos_silva is now known as carloss17:05
*** e0ne has joined #openstack-cinder17:14
*** e0ne has quit IRC17:15
*** v12aml has quit IRC17:17
jungleboyjsmcginnis: eharney If I could get some love on this patch it would make my subsequent patches easier.  :-)17:19
jungleboyjhttps://review.openstack.org/#/c/649494/217:19
*** erlon has quit IRC17:20
*** dviroel has quit IRC17:21
*** dviroel has joined #openstack-cinder17:21
*** v12aml has joined #openstack-cinder17:27
*** spsurya has joined #openstack-cinder17:27
*** v12aml has quit IRC17:35
*** v12aml has joined #openstack-cinder17:39
openstackgerritRajat Dhasmana proposed openstack/cinderlib master: DOCFIX: correct syntax of codeblock  https://review.openstack.org/64967917:44
*** dpawlik has quit IRC17:45
whoami-rajat geguileo: ^^ was going through cinderlib docs, did a simple docfix for17:45
whoami-rajathttps://docs.openstack.org/cinderlib/latest/topics/backends.html#installed-drivers17:45
*** jmlowe has quit IRC17:52
*** jmlowe has joined #openstack-cinder17:55
geguileowhoami-rajat: thank you!18:07
*** abishop_ has joined #openstack-cinder18:31
*** abishop has quit IRC18:31
*** e0ne has joined #openstack-cinder18:48
*** jmlowe has quit IRC18:57
*** carloss has quit IRC19:09
*** abishop_ has quit IRC19:13
*** abishop_ has joined #openstack-cinder19:22
*** abishop_ is now known as abishop19:22
*** e0ne has quit IRC19:30
openstackgerritMerged openstack/cinder master: Add NetApp E-Series Driver to Removal List  https://review.openstack.org/64789119:31
*** erlon has joined #openstack-cinder19:32
*** eharney has quit IRC19:37
*** jmlowe has joined #openstack-cinder19:48
rosmaitajungleboyj: smcginnis: how are we looking for rc2 ?20:00
jungleboyjWell, I have UT for one patch done.20:00
jungleboyjStill having fun trying to get patches merged though.20:00
rosmaitayeah, the gate is moving very slowly20:00
jungleboyjSecond UT shouldn't be too hard now that I know how to do it.  Just trying to figure out if I can use DDT to make this less ugly.20:01
*** mriedem has quit IRC20:01
rosmaitajungleboyj: and once those get into master, they still need to be backported to stein20:02
rosmaitamy opinion is cut rc2 now, and if we do manage to get the upgrade checks merged by tomorrow afternoon, we cut rc320:03
*** thgcorrea has quit IRC20:04
rosmaitajungleboyj: i discovered last week that ddt has an 'idata' decorator, don't know if that will help you20:04
rosmaitamy patch increasing ddt to a more current version is in the gate now20:05
jungleboyjrosmaita: Example?20:05
*** mriedem has joined #openstack-cinder20:06
rosmaitahttps://review.openstack.org/#/c/648309/4/cinder/tests/unit/message/test_message_field.py@4420:06
*** erlon has quit IRC20:07
jungleboyjHmm, not sure if that will help here.20:09
rosmaitayeah, very possibly not20:09
openstackgerritMerged openstack/cinder master: Remove non-exception from EXCEPTION_DETAIL_MAPPINGS  https://review.openstack.org/64830920:12
openstackgerritMerged openstack/cinder master: Remove scanning upgrade checker from opts generation  https://review.openstack.org/64949420:12
*** whoami-rajat has quit IRC20:29
rosmaitajungleboyj: what are you thinking release-wise for this afternoon?20:39
* jungleboyj hears the Jeopardy music.20:40
smcginnisI'm thinking we can just go with what we have at this point.20:40
jungleboyjI will have my patch updated this afternoon.  Whether we can get things merged and backported ....20:40
smcginnisJust needed to restart check jobs on that first one about an hour ago, so not likely.20:40
jungleboyjsmcginnis:  Yeah, what happened there?20:40
smcginnisIf things suddenly speed up we can get an rc3 tomorrow, otherwise we can just see about adding these to a stable release.20:41
smcginnisjungleboyj: Just more random failures.20:41
rosmaitathat sounds good to me (the release, not the random failures)20:41
jungleboyjSadness.20:41
rosmaitahttps://review.openstack.org/64972120:42
smcginnisrosmaita: Going to have to give you the nickname "Quickdraw"20:42
rosmaita:)20:42
rosmaitai am trying to make up for the cinderclient snafu20:42
jungleboyj:-)  I am sure everyone has forgotten about that now.20:43
*** rcernin has joined #openstack-cinder20:44
openstackgerritMerged openstack/cinderlib master: DOCFIX: correct syntax of codeblock  https://review.openstack.org/64967920:51
*** spsurya has quit IRC20:59
*** mmethot has quit IRC21:00
*** pcaruana has quit IRC21:06
*** abishop has quit IRC21:08
*** eharney has joined #openstack-cinder21:21
openstackgerritBrian Rosmaita proposed openstack/cinder master: Document behavior of message.create  https://review.openstack.org/64829421:36
jungleboyjsmcginnis: rosmaita  I have my patches ready to go.  Just need to have Sean's first patch merge and then I can rebase and push them up.21:36
rosmaitacool21:36
jungleboyjAnd I think my UTs are decent.21:37
rosmaitasounds good, i will take a look later21:37
jungleboyjYeah, I will check back later and push things up.21:37
*** rcernin has quit IRC21:42
*** dviroel has quit IRC23:01
*** tkajinam has joined #openstack-cinder23:04
*** abishop has joined #openstack-cinder23:16
*** abishop has quit IRC23:25
*** v12aml has quit IRC23:41
*** v12aml has joined #openstack-cinder23:44
*** lseki has quit IRC23:53
*** brinzhang has joined #openstack-cinder23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!