Thursday, 2018-09-27

*** dpawlik has joined #openstack-cinder00:02
*** dpawlik has quit IRC00:06
*** mriedem_away has quit IRC00:18
*** LiangFang has joined #openstack-cinder00:27
*** brinzhang has joined #openstack-cinder00:37
*** lixiaoy1 has joined #openstack-cinder00:48
*** Emine has quit IRC00:55
*** Dinesh_Bhor has joined #openstack-cinder01:11
*** openstackgerrit has joined #openstack-cinder01:14
openstackgerrityenai proposed openstack/os-brick master: Remove meanless debug log  https://review.openstack.org/60538001:14
*** Dinesh_Bhor has quit IRC01:31
openstackgerritChuck Short proposed openstack/cinder master: Fix pylint warning  https://review.openstack.org/60556601:37
*** Dinesh_Bhor has joined #openstack-cinder01:37
*** Bhujay has joined #openstack-cinder02:19
*** Bhujay has quit IRC02:19
*** Bhujay has joined #openstack-cinder02:20
*** Dinesh_Bhor has quit IRC02:22
*** Dinesh_Bhor has joined #openstack-cinder02:26
*** gnufied has quit IRC02:40
*** psachin has joined #openstack-cinder02:48
*** imacdonn has quit IRC02:50
*** markvoelker has joined #openstack-cinder02:50
*** imacdonn has joined #openstack-cinder02:51
openstackgerrithzliaoyuehua proposed openstack/cinder master: Fix TypeError when retrieving pools filtered by volume-type  https://review.openstack.org/60406702:56
*** Bhujay has quit IRC02:59
openstackgerritYikun Jiang proposed openstack/cinder-specs master: Add volume re-image api  https://review.openstack.org/60531703:07
openstackgerrityenai proposed openstack/os-brick master: Improve debug msg  https://review.openstack.org/60557603:31
jungleboyjimacdonn:  That looks normal.  The owner is the important part.03:33
jungleboyjimacdonn:  The other stuff changes depending on who last uploaded a change.03:34
imacdonnjungleboyj: ok, cool ... just a bit worried, since smcginnis is not too well established in the cinder team ;)03:38
jungleboyjimacdonn:  Yeah, I have been trying to get him to participate more ... We will see if we can get him there.03:39
imacdonn;)03:39
jungleboyj;-)03:39
*** jiapei has joined #openstack-cinder03:42
*** rcernin_ has quit IRC03:42
*** rcernin has joined #openstack-cinder03:43
*** dave-mccowan has quit IRC03:46
*** sapd1 has quit IRC03:55
*** sapd1 has joined #openstack-cinder04:00
*** dpawlik has joined #openstack-cinder04:02
*** dpawlik has quit IRC04:07
*** vivsoni_ has joined #openstack-cinder04:13
*** vivsoni has quit IRC04:15
*** dave-mccowan has joined #openstack-cinder04:50
openstackgerritMerged openstack/cinder master: Fix image volume cache max size and max count limits  https://review.openstack.org/60314504:52
*** Bhujay has joined #openstack-cinder05:35
*** hoangcx has quit IRC06:11
openstackgerritzhufl proposed openstack/cinder master: api-ref: namespace in extensions is optional  https://review.openstack.org/60559306:12
*** hoangcx has joined #openstack-cinder06:12
*** dpawlik has joined #openstack-cinder06:23
*** Dinesh_Bhor has quit IRC06:24
*** pcaruana has joined #openstack-cinder06:33
*** Dinesh_Bhor has joined #openstack-cinder06:43
*** Luzi has joined #openstack-cinder07:06
*** rcernin has quit IRC07:12
*** mhen has joined #openstack-cinder07:26
*** gkadam has joined #openstack-cinder07:36
*** amoralej|off is now known as amoralej07:49
*** lpetrut has joined #openstack-cinder08:03
openstackgerritYikun Jiang proposed openstack/cinder master: Fix wrong NotFound in get_by_name_or_id  https://review.openstack.org/60502008:04
*** lpetrut has quit IRC08:04
*** e0ne has joined #openstack-cinder08:12
*** Dinesh_Bhor has quit IRC08:16
*** alexchadin has joined #openstack-cinder08:21
*** lpetrut has joined #openstack-cinder08:23
*** lpetrut has quit IRC08:30
*** jiapei has quit IRC08:31
*** lpetrut has joined #openstack-cinder08:33
*** gkadam is now known as gkadam-afk08:52
*** lixiaoy1 has quit IRC08:55
*** Dinesh_Bhor has joined #openstack-cinder08:55
*** gkadam-afk is now known as gkadam08:59
*** Bhujay has quit IRC09:19
*** Emine has joined #openstack-cinder09:24
*** Bhujay has joined #openstack-cinder09:25
*** Dinesh_Bhor has quit IRC09:29
*** alexchadin has quit IRC09:42
*** moshele has joined #openstack-cinder09:52
*** erlon has joined #openstack-cinder10:00
*** Dinesh_Bhor has joined #openstack-cinder10:04
*** brinzhang has quit IRC10:22
*** Dinesh_Bhor has quit IRC10:29
*** LiangFang has quit IRC10:31
openstackgerritYikun Jiang proposed openstack/cinder-specs master: Add volume re-image api  https://review.openstack.org/60531710:58
*** luizbag has joined #openstack-cinder11:00
*** amoralej is now known as amoralej|lunch11:06
openstackgerritwang yong proposed openstack/cinder master: Cinder volume driver for Inspur AS13000 series  https://review.openstack.org/60233811:11
openstackgerritRajat Dhasmana proposed openstack/cinder master: Fix multiattach set to false after retype  https://review.openstack.org/60565011:17
*** alexchadin has joined #openstack-cinder11:22
*** abishop has joined #openstack-cinder11:32
*** ganso has joined #openstack-cinder11:34
*** pcaruana has quit IRC11:50
*** Bhujay has quit IRC11:51
*** Bhujay has joined #openstack-cinder11:52
*** Bhujay has quit IRC11:53
*** Bhujay has joined #openstack-cinder11:53
*** tpsilva has joined #openstack-cinder11:54
*** Bhujay has quit IRC11:54
*** zhongjun2_ has quit IRC12:04
*** e0ne has quit IRC12:09
*** e0ne has joined #openstack-cinder12:09
*** mriedem has joined #openstack-cinder12:22
openstackgerritYikun Jiang proposed openstack/cinder master: Fix wrong uuid recognized when create group  https://review.openstack.org/60566612:28
*** abishop has quit IRC12:31
*** abishop has joined #openstack-cinder12:32
openstackgerritYikun Jiang proposed openstack/cinder master: Fix wrong NotFound in get_by_name_or_id  https://review.openstack.org/60502012:33
*** mriedem has quit IRC12:34
openstackgerritYikun Jiang proposed openstack/cinder master: Fix wrong uuid recognized when create group  https://review.openstack.org/60566612:35
*** pcaruana has joined #openstack-cinder12:39
*** amoralej|lunch is now known as amoralej12:42
*** alexchadin has quit IRC12:43
*** mriedem has joined #openstack-cinder12:49
openstackgerritHelen Walsh proposed openstack/cinder stable/queens: VMAX Driver - Initiator retrieval short hostname fix  https://review.openstack.org/60160513:02
*** abishop has quit IRC13:15
openstackgerritHelen Walsh proposed openstack/cinder stable/queens: VMAX Driver - Fix for get-pools and returned Service Levels  https://review.openstack.org/59704413:20
*** scroll2 has joined #openstack-cinder13:22
*** e0ne has quit IRC13:22
*** e0ne has joined #openstack-cinder13:26
openstackgerritDoug Hellmann proposed openstack/cinder-specs master: fix tox python3 overrides  https://review.openstack.org/60570513:27
openstackgerritDoug Hellmann proposed openstack/cinder-tempest-plugin master: fix tox python3 overrides  https://review.openstack.org/60570613:27
*** psachin has quit IRC13:36
*** jsheeren has joined #openstack-cinder13:37
jsheerenhi all!13:37
jsheereni have a quick question about notifications.. I was looking into doing some accounting and listening in on the message queues for volume create and delete events13:38
jsheerenusing the messagingv2 driver, set the topics to notifications in the cinder.conf file, using rabbitmq13:38
jsheerenwhich events should i see on which queue/exchange?13:39
*** dustins has joined #openstack-cinder13:40
*** yumiriam has quit IRC13:41
*** abishop has joined #openstack-cinder13:41
*** abishop has quit IRC13:48
*** abishop has joined #openstack-cinder13:48
*** gnufied has joined #openstack-cinder13:58
*** itlinux has quit IRC13:59
*** jsheeren has quit IRC14:03
*** LiangFang has joined #openstack-cinder14:07
*** jistr is now known as jistr|call14:31
*** lpetrut has quit IRC14:36
*** lpetrut has joined #openstack-cinder14:36
openstackgerritMerged openstack/cinder master: Exclude disabled API versions from listing  https://review.openstack.org/59395514:38
openstackgerritAlan Bishop proposed openstack/cinder stable/rocky: Fix image volume cache max size and max count limits  https://review.openstack.org/60575714:38
*** moshele has quit IRC14:41
openstackgerritIvaylo Mitev proposed openstack/cinder master: Implement volume capacity stats for VMware  https://review.openstack.org/60576214:44
*** evrardjp has quit IRC14:45
*** evrardjp has joined #openstack-cinder14:47
*** itlinux has joined #openstack-cinder14:58
*** zhongjun2_ has joined #openstack-cinder14:58
*** _erlon_ has joined #openstack-cinder14:58
*** evrardjp has quit IRC14:58
*** Luzi has quit IRC15:13
*** LiangFang has quit IRC15:14
*** dave-mccowan has quit IRC15:23
openstackgerritRajini Karthik proposed openstack/cinder master: Update Dell EMC Driver's multi-attach Support  https://review.openstack.org/60578115:25
*** jgrosso has joined #openstack-cinder15:36
*** dave-mccowan has joined #openstack-cinder15:41
*** jistr|call is now known as jistr15:46
*** e0ne has quit IRC15:51
*** dpawlik has quit IRC15:54
*** dpawlik has joined #openstack-cinder15:58
*** dpawlik has quit IRC15:59
*** dpawlik has joined #openstack-cinder15:59
*** woojay has quit IRC16:06
*** dave-mccowan has quit IRC16:08
*** raunak12 has joined #openstack-cinder16:14
*** dustins has quit IRC16:16
*** dpawlik has quit IRC16:26
*** dpawlik has joined #openstack-cinder16:30
openstackgerritGorka Eguileor proposed openstack/os-brick master: Succeed on iSCSI detach when path just went down  https://review.openstack.org/60580216:30
*** sapd1_ has joined #openstack-cinder16:40
*** e0ne has joined #openstack-cinder16:52
*** e0ne has quit IRC16:54
*** dpawlik has quit IRC16:58
openstackgerritJon Bernard proposed openstack/cinder master: RBD: add support for multiattach  https://review.openstack.org/59582716:59
*** dpawlik has joined #openstack-cinder16:59
*** _erlon_ has quit IRC17:08
*** e0ne has joined #openstack-cinder17:16
*** gkadam has quit IRC17:20
*** Emine has quit IRC17:21
openstackgerritMerged openstack/cinder-specs master: fix tox python3 overrides  https://review.openstack.org/60570517:23
*** jgrosso has quit IRC17:34
*** Emine has joined #openstack-cinder17:34
*** dpawlik has quit IRC17:36
*** dpawlik has joined #openstack-cinder17:39
*** dpawlik has quit IRC17:39
*** dpawlik has joined #openstack-cinder17:40
*** dpawlik has quit IRC17:40
*** mvkr has quit IRC17:42
*** amoralej is now known as amoralej|off17:56
melwitthas anyone else noticed this error recently in the ceph job? "ERROR cinder ImportError: Class ceph cannot be found" coming from the backup/manager http://logs.openstack.org/97/604397/6/check/devstack-plugin-ceph-tempest/7f846fa/job-output.txt.gz#_2018-09-26_10_44_37_80528617:58
jungleboyjmelwitt:  That is a new one to me.18:02
*** dims_ is now known as dims18:05
openstackgerritRajat Dhasmana proposed openstack/cinder master: Fix multiattach set to false after retype  https://review.openstack.org/60565018:05
whoami-rajatgeguileo: Hi, can you have a look at it again? https://review.openstack.org/#/c/605650/2 , not the best test but i guess will do the job.18:09
*** sapd1_ has quit IRC18:12
smcginnismelwitt, jungleboyj: That seems suspiciously related to https://review.openstack.org/#/c/595372/18:16
smcginnisI bet some config somewhere is trying to use the deprecated way of specifying which backup driver to use.18:17
jungleboyjsmcginnis:  Broke it.18:18
smcginnisBingo - https://github.com/openstack/devstack-plugin-ceph/blob/master/devstack/override-defaults#L1418:19
jungleboyjGood find.18:19
melwittI also found this backup_driver = cinder.backup.drivers.ceph in http://logs.openstack.org/97/604397/6/check/devstack-plugin-ceph-tempest/7f846fa/controller/logs/etc/cinder/cinder_conf.txt.gz is that coming from the devstack plugin?18:20
smcginnisI *think* that should be providing full path to the class.18:20
smcginnismelwitt: Ah, exactly. That's what's causing the error.18:20
jungleboyjThat would be needed given your change.18:20
smcginnisOnly deprecated since Havana, so I guess it was too soon. :}18:21
jungleboyj*SMH*18:21
*** lpetrut has quit IRC18:21
melwittthanks for the clues. I think I have enough info to go digging for what needs to be updated18:23
smcginnisGreat! I'm at the airport, otherwise I would track it down. But if you find where it needs to be changed, I can try to look at it quick.18:24
melwittok, cool. thank you18:24
jungleboyjsmcginnis:  Coming home?18:25
smcginnisYep, should get back later this evening.18:25
jungleboyjYay!18:25
* jungleboyj gets lonely when you are out of state. ;-)18:26
smcginnisYeah, this kept me busier than I expected. Will be good to get back to things.18:26
jungleboyjProductive trip though?18:26
melwitteureka https://github.com/openstack-dev/devstack/blob/94ca9f6756e7b677b1ee3fd2e32b555447e950dd/lib/cinder_backends/ceph#L6818:27
smcginnisLol, was just about to paste that link. ;)18:27
melwittgonna try updating it and run the experimental job18:27
smcginnis++18:27
smcginnisI think I better post something to the ML. Looking in codesearch.o.o, there are others (helm, kolla, etc.) that are using the old deprecated name too.18:28
melwittyeah, was thinking that might be helpful for deployment tool peeps too18:29
smcginnisSome day there will be an OS that can reliably handle copying and pasting.18:33
jungleboyjsmcginnis:  One can dream.18:34
*** zhongjun2_ has quit IRC18:37
*** jistr has quit IRC18:47
whoami-rajatjungleboyj: smcginnis , Hi, i've noticed a lot of gate failures due to this error, 'testtools.matchers._impl.MismatchError: 'volume.retype' != 'backup.createprogress'' , is it worth investigating?18:47
*** jistr has joined #openstack-cinder18:49
*** dustins has joined #openstack-cinder18:49
jungleboyjwhoami-rajat:  How many?18:49
whoami-rajat'jungleboyj : like not all at once, but from time to time when i review patches, this seems to be a common error.18:51
whoami-rajatjungleboyj:  currently looking here http://logs.openstack.org/66/605666/2/check/openstack-tox-py27/0f4b3c9/testr_results.html.gz18:51
e0newhoami-rajat, jungleboyj: it's some kind of a race in our tests18:54
jungleboyje0ne:  Yeah, that was what I was thinking.18:54
e0newhoami-rajat, jungleboyj: I saw it before. usually recheck helps. I did't have a time to dig into the it18:54
jungleboyjwhoami-rajat:  Sounds like it is worth digging into if you have time.18:55
whoami-rajate0ne: yes, recheck works but i thought this shouldn't be occurring in the first place, in retype test the status sets to backup.createprogress was strange to me.18:56
jungleboyjwhoami-rajat:  That isn't the test that is actually running though.  Is it?18:57
whoami-rajatjungleboyj: ok, will see into it whenever i get time.18:57
jungleboyjOh, it is.  Hmmm.18:58
whoami-rajatjungleboyj: https://github.com/openstack/cinder/blob/master/cinder/tests/unit/volume/test_volume_migration.py#L894 , this seems to be the test side.19:02
*** jistr has quit IRC19:08
*** jistr has joined #openstack-cinder19:08
*** itlinux has quit IRC19:09
*** raunak12 has quit IRC19:10
mnasersmcginnis: should we refer to drivers as just 'ceph' or 'swift' instead?19:14
mnaserre: backup drivers19:14
e0nemnaser: no, you should use full class path19:16
mnasere0ne: so if we're using "cinder.backup.drivers.swift" we're doing the right thing right now?19:16
e0necinder.backup.drivers.swift. SwiftBackupDriver19:16
mnaseraaaah19:17
mnaserokay19:17
mnaserhttps://docs.openstack.org/cinder/latest/configuration/block-storage/backup/swift-backup-driver.html fwiw19:17
mnaserthat should probably be updated19:17
mnaserthe rest as well19:18
*** dcdamien has quit IRC19:18
*** jistr has quit IRC19:23
*** jistr has joined #openstack-cinder19:26
*** jistr has quit IRC19:28
e0nemnaser: thanks! I'll do it tomorrow morning19:28
*** dcdamien has joined #openstack-cinder19:28
*** jistr has joined #openstack-cinder19:29
*** jistr has quit IRC19:34
*** jistr has joined #openstack-cinder19:37
*** jistr has quit IRC19:39
*** e0ne has quit IRC19:42
jungleboyjmnaser:  Will all of Cinder really not start if you have that set wrong?19:46
*** e0ne has joined #openstack-cinder19:47
openstackgerritRajat Dhasmana proposed openstack/cinder master: Add tests for multiattach check in cinder.objects  https://review.openstack.org/60585419:48
*** jistr has joined #openstack-cinder19:49
*** e0ne has quit IRC19:50
*** pcaruana has quit IRC19:54
*** raunak12 has joined #openstack-cinder20:01
*** _ix has joined #openstack-cinder20:03
_ixHello! I'm validating my deployment and I can't seem to get beyond this error...20:04
_ix"One of cinder-scheduler services is too old to accept create_snapshot request. Required RPC API version is 3.9. Are you running mixed versions of cinder-schedulers?"20:04
*** Nel1x has joined #openstack-cinder20:04
_ixCould be  ared herring.20:04
jungleboyj_ix:  Are you running and old version of the scheduler and a newer version of API and or Volume services?20:05
_ixI don't think so. Seems everything is up to date.20:05
jungleboyjStrange.20:06
_ixIs there a smoking gun of what's currently running? Looking in the local site-packages/cinder and rpcapi.py looks to be at v3.10... that's latest, no?20:08
*** e0ne has joined #openstack-cinder20:08
jungleboyjNo.  Not even close.20:08
jungleboyj_ix: What release are you on?20:09
_ixQueens.20:10
jungleboyjOh.  Hmmm.20:10
_ixjungleboyj: Versioning is hard to figure out for me sometimes... https://docs.openstack.org/cinder/queens/contributor/api/cinder.scheduler.rpcapi.html20:10
_ixI _thought_ that rpc api would be versioned at something like... 3.5020:11
jungleboyj_ix:  Ok, so that looks ok for Queens.20:11
_ixLet me see if I can run a few of these test cases again after bouncing the service....20:11
jungleboyjIs it possible that you have an old scheduler process sitting around.  Running old code?20:11
jungleboyj_ix:  ++20:12
_ixI don't think so. Until the test cases are generally passing, I'm holding off on triplicating the services. Everything's homed on a single cinder controller node.20:12
jungleboyjMay want to run cinder service-list and see what you get there.20:13
*** luizbag has quit IRC20:13
mnaserjungleboyj: i dunno, i figure it probably blows up :D20:14
* jungleboyj is laughing20:14
jungleboyjmnaser:  I think that the backup process will not start but I would be surprised if all processes didn't start.20:15
jungleboyjDon't have an ENV up at the moment to try.  Really need to finish setting my systems back up tonight.20:19
*** Emine has quit IRC20:27
*** Emine has joined #openstack-cinder20:28
_ixjungleboyj: It's got to be a red herring. This a ceph-backed cinder deployment, and I'm thinking that snapshot functionality hasn't been configured correctly just yet.20:34
_ixThanks for your conjecture.20:34
jungleboyjDoh!  You know, I think we had that discussion the other day.20:34
jungleboyjimacdonn:  ^^^20:34
jungleboyjWere you the one talking about that?20:34
melwittjungleboyj, mnaser: here's an example of the backup service not starting http://logs.openstack.org/97/604397/6/check/devstack-plugin-ceph-tempest/7f846fa/controller/logs/screen-c-bak.txt.gz#_Sep_26_10_44_19_207122 the other cinder services start up fine20:36
jungleboyjmelwitt Thank you.  That was what I expected.  :-)20:37
melwittor at least I think so, this one I'm not as sure because there's a GMR in it http://logs.openstack.org/97/604397/6/check/devstack-plugin-ceph-tempest/7f846fa/controller/logs/screen-c-vol.txt.gz20:37
melwittmaybe that's just from the job shutting everything down bc the backup service failed to start20:38
melwittyeah, I think that's what it is20:39
jungleboyjhttps://www.irccloud.com/pastebin/TppgxDfh/20:39
melwitt*the tempest job20:39
melwittyeah, it started up fine and was shut down almost immediately by the tempest job itself since the backup service didn't start up properly20:40
melwittI think20:40
jungleboyjThat makes sense.20:41
*** dpawlik has joined #openstack-cinder20:42
*** dpawlik has quit IRC20:46
*** erlon has quit IRC21:04
*** e0ne has quit IRC21:14
*** abishop has quit IRC21:16
*** dustins has quit IRC21:24
*** mchlumsky has quit IRC21:37
*** _ix has quit IRC21:46
*** mriedem has quit IRC21:55
mnaserjungleboyj: melwitt https://review.openstack.org/#/c/605846/ fyi :)22:01
melwittmnaser: I think you didn't address jungleboyj's point, that only the cinder backup service won't start. the other cinder services will start22:03
mnasermelwitt: ugh git add22:05
mnasermelwitt: there, i had it fixed but its 6pm22:05
melwittyou got git'd22:05
mnaser10/1022:06
mnasermelwitt: i guess i'll git gud for the next time22:06
melwittheh22:07
*** mriedem has joined #openstack-cinder22:07
jungleboyjOh git puns!22:08
*** mvkr has joined #openstack-cinder22:13
*** ganso has quit IRC22:22
*** rcernin has joined #openstack-cinder22:29
*** KeithMnemonic has quit IRC22:33
*** KeithMnemonic has joined #openstack-cinder22:33
*** tpsilva has quit IRC22:42
*** dpawlik has joined #openstack-cinder22:42
*** dpawlik has quit IRC22:47
*** raunak12 has quit IRC22:50
*** raunak12 has joined #openstack-cinder23:12
*** dpawlik has joined #openstack-cinder23:20
*** dpawlik has quit IRC23:25
*** mriedem has quit IRC23:26
*** erlon has joined #openstack-cinder23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!