Thursday, 2019-01-17

« Wednesday, 2019-01-16 Index Friday, 2019-01-18 »
*** eharney has quit IRC00:34
*** TxGirlGeek has quit IRC00:37
*** Liang__ has joined #openstack-cinder00:46
*** dave-mccowan has quit IRC00:49
*** TxGirlGeek has joined #openstack-cinder00:51
*** dave-mccowan has joined #openstack-cinder00:51
*** TxGirlGeek has quit IRC00:55
*** erlon has joined #openstack-cinder00:58
openstackgerritQian Mingyue proposed openstack/cinder master: Move Fujitsu ETERNUS DX related file  https://review.openstack.org/63112101:13
*** dave-mccowan has quit IRC01:15
*** erlon has quit IRC01:17
*** whoami-rajat has joined #openstack-cinder01:32
*** mriedem has quit IRC01:39
*** erlon has joined #openstack-cinder01:40
*** tkajinam has joined #openstack-cinder02:02
*** Dinesh_Bhor has joined #openstack-cinder02:02
*** tkajinam is now known as kajinamit02:04
*** kajinamit is now known as tkajinam02:05
openstackgerritYingxin Cheng proposed openstack/cinder master: Cinder RSD Driver  https://review.openstack.org/62146502:05
*** erlon has quit IRC02:10
*** arne_wiebalck_ has joined #openstack-cinder02:19
*** etp has quit IRC02:19
*** arne_wiebalck has quit IRC02:20
*** kaisers has quit IRC02:20
*** arne_wiebalck_ is now known as arne_wiebalck02:20
openstackgerritYikun Jiang proposed openstack/cinder master: Refresh the Service.service_id after re-spawning children  https://review.openstack.org/63006802:24
*** jenglisch has quit IRC02:35
*** lifeless has quit IRC02:40
*** lifeless has joined #openstack-cinder02:41
*** odyssey4me has quit IRC02:46
*** freerunner has joined #openstack-cinder02:46
*** psachin has joined #openstack-cinder02:49
*** mhen has quit IRC02:49
*** mhen has joined #openstack-cinder02:51
*** sapd1_x has joined #openstack-cinder03:10
*** udesale has joined #openstack-cinder03:57
*** doubletao_new has joined #openstack-cinder04:00
*** sapd1_x has quit IRC04:08
*** itlinux_ has joined #openstack-cinder04:10
*** itlinux has quit IRC04:13
*** udesale has quit IRC04:21
*** udesale has joined #openstack-cinder04:22
*** lifeless has quit IRC04:30
openstackgerritMerged openstack/cinder master: Add policy test for volume action policy  https://review.openstack.org/61754404:35
openstackgerritMerged openstack/cinder master: Add policy test for volume metadata policy  https://review.openstack.org/61997704:35
openstackgerritMerged openstack/cinder master: Add policy test for volume extend/retype/update_ro policy  https://review.openstack.org/61997804:35
openstackgerritMerged openstack/cinder master: Refactor on policy in code  https://review.openstack.org/62759704:35
*** udesale has quit IRC04:47
*** udesale has joined #openstack-cinder04:47
*** zzzeek has quit IRC04:48
*** zzzeek has joined #openstack-cinder04:48
*** phuongnh has joined #openstack-cinder04:50
*** doubletao_new has quit IRC05:01
*** doubletao has joined #openstack-cinder05:03
*** rcernin has quit IRC05:05
*** rcernin has joined #openstack-cinder05:07
*** bhagyashris has joined #openstack-cinder05:09
*** sapd1_x has joined #openstack-cinder05:12
*** Bhujay has joined #openstack-cinder05:20
*** Bhujay has quit IRC05:21
*** Bhujay has joined #openstack-cinder05:21
*** tkajinam has quit IRC05:23
*** tkajinam has joined #openstack-cinder05:25
*** udesale has quit IRC05:31
*** udesale has joined #openstack-cinder05:33
*** Dinesh_Bhor has quit IRC05:47
*** lifeless has joined #openstack-cinder05:51
*** Dinesh_Bhor has joined #openstack-cinder05:55
*** tkajinam has quit IRC06:00
*** Bhujay has quit IRC06:07
*** Bhujay has joined #openstack-cinder06:07
*** Bhujay has quit IRC06:08
*** Bhujay has joined #openstack-cinder06:08
*** Bhujay has quit IRC06:10
*** Bhujay has joined #openstack-cinder06:10
*** Bhujay has quit IRC06:11
*** Bhujay has joined #openstack-cinder06:11
*** radeks has joined #openstack-cinder06:12
*** Bhujay has quit IRC06:13
*** Bhujay has joined #openstack-cinder06:13
*** Bhujay has quit IRC06:14
*** radeks_ has joined #openstack-cinder06:14
*** Bhujay has joined #openstack-cinder06:14
*** Bhujay has quit IRC06:16
*** Bhujay has joined #openstack-cinder06:16
*** tkajinam has joined #openstack-cinder06:17
*** Bhujay has quit IRC06:17
*** radeks has quit IRC06:17
*** Bhujay has joined #openstack-cinder06:17
*** Bhujay has quit IRC06:19
*** Bhujay has joined #openstack-cinder06:19
*** Bhujay has quit IRC06:20
*** Bhujay has joined #openstack-cinder06:20
*** Bhujay has quit IRC06:22
*** tkajinam has quit IRC06:22
*** Bhujay has joined #openstack-cinder06:22
*** Bhujay has quit IRC06:23
*** Bhujay has joined #openstack-cinder06:23
openstackgerritYingxin Cheng proposed openstack/cinder master: Cinder RSD Driver  https://review.openstack.org/62146506:28
openstackgerritfutaotao proposed openstack/cinder master: Update FusionStorage Cinder Driver by using REST API  https://review.openstack.org/61995206:38
openstackgerritfutaotao proposed openstack/cinder master: Update FusionStorage Cinder Driver by using REST API  https://review.openstack.org/61995206:41
*** Luzi has joined #openstack-cinder06:43
*** tkajinam has joined #openstack-cinder06:46
*** tkajinam_ has joined #openstack-cinder06:55
*** tkajinam has quit IRC06:57
*** radeks_ has quit IRC07:16
*** threestrands has quit IRC07:17
*** rcernin has quit IRC07:20
*** radeks_ has joined #openstack-cinder07:32
*** pcaruana has joined #openstack-cinder07:36
*** srini_ has quit IRC07:47
*** e0ne has joined #openstack-cinder07:52
*** udesale has quit IRC08:11
*** udesale has joined #openstack-cinder08:11
*** Bhujay has quit IRC08:13
*** udesale has quit IRC08:16
*** udesale has joined #openstack-cinder08:16
*** udesale has quit IRC08:17
*** udesale has joined #openstack-cinder08:17
*** helenafm has joined #openstack-cinder08:20
*** jenglisch_ has joined #openstack-cinder08:29
*** radeks__ has joined #openstack-cinder08:36
*** udesale has quit IRC08:39
*** radeks_ has quit IRC08:39
*** udesale has joined #openstack-cinder08:39
*** udesale has quit IRC08:49
*** udesale has joined #openstack-cinder08:49
*** Dinesh_Bhor has quit IRC08:53
*** Dinesh_Bhor has joined #openstack-cinder08:54
*** Bhujay has joined #openstack-cinder08:56
*** udesale has quit IRC09:08
*** udesale has joined #openstack-cinder09:09
*** david-lyle has joined #openstack-cinder09:16
*** dklyle has quit IRC09:19
*** david-lyle has quit IRC09:29
*** dklyle has joined #openstack-cinder09:32
*** Liang__ has quit IRC09:38
*** odyssey4me has joined #openstack-cinder09:44
*** david-lyle has joined #openstack-cinder09:49
*** ysandeep has joined #openstack-cinder09:51
*** dklyle has quit IRC09:51
*** ysandeep has quit IRC09:53
*** luizbag has joined #openstack-cinder09:56
*** david-lyle has quit IRC09:56
*** dklyle has joined #openstack-cinder10:00
*** arne_wiebalck_ has joined #openstack-cinder10:03
*** bhagyashris has quit IRC10:06
*** arne_wiebalck_ has quit IRC10:07
*** erlon has joined #openstack-cinder10:18
*** psachin has quit IRC10:31
*** Bhujay has quit IRC10:37
*** niceplace has quit IRC10:40
*** niceplace has joined #openstack-cinder10:41
*** odyssey4me has quit IRC10:49
*** v12aml has joined #openstack-cinder10:52
*** Dinesh_Bhor has quit IRC10:53
*** Bhujay has joined #openstack-cinder10:53
*** udesale has quit IRC10:56
*** lpetrut has joined #openstack-cinder11:03
*** phuongnh has quit IRC11:18
*** abishop has joined #openstack-cinder11:25
*** helenafm has left #openstack-cinder11:27
*** ganso has joined #openstack-cinder11:28
*** sapd1_x has quit IRC11:42
*** e0ne has quit IRC11:44
*** e0ne has joined #openstack-cinder11:52
*** udesale has joined #openstack-cinder12:23
*** Bhujay has quit IRC12:34
*** Bhujay has joined #openstack-cinder12:35
*** Bhujay has quit IRC12:36
*** Bhujay has joined #openstack-cinder12:36
*** Bhujay has quit IRC12:37
*** Bhujay has joined #openstack-cinder12:40
*** lemko has joined #openstack-cinder12:41
*** Bhujay has quit IRC12:42
*** irclogbot_0 has quit IRC12:47
*** lseki has joined #openstack-cinder12:49
*** irclogbot_0 has joined #openstack-cinder12:57
*** mvkr has quit IRC13:00
*** logan- has joined #openstack-cinder13:04
*** rosmaita has left #openstack-cinder13:14
*** rosmaita has joined #openstack-cinder13:15
*** sapd1_x has joined #openstack-cinder13:21
*** eharney has joined #openstack-cinder13:26
*** edmondsw_ has joined #openstack-cinder13:27
*** edmondsw has quit IRC13:29
*** edmondsw_ is now known as edmondsw13:29
*** zul has joined #openstack-cinder13:31
lemkoHello. Cinder cannot unmap volume properly in a reasonable time. It takes ~20-30  minutes most of the time... I found out that nova-compute is executing the command  multipath -f <MULTIPATH_ID> and get stucks there... What could possibly be the reason of this?13:33
*** radeks__ has quit IRC13:36
*** eharney has quit IRC13:40
*** mvkr has joined #openstack-cinder13:42
*** irclogbot_0 has quit IRC13:45
*** mmethot has quit IRC13:48
*** mmethot has joined #openstack-cinder13:52
*** e0ne has quit IRC13:53
*** eharney has joined #openstack-cinder13:53
*** irclogbot_0 has joined #openstack-cinder13:55
*** abhishekk has joined #openstack-cinder13:55
*** Liang__ has joined #openstack-cinder13:56
*** e0ne has joined #openstack-cinder13:59
*** Liang__ is now known as LiangFang14:00
*** dave-mccowan has joined #openstack-cinder14:04
*** radeks__ has joined #openstack-cinder14:08
*** dave-mccowan has quit IRC14:09
*** davidsha has joined #openstack-cinder14:16
*** mriedem has joined #openstack-cinder14:58
*** abhishekk has quit IRC15:01
jungleboyjlemko:  Don't know if anything off the top of my head, but have you checked the system logs on the compute node to see if there are any clues?15:03
lemkoI found something interesting15:03
lemkoCould not find notification semaphore identified by cookie value15:03
*** LiangFang has quit IRC15:04
*** carlos_silva has joined #openstack-cinder15:04
lemkohttps://www.irccloud.com/pastebin/cqFYSeEJ/15:04
lemkoI run openstack in container jungleboyj, and it is executed on host when the volume is trying to be unmounted.15:05
lemkoHowever when I try to use this command in the nova-compute container it works.15:06
lemkoDo you have any idea how to fix it jungleboyj? Like I should share these semaphore "cookies" between docker and the host, and it might be good?15:06
*** Liang__ has joined #openstack-cinder15:07
jungleboyjlemko:  Your guess is as good as mine on that.  I have not seen an error like that before.15:08
jungleboyjGoogle search is suggesting a problem with dbus perhaps.15:10
*** tkajinam__ has joined #openstack-cinder15:11
*** Liang__ has quit IRC15:11
*** tkajinam_ has quit IRC15:13
*** radeks__ has quit IRC15:21
*** radeks__ has joined #openstack-cinder15:21
*** lpetrut has quit IRC15:27
*** Luzi has quit IRC15:33
*** sapd1_x has quit IRC15:33
openstackgerritHelen Walsh proposed openstack/cinder master: PowerMax driver - solve issue of concurrent snapvx operations  https://review.openstack.org/63153415:34
lemkoMaybe allowing shared IPC between host and docker will solve it...15:39
*** jmlowe has quit IRC15:47
*** mvkr has quit IRC15:53
*** radeks__ has quit IRC15:55
*** tkajinam_ has joined #openstack-cinder15:58
*** TxGirlGeek has joined #openstack-cinder16:00
*** tkajinam__ has quit IRC16:01
openstackgerritNolwennCauchois proposed openstack/cinder master: Fix gigabytes usage error when deleting snapshot group  https://review.openstack.org/62686316:17
*** sapd1_x has joined #openstack-cinder16:24
*** e0ne has quit IRC16:25
*** lpetrut has joined #openstack-cinder16:39
*** itlinux_ has quit IRC16:41
davidshaQuick question, Is this the spec for QoS or where would I find it? https://review.openstack.org/#/c/451565/116:55
smcginnisdavidsha: That's for the addition of capacity based QoS settings.16:56
smcginnisQoS has been around for a very long time, so not sure if there was ever a spec for it.16:57
smcginnisYeah, not seeing anything in https://specs.openstack.org/openstack/cinder-specs/16:57
smcginnisCould have been something that Cinder already had when it was split out of nova.16:58
davidshasmcginnis: kk, thought it was a recent addition, read somewhere it was introduced in Rocky but that might have just been for a specific driver.16:58
davidshaThanks!16:58
smcginnisdavidsha: Yeah, that must have been a specific driver.16:58
openstackgerritNolwennCauchois proposed openstack/cinder master: Fix gigabytes usage error when deleting snapshot group  https://review.openstack.org/62686316:59
*** eharney has quit IRC16:59
davidshaactually quick question, would a generic QoS mixin for "*over-fabric" drivers that called on Neutron's QoS API for bandwidth limiting/prioritization sound any way feasable? Just looking for reading material to see how possible it is.17:02
smcginnisHmm. We normally would not want Cinder needing to call out to Neutron APIs for anything.17:02
smcginnisBut I suppose if it was controlled by config settings that the deployer chose to set up to enable, that could be feasible.17:03
smcginnisI could see how it would make sense for those kinds of things. Kind of like we have the FCZM for fibre channel storage.17:03
smcginnisdavidsha: It would definitely need a spec written at least to detail the proposed changes so everyone can understand what's being proposed.17:04
smcginnisdavidsha: Hate saying it to you again, but too late for stein. :)17:04
davidshakk, I'll do a bit more reading first!17:05
davidshaAHHHH!!!!17:05
smcginnisBut if you wanted to get something started for train, we can think about that.17:05
smcginnis:)17:05
*** sapd1_x has quit IRC17:08
davidshaI'll probably mock up a POC and see from there, it would rely on the neutron switch vendor projects enabling QoS too...17:10
hemna@smcginnis, but the FCZM is inside of cinder17:12
hemnastill makes cinder self contained...17:12
hemnacan't you basically do this today, with setting up neutron qos17:13
hemnaand then configuring a cinder iscsi driver to use the network defined in neutron that has the qos settings you want?17:14
hemnanot sure it makes sense to have cinder talking to neutron in this way...dunno17:14
*** eharney has joined #openstack-cinder17:14
davidshahemna: kk, I did a bit of work on QoS in Neutron so was just wondering about using it for this.17:15
*** lpetrut has quit IRC17:18
hemnamaybe you can convince me :)17:19
*** radeks__ has joined #openstack-cinder17:23
davidshahemna: I'll do a bit more reading first and make sure I know what I'm talking about ;)17:26
hemnawell we do have a QoS 'mixin' for iops to a degree with nova17:27
hemnathat tries to set the qos settings for kvm I believe17:27
hemnaas well as qos for backends17:27
hemnaso maybe this is just an extension of that17:27
davidshaOk, that sounds similar to what I have in mind17:29
*** udesale has quit IRC17:41
*** davidsha has quit IRC17:44
openstackgerritMerged openstack/cinder master: PowerMax driver - rebranding VMAX to PowerMax  https://review.openstack.org/62065917:54
*** e0ne has joined #openstack-cinder18:14
*** e0ne has quit IRC18:16
*** lemko has quit IRC18:30
*** e0ne has joined #openstack-cinder18:36
*** ociuhandu has joined #openstack-cinder18:49
*** ociuhandu has quit IRC18:49
*** radeks__ has quit IRC18:56
openstackgerritChuck Short proposed openstack/cinder master: Use oslo.privsep for 'lvcreate'  https://review.openstack.org/63159918:58
*** jmlowe has joined #openstack-cinder19:22
*** radeks__ has joined #openstack-cinder19:33
*** lpetrut has joined #openstack-cinder19:35
mriedemhas anyone worked on adding calls to cinder-manage db online_data_migrations to grenade?19:39
*** mchlumsky has quit IRC19:41
*** mchlumsky has joined #openstack-cinder19:43
*** abishop has quit IRC19:44
*** e0ne has quit IRC19:44
*** luizbag has quit IRC19:49
*** erlon has quit IRC20:04
whoami-rajatrosmaita:  I think rebasing your patch may help as the current failure (backup.create_progress != volume.retype) is fixed here [1], and the tpool error (which occurred in the initial rechecks) here [2]20:07
whoami-rajat[1] https://review.openstack.org/#/c/627329/20:07
whoami-rajat[2] https://review.openstack.org/#/c/630648/20:07
*** pcaruana has quit IRC20:09
*** lseki has quit IRC20:11
*** erlon has joined #openstack-cinder20:33
*** lpetrut has quit IRC20:36
*** irclogbot_0 has quit IRC20:41
*** irclogbot_0 has joined #openstack-cinder20:52
*** openstackgerrit has quit IRC20:56
*** jmlowe has quit IRC21:19
mriedemsmcginnis: jungleboyj: is this a known issue? http://logs.openstack.org/66/629766/3/gate/openstack-tox-py27/24095a4/testr_results.html.gz21:24
mriedemlooks like it started on jan 1421:25
mriedemhttp://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22testtools.matchers._impl.MismatchError%3A%20'volume.retype'%20!%3D%20'backup.createprogress'%5C%22%20AND%20tags%3A%5C%22console%5C%22&from=7d21:25
mriedemeh i guess it's older than that21:26
mriedem62 hits in 7 days, that's pretty bad21:26
whoami-rajatmriedem: yes, it was caused by the leaking notification of the asynchronous backup task causing failure in other tests. It was recently fixed.21:27
*** eharney has quit IRC21:27
*** ganso has quit IRC21:27
mriedemhttps://bugs.launchpad.net/cinder/+bug/181226321:28
openstackLaunchpad bug 1812263 in Cinder "test_retype_volume_replica_2__False__True_ intermittently fails with "testtools.matchers._impl.MismatchError: 'volume.retype' != 'backup.createprogress'"" [High,Confirmed]21:28
mriedemreally21:28
mriedemit's still hitting today21:28
mriedemdo you have a patch?21:28
mriedemhttps://review.openstack.org/#/c/627329/ ?21:28
mriedemheh coincidentally it looks like you're bringing up the same thing21:29
smcginnisI'm not entirely convinced we've squashed that one.21:29
whoami-rajatActually there were multiple fixes proposed https://bugs.launchpad.net/cinder/+bug/180364821:30
openstackLaunchpad bug 1803648 in Cinder "gate failure : testtools.matchers._impl.MismatchError: 'volume.retype' != 'backup.createprogress'" [Undecided,Fix released] - Assigned to Yikun Jiang (yikunkero)21:30
whoami-rajatI think Brian's patch isn't rebased with the latest fix causing the failure, cause there was another patch with the same problem21:31
*** itlinux has joined #openstack-cinder21:39
*** jmlowe has joined #openstack-cinder21:41
rosmaitawhoami-rajat: i've been afraid to rebase cause i didn't want to go through the gates again, but guess at this point i might as well!21:41
*** openstackgerrit has joined #openstack-cinder21:41
openstackgerritBrian Rosmaita proposed openstack/cinder master: Pass image_id to ImageDownloadFailed  https://review.openstack.org/62976621:41
whoami-rajatrosmaita: understand your concerns. Haven't seen these many failures before.21:47
rosmaitait's like my patch is a center of gravity for test failures21:48
*** mriedem has quit IRC21:49
whoami-rajatHeh, maybe an opportunity to fix our loopholes :)21:51
whoami-rajatsmcginnis: do we have other drivers working on nvmeof other than spdk ?21:52
*** mriedem has joined #openstack-cinder21:56
*** rcernin has joined #openstack-cinder22:02
*** radeks__ has quit IRC22:05
smcginniswhoami-rajat: I think that's the only one.22:07
smcginnisRSD, but that didn't make it.22:07
*** imacdonn has quit IRC22:07
*** imacdonn has joined #openstack-cinder22:07
whoami-rajatsmcginnis: ok, thanks.22:08
*** mvkr has joined #openstack-cinder22:23
jungleboyjwhoami-rajat:  Yeah, the RSD one is the only one I know of.22:29
*** mvkr has quit IRC22:36
*** itlinux has quit IRC22:49
*** sapd1_ has joined #openstack-cinder22:57
*** sapd1 has quit IRC23:01
*** mriedem has quit IRC23:17
*** mchlumsky has quit IRC23:57
« Wednesday, 2019-01-16 Index Friday, 2019-01-18 »

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!