Tuesday, 2020-04-07

*** keper7 has quit IRC00:22
*** brinzhang has quit IRC00:50
*** brinzhang has joined #openstack-cinder00:51
*** brinzhang_ has joined #openstack-cinder00:59
*** brinzhang has quit IRC01:03
*** ociuhandu has joined #openstack-cinder01:04
*** ociuhandu has quit IRC01:09
*** zhanglong has joined #openstack-cinder01:12
*** Liang__ has joined #openstack-cinder01:17
*** ociuhandu has joined #openstack-cinder02:34
*** ociuhandu has quit IRC02:39
*** psachin has joined #openstack-cinder03:17
*** lvbin01 has joined #openstack-cinder03:21
*** spatel has joined #openstack-cinder03:24
*** spatel has quit IRC03:25
*** ykarel|away is now known as ykarel04:20
*** brinzhang has joined #openstack-cinder04:36
*** brinzhang_ has quit IRC04:39
openstackgerritRaghavendra Tilay proposed openstack/cinder master: HPE 3PAR: Support duplicated FQDN in network  https://review.opendev.org/71380305:05
*** andrebeltrami has quit IRC05:16
*** lvbin01 has quit IRC05:25
*** lvbin01 has joined #openstack-cinder05:26
*** brinzhang_ has joined #openstack-cinder05:33
openstackgerritMerged openstack/cinderlib master: Cleanup py27 support  https://review.opendev.org/71748705:36
*** brinzhang has quit IRC05:36
*** udesale has joined #openstack-cinder05:41
*** ircuser-1 has quit IRC06:07
*** udesale has quit IRC06:09
*** udesale has joined #openstack-cinder06:13
*** kevinz has joined #openstack-cinder06:28
kevinzMorning Cinder!06:29
kevinzI wonder do we support change volume backend after the volume backend is dead?06:29
*** dpawlik has joined #openstack-cinder06:30
kevinzwe have cinder+ceph, and we removed the cinder volume service+Ceph osd in one host. but some volumes still have "os-vol-host-attr:host" to that cinder service. How could we migrate the volume to another host?06:31
openstackgerritXuchu Jiang proposed openstack/cinder master: Add an option to specify iSCSI IP version  https://review.opendev.org/69863006:40
*** lvbin02 has joined #openstack-cinder06:46
*** lvbin01 has quit IRC06:46
*** lvbin02 is now known as lvbin0106:46
*** throne82 has quit IRC06:58
*** zhanglong has quit IRC06:58
*** tosky has joined #openstack-cinder07:24
*** xuanyandong has joined #openstack-cinder07:31
*** ociuhandu has joined #openstack-cinder07:45
xuanyandongwhoami-rajat: Hello, thanks for your review, In order not to lose +2, Can i submit a new commit to fix it? https://review.opendev.org/#/c/705876/07:51
*** lvbin02 has joined #openstack-cinder07:52
*** muliby has joined #openstack-cinder07:52
whoami-rajatxuanyandong, i was thinking of same but just because of commit message i didn't consider followup. i think now the releasenote is more important so if you submit a quick followup then i can merge it.07:54
*** lvbin01 has quit IRC07:54
*** lvbin02 is now known as lvbin0107:54
*** brinzhang has joined #openstack-cinder07:56
mulibyhello everyone, I'm writing a Cinder driver for the LightOS storage defined disaggregated storage soluion (https://www.lightbitslabs.com/products/lightos/). I think I found a bug with the thin provisioning support in Cinder. If I expose 20GB of storage *thinly-provisioned* and attempt to create volumes larger than that (say 70GB) rapidly, at some07:58
mulibypoint volume creation will be forbidden by the capacity filter because we do self.free_capacity_gb -= volume size in host_manager:consume_from_volume(), leading to negative free_capacity_gb07:58
*** xuanyandong has quit IRC07:58
*** brinzhang_ has quit IRC07:59
mulibyThe reason it takes multiple creation attempts is that *if* the host_manager gets updated stats from the driver, self.free_capacity_gb will be reset to the driver reported value07:59
mulibyBut if two creation attempts happen without an updated stats call inbetween, the second creation will fail, even though the system is thinly provisioned and no actual storage was used, so free_capacity_gb is still 20GB08:00
*** xuanyd has joined #openstack-cinder08:01
mulibyI worked around it for now by setting free_capacity_gb to 'infinite', but it would be nicer to fix this properly, either by forcing updated stats on every volume creation (can I do that from the driver?) or by fixing the free_capacity_gb calculation08:01
xuanydwhoami-rajat: Ok, i will update it right now.08:01
whoami-rajatxuanyd, okay. you don't have to do it right away, i just wanted a confirmation as we will cut stable/ussuri soon and i don't want the wrong releasenote to publish in it.08:03
whoami-rajatmuliby, are you using master or any stable branch?08:05
*** brinzhang_ has joined #openstack-cinder08:05
mulibywhoami-rajat I have only tested the driver on queens, rocky, and stein so far (customer requests...) but confirmed that this code is identical in Cinder master (https://github.com/openstack/cinder/blob/e5fe9b881cc06d94a077efd0fa4c73abb1781766/cinder/scheduler/host_manager.py)08:06
whoami-rajatmuliby, ok. the volume backend periodically reports the driver stats so i don't think its a good idea to change that08:08
*** brinzhang has quit IRC08:09
whoami-rajatmuliby, modifying the calculations seems reasonable, you can open a launchpad bug and also propose a solution upstream if you have one08:09
xuanydwhoami-rajat: Sorry, I do n’t quite understand what you mean, what should I do next08:10
mulibywhoami-rajat I thought of modifying the calculation to do something like this: self.free_capacity_gb = (volume size) / (max overprovision factor)08:10
muliby(for thinly provisioned systems, of course)08:11
mulibythat should have been -= not = of course, i.e., temporarily reduce the free_capacity_gb not by the full volume size, since it's thinly provisioned, but rather by the volume size divided by the max overprovisioning factor, i.e., the amount of space it is likely to consume shortly after having been created08:12
whoami-rajatxuanyd, i've merged your patch, you just need to propose a followup now.08:13
xuanydwhoami-rajat: ok, thanks very much, i will submit a new path latter.08:14
*** e0ne has joined #openstack-cinder08:16
whoami-rajatxuanyd, great. just don't forget about it :)08:17
*** tkajinam has quit IRC08:17
*** xinliang has joined #openstack-cinder08:18
kevinzmorning Cinder! I wonder do we support change volume backend after the volume backend is dead? we have cinder+ceph, and we removed the cinder volume service+Ceph osd in one host. but some volumes still have "os-vol-host-attr:host" to that cinder service. How could we migrate the volume to another host?08:19
*** zhanglong has joined #openstack-cinder08:25
whoami-rajatmuliby, so i'm not totally familiar with the code but i think the free_capacity_gb term is calculated from max_over_subscription_ratio parameter defined in cinder.conf and not the actual free_capacity of the backend08:27
mulibywhoami-rajat that's the way I would have expected it to be, but it seems incomplete -- here we reduce the entire volume size, which makes sense for a thick provisioned volume, but not for a thinly provisioned volume08:28
whoami-rajatmuliby, ack. so you're pointing at if the new volume size is 10 GB and 2 GB is used then we should only subtract 2 from the free capacity08:30
mulibywell, yes, but the problem here is that we don't know how much is actually going to be used soon until the next stats update, so I'm suggesting that if the volume size is 10GB and the max ovp factor is 20, we reduce only 0.5GB08:32
mulibywhich is a more accurate approximation of how much will be used shortly after creation08:33
mulibyI'll open a launchpad bug and we'll take it from there, thanks for the help!08:33
whoami-rajatmuliby, yeah, that seems like a reasonable issue08:34
whoami-rajatmuliby, thanks for finding and reporting it.08:35
whoami-rajatkevinz, i think the correct way to migrate is, setup the new backend, retype (migrate) all existing volumes to the new backend and then remove the config of previous backend.08:37
whoami-rajatkevinz, i'm not really sure your case is supported.08:37
Xuchuwhoami-rajat: for the thick provision, I think the capacity is dedicated for this volume, so I think cinder should subtract 10GB from free space.08:42
Xuchufor thin provision, cinder already has over_provision ratio,  I think subtract 10GB is ok too08:44
Xuchuover-provision capacity is a virtual capacity, thin capacity is a virtual capacity08:44
whoami-rajatXuchu, yep, we are discussing the scenario of only thin provisioning here08:45
whoami-rajatXuchu, as it makes sense to use MOSR but theoretically the allocated capacity should only account for the filled up space in the volume08:46
*** ykarel is now known as ykarel|lunch08:48
whoami-rajatXuchu, but we really can't account for that so whichever works, as i think now its the same thing to use free capacity * MOSR or free_cap = vol/MOSR08:48
whoami-rajatmuliby, ^^08:48
*** ociuhandu has quit IRC08:50
*** ociuhandu has joined #openstack-cinder08:57
*** zhanglong has quit IRC09:03
*** zhanglong has joined #openstack-cinder09:06
*** martinkennelly has joined #openstack-cinder09:08
mulibywhoami-rajat in the capacity filter, we indeed check free capacity * MOSR vs. volume size, the problem is that once free_capacity goes negative, free capacity * MOSR is negative as well. And it goes negative because we do free_capacity -= volume size after accepting it. So doing free_capacity -= volume size / MOSR seems like a reasonable solution09:08
*** lvbin02 has joined #openstack-cinder09:19
*** lvbin01 has quit IRC09:21
*** lvbin02 is now known as lvbin0109:21
*** ajitha has joined #openstack-cinder09:23
*** xinliang has quit IRC09:29
*** ajitha has quit IRC09:30
*** zhanglong has quit IRC09:35
*** brinzhang has joined #openstack-cinder09:36
*** zhanglong has joined #openstack-cinder09:38
*** brinzhang_ has quit IRC09:39
*** ykarel|lunch is now known as ykarel09:41
*** xuanyd has quit IRC09:42
kevinzwhoami-rajat: Hi, thanks for reply. Yeah I think it is reasonable, but we have already removed some backend volume services already, is there an easy way to recover or migrate the volumes?09:46
openstackgerritXuchu Jiang proposed openstack/cinder master: Add an option to specify iSCSI IP version  https://review.opendev.org/69863009:46
*** n-saito has quit IRC09:46
*** kaisers_ has joined #openstack-cinder09:47
whoami-rajatmuliby, as i said i'm not very familiar with that code but if that's the case then we should do free_capacity = free_capacity * MOSR and then free_capacity -= vol_size to minimize code change09:49
whoami-rajatkevinz, i don't have that much production experience to help you, maybe others could09:50
kevinzwhoami-rajat: thx :-)09:50
*** ykarel is now known as ykarel|meeting10:02
*** zhanglong has quit IRC10:08
*** Liang__ has quit IRC10:09
openstackgerritMerged openstack/cinder master: Add features for add backup id to volume metadata  https://review.opendev.org/70587610:27
openstackgerritRajat Dhasmana proposed openstack/cinder-tempest-plugin master: Add LVM+tgt tempest job  https://review.opendev.org/53765810:34
*** ykarel|meeting is now known as ykarel10:37
*** vishalmanchanda has joined #openstack-cinder10:40
openstackgerritRajat Dhasmana proposed openstack/cinder-tempest-plugin master: Add LVM+tgt tempest job  https://review.opendev.org/53765810:41
toskywhoami-rajat: another question (apart from the several questions in the reviews): is https://review.opendev.org/#/c/702495/ a more general version of https://review.opendev.org/#/c/620577/ ?11:17
whoami-rajattosky, If i understand your question clearly, they both are different tests but they both require common functions from tempest scenario manager so if it gets merged once we just require to write new tests only.11:22
toskyright11:25
*** lvbin02 has joined #openstack-cinder11:28
*** andrebeltrami has joined #openstack-cinder11:28
*** lvbin01 has quit IRC11:30
*** lvbin02 is now known as lvbin0111:30
*** rosmaita has quit IRC11:40
*** ociuhandu has quit IRC11:41
*** ociuhandu has joined #openstack-cinder11:42
*** rosmaita has joined #openstack-cinder11:42
*** muliby has quit IRC11:42
*** ociuhandu has quit IRC11:47
*** tkajinam has joined #openstack-cinder12:08
*** yaawang has quit IRC12:08
hemna_morning12:16
*** ociuhandu has joined #openstack-cinder12:45
*** lvbin02 has joined #openstack-cinder12:48
*** enriquetaso has joined #openstack-cinder12:48
*** lvbin01 has quit IRC12:50
*** lvbin02 is now known as lvbin0112:50
*** enriquetaso has quit IRC12:51
*** ociuhandu has quit IRC12:52
*** ociuhandu has joined #openstack-cinder12:59
*** ociuhandu has quit IRC13:00
*** ociuhandu has joined #openstack-cinder13:01
*** udesale_ has joined #openstack-cinder13:03
*** enriquetaso has joined #openstack-cinder13:04
*** udesale has quit IRC13:05
*** Luzi has joined #openstack-cinder13:09
*** ociuhandu has quit IRC13:32
*** ociuhandu has joined #openstack-cinder13:33
*** yaawang has joined #openstack-cinder13:47
openstackgerritSofia Enriquez proposed openstack/cinder-tempest-plugin master: Create new Ceph job with c-bak service enabled  https://review.opendev.org/71737913:50
*** dave-mccowan has joined #openstack-cinder13:59
*** _kukacz has joined #openstack-cinder14:02
*** tkajinam has quit IRC14:03
*** tkajinam has joined #openstack-cinder14:03
openstackgerritBrian Rosmaita proposed openstack/cinder master: RBD: add support for revert-to-snapshot  https://review.opendev.org/71033414:07
*** Luzi has quit IRC14:07
*** ajitha has joined #openstack-cinder14:08
*** dave-mccowan has quit IRC14:10
*** yaawang_ has joined #openstack-cinder14:11
*** yaawang has quit IRC14:14
openstackgerritXuan Yandong proposed openstack/cinder master: Update test and releasenote for bp: add-volume-backup-id  https://review.opendev.org/71812114:18
*** martinkennelly has quit IRC14:18
openstackgerritXuan Yandong proposed openstack/cinder master: Update test and releasenote for bp: add-volume-backup-id  https://review.opendev.org/71812114:32
*** xuanyd has joined #openstack-cinder14:33
*** tkajinam has quit IRC14:42
xuanydwhoami-rajat: hello, the patch has commited, please review it, thanks very much,https://review.opendev.org/#/c/718121/14:48
whoami-rajatxuanyd, great, i'm in a meeting right now, will review after that.14:49
whoami-rajatalso zuul hasn't run yet14:50
xuanydwhoami-rajat: ok, thanks14:51
*** xuanyd has quit IRC14:52
*** yaawang has joined #openstack-cinder14:53
*** yaawang__ has joined #openstack-cinder14:54
*** yaawang_ has quit IRC14:56
*** yaawang has quit IRC14:58
*** martinkennelly has joined #openstack-cinder15:03
*** ircuser-1 has joined #openstack-cinder15:11
*** rcernin has quit IRC15:13
rosmaitaany reviewer with an interest in cinderclient, please look at https://review.opendev.org/#/c/714572/15:39
rosmaitae0ne eharney geguileo hemna_ jungleboyj smcginnis whoami-rajat ^^15:39
jungleboyjrosmaita:  Done.15:44
smcginnisIf have (had) a few concerns on that one.15:45
rosmaitaoops15:46
rosmaitasmcginnis: not too late to stop it15:47
jungleboyjsmcginnis:  I just stopped it.15:47
smcginnisEh, I'm looking through the results of codesearch.o.o and not seeing anyone using it that way.15:48
smcginnisMy main concern was OSC or one of the packaging type projects like kolla or ansible.15:48
smcginnisLooks like maybe we're safe as far as the OpenStack hosted code goes.15:48
smcginnisjungleboyj: Go ahead with the +W, I think we're actually fine.15:49
smcginnisThanks15:49
jungleboyjsmcginnis:  Okdie dokie.  Thanks for checking.15:50
*** dpawlik has quit IRC16:00
*** _kukacz has quit IRC16:01
*** udesale_ has quit IRC16:08
*** ykarel is now known as ykarel|away16:10
*** ociuhandu has quit IRC16:18
*** ociuhandu has joined #openstack-cinder16:19
*** lpetrut has joined #openstack-cinder16:27
*** brinzhang has quit IRC16:30
*** brinzhang has joined #openstack-cinder16:31
*** ociuhandu has quit IRC16:42
*** ociuhandu has joined #openstack-cinder16:43
*** ociuhandu has quit IRC16:48
*** psachin has quit IRC16:55
*** lpetrut has quit IRC16:56
openstackgerritMerged openstack/python-cinderclient master: Replace bypass_url with os_endpoint  https://review.opendev.org/71457217:18
openstackgerritMerged openstack/python-cinderclient master: Remove autogen warning  https://review.opendev.org/71457717:19
*** martinkennelly has quit IRC17:30
openstackgerritSofia Enriquez proposed openstack/cinder-tempest-plugin master: WIP: Retype test added  https://review.opendev.org/71556617:47
*** vishalmanchanda has quit IRC17:47
*** brinzhang_ has joined #openstack-cinder17:51
*** brinzhang has quit IRC17:53
*** kaisers_ has quit IRC17:59
*** e0ne has quit IRC18:04
*** e0ne has joined #openstack-cinder18:37
*** enriquetaso has quit IRC18:40
*** raunak12 has joined #openstack-cinder18:44
*** e0ne has quit IRC18:45
*** Lucas_Gray has joined #openstack-cinder19:14
*** Lucas_Gray has quit IRC19:22
*** Lucas_Gray has joined #openstack-cinder19:22
*** lvbin02 has joined #openstack-cinder19:49
*** lvbin01 has quit IRC19:49
*** lvbin02 is now known as lvbin0119:49
*** ociuhandu has joined #openstack-cinder19:54
*** ociuhandu has quit IRC20:00
*** Lucas_Gray has quit IRC20:15
*** Lucas_Gray has joined #openstack-cinder20:21
openstackgerritEric Harney proposed openstack/cinder master: validator: Replace InvalidInput exception w/ InvalidName  https://review.opendev.org/70871320:22
*** Lucas_Gray has quit IRC20:42
*** Lucas_Gray has joined #openstack-cinder20:44
*** ajitha has quit IRC21:03
*** enriquetaso has joined #openstack-cinder21:04
*** ociuhandu has joined #openstack-cinder21:34
*** ociuhandu has quit IRC21:39
openstackgerritBrian Rosmaita proposed openstack/python-cinderclient master: Add release note for Ussuri cinderclient release.  https://review.opendev.org/71823421:39
rosmaitasmcginnis: lmk if that addresses your concern about https://review.opendev.org/#/c/714572/21:40
rosmaitajungleboyj: would also appreciate your feedback on https://review.opendev.org/71823421:41
*** enriquetaso has quit IRC21:51
*** rcernin has joined #openstack-cinder22:11
*** eharney has quit IRC22:20
*** Lucas_Gray has quit IRC22:36
*** tkajinam has joined #openstack-cinder22:56
*** yaawang__ has quit IRC23:16
*** yaawang__ has joined #openstack-cinder23:17
*** tosky has quit IRC23:26
*** raunak12 has quit IRC23:40
*** n-saito has joined #openstack-cinder23:48

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!