Thursday, 2021-04-01

*** hamalq has quit IRC00:02
*** carloss has quit IRC00:06
*** martinkennelly has quit IRC00:13
*** ikla has joined #openstack-cinder00:20
iklacan I use ceph for my instance and local disk for ephemeral storage?00:20
iklaappears to be either or rbd or local00:20
iklaor can I pass a local partition in?00:20
*** ikla has quit IRC00:36
*** xuany has joined #openstack-cinder00:55
*** rcernin_ has joined #openstack-cinder00:59
*** rcernin has quit IRC00:59
*** ikla has joined #openstack-cinder01:15
iklaanyone alive?01:15
*** zenkuro has quit IRC01:52
*** zenkuro has joined #openstack-cinder01:54
*** brinzhang_ is now known as brinzhang02:04
*** rcernin_ has quit IRC02:20
*** zenkuro has quit IRC02:21
*** rcernin_ has joined #openstack-cinder02:25
*** rcernin_ has quit IRC02:39
*** rcernin_ has joined #openstack-cinder02:40
*** rcernin_ has quit IRC03:01
*** rcernin_ has joined #openstack-cinder03:07
*** ykarel|away has joined #openstack-cinder03:50
*** tkajinam has quit IRC03:51
*** tkajinam has joined #openstack-cinder03:51
*** tkajinam has quit IRC03:52
*** tkajinam has joined #openstack-cinder03:53
*** ykarel|away is now known as ykarel03:54
*** ajitha has joined #openstack-cinder03:59
*** GirishChilukuri has joined #openstack-cinder04:04
*** whoami-rajat has joined #openstack-cinder04:17
*** m75abrams has joined #openstack-cinder04:19
*** Luzi has joined #openstack-cinder05:31
*** udesale has joined #openstack-cinder05:58
*** tkajinam has quit IRC06:02
*** tkajinam has joined #openstack-cinder06:03
*** tkajinam has quit IRC06:03
*** tkajinam has joined #openstack-cinder06:03
*** lpetrut has joined #openstack-cinder06:30
*** happyhemant has joined #openstack-cinder06:48
*** rcernin_ has quit IRC07:03
*** GirishChilukuri_ has joined #openstack-cinder07:06
*** lemko has joined #openstack-cinder07:08
*** GirishChilukuri has quit IRC07:09
*** sapd1 has joined #openstack-cinder07:23
zigorosmaita: That's good, especially pointing at the Bullseye release notes, however a few remarks:07:32
zigo1/ this is not Debian specific, as much as I understand07:32
zigo2/ this is not only for the volume-copy, but also when using qos as per https://docs.openstack.org/cinder/latest/admin/blockstorage-basic-volume-qos.html07:32
zigo3/ I would stronlgy advice to put in the release notes the kernel command line parameters: "systemd.unified_cgroup_hierarchy=false systemd.legacy_systemd_cgroup_controller=false"07:32
zigoYou have my +1 despite the remarks for enhancements ... :)07:33
*** tosky has joined #openstack-cinder07:45
*** ociuhandu has joined #openstack-cinder07:56
*** MrClayPole has quit IRC08:01
*** MrClayPole has joined #openstack-cinder08:03
*** ykarel has quit IRC08:03
*** ykarel has joined #openstack-cinder08:05
openstackgerritkatari manoj kumar proposed openstack/cinder master: [SVF]:Fix add volumes to replicated group  https://review.opendev.org/c/openstack/cinder/+/78409208:14
*** ociuhandu has quit IRC08:14
*** ociuhandu has joined #openstack-cinder08:15
*** ociuhandu has quit IRC08:21
*** martinkennelly has joined #openstack-cinder08:29
*** ociuhandu has joined #openstack-cinder08:29
*** zenkuro has joined #openstack-cinder08:32
*** ociuhandu has quit IRC08:34
*** sapd1 has quit IRC08:35
openstackgerritMerged openstack/cinder stable/wallaby: Use os-brick 4.3.1  https://review.opendev.org/c/openstack/cinder/+/78403908:40
openstackgerritMerged openstack/cinder master: Set Wallaby maximum mv in REST API version history  https://review.opendev.org/c/openstack/cinder/+/78391508:40
*** ociuhandu has joined #openstack-cinder08:44
*** ociuhandu has quit IRC08:49
*** ociuhandu has joined #openstack-cinder08:50
*** ociuhandu has quit IRC08:50
*** ociuhandu has joined #openstack-cinder08:51
*** ykarel is now known as ykarel|lunch08:58
*** zenkuro has quit IRC09:00
*** zenkuro has joined #openstack-cinder09:01
*** ociuhandu has quit IRC09:01
*** zenkuro has quit IRC09:05
*** ociuhandu has joined #openstack-cinder09:14
openstackgerritMerged openstack/cinder master: Add quota utils to cinder-manage  https://review.opendev.org/c/openstack/cinder/+/77695109:44
openstackgerritMerged openstack/cinder master: Change snapshots type with volume retype  https://review.opendev.org/c/openstack/cinder/+/78151509:54
*** sapd1 has joined #openstack-cinder09:56
*** elod is now known as elod_afk10:01
geguileorosmaita: I see you are already giving +W to more quota patches, thanks  :-)10:02
*** zzzeek has quit IRC10:03
*** zzzeek has joined #openstack-cinder10:05
openstackgerritGorka Eguileor proposed openstack/cinder stable/wallaby: Change snapshots type with volume retype  https://review.opendev.org/c/openstack/cinder/+/78436110:09
openstackgerritGorka Eguileor proposed openstack/cinder stable/wallaby: Add quota utils to cinder-manage  https://review.opendev.org/c/openstack/cinder/+/78436210:09
geguileorosmaita: ^ the first 2 backports of patches that have already merged in master10:09
*** ykarel|lunch is now known as ykarel10:10
*** xuany has quit IRC10:22
*** carloss has joined #openstack-cinder10:30
*** ociuhandu has quit IRC10:39
*** m75abrams has quit IRC10:50
*** sapd1 has quit IRC10:53
*** m75abrams has joined #openstack-cinder10:59
*** bluex has joined #openstack-cinder11:03
*** bluex has quit IRC11:07
*** bluex has joined #openstack-cinder11:07
*** ociuhandu has joined #openstack-cinder11:09
*** rcernin_ has joined #openstack-cinder11:11
*** bluex has quit IRC11:12
*** bluex has joined #openstack-cinder11:13
*** sapd1 has joined #openstack-cinder11:20
*** ociuhandu has quit IRC11:23
*** nikparasyr has joined #openstack-cinder11:36
*** rcernin_ has quit IRC11:48
*** ociuhandu has joined #openstack-cinder11:52
rosmaitageguileo: ty11:54
rosmaitazigo: thanks for the review11:56
*** ociuhandu has quit IRC11:57
*** ociuhandu has joined #openstack-cinder12:08
openstackgerritMerged openstack/cinder master: Remove unused quota python classes  https://review.opendev.org/c/openstack/cinder/+/77801712:10
*** GirishChilukuri_ has quit IRC12:11
*** GirishChilukuri_ has joined #openstack-cinder12:11
*** ociuhandu has quit IRC12:13
openstackgerritRajat Dhasmana proposed openstack/cinder stable/wallaby: Remove unused quota python classes  https://review.opendev.org/c/openstack/cinder/+/78439912:22
*** ociuhandu has joined #openstack-cinder12:24
*** bhagyashris has quit IRC12:28
*** ociuhandu has quit IRC12:29
*** bhagyashris has joined #openstack-cinder12:29
*** sapd1 has quit IRC12:31
*** ociuhandu has joined #openstack-cinder12:40
*** ociuhandu has quit IRC12:47
*** stand has joined #openstack-cinder12:55
*** m75abrams has quit IRC12:56
*** ociuhandu has joined #openstack-cinder13:00
*** ociuhandu has quit IRC13:04
*** ociuhandu has joined #openstack-cinder13:05
hemna_mep13:13
rosmaitagood morning13:15
hemna_hey man13:18
hemna_are you or geguileo familiar w/ the backup process ?13:18
hemna_we are getting lots of backup failures due to the backup manager getting rpc timeouts here:  https://github.com/openstack/cinder/blob/master/cinder/backup/manager.py#L464-L46613:20
hemna_that is an rpc call (waits for return)13:20
hemna_which calls the volume manager to clone a volume13:21
hemna_that cloning process can take a very long time.13:21
hemna_the vmware driver creates a full clone to create a temp volume that can be safely backed up13:21
hemna_the default rpc timeout is 300 seconds.   a full clone can take hours13:21
hemna_2TB volumes13:22
hemna_that should be a cast, not a call13:22
hemna_but then the driver would have to rpc back to the backup manager to continue on after the backup device is available13:23
openstackgerritMerged openstack/os-brick stable/ussuri: iSCSI: Fix flushing after multipath cfg change  https://review.opendev.org/c/openstack/os-brick/+/78409513:23
toskyand now time for the stable/train backport of ^^13:25
hemna_so backup is basically broken13:25
*** Luzi has quit IRC13:25
tosky( https://review.opendev.org/c/openstack/os-brick/+/784097 )13:25
hemna_this is the same bug: https://bugs.launchpad.net/cinder/+bug/191684313:26
openstackLaunchpad bug 1916843 in Cinder "Backup create failed: RBD volume flatten too long causing mq to timed out." [Medium,Incomplete]13:26
*** m75abrams has joined #openstack-cinder13:28
*** jgriffith has joined #openstack-cinder13:31
hemna_we need to decouple the backup process to make it async in order for this to always work13:33
hemna_it's totally broken as it is13:34
rosmaitahemna_: e0ne is my go-to guy for backup issues13:35
hemna_this might not be that hard to do13:36
rosmaitasounds like we should discuss at the PTG13:36
hemna_basically have to switch the call to a cast13:36
hemna_and then the volume manager has to do a cast back to the backup manager when the driver is done creating the temp clone13:36
hemna_I'm going to try and write something.  I need it asap, due to backup being completely broken for customers as is13:36
rosmaitaok, then we will have something to look at at the PTG13:37
hemna_when is that?13:38
rosmaitaweek of 19 April13:38
hemna_ok13:38
*** m75abrams has quit IRC13:43
*** GirishChilukuri has joined #openstack-cinder14:04
*** GirishChilukuri_ has quit IRC14:07
*** GirishChilukuri_ has joined #openstack-cinder14:07
*** GirishChilukuri has quit IRC14:11
*** sapd1 has joined #openstack-cinder14:20
*** ajitha has quit IRC14:24
*** elod_afk is now known as elod14:29
*** lbragstad has quit IRC14:36
openstackgerritkatari manoj kumar proposed openstack/cinder master: [SVF]:Fix add volumes to GMCV group  https://review.opendev.org/c/openstack/cinder/+/78409214:39
*** lpetrut has quit IRC14:45
*** haixin has joined #openstack-cinder14:51
*** tkajinam has quit IRC15:02
*** haixin has quit IRC15:07
*** haixin has joined #openstack-cinder15:07
*** GirishChilukuri has joined #openstack-cinder15:15
*** GirishChilukuri_ has quit IRC15:18
*** GirishChilukuri_ has joined #openstack-cinder15:18
*** GirishChilukuri has quit IRC15:22
*** ykarel is now known as ykarel|away15:43
*** whoami-rajat has quit IRC15:47
*** ykarel|away has quit IRC15:53
*** ociuhandu has quit IRC16:00
*** haixin has quit IRC16:00
*** nikparasyr has left #openstack-cinder16:11
*** GirishChilukuri has joined #openstack-cinder16:12
*** GirishChilukuri_ has quit IRC16:15
*** GirishChilukuri_ has joined #openstack-cinder16:16
*** GirishChilukuri has quit IRC16:19
*** ociuhandu has joined #openstack-cinder16:27
*** happyhemant has quit IRC16:27
*** ociuhandu has quit IRC16:33
*** hamalq has joined #openstack-cinder16:40
*** GirishChilukuri has joined #openstack-cinder16:51
*** GirishChilukuri_ has quit IRC16:54
*** GirishChilukuri_ has joined #openstack-cinder16:55
*** GirishChilukuri_ has quit IRC16:58
*** GirishChilukuri has quit IRC16:59
openstackgerritVictoria Martinez de la Cruz proposed openstack/devstack-plugin-ceph master: Enable testing Ceph master  https://review.opendev.org/c/openstack/devstack-plugin-ceph/+/77215717:03
*** udesale has quit IRC17:14
openstackgerritEric Harney proposed openstack/cinder master: mypy: annotate volume_utils / utils / exc  https://review.opendev.org/c/openstack/cinder/+/73685517:56
openstackgerritEric Harney proposed openstack/cinder master: mypy: image_utils  https://review.opendev.org/c/openstack/cinder/+/77428617:56
openstackgerritEric Harney proposed openstack/cinder master: mypy: continued manager, scheduler, rpcapi  https://review.opendev.org/c/openstack/cinder/+/78445317:56
openstackgerritMerged openstack/cinder master: LVM: Fix delete volume error due to lvs failure  https://review.opendev.org/c/openstack/cinder/+/78366017:59
*** ykarel|away has joined #openstack-cinder18:13
*** ykarel|away has quit IRC18:25
openstackgerritMerged openstack/cinder stable/wallaby: Cinder - Creating clone of encrypted volume fails  https://review.opendev.org/c/openstack/cinder/+/78410918:26
openstackgerritMerged openstack/cinder stable/wallaby: Add prelude for Wallaby release notes  https://review.opendev.org/c/openstack/cinder/+/78393718:26
openstackgerritEric Harney proposed openstack/cinder master: mypy: annotate volume_utils / utils / exc  https://review.opendev.org/c/openstack/cinder/+/73685518:59
openstackgerritEric Harney proposed openstack/cinder master: mypy: image_utils  https://review.opendev.org/c/openstack/cinder/+/77428618:59
openstackgerritEric Harney proposed openstack/cinder master: mypy: continued manager, scheduler, rpcapi  https://review.opendev.org/c/openstack/cinder/+/78445318:59
hemna_I might be close to having a POC fix for the backup manager <---> volume manager failures19:19
*** rosmaita has left #openstack-cinder19:41
openstackgerritBrian Rosmaita proposed openstack/cinder stable/wallaby: LVM: Fix delete volume error due to lvs failure  https://review.opendev.org/c/openstack/cinder/+/78440719:41
hemna_backup worked :) phew19:55
*** ociuhandu has joined #openstack-cinder20:20
hemna_going to put up a WIP patch (no unit test changes)20:26
*** ociuhandu has quit IRC20:38
openstackgerrithemna proposed openstack/cinder master: WIP: Rework backup process to make it async  https://review.opendev.org/c/openstack/cinder/+/78447720:39
*** ociuhandu has joined #openstack-cinder21:38
*** lemko9 has joined #openstack-cinder21:42
*** ociuhandu has quit IRC21:42
*** lemko has quit IRC21:42
*** lemko9 is now known as lemko21:42
*** eharney has quit IRC22:54
*** tkajinam has joined #openstack-cinder22:57
*** tkajinam has quit IRC22:57
*** tkajinam has joined #openstack-cinder22:58
*** tosky has quit IRC23:40
*** martinkennelly has quit IRC23:41
*** martinkennelly has joined #openstack-cinder23:41
openstackgerritMerged openstack/cinder master: Quota: Fix until_refresh config changes  https://review.opendev.org/c/openstack/cinder/+/77821023:57

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!