Wednesday, 2025-07-30

*** mhen_ is now known as mhen01:37
*** mhen_ is now known as mhen08:22
jbernard#startmeeting cinder14:00
opendevmeetMeeting started Wed Jul 30 14:00:49 2025 UTC and is due to finish in 60 minutes.  The chair is jbernard. Information about MeetBot at http://wiki.debian.org/MeetBot.14:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:00
opendevmeetThe meeting name has been set to 'cinder'14:00
jbernardjungleboyj rosmaita smcginnis tosky whoami-rajat m5z e0ne geguileo eharney jbernard hemna fabiooliveira yuval tobias-urdin adiare happystacker dosaboy hillpd msaravan sp-bmilanov Luzi sfernand simondodsley: courtesy reminder14:01
jayaanandhi14:01
jbernard#topic roll call14:01
jbernardo/ hello everyone14:01
gireesho/14:01
Saio/14:01
nileshthathagarhi14:01
jungleboyjo/14:02
simondodsleyo/14:03
hvlcchao1o/14:04
whoami-rajat__Hi14:04
jbernard#link https://etherpad.opendev.org/p/cinder-flamingo-meetings14:04
vdhakadhi14:04
jbernardwelcome everyone,14:05
jbernardthis may be a short meeting, we'll see14:05
jbernard#link https://releases.openstack.org/flamingo/schedule.html14:06
jbernard^ current flamingo schedule14:06
jbernardwhoami-rajat__: if you're here, i now simondodsley has/had some questions about the openstack sdk and some functions that seemed to be missing14:07
simondodsleyyes, yes...14:07
jbernardwhoami-rajat__: i thought you might be most qualified to respond14:07
whoami-rajat__Sure14:08
simondodsleyThere is a list of cinder features not present in the SDK so I can't (easily) create Ansible modules for these in the OpenStack collection.14:09
simondodsleyI'd like to know if these will ever be added?14:09
simondodsleyThe most concerning is lack of support for QoS14:10
simondodsleyI created this: https://etherpad.opendev.org/p/cinder-openstacksdk-gaps but there is a much bigger sheet on this subject as well14:11
whoami-rajat__Openstacksdk is definitely missing some support, i was working on getting it up to date but my work ended after reaching parity with openstackclient which was some releases ago14:12
whoami-rajat__Regarding the current state, i had prepared some google docs at that time which can depict what we have and what we dont14:12
whoami-rajat__Currently i am not actively working on it due to other priority work14:12
whoami-rajat__And we as a team decided that an intern could pick it up, but i havent heard about any outreachy or any other type of intern in a while14:13
whoami-rajat__So to answer your question, i can’t guarantee that the work will be over, surely i can spare some cycles for specific important operations if its blocking work for vendors - but will require my manager’s approval first14:14
simondodsleyAs OpenStack becomes more important and has greater visibility the automation side of the house is coming under scrutiny and the lack of Ansible modules for basic functions is an issue.  QoS is a pretty fundamental requirement for MSPs so this hole is glaring14:15
simondodsleyI'm happy to write the ANsible modules, but I need the SDK to have the functions to call14:15
whoami-rajat__I understand and agree with your concerns and its not that hard to add the support, just its time consuming to code and test14:17
jbernardre an intern, i think outreachy is having some funding pressure, it's my impression that we were not likely to have an intern candidate in the near future14:17
simondodsleyHappy to work with you on this14:17
whoami-rajat__Anyways, we can talk about it after the meeting if you can share a list of few important operations (like qos), i can initiate a discussion to get some time working on it14:18
whoami-rajat__jbernard: ah, i thought so, thanks for the update14:18
jbernardwe don't have much in the way of topics today14:20
vdhakad@Brian/ @core-members, IBM third party CI is up, requesting reviews on [IBM SVf driver] Adding support for temporary volumegroup | https://review.opendev.org/c/openstack/cinder/+/92545014:20
simondodsleyAdd it to the list: https://etherpad.opendev.org/p/cinder-flamingo-reviews14:21
harshhi.. added a few more reviews for IBM SVf drivers in the list under the name "harsh". They are also part of the same volumegroup feature.14:22
Anoop_ShuklaHeads Up - NetApp team is working on support for ASAr2 platform and there will be some PRs upcoming for reviews. We are looking to support basic Volume operations in Flamingo. Upcoming release will have other operations supported.14:22
jbernardvdhakad: the ci results would be more helpful if we could see what tests were run and what the outcome was, as opposed to the stdout dump14:22
simondodsleySo on that subject...14:23
jbernardim personally looking at tobias' patches this week14:23
jbernardspecifically adding az support to backupws14:23
simondodsleyPart of the issue with seeing the logs through gerrit is that Zuul have deprecated a pamater that allows gerrit to get the correct URL location of the logs14:23
simondodsleyso it will only point to the zuul webserver url - this means anyone with a CI behind a firewall won't be able to expose the logs14:24
jbernardsimondodsley: have you inquired about what they envision as the proper way to see logs?14:24
simondodsleythe say that the zuul dashboard is the correct way - they completely ignored corporate security...14:25
simondodsleythe other option is to set up some reverse proxy, but again corporate security may have a negative opinion of that14:25
jbernarddo they have any advice? or we're on our own for that?14:25
simondodsleythe only advice is 'use a reverse proxy' - not particularly helpful14:26
simondodsleywe have managed to get to the logs into  apublic guthub repo with a custome zuul role, but the issue is getting the gerrit response to contain that url14:26
vdhakadjbernard: List of test cases can be found here: https://github.com/vp0410/IBM-Cinder-CI/blob/main/925450/37/fc_summary.log14:27
jbernardsimondodsley: it looks like vdhakad was successful, im looking a this one: https://review.opendev.org/c/openstack/cinder/+/92545014:27
jbernardvdhakad: ahh, thank you14:28
jbernardsimondodsley: ^ could you do something like that?14:28
harshyuo. the std out has the list of all the testcase summary for iscsi and fc both.14:28
simondodsleywould love to - vdhakad: can we talk about your config offline?14:28
harshyes *14:28
jbernardharsh: yep, i see the summary now, i had missed that earlier14:29
harsh:) np14:29
vdhakadsimondodsley: Sure. I'll include vivek from my team, he understands the config best.14:29
simondodsleythanks14:29
jbernardif that works out, it would be really nice to capture that in a doc somewhere14:30
jbernard#topic open discussion14:31
jbernardif noone has anything else to add, we can end early14:34
Anoop_ShuklaI had a question about DR support on Cinder.14:35
jbernardAnoop_Shukla: sure14:35
Anoop_ShuklaVMWare has a tool called SRM (Site Recovery Manager) that a lot of Virtualization customers are used to.. 14:35
gireeshThere are list of pending patches for review, requested to core team to looked into those 14:36
Anoop_ShuklaA lot of customers migrating from VMWare are asking for a similar support on OpenStack14:36
Anoop_ShuklaAre there any integrations/tools that can provide similar DR (VM level recovery between two sites with two OpenStack deployments)?14:36
jbernardAnoop_Shukla: im not familiar with what features SRM offers, but we have support for replication in participating drivers14:37
harshin a previous meeting we discussed about having a review day for non-S reviews. Are there any updates on that?14:37
Anoop_ShuklaRight. But today recovery on the VMs is manual..14:37
jbernardharsh: ahh, will send a mail about that today, thanks for reminding me14:38
harsh:) np, thanks 14:38
whoami-rajat__Anoop_Shukla: yeah there is no automated way but i have proposed a documentation that will guide you step by step to recover your workloads14:38
Anoop_ShuklaOkay. Is there a link to that document?14:38
whoami-rajat__I will need to find it as i am afk, jbernard i remember you reviewing it, is it possible for you to post the link here?14:39
Anoop_ShuklaWe wanted to see if we can hack something using metadata between two deployments where the recovery can be automated between two sites by creating a recovery plan of some sort..14:39
whoami-rajat__Okay i found it https://review.opendev.org/c/openstack/cinder/+/95085914:41
jbernardhttps://review.opendev.org/c/openstack/cinder/+/95085914:41
jbernard^ i think that's the one14:41
whoami-rajat__Thanks14:41
Anoop_ShuklaFYI VMWare Site Recovery Manager Documentation: https://www.vmware.com/docs/site-recovery-manager-technical-overview14:41
whoami-rajat__Which backend are you using Anoop_Shukla ?14:42
Anoop_Shukla👍14:42
Anoop_ShuklaWe are planning for NetApp driver14:42
whoami-rajat__Ack, fc?14:43
Anoop_ShuklaiSCSi to start with..14:43
whoami-rajat__Okay, ideally the procedure should work for all but its using ceph rbd as a reference14:43
gireeshthis is replication at storage level, Anoop point is DR solution across 2 different site (between 2 openstack cluster)14:43
gireeshand that will be at Nova level, DR for vms 14:44
Anoop_ShuklaYes14:44
whoami-rajat__its related to DR using the rbd mirror utility and it covers the scenarios for boot from volume and external data volumes14:44
gireeshI think we don't have this solution available in OpenStack and now OpenStack is picking up fast so now customer is asking this kind of solution in OpenStack 14:44
whoami-rajat__For testing i deployed both clusters in single node but i have tested DR across two different openstack clusters as well14:45
gireeshif one site went down how my vms will automatically migrated to other site 14:45
whoami-rajat__There is no automatic migration, everything happens manually with the failover operations14:46
whoami-rajat__Openstack is not as tightly coupled as vmware and supporting this kind of DR automation is a complex task in OpenStack14:46
Anoop_ShuklaYes. That is where we need some sort of communication/pairing between two OpenStack deployments (may be at Nova level). If the metadata can be synced between two different site deployments, since storage can be failed over on site B storage, it would be just recovering the VM and creating instance on secondary OpenStack deployment.14:47
whoami-rajat__Though the failover operation does migrate all volumes for a particular backend, the vm recovery remains manual14:47
Anoop_ShuklaAgreed. But if site A is lost, VM/Instant metadata is lost..14:48
whoami-rajat__I don’t think any such effort if being pursued upstream14:49
Anoop_ShuklaOkay14:50
Anoop_ShuklaAre there any third party tools available to help on these use cases?14:51
whoami-rajat__Replication has been a feature upstream since several releases so i assume someone would have build tooling around it though i am not aware of any14:53
simondodsleyFYI there is, in the very early stages, a project to create an SRM-like tool for OpenStack14:55
Anoop_ShuklaOh..is there a link/documentation available for that?14:55
simondodsleyNot yet - still in early stages - will be done based on a commerical project initially and leveraging cinder replication, but also using Ansible to perform some of the failover tasks14:56
Anoop_Shuklaokay14:57
Anoop_ShuklaThere is also a solution for MetroCluster available on VMware called vMSC - which provides a active active failover across sites..via multipathing14:58
simondodsleyPure also has ActiveCluster which does the same thing14:58
Anoop_ShuklaRight. NetApp also has active sync on storage layer. But the RTO is completely dependent on how long it takes for the VMs to be recovered on secondary site..14:59
Anoop_Shuklawithout a host level support its hard to get 0 RTO14:59
jbernardok, we're at time15:00
jbernard#endmeeting15:01
opendevmeetMeeting ended Wed Jul 30 15:01:12 2025 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:01
opendevmeetMinutes:        https://meetings.opendev.org/meetings/cinder/2025/cinder.2025-07-30-14.00.html15:01
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/cinder/2025/cinder.2025-07-30-14.00.txt15:01
opendevmeetLog:            https://meetings.opendev.org/meetings/cinder/2025/cinder.2025-07-30-14.00.log.html15:01
jbernardthanks everyone15:01
jungleboyjThanks!15:01
whoami-rajat__Thanks15:02
Anoop_ShuklaThanks!15:02
jayaanandthank you!15:02
SaiThanks!!15:03

Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!