Wednesday, 2024-01-10

daleesmnasiadka: yep, we're following your lead with Calico's tigera-operator for the CAPI driver. Keeping simple Calico manifest for 1.27 in the Heat driver.01:26
mnasiadkahttps://review.opendev.org/c/openstack/magnum/+/894395 is passing, I guess it's time to say goodbye to Swarm07:17
mnasiadkadalees, jakeyip ^^07:17
jakeyipbye bye swarm :)07:30
jakeyipmnasiadka, dalees: around for the meeting later?07:33
mnasiadkaSure07:33
jakeyipI think we may have a number of things to discuss07:33
opendevreviewMichal Nasiadka proposed openstack/magnum-tempest-plugin master: Drop xena jobs after xena EOL  https://review.opendev.org/c/openstack/magnum-tempest-plugin/+/90519007:35
daleesyes, I'm around tonight07:53
jakeyipgreat :)07:54
jakeyiphi all, meeting in 10 mins, please feel free to populate https://etherpad.opendev.org/p/magnum-weekly-meeting if you have something to bring up08:53
jakeyip#startmeeting magnum09:00
opendevmeetMeeting started Wed Jan 10 09:00:20 2024 UTC and is due to finish in 60 minutes.  The chair is jakeyip. Information about MeetBot at http://wiki.debian.org/MeetBot.09:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.09:00
opendevmeetThe meeting name has been set to 'magnum'09:00
jakeyipAgenda:09:00
jakeyip#link https://etherpad.opendev.org/p/magnum-weekly-meeting09:00
jakeyip#topic Roll Call09:00
daleeso/09:00
jakeyipo/09:01
jakeyipmnasiadka: ping :) 09:01
mnasiadkao/09:01
jakeyiphi dalees mnasiadka, thanks for joining the meeting. hope you had a good holiday.09:02
mnasiadkawill be off for next two weeks for another vacation ;-)09:03
jakeyipniceeee :) 09:03
jakeyipalright I think that's everyone, let's get on with it09:04
jakeyip#topic Announcements09:04
jakeyipI would like to change things up a bit this year. I realised I've been dropping the ball a bit last year on deadlines. Thanks to the others who reminded me.09:06
jakeyipI would like to start meeting with a ping of deadlines we need to meet in near future so I can get on to things.09:06
jakeyipone example is  feature freeze R-5 (Feb 26 - Mar 01, mnasiadka brought it up 09:08
jakeyipanother is vPTG which should be in Apr09:08
jakeyipanything else we need to take note of?09:08
daleesMost deadlines will be on here, though I don't often look at it. Good to be reminded of upcoming ones - https://releases.openstack.org/caracal/schedule.html09:09
daleesI'd like to ask if there is a deadline for spec additions for Caracal. I have a couple in draft I've not uploaded yet. I see only Cinder and Nova specify deadlines for these.09:09
jakeyipdalees: for magnum? I am not aware of any, we can decide. follow nova for now? 09:11
daleestheirs is this week, so I'd prefer a little more. But yeah it can't be too close to R-509:12
jakeyipit doesn't have to be strict, still can upload after, it's just us09:12
jakeyipbigger projects like cinder and nova have many projects downstream of them so they need to be stricter09:12
daleesyep, ok.09:13
jakeyipspeaking of spec, capi spec needs +1 if nobody objects violently :P 09:14
jakeyipok back to deadlines, anything we (I) need to take note of?09:14
daleesI was just reading it again, I missed scrolling down to all of your updates in patchset 2. Yep I will +109:14
jakeyipthanks dalees 09:15
jakeyipclose to the topic of deadlines, I also would like to get a feel for people who are interested in taking over as PTL09:16
daleeskeen to continue supporting you, jakeyip 09:17
jakeyipI was quite slammed last yaer due to team members in my company being away, which caused me to drop the ball on some things. this year should be better (fingers crossed)09:18
jakeyipBut if anybody wants to take over PTL do let me know. I am all for new leadership. feel free to DM me etc to talk about it.09:19
jakeyipthanks dalees and mnasiadka for stepping up to help with release. :) 09:19
mnasiadkanp09:20
jakeyipdalees / mnasiadka: you keen on rotating for a cycle or so? or move to shared? hoppy to hear your opinions.09:20
mnasiadkaWell, from my perspective - if you're persistent on stepping down/rotating - I think dalees would be better candidate - but if he's not up for it, I can probably think about it.09:23
daleesI'll have a think about that and discuss with you later.09:23
jakeyipsure, I just want to put the idea out there, I don't want to be dictator for life. :P 09:24
jakeyipthanks al09:24
jakeyipthanks all09:25
mnasiadkabenevolent dictator for life? ;-)09:25
jakeyip#topic CAPI09:25
jakeyip:P 09:25
mnasiadkaAgain?09:26
mnasiadka:-)09:26
jakeyipsticky topic :) 09:26
mkjpryorHi all. Apologies for my late arrival - I had some issues connecting, not sure why...09:26
jakeyipwelcome mkjpryor :) 09:26
mkjpryorDid I miss anything critical?09:26
jakeyipjust in time for CAPI :P 09:27
daleesSo, CAPI topic was prompted by elodilles's question about the currently empty capi-helm repo.09:27
mkjpryorMy favourite :D09:27
jakeyipok let's knock out the elodilles question first. dalees you were looking at this, any updates?09:27
mkjpryorWhat was the question?09:28
daleeswell it's a bunch of helm charts that the driver uses; no point putting anything in there unless we're going to merge the driver (and thusly, fork the helm charts)?09:28
mkjpryorSo I think we are happy contributing the Helm charts to Magnum09:28
daleestravisholton and I are contributing to the upstream sources currently, under github.com/stackhpc/09:29
mkjpryorSo no need to fork - we should just change the canonical place where changes happen09:29
daleesmkjpryor: you mentioned last time becoming a core reviewer of this repo - you do have way more background and use cases than anyone.09:30
mkjpryorI suppose if Magnum adopts the Helm charts then I would be happy to own those and be a core reviewer for them09:30
mnasiadkaWell, but if we don't have a driver - then there's no purpose for that repo09:30
mkjpryorProbably for our driver too, if that gets adopted09:30
mnasiadkaand we'd need proper CI in that repo09:30
daleesmnasiadka: indeed09:31
mnasiadkaSo I think the way forward is either both driver and helm charts stay in GitHub, or we move them both to OpenDev under Magnum governance09:31
mkjpryormnasiadka: I don't actually agree with that statement. Even if we don't have the Magnum driver (yet) there is still value in the Magnum project owning the Helm charts as the best practice for deploying Kubernetes using CAPI on OpenStack09:31
mkjpryorYou don't have to use Magnum to do that09:32
mnasiadkaBut then you can't expect Magnum core team to own this09:32
mkjpryorI think we can if I join the core team, since that is basically how it works now09:32
mnasiadkaI'm not a fan of a single person repository that is completely not tied to anything in the project09:33
mkjpryorIt depends how we define the scope of Magnum I think. You can either say "Magnum is the API + drivers" or "Magnum provides mechanisms for deploying Kubernetes on OpenStack"09:33
mkjpryor:shrugs:09:33
mkjpryorI mean, selfishly, the way things are now means less work for me09:34
mkjpryorjakeyip: Have you already discussed progress on the driver discovery? Did I miss it?09:34
mkjpryorBecause that needs to be sorted before we can think about merging our driver.09:35
jakeyipbest practice is a ... sensitive term...09:35
mkjpryorYes09:35
mkjpryorAgreed09:35
jakeyipI am not keen to bring in helm chart without driver, so let's concentrate on that for now09:35
mkjpryorSo maybe it is better to wait until a CAPI driver is merged and do it then09:35
jakeyipyeap.09:36
mkjpryorSo I think the driver discovery is on the critical path to merging a CAPI driver. Where are we at with that?09:36
mkjpryor*improved driver discovery09:36
jakeyipconversely, we can merge capi driver without helm chart in currently release. just view it as an external dependency.09:37
jakeyipis that agreeable?09:38
jakeyipmkjpryor: I will get to the discovery in a bit09:38
mkjpryorThat would definitely work09:38
mkjpryorI think it would be good to have a reference implementation of the Helm charts owned by Magnum, but that can happen after the driver is merged09:39
daleesyes, Magnum could do without owning the charts repo for the short term, and while the driver remains beta.09:39
mkjpryorI think that is probably the correct way round to do it09:39
mkjpryorBut I do think in the long term we are keen for the Magnum project to own the Helm chart09:39
mnasiadkaBasically, if we want to merge anything, we have around 6 weeks time09:40
opendevreviewMerged openstack/magnum-tempest-plugin master: Drop xena jobs after xena EOL  https://review.opendev.org/c/openstack/magnum-tempest-plugin/+/90519009:40
jakeyipmkjpryor: yeap I think that is OK. glad we have it on record that StackHPC is OK with passing governace to OpenStack :P09:40
mkjpryorWe are open-first :D09:40
mnasiadkaJudging by the fact we haven't done anything in that direction since the start of the cycle, I feel a bit... concerned. ;-)09:40
jakeyipalright, so we don't worry about helm repo in this cycle09:41
mkjpryorAgreed09:41
jakeyipmnasiadka, mkjpryor: so majority of the code works. there is one thing on critical path which is the code for improve driver discovery09:41
mkjpryorThe thing I would like to see merged in this cycle is the improved driver discovery, which then opens up the possibility of basically merging our driver as-is in the next cycle (as beta)09:42
mnasiadkaI am not convinced that the current patches in Gerrit are the same as the current code in github repo09:42
mkjpryormnasiadka: No - they probably are not09:42
daleesthat answers elodilles' question, even if we do progress the driver. We won't require the empty capi helm to be part of the Openstack Release in Caracal09:42
jakeyipcode part is with me, apologies I haven't progressed much yet but I'll make time the next couple of week09:42
jakeyipI just have CKS on my plate, then I can knock this one out09:42
mnasiadkaAnd to be honest - I would prefer to get it all in one commit, since we're importing already working driver - it's not that the development of this driver is being done now and in the open.09:43
mkjpryor:thumbsup: Thanks jakeyip09:43
daleesmkjpryor: that seems like the achievable timeline - aim for the driver discovery improvements this cycle and the driver next.09:43
mkjpryormnasiadka - I would also propose that we abandon the current CAPI driver patches in Gerrit and start a new patchset that basically imports our driver09:44
jakeyipI do need everyone's help to review the spec and +1. normally spec comes before code :P but I think we can do it in parallel09:44
mkjpryorSince we know that it works09:44
jakeyipI just don't want objections to come AFTER I wrote all that code09:44
mkjpryorjakeyip: I can take a look at the spec after this meeting09:44
jakeyipthanks mkjpryor 09:44
daleesImprove driver discovery spec link: https://review.opendev.org/c/openstack/magnum-specs/+/90041009:44
jakeyipmnasiadka: got your point there, I think we can squash it, if we can make it basically noop with the combination of beta drivers, etc09:45
jakeyip* I think we can squash CAPI into a massive commit if it works and is a noop to anyone installing Magnum09:45
mnasiadkaSo - to get this simple - we improve driver discovery (and hopefully clean up old drivers) in 2024.1 - and aim for merging a CAPI driver in 2024.2?09:45
jakeyipyeah sounds good to me.09:46
mkjpryor+109:46
jakeyipstretch goal is 2024.1 CAPI :)09:46
jakeyipdepending on gofundme09:46
jakeyipor buymeacoffee.com :D 09:47
mnasiadkaWell, deployment projects already deliver a CAPI driver for Magnum in 2023.2 - so that's not a big hurry I guess09:48
mnasiadka(and that driver is not the driver we're trying to get merged)09:48
jakeyipjust kidding, not asking for $$$. I DO like to push if I can. I don't think there's much left to do for CAPI, all work is in improve driver discovery09:49
mnasiadkaI'm going to say again - I don't think the CAPI driver tempest CI jobs are in any shape right now ;-)09:50
jakeyipI've been running the current one in our dev cloud already09:50
jakeyipoh yeah ok that may be work09:50
jakeyipspeaking of tests, how's the work you are doing coming along mnasiadka?09:51
daleesplenty of work to do on the CAPI Helm driver, but it's viable as a driver, has reasonable unit tests and work continues in https://github.com/stackhpc/magnum-capi-helm/pulls ;)09:51
mnasiadkajakeyip: I have some time this week, so I'll get them working before my vacation - will notify when it's ready to merge.09:52
jakeyipin tempest IIRC there was a test to create a CT then a cluster, is that what CAPI tempest should do?09:53
mnasiadkadalees: there's the other driver with also a community behind it (and already shipped with OSA and Kolla), and I have a feeling that forever there will be two drivers - we just need to allow for both to be coexisting ;-)09:54
mnasiadkajakeyip: and deploy a CAPI mgmt cluster09:54
mnasiadkawithout that it's not going to work ;)09:54
mnasiadkaI would say we could try to improve that aspect after we get the driver merged09:54
mnasiadka(as in for users)09:54
jakeyipyeah devstack does that09:55
mkjpryorHow do OSA and Kolla solve the CAPI mgmt cluster problem?09:55
mnasiadkaOSA uses vexxhost kubernetes collection for deploying CAPI mgmt cluster09:55
mkjpryorIf they are already shipping the other driver?09:55
mnasiadkaKolla doesn't, you're on your own.09:55
mnasiadka(at least for now)09:55
mkjpryorI suppose it isn't really Kolla's problem09:55
mkjpryorThat is just the container builds right?09:56
mkjpryorI wonder what OSA does09:56
jrosserit depends if as a OSA deployment tool you want to give your users an out-of-the-box experience that just works09:56
jrosserthat is what i have aimed for with my OSA patches09:56
mnasiadkajrosser: did they get merged?09:56
jrossernot yet09:56
jrosserthe whole out-of-tree driver thing makes it tricky09:57
mnasiadkaok, 2024.1 then09:57
jrosserbut i am working on the patches right now09:57
mkjpryorjrosser: So how do you deploy the CAPI mgmt cluster in your current patches?09:57
jrosserusing the vexxhost ansible collection09:57
mnasiadkaKolla for now ships vexxhost driver in the image and supports copying kubeconfig (and disables the CAPI driver at all if no kubeconfig given, because that fails miserably)09:57
jrosserhttps://github.com/vexxhost/ansible-collection-kubernetes09:57
mkjpryorOK - so you deploy a Kubernetes cluster on the OpenStack control plane nodes?09:58
jrosseryes09:58
mkjpryorOr other nodes?09:58
mkjpryor:thumbsup:09:58
jrosseri think that opinion varies about how/where the mgmt cluster should live09:59
mnasiadkaYes, Kolla believes it should rather be an OpenStack instance10:00
jrosseri think we are very strict about network isolation for the control plane10:00
mkjpryorThe approach we usually use is to use CAPI to deploy a cluster in an OpenStack project using a K3S bootstrap instance10:01
jrosserwhich means you cant do that10:01
jakeyipok we are drifting. happy for this to continue, but I'd like to close meeting since we are at time10:01
mnasiadkayup10:01
mnasiadkaI'd like reviews on the Swarm drop10:01
mnasiadkaSo I could move to remove other drivers ;-)10:01
jakeyip#agree target 2024.1 for improve-driver-discovery10:01
jakeyip#agree target 2024.2 for CAPI Helm10:02
mnasiadka#link https://review.opendev.org/c/openstack/magnum/+/89439510:02
jakeyipmnasiadka: I've just spun my vagrant to test that... if only CI does that for me... :P 10:02
jakeyipalright, let's end10:03
jakeyip#endmeeting10:03
opendevmeetMeeting ended Wed Jan 10 10:03:18 2024 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)10:03
opendevmeetMinutes:        https://meetings.opendev.org/meetings/magnum/2024/magnum.2024-01-10-09.00.html10:03
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/magnum/2024/magnum.2024-01-10-09.00.txt10:03
opendevmeetLog:            https://meetings.opendev.org/meetings/magnum/2024/magnum.2024-01-10-09.00.log.html10:03
jakeyipthanks all for coming, please continue10:03
daleesmnasiadka: ack, it's a big change, but should be fairly clean. I'll see if I can spend some time on that.10:03
mnasiadkajakeyip: it will soon ;-)10:03
daleesmkjpryor: we do the same to bootstrap CAPI management cluster; and then add an additional ControlPlaneEndpoint to allow private workload clusters - important for a public cloud. Having CAPI management in the Openstack control plane gets around this with Vexxhosts proxy'ing - which is quite handy.10:10
daleesI'm looking forward to https://github.com/kubernetes-sigs/cluster-api/issues/5295 progressing, so less CAPI changes are required to enable this.10:10
opendevreviewMichal Nasiadka proposed openstack/magnum-tempest-plugin master: Add job for cluster tests  https://review.opendev.org/c/openstack/magnum-tempest-plugin/+/89313111:14
opendevreviewMichal Nasiadka proposed openstack/magnum-tempest-plugin master: Add job for cluster tests  https://review.opendev.org/c/openstack/magnum-tempest-plugin/+/89313111:17
opendevreviewMichal Nasiadka proposed openstack/magnum-tempest-plugin master: Add job for cluster tests  https://review.opendev.org/c/openstack/magnum-tempest-plugin/+/89313111:17
opendevreviewJake Yip proposed openstack/magnum master: Remove doc for rolling upgrade  https://review.opendev.org/c/openstack/magnum/+/90520911:27
opendevreviewMerged openstack/magnum master: Add validator for fixed_subnet  https://review.opendev.org/c/openstack/magnum/+/89750612:35
opendevreviewMichal Nasiadka proposed openstack/magnum-tempest-plugin master: Add job for cluster tests  https://review.opendev.org/c/openstack/magnum-tempest-plugin/+/89313116:08
opendevreviewMichal Nasiadka proposed openstack/magnum-tempest-plugin master: Add job for cluster tests  https://review.opendev.org/c/openstack/magnum-tempest-plugin/+/89313116:13
opendevreviewMichal Nasiadka proposed openstack/magnum-tempest-plugin master: Add job for cluster tests  https://review.opendev.org/c/openstack/magnum-tempest-plugin/+/89313117:40
opendevreviewMichal Nasiadka proposed openstack/magnum master: Add kubernetes fedora coreos v1 jobs  https://review.opendev.org/c/openstack/magnum/+/89624420:03
opendevreviewMichal Nasiadka proposed openstack/magnum master: Add kubernetes fedora coreos v1 jobs  https://review.opendev.org/c/openstack/magnum/+/89624420:04
opendevreviewMerged openstack/magnum master: Remove doc for rolling upgrade  https://review.opendev.org/c/openstack/magnum/+/90520920:30

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!