Monday, 2025-05-12

arne_wiebalckGood morning, Ironic!06:39
rpittaugood morning ironic! o/06:42
zigoMy CI doesn't have the issues of the one upstream OpenStack, packages don't change, and never break.07:12
zigoThough I don't have Ironic in my functional tests ... :/07:12
opendevreviewRiccardo Pittau proposed openstack/bifrost master: [WIP] use Pyhon 3.12 on centos9  https://review.opendev.org/c/openstack/bifrost/+/94944908:00
queensly[m]Good morning08:01
abongaleGood morning Ironic!08:03
opendevreviewVerification of a change to openstack/ironic master failed: provide host_id to neutron early on  https://review.opendev.org/c/openstack/ironic/+/94637808:10
opendevreviewRiccardo Pittau proposed openstack/ironic master: Make metal3 job voting again  https://review.opendev.org/c/openstack/ironic/+/94945808:14
rpittaucan we please stop making the metal3 job non-voting every time there is a tiny issue? was it even not working or was it made non-voting just because it was running Python 3.9 ?08:21
rpittauI don't see ironic dropping python 3.9 recently, it's still supported https://opendev.org/openstack/ironic/src/branch/master/setup.cfg#L1908:21
zigoJayF: oslo.messaging has no get_grpc_client, how did you do the backport then?08:59
zigoTo Zed I mean...09:00
zigoShould I backport https://review.opendev.org/c/openstack/oslo.messaging/+/869899 and https://review.opendev.org/c/openstack/oslo.messaging/+/862419 to Oslo messaging ?09:01
opendevreviewRiccardo Pittau proposed openstack/bifrost master: [WIP] use Pyhon 3.12 on centos9  https://review.opendev.org/c/openstack/bifrost/+/94944909:01
opendevreviewMerged openstack/networking-generic-switch master: Correctly set use_keys when key_file is set  https://review.opendev.org/c/openstack/networking-generic-switch/+/94877409:16
opendevreviewMerged openstack/metalsmith master: Fix metadata generation  https://review.opendev.org/c/openstack/metalsmith/+/94752309:42
iurygregorygood morning Ironic09:44
dtantsurrpittau: I suspect not all dependencies could be installed at that point?10:28
rpittaudtantsur: probably, but I remember discussing at least adding a revert as a reminder? I get unblocking ci, but following that all the cs9 jobs should be non voting or removed? Including all dib IPA jobs? I'm trying to understand what the criteria is here10:47
dtantsuryeah, a revert should have been created10:47
opendevreviewRiccardo Pittau proposed openstack/bifrost master: [WIP] use Pyhon 3.12 on centos9  https://review.opendev.org/c/openstack/bifrost/+/94944911:30
opendevreviewHarald Jensås proposed openstack/sushy-tools master: Status code 501 for Unsupported/Not implemented  https://review.opendev.org/c/openstack/sushy-tools/+/94950012:32
TheJuliagood morning13:07
*** iurygregory_ is now known as iurygregory13:08
iurygregorygood morning TheJulia 13:09
JayFrpittau: Even though our setup.cfg hasn't been updated, the documented runtime for the f release does not include 3.9 and the requirements for 3.9 were already removed from the constraints list13:33
JayFWhat's the appropriate action for us to take when metal3 jobs are blocking merge due to an upstream change that we can't revert and when there's no engineers from that team to repair it?13:34
TheJuliabraaaains13:55
TheJuliaThe most appropriate action is likely to update the job to either use a newer specific python or stream version in the job, however that may ultimately also be a heavier lift than a quick packaging change. Bottom line though, it is akin to rolling with the punches13:56
rpittauJayF: as I wrote in my message, I perfectly understand the need to unblock ci, but no revert was created for that14:17
rpittauif we don't support Python 3.9 anymore, just because the f release does not support it, then let's be explicit and remove all the jobs that use that, including all the DIB ipa jobs and the ipa-builder jobs14:17
JayFzigo: are we talking about different bugs?14:17
JayFzigo: that image change doesn't use any oslo.messaging buts?14:17
JayFthe no revert is my fault for sure14:18
JayFhttps://governance.openstack.org/tc/reference/runtimes/2025.2.html is the updated runtime information if anyone wants to perform the maintenance needed to update CI.14:18
rpittauwe're not the only project still using python 3.914:19
rpittauI've reverted the change in requirements, just took some talking and a bit of understanding to grant time for a proper migration14:19
JayFah, nice14:20
JayFI don't ask requirements for reverts unless I know specifically why/what14:20
JayFbecause of how hard they work to get the updates in14:20
JayFs/don't/rarely/14:20
JayFso I usually assume it's all on us to be compatible if possible14:21
rpittauJayF: indeed, but compatibility requires time and a proper plan14:21
JayFmakes sense, in the moment I'm pretty sure it was just "oh no breaky" and me working on a CVE in the background so just trying to barrel thru14:30
opendevreviewJay Faulkner proposed openstack/ironic unmaintained/zed: OSSA-2025-001: Disallow unsafe image file:// paths  https://review.opendev.org/c/openstack/ironic/+/94917614:36
dtantsurJayF: note: it's not "metal3 job got broken", it's "we broke a significant downstream consumer (and potentially more)"14:43
dtantsurI understand that our (= Ironic) hands were tied, and making the job non-voting was the only realistic option14:43
dtantsurbut we need to be sober about what has happened14:44
JayFI'm not saying this as some kinda go-around, just curious now: does metal3 use master Ironic?14:44
JayFI like that perspective but have always considered it more of an early warning system than an urgent break, I guess14:44
dtantsurJayF: yep, our main branch follows Ironic master very closely14:44
JayFoooh okay14:44
JayFalthough I guess in this case you all were broken already by !ironic at that point14:45
dtantsurtrue14:45
JayFI honestly had assumed metal3 consumed bugfix tags/branches14:45
JayFso I thought the CI failure started a timer of "fix this soon" 14:45
JayFrather than "actual humans using ironic (via metal3) are broken"14:45
dtantsurI'm not mad at ironic, I'm mad at both requirements and *one large company* that both has a lot of investment in OpenStack AND uses Python 3.914:45
dtantsurJayF: well... it's "just" that our images were no longer getting built14:46
dtantsurso humans are kinda fine (if they're fine not getting bug fixes)14:46
JayFah, sorta like if IPA images stopped being built14:47
dtantsuryep14:48
JayFTBH in this case, we probably would've held the CVE for it if I had realized this combo of things14:50
dtantsurwell, rpittau put a workaround in place, so the images are being built now14:51
dtantsurbut the workaround is pinning upper-constraints, which is not great14:51
JayFyeah, but honestly not that harmful in the medium term14:52
iurygregoryI won't be able to join the weekly meeting, but I still can take the bug triage for this week o/14:52
dtantsurJayF: until the first CVE in a dependency :)14:52
opendevreviewRiccardo Pittau proposed openstack/bifrost master: [WIP] use Pyhon 3.12 on centos9  https://review.opendev.org/c/openstack/bifrost/+/94944914:55
cardoeI've got an overlap with the Ironic meeting with an update I've gotta give leadership so I'll miss.14:55
cardoeBut holler at me if you need me to do anything. After this week I'll be in Scotland for 2 weeks. Only planning on bringing my phone with IRC cloud and a browser so minimal interaction from me.14:56
* TheJulia longs for a vacation14:58
dtantsurScotland, nice! It's on my destination list as well (now that I got a normal passport lol)14:59
rpittau#startmeeting ironic15:00
opendevmeetMeeting started Mon May 12 15:00:02 2025 UTC and is due to finish in 60 minutes.  The chair is rpittau. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
opendevmeetThe meeting name has been set to 'ironic'15:00
TheJuliao/15:00
dtantsuro/15:00
rpittauHello everyone!15:00
rpittauWelcome to our weekly meeting!15:00
rpittauThe meeting agenda can be found here:15:00
rpittauhttps://wiki.openstack.org/wiki/Meetings/Ironic#Agenda_for_May.2C_202515:00
JayF\o15:00
rpittauwell no day there :/15:00
rpittauthis one https://wiki.openstack.org/wiki/Meetings/Ironic#Agenda_for_May_12.2C_202515:00
rpittaugiving 2 minutes for people to join15:01
cido/15:01
rpittau#topic Announcements/Reminders15:02
rpittauStanding reminder to review patches tagged ironic-week-prio and to hashtag any patches ready for review with ironic-week-prio:15:03
rpittau#link https://tinyurl.com/ironic-weekly-prio-dash15:03
rpittaummm there are some patches from March that need attention15:03
kubajjo/15:03
* JayF will make a review pass 15:04
TheJuliaI'll try to spend some time reviewing this week, last week was crazy fo rme15:04
rpittauyeah, time for reviews has been short for me too recently15:04
rpittaumoving on15:05
rpittau#info 2025.2 Flamingo Release Schedule15:05
rpittau#link https://releases.openstack.org/flamingo/schedule.html15:05
rpittauwe're already at milestone 115:05
TheJuliagah!15:05
rpittauwe'll ahve some libraries releases incoming15:05
rpittaujust 20 weeks to go15:06
rpittauI can see the leaves falling already :D15:06
TheJuliaWe need to begin to get some time on eventlet, the lockutils deprecation might be a good small start since it slows our unit tests WAY down to log it15:06
JayFRight now we have a pilot patch up for networking-baremetal 15:06
JayFit's waiting on the oslo.service threading backend to land before it moves ahead further15:06
JayFbut you're probably right that we shouldn't hold on starting Ironic and migrating where we can15:07
rpittauthat's a good idea15:08
rpittauJayF: is the networking-baremetal patch in the prio list ?15:08
JayFI only put RFR things in there, I'll link it here now15:09
rpittauok thanks15:09
JayFhttps://review.opendev.org/c/openstack/networking-baremetal/+/94798515:09
JayF#link https://review.opendev.org/c/openstack/networking-baremetal/+/94798515:09
TheJuliaJayF: Yeah, my thoughts exactly. And also.. I don't like unit tests taking ~4 minutes to run on my laptop :)15:09
TheJulia(its all the deprecation notices getting logged to the console with each Taskmanager instance)15:10
rpittauyay15:10
dtantsuris there any WIP document about the Ironic's migration?15:11
dtantsurlike, number of places to change, so on?15:11
TheJuliaI don't think anyone has really sat down and identified it15:12
dtantsurI can take this task, but I'd like to make sure cid and JayF haven't already started it15:12
TheJuliaThat being said, for things which actively raise deprecation notices, we likely just need to act15:12
JayFI haven't done it, I don't know if cid has but I doubt he's pointed attention at ironic-proper15:13
JayFI would GREATLY appreciate such a doc existing15:13
TheJulia++15:13
cidI haven't either15:13
dtantsurokay, I'll get it done this week15:13
cid\o/15:13
rpittauthanks dtantsur :)15:14
TheJuliacool cool15:14
rpittauanything else for eventlet? (or other priorities/work items)15:15
JayFdtantsur: I'll note that if it's broken down well-enough that people with minimal Ironic/OpenStack context could take the tasks on, I may be able to bring additional resources to bear15:16
cidrpittau: I think dtantsur's work would be first step towards migrating Ironic away from eventlet. IPA is in the clear, NBM is WIP, just networking baremetal left.15:16
cid*networking generic switch15:17
rpittauthanks cid 15:17
rpittaumoving on if we don't ahve anything to add15:17
rpittau#info Outreachy intern for June-August 2025 internship has been chosen!15:18
rpittauI'd like everyone to congratulate and welcome queensly[m] :)15:18
cid\o, queensly[m]. Congratulations!15:19
JayFCongratulations queensly[m]! 15:19
rpittauand that was all for the annoouncements/reminders15:20
rpittauanything else to announce/remind ?15:20
rpittauonwards!15:21
JayFSummit CfP is open.15:21
rpittauoh right15:21
JayFAnd we had OSSA-2025-001 released last week15:22
JayFBoth of which are well documented in their own right :)15:22
TheJuliaI highly recommend submitting to the summit cfp15:22
rpittaujust adding the link for the summit here15:22
rpittau#link https://summit2025.openinfra.org/15:22
dtantsurSigh, I wish I had something..15:22
* JayF has a talk cooking based on the same idea as the blog series https://jay.jvf.cc/posts/invisible-oss-work/15:22
rpittau#topic Discussions 15:25
rpittauI had a point sinec a while, just wondering if we should add permanent topics based on work itoms/priorities15:26
JayFEventlet being one makes sense15:26
TheJulia++15:26
rpittauyeah, exactly15:26
rpittauwe can add at least that to the list15:27
rpittauanything else to discuss or add today?15:28
TheJuliaNot right now, I'm semi-heads down which doesn't help :)15:28
rpittau:/15:28
rpittauwe can probably close here 15:30
rpittauthanks everyone!15:30
TheJuliaThanks!15:30
rpittau#endmeeting15:30
opendevmeetMeeting ended Mon May 12 15:30:53 2025 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:30
opendevmeetMinutes:        https://meetings.opendev.org/meetings/ironic/2025/ironic.2025-05-12-15.00.html15:30
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/ironic/2025/ironic.2025-05-12-15.00.txt15:30
opendevmeetLog:            https://meetings.opendev.org/meetings/ironic/2025/ironic.2025-05-12-15.00.log.html15:30
opendevreviewMerged openstack/bifrost master: doc: replace outdated release version with a latest one  https://review.opendev.org/c/openstack/bifrost/+/94672515:31
kubajjAnybody has experience with slurp upgrades? If I am planning to upgrade from Zed to Caracal, which steps would you do both for Antelope and Caracal? For example, the DB upgrade should be ok to do just once as it will just apply more changes through alembic, right?!15:33
opendevreviewRiccardo Pittau proposed openstack/bifrost master: Fix python interpreter when installing in venv  https://review.opendev.org/c/openstack/bifrost/+/94951815:34
TheJuliaSame steps for any upgrade, at Antelope you'd update the schema and run online data migrations, and you would rinse and repeat for caracal15:34
opendevreviewRiccardo Pittau proposed openstack/bifrost master: [WIP] use Pyhon 3.12 on centos9  https://review.opendev.org/c/openstack/bifrost/+/94944915:35
kubajjok, thanks TheJulia :) Trying to catch up with upstream to be able to test all the new features 😉15:36
opendevreviewcid proposed openstack/ironic master: Fix IPA external inspection callback url override  https://review.opendev.org/c/openstack/ironic/+/94952115:39
opendevreviewJay Faulkner proposed openstack/ironic bugfix/26.0: OSSA-2025-001: Disallow unsafe image file:// paths  https://review.opendev.org/c/openstack/ironic/+/94918616:09
JayFhttps://review.opendev.org/c/openstack/ironic/+/949176 zed fix ready for approval16:09
opendevreviewVerification of a change to openstack/ironic master failed: Allow to unprovision instance from service wait states  https://review.opendev.org/c/openstack/ironic/+/94830116:26
TheJuliaSo much writing of words today16:33
JayFdtantsur: (re: your comment on the wsgi change) IDK if we have a written policy, but I haven't been shy about approving my own changes as long as one of the +2s are from approver group 16:41
dtantsurYeah, I just forgot that this change hasn't merged :)16:41
TheJuliaheh, our cve fix broke the anaconda job16:43
TheJuliaMay 09 21:30:47.129826 np0040709003 ironic-conductor[74698]: ERROR ironic.conductor.task_manager [None req-37a97bea-e5c6-4a9d-89ff-84181b054099 None None] Node 40615f05-152b-47ea-a1d6-252ade2a786d moved to provision state "deploy failed" from state "deploying"; target provision state is "active": ironic.common.exception.ImageRefValidationFailed: Validation of image href 16:43
TheJuliafile:///opt/stack/ironic/ironic/drivers/modules/ks.cfg.template failed, reason: Security: Path /opt/stack/ironic/ironic/drivers/modules/ks.cfg.template is not allowed for image source file URLs16:43
TheJuliaI'll post a fix in a little bit16:43
dtantsurooops16:45
JayFsorry for missing that in the initial merge16:46
JayFalthough tbh if we managed to only break one job thru checking docs/config without CI to validate while writing in the dark, that's not as bad as it coulda been16:47
opendevreviewHabeeb Babasulaiman proposed openstack/bifrost master: bug: drop --develop flag from testenv usage  https://review.opendev.org/c/openstack/bifrost/+/94672416:53
opendevreviewHabeeb Babasulaiman proposed openstack/bifrost master: bug: drop baremetal introspection mention  https://review.opendev.org/c/openstack/bifrost/+/94672616:53
opendevreviewHabeeb Babasulaiman proposed openstack/bifrost master: doc: remove note that is not needed  https://review.opendev.org/c/openstack/bifrost/+/94760016:53
dtantsursooo, I'm leaving comments on https://review.opendev.org/c/openstack/oslo.service/+/945720 and wondering if it's better for us to go to Cotyledon directly..16:58
dtantsurI guess I need to review the whole thing with a fresh head16:58
JayFI don't have a strong feeling as to how to go, but the callout about it not returning is a really good catch16:59
dtantsurwe can probably work around it by using the Services wrapper, but I'd like to hear the thoughts of the authors before I propose a path for us17:01
JayF++17:02
JayFI also think based on recent posts to the list17:02
JayFthat patch, even if merges, will be accepted as a WIP 17:02
JayFmeaning like, I think they know it has some edges17:02
dtantsurfair enough17:03
opendevreviewJulia Kreger proposed openstack/ironic master: CI: Fix anaconda job post OSSA-2025-001  https://review.opendev.org/c/openstack/ironic/+/94952917:18
TheJuliaerr, well that is annoying17:22
TheJuliaSomeone refresh my memory, bifrost is supposed to send json across right?17:27
TheJuliafor configuration drives that is17:27
opendevreviewJulia Kreger proposed openstack/ironic master: WIP Patch configdrive metadata  https://review.opendev.org/c/openstack/ironic/+/94667717:27
opendevreviewRiccardo Pittau proposed openstack/bifrost master: Fix python interpreter when installing in venv  https://review.opendev.org/c/openstack/bifrost/+/94951817:29
opendevreviewMerged openstack/ironic bugfix/26.0: OSSA-2025-001: Disallow unsafe image file:// paths  https://review.opendev.org/c/openstack/ironic/+/94918617:37
opendevreviewJulia Kreger proposed openstack/ironic master: CI: Fix anaconda job post OSSA-2025-001  https://review.opendev.org/c/openstack/ironic/+/94952917:51
TheJuliadoh, its a rul17:52
TheJuliaurl17:52
TheJuliaI completely forgot it was a thing17:53
opendevreviewVerification of a change to openstack/ironic-tempest-plugin master failed: Adding basic microversion tests to CI  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/94308617:58
opendevreviewJulia Kreger proposed openstack/ironic master: Patch configdrive metadata  https://review.opendev.org/c/openstack/ironic/+/94667718:27
opendevreviewVerification of a change to openstack/ironic master failed: De-duplicate two WSGIService's  https://review.opendev.org/c/openstack/ironic/+/94548018:30
opendevreviewJulia Kreger proposed openstack/ironic master: Patch configdrive metadata  https://review.opendev.org/c/openstack/ironic/+/94667718:39
opendevreviewJulia Kreger proposed openstack/ironic master: provide host_id to neutron early on  https://review.opendev.org/c/openstack/ironic/+/94637818:40
opendevreviewJulia Kreger proposed openstack/ironic master: Patch configdrive metadata  https://review.opendev.org/c/openstack/ironic/+/94667718:40
opendevreviewJulia Kreger proposed openstack/ironic master: Consider missing MTU invalid metadata  https://review.opendev.org/c/openstack/ironic/+/94938518:41
opendevreviewJulia Kreger proposed openstack/ironic master: Consider missing MTU invalid metadata  https://review.opendev.org/c/openstack/ironic/+/94938518:45
TheJuliasome rebasing, and a minor fix. Should be a good stack now.18:45

Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!