arne_wiebalck | Good morning, Ironic! | 06:39 |
---|---|---|
rpittau | good morning ironic! o/ | 06:42 |
zigo | My CI doesn't have the issues of the one upstream OpenStack, packages don't change, and never break. | 07:12 |
zigo | Though I don't have Ironic in my functional tests ... :/ | 07:12 |
opendevreview | Riccardo Pittau proposed openstack/bifrost master: [WIP] use Pyhon 3.12 on centos9 https://review.opendev.org/c/openstack/bifrost/+/949449 | 08:00 |
queensly[m] | Good morning | 08:01 |
abongale | Good morning Ironic! | 08:03 |
opendevreview | Verification of a change to openstack/ironic master failed: provide host_id to neutron early on https://review.opendev.org/c/openstack/ironic/+/946378 | 08:10 |
opendevreview | Riccardo Pittau proposed openstack/ironic master: Make metal3 job voting again https://review.opendev.org/c/openstack/ironic/+/949458 | 08:14 |
rpittau | can we please stop making the metal3 job non-voting every time there is a tiny issue? was it even not working or was it made non-voting just because it was running Python 3.9 ? | 08:21 |
rpittau | I don't see ironic dropping python 3.9 recently, it's still supported https://opendev.org/openstack/ironic/src/branch/master/setup.cfg#L19 | 08:21 |
zigo | JayF: oslo.messaging has no get_grpc_client, how did you do the backport then? | 08:59 |
zigo | To Zed I mean... | 09:00 |
zigo | Should I backport https://review.opendev.org/c/openstack/oslo.messaging/+/869899 and https://review.opendev.org/c/openstack/oslo.messaging/+/862419 to Oslo messaging ? | 09:01 |
opendevreview | Riccardo Pittau proposed openstack/bifrost master: [WIP] use Pyhon 3.12 on centos9 https://review.opendev.org/c/openstack/bifrost/+/949449 | 09:01 |
opendevreview | Merged openstack/networking-generic-switch master: Correctly set use_keys when key_file is set https://review.opendev.org/c/openstack/networking-generic-switch/+/948774 | 09:16 |
opendevreview | Merged openstack/metalsmith master: Fix metadata generation https://review.opendev.org/c/openstack/metalsmith/+/947523 | 09:42 |
iurygregory | good morning Ironic | 09:44 |
dtantsur | rpittau: I suspect not all dependencies could be installed at that point? | 10:28 |
rpittau | dtantsur: probably, but I remember discussing at least adding a revert as a reminder? I get unblocking ci, but following that all the cs9 jobs should be non voting or removed? Including all dib IPA jobs? I'm trying to understand what the criteria is here | 10:47 |
dtantsur | yeah, a revert should have been created | 10:47 |
opendevreview | Riccardo Pittau proposed openstack/bifrost master: [WIP] use Pyhon 3.12 on centos9 https://review.opendev.org/c/openstack/bifrost/+/949449 | 11:30 |
opendevreview | Harald Jensås proposed openstack/sushy-tools master: Status code 501 for Unsupported/Not implemented https://review.opendev.org/c/openstack/sushy-tools/+/949500 | 12:32 |
TheJulia | good morning | 13:07 |
*** iurygregory_ is now known as iurygregory | 13:08 | |
iurygregory | good morning TheJulia | 13:09 |
JayF | rpittau: Even though our setup.cfg hasn't been updated, the documented runtime for the f release does not include 3.9 and the requirements for 3.9 were already removed from the constraints list | 13:33 |
JayF | What's the appropriate action for us to take when metal3 jobs are blocking merge due to an upstream change that we can't revert and when there's no engineers from that team to repair it? | 13:34 |
TheJulia | braaaains | 13:55 |
TheJulia | The most appropriate action is likely to update the job to either use a newer specific python or stream version in the job, however that may ultimately also be a heavier lift than a quick packaging change. Bottom line though, it is akin to rolling with the punches | 13:56 |
rpittau | JayF: as I wrote in my message, I perfectly understand the need to unblock ci, but no revert was created for that | 14:17 |
rpittau | if we don't support Python 3.9 anymore, just because the f release does not support it, then let's be explicit and remove all the jobs that use that, including all the DIB ipa jobs and the ipa-builder jobs | 14:17 |
JayF | zigo: are we talking about different bugs? | 14:17 |
JayF | zigo: that image change doesn't use any oslo.messaging buts? | 14:17 |
JayF | the no revert is my fault for sure | 14:18 |
JayF | https://governance.openstack.org/tc/reference/runtimes/2025.2.html is the updated runtime information if anyone wants to perform the maintenance needed to update CI. | 14:18 |
rpittau | we're not the only project still using python 3.9 | 14:19 |
rpittau | I've reverted the change in requirements, just took some talking and a bit of understanding to grant time for a proper migration | 14:19 |
JayF | ah, nice | 14:20 |
JayF | I don't ask requirements for reverts unless I know specifically why/what | 14:20 |
JayF | because of how hard they work to get the updates in | 14:20 |
JayF | s/don't/rarely/ | 14:20 |
JayF | so I usually assume it's all on us to be compatible if possible | 14:21 |
rpittau | JayF: indeed, but compatibility requires time and a proper plan | 14:21 |
JayF | makes sense, in the moment I'm pretty sure it was just "oh no breaky" and me working on a CVE in the background so just trying to barrel thru | 14:30 |
opendevreview | Jay Faulkner proposed openstack/ironic unmaintained/zed: OSSA-2025-001: Disallow unsafe image file:// paths https://review.opendev.org/c/openstack/ironic/+/949176 | 14:36 |
dtantsur | JayF: note: it's not "metal3 job got broken", it's "we broke a significant downstream consumer (and potentially more)" | 14:43 |
dtantsur | I understand that our (= Ironic) hands were tied, and making the job non-voting was the only realistic option | 14:43 |
dtantsur | but we need to be sober about what has happened | 14:44 |
JayF | I'm not saying this as some kinda go-around, just curious now: does metal3 use master Ironic? | 14:44 |
JayF | I like that perspective but have always considered it more of an early warning system than an urgent break, I guess | 14:44 |
dtantsur | JayF: yep, our main branch follows Ironic master very closely | 14:44 |
JayF | oooh okay | 14:44 |
JayF | although I guess in this case you all were broken already by !ironic at that point | 14:45 |
dtantsur | true | 14:45 |
JayF | I honestly had assumed metal3 consumed bugfix tags/branches | 14:45 |
JayF | so I thought the CI failure started a timer of "fix this soon" | 14:45 |
JayF | rather than "actual humans using ironic (via metal3) are broken" | 14:45 |
dtantsur | I'm not mad at ironic, I'm mad at both requirements and *one large company* that both has a lot of investment in OpenStack AND uses Python 3.9 | 14:45 |
dtantsur | JayF: well... it's "just" that our images were no longer getting built | 14:46 |
dtantsur | so humans are kinda fine (if they're fine not getting bug fixes) | 14:46 |
JayF | ah, sorta like if IPA images stopped being built | 14:47 |
dtantsur | yep | 14:48 |
JayF | TBH in this case, we probably would've held the CVE for it if I had realized this combo of things | 14:50 |
dtantsur | well, rpittau put a workaround in place, so the images are being built now | 14:51 |
dtantsur | but the workaround is pinning upper-constraints, which is not great | 14:51 |
JayF | yeah, but honestly not that harmful in the medium term | 14:52 |
iurygregory | I won't be able to join the weekly meeting, but I still can take the bug triage for this week o/ | 14:52 |
dtantsur | JayF: until the first CVE in a dependency :) | 14:52 |
opendevreview | Riccardo Pittau proposed openstack/bifrost master: [WIP] use Pyhon 3.12 on centos9 https://review.opendev.org/c/openstack/bifrost/+/949449 | 14:55 |
cardoe | I've got an overlap with the Ironic meeting with an update I've gotta give leadership so I'll miss. | 14:55 |
cardoe | But holler at me if you need me to do anything. After this week I'll be in Scotland for 2 weeks. Only planning on bringing my phone with IRC cloud and a browser so minimal interaction from me. | 14:56 |
* TheJulia longs for a vacation | 14:58 | |
dtantsur | Scotland, nice! It's on my destination list as well (now that I got a normal passport lol) | 14:59 |
rpittau | #startmeeting ironic | 15:00 |
opendevmeet | Meeting started Mon May 12 15:00:02 2025 UTC and is due to finish in 60 minutes. The chair is rpittau. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
opendevmeet | The meeting name has been set to 'ironic' | 15:00 |
TheJulia | o/ | 15:00 |
dtantsur | o/ | 15:00 |
rpittau | Hello everyone! | 15:00 |
rpittau | Welcome to our weekly meeting! | 15:00 |
rpittau | The meeting agenda can be found here: | 15:00 |
rpittau | https://wiki.openstack.org/wiki/Meetings/Ironic#Agenda_for_May.2C_2025 | 15:00 |
JayF | \o | 15:00 |
rpittau | well no day there :/ | 15:00 |
rpittau | this one https://wiki.openstack.org/wiki/Meetings/Ironic#Agenda_for_May_12.2C_2025 | 15:00 |
rpittau | giving 2 minutes for people to join | 15:01 |
cid | o/ | 15:01 |
rpittau | #topic Announcements/Reminders | 15:02 |
rpittau | Standing reminder to review patches tagged ironic-week-prio and to hashtag any patches ready for review with ironic-week-prio: | 15:03 |
rpittau | #link https://tinyurl.com/ironic-weekly-prio-dash | 15:03 |
rpittau | mmm there are some patches from March that need attention | 15:03 |
kubajj | o/ | 15:03 |
* JayF will make a review pass | 15:04 | |
TheJulia | I'll try to spend some time reviewing this week, last week was crazy fo rme | 15:04 |
rpittau | yeah, time for reviews has been short for me too recently | 15:04 |
rpittau | moving on | 15:05 |
rpittau | #info 2025.2 Flamingo Release Schedule | 15:05 |
rpittau | #link https://releases.openstack.org/flamingo/schedule.html | 15:05 |
rpittau | we're already at milestone 1 | 15:05 |
TheJulia | gah! | 15:05 |
rpittau | we'll ahve some libraries releases incoming | 15:05 |
rpittau | just 20 weeks to go | 15:06 |
rpittau | I can see the leaves falling already :D | 15:06 |
TheJulia | We need to begin to get some time on eventlet, the lockutils deprecation might be a good small start since it slows our unit tests WAY down to log it | 15:06 |
JayF | Right now we have a pilot patch up for networking-baremetal | 15:06 |
JayF | it's waiting on the oslo.service threading backend to land before it moves ahead further | 15:06 |
JayF | but you're probably right that we shouldn't hold on starting Ironic and migrating where we can | 15:07 |
rpittau | that's a good idea | 15:08 |
rpittau | JayF: is the networking-baremetal patch in the prio list ? | 15:08 |
JayF | I only put RFR things in there, I'll link it here now | 15:09 |
rpittau | ok thanks | 15:09 |
JayF | https://review.opendev.org/c/openstack/networking-baremetal/+/947985 | 15:09 |
JayF | #link https://review.opendev.org/c/openstack/networking-baremetal/+/947985 | 15:09 |
TheJulia | JayF: Yeah, my thoughts exactly. And also.. I don't like unit tests taking ~4 minutes to run on my laptop :) | 15:09 |
TheJulia | (its all the deprecation notices getting logged to the console with each Taskmanager instance) | 15:10 |
rpittau | yay | 15:10 |
dtantsur | is there any WIP document about the Ironic's migration? | 15:11 |
dtantsur | like, number of places to change, so on? | 15:11 |
TheJulia | I don't think anyone has really sat down and identified it | 15:12 |
dtantsur | I can take this task, but I'd like to make sure cid and JayF haven't already started it | 15:12 |
TheJulia | That being said, for things which actively raise deprecation notices, we likely just need to act | 15:12 |
JayF | I haven't done it, I don't know if cid has but I doubt he's pointed attention at ironic-proper | 15:13 |
JayF | I would GREATLY appreciate such a doc existing | 15:13 |
TheJulia | ++ | 15:13 |
cid | I haven't either | 15:13 |
dtantsur | okay, I'll get it done this week | 15:13 |
cid | \o/ | 15:13 |
rpittau | thanks dtantsur :) | 15:14 |
TheJulia | cool cool | 15:14 |
rpittau | anything else for eventlet? (or other priorities/work items) | 15:15 |
JayF | dtantsur: I'll note that if it's broken down well-enough that people with minimal Ironic/OpenStack context could take the tasks on, I may be able to bring additional resources to bear | 15:16 |
cid | rpittau: I think dtantsur's work would be first step towards migrating Ironic away from eventlet. IPA is in the clear, NBM is WIP, just networking baremetal left. | 15:16 |
cid | *networking generic switch | 15:17 |
rpittau | thanks cid | 15:17 |
rpittau | moving on if we don't ahve anything to add | 15:17 |
rpittau | #info Outreachy intern for June-August 2025 internship has been chosen! | 15:18 |
rpittau | I'd like everyone to congratulate and welcome queensly[m] :) | 15:18 |
cid | \o, queensly[m]. Congratulations! | 15:19 |
JayF | Congratulations queensly[m]! | 15:19 |
rpittau | and that was all for the annoouncements/reminders | 15:20 |
rpittau | anything else to announce/remind ? | 15:20 |
rpittau | onwards! | 15:21 |
JayF | Summit CfP is open. | 15:21 |
rpittau | oh right | 15:21 |
JayF | And we had OSSA-2025-001 released last week | 15:22 |
JayF | Both of which are well documented in their own right :) | 15:22 |
TheJulia | I highly recommend submitting to the summit cfp | 15:22 |
rpittau | just adding the link for the summit here | 15:22 |
rpittau | #link https://summit2025.openinfra.org/ | 15:22 |
dtantsur | Sigh, I wish I had something.. | 15:22 |
* JayF has a talk cooking based on the same idea as the blog series https://jay.jvf.cc/posts/invisible-oss-work/ | 15:22 | |
rpittau | #topic Discussions | 15:25 |
rpittau | I had a point sinec a while, just wondering if we should add permanent topics based on work itoms/priorities | 15:26 |
JayF | Eventlet being one makes sense | 15:26 |
TheJulia | ++ | 15:26 |
rpittau | yeah, exactly | 15:26 |
rpittau | we can add at least that to the list | 15:27 |
rpittau | anything else to discuss or add today? | 15:28 |
TheJulia | Not right now, I'm semi-heads down which doesn't help :) | 15:28 |
rpittau | :/ | 15:28 |
rpittau | we can probably close here | 15:30 |
rpittau | thanks everyone! | 15:30 |
TheJulia | Thanks! | 15:30 |
rpittau | #endmeeting | 15:30 |
opendevmeet | Meeting ended Mon May 12 15:30:53 2025 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:30 |
opendevmeet | Minutes: https://meetings.opendev.org/meetings/ironic/2025/ironic.2025-05-12-15.00.html | 15:30 |
opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/ironic/2025/ironic.2025-05-12-15.00.txt | 15:30 |
opendevmeet | Log: https://meetings.opendev.org/meetings/ironic/2025/ironic.2025-05-12-15.00.log.html | 15:30 |
opendevreview | Merged openstack/bifrost master: doc: replace outdated release version with a latest one https://review.opendev.org/c/openstack/bifrost/+/946725 | 15:31 |
kubajj | Anybody has experience with slurp upgrades? If I am planning to upgrade from Zed to Caracal, which steps would you do both for Antelope and Caracal? For example, the DB upgrade should be ok to do just once as it will just apply more changes through alembic, right?! | 15:33 |
opendevreview | Riccardo Pittau proposed openstack/bifrost master: Fix python interpreter when installing in venv https://review.opendev.org/c/openstack/bifrost/+/949518 | 15:34 |
TheJulia | Same steps for any upgrade, at Antelope you'd update the schema and run online data migrations, and you would rinse and repeat for caracal | 15:34 |
opendevreview | Riccardo Pittau proposed openstack/bifrost master: [WIP] use Pyhon 3.12 on centos9 https://review.opendev.org/c/openstack/bifrost/+/949449 | 15:35 |
kubajj | ok, thanks TheJulia :) Trying to catch up with upstream to be able to test all the new features 😉 | 15:36 |
opendevreview | cid proposed openstack/ironic master: Fix IPA external inspection callback url override https://review.opendev.org/c/openstack/ironic/+/949521 | 15:39 |
opendevreview | Jay Faulkner proposed openstack/ironic bugfix/26.0: OSSA-2025-001: Disallow unsafe image file:// paths https://review.opendev.org/c/openstack/ironic/+/949186 | 16:09 |
JayF | https://review.opendev.org/c/openstack/ironic/+/949176 zed fix ready for approval | 16:09 |
opendevreview | Verification of a change to openstack/ironic master failed: Allow to unprovision instance from service wait states https://review.opendev.org/c/openstack/ironic/+/948301 | 16:26 |
TheJulia | So much writing of words today | 16:33 |
JayF | dtantsur: (re: your comment on the wsgi change) IDK if we have a written policy, but I haven't been shy about approving my own changes as long as one of the +2s are from approver group | 16:41 |
dtantsur | Yeah, I just forgot that this change hasn't merged :) | 16:41 |
TheJulia | heh, our cve fix broke the anaconda job | 16:43 |
TheJulia | May 09 21:30:47.129826 np0040709003 ironic-conductor[74698]: ERROR ironic.conductor.task_manager [None req-37a97bea-e5c6-4a9d-89ff-84181b054099 None None] Node 40615f05-152b-47ea-a1d6-252ade2a786d moved to provision state "deploy failed" from state "deploying"; target provision state is "active": ironic.common.exception.ImageRefValidationFailed: Validation of image href | 16:43 |
TheJulia | file:///opt/stack/ironic/ironic/drivers/modules/ks.cfg.template failed, reason: Security: Path /opt/stack/ironic/ironic/drivers/modules/ks.cfg.template is not allowed for image source file URLs | 16:43 |
TheJulia | I'll post a fix in a little bit | 16:43 |
dtantsur | ooops | 16:45 |
JayF | sorry for missing that in the initial merge | 16:46 |
JayF | although tbh if we managed to only break one job thru checking docs/config without CI to validate while writing in the dark, that's not as bad as it coulda been | 16:47 |
opendevreview | Habeeb Babasulaiman proposed openstack/bifrost master: bug: drop --develop flag from testenv usage https://review.opendev.org/c/openstack/bifrost/+/946724 | 16:53 |
opendevreview | Habeeb Babasulaiman proposed openstack/bifrost master: bug: drop baremetal introspection mention https://review.opendev.org/c/openstack/bifrost/+/946726 | 16:53 |
opendevreview | Habeeb Babasulaiman proposed openstack/bifrost master: doc: remove note that is not needed https://review.opendev.org/c/openstack/bifrost/+/947600 | 16:53 |
dtantsur | sooo, I'm leaving comments on https://review.opendev.org/c/openstack/oslo.service/+/945720 and wondering if it's better for us to go to Cotyledon directly.. | 16:58 |
dtantsur | I guess I need to review the whole thing with a fresh head | 16:58 |
JayF | I don't have a strong feeling as to how to go, but the callout about it not returning is a really good catch | 16:59 |
dtantsur | we can probably work around it by using the Services wrapper, but I'd like to hear the thoughts of the authors before I propose a path for us | 17:01 |
JayF | ++ | 17:02 |
JayF | I also think based on recent posts to the list | 17:02 |
JayF | that patch, even if merges, will be accepted as a WIP | 17:02 |
JayF | meaning like, I think they know it has some edges | 17:02 |
dtantsur | fair enough | 17:03 |
opendevreview | Julia Kreger proposed openstack/ironic master: CI: Fix anaconda job post OSSA-2025-001 https://review.opendev.org/c/openstack/ironic/+/949529 | 17:18 |
TheJulia | err, well that is annoying | 17:22 |
TheJulia | Someone refresh my memory, bifrost is supposed to send json across right? | 17:27 |
TheJulia | for configuration drives that is | 17:27 |
opendevreview | Julia Kreger proposed openstack/ironic master: WIP Patch configdrive metadata https://review.opendev.org/c/openstack/ironic/+/946677 | 17:27 |
opendevreview | Riccardo Pittau proposed openstack/bifrost master: Fix python interpreter when installing in venv https://review.opendev.org/c/openstack/bifrost/+/949518 | 17:29 |
opendevreview | Merged openstack/ironic bugfix/26.0: OSSA-2025-001: Disallow unsafe image file:// paths https://review.opendev.org/c/openstack/ironic/+/949186 | 17:37 |
opendevreview | Julia Kreger proposed openstack/ironic master: CI: Fix anaconda job post OSSA-2025-001 https://review.opendev.org/c/openstack/ironic/+/949529 | 17:51 |
TheJulia | doh, its a rul | 17:52 |
TheJulia | url | 17:52 |
TheJulia | I completely forgot it was a thing | 17:53 |
opendevreview | Verification of a change to openstack/ironic-tempest-plugin master failed: Adding basic microversion tests to CI https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/943086 | 17:58 |
opendevreview | Julia Kreger proposed openstack/ironic master: Patch configdrive metadata https://review.opendev.org/c/openstack/ironic/+/946677 | 18:27 |
opendevreview | Verification of a change to openstack/ironic master failed: De-duplicate two WSGIService's https://review.opendev.org/c/openstack/ironic/+/945480 | 18:30 |
opendevreview | Julia Kreger proposed openstack/ironic master: Patch configdrive metadata https://review.opendev.org/c/openstack/ironic/+/946677 | 18:39 |
opendevreview | Julia Kreger proposed openstack/ironic master: provide host_id to neutron early on https://review.opendev.org/c/openstack/ironic/+/946378 | 18:40 |
opendevreview | Julia Kreger proposed openstack/ironic master: Patch configdrive metadata https://review.opendev.org/c/openstack/ironic/+/946677 | 18:40 |
opendevreview | Julia Kreger proposed openstack/ironic master: Consider missing MTU invalid metadata https://review.opendev.org/c/openstack/ironic/+/949385 | 18:41 |
opendevreview | Julia Kreger proposed openstack/ironic master: Consider missing MTU invalid metadata https://review.opendev.org/c/openstack/ironic/+/949385 | 18:45 |
TheJulia | some rebasing, and a minor fix. Should be a good stack now. | 18:45 |
Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!