Monday, 2025-04-21

opendevreviewcid proposed openstack/ironic-python-agent master: WIP: Eventlet Removal- WSGI server  https://review.opendev.org/c/openstack/ironic-python-agent/+/94609100:02
opendevreviewcid proposed openstack/ironic-python-agent master: WIP: Eventlet Removal- WSGI server  https://review.opendev.org/c/openstack/ironic-python-agent/+/94609100:23
opendevreviewcid proposed openstack/ironic-python-agent master: WIP: Eventlet Removal- WSGI server  https://review.opendev.org/c/openstack/ironic-python-agent/+/94609100:26
freemanboss[m]Good morning ironic 10:58
opendevreviewminwoo seo proposed openstack/ironic master: Add `api-call` action for ironic inspection rule  https://review.opendev.org/c/openstack/ironic/+/94674111:11
opendevreviewminwoo seo proposed openstack/ironic master: Add `api-call` action for ironic inspection rule  https://review.opendev.org/c/openstack/ironic/+/94674111:13
*** darmach9 is now known as darmach11:43
TheJuliagood morning13:17
opendevreviewminwoo seo proposed openstack/ironic master: Add `api-call` action for ironic inspection rule  https://review.opendev.org/c/openstack/ironic/+/94674113:56
opendevreviewminwoo seo proposed openstack/ironic master: Add `api-call` action for ironic inspection rule  https://review.opendev.org/c/openstack/ironic/+/94674113:57
-opendevstatus- NOTICE: notice Reminder: The Gerrit service on review.opendev.org will be offline for a server replacement maintenance between 16:00-17:00 UTC today per https://lists.opendev.org/archives/list/service-announce@lists.opendev.org/message/D6VGKXHKXCV6TD6MFJY4H4KQBIM3AQYI/14:15
TheJuliaoh fun14:15
opendevreviewJulia Kreger proposed openstack/ironic master: provide host_id to neutron early on  https://review.opendev.org/c/openstack/ironic/+/94637814:51
* cid updates Meetings wiki14:55
JayFWho wants to run the meeting today?15:00
opendevreviewJulia Kreger proposed openstack/ironic master: WIP: Patch configdrive metadata  https://review.opendev.org/c/openstack/ironic/+/94667715:01
JayFAre we even going to have a quorum today given it's Easter Monday?15:01
JayF#startmeeting ironic15:01
opendevmeetMeeting started Mon Apr 21 15:01:26 2025 UTC and is due to finish in 60 minutes.  The chair is JayF. Information about MeetBot at http://wiki.debian.org/MeetBot.15:01
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:01
opendevmeetThe meeting name has been set to 'ironic'15:01
TheJuliao/15:01
JayFGoing to see if we have enough folks to actually run this15:01
TheJuliaYeah, I'm assuming everyone EU based is away today15:01
JayFSame; it's likely valuable to hold off on any of the discussion of bugs and work items if it's just us15:02
keekzo/15:02
JayFgoing to give until :05 for a quorrum to arrive and if not we cancel the meeting?15:02
TheJuliagerrit is also going down in an hour :(15:02
cid:)15:03
JayFcid: have you tried a version of your eventlet-wsgi-server-gone patch with eventlet + the monkey patch completely removed?15:03
cardoeI'm around15:04
cidJayF: Not yet15:04
JayFI'm so jazzed to see that pass any tests at all :)15:05
JayFokay it's :05, cores here are me, julia, cid, cardoe15:05
JayFI think I'm going to call it no quorum unless there's an objection15:05
JayF#info Most Ironic contributors in Europe are out today on holiday, did not have quorum for meeting.15:05
JayFLast call?15:06
TheJuliauhh15:06
TheJuliaIt would be good for some wider reviews on https://review.opendev.org/c/openstack/ironic-specs/+/945642 in terms of moving forward integrated network cases15:06
JayF#info Wider reviews needed on https://review.opendev.org/c/openstack/ironic-specs/+/94564215:06
JayFI've read it multiple times, unsure if I've voted on it15:07
JayFI'll take a full-on review pass today15:07
TheJuliaThanks15:07
JayFTheJulia: no objection to closing the meeting with that note?15:07
TheJuliaNone15:07
JayF#endmeeting15:08
opendevmeetMeeting ended Mon Apr 21 15:08:00 2025 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:08
opendevmeetMinutes:        https://meetings.opendev.org/meetings/ironic/2025/ironic.2025-04-21-15.01.html15:08
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/ironic/2025/ironic.2025-04-21-15.01.txt15:08
opendevmeetLog:            https://meetings.opendev.org/meetings/ironic/2025/ironic.2025-04-21-15.01.log.html15:08
JayFcid: ima put a follow on patch to your eventlet patch ripping the rest out15:15
JayFcid: just as some science as to not derail you from the path of the patch that might actually merge :D 15:16
cid++ :)15:18
opendevreviewJay Faulkner proposed openstack/ironic-python-agent master: SCIENCE: Remove *ALL THE EVENTLET*  https://review.opendev.org/c/openstack/ironic-python-agent/+/94774415:19
JayFpushed so integration tests can run, gonna look at unit tests15:19
keekzi was looking to see 'clean failed' oslo notifications but looking at https://opendev.org/openstack/ironic/src/branch/master/ironic/conductor/utils.py the clean failed notifications only appear to be attached to power state changes. but i think some of the clean failed failure scenarios don't always change power state. i'd like to wedge in sending a clean failed notification when the cleaning actually fails but i'm not sure 15:19
keekzsure where/how to do this. i'm thinking in https://opendev.org/openstack/ironic/src/branch/master/ironic/conductor/utils.py#L536 ?15:19
JayFunit tests are passing!15:20
JayFkeekz: that seems wrong to me, we emit notifications on provision_state change don't we?15:20
keekzi'm just looking at notify_utils and it seems to be attached to power state changes15:22
opendevreviewJulia Kreger proposed openstack/ironic master: WIP: Patch configdrive metadata  https://review.opendev.org/c/openstack/ironic/+/94667715:24
JayFI think some are automatic and some are not but I'm not 100% sure15:25
TheJuliaThat sounds like current state to me. I suspect there could/should maybe some explicit invocation in the cleaning failure case because the nodes are not actually powered off. Almost like we need an "emit_current_state" as an explicit call from the handler in that case15:27
keekzto give some context, we have automated cleaning enabled and sometimes the cleaning can fail. for example during a deploy of our dev environment where services get restarted a lot which can break interactions with other services. issuing a 're-clean' of the node by doing an `openstack baremetal node manage $node` then `openstack baremetal node provide $node` fixes it. i wrote a little argo workflows script to watch our oslo 15:27
keekznotifications queue for clean failed events but that's where i'm having issues. maybe i'm not looking for clean failed events correctly15:27
JayFkeekz: look at conductor task manager process_event15:27
JayFkeekz: it sends a notification on any state change that doesn't have a callback15:27
JayFkeekz: if you wanna change behavior, you may want to  start there :)15:27
TheJuliakeekz: so, I guess the thing I would be interested issue wise is why does it fail, and should/could that be a bug or opportunity for better error handling15:28
keekzwe're using custom neutron plugins and experimenting a lot in our dev environment so things just fail a lot :)15:29
TheJuliaOkay, as long as you know that is what the root cause is :)15:33
keekzi made this little script to dump the rabbitmq oslo notifications queue to help me find see/find events: https://github.com/rackerlabs/understack/tree/main/examples/openstack-notifications and i don't see 'clean failed' in the payload for any of the baremetal.node.provision_set.* event types15:44
JayFcid: this is passing CI holy crap15:56
JayFcid: only failure is pep8 and I'm about to push over that, but you may just wanna integrate my changes and see if we can de-eventlet ipa in one show15:56
JayF**shot15:56
-opendevstatus- NOTICE: notice The Gerrit service on review.opendev.org is offline for a server replacement maintenance between 16:00-17:00 UTC today per https://lists.opendev.org/archives/list/service-announce@lists.opendev.org/message/D6VGKXHKXCV6TD6MFJY4H4KQBIM3AQYI/16:00
opendevreviewVerification of a change to openstack/ironic master failed: Add several NV GPU types  https://review.opendev.org/c/openstack/ironic/+/94721316:01
JayFrunning an errand while gerrit is down, but going to look at logs for https://zuul.opendev.org/t/openstack/build/7d69a82b2c4d4d7da5a660064ead4fb3 to ensure nothing unexpected16:03
JayFI am completely buzzed about the possibility we've finally got IPA off eventlet16:03
JayFI guess I'll also check to make sure we don't need to change any settings to make Oslo libraries use non-eventlet methods16:04
TheJuliaThat is awesome16:07
opendevreviewminwoo seo proposed openstack/ironic master: Add `api-call` action for ironic inspection rule  https://review.opendev.org/c/openstack/ironic/+/94674116:26
okamiHey, has anyone used Ironic with Skyline? Running into a couple of issue with bare metal instances and flavors as well as adding kernel and ramdisk images. 16:31
TheJuliaokami: Greetings, so none of the developers/maintainers of Ironic has, as far as I'm aware16:34
TheJuliaJayF: did we conclusively reach a consensus eventlet was ironic/ipa/networking-baremetal/networking-generic-switch only ?16:34
okamiTheJulia: Thanks, I will check in with the Skyline channel.16:38
JayFTheJulia: not 100% sure17:13
TheJuliaI suspect at least broad stroke wise, those are the major items17:15
opendevreviewJulia Kreger proposed openstack/ironic master: WIP: Patch configdrive metadata  https://review.opendev.org/c/openstack/ironic/+/94667718:28
opendevreviewJulia Kreger proposed openstack/ironic master: WIP: Patch configdrive metadata  https://review.opendev.org/c/openstack/ironic/+/94667719:00
opendevreviewJay Faulkner proposed openstack/ironic-python-agent master: SCIENCE: Remove *ALL THE EVENTLET*  https://review.opendev.org/c/openstack/ironic-python-agent/+/94774419:29
JayFjust fixed a pep8 issue, only reason it didn't V+119:29
JayFobviously we need to manually test the edges but this is exciting19:30
TheJuliavery cool19:30
opendevreviewJulia Kreger proposed openstack/ironic master: WIP: Patch configdrive metadata  https://review.opendev.org/c/openstack/ironic/+/94667719:44
cardoeFor Science!20:12
opendevreviewJulia Kreger proposed openstack/ironic master: WIP: Patch configdrive metadata  https://review.opendev.org/c/openstack/ironic/+/94667721:08
JayFI'm going to be making a PTG recap video public on the GR-OSS youtube channel in the next day or two; if anyone wants to (p)review feel free https://www.youtube.com/watch?v=TE5GDkPXJP821:48
opendevreviewminwoo seo proposed openstack/ironic master: Add `api-call` action for ironic inspection rule  https://review.opendev.org/c/openstack/ironic/+/94674122:09

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!