Friday, 2025-03-07

TheJuliastevebaker[m]: so maybe members view only by default and lessees no access, and admins write?!00:05
stevebaker[m]TheJulia: that sounds reasonable to start00:30
JayF+101:11
opendevreviewDoug Goldstein proposed openstack/ironic master: fix glance metadata layout  https://review.opendev.org/c/openstack/ironic/+/94249602:46
rpittaugood morning ironic! happy friday! o/07:50
opendevreviewRiccardo Pittau proposed openstack/ironic master: Use bigger partition as work dir for metal3 job  https://review.opendev.org/c/openstack/ironic/+/94337408:31
opendevreviewRiccardo Pittau proposed openstack/ironic master: [WIP] Use bigger partition as work dir for metal3 job  https://review.opendev.org/c/openstack/ironic/+/94337409:37
adam-metal3rpittau, sorry to disturb you but I was wondering how necessary of cacheing the boot and vendor info within the pwoer_sync process of Ironic here : https://opendev.org/openstack/ironic/src/branch/master/ironic/conductor/manager.py#L4092  ? With deployments that have nodes north of 100 this will result sending 300 requests within 1 minute just for power syncing, is it really necessary to do the cacheing here?, so would anything break if I would 09:43
adam-metal3just remove this to chacing calls from the powr cycling ?09:43
adam-metal3two* caching calls09:43
adam-metal3I will do test to see if regular standalone ironic use-cases I have would break if I just remove these 2 cahing actions or not09:44
rpittauadam-metal3: IIRC that has been tested with a large deployment and it didn't give any issue09:45
adam-metal3rpittau: It does not break, but I have received complaints from my stakeholders that reaching out to the same endpoint 3times within 1 minute x 100+  is seen as an unreasonable network trafic generation, I understand that by itself it is not a "good enough" upstream justification but I was wondering how ncessary it is to do these 2 cahce updating operations together with power syncing09:48
adam-metal3I mean within the power status syncing itself09:48
adam-metal3because AFAIK this vendor and boot info is cached during other operations also so here ti looks like they are called for the reason of "just to make sure it is up to date"09:50
rpittauadam-metal3: I don't remember the exact story behind it, but looking at it yes, it's done to be sure it's up to date in case operations are needed for specific vendors/drivers09:52
rpittauand well boot_mode really need to be correct in case of power status change09:53
adam-metal3rpittau: thanks for confirming, I think I have an idea to modify this to improve this process, will let the community know if I have smething concrete09:58
rpittaunp :)10:01
vsaienkoplease review https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/943529 marks BaremetalDriverAnsibleWholedisk as unstable10:26
*** iurygregory__ is now known as iurygregory11:50
iurygregoryhappy friday ironic11:50
iurygregoryseems like iDRAC 10 changed a few things on the OemManager.ImportSystemConfiguration D: 11:53
opendevreviewMerged openstack/sushy-tools master: Redefine libvirt domain on Restart  https://review.opendev.org/c/openstack/sushy-tools/+/94323912:02
opendevreviewTakashi Kajinami proposed openstack/ironic master: vncproxy: Use dedicated options for SSL  https://review.opendev.org/c/openstack/ironic/+/94367812:14
opendevreviewTakashi Kajinami proposed openstack/ironic master: vncproxy: Use dedicated options for SSL  https://review.opendev.org/c/openstack/ironic/+/94367812:15
tkajinam ^^^ this probably needs some attention before rc112:15
tkajinam(this also made me aware the existing consoleproxy feature in nova lacks cafile option which I'll fix ...12:16
iurygregorytks tkajinam!12:17
tkajinam:-)12:18
rpittauan y available core for a quick approval to unblock CI? :)13:29
rpittauplease check https://review.opendev.org/c/openstack/python-ironicclient/+/943584 and https://review.opendev.org/c/openstack/python-ironic-inspector-client/+/94358813:29
dtantsurdone13:34
dtantsurShould I be concerned that we've changed something that may break people?13:34
dtantsurtkajinam: oh, removal of sslutils can be a pretty big disaster13:35
rpittaudtantsur: I'm still trying to understand what happened there, we didn't change anything on the clients side that can justify that13:38
dtantsurA new version of osc-lib?13:38
rpittaummmm maybe13:38
rpittauI will have to backport the fix to the new stable branches now.... :/13:39
dtantsurle sigh13:40
opendevreviewMerged openstack/python-ironicclient master: Fix bare metal info order in unit tests  https://review.opendev.org/c/openstack/python-ironicclient/+/94358413:45
opendevreviewMerged openstack/python-ironic-inspector-client master: Fix bare metal info order in unit tests  https://review.opendev.org/c/openstack/python-ironic-inspector-client/+/94358813:46
opendevreviewRiccardo Pittau proposed openstack/python-ironicclient stable/2025.1: Fix bare metal info order in unit tests  https://review.opendev.org/c/openstack/python-ironicclient/+/94369113:47
opendevreviewRiccardo Pittau proposed openstack/python-ironic-inspector-client stable/2025.1: Fix bare metal info order in unit tests  https://review.opendev.org/c/openstack/python-ironic-inspector-client/+/94369213:47
opendevreviewcid proposed openstack/ironic-tempest-plugin master: Test double encoding of error message  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/93574014:43
opendevreviewcid proposed openstack/ironic-python-agent master: Doc: Fix incorrect function in example code  https://review.opendev.org/c/openstack/ironic-python-agent/+/94377114:44
opendevreviewDr. Jens Harbott proposed openstack/ironic master: Revert "Add systemd provider for console containers"  https://review.opendev.org/c/openstack/ironic/+/94379815:09
keekzdo nova aggregates work with ironic? i'm looking at https://docs.openstack.org/nova/latest/admin/aggregates.html .. i'd like to be able to put all the hosts in a specific rack in an aggregate or something similar, so that i can issue a build with that rack trait15:16
cardoefrickler: I just wanna fix glance usage in a backportable way. My follow on (which I had wanted to land in 2025.1 but now looks less likely) refactors Ironic to use the real object type throughout instead of thunking to a dict and passing a dict all around. But it's a bigger change and changes the tests a lot more. It fixes another half dozen bugs where we do our_dict.get('some_typo', 'default_value') which results in us 15:22
cardoealways using the default.15:22
cardoeI'm also unsure of how those fixes will affect user usage because some of those typos have been around for 3+ releases.15:23
fricklercardoe: backporting is a good argument, ack15:48
JayFkeekz: a lot of active ironic irc'ers are here at scale/openinfra days. Might be a good question for the mailing list in general though17:00
keekzok,  thanks for the heads up17:14
opendevreviewPierre Riteau proposed openstack/metalsmith master: Use releases.openstack.org instead of opendev.org  https://review.opendev.org/c/openstack/metalsmith/+/94381017:57
cardoejust a heads up, I'm on PTO next week.18:45
TheJuliaiurygregory_: so I can remove the bulk config option the. ;)19:19
vsaienkoTheJulia, cardoe: please review https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/943529 marks BaremetalDriverAnsibleWholedisk as unstable, with this patch chain with 3 patches at least was able to pass CI (not with first attempt, due to not related timeouts).19:21
TheJuliavsaienko: unstable on top of dnsmasq change?19:23
vsaienkowhat dbsmasq change, I'm sorry I'm not aware about that change19:25
vsaienkoredfish fas failing with: Stderr: 'env: ‘ansible-playbook’: No such file or directory\n'.19:26
vsaienkonot sure its related to dnsmasq19:26
vsaienkoplease check this bug https://bugs.launchpad.net/ironic/+bug/210102119:26
TheJuliaAck, thanks. I’m at lunch at SCaLE19:36
TheJuliaThe dnsmasq issues were it crashing :(19:39
vsaienkohttps://bugs.launchpad.net/ironic/+bug/2026757 this one?19:40
vsaienkoI though that on CI dnsmasq is pinned to some earlier version https://github.com/openstack/ironic/blob/25a3dd076a0a8d3f4bbb5886252f6d08d78e33f9/devstack/lib/ironic#L369819:43
opendevreviewTakashi Kajinami proposed openstack/ironic master: vncproxy: Use dedicated options for SSL  https://review.opendev.org/c/openstack/ironic/+/94367820:21
opendevreviewSatoshi Shirosaka proposed openstack/ironic-python-agent-builder master: WIP Add Podman DIB for container-based cleaning  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/94334820:24
iurygregory_TheJulia, yeah I think we don't need to send https://opendev.org/openstack/sushy-oem-idrac/src/branch/master/sushy_oem_idrac/resources/manager/manager.py#L86 anymore (at least for iDRAC 10)20:26
iurygregory_going to do some testing next week with the two machines I have access to figure out how to solve it20:27
JayFJust a thought of a use case we might want to consider; think about this: I have an entire datacenter of servers, thousands of servers, managed by ironic. The BMC network goes kaput, and the power status loop marks all of them maintenance. That's thousands of API calls to unset maintenance.20:32
JayFI don't really like the idea of a shape of a bulk-set/unset endpoint, but it might be worth thinking about how to auto-recover this, or allow an operator to rapidly fix somehow(?)20:33
opendevreviewSatoshi Shirosaka proposed openstack/ironic-python-agent-builder master: WIP Add Podman DIB for container-based cleaning  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/94334821:06
opendevreviewSatoshi Shirosaka proposed openstack/ironic-python-agent-builder master: WIP Add Podman DIB for container-based cleaning  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/94334821:26
opendevreviewDr. Jens Harbott proposed openstack/ironic master: DNM: Revert some changes for testing  https://review.opendev.org/c/openstack/ironic/+/94379821:33
*** winicius is now known as wncslln21:39
JayFvsaienko: that pin broke for a couple weeks, which caused the real bad instability. 22:11
JayFI'm on conference wifi dropping about 50% of my packets so I may not be able to help; but looking at 943798 what broke? Is there a bug somewhere?22:11
fricklerJayF: that's my current guess for https://bugs.launchpad.net/ironic/+bug/2101021 which vsaienko mentioned. just going by correlation for now, no idea about cause except if it is only the bindep change, will test that next22:15
JayFwill look if it decides to load :D 22:15
JayFbut if you're concerned about those, make sure to loop in stevebaker[m] -- he's been deep in those console patches and it'd be a shame if we had to revert them22:15
JayF(I assume the ping on gerrit might get lost in a sea of notifications)22:16
JayFah, ansible driver :) Yeah I'm not going to be a huge amount of help there, but that's absolutely a wweird thing to break22:16
opendevreviewDr. Jens Harbott proposed openstack/ironic master: DNM: testing ironic-standalone-redfish job  https://review.opendev.org/c/openstack/ironic/+/94382722:17
fricklerseems the failure is not happening on 943798, now let's see what ^^ does22:18
fricklerJayF: yeah, I have no intention of actually reverting this, just trying to isolate the issue22:19
JayFjust punch the 'gerrit bisect' button /s :D 22:19
JayFI figured, but he also might have ideas too. And honestly I am always understanding of a "fix ci" revert when we can repush at fix22:19
JayFjust ... perilously close to the release 😅22:19
stevebaker[m]Devstack doesn't actually install those bindep.txt devstack packages so they are really only there for documentation. Those bindep changes can be backed out if necessary 22:31
TheJuliaiurygregory_: cool cool, I was more so thinking the feature in ironic23:39
TheJuliaJayF: we've had auto-recover for that for... years and years.23:39
TheJulia(the thousands of nodes go into maintenance over power state check failing thing)23:40

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!