| opendevreview | Verification of a change to openstack/ironic master failed: Use patched dnsmasq from PPA https://review.opendev.org/c/openstack/ironic/+/933104 | 00:30 |
|---|---|---|
| opendevreview | cid proposed openstack/ironic master: [WIP] Add inspection rules https://review.opendev.org/c/openstack/ironic/+/918303 | 01:14 |
| *** fungi is now known as Guest9249 | 01:33 | |
| *** kinrui is now known as fungi | 01:41 | |
| rpittau | good morning ironic! o/ | 07:03 |
| opendevreview | Derek Higgins proposed openstack/python-ironicclient master: Add support to set 'disable_power_off' https://review.opendev.org/c/openstack/python-ironicclient/+/934741 | 10:39 |
| opendevreview | Derek Higgins proposed openstack/ironic master: Allow setting of disable_power_off via API https://review.opendev.org/c/openstack/ironic/+/934740 | 11:05 |
| opendevreview | Dmitry Tantsur proposed openstack/ironic master: Inspection: account for disable_power_off https://review.opendev.org/c/openstack/ironic/+/934233 | 11:49 |
| opendevreview | Dmitry Tantsur proposed openstack/ironic master: Refactoring: simplify tear_down_agent https://review.opendev.org/c/openstack/ironic/+/934956 | 12:01 |
| opendevreview | Dmitry Tantsur proposed openstack/ironic master: [WIP] Agent deploy: account for disable_power_off https://review.opendev.org/c/openstack/ironic/+/934637 | 12:04 |
| dtantsur | This CI failure seems worrying: IPA reports invalid or missing agent token https://zuul.opendev.org/t/openstack/build/955fb0a901a04fd0aa9c611b0d7ad57e/logs | 12:06 |
| dtantsur | The root cause might be Clean step deploy.erase_devices_metadata failed on node ce278bf0-2b7e-4410-b8d9-8a2d2b388a5e. Unexpected exception performing clean step erase_devices_metadata. FileNotFoundError: [Errno 2] No such file or directory: 'sgdisk' | 12:07 |
| dtantsur | This is a CentOS based ramdisk, may be missing a package? | 12:08 |
| dtantsur | This is really strange, gdisk is installed.. | 12:09 |
| dtantsur | Ouch. OUCH. This is very-very broken: https://zuul.opendev.org/t/openstack/build/955fb0a901a04fd0aa9c611b0d7ad57e/log/controller/logs/devstacklog.txt#23822 | 12:12 |
| opendevreview | Dmitry Tantsur proposed openstack/ironic-python-agent-builder master: Move extra package de-installation before the installation phase https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/934962 | 12:16 |
| dtantsur | TheJulia: this touches your code I believe ^^ (and also affects your downstream) | 12:16 |
| opendevreview | Dmitry Tantsur proposed openstack/ironic-python-agent-builder master: Move extra package de-installation before the installation phase https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/934962 | 12:18 |
| rpittau | dtantsur: it could be temporary, maybe a wrong package pulled in the repo, would not be the first time | 13:47 |
| dtantsur | rpittau: could be, but I'd rather try to protect us against such cases | 13:58 |
| TheJulia | we can't protect against everything though, if we spend all our energy in one area, we make no progress in others | 14:07 |
| dtantsur | I think "we product completely broken IPA images at least sometimes" is a good area to make progress | 14:07 |
| TheJulia | do we aactually understand what has happened yet, or do we just know we have a weird gdisk package which doesn't behave like expected nor carry sgdisk it seems | 14:07 |
| dtantsur | TheJulia: see the log link I pasted | 14:08 |
| TheJulia | agree, this is the first and only upstream guard | 14:08 |
| dtantsur | tl;dr after removing polkit, dnf considers a whole bunch of important packages unnecessary | 14:08 |
| TheJulia | I already did, it doesn't have any context beyond the package | 14:08 |
| TheJulia | OH | 14:08 |
| TheJulia | oh jebus | 14:08 |
| dtantsur | Right | 14:08 |
| TheJulia | I didn't catch that | 14:08 |
| dtantsur | I'm trying to safeguard against this by removing polkit and co earlier | 14:08 |
| * TheJulia makes coffee | 14:08 | |
| * dtantsur needs to move the script to pre-isntall | 14:08 | |
| rpittau | yeah that's very bad, I haven't got that at first | 14:08 |
| * TheJulia sips coffee to try and wake up | 14:10 | |
| opendevreview | Dmitry Tantsur proposed openstack/ironic-python-agent-builder master: Move extra package de-installation before the installation phase https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/934962 | 14:10 |
| dtantsur | meanwhile, reminder for myself and everyone: do not assert anything about time.sleep in unit tests | 14:11 |
| * dtantsur stares at https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_42a/934956/1/check/openstack-tox-cover/42ad890/testr_results.html | 14:11 | |
| rpittau | dtantsur: I was looknig at that too :D | 14:11 |
| rpittau | more like staring | 14:12 |
| dtantsur | cool :) | 14:12 |
| dtantsur | I wonder if sleep is used somewhere inside the testing machinery | 14:12 |
| dtantsur | rpittau: I need to switch over to another task, please let me know if you find anything | 14:14 |
| rpittau | yep, so far no luck with local testing | 14:15 |
| opendevreview | Dmitry Tantsur proposed openstack/ironic master: Neutron: account for disable_power_off https://review.opendev.org/c/openstack/ironic/+/934972 | 14:28 |
| TheJulia | sleep failures only really demonstrate themselves under the most extreme cpu conditions | 14:29 |
| TheJulia | like... streaming 8 videos at once on a 6 core machine and then trying to run unit tests | 14:29 |
| opendevreview | Dmitry Tantsur proposed openstack/ironic master: [WIP] Agent deploy: account for disable_power_off https://review.opendev.org/c/openstack/ironic/+/934637 | 14:29 |
| * dtantsur is now curious why TheJulia was streaming 8 videos on one machine | 14:30 | |
| TheJulia | trying to reproduce such failures | 14:30 |
| dtantsur | fair enough :) | 14:30 |
| TheJulia | I *highly* recommend BPS.Space on youtube now | 14:30 |
| TheJulia | the guy is crazy and working on a Mach-3+ space shot | 14:30 |
| dtantsur | please don't tell my brain to go to youtube, we'll never get nc-si support :D | 14:31 |
| TheJulia | lots of fun about materials science | 14:31 |
| TheJulia | fair | 14:31 |
| rpittau | does it count running the tests in a container with other 2 vms on the same machine? | 14:37 |
| TheJulia | depends on how many cores and how busy they are :) | 14:40 |
| * dtantsur notes that mining bitcoins may also make you richer while debugging the tests | 14:44 | |
| rpittau | lol | 14:47 |
| TheJulia | https://review.opendev.org/c/openstack/ironic-specs/+/933612 and https://review.opendev.org/c/openstack/ironic-specs/+/933620 would love some eyeballs :) | 15:00 |
| kubajj | TheJulia: sorry if it was mentioned in the mailing list, I subscribed just recently, is the baremetal networking working group on today? | 15:02 |
| TheJulia | I hadn't really gotten time to sort out making the actual change | 15:04 |
| TheJulia | I ended up being sick Friday as well | 15:04 |
| TheJulia | uhh | 15:04 |
| opendevreview | Dmitry Tantsur proposed openstack/ironic master: [WIP] Agent deploy: account for disable_power_off https://review.opendev.org/c/openstack/ironic/+/934637 | 15:05 |
| TheJulia | so I guess we would be meeting now if it was today | 15:06 |
| * dtantsur is totally cool with skipping | 15:06 | |
| TheJulia | lets try to start next week | 15:06 |
| dtantsur | I suspect everyone is waiting for The Official Announcement | 15:06 |
| TheJulia | I also didn't get any replies which stalled me | 15:06 |
| TheJulia | yeah | 15:06 |
| kubajj | TheJulia: ok, we (as CERN) would be interested to participate, next week sounds well | 15:08 |
| TheJulia | Excellent! | 15:08 |
| iurygregory | TheJulia, have you seen any report of virtual media not working in ProLiant DL365 Gen11 ? | 15:20 |
| TheJulia | no | 15:21 |
| iurygregory | ack tks! | 15:21 |
| dtantsur | Mmm, sigh. Testing disable_power_off is going to be complicated because libvirt does not apply changes on reboots. | 15:30 |
| dtantsur | Any opinions about implementing reboots in sushy as destroy+start? | 15:44 |
| dtantsur | * sushy-tools of course | 15:44 |
| iurygregory | dtantsur, not against doing it :D | 15:56 |
| dtantsur | The OVN job starts looking unhealthy, does anyone know why? https://zuul.opendev.org/t/openstack/builds?job_name=ironic-tempest-ovn-uefi-ipmi-pxe&project=openstack/ironic | 15:58 |
| rpittau | dtantsur: one reason could be that we're not using an up-to-date OVN/OVS versions, neutron people suggested to use the versions I've added in the ubuntu noble migration patch | 16:02 |
| dtantsur | Node testvm1 failed to reach state available. It's in state clean failed, and has error: None | 16:33 |
| * dtantsur flips table | 16:33 | |
| jamesdenton | "failed cleaning successfully" | 16:35 |
| TheJulia | brraaaaaaaaains | 16:50 |
| iurygregory | {"@odata.id":"/redfish/v1/Managers/1/VirtualMedia/0"}, | 16:53 |
| iurygregory | {"@odata.id":"/redfish/v1/Managers/1/VirtualMedia/0"} I like when the hardware has two VirtualMedia members with the same ID :D | 16:53 |
| * dtantsur this_is_fine.jpg | 16:53 | |
| iurygregory | I told the person to try updating/downgrading or reach out to HPE to find more about the issue | 16:54 |
| iurygregory | {"error":{"code":"iLO.0.10.ExtendedInfo","message":"See @Message.ExtendedInfo for more information.","@Message.ExtendedInfo":[{"MessageId":"Base.1.18.InternalError"}]}} | 16:55 |
| iurygregory | \o/ best http response | 16:56 |
| rpittau | JayF, TheJulia, dtantsur, iurygregory, I'll be unexpectedly out next Monday, please take care of the meeting, thanks! | 17:02 |
| TheJulia | InternalError is likely it can't verify what it expects | 17:02 |
| TheJulia | rpittau: ack, thanks | 17:02 |
| rpittau | bye everyone, see you next Tuesday o/ | 17:02 |
| iurygregory | rpittau, ack | 17:02 |
| TheJulia | iurygregory: That sounds much like the dell hardware I was looking at yesterday which claimed it had a service listening on a port | 17:02 |
| TheJulia | and it was a lie... | 17:02 |
| iurygregory | TheJulia, oh perfect | 17:03 |
| JayF | rpittau: ok, hope everything is goin' okay over there o/ | 17:03 |
| TheJulia | well, lie is a harsh way of putting it | 17:03 |
| iurygregory | so not only HPE is doing that? :D | 17:03 |
| TheJulia | Turns out that gray area interpretation in redfish which is permitted allows for it | 17:03 |
| TheJulia | so the put something in it seems to serve as a value | 17:03 |
| iurygregory | omg, if we can workaround is ok | 17:03 |
| TheJulia | oh, no, deviation and brokenness is an inherent standards implementation requirement | 17:03 |
| iurygregory | but with the machine answering 500 when you try to query the VirtualMedia resource is a bit complicated | 17:04 |
| iurygregory | I prefer when they have non-standards att as required in the request :D | 17:04 |
| TheJulia | Dell does now, at least in 7.10.something.something, explicitly list the VirtualMedia resource on the Manager as deprecated | 17:04 |
| TheJulia | A 500 in response to a get or post/patch? | 17:05 |
| JayF | Hey folks, just an aside: I recorded https://www.youtube.com/watch?v=oy25mATgbrY and will be changing it to "public" (currently unlisted) by the end of the day. Figured I'd give the community an opportunity to scream test :D | 17:06 |
| opendevreview | Jay Faulkner proposed openstack/ironic-specs master: 2025.1 Ironic priorities / PTG Summary https://review.opendev.org/c/openstack/ironic-specs/+/934092 | 17:14 |
| JayF | I said this in the PR, but since we usually land these with lazy consensus; I'm going to self-land this on Friday unless it gets a -1 before then. We can revise further if needed afterwards. | 17:20 |
| opendevreview | Dmitry Tantsur proposed openstack/ironic-python-agent-builder master: Move extra package de-installation before the installation phase https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/934962 | 17:22 |
| dtantsur | Another desperate attempt to fix the DIB builds ^^^ | 17:22 |
| dtantsur | I suspect it may cause cloud-init to get installed.. we'll see | 17:23 |
| JayF | We can revert the DIB change that caused this, too, if needed. | 17:24 |
| JayF | at least until we suss out a better way | 17:24 |
| dtantsur | It's not necessarily a DIB change, could be something in CS9 | 17:24 |
| JayF | I'm 99% sure I know exactly what change did it | 17:24 |
| JayF | https://opendev.org/openstack/diskimage-builder/commit/fd8fae299e8de8a4765dfb030ea94dcefd55b00c | 17:25 |
| dtantsur | jesus.. | 17:27 |
| JayF | Yeah, that 100% shouldn't be needed | 17:31 |
| JayF | but apparently is ... :( | 17:31 |
| TheJulia | ugh.... | 17:31 |
| opendevreview | Adam McArthur proposed openstack/ironic-tempest-plugin master: WIP: Microversion handling test https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/933970 | 18:37 |
| cardoe | JayF: not sure how ya feel about my spam o' commits against sushy for getting some more pre-commit or if you'd rather I squash things. | 18:45 |
| cardoe | or what ya think about using pyupgrade | 18:45 |
| cardoe | less looking for reviews and more looking for feelings on approach / tools | 18:46 |
| opendevreview | Adam McArthur proposed openstack/ironic-tempest-plugin master: WIP: Microversion handling test https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/933970 | 19:03 |
| cardoe | adamcarthur5: https://review.opendev.org/c/openstack/tenks/+/907112/1 if you rebase that the following 2 patches should be able to land. | 19:18 |
| adamcarthur5 | Sounds good, I'll get on that | 19:23 |
| opendevreview | Adam McArthur proposed openstack/ironic-tempest-plugin master: WIP: Microversion handling test https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/933970 | 20:04 |
| JayF | https://review.opendev.org/c/openstack/ironic/+/933622 if someone has some cycles, I gave some feedback here but have a nagging feeling I'm missing something. I specifically think dtantsur would find it interesting. | 20:16 |
| JayF | basically that's the white whale of Ironic bugs; moving configdrive outta instance_info | 20:20 |
| opendevreview | Adam McArthur proposed openstack/tenks master: [codespell] Fixing Spelling Mistakes https://review.opendev.org/c/openstack/tenks/+/907112 | 20:32 |
| opendevreview | Adam McArthur proposed openstack/tenks master: [codespell] Adding Tox Target for Codespell https://review.opendev.org/c/openstack/tenks/+/907113 | 20:32 |
| opendevreview | Adam McArthur proposed openstack/tenks master: [codespell] Adding CI target for Tox Codespell https://review.opendev.org/c/openstack/tenks/+/907114 | 20:32 |
| adamcarthur5 | That should be it now, thanks cardoe for letting me know | 20:33 |
| TheJulia | brrrraaains | 21:24 |
| opendevreview | Merged openstack/python-ironicclient master: Support /v1/shards https://review.opendev.org/c/openstack/python-ironicclient/+/933894 | 21:50 |
| JayF | https://review.opendev.org/c/openstack/oslo.messaging/+/914840 we might wanna look at that in context of our json-rpc stuff | 22:09 |
| JayF | someone adding an http driver there | 22:09 |
| *** tkajinam is now known as Guest9338 | 22:33 | |
| opendevreview | Julia Kreger proposed openstack/ironic-tempest-plugin master: Fix failure cases around test_ports https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/934387 | 23:05 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!