| opendevreview | Adam McArthur proposed openstack/ironic-tempest-plugin master: Microversion Test Generator https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/937206 | 00:14 |
|---|---|---|
| opendevreview | Adam McArthur proposed openstack/ironic-tempest-plugin master: Testing bad microversions on v1/allocations https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/937213 | 00:14 |
| opendevreview | Adam McArthur proposed openstack/ironic-tempest-plugin master: Testing bad microversions on v1/nodes/{uuid}/firmware https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/937214 | 00:14 |
| opendevreview | Jakub Jelinek proposed openstack/ironic-python-agent master: WIP: Fix skip block devices for RAID arrays https://review.opendev.org/c/openstack/ironic-python-agent/+/937342 | 10:19 |
| kubajj | ^ is my WIP patch to fix the skip block devices property. If anybody had any suggestions, why mdadm --examine would not find any superblock and mdadm --detail would give me all the info, please share. (It is probably me not understanding mdadm well, I am sorry in advance) | 10:21 |
| TheJulia | Good morning | 13:43 |
| TheJulia | mnasiadka: do you have a link to this bug? Sounds like we should update our ovn docs | 13:43 |
| mnasiadka | TheJulia: the same I gave you in Indianapolis - https://bugs.launchpad.net/neutron/+bug/1995078 | 14:14 |
| TheJulia | Hmm. I guess I should check the docs because I think I did something with that one | 14:19 |
| * TheJulia adds a todo list, fix docs for that bug | 14:21 | |
| opendevreview | Julia Kreger proposed openstack/ironic master: docs: mention bug 1995078 https://review.opendev.org/c/openstack/ironic/+/937373 | 14:29 |
| TheJulia | mnasiadka: let me know if the update above is accurate or not. I tried to re-parse it into something as short as possible. If you have any suggestions to add further clarity, by all means please feel free to revise the change | 14:32 |
| mnasiadka | TheJulia: commented, I might have some time later to reword it | 14:37 |
| TheJulia | please go ahead and give it a try to reword it. I'm trying to focus on my feature to get images/artifacts from an OCI Container store | 14:38 |
| opendevreview | Michal Nasiadka proposed openstack/ironic master: docs: mention bug 1995078 https://review.opendev.org/c/openstack/ironic/+/937373 | 14:48 |
| cardoe | I've gotta do a sprint planning during the ironic meeting so I'll miss out. | 14:54 |
| cid | I don't think there's any today. IIRC | 15:01 |
| jovial | On clean failure, is the node always put into maintenance? | 15:01 |
| TheJulia | o/ | 15:02 |
| TheJulia | jovial: I think so yes | 15:02 |
| TheJulia | cardoe: unless someone jumps up and down and demands we hold a meeting sans quorum.... :) | 15:02 |
| TheJulia | enjoy sprint planning! | 15:02 |
| TheJulia | jovial: The logic behind doing so is if something wen't really wrong, you want to understand how it failed before proceeding | 15:03 |
| TheJulia | or at least, be able to kind of gather some data and understand the state | 15:03 |
| jovial | TheJulia, Thanks, that makes sense. I've just come across a node on a clients deployment in the clean failed state with maintenance unset, the last error is a timeout waiting the ramdisk to boot. My understanding was that it should always be put into maintenance, so just wanted to double check there were no exceptions. | 15:07 |
| priteau | Hello. This backport has been waiting for another +2 for a month: https://review.opendev.org/c/openstack/bifrost/+/934178 | 15:08 |
| priteau | This bifrost backport would be good to merge as well: https://review.opendev.org/c/openstack/bifrost/+/934660 | 15:09 |
| cardoe | I still gotta get access to +2 in bifrost. | 15:09 |
| TheJulia | Approved | 15:09 |
| TheJulia | well, the backport | 15:09 |
| * cid feels good after reading 1 week worth of chat log. | 15:27 | |
| cid | Talking about bifrost, | 15:27 |
| cid | Is this bug valid, or do we need more details to determine that? https://bugs.launchpad.net/bifrost/+bug/2091091 | 15:27 |
| TheJulia | cid: I think environmental. Specifically the agent boots, but then finds a network via dhcp where it can’t reach the ironic deployment | 15:48 |
| cid | TheJulia: So it has to do with the way the environment was setup, .i.e not a bug? | 15:50 |
| TheJulia | So… it is not advised to have conflicting dhcp servers on networks physically attached to a host. Realistically, we would need more info if that is not the case. No way for us to really, with the minimal logging presented to us, to make a determination beyond this is suspect or incorrectly configured environment | 15:53 |
| cid | This may not have anything to do with the bug,... but what would make dhcp servers conflicting? | 15:57 |
| * cid goes to update the bug's thread | 15:58 | |
| TheJulia | cid: explicit or unrelated configuration | 16:06 |
| TheJulia | cid: physical attachment | 16:06 |
| TheJulia | cid: mulitple other environments with like configuraiton | 16:06 |
| TheJulia | ENETUNREACH makes me think there is more than one dhcp server on the same network | 16:06 |
| JayF | well even generally | 16:10 |
| JayF | DHCP is broadcast on a newtork | 16:10 |
| JayF | so if you have more than one DHCP server serving a subnet, they race each other | 16:11 |
| JayF | one of the classic failure cases in networking :) | 16:11 |
| TheJulia | yup | 16:13 |
| TheJulia | https://imgflip.com/i/9d5uq3 | 16:14 |
| cid | ++, thanks a ton. | 16:19 |
| cid | I will note that the 'phsyical attachment' part is still not clear to me. Does the conflicting config (multiple other envs with similar config, explicit or unrelated config, ...) matter only when physically connected to the host? | 16:19 |
| TheJulia | cid: I sort of expect the host, based upon the report to have multiple ethernet cables physically connected | 16:24 |
| TheJulia | cid: or there is some conflict on primary network used for network booting | 16:24 |
| TheJulia | Those sorts of cases and aspects are going to vary based upon the situation | 16:25 |
| cid | Got it! | 16:27 |
| cid | Thanks | 16:27 |
| opendevreview | Merged openstack/bifrost stable/2024.2: Fix checksum parsing for Cirros and Rocky Linux https://review.opendev.org/c/openstack/bifrost/+/934178 | 16:53 |
| opendevreview | Pierre Riteau proposed openstack/bifrost master: Add support for Ubuntu 24.04 image download https://review.opendev.org/c/openstack/bifrost/+/934177 | 16:58 |
| opendevreview | cid proposed openstack/ironic master: Migrates Inspector rules over to Ironic https://review.opendev.org/c/openstack/ironic/+/918303 | 18:05 |
| cardoe | https://bugs.launchpad.net/nova/+bug/2091185 is the report I made about the vlan support | 18:14 |
| JayF | hmmm | 18:44 |
| JayF | I'm trying to run a local devstack | 18:44 |
| JayF | and getting kernel panics from the ipa image devstack downloaded | 18:44 |
| JayF | [ 23.747748] Kernel panic - not syncing: VFS: Unable to mount root fs on unknown-block(0,0) | 18:45 |
| JayF | is it centos 10, I wonder | 18:46 |
| JayF | does it need -v3? | 18:46 |
| JayF | no, looks like stream 9 | 18:46 |
| JayF | Huh, there's no meaningful explanation for this | 18:47 |
| JayF | cid: ^^ we might need to push our chat about inspector rules, I'm hitting this trying to get a devstack setup for us to test in | 18:47 |
| JayF | and I need to figure out wtf is going on | 18:47 |
| JayF | oh, do we default to bios booting or something? and that's broken now in centos 9 perhaps? | 18:49 |
| JayF | [ 23.316141] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 2024.02-2 03/11/2024 | 18:49 |
| JayF | I am on bios... | 18:49 |
| cid | JayF: Alright. | 18:50 |
| JayF | IRONIC_BOOT_MODE defaults to uefi, but my VM is bios? I don't think I've ever had this problem before but that default might be new (?) | 18:52 |
| JayF | this is so weird, it's not even trying to extract the initramfs | 18:54 |
| JayF | restacking with more ram for each vm and IRONIC_BOOT_MODE=bios | 18:55 |
| JayF | also confirmed I'm running noble and so is the gate | 18:58 |
| JayF | actually, the unstack broke, going to instead try with a UEFI-booting devstack host vm | 18:59 |
| JayF | I never know if my environment is weird or if I'm literally the only person who uses our devstack docs :( | 19:19 |
| cardoe | JayF: that looks like a fun Gentoo error or a ZFS error. Whatever the root filesystem is (or initramfs) doesn't have support in the kernel | 19:45 |
| JayF | it's neither | 19:45 |
| JayF | it's literally a devstack running on an ubuntu noble vm | 19:46 |
| JayF | using the instructions that I have personally used and tested a million times, and just today it's laughing at me | 19:46 |
| JayF | which makes me think we had to change something to make stuff work for noble, and I gotta figure it out | 19:46 |
| cardoe | Just wanted to bring up https://review.opendev.org/c/openstack/ironic/+/937255 I think it should be backported to the stable branches because I think this is broken? | 21:03 |
| JayF | okay, it works, phew, finally | 21:51 |
| JayF | I think basically with our new defaults, devstack doesn't like running on noble+BIOS booted VM | 21:51 |
| JayF | cardoe: probably, dpeending on when the bug was intro'd | 21:52 |
| opendevreview | Verification of a change to openstack/ironic master failed: The i18n function is used but not imported https://review.opendev.org/c/openstack/ironic/+/937255 | 23:21 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!