Wednesday, 2024-05-01

opendevreviewcid proposed openstack/ironic master: Flexible IPMI credential persistence method configuration  https://review.opendev.org/c/openstack/ironic/+/91722904:23
opendevreviewMerged openstack/ironic-inspector master: Remove old excludes  https://review.opendev.org/c/openstack/ironic-inspector/+/91770204:41
opendevreviewMerged openstack/ironic master: Run neutron for the functional test job  https://review.opendev.org/c/openstack/ironic/+/91612804:55
opendevreviewMerged openstack/ironic master: Remove special treatment of .json for API objects  https://review.opendev.org/c/openstack/ironic/+/91346704:55
opendevreviewMerged openstack/ironic master: Inject a randomized publisher id  https://review.opendev.org/c/openstack/ironic/+/91502204:58
opendevreviewMerged openstack/ironic-lib master: Remove old excludes  https://review.opendev.org/c/openstack/ironic-lib/+/91770305:13
opendevreviewMerged openstack/ironic-python-agent master: Unmount config drives  https://review.opendev.org/c/openstack/ironic-python-agent/+/91728005:50
opendevreviewMerged openstack/ironic-tempest-plugin master: Remove old excludes  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/91771006:40
iurygregorygood morning Ironic, happy holiday, does anyone know about missing features on openstack sdk from our side? example, I know we have the firmware information available via python-ironicclient, but not via openstacksdk...12:32
TheJuliawe likely lack the service_step field on deploy, I'm not sure if work was done for shards. Likely lack /v1/nodes/{ident}history/* stuffs14:00
JayFshards are in the sdk, was required for nova14:25
JayFit's in the cli client too iirc14:26
TheJuliacool cool14:32
opendevreviewMark Goddard proposed openstack/bifrost stable/2024.1: CI: Add a non-voting SLURP upgrade job for Ubuntu Jammy  https://review.opendev.org/c/openstack/bifrost/+/91773214:37
opendevreviewJulia Kreger proposed openstack/ironic-python-agent stable/2024.1: Unmount config drives  https://review.opendev.org/c/openstack/ironic-python-agent/+/91773314:40
opendevreviewJulia Kreger proposed openstack/ironic-python-agent stable/2023.2: Unmount config drives  https://review.opendev.org/c/openstack/ironic-python-agent/+/91773414:41
opendevreviewJulia Kreger proposed openstack/ironic-python-agent stable/2023.1: Unmount config drives  https://review.opendev.org/c/openstack/ironic-python-agent/+/91785214:58
opendevreviewJulia Kreger proposed openstack/ironic stable/2024.1: Inject a randomized publisher id  https://review.opendev.org/c/openstack/ironic/+/91773515:00
opendevreviewJulia Kreger proposed openstack/ironic stable/2023.2: Inject a randomized publisher id  https://review.opendev.org/c/openstack/ironic/+/91786116:08
opendevreviewJulia Kreger proposed openstack/ironic stable/2023.1: Inject a randomized publisher id  https://review.opendev.org/c/openstack/ironic/+/91786216:16
TheJuliaokay, yay for painful backports16:16
opendevreviewJulia Kreger proposed openstack/ironic master: WIP Advanced vmedia deployment test ops  https://review.opendev.org/c/openstack/ironic/+/89801016:34
opendevreviewJulia Kreger proposed openstack/ironic master: docs: revise notes around iso booting for clarity  https://review.opendev.org/c/openstack/ironic/+/91786717:15
opendevreviewMerged openstack/ironic master: Replace cinderclient usage with openstacksdk  https://review.opendev.org/c/openstack/ironic/+/90026517:22
opendevreviewJulia Kreger proposed openstack/ironic master: WIP Advanced vmedia deployment test ops  https://review.opendev.org/c/openstack/ironic/+/89801018:51
opendevreviewJulia Kreger proposed openstack/metalsmith stable/2024.1: Use bootloader element instead of grub2  https://review.opendev.org/c/openstack/metalsmith/+/91773818:56
opendevreviewJulia Kreger proposed openstack/metalsmith stable/2023.2: Use bootloader element instead of grub2  https://review.opendev.org/c/openstack/metalsmith/+/91773918:57
TheJuliasigh, ipa gate broken19:11
JayFegad19:13
JayFahh, stable gates?19:14
* JayF can't find the master failure19:14
TheJuliayeah19:14
TheJulialooks like something with the centos build19:14
JayF:( 19:14
TheJuliaand at the same time metalsmith19:14
TheJuliaI've tagged the metalsmith jobs, all we can really do is push button and wait19:15
JayFI have a fun change close to pushable :D 19:21
TheJulia\o/ https://review.opendev.org/c/openstack/metalsmith/+/91773920:24
TheJuliapassing CI20:24
TheJuliaJust need https://review.opendev.org/c/openstack/metalsmith/+/917738 to wrap up20:24
JayFthat chain is landing, approved as single core for stable20:30
opendevreviewJulia Kreger proposed openstack/ironic master: wip: Provision aarch64 fake-bare-metal-vms  https://review.opendev.org/c/openstack/ironic/+/91544120:48
TheJuliacid: I rebased your change and changed the test name to one which works.20:48
opendevreviewJay Faulkner proposed openstack/ironic master: Add pre-commit configuration and docs  https://review.opendev.org/c/openstack/ironic/+/91788021:03
JayF^^ is said promised fun change, one plumber-visit later lol21:03
opendevreviewJulia Kreger proposed openstack/ironic-tempest-plugin master: Remove agent_ipmitool/pxe_ipmitool tests  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/91790221:06
opendevreviewMerged openstack/metalsmith stable/2023.2: Use bootloader element instead of grub2  https://review.opendev.org/c/openstack/metalsmith/+/91773921:43
opendevreviewMerged openstack/metalsmith stable/2024.1: Use bootloader element instead of grub2  https://review.opendev.org/c/openstack/metalsmith/+/91773821:48
JayFTheJulia: ^ I am giong to kick your IPA change now21:49
TheJuliaI already did21:50
JayFor, you know, you can do it in the same minute I was gonna lol21:50
*** dmellado0334 is now known as dmellado03321:52
TheJuliaI'm thinking we likely need to dial back testing on 2023.1, dib builds erroring on that as well :(21:53
TheJuliahmmmmmm21:59
JayFTheJulia: I'll note I'm between tasks right now, if you want a second pair of eyes I have 'em21:59
TheJuliaits tryign to mount a loop and blowing up22:00
JayFyou have a direct link at hand22:02
TheJulialogging from https://zuul.opendev.org/t/openstack/build/c92ab14ca95e4aadb4fa045ee04edeec22:03
TheJuliatrying to reproduce locally22:03
JayFyeah I'm looking at lines around 2024-05-01 15:53:02.551545 | controller | 2024-05-01 15:53:02.550 | mount: /tmp/tmp.z1YchOI1ze/mnt/boot: wrong fs type, bad option, bad superblock on /dev/mapper/loop1p3, missing codepage or helper program, or other error.22:04
JayFthis smells like you need ${fstype}-tools22:05
JayFwhich seems impossible22:05
TheJuliaya know what, the kernel log might have details22:05
JayFit's never making the fs22:06
JayFat least afaict22:06
TheJuliaMay 01 15:53:02 np0037417007 kernel: XFS (dm-2): Filesystem cannot be safely mounted by this kernel.22:06
TheJuliabingo22:06
TheJuliaso a pin back in time might... work22:06
JayFwhere is loop1p3 hydrated, then?22:07
TheJulialist of devices from the image22:07
TheJuliaso the extractor mounts everything up22:07
TheJuliaand that is what detonates22:07
JayFoooooh22:07
JayFloop1 is blah.raw22:07
JayFof course it is22:07
JayFTheJulia: relink feature in xfs22:08
JayFTheJulia: so if we can find a kernel for this that supports it; awesome. otherwise we'll have to change images22:09
JayFno way to disable it after the fact22:09
JayFHmm.22:09
TheJuliaI think we could pin to an older image22:12
TheJuliawhich should be okay for CI22:12
JayFI kinda am curious if we could mirror it22:13
JayFbecause I'm feeling a bit burned from dnsmasq old debs disappearing22:13
JayFand I don't want us to re-troubleshoot this same problem in 3 months22:13
TheJulialooks like we just set BASE_IMAGE_FILE22:21
opendevreviewJulia Kreger proposed openstack/ironic-python-agent stable/2023.1: ci: stable-only: explicitly pin centos for builds  https://review.opendev.org/c/openstack/ironic-python-agent/+/91790322:29
* TheJulia crosses her fingers22:31
clarkbcatching up is the issue that new kernels can't mount xfs partitions of some older vintage?23:21
clarkbbecause well maybe the easiest thing is to not use xfs... ext* have been incredibly stable over the years23:22
TheJuliait is xfs in the image being extracted23:23
clarkbwith opendev's nodepool iamges we explicitly build on ext4 for historical reasons like this and build the images from scratch using debootstrap/dnf/etc23:24

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!