| opendevreview | Eduardo Santos proposed openstack/diskimage-builder master: Fix openSUSE images and bump them to 15.3 https://review.opendev.org/c/openstack/diskimage-builder/+/825347 | 02:24 |
|---|---|---|
| *** cstone7 is now known as cstone | 05:13 | |
| *** priteau_ is now known as priteau | 11:16 | |
| stevebaker[m] | ianw: hey I'm having an issue with 03-reset-bls-entries and latest centos9 images. grub2-switch-to-blscfg fails with "grub2-probe: error: cannot find a device for / (is /dev mounted?)". This happens in more than one image type (ipa ramdisk build, a basic utility vm image) | 21:38 |
| ianw | stevebaker[m]: hrm, are there bls entries? | 21:43 |
| ianw | i think it would be great to try and get the grub maintainer's response on fixing this in grub | 21:43 |
| stevebaker[m] | ianw: in the base image? yes https://paste.opendev.org/show/812275/ | 21:44 |
| ianw | i just noticed https://bugzilla.redhat.com/show_bug.cgi?id=2032680 is held up on a technicality, let me reupload that patch | 21:48 |
| stevebaker[m] | ianw: can you point me at the gitlab merge request? I might try and patch a base image to test | 21:53 |
| ianw | i have only sent the patch in as an attachment to that bug | 21:54 |
| stevebaker[m] | ianw: so does that patch mean 03-reset-bls-entries isn't required at all? | 21:58 |
| ianw | right, because with that patch, grub2-mkconfig would update the BLS entries that come on the image | 22:00 |
| ianw | the problem is they have some random machine-id | 22:00 |
| stevebaker[m] | ianw: how about 03-reset-bls-entries renames the existing entry filename to match the machine-id> | 22:01 |
| stevebaker[m] | ? | 22:01 |
| ianw | it can do that too, i guess | 22:03 |
| stevebaker[m] | Or do whatever we can to avoid grub2-switch-to-blscfg, it is brittle in our dib chroot | 22:04 |
| ianw | i think that's fine, i think i just used that for convenience | 22:09 |
| ianw | but this *was* working? | 22:09 |
| ianw | i mean it seems to work in the dib gate, in the centos image | 22:09 |
| ianw | 2022-01-20 03:06:15.867 | dib-run-parts Running /tmp/in_target.d/pre-install.d/03-reset-bls-entries | 22:11 |
| ianw | https://e856287c707d0d738c8a-25f8dcd5db154e1632e2236aa5a8224a.ssl.cf2.rackcdn.com/825347/3/check/dib-functests/e7bd0c8/logs/centos_9-stream-build-succeeds.PASS.log | 22:11 |
| ianw | i'm not sure what's different | 22:11 |
| stevebaker[m] | ianw: that is using CentOS-Stream-GenericCloud-9-20220119.0.x86_64.qcow2, it failed for me with CentOS-Stream-GenericCloud-9-20220120.0.x86_64.qcow2. I'll try and recreate that gate image locally. But I'm having other issues with grub2-switch-to-blscfg on my workstation, efi detection comes from the host, so it assume the config file is /etc/grub2-efi.cfg which is missing unless grub2-efi is installed | 22:16 |
| ianw | iirc all that really does is ls /lib/modules/* and runs kernel-install for each one | 22:16 |
| ianw | the other option is to use the -minimal builds, which i feel like i've been saying for years. we spend so much time keeping all these different paths working for very little overall benefit IMO | 22:19 |
| ianw | i've pushed the new patch so hopefully that can be considered now | 22:24 |
| stevebaker[m] | ianw: I've proposed a change to move ipa to centos-minimal, which is what we document anyway https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/825414. However its failing on centos9 with an obscure error. It works fine for me locally https://zuul.opendev.org/t/openstack/build/b7b7e839019c4d77bf546a097dff3a7d/log/job-output.txt#959 | 22:27 |
| ianw | sudo mount -t proc none /tmp/dib_build.Fnlr8AUJ/mnt/proc | 22:30 |
| ianw | mount: /tmp/dib_build.Fnlr8AUJ/mnt/proc: none already mounted on /sys/fs/bpf. | 22:30 |
| ianw | that is indeed a new one | 22:30 |
| ianw | actually i think the real error is further up | 22:32 |
| ianw | 2022-01-20 01:14:32.445097 | ubuntu-focal | 2022-01-20 01:14:32.445 | Failed to download initial packages: basesystem filesystem setup bash glibc ncurses-libs centos-gpg-keys centos-stream-release centos-stream-repos | 22:32 |
| ianw | dnf download --verbose --releasever=9-stream --setopt=reposdir=/tmp/dib_build.Fnlr8AUJ/hooks/yum.repos.d/9-stream --setopt=cachedir=/tmp/tmp.1dLazGlhbU --destdir=/tmp/tmp.40DxR6ZIcu basesystem filesystem setup bash glibc ncurses-libs centos-gpg-keys centos-stream-release centos-stream-repos | 22:32 |
| ianw | 2022-01-20 01:14:32.427675 | ubuntu-focal | 2022-01-20 01:14:32.427 | /tmp/dib_build.Fnlr8AUJ/hooks/root.d/08-yum-chroot: line 145: dnf: command not found | 22:32 |
| ianw | yeah, 2022-01-20 01:12:33.188372 | localhost | Inventory Hostname: ubuntu-focal | 22:33 |
| stevebaker[m] | maybe this is why IPA jobs use the centos element, because IPA jobs don't use any centos nodepool | 22:38 |
| ianw | you can build from the nodepool-builder container ... but this might be getting too far off track | 22:39 |
| stevebaker[m] | my track is meant to be unblocking the tripleo build pipeline, I've been far off track for a while now ;) | 22:41 |
| ianw | yeah, i dunno :( | 22:53 |
| ecsantos[m] | Built CentOS 9 Stream with the 20220120 QCOW2 with no problems: https://pastebin.com/raw/Kp7TZrmX | 22:54 |
| ecsantos[m] | Not using Nodepool though | 22:54 |
| ianw | nodepool does not actually build any of these .qcow2 based elements at all actually | 22:55 |
| ianw | (well, opendev nodepool, at least, and in the dib gate) | 22:55 |
| ianw | the gate testing for these is done via dib-functests, which builds on a bullseye node | 22:57 |
| ecsantos[m] | stevebaker: Out of curiosity, which job is failing in the TripleO pipline? That depend on the centos element | 22:58 |
| ecsantos[m] | s/pipline/pipeline/ | 22:59 |
| stevebaker[m] | ecsantos: this is about centos9 enablement in general, here is the IPA job running in master, and whatever changes are made to ironic-python-agent-builder need to be backportable to wallaby https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/825411 | 23:01 |
| ecsantos[m] | Oh, weird, it doesn't found dnf | 23:12 |
| ianw | dnf isn't available on focal | 23:12 |
| ianw | bullseye it is | 23:12 |
| ecsantos[m] | Oooh, I though it ran inside the chroot | 23:12 |
| ianw | we use it on the host system to extract the initial chroot for the -minimal builds | 23:12 |
| ecsantos[m] | I had a similar issue when building ubuntu-minimal on a CentOS 7 host (it needs debootstrap), but in this case it's missing the package manager itself | 23:19 |
| ecsantos[m] | If using a Focal node isn't a requirement maybe just switching [1] to a Red Hat-based host would just work(tm)? | 23:19 |
| ecsantos[m] | [1] https://opendev.org/openstack/ironic-python-agent-builder/src/branch/master/zuul.d/ironic-python-agent-builder-jobs.yaml#L56 | 23:19 |
| ianw | looks like grub put that patch into f36, so that's something | 23:35 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!