| opendevreview | Michal Arbet proposed openstack/kolla master: Add podman for image building https://review.opendev.org/c/openstack/kolla/+/825791 | 00:21 |
|---|---|---|
| opendevreview | Michal Arbet proposed openstack/kolla master: Add podman for image building https://review.opendev.org/c/openstack/kolla/+/825791 | 00:28 |
| opendevreview | Michal Arbet proposed openstack/kolla master: Add podman for image building https://review.opendev.org/c/openstack/kolla/+/825791 | 00:31 |
| opendevreview | Michal Arbet proposed openstack/kolla master: Add podman for image building https://review.opendev.org/c/openstack/kolla/+/825791 | 01:38 |
| kevko | \o/ morning | 08:12 |
| SvenKieske | o/ | 08:57 |
| SvenKieske | do you even sleep? :D | 08:57 |
| mnasiadka | sleeping is overrated | 09:00 |
| kevko | haha worked until 4 30 :D | 09:38 |
| kevko | 8 30 i woke up :D | 09:39 |
| kevko | probably I found the issue with aarch64 podman | 09:39 |
| kevko | i was very curious why it is failing | 09:39 |
| kevko | and , do anyone have some idea why podman kolla building working locally but not in CI | 09:39 |
| kevko | ? | 09:40 |
| opendevreview | Michal Arbet proposed openstack/kolla master: Add podman for image building https://review.opendev.org/c/openstack/kolla/+/825791 | 10:06 |
| jangutter | mnasiadka, just minor clarifications regarding the not-at-all confusing b's of debian bullseye bobcat bookworm ... | 10:10 |
| mnasiadka | jangutter: Bobcat is OpenStack release (which is master branch right now), Bullseye is previous Debian release, Bookworm is current Debian release - OpenStack Bobcat will not support Debian Bullseye :) | 10:11 |
| jangutter | mnasiadka: but what I mean is for the stable branch patch, I should also edit this right? https://review.opendev.org/c/openstack/kolla-ansible/+/892744/5/doc/source/user/support-matrix.rst | 10:12 |
| mnasiadka | jangutter: I rather meant the Kolla support-matrix - because there we state support for each service :) | 10:13 |
| jangutter | masiadka: aaah... different repo! | 10:14 |
| mnasiadka | yes, it's tied to container images, so it feels like the obvious place :) | 10:14 |
| mnasiadka | Second thing is - we might think about not building zun for Debian Bookworm at all | 10:15 |
| mnasiadka | (so add that to unbuildable) | 10:16 |
| jangutter | mnasiadka, however, zun seems to rely on comoponets on the _host_ version too, which is independent of the container versions. | 10:16 |
| mnasiadka | yeah, that's true | 10:16 |
| mnasiadka | so maybe we need to add a note in the place you mentioned + a precheck that fails when zun is enabled on Debian with a link to the bug in fail message | 10:17 |
| jangutter | as I understand it, zun currently needs a specific version of docker on the host, and that needs a specific version of etcd in the container. Both requirements which are now no longer supported. | 10:19 |
| jangutter | also, 2023.1 is antelope yeah? Is that still going to support bullseye? | 10:21 |
| hrw | so it looks like zun's weird dependencies are a good sign of 'soon will be forgotten'? | 10:23 |
| mnasiadka | 2023.1 is antelope, that will still support bullseye | 10:23 |
| jangutter | hrw: too zuun, man, too zoon. | 10:23 |
| mnasiadka | so we should ,,drop'' support for zun on Bookworm | 10:23 |
| mnasiadka | so a note in kolla-ansible's support matrix + a precheck in zun role that fails on Debian Bookworm | 10:24 |
| mnasiadka | seems they want to fix it in C | 10:24 |
| mnasiadka | if they don't - we might want to consider dropping Zun at the end of C cycle | 10:24 |
| jangutter | _but_ as I understand it, https://review.opendev.org/c/openstack/kolla-ansible/+/894578 targets only 2023.1 (antelope) and fixes it to use "Bullseye(supported)" in stead of "Bookworm(unsupported)"? | 10:27 |
| jangutter | there is another ironic job defined on that branch that calls itself bullseye but uses bookworm nodes, so I'm thinking that's also an off-by-one error. | 10:29 |
| jangutter | but if bullseye support is getting dropped for 2023.1 then it's that job can certainly be removed instead of fixed. | 10:31 |
| mnasiadka | jangutter: but why is that patch targeting 2023.1? | 10:41 |
| jangutter | the stable series is referencing a job that's only available in the master branch, so can't delete the job in the master branch until the stable series has removed it. | 10:42 |
| jangutter | also, it's unlikely that the stable series _wants_ to run a job variant from the master branch... (the other jobs have been converted to stable branch jobs) | 10:43 |
| mnasiadka | one thing is we might want to run that job on bullseye, true | 10:43 |
| mnasiadka | but I don't believe first statement is true - the job definition is not only available in master branch | 10:43 |
| mnasiadka | ah, it is, it seems we had some typo when doing the backport | 10:44 |
| mnasiadka | thanks for finding out | 10:44 |
| mnasiadka | we should basically have two versions of each job on 2023.1 - both for bullseye and bookworm | 10:45 |
| mnasiadka | can you update 894578 to fix that? | 10:45 |
| jangutter | mnasiadka: yeah, I stumbled on it with this one: https://review.opendev.org/c/openstack/kolla-ansible/+/894573 <--- (first revision of the patch triggered a Zuul error I've never seen before) | 10:45 |
| jangutter | can do | 10:45 |
| mnasiadka | thanks | 10:46 |
| opendevreview | Jan Gutter proposed openstack/kolla-ansible stable/2023.1: debian: fix some debian jobs https://review.opendev.org/c/openstack/kolla-ansible/+/894578 | 10:52 |
| SvenKieske | nice finding :) | 11:34 |
| SvenKieske | maybe that stuff could be templated? like "kolla-ansible-debian-{debian-release}-{service}"? could that improve robustness? | 11:38 |
| jangutter | That part of the Zuul config doesn't work with templating, so there would need to be a zuul.d/jobs.yaml.j2 somewhere... | 11:49 |
| opendevreview | Bartosz Bezak proposed openstack/kolla-ansible master: Add option for extra kernel modules in neutron role https://review.opendev.org/c/openstack/kolla-ansible/+/894735 | 12:06 |
| kevko | mnasiadka: any advice why CI failing but working locally ? | 13:01 |
| kevko | https://review.opendev.org/c/openstack/kolla-ansible/+/893609 | 13:01 |
| kevko | sorry .. | 13:02 |
| kevko | not this | 13:02 |
| kevko | this one https://review.opendev.org/c/openstack/kolla/+/825791 | 13:02 |
| mnasiadka | it fails on the upgrade jobs in kolla-ansible - before the upgrade, so on stable/2023.1 code | 13:06 |
| SvenKieske | docker.errors.BuildError: The command '/bin/sh -c ln -s glance-base-source/* glance && SETUPTOOLS_USE_DISTUTILS=stdlib python3 -m pip --no-cache-dir install --upgrade -c /requirements/upper-constraints.txt /glance glance_store[cinder,vmware,swift,s3] && mkdir -p /etc/glance && cp -r /glance/etc/* /etc/glance/ && sed -i 's|^exec_dirs.*|exec_dirs=/var/lib/kolla/venv/bin,/sbin,/usr/sbin,/bin,/ | 13:07 |
| SvenKieske | usr/bin,/usr/local/bin,/usr/local/sbin|g' /etc/glance/rootwrap.conf && chmod 750 /etc/sudoers.d && chmod 440 /etc/sudoers.d/kolla_glance_sudoers && touch /usr/local/bin/kolla_glance_extend_start && chmod 644 /usr/local/bin/kolla_extend_start /usr/local/bin/kolla_glance_extend_start' returned a non-zero code: 1 | 13:07 |
| SvenKieske | https://zuul.opendev.org/t/openstack/build/8aff621049b7425a8a77397ab7a6905c/log/primary/logs/build/000_FAILED_glance-base.log | 13:07 |
| SvenKieske | there are more failures in the "build" section of the logs | 13:08 |
| mnasiadka | question if stable/2023.1 jobs are not failing on build | 13:09 |
| SvenKieske | glance-base, horizon and neutron-base all fail in the same way here, at least. | 13:10 |
| mnasiadka | todays publish job works | 13:10 |
| opendevreview | Bartosz Bezak proposed openstack/kolla-ansible master: Add option for extra kernel modules in neutron role https://review.opendev.org/c/openstack/kolla-ansible/+/894735 | 13:14 |
| SvenKieske | that tries to install a yanked version of cryptography: https://zuul.opendev.org/t/openstack/build/8aff621049b7425a8a77397ab7a6905c | 13:22 |
| SvenKieske | for some reason our urllib3 also doesn't check https certs..nice | 13:24 |
| kevko | hmm, so the error is not related to podman patchset ? | 13:28 |
| kevko | i checkout the same code ...install requirements and test-requirements in venv and run build glance with same opts and it's not failing | 13:29 |
| SvenKieske | don't know, still going through the logs what exactly is causing the build of these containers to fail | 13:29 |
| kevko | because others are not failing | 13:29 |
| SvenKieske | might have been just a temporary issue during container build, maybe mirror/internet problems. I'll look if I find anything in the logs | 13:30 |
| opendevreview | Michal Arbet proposed openstack/kolla master: [DNM] glance build test https://review.opendev.org/c/openstack/kolla/+/894754 | 13:31 |
| opendevreview | Merged openstack/kolla-ansible master: CI: Add back ARA logging https://review.opendev.org/c/openstack/kolla-ansible/+/891097 | 13:32 |
| kevko | SvenKieske: no it's still failing from morning | 13:32 |
| SvenKieske | is this task supposed to be ignored? " TASK [openstack.kolla.baremetal : Set firewall default policy]" | 13:36 |
| kevko | when: disable_firewall | bool | 13:45 |
| kevko | so yes it is ignored by default | 13:46 |
| kevko | roles/baremetal/defaults/main.yml:disable_firewall: True | 13:46 |
| kevko | SvenKieske: you will not find anything i suppose ...that's why I am asking ..because i really don't know what is the issue ..let's wait for glance build test above ^^ | 13:48 |
| SvenKieske | yes, maybe we could improve logging during container build though? | 13:51 |
| kevko | hmm, deploy.sh is running currently ..so it's definitely issue with pathset :( | 13:52 |
| opendevreview | Alex Welsh proposed openstack/kayobe master: Fix ipa_build_dib_elements_default comments https://review.opendev.org/c/openstack/kayobe/+/894765 | 14:03 |
| opendevreview | Alex Welsh proposed openstack/kayobe master: Fix ipa_build_dib_elements_default comments https://review.opendev.org/c/openstack/kayobe/+/894765 | 14:16 |
| kevko | SvenKieske: hmm, there will be something very uglu in stream which is json loaded | 14:36 |
| SvenKieske | kevko: what do you mean exactly? | 14:42 |
| kevko | *ugly | 14:43 |
| kevko | SvenKieske: i think zuul is adding something to output ..so json.loads(stream) is broken ..i am debugging currently | 14:43 |
| kevko | but still not sure | 14:43 |
| opendevreview | Alex Welsh proposed openstack/kayobe-config stable/2023.1: 2023.1 - Sync defaults with Kayobe https://review.opendev.org/c/openstack/kayobe-config/+/894597 | 14:49 |
| opendevreview | Juan Pablo Suazo proposed openstack/kolla-ansible master: Deploy Glance and Cinder Backup with S3 backend support https://review.opendev.org/c/openstack/kolla-ansible/+/844614 | 14:56 |
| opendevreview | wangjing proposed openstack/kolla-ansible master: Repair the link address of quickstart to open 404 BUG https://review.opendev.org/c/openstack/kolla-ansible/+/894787 | 15:16 |
| opendevreview | Alex Welsh proposed openstack/kayobe stable/2023.1: Remove references to skydive https://review.opendev.org/c/openstack/kayobe/+/894798 | 15:50 |
| opendevreview | Pierre Riteau proposed openstack/kayobe master: Complete Skydive removal and Skyline addition https://review.opendev.org/c/openstack/kayobe/+/894799 | 15:55 |
| opendevreview | Merged openstack/kayobe-config stable/2023.1: 2023.1 - Sync defaults with Kayobe https://review.opendev.org/c/openstack/kayobe-config/+/894597 | 16:55 |
| opendevreview | Michal Arbet proposed openstack/kolla master: Add podman for image building https://review.opendev.org/c/openstack/kolla/+/825791 | 17:49 |
| opendevreview | Michal Arbet proposed openstack/kolla master: Add podman for image building https://review.opendev.org/c/openstack/kolla/+/825791 | 17:56 |
| opendevreview | Michal Arbet proposed openstack/kolla master: Add podman for image building https://review.opendev.org/c/openstack/kolla/+/825791 | 18:52 |
| opendevreview | Merged openstack/kolla-ansible master: Add Quickstart Developer Guide https://review.opendev.org/c/openstack/kolla-ansible/+/863982 | 19:00 |
| opendevreview | Michal Arbet proposed openstack/kolla master: [DNM] glance build test https://review.opendev.org/c/openstack/kolla/+/894754 | 19:19 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: Revert "macros/pip: revert to old setuptools way" https://review.opendev.org/c/openstack/kolla/+/894600 | 19:41 |
| opendevreview | Michal Arbet proposed openstack/kolla master: Add podman for image building https://review.opendev.org/c/openstack/kolla/+/825791 | 19:43 |
| opendevreview | Michal Arbet proposed openstack/kolla master: Add podman for image building https://review.opendev.org/c/openstack/kolla/+/825791 | 20:27 |
| opendevreview | Pierre Riteau proposed openstack/kayobe master: Fix data file path detection with new setuptools https://review.opendev.org/c/openstack/kayobe/+/894831 | 21:10 |
| opendevreview | Pierre Riteau proposed openstack/kayobe master: Fix data file path detection with new setuptools https://review.opendev.org/c/openstack/kayobe/+/894831 | 21:10 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!