Tuesday, 2023-09-12

opendevreviewMichal Arbet proposed openstack/kolla master: Add podman for image building  https://review.opendev.org/c/openstack/kolla/+/82579100:21
opendevreviewMichal Arbet proposed openstack/kolla master: Add podman for image building  https://review.opendev.org/c/openstack/kolla/+/82579100:28
opendevreviewMichal Arbet proposed openstack/kolla master: Add podman for image building  https://review.opendev.org/c/openstack/kolla/+/82579100:31
opendevreviewMichal Arbet proposed openstack/kolla master: Add podman for image building  https://review.opendev.org/c/openstack/kolla/+/82579101:38
kevko\o/ morning08:12
SvenKieskeo/08:57
SvenKieskedo you even sleep? :D08:57
mnasiadkasleeping is overrated09:00
kevkohaha worked until 4 30 :D 09:38
kevko8 30 i woke up :D 09:39
kevkoprobably I found the issue with aarch64 podman 09:39
kevkoi was very curious why it is failing 09:39
kevkoand , do anyone have some idea why podman kolla building working locally but not in CI 09:39
kevko?09:40
opendevreviewMichal Arbet proposed openstack/kolla master: Add podman for image building  https://review.opendev.org/c/openstack/kolla/+/82579110:06
janguttermnasiadka, just minor clarifications regarding the not-at-all confusing b's of debian bullseye bobcat bookworm ...10:10
mnasiadkajangutter: Bobcat is OpenStack release (which is master branch right now), Bullseye is previous Debian release, Bookworm is current Debian release - OpenStack Bobcat will not support Debian Bullseye :)10:11
janguttermnasiadka: but what I mean is for the stable branch patch, I should also edit this right? https://review.opendev.org/c/openstack/kolla-ansible/+/892744/5/doc/source/user/support-matrix.rst10:12
mnasiadkajangutter: I rather meant the Kolla support-matrix - because there we state support for each service :)10:13
janguttermasiadka: aaah... different repo!10:14
mnasiadkayes, it's tied to container images, so it feels like the obvious place :)10:14
mnasiadkaSecond thing is - we might think about not building zun for Debian Bookworm at all10:15
mnasiadka(so add that to unbuildable)10:16
janguttermnasiadka, however, zun seems to rely on comoponets on the _host_ version too, which is independent of the container versions.10:16
mnasiadkayeah, that's true10:16
mnasiadkaso maybe we need to add a note in the place you mentioned + a precheck that fails when zun is enabled on Debian with a link to the bug in fail message10:17
jangutteras I understand it, zun currently needs a specific version of docker on the host, and that needs a specific version of etcd in the container. Both requirements which are now no longer supported.10:19
jangutteralso, 2023.1 is antelope yeah? Is that still going to support bullseye?10:21
hrwso it looks like zun's weird dependencies are a good sign of 'soon will be forgotten'?10:23
mnasiadka2023.1 is antelope, that will still support bullseye10:23
jangutterhrw: too zuun, man, too zoon.10:23
mnasiadkaso we should ,,drop'' support for zun on Bookworm10:23
mnasiadkaso a note in kolla-ansible's support matrix + a precheck in zun role that fails on Debian Bookworm10:24
mnasiadkaseems they want to fix it in C10:24
mnasiadkaif they don't - we might want to consider dropping Zun at the end of C cycle10:24
jangutter_but_ as I understand it, https://review.opendev.org/c/openstack/kolla-ansible/+/894578 targets only 2023.1 (antelope) and fixes it to use "Bullseye(supported)" in stead of "Bookworm(unsupported)"?10:27
jangutterthere is another ironic job defined on that branch that calls itself bullseye but uses bookworm nodes, so I'm thinking that's also an off-by-one error.10:29
jangutterbut if bullseye support is getting dropped for 2023.1 then it's that job can certainly be removed instead of fixed.10:31
mnasiadkajangutter: but why is that patch targeting 2023.1?10:41
jangutterthe stable series is referencing a job that's only available in the master branch, so can't delete the job in the master branch until the stable series has removed it.10:42
jangutteralso, it's unlikely that the stable series _wants_ to run a job variant from the master branch... (the other jobs have been converted to stable branch jobs)10:43
mnasiadkaone thing is we might want to run that job on bullseye, true10:43
mnasiadkabut I don't believe first statement is true - the job definition is not only available in master branch10:43
mnasiadkaah, it is, it seems we had some typo when doing the backport10:44
mnasiadkathanks for finding out10:44
mnasiadkawe should basically have two versions of each job on 2023.1 - both for bullseye and bookworm10:45
mnasiadkacan you update 894578 to fix that?10:45
janguttermnasiadka: yeah, I stumbled on it with this one: https://review.opendev.org/c/openstack/kolla-ansible/+/894573 <--- (first revision of the patch triggered a Zuul error I've never seen before)10:45
janguttercan do10:45
mnasiadkathanks10:46
opendevreviewJan Gutter proposed openstack/kolla-ansible stable/2023.1: debian: fix some debian jobs  https://review.opendev.org/c/openstack/kolla-ansible/+/89457810:52
SvenKieskenice finding :)11:34
SvenKieskemaybe that stuff could be templated? like "kolla-ansible-debian-{debian-release}-{service}"? could that improve robustness?11:38
jangutterThat part of the Zuul config doesn't work with templating, so there would need to be a zuul.d/jobs.yaml.j2 somewhere... 11:49
opendevreviewBartosz Bezak proposed openstack/kolla-ansible master: Add option for extra kernel modules in neutron role  https://review.opendev.org/c/openstack/kolla-ansible/+/89473512:06
kevkomnasiadka: any advice why CI failing but working locally ? 13:01
kevkohttps://review.opendev.org/c/openstack/kolla-ansible/+/89360913:01
kevkosorry ..13:02
kevkonot this 13:02
kevkothis one https://review.opendev.org/c/openstack/kolla/+/82579113:02
mnasiadkait fails on the upgrade jobs in kolla-ansible - before the upgrade, so on stable/2023.1 code13:06
SvenKieskedocker.errors.BuildError: The command '/bin/sh -c ln -s glance-base-source/* glance     && SETUPTOOLS_USE_DISTUTILS=stdlib python3 -m pip --no-cache-dir install --upgrade -c /requirements/upper-constraints.txt /glance glance_store[cinder,vmware,swift,s3]     && mkdir -p /etc/glance     && cp -r /glance/etc/* /etc/glance/     && sed -i 's|^exec_dirs.*|exec_dirs=/var/lib/kolla/venv/bin,/sbin,/usr/sbin,/bin,/13:07
SvenKieskeusr/bin,/usr/local/bin,/usr/local/sbin|g' /etc/glance/rootwrap.conf     && chmod 750 /etc/sudoers.d     && chmod 440 /etc/sudoers.d/kolla_glance_sudoers     && touch /usr/local/bin/kolla_glance_extend_start     && chmod 644 /usr/local/bin/kolla_extend_start /usr/local/bin/kolla_glance_extend_start' returned a non-zero code: 113:07
SvenKieskehttps://zuul.opendev.org/t/openstack/build/8aff621049b7425a8a77397ab7a6905c/log/primary/logs/build/000_FAILED_glance-base.log13:07
SvenKieskethere are more failures in the "build" section of the logs13:08
mnasiadkaquestion if stable/2023.1 jobs are not failing on build13:09
SvenKieskeglance-base, horizon and neutron-base all fail in the same way here, at least.13:10
mnasiadkatodays publish job works13:10
opendevreviewBartosz Bezak proposed openstack/kolla-ansible master: Add option for extra kernel modules in neutron role  https://review.opendev.org/c/openstack/kolla-ansible/+/89473513:14
SvenKieskethat tries to install a yanked version of cryptography: https://zuul.opendev.org/t/openstack/build/8aff621049b7425a8a77397ab7a6905c13:22
SvenKieskefor some reason our urllib3 also doesn't check https certs..nice13:24
kevkohmm, so the error is not related to podman patchset ? 13:28
kevkoi checkout the same code ...install requirements and test-requirements in venv and run build glance with same opts and it's not failing 13:29
SvenKieskedon't know, still going through the logs what exactly is causing the build of these containers to fail13:29
kevkobecause others are not failing 13:29
SvenKieskemight have been just a temporary issue during container build, maybe mirror/internet problems. I'll look if I find anything in the logs13:30
opendevreviewMichal Arbet proposed openstack/kolla master: [DNM] glance build test  https://review.opendev.org/c/openstack/kolla/+/89475413:31
opendevreviewMerged openstack/kolla-ansible master: CI: Add back ARA logging  https://review.opendev.org/c/openstack/kolla-ansible/+/89109713:32
kevkoSvenKieske: no it's still failing  from morning 13:32
SvenKieskeis this task supposed to be ignored? " TASK [openstack.kolla.baremetal : Set firewall default policy]"13:36
kevkowhen: disable_firewall | bool13:45
kevkoso yes it is ignored by default 13:46
kevkoroles/baremetal/defaults/main.yml:disable_firewall: True13:46
kevkoSvenKieske: you will not find anything i suppose ...that's why I am asking ..because i really don't know what is the issue ..let's wait for glance build test above ^^ 13:48
SvenKieskeyes, maybe we could improve logging during container build though?13:51
kevkohmm, deploy.sh is running currently ..so it's definitely issue with pathset :( 13:52
opendevreviewAlex Welsh proposed openstack/kayobe master: Fix ipa_build_dib_elements_default comments  https://review.opendev.org/c/openstack/kayobe/+/89476514:03
opendevreviewAlex Welsh proposed openstack/kayobe master: Fix ipa_build_dib_elements_default comments  https://review.opendev.org/c/openstack/kayobe/+/89476514:16
kevkoSvenKieske: hmm, there will be something very uglu in stream which is json loaded 14:36
SvenKieskekevko: what do you mean exactly?14:42
kevko*ugly14:43
kevkoSvenKieske: i think zuul is adding something to output ..so json.loads(stream) is broken ..i am debugging currently 14:43
kevkobut still not sure 14:43
opendevreviewAlex Welsh proposed openstack/kayobe-config stable/2023.1: 2023.1 - Sync defaults with Kayobe  https://review.opendev.org/c/openstack/kayobe-config/+/89459714:49
opendevreviewJuan Pablo Suazo proposed openstack/kolla-ansible master: Deploy Glance and Cinder Backup with S3 backend support  https://review.opendev.org/c/openstack/kolla-ansible/+/84461414:56
opendevreviewwangjing proposed openstack/kolla-ansible master: Repair the link address of quickstart to open 404 BUG  https://review.opendev.org/c/openstack/kolla-ansible/+/89478715:16
opendevreviewAlex Welsh proposed openstack/kayobe stable/2023.1: Remove references to skydive  https://review.opendev.org/c/openstack/kayobe/+/89479815:50
opendevreviewPierre Riteau proposed openstack/kayobe master: Complete Skydive removal and Skyline addition  https://review.opendev.org/c/openstack/kayobe/+/89479915:55
opendevreviewMerged openstack/kayobe-config stable/2023.1: 2023.1 - Sync defaults with Kayobe  https://review.opendev.org/c/openstack/kayobe-config/+/89459716:55
opendevreviewMichal Arbet proposed openstack/kolla master: Add podman for image building  https://review.opendev.org/c/openstack/kolla/+/82579117:49
opendevreviewMichal Arbet proposed openstack/kolla master: Add podman for image building  https://review.opendev.org/c/openstack/kolla/+/82579117:56
opendevreviewMichal Arbet proposed openstack/kolla master: Add podman for image building  https://review.opendev.org/c/openstack/kolla/+/82579118:52
opendevreviewMerged openstack/kolla-ansible master: Add Quickstart Developer Guide  https://review.opendev.org/c/openstack/kolla-ansible/+/86398219:00
opendevreviewMichal Arbet proposed openstack/kolla master: [DNM] glance build test  https://review.opendev.org/c/openstack/kolla/+/89475419:19
opendevreviewMichal Nasiadka proposed openstack/kolla master: Revert "macros/pip: revert to old setuptools way"  https://review.opendev.org/c/openstack/kolla/+/89460019:41
opendevreviewMichal Arbet proposed openstack/kolla master: Add podman for image building  https://review.opendev.org/c/openstack/kolla/+/82579119:43
opendevreviewMichal Arbet proposed openstack/kolla master: Add podman for image building  https://review.opendev.org/c/openstack/kolla/+/82579120:27
opendevreviewPierre Riteau proposed openstack/kayobe master: Fix data file path detection with new setuptools  https://review.opendev.org/c/openstack/kayobe/+/89483121:10
opendevreviewPierre Riteau proposed openstack/kayobe master: Fix data file path detection with new setuptools  https://review.opendev.org/c/openstack/kayobe/+/89483121:10

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!