| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: octavia: Fix hm-interface after bumping openstack collection https://review.opendev.org/c/openstack/kolla-ansible/+/878209 | 05:36 |
|---|---|---|
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: octavia: Fix hm-interface after bumping openstack collection https://review.opendev.org/c/openstack/kolla-ansible/+/878209 | 05:45 |
| opendevreview | Michal Nasiadka proposed openstack/kolla stable/yoga: Pin setuptools=67.2.* https://review.opendev.org/c/openstack/kolla/+/873913 | 05:53 |
| opendevreview | Dr. Jens Harbott proposed openstack/kolla-ansible master: Stop running broken openeuler job https://review.opendev.org/c/openstack/kolla-ansible/+/879129 | 06:13 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: octavia: Fix hm-interface after bumping openstack collection https://review.opendev.org/c/openstack/kolla-ansible/+/878209 | 06:25 |
| opendevreview | Michal Nasiadka proposed openstack/kolla stable/yoga: CI: Fix rocky no infra wheels job https://review.opendev.org/c/openstack/kolla/+/879131 | 06:34 |
| opendevreview | Dr. Jens Harbott proposed openstack/kolla-ansible master: DNM: Test some more scenarios on debian https://review.opendev.org/c/openstack/kolla-ansible/+/879132 | 06:38 |
| opendevreview | Dr. Jens Harbott proposed openstack/kolla-ansible master: DNM: Test some more scenarios on debian https://review.opendev.org/c/openstack/kolla-ansible/+/879132 | 06:46 |
| opendevreview | Dr. Jens Harbott proposed openstack/kolla-ansible master: DNM: Test some more scenarios on debian https://review.opendev.org/c/openstack/kolla-ansible/+/879132 | 06:49 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: [release] Use Antelope sources by default https://review.opendev.org/c/openstack/kolla/+/879133 | 06:54 |
| mnasiadka | Seems it's time to use Antelope, Nova broke on master | 06:54 |
| frickler | that escalated quickly ;) | 06:57 |
| mnasiadka | Well, we should start going through the release checklist to get ready for branching :-) | 07:02 |
| mnasiadka | and that's the first step | 07:02 |
| mnasiadka | hmm, maybe that's rabbitmq 3.11.12 released 7 hours ago | 07:06 |
| mnasiadka | crap | 07:06 |
| mnasiadka | https://github.com/rabbitmq/rabbitmq-server/releases | 07:07 |
| mnasiadka | let's pin and see | 07:07 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: rabbitmq: Pin to 3.11.11 https://review.opendev.org/c/openstack/kolla/+/879134 | 07:09 |
| frickler | mnasiadka: where did you see that nova failure? | 07:11 |
| mnasiadka | this is the rabbitmq log - nova_compute fails to connect - https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_7b7/878209/21/check/kolla-ansible-rocky9/7b7d31f/primary/logs/kolla/rabbitmq/rabbit%40primary.txt | 07:12 |
| frickler | ah, nice, that would also explain the failures in my downstream CI tonight | 07:15 |
| mnasiadka | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_7b7/878209/21/check/kolla-ansible-rocky9/7b7d31f/primary/logs/kolla/nova/nova-compute.txt - nova rmq connection fail is rather just an effect | 07:15 |
| mnasiadka | if pinning will pass - I'll raise an issue in rabbitmq's github | 07:15 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: [release] Use Antelope sources by default https://review.opendev.org/c/openstack/kolla/+/879133 | 07:17 |
| mnasiadka | forgot we changed to 2023.1 ;) | 07:17 |
| opendevreview | Merged openstack/kolla stable/yoga: CI: Fix rocky no infra wheels job https://review.opendev.org/c/openstack/kolla/+/879131 | 07:20 |
| opendevreview | Michal Nasiadka proposed openstack/kolla stable/yoga: Pin setuptools=67.2.* https://review.opendev.org/c/openstack/kolla/+/873913 | 07:31 |
| opendevreview | Pierre Riteau proposed openstack/kayobe master: Build Ubuntu images with IPA when on Ubuntu https://review.opendev.org/c/openstack/kayobe/+/870522 | 08:06 |
| frickler | mnasiadka: that rmq pin doesn't seem to work, I still see 3.11.12 running in the failing jobs | 08:10 |
| frickler | also seems I can stop looking at everything else because of that issue :( | 08:11 |
| frickler | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_882/879134/1/check/kolla-ansible-debian/8827671/primary/logs/build/rabbitmq.log | 08:13 |
| frickler | ah, maybe we still need to pin 3.11.* to some other prio? gotta check locally | 08:14 |
| opendevreview | Bartosz Bezak proposed openstack/kayobe stable/yoga: [DNM] ansible-role-interfaces NetworkManager test https://review.opendev.org/c/openstack/kayobe/+/879140 | 08:26 |
| mnasiadka | frickler: not a Debuntu expert :) | 08:31 |
| opendevreview | Dr. Jens Harbott proposed openstack/kolla master: rabbitmq: Pin to 3.11.11 https://review.opendev.org/c/openstack/kolla/+/879134 | 08:32 |
| frickler | mnasiadka: found it ^^ | 08:32 |
| mnasiadka | Argh, good :) | 08:35 |
| mnasiadka | I already raised a bug/discussion in rabbitmq, let’s see how that goes | 08:36 |
| frickler | mnasiadka: there's an open question for you there, let me know if you need help | 09:02 |
| frickler | I'm setting up a repro anyway now for my downstream issue. will run with the proposed fix when I get a deb | 09:25 |
| opendevreview | Dr. Jens Harbott proposed openstack/kolla master: [release] Use Antelope sources by default https://review.opendev.org/c/openstack/kolla/+/879133 | 09:31 |
| opendevreview | Bartosz Bezak proposed openstack/kayobe stable/yoga: [DNM] ansible-role-interfaces NetworkManager test https://review.opendev.org/c/openstack/kayobe/+/879140 | 09:31 |
| opendevreview | Bartosz Bezak proposed openstack/kayobe master: CI: Add custom routing table output to logs. https://review.opendev.org/c/openstack/kayobe/+/879147 | 10:08 |
| mnasiadka | frickler: they want some comand to be run, if you can test that out before fixing - would be nice | 10:38 |
| mnasiadka | and they have some alpha/beta version for testing | 10:39 |
| mnasiadka | I'm stuck in some meetings... | 10:39 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: octavia: Fix hm-interface after bumping openstack collection https://review.opendev.org/c/openstack/kolla-ansible/+/878209 | 10:54 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: octavia: Fix hm-interface after bumping openstack collection https://review.opendev.org/c/openstack/kolla-ansible/+/878209 | 10:55 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: CI: dump tab2list RMQ 3.11.12 https://review.opendev.org/c/openstack/kolla-ansible/+/879149 | 11:00 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: Fix test malicious tarball fail https://review.opendev.org/c/openstack/kolla/+/878562 | 11:17 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: Fix test malicious tarball fail https://review.opendev.org/c/openstack/kolla/+/878562 | 11:30 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: octavia: Fix hm-interface after bumping openstack collection https://review.opendev.org/c/openstack/kolla-ansible/+/878209 | 11:43 |
| opendevreview | Merged openstack/kolla master: rabbitmq: Pin to 3.11.11 https://review.opendev.org/c/openstack/kolla/+/879134 | 11:59 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: cli: fix find globals.d https://review.opendev.org/c/openstack/kolla-ansible/+/879154 | 12:03 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: Fix test malicious tarball fail https://review.opendev.org/c/openstack/kolla/+/878562 | 12:35 |
| opendevreview | Merged openstack/kayobe master: Move to Launchpad for project management https://review.opendev.org/c/openstack/kayobe/+/878776 | 13:29 |
| opendevreview | Bartosz Bezak proposed openstack/kayobe stable/zed: Move to Launchpad for project management https://review.opendev.org/c/openstack/kayobe/+/879104 | 13:32 |
| opendevreview | Bartosz Bezak proposed openstack/kayobe stable/yoga: Move to Launchpad for project management https://review.opendev.org/c/openstack/kayobe/+/879105 | 13:32 |
| opendevreview | Bartosz Bezak proposed openstack/kayobe stable/xena: Move to Launchpad for project management https://review.opendev.org/c/openstack/kayobe/+/879106 | 13:32 |
| opendevreview | Bartosz Bezak proposed openstack/kayobe stable/wallaby: Move to Launchpad for project management https://review.opendev.org/c/openstack/kayobe/+/879107 | 13:33 |
| frickler | mnasiadka: this is still failing with rmq https://review.opendev.org/c/openstack/kolla-ansible/+/879132 do I need to wait for the periodic pipeline for new images? can I trigger those builds manually? or can we drop the broken builds from quay? | 13:38 |
| mnasiadka | frickler: yes, periodic runs in the morning - and that's our only publish job | 13:39 |
| mnasiadka | so, we could think of running the publish job post Kolla merges - or having an option of manually triggering it | 13:39 |
| mnasiadka | frickler: is there an option to use zuul-client or something similar to trigger a job run? | 13:40 |
| frickler | I'll try to trigger something manually as a one off now. yes, via zuul-client, but you need to be infra-root for that as of now | 13:40 |
| fungi | and it enqueues a reference into a pipeline, it can't just rerun a single job (though if that job's the only thing run in that pipeline, i suppose the end result will be approximately the same) | 13:54 |
| mnasiadka | does it make sense to run the publish job in the promote pipeline? I guess we don't get so many jobs these days in Kolla, so that wouldn't be a big load on Zuul | 13:56 |
| frickler | it's four different jobs for different distros/arches, but we want them all to run, sorry for sloppy wording | 13:59 |
| mnasiadka | frickler: but that's still one pipeline called periodic | 14:01 |
| mnasiadka | so that should work | 14:02 |
| frickler | mnasiadka: yes, my comment was more meant for fungi. I'm not sure about the promote pipeline thing, we don't just promote images, but rebuild them, so it takes >2h at least to what zuul says currently | 14:04 |
| frickler | maybe if we don't get broken upstream releases too often, daily will be good enough | 14:04 |
| mnasiadka | it's been enough for some time, we're used to waiting for the next day :) | 14:05 |
| frickler | the other concern that maybe registry rate limits might be triggered if we push too often | 14:05 |
| frickler | also now that I'm aware of it, I can trigger a run more timely next time | 14:06 |
| mnasiadka | I don't think quay.io does those, and we still need to drop Docker Hub (although they have allegedly backed out from removing non-paid teams) | 14:06 |
| opendevreview | Merged openstack/kayobe stable/zed: Move to Launchpad for project management https://review.opendev.org/c/openstack/kayobe/+/879104 | 14:06 |
| fungi | quay doesn't currently rate-limit things, as i understand it, but have said there's always the possibility that they might in the future, so it's still worth keeping in mind | 14:07 |
| opendevreview | Merged openstack/kayobe stable/yoga: Move to Launchpad for project management https://review.opendev.org/c/openstack/kayobe/+/879105 | 14:08 |
| opendevreview | Merged openstack/kayobe stable/xena: Move to Launchpad for project management https://review.opendev.org/c/openstack/kayobe/+/879106 | 14:09 |
| opendevreview | Merged openstack/kayobe stable/wallaby: Move to Launchpad for project management https://review.opendev.org/c/openstack/kayobe/+/879107 | 14:09 |
| opendevreview | Merged openstack/kolla master: Fix test malicious tarball fail https://review.opendev.org/c/openstack/kolla/+/878562 | 15:28 |
| opendevreview | Maksim Malchuk proposed openstack/kayobe master: Adds support for custom Multipathd configuration. https://review.opendev.org/c/openstack/kayobe/+/879190 | 16:02 |
| opendevreview | Pierre Riteau proposed openstack/kolla-ansible master: Allow to specify ca_file for blackbox exporter https://review.opendev.org/c/openstack/kolla-ansible/+/875223 | 16:16 |
| opendevreview | Pierre Riteau proposed openstack/kolla-ansible master: Allow to specify ca_file for blackbox exporter https://review.opendev.org/c/openstack/kolla-ansible/+/875223 | 16:17 |
| opendevreview | Michal Nasiadka proposed openstack/kolla stable/zed: Fix test malicious tarball fail https://review.opendev.org/c/openstack/kolla/+/879176 | 19:10 |
| opendevreview | Michal Nasiadka proposed openstack/kolla stable/yoga: Fix test malicious tarball fail https://review.opendev.org/c/openstack/kolla/+/879177 | 19:11 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!