opendevreview | wu.chunyang proposed openstack/kolla-ansible master: CI: Trove: Create a database instance https://review.opendev.org/c/openstack/kolla-ansible/+/863521 | 01:10 |
---|---|---|
opendevreview | wu.chunyang proposed openstack/kolla-ansible master: CI: Trove: Create a database instance https://review.opendev.org/c/openstack/kolla-ansible/+/863521 | 01:15 |
opendevreview | wu.chunyang proposed openstack/kolla-ansible master: CI: Trove: Create a database instance https://review.opendev.org/c/openstack/kolla-ansible/+/863521 | 08:13 |
opendevreview | wu.chunyang proposed openstack/kolla-ansible master: CI: Trove: Create a database instance https://review.opendev.org/c/openstack/kolla-ansible/+/863521 | 08:21 |
mnasiadka | that kolla-build-ubuntu-podman timing out after 3h is some joke | 08:45 |
mnasiadka | https://zuul.opendev.org/t/openstack/build/c190bf00e0174105b14a540eabd4f568 | 08:45 |
mnasiadka | it happens from time to time | 08:45 |
frickler | mnasiadka: yes, I've been meaning to mention that, too. for a job that usually takes about 30 mins, a timeout of 1h should really be enough | 08:54 |
mnasiadka | it just gets stuck | 08:55 |
mnasiadka | question is why it gets stuck | 08:55 |
frickler | that's another good question, but no idea how to tackle it, there doesn't seem to be anything to be seen in the logs. maybe I should try and hold a node to look at | 08:59 |
mnasiadka | and only on Ubuntu | 09:05 |
mnasiadka | not Debian, not Rocky | 09:05 |
mnasiadka | https://github.com/containers/podman/issues/17628 | 09:24 |
mnasiadka | but no other bugs matching that behaviour | 09:26 |
mnasiadka | Dec 4 14:06:13 ubuntu podman[1903]: @ - - [04/Dec/2023:14:00:40 +0000] "POST /v4.8.0/libpod/build?dockerfile=Dockerfile&forcerm=True&networkmode=host&nocache=False&pull=False&rm=True&t=kolla%2Fironic-prometheus-exporter%3A17.1.0&layers=True&buildargs=null HTTP/1.1" 200 15406 "" "PodmanPy/4.8.0.post1 (API v4.8.0; Compatible v1.40)" | 09:33 |
mnasiadka | and it gets stuck after that | 09:33 |
opendevreview | Pierre Riteau proposed openstack/kayobe master: Ensure git is present before kolla checkout task https://review.opendev.org/c/openstack/kayobe/+/903138 | 09:34 |
mnasiadka | ah, Jammy gets old buildah | 09:35 |
opendevreview | Pierre Riteau proposed openstack/kayobe master: Ensure git is present before checkout tasks https://review.opendev.org/c/openstack/kayobe/+/903138 | 09:36 |
opendevreview | Mark Goddard proposed openstack/kayobe master: Prevent running from a different Kayobe configuration repository https://review.opendev.org/c/openstack/kayobe/+/903139 | 09:36 |
opendevreview | Matt Crees proposed openstack/kolla-ansible master: Add precheck for RabbitMQ quorum queues https://review.opendev.org/c/openstack/kolla-ansible/+/902787 | 09:37 |
opendevreview | Michal Nasiadka proposed openstack/kolla master: CI: Use newer podman/buildah on Ubuntu Jammy https://review.opendev.org/c/openstack/kolla/+/903161 | 09:55 |
mnasiadka | frickler: ^^ that should fix it I guess | 09:55 |
opendevreview | Michal Nasiadka proposed openstack/kolla master: WIP: Add gunicorn pip package to openstack-base https://review.opendev.org/c/openstack/kolla/+/902874 | 10:19 |
opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Use gunicorn for Nova services https://review.opendev.org/c/openstack/kolla-ansible/+/903165 | 10:22 |
frickler | mnasiadka: hmm, I'm a bit wary of using unstable opensuse repos. maybe we want to try to move build jobs to bookworm instead? (though likely we'll need newer version there, too?) | 10:30 |
mnasiadka | bookworm has newer version | 10:30 |
mnasiadka | frickler: it's only for CI - either that, or we remove the ubuntu job | 10:30 |
mnasiadka | Ubuntu is extremely stable with old Podman and old Buildah | 10:31 |
mnasiadka | we could install newer podman/buildah from newer Ubuntu if you prefer | 10:31 |
frickler | hmm, no, then let's try your solution and make the job non-voting if it doesn't become more stable. maybe with that we can wait for 24.04 then | 10:33 |
osmanlicilegi | morning | 10:34 |
mnasiadka | frickler: it's not that long ;-) | 10:41 |
opendevreview | Matt Crees proposed openstack/kolla-ansible master: Add precheck for RabbitMQ quorum queues https://review.opendev.org/c/openstack/kolla-ansible/+/902787 | 10:44 |
opendevreview | Merged openstack/kayobe master: Fix gateway assignment when seed SNAT is disabled https://review.opendev.org/c/openstack/kayobe/+/902113 | 10:51 |
opendevreview | Merged openstack/kayobe stable/zed: docs: add information about enabling TLS to automated guide https://review.opendev.org/c/openstack/kayobe/+/902227 | 10:51 |
opendevreview | Merged openstack/kayobe stable/yoga: docs: add information about enabling TLS to automated guide https://review.opendev.org/c/openstack/kayobe/+/902228 | 10:51 |
opendevreview | Merged openstack/kayobe stable/yoga: Sync Kolla Ansible feature flags for stable/yoga https://review.opendev.org/c/openstack/kayobe/+/903084 | 10:51 |
opendevreview | Merged openstack/kayobe stable/zed: Clean up release notes https://review.opendev.org/c/openstack/kayobe/+/903125 | 10:51 |
opendevreview | Merged openstack/kayobe stable/2023.1: Clean up release notes https://review.opendev.org/c/openstack/kayobe/+/903124 | 10:51 |
opendevreview | Merged openstack/kayobe stable/yoga: Clean up release notes https://review.opendev.org/c/openstack/kayobe/+/903126 | 10:51 |
opendevreview | Pierre Riteau proposed openstack/kayobe stable/2023.2: Fix gateway assignment when seed SNAT is disabled https://review.opendev.org/c/openstack/kayobe/+/903142 | 10:52 |
opendevreview | Pierre Riteau proposed openstack/kayobe stable/2023.1: Fix gateway assignment when seed SNAT is disabled https://review.opendev.org/c/openstack/kayobe/+/903143 | 10:52 |
opendevreview | Pierre Riteau proposed openstack/kayobe stable/zed: Fix gateway assignment when seed SNAT is disabled https://review.opendev.org/c/openstack/kayobe/+/903144 | 10:52 |
opendevreview | Pierre Riteau proposed openstack/kayobe stable/yoga: Fix gateway assignment when seed SNAT is disabled https://review.opendev.org/c/openstack/kayobe/+/903145 | 10:53 |
opendevreview | Pierre Riteau proposed openstack/kayobe master: Revert "Use OpenStack 2023.2 release" https://review.opendev.org/c/openstack/kayobe/+/903167 | 10:55 |
opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Use gunicorn for Nova services https://review.opendev.org/c/openstack/kolla-ansible/+/903165 | 10:56 |
opendevreview | Merged openstack/kayobe stable/2023.1: Remove kolla_enable_host_ntp variable https://review.opendev.org/c/openstack/kayobe/+/902483 | 10:57 |
opendevreview | Merged openstack/kayobe stable/yoga: Use latest published CentOS Stream 8 image https://review.opendev.org/c/openstack/kayobe/+/902451 | 10:57 |
opendevreview | Merged openstack/kayobe stable/2023.1: Fix configuration dump with inline encrypted variables https://review.opendev.org/c/openstack/kayobe/+/902234 | 10:57 |
opendevreview | Pierre Riteau proposed openstack/kayobe-config stable/yoga: Synchronise with kayobe stable/yoga https://review.opendev.org/c/openstack/kayobe-config/+/903168 | 11:00 |
mnasiadka | frickler: Took 1 hr 2 mins 41 secs - looks a bit better I guess | 11:01 |
mnasiadka | although still slow | 11:02 |
frickler | mnasiadka: I'm not sure I would trust a single measurement, let's check the next run, too, when you fix the whitespace ;) we could still cap the timeout at 90 mins then, too? | 11:03 |
opendevreview | Merged openstack/kayobe stable/zed: Fix configuration dump with inline encrypted variables https://review.opendev.org/c/openstack/kayobe/+/902235 | 11:04 |
opendevreview | Merged openstack/kayobe stable/yoga: Fix configuration dump with inline encrypted variables https://review.opendev.org/c/openstack/kayobe/+/902311 | 11:04 |
mnasiadka | let me check now if we don't have the same issue as RedHat family now - will update the patch | 11:04 |
mnasiadka | no, it's fine | 11:05 |
opendevreview | Pierre Riteau proposed openstack/kayobe-config stable/yoga: Synchronise with kayobe stable/yoga https://review.opendev.org/c/openstack/kayobe-config/+/903168 | 11:10 |
opendevreview | Michal Nasiadka proposed openstack/kolla master: CI: Use newer podman/buildah on Ubuntu Jammy https://review.opendev.org/c/openstack/kolla/+/903161 | 11:13 |
opendevreview | Matt Crees proposed openstack/kayobe master: Stop NetworkManager from overriding resolv.conf https://review.opendev.org/c/openstack/kayobe/+/902561 | 11:20 |
*** hrw is now known as Guest9629 | 11:24 | |
*** hrww is now known as hrw | 11:24 | |
opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Use gunicorn for Nova services https://review.opendev.org/c/openstack/kolla-ansible/+/903165 | 11:47 |
opendevreview | Bartosz Bezak proposed openstack/kayobe master: CI: Use nested nodepools for jobs that are spawning vms https://review.opendev.org/c/openstack/kayobe/+/872647 | 12:07 |
opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Use gunicorn for Nova services https://review.opendev.org/c/openstack/kolla-ansible/+/903165 | 12:19 |
opendevreview | Matt Crees proposed openstack/kayobe master: Stop NetworkManager from overriding resolv.conf https://review.opendev.org/c/openstack/kayobe/+/902561 | 13:54 |
opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Use gunicorn for Nova services https://review.opendev.org/c/openstack/kolla-ansible/+/903165 | 15:03 |
opendevreview | Alex Welsh proposed openstack/kolla-ansible master: Update keystone service user passwords https://review.opendev.org/c/openstack/kolla-ansible/+/903178 | 15:43 |
opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Use gunicorn for Nova services https://review.opendev.org/c/openstack/kolla-ansible/+/903165 | 15:48 |
opendevreview | Merged openstack/kayobe stable/2023.2: Fix gateway assignment when seed SNAT is disabled https://review.opendev.org/c/openstack/kayobe/+/903142 | 18:52 |
opendevreview | Merged openstack/kayobe stable/yoga: Fix gateway assignment when seed SNAT is disabled https://review.opendev.org/c/openstack/kayobe/+/903145 | 18:52 |
opendevreview | Merged openstack/kayobe stable/zed: Fix gateway assignment when seed SNAT is disabled https://review.opendev.org/c/openstack/kayobe/+/903144 | 18:52 |
opendevreview | Merged openstack/kayobe stable/2023.1: Fix gateway assignment when seed SNAT is disabled https://review.opendev.org/c/openstack/kayobe/+/903143 | 18:52 |
opendevreview | Pierre Riteau proposed openstack/kayobe stable/yoga: [DNM] Test c9s IPA builds for stable/yoga https://review.opendev.org/c/openstack/kayobe/+/903242 | 23:02 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!