| opendevreview | Ivan Halomi proposed openstack/kolla-ansible master: Refactor of docker worker https://review.opendev.org/c/openstack/kolla-ansible/+/908295 | 08:01 |
|---|---|---|
| opendevreview | Michal Nasiadka proposed openstack/kolla master: WIP: Fix arm builds https://review.opendev.org/c/openstack/kolla/+/909915 | 08:49 |
| opendevreview | Will Szumski proposed openstack/kayobe master: WIP: Add podman support https://review.opendev.org/c/openstack/kayobe/+/909686 | 09:35 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: WIP: Fix arm builds https://review.opendev.org/c/openstack/kolla/+/909915 | 09:44 |
| opendevreview | Merged openstack/kolla-ansible stable/2023.2: Fix gnocchi-metricd when TLS and Swift enabled https://review.opendev.org/c/openstack/kolla-ansible/+/909556 | 10:32 |
| opendevreview | Merged openstack/kolla-ansible stable/zed: Fix gnocchi-metricd when TLS and Swift enabled https://review.opendev.org/c/openstack/kolla-ansible/+/909558 | 10:32 |
| opendevreview | Merged openstack/kolla-ansible stable/2023.1: Fix gnocchi-metricd when TLS and Swift enabled https://review.opendev.org/c/openstack/kolla-ansible/+/909557 | 10:32 |
| opendevreview | Ivan Halomi proposed openstack/kolla-ansible master: Refactor of docker worker https://review.opendev.org/c/openstack/kolla-ansible/+/908295 | 11:25 |
| opendevreview | Martin Hiner proposed openstack/kolla-ansible master: Add container engine migration scenario https://review.opendev.org/c/openstack/kolla-ansible/+/836941 | 12:40 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: WIP: Fix arm builds https://review.opendev.org/c/openstack/kolla/+/909915 | 12:42 |
| opendevreview | Michal Arbet proposed openstack/kolla-ansible master: Refactor external ceph https://review.opendev.org/c/openstack/kolla-ansible/+/907166 | 12:51 |
| kevko | mnasiadka bbezak I added you to my ceph refactor review ..could you please then check ? | 12:54 |
| mnasiadka | will try, but this week might be complicated | 12:55 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: WIP: Fix arm builds https://review.opendev.org/c/openstack/kolla/+/909915 | 12:57 |
| jovial | Anyone have any idea why a container would stay in the created state when using podman (seem to hit this with bifrost on ubuntu)? See: https://zuul.opendev.org/t/openstack/build/f6c36340679345ab9d8597d7d7aa0c24/log/primary/ansible/seed-deploy#14265-14310 | 12:58 |
| mnasiadka | Ubuntu? Old Podman? | 12:59 |
| mnasiadka | yeah, I see it's ubuntu | 12:59 |
| jovial | I also see this: https://zuul.opendev.org/t/openstack/build/f6c36340679345ab9d8597d7d7aa0c24/log/primary/system_logs/podman-info.txt#105 | 12:59 |
| jovial | Seemed to work for the overcloud job :( | 13:00 |
| frickler | jovial: https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_f6c/909686/20/check/kayobe-seed-ubuntu-jammy-podman/f6c3634/primary/podman_logs/bifrost_deploy.txt ? | 13:00 |
| mnasiadka | podman 3.4.4+ds1-1ubuntu1.22.04.2 | 13:01 |
| mnasiadka | ah, invalid syntax | 13:01 |
| mnasiadka | would make sense | 13:01 |
| jovial | frickler, Ooh, nice find, thanks. I also meant to thank you for the ret: -13 ansible.cfg tweaks. | 13:01 |
| greatgatsby | Good day. I'm wondering if there's a nice solution for the certificate bundle used by requests within the venv in kolla images? Currently we're using the extra volumes to inject our own kolla_copy_cacerts file that also appends our certs into venv bundle, but we're hoping there's a more elegant solution. Is there a nice way to set REQUESTS_CA_BUNDLE for all containers? Maybe we're doing | 13:06 |
| greatgatsby | something wrong entirely. | 13:06 |
| jovial | greatgatsby, Does kolla_copy_ca_into_containers do what you need? | 13:07 |
| greatgatsby | jovial: kolla_copy_cacerts does not copy the certs into the venv, only the system cert bundle, but certifi.where() within the venv points to the venv cacert.pem, so any requests calls from the venv will fail with invalid cert. | 13:10 |
| jovial | Ouch, I forgot that requests doesn't use the system trust store. | 13:12 |
| mnasiadka | greatgatsby: which container needs to connect somewhere outside with certs? | 13:13 |
| greatgatsby | yeah we're hoping we're just missing something obvious. It's not a huge deal to use a custom volume, but we can't be the only ones having this issue. I think the REQUESTS_CA_BUNDLE would be cleaner, but I can't find a way to set an env var globally for all containers (like we can with volumes) | 13:13 |
| greatgatsby | mnasiadka: I'll have to double-check, it was so long that we had to implement this, but we were definitely having SSL validation failures. Possibly with our pure storage backend? I'll double-check when the rest of the team gets online | 13:14 |
| * greatgatsby goes to see if he can find the ticket | 13:15 | |
| opendevreview | Will Szumski proposed openstack/kayobe master: Vagrant: Add support for ubuntu https://review.opendev.org/c/openstack/kayobe/+/910899 | 13:19 |
| opendevreview | Will Szumski proposed openstack/kayobe master: WIP: Add podman support https://review.opendev.org/c/openstack/kayobe/+/909686 | 13:23 |
| opendevreview | Roman Krček proposed openstack/kolla-ansible master: Update cell0 database connection https://review.opendev.org/c/openstack/kolla-ansible/+/910924 | 13:48 |
| kevko | mnasiadka: thanks | 14:08 |
| greatgatsby | still hunting down that ticket. FWIW, we have kolla_enable_tls for internal, external, and backend | 14:32 |
| greatgatsby | it could also be keystone doing LDAPS queries. I can't seem to find the specifics, but we definitely needed to do this to resolve SSL verification issues. | 14:40 |
| opendevreview | Merged openstack/kayobe master: Skip buggy release of docker PyPI package https://review.opendev.org/c/openstack/kayobe/+/909913 | 14:55 |
| opendevreview | Martin Hiner proposed openstack/kolla-ansible master: Add container engine migration scenario https://review.opendev.org/c/openstack/kolla-ansible/+/836941 | 15:04 |
| opendevreview | Roman Krček proposed openstack/kolla-ansible master: Update cell0 database connection https://review.opendev.org/c/openstack/kolla-ansible/+/910924 | 15:28 |
| jovial | Just to follow up on my podman on ubuntu issue. I found: "Error: OCI runtime error: unable to start container 94f34a7a2ad74969ea4a8330637ab28338134161fae268cfc0df48b5c516918f: chmod `run/shm`: Operation not supported" in syslog. Looks like a known issue with crun: https://noobient.com/2023/11/15/fixing-ubuntu-containers-failing-to-start-with-systemd/ | 15:59 |
| mnasiadka | jovial: mhiner / ihalomi might have some pointers, they did the initial kolla-ansible implementation - do you want to tell me bifrost does not work on podman in k-a? ;-) | 16:02 |
| jovial | Annoyingly its working for me locally, so I'm wondering if there is kernel / crun version difference | 16:04 |
| opendevreview | Uwe Jäger proposed openstack/kolla-ansible master: Skyline configure Prometheus https://review.opendev.org/c/openstack/kolla-ansible/+/910514 | 16:40 |
| opendevreview | Will Szumski proposed openstack/kayobe master: WIP: Add podman support https://review.opendev.org/c/openstack/kayobe/+/909686 | 16:54 |
| opendevreview | Will Szumski proposed openstack/kayobe master: WIP: Add podman support https://review.opendev.org/c/openstack/kayobe/+/909686 | 17:14 |
| SvenKieske | can anybody who has been longer around educate me about the original reason for "kolla_toolbox"? the use case is to avoid ansible modules being installed in different containers I guess? or is there more to it? | 18:11 |
| mnaser | i'm playing around with the kolla image build process and it seems that it doesnt do something like multi-staged builds, so it is leaving a lot of 'stuff' around, such as build-essential, gcc, etc .. has there been effort/ideas in cleaning that up somehow with multistage? | 20:47 |
| simondodsley | Can I get reviews for https://review.opendev.org/c/openstack/kolla-ansible/+/879844 please? | 21:24 |
| simondodsley | and https://review.opendev.org/c/openstack/kolla-ansible/+/879846 | 21:25 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!