| *** Guest0 is now known as prometheanfire | 00:17 | |
| *** ysandeep|out is now known as ysandeep|rover | 06:25 | |
| *** frenzy_friday is now known as frenzyfriday|ruck | 06:34 | |
| jrosser | frickler: we went round the same issue as you with ca-certificates/debootstrap here for OSA quite some time ago, also finding the only workable solution is to rewrite the mirror urls to be http | 07:18 |
|---|---|---|
| opendevreview | Andrew Bonney proposed openstack/openstack-ansible stable/xena: haproxy: fix csp for glance image uploads via horizon https://review.opendev.org/c/openstack/openstack-ansible/+/842914 | 07:19 |
| frickler | jrosser: sad to hear that. did you ever try to take that issue upstream? what shocked me most is that apt from -updates isn't even installable on a blank machine | 08:14 |
| jrosser | frickler: from what i remember it appeared more of a feature than a bug that we couldnt add the security repo during debootstrap | 08:18 |
| opendevreview | Siavash Sardari proposed openstack/openstack-ansible-os_octavia master: Add flexability for octavia cinder variable. https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/839373 | 08:22 |
| jrosser | though we always had two steps, somehow obtain a rootfs - which we changed to debootstrap, then run a script against the chroot to fix stuff up.... that second step was the one which dealt with getting ca-certificates into place | 08:22 |
| jrosser | but when the LE CA cert rolled over we had more trouble because that fixup script couldn't use apt against the infra https mirrors, so in rather brute force we do this https://github.com/openstack/openstack-ansible/commit/465a1fea4f2ffa7aa4a54a59f10d31cee732e244 | 08:25 |
| *** ysandeep|rover is now known as ysandeep|rover|lunch | 08:38 | |
| opendevreview | Merged openstack/openstack-ansible-plugins master: Add support for centos-9 https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/841620 | 08:58 |
| jrosser | wierd - did we change any SSL stuff https://98df198148ccd33d268f-ce6a5fd6bc9c2e4df98a625b23d5ab22.ssl.cf2.rackcdn.com/823417/23/check/openstack-ansible-deploy-aio_lxc-centos-9-stream/961bf22/logs/ara-report/results/2398.html | 09:04 |
| noonedeadpunk | I can't recall we did... | 09:06 |
| noonedeadpunk | and it's only for lxc which is even more weird | 09:06 |
| noonedeadpunk | maybe smth wrong with root installation? | 09:07 |
| noonedeadpunk | like different path where update-certificates look for them... | 09:07 |
| jrosser | oh maybe | 09:08 |
| jrosser | i'll try to reproduce it | 09:12 |
| opendevreview | Christian Rohmann proposed openstack/openstack-ansible-galera_server master: Add lost+found to list of ignored db dirs https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/842957 | 10:03 |
| *** ysandeep|rover|lunch is now known as ysandeep|rover | 10:07 | |
| opendevreview | Merged openstack/ansible-role-systemd_mount master: Do not report changed for shell https://review.opendev.org/c/openstack/ansible-role-systemd_mount/+/842414 | 10:15 |
| opendevreview | Merged openstack/openstack-ansible-os_octavia master: Fix condition for deleting old amp images https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/842145 | 10:19 |
| opendevreview | Merged openstack/ansible-role-systemd_networkd master: Update documentation on role requirements https://review.opendev.org/c/openstack/ansible-role-systemd_networkd/+/841691 | 10:19 |
| opendevreview | Merged openstack/openstack-ansible-os_nova master: Do not adjust libvirtd sysconfig for centos-9 https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/841862 | 10:20 |
| opendevreview | Merged openstack/ansible-role-systemd_mount master: Update documentation on role requirements https://review.opendev.org/c/openstack/ansible-role-systemd_mount/+/841694 | 10:21 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_octavia stable/xena: Fix condition for deleting old amp images https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/842935 | 10:21 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_octavia stable/wallaby: Fix condition for deleting old amp images https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/842936 | 10:22 |
| opendevreview | Merged openstack/openstack-ansible-os_gnocchi master: Add variables to manage redis url https://review.opendev.org/c/openstack/openstack-ansible-os_gnocchi/+/841699 | 10:37 |
| opendevreview | Merged openstack/openstack-ansible-repo_server master: Have a symlink to u_c versioned file https://review.opendev.org/c/openstack/openstack-ansible-repo_server/+/842567 | 10:49 |
| opendevreview | Merged openstack/openstack-ansible-ceph_client master: Drop duplicated group creation tasks https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/842340 | 10:58 |
| opendevreview | Merged openstack/openstack-ansible-os_neutron master: Remove legacy vpnaas agent service https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/827251 | 10:59 |
| opendevreview | Merged openstack/openstack-ansible master: Template out zuul mirror info variables for later use by embedded ansible https://review.opendev.org/c/openstack/openstack-ansible/+/842158 | 11:09 |
| opendevreview | Merged openstack/openstack-ansible-os_tempest master: Update default endpoint type to "internal" https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/842758 | 11:11 |
| opendevreview | Merged openstack/openstack-ansible-ceph_client master: Drop default nova client_uuid https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/842335 | 11:13 |
| opendevreview | Merged openstack/openstack-ansible-ceph_client master: Allow service to be absent https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/842339 | 11:13 |
| opendevreview | Merged openstack/openstack-ansible master: Drop sshd role requirement https://review.opendev.org/c/openstack/openstack-ansible/+/842686 | 11:19 |
| *** dviroel|out is now known as dviroel | 11:21 | |
| jrosser | looks like this is why centos-9 lxc is breaking https://paste.opendev.org/ | 12:04 |
| jrosser | https://paste.opendev.org/show/b4cX8XbPKLhFy7WPZQwi/ | 12:04 |
| jrosser | when the shell is a login shell we're somehow not seeing /etc/environment | 12:11 |
| *** ysandeep|rover is now known as ysandeep|rover|brb | 12:21 | |
| jrosser | right so `authrequiredpam_env.so` is removed from /etc/pam.d/su on centos-9 | 12:37 |
| *** ysandeep|rover|brb is now known as ysandeep|rover | 12:37 | |
| jrosser | which appears to be fixed here https://git.centos.org/rpms/util-linux/c/cd9c7799dacfe351f0e558e78dab72cb80d53a86?branch=c9-beta | 13:00 |
| jrosser | https://access.redhat.com/errata/RHBA-2022:4082 | 13:03 |
| jrosser | argh | 13:03 |
| noonedeadpunk | that's looks fun somehow... | 13:06 |
| noonedeadpunk | or well, quite annoying | 13:06 |
| jrosser | i'm convinved i had this working locally last week | 13:07 |
| jrosser | and why does the metal job work? | 13:08 |
| noonedeadpunk | that's really good question... and there's correct version of util-linux inside container? | 13:10 |
| opendevreview | Merged openstack/openstack-ansible stable/xena: haproxy: fix csp for glance image uploads via horizon https://review.opendev.org/c/openstack/openstack-ansible/+/842914 | 13:22 |
| jrosser | i have util-linux-2.37.2-1.el9.src.rpm on the host and in the container | 13:30 |
| noonedeadpunk | and they claim it to be fixed in 2.37.4... | 13:32 |
| noonedeadpunk | 2 month ago | 13:32 |
| jrosser | i think that this is where the release model for centos makes my head really hurt | 13:32 |
| noonedeadpunk | I'd expect it to land directly to repos for Stream... But I feel it's not that easy | 13:32 |
| jrosser | c9-stream is supposed to be ahead of rhel-9, but bugfixes land in rhel first? | 13:32 |
| NeilHanlon | jrosser: yeah, well.... | 13:47 |
| NeilHanlon | I have stories, but they'll raise my blood pressure... | 13:47 |
| NeilHanlon | It's *supposed* to be like this: https://twitter.com/carlwgeorge/status/1439724277746573314 - but in reality, we see patches missing and/or late landing in both c8s *and* c9s, when they exist in RHEL already. It's annoying, to say the least | 13:49 |
| jrosser | this looks like the c9-stream source repo contains the fix for some time now, but the packages dont seem to be built/available | 13:55 |
| NeilHanlon | Yeah, that is exactly the case. I'm poking some folks in the relevant CentOS channels now | 14:04 |
| NeilHanlon | Frustrating, and not the only package either. | 14:04 |
| noonedeadpunk | automated they said... | 14:12 |
| noonedeadpunk | I also kind of wonder why upgrade jobs are keep failing here https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/840353 | 14:13 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-openstack_hosts master: Use pam_env for su commands on Centos-9 https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/842988 | 15:14 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-openstack_hosts master: Use pam_env for su commands on Centos-9 https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/842988 | 15:15 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible master: WIP - Centos-9 Stream support https://review.opendev.org/c/openstack/openstack-ansible/+/823417 | 15:16 |
| *** dviroel is now known as dviroel|lunch | 15:20 | |
| jrosser | noonedeadpunk: for those upgrade jobs i'm sure we fixed this once before https://zuul.opendev.org/t/openstack/build/12462c38e9e74162b25bd7a3e74bba71/log/job-output.txt#22514-22516 | 15:30 |
| jrosser | https://github.com/openstack/openstack-ansible-plugins/commit/5b2b38ea1cf2554b081e9638423d3d6b06308ec4 | 15:31 |
| jrosser | i wonder if that is a issue with it picking up the old plugins repo from /etc/ansible/roles | 15:37 |
| jrosser | becasue we got rid of that here https://github.com/openstack/openstack-ansible/commit/db1555018a0906b8fa743b782023d448fd72beb4 | 15:38 |
| jrosser | why does this task not run https://zuul.opendev.org/t/openstack/build/1a757a536fe54831a40706a7847bef10/log/job-output.txt#7348 | 16:16 |
| jrosser | oh wait.... | 16:17 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-plugins master: Fix installation of glusterfs repo on rocky linux https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/842999 | 16:22 |
| *** dviroel|lunch is now known as dviroel | 16:29 | |
| *** ysandeep|rover is now known as ysandeep|out | 16:30 | |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Add bullseye and rockylinux-8 functional tests https://review.opendev.org/c/openstack/openstack-ansible-tests/+/843000 | 16:30 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible master: Add validation zuul job for hosts setup https://review.opendev.org/c/openstack/openstack-ansible/+/843002 | 16:37 |
| SiavashSardari | I'm not getting why https://review.opendev.org/c/openstack/openstack-ansible-lxc_container_create/+/837734 keep failing. are tests use specifically python-novaclient==18.0.0? this version released two days ago. | 16:58 |
| SiavashSardari | and a newbie question. the mentioned patch depends on another patch that is not mergerd yet. isn't the *depends-on* supposed to check the other patch status and not run the check-pipeline while it's not merged? | 17:02 |
| jrosser | SiavashSardari: deployment projects like openstack-ansible have their release cycle offset from the rest of openstack, in order to give us some time to get the new openstack-release sorted out in openstack-ansible, to then make our release | 17:13 |
| jrosser | and for part of the openstack-ansible yoga development cycle, the rest of openstack have started working on the zed release, and we have to take steps in openstack-ansible to make sure that Zed related changes to the master branches of wider openstack does not break the master branch (about to be Yoga release) of openstack-ansible | 17:15 |
| jrosser | in this case i think we're seeing that has not worked out quite right, as in zed support for python3.6 is being dropped and some of that is now impacting particularly centos-8 jobs on openstack-ansible | 17:15 |
| jrosser | noonedeadpunk: ^ openstack-ansible-tests repo i think is deploying actual master of stuff | 17:16 |
| noonedeadpunk | oh yes, it does.... | 17:16 |
| jrosser | we're pretty broken right now actually becasue of this | 17:16 |
| jrosser | i was just looking at openstack-ansible-plugins in particular | 17:16 |
| noonedeadpunk | I _think_ there was some simple variable to control that | 17:17 |
| jrosser | TESTING_BRANCH or something | 17:17 |
| noonedeadpunk | https://opendev.org/openstack/openstack-ansible-tests/src/branch/master/test-vars.yml#L21 | 17:18 |
| noonedeadpunk | yup | 17:18 |
| noonedeadpunk | Which basically impacts us only because we still not branched.... | 17:19 |
| jrosser | i think it may be ok to use stable/yoga requirements and that should fix stuff | 17:19 |
| jrosser | perhaps..... | 17:19 |
| noonedeadpunk | or make functional tests nv... | 17:20 |
| noonedeadpunk | but yes, hardcoding stable/yoga there would also help | 17:20 |
| noonedeadpunk | *functional centos8 tests nv | 17:20 |
| jrosser | that might be wise, though we're still testing something pretty wierd | 17:21 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Make centos-8 jobs non voting before OSA makes yoga branch https://review.opendev.org/c/openstack/openstack-ansible-tests/+/843009 | 17:32 |
| opendevreview | Merged openstack/openstack-ansible-os_octavia stable/xena: Fix condition for deleting old amp images https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/842935 | 17:50 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible master: Allow lxc container backing store to be defined as part of the scenario https://review.opendev.org/c/openstack/openstack-ansible/+/843011 | 18:10 |
| jrosser | noonedeadpunk: i think we are also broken now on openstacksdk https://zuul.opendev.org/t/openstack/build/0f745a08587743989ed4cbcfe052ce65/log/job-output.txt#5829 | 18:34 |
| noonedeadpunk | wtf.... It shouldn't be backported to Y.... | 18:35 |
| noonedeadpunk | I posted https://review.opendev.org/c/openstack/ansible-collections-openstack/+/836202 ages ago | 18:36 |
| noonedeadpunk | and there's also https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839352/8 | 18:36 |
| jrosser | well it's again tests repo picking up master versions | 18:37 |
| noonedeadpunk | but afaik it's won't be around until 2.0 collections for sure | 18:37 |
| noonedeadpunk | ah | 18:37 |
| noonedeadpunk | ok | 18:37 |
| jrosser | bliemy there is a release https://pypi.org/project/openstacksdk/ | 18:38 |
| jrosser | anything without a constraint is pretty hosed by that | 18:38 |
| jrosser | and also https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L499 | 18:39 |
| jrosser | so we are using it really if we like it or not on master | 18:40 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Make centos-8 jobs non voting before OSA makes yoga branch https://review.opendev.org/c/openstack/openstack-ansible-tests/+/843009 | 18:43 |
| spatel | noonedeadpunk admin1 I got visa for Germany so hope i will see you in person. | 18:44 |
| noonedeadpunk | ٩(^ᴗ^)۶ | 18:45 |
| spatel | :) | 18:45 |
| NeilHanlon | :D | 18:48 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible master: Allow lxc container backing store to be defined as part of the scenario https://review.opendev.org/c/openstack/openstack-ansible/+/843011 | 19:00 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Make centos-8 jobs non voting before OSA makes yoga branch https://review.opendev.org/c/openstack/openstack-ansible-tests/+/843009 | 19:31 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Make centos-8 jobs non voting before OSA makes yoga branch https://review.opendev.org/c/openstack/openstack-ansible-tests/+/843009 | 19:47 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible master: Allow lxc container backing store to be defined as part of the scenario https://review.opendev.org/c/openstack/openstack-ansible/+/843011 | 19:55 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible master: Allow lxc container backing store to be defined as part of the scenario https://review.opendev.org/c/openstack/openstack-ansible/+/843011 | 20:25 |
| jrosser | noonedeadpunk: this is passing for focal now https://review.opendev.org/c/openstack/openstack-ansible-tests/+/843009 | 20:44 |
| jrosser | but it still installs master branch of things like keystone etc... which is why it's failing on centos | 20:44 |
| jrosser | maybe the thing we could do is copy this across https://github.com/openstack/openstack-ansible/blob/master/playbooks/defaults/repo_packages/openstack_services.yml | 20:46 |
| jrosser | to ensure we test the same in thing as in the integrated repo | 20:46 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible master: Add zuul jobs and template for testing different LXC backing stores https://review.opendev.org/c/openstack/openstack-ansible/+/843027 | 21:17 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible master: Add zuul jobs and template for testing different LXC backing stores https://review.opendev.org/c/openstack/openstack-ansible/+/843027 | 21:19 |
| *** dviroel is now known as dviroel|out | 21:21 | |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-lxc_hosts master: Use integrated repo 'hosts' jobs to test different backing stores https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/843029 | 21:23 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-lxc_container_create master: Use integrated repo 'hosts' jobs to test different backing stores https://review.opendev.org/c/openstack/openstack-ansible-lxc_container_create/+/843030 | 21:27 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible master: Allow lxc container backing store to be defined as part of the scenario https://review.opendev.org/c/openstack/openstack-ansible/+/843011 | 21:33 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible master: Add zuul jobs and template for testing different LXC backing stores https://review.opendev.org/c/openstack/openstack-ansible/+/843027 | 21:33 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible master: Add zuul jobs and template for testing different LXC backing stores https://review.opendev.org/c/openstack/openstack-ansible/+/843027 | 21:34 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!