| *** ysandeep|out is now known as ysandeep | 04:12 | |
| *** ysandeep is now known as ysandeep|afk | 06:31 | |
| noonedeadpunk | hm, we have failure for centos upgrade regarding gluster https://zuul.opendev.org/t/openstack/build/771744e075b441748431a4ee0c1eeea3/log/job-output.txt#24382 | 06:42 |
|---|---|---|
| noonedeadpunk | maybe some race condition we already covered... | 06:42 |
| *** ysandeep|afk is now known as ysandeep | 07:22 | |
| jrosser_ | i'm not sure it has fixed it https://zuul.opendev.org/t/openstack/build/fdf72789100f47c2b463426b02578b36/log/job-output.txt#22621-22623 | 07:28 |
| jrosser_ | also looks like the infra jobs make one keystone container but don't actually deploy it - doh :( | 07:37 |
| noonedeadpunk | um... I think they should? as they should also run tempest for keystone... | 07:46 |
| noonedeadpunk | ah, but yes, keystone is only single one for infra jobs | 07:47 |
| opendevreview | Andrew Bonney proposed openstack/openstack-ansible-ops master: Add support for apt package pinning https://review.opendev.org/c/openstack/openstack-ansible-ops/+/843573 | 07:50 |
| opendevreview | Andrew Bonney proposed openstack/openstack-ansible-ops master: Serialise operations on components which may be highly available https://review.opendev.org/c/openstack/openstack-ansible-ops/+/843574 | 07:50 |
| jrosser_ | noonedeadpunk: oh is it this https://github.com/openstack/openstack-ansible/blob/master/scripts/gate-check-commit.sh#L210-L220 | 07:52 |
| jrosser_ | the healthcheck-infrastructure runs before setup-openstack, which does make some sense | 07:52 |
| jrosser_ | maybe the comment there is wrong "# Verify our infra setup and do not continue with openstack part" | 07:53 |
| jrosser_ | it'll be why this doesnt work https://review.opendev.org/c/openstack/openstack-ansible/+/843495 | 07:54 |
| noonedeadpunk | jrosser_: well from what I can recall, infra does setup and test keystone... | 08:10 |
| noonedeadpunk | hosts doesn't | 08:10 |
| noonedeadpunk | jrosser_: so if you check https://zuul.opendev.org/t/openstack/build/643c2517f37e494198dd02e8a94ccadf/logs tempest results, you see that keystone checks are passing | 08:11 |
| jrosser_ | yeah, so for that patch of mine we either should move the healthcheck-infrastructure playbook to after setup-openstack, or make a new healthcheck-openstack | 08:11 |
| noonedeadpunk | there is healthckec-openstack actually | 08:11 |
| noonedeadpunk | But as a side note - we run tempest, why we need that ?:) I just thought we don't but look https://b0e4cfcca60ce9be2623-476ea4d7332a88439ec405489889023d.ssl.cf2.rackcdn.com/837859/29/check/openstack-ansible-deploy-infra_lxc-ubuntu-focal/643c251/logs/openstack/aio1_utility_container-1e92b048/utility/stestr_results.html | 08:12 |
| noonedeadpunk | Isn't that covering usecase you wrote in https://review.opendev.org/c/openstack/openstack-ansible/+/843495/1/playbooks/healthcheck-infrastructure.yml ? | 08:12 |
| jrosser_ | perhaps it is | 08:13 |
| jrosser_ | i think i was trying to guard against breaking the ssl stull like i did with the pam_env changes | 08:14 |
| jrosser_ | somehow we managed to merge that without catching it in CI | 08:14 |
| noonedeadpunk | Well, then just running keystone role should fail, as we're doing api calls there as well iirc | 08:14 |
| jrosser_ | bu that might be hosts vs. infra scenario | 08:15 |
| noonedeadpunk | oh yes, for hosts we don't do that | 08:15 |
| noonedeadpunk | just in case - I won't be really around for next 2 weeks because of travels to conferences (including summit) | 08:27 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Align collection_file naming https://review.opendev.org/c/openstack/openstack-ansible/+/843483 | 08:37 |
| opendevreview | Merged openstack/openstack-ansible-galera_server master: Fix race on boot for mariadb-check socket https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/843547 | 09:10 |
| damiandabrowski[m] | morning guys | 09:31 |
| damiandabrowski[m] | same as Dmitriy - won't be around for next 2 weeks, but I'll be present on summit, looking forward to see You guys | 09:32 |
| damiandabrowski[m] | btw. after a long time my neutron fix was finally merged: https://review.opendev.org/c/openstack/neutron/+/839671 | 09:34 |
| damiandabrowski[m] | You may be interested as starting from Zed, qg-* interface on standby router will be up. | 09:34 |
| noonedeadpunk | would be great if we could land centos9/ubuntu patches before summit tbh... | 09:35 |
| noonedeadpunk | I will try to keep an eye on things in terms of reviews and some fixes | 09:35 |
| damiandabrowski[m] | the main reason of this is that for now HA routers do not send GARPs for floating IPs and external GW | 09:36 |
| noonedeadpunk | yeah, that is good improvement of how routers behave now... | 09:37 |
| noonedeadpunk | btw, damiandabrowski[m], would be great if you could review patches for stable branches https://review.opendev.org/q/parentproject:openstack/openstack-ansible+branch:%255Estable/.*+status:open+ | 09:37 |
| damiandabrowski[m] | I'll try but as You now, I need to sort out some internal things before :/ | 09:38 |
| jrosser_ | I can try to do some more reviews later today (not usually working Fridays) | 09:39 |
| jrosser_ | when do we need to try to get an RC by? | 09:39 |
| noonedeadpunk | I was thinking at least about beta (milestone) without branching. | 09:41 |
| noonedeadpunk | And would be great to have end of next week | 09:41 |
| jrosser_ | I make some silly mistake in https://review.opendev.org/c/openstack/openstack-ansible/+/823417 | 09:42 |
| noonedeadpunk | as of release deadline - June 23rd | 09:43 |
| jrosser_ | bootstrap for Rocky, only on my phone right now so can’t look close but centos-9 is basically done | 09:43 |
| jrosser_ | rocky needs it’s own handling in bootstrap because the version is “8.x” not just “8” | 09:44 |
| noonedeadpunk | `Cannot find libsystemd or libsystemd-journal` o_O | 09:44 |
| jrosser_ | wtf :) | 09:44 |
| jrosser_ | well I’ve certainly failed to copy OSA_ANSIBLE_PYTHON_INTERPRETER across | 09:48 |
| noonedeadpunk | ah | 09:54 |
| noonedeadpunk | I think it can be set to PYTHON_EXEC_PATH.... | 09:56 |
| noonedeadpunk | or well, no, it can't | 09:57 |
| noonedeadpunk | I'm not sure it's needed.... I bet ansible should be already aware of rocky and detect correctly... | 09:57 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Add Centos-9 Stream support https://review.opendev.org/c/openstack/openstack-ansible/+/823417 | 09:58 |
| opendevreview | Merged openstack/openstack-ansible master: Bump ansible version to 2.12.6 https://review.opendev.org/c/openstack/openstack-ansible/+/843420 | 10:11 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible stable/xena: Bump OpenStack-Ansible Xena https://review.opendev.org/c/openstack/openstack-ansible/+/843599 | 10:20 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible stable/wallaby: Bump OpenStack-Ansible Wallaby https://review.opendev.org/c/openstack/openstack-ansible/+/843600 | 10:30 |
| *** ysandeep is now known as ysandeep|afk | 10:30 | |
| *** ysandeep|afk is now known as ysandeep | 10:43 | |
| *** ysandeep is now known as ysandeep|afk | 11:06 | |
| *** dviroel|out is now known as dviroel | 11:15 | |
| opendevreview | Merged openstack/openstack-ansible-os_octavia master: Add flexability for octavia cinder variable. https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/839373 | 11:48 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Bump SHA for master https://review.opendev.org/c/openstack/openstack-ansible/+/843616 | 12:58 |
| *** dviroel is now known as dviroel|afk | 13:07 | |
| opendevreview | Merged openstack/openstack-ansible-repo_server master: Remove all code for lsync, rsync and ssh https://review.opendev.org/c/openstack/openstack-ansible-repo_server/+/837588 | 13:57 |
| mgariepy | woohoo lsync cleaned up ! \o/ | 13:58 |
| opendevreview | Merged openstack/openstack-ansible-os_rally stable/victoria: Disable setuptools auto discovery https://review.opendev.org/c/openstack/openstack-ansible-os_rally/+/843487 | 14:06 |
| *** ysandeep|afk is now known as ysandeep | 14:46 | |
| opendevreview | Merged openstack/openstack-ansible master: Change unbound role source https://review.opendev.org/c/openstack/openstack-ansible/+/843468 | 15:00 |
| opendevreview | Marc Gariépy proposed openstack/openstack-ansible stable/wallaby: limit the number of thread for panko. https://review.opendev.org/c/openstack/openstack-ansible/+/843629 | 15:32 |
| opendevreview | Marc Gariépy proposed openstack/openstack-ansible-os_aodh stable/wallaby: Ensure libxml2 is installed on debian systems https://review.opendev.org/c/openstack/openstack-ansible-os_aodh/+/826379 | 15:35 |
| mgariepy | noonedeadpunk, ^^ centos aodh oom | 15:35 |
| opendevreview | Merged openstack/openstack-ansible-os_octavia stable/wallaby: Fix distro support option for Octavia https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/843409 | 15:38 |
| opendevreview | Merged openstack/openstack-ansible-os_octavia stable/xena: Fix distro support option for Octavia https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/843408 | 15:43 |
| *** dviroel|afk is now known as dviroel | 16:08 | |
| noonedeadpunk | mgariepy: yeah thanks... | 17:09 |
| noonedeadpunk | btw, I saw that lxc is finally in epel for centos 9 | 17:09 |
| jrosser_ | i think i saw what was wrong with the rocky jobs on tyhe c9s patch | 17:10 |
| jrosser_ | looked like the dnf install lines were in the wrong place in the case statement | 17:10 |
| jrosser_ | i think i can simplify this | 17:13 |
| mgariepy | lol. i didn't saw it :/ haha | 17:17 |
| mgariepy | and the same patch is working ok in a container.. except the wget stuff that i didn't trigger on :/ lol | 17:19 |
| mgariepy | in a rocky8 lxd container** | 17:19 |
| opendevreview | Merged openstack/openstack-ansible-os_rally stable/victoria: Ensure that the rally venv build is self contained https://review.opendev.org/c/openstack/openstack-ansible-os_rally/+/843393 | 17:23 |
| opendevreview | Merged openstack/openstack-ansible-galera_server master: Bump mariadb version. https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/842106 | 17:23 |
| noonedeadpunk | https://koji.fedoraproject.org/koji/buildinfo?buildID=1971289 | 17:26 |
| noonedeadpunk | still not published though | 17:26 |
| damiandabrowski[m] | the number of failed zuul builds is a bit funny there :D https://review.opendev.org/c/openstack/openstack-ansible-os_aodh/+/826379 | 17:28 |
| mgariepy | damiandabrowski[m], yep but the issue with centos + oom was because of panko thread on W. | 17:29 |
| noonedeadpunk | and me too lazy to check for that | 17:29 |
| damiandabrowski[m] | ahhh that makes sense | 17:29 |
| mgariepy | well. the comment on centos oom made me fix it :) | 17:30 |
| mgariepy | so it was a joint effort | 17:30 |
| mgariepy | i fixed a bunch of the same issue a couple weeks ago. | 17:30 |
| opendevreview | Merged openstack/openstack-ansible-repo_server master: Clean up legacy lsycnd, rsync and ssh key config https://review.opendev.org/c/openstack/openstack-ansible-repo_server/+/837859 | 17:32 |
| opendevreview | Merged openstack/openstack-ansible master: Allow lxc container backing store to be defined as part of the scenario https://review.opendev.org/c/openstack/openstack-ansible/+/843011 | 17:38 |
| opendevreview | Merged openstack/openstack-ansible master: Add zuul jobs and template for testing different LXC backing stores https://review.opendev.org/c/openstack/openstack-ansible/+/843027 | 17:38 |
| opendevreview | Merged openstack/openstack-ansible master: Align collection_file naming https://review.opendev.org/c/openstack/openstack-ansible/+/843483 | 18:19 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-lxc_hosts master: Do not install COPR repo for CentOS 8 LXC https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/843672 | 18:19 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-lxc_hosts master: Do not install COPR repo for CentOS 8 LXC https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/843672 | 18:29 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-lxc_hosts master: Do not install COPR repo for CentOS 8 LXC https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/843672 | 18:30 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_neutron master: Implement uWSGI for neutron-api https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/486156 | 18:34 |
| noonedeadpunk | I wonder if we want to land ^ at least for ovs/lxb? | 18:35 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible master: Add Centos-9 Stream support https://review.opendev.org/c/openstack/openstack-ansible/+/823417 | 18:38 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible master: Add Centos-9 Stream support https://review.opendev.org/c/openstack/openstack-ansible/+/823417 | 18:45 |
| jrosser_ | noonedeadpunk: i did a yum repo bemoval for repo_server and didnt use a handler for cleaning the metadata, as i was thinking that needed to happen before the next use of yum/dnf, rather than at the end of the play | 18:47 |
| jrosser_ | *removeal | 18:47 |
| jrosser_ | *removal :) | 18:47 |
| noonedeadpunk | oh, well, fair... | 18:56 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-lxc_hosts master: Do not install COPR repo for CentOS 8 LXC https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/843672 | 18:58 |
| noonedeadpunk | tbh I'm not sure there about upgrade as haven't actually check if copr was providing newer lxc version, but highly doubt it did, as last change there was quite a while ago | 18:59 |
| noonedeadpunk | Btw I wrote text for presentation and about to record it. So if anybody interested - not to late to edit smth :) | 18:59 |
| noonedeadpunk | I can barely fit it in 10 mins... Takes 9:30 in quite fast tempo | 19:01 |
| jrosser_ | let me take a look | 19:04 |
| jrosser_ | i took a pass through - looks great :) | 19:19 |
| noonedeadpunk | great, now I feel a bit more confident, as you know how terrible my english is... | 19:20 |
| noonedeadpunk | Will share what I got in a while :D | 19:20 |
| opendevreview | Merged openstack/openstack-ansible-repo_server master: Avoid a race condition between mounting and using repo filesystem https://review.opendev.org/c/openstack/openstack-ansible-repo_server/+/843418 | 19:24 |
| noonedeadpunk | I'm also thinking about where else we need help, without saying everywhere.... | 19:24 |
| jrosser_ | maybe saying that some of the people who get the best value out of OSA are those who participate in IRC / bug reports / small patches / blah | 19:25 |
| jrosser_ | so kind of just be interactive rather than try to do it isolation | 19:26 |
| jrosser_ | right so for the centos-9 patch i split the bootstrap into "install the python we need" then "install the base packages we need" and that seems to have got rocky going again | 19:28 |
| mgariepy | noonedeadpunk, your english is probably a lot better than the ukrenian or french of most english speaking listener :D | 19:29 |
| NeilHanlon | jrosser_: lxc4.0 should be coming to epel shortly. i need to run a few tests but: https://bodhi.fedoraproject.org/updates/FEDORA-EPEL-2022-968b01292a | 19:31 |
| NeilHanlon | also the next update for stream 9 should have that util-linux fix https://bugzilla.redhat.com/show_bug.cgi?id=2089378 | 19:31 |
| noonedeadpunk | that's nice | 19:32 |
| noonedeadpunk | I hope they would bring in lxc-tempaltes fix as well :) | 19:32 |
| NeilHanlon | :) yes i've asked about that as well heh | 19:32 |
| noonedeadpunk | So that you don't have to maintain copr repo | 19:32 |
| noonedeadpunk | jrosser_: ok, I added another paragraph to slide8 | 19:34 |
| noonedeadpunk | yes, it much better now :) | 19:37 |
| jrosser_ | :) | 19:37 |
| noonedeadpunk | do you want to record some slides?:) | 19:37 |
| jrosser_ | whats the format? Make audio to go along with them? | 19:39 |
| noonedeadpunk | yup | 19:39 |
| opendevreview | Merged openstack/openstack-ansible-tests master: Bump ansible version to 2.12.6 https://review.opendev.org/c/openstack/openstack-ansible-tests/+/843421 | 19:45 |
| *** dviroel is now known as dviroel|afk | 19:50 | |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible stable/xena: Align collection_file naming https://review.opendev.org/c/openstack/openstack-ansible/+/843641 | 19:50 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible stable/xena: Align collection_file naming https://review.opendev.org/c/openstack/openstack-ansible/+/843641 | 19:50 |
| opendevreview | Merged openstack/openstack-ansible-lxc_hosts stable/wallaby: Do not mess up with distro-provided machines mount https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/843392 | 20:10 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-lxc_hosts master: Do not install COPR repo for CentOS 8 LXC https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/843672 | 20:12 |
| opendevreview | Merged openstack/openstack-ansible master: Bump SHA for master https://review.opendev.org/c/openstack/openstack-ansible/+/843616 | 20:15 |
| opendevreview | Merged openstack/openstack-ansible stable/wallaby: limit the number of thread for panko. https://review.opendev.org/c/openstack/openstack-ansible/+/843629 | 20:28 |
| noonedeadpunk | https://zuul.opendev.org/t/openstack/build/6f68097ac0a64cf4b206385163a9787d/log/job-output.txt#2434 this looks like we're trying to install ansible inside py3.6 env | 21:30 |
| noonedeadpunk | but we haven't landed anything that can break it... did we? | 21:31 |
| jrosser_ | https://zuul.opendev.org/t/openstack/build/6f68097ac0a64cf4b206385163a9787d/log/job-output.txt#2067-2109 | 21:37 |
| jrosser_ | do we expect python 3.6 there? | 21:37 |
| jrosser_ | 3.8 i think https://github.com/openstack/openstack-ansible/blob/master/scripts/bootstrap-ansible.sh#L72 | 21:39 |
| jrosser_ | oh no but this is the tests repo functional job isnt it | 21:40 |
| noonedeadpunk | yeah, we expect 3.8 | 21:41 |
| noonedeadpunk | I know you was placing patch to make these integrated?:) And I guess it merged today... | 21:41 |
| jrosser_ | https://review.opendev.org/q/topic:osa%252Flxc-ci | 21:41 |
| noonedeadpunk | But dunno what's that in fact | 21:41 |
| noonedeadpunk | ah | 21:42 |
| jrosser_ | the changes to lxc_* roles have not merged | 21:42 |
| jrosser_ | but maybe rather than take time fixing the funtional jobs it is better to switch to these new tests | 21:42 |
| noonedeadpunk | yeah, totally | 21:44 |
| noonedeadpunk | Well, project update went live before I expected.... hope nobody will notice it :D https://www.youtube.com/watch?v=KwOmFKNpIiQ&list=PLKqaoAnDyfgrZOaZTLOLaG8-5NzK2Sr2j&index=8 | 22:16 |
| mgariepy | i watched it ! :P | 22:17 |
| opendevreview | Merged openstack/openstack-ansible stable/xena: Bump OpenStack-Ansible Xena https://review.opendev.org/c/openstack/openstack-ansible/+/843599 | 22:24 |
| opendevreview | Merged openstack/openstack-ansible stable/victoria: Switch Victoria to stable branch https://review.opendev.org/c/openstack/openstack-ansible/+/842674 | 22:24 |
| opendevreview | Merged openstack/openstack-ansible-lxc_container_create master: Use integrated repo 'hosts' jobs to test different backing stores https://review.opendev.org/c/openstack/openstack-ansible-lxc_container_create/+/843030 | 23:24 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!