Friday, 2024-03-15

opendevreviewVictor Morales proposed openstack/kolla-ansible master: Ensure that nova scheduler runs before refesh it  https://review.opendev.org/c/openstack/kolla-ansible/+/91327700:19
opendevreviewVictor Morales proposed openstack/kolla-ansible master: Ensure that nova scheduler runs before refesh it  https://review.opendev.org/c/openstack/kolla-ansible/+/91327702:33
opendevreviewVictor Morales proposed openstack/kolla-ansible master: Ensure that nova scheduler runs before refesh it  https://review.opendev.org/c/openstack/kolla-ansible/+/91327702:58
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: CI: Increase galera node timeouts  https://review.opendev.org/c/openstack/kolla-ansible/+/91272509:40
mnasiadkafrickler, bbezak: ^^ seems that is helping for Galera failures in multinode09:52
SvenKieskelooks better now :)10:07
opendevreviewSven Kieske proposed openstack/kolla-ansible master: Run shellcheck on scripts  https://review.opendev.org/c/openstack/kolla-ansible/+/88249710:39
opendevreviewMarius proposed openstack/kolla master: Updated letsencrypt-lego to version v4.15.0.  https://review.opendev.org/c/openstack/kolla/+/91331610:41
opendevreviewMarius proposed openstack/kolla master: Modified releasnote for letsencrypt-lego  https://review.opendev.org/c/openstack/kolla/+/91331710:50
opendevreviewMarius proposed openstack/kolla master: Updated letsencrypt-lego to version v4.15.0.  https://review.opendev.org/c/openstack/kolla/+/91331611:02
opendevreviewMarius proposed openstack/kolla master: Upgraded prometheus-alertmanager to version 0.27.0.  https://review.opendev.org/c/openstack/kolla/+/91331911:10
opendevreviewSven Kieske proposed openstack/kolla-ansible master: Run shellcheck on scripts  https://review.opendev.org/c/openstack/kolla-ansible/+/88249711:17
opendevreviewDawud proposed openstack/kolla-ansible master: Update Grafana OpenSearch datasource configuration  https://review.opendev.org/c/openstack/kolla-ansible/+/91332011:27
opendevreviewMarius proposed openstack/kolla master: Update prometheus-cadvisor to version 0.49.1.  https://review.opendev.org/c/openstack/kolla/+/91332211:37
opendevreviewMarius proposed openstack/kolla master: Update prometheus-elasticsearch-exporter to version 1.7.0.  https://review.opendev.org/c/openstack/kolla/+/91332311:57
kevkomnasiadka: frickler: do I have a chance to find a log from keepalived vrrp track script for HA router ? ...there is only bash script checking the gateway ...11:59
kevkobut no log 11:59
mnasiadkabecause log is going to syslog12:02
mnasiadkavia /dev/log12:02
mnasiadkawhich we don't support12:02
mnasiadkathe easiest way probably is installing rsyslog on the host12:02
opendevreviewMarius proposed openstack/kolla master: Update prometheus-memcached-exporter to version 0.14.2.  https://review.opendev.org/c/openstack/kolla/+/91332512:04
kevkothat was what i wanted to say ..that normally it's in syslog :D 12:04
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: CI: Increase galera node timeouts  https://review.opendev.org/c/openstack/kolla-ansible/+/91272512:04
kevkomnasiadka: hmm, shouldn't we support it - optionally let's say 12:04
mnasiadkaI tried working on Neutron side configuration in the past, I plan to pick it up - https://review.opendev.org/c/openstack/neutron/+/88440712:05
kevkomnasiadka: nice12:08
kevkobut this is haproxy logging 12:08
mnasiadkaright12:08
kevkoi would like to log track_script from keepalived 12:09
mnasiadkahmm, wonder if keepalived supports logging somewhere else than /dev/log12:09
kevkofrom time to time we see that our routers are jumping ..12:09
kevkoand there is no information from check script which is pinging gateway 12:09
kevkoalso, there is hardcoded rise and fall to 2 12:10
opendevreviewMaksim Malchuk proposed openstack/kolla-ansible stable/2023.2: Fix images pull in ovs-dpdk role  https://review.opendev.org/c/openstack/kolla-ansible/+/91275612:10
opendevreviewMaksim Malchuk proposed openstack/kolla-ansible stable/2023.1: Fix images pull in ovs-dpdk role  https://review.opendev.org/c/openstack/kolla-ansible/+/91275712:10
opendevreviewMaksim Malchuk proposed openstack/kolla-ansible stable/zed: Fix images pull in ovs-dpdk role  https://review.opendev.org/c/openstack/kolla-ansible/+/91275812:11
opendevreviewMarius proposed openstack/kolla master: Update prometheus-mtail to version 3.0.0-rc54.  https://review.opendev.org/c/openstack/kolla/+/91332612:13
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Run ML2/OVS agents processes in separate containers  https://review.opendev.org/c/openstack/kolla-ansible/+/86478012:14
opendevreviewMarius proposed openstack/kolla master: Update prometheus-mysqld-exporter to version 0.15.1.  https://review.opendev.org/c/openstack/kolla/+/91332712:16
opendevreviewMarius proposed openstack/kolla master: Update prometheus-v2-server to version 2.50.1.  https://review.opendev.org/c/openstack/kolla/+/91332912:27
opendevreviewMark Goddard proposed openstack/ansible-collection-kolla master: docker_sdk/podman_sdk: Install packaging Python package  https://review.opendev.org/c/openstack/ansible-collection-kolla/+/90720712:33
mnasiadkafrickler: something changed in zuul? we see some changed ownerships in jobs now: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_315/882497/9/check/kolla-ansible-debian/31570fa/job-output.txt13:06
mnasiadkaERROR: Unexpected ownership on /etc/kolla/admin-openrc-system.sh. Got zuul:zuul, expected root:root13:06
fricklerfirst time I see that13:17
fricklermnasiadka: that's a bug in SvenKieske's patch https://review.opendev.org/c/openstack/kolla-ansible/+/882497/9/tests/check-config.sh#b2613:23
mnasiadkaLet’s see if more things fail on it13:41
mnasiadkaUnclear what changed13:41
kevkomnasiadka: rsyslog didn't help as there is no /dev/log inside container 14:06
mnasiadkakevko: bind mount it?14:09
kevkomnasiadka: not working ..14:23
kevkomnasiadka: moreover ../dev/log is symlink to /run/systemd...14:23
kevkomnasiadka: what's working isln -sf /proc/1/fd/1 /dev/log14:26
opendevreviewMarius proposed openstack/kolla master: Update prometheus-cadvisor to version 0.49.1.  https://review.opendev.org/c/openstack/kolla/+/91332214:28
SvenKieskeI don't understand how my patch (the highlighted part is of course wrong) have an impact on other jobs running. aren't jobs isolated from each other?14:34
SvenKieskeah nvm, the linked log is from my job14:40
kevko:D14:41
opendevreviewSven Kieske proposed openstack/kolla-ansible master: Run shellcheck on scripts  https://review.opendev.org/c/openstack/kolla-ansible/+/88249714:41
SvenKieskehope I can fix all the different errors there soon. we urgently need better bash script linting, as long as we use those and don't rewrite them in python.14:42
SvenKieskeI would also appreciate reviews for: https://review.opendev.org/c/openstack/kolla-ansible/+/91245214:55
SvenKieskeand I'll investigate the pipeline14:56
opendevreviewChristian Berendt proposed openstack/kolla-ansible master: octavia: add missing bool to the enable_octavia_jobboard parameter  https://review.opendev.org/c/openstack/kolla-ansible/+/91341015:13
opendevreviewChristian Berendt proposed openstack/kolla-ansible stable/2023.2: octavia: add missing bool to the enable_octavia_jobboard parameter  https://review.opendev.org/c/openstack/kolla-ansible/+/91275915:18
opendevreviewSven Kieske proposed openstack/kolla-ansible master: octavia: add missing bool to the enable_octavia_jobboard parameter  https://review.opendev.org/c/openstack/kolla-ansible/+/91341015:42
opendevreviewDawud proposed openstack/kolla-ansible master: Update Grafana OpenSearch datasource configuration  https://review.opendev.org/c/openstack/kolla-ansible/+/91332015:47
mnasiadkaSvenKieske: it’s also in Galera timeouts patch - I’ll have a look later15:56
SvenKieskeI took the liberty to answer in the rmq issue on github, they wanted some env debug stuff for the ipv6 failure, I provided hopefully enough context, but I took the values from another env, as I'm not sure we have these in CI without shell access.16:00
SvenKieskemnasiadka: if you have time for a one line bugfix +2: https://review.opendev.org/c/openstack/kolla-ansible/+/913410 :)16:00
opendevreviewDawud proposed openstack/kolla-ansible master: Update Grafana OpenSearch datasource configuration  https://review.opendev.org/c/openstack/kolla-ansible/+/91332016:04
atmarkhello, I read somewhere that Yoga supports Ubuntu Jammy 22.04 but I do not know if it supports both host OS and base image. Looking at https://docs.openstack.org/kolla/yoga/support_matrix, 22.04 is only supported host OS but not base image, is my understanding correct?16:09
atmarkif host OS is supported but not base image, would there be issue if I upgrade host OS first to 22.04 before upgrading the containers to Zed as oppose to what is mentioned on https://docs.openstack.org/kolla-ansible/yoga/user/operating-kolla.html#ubuntu-jammy-22-04 16:14
SvenKieskeatmark: there is a note somewhere that describes this; look in the upgrade docs pls16:15
atmarkSvenKieske: I did. I'm a bit confused. Regarding https://docs.openstack.org/kolla-ansible/yoga/user/operating-kolla.html#ubuntu-jammy-22-04, "The Zed release adds support for Ubuntu Jammy 22.04 as a host operating system. Ubuntu Jammy 22.04 support has also been added to a Yoga stable release." - Does this mean Yoga can run a host running 22.04 ?16:19
atmarkThere's another statement which confuses me "Ubuntu Focal 20.04 users upgrading from Yoga should first upgrade OpenStack containers to Zed, which uses the Ubuntu Jammy 22.04 base container image. Hosts should then be upgraded to Ubuntu Jammy 22.04."  - in this case , what's the point of "Ubuntu Jammy 22.04 support has also been added to a Yoga stable release." if we upgrade16:23
atmarkthe containers first before the host?16:23
SvenKieskeatmark: https://docs.openstack.org/kolla-ansible/latest/user/operating-kolla.html#upgrade-procedure16:25
opendevreviewVictor Morales proposed openstack/kolla-ansible master: Ensure that nova scheduler runs before refesh it  https://review.opendev.org/c/openstack/kolla-ansible/+/91327716:26
SvenKieskeyoga has jammy support, that was never updated in the docs I guess: https://review.opendev.org/c/openstack/kolla-ansible/+/86912716:27
SvenKieskethat statement was only important before yoga supported 22.0416:28
SvenKieskebut if you happen to want to upgrade to an openstack release, that also supports a newer host os, you should of course first upgrade the containers to the openstack release that supports the host os16:29
atmarkLatest states that  "Ubuntu Jammy 22.04 support will also be addeed to a Yoga stable release" while Yoga "Ubuntu Jammy 22.04 support has also been added to a Yoga stable release"16:30
SvenKieskeyeah, as I said, the docs are inconsistent there, the first sentence should be removed, patches welcome I guess :)16:32
opendevreviewAlex Welsh proposed openstack/kolla-ansible master: WIP: Automate prometheus blackbox endpoint config  https://review.opendev.org/c/openstack/kolla-ansible/+/91242016:37
atmarkSvenKieske: Thanks for confirming. I'll figure out how to submit patches 16:38
opendevreviewSven Kieske proposed openstack/kolla-ansible master: fix confusing jammy upgrade docs  https://review.opendev.org/c/openstack/kolla-ansible/+/91342616:40
SvenKieskeI just did :) hope this is now less confusing (I'm honestly not sure though :D) I can only encourage you to upgrade, yoga is EOL16:41
atmarkSvenKieske: Thanks. Yeah, trying to get to Zed in next months coming motnhs 16:45
atmarkin the next coming months*16:46
SvenKieskegood luck :)16:47
opendevreviewAlex Welsh proposed openstack/kolla-ansible master: WIP: Automate prometheus blackbox endpoint config  https://review.opendev.org/c/openstack/kolla-ansible/+/91242016:50
opendevreviewUwe Jäger proposed openstack/kolla-ansible master: Update Skyline configuration to enable SSO  https://review.opendev.org/c/openstack/kolla-ansible/+/90586018:15
opendevreviewUwe Jäger proposed openstack/kolla-ansible master: Update Skyline configuration to enable SSO  https://review.opendev.org/c/openstack/kolla-ansible/+/90586019:19
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: CI: Increase galera node timeouts  https://review.opendev.org/c/openstack/kolla-ansible/+/91272519:20
opendevreviewMerged openstack/kolla-ansible master: octavia: add missing bool to the enable_octavia_jobboard parameter  https://review.opendev.org/c/openstack/kolla-ansible/+/91341019:53
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Run ML2/OVS agents processes in separate containers  https://review.opendev.org/c/openstack/kolla-ansible/+/86478020:57
opendevreviewChristian Berendt proposed openstack/kolla-ansible master: ironic: add missing ironic_database_shard_id parameter  https://review.opendev.org/c/openstack/kolla-ansible/+/91344921:40

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!