Wednesday, 2023-11-29

*** mmalchuk_ is now known as mmalchuk03:44
opendevreviewVerification of a change to openstack/kolla-ansible master failed: etcd: Add support for more scenarios  https://review.opendev.org/c/openstack/kolla-ansible/+/88801206:31
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: magnum: support kubeconfig configuration file  https://review.opendev.org/c/openstack/kolla-ansible/+/89629207:13
opendevreviewPiotr Parczewski proposed openstack/kolla-ansible master: Adjust Ceph metrics scrape interval in Prometheus  https://review.opendev.org/c/openstack/kolla-ansible/+/90212907:30
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Adjust Ceph metrics scrape interval in Prometheus  https://review.opendev.org/c/openstack/kolla-ansible/+/90212907:37
* frickler cries a bit about unstable ci08:08
fricklermnasiadka: I don't think we need anything from https://review.opendev.org/q/project:openstack/ansible-collection-kolla+status:open , so we could approve the release patch for that?08:14
mnasiadkafrickler: makes sense - feel free to approve :)08:15
fricklerdone08:22
mnasiadkahttps://review.opendev.org/c/openstack/kolla/+/902053 and https://review.opendev.org/c/openstack/kolla/+/896644 ready for reviews08:40
opendevreviewVerification of a change to openstack/kolla-ansible master failed: etcd: Add support for more scenarios  https://review.opendev.org/c/openstack/kolla-ansible/+/88801208:42
mnasiadkawhat happened with Debuntu upgrade...08:58
mnasiadkahttps://1091c07913eb4632aa6d-ee11d96724f7ceb5cf79a550bea264c0.ssl.cf5.rackcdn.com/888012/11/gate/kolla-ansible-ubuntu-upgrade/9c7b5dd/primary/logs/kolla/all-CRITICAL.txt09:00
mnasiadkahttps://22999be8fea712a10cfd-df24963d5172a658f3710dd49321d0e5.ssl.cf1.rackcdn.com/888012/11/gate/kolla-ansible-debian-upgrade/8ac994d/primary/logs/kolla/all-CRITICAL.txt09:01
mnasiadkaidentical09:01
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: CI: Add oslo_db.exception.DBConnectionError to check-logs.sh  https://review.opendev.org/c/openstack/kolla-ansible/+/90213109:04
mnasiadkafrickler: ^^09:04
mnasiadkafunny it only hits in gate09:12
opendevreviewMark Goddard proposed openstack/kayobe master: CI: Run configuration dump against localhost  https://review.opendev.org/c/openstack/kayobe/+/90205609:25
opendevreviewMerged openstack/kolla-ansible stable/2023.1: Fix Horizon WSGI application log parsing  https://review.opendev.org/c/openstack/kolla-ansible/+/90206609:31
opendevreviewMerged openstack/kolla-ansible stable/zed: Fix Horizon WSGI application log parsing  https://review.opendev.org/c/openstack/kolla-ansible/+/90206909:31
opendevreviewMerged openstack/kolla-ansible stable/yoga: Fix Horizon WSGI application log parsing  https://review.opendev.org/c/openstack/kolla-ansible/+/90207009:31
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: CI: Fail on fluentd log parsing errors  https://review.opendev.org/c/openstack/kolla-ansible/+/74239909:42
opendevreviewMerged openstack/kolla master: Add magnum-cluster-api driver to Kolla images  https://review.opendev.org/c/openstack/kolla/+/90210110:15
opendevreviewMerged openstack/kolla master: Handle the case where docker is not available  https://review.opendev.org/c/openstack/kolla/+/90205310:19
opendevreviewMerged openstack/kolla master: Drop docker-py from requirements.txt  https://review.opendev.org/c/openstack/kolla/+/89664410:19
opendevreviewMichal Nasiadka proposed openstack/kolla master: bump td-agent lts from v4 to v5  https://review.opendev.org/c/openstack/kolla/+/89494810:51
opendevreviewMerged openstack/kolla-ansible master: etcd: Add support for more scenarios  https://review.opendev.org/c/openstack/kolla-ansible/+/88801211:13
mnasiadkafrickler: I see neutron is special - some other upgrade job failure - https://4a9836736643be5ed458-c393df920c3ba3d74686e2bffd0842f4.ssl.cf5.rackcdn.com/902131/1/check/kolla-ansible-ubuntu-upgrade-cephadm/ab3f02a/primary/logs/kolla/all-CRITICAL.txt11:18
mnasiadkajangutter: https://review.opendev.org/q/topic:%22update-etcd-v3.4%22 - I see only merge conflicts - can you fix?11:18
jangutteryep, on it11:19
mnasiadkathanks11:22
opendevreviewJan Gutter proposed openstack/kolla-ansible master: Update etcd docs and reno  https://review.opendev.org/c/openstack/kolla-ansible/+/90208611:24
opendevreviewJan Gutter proposed openstack/kolla-ansible master: etcd: deduplicate environments for containers  https://review.opendev.org/c/openstack/kolla-ansible/+/89020811:24
opendevreviewJan Gutter proposed openstack/kolla-ansible master: etcd: update to v3.4  https://review.opendev.org/c/openstack/kolla-ansible/+/89046511:24
guesswhat[m]mnasiadka: what do I need to change here https://review.opendev.org/c/openstack/kolla-ansible/+/888496 for getting Approval ? 11:27
opendevreviewMerged openstack/kayobe master: Deduplicate before picking merge strategy  https://review.opendev.org/c/openstack/kayobe/+/90133611:37
sylvrjovial: here's the log from dhcpdump for dnsmasq and for dhcpd https://pastebin.com/q3en5DMD https://pastebin.com/wf8MLRuh12:05
sylvrno filename are provided by the dnsmasq's dhcp, seems odd12:07
opendevreviewJan Gutter proposed openstack/kolla-ansible master: Update etcd docs and reno  https://review.opendev.org/c/openstack/kolla-ansible/+/90208612:08
opendevreviewJan Gutter proposed openstack/kolla-ansible master: etcd: deduplicate environments for containers  https://review.opendev.org/c/openstack/kolla-ansible/+/89020812:08
opendevreviewJan Gutter proposed openstack/kolla-ansible master: etcd: update to v3.4  https://review.opendev.org/c/openstack/kolla-ansible/+/89046512:08
sylvrand with dhcpd I don't think I manged to pass the correct file since the machines keep retrying PXE boot12:12
jovialslyvr: thanks for that. It does seem odd... Possibly enabling iPXE could help?12:12
fricklerI wanted to handle the etcd merge conflicts once the base patch is merged, seems the CI didn't agree with me :-(12:13
sylvrjovial: I'm not sure I can enable iPXE for my client, or is it something to enable in Ironic/Bifrost ?12:14
jovialslyvr: I think to do that you may need to set `enabled_boot_interfaces: "ipxe,pxe"` in `$KAYOBE_CONFIG_PATH/kolla/config/bifrost/bifrost.yml`. I noticed in the dnsmaq config you posted was missing the iPXE related config options. To apply that, use: `kayobe seed service deploy`.12:16
sylvrokay, this line isn't present in the config file, can I set it in kayobe ?12:20
jovialyes, just create the file: `$KAYOBE_CONFIG_PATH/kolla/config/bifrost/bifrost.yml` and pop it in there12:21
sylvrthe file exist so that's good12:21
sylvrokay so I'm running the kayobe command hoping this will fix things12:22
jovialslyvr: looking at your dnsmasq config again, it kind of looks like you are missing this whole section: https://github.com/openstack/bifrost/blob/e41ed498324e527400b50897fbb8b51ac909db1e/playbooks/roles/bifrost-ironic-install/templates/dnsmasq.conf.j2#L96-L11912:27
jovialwhich might suggest that `enable_inspector_discovery` is set to false12:28
jovialDoes anything show up with `grep -R "enable_inspector_discovery" $KOLLA_CONFIG_PATH`?12:29
sylvrgrep -Rnw 'ostack/src/kayobe-config' -e 'enable_inspector_discovery' => ostack/src/kayobe-config/etc/kolla/config/bifrost/bifrost.yml:8:enable_inspector_discovery: true12:29
jovialOK, that looks good12:29
sylvreven the config path ?12:30
opendevreviewJan Gutter proposed openstack/kolla-ansible master: etcd: deduplicate environments for containers  https://review.opendev.org/c/openstack/kolla-ansible/+/89020812:30
opendevreviewJan Gutter proposed openstack/kolla-ansible master: etcd: update to v3.4  https://review.opendev.org/c/openstack/kolla-ansible/+/89046512:30
jovialslyvr: Yeah, kayobe generates config for kolla and that is what is populated in ` ostack/src/kayobe-config/etc/kolla/`12:31
jovialnever modify files in that directory directly12:31
sylvrbecause there's still a kolla directory inside the kayobe config (etc/kayobe/kolla/) with the passwords inside12:31
sylvrokay, but how do you set ipxe and pxe then ? in etc/kayobe/bifrost.yml ?12:32
jovialslyvr: Yeah, that is normal. Config in that directory is used by kayobe to generate the the output in ` ostack/src/kayobe-config/etc/kolla/`12:32
jovialit would be in  `ostack/src/kayobe-config/etc/kayobe/kolla/config/bifrost/bifrost.yml`12:33
opendevreviewMerged openstack/kayobe master: Honor custom ssh args in kayobe-ansible-user.yml  https://review.opendev.org/c/openstack/kayobe/+/78827612:33
sylvrhum... okay12:33
sylvrso, the dnsmasq.conf is still missing the dhcp-boot part12:34
sylvroh wait12:35
sylvrI modified the wrong file haven't I12:35
sylvryuup12:35
sylvrshouldn't I modify this file ? : ostack/src/kayobe-config/etc/kayobe/bifrost.yml12:36
jovialPossibly, its weird though.. I'd still expect to see that `dhcp-boot` even with ipxe not in the enabled_boot_interfaces12:36
jovialslyvr: Put it in `ostack/src/kayobe-config/etc/kayobe/kolla/config/bifrost/bifrost.yml`12:38
jovialI'm not sure we have a variable to expose the boot interfaces in etc/kayobe/bifrost.yml12:39
sylvroh yeah okay12:39
sylvrwell, I don't think it worked, I'm going to replay all playbook just to be sure12:50
sylvr(there's still a loop of DHCP discovery and DHCP offer, and the dnsmasq.conf is still missing some lines)12:54
opendevreviewSven Kieske proposed openstack/kolla-ansible master: Add a flag to enable quorum queues  https://review.opendev.org/c/openstack/kolla-ansible/+/89854313:31
jovialslyvr: How does the dnsmasq config file look now?13:32
sylvrjovial : it's the same13:33
sylvrhow can I check if the correct files are read for the config ?13:34
jovialslyvr: I wonder if that means that the overrides aren't being used 13:34
sylvryup, that's why I want to be sure that the config is really made from the file I'm modifying13:35
sylvrwell, the kolla file contain the correct options13:36
sylvrhttps://pastebin.com/kvHWfn6C13:36
sylvrat least from what I understand from the files lmao13:37
jovialslyvr: Could you increase the verbosity and look for something like: `Running command: . /home/stack/yoga-rl9-migration/venvs/kolla-ansible/bin/activate && kolla-ansible deploy-bifrost` in the output13:38
sylvrso I had -vvv ?13:39
jovialslyvr: lets see what it is passing as the `--configdir` option13:39
jovialslyvr: yeah, that should do it13:40
sylvrokay ! I'll send the logs, so I run just kayobe seed service deploy ?13:40
jovialyes, please. That would be great.13:41
sylvrokay ! I hope the logfile won't be too big ^^13:41
jovialYou could do something like: `kayobe seed service deploy -kt none -t none -vvv` and that will at least tell us where it is looking for the config (but won't actually do any changes)13:43
mnasiadkabbezak, frickler: fluentd v5 ready - https://review.opendev.org/q/topic:%22fluentd5%2213:44
mmalchukmgoddard tls followup ready - https://review.opendev.org/c/openstack/kayobe/+/79369713:45
fricklermnasiadka: thx, checking. fyi I'm having some flakyness with my broadband connection today, might not respond fast during the meeting13:49
mnasiadkafrickler: I'm going to make the meeting short - I'll be in two meetings at the same time13:49
fricklerok13:50
mnasiadkabut I think we need to focus on the things we need to merge before we release rc113:51
mnasiadkaand a final next week13:51
sylvrjovial : running grep "kolla-ansible deploy-bifrost" logs_quick  (the file containing the output of the command you sent me) returns nothing13:51
mnasiadkafrickler: https://review.opendev.org/c/openstack/kolla-ansible/+/742399 - this will make us fail on fluentd parsing errors - so we don't get into this in the future again - needs second +213:52
sylvrI think it might be a good idea to make my config from scratch at this point13:52
mnasiadkamgoddard mnasiadka bbezak frickler kevko SvenKieske mmalchuk gkoper jangutter jsuazo jovial - meeting in 7 minutes13:53
sylvrjovial : I'm going to redo the whole installation/config of kayobe, hopefully I can do things way quicker now that I already have exemple of config, I hope it'll fix issues, I can make my repo public if you'd like to check the configfiles directly14:00
jovialslyvr: Sounds awesome, if I could see the config, that would definitely aid in debugging - thanks :)14:01
SvenKieskemnasiadka: do we want to start? :)14:02
mnasiadkaoh crap14:02
mnasiadkayes14:02
mnasiadka#startmeeting kolla14:02
opendevmeetMeeting started Wed Nov 29 14:02:14 2023 UTC and is due to finish in 60 minutes.  The chair is mnasiadka. Information about MeetBot at http://wiki.debian.org/MeetBot.14:02
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:02
opendevmeetThe meeting name has been set to 'kolla'14:02
mnasiadka#topic rollcall14:02
mnasiadkao/14:02
SvenKieskeo/14:02
mattcrees\o14:02
frickler\o14:02
jovial\o14:02
jangutter\o14:02
mhinero/14:02
mnasiadka#topic agenda14:04
mnasiadka* Release tasks14:04
mnasiadka* Open discussion14:04
mnasiadkaWe make it basically short today - to use the time to review RP+1 patches and RC1 this week14:04
mnasiadka#topic Release tasks14:04
mnasiadkaansible-collection-kolla rc1 is on the way14:05
mnasiadkalet's check kolla14:05
mnasiadkaBasically fluentd - https://review.opendev.org/q/topic:%22fluentd5%2214:05
mnasiadkaand then we're ready to release rc114:05
mnasiadkafirst add labels for transition in https://review.opendev.org/c/openstack/kolla/+/90150814:06
mnasiadkasecond in kolla-ansible - use these labels https://review.opendev.org/c/openstack/kolla-ansible/+/90150914:06
mnasiadkaand then bump version - https://review.opendev.org/c/openstack/kolla/+/89494814:06
mmalchuko/14:06
mnasiadkaany questions to those?14:06
mnasiadkaok, I see review comments are coming in - good, will address14:08
mnasiadkawhat about kolla-ansible - let me check14:08
mnasiadkamainly etcd - https://review.opendev.org/q/topic:%22update-etcd-v3.4%2214:08
mnasiadkaWhat about quorum queues? https://review.opendev.org/c/openstack/kolla-ansible/+/89854314:09
mnasiadkaAre we merging that now - or waiting for C?14:09
mnasiadkaSvenKieske, mattcrees ?14:09
mattcreesI'm currently in the process of testing if the migration strategy we used for HA queues will also work for quorum queues. So far, it seems like it will. (https://docs.openstack.org/kolla-ansible/latest/reference/message-queues/rabbitmq.html#high-availability)14:10
SvenKieskewell the cephadm job is unstable with it14:10
SvenKieskebut I was not able to figure out why so far. :/14:10
fricklercephadm is unstable without it, too, I think?14:10
SvenKieskexD yeah that's true, so it might also be unrelated14:11
mnasiadkayeah, we need to put more cycles into that instability14:11
mnasiadkabut I've seen that mainly we're failing this job due to errors in neutron-server logs14:11
mnasiadkaso it might be some more tweaks to check-logs.sh14:11
SvenKieskeI just fixed the Merge conflict, from my pov it could get merged, I only saw people so far who had good experience with quorum queues14:11
mnasiadkaok, let's try to get the etcd stuff in - then we can see if that one can get it14:12
mnasiadkaget in14:12
SvenKieskeok14:12
mattcreesIf you can give me an hour or so to finish a bit of testing, I'll then be happy to merge it14:12
mnasiadkamattcrees: you can test until tomorrow ;-)14:12
mattcreesI also want to make some follow-up prechecks and docs, but those don't need to block the merge14:12
SvenKieskemattcrees:sure! :)14:12
mnasiadkaprechecks and docs can be backported from C I guess14:12
mattcreesYes that's my thinking too14:13
mnasiadkaand the quorum queue support could be backported all the way to Yoga I guess - but without changing any defaults14:13
mnasiadkabut that's another story14:13
mnasiadkaok, basically that's it from me14:13
mnasiadka#topic Open discussion14:13
mattcreesProvided the oslo messagine support goes back that far too ;) 14:13
mnasiadkamattcrees: I think it does14:13
mnasiadkaok, Open discussion time14:14
mnasiadkaah14:14
mnasiadkajovial: forgot about kayobe - but I think you're chasing that internally in SHPC, right?14:14
mnasiadkaand you need to wait for kolla and kolla-ansible to release14:14
mnasiadkato do some pre-branching tasks14:14
SvenKieskeis it just me or was CI more unstable the last few weeks?14:15
mnasiadkait's just the CI14:15
jovialYeah, for kayobe: This is is the list of patches I was hoping to get in: https://review.opendev.org/q/project:openstack/kayobe+status:open+label:Review-Priority%252B1. Let me know if I've missed any important ones.14:15
mnasiadkathe javascript error on checking zuul output wasn't helpful as well :)14:15
opendevreviewMerged openstack/kolla-ansible master: CI: Add oslo_db.exception.DBConnectionError to check-logs.sh  https://review.opendev.org/c/openstack/kolla-ansible/+/90213114:16
opendevreviewMerged openstack/kolla-ansible master: Update etcd docs and reno  https://review.opendev.org/c/openstack/kolla-ansible/+/90208614:16
mnasiadkaok then, off to get those patches merged and checking the CI stability14:18
mnasiadkaI mean that's my plan14:18
mmalchukjovial https://review.opendev.org/c/openstack/kayobe/+/793697 is one of the most important for a 2 years14:18
mnasiadkaLet's meet next week with a christmas present for the community - and then work on C14:18
mnasiadkaThanks - and sorry for the short meeting, but I'm overloaded today14:19
mnasiadka#endmeeting14:19
opendevmeetMeeting ended Wed Nov 29 14:19:14 2023 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)14:19
opendevmeetMinutes:        https://meetings.opendev.org/meetings/kolla/2023/kolla.2023-11-29-14.02.html14:19
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/kolla/2023/kolla.2023-11-29-14.02.txt14:19
opendevmeetLog:            https://meetings.opendev.org/meetings/kolla/2023/kolla.2023-11-29-14.02.log.html14:19
mmalchukmnasiadka thanks14:19
samcat116I have an all in one node deployed with yoga via k-a. Sometimes I'll see openvswitch_vswitchd die for some reason. The container will restart, but won't become healthy as vswitchd will complain that pidfile check failed. Removing the /var/run/openvswitch/ovs-vswitchd.pid file on the host side and manually restarting the container seems to fix it, but is there a way to automatically clean up that file when the container exits?14:37
mnasiadkajangutter: did we break something in cinder-ceph with etcd? https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_93a/890208/11/check/kolla-ansible-ubuntu-cephadm/93a6c6d/primary/logs/kolla/cinder/cinder-volume.txt14:38
fricklermnasiadka: yes, there was a comment earlier, we need the whole series merged to fix that14:38
mnasiadkafrickler: fantastic14:39
fricklermnasiadka: well the other option was to revert to bump in kolla and redo later, but I thought just moving forward would be better14:39
jangutterYeah, apologies, it's a bit of a circular dependency for that job.,14:40
jangutterhttps://review.opendev.org/c/openstack/kolla-ansible/+/890465 should fix it.14:41
jangutter(sorry, need to run, will be back in 2.5h)14:41
sylvrjovial : here's the repository https://forge.univ-lyon1.fr/p1919734/kayobe-config I'm moving some files and config from the old one (but I log very thorougly this time)14:52
SvenKieskemnasiadka: can you have a look at my proposal for the variable definition? any other core would also suffice, I guess :) https://review.opendev.org/c/openstack/kolla-ansible/+/89629215:11
opendevreviewJake Hutchinson proposed openstack/kolla-ansible stable/yoga: Change regex for the multiline parser at the fluentd rabbitmq input  https://review.opendev.org/c/openstack/kolla-ansible/+/90170915:32
opendevreviewVerification of a change to openstack/kolla-ansible master failed: CI: Fail on fluentd log parsing errors  https://review.opendev.org/c/openstack/kolla-ansible/+/74239915:35
SvenKieskemhm, is the gate broken?15:45
fricklerhmm ... "ModuleNotFoundError: No module named 'rich'" ... some regression in podman maybe?15:47
fricklerjust released ... .post1 doesn't sound healthy to me ... https://pypi.org/project/podman/4.8.0.post1/15:49
fricklermaybe we do need to pin versions after all?15:50
sylvrjovial : with the current configuration, nothing changed, I'll check if discovery is enabled (or is it the default ? )15:52
jovialsylvr: its disabled by default in bifrost, but kayobe should be enabling it. Did you manage to get the verbose output of seed service deploy?15:53
jovialIt does seem like kolla isn't using the config files kayobe has generated15:54
SvenKieskefrickler: this seems to be the culprit: https://github.com/containers/podman-py/commit/78d57dd116c32b7251c9024c17f3d635d30587ba15:55
SvenKieskefrickler: I asked upstream when we implemented this initially, they only support the latest version, basically - I would need to dig up the original review to recall the exact wording, which I saved there15:55
sylvrjovial : oops, I'll do that rn, how do you want me to send you the logs?15:55
SvenKieskeit15:56
sylvrjovial : well, I had issue before with dnsmasq not having the same config for the DHCP server...15:57
SvenKieskeit's still weird, "rich" is in the requirements.txt of podman-py, so why can't it be imported?15:57
SvenKieskemhm, they also got a pyproject.toml and each file references the other and says dependencies should be updated in both, but that doesn't seem to be the case? https://github.com/containers/podman-py/blob/main/pyproject.toml15:58
jovialsylvr: The logs would be handy. Especially the `Running command` bit when it trys to deploy bifrost.15:59
sylvrwell, I'm running kayobe seed service deploy -vvv | tee log_file16:00
SvenKieskemhm, a local installation of podman-py at least works..16:01
SvenKieskefrickler: I filed an issue: https://github.com/containers/podman-py/issues/35016:08
sylvrjovial : deployment finished, how can I send you the logs ?16:14
sylvrthe file is 2.9MB16:15
fricklerSvenKieske: "tox -e py3" is a simple reproducer for me locally16:23
fricklerand "rich" isn't installed in the tox venv, likely since it is missing from pyproject.toml. as a workaround we can likely add it to test-reqs.txt?16:25
SvenKieskeseems sane16:26
* frickler proposes a patch to see what else will break16:26
fricklermeh, the installation outside of tox comes from a-c-k (except for debian), that's getting more complicated than I was hoping for16:40
mnasiadkanobody said it will be simple16:40
SvenKieskecould it at least be easy? :D16:41
mnasiadkafrickler: https://zuul.opendev.org/t/openstack/build/78886ceb45a14d6aa7dd3d32aaedbc2f - what the heck happened here? ;-)16:41
SvenKieskemnasiadka: see comments above, specifically: https://github.com/containers/podman-py/issues/35016:43
opendevreviewDr. Jens Harbott proposed openstack/kolla-ansible master: podman: install "rich" dependency  https://review.opendev.org/c/openstack/kolla-ansible/+/90217016:44
jovialslyvr: Any way you are happy with. Could email them to me at will@stackhpc.com if you like.16:44
fricklermnasiadka: ^^ might fix it, though I'm too tired to be sure, will check CI results later, feel free to amend if needed16:45
mnasiadkawill do16:45
SvenKieskethere's a small whitespace missing, otherwise LGTM16:45
SvenKieskeerr, rather too much whitespace, not missing16:45
mnasiadkathat whitespace is not related to this patch, is it?16:45
* SvenKieske needs to get some sleep16:46
SvenKieskeah indeed16:46
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: CI: Fail on fluentd log parsing errors  https://review.opendev.org/c/openstack/kolla-ansible/+/74239916:47
mnasiadkaok, rebased on the rich patch16:47
mnasiadkaSvenKieske: that means we're not linting tox.ini :)16:47
SvenKieskeyeah, I won't ask why today, though ;P16:47
mnasiadkaevery question adds more work :)16:48
SvenKieskeso I won't ask :D16:48
SvenKieskehttps://xkcd.com/1319/ comes to mind :)16:49
SvenKieskeat least https://zuul.opendev.org/t/openstack/build/25141e6affa2409b8093fb65f25139e5 looks better now :)16:54
fricklerthat's the easy part that I could test locally ;) but good to see that confirmed anyway16:55
SvenKieskewell I think this should really not break anything else, but you never know..16:56
SvenKieskeI'll guess I call it a day, especially when looking at tomorrows endless list of meetings :)16:57
SvenKieskelol rocky9-podman job failed..16:57
SvenKieskeanyway, o/16:57
mnasiadkafrickler: I guess we should add rich to the list of podman_sdk_pip_packages in a-c-k?16:58
fricklermnasiadka: I was thinking about that, but I'm really hoping podman people will fix their blunder soon enough so that we don't have to16:59
fricklerso I'd be fine to just fix our CI for now and then wait until Friday maybe?17:00
mnasiadkapodman jobs failed, we would need to override podman_sdk_pip_packages in tests/templates/globals-default.yml.j217:00
mnasiadkalet me update your patch17:00
frickleryeah, I wasn't sure if the var would make it through from the zuul env, thx17:01
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: podman: install "rich" dependency  https://review.opendev.org/c/openstack/kolla-ansible/+/90217017:01
mnasiadkaI left the var in zuul just to run those jobs to check17:02
mnasiadkaonce it passes green I'll remove it17:02
mnasiadkawe could pass through the vars in that way so we don't have to manage everything in that file, might be a good idea for C17:02
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: podman: install "rich" dependency  https://review.opendev.org/c/openstack/kolla-ansible/+/90217017:04
mnasiadkaactually editing globals-default made nearly all jobs to run17:04
opendevreviewMerged openstack/kayobe master: kolla-bifrost: Add precheck for inspection allocation pool  https://review.opendev.org/c/openstack/kayobe/+/90174817:10
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: CI: Fail on fluentd log parsing errors  https://review.opendev.org/c/openstack/kolla-ansible/+/74239917:42
opendevreviewJan Gutter proposed openstack/kolla-ansible master: etcd: deduplicate environments for containers  https://review.opendev.org/c/openstack/kolla-ansible/+/89020817:43
opendevreviewJan Gutter proposed openstack/kolla-ansible master: etcd: update to v3.4  https://review.opendev.org/c/openstack/kolla-ansible/+/89046517:43
opendevreviewSven Kieske proposed openstack/kolla-ansible master: Add a flag to enable quorum queues  https://review.opendev.org/c/openstack/kolla-ansible/+/89854317:48
mnasiadkafrickler: https://review.opendev.org/c/openstack/kolla-ansible/+/901509 - if you could have a look in this one tomorrow - would be nice (kolla-ansible patch between kolla fluentd patches)17:53
guesswhat[m]Do You know that Skyline has an integration to Prometheus and its exporters via query? It has own monitoring center in UI which aggregate common exporters ( libvirt, rabbit, mysql, etc )18:04
mnasiadkanice, haven't really got time to look into skyline18:06
mnasiadkaugh, kolla also broken by rich18:07
opendevreviewMichal Nasiadka proposed openstack/kolla master: podman: install "rich" dependency  https://review.opendev.org/c/openstack/kolla/+/90217918:07
opendevreviewMichal Nasiadka proposed openstack/kolla master: fluentd: Add labels for transition to v5  https://review.opendev.org/c/openstack/kolla/+/90150818:08
guesswhat[m]mnasiadka: is there any module in kolla which is capable of merging yaml ? would be great to be able to overide skyline.yaml from kolla config dir18:08
opendevreviewMichal Nasiadka proposed openstack/kolla master: bump td-agent lts from v4 to v5  https://review.opendev.org/c/openstack/kolla/+/89494818:08
mnasiadkaguesswhat[m]: https://github.com/openstack/kolla-ansible/blob/master/ansible/action_plugins/merge_yaml.py - that one?18:09
mnasiadkawe use it in multiple roles18:09
mnasiadkaok, enough for today, let's see what zuul says tomorrow morning ;)18:10
ozzzo_workWhere can I find a reference showing which openstack version runs on which RHEL version?18:31
ozzzo_workI'm trying to figure out how I can upgrade from Train on RHEL8 to Wallaby on RHEL9. I believe that I have to do the RHEL8->9 upgrade on one of the intermediate steps. Is it Ussuri?18:52
guesswhat[m]is enough to put merge_yaml here https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/skyline/tasks/config.yml#L20C6-L20C6 to enable merging for skyline ?19:18
mnasiadkaozzzo: we don’t support RHEL - as in we don’t test it19:18
mnasiadkaozzzo: but centos 8 to 9 switch is in yoga19:19
ozzzoIs Yoga the only version that supports both 8 and 9?19:19
ozzzoISTR seeing a document that lays out Centos/Openstack version compatibility but I can't find it now19:21
mnasiadkaYes, Yoga is the version that supports both python 3.6 and 3.919:24
mnasiadkaKolla publishes c8s and rocky linux 9 images on quay.io/openstack.kolla if that helps19:25
opendevreviewLukas M proposed openstack/kolla-ansible master: skyline: allow to merge skyline.yaml config with custom config  https://review.opendev.org/c/openstack/kolla-ansible/+/90218219:38
guesswhat[m]mnasiadka: here ^ ( this will allow to configure sso and prometheus integration even if its not yet supported by kolla )19:39
opendevreviewMerged openstack/kolla-ansible master: podman: install "rich" dependency  https://review.opendev.org/c/openstack/kolla-ansible/+/90217019:51
dcapone2004hi, 2023.1 release....globals.yml does not contain a storage_interface option.... this option was in my older globals.yml deployment...what controls the storage interface used in the deployment now?19:55
-opendevstatus- NOTICE: The Gerrit service on review.opendev.org will be restarting momentarily for a patch update to address a recently observed regression preventing some changes from merging21:09
opendevreviewMaksim Malchuk proposed openstack/kolla-ansible stable/yoga: Adding mariadb_port to wsrep sync status so alterative ports can be used  https://review.opendev.org/c/openstack/kolla-ansible/+/90191821:52
opendevreviewMaksim Malchuk proposed openstack/kayobe stable/2023.1: kolla-bifrost: Add precheck for inspection allocation pool  https://review.opendev.org/c/openstack/kayobe/+/90222122:33
opendevreviewMaksim Malchuk proposed openstack/kayobe stable/zed: kolla-bifrost: Add precheck for inspection allocation pool  https://review.opendev.org/c/openstack/kayobe/+/90222222:33
opendevreviewMaksim Malchuk proposed openstack/kayobe stable/yoga: kolla-bifrost: Add precheck for inspection allocation pool  https://review.opendev.org/c/openstack/kayobe/+/90222322:33
opendevreviewMaksim Malchuk proposed openstack/kayobe stable/2023.1: Honor custom ssh args in kayobe-ansible-user.yml  https://review.opendev.org/c/openstack/kayobe/+/90222422:37
opendevreviewMaksim Malchuk proposed openstack/kayobe stable/zed: Honor custom ssh args in kayobe-ansible-user.yml  https://review.opendev.org/c/openstack/kayobe/+/90222522:38
opendevreviewMaksim Malchuk proposed openstack/kayobe stable/yoga: Honor custom ssh args in kayobe-ansible-user.yml  https://review.opendev.org/c/openstack/kayobe/+/90222622:38
opendevreviewMaksim Malchuk proposed openstack/kayobe stable/zed: docs: add information about enabling TLS to automated guide  https://review.opendev.org/c/openstack/kayobe/+/90222722:40
opendevreviewMaksim Malchuk proposed openstack/kayobe stable/yoga: docs: add information about enabling TLS to automated guide  https://review.opendev.org/c/openstack/kayobe/+/90222822:41
opendevreviewVerification of a change to openstack/kolla master failed: podman: install "rich" dependency  https://review.opendev.org/c/openstack/kolla/+/90217923:43
opendevreviewVerification of a change to openstack/kolla master failed: fluentd: Add labels for transition to v5  https://review.opendev.org/c/openstack/kolla/+/90150823:43

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!