Thursday, 2023-06-22

opendevreviewVerification of a change to openstack/kolla stable/2023.1 failed: rabbitmq: use erlang-25 ppa on Debian/Ubuntu  https://review.opendev.org/c/openstack/kolla/+/88667202:21
opendevreviewVerification of a change to openstack/kolla stable/2023.1 failed: rabbitmq: use erlang-25 ppa on Debian/Ubuntu  https://review.opendev.org/c/openstack/kolla/+/88667206:28
opendevreviewIvan Halomi proposed openstack/kolla-ansible master: Add support of podman deployment  https://review.opendev.org/c/openstack/kolla-ansible/+/79922907:12
opendevreviewMichal Nasiadka proposed openstack/kolla master: Designate infoblox port 53 permission denied  https://review.opendev.org/c/openstack/kolla/+/88663607:36
opendevreviewMargaritaShakhova proposed openstack/kolla-ansible master: Adds support for Huawei backends  https://review.opendev.org/c/openstack/kolla-ansible/+/86925207:54
hrwkevko: proxysql 2.5.3 for debian/bookworm is available08:06
hrwkevko: one less thing to worry08:06
hrwkevko: https://github.com/sysown/proxysql/issues/425908:06
SvenKieskenice08:25
opendevreviewMichal Nasiadka proposed openstack/kolla master: Designate infoblox port 53 permission denied  https://review.opendev.org/c/openstack/kolla/+/88663608:59
kevkohrw: cool, that guys are very nice if you ask ... thank you that you handled it 09:14
mnasiadkahrw: regarding bookworm - I spoke with cboylan on the summit, and he proposed that we could add bookworm nodes/images without the mirror first (because it's going to take a while to remove the content and make place for bookworm content) - do you want to handle that?09:16
hrwmnasiadka: patches are in gerrit already09:17
hrwmnasiadka: and there are 3rdparty repos missing still09:17
hrwmnasiadka: erlang needs to be built with openssl3, mariadb is missing etc.09:18
fricklercan we use distro pkgs for those in the first iteration?09:18
hrwfrickler: should be possible09:18
fricklerI was thinking about simply adding another volume to AFS to make space for bookworm mirrors09:18
fricklerso what exactly is missing to build a bookworm image in nodepool?09:19
frickler(we can likely move this discussion to #opendev)09:20
hrwfrickler: https://review.opendev.org/c/opendev/system-config/+/881952 for start (adds reprepro)09:20
fricklerok, so that needs AFS space. what about the option to start without mirrors?09:20
hrwfrickler: in short: same shit as usual. zuul jobs, distro mirror. we can skip python wheel cache for now 09:20
hrwfrickler: going mirrorless depends on how infra team likes jobs which do not use mirrors09:21
hrwmnasiadka: we should move to mariadb 10.11 for all distros. This is Debian/bookworm version. 09:22
* frickler as infra team doesn't care much, we'll need to test it and see how unstable jobs might become due to upstream mirror issues09:22
hrwmnasiadka: Debian has Erlang 25 so should fit 09:22
mnasiadkathere is a patch for moving to mariadb 10.1109:22
hrwand some 3rdparty stuff can go with ubuntu/jammy repos for now09:22
hrwmnasiadka: +209:23
mnasiadkahrw: we're running rocky without mirrors for two cycles at least, so I don't think it's a problem09:23
hrwok09:24
hrwlet me update and do build09:29
hrwas a break from dealing with DSDT hacking09:29
hrwbtw: http://osbpo.debian.net/deb-status/ is handy 09:31
mnasiadkafrickler: remind me - we wanted to add podman package to requirements, right?09:32
ihalomihi, could you merge this one? it fails podman tests in podman patchset, but it looks that rabbitmq issue is just on my machine https://review.opendev.org/c/openstack/kolla-ansible/+/88639109:35
mnasiadkaihalomi: done09:37
ihalomimnasiadka: thanks09:38
hrwERROR:kolla.common.utils:neutron-mlnx-agent Failed with status: error09:38
hrwERROR:kolla.common.utils:openvswitch-netcontrold Failed with status: error09:38
hrwnice progress on bookworm09:38
opendevreviewMarcin Juszkiewicz proposed openstack/kolla master: Revert "neutron-mlnx-agent: pin pyzmq at 21.*"  https://review.opendev.org/c/openstack/kolla/+/88205109:39
opendevreviewMarcin Juszkiewicz proposed openstack/kolla master: base: install adduser on Debian/Ubuntu  https://review.opendev.org/c/openstack/kolla/+/88194809:39
opendevreviewMarcin Juszkiewicz proposed openstack/kolla master: base: Debian 12 uses new APT sources file  https://review.opendev.org/c/openstack/kolla/+/88195009:39
opendevreviewMarcin Juszkiewicz proposed openstack/kolla master: WIP: Move to Debian 12 'bookworm'  https://review.opendev.org/c/openstack/kolla/+/88608809:39
hrwneutron-mlnx-agent looks like we use antelope requirements09:40
hrw(kolla) 11:40 marcin@applejack:kolla$ git review -x https://review.opendev.org/c/openstack/kolla/+/88608709:42
hrwlet rebuild09:42
opendevreviewMichal Nasiadka proposed openstack/kolla master: config: switch OpenStack release back to master  https://review.opendev.org/c/openstack/kolla/+/88608709:42
kevkohmm, Waiting for rabbitmq to start in zuul ...anyone seen this error nowadays ? 09:45
kevkoin zuul ...09:46
kevkoupgrade job 09:47
opendevreviewVerification of a change to openstack/kolla-ansible master failed: Fix issue with octavia security group rules creation  https://review.opendev.org/c/openstack/kolla-ansible/+/88583109:49
hrwok, now only openvswitch-netcontrold fails. 09:49
hrwand this one needs to be rewritten to use virtualenv09:49
hrwsomeone uses this image?09:49
opendevreviewMarcin Juszkiewicz proposed openstack/kolla master: config: switch OpenStack release back to master  https://review.opendev.org/c/openstack/kolla/+/88608709:50
opendevreviewMarcin Juszkiewicz proposed openstack/kolla master: Revert "neutron-mlnx-agent: pin pyzmq at 21.*"  https://review.opendev.org/c/openstack/kolla/+/88205109:50
opendevreviewMarcin Juszkiewicz proposed openstack/kolla master: base: install adduser on Debian/Ubuntu  https://review.opendev.org/c/openstack/kolla/+/88194809:50
opendevreviewMarcin Juszkiewicz proposed openstack/kolla master: base: Debian 12 uses new APT sources file  https://review.opendev.org/c/openstack/kolla/+/88195009:50
opendevreviewMarcin Juszkiewicz proposed openstack/kolla master: WIP: Move to Debian 12 'bookworm'  https://review.opendev.org/c/openstack/kolla/+/88608809:50
hrwso those patches need reviews and then kolla will be ready for bookworm09:51
opendevreviewMarcin Juszkiewicz proposed openstack/kolla master: WIP: Move to Debian 12 'bookworm'  https://review.opendev.org/c/openstack/kolla/+/88608809:57
hrwremoved use of CI mirror for distro09:57
SvenKieskeI'm really confused about https://review.opendev.org/c/openstack/kolla/+/886088 it seems to be WIP but is not marked WIP in gerrit. I assume the commented out repos are on purpose to not make CI fail? please mark as WIP until ready for review imho.10:29
fricklermnasiadka: yes, I still have that on my todo list to propose a req patch10:29
fricklerhrw: so you build kolla bookworm images on old debian and don't need opendev images for that, right? but we will need them for kolla-ansible? or keep the old host there, too?10:31
opendevreviewMerged openstack/kolla stable/2023.1: rabbitmq: use erlang-25 ppa on Debian/Ubuntu  https://review.opendev.org/c/openstack/kolla/+/88667210:35
mnasiadkafrickler: just wanted us to not miss some deadline ;-)10:36
hrwfrickler: images can be built on anything. I build on fedora10:36
hrwfrickler: both kolla and kolla-ansible would need bookworm images to make it proper on CI.10:37
hrwfrickler: for now we can build on bullseye10:37
hrwSvenKieske: 886088 has WIP in title as it something I am not sure about being ready for use. Lacks W-1 flag as I need someone else to look at it10:39
mnasiadkafrickler: can you check reprepro logs for ubuntu aarch64 mirror? we've been hitting this for some days - https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_53f/886673/1/check-arm64/kolla-build-ubuntu-aarch64/53f3662/kolla/build/000_FAILED_base.log10:39
fricklermnasiadka: not sure about deadlines, but I can move it up on my list10:40
SvenKieskehrw: was just not sure if the commented out repos are just intermediate or a thing that would be left in the code after it's not WIP; so I prepared a comment to ask for the removal, because I really don't like dead code10:41
hrwSvenKieske: I think I left NOTE(hrw) in each place. please comment if not or it is not clear10:41
hrwSvenKieske: I prefer to have comment rather than not10:42
fricklerhrw: ok, let's see how far we get with that and I'll check the opendev side in the meantime10:43
hrwSvenKieske: also I am building it only on aarch6410:44
opendevreviewMarcin Juszkiewicz proposed openstack/kolla master: Move to Debian 12 'bookworm'  https://review.opendev.org/c/openstack/kolla/+/88608810:46
hrwSvenKieske: dropped WIP, rewrote commit message, fixed tests10:46
SvenKieskehrw: now, I just commented :/ hope my comments are not outdated yet :D10:48
hrwSvenKieske: thanks10:56
hrwSvenKieske: replied10:58
opendevreviewMerged openstack/kayobe master: Revert "Use OpenStack 2023.1 release"  https://review.opendev.org/c/openstack/kayobe/+/88631311:12
opendevreviewMerged openstack/kolla-ansible master: Fixing kolla_container_engine option  https://review.opendev.org/c/openstack/kolla-ansible/+/88639111:18
opendevreviewMarcin Juszkiewicz proposed openstack/kolla master: build: distutils.StrictVersion() is deprecated  https://review.opendev.org/c/openstack/kolla/+/88674111:40
mnasiadkathose rax pypi issues are weird - https://0621dfde94c6b8e169b4-b0a2dd3101468fc87c6314d880da813b.ssl.cf1.rackcdn.com/886673/1/gate/kolla-ansible-debian-source/18488a9/primary/logs/build/000_FAILED_openstack-base.log11:52
fricklermnasiadka: yes, I've seen a couple of these lately. connectivity from rackspace to pypi cdn seems flaky12:09
opendevreviewIvan Halomi proposed openstack/kolla-ansible master: Add support of podman deployment  https://review.opendev.org/c/openstack/kolla-ansible/+/79922912:21
opendevreviewIvan Halomi proposed openstack/kolla-ansible master: Add support of podman deployment  https://review.opendev.org/c/openstack/kolla-ansible/+/79922912:22
opendevreviewVerification of a change to openstack/kolla stable/zed failed: rabbitmq: use erlang-25 ppa on Debian/Ubuntu  https://review.opendev.org/c/openstack/kolla/+/88667312:30
opendevreviewpara sitid proposed openstack/kolla-ansible master: Use better default bind address for ironic-tftp  https://review.opendev.org/c/openstack/kolla-ansible/+/88674712:53
simondodsleyWhat is the kolla policy on Centos8 Stream support? We have a customer appearing to have multipath/iscsi issues with Victoria deployed with Kolla running Centos 8 Stream, but their version is 18 months old. Do the team recommend keeping Stream at the tip or is leaving it stuck at a very old release acceptable?13:08
SvenKieskesimondodsley: there is currently no CentOS support in kolla at all, beside accidently working, see: https://docs.openstack.org/kolla/latest/support_matrix the last release officially supporting centos8 stream was yoga: https://docs.openstack.org/kolla/yoga/support_matrix13:12
SvenKieskewhich release are you running?13:12
simondodsleyVictoria13:12
SvenKieskeah sorry, you mentioned victoria already13:12
opendevreviewpara sitid proposed openstack/kolla-ansible master: Use better default bind address for ironic-tftp  https://review.opendev.org/c/openstack/kolla-ansible/+/88674713:12
SvenKieskein general I know it's recommended - and only supported by redhat/centos upstream - to run latest releases. I don't know how stable that would be with regards to kolla/openstack, maybe someone else has experience with this combination13:13
SvenKieskeelse I'd suggest asking on openstack-discuss Mailinglist to reach more users13:13
mnasiadkavictoria is EOL basically13:33
mnasiadkaand you get what you get with Stream13:33
opendevreviewVerification of a change to openstack/kolla master failed: config: switch OpenStack release back to master  https://review.opendev.org/c/openstack/kolla/+/88608713:57
opendevreviewVerification of a change to openstack/kolla master failed: Revert "neutron-mlnx-agent: pin pyzmq at 21.*"  https://review.opendev.org/c/openstack/kolla/+/88205113:57
opendevreviewVerification of a change to openstack/kolla stable/zed failed: rabbitmq: use erlang-25 ppa on Debian/Ubuntu  https://review.opendev.org/c/openstack/kolla/+/88667314:00
opendevreviewJuan Pablo Suazo proposed openstack/kolla-ansible master: Enables the Fluentd Plugin Systemd  https://review.opendev.org/c/openstack/kolla-ansible/+/87598314:40
kevkohttps://www.phoronix.com/news/Red-Hat-CentOS-Stream-Sources <<  Red Hat Now Limiting RHEL Sources To CentOS Stream14:54
kevkodebian is just debian :) 14:54
kevkoso switch back to centos stream :D ? 14:54
kevkohttps://forums.rockylinux.org/t/has-red-hat-just-killed-rocky-linux/10378 14:56
opendevreviewVerification of a change to openstack/kolla master failed: config: switch OpenStack release back to master  https://review.opendev.org/c/openstack/kolla/+/88608715:03
BobZAnnapolis_apologise if this is the wrong channel; kayobe aio install is failing at the 'control host bootstrap' step w/the following msg : "[WARNING]: - mrlesmithjr.manage-lvm was NOT installed successfully: - sorry, mrlesmithjr.manage-lvm was not found on https://galaxy.ansible.com/api/." ideas ? I have tried using stable/2023.1 as well as master branches - same error, tia15:08
mnasiadkafrickler, kevko: should we +w https://review.opendev.org/c/openstack/kolla-ansible/+/876357 finally? ;-)15:16
kevkoyep15:17
mnasiadkakevko: I'm pretty sure they will come up with something regarding Rocky/Alma/others, I'm not worried ;)15:17
kevkowhy all wants rhel based distros :D 15:18
fricklerBobZAnnapolis_: iiuc that has been fixed, make sure to use the latest version from git15:20
mnasiadkakevko: it's not that everybody want them, it's just a matter of choice - and after such RH stunts - people will rather choose something else15:20
mnasiadkaBobZAnnapolis_: fetch latest kayobe stable/2023.1, it has been fixed there15:21
mnasiadkaBobZAnnapolis_: ensure you have this commit: https://opendev.org/openstack/kayobe/commit/f525c6a563ebe36cd0c1016deb4fa16529eec51f15:21
opendevreviewMerged openstack/kayobe master: set previous_release to 2023.1  https://review.opendev.org/c/openstack/kayobe/+/88639615:24
opendevreviewMerged openstack/kolla-ansible master: Fix issue with octavia security group rules creation  https://review.opendev.org/c/openstack/kolla-ansible/+/88583115:42
opendevreviewMerged openstack/kolla-ansible master: Use friendly prometheus instance labels  https://review.opendev.org/c/openstack/kolla-ansible/+/87635717:01
opendevreviewMerged openstack/kolla master: config: switch OpenStack release back to master  https://review.opendev.org/c/openstack/kolla/+/88608717:01
opendevreviewMerged openstack/kolla stable/zed: rabbitmq: use erlang-25 ppa on Debian/Ubuntu  https://review.opendev.org/c/openstack/kolla/+/88667318:01
opendevreviewVerification of a change to openstack/kolla master failed: Revert "neutron-mlnx-agent: pin pyzmq at 21.*"  https://review.opendev.org/c/openstack/kolla/+/88205118:46
mmalchukkevko no any chance, all the RH distro owners in panic mode. all the peoples in panic)20:47
mmalchukbusiness in panic)20:48
mmalchukRedHat did this day)))20:49
opendevreviewVerification of a change to openstack/kolla master failed: Revert "neutron-mlnx-agent: pin pyzmq at 21.*"  https://review.opendev.org/c/openstack/kolla/+/88205121:17
mmalchukhttps://rockylinux.org/news/2023-06-22-press-release/21:35
mmalchukwe shouldn't switch back to centos)21:37

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!