| opendevreview | Michal Arbet proposed openstack/kolla-ansible master: Add support for multiple ceph files https://review.opendev.org/c/openstack/kolla-ansible/+/877413 | 08:17 |
|---|---|---|
| opendevreview | Michal Arbet proposed openstack/kolla-ansible master: Add support for multiple ceph files https://review.opendev.org/c/openstack/kolla-ansible/+/877413 | 08:18 |
| kevko | SvenKieske: are u satisfied now ? ^^^ | 08:19 |
| SvenKieske | kevko: currently in a meeting, will check soon(TM) | 08:20 |
| kevko | SvenKieske: ok, thanks | 08:21 |
| mmalchuk | morning | 08:21 |
| kevko | morning | 08:21 |
| mmalchuk | folks, please review https://review.opendev.org/q/topic:fix-cyborg-service | 08:22 |
| mmalchuk | cores, please merge https://review.opendev.org/q/topic:fix-passwords-yml-permissions | 08:22 |
| SvenKieske | kevko: done (still having trouble mapping your IRC nick to your name :D ) | 09:11 |
| kevko | haha :D | 09:12 |
| mmalchuk | lol | 09:14 |
| kevko | https://nm.debian.org/person/kevko/ | 09:15 |
| kevko | mmalchuk: yesterday i didn't have a time ... | 09:16 |
| kevko | but what about rabbitmq ? | 09:16 |
| SvenKieske | oh a debian dev as well, nice. | 09:16 |
| kevko | ;-) | 09:16 |
| SvenKieske | the repo situation is really not great :( | 09:17 |
| mmalchuk | kevko I remember, you said in private chat) so "the one who I know" is you) | 09:17 |
| kevko | i used to build all deb packages and upload to debian ... and that was very good when kolla supported builds with deb packages ... | 09:17 |
| kevko | it was super easy to patch bugs ...for now it is unnecessary | 09:18 |
| mmalchuk | remember... but the time passed and we don't have binary images) | 09:19 |
| kevko | i know :D | 09:19 |
| mmalchuk | lets solve issue with rabbitmq | 09:19 |
| kevko | well, 25 erlang is missing .. | 09:19 |
| mmalchuk | can you help with? | 09:19 |
| kevko | yeah .. | 09:19 |
| mmalchuk | why it absent? | 09:20 |
| kevko | there is only two options how to fix | 09:20 |
| kevko | contact ppa.launchpad rabbitmq maintainers and ask him to reupload 25 erlang | 09:20 |
| kevko | or bump erlang and rabbitmq (currently failing for upgrade jobs ) .... | 09:20 |
| kevko | or switch erlang repository to something different where erlang 25 is | 09:20 |
| kevko | it can be also mistake from their side - i don't know | 09:21 |
| mmalchuk | i'm ok for bump, beacause we can't move to github | 09:21 |
| kevko | but we need erlang-base_25.3.2.2-1rmq1ppa1~ubuntu18.04.1_arm64.deb << but for 20.04 and 22.04 ....etc etc etc | 09:22 |
| kevko | btw, only ubuntu is failing ? | 09:22 |
| kevko | or everything ? | 09:22 |
| mmalchuk | debian afik too | 09:22 |
| mmalchuk | but maybe I'm wrong | 09:22 |
| SvenKieske | shouldn't all deb based stuff fail? we do have the same sources configured, no? <- this might be totally wrong | 09:23 |
| mmalchuk | lets see repos.yaml | 09:24 |
| mmalchuk | debian also uses https://ppa.launchpadcontent.net/rabbitmq/rabbitmq-erlang/ubuntu | 09:25 |
| mmalchuk | so both ubunt/debian failed | 09:26 |
| hrw | yay for 3rdparty repos | 09:31 |
| opendevreview | Merged openstack/kolla-ansible stable/zed: Fix passwords.yml permissions https://review.opendev.org/c/openstack/kolla-ansible/+/885868 | 09:32 |
| opendevreview | Merged openstack/kolla-ansible stable/yoga: Fix passwords.yml permissions https://review.opendev.org/c/openstack/kolla-ansible/+/885869 | 09:32 |
| opendevreview | Merged openstack/kolla-ansible stable/2023.1: Fix passwords.yml permissions https://review.opendev.org/c/openstack/kolla-ansible/+/885867 | 09:32 |
| kevko | this works https://github.com/rabbitmq/erlang-debian-package << it's based on official deb packaging from salsa | 09:34 |
| kevko | verified yesterday | 09:34 |
| ramona-beermann[m] | You need to add the official Repos of Erlang and RabbitMQ than it works. | 09:34 |
| hrw | ramona-beermann[m]: on aarch64 too? | 09:34 |
| mmalchuk | kevko it don't contain arm | 09:34 |
| ramona-beermann[m] | We only use x86_64 | 09:35 |
| hrw | ramona-beermann[m]: you maybe. project supports both archs | 09:35 |
| mmalchuk | cool. let switch? | 09:35 |
| kevko | and what about build all just for this version and host somewhere ? :/ | 09:35 |
| hrw | kevko: feel free | 09:36 |
| kevko | well, i can build it ...but not for aarch64 | 09:36 |
| hrw | kevko: then what's the point? | 09:37 |
| ramona-beermann[m] | But feel free to test it with my solution on arch64. I dont have the ability to test it. https://github.com/osism/container-images-kolla/pull/310 | 09:37 |
| kevko | hrw: for now i don't have a time ..but hope i will find some during the day ...for now i 've sent an email to rabbitmq maintainers with question to repload erlang 25* for other ubuntu versions not only for 18.04 as it is now | 09:42 |
| SvenKieske | that github says: "For every [Erlang] release series, only the latest minor series is supported." | 09:44 |
| SvenKieske | I mean this link: https://github.com/rabbitmq/erlang-debian-package | 09:45 |
| SvenKieske | so, this would still be a problem if we want to pin a specific patch level, afaik this was done in the past, sometimes. | 09:45 |
| * SvenKieske is thinking about the meaning of "supported" here. | 09:46 | |
| SvenKieske | kevko: I see you already mailed the repo maintainers, thanks! | 09:50 |
| guesswhat[m] | Any idea how to setup Octavia in All-in-one setup, there is requirement for another interface for Octavia Controller | 09:50 |
| SvenKieske | guesswhat: build a virtual bridge with maybe a dummy interface? not sure if that works in all-in-one setup | 09:51 |
| mmalchuk | guesswhat[m] dummy interface didn't help? | 09:51 |
| hrw | ramona-beermann[m]: use base_apt_keys/base_remote_apt_keys instead of fetching repo keys using curl directly | 09:53 |
| opendevreview | Merged openstack/kolla-ansible stable/xena: Fix passwords.yml permissions https://review.opendev.org/c/openstack/kolla-ansible/+/885870 | 09:54 |
| kevko | ()[root@builder /]# apt-cache policy erlang-base | 09:57 |
| kevko | erlang-base: | 09:57 |
| kevko | Installed: 1:25.3.2.2-1 | 09:57 |
| kevko | Candidate: 1:25.3.2.2-1 | 09:57 |
| kevko | Version table: | 09:57 |
| kevko | 1:26.0.1-1rmq1ppa1~ubuntu22.04.1 500 | 09:57 |
| kevko | 500 https://ppa.launchpadcontent.net/rabbitmq/rabbitmq-erlang/ubuntu jammy/main amd64 Packages | 09:57 |
| kevko | 1:26.0.1-1 500 | 09:57 |
| kevko | 500 https://ppa1.novemberain.com/rabbitmq/rabbitmq-erlang/deb/ubuntu jammy/main amd64 Packages | 09:57 |
| kevko | *** 1:25.3.2.2-1 1000 | 09:57 |
| kevko | 500 https://ppa1.novemberain.com/rabbitmq/rabbitmq-erlang/deb/ubuntu jammy/main amd64 Packages | 09:57 |
| kevko | 100 /var/lib/dpkg/status | 09:57 |
| kevko | 1:25.3.2.1-1 1000 | 09:57 |
| kevko | 500 https://ppa1.novemberain.com/rabbitmq/rabbitmq-erlang/deb/ubuntu jammy/main amd64 Packages | 09:57 |
| kevko | 1:25.3.2-1 1000 | 09:57 |
| kevko | 500 https://ppa1.novemberain.com/rabbitmq/rabbitmq-erlang/deb/ubuntu jammy/main amd64 Packages | 09:57 |
| kevko | 1:25.2.3-1 1000 | 09:57 |
| kevko | 500 https://ppa1.novemberain.com/rabbitmq/rabbitmq-erlang/deb/ubuntu jammy/main amd64 Packages | 09:57 |
| kevko | 1:25.1.2-1 1000 | 09:57 |
| kevko | 500 https://ppa1.novemberain.com/rabbitmq/rabbitmq-erlang/deb/ubuntu jammy/main amd64 Packages | 09:57 |
| kevko | 1:25.0.4-1 1000 | 09:57 |
| kevko | 500 https://ppa1.novemberain.com/rabbitmq/rabbitmq-erlang/deb/ubuntu jammy/main amd64 Packages | 09:57 |
| kevko | 1:24.3.4.12-1 500 | 09:57 |
| kevko | 500 https://ppa1.novemberain.com/rabbitmq/rabbitmq-erlang/deb/ubuntu jammy/main amd64 Packages | 09:57 |
| kevko | 1:24.3.4.11-1 500 | 09:57 |
| kevko | 500 https://ppa1.novemberain.com/rabbitmq/rabbitmq-erlang/deb/ubuntu jammy/main amd64 Packages | 09:57 |
| kevko | 1:24.3.4.10-1 500 | 09:57 |
| kevko | 500 https://ppa1.novemberain.com/rabbitmq/rabbitmq-erlang/deb/ubuntu jammy/main amd64 Packages | 09:57 |
| kevko | 1:24.2.1+dfsg-1ubuntu0.1 500 | 09:57 |
| kevko | 500 mirror://mirrors.ubuntu.com/mirrors.txt jammy-updates/main amd64 Packages | 09:57 |
| kevko | 500 mirror://mirrors.ubuntu.com/mirrors.txt jammy-security/main amd64 Packages | 09:57 |
| kevko | 1:24.2.1+dfsg-1 500 | 09:57 |
| kevko | 500 mirror://mirrors.ubuntu.com/mirrors.txt jammy/main amd64 Packages | 09:57 |
| guesswhat[m] | mmalchuk, SvenKieske: that would be the solution, thanks | 09:58 |
| hrw | ramona-beermann[m]: and your solution is x86-64 only: | 09:58 |
| hrw | Err:6 https://ppa1.novemberain.com/rabbitmq/rabbitmq-server/deb/ubuntu jammy/main arm64 Packages | 09:58 |
| hrw | 404 Not Found [IP: 172.67.140.63 443] | 09:58 |
| guesswhat[m] | Btw, do I need still two network interfaces for all-in-one setup ? | 09:59 |
| hrw | erlang/rabbitmq was always PITA. | 10:04 |
| kevko | hrw why we are not using distro stable packages ? | 10:08 |
| kevko | a round, flat Middle Eastern bread that is often filled with meat, peppers, etc., to make a sandwich also called pita bread | 10:09 |
| hrw | kevko: also 'Pain In The Ass' when written in capital letters. | 10:16 |
| hrw | kevko: because they are at different version in each distro? | 10:16 |
| opendevreview | Michal Arbet proposed openstack/kolla master: Fix rabbitmq image build https://review.opendev.org/c/openstack/kolla/+/886074 | 10:16 |
| opendevreview | Michal Arbet proposed openstack/kolla master: Fix rabbitmq image build https://review.opendev.org/c/openstack/kolla/+/885857 | 10:17 |
| kevko | ^^ hrw, let's see ... | 10:18 |
| hrw | Err:6 https://ppa1.novemberain.com/rabbitmq/rabbitmq-server/deb/ubuntu jammy/main arm64 Packages11:58 < hrw> Err:6 https://ppa1.novemberain.com/rabbitmq/rabbitmq-server/deb/ubuntu jammy/main arm64 Packages | 10:18 |
| kevko | but i am afreaid that aarch64 will be missing .. | 10:18 |
| hrw | 11:58 < hrw> 404 Not Found [IP: 172.67.140.63 443] | 10:18 |
| hrw | already checked | 10:18 |
| kevko | a :( | 10:18 |
| kevko | can u build it separately ? | 10:18 |
| hrw | no | 10:19 |
| kevko | i don't have a machine for build it | 10:19 |
| hrw | kevko: create ppa? | 10:19 |
| kevko | never done before :P | 10:20 |
| kevko | you've build before ... | 10:21 |
| kevko | # erlang repo - aarch64 only | 10:21 |
| kevko | #deb https://obs.linaro.org/repos/home:/marcin.juszkiewicz/debian-buster ./ | 10:21 |
| hrw | kevko: that was ages ago | 10:22 |
| kevko | i know :D | 10:22 |
| hrw | and we scrapped obs.linaro.org long time ago | 10:22 |
| opendevreview | Maksim Malchuk proposed openstack/kolla master: Fix Venus containers built from correct branch https://review.opendev.org/c/openstack/kolla/+/885967 | 10:22 |
| hrw | kevko: reviewed your change | 10:31 |
| hrw | bookworm enablement does not look that bad: | 11:00 |
| hrw | ERROR:kolla.common.utils:fluentd Failed with status: error | 11:00 |
| hrw | ERROR:kolla.common.utils:influxdb Failed with status: error | 11:00 |
| hrw | ERROR:kolla.common.utils:mariadb-base Failed with status: error | 11:00 |
| hrw | ERROR:kolla.common.utils:mariadb-clustercheck Failed with status: matched | 11:00 |
| hrw | ERROR:kolla.common.utils:mariadb-server Failed with status: matched | 11:00 |
| hrw | ERROR:kolla.common.utils:neutron-mlnx-agent Failed with status: error | 11:00 |
| hrw | ERROR:kolla.common.utils:openvswitch-netcontrold Failed with status: error | 11:00 |
| hrw | ERROR:kolla.common.utils:proxysql Failed with status: error | 11:00 |
| hrw | ERROR:kolla.common.utils:telegraf Failed with status: error | 11:00 |
| hrw | will take some time as fluentd, mariadb, erlang need to be built against openssl 3 | 11:04 |
| frickler | can you all please go back to using paste.o.o for multiline things? | 11:08 |
| kevko8 | paste.o.o ? | 11:08 |
| hrw | ack | 11:08 |
| kevko8 | what is it | 11:09 |
| frickler | opendev.org or openstack.org. it's the standard way of posting longer texts in openstack channels | 11:09 |
| kevko8 | aaa ..ok | 11:09 |
| *** kevko8 is now known as kevko | 11:10 | |
| kevko | ack | 11:10 |
| hrw | fluentd can be solved by use of ubuntu/jammy package | 11:29 |
| guesswhat[m] | Any idea if possible to use cpu_mode=host-passthrough via propery in openstack flavor create API ? I want to enable nested virtualization per Guest, not globaly for KVM host. Thanks | 11:30 |
| hrw | same with influxdb | 11:30 |
| hrw | guesswhat[m]: iirc it is global in nova | 11:31 |
| mmalchuk | guesswhat[m] this is part of the libvirt configuration, it can't be per guest, only per host. | 11:32 |
| mmalchuk | guesswhat[m] https://docs.openstack.org/nova/latest/admin/configuration/hypervisor-kvm.html#nova-configuration | 11:34 |
| hrw | mnasiadka: https://etherpad.opendev.org/p/kolla-bobcat-ptg#L199 updated to cover how things are with move to Debian bookworm (on kolla side) | 11:36 |
| hrw | anyway kolla cannot move to bookworm due to CI being totally not ready for it | 11:37 |
| guesswhat[m] | hrw mmalchuk ty, I saw docs, but should be possible to override Libvirt XML per guest, but that proly not the possible via property arg in flavour api | 11:45 |
| opendevreview | Marcin Juszkiewicz proposed openstack/kolla master: Revert "neutron-mlnx-agent: pin pyzmq at 21.*" https://review.opendev.org/c/openstack/kolla/+/882051 | 11:45 |
| hrw | rebased | 11:46 |
| mmalchuk | not possible in nova | 11:46 |
| mmalchuk | guesswhat[m] | 11:46 |
| guesswhat[m] | mmalchuk: but I can probably enable it, create guest, disable it, right ? | 11:48 |
| hrw | folks: was Kolla Antelope released already or not yet? | 11:49 |
| hrw | stable/2023.1 exists so I assume 'yes' | 11:50 |
| mmalchuk | guesswhat[m] manually sure. you can always edit the xml for any domain, but this information can be lost | 11:51 |
| guesswhat[m] | mmalchuk: like overridden by some "process" ? | 11:52 |
| mmalchuk | guesswhat[m] anyway to allow some guest to use nested virtualisation you should enable it in the kernel - this is global per host anyway) | 11:52 |
| guesswhat[m] | yes, I know | 11:53 |
| mmalchuk | guesswhat[m] like 'virsh edit-xml ...' | 11:53 |
| opendevreview | Marcin Juszkiewicz proposed openstack/kolla master: base: switch to new Grafana key https://review.opendev.org/c/openstack/kolla/+/886086 | 12:03 |
| opendevreview | Marcin Juszkiewicz proposed openstack/kolla master: Revert "neutron-mlnx-agent: pin pyzmq at 21.*" https://review.opendev.org/c/openstack/kolla/+/882051 | 12:07 |
| opendevreview | Marcin Juszkiewicz proposed openstack/kolla master: base: install adduser on Debian/Ubuntu https://review.opendev.org/c/openstack/kolla/+/881948 | 12:07 |
| opendevreview | Marcin Juszkiewicz proposed openstack/kolla master: base: Debian 12 uses new APT sources file https://review.opendev.org/c/openstack/kolla/+/881950 | 12:07 |
| opendevreview | Marcin Juszkiewicz proposed openstack/kolla master: config: switch OpenStack release back to master https://review.opendev.org/c/openstack/kolla/+/886087 | 12:07 |
| opendevreview | Marcin Juszkiewicz proposed openstack/kolla master: WIP: Move to Debian 12 'bookworm' https://review.opendev.org/c/openstack/kolla/+/886088 | 12:07 |
| hrw | with https://review.opendev.org/c/openstack/kolla/+/885857/2 on top it builds quite nice | 12:08 |
| hrw | still not ready but closer | 12:09 |
| mmalchuk | hrw thanks for https://review.opendev.org/c/openstack/kolla/+/886087 | 12:36 |
| mmalchuk | folks +RP ^ this should be landed asap | 12:36 |
| hrw | mmalchuk: without it https://review.opendev.org/c/openstack/kolla/+/882051 does not make sense ;d | 12:36 |
| hrw | mmalchuk: bumped RP | 12:37 |
| mmalchuk | hrw it make sense for Venus at least) | 12:37 |
| mmalchuk | anyway thanks | 12:37 |
| mmalchuk | hrw kolla CI all red, all your changes wouldn't pass | 12:48 |
| mmalchuk | also, we have many node_failures in arm64 jobs | 12:50 |
| SvenKieske | anyone: about PTG; I find it very hard to follow what's going on when. the etherpad links for the "schedule" of the ptg to https://ptg.opendev.org/ptg.html, but I don't find anything there regarding kolla? can't the dates maybe also be added just as plaintext to the etherpad, if dates exists? how can one participate remotely (is it even possible)? just reading up on the etherpad, a lot of text.. | 12:54 |
| hrw | mmalchuk: those changes would not pass CI anyway as CI lacks bookworm mirrors etc. | 12:54 |
| mmalchuk | sad | 12:55 |
| kevko | anyone for +2 here > https://review.opendev.org/c/openstack/kolla-ansible/+/877413 | 12:56 |
| bbezak | kolla meeting in 5 mgoddard mnasiadka hrw bbezak frickler kevko SvenKieske mmalchuk | 12:56 |
| hrw | mmalchuk: live. CI mirrors are ~full | 12:56 |
| SvenKieske | yeah, something is wrong with CI in general it seems? the promote pipelines of the password fixes errored, e.g. https://review.opendev.org/c/openstack/kolla-ansible/+/885867 | 12:56 |
| hrw | s/live/life/ | 12:56 |
| mmalchuk | kevko i'll give you virtual +2 | 12:57 |
| hrw | SvenKieske: iirc PTG was in March... | 12:58 |
| SvenKieske | there's IO errors in rsync: https://zuul.opendev.org/t/openstack/build/e804ca9b01f24a4ca7e1d7edb3e96fb3/log/job-output.txt | 12:58 |
| SvenKieske | ah, that was before I switched employment. but still, I feel links to schedules should just work, especially for past events, as they don't tend to change. | 12:59 |
| frickler | there's a "PTG" ongoing at the summit in vancouver. kolla doesn't participate there. it is an in-person event, remote access is not being cared about | 13:00 |
| bbezak | #startmeeting kolla | 13:00 |
| opendevmeet | Meeting started Wed Jun 14 13:00:24 2023 UTC and is due to finish in 60 minutes. The chair is bbezak. Information about MeetBot at http://wiki.debian.org/MeetBot. | 13:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 13:00 |
| opendevmeet | The meeting name has been set to 'kolla' | 13:00 |
| bbezak | #topic rollcall | 13:00 |
| mmalchuk | \o | 13:00 |
| mattcrees | o/ | 13:00 |
| SvenKieske | o/ | 13:00 |
| kevko | gre\o/ | 13:00 |
| frickler | and /me is surprised, I'd assumed we'd skip this one, too. but well, I'm here | 13:00 |
| bbezak | I recon we can chat about pressing issues, even when some of us are in vancouver sleeping :) | 13:01 |
| mmalchuk | frickler only mnasiadka skip this meeting as he said | 13:01 |
| hrw | \~o~\ | 13:01 |
| bbezak | #topic agenda | 13:02 |
| bbezak | * Roll-call | 13:02 |
| bbezak | * Agenda | 13:02 |
| bbezak | * Announcements | 13:02 |
| bbezak | * Review action items from the last meeting | 13:02 |
| bbezak | * CI status | 13:02 |
| bbezak | * Release tasks | 13:02 |
| bbezak | * Regular stable releases (first meeting in a month) | 13:02 |
| bbezak | * Current cycle planning | 13:02 |
| bbezak | * Additional agenda (from whiteboard) | 13:02 |
| bbezak | * Open discussion | 13:02 |
| bbezak | I don't have much too say about announcements and review actions items from the last meeting | 13:04 |
| bbezak | let's go to the CI status then | 13:04 |
| bbezak | #topic CI status | 13:04 |
| mmalchuk | red | 13:04 |
| mmalchuk | rabbitmq issue the main thing | 13:05 |
| hrw | just do upgrade to 3.12/26 | 13:05 |
| mmalchuk | +1 | 13:05 |
| frickler | 3.12.0? very courageous | 13:05 |
| SvenKieske | as said above, there seem to be new IO issues, see e.g. https://zuul.opendev.org/t/openstack/build/e804ca9b01f24a4ca7e1d7edb3e96fb3/log/job-output.txt | 13:05 |
| mmalchuk | frickler why? | 13:05 |
| frickler | and not very feasible for stable branches | 13:05 |
| frickler | because .0 is like "alpha" release | 13:06 |
| mmalchuk | tommorow it would be .1 | 13:06 |
| hrw | frickler: that's why master first? | 13:06 |
| mmalchuk | lets pin .* | 13:06 |
| hrw | rabbitmq/erlang was always a problem | 13:07 |
| frickler | so maybe for master, ok, but that doesn't handle stable branches and upgrade tests | 13:07 |
| bbezak | yeah, surely stable branches cannot go with 3.12.0 | 13:08 |
| mmalchuk | as mnasiadka said we a firefighters) so wi will fix it again and again | 13:08 |
| kevko | Arnaud Cogoluègnes replied regarding rabbitmq | 13:08 |
| hrw | I do not have hours assigned to kolla anymore so will ignore rmq this time | 13:08 |
| hrw | kevko: url? | 13:08 |
| SvenKieske | sure, there are, especially for upgrades, quite some preconditions mentioned in the 3.12 release notes, before you can upgrade from 3.11; don't know if we meet them | 13:08 |
| frickler | probably in moderation still | 13:09 |
| kevko | it is not in mail archive ..but check openstack discuss ..he is suggesting to switch to cloudsmith ..i am preparing email that we already replaced this repo | 13:09 |
| frickler | so what about arm then? | 13:09 |
| mmalchuk | postpone ? | 13:10 |
| hrw | sometimes I wonder when kolla team get tired enough and remove whole aarch64 support and then start cutting distros | 13:10 |
| mmalchuk | fix x86_64 first? | 13:10 |
| bbezak | SvenKieske: those IO issues looks like zuul issues, maybe it is a case for #opendev channel ? | 13:10 |
| kevko | hrw: +1 :D | 13:10 |
| mmalchuk | +1 lol | 13:10 |
| SvenKieske | bbezak: yeah, was wondering the same; I'll post them there | 13:11 |
| bbezak | SvenKieske: thx | 13:11 |
| * SvenKieske has the impression that there simply does not exist a stable, available mirror for all past erlang/rmq releases, regardless the architecture. | 13:13 | |
| bbezak | that would a bummer :) | 13:14 |
| mmalchuk | it exists but lack of aarch64 | 13:14 |
| bbezak | and a bit crazy | 13:14 |
| hrw | SvenKieske: exactly | 13:14 |
| mmalchuk | #opendev sleeps with vancouver) | 13:15 |
| SvenKieske | mmalchuk: I dunno, I mean we get the suggestion to use cloudsmith, but we just disabled that because it was broken, no? where is that magic mirror that doesn't remove past patch releases ? | 13:15 |
| opendevreview | Michal Arbet proposed openstack/kolla master: Bump proxysql version https://review.opendev.org/c/openstack/kolla/+/886093 | 13:15 |
| mmalchuk | SvenKieske we have many suggestions but not choose right) | 13:16 |
| hrw | SvenKieske: we have 3 distros and two architectures. and 5-6 distro versions. | 13:17 |
| frickler | so the only solution: build erlang+rmq from source within a container? | 13:17 |
| hrw | SvenKieske: covering it for rmq/erlang is painful | 13:17 |
| SvenKieske | so, fix x86_64 first, or what? fine with me; afaik I don't know of any arm prod systems, but that doesn't mean a lot. | 13:17 |
| kevko | https://review.opendev.org/c/openstack/kolla/+/885857 | 13:17 |
| SvenKieske | hrw: sure; I know :) | 13:17 |
| mmalchuk | frickler built from source? kidding? | 13:18 |
| * hrw off - other duties | 13:18 | |
| bbezak | somebody contacted ppa admins? | 13:18 |
| kevko | me | 13:18 |
| bbezak | thx hrw | 13:18 |
| SvenKieske | frickler: that sounds at least somewhat viable, though I never build anything in the erlang space. | 13:18 |
| kevko | but mail not archived because of message size ... probably my picture of company in footer ? :/ | 13:18 |
| mmalchuk | lets drop the arm and one problem solved | 13:19 |
| SvenKieske | the less nuclear option maybe would be to contact ppa admins and ask if we can help maintain that. as I understood it was "just" a matter of a package being dropped. co maintaining is certainly less a burden than rebuilding everything ourselves? | 13:20 |
| kevko | https://paste.openstack.org/show/bUaFtanAO13OvMm8O79Q/ << communication | 13:20 |
| bbezak | pretty big decision for that meeting I'd say :), let's not rush it and drop support for now | 13:20 |
| kevko | SvenKieske do you have arm64 hosts to build ? | 13:20 |
| bbezak | so according to them everything is fine? kevko | 13:21 |
| bbezak | "network glitch" | 13:21 |
| bbezak | https://cloudsmith.io/~rabbitmq/repos/rabbitmq-erlang/packages/?q=distribution%3Aubuntu+AND+distribution%3Ajammy+AND+version%3A1%3A25*+AND+name%3A%27%5Eerlang-base%24%27 | 13:21 |
| SvenKieske | I mean when I look at the link posted by bbezak everything looks fine? did someone retry the download? | 13:22 |
| SvenKieske | maybe that stuff was affected by the aws us-east-1 outage yesterday(?) | 13:22 |
| SvenKieske | dunno where cloudsmith hosts | 13:22 |
| kevko | we are using ppa.launchpad.net because armd64 ...but they removed 25* ..so there is only 26* ... when you switch to cloudsmith ...it's ok ...but no support for arm64 | 13:22 |
| SvenKieske | kevko: ah thanks for correcting me; I mixed those repos up (we switch too often :D ) | 13:23 |
| mmalchuk | lets vote for temp swtitch to cloudsmith? until we fix arm | 13:23 |
| SvenKieske | sounds reasonable from my newbie perspective *shrugs* | 13:24 |
| kevko | Launchpad PPA only provides the most recent release of Erlang 25.3.x. Cloudsmith and its mirror currently provides the most recent patch release in the following Erlang series: | 13:24 |
| kevko | https://www.rabbitmq.com/install-debian.html#apt-launchpad-erlang | 13:25 |
| kevko | we definitely remove and replace ppa repository | 13:25 |
| kevko | because it looks like ppa.launchpad.net only maintain latest erlang versions | 13:26 |
| SvenKieske | "The Cloudsmith repository has a monthly traffic quota that can be exhausted" | 13:26 |
| SvenKieske | https://www.rabbitmq.com/install-debian.html#apt-cloudsmith | 13:26 |
| mmalchuk | IMHO Cloudsmith is the best place. then we can talk how to build/sync arm repos and add it later | 13:26 |
| kevko | that's the reason why i used the mirros ... | 13:26 |
| kevko | The Cloudsmith repository has a monthly traffic quota that can be exhausted. For this reason, examples below use a Cloudsmith repository mirror. All packages in the mirror repository are signed using the same signing key. | 13:26 |
| kevko | in my patch | 13:27 |
| kevko | ppa1.novemberain.com | 13:27 |
| SvenKieske | yeah, sounds also reasonable | 13:27 |
| kevko | https://review.opendev.org/c/openstack/kolla/+/885857 | 13:27 |
| mmalchuk | +1 | 13:27 |
| kevko | The logs above mentioned both Cloudsmith and PPA, use one or the other, not both. | 13:28 |
| kevko | PPA makes only the latest built version available, in this case, 26.0. This is something we don't control with PPA. | 13:28 |
| kevko | ^^ he replied 6 minutes ago | 13:28 |
| mmalchuk | no matter wich repo, I mean Cloudsmith - lest be a mirror | 13:28 |
| bbezak | so cloudsmith looks better in that regard surely | 13:29 |
| kevko | yep | 13:30 |
| bbezak | tough case indeed. In any case I would rather have fixed stable branches for x86 for now. master can use 26. On the other hand divergence between master and stable branches is not wise in the longer run | 13:31 |
| mmalchuk | as I understand we don't want 26 | 13:32 |
| mmalchuk | even master use 25 from cloudsmith mirror | 13:32 |
| bbezak | not in stable branches, until it is proven to be stable and working upgrade | 13:33 |
| kevko | we should use cloudsmith for amd64 and something different for amr64 | 13:33 |
| kevko | what about this http://binaries.erlang-solutions.com/debian/dists/bullseye/contrib/binary-arm64/Packages | 13:34 |
| bbezak | looks like it is a way to go | 13:34 |
| kevko | this should work | 13:34 |
| bbezak | no jammy arm there? | 13:35 |
| kevko | nope | 13:35 |
| mmalchuk | debian only | 13:36 |
| mmalchuk | http://binaries.erlang-solutions.com/ubuntu/dists/jammy/ | 13:36 |
| mmalchuk | empty | 13:36 |
| bbezak | debian: | 13:37 |
| bbezak | erlang: | 13:37 |
| bbezak | url: "https://ppa.launchpadcontent.net/rabbitmq/rabbitmq-erlang/ubuntu" | 13:37 |
| bbezak | suite: "focal" | 13:37 |
| bbezak | component: "main" | 13:37 |
| bbezak | gpg_key: "erlang-ppa.gpg" | 13:37 |
| bbezak | that is current setting | 13:37 |
| SvenKieske | maybe the debian packages "Just work" on jammy? (who am I kidding, but one can hope) | 13:37 |
| kevko | hmm we can use debian repo ...but worse is that yammy is based on bookworm if i am correct and bookworm is missing | 13:37 |
| bbezak | exactly my point | 13:37 |
| bbezak | :) | 13:37 |
| bbezak | can you test it kevko ? | 13:37 |
| bbezak | in change that is | 13:37 |
| kevko | in past hrw built and hosted erlang on his server ..but he already dropped ... | 13:38 |
| kevko | maybe we can ask him to build again ? :P | 13:38 |
| kevko | well, i don't have arm host ..so i can't :D | 13:39 |
| kevko | *can't test | 13:39 |
| bbezak | I mean those erlang-solutions.com | 13:39 |
| bbezak | binaries | 13:39 |
| kevko | i don't have arm64 | 13:39 |
| bbezak | well I guess in CI it is fine | 13:39 |
| kevko | which job is for arm64 ? | 13:40 |
| bbezak | kolla-build-ubuntu-aarch64 | 13:41 |
| bbezak | kolla-build-debian-aarch64, | 13:42 |
| bbezak | and then kolla-ansible-debian-aarch64 | 13:42 |
| bbezak | it has failed in your change | 13:42 |
| kevko | https://paste.openstack.org/show/b3mRNUqQi2BVfjRTUhs9/ | 13:42 |
| bbezak | yeap | 13:42 |
| kevko | yeah i know :D | 13:42 |
| bbezak | :) | 13:42 |
| bbezak | ok I think we have something to test on. Use stable 25 1.11 from Cloudsmith for amd64, and try maybe those erlang-solutions for arm in the meantime if possible | 13:44 |
| bbezak | ok, let's move on. we can continue this discussion on IRC and in the change | 13:44 |
| bbezak | if that's ok for you | 13:45 |
| frickler | +1 | 13:45 |
| SvenKieske | +1 | 13:45 |
| bbezak | #topic Release tasks | 13:45 |
| bbezak | we need to do switchover master branch from antelope, I saw some changes from hrw. I'll try to look into that later this week if nobody have a time to do so | 13:46 |
| mmalchuk | lets merge https://review.opendev.org/c/openstack/kolla/+/886087 | 13:47 |
| mmalchuk | it has +2 | 13:47 |
| mmalchuk | no matter that CI failed so) | 13:48 |
| kevko | well, i thought that it will pass and second +2 is needed | 13:48 |
| frickler | what about the rocky failure? is that also from rmq repo? | 13:48 |
| kevko | i will reset my voe | 13:48 |
| bbezak | it is bifrost | 13:49 |
| bbezak | that failed in rocky | 13:49 |
| kevko | frickler: rocky repo should use different repo for erlang ..but didn't check ..ppa is used only for debubtu | 13:49 |
| frickler | so more CI issues | 13:49 |
| bbezak | hurray | 13:49 |
| frickler | epel install failure | 13:50 |
| frickler | https://ef634d1e9a5ddf8bf39c-29c48a4a553d1a0c965532e3378dd6a0.ssl.cf1.rackcdn.com/886087/1/check/kolla-build-rocky9/17bbc7d/kolla/build/000_FAILED_bifrost-base.log | 13:50 |
| frickler | might just be unstable? | 13:50 |
| bbezak | it might, gpg error | 13:50 |
| bbezak | let's recheck it then, let's see | 13:51 |
| bbezak | ok, let's go further | 13:51 |
| bbezak | #topic Current cycle planning | 13:52 |
| bbezak | I assume bookworm, that hrw is working on | 13:52 |
| bbezak | anyone has a case to discuss within this topic? | 13:54 |
| kevko | nope, i will follow hrw changes and will help if it will be needed | 13:54 |
| bbezak | thx kevko | 13:54 |
| bbezak | #topic Open discussion | 13:54 |
| mmalchuk | please review and merge backports: https://review.opendev.org/q/topic:fix-cyborg-service | 13:54 |
| bbezak | will do mmalchuk | 13:55 |
| mmalchuk | and there lack of Kayobe reviews again | 13:55 |
| mmalchuk | https://review.opendev.org/c/openstack/kayobe/+/879554?usp=search | 13:55 |
| mmalchuk | https://review.opendev.org/c/openstack/kayobe/+/861397?usp=search | 13:55 |
| mmalchuk | please these two at least | 13:55 |
| bbezak | will try to look into that | 13:56 |
| kevko | bbezak i've added you as reviewer for my patch ..can u check ? https://review.opendev.org/c/openstack/kolla-ansible/+/877413 | 13:56 |
| bbezak | sure | 13:56 |
| mmalchuk | regarding https://bugs.launchpad.net/kolla-ansible/+bug/1965111 | 13:57 |
| mmalchuk | should we backport? | 13:57 |
| mmalchuk | y, x, w | 13:57 |
| mmalchuk | IMHO we need to | 13:58 |
| bbezak | if it's not breaking anything I don't think it is an issue | 13:58 |
| mmalchuk | maybe you right | 13:59 |
| kevko | i think this is not breaking anything | 13:59 |
| mmalchuk | but it can be cacouse service_name==service_type in most cases | 13:59 |
| mmalchuk | but if we face the issue like Cyborg? | 13:59 |
| SvenKieske | I can maybe at least review some of that stuff, as we either way wanted to add more service token stuff in light of the last cve. | 13:59 |
| mmalchuk | service tokens - the different problem | 14:00 |
| mmalchuk | this is about access rules | 14:01 |
| opendevreview | Michal Arbet proposed openstack/kolla master: Bump proxysql version https://review.opendev.org/c/openstack/kolla/+/886093 | 14:01 |
| SvenKieske | ah okay, I just skimmed it | 14:01 |
| bbezak | if you feel that it is a big problem just propose backports, if it is not breaking current deployments | 14:02 |
| bbezak | ok I think we can conclude for today, thx for joining and good talk | 14:02 |
| bbezak | #endmeeting | 14:02 |
| opendevmeet | Meeting ended Wed Jun 14 14:02:55 2023 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:02 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/kolla/2023/kolla.2023-06-14-13.00.html | 14:02 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/kolla/2023/kolla.2023-06-14-13.00.txt | 14:02 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/kolla/2023/kolla.2023-06-14-13.00.log.html | 14:02 |
| mmalchuk | thanks bbezak | 14:03 |
| frickler | o/ | 14:04 |
| mmalchuk | kevko see https://review.opendev.org/c/openstack/kolla/+/885967 kolla-ansible-debian-upgrade passed | 14:04 |
| mmalchuk | my patch шт кудфtion chan with yours | 14:05 |
| hrw | kevko: getting bookworm ready would involve: CI mirrors, Zuul jobs (base and kolla ones), CI Wheels cache. | 14:05 |
| mmalchuk | my patch in relation chain with yours | 14:05 |
| hrw | kevko: and this means discussions with #opendev infra folks. Which I wont do this time | 14:06 |
| kevko | i suppose because you don't have time, have you ? | 14:07 |
| mmalchuk | they said kafs - what is it? | 14:08 |
| hrw | kevko: someone else in kolla needs to learn that stuff | 14:08 |
| mmalchuk | kolla ansible file system ? | 14:08 |
| kevko | hrw: where is the teacher ? :P | 14:09 |
| hrw | kevko: in 'git log' | 14:09 |
| mmalchuk | lol | 14:09 |
| hrw | kevko: and in gerrit | 14:09 |
| hrw | kevko: Mr Gerrit would be your primary teacher even | 14:09 |
| kevko | i can try it ...give me few keywords to find | 14:09 |
| kevko | bullseye for example ? | 14:09 |
| hrw | kevko: yeah. and https://review.opendev.org/c/opendev/system-config/+/881952 | 14:10 |
| kevko | okay | 14:11 |
| * kevko is going, bye bye | 14:19 | |
| greatgatsby | I think some of the meeting that just occurred was reference a rabbitmq bug that seems to be in the most recent yoga image? We've hit this in our cluster, and I'm wondering if there's any recommendations right now? | 14:22 |
| kevko | greatgatsby: check history of discussion | 14:23 |
| SvenKieske | hrw: maybe I can learn that stuff, at least we have afaik some interest in more debian support (looking at frickler) | 14:25 |
| greatgatsby | kevko: I followed all the discussion regarding how openstack-kolla will build/create rabbitmq images going forward, but don't see anything specific to this current bug. Does that mean rabbitmq is simply broken until a new image yoga/latest image is released? | 14:25 |
| greatgatsby | thanks for any suggestions, much appreciated | 14:25 |
| kevko | debian 4ever | 14:26 |
| kevko | greatgatsby: did you check this ? | 14:26 |
| kevko | https://review.opendev.org/c/openstack/kolla/+/885857 | 14:26 |
| kevko | greatgatsby: build your own rabbitmq with this patch ..but this is not solution for arm64 | 14:27 |
| greatgatsby | kevko: thanks a lot! | 14:27 |
| SvenKieske | kevko: I'm not sure you and greatgatsby are really talking about the same bug.. | 14:33 |
| greatgatsby | yeah sorry, we're facing an issue where rabbitmq is crashes on startup | 14:35 |
| SvenKieske | greatgatsby: can you post the crash output somewhere? I have an idea that it might be already fixed, but don't kow if it's the same issue | 14:36 |
| SvenKieske | best case you have a launchpad bug :) | 14:36 |
| greatgatsby | for sure, one sec, just trying to find it, thanks again | 14:36 |
| SvenKieske | e.g. there was this faulty precheck fixed recently: https://bugs.launchpad.net/kolla-ansible/+bug/1999081 | 14:37 |
| greatgatsby | https://bugs.launchpad.net/ubuntu/+source/rabbitmq-server/+bug/2023668 | 14:38 |
| kevko | aah, sorry i thought you are talking about above bug | 14:38 |
| SvenKieske | greatgatsby: which rabbitmq version are you running? also 3.9.29 (are you the same person)? | 14:42 |
| SvenKieske | did you maybe try to upgrade to a newer version, or did this version worked for you in the past? it really should not crash. | 14:43 |
| greatgatsby | I'm not one of the people in that ticket. We recently pulled/upgraded all new yoga images. Rabbitmq version seems to be 3.9.29-1 (from dpkg) | 14:44 |
| greatgatsby | we're using the ubuntu based images | 14:45 |
| guesswhat[m] | Question, is possible to configure reserved host memory for Nova? Cloudstack does this https://github.com/apache/cloudstack/blob/main/agent/conf/agent.properties#L280 | 14:45 |
| guesswhat[m] | For critical services running on the same KVM host, this can be helpful in All-in-one scenario | 14:46 |
| guesswhat[m] | it is, reserved_host_memory_mb | 14:47 |
| SvenKieske | greatgatsby: it might be helpful to add your datapoint to the bugreport though. it seems ubuntu maintainers of rabbitmq are already aware of it and maybe working on it? | 14:48 |
| greatgatsby | SvenKieske: I think someone on my team is contributing to that issue. Thanks again for the help, we'll continue to monitor that ticket. | 14:49 |
| kevko | guesswhat[m]: yeah of course ...i am doing the same in my env ...just use merge config | 14:49 |
| SvenKieske | guesswhat[m]: sure, afaik that's just a config line and afaik kolla already sets this to some reasonable default | 14:49 |
| kevko | place your nova compute config to /e/tc/kolla/config/nova.conf | 14:49 |
| kevko | or better nova-compute.conf | 14:49 |
| SvenKieske | greatgatsby: cool, if you can you could try different rmq versions, maybe that fixes stuff. newer versions are in general more stable, but might depend on your deployment. | 14:50 |
| kevko | SvenKieske: you mean reasonable default is 0 ? :D | 14:50 |
| guesswhat[m] | Thanks, one more question, anyone did some 2FA setup for Keystone? Is for example Google Authenticator implemented, looking for docs, but I am little bit confused | 14:50 |
| kevko | SvenKieske: ansible/roles/nova-cell/templates/nova.conf.j2:reserved_host_memory_mb = 0 | 14:50 |
| kevko | :D | 14:50 |
| SvenKieske | kevko: mhm, damn, then I'm misremembering and we set these ourselves to something reasonable. | 14:51 |
| kevko | SvenKieske: haha yeah | 14:51 |
| SvenKieske | might be worthwhile to compute a reasonable default based on host facts | 14:51 |
| kevko | but everything what can be changed should be changed via /etc/kolla/config/service.conf and kolla-ansible will merge this | 14:52 |
| * SvenKieske can't imagine a scenario where you don't want to reserver some memory for the host | 14:52 | |
| SvenKieske | yeah, what kevko says^^ | 14:52 |
| guesswhat[m] | Is possible to enable https proto for external endpoint when using enable_haproxy: no and kolla_internal_vip_address=kolla_external_vip_address ? | 15:01 |
| guesswhat[m] | kolla_enable_tls_external requires additional VIP, which does not make sense for all-in-one setup | 15:02 |
| opendevreview | Sven Kieske proposed openstack/kolla-ansible master: remove unnecessary comments https://review.opendev.org/c/openstack/kolla-ansible/+/884503 | 15:03 |
| guesswhat[m] | kolla_external_vip_address and kolla_internal_vip_address must not be the same when only one network has TLS enabled | 15:09 |
| guesswhat[m] | okey, then just tell me how to force proto to https and I will use external reverse proxy with TLS offloading | 15:10 |
| guesswhat[m] | is {{ external_protocol }} = https solution for me? | 15:12 |
| guesswhat[m] | oh, its proly {{ public_protocol }} = https | 15:24 |
| opendevreview | Maksim Malchuk proposed openstack/kolla master: config: switch OpenStack release back to master https://review.opendev.org/c/openstack/kolla/+/886087 | 16:59 |
| mmalchuk | cores, please merge rabbitmq fix https://review.opendev.org/c/openstack/kolla/+/885857 | 17:01 |
| mnasiadka | It's failing for ARM, so it's a no go | 17:39 |
| mnasiadka | hrw: have some cycles to have a look? ^^ | 17:43 |
| mmalchuk | we discus to solve the x86_64 right now, then kevo will try to fix arm | 18:00 |
| mmalchuk | and yes, stable branches should fail also | 18:00 |
| mmalchuk | this is dependency problem with erlang an rabbitmq | 18:01 |
| mnasiadka | hrw: didn't you build erlang in copr? | 18:01 |
| mnasiadka | mmalchuk: If we would disable the arm jobs in CI - I can agree to that, but running them every time and fail is at least a drama | 18:02 |
| mmalchuk | +1 to disable until we solve the issue | 18:03 |
| mnasiadka | hrw: sorry, didn't wake up yet - copr is for centos ;-) | 18:03 |
| mmalchuk | kevko ? | 18:03 |
| hrw | mnasiadka: my way is to go back to /2 patch and do rmq 3.12 on erlang 26. but that's only good for master | 18:07 |
| kevko | yes ? | 18:07 |
| mnasiadka | did we raise an issue for this in https://github.com/rabbitmq/erlang-debian-package ? | 18:08 |
| * hrw off | 18:08 | |
| kevko | hrw: check my patch revision 1 .... i've tried 3.12 and 26 ..upgrade jobs failed | 18:08 |
| kevko | but maybe it was some different issue .... | 18:08 |
| kevko | mnasiadka: no, but i am communicating with them from morning ...they are not going to build ... | 18:08 |
| hrw | kevko: upgrade fail because stable/* are broken withour 3.12/26 | 18:08 |
| kevko | that repository is only for latest erlang | 18:08 |
| kevko | hrw: ah, ok | 18:09 |
| mnasiadka | kevko: previous_release is zed, so nothing weird that upgrade jobs failed to do a skip level upgrade | 18:09 |
| kevko | so, i would say that easiest way will be just to update rmq | 18:09 |
| hrw | kevko: we had a moment when we synced up on 3.11/25 in master and some of stable/ ones | 18:09 |
| kevko | mnasiadka but all passed | 18:09 |
| mnasiadka | kevko: you said upgrade jobs failed? | 18:09 |
| hrw | kevko: so now it would be 3.12/26 on master, stable/a, stable/z, stable/whatever-with-3.11 | 18:10 |
| hrw | have to go, sorry | 18:10 |
| mnasiadka | anyway, did we raise an issue? | 18:10 |
| mnasiadka | or only a mail to the mailing list? | 18:10 |
| kevko | no | 18:10 |
| kevko | yes | 18:10 |
| mnasiadka | fantastic | 18:10 |
| mnasiadka | so please raise it, so we can track it properly | 18:10 |
| mnasiadka | I'm off for over a week and we go chaos monkey style, I like it | 18:11 |
| kevko | i like it too :) | 18:11 |
| mnasiadka | well, basically it seems like we're screwed | 18:50 |
| mnasiadka | arm jobs are voting - so we need to disable them | 18:51 |
| timmins | Hi there - apols if this is an idiotic question! How come the following reviewed/merged commit isn't present in the corresponding git repo/branch? https://review.opendev.org/c/openstack/kolla/+/843644 | 19:16 |
| frickler | that commit is right there, no idea what they were looking at https://opendev.org/openstack/kolla/commit/240b3cf448354bf1a7271f8f81d730e51da856cb | 19:43 |
| guesswhat[m] | Anyone using Skyline, domain in login form is empty and it does not allow login without domain filled in. Thanks | 20:07 |
| guesswhat[m] | Probably bug https://bugs.launchpad.net/skyline-apiserver/+bug/1998417 ? | 20:15 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: Fix rabbitmq image build https://review.opendev.org/c/openstack/kolla/+/885857 | 21:28 |
| mnasiadka | guesswhat[m]: seems so | 21:30 |
| mnasiadka | hrw, kevko: it seems that also hrw's copr only has erlang 26 - can we get back 25? :D | 22:00 |
| mnasiadka | well actually erlang is here: https://github.com/rabbitmq/erlang-rpm/releases/tag/v25.3 - I guess we could use it instead of copr | 22:18 |
| opendevreview | Juan Pablo Suazo proposed openstack/kolla-ansible master: Configures the tap-as-a-service neutron plugin https://review.opendev.org/c/openstack/kolla-ansible/+/885417 | 22:29 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!