Tuesday, 2024-08-27

opendevreviewIvan Vnučko proposed openstack/kolla-ansible master: Add backend TLS encryption for Masakari  https://review.opendev.org/c/openstack/kolla-ansible/+/92722805:22
opendevreviewIvan Vnučko proposed openstack/kolla-ansible master: Add backend TLS encryption for Gnocchi  https://review.opendev.org/c/openstack/kolla-ansible/+/92722905:23
opendevreviewIvan Vnučko proposed openstack/kolla-ansible master: Add backend TLS encryption for CloudKitty  https://review.opendev.org/c/openstack/kolla-ansible/+/92723005:23
opendevreviewRoman Krček proposed openstack/kolla master: Refactor dev mode  https://review.opendev.org/c/openstack/kolla/+/92571205:39
opendevreviewRoman Krček proposed openstack/kolla-ansible master: Refactor dev mode  https://review.opendev.org/c/openstack/kolla-ansible/+/92571405:57
stanare we planning to replace redis with valkey any time soon?06:47
SvenKieskestan: there was some discussion but I guess so far no one had the time to do so. feel free to raise a patch07:14
opendevreviewMatt Crees proposed openstack/kolla stable/2024.1: Add support for checking incoming RabbitMQ version  https://review.opendev.org/c/openstack/kolla/+/92723908:05
opendevreviewBartosz Bezak proposed openstack/kolla master: Remove incorrect reno  https://review.opendev.org/c/openstack/kolla/+/92724108:24
mnasiadkastan: that's the plan, but I haven't seem rpm/deb that we could use08:44
gbialasSvenKieske: I made some comment in https://review.opendev.org/c/openstack/kolla-ansible/+/927022/5 regarding changes you suggested. For some reason I couldn't reply properly, so I had to add it as main comment. I am not sure if it is visible to you, hence I am bothering you here ;08:45
SvenKieskegbialas: yes I've seen your comment, but it seems you are trying to do something that is not supported the way you're doing it. as you wrote, CI expects a string, not a list for these docvars, I'm not sure if this can be changed.08:51
SvenKieskenot sure who is well versed with doc/source/conf.py here?08:55
SvenKieskein theory it should be possible to extend conf.py so it can convert your list of strings to a string I guess.08:55
mnasiadkaSvenKieske: those variables that you commented on are ONLY for using these in .rst files, the variable introduced by gbialas is only for templating out branch name properly - it doesn't need to be added there.09:03
SvenKieskemhm I know these are only for rst files, but the comment specifically calls out to add all variables? then maybe the comment should be fixed?09:05
SvenKieskeas I said I don't know that part of the codebase good. I was just going by the comment in the source code to add all variables to the global map.09:05
mnasiadkafine by me - gbialas can you change the comment?09:05
gbialasSure. I will also add comment to clarify why this variable was added.09:07
SvenKieskebut when you look at replace_global_vars in line 150/160 (old/new change) the iteration seems only to iterate over GLOBAL_VARIABLE_MAP[key], so are you sure this is not needed?09:07
mnasiadkaSvenKieske: there's a cherry pick to unmaintained branch that seems to work, aren't we overdoing this? ;-)09:08
SvenKieskewell I'm talking about a review on master branch: https://review.opendev.org/c/openstack/kolla-ansible/+/92702209:08
mnasiadkayes, but the effect will be only visible on unmaintained branch09:09
SvenKieskethat was also what gbialas linked to above09:09
mnasiadkahttps://review.opendev.org/c/openstack/kolla-ansible/+/927092?tab=change-view-tab-header-zuul-results-summary09:09
SvenKieskeI don't care about the unmaintained branch :) 09:09
mnasiadkawell, antelope is going to be unmaintained this year, so we can't merge the docs change only to unmaintaned/*09:09
mnasiadkaI don't care if you care, but your comments are not helping :)09:10
mnasiadkayou can see that it's working here: https://4e240f8fa4f8989d230c-b3141299f569dd5d6d8f436de9f6d947.ssl.cf5.rackcdn.com/927092/1/check/openstack-tox-docs/da73fd1/docs/user/quickstart.html09:12
mnasiadkamore detailed link: https://4e240f8fa4f8989d230c-b3141299f569dd5d6d8f436de9f6d947.ssl.cf5.rackcdn.com/927092/1/check/openstack-tox-docs/da73fd1/docs/user/quickstart.html#install-kolla-ansible09:13
opendevreviewPierre Riteau proposed openstack/kayobe master: [DNM] Test seed-vm job with Ubuntu image without EFI changes  https://review.opendev.org/c/openstack/kayobe/+/92710009:13
SvenKieskeI'm sorry, I misread that to mean that this is only about the patch on the unmaintained branch. if it's working it's fine I guess, I see as much on the cherry pick.09:14
gbialasOk. I will push all necessary changes, and will wait for further review. 09:16
opendevreviewBartosz Bezak proposed openstack/kolla-ansible master: Drop prometheus-msteams support  https://review.opendev.org/c/openstack/kolla-ansible/+/92700109:24
opendevreviewPierre Riteau proposed openstack/kayobe master: [DNM] Test Ubuntu seed VM on RL9 hypervisor  https://review.opendev.org/c/openstack/kayobe/+/92698409:43
stanSvenKieske Is there any rabbimq optimization guide to follow? Everytime we face any problem, 9/10 times it's rabbitmq shitting the bed. Any pointers?10:22
SvenKieskestan: there are quite a lot of guides etc out there, and also one patch is still outstanding on our side..10:36
mnasiadkastan: What type of queues are you using? HA classic-mirrored queues? Quorum queues?10:36
SvenKieskepatch that's still open: https://review.opendev.org/c/openstack/kolla-ansible/+/90052810:37
SvenKieskeguides: https://docs.openstack.org/large-scale/journey/configure/rabbitmq.html (mostly already incorporated into kolla afaik)10:38
SvenKieskeshort lightning talk with some pitfalls when scaling rmq: https://www.youtube.com/watch?v=cknfE7xymeQ10:38
matusjencahello everyone, can I change a docker's container USER with kolla-ansible alone or do I need to rebuild image?10:41
SvenKieskedepends on what you want to do, for one time execution you can just do docker exec --user=root if you want to reuse this it's better to rebuild the image I guess.10:45
SvenKieskein general the user settings should be fine though10:45
SvenKieskemhm, we don't have a really established mechanism to load variables from one role into another I guess? So I end up defining a huge chunk in group_vars/all.yml and then reference that everywhere? currently reworking the haproxy ssl settings (again)10:47
SvenKieskemnasiadka: what do you think? we currently have these roles, which all manage different haproxy aspects: "loadbalancer", "loadbalancer-config", "haproxy-config", and then the special cases "glance" and neutron with their completely own haproxy.cfg10:48
SvenKieskeI initially did put new ssl defaults in "haproxy-config" but I would need to reference that variable at least in "loadbalancer" and in glance and neutron. Could do so via relative path "include_vars", but it's kind of ugly10:49
mnasiadkaHistorically we've just put such variables in group_vars/all.yml10:50
SvenKieskeso I could move it to group_vars/all.yml but it's quite a large chunk.10:50
mnasiadkawe could think of chopping up all.yml into separate files, but that will make backports more complicated ;)10:50
SvenKieskeI guess I'll stick with that. Probably should raise a separate patch to move some of the glance/neutron haproxy configs out of those. the original intend was to make maintenance easier, but I feel it's more complicated to keep all haproxy.cfg files up-to-date10:51
SvenKieskeat least the TLS settings should be sourced centrally I guess, which can be overriden10:52
opendevreviewSven Kieske proposed openstack/kolla-ansible master: harden haproxy TLS configuration  https://review.opendev.org/c/openstack/kolla-ansible/+/91540310:56
stanSvenKieske thank you. I will refer to the links you have provided:)11:00
stanwe use quorum queues11:01
opendevreviewSven Kieske proposed openstack/kolla-ansible master: harden haproxy TLS configuration  https://review.opendev.org/c/openstack/kolla-ansible/+/91540311:01
SvenKieskestan: have you encountered a problem or are you just asking in advance?11:02
opendevreviewMatt Crees proposed openstack/kolla-ansible master: Add a precheck to catch RMQ SLURP upgrades  https://review.opendev.org/c/openstack/kolla-ansible/+/92614611:07
opendevreviewSven Kieske proposed openstack/kolla-ansible master: harden haproxy TLS configuration  https://review.opendev.org/c/openstack/kolla-ansible/+/91540311:14
SvenKieskenow this should work11:14
stanSvenKieske I have no idea how rabbitmq works yet. So just wanted to know if we are following the best practices while we start, to avoid any tech debt11:15
SvenKieskestan: always good to be cautious! rabbitmq.com has also lot's of docs. if this is your first message queueing system I would also advise to read something about distributed systems and messages queues in general :)11:17
rohit02Hi Team,We are trying kolla-ansible Caracal(2024.1) deployment on Rocky 9 Linux but deployment failed at Task "TASK [rabbitmq : List RabbitMQ policies]"11:18
rohit02Attached the detailed logs "https://paste.openstack.org/show/bMInLqyd0Wpt9Che0400/" 11:20
rohit02rabbitmq policy11:26
stanSvenKieske Yes, I should start reading a lot on these topics.11:27
stan:)11:27
opendevreviewMerged openstack/kayobe master: seed-vm/infra-vms: Add support for EFI and q35  https://review.opendev.org/c/openstack/kayobe/+/92166011:27
SvenKieskerohit02: the error says your rabbitmq is not running, so the task can't list the policies. are you sure you already deployed rabbitmq sucessfully? which installation docs are you following?11:39
opendevreviewMaximilian Sesterhenn proposed openstack/kolla-ansible master: WIP: Add ovn-bgp-agent / FRR / neutron-bgpvpn / Horizon BGPVPN dashboard support  https://review.opendev.org/c/openstack/kolla-ansible/+/89162211:42
opendevreviewMaximilian Sesterhenn proposed openstack/kolla master: Add ovn-bgp-agent / FRR / Horizon BGPVPN dashboard  https://review.opendev.org/c/openstack/kolla/+/89161711:42
rohit02Hi @SvenKieske i am following this official kolla doc link "https://docs.openstack.org/kolla-ansible/2024.1/user/quickstart.html"11:43
SvenKieskethose should work, at which step are you? deployment? https://docs.openstack.org/kolla-ansible/2024.1/user/quickstart.html#deployment11:46
rohit02@<SvenKieske> rabbitmq container continuously failing with error " https://paste.openstack.org/show/brb0YOD1EM8XlAgLBcd8/"11:47
opendevreviewPierre Riteau proposed openstack/kayobe stable/2024.1: seed-vm/infra-vms: Add support for EFI and q35  https://review.opendev.org/c/openstack/kayobe/+/92726111:49
rohit02yes at deploy command it fails11:49
opendevreviewPierre Riteau proposed openstack/kayobe stable/2023.2: seed-vm/infra-vms: Add support for EFI and q35  https://review.opendev.org/c/openstack/kayobe/+/92726211:49
opendevreviewPierre Riteau proposed openstack/kayobe stable/2023.1: seed-vm/infra-vms: Add support for EFI and q35  https://review.opendev.org/c/openstack/kayobe/+/92726311:50
SvenKieskemhm interesting, it can't enable the required feature flags for rabbitmq somehow. which rabbitmq version or image are you using?11:52
opendevreviewGrzegorz Bialas proposed openstack/kolla-ansible master: Fix links in docs for unmaintained releases  https://review.opendev.org/c/openstack/kolla-ansible/+/92702211:55
rohit02@SvenKieske i am using quay.io/openstack.kolla/rabbitmq     2024.1-rocky-9 11:57
opendevreviewGrzegorz Bialas proposed openstack/kolla-ansible master: Fix links in docs for unmaintained releases  https://review.opendev.org/c/openstack/kolla-ansible/+/92702212:09
PrzemekKrocky is sheet xD always missing some packages vs ubuntu12:56
PrzemekKwhat image date You have ? What version of Rabbit ? @rohit0213:00
PrzemekKstream_single_active_consumer is from this 3.1113:01
opendevreviewMartin Hiner proposed openstack/kolla-ansible master: Move to high level client in DockerWorker  https://review.opendev.org/c/openstack/kolla-ansible/+/90829513:57
opendevreviewMartin Hiner proposed openstack/kolla-ansible master: Move to high level client in DockerWorker  https://review.opendev.org/c/openstack/kolla-ansible/+/90829514:09
opendevreviewSven Kieske proposed openstack/kolla-ansible master: put in a short dealy when waiting for haproxy  https://review.opendev.org/c/openstack/kolla-ansible/+/92727714:21
opendevreviewSven Kieske proposed openstack/kolla-ansible master: harden haproxy TLS configuration  https://review.opendev.org/c/openstack/kolla-ansible/+/91540314:22
opendevreviewSven Kieske proposed openstack/kolla-ansible master: put in a short delay when waiting for haproxy  https://review.opendev.org/c/openstack/kolla-ansible/+/92727714:23
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: mariadb: Disable wsrep_provider plugin  https://review.opendev.org/c/openstack/kolla-ansible/+/92709614:46
SvenKieskemhm, CI issue? I currently see constantly failing Task "Wait for backup haproxy to start" in deploy phase14:47
mnasiadkaSvenKieske: https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_233/915403/7/check/kolla-ansible-debian/2335d5e/primary/logs/container_logs/haproxy.txt - look at the bottom14:49
SvenKieskeah thx for the pointer! I also looked at a wrong log I see14:50
SvenKieskerather wrong buildset from a different patch14:50
mnasiadkathat's what I meant by running some haproxy config test before we start/restart anything :)14:50
mnasiadkaideally in config.yml I guess - running an additional container that only runs the test14:50
SvenKieskeyep, but that container then needs all the linters installed, haproxy, promtool..but it is feasible I guess.14:51
mnasiadkarun haproxy container just for parsing the config14:52
mnasiadkanot use one image for all parsing :)14:52
SvenKieskewell and we need a binary per version, I just noticed that debian version is ancient again :D14:52
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: service-python-path: Introduce a role to get python_path of an image  https://review.opendev.org/c/openstack/kolla-ansible/+/92663214:55
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: WIP: Add support for Ubuntu Noble Numbat (24.04 LTS)  https://review.opendev.org/c/openstack/kolla-ansible/+/92558114:56
SvenKieskegot the wrong yaml multiline anchor again.. good thing there is: https://yaml-multiline.info/14:59
opendevreviewSven Kieske proposed openstack/kolla-ansible master: harden haproxy TLS configuration  https://review.opendev.org/c/openstack/kolla-ansible/+/91540315:00
mnasiadkaSvenKieske: https://ih1.redbubble.net/image.3180585412.6676/fposter,small,wall_texture,product,750x1000.u13.jpg15:02
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: WIP: Add support for Ubuntu Noble Numbat (24.04 LTS)  https://review.opendev.org/c/openstack/kolla-ansible/+/92558115:16
opendevreviewMichal Nasiadka proposed openstack/kolla stable/2024.1: CI: Disable CentOS/Rocky/Ubuntu aarch64 jobs  https://review.opendev.org/c/openstack/kolla/+/92728815:19
opendevreviewMichal Nasiadka proposed openstack/kolla stable/2023.2: CI: Disable CentOS/Rocky/Ubuntu aarch64 jobs  https://review.opendev.org/c/openstack/kolla/+/92728915:19
opendevreviewMichal Nasiadka proposed openstack/kolla stable/2023.2: CI: Disable CentOS/Rocky/Ubuntu aarch64 jobs  https://review.opendev.org/c/openstack/kolla/+/92728915:20
opendevreviewMichal Nasiadka proposed openstack/kolla stable/2023.2: CI: Disable CentOS/Rocky/Ubuntu aarch64 jobs  https://review.opendev.org/c/openstack/kolla/+/92728915:20
opendevreviewMichal Nasiadka proposed openstack/kolla stable/2023.2: CI: Disable CentOS/Rocky/Ubuntu aarch64 jobs  https://review.opendev.org/c/openstack/kolla/+/92728915:21
opendevreviewMichal Nasiadka proposed openstack/kolla stable/2023.1: CI: Disable CentOS/Rocky/Ubuntu aarch64 jobs  https://review.opendev.org/c/openstack/kolla/+/92729015:21
opendevreviewMichal Nasiadka proposed openstack/kolla stable/2023.1: CI: Disable CentOS/Rocky/Ubuntu aarch64 jobs  https://review.opendev.org/c/openstack/kolla/+/92729015:22
opendevreviewMichal Nasiadka proposed openstack/kolla master: DNM: Run fio tests  https://review.opendev.org/c/openstack/kolla/+/92721015:25
SvenKieskemnasiadka: xD nice, I should probably print that out..15:48
SvenKieskemnasiadka: I prepared some docs for haproxy TLS stuff, just want to let CI pass once before I push again.16:00
SvenKieskemhm, I'm just thinking, in theory I could reverse some of the patchlogic so we could actually backport this, if I make the legacy behaviour the default and raise a second patch just for changing the default then? but I don't know if we would want to backport that..16:04
SvenKieskepeople really needing it can of course always backport manually.16:04
PrzemekKI dont know why You dont support aarch64 while kolla does - https://docs.openstack.org/kolla-ansible/latest/user/support-matrix.html https://docs.openstack.org/kolla/2024.1/support_matrix . What the plans for host/image on Ubuntu 24 ?16:23
PrzemekKwill You change matrix as well ?16:25
PrzemekKAnd ubuntu 24 will be on 2024.2 or sooner ?16:25
opendevreviewSven Kieske proposed openstack/kolla-ansible master: harden haproxy TLS configuration  https://review.opendev.org/c/openstack/kolla-ansible/+/91540316:26
PrzemekKBecause i have discussion if ubuntu 24 can be host OS for kolla-ansible . I have told that kolla images will be ubuntu 2024.1 but they can run on all Host OS  (for example Windows OS) can You give arguments why it should run on ubuntu 22.04 ?16:29
opendevreviewMerged openstack/kolla stable/2024.1: CI: Disable CentOS/Rocky/Ubuntu aarch64 jobs  https://review.opendev.org/c/openstack/kolla/+/92728816:54
opendevreviewMerged openstack/kolla stable/2023.1: CI: Disable CentOS/Rocky/Ubuntu aarch64 jobs  https://review.opendev.org/c/openstack/kolla/+/92729016:57
opendevreviewMerged openstack/kolla stable/2023.2: CI: Disable CentOS/Rocky/Ubuntu aarch64 jobs  https://review.opendev.org/c/openstack/kolla/+/92728917:01
opendevreviewMichal Nasiadka proposed openstack/kolla master: mariadb: Add pv on Ubuntu as well  https://review.opendev.org/c/openstack/kolla/+/92730518:02
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: mariadb: Disable wsrep_provider plugin  https://review.opendev.org/c/openstack/kolla-ansible/+/92709618:03
opendevreviewAravindh proposed openstack/kolla-ansible master: HAProxy: Switch to L7 Healthchecks (Phase 1)  https://review.opendev.org/c/openstack/kolla-ansible/+/91843718:36
opendevreviewMichal Nasiadka proposed openstack/kolla master: DNM: Run fio tests  https://review.opendev.org/c/openstack/kolla/+/92721018:48
opendevreviewMichal Nasiadka proposed openstack/kolla master: DNM: Run fio tests  https://review.opendev.org/c/openstack/kolla/+/92721018:49
opendevreviewMichal Nasiadka proposed openstack/kolla master: DNM: Run fio tests  https://review.opendev.org/c/openstack/kolla/+/92721018:50
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: WIP: Use new module names from openstack.cloud  https://review.opendev.org/c/openstack/kolla-ansible/+/91432519:50
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: WIP: Use new module names from openstack.cloud  https://review.opendev.org/c/openstack/kolla-ansible/+/91432519:50
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Use new module names from openstack.cloud  https://review.opendev.org/c/openstack/kolla-ansible/+/91432519:50
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: ironic: use ironic_tftp_listen_address in dnsmasq.conf  https://review.opendev.org/c/openstack/kolla-ansible/+/92707920:07
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: ironic: use ironic_tftp_listen_address  https://review.opendev.org/c/openstack/kolla-ansible/+/92707920:10
opendevreviewGrzegorz Bialas proposed openstack/kolla master: Check if archive is tarfile  https://review.opendev.org/c/openstack/kolla/+/91419320:20
opendevreviewMichal Nasiadka proposed openstack/kolla master: CI: Add reno linting  https://review.opendev.org/c/openstack/kolla/+/91664220:21
opendevreviewMichal Nasiadka proposed openstack/kolla master: WIP: Move pre tasks into roles  https://review.opendev.org/c/openstack/kolla/+/92059020:21
opendevreviewMichal Nasiadka proposed openstack/kolla master: WIP: Move pre tasks into roles  https://review.opendev.org/c/openstack/kolla/+/92059020:22
opendevreviewMichal Nasiadka proposed openstack/kolla master: WIP: Move pre tasks into roles  https://review.opendev.org/c/openstack/kolla/+/92059020:22
opendevreviewMichal Nasiadka proposed openstack/kolla master: WIP: Move pre tasks into roles  https://review.opendev.org/c/openstack/kolla/+/92059020:23
opendevreviewMichal Nasiadka proposed openstack/kolla master: WIP: Move pre tasks into roles  https://review.opendev.org/c/openstack/kolla/+/92059020:23
opendevreviewMichal Nasiadka proposed openstack/kolla master: CI: Move image building to a role  https://review.opendev.org/c/openstack/kolla/+/92214820:23
opendevreviewMichal Nasiadka proposed openstack/kolla master: CI: Add reno linting  https://review.opendev.org/c/openstack/kolla/+/91664220:57
opendevreviewVerification of a change to openstack/kolla master failed: Revert "[release] Change RDO's DELOREAN_DEPS repo to Caracal"  https://review.opendev.org/c/openstack/kolla/+/92698221:55
opendevreviewMerged openstack/kolla master: Check if archive is tarfile  https://review.opendev.org/c/openstack/kolla/+/91419323:14

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!