Wednesday, 2023-08-02

opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: systemd: wait for stopping container  https://review.opendev.org/c/openstack/kolla-ansible/+/89019806:33
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: systemd: wait for stopping container  https://review.opendev.org/c/openstack/kolla-ansible/+/89019806:34
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: systemd: wait for stopping container  https://review.opendev.org/c/openstack/kolla-ansible/+/89019806:35
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Introduce oneshot docker_restart_policy  https://review.opendev.org/c/openstack/kolla-ansible/+/88170706:36
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: systemd: wait for stopping container  https://review.opendev.org/c/openstack/kolla-ansible/+/89019806:44
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Introduce oneshot docker_restart_policy  https://review.opendev.org/c/openstack/kolla-ansible/+/88170706:44
opendevreviewMaksim Malchuk proposed openstack/kolla master: Revert "Disable build of Gnocchi containers"  https://review.opendev.org/c/openstack/kolla/+/89030207:52
opendevreviewMaksim Malchuk proposed openstack/kolla master: Revert "Disable build of Gnocchi containers"  https://review.opendev.org/c/openstack/kolla/+/89030208:38
kevkohmm, i think we have bad configuration for service_user in kolla-ansible 08:58
mmalchukkevko more details?09:10
alistarleHello guys :) We discover an hardcoded value in ironic tftp who can break some setup, we variabilize it in this very small patch if its look good to you : https://review.opendev.org/c/openstack/kolla-ansible/+/88674709:12
opendevreviewhowardlee proposed openstack/kolla-ansible master: Fix an undefined variable bug for venus deployment  https://review.opendev.org/c/openstack/kolla-ansible/+/89032109:31
opendevreviewWill Szumski proposed openstack/kayobe master: Adds initial support for vGPUs  https://review.opendev.org/c/openstack/kayobe/+/88720009:33
opendevreviewWill Szumski proposed openstack/kayobe master: Adds initial support for vGPUs  https://review.opendev.org/c/openstack/kayobe/+/88720009:40
opendevreviewMerged openstack/kolla-ansible master: Fix L3 agent docs typo  https://review.opendev.org/c/openstack/kolla-ansible/+/88993809:48
opendevreviewhowardlee proposed openstack/kolla-ansible master: Fix an undefined variable bug for venus deployment  https://review.opendev.org/c/openstack/kolla-ansible/+/89032110:17
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: systemd: wait for stopping container  https://review.opendev.org/c/openstack/kolla-ansible/+/89019811:13
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Introduce oneshot docker_restart_policy  https://review.opendev.org/c/openstack/kolla-ansible/+/88170711:13
kevkommalchuk: this cant pass on my environment tempest.scenario.test_server_volume_attachment.TestServerVolumeAttachmentScenario.test_server_detach_rules11:34
kevkohttps://paste.openstack.org/show/bYVAmLV2BQqoxE9LuRGa/11:34
mmalchukforgot what you are talking about sorry11:34
kevkoservice_user in  nova and service_token_roles11:35
kevkoattach/detach 11:35
mmalchukah... understand11:35
mmalchukissue in cinder client?11:36
kevkoi can find a patch ....it was some CVE in cinder/nova ..so service_user configuration was implemented to address this issue ... service token is sent with user token also ...11:37
kevkono11:37
kevkobtw, do we test rally/tempest somewhere ? 11:37
kevkodo you know where i can check if it is passing somewhere in gerrit/zuul11:37
kevkoi mean that tempest test11:38
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: systemd: wait for stopping container  https://review.opendev.org/c/openstack/kolla-ansible/+/89019811:39
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Introduce oneshot docker_restart_policy  https://review.opendev.org/c/openstack/kolla-ansible/+/88170711:39
mmalchukwe use tempest and in xena all fine11:39
mmalchukwhre in gerrit I don't know11:40
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Introduce oneshot docker_restart_policy  https://review.opendev.org/c/openstack/kolla-ansible/+/88170711:40
mmalchukmay be in tempest project?11:40
mnasiadkakevko: this test doesn't fail in any of my environments11:43
mnasiadkakevko: and we test attach/detach in CI, just we don't use tempest for that11:47
opendevreviewDr. Jens Harbott proposed openstack/kolla-ansible master: octavia: enable jobboard  https://review.opendev.org/c/openstack/kolla-ansible/+/88858811:49
kevkomnasiadka: hmmm, can u share your tempest.conf ? 11:50
kevkomnasiadka: attach/detach is working normally ...but that test is also testing valid/invalid tokens and proper return code ...11:50
kevkomnasiadka: if i remove this from test ..it pass https://github.com/openstack/tempest/blob/4025fa3c8e5ba8de3f2cb60f4a225f1bc550b5e4/tempest/scenario/test_server_volume_attachment.py#L98-L15811:52
mnasiadkaThe test was merged in May, might be that my tempest is older than that ;)11:55
kevkoprobably :D :D 11:56
mnasiadkawe could move to tempest tests, I had an approach but something was wrong ;)11:58
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: WIP: Run Tempest in test-core-openstack  https://review.opendev.org/c/openstack/kolla-ansible/+/87882611:59
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: WIP: Run Tempest in test-core-openstack  https://review.opendev.org/c/openstack/kolla-ansible/+/87882611:59
opendevreviewDr. Jens Harbott proposed openstack/kolla-ansible master: ironic: add ironic_agent_files_directory parameter  https://review.opendev.org/c/openstack/kolla-ansible/+/87105412:15
fricklermnasiadka: regarding the octavia-redis dependency, I looked a bit for prior art, but didn't find any. like we also don't check whether neutron is enabled for octavia, or do we? so I'm actually wondering whether this is necessary12:24
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: systemd: wait for stopping container  https://review.opendev.org/c/openstack/kolla-ansible/+/89019812:30
mnasiadkafrickler: we usually did something like we do in cinder - https://github.com/openstack/kolla-ansible/blob/e0b212d72de8aac1d5fbbc6562f69ef0190a80b9/ansible/group_vars/all.yml#L105712:32
mnasiadkafrickler: so we could enable jobboard when redis is enabled, and/or have a precheck that if you don't have redis enabled and you enable jobboard - it's not going to work ;)12:33
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Introduce oneshot docker_restart_policy  https://review.opendev.org/c/openstack/kolla-ansible/+/88170712:34
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: WIP: Run Tempest in test-core-openstack  https://review.opendev.org/c/openstack/kolla-ansible/+/87882612:42
mnasiadkamgoddard mnasiadka hrw  bbezak frickler kevko SvenKieske mmalchuk gkoper jangutter - meeting in 10 minutes12:49
fricklerjobboard is more than a coordination backend, there's also a database involved, so making it optional would be a lot more complicated12:50
mnasiadkabut it only supports redis?12:51
fricklermnasiadka: or zookeeper, which afaict we don't support?12:53
yusufgungorHi, is it possible to upgrade from yoga to zed without os upgrade? Yoga release installed on ubuntu 20.04 hosts as docker containers. Do we have to upgrade hosts to ubuntu 22.04 before upgrade?12:55
mmalchukyusufgungor os not related in most cases, kolla use containers12:55
fricklersome review suggestions while waiting for the meeting: https://review.opendev.org/c/openstack/kolla-ansible/+/876650 https://review.opendev.org/c/openstack/kolla/+/88821912:56
yusufgungor@mmalchuk thansk for reply, nice to hear that. kolla-ansible zed prechecks playbook also shows that ubuntu focal and jammy is ok12:58
yusufgungorhost_os_distributions:12:58
yusufgungor  CentOS:12:58
yusufgungor    - "9"12:58
yusufgungor  Debian:12:58
yusufgungor    - "bullseye"12:58
yusufgungor  openEuler:12:58
yusufgungor    - "22.03"12:58
yusufgungor  Rocky:12:58
yusufgungor    - "9"12:58
yusufgungor  Ubuntu:12:58
yusufgungor    - "focal"12:58
yusufgungor    - "jammy"12:58
mmalchukfrickler reviewed12:59
mnasiadkafrickler: yeah, so redis it is ;)12:59
mmalchukyusufgungor right12:59
mmalchukyusufgungor you can upgrade os later for example13:00
mnasiadka#startmeeting kolla13:00
opendevmeetMeeting started Wed Aug  2 13:00:50 2023 UTC and is due to finish in 60 minutes.  The chair is mnasiadka. Information about MeetBot at http://wiki.debian.org/MeetBot.13:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.13:00
opendevmeetThe meeting name has been set to 'kolla'13:00
mnasiadka#topic rollcall13:00
mnasiadkao/13:00
mmalchuk\o13:00
janguttero/13:01
frickler\o13:01
mattcreeso/13:01
* frickler likes how that all lined up13:01
mmalchuklol13:03
mnasiadka#topic agenda13:03
mnasiadka* CI status13:03
mnasiadka* Release tasks13:03
mnasiadka* Regular stable releases (first meeting in a month)13:03
mnasiadka* Current cycle planning13:03
mnasiadka* Additional agenda (from whiteboard)13:03
mnasiadka* Open discussion13:03
mnasiadka#topic CI Status13:03
mnasiadkaBasically master Kayobe is RED, because of a bug in Kolla-Ansible's systemd stuff13:03
mnasiadkaAnd we haven't seen that in Kolla-Ansible CI, because we don't use systemd at all (docker_restart_policy = no)13:04
mnasiadkaworking on a fix, but basically on upgrade we end up with removing containers before they are stopped (so docker engine sends SIGKILL instead of SIGTERM) - and guess what - MariaDB doesn't like it very much.13:04
mmalchukthats predictable)13:05
mnasiadkathank you captain obvious :)13:06
mnasiadkaok, let's move on13:06
mnasiadka#topic Release tasks13:06
mnasiadkanone this week13:06
mnasiadka#topic Regular stable releases (first meeting in a month)13:06
mnasiadkafrickler: should we wait for the systemd fix with stable releases?13:06
fricklerwhich releases are affected?13:06
mnasiadkaAntelope only13:07
fricklerlet's wait then I'd say13:08
mnasiadkaYoga is going EM I think, so we'd need to tidy up patches there and submit last release13:08
frickleralso please review https://review.opendev.org/c/openstack/kolla/+/888219 that updates the instructions, I used the updated docs last time already13:08
frickleroh, only just EMed xena13:09
fricklerbut I don't mind, we don't use yoga anymore downstream13:09
mnasiadkawell, other thing is that seems EM is being changed to unmaintained (naming wise)13:09
mnasiadkaso those that use EM can expect a branch name change if I remember correctly to unmaintained/xena and unmaintained/yoga13:10
fricklerand becoming opt-in rather than opt-out going forward13:10
mnasiadkayup, I don't mind - EM was like an unwanted child in Kolla landscape ;)13:11
mnasiadkaSHPC uses Yoga for now, but  Xena is not something we need13:11
mnasiadkaSo agreed - when systemd will be fixed in k-a and backported to Antelope - we should do releases13:12
fricklerI was about to ask if we can just eol yoga instead, but seems you would not agree?13:12
mnasiadkaFor now I think it would be better to keep the branch open, but I'll discuss that internally and come back to it on next weekly meeting13:13
mnasiadkaAnybody needs Xena?13:13
fricklercool13:13
mmalchukme13:13
mnasiadkaNo patches for stable/xena open13:14
mnasiadkammalchuk: how long do you think you need stable/xena open?13:14
mmalchukcouple of week13:14
mmalchukplease13:14
mnasiadkaok, let's reassess in September13:15
mmalchukthanks13:15
mnasiadka#topic Current cycle planning13:15
mnasiadkaAnybody had cycles to review Let's Encrypt?13:15
mmalchukI did review13:15
opendevreviewMerged openstack/kolla master: Update stable branch management doc  https://review.opendev.org/c/openstack/kolla/+/88821913:16
mnasiadkaI don't have time this week, but I'll try next13:16
mnasiadkaOk, let's go to agenda from whiteboard, seems we have some13:17
mnasiadka#topic Additional agenda (from whiteboard)13:17
mnasiadkaihalomi - failing podman test on rocky9 https://zuul.opendev.org/t/openstack/build/bfc1625b4e0f4788be21f3bf5454ba4d13:18
mnasiadkaI promised to have a look, but didn't have time - should have some after the systemd bug13:18
mnasiadkafrickler - octavia jobboard13:18
mnasiadkahttps://review.opendev.org/c/openstack/kolla/+/88858713:18
mnasiadkahttps://review.opendev.org/c/openstack/kolla-ansible/+/88858813:18
frickleryes, took me until today to update, sorry for that13:18
fricklerfirst patch is merged, second we talked about earlier13:19
mnasiadkano problems13:19
mnasiadkakolla side is merged13:19
mnasiadkaI understand jobboard won't work without redis - so we'd need some precheck?13:19
frickleryes, I think so, I will try to build that13:20
mnasiadkaGreat, anything else on that topic?13:20
fricklernot from me13:20
fricklerexcept ...13:20
mnasiadkaok, next one13:20
mnasiadkafrickler - debian bookworm support13:20
mnasiadkahttps://review.opendev.org/c/openstack/kolla/+/886088 seems mostly ready13:20
mnasiadkahttps://review.opendev.org/c/openstack/kolla-ansible/+/888034 need to check the haproxy config update13:20
frickleryes, the latter is marked as wip still because I wasn't sure whether we can drop that old haproxy option globally13:21
mnasiadkakolla side looks ok, I can fix the netcontrold image13:21
fricklerdoes someone know haproxy better than me?13:21
mmalchukhaproxy authorr?)13:22
mmalchukwhat the problem?13:22
mnasiadkahttps://www.haproxy.com/blog/multithreading-in-haproxy#from-multiprocess-to-multithreading13:22
mnasiadkanbproc is not supported, and we should move to multithreading13:22
mmalchukbut there was reviews13:23
mmalchukand CI passd13:23
mnasiadkawhere?13:24
mmalchukhttps://review.opendev.org/c/openstack/kolla-ansible/+/88356013:24
mmalchukand13:25
mmalchukhttps://review.opendev.org/c/openstack/kolla-ansible/+/88355913:25
mnasiadkafrickler: is nbproc dropped or do we need now to do nbthread and nbproc?13:25
mmalchukboth need reviewers13:25
mnasiadkaI haven't seen that13:25
mmalchukvacation)13:25
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: loadbalancer: support setting nbthread with variable haproxy_threads  https://review.opendev.org/c/openstack/kolla-ansible/+/88355913:25
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: loadbalancer: support cpu-map for threads  https://review.opendev.org/c/openstack/kolla-ansible/+/88356013:25
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: loadbalancer: remove support for haproxy_processes  https://review.opendev.org/c/openstack/kolla-ansible/+/88398213:26
mnasiadkarebased, let's review13:26
fricklerme neither, I'll check those patches13:26
mnasiadkaadded RP+1 to them13:26
fricklerthe other thing is how to bump the debian python version in k and k-a at the same time13:26
fricklermake debian n-v in k-a temporarily?13:27
mnasiadkano, we've been passing a variable in the past13:27
mnasiadkabut I had an idea to link the python version so that wsgi configs don't need to know the python version13:27
mnasiadkaor we could have a task to check python version in the image13:27
mnasiadkahttps://review.opendev.org/c/openstack/kolla-ansible/+/87499013:28
mnasiadkaone attempt13:28
mnasiadkaI can have a look again, so we stop doing weird dances every time13:28
mnasiadkaok, next one13:28
mnasiadkajangutter - etcd support13:28
mnasiadkahttps://review.opendev.org/c/openstack/kolla-ansible/+/888012 (adding/removing nodes to a cluster)13:28
mnasiadkageneral question: any users of etcd? etcd-3.3 might no longer be supported13:28
mnasiadkaI saw that patch, will have a look next week13:29
jangutterthanks! no rush!13:29
mnasiadkaaround upgrading etcd - we could bump to 3.4 I guess, because etcd can't do skip level upgrades, right?13:29
jangutterThat's what I read too..13:29
mnasiadkaso let's do that13:30
jangutterIt's getting close though, if 3.6 releases then 3.4 goes out of maintenance.... so I guess sooner is better than later.13:30
mnasiadkajangutter: happy to raise a patch to go to 3.4?13:30
mnasiadkaand then we could go to 3.5 in Caracal13:30
janguttertry and stop me :-p13:30
mnasiadkaok, thanks13:30
mnasiadkaI unfortunately need to run... sorry for the short meeting today13:31
mnasiadkafeel free to continue the discussion after the meeting13:31
mmalchukGnocchi is back, fix - https://review.opendev.org/c/openstack/kolla/+/89030213:31
mnasiadka#endmeeting13:31
opendevmeetMeeting ended Wed Aug  2 13:31:23 2023 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)13:31
opendevmeetMinutes:        https://meetings.opendev.org/meetings/kolla/2023/kolla.2023-08-02-13.00.html13:31
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/kolla/2023/kolla.2023-08-02-13.00.txt13:31
opendevmeetLog:            https://meetings.opendev.org/meetings/kolla/2023/kolla.2023-08-02-13.00.log.html13:31
mnasiadkammalchuk: thanks for handling that13:31
mmalchukCan be merged and need backports13:31
mmalchukmnasiadka thanks13:31
mmalchukcores, review and merge please: https://review.opendev.org/c/openstack/kolla/+/89030213:34
opendevreviewGaĆ«l THEROND proposed openstack/kolla-ansible master: Improve designate role support.  https://review.opendev.org/c/openstack/kolla-ansible/+/87827014:37
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: systemd: wait for stopping container  https://review.opendev.org/c/openstack/kolla-ansible/+/89019814:40
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: systemd: wait for stopping container  https://review.opendev.org/c/openstack/kolla-ansible/+/89019814:40
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Introduce oneshot docker_restart_policy  https://review.opendev.org/c/openstack/kolla-ansible/+/88170714:41
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Introduce oneshot docker_restart_policy  https://review.opendev.org/c/openstack/kolla-ansible/+/88170714:41
opendevreviewMichal Nasiadka proposed openstack/kolla master: Link lib/python version  https://review.opendev.org/c/openstack/kolla/+/87498914:43
opendevreviewMichal Nasiadka proposed openstack/kolla master: Link lib/python version  https://review.opendev.org/c/openstack/kolla/+/87498914:44
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Drop distro_python_version  https://review.opendev.org/c/openstack/kolla-ansible/+/87499014:45
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Drop distro_python_version  https://review.opendev.org/c/openstack/kolla-ansible/+/87499014:45
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: WIP: Run Tempest in test-core-openstack  https://review.opendev.org/c/openstack/kolla-ansible/+/87882614:49
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: WIP: Run Tempest in test-core-openstack  https://review.opendev.org/c/openstack/kolla-ansible/+/87882614:49
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: systemd: wait for stopping container  https://review.opendev.org/c/openstack/kolla-ansible/+/89019815:01
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Introduce oneshot docker_restart_policy  https://review.opendev.org/c/openstack/kolla-ansible/+/88170715:01
opendevreviewMerged openstack/kayobe stable/xena: Limit interface names to 15 characters  https://review.opendev.org/c/openstack/kayobe/+/88454215:02
spatelMy two cents on HAproxy, nbproc is deprecated after 2.x release of haproxy and it has been replace with nbthread 17:09
johnsomThat is correct nbproc is going away, it had a ton of tricky issues to work around. The new threads model is much better.17:46
guesswhat[m]By any chance, would be possible to backport this https://review.opendev.org/c/openstack/skyline-apiserver/+/879465 ? 20:37

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!