| congnt | Hi everyone, I'm building image horizon but hit a bug. I have a repo horizon with my code. When I'm build with kolla, first, kolla install horizon with my code, but after that I don't know why horizon install version 22.1.0. It seems because blazar-dashboard require horizon >=17.1.0. Anyone know how to fix it? (https://imgur.com/04yaE6Z) | 05:10 |
|---|---|---|
| shyamb | Hi | 06:22 |
| shyamb | In openstack kolla-ansible we want to run our service in active passive mode among controller nodes | 06:23 |
| shyamb | Service is supposed to run on any one controller node | 06:23 |
| shyamb | How can we achieve that? Any thoughts are welcome | 06:24 |
| congnt | Hi everyone, I'm building image horizon but I hit a bug. I have a repo horizon with my code. When I'm build image with kolla, first, kolla install horizon with my code (horizon-19.2.0.dev213), but after that I don't know why horizon install version 22.1.0. It seems a plugin require horizon >=17.1.0. Anyone know how to fix it? (https://imgur.com/04yaE6Z). Log building (https://paste.ubuntu.com/p/QMsPY9GGzf/plain/) | 06:26 |
| congnt | Hi hrw & mgoddard, Do you know this bug? Can you explain why horizon installed version 22.1.0 for me. Thank you so much! | 06:28 |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible stable/yoga: [docs] Align IPA images urls https://review.opendev.org/c/openstack/kolla-ansible/+/857477 | 06:31 |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible stable/xena: [docs] Align IPA images urls https://review.opendev.org/c/openstack/kolla-ansible/+/857478 | 06:31 |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible stable/xena: [docs] Align IPA images urls https://review.opendev.org/c/openstack/kolla-ansible/+/857478 | 06:32 |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible stable/wallaby: [docs] Align IPA images urls https://review.opendev.org/c/openstack/kolla-ansible/+/857479 | 06:33 |
| congnt | Oh, I fixed, my mistake. Sorry all of you | 06:44 |
| yoctozepto | shyamb: we don't support active-passive in kolla-ansible yet - I need such support too and will likely work on it later this year or early next year (unless I have my priorities changed once again which is not improbable) | 07:48 |
| yoctozepto | that said, a feasible implementation would be based off of the current support for hacluster (pacemaker+corosync) | 07:48 |
| yoctozepto | but it needs improvements to be made :/ | 07:49 |
| frickler | why would you want active-passive if you can have active-active? is this only if you can't afford the third controller or is there something else? | 07:55 |
| frickler | don't need to discuss right now, maybe make it a PTG topic? | 07:56 |
| yoctozepto | frickler: FC-backed LVM-based Cinder iSCSI has to be active-passive :-( | 07:59 |
| yoctozepto | 😭 | 08:00 |
| yoctozepto | I mean, it could be active but it's not anyone supports so it is even more work :D | 08:00 |
| frickler | sounds like hell indeed. but that would be a special case then only for the cinder service or would you change everything to match this? | 08:01 |
| yoctozepto | no, for cinder-volume, but I need it controlled by hacluster | 08:01 |
| yoctozepto | I obviously don't know what shyamb wants active-passive for | 08:02 |
| yoctozepto | but I bet the basics required are the same | 08:02 |
| frickler | right, so two dedicated haclustered nodes for cinder-volume might be feasible? | 08:03 |
| yoctozepto | frickler: yeah, I mean, with the current plan I want to reuse the hacluster support we have, have a proper 3-node head (full members) and remotes for everything else (like nova-compute nodes now, for masakari-hostmonitor) - in this case for relevant cinder-volume hosts | 08:05 |
| yoctozepto | I need the cluster to manage fencing, LVM activation and cinder-volume activation, possibly also a VIP for iSCSI | 08:06 |
| yoctozepto | I have this drafted out in my head but it's paused atm | 08:06 |
| yoctozepto | I mean, the implementation | 08:06 |
| yoctozepto | as it is a lesser priority | 08:06 |
| yoctozepto | I guess we will never know what shyamb needed ;D | 08:10 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: veryWIP: Add Opensearch support https://review.opendev.org/c/openstack/kolla-ansible/+/856610 | 08:22 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: veryWIP: Add Opensearch support https://review.opendev.org/c/openstack/kolla-ansible/+/856610 | 08:31 |
| wuchunyang | Hi yoctozepto: Good morning. I have a question about oslo.db 12.1.0 and need your help!!! | 08:37 |
| wuchunyang | https://lists.openstack.org/pipermail/openstack-discuss/2022-September/030317.html | 08:37 |
| wuchunyang | Does 'autocommit' only effect sqlite driver? or all drivers(e.g. mysql)？ thanks in advance. | 08:38 |
| frickler | wuchunyang: I'm pretty sure it affects all drivers | 08:40 |
| opendevreview | Christian Berendt proposed openstack/kolla-ansible master: nova-cell: add external_ceph_always_copy_cinder_keyring parameter https://review.opendev.org/c/openstack/kolla-ansible/+/856239 | 08:42 |
| wuchunyang | frickler: okay, thanks very much. I am really not sure about this. | 08:42 |
| opendevreview | Merged openstack/kolla-ansible stable/wallaby: [docs] Align IPA images urls https://review.opendev.org/c/openstack/kolla-ansible/+/857479 | 08:44 |
| opendevreview | Merged openstack/kolla-ansible stable/yoga: [docs] Align IPA images urls https://review.opendev.org/c/openstack/kolla-ansible/+/857477 | 08:46 |
| opendevreview | Merged openstack/kolla-ansible stable/xena: [docs] Align IPA images urls https://review.opendev.org/c/openstack/kolla-ansible/+/857478 | 08:46 |
| mnasiadka | morning | 08:50 |
| wuchunyang | morning | 09:00 |
| opendevreview | Rafal Lewandowski proposed openstack/kayobe master: updated write_bifrost_clouds_yaml logic https://review.opendev.org/c/openstack/kayobe/+/857594 | 09:03 |
| yoctozepto | wuchunyang: hi; it affects all drivers that it could affect; afaict mysql and postgres should be affected | 09:05 |
| yoctozepto | wuchunyang: I gather that you have found trove affected? | 09:06 |
| yoctozepto | thankfully, it did not hit masakari | 09:07 |
| yoctozepto | and in blazar we have simply workarounded it by enabling autocommit explicitly https://review.opendev.org/c/openstack/blazar/+/856768 | 09:07 |
| opendevreview | Rafal Lewandowski proposed openstack/kayobe master: updated write_bifrost_clouds_yaml logic https://review.opendev.org/c/openstack/kayobe/+/857594 | 09:07 |
| wuchunyang | yes, trove ci starts to failed. and i try to figure it out, it costs me 10 hours with this issue. Just because i forgot to read the openstack mail list. | 09:09 |
| wuchunyang | yoctozepto: thanks for your explanation. | 09:09 |
| opendevreview | Mark Goddard proposed openstack/kayobe master: Use environment variables for plugin paths https://review.opendev.org/c/openstack/kayobe/+/817965 | 09:10 |
| yoctozepto | yw | 09:11 |
| yoctozepto | mgoddard: any chance to get my tenks patches stack approved? https://review.opendev.org/q/project:openstack/tenks+status:open+-is:wip | 09:35 |
| yoctozepto | if some need more discussion than others, let me know, I can rebase and offload the disputable ones | 09:36 |
| opendevreview | Rafal Lewandowski proposed openstack/kayobe master: updated write_bifrost_clouds_yaml logic https://review.opendev.org/c/openstack/kayobe/+/857594 | 10:04 |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible master: [DNM] [CI] Run it all https://review.opendev.org/c/openstack/kolla-ansible/+/857633 | 10:44 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: veryWIP: Add Opensearch support https://review.opendev.org/c/openstack/kolla-ansible/+/856610 | 10:44 |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible stable/yoga: [DNM] [CI] Run it all https://review.opendev.org/c/openstack/kolla-ansible/+/857481 | 10:44 |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible stable/xena: [DNM] [CI] Run it all https://review.opendev.org/c/openstack/kolla-ansible/+/857482 | 10:44 |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible stable/xena: [DNM] [CI] Run it all https://review.opendev.org/c/openstack/kolla-ansible/+/857482 | 10:45 |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible stable/wallaby: [DNM] [CI] Run it all https://review.opendev.org/c/openstack/kolla-ansible/+/857483 | 10:45 |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible stable/wallaby: [DNM] [CI] Run it all https://review.opendev.org/c/openstack/kolla-ansible/+/857483 | 10:45 |
| hrw | Debian builds still fail on CI? | 11:15 |
| frickler | the mirror db needs to be repaired before the mirror can be updated again, seems this will take some more hours | 11:24 |
| yoctozepto | maybe let's avoid the mirror and see how bad that goes? | 11:33 |
| frickler | it will make things more unstable to rely on external network connectivity, but feel free to give it a try | 11:41 |
| hrw | and disable cleaning package cache in non-publish jobs | 11:43 |
| opendevreview | Bartosz Bezak proposed openstack/kayobe master: Move to CentOS Stream 9 / Rocky Linux 9 https://review.opendev.org/c/openstack/kayobe/+/855656 | 12:00 |
| opendevreview | Bartosz Bezak proposed openstack/kayobe master: Move to CentOS Stream 9 / Rocky Linux 9 https://review.opendev.org/c/openstack/kayobe/+/855656 | 12:02 |
| opendevreview | Bartosz Bezak proposed openstack/kayobe master: Move to CentOS Stream 9 / Rocky Linux 9 https://review.opendev.org/c/openstack/kayobe/+/855656 | 12:29 |
| hrw | 14:44 marcin@puchatek:~$ python --version | 12:44 |
| hrw | Python 3.11.0rc2 | 12:44 |
| kevko_ | hi, we are trying to debug some DB connections issues in openstack ... was it good idea to do this ? https://review.opendev.org/c/openstack/kolla-ansible/+/754931 | 12:44 |
| hrw | time to check how kolla reacts ;D | 12:44 |
| opendevreview | Rafal Lewandowski proposed openstack/kayobe master: updated write_bifrost_clouds_yaml logic https://review.opendev.org/c/openstack/kayobe/+/857594 | 13:17 |
| opendevreview | Rafal Lewandowski proposed openstack/kayobe master: updated write_bifrost_clouds_yaml logic https://review.opendev.org/c/openstack/kayobe/+/857594 | 13:28 |
| mnasiadka | mgoddard mnasiadka hrw yoctozepto bbezak parallax Fl1nt frickler adrian-a kevko - meeting in 8 | 13:52 |
| opendevreview | Marcin Juszkiewicz proposed openstack/kolla master: Python 3.8+ has better shutil.copytree() https://review.opendev.org/c/openstack/kolla/+/857709 | 13:52 |
| opendevreview | Rafal Lewandowski proposed openstack/kayobe master: updated write_bifrost_clouds_yaml logic https://review.opendev.org/c/openstack/kayobe/+/857594 | 14:00 |
| mnasiadka | #startmeeting kolla | 14:00 |
| opendevmeet | Meeting started Wed Sep 14 14:00:16 2022 UTC and is due to finish in 60 minutes. The chair is mnasiadka. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
| opendevmeet | The meeting name has been set to 'kolla' | 14:00 |
| mnasiadka | #topic rollcall | 14:00 |
| frickler | \o | 14:00 |
| hrw | (°Y.) | 14:00 |
| mnasiadka | o/ | 14:01 |
| opendevreview | Rafal Lewandowski proposed openstack/kayobe master: updated write_bifrost_clouds_yaml logic https://review.opendev.org/c/openstack/kayobe/+/857594 | 14:01 |
| yoctozepto | o/ | 14:02 |
| mnasiadka | #topic agenda | 14:03 |
| mnasiadka | * CI status | 14:03 |
| mnasiadka | * Release tasks | 14:03 |
| mnasiadka | * Regular stable releases (first meeting in a month) | 14:03 |
| mnasiadka | * Current cycle planning | 14:03 |
| mnasiadka | * Additional agenda (from whiteboard) | 14:03 |
| mnasiadka | * Open discussion | 14:03 |
| mnasiadka | #topic CI status | 14:03 |
| mnasiadka | whiteboard says green | 14:03 |
| yoctozepto | it is | 14:03 |
| mnasiadka | but I noticed k-a jobs that depend on kolla patch are failing on c9s and rl9 | 14:03 |
| yoctozepto | I have also run today all jobs on all supported branches | 14:03 |
| yoctozepto | message:"[DNM] [CI] Run it all" status:open | 14:04 |
| yoctozepto | or: | 14:04 |
| yoctozepto | https://review.opendev.org/q/message:%2522%255BDNM%255D+%255BCI%255D+Run+it+all%2522+status:open | 14:04 |
| mnasiadka | anyway CI green | 14:04 |
| mnasiadka | #topic Release tasks | 14:04 |
| matfechner | o/ | 14:04 |
| bbezak | o/ | 14:05 |
| mnasiadka | next week feature freeze | 14:05 |
| mnasiadka | opensearch and rocky 9 related will probably need an exception | 14:05 |
| mnasiadka | #topic Current cycle planning | 14:06 |
| mnasiadka | speaking of the devil | 14:06 |
| mnasiadka | I worked on opensearch, still in progress | 14:06 |
| mnasiadka | missing opensearch-dashboards deployment | 14:06 |
| mnasiadka | but opensearch with fluentd works properly | 14:06 |
| mnasiadka | hrw: how are we with cs9 Kolla patch? ready to merge? | 14:07 |
| opendevreview | Bartosz Bezak proposed openstack/kayobe master: Move to CentOS Stream 9 / Rocky Linux 9 https://review.opendev.org/c/openstack/kayobe/+/855656 | 14:07 |
| mnasiadka | https://review.opendev.org/c/openstack/kolla/+/836664 | 14:07 |
| hrw | mnasiadka: I would say that it is and then needs some improvements on top | 14:08 |
| mnasiadka | ELK and Grafana should be fixed by OpenSearch | 14:08 |
| hrw | we use cron for logrotate but there is no cron in el9 | 14:08 |
| mnasiadka | and what's the replacement? | 14:08 |
| hrw | systemd timers | 14:08 |
| mnasiadka | fantastic | 14:08 |
| hrw | which we lack in container | 14:08 |
| mnasiadka | then we would need to run a container with systemd and use timers | 14:09 |
| mnasiadka | seems like a followup to the original change | 14:09 |
| yoctozepto | mnasiadka: or the host one | 14:09 |
| hrw | or use host one | 14:10 |
| mnasiadka | yes, that's another option | 14:10 |
| hrw | install logrotate in host OS and point to kolla logs | 14:10 |
| opendevreview | Bartosz Bezak proposed openstack/kayobe master: Move to CentOS Stream 9 / Rocky Linux 9 https://review.opendev.org/c/openstack/kayobe/+/855656 | 14:10 |
| hrw | and then we can deprecate logrotate image | 14:10 |
| mnasiadka | ok then | 14:11 |
| yoctozepto | hrw: well, we need logrotate somewhere | 14:11 |
| yoctozepto | host systemd could run the container | 14:11 |
| yoctozepto | I guess for now it would be easier to introduce systemd in that container? | 14:11 |
| mnasiadka | it might be | 14:12 |
| hrw | yoctozepto: we keep logs on host OS disk so why host's logrotate can not handle it for us? | 14:12 |
| yoctozepto | hrw: no idea | 14:12 |
| mnasiadka | or look for some small alternatives | 14:12 |
| hrw | present in el9 or epel9? | 14:13 |
| mnasiadka | nobody says it needs to be present there, if it's a small Go binary or similar, we can just curl it | 14:13 |
| yoctozepto | cron go? | 14:13 |
| mnasiadka | gocron, clockwork, others, anything :) | 14:14 |
| hrw | mnasiadka: "while true; do logrotate; sleep 1h;done"? | 14:14 |
| mnasiadka | if we move to systemd this cycle - we can use systemd timer on logrotate container :) | 14:14 |
| hrw | CS9 images worked with systemd as init | 14:15 |
| mnasiadka | yes, but if we need that, it should be an exception, not standard | 14:15 |
| yoctozepto | hrw's loop might work well enough | 14:15 |
| hrw | or using host OS logrotate | 14:15 |
| mnasiadka | ok, so - discussion is fine - is there anybody that wants to look into making that work? | 14:16 |
| hrw | each of them has it. and runs it somehow | 14:16 |
| yoctozepto | yeah, I guess kolla might have overcontainerised some services | 14:17 |
| hrw | mnasiadka: assign it to me | 14:17 |
| mnasiadka | #action hrw work on cron alternative | 14:18 |
| mnasiadka | ok then | 14:18 |
| opendevreview | Rafal Lewandowski proposed openstack/kayobe master: updated write_bifrost_clouds_yaml logic https://review.opendev.org/c/openstack/kayobe/+/857594 | 14:18 |
| mnasiadka | so second thing around CS9 Kolla patch - in Zed PTG we decided to not publish cs9 images | 14:18 |
| mnasiadka | and run cs9 jobs as non-voting or experimental to see what's ahead | 14:19 |
| mnasiadka | are we changing that? | 14:19 |
| hrw | I would keep it that way - no publishing | 14:19 |
| mnasiadka | ok, so the patch needs to be updated I guess - there are publish jobs defined | 14:19 |
| hrw | we merge them very late in a cycle so not tested as much yet as usual stuff was tested | 14:19 |
| mnasiadka | well, I guess we want to publish rocky9 images instead - that was the plan | 14:20 |
| hrw | once we have rl9 merged working | 14:20 |
| mnasiadka | maybe not initially | 14:20 |
| mnasiadka | yeah | 14:20 |
| mnasiadka | I'll push a patch based on cs9 one to add rl9 | 14:20 |
| mnasiadka | ok that is solved | 14:20 |
| mnasiadka | bbezak: how's it going with rl9 for Kayobe? | 14:21 |
| bbezak | lovely :). Biggest hurdle till now was dummy interfaces in network manager with network-interfaces role | 14:21 |
| bbezak | but looks promising | 14:22 |
| mnasiadka | so basically network-scripts missing in EL9 | 14:22 |
| mnasiadka | nice | 14:22 |
| mnasiadka | yoctozepto: I noticed you started some reviews on systemd approach - do you think we can merge it this cycle? | 14:22 |
| yoctozepto | mnasiadka: yes, it seems pretty ready; I would go with an exception for it | 14:23 |
| yoctozepto | can review | 14:23 |
| bbezak | however there is compatibility layer NetworkManager-initscripts-updown - https://www.redhat.com/en/blog/rhel-9-networking-say-goodbye-ifcfg-files-and-hello-keyfiles | 14:23 |
| yoctozepto | I just can't commit much time this and the next week | 14:23 |
| mnasiadka | ok, is there any other core that has cycles to review? | 14:23 |
| mnasiadka | because we need a second one | 14:23 |
| yoctozepto | in other words | 14:23 |
| yoctozepto | any other core to review this by the end of September? | 14:23 |
| mnasiadka | yoctozepto: sure, I would probably feel more comfortable to merge it on beginning of Antelope, but it's been hanging there for some time | 14:23 |
| yoctozepto | same thinking here | 14:24 |
| yoctozepto | maybe it's more motivating to merge at the last minute :D | 14:24 |
| mnasiadka | ok, enough about that | 14:25 |
| mnasiadka | Let's Encrypt is also eager to get some reviews, but maybe we need to postpone it as well | 14:25 |
| mnasiadka | ok, let's go forward | 14:25 |
| mnasiadka | #topic Additional agenda (from whiteboard) | 14:25 |
| mnasiadka | (yoctozepto) systemd container control https://review.opendev.org/c/openstack/kolla-ansible/+/816724 | 14:25 |
| yoctozepto | already discussed | 14:26 |
| mnasiadka | ok | 14:26 |
| yoctozepto | please help review, seems reasonable | 14:26 |
| mnasiadka | (mnasiadka) Monasca status | 14:26 |
| mnasiadka | I think hrw mentioned we've had multiple issues with Monasca (not buildable on Jammy, now buildable, similar situation on EL9 I think) | 14:26 |
| hrw | monasca... napalm or thermite? | 14:26 |
| mnasiadka | and then somebody would need to make it work with OpenSearch | 14:27 |
| hrw | we have monasca buildable on x86-64 in Zed | 14:27 |
| hrw | will it be buildable in next cycle? probably after half of cycle | 14:27 |
| mnasiadka | I think we could deprecate this cycle, and if nobody steps up - remove next cycle together with removal of Elasticsearch | 14:27 |
| hrw | +3 | 14:27 |
| yoctozepto | +2 | 14:28 |
| mnasiadka | anybody wants to raise the patch and send a mail to openstack-ml or should I? | 14:28 |
| hrw | and monasca is yet-another-monitoring-as-a-service stuff | 14:28 |
| mnasiadka | ok, so let me do that | 14:30 |
| mnasiadka | #action mnasiadka deprecate Monasca and send mail to ML asking for contributors to step up | 14:30 |
| bbezak | +1 (non core) :) | 14:30 |
| mnasiadka | (yoctozepto) Topics for the PTG (I propose a discussion of Zens of Kolla) | 14:30 |
| mnasiadka | #link https://etherpad.opendev.org/p/kolla-antelope-ptg | 14:31 |
| mnasiadka | I created that | 14:31 |
| mnasiadka | please add topics for the PTG | 14:31 |
| mnasiadka | we also should book an operator hour it seems | 14:32 |
| mnasiadka | should it be last hour of Tue session? | 14:32 |
| yoctozepto | ok | 14:32 |
| mnasiadka | ok, will arrange | 14:33 |
| mnasiadka | #topic Open discussion | 14:33 |
| mnasiadka | any open topics? | 14:33 |
| hrw | I sent patch to use shutil.copytree() better | 14:33 |
| hrw | have one to send which moves from os.path to pathlib | 14:33 |
| yoctozepto | please do | 14:34 |
| mnasiadka | nice, will review | 14:34 |
| opendevreview | Marcin Juszkiewicz proposed openstack/kolla master: Switch from os.path to pathlib https://review.opendev.org/c/openstack/kolla/+/857720 | 14:34 |
| mnasiadka | ok then, let's finish for today | 14:34 |
| mnasiadka | thanks for coming | 14:34 |
| mnasiadka | #endmeeting | 14:34 |
| opendevmeet | Meeting ended Wed Sep 14 14:34:51 2022 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:34 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/kolla/2022/kolla.2022-09-14-14.00.html | 14:34 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/kolla/2022/kolla.2022-09-14-14.00.txt | 14:34 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/kolla/2022/kolla.2022-09-14-14.00.log.html | 14:34 |
| yoctozepto | thanks mnasiadka | 14:35 |
| * yoctozepto off | 14:35 | |
| hrw | mnasiadka: thx | 14:35 |
| opendevreview | Marcin Juszkiewicz proposed openstack/kolla master: Switch from os.path to pathlib https://review.opendev.org/c/openstack/kolla/+/857720 | 15:24 |
| hrw | pep8 | 15:24 |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible master: [DNM] [CI] No external network https://review.opendev.org/c/openstack/kolla-ansible/+/857750 | 17:55 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!