| *** vishalmanchanda_ is now known as vishalmanchanda | 06:12 | |
| *** carloss_ is now known as carloss | 06:12 | |
| opendevreview | Merged openstack/kolla-ansible master: Fix nested mounts of /run/openvswitch https://review.opendev.org/c/openstack/kolla-ansible/+/846969 | 06:42 |
|---|---|---|
| opendevreview | Merged openstack/kolla-ansible stable/wallaby: Increase openstack-exporter timeout to 45 seconds https://review.opendev.org/c/openstack/kolla-ansible/+/844794 | 07:05 |
| mnasiadka | hrw: I can! | 07:28 |
| *** amoralej|off is now known as amoralej | 07:42 | |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible stable/yoga: Fix nested mounts of /run/openvswitch https://review.opendev.org/c/openstack/kolla-ansible/+/846944 | 07:46 |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible stable/xena: Fix nested mounts of /run/openvswitch https://review.opendev.org/c/openstack/kolla-ansible/+/846945 | 07:47 |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible stable/wallaby: Fix nested mounts of /run/openvswitch https://review.opendev.org/c/openstack/kolla-ansible/+/846946 | 07:48 |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible master: [DNM] [CI] backend_host pre-upgrade https://review.opendev.org/c/openstack/kolla-ansible/+/847022 | 07:52 |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible master: [DNM] [CI] backend_host pre- and post-upgrade https://review.opendev.org/c/openstack/kolla-ansible/+/847025 | 07:53 |
| kevko | frickler: +2 and +w ? https://review.opendev.org/c/openstack/kolla/+/818727 << ? | 08:07 |
| opendevreview | Merged openstack/kolla-ansible stable/yoga: CI: cephadm: Add osds/pools/users in one run https://review.opendev.org/c/openstack/kolla-ansible/+/846558 | 09:01 |
| opendevreview | Merged openstack/kolla-ansible stable/xena: CI: cephadm: Add osds/pools/users in one run https://review.opendev.org/c/openstack/kolla-ansible/+/846559 | 09:01 |
| opendevreview | Merged openstack/kolla-ansible stable/wallaby: CI: cephadm: Add osds/pools/users in one run https://review.opendev.org/c/openstack/kolla-ansible/+/846560 | 09:01 |
| mnasiadka | yay | 09:10 |
| hrw | mnasiadka: lovely | 10:34 |
| kevko | https://review.opendev.org/c/openstack/kolla-ansible/+/846946 << bugfix, please anyone for +2 and +w ? | 11:12 |
| *** amoralej is now known as amoralej|lunch | 12:01 | |
| hrw | done | 12:05 |
| opendevreview | Merged openstack/kolla-ansible stable/yoga: Fix nested mounts of /run/openvswitch https://review.opendev.org/c/openstack/kolla-ansible/+/846944 | 12:27 |
| *** mattia is now known as Guest2939 | 12:48 | |
| *** Guest2939 is now known as mattia | 12:51 | |
| *** mattia is now known as blmt | 12:52 | |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible stable/yoga: cinder: start using active-active for rbd https://review.opendev.org/c/openstack/kolla-ansible/+/847151 | 13:02 |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible master: [DNM] [CI] backend_host pre-upgrade https://review.opendev.org/c/openstack/kolla-ansible/+/847022 | 13:03 |
| opendevreview | Merged openstack/kolla-ansible stable/wallaby: Fix nested mounts of /run/openvswitch https://review.opendev.org/c/openstack/kolla-ansible/+/846946 | 13:03 |
| *** amoralej|lunch is now known as amoralej | 13:11 | |
| mnasiadka | mgoddard mnasiadka hrw yoctozepto bbezak parallax Fl1nt frickler adrian-a - meeting in 10 | 13:50 |
| *** rockey_ is now known as rockey | 13:51 | |
| mnasiadka | #startmeeting kolla | 14:00 |
| opendevmeet | Meeting started Wed Jun 22 14:00:03 2022 UTC and is due to finish in 60 minutes. The chair is mnasiadka. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
| opendevmeet | The meeting name has been set to 'kolla' | 14:00 |
| mnasiadka | #topic rollcall | 14:00 |
| mnasiadka | o/ | 14:00 |
| frickler | \o | 14:01 |
| ra-rau | o/ | 14:02 |
| yoctozepto | o/ | 14:02 |
| mnasiadka | #topic agenda | 14:03 |
| mnasiadka | * Review action items from the last meeting | 14:03 |
| mnasiadka | * CI status | 14:03 |
| mnasiadka | * Release tasks | 14:03 |
| mnasiadka | * Regular stable releases (first meeting in a month) | 14:03 |
| mnasiadka | * Current cycle planning | 14:03 |
| mnasiadka | * Additional agenda (from whiteboard) | 14:03 |
| mnasiadka | * Open discussion | 14:03 |
| mnasiadka | #topic Review action items from the last meeting | 14:03 |
| mnasiadka | frickler to continue working on Grafana dashboards | 14:03 |
| mnasiadka | hrw to look for aarch64 failures in yoga/master | 14:03 |
| mnasiadka | mnasiadka add more release liasons | 14:03 |
| mnasiadka | I did mine | 14:03 |
| mnasiadka | hrw is not here | 14:03 |
| mnasiadka | #action hrw to look for aarch64 failures in yoga/master | 14:03 |
| mnasiadka | frickler: ? | 14:03 |
| frickler | I did some dashboard updates, but not finished yet | 14:03 |
| mnasiadka | ok, in progress then | 14:04 |
| mnasiadka | #action frickler to continue working on Grafana dashboards | 14:04 |
| mnasiadka | #topic CI status | 14:04 |
| mnasiadka | yoctozepto: CI all green I guess? | 14:04 |
| yoctozepto | seems so | 14:04 |
| mnasiadka | at least once | 14:04 |
| mnasiadka | #topic Release tasks | 14:04 |
| mnasiadka | This week is R-15 | 14:05 |
| mnasiadka | Yoga Cycle-Trailing Release Deadline | 14:05 |
| mnasiadka | And I think we merged the R-17 patches (switching back to master) | 14:06 |
| mnasiadka | I need to check if we did that for Kayobe | 14:06 |
| mnasiadka | #topic Regular stable releases (first meeting in a month) | 14:06 |
| mnasiadka | frickler: did we merge the regular stable release - first patch that you raised? | 14:07 |
| frickler | yes | 14:07 |
| mnasiadka | fantastic | 14:07 |
| mnasiadka | do we need another one now, or not yet? | 14:07 |
| frickler | in two weeks would be first meeting of July | 14:07 |
| mnasiadka | ok | 14:07 |
| mnasiadka | I'm going to be off first two weeks of July | 14:07 |
| mnasiadka | yoctozepto/frickler: can you run the meetings? | 14:07 |
| frickler | the first one yes, I may be off after that, too | 14:08 |
| yoctozepto | I will be there | 14:08 |
| mnasiadka | ok, I'm leaving 30th (next week Thu - so will run next meeting) - coming back 18th July | 14:08 |
| mnasiadka | #topic Current cycle planning | 14:09 |
| frickler | do we want to discuss Jammy under this topic or later? | 14:09 |
| mnasiadka | That's the topic for it | 14:10 |
| mnasiadka | Thanks for picking up this topic as a joint effort ;-) | 14:10 |
| frickler | well thanks for breaking the things that I had working :-P | 14:10 |
| mnasiadka | Well, I think it makes sense to have the init-runonce patch as separate | 14:11 |
| frickler | first thing: tzdata vs. /etc/timezone, I would suggest to keep it in bindep | 14:11 |
| mnasiadka | I'll raise it later today (unless you've done that already). | 14:11 |
| mnasiadka | Well, bindep is for CI - what about regular users? | 14:11 |
| frickler | btw. we should fix kolla bindep getting used in kolla-ansible jobs | 14:11 |
| yoctozepto | we should probably disable it | 14:11 |
| frickler | the ssh key type patch I didn't do yet | 14:11 |
| frickler | yoctozepto: and then set up the CI environment how? | 14:12 |
| yoctozepto | anyhow, do we still need to mount /etc/timezone? | 14:12 |
| mnasiadka | ok, I'll do it today (the ssh key type patch) as promised | 14:12 |
| mnasiadka | yoctozepto: that's probably a good question | 14:12 |
| yoctozepto | frickler: I think that file is actually just cargoculting stuff | 14:12 |
| frickler | o.k., so make a patch to drop it and we can base jammy on top | 14:13 |
| yoctozepto | roger that | 14:13 |
| frickler | then there are the monasca issues. does anyone really care about monasca? | 14:14 |
| frickler | or phrased differently, who would block just dropping it? | 14:15 |
| yoctozepto | not me | 14:15 |
| mnasiadka | Let's post a patch for it, and see what's the result - but probably would be worth sending a mail to the mailing list. | 14:16 |
| mnasiadka | my company is not relying on it anymore | 14:17 |
| yoctozepto | how badly is it broken? | 14:17 |
| yoctozepto | mnasiadka: wow, that's good to hear | 14:17 |
| mnasiadka | it requires some confluent/kafka libs that are not in distros | 14:17 |
| yoctozepto | ack | 14:17 |
| mnasiadka | I mean it requires newer versions than in distros | 14:17 |
| mnasiadka | So unless somebody wants to put cycles in making it work - we just make it unbuildable for now and try to seek any people wanting to make it alive in Kolla | 14:18 |
| mnasiadka | at least that's my proposal | 14:18 |
| frickler | +1 | 14:18 |
| mnasiadka | anybody wants to take care of this? | 14:18 |
| frickler | I can make a patch but I don't like sending mail | 14:19 |
| mnasiadka | Ok, I can send the mail | 14:19 |
| mnasiadka | probably no answers as always :) | 14:19 |
| frickler | do you want the patch first in order to reference it in the mail? or the other way round? | 14:20 |
| mnasiadka | #action frickler/mnasiadka to handle Monasca being unbuildable (mark as unbuildable, send mail to ML around volunteers to fix, if not submit a patch to drop) | 14:20 |
| mnasiadka | I think we can. create the patch as a result, too much work if somebody wants to pick it up I think | 14:21 |
| mnasiadka | too much work in creating a patch dropping everything ;-) | 14:21 |
| mnasiadka | ok, I guess Jammy topic is more or less clear how to proceed | 14:21 |
| frickler | ok, so I'll wait for answers until next week | 14:21 |
| mnasiadka | are there any other features/patches we'd like to discuss? | 14:22 |
| frickler | does anyone know the state of the podman work? | 14:22 |
| priteau | I would like to discuss the openstack-exporter patch | 14:22 |
| frickler | some time ago they said they are reworking things | 14:22 |
| mnasiadka | I have no clue | 14:23 |
| mnasiadka | priteau: sure, go on | 14:23 |
| mnasiadka | I think yoctozepto and frickler are the reviewers | 14:23 |
| priteau | Indeed | 14:23 |
| priteau | So as a summary: we currently have an old prometheus openstack-exporter, 1.3.0 | 14:23 |
| priteau | I have contributed an update to the latest, 1.6.0 | 14:23 |
| priteau | Problem is that now, by default, openstack-exporter will use the latest Nova API microversion, which makes some metrics unavailable or changes some metadata | 14:24 |
| frickler | #link https://review.opendev.org/c/openstack/kolla-ansible/+/828902 | 14:24 |
| priteau | The microversion can be customised with an environemtn variable | 14:24 |
| priteau | That's the patch | 14:25 |
| priteau | The debate is around the default microversion to use | 14:25 |
| priteau | I was proposing to use 2.1 so metrics stay the same as what we have in Yoga and previous releases | 14:25 |
| priteau | But if the majority thinks we should use latest, I can update my patch | 14:25 |
| priteau | And add an upgrade note explaining how to set the microversion to keep metrics unchanged | 14:26 |
| frickler | so I'm the one with the -1 on it, but open to hearing other opinions | 14:27 |
| mnasiadka | I understand new API is not returning some data? | 14:27 |
| frickler | it doesn't return data that is possibly wrong | 14:28 |
| priteau | They dropped some metrics in Wallaby: https://docs.openstack.org/nova/latest/reference/api-microversion-history.html#maximum-in-wallaby | 14:28 |
| frickler | like the flavor id that a server was created with | 14:28 |
| frickler | which may no longer exist | 14:28 |
| priteau | But also flavor_id is missing | 14:28 |
| priteau | That's an older change, Pike microversion I think, but only visible through openstack-exporter with latest versions | 14:29 |
| frickler | so my argument is nova made these changes for a reason and we shouldn't override them by default | 14:30 |
| frickler | I'm fine with keeping the old behavior in stable backports | 14:30 |
| frickler | deployers can still override if they choose to going forward | 14:31 |
| priteau | Would we update openstack-exporter in stable? | 14:31 |
| frickler | not sure, would we? we did backport the skydive update | 14:32 |
| priteau | I believe I checked the output of metrics, if we use Nova API 2.1, the existing metrics are not modified | 14:32 |
| priteau | Well, skydive was fixing a bug | 14:32 |
| mnasiadka | We normally bump versions of those external infra components in stable branches | 14:32 |
| priteau | openstack-exporter update would add a number of new metrics, but shouldn't be a problem | 14:32 |
| mnasiadka | As long as it does not break anything it’s fine | 14:33 |
| frickler | there are some bugfixes in 1.4.0 at least, so I think we do want to backport | 14:34 |
| mnasiadka | So, default to latest microversion in Zed, backport with old microversion (but overridable) - does that sound ok? | 14:34 |
| priteau | In a way I would have preferred if the exporter used 2.1 as default, which I believe is what CLI clients do? You need to explicitly give the microversion you want to use if not default | 14:34 |
| priteau | mnasiadka: yes, I think so. | 14:34 |
| mnasiadka | Good :) | 14:35 |
| frickler | that's a bug in OSC rather than a feature | 14:35 |
| priteau | I understand frickler's arguments, no one else agrees or disagrees strongly, so I'll adapt the patch | 14:35 |
| mnasiadka | Thanks | 14:35 |
| priteau | Thanks for taking the time to discuss this | 14:36 |
| mnasiadka | frickler: podman state is unknown to me - yoctozepto probably is the assigned reviewer | 14:36 |
| yoctozepto | I dont | 14:36 |
| yoctozepto | know either | 14:36 |
| yoctozepto | sorry | 14:36 |
| mnasiadka | So be it | 14:36 |
| mnasiadka | #topic Open discussion | 14:36 |
| mnasiadka | Anybody anything? | 14:37 |
| frickler | I revived an old patch to use clouds.yaml instead of openrc https://review.opendev.org/c/openstack/kolla-ansible/+/452005 | 14:37 |
| frickler | also the test with updated ansible version in zuul went well, so we are prepared for that | 14:38 |
| mnasiadka | Ok, makes sense, but we’re still going to template out openrc? Kayobe uses that | 14:38 |
| frickler | we will do it for now, but IMO we should deprecate it | 14:39 |
| yoctozepto | I agree with frickler | 14:39 |
| frickler | but not urgent, so maybe a topic for next ptg | 14:39 |
| mnasiadka | Deprecation is ok, we just need to adapt | 14:39 |
| yoctozepto | I think we can deprecate this cycle | 14:39 |
| mnasiadka | +1 | 14:40 |
| frickler | it also mainly is about CI I think | 14:40 |
| frickler | not about how deployments use it. we have clouds.yaml in OSISM for quite some time | 14:40 |
| headphoneJames | if possible, a review of Let's Encrypt is still most welcome: https://review.opendev.org/c/openstack/kolla-ansible/+/741340 | 14:41 |
| mnasiadka | headphoneJames: thanks for reminding | 14:43 |
| mnasiadka | Ok, thanks for attending | 14:43 |
| mnasiadka | See you next week | 14:43 |
| mnasiadka | #endmeeting | 14:43 |
| opendevmeet | Meeting ended Wed Jun 22 14:43:44 2022 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:43 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/kolla/2022/kolla.2022-06-22-14.00.html | 14:43 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/kolla/2022/kolla.2022-06-22-14.00.txt | 14:43 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/kolla/2022/kolla.2022-06-22-14.00.log.html | 14:43 |
| frickler | thx mnasiadka | 14:45 |
| yoctozepto | thx mnasiadka | 14:46 |
| frickler | there was a patch in devstack tuning malloc for python threads, not sure if we'd want to copy https://review.opendev.org/c/openstack/devstack/+/845805 | 14:46 |
| yoctozepto | interesting | 14:47 |
| frickler | and this one from osa I also found interesting, though it seems we don't do CSP at all yet? https://review.opendev.org/c/openstack/openstack-ansible-haproxy_server/+/846473 | 14:48 |
| opendevreview | Pierre Riteau proposed openstack/kolla-ansible master: Fix typo in prometheus-node-exporter restart handler https://review.opendev.org/c/openstack/kolla-ansible/+/847179 | 14:52 |
| opendevreview | Pierre Riteau proposed openstack/kolla-ansible master: Support setting Nova API microversion for openstack-exporter https://review.opendev.org/c/openstack/kolla-ansible/+/828902 | 14:55 |
| opendevreview | Pierre Riteau proposed openstack/kolla master: Bump prometheus-openstack-exporter version to 1.6.0 https://review.opendev.org/c/openstack/kolla/+/845601 | 14:57 |
| priteau | I updated both patches for openstack-exporter | 14:58 |
| *** blmt is now known as mattia | 15:19 | |
| *** mattia is now known as blmt | 15:20 | |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: Add support for Ubuntu Jammy Jellyfish (22.04 LTS) https://review.opendev.org/c/openstack/kolla-ansible/+/846070 | 15:33 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: init-runonce: Migrate to ecdsa keys https://review.opendev.org/c/openstack/kolla-ansible/+/847187 | 15:36 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: Add support for Ubuntu Jammy Jellyfish (22.04 LTS) https://review.opendev.org/c/openstack/kolla-ansible/+/846070 | 15:41 |
| hrw | frickler: monasca/x86-64 builds for Debian, CS8, CS9, Ubuntu/20.04 as they use python 3.6 - 3.9 so use upstream provided wheel file. | 16:21 |
| hrw | frickler: Ubuntu 22.04 uses Python 3.10 so no wheel == no monasca | 16:22 |
| hrw | frickler: aarch64 do not have wheel == no monasca | 16:22 |
| hrw | frickler: we can make ubuntu/22.04 use upstream confluent repos and build confluent-kafka-python during building an image. but it is time consuming | 16:23 |
| mnasiadka | hrw: so basically in Zed the final situation (unless somebody steps up) is that we'll have Monasca buildable for Debian and CS9/RockyLinux9 | 17:36 |
| hrw | mnasiadka: yes | 17:37 |
| hrw | mnasiadka: and x86-64 only | 17:37 |
| mnasiadka | yes, that's what I meant | 17:37 |
| hrw | mnasiadka: I wrote about it on openstack-discuss few days ago. no reponse | 17:38 |
| mnasiadka | hrw: so mailing to ML step is done ;) | 17:38 |
| mnasiadka | Let's see how that evolves, but I don't see anybody putting in cycles/caring for Monasca in Kolla anymore - so we might drop off some weight sooner or later. | 17:39 |
| hrw | mnasiadka: deprecate in Zed, drop in Atlas? | 17:40 |
| mnasiadka | might be, let's discuss it again on next meeting - if nobody replies to your mail. | 17:41 |
| hrw | iirc aarch64 failures got sorted by disabling monasca. ubuntu/aarch64 fails due to rmq/erlang situation | 17:41 |
| *** amoralej is now known as amoralej|off | 17:56 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!