| *** kevko_ has quit IRC | 00:02 | |
| *** kevko_ has joined #openstack-kolla | 00:36 | |
| *** LinPeiWen has joined #openstack-kolla | 00:49 | |
| *** kevko_ has quit IRC | 00:52 | |
| *** wuchunyang has joined #openstack-kolla | 01:01 | |
| *** zzzeek has quit IRC | 01:07 | |
| *** zzzeek has joined #openstack-kolla | 01:08 | |
| *** zzzeek has quit IRC | 01:33 | |
| *** zzzeek has joined #openstack-kolla | 01:35 | |
| *** k_mouza has joined #openstack-kolla | 01:50 | |
| *** k_mouza has quit IRC | 01:54 | |
| *** zzzeek has quit IRC | 01:54 | |
| *** zzzeek has joined #openstack-kolla | 01:57 | |
| *** zzzeek has quit IRC | 02:55 | |
| *** zzzeek has joined #openstack-kolla | 02:57 | |
| *** zzzeek has quit IRC | 03:30 | |
| *** zzzeek has joined #openstack-kolla | 03:31 | |
| *** skramaja has joined #openstack-kolla | 03:52 | |
| *** dasTor has quit IRC | 03:57 | |
| *** wuchunyang has quit IRC | 04:01 | |
| *** wuchunyang has joined #openstack-kolla | 04:22 | |
| *** wuchunyang has quit IRC | 04:26 | |
| *** vishalmanchanda has joined #openstack-kolla | 04:44 | |
| *** ivan_lin has quit IRC | 04:46 | |
| *** ivan_lin has joined #openstack-kolla | 04:46 | |
| *** cah_link has joined #openstack-kolla | 05:25 | |
| *** wuchunyang has joined #openstack-kolla | 05:36 | |
| *** dasTor has joined #openstack-kolla | 05:37 | |
| openstackgerrit | Lin PeiWen proposed openstack/kolla-ansible master: Use Docker healthchecks for rabbitmq services https://review.opendev.org/c/openstack/kolla-ansible/+/780407 | 05:47 |
|---|---|---|
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: mariadb: Fix wsrep notify script https://review.opendev.org/c/openstack/kolla-ansible/+/786036 | 06:31 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: mariadb: Update wsrep notify script for Debian Bullseye https://review.opendev.org/c/openstack/kolla-ansible/+/786036 | 06:32 |
| *** emccormick has quit IRC | 06:34 | |
| *** macz_ has joined #openstack-kolla | 06:34 | |
| *** PrinzElvis has quit IRC | 06:34 | |
| *** kevko_ has joined #openstack-kolla | 06:35 | |
| *** lxkong has quit IRC | 06:35 | |
| *** emccormick has joined #openstack-kolla | 06:37 | |
| *** lxkong has joined #openstack-kolla | 06:37 | |
| *** PrinzElvis has joined #openstack-kolla | 06:37 | |
| *** macz_ has quit IRC | 06:38 | |
| *** luksky has joined #openstack-kolla | 07:11 | |
| oklhost | morning | 07:14 |
| *** andrewbonney has joined #openstack-kolla | 07:14 | |
| *** bengates has joined #openstack-kolla | 07:17 | |
| *** bengates has quit IRC | 07:18 | |
| *** bengates has joined #openstack-kolla | 07:19 | |
| *** bengates has quit IRC | 07:26 | |
| *** bengates has joined #openstack-kolla | 07:27 | |
| *** k_mouza has joined #openstack-kolla | 07:30 | |
| *** k_mouza has quit IRC | 07:34 | |
| *** e0ne has joined #openstack-kolla | 07:54 | |
| *** rpittau|afk is now known as rpittau | 07:55 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla master: move to Debian 'bullseye' https://review.opendev.org/c/openstack/kolla/+/772479 | 07:57 |
| mnasiadka | hrw, yoctozepto: we need https://review.opendev.org/c/openstack/kolla-ansible/+/786036 and https://review.opendev.org/c/openstack/kolla/+/772479 to move to Bullseye - seems it's working :) | 07:58 |
| hrw | just as I was looking for it at gerrit ;D | 07:58 |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe stable/stein: Revert "Performance: skip LVM configuration if no groups configured" https://review.opendev.org/c/openstack/kayobe/+/783337 | 07:59 |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe stable/train: Revert "Performance: skip LVM configuration if no groups configured" https://review.opendev.org/c/openstack/kayobe/+/783316 | 07:59 |
| hrw | mnasiadka: please add comment "as we have mariadb 10.5, this and that was changed so we have to do this' | 07:59 |
| hrw | +1 + comment | 08:01 |
| *** gfidente|afk is now known as gfidente | 08:01 | |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: move to Debian 'bullseye' https://review.opendev.org/c/openstack/kolla/+/772479 | 08:02 |
| hrw | dropped changelog from commit message | 08:02 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: mariadb: Update wsrep notify script for Debian Bullseye https://review.opendev.org/c/openstack/kolla-ansible/+/786036 | 08:03 |
| *** fuhrmannb has joined #openstack-kolla | 08:03 | |
| mnasiadka | I updated the second change in the same time, let me run recheck on Kolla change ;) | 08:06 |
| hrw | +2 | 08:06 |
| yoctozepto | mnasiadka: does not the timeout affect other versions as well? | 08:07 |
| mnasiadka | yoctozepto: well, if by affect you mean if we saw it failing due to that - I think not, but really we should drop that wsrep-notify script | 08:08 |
| mnasiadka | I just don't want to do it at this state of a cycle :) | 08:08 |
| yoctozepto | mnasiadka: what will we replace it with? | 08:09 |
| yoctozepto | did I miss something? | 08:09 |
| mnasiadka | yoctozepto: we don't need it since we have clustercheck | 08:09 |
| mnasiadka | yoctozepto: that script only renames the haproxy user - we needed that when we did do haproxy level healthchecks on the DB | 08:09 |
| mnasiadka | yoctozepto: clustercheck makes more ,,advanced'' checks to check if the galera node is usable | 08:10 |
| yoctozepto | mnasiadka: ah, it's pre-xinetd then | 08:10 |
| yoctozepto | I remember | 08:10 |
| yoctozepto | did not we deprecate this monstrosity? | 08:11 |
| yoctozepto | perhaps we can drop it indeed | 08:11 |
| mnasiadka | I have no clue | 08:11 |
| yoctozepto | at least we should not use it with clustercheck | 08:11 |
| mnasiadka | well, right | 08:12 |
| mnasiadka | We can skip connect-timeout - but I think mariadb locally should respond in 3 seconds :) | 08:12 |
| mnasiadka | And in Bullseye I've seen that this script when called by mariadb - it made the DB ,,hang'' - no connections could be made to MariaDB even over network | 08:13 |
| mnasiadka | but maybe it was because mysql.user is a view now :) | 08:13 |
| *** ivan_lin has quit IRC | 08:21 | |
| *** ivan_lin has joined #openstack-kolla | 08:21 | |
| kevko_ | i think connection timeout is ok, if it is less then time when haproxy will start report backend is down | 08:26 |
| kevko_ | (and I don't know how much it is ) | 08:26 |
| kevko_ | mnasiadka and yes , wsrep notify is dirty thing | 08:26 |
| yoctozepto | mnasiadka: can we skip wsrep-notify if clustercheck is used? | 08:33 |
| mnasiadka | yoctozepto: sure we can | 08:33 |
| yoctozepto | let's run all deprec/obsolete/drop we can | 08:33 |
| yoctozepto | thanks mnasiadka | 08:33 |
| *** macz_ has joined #openstack-kolla | 08:35 | |
| hrw | will have to build images for aarch64 and check locally | 08:35 |
| *** ricolin has quit IRC | 08:39 | |
| *** macz_ has quit IRC | 08:39 | |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe master: Remove ntp.yml configuration file https://review.opendev.org/c/openstack/kayobe/+/786181 | 09:04 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: mariadb: Disable wsrep-notify script if clustercheck enabled https://review.opendev.org/c/openstack/kolla-ansible/+/786182 | 09:06 |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe master: Fix typo in CI playbook https://review.opendev.org/c/openstack/kayobe/+/786190 | 09:30 |
| *** hjensas|afk is now known as hjensas | 09:36 | |
| *** jovial[m] has quit IRC | 09:43 | |
| *** kevko_ has quit IRC | 09:44 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: mariadb: Disable wsrep-notify script if clustercheck enabled https://review.opendev.org/c/openstack/kolla-ansible/+/786182 | 09:46 |
| *** jovial[m] has joined #openstack-kolla | 09:48 | |
| yoctozepto | mnasiadka: have you verified that deprec/obsoletion? happened/not? | 09:56 |
| openstackgerrit | Merged openstack/kayobe stable/victoria: Fix overcloud provision with fast track enabled https://review.opendev.org/c/openstack/kayobe/+/785331 | 09:57 |
| mnasiadka | yoctozepto: nope it didn't | 09:57 |
| *** kevko_ has joined #openstack-kolla | 10:00 | |
| yoctozepto | mnasiadka: then prime time, started failing on bullseye - no longer supported :-) | 10:03 |
| yoctozepto | since we already want to get rid of it | 10:03 |
| yoctozepto | I somehow missed that we did not | 10:03 |
| yoctozepto | I wonder if it has a good reason | 10:03 |
| mnasiadka | well, now that we default to clustercheck - we don't have any good reason to keep it | 10:04 |
| mnasiadka | and it keeps failing on renaming the haproxy user when it can't connect to the DB and so on | 10:04 |
| mnasiadka | so, do we want to deprecate wsrep-notify, or deprecate haproxy/mariadb without clustercheck? | 10:05 |
| *** wuchunyang has quit IRC | 10:05 | |
| yoctozepto | mnasiadka: I guess wsrep-notify; we can let users break themselves by disabling clustercheck, why not ;-) | 10:06 |
| yoctozepto | depends on what to guard against | 10:06 |
| yoctozepto | on single node it does not make sense to use either | 10:06 |
| yoctozepto | so | 10:06 |
| yoctozepto | ah this lovely time when we go berserk in deprecations... | 10:07 |
| hrw | ;D | 10:07 |
| hrw | I checked deprecation of binary images. Debian and Ubuntu build fine without external openstack repos. CentOS needs openstack repos | 10:08 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla master: move to Debian 'bullseye' https://review.opendev.org/c/openstack/kolla/+/772479 | 10:09 |
| yoctozepto | hrw: though I wonder how they work | 10:10 |
| yoctozepto | did not UCA bump up things like libvirt? | 10:10 |
| hrw | probably | 10:25 |
| kevko_ | hi, | 10:30 |
| kevko_ | how much time between joined and synced is normal ? | 10:31 |
| kevko_ | [mariadb] | 10:31 |
| kevko_ | i have something about 5 minutes (test cloud deployed on vms on openstack) | 10:32 |
| *** Luzi has joined #openstack-kolla | 10:46 | |
| parallax | kevko_: depends on the amount of data in the cluster | 10:47 |
| kevko_ | parallax: well, empty dbs .. it's just fresh env ... | 10:48 |
| kevko_ | parallax: but maybe really slow disks .. before they dies | 10:48 |
| kevko_ | parallax: because when I m reconfiguring ..I almost always faild on wait for wsrep synced ..so trying to figure out how to change not only "hard coded" retries and deplay | 10:49 |
| parallax | Should be instantaneous then | 10:50 |
| mnasiadka | kevko_: 5 minutes for syncing an empty log? that's awesome! :) | 10:56 |
| kevko_ | mnasiadka: :) | 11:02 |
| kevko_ | mnasiadka: well it's actually bigger :) | 11:02 |
| kevko_ | mnasiadka: | wsrep_local_state_comment | Joined | | 11:02 |
| kevko_ | | wsrep_local_state_uuid | 7e0a8cca-9b90-11eb-a7ca-9b5bedd1b90f | | 11:02 |
| kevko_ | | wsrep_open_connections | 0 | | 11:02 |
| kevko_ | | wsrep_open_transactions | 0 | | 11:02 |
| kevko_ | | wsrep_protocol_version | 9 | | 11:02 |
| kevko_ | | wsrep_provider_name | Galera | | 11:02 |
| kevko_ | | wsrep_provider_vendor | Codership Oy <info@codership.com> | | 11:02 |
| kevko_ | | wsrep_provider_version | 3.25(rddf9876) | | 11:02 |
| kevko_ | | wsrep_ready | OFF | | 11:02 |
| kevko_ | | wsrep_received | 1684 | | 11:02 |
| kevko_ | | wsrep_received_bytes | 1425412 | 11:02 |
| mnasiadka | kevko_: 1.5 megabyte? nice | 11:13 |
| kevko_ | mnasiadka: well, i really don't know why it is so slow .. | 11:13 |
| hrw | meh. grafana repo broke builds | 11:21 |
| mnasiadka | maybe it's time to setup a mirror@infra ;) | 11:23 |
| hrw | no | 11:27 |
| hrw | as then you would follow with elasticsearch, rabbitmq, erlang... | 11:28 |
| mnasiadka | hrw: https://review.opendev.org/c/openstack/kolla-ansible/+/786182 - need another +2 and we have this mariadb crap solved | 11:33 |
| hrw | done | 11:34 |
| * hrw deploys on aarch64 | 11:34 | |
| yoctozepto | mnasiadka: could you kickstart the wsrep-notify deprecation in gerrit? | 11:37 |
| mnasiadka | yoctozepto: that's my plan | 11:37 |
| yoctozepto | great! :D | 11:37 |
| mnasiadka | do we have the meeting today? | 11:45 |
| *** hrw has quit IRC | 11:50 | |
| *** hrw has joined #openstack-kolla | 12:08 | |
| yoctozepto | yes, I can chair | 12:12 |
| yoctozepto | we have agenda ;-) | 12:12 |
| *** luksky has quit IRC | 12:20 | |
| *** luksky has joined #openstack-kolla | 12:20 | |
| *** luksky has quit IRC | 12:21 | |
| hrw | yepFAILED - RETRYING: Wait for MariaDB service port liveness (4 retries left). | 12:21 |
| *** luksky has joined #openstack-kolla | 12:21 | |
| hrw | (kolla) 14:21 (1s) hrw@jagular:kolla$ mysql -h 192.168.200.241 -u root -p | 12:21 |
| hrw | Enter password: | 12:21 |
| hrw | but then hangs after providing whatever | 12:21 |
| *** wuchunyang has joined #openstack-kolla | 12:35 | |
| *** macz_ has joined #openstack-kolla | 12:36 | |
| *** hrw has quit IRC | 12:36 | |
| openstackgerrit | Merged openstack/kolla-ansible master: mariadb: Disable wsrep-notify script if clustercheck enabled https://review.opendev.org/c/openstack/kolla-ansible/+/786182 | 12:37 |
| *** macz_ has quit IRC | 12:41 | |
| *** wuchunyang has quit IRC | 12:42 | |
| *** hrw has joined #openstack-kolla | 12:44 | |
| *** Luzi has quit IRC | 12:44 | |
| hrw | had anyone said something after '14:21 < hrw> but then hangs after providing whatever'? | 12:46 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: mariadb: Deprecate wsrep-notify.sh https://review.opendev.org/c/openstack/kolla-ansible/+/786245 | 13:05 |
| mnasiadka | hrw: do you have the change for disabling wsrep-notify.sh? | 13:05 |
| mnasiadka | hrw: that merged some minutes ago? | 13:05 |
| mnasiadka | hrw: https://review.opendev.org/c/openstack/kolla-ansible/+/786182 | 13:05 |
| yoctozepto | it's green in the CI so I would assume hrw does not | 13:11 |
| *** hrw has quit IRC | 13:11 | |
| yoctozepto | hrw is b0rken | 13:13 |
| *** hrw has joined #openstack-kolla | 13:16 | |
| mnasiadka | maybe now hrw is unbroken | 13:18 |
| *** hrw has quit IRC | 13:21 | |
| *** k_mouza has joined #openstack-kolla | 13:24 | |
| mnasiadka | or not :) | 13:27 |
| *** ricolin has joined #openstack-kolla | 13:34 | |
| *** skramaja has quit IRC | 13:34 | |
| *** k_mouza has quit IRC | 13:47 | |
| *** sorin-mihai has quit IRC | 13:50 | |
| *** k_mouza has joined #openstack-kolla | 13:54 | |
| *** samcat116 has joined #openstack-kolla | 13:59 | |
| openstackgerrit | Jan Horstmann proposed openstack/kolla-ansible master: Allow override of rabbitmq config in kolla toolbox https://review.opendev.org/c/openstack/kolla-ansible/+/785595 | 14:00 |
| *** baha has joined #openstack-kolla | 14:13 | |
| *** k_mouza has quit IRC | 14:20 | |
| *** samcat116 has quit IRC | 14:28 | |
| *** wuchunya_ has joined #openstack-kolla | 14:28 | |
| yoctozepto | oh well | 14:30 |
| yoctozepto | mgoddard is vacationing | 14:30 |
| yoctozepto | hrw b0rken | 14:30 |
| yoctozepto | it seems it's only me and you, mnasiadka | 14:30 |
| yoctozepto | we have to proteccc the gatezzz | 14:30 |
| *** wuchunya_ has quit IRC | 14:33 | |
| mnasiadka | yoctozepto: seen this https://review.opendev.org/c/openstack/kolla/+/785350 ? | 14:35 |
| *** samcat116 has joined #openstack-kolla | 14:37 | |
| yoctozepto | mnasiadka: yeah, but hrw told me the gates are back on track | 14:37 |
| mnasiadka | so should we ask Rico Lin to abandon? | 14:38 |
| yoctozepto | still, I think hrw does not care about centos aarch64 | 14:38 |
| mnasiadka | so if hrw does not care, why should we waste Linaro CI cycles on that? | 14:38 |
| yoctozepto | so it's droppable but due to different reasons | 14:38 |
| yoctozepto | add him to that before approving | 14:38 |
| mnasiadka | yoctozepto: there's a second change to add it back ;) | 14:39 |
| mnasiadka | I think it's only to delete some stale jobs or something... | 14:39 |
| yoctozepto | added him | 14:39 |
| yoctozepto | mnasiadka: yeah, it was | 14:39 |
| yoctozepto | it's written in the very message | 14:40 |
| yoctozepto | aarch64 queue was stuck | 14:40 |
| yoctozepto | I got a spam afterward | 14:40 |
| yoctozepto | still left some around | 14:40 |
| yoctozepto | no time to delete | 14:40 |
| *** samcat116 has quit IRC | 14:50 | |
| *** macz_ has joined #openstack-kolla | 14:50 | |
| *** k_mouza has joined #openstack-kolla | 14:50 | |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: Additional small changes in role/mariadb https://review.opendev.org/c/openstack/kolla-ansible/+/785657 | 14:54 |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: Rename role haproxy to loadbalancer https://review.opendev.org/c/openstack/kolla-ansible/+/770618 | 14:54 |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: Add proxysql support for database https://review.opendev.org/c/openstack/kolla-ansible/+/770215 | 14:54 |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: Edit services roles to support database sharding https://review.opendev.org/c/openstack/kolla-ansible/+/770216 | 14:54 |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: [CI] Test ProxySQL with shards in the nova cells scenario https://review.opendev.org/c/openstack/kolla-ansible/+/770621 | 14:55 |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: Move config.yml to config-node.yml in mariadb role https://review.opendev.org/c/openstack/kolla-ansible/+/783563 | 14:55 |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: Add mariadb arbitrator to mariadb role https://review.opendev.org/c/openstack/kolla-ansible/+/780811 | 14:55 |
| *** samcat116 has joined #openstack-kolla | 14:55 | |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: [CI] Test Mariadb-Arbitrator with shards in the nova cells scenario https://review.opendev.org/c/openstack/kolla-ansible/+/780970 | 14:55 |
| yoctozepto | mnasiadka: https://review.opendev.org/c/openstack/kolla-ansible/+/785657 | 14:56 |
| yoctozepto | make kevko happy | 14:56 |
| yoctozepto | well, kevko_* | 14:56 |
| yoctozepto | and mnasiadka: https://review.opendev.org/c/openstack/kolla-ansible/+/744235 | 14:57 |
| * yoctozepto starting the meeting | 14:59 | |
| yoctozepto | mgoddard mnasiadka hrw egonzalez yoctozepto rafaelweingartne cosmicsound osmanlicilegi bbezak parallax Fl1nt | 15:00 |
| yoctozepto | meeting now | 15:00 |
| yoctozepto | #startmeeting kolla | 15:00 |
| openstack | Meeting started Wed Apr 14 15:00:13 2021 UTC and is due to finish in 60 minutes. The chair is yoctozepto. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
| *** openstack changes topic to " (Meeting topic: kolla)" | 15:00 | |
| openstack | The meeting name has been set to 'kolla' | 15:00 |
| yoctozepto | #topic Roll-call | 15:00 |
| *** openstack changes topic to "Roll-call (Meeting topic: kolla)" | 15:00 | |
| yoctozepto | \o/ | 15:01 |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: Add mariadb arbitrator to mariadb role https://review.opendev.org/c/openstack/kolla-ansible/+/780811 | 15:01 |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: [CI] Test Mariadb-Arbitrator with shards in the nova cells scenario https://review.opendev.org/c/openstack/kolla-ansible/+/780970 | 15:01 |
| headphoneJames | o/ | 15:01 |
| mnasiadka | o/ | 15:01 |
| *** wuchunya_ has joined #openstack-kolla | 15:02 | |
| yoctozepto | it's not quantity but quality that counts they say | 15:03 |
| yoctozepto | #topic Agenda | 15:03 |
| *** openstack changes topic to "Agenda (Meeting topic: kolla)" | 15:03 | |
| yoctozepto | * Roll-call | 15:03 |
| yoctozepto | * Announcements | 15:03 |
| yoctozepto | ** mgoddard on holiday this week | 15:03 |
| yoctozepto | ** Xena PTG next week! https://etherpad.opendev.org/p/kolla-xena-ptg | 15:03 |
| yoctozepto | ** OpenStack User Survey 2020 is in! https://www.openstack.org/analytics | 15:03 |
| yoctozepto | * Review action items from the last meeting | 15:03 |
| yoctozepto | * CI status | 15:03 |
| yoctozepto | * Review requests | 15:03 |
| yoctozepto | * Wallaby release planning | 15:03 |
| yoctozepto | ** Debian bullseye progress | 15:03 |
| yoctozepto | * Xena PTG planning https://etherpad.opendev.org/p/kolla-xena-ptg | 15:03 |
| yoctozepto | #topic Announcements | 15:04 |
| *** openstack changes topic to "Announcements (Meeting topic: kolla)" | 15:04 | |
| yoctozepto | mgoddard on holiday this week | 15:04 |
| yoctozepto | all wish him a good rest; he deserves it ;-) | 15:04 |
| yoctozepto | Xena PTG next week! https://etherpad.opendev.org/p/kolla-xena-ptg | 15:04 |
| yoctozepto | yeas! it's this time of the year again | 15:05 |
| yoctozepto | grab your entry cards and join us on the ptg | 15:05 |
| yoctozepto | and add discussion topics to the etherpad | 15:05 |
| mnasiadka | it's this week where you end up exhausted like after running a marathon? ;) | 15:06 |
| yoctozepto | mnasiadka: yeah, I already feel it in my bones, ouch | 15:06 |
| yoctozepto | but it's worth the effort! :D | 15:06 |
| yoctozepto | #info OpenStack User Survey 2020 is in! https://www.openstack.org/analytics | 15:06 |
| yoctozepto | 15% of deployments are powered by kolla | 15:07 |
| yoctozepto | kolla stronk | 15:07 |
| mnasiadka | 17% of deployments on Stein? :) | 15:07 |
| mnasiadka | and Queens | 15:08 |
| mnasiadka | yay | 15:08 |
| yoctozepto | yeas ;-) | 15:08 |
| yoctozepto | many sad numbers there | 15:08 |
| mnasiadka | 2% of people using Kolla-Kubernetes | 15:09 |
| mnasiadka | good one | 15:09 |
| yoctozepto | more masakari than blazar priteau | 15:09 |
| * yoctozepto feels the pressure | 15:09 | |
| yoctozepto | yeah, kolla-kubernetes kills the system | 15:09 |
| mnasiadka | oh, TripleO only used in 10% deployments and K-A in 15% | 15:09 |
| mnasiadka | that's interesting | 15:09 |
| yoctozepto | yeah, I wonder what those using RHOSP chose | 15:10 |
| yoctozepto | some might be remembering the good ol' days of puppet | 15:10 |
| mnasiadka | Which OpenStack Network (Neutron) drivers are you using? - this is my readability winner | 15:10 |
| yoctozepto | well, and pure "ansible" is interesting as the deployment choice | 15:11 |
| yoctozepto | yeah, re neutron I have no idea who looked at this and thought: yeas, it's perfect to display ;D | 15:12 |
| yoctozepto | only table makes sense for that | 15:12 |
| yoctozepto | and sorted by pop | 15:12 |
| yoctozepto | but meh | 15:12 |
| yoctozepto | well, anyhow | 15:13 |
| wuchunya_ | ubuntu used 40% | 15:13 |
| yoctozepto | in storage ceph is the king | 15:13 |
| mnasiadka | nothing new | 15:14 |
| yoctozepto | wuchunya_: yeah but it's for 2020 and centos+rhel = 47 | 15:14 |
| *** wuchunya_ is now known as wuchunyang | 15:14 | |
| yoctozepto | but hard to tell if they overlap or not | 15:14 |
| yoctozepto | perhaps they do | 15:14 |
| yoctozepto | nowadays ubuntu would probably be getting a boost | 15:14 |
| yoctozepto | many simply decided to migrate to ubuntu | 15:14 |
| yoctozepto | for lolz: more windows than suse | 15:15 |
| yoctozepto | all right, enough dwelling on stats | 15:15 |
| yoctozepto | #topic Review action items from the last meeting | 15:15 |
| *** openstack changes topic to "Review action items from the last meeting (Meeting topic: kolla)" | 15:15 | |
| yoctozepto | mgoddard email openstack-discuss about quay.io credentials | 15:16 |
| yoctozepto | he did not | 15:16 |
| yoctozepto | #action mgoddard email openstack-discuss about quay.io credentials | 15:16 |
| yoctozepto | yoctozepto deprecate enable_host_ntp | 15:16 |
| yoctozepto | he did not either | 15:16 |
| yoctozepto | #action yoctozepto deprecate enable_host_ntp | 15:16 |
| yoctozepto | #topic CI status | 15:16 |
| *** openstack changes topic to "CI status (Meeting topic: kolla)" | 15:16 | |
| yoctozepto | I was not angry at CI so it must be pretty green | 15:17 |
| yoctozepto | I like quay so far | 15:17 |
| yoctozepto | it only failed once since | 15:17 |
| yoctozepto | move to Bullseye needs mariadb work | 15:17 |
| yoctozepto | ^ that has happened already | 15:17 |
| yoctozepto | removing | 15:17 |
| mnasiadka | yep, we're waiting for hrw to test on aarch | 15:18 |
| yoctozepto | nobody cares about monasca-grafana I guess? | 15:18 |
| mnasiadka | seems so | 15:19 |
| mnasiadka | are we deprecating in W or in X? | 15:19 |
| yoctozepto | kayobe looks green too | 15:19 |
| yoctozepto | mnasiadka: would ask dougsz | 15:19 |
| yoctozepto | but I love to deprecate early | 15:20 |
| yoctozepto | and drop early :-) | 15:20 |
| yoctozepto | it's a monstrosity anyway | 15:20 |
| mnasiadka | Will ask when I'll see him online | 15:20 |
| * yoctozepto feels bad recommending it | 15:20 | |
| mnasiadka | https://review.opendev.org/c/openstack/kolla/+/784901 | 15:21 |
| mnasiadka | we have this, seems there's consensus | 15:21 |
| yoctozepto | mnasiadka: does your cephadm fix helps with that random issue mentioned on the whiteboard? | 15:21 |
| *** k_mouza has quit IRC | 15:21 | |
| *** k_mouza_ has joined #openstack-kolla | 15:21 | |
| mnasiadka | yoctozepto: well, I haven't seen it in there, but I'll do a couple of rechecks to be sure. | 15:22 |
| yoctozepto | mnasiadka: thanks | 15:22 |
| yoctozepto | let me check that monasca-grafana | 15:22 |
| yoctozepto | +2 | 15:23 |
| yoctozepto | mnasiadka: you +2 too? | 15:25 |
| mnasiadka | sure, I'll try to ask Doug if he needs help in K-A deprecation | 15:25 |
| yoctozepto | #topic Review requests | 15:26 |
| *** openstack changes topic to "Review requests (Meeting topic: kolla)" | 15:26 | |
| yoctozepto | mnasiadka: very well, thanks! | 15:26 |
| yoctozepto | what do you want reviewed? | 15:26 |
| yoctozepto | your favourite plant? | 15:26 |
| yoctozepto | your favourite meal? | 15:26 |
| headphoneJames | https://review.opendev.org/c/openstack/kolla-ansible/+/741340/ | 15:26 |
| yoctozepto | I'm here to grant you your wish | 15:26 |
| yoctozepto | ah yes | 15:27 |
| yoctozepto | +966 | 15:27 |
| yoctozepto | -18 | 15:27 |
| headphoneJames | I also enjoy orchids | 15:27 |
| yoctozepto | and now I know why it is still not merged :-) | 15:27 |
| yoctozepto | orchids can be pretty | 15:27 |
| mnasiadka | headphoneJames: well, my main issue is with supervisord (so multiple processes) in haproxy image... can we do anything to not do it? | 15:28 |
| headphoneJames | I'm open to other approaches. | 15:29 |
| mnasiadka | I'll try to look into, but that might happen in two weeks time... | 15:30 |
| headphoneJames | The issue is that we need a process that monitors for new certificates, and causes an haproxy reload | 15:30 |
| mnasiadka | or we need a newer haproxy, which is a crazy thing to do - because we would need additional repos... | 15:30 |
| headphoneJames | I have a suspicion this is not going in the current release, so two weeks should be fine | 15:30 |
| *** hrw has joined #openstack-kolla | 15:31 | |
| hrw | morning | 15:31 |
| yoctozepto | you might be right, headphoneJames, I am sorry | 15:31 |
| yoctozepto | I really wished to get this in this cycle :/ | 15:31 |
| mnasiadka | we could run a separate container with shared ipc namespace | 15:31 |
| headphoneJames | s'all good | 15:31 |
| mnasiadka | headphoneJames: thought about that? | 15:31 |
| headphoneJames | I certainly have not. I would have to learn with that means ;) | 15:32 |
| mnasiadka | headphoneJames: https://docs.docker.com/engine/reference/run/#ipc-settings---ipc - look at shareable | 15:32 |
| mnasiadka | probably we could then restart haproxy from another container | 15:32 |
| yoctozepto | we could send a signal | 15:33 |
| priteau | Is there a less automated version that could be merged in wallaby, with a manual command to update certificates and reload haproxy? | 15:33 |
| mnasiadka | but what happens when you restart haproxy and if it joins the same ipc group, that is a mystery :) | 15:33 |
| yoctozepto | but that would need share pid namespace, no? | 15:33 |
| mnasiadka | yoctozepto: but it doesn't need to be host namespace, it seems in Docker you can create a ,,shareable'' one | 15:33 |
| yoctozepto | priteau: yeah, my thoughts exactly | 15:33 |
| yoctozepto | I remember we discussed some layering to this | 15:33 |
| yoctozepto | mnasiadka: I wonder what the lifetime is ;-) | 15:34 |
| yoctozepto | as you need that PID 1 | 15:34 |
| yoctozepto | it would be fugly to have either break the other | 15:34 |
| yoctozepto | perhaps it's better to push newer haproxy for this | 15:34 |
| mnasiadka | yoctozepto: that's why I mentioned a mystery, meaning it would need some degree of testing | 15:34 |
| yoctozepto | headphoneJames: do you have an answer for priteau? | 15:34 |
| mnasiadka | yoctozepto: both centos and ubuntu would need a repo | 15:34 |
| yoctozepto | even current ubuntu? doh | 15:35 |
| mnasiadka | yoctozepto: which in centos case there's a nfv repo - but for Ubuntu it's just somebody's PPA | 15:35 |
| yoctozepto | we need | 15:35 |
| yoctozepto | 2.2? | 15:35 |
| *** hrw has quit IRC | 15:35 | |
| headphoneJames | We can definitely push a version that doesn't do the automatic restart, and would require customers to restart ha proxy manually | 15:36 |
| *** hrw has joined #openstack-kolla | 15:36 | |
| openstackgerrit | Merged openstack/kolla master: centos: enable repos where needed https://review.opendev.org/c/openstack/kolla/+/785871 | 15:36 |
| mnasiadka | yoctozepto: ideally 2.2 | 15:36 |
| headphoneJames | However, the test case would need to then manually restart haproxy | 15:36 |
| yoctozepto | headphoneJames: let's do it in another change then | 15:37 |
| yoctozepto | perhaps we can merge that | 15:37 |
| yoctozepto | mnasiadka: meh | 15:37 |
| mnasiadka | headphoneJames: well, how do we notify them to restart haproxy? :) and how often do they need to do that? | 15:37 |
| headphoneJames | They would have to check logs :) | 15:37 |
| mnasiadka | yoctozepto: yeah, so centos nfv repo and ubuntu PPA https://launchpad.net/~vbernat/+archive/ubuntu/haproxy-2.2 - no other option with Focal | 15:37 |
| headphoneJames | Keep in mind supervisord is only deployed and used with the let's encrypt option enabled | 15:38 |
| headphoneJames | And works really well over several months of testing | 15:38 |
| mnasiadka | I don't doubt it does work, but we don't run more than one process in any container image :) | 15:38 |
| headphoneJames | Anyhow, my expectations are properly set for next release | 15:39 |
| yoctozepto | I made a few updates to https://ethercalc.openstack.org/kolla-infra-service-matrix | 15:40 |
| yoctozepto | I assumed we move to bullseye | 15:40 |
| yoctozepto | headphoneJames: how long will it take you to simplify it as we discussed? | 15:41 |
| *** hrw has quit IRC | 15:41 | |
| *** samcat116 has quit IRC | 15:41 | |
| headphoneJames | I can easily remove the supervisord part. | 15:42 |
| *** hrw has joined #openstack-kolla | 15:42 | |
| headphoneJames | I will look into the shared ipc today | 15:42 |
| priteau | mnasiadka: don't look at the bifrost image then ;-) | 15:43 |
| yoctozepto | priteau: bifrost is on the death path | 15:43 |
| headphoneJames | Having customers manually restart haproxy is probably not the right approach | 15:43 |
| yoctozepto | just no executioners around | 15:43 |
| yoctozepto | headphoneJames: yes, it's not | 15:43 |
| yoctozepto | but I have a feeling we are better off merging it in parts rather than postponing till the end of the world | 15:44 |
| headphoneJames | Let me see how far I get today. I'm happy to discuss breaking it into smaller chunks | 15:45 |
| yoctozepto | all right, ping us whenever | 15:45 |
| *** wuchunyang has quit IRC | 15:46 | |
| yoctozepto | ooh, I have a last minute announcement | 15:46 |
| yoctozepto | #topic Last minute announcements | 15:46 |
| *** openstack changes topic to "Last minute announcements (Meeting topic: kolla)" | 15:46 | |
| yoctozepto | #info OpenStack Wallaby released! yahoo! | 15:46 |
| hrw | yay! | 15:46 |
| mnasiadka | priteau: bifrost is a monster | 15:47 |
| hrw | so when we branch? | 15:47 |
| yoctozepto | that's the question for ptg | 15:47 |
| yoctozepto | #topic Wallaby release planning | 15:47 |
| *** openstack changes topic to "Wallaby release planning (Meeting topic: kolla)" | 15:47 | |
| mnasiadka | I think we can branch Kolla once we merge all hrw's patches ;) (UCA/Debian/RDO) | 15:47 |
| yoctozepto | Debian bullseye progress | 15:47 |
| yoctozepto | I think it's only pending a review | 15:47 |
| yoctozepto | https://review.opendev.org/c/openstack/kolla/+/772479 | 15:47 |
| yoctozepto | I pasted it on the whiteboard already | 15:48 |
| yoctozepto | anything to discuss? | 15:48 |
| *** samcat116 has joined #openstack-kolla | 15:48 | |
| *** hrww has joined #openstack-kolla | 15:49 | |
| mnasiadka | well, since Debian is now on good path, I guess it's time to look into UCA/RDO changes to get them merged and images built | 15:49 |
| hrww | I will read meeting log :( | 15:49 |
| mnasiadka | I'll try to look into those | 15:49 |
| hrww | UCA is upgrade V->W issue iirc | 15:50 |
| mnasiadka | upgrade is always a release change issue :) | 15:50 |
| *** e0ne has quit IRC | 15:50 | |
| *** e0ne has joined #openstack-kolla | 15:51 | |
| *** hrw has quit IRC | 15:51 | |
| mnasiadka | ah, looking for somebody brave enough to merge this: https://review.opendev.org/c/openstack/kolla-ansible/+/783669 | 15:51 |
| *** hrw has joined #openstack-kolla | 15:52 | |
| * hrw drops - too many lags and reconnects today to be able to follow discussion | 15:53 | |
| hrw | upc-- | 15:53 |
| mnasiadka | yoctozepto: anything else left on agenda? because it seems I'm speaking with myself... | 15:53 |
| yoctozepto | check the recorded logs hrw | 15:53 |
| *** e0ne has quit IRC | 15:53 | |
| yoctozepto | mnasiadka: open discussion | 15:54 |
| mnasiadka | ok then | 15:54 |
| yoctozepto | #topic Xena PTG planning https://etherpad.opendev.org/p/kolla-xena-ptg | 15:54 |
| *** openstack changes topic to "Xena PTG planning https://etherpad.opendev.org/p/kolla-xena-ptg (Meeting topic: kolla)" | 15:54 | |
| yoctozepto | it was mentioned already | 15:54 |
| yoctozepto | please add yourself and your discussion topics | 15:54 |
| *** hrww has quit IRC | 15:55 | |
| yoctozepto | #topic Open discussion | 15:55 |
| *** openstack changes topic to "Open discussion (Meeting topic: kolla)" | 15:55 | |
| yoctozepto | mnasiadka wanted to participate in open discussion | 15:56 |
| mnasiadka | naah, I speak too much and mainly to myself, it doesn't sound like an open discussion ;) | 15:56 |
| mnasiadka | and we will have too much time for discussions next week | 15:56 |
| *** hrw has quit IRC | 15:57 | |
| yoctozepto | mnasiadka: well, it's open-ended then! | 15:57 |
| yoctozepto | but you are right | 15:57 |
| yoctozepto | we are all tired simply by thinking how tired we will be after the ptg | 15:58 |
| yoctozepto | that said | 15:58 |
| yoctozepto | thank you for attending | 15:58 |
| yoctozepto | #endmeeting | 15:58 |
| *** openstack changes topic to "IRC meetings on Wednesdays @ 15:00 UTC - agenda @ https://goo.gl/OXB0DL | Whiteboard: https://bit.ly/2MM7mWF | IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b" | 15:58 | |
| openstack | Meeting ended Wed Apr 14 15:58:28 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:58 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/kolla/2021/kolla.2021-04-14-15.00.html | 15:58 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/kolla/2021/kolla.2021-04-14-15.00.txt | 15:58 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/kolla/2021/kolla.2021-04-14-15.00.log.html | 15:58 |
| headphoneJames | thx! | 15:58 |
| *** hrw has joined #openstack-kolla | 15:58 | |
| *** samcat116 has quit IRC | 16:00 | |
| *** hrw has quit IRC | 16:14 | |
| *** hrw has joined #openstack-kolla | 16:15 | |
| *** samcat116 has joined #openstack-kolla | 16:17 | |
| openstackgerrit | Merged openstack/kolla master: deprecate monasca-grafana image https://review.opendev.org/c/openstack/kolla/+/784901 | 16:20 |
| *** hrw has quit IRC | 16:21 | |
| *** rpittau is now known as rpittau|afk | 16:21 | |
| *** hrw has joined #openstack-kolla | 16:22 | |
| *** gfidente is now known as gfidente|afk | 16:25 | |
| *** hrww has joined #openstack-kolla | 16:26 | |
| hrww | ok. now network should work | 16:26 |
| *** hrw has quit IRC | 16:26 | |
| *** hrww is now known as hrw | 16:26 | |
| *** k_mouza_ has quit IRC | 16:32 | |
| hrw | ricolin: -1 on your job removal patch | 16:35 |
| *** fuhrmannb has quit IRC | 16:38 | |
| *** bengates has quit IRC | 16:38 | |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: centos: clean up repo enable/disable/keys https://review.opendev.org/c/openstack/kolla/+/765864 | 16:40 |
| *** bengates has joined #openstack-kolla | 16:40 | |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: [WIP] centos: switch to RDO final release of Wallaby https://review.opendev.org/c/openstack/kolla/+/785622 | 16:42 |
| ricolin | hrw, the image build issue solved already, I think we can abandon the job directly | 16:42 |
| ricolin | I mean abandon the patch :p | 16:43 |
| hrw | ricolin: feel free | 16:43 |
| ricolin | hrw, done | 16:43 |
| hrw | ricolin: next time ask why images are not building | 16:43 |
| hrw | ricolin: it was lack of powertools repo in both failing images | 16:43 |
| openstackgerrit | Merged openstack/kayobe stable/ussuri: Fix overcloud provision with fast track enabled https://review.opendev.org/c/openstack/kayobe/+/785332 | 16:44 |
| hrw | ricolin: as I wrote in comment - I may not use most of aarch64 images but I atleast try to keep them buildable | 16:44 |
| hrw | ricolin: that's why ubuntu/aarch64 CI job was dropped - it is not buildable/deployable due to too old erlang | 16:45 |
| *** bengates has quit IRC | 16:45 | |
| *** k_mouza has joined #openstack-kolla | 16:46 | |
| *** ivan_lin has quit IRC | 16:49 | |
| *** ivan_lin has joined #openstack-kolla | 16:50 | |
| hrw | "msg": "timedatectl sees the system clock as unsynchronized. Please wait for synchronization." | 16:52 |
| hrw | hm. | 16:52 |
| *** e0ne has joined #openstack-kolla | 16:55 | |
| ricolin | hrw, thanks for these suggestions, actually learned some more infra stuff (like nb03.opendev.org ) through this chance. | 16:55 |
| hrw | ricolin: base-jobs diskimage-builder openstack-zuul-jobs project-config system-config zuul-jobs - check all of them ;D | 16:57 |
| hrw | my ~/devel/linaro/openstack/Infra/ directory | 16:57 |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: move to Debian 'bullseye' https://review.opendev.org/c/openstack/kolla/+/772479 | 16:59 |
| hrw | added back rabbitmq for debian/aarch64 | 16:59 |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: Debian/Ubuntu: handle APT keys in proper way https://review.opendev.org/c/openstack/kolla/+/784923 | 17:02 |
| hrw | and here as well | 17:02 |
| *** k_mouza has quit IRC | 17:06 | |
| ricolin | hrw, will do! BTW, I upload the devstack arm64 job patch with your suggestion, all building wheels things are gone. | 17:06 |
| ricolin | Still try to fine out why volume backup/restore is so slow | 17:06 |
| ricolin | it takes like 5 mins to do one backup or restore action | 17:07 |
| hrw | glad to help | 17:07 |
| *** cah_link has quit IRC | 17:08 | |
| *** k_mouza has joined #openstack-kolla | 17:10 | |
| *** samcat116 has quit IRC | 17:10 | |
| *** bengates has joined #openstack-kolla | 17:12 | |
| *** bengates_ has joined #openstack-kolla | 17:17 | |
| *** bengates has quit IRC | 17:17 | |
| hrw | rabbitmq crashes on debian/aarch64 :( | 17:18 |
| *** samcat116 has joined #openstack-kolla | 17:21 | |
| *** bengates_ has quit IRC | 17:21 | |
| *** k_mouza has quit IRC | 17:25 | |
| *** hrw has quit IRC | 17:30 | |
| *** hrw has joined #openstack-kolla | 17:32 | |
| *** hrw has quit IRC | 17:39 | |
| *** hrw has joined #openstack-kolla | 17:41 | |
| *** hrw has quit IRC | 17:49 | |
| *** bengates has joined #openstack-kolla | 17:52 | |
| *** e0ne has quit IRC | 17:56 | |
| *** andrewbonney has quit IRC | 17:59 | |
| *** ivan_lin has quit IRC | 18:04 | |
| *** ivan_lin has joined #openstack-kolla | 18:04 | |
| *** bengates has quit IRC | 18:05 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Additional small changes in role/mariadb https://review.opendev.org/c/openstack/kolla-ansible/+/785657 | 18:07 |
| *** k_mouza has joined #openstack-kolla | 18:24 | |
| *** k_mouza has quit IRC | 18:27 | |
| openstackgerrit | Merged openstack/kayobe stable/train: Revert "Performance: skip LVM configuration if no groups configured" https://review.opendev.org/c/openstack/kayobe/+/783316 | 18:36 |
| *** vishalmanchanda has quit IRC | 18:44 | |
| *** jonaspaulo has joined #openstack-kolla | 18:51 | |
| *** hrw has joined #openstack-kolla | 19:02 | |
| *** k_mouza has joined #openstack-kolla | 19:28 | |
| *** k_mouza has quit IRC | 19:32 | |
| *** jonaspaulo has quit IRC | 19:33 | |
| openstackgerrit | Merged openstack/kolla-ansible master: masakari: support host monitor https://review.opendev.org/c/openstack/kolla-ansible/+/744235 | 20:02 |
| *** samcat116 has quit IRC | 20:30 | |
| *** samcat116 has joined #openstack-kolla | 20:43 | |
| *** samcat116 has quit IRC | 21:13 | |
| *** jaicaa has quit IRC | 21:52 | |
| *** jaicaa has joined #openstack-kolla | 21:53 | |
| *** luksky has quit IRC | 22:34 | |
| *** luksky has joined #openstack-kolla | 22:34 | |
| *** luksky has quit IRC | 22:40 | |
| *** luksky has joined #openstack-kolla | 22:53 | |
| *** macz_ has quit IRC | 23:05 | |
| *** ivan_lin has quit IRC | 23:15 | |
| *** ivan_lin has joined #openstack-kolla | 23:15 | |
| *** luksky has quit IRC | 23:18 | |
| *** jovial[m] has quit IRC | 23:23 | |
| *** irclogbot_3 has quit IRC | 23:50 | |
| *** irclogbot_2 has quit IRC | 23:50 | |
| *** irclogbot_3 has joined #openstack-kolla | 23:55 | |
| *** irclogbot_2 has joined #openstack-kolla | 23:56 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!