| *** diurnalist has quit IRC | 00:13 | |
| *** Manheim has quit IRC | 00:37 | |
| *** zhanglong has joined #openstack-kolla | 00:38 | |
| *** diurnalist has joined #openstack-kolla | 01:08 | |
| *** ricolin_ has joined #openstack-kolla | 01:43 | |
| *** Tengu has quit IRC | 01:47 | |
| *** Tengu has joined #openstack-kolla | 01:49 | |
| *** also_stingrayza has joined #openstack-kolla | 02:03 | |
| *** diurnalist has quit IRC | 02:07 | |
| *** stingrayza has quit IRC | 02:07 | |
| *** Manheim has joined #openstack-kolla | 02:38 | |
| *** Manheim has quit IRC | 02:42 | |
| *** wuchunyang has joined #openstack-kolla | 02:53 | |
| *** wuchunyang has quit IRC | 02:58 | |
| *** ricolin_ is now known as ricolin | 03:30 | |
| *** zhanglong has quit IRC | 03:42 | |
| *** diurnalist has joined #openstack-kolla | 04:05 | |
| *** ykarel|away is now known as ykarel | 04:24 | |
| *** evrardjp has quit IRC | 04:33 | |
| *** evrardjp has joined #openstack-kolla | 04:33 | |
| *** wuchunyang has joined #openstack-kolla | 04:37 | |
| *** cah_link has joined #openstack-kolla | 04:46 | |
| *** skramaja has joined #openstack-kolla | 04:49 | |
| *** wuchunyang has quit IRC | 04:55 | |
| *** wuchunyang has joined #openstack-kolla | 04:56 | |
| *** wuchunyang has quit IRC | 04:57 | |
| *** abdysn has joined #openstack-kolla | 04:59 | |
| *** strigazi has quit IRC | 05:04 | |
| *** diurnalist has quit IRC | 05:06 | |
| *** strigazi has joined #openstack-kolla | 05:06 | |
| *** vishalmanchanda has joined #openstack-kolla | 05:23 | |
| *** wuchunyang has joined #openstack-kolla | 05:28 | |
| *** wuchunyang has quit IRC | 05:35 | |
| *** strigazi has quit IRC | 05:46 | |
| *** factor has quit IRC | 06:03 | |
| *** factor has joined #openstack-kolla | 06:03 | |
| *** icarusfactor has joined #openstack-kolla | 06:05 | |
| *** factor has quit IRC | 06:06 | |
| *** zhanglong has joined #openstack-kolla | 06:09 | |
| *** zhanglong has quit IRC | 06:18 | |
| *** zhanglong has joined #openstack-kolla | 06:20 | |
| *** icarusfactor has quit IRC | 06:22 | |
| *** amoralej|off is now known as amoralej | 06:39 | |
| *** zhanglong has quit IRC | 06:42 | |
| *** zhanglong has joined #openstack-kolla | 06:43 | |
| *** also_stingrayza is now known as stingrayza | 06:49 | |
| *** bhagyashris is now known as bhagyashris|brb | 06:59 | |
| *** nikparasyr has joined #openstack-kolla | 07:02 | |
| *** luksky has joined #openstack-kolla | 07:02 | |
| *** bengates has joined #openstack-kolla | 07:10 | |
| *** bengates has quit IRC | 07:12 | |
| *** bengates has joined #openstack-kolla | 07:13 | |
| *** sorin-mihai_ has joined #openstack-kolla | 07:15 | |
| *** bhagyashris|brb is now known as bhagyashris | 07:15 | |
| *** sorin-mihai_ has quit IRC | 07:16 | |
| *** sorin-mihai_ has joined #openstack-kolla | 07:16 | |
| *** sorin-mihai has quit IRC | 07:17 | |
| *** sorin-mihai_ has quit IRC | 07:19 | |
| *** sorin-mihai_ has joined #openstack-kolla | 07:19 | |
| *** sorin-mihai_ has quit IRC | 07:21 | |
| *** sorin-mihai_ has joined #openstack-kolla | 07:21 | |
| *** sorin-mihai__ has joined #openstack-kolla | 07:23 | |
| *** sorin-mihai_ has quit IRC | 07:26 | |
| *** jan00 has joined #openstack-kolla | 07:29 | |
| *** zhanglong has quit IRC | 07:34 | |
| *** zhanglong has joined #openstack-kolla | 07:36 | |
| *** dougsz has joined #openstack-kolla | 07:37 | |
| yoctozepto | morning | 07:47 |
|---|---|---|
| mgoddard | morning | 07:54 |
| *** born2bake has joined #openstack-kolla | 07:57 | |
| *** e0ne has joined #openstack-kolla | 07:58 | |
| hrw | ho | 08:08 |
| *** zhanglong has quit IRC | 08:11 | |
| *** k_mouza has joined #openstack-kolla | 08:15 | |
| *** zhanglong has joined #openstack-kolla | 08:15 | |
| *** Manheim has joined #openstack-kolla | 08:21 | |
| *** gfidente has joined #openstack-kolla | 08:33 | |
| *** Manheim_ has joined #openstack-kolla | 08:33 | |
| *** Manheim__ has joined #openstack-kolla | 08:34 | |
| *** Manheim has quit IRC | 08:34 | |
| *** kevko has joined #openstack-kolla | 08:35 | |
| kevko | hi guys, just wondering , have you ever meet this intermittent failure ? Remotedisconnected('Remote End Closed Connection Without Response') apache2 as LB ...sometimes it is throwing this ..without reason .. | 08:37 |
| *** Manheim_ has quit IRC | 08:37 | |
| openstackgerrit | Jan Horstmann proposed openstack/kolla-ansible master: Set [magnum_client]endpoint_type to publicURL https://review.opendev.org/738760 | 08:40 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: Use public interface for Magnum client and trustee Keystone interface https://review.opendev.org/738351 | 08:45 |
| *** suff has joined #openstack-kolla | 08:48 | |
| *** gfidente is now known as gfidente|ffu | 08:50 | |
| mgoddard | kevko: we did see something like that in the patch to add nova backend TLS, and I blocked merging because of it. I was concerned we might hit it with other APIs too | 08:52 |
| mgoddard | kevko: could you give any more details? | 08:52 |
| openstackgerrit | Stig Telfer proposed openstack/kolla-ansible master: Syntax error in Fluentd Monasca output config https://review.opendev.org/738765 | 08:57 |
| yoctozepto | mgoddard, kevko: I wonder whether it has any true effect on stability too | 08:57 |
| mgoddard | yoctozepto: well in the nova case it failed a request | 08:58 |
| yoctozepto | mgoddard: ack, thanks for confirming | 08:59 |
| *** k_mouza has quit IRC | 09:00 | |
| *** k_mouza has joined #openstack-kolla | 09:05 | |
| kevko | yoctozepto: well, most of these failures i've already seen were in neutron (but it was also in nova,cinder,glance ..but much less), it hurts especcially when using heat to create some bigger stack ...and something fails by this way | 09:16 |
| kevko | mgoddard: could you provide review id plese ? I would like to check it | 09:17 |
| mgoddard | kevko: odd - we don't use apache for neutron | 09:23 |
| mgoddard | kevko: https://review.opendev.org/724794 | 09:23 |
| patchbot | patch 724794 - kolla-ansible - Add support for encrypting Nova API - 10 patch sets | 09:23 |
| *** jbadiapa has quit IRC | 09:25 | |
| *** bengates has quit IRC | 09:47 | |
| *** bengates has joined #openstack-kolla | 09:48 | |
| *** ricolin has quit IRC | 09:52 | |
| openstackgerrit | Mark Goddard proposed openstack/kayobe stable/train: Update feature flag defaults https://review.opendev.org/738776 | 09:53 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe stable/train: Update image regexes https://review.opendev.org/738777 | 09:53 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe stable/train: Fix condition of placement image build https://review.opendev.org/738778 | 09:53 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: Make ES Curator schedule multinode-friendly https://review.opendev.org/738779 | 10:01 |
| yoctozepto | dougsz: curating the curator ^ | 10:01 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe stable/train: Update image regexes https://review.opendev.org/738777 | 10:07 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe stable/train: Fix condition of placement image build https://review.opendev.org/738778 | 10:07 |
| dougsz | yoctozepto: great stuff, a much better default | 10:16 |
| yoctozepto | dougsz: well, thanks, you are too kind! | 10:18 |
| openstackgerrit | Merged openstack/kolla-ansible master: Fix the Elasticsearch Curator cron schedule run https://review.opendev.org/738639 | 10:20 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/ussuri: Fix the Elasticsearch Curator cron schedule run https://review.opendev.org/738782 | 10:21 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/train: Fix the Elasticsearch Curator cron schedule run https://review.opendev.org/738783 | 10:21 |
| yoctozepto | mgoddard: today's meeting slightly collides with the opendev event; could we change the hour? | 10:25 |
| yoctozepto | I guess the wrap-up session can really be left in background so it might be fine to reschedule by 15 minutes | 10:26 |
| *** Manheim has joined #openstack-kolla | 10:37 | |
| *** Manheim__ has quit IRC | 10:41 | |
| *** jan00 has quit IRC | 10:46 | |
| *** priteau has joined #openstack-kolla | 11:02 | |
| *** dougsz has quit IRC | 11:08 | |
| *** kevinz has quit IRC | 11:11 | |
| mgoddard | yoctozepto: it's a bit late to reschedule, but I suppose we could pause for 15m | 11:13 |
| *** zhanglong has quit IRC | 11:32 | |
| *** jbadiapa has joined #openstack-kolla | 11:37 | |
| openstackgerrit | Merged openstack/kolla stable/train: Add Logstash 6 for Monasca on Centos 8 https://review.opendev.org/736745 | 11:44 |
| openstackgerrit | Merged openstack/kolla stable/train: Update support matrix for ELK images https://review.opendev.org/738186 | 11:44 |
| *** amoralej is now known as amoralej|lunch | 12:00 | |
| openstackgerrit | Doug Szumski proposed openstack/kolla-ansible stable/ussuri: Syntax error in Fluentd Monasca output config https://review.opendev.org/738835 | 12:07 |
| openstackgerrit | Doug Szumski proposed openstack/kolla-ansible stable/train: Fix the Elasticsearch Curator cron schedule run https://review.opendev.org/738783 | 12:07 |
| openstackgerrit | Doug Szumski proposed openstack/kolla-ansible stable/train: Syntax error in Fluentd Monasca output config https://review.opendev.org/738836 | 12:10 |
| *** k_mouza has quit IRC | 12:13 | |
| *** k_mouza has joined #openstack-kolla | 12:13 | |
| *** dougsz has joined #openstack-kolla | 12:15 | |
| *** irclogbot_3 has quit IRC | 12:16 | |
| *** irclogbot_0 has joined #openstack-kolla | 12:17 | |
| openstackgerrit | Merged openstack/kolla stable/train: Add Elasticsearch Curator Docker image https://review.opendev.org/738360 | 12:18 |
| *** JangwonLee_ has joined #openstack-kolla | 12:31 | |
| *** cah_link has quit IRC | 12:33 | |
| *** cah_link has joined #openstack-kolla | 12:34 | |
| openstackgerrit | Mark Goddard proposed openstack/kayobe master: WIP: Docker registry TLS https://review.opendev.org/738839 | 12:39 |
| *** cah_link has quit IRC | 12:44 | |
| *** cah_link1 has joined #openstack-kolla | 12:44 | |
| *** maharg101 has quit IRC | 12:45 | |
| *** maharg101 has joined #openstack-kolla | 12:46 | |
| *** cah_link1 is now known as cah_link | 12:47 | |
| *** zhanglong has joined #openstack-kolla | 12:48 | |
| *** cah_link1 has joined #openstack-kolla | 12:54 | |
| *** ricolin has joined #openstack-kolla | 12:54 | |
| *** cah_link has quit IRC | 12:56 | |
| *** cah_link1 is now known as cah_link | 12:56 | |
| *** jcmdln has joined #openstack-kolla | 12:56 | |
| *** amoralej|lunch is now known as amoralej | 13:08 | |
| *** yankcrime has quit IRC | 13:22 | |
| *** yankcrime has joined #openstack-kolla | 13:24 | |
| *** TrevorV has joined #openstack-kolla | 13:31 | |
| *** zhanglong has quit IRC | 13:34 | |
| *** Manheim_ has joined #openstack-kolla | 13:37 | |
| *** Manheim has quit IRC | 13:40 | |
| *** wuchunyang has joined #openstack-kolla | 13:41 | |
| *** Manheim_ has quit IRC | 13:41 | |
| *** Manheim has joined #openstack-kolla | 13:42 | |
| *** bhagyashris is now known as bhagyashris|afk | 13:42 | |
| *** Manheim has quit IRC | 13:46 | |
| *** Tengu has quit IRC | 13:56 | |
| *** Tengu has joined #openstack-kolla | 13:57 | |
| *** abdysn has quit IRC | 14:00 | |
| *** sluna has quit IRC | 14:12 | |
| *** sluna has joined #openstack-kolla | 14:13 | |
| *** dave-mccowan has quit IRC | 14:22 | |
| openstackgerrit | Mark Goddard proposed openstack/kayobe master: WIP: Docker registry TLS https://review.opendev.org/738839 | 14:24 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe master: WIP: Docker registry basic auth https://review.opendev.org/738856 | 14:24 |
| *** dave-mccowan has joined #openstack-kolla | 14:25 | |
| *** xinliang has joined #openstack-kolla | 14:39 | |
| *** diurnalist has joined #openstack-kolla | 14:44 | |
| openstackgerrit | Stig Telfer proposed openstack/kolla-ansible master: Set a chunk size for Fluentd bulk log upload to Monasca https://review.opendev.org/738859 | 14:46 |
| openstackgerrit | Stig Telfer proposed openstack/kolla-ansible master: Set a chunk size for Fluentd bulk log upload to Monasca https://review.opendev.org/738859 | 14:55 |
| *** kplant has quit IRC | 14:56 | |
| *** kplant has joined #openstack-kolla | 14:57 | |
| mgoddard | #startmeeting kolla | 15:00 |
| openstack | Meeting started Wed Jul 1 15:00:34 2020 UTC and is due to finish in 60 minutes. The chair is mgoddard. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
| *** openstack changes topic to " (Meeting topic: kolla)" | 15:00 | |
| openstack | The meeting name has been set to 'kolla' | 15:00 |
| mgoddard | #topic rollcall | 15:00 |
| *** openstack changes topic to "rollcall (Meeting topic: kolla)" | 15:01 | |
| suryasingh | \0 | 15:01 |
| yoctozepto | o/ | 15:01 |
| mgoddard | Hi, this meeting is clashing with the opendev large scale discussions. Let's see who shows up | 15:01 |
| mgoddard | \o | 15:01 |
| hrw | o/ | 15:01 |
| yoctozepto | I can see only priteau with me in there | 15:03 |
| headphoneJames | o/ | 15:03 |
| yoctozepto | so we might start as well | 15:03 |
| priteau | o/ | 15:03 |
| yoctozepto | edge is not really my thing | 15:03 |
| mgoddard | mgoddard mnasiadka hrw egonzalez yoctozepto rafaelweingartne cosmicsound osmanlicilegi | 15:05 |
| mgoddard | ^ meeting | 15:05 |
| mgoddard | #topic agenda | 15:05 |
| *** openstack changes topic to "agenda (Meeting topic: kolla)" | 15:05 | |
| *** ysirndjuro has joined #openstack-kolla | 15:05 | |
| mgoddard | * Roll-call | 15:05 |
| mgoddard | * Announcements | 15:05 |
| mgoddard | * Review action items from last meeting | 15:05 |
| mgoddard | * CI status | 15:05 |
| mgoddard | * Chrony & Ceph octopus (https://bugs.launchpad.net/kolla-ansible/+bug/1885689 & https://storyboard.openstack.org/#!/story/2007872) | 15:05 |
| openstack | Launchpad bug 1885689 in kolla-ansible victoria "Ceph octopus incompatible with containerised chrony" [Medium,Triaged] | 15:05 |
| mgoddard | * Switching Ussuri to track stable branches | 15:05 |
| mgoddard | * Future of the common role | 15:05 |
| mgoddard | * Keystone fernet keys handling https://review.opendev.org/707080 | 15:05 |
| patchbot | patch 707080 - kolla-ansible - Fix fernet bootstrap and key distribution - follow up - 14 patch sets | 15:05 |
| mgoddard | * CentOS/AArch64: use Erlang from CentOS to get RabbitMQ working: https://review.opendev.org/#/q/I2559267d120081f2e5eabc9d966b019517a5ad5d | 15:05 |
| mgoddard | * Infra images: https://etherpad.opendev.org/p/Kolla-infra-images | 15:05 |
| mgoddard | * Victoria release planning (kayobe) | 15:05 |
| mgoddard | * Victoria release planning (kolla & kolla ansible) | 15:06 |
| mgoddard | * Kolla klub | 15:06 |
| mgoddard | Lots of topics today | 15:06 |
| mgoddard | #topic Announcements | 15:06 |
| *** openstack changes topic to "Announcements (Meeting topic: kolla)" | 15:06 | |
| mgoddard | #info OpenDev large scale infra sessions took place this week | 15:06 |
| mgoddard | #link https://www.openstack.org/events/opendev-2020/opendev-schedule | 15:06 |
| mgoddard | Videos on youtube, notes on etherpad | 15:07 |
| mgoddard | Any others? | 15:07 |
| hrw | go on | 15:08 |
| *** dave-mccowan has quit IRC | 15:08 | |
| mgoddard | #topic Review action items from last meeting | 15:09 |
| *** openstack changes topic to "Review action items from last meeting (Meeting topic: kolla)" | 15:09 | |
| mgoddard | mnasiadka backport stein CI fixes | 15:09 |
| mgoddard | yoctozepto to email list about kolla dev kalls | 15:09 |
| mgoddard | mnasiadka did his | 15:09 |
| mgoddard | yoctozepto did his | 15:09 |
| mgoddard | #topic CI status | 15:09 |
| *** openstack changes topic to "CI status (Meeting topic: kolla)" | 15:09 | |
| yoctozepto | pretty green | 15:09 |
| mgoddard | yeah | 15:10 |
| mgoddard | Rocky still broken | 15:10 |
| hrw | yep | 15:10 |
| yoctozepto | random errors with mirrors | 15:10 |
| mgoddard | https://review.opendev.org/#/c/738344/ | 15:10 |
| patchbot | patch 738344 - kolla (stable/rocky) - Fix multiple issues - 3 patch sets | 15:10 |
| yoctozepto | any idea what's left to be done? | 15:10 |
| yoctozepto | (for rocky) | 15:10 |
| mgoddard | no, haven't dug into it | 15:11 |
| yoctozepto | ah, you reverted my fix part | 15:11 |
| mgoddard | probably | 15:11 |
| hrw | +2 | 15:11 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla stable/rocky: Fix multiple issues https://review.opendev.org/738344 | 15:12 |
| yoctozepto | +2 from me as well, let's see now | 15:12 |
| mgoddard | let's see how it goes | 15:12 |
| mgoddard | hold your +2s until we pass... | 15:12 |
| hrw | no +W until pass | 15:13 |
| yoctozepto | meh, I agree with the contents | 15:13 |
| yoctozepto | fingers crossed for CI jobs | 15:13 |
| yoctozepto | rocky k-a fine? | 15:13 |
| mgoddard | hopefully | 15:13 |
| yoctozepto | ok | 15:13 |
| mgoddard | we are seeing instability in kayobe CI | 15:13 |
| mgoddard | at least partially down to out of disk space issues | 15:14 |
| yoctozepto | as I mentioned above mirrors are very grumpy | 15:14 |
| yoctozepto | so could affect kayobe as well | 15:14 |
| mgoddard | likely | 15:14 |
| mgoddard | let's see how it goes, but probably needs attention | 15:14 |
| mgoddard | #topic Chrony & Ceph octopus (https://bugs.launchpad.net/kolla-ansible/+bug/1885689 & https://storyboard.openstack.org/#!/story/2007872) | 15:15 |
| *** openstack changes topic to "Chrony & Ceph octopus (https://bugs.launchpad.net/kolla-ansible/+bug/1885689 & https://storyboard.openstack.org/#!/story/2007872) (Meeting topic: kolla)" | 15:15 | |
| openstack | Launchpad bug 1885689 in kolla-ansible victoria "Ceph octopus incompatible with containerised chrony" [Medium,Triaged] | 15:15 |
| yoctozepto | all in for changing the default | 15:15 |
| yoctozepto | even for ussuri now (with a reno, ml post and alike) | 15:15 |
| mgoddard | it would leave us without NTP by default | 15:16 |
| hrw | add it to bootstrap-servers? | 15:17 |
| yoctozepto | there is some ntp nowadays by default though | 15:17 |
| openstackgerrit | Doug Szumski proposed openstack/kolla-ansible master: Set a chunk size for Fluentd bulk log upload to Monasca https://review.opendev.org/738859 | 15:17 |
| hrw | my Debian 'buster' laptop lacks chronyd | 15:18 |
| mgoddard | true, but if we disable it then existing environments may lose any custom config | 15:18 |
| yoctozepto | that true | 15:18 |
| priteau | Make it an option in Ussuri and earlier? | 15:18 |
| priteau | And change the default in Victoria | 15:18 |
| yoctozepto | it's already an option :-) | 15:18 |
| yoctozepto | the default is bad | 15:19 |
| mgoddard | I think that makes sense | 15:19 |
| openstackgerrit | Doug Szumski proposed openstack/kolla-ansible master: Set a chunk size for Fluentd bulk log upload to Monasca https://review.opendev.org/738859 | 15:19 |
| yoctozepto | but changing is disruptive for those unaware ;/ | 15:19 |
| mgoddard | I suppose if we get in quick and make a release we could minimise disruption in ussuri | 15:20 |
| hrw | install chronyd, enable it, check is it running. if fails then fail deploy at bootstrap-servers | 15:20 |
| yoctozepto | mgoddard: my thoughts exactly :-) | 15:20 |
| hrw | as that would mean user config being wrong | 15:20 |
| yoctozepto | just add reno, post to ml, all that nice stuff | 15:20 |
| yoctozepto | we could do better with prechecks, that true | 15:20 |
| yoctozepto | all our target platforms have systemd | 15:21 |
| yoctozepto | so timedatectl check would do | 15:21 |
| hrw | I always forget order of prechecks and bootstrap-servers ;D | 15:21 |
| yoctozepto | hrw: what does your laptop say about timedatectl ? | 15:21 |
| hrw | Time zone: Europe/Warsaw (CEST, +0200) | 15:22 |
| hrw | System clock synchronized: yes | 15:22 |
| hrw | NTP service: active | 15:22 |
| mgoddard | mine says unknown command check | 15:22 |
| yoctozepto | so you've got ntp | 15:22 |
| hrw | no ntp nor chronyd | 15:22 |
| yoctozepto | mgoddard: :-( | 15:22 |
| yoctozepto | hrw: probably timesyncd | 15:22 |
| hrw | no | 15:22 |
| yoctozepto | we don't really check for all conflicting ntp clients | 15:22 |
| hrw | chronyd ntp ntpd timesyncd missing | 15:22 |
| yoctozepto | odd | 15:23 |
| mgoddard | my bionic laptop is using ntpd | 15:23 |
| mgoddard | anyway, I think we're rabbit holing | 15:23 |
| hrw | systemd-timesyncd.service not timesyncd ;d | 15:23 |
| mgoddard | we have a few things to get through | 15:23 |
| yoctozepto | on bionic, focal and buster I see systemd-timesyncd | 15:23 |
| yoctozepto | did not touch anything | 15:23 |
| mgoddard | does anyone want to pick this up? | 15:24 |
| dougsz | +1, Bionic: systemd-timesyncd.service active: yes | 15:24 |
| yoctozepto | mgoddard: changing default + prechecks with timedatectl? | 15:24 |
| yoctozepto | centos 7 obviously chronyd | 15:24 |
| hrw | so chronyd on centos and ssytemd-timesyncd on debuntu? | 15:24 |
| yoctozepto | it looks so | 15:25 |
| yoctozepto | chcecking centos8 | 15:25 |
| mgoddard | can chrony not be installed on buster? | 15:25 |
| priteau | IIRC timesyncd is just a client, so we cannot do the NTP server on VIP like we do with chrony | 15:25 |
| mgoddard | presumably chrony is supported on all platforms, given we have a container | 15:26 |
| priteau | https://packages.debian.org/buster/chrony | 15:26 |
| yoctozepto | it is | 15:27 |
| yoctozepto | centos8 is also chrony | 15:27 |
| yoctozepto | priteau: if we drop controlling ntp, then it's not our biz to carry on with that | 15:27 |
| yoctozepto | timesyncd is sntp client only | 15:28 |
| yoctozepto | does k-a actually run chronyd on controllers as server? | 15:28 |
| mgoddard | I updated the bug report | 15:29 |
| priteau | Sorry if I misunderstood, I thought you were discussing configuring it as a host service via bootstrap-servers | 15:29 |
| mgoddard | ah, so we're not planning to add configuration in bootstrap-servers? | 15:29 |
| yoctozepto | I wouldn't | 15:29 |
| yoctozepto | I mean, if it's to be done somewhere, then kayobe is probably a better place | 15:30 |
| yoctozepto | as MAAS/Foreman will deal with NTP anyhow | 15:30 |
| mgoddard | there's a bit of a regression there then, to provide custom config | 15:30 |
| yoctozepto | CD install or cloud image have it by default as well | 15:30 |
| yoctozepto | depends on how many folks actually rely on that feature | 15:30 |
| yoctozepto | always sad to revert such things | 15:30 |
| yoctozepto | well, we are leaving the switch for now | 15:31 |
| mgoddard | true | 15:31 |
| yoctozepto | we might deprecate it and remove in W or later but it does not hurt much | 15:31 |
| *** factor has joined #openstack-kolla | 15:32 | |
| mgoddard | I think whoever picks this up can spend some time thinking about it | 15:32 |
| mgoddard | Anyone want to | 15:32 |
| mgoddard | ? | 15:32 |
| priteau | yoctozepto: My understanding is that k-a configures the VIP as one of the server, and that makes the active controller act as an NTP server | 15:32 |
| yoctozepto | mgoddard: /me as secondary candidate | 15:33 |
| yoctozepto | priteau: I never really used it so no idea, could check | 15:33 |
| priteau | Although the external NTP servers are also listed in the configuration, and they have a lower stratum, so not sure if it's really used | 15:34 |
| yoctozepto | we've also got enable_host_ntp for lolz | 15:34 |
| yoctozepto | what about it | 15:34 |
| mgoddard | priteau: I haven't seen that VIP support | 15:34 |
| yoctozepto | looks half-butted | 15:34 |
| mgoddard | won't work on centos 8 | 15:34 |
| mgoddard | ok, calling time on this | 15:35 |
| yoctozepto | ack, add to the bug report | 15:35 |
| mgoddard | #topic Switching Ussuri to track stable branches | 15:35 |
| *** openstack changes topic to "Switching Ussuri to track stable branches (Meeting topic: kolla)" | 15:35 | |
| yoctozepto | +1 | 15:35 |
| *** oneswig has joined #openstack-kolla | 15:35 | |
| hrw | +1 | 15:35 |
| mgoddard | We agreed to switch kolla stable/ussuri to track stable branches rather than versions at the PTG | 15:35 |
| mgoddard | we made the GA release, so now we can do it | 15:36 |
| yoctozepto | yeah, so no need to discuss | 15:36 |
| mgoddard | anyone want to? | 15:36 |
| yoctozepto | next topic | 15:36 |
| mgoddard | looking for a volunteer :) | 15:36 |
| hrw | I will | 15:36 |
| yoctozepto | hrw sounds like the guy | 15:36 |
| hrw | continue | 15:36 |
| mgoddard | thanks hrw | 15:36 |
| yoctozepto | you see | 15:36 |
| yoctozepto | :D | 15:36 |
| mgoddard | #action hrw to switch kolla to use stable branches and update release documentation | 15:36 |
| *** JamesBenson has joined #openstack-kolla | 15:37 | |
| mgoddard | #topic Future of the common role | 15:37 |
| *** openstack changes topic to "Future of the common role (Meeting topic: kolla)" | 15:37 | |
| mgoddard | I've been spending a lot of time profiling ansible recently | 15:37 |
| yoctozepto | much appreciated | 15:38 |
| mgoddard | At scale (100+ hosts) the common role takes the most time to execute | 15:38 |
| yoctozepto | you know the drill: deprecate and drop :-) | 15:38 |
| *** dcapone2004 has joined #openstack-kolla | 15:38 | |
| mgoddard | We can improve this by removing the role dependency and executing it like any other role | 15:38 |
| mgoddard | There is a behaviour change here though | 15:39 |
| mgoddard | The common role was previously added as a dependency to all other roles. | 15:39 |
| mgoddard | It would set a fact after running on a host to avoid running twice. This | 15:39 |
| mgoddard | had the nice effect that deploying any service would automatically pull | 15:39 |
| mgoddard | in the common services for that host. When using tags, any services with | 15:39 |
| mgoddard | matching tags would also run the common role. This could be both | 15:39 |
| mgoddard | surprising and sometimes useful. | 15:39 |
| mgoddard | 15:39 | |
| mgoddard | When using Ansible at large scale, there is a penalty associated with | 15:39 |
| mgoddard | executing a task against a large number of hosts, even if it is skipped. | 15:39 |
| openstackgerrit | Merged openstack/kolla-ansible master: Use public interface for Magnum client and trustee Keystone interface https://review.opendev.org/738351 | 15:39 |
| mgoddard | The common role introduces some overhead, just in determining that it | 15:39 |
| mgoddard | has already run. | 15:39 |
| mgoddard | 15:39 | |
| mgoddard | This change extracts the common role into a separate play, and removes | 15:39 |
| mgoddard | the dependency on it from all other roles. New groups have been added | 15:39 |
| mgoddard | for cron, fluentd, and kolla-toolbox, similar to other services. This | 15:39 |
| mgoddard | changes the behaviour in the following ways: | 15:40 |
| mgoddard | 15:40 | |
| yoctozepto | ah, that paste | 15:40 |
| mgoddard | * The common role is now run for all hosts at the beginning, rather than | 15:40 |
| mgoddard | prior to their first enabled service | 15:40 |
| mgoddard | * Hosts must be in the necessary group for each of the common services | 15:40 |
| mgoddard | in order to have that service deployed. This is mostly to avoid | 15:40 |
| mgoddard | deploying on localhost or the deployment host | 15:40 |
| mgoddard | * If tags are specified for another service e.g. nova, the common role | 15:40 |
| mgoddard | will *not* automatically run for matching hosts. The common tag must | 15:40 |
| mgoddard | be specified explicitly | 15:40 |
| mgoddard | 15:40 | |
| mgoddard | The last of these is probably the largest behaviour change. While it | 15:40 |
| mgoddard | would be possible to determine which hosts should automatically run the | 15:40 |
| mgoddard | common role, it would be quite complex, and would introduce some | 15:40 |
| mgoddard | overhead that would probably negate the benefit of splitting out the | 15:40 |
| mgoddard | common role. | 15:40 |
| mgoddard | just dropping in my commit message for reference :) | 15:40 |
| mgoddard | skip to the end... | 15:40 |
| mgoddard | is this a hit we are willing to take to improve performance? | 15:40 |
| yoctozepto | since we have other "dependent" roles, I +1 as it matches most of our design | 15:41 |
| yoctozepto | the 'all depends on common' is funky | 15:41 |
| priteau | IMHO I would say yes, because I always run Kayobe with --kolla-skip-tags common unless I know I need it | 15:41 |
| yoctozepto | priteau: truer words have never been spoken | 15:41 |
| yoctozepto | priteau: although /me with k-a directly | 15:41 |
| yoctozepto | mgoddard: how much better does it get? | 15:42 |
| yoctozepto | performance-wise | 15:42 |
| hrw | I do not have opinion on it. | 15:42 |
| mgoddard | it depends. I think there are non-linear scaling factors | 15:42 |
| yoctozepto | non-linear is bad | 15:43 |
| mgoddard | at 100+ hosts just skipping a task takes a long time | 15:43 |
| yoctozepto | unless it's sub-linear | 15:43 |
| yoctozepto | yeah, figured, and there is a bunch | 15:43 |
| yoctozepto | how was it for you? | 15:43 |
| yoctozepto | at least 10% decrease in time? | 15:43 |
| mgoddard | I'm doing a few runs with multiple improvements applied. I don't know if I'll get an exact figure just for this one | 15:44 |
| yoctozepto | I see; well, it would be nicer if it was measurable | 15:44 |
| dougsz | the other thing - sometimes you want to just run the common role which I don't think you can at the moment | 15:44 |
| yoctozepto | if we are refactoring for 1% performance gain then it's not really worth it | 15:44 |
| mgoddard | that's true. This makes that possible | 15:44 |
| yoctozepto | and this makes it possible to finally split the common role | 15:45 |
| yoctozepto | to be less confusing | 15:45 |
| mgoddard | true, although more roles == more painful includes :) | 15:45 |
| yoctozepto | haha, that true | 15:45 |
| yoctozepto | deprecate all, let's go for the monolith 8-) | 15:45 |
| mgoddard | I don't think this one change will be a 10% improvement, but I'd expect more than 1% | 15:46 |
| yoctozepto | mgoddard: measurements welcome | 15:46 |
| mgoddard | I can add up some tasks that won't exist :) | 15:46 |
| *** amoralej is now known as amoralej|off | 15:47 | |
| mgoddard | I'm going to be doing quite a few small improvements. I don't know if it will be realistic to benchmark them all, but I am benchmarking the underlying behaviour | 15:47 |
| mgoddard | #link https://github.com/stackhpc/ansible-scaling | 15:47 |
| mgoddard | WIP | 15:47 |
| yoctozepto | nice, instastar | 15:48 |
| mgoddard | #topic Keystone fernet keys handling https://review.opendev.org/707080 | 15:48 |
| patchbot | patch 707080 - kolla-ansible - Fix fernet bootstrap and key distribution - follow up - 14 patch sets | 15:48 |
| *** openstack changes topic to "Keystone fernet keys handling https://review.opendev.org/707080 (Meeting topic: kolla)" | 15:48 | |
| JamesBenson | wouldn't there be a lot of repetition between roles separating it out completely? Perhaps demarkating the common role more, but not completely? | 15:48 |
| mgoddard | JamesBenson: possibly. I don't plan to split at this point | 15:49 |
| yoctozepto | ++ | 15:49 |
| mgoddard | who added this topic? | 15:49 |
| yoctozepto | ok, now unto the keystone | 15:49 |
| * yoctozepto did | 15:49 | |
| yoctozepto | just quick recap | 15:49 |
| yoctozepto | whether you have something to say about it | 15:50 |
| yoctozepto | it seems to we are still plagued by the random keystone issues | 15:50 |
| yoctozepto | I don't want to take up too much meeting time but rather make sure you remember we have this pesky issue and reviewing and any more info is welcome | 15:50 |
| yoctozepto | mnasiadka is not around today so we might as well postpone any further discussion till the next meeting | 15:51 |
| mgoddard | +1 for prioritising it | 15:51 |
| * yoctozepto said what he wanted to say | 15:51 | |
| yoctozepto | dougsz, priteau: your thoughts maybe? | 15:51 |
| mgoddard | #topic CentOS/AArch64: use Erlang from CentOS to get RabbitMQ working: https://review.opendev.org/#/q/I2559267d120081f2e5eabc9d966b019517a5ad5d | 15:52 |
| *** openstack changes topic to "CentOS/AArch64: use Erlang from CentOS to get RabbitMQ working: https://review.opendev.org/#/q/I2559267d120081f2e5eabc9d966b019517a5ad5d (Meeting topic: kolla)" | 15:52 | |
| mgoddard | hrw: | 15:52 |
| hrw | yes, me | 15:52 |
| hrw | we need those two patches in | 15:52 |
| priteau | yoctozepto: Sorry I've not looked closely at the fernet issues | 15:52 |
| dougsz | yoctozepto: Only that the follow up patch resolved my issues on a single node deploy | 15:52 |
| hrw | otherwise no rabbitmq for centos/aarch64 so no deployments | 15:52 |
| dougsz | agree we need those 2 patches | 15:52 |
| hrw | and no, I do not plan to work on building upstream erlang to satisfy sick yoctozepto wishes | 15:52 |
| yoctozepto | priteau, dougsz: thanks, guys | 15:52 |
| yoctozepto | hrw: I'm sorry to hear you consider them sick | 15:53 |
| yoctozepto | I'm fine as long as we don't have to cater for multiarch deployment of rabbitmq (unlikely) or rdo-provided rmq breaks k-a logic at some point (more likely) | 15:54 |
| hrw | I came from 'get it working and then fix if bug reports' than 'spend extra week or two on stuff no one uses' | 15:54 |
| mgoddard | +1 | 15:55 |
| mgoddard | +2 | 15:55 |
| yoctozepto | I'm an overthinker as you might have noticed | 15:55 |
| yoctozepto | I like to know the traps ahead | 15:55 |
| hrw | yoctozepto: rmq goes from upstream repo not centos | 15:56 |
| hrw | https://24eade5565127d985eb0-7e6feee1594781d3a430e22d861f8db7.ssl.cf2.rackcdn.com/737473/2/check-arm64/kolla-build-centos8-source-aarch64/b9f98b0/kolla/build/rabbitmq.log | 15:56 |
| yoctozepto | hrw: yeah, but erlang is critical to rmq's happiness :-) | 15:56 |
| hrw | yoctozepto: so go, spend some time on building it. | 15:56 |
| hrw | copr will make it quite easy probably | 15:56 |
| yoctozepto | hrw: you are supporting aarch64 | 15:56 |
| mgoddard | hrw: ussuri fails | 15:56 |
| yoctozepto | I'm supporting your supporting | 15:57 |
| yoctozepto | and that's it :-) | 15:57 |
| hrw | mgoddard: once master gets approved I will see looking at ussuri | 15:57 |
| mgoddard | ok | 15:57 |
| mgoddard | it's approved :) | 15:57 |
| mgoddard | #topic Infra images: https://etherpad.opendev.org/p/Kolla-infra-images | 15:57 |
| *** openstack changes topic to "Infra images: https://etherpad.opendev.org/p/Kolla-infra-images (Meeting topic: kolla)" | 15:57 | |
| mgoddard | hrw again | 15:57 |
| hrw | yes | 15:57 |
| *** wuchunyang has quit IRC | 15:57 | |
| hrw | review patches, read and comment notes | 15:57 |
| hrw | or better read/comment/review even | 15:57 |
| hrw | as we had so many discussions that I am starting to loose track what we agreed and what not | 15:58 |
| yoctozepto | ++ | 15:58 |
| yoctozepto | only me looking at that etherpad though | 15:58 |
| mgoddard | will read the pad after the meeting | 15:59 |
| hrw | thx | 16:00 |
| mgoddard | that's a wrap | 16:00 |
| mgoddard | Kolla klub tomorrow | 16:00 |
| mgoddard | see you there | 16:00 |
| hrw | time for #endmeeting | 16:00 |
| mgoddard | #endmeeting | 16:00 |
| *** openstack changes topic to "Vote on Victoria priorities https://bit.ly/2ActPtx | IRC meetings on Wednesdays @ 15:00 UTC - agenda @ https://goo.gl/OXB0DL | Whiteboard: https://bit.ly/2MM7mWF | IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b" | 16:00 | |
| openstack | Meeting ended Wed Jul 1 16:00:25 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:00 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/kolla/2020/kolla.2020-07-01-15.00.html | 16:00 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/kolla/2020/kolla.2020-07-01-15.00.txt | 16:00 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/kolla/2020/kolla.2020-07-01-15.00.log.html | 16:00 |
| *** xinliang has quit IRC | 16:00 | |
| yoctozepto | ah, that kolla-toolbox | 16:01 |
| priteau | mgoddard: you were asking about chronyd server on the VIP earlier | 16:01 |
| priteau | https://opendev.org/openstack/kolla-ansible/src/branch/master/ansible/roles/chrony/templates/chrony.conf.j2#L3 | 16:01 |
| yoctozepto | it's somewhere inbetween | 16:01 |
| *** ricolin has quit IRC | 16:01 | |
| yoctozepto | priteau: but I can't see it being referenced in haproxy | 16:02 |
| yoctozepto | so it's even buggy | 16:02 |
| yoctozepto | :/ | 16:02 |
| yoctozepto | ah no | 16:02 |
| yoctozepto | chrony_bindaddress | 16:02 |
| yoctozepto | it just binds to it | 16:02 |
| yoctozepto | everywhere | 16:02 |
| yoctozepto | which means it could fail outside of haproxy nodes which allow nonlocal bind | 16:03 |
| yoctozepto | wth | 16:03 |
| priteau | I don't think haproxy talk NTP anyway | 16:03 |
| yoctozepto | priteau: yeah, it only does tcp, and ntp isn't | 16:03 |
| yoctozepto | so the containerized chrony is a bad advice | 16:03 |
| yoctozepto | all the more reasons to disable it by default and deprecate | 16:04 |
| yoctozepto | just ensure our prechecks are happy regarding ntp and all the platforms | 16:04 |
| *** kevko has quit IRC | 16:15 | |
| *** etp has quit IRC | 16:16 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: [DNM] Timesync playground https://review.opendev.org/738877 | 16:17 |
| openstackgerrit | Merged openstack/kolla-ansible master: Make ES Curator schedule multinode-friendly https://review.opendev.org/738779 | 16:18 |
| *** etp has joined #openstack-kolla | 16:19 | |
| *** k_mouza has quit IRC | 16:19 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/ussuri: Make ES Curator schedule multinode-friendly https://review.opendev.org/738878 | 16:19 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/train: Make ES Curator schedule multinode-friendly https://review.opendev.org/738879 | 16:19 |
| *** Manheim has joined #openstack-kolla | 16:19 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/ussuri: Use public interface for Magnum client and trustee Keystone interface https://review.opendev.org/738880 | 16:20 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/train: Use public interface for Magnum client and trustee Keystone interface https://review.opendev.org/738882 | 16:20 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/stein: Use public interface for Magnum client and trustee Keystone interface https://review.opendev.org/738883 | 16:20 |
| *** Manheim has quit IRC | 16:24 | |
| *** etp has quit IRC | 16:24 | |
| *** zijlboot has quit IRC | 16:28 | |
| *** zijlboot has joined #openstack-kolla | 16:29 | |
| *** dougsz has quit IRC | 16:33 | |
| *** ykarel is now known as ykarel|away | 16:34 | |
| hrw | "./tools/version-check.py --openstack-release ussuri --stable-tarballs" | 16:36 |
| dcapone2004 | meeting done? don't want to interrupt.... | 16:36 |
| hrw | dcapone2004: done | 16:36 |
| yoctozepto | mgoddard, hrw: https://review.opendev.org/738877 - it seems ubuntu & centos are time sync as expected but debian is not, weird | 16:37 |
| patchbot | patch 738877 - kolla-ansible - [DNM] Timesync playground - 1 patch set | 16:37 |
| dcapone2004 | was discussing hyperconverged with mgoddard the other day....wanting to report back my "research" with ceph...not sure if anyone thinks docs should note it or not as it isn't really kolla specific and hyper-converged isn't a large target....but cephadm and kolla will clash on hostname prerequisities and ceph doesn't recommend working around that | 16:38 |
| *** etp has joined #openstack-kolla | 16:44 | |
| *** kevko has joined #openstack-kolla | 16:45 | |
| mgoddard | dcapone2004: it seems like something that needs to be called out, and possibly addressed | 16:48 |
| mgoddard | dcapone2004: is there a launchpad bug? | 16:48 |
| mgoddard | dcapone2004: if so, could you add your notes there and share? | 16:49 |
| dcapone2004 | mgoddard: I wouldn't really call it a bug is the issue...more of a limitation of hyper-converged | 16:49 |
| dcapone2004 | api_network needs to be set to one of the ceph networks used by cephadm | 16:49 |
| mgoddard | is this a new requirement for ceph octopus? | 16:50 |
| dcapone2004 | probably moreso for cephadm | 16:50 |
| *** factor has quit IRC | 16:51 | |
| *** icarusfactor has joined #openstack-kolla | 16:51 | |
| dcapone2004 | I had the link up last night and then like an idiot I closed it....let me find it again (I also chatted in the ceph irc channel) and when I asked about working around it, someone asked if I knew what seppuku was .... so I took that as a hint not to try it | 16:51 |
| hrw | yoctozepto: what to look for? | 16:52 |
| dcapone2004 | https://docs.ceph.com/docs/master/cephadm/concepts/ | 16:53 |
| dcapone2004 | so there you see cephadm uses /etc/hosts and what is returned by hostname | 16:53 |
| yoctozepto | hrw: logs, timedatectl run | 16:53 |
| yoctozepto | hrw: but no need to, I summarized it for you, now asking infra | 16:53 |
| hrw | ok | 16:53 |
| dcapone2004 | I was told you can run certain command with cephadm by adding the IP after the hostname in many places, but the seppuku comment came in when discussing sanity checks performed by cephadm | 16:54 |
| *** bengates has quit IRC | 16:55 | |
| mgoddard | the problem with all these deployment tools is they think they own the place :) | 16:57 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: [DNM] Timesync playground https://review.opendev.org/738877 | 16:58 |
| openstackgerrit | Merged openstack/kolla-ansible master: Syntax error in Fluentd Monasca output config https://review.opendev.org/738765 | 17:00 |
| mgoddard | hrw: thanks for the write up. I made some comments, will look again | 17:00 |
| dcapone2004 | mgoddard: lol | 17:01 |
| mgoddard | dcapone2004: I would say it's worth a bug report, even if it's not strictly a bug. It's an issue, we need to be able to coexist with ceph | 17:02 |
| mgoddard | e.g. it's quite common to share controllers and ceph control services | 17:02 |
| mgoddard | heading off now | 17:03 |
| mgoddard | o/ | 17:03 |
| dcapone2004 | I will write one up.... | 17:03 |
| *** Fl1nt has joined #openstack-kolla | 17:03 | |
| Fl1nt | Hi ! | 17:03 |
| hrw | mgoddard: thanks | 17:03 |
| Fl1nt | @mgoddard, I'm really sorry, but I'll not be able to be on time on tomorrow Klub, I've got a release demo meeting in order to show off the end of our deployment project :'( | 17:04 |
| *** kevko has quit IRC | 17:07 | |
| dcapone2004 | with advanced kolla configuration is there anyway to specify in an override file that a certain field should be additive to the kolla generated config instead of a replacement....for example, I would like to enable trunk ports for neutron which requires service_plugins to include trunk | 17:08 |
| dcapone2004 | kolla already generates service_plugins=router and then has options where other things are added to the list | 17:10 |
| dcapone2004 | I am trying to determine if there is anyway in the neutron.conf override fille instead of having to put service_plugins=router,trunk or service_plugins=firewall_v2,router,trunk if there is some syntax like service_plugins=+trrunk | 17:11 |
| hrw | wth is novajoin? | 17:11 |
| openstackgerrit | Merged openstack/kolla-ansible stable/ussuri: Fix the Elasticsearch Curator cron schedule run https://review.opendev.org/738782 | 17:12 |
| dcapone2004 | hrw: was that to me? | 17:14 |
| *** _Cyclone_ has quit IRC | 17:15 | |
| *** timburke has quit IRC | 17:15 | |
| *** andreykurilin has quit IRC | 17:15 | |
| Fl1nt | @dcapone2004, you mean block_something_append ? | 17:15 |
| *** factor has joined #openstack-kolla | 17:16 | |
| *** icarusfactor has quit IRC | 17:16 | |
| dcapone2004 | sounds like something I want | 17:16 |
| *** Manheim has joined #openstack-kolla | 17:17 | |
| dcapone2004 | basically kolla generates neutron.conf without an override file with service_plugins=router | 17:17 |
| *** _Cyclone_ has joined #openstack-kolla | 17:18 | |
| dcapone2004 | I want to enable neutron trunk ports, so the way I know to do it is to put neutron.conf with [DEFAULT] service_plugins=router,trunk in the right config spot | 17:18 |
| *** timburke has joined #openstack-kolla | 17:18 | |
| *** andreykurilin has joined #openstack-kolla | 17:19 | |
| dcapone2004 | but I'm thinking outside the box on day 2 management or a requirements change.... someone enables fwaas in globals.yml and wonders why it isn't working on reconfigure | 17:19 |
| dcapone2004 | it isn't too hard to check /etc/kolla/config for an override and realize your error, so I am not requesting a change, I'm merely inquiring if the mechanism might already exist and I just don't know about it | 17:20 |
| Fl1nt | @dcapone2004, for configuration such as neutron.conf etc, the operation is a merge, not an override. | 17:20 |
| dcapone2004 | yeah, but unless I am wrong I think the way the merge works is if the "directive" (not sure the correct term) exists in the config override directory it uses the value specified in the config override directory | 17:21 |
| dcapone2004 | it merges that directive with all the other directives, but the specifically defined directive is overridden...does that make sense? | 17:22 |
| *** Manheim has quit IRC | 17:22 | |
| dcapone2004 | I can give it a try now and confirm in my dev environment...reconfigure will take a bit though | 17:23 |
| *** Manheim has joined #openstack-kolla | 17:23 | |
| Fl1nt | nope, it's not overriden, if you got let said service=A and then you define service=B you'll end up with: service=1 && service=B | 17:23 |
| dcapone2004 | hmmm....ok, that isn't the behavior that occurred when overriding ml2_conf.ini | 17:25 |
| *** born2bake has quit IRC | 17:26 | |
| *** amoralej|off has quit IRC | 17:26 | |
| *** e3gh75 has quit IRC | 17:26 | |
| *** weshay_ruck has quit IRC | 17:26 | |
| *** hjensas|afk has quit IRC | 17:26 | |
| *** zzzeek has quit IRC | 17:26 | |
| *** devfaz has quit IRC | 17:26 | |
| *** rphillips_ has quit IRC | 17:26 | |
| *** hrw has quit IRC | 17:26 | |
| *** timss has quit IRC | 17:26 | |
| *** numans has quit IRC | 17:26 | |
| Fl1nt | well, that's another config file, you told me neutron.conf ^^ | 17:26 |
| dcapone2004 | treid adding vlan support for provider networks by just specifying vlan and the ml2_conf.ini that was generated left out vxlan | 17:26 |
| dcapone2004 | ok, so it is config file dependant | 17:26 |
| dcapone2004 | I just assumed the behavior because of what I experienced with ml2_conf.ini...so I will give it a try with neutron.conf and see what happens | 17:27 |
| *** Manheim has quit IRC | 17:28 | |
| Fl1nt | hold on | 17:28 |
| *** hongbin has joined #openstack-kolla | 17:28 | |
| Fl1nt | it shouldn't | 17:28 |
| *** irclogbot_0 has quit IRC | 17:28 | |
| *** born2bake has joined #openstack-kolla | 17:29 | |
| *** amoralej|off has joined #openstack-kolla | 17:29 | |
| *** e3gh75 has joined #openstack-kolla | 17:29 | |
| *** weshay_ruck has joined #openstack-kolla | 17:29 | |
| *** hjensas|afk has joined #openstack-kolla | 17:29 | |
| *** zzzeek has joined #openstack-kolla | 17:29 | |
| *** devfaz has joined #openstack-kolla | 17:29 | |
| *** rphillips_ has joined #openstack-kolla | 17:29 | |
| *** hrw has joined #openstack-kolla | 17:29 | |
| *** timss has joined #openstack-kolla | 17:29 | |
| *** numans has joined #openstack-kolla | 17:29 | |
| *** irclogbot_2 has joined #openstack-kolla | 17:29 | |
| hrw | mgoddard: stable-tarballs version-check changes adds lot of new functionality... | 17:31 |
| Fl1nt | what is your neutron_plugin_agent @dcapone2004 | 17:32 |
| dcapone2004 | ovs | 17:32 |
| Fl1nt | ok, so your neutron.conf should get vxlan,vlan,flat as default available plugins. | 17:32 |
| Fl1nt | @dcapone2004, exactly: neutron_type_drivers: "flat,vlan,vxlan{% if neutron_plugin_agent == 'ovn' %},geneve{% endif %}" <-- that should be your default list. | 17:34 |
| *** gfidente|ffu is now known as gfidente|afk | 17:34 | |
| openstackgerrit | Merged openstack/kolla master: CentOS/AArch64: RabbitMQ is back! https://review.opendev.org/737473 | 17:36 |
| hrw | mgoddard: list of stale projects, list of projects requiring renames... | 17:37 |
| Fl1nt | @dcapone2004, did someone created a /etc/kolla/config/neutron/neutron.conf file where you specify the list ? | 17:37 |
| dcapone2004 | yes | 17:37 |
| Fl1nt | ok, don't, rather use: etc/kolla/neutron/plugins/ | 17:39 |
| Fl1nt | https://opendev.org/openstack/kolla-ansible/src/branch/master/ansible/roles/neutron/tasks/config.yml#L15 | 17:39 |
| dcapone2004 | assume you mean /etc/kolla/config/neutron/plugins? | 17:40 |
| Fl1nt | yep | 17:40 |
| dcapone2004 | and just create a file like trunk.conf with [DEFAULT} service_plugins=trunk and that should make the list append, or are you going back to the ml2_conf.ini issue? (you asked about neutron.conf, but the plugins directory is usually where ml2_conf.ini lives) | 17:41 |
| dcapone2004 | https://pastebin.com/re1DrxzS | 17:43 |
| dcapone2004 | this was ml2_conf.ini that was created in /etc/kolla/config/neutron where I learned vxlan was not automatically merged onto the type_drivers list by kolla | 17:43 |
| dcapone2004 | now, I am testing some neutron.conf overrides to enable trunk ports as we are basically looking to use this particular deployment to lab kolla deployments oddly enough | 17:44 |
| Fl1nt | it is, I linked you the the source of the template, what's your kolla release? | 17:44 |
| dcapone2004 | train | 17:45 |
| dcapone2004 | actually I might be using the master branch branch and deploying train....hold on | 17:45 |
| Fl1nt | this ml2_conf.ini file isn't correct | 17:45 |
| dcapone2004 | Name: kolla-ansible | 17:46 |
| dcapone2004 | what wasn't / isn't correct about it? | 17:46 |
| Fl1nt | your [ml2] block | 17:47 |
| dcapone2004 | what is missing/wrong? I think it worked for test scenario we were using it for....I would need to check to verify that though | 17:49 |
| Fl1nt | just get ride of it | 17:49 |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: version-check: handle using of stable branch tarballs https://review.opendev.org/738906 | 17:50 |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla stable/ussuri: version-check: handle using of stable branch tarballs https://review.opendev.org/738907 | 17:51 |
| hrw | patch for master is version-check only, for ussuri it is also updated config.py | 17:51 |
| dcapone2004 | it is gone now, as we are not using vlan provider networks in our current test....only brought it up as an example of trying to fully understand merge config behavior | 17:52 |
| * hrw off | 17:55 | |
| Fl1nt | @dcapone2004, regarding the merge strategy, I highly suggest you to have a look at the various config.yml task file to understand when does it do it and with which config, then, have a look at ansible merge_configs to understand how it is applied | 17:56 |
| Fl1nt | https://github.com/openstack/kolla-ansible/blob/master/ansible/action_plugins/merge_configs.py | 17:56 |
| dcapone2004 | https://pastebin.com/ufaLJne0 | 17:57 |
| dcapone2004 | this is basically what I am testing now....is this additive or is it going to replace that line on the merge | 17:57 |
| Fl1nt | that specific case will override it. | 17:58 |
| dcapone2004 | I just assumed that it is using the same parse routine, so if it replaced for ml2_conf.ini, it would replace for all config files (again replace the specifically defined fields) | 17:58 |
| dcapone2004 | Fl1nt: ok, that is what I thought....my question was if there was a way to define that so it is additive? | 17:58 |
| *** e0ne has quit IRC | 17:59 | |
| Fl1nt | due to: https://opendev.org/openstack/kolla-ansible/src/branch/master/ansible/roles/neutron/templates/neutron.conf.j2#L48 | 18:01 |
| Fl1nt | it will not be additive using neutron.conf BUT should be using the /etc/kolla/config/neutron/plugins directory | 18:01 |
| dcapone2004 | ok, appreciate your time here very much, I'm just not seeing how that would be defined in the plugins directory to merge it? | 18:05 |
| dcapone2004 | as neutron documention, on trunking, just basically says add trunk to the service_plugins definition in neutron.conf, so I do not understand the syntax / format I would use to define a file in the plugins directory to get that result | 18:07 |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: version-check: handle using of stable branch tarballs https://review.opendev.org/738906 | 18:10 |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla stable/ussuri: version-check: handle using of stable branch tarballs https://review.opendev.org/738907 | 18:11 |
| *** jonaspaulo has joined #openstack-kolla | 18:15 | |
| *** dasp_ has quit IRC | 18:39 | |
| *** dasp has joined #openstack-kolla | 18:41 | |
| *** hongbin has quit IRC | 18:44 | |
| *** factor has quit IRC | 18:46 | |
| *** factor has joined #openstack-kolla | 18:46 | |
| *** dcapone2004 has quit IRC | 18:50 | |
| *** cah_link has quit IRC | 18:51 | |
| *** nikparasyr has left #openstack-kolla | 18:52 | |
| *** factor has quit IRC | 19:04 | |
| *** factor has joined #openstack-kolla | 19:04 | |
| *** factor has quit IRC | 19:10 | |
| *** hongbin has joined #openstack-kolla | 19:18 | |
| v1k0d3n | hey everyone...i'm trying to enable trunk to individual vm's and a little confused on the best approach within Kolla. it doesn't look like putting an openvswitch_agent.ini gets picked up and added to neutron. i have OVS configured by default, but i think that i need to set the firewall_driver = openvswitch in securitygroup section. is anyone else doing this who could set me straight? | 19:27 |
| *** yoctozepto7 has joined #openstack-kolla | 19:37 | |
| *** yoctozepto has quit IRC | 19:45 | |
| *** yoctozepto7 is now known as yoctozepto | 19:45 | |
| *** Tengu has quit IRC | 19:45 | |
| *** vishalmanchanda has quit IRC | 19:47 | |
| *** Tengu has joined #openstack-kolla | 19:47 | |
| *** sorin-mihai__ has quit IRC | 20:01 | |
| *** hongbin has quit IRC | 20:06 | |
| *** e0ne has joined #openstack-kolla | 20:20 | |
| *** pbing19 has joined #openstack-kolla | 20:25 | |
| *** also_stingrayza has joined #openstack-kolla | 20:33 | |
| *** jonaspaulo has quit IRC | 20:34 | |
| *** stingrayza has quit IRC | 20:37 | |
| *** hongbin has joined #openstack-kolla | 20:54 | |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe master: Sync zookeeper feature flag with kolla-ansible https://review.opendev.org/738940 | 21:00 |
| *** e0ne has quit IRC | 21:07 | |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe stable/train: Remove support for Neutron LBaaS https://review.opendev.org/737479 | 21:19 |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe stable/train: Update feature flag defaults https://review.opendev.org/738776 | 21:19 |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe stable/train: Update image regexes https://review.opendev.org/738777 | 21:19 |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe stable/train: Fix condition of placement image build https://review.opendev.org/738778 | 21:19 |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe stable/train: Update feature flags https://review.opendev.org/738944 | 21:19 |
| *** priteau has quit IRC | 21:21 | |
| *** factor has joined #openstack-kolla | 21:29 | |
| *** factor has quit IRC | 21:33 | |
| *** factor has joined #openstack-kolla | 21:33 | |
| *** suff has quit IRC | 21:47 | |
| *** factor has quit IRC | 21:49 | |
| *** factor has joined #openstack-kolla | 21:50 | |
| *** oneswig has quit IRC | 21:59 | |
| *** born2bake has quit IRC | 22:08 | |
| *** Manheim has joined #openstack-kolla | 22:09 | |
| *** greuceanu has joined #openstack-kolla | 22:21 | |
| *** zhanglong has joined #openstack-kolla | 22:22 | |
| *** Manheim has quit IRC | 22:24 | |
| *** greuceanu has quit IRC | 22:27 | |
| *** luksky has quit IRC | 22:29 | |
| *** icarusfactor has joined #openstack-kolla | 22:33 | |
| *** factor has quit IRC | 22:36 | |
| *** JamesBenson has quit IRC | 22:47 | |
| *** JamesBenson has joined #openstack-kolla | 22:49 | |
| *** zhanglong has quit IRC | 22:50 | |
| *** zhanglong has joined #openstack-kolla | 22:52 | |
| *** dking has quit IRC | 22:53 | |
| *** TrevorV has quit IRC | 22:54 | |
| *** JamesBenson has quit IRC | 22:54 | |
| *** gfidente|afk has quit IRC | 22:59 | |
| *** Fl1nt has quit IRC | 23:03 | |
| *** hongbin has quit IRC | 23:11 | |
| *** dking has joined #openstack-kolla | 23:16 | |
| *** hongbin has joined #openstack-kolla | 23:16 | |
| *** zhanglong has quit IRC | 23:17 | |
| openstackgerrit | Merged openstack/kayobe master: Remove the neutron-fwaas since it retired https://review.opendev.org/736101 | 23:20 |
| *** JamesBenson has joined #openstack-kolla | 23:29 | |
| *** JamesBenson has quit IRC | 23:34 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!