Tuesday, 2021-03-02

admin0if I try to login from the controller to galera ip directly, it works just fine00:00
*** macz_ has quit IRC00:06
*** luksky has quit IRC00:14
*** tosky has quit IRC00:17
*** jamesdenton has quit IRC00:26
*** jamesden_ has joined #openstack-ansible00:27
openstackgerritEbbex proposed openstack/openstack-ansible-ops stable/victoria: Fixes for tests and gates, stable/victoria  https://review.opendev.org/c/openstack/openstack-ansible-ops/+/77808400:38
openstackgerritMerged openstack/openstack-ansible master: Switch gnocchi release to 4.4  https://review.opendev.org/c/openstack/openstack-ansible/+/77248500:40
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Move lxc cache facts setting to where those facts are used.  https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/77619900:58
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Remove duplicate lxc volume tasks  https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/77620001:00
openstackgerritEbbex proposed openstack/openstack-ansible-ops stable/victoria: Fixes for tests and gates, stable/victoria  https://review.opendev.org/c/openstack/openstack-ansible-ops/+/77808401:20
*** LowKey has quit IRC01:44
*** LowKey has joined #openstack-ansible01:45
openstackgerritEbbex proposed openstack/openstack-ansible-ops stable/victoria: Fixes for tests and gates, stable/victoria  https://review.opendev.org/c/openstack/openstack-ansible-ops/+/77808402:39
*** spatel has joined #openstack-ansible03:03
*** spatel has quit IRC03:22
openstackgerritJames Denton proposed openstack/openstack-ansible master: Add Neutron Role Testing Overrides  https://review.opendev.org/c/openstack/openstack-ansible/+/77800803:28
jamesden_watersj yes, ironic and nova (vms) can co-exist03:29
*** jamesden_ is now known as jamesdenton03:29
*** rh-jlabarre has quit IRC04:35
*** zul has quit IRC04:53
*** evrardjp has quit IRC05:33
*** evrardjp has joined #openstack-ansible05:33
openstackgerritEbbex proposed openstack/openstack-ansible-ops stable/victoria: Fixes for tests and gates, stable/victoria  https://review.opendev.org/c/openstack/openstack-ansible-ops/+/77808405:33
*** shyamb has joined #openstack-ansible06:09
*** shyamb has quit IRC06:32
*** SiavashSardari has joined #openstack-ansible06:37
*** gyee has quit IRC06:47
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Convert host and container journal collection to python  https://review.opendev.org/c/openstack/openstack-ansible/+/73488306:51
*** miloa has joined #openstack-ansible06:53
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-lxc_hosts master: DNM - test log collection  https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/77814106:54
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-openstack_hosts master: DNM: test log collection  https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/77814206:56
*** miloa has quit IRC06:57
*** shyamb has joined #openstack-ansible07:09
*** jawad_axd has joined #openstack-ansible07:25
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Convert host and container journal collection to python  https://review.opendev.org/c/openstack/openstack-ansible/+/73488307:44
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-lxc_hosts master: Use ansible_facts[] instead of fact variables  https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/77695907:51
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-openstack_hosts master: Correct the UCA repo location variable for ubuntu focal  https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/77773407:54
*** andrewbonney has joined #openstack-ansible07:58
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-openstack_hosts master: Assume centos version is at least 8.3  https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/77616908:00
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_tempest master: add bug url to readme  https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/61327608:05
*** shyamb has quit IRC08:05
openstackgerritJonathan Rosser proposed openstack/ansible-role-python_venv_build stable/victoria: Slurp constraints for all hosts  https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/77810408:06
*** luksky has joined #openstack-ansible08:14
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Convert host and container journal collection to python  https://review.opendev.org/c/openstack/openstack-ansible/+/73488308:18
*** rpittau|afk is now known as rpittau08:22
*** jbadiapa has joined #openstack-ansible08:35
*** tosky has joined #openstack-ansible08:35
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-lxc_hosts master: Optionally build container image as a local chroot  https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/77620108:54
*** jamesdenton has quit IRC08:56
*** jamesdenton has joined #openstack-ansible08:57
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible master: Use admin user instead of root for galera  https://review.opendev.org/c/openstack/openstack-ansible/+/77568408:59
*** shyamb has joined #openstack-ansible09:01
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible master: Cover galera verification with no_log  https://review.opendev.org/c/openstack/openstack-ansible/+/77815209:13
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Convert host and container journal collection to python  https://review.opendev.org/c/openstack/openstack-ansible/+/73488309:42
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Updated from OpenStack Ansible Tests  https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/77799509:45
openstackgerritMerged openstack/openstack-ansible-os_octavia master: Use global service variables  https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/76995210:06
openstackgerritMerged openstack/openstack-ansible-os_octavia master: Use barbican for certificates storage  https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/76851410:11
openstackgerritMerged openstack/openstack-ansible-os_octavia master: Move octaiva pip packages from constraints to requirements  https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/77229310:11
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible stable/ussuri: Workaround nova bug  https://review.opendev.org/c/openstack/openstack-ansible/+/77810510:12
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible stable/ussuri: Workaround nova bug  https://review.opendev.org/c/openstack/openstack-ansible/+/77810510:14
openstackgerritMerged openstack/openstack-ansible-os_glance master: Use ansible_facts[] instead of fact variables  https://review.opendev.org/c/openstack/openstack-ansible-os_glance/+/77717910:14
jrosserhmmm right so i think we only need to unstick os_neutron and we can merge the new pip resolver stuff10:15
noonedeadpunkjamesdenton: did great progress there with integrated tests10:17
* noonedeadpunk will kill himself while debugging magnum...10:17
openstackgerritMerged openstack/openstack-ansible-os_tempest master: add bug url to readme  https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/61327610:18
jrosserone of the folk here built something really quick with microk8s10:20
jrosserand it made me think back to the time around rocky we tried to deploy magnum and got nowhere in the end10:20
noonedeadpunkwell, it works nicely nowadays I guess. When you don't want to make it work through proxy...10:21
jrosseryeah, i submitted a ton of proxy related patches back then but they're not testing any of that in CI so it rots super quickly10:21
noonedeadpunkI have interminnent issue now, when one time cluster is created and other fails with `E0224 13:09:37.605344    4543 csi_plugin.go:271] Failed to initialize CSINodeInfo: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "test-proxy-wjwvjyxitg6o-master-0" not found`10:22
openstackgerritMerged openstack/ansible-role-python_venv_build stable/victoria: Gather facts for repo containers  https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/77790810:23
openstackgerritMerged openstack/ansible-role-python_venv_build master: [reno] Stop publishing release notes  https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/77200610:23
noonedeadpunkI kind of use the same template and have no idea why it's floating....10:24
noonedeadpunkAnd obviously http://127.0.0.1:8080/api/v1/nodes/ does not contain nodes when it fails...10:27
noonedeadpunkit feels like smth can fail before proxy is in place or smth like that10:33
*** shyam89 has joined #openstack-ansible10:35
*** shyamb has quit IRC10:36
noonedeadpunksmth is wrong with galera 10.5.9 even with admin user....10:41
*** shyam89 has quit IRC10:42
*** shyamb has joined #openstack-ansible10:47
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-galera_server master: DNM  https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/77816310:47
*** LowKey has quit IRC10:51
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Correct the UCA repo location variable for ubuntu focal  https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/77773411:21
openstackgerritMerged openstack/openstack-ansible-os_nova master: Use ansible_facts[] instead of fact variables  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/77762711:22
*** gshippey has joined #openstack-ansible11:38
openstackgerritMerged openstack/ansible-role-python_venv_build stable/victoria: Slurp constraints for all hosts  https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/77810411:47
*** shyamb has quit IRC11:48
noonedeadpunkI think I will wait till https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/773962 before bumping V11:54
*** mathlin has quit IRC12:15
*** rh-jlabarre has joined #openstack-ansible13:04
openstackgerritMerged openstack/openstack-ansible stable/victoria: Workaround nova bug  https://review.opendev.org/c/openstack/openstack-ansible/+/77777913:17
*** SiavashSardari has quit IRC13:19
*** SiavashSardari has joined #openstack-ansible13:24
*** pto has joined #openstack-ansible13:35
fricklernoonedeadpunk: I just discovered https://bugs.launchpad.net/openstack-ansible/+bug/1902914 , the issue is already present in stein, would it be possible to backport this? the [nova] section was actually introduced in pike by cinder, but it's still not documented in their install guide, either :(13:51
openstackLaunchpad bug 1902914 in openstack-ansible "cinder extend "Policy doesn't allow os_compute_api:os-server-external-events:create to be performed"" [Medium,Fix released] - Assigned to Dmitriy Rabotyagov (noonedeadpunk)13:51
ptoI am seeing some strage errors in keystone about rabbitmq ssl errors: http://paste.openstack.org/show/803142/ - any idea why these have started to emerge+13:55
jamesdentonfrickler maybe as a temporary work around you could define those missing config options using a cinder_cinder_conf_overrides13:58
jamesdentonhttps://docs.openstack.org/project-deploy-guide/openstack-ansible/draft/app-advanced-config-override.html13:58
*** jamesgibo has joined #openstack-ansible14:08
*** spatel has joined #openstack-ansible14:24
*** jawad_axd has quit IRC14:31
*** jawad_axd has joined #openstack-ansible14:32
*** spatel has quit IRC15:00
openstackgerritMerged openstack/openstack-ansible-os_octavia stable/victoria: Add variable to override keypair setup python interpreter  https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/77396215:00
*** spatel has joined #openstack-ansible15:02
*** miloa has joined #openstack-ansible15:05
*** miloa has quit IRC15:06
mgariepyhey pto did you figureout the gpu passthrough the other day ?15:06
*** pto has quit IRC15:10
*** jawad_axd has quit IRC15:15
*** weshay|ruck has joined #openstack-ansible15:16
*** jawad_axd has joined #openstack-ansible15:16
*** macz_ has joined #openstack-ansible15:19
noonedeadpunkfrickler: oh, interesting. I thought it touches only in-use volume interaction? And it was not the case in S?15:20
noonedeadpunkbut we can backport this if you know it's relevant15:21
*** corvus has joined #openstack-ansible15:21
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Convert host and container journal collection to python  https://review.opendev.org/c/openstack/openstack-ansible/+/73488315:22
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Gather minimal facts for dynamic_address_fact  https://review.opendev.org/c/openstack/openstack-ansible/+/77798915:24
*** jawad_axd has quit IRC15:24
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Gather minimal facts in common playbooks  https://review.opendev.org/c/openstack/openstack-ansible/+/77799015:24
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in playbooks  https://review.opendev.org/c/openstack/openstack-ansible/+/77799615:24
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in group_vars  https://review.opendev.org/c/openstack/openstack-ansible/+/77799715:25
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in tests  https://review.opendev.org/c/openstack/openstack-ansible/+/77799815:25
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in AIO config  https://review.opendev.org/c/openstack/openstack-ansible/+/77799915:25
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in docs  https://review.opendev.org/c/openstack/openstack-ansible/+/77800015:26
*** openstackgerrit has quit IRC15:35
fricklernoonedeadpunk: resizing attached rbd volumes was added in S, that's my use case15:36
*** openstackgerrit has joined #openstack-ansible15:36
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_nova master: Do not use service_facts  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/77764415:36
noonedeadpunkok, gotcha, then let's backport that...15:37
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_cinder stable/train: Define credentials for nova interaction  https://review.opendev.org/c/openstack/openstack-ansible-os_cinder/+/77811315:39
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible stable/victoria: Bump SHAs for stable/victoria  https://review.opendev.org/c/openstack/openstack-ansible/+/77552115:39
openstackgerritArtom Lifshitz proposed openstack/openstack-ansible-os_tempest master: Add whitebox-tempest-plugin support  https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/77147215:52
noonedeadpunk#startmeeting openstack_ansible_meeting16:00
openstackMeeting started Tue Mar  2 16:00:24 2021 UTC and is due to finish in 60 minutes.  The chair is noonedeadpunk. Information about MeetBot at http://wiki.debian.org/MeetBot.16:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:00
*** openstack changes topic to " (Meeting topic: openstack_ansible_meeting)"16:00
openstackThe meeting name has been set to 'openstack_ansible_meeting'16:00
noonedeadpunk#topic office hours16:00
*** openstack changes topic to "office hours (Meeting topic: openstack_ansible_meeting)"16:00
noonedeadpunk#chair jrosser16:00
openstackCurrent chairs: jrosser noonedeadpunk16:00
noonedeadpunkSorry, I will need to run away somewhere in the middle of the meeting16:01
jrosserhello16:01
noonedeadpunkhey!16:01
noonedeadpunkalso, fwiw, I will be absent during the rest of this and the next weeks, so I won't be able to take part during next meeting16:02
mgariepyhey16:02
jrosserok no problem16:02
jamesdentono/16:02
noonedeadpunkwe need to agree on cycle-highlights16:02
jrosseri guess we can say centos8-stream, that looks like it will work now16:03
jrosser(i think i will regret saying that......)16:03
noonedeadpunkthey are due to be published on 11th of March16:03
noonedeadpunkwe totally will16:03
noonedeadpunklet's say experimental support?:)16:04
jrossersounds good :)16:04
jrosserwe can also maybe say that Zun is no longer experimental, we know it works now16:04
noonedeadpunkyep, agree16:04
jrosserOVN is new this cycle for depoyment16:04
noonedeadpunkIs it?16:05
noonedeadpunkI think it was for V?16:05
jrosseroh err, maybe it was in V16:05
noonedeadpunkProbably never properly announced though...16:05
mgariepyovn was kinda there in U but it was not really working correclty.16:05
jrosserinternal SSL /o\16:05
mgariepythere was some part missing like ovsdb ha stuff and so on.16:05
noonedeadpunkI think we should also say that we reworked the way we interact with certificates and that now we issue a root certificate authority on the deploy host which is used for all self-signed certificates16:06
noonedeadpunknot sure how to phrase this correctly though16:06
noonedeadpunkBut with rabbit failing we have no option but to implement this... We have 2-3 month for this for sure?:)16:07
noonedeadpunkrelease is on 14th of April + 2 month for trailing...16:07
noonedeadpunkFeels doable16:07
jamesdentonis OVN working now, mgariepy ?16:07
mgariepyi didn't had time to work on it yet.16:08
jamesdentonkk16:08
jamesdentonhoping to resolve these integrated tests today, btw16:08
noonedeadpunkI also would love to integrate cloudkitty finally, but prefer not to announce that I guess.16:08
noonedeadpunkDebian bullseye - should we aim to add it's support? Considering buster won't support W at least in terms of libvirt16:09
jrosseri would like to though it does depend on the infra folk helping with the mirror and image16:10
jrosseri was thinking to do some local testing if there is a bullseye cloud image yet16:10
jrosserahha http://cloud.debian.org/images/cloud/bullseye/daily/20210302-564/16:11
jrosserthe debuntu OS seem relatively lightweight to add support for, though there was some quite big difficulty with lxc/apparmor for buster16:12
noonedeadpunkso: 1. Significantly improved Zun deployment and moved from experimental to stable status. 2. Exerimental support for CentOS Stream 3. Experimental support of Debian Bullseye 4. All self-signed SSL will now be generated with local Certificate Authority and thus be internally trusted.16:14
jrossersounds good16:15
openstackgerritMerged openstack/openstack-ansible master: [doc] Fix Docker latest_tag parser  https://review.opendev.org/c/openstack/openstack-ansible/+/77567016:15
noonedeadpunkAnother thing is that galera admin user makes galera role fail :(16:17
jrosseryeah, i've not had any chance to look at that16:18
noonedeadpunkeventually it's failed with at healthcheck-infrastructure.yml with `Can't connect to MySQL server on` which is... not good I think16:20
noonedeadpunkbut yeah, didn't have much time to spend on it.16:20
noonedeadpunk10.5.9 in current shape also seems like broken a bit (at least during upgrade)16:20
noonedeadpunkI think we have fixed Victoria now?16:21
noonedeadpunkSo I've updated bump https://review.opendev.org/c/openstack/openstack-ansible/+/77552116:22
jrosseri think that all the broken things have now merged16:22
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Gather minimal facts in common playbooks  https://review.opendev.org/c/openstack/openstack-ansible/+/77799016:22
noonedeadpunkjrosser: sounds not so promising haha16:22
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in playbooks  https://review.opendev.org/c/openstack/openstack-ansible/+/77799616:23
jrosseroh! yes that could maybe use better words16:23
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in group_vars  https://review.opendev.org/c/openstack/openstack-ansible/+/77799716:23
noonedeadpunkbut yeah. I hope we really have fixed issues and good to go with 22.1.0 finally16:23
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in tests  https://review.opendev.org/c/openstack/openstack-ansible/+/77799816:24
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in AIO config  https://review.opendev.org/c/openstack/openstack-ansible/+/77799916:24
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in docs  https://review.opendev.org/c/openstack/openstack-ansible/+/77800016:24
jrosseri did another go at the u-c caching after we discussed it before16:25
jrosserneed to look at why it broke but it should hopefully be simpler this time https://review.opendev.org/q/topic:%22osa-uc-cache%22+(status:open%20OR%20status:merged)16:26
noonedeadpunkoh, sorry, wasn't able to check it properly. Looked good at glance for me16:26
jrosserno worries, i'll try to get all of that passing16:26
noonedeadpunkSorry, need to run away now16:27
* noonedeadpunk has a flight in 5 hours16:27
jrosserhave a good break16:28
openstackgerritJames Denton proposed openstack/openstack-ansible master: Add Neutron Role Testing Overrides  https://review.opendev.org/c/openstack/openstack-ansible/+/77800816:29
mgariepyhave a good one noonedeadpunk16:29
openstackgerritMerged openstack/openstack-ansible-ops stable/victoria: Fixes for tests and gates, stable/victoria  https://review.opendev.org/c/openstack/openstack-ansible-ops/+/77808416:29
noonedeadpunkyeah, thanks! will really try me best :p16:29
jamesdentonjrosser the ODL PPA hasn't been updated since v9 of ODL, they're at v13 now. We could consider implementing the manual install process, or deprecate ODL support16:29
jamesdentoni also need to revisit the NSH support for OVS, as i think that's baked in now.16:30
jrosseryes, andrewbonney had a look at the ODL stuff and I think found the same16:30
jrosserit was hard to get anything working on focal without major changes16:30
openstackgerritJames Denton proposed openstack/openstack-ansible-os_neutron master: Add integrated tests various Neutron deployment scenarios  https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/77801516:30
jamesdentonw/ fluorine?16:31
jamesdentonor Aluminum?16:31
jrosserafaik we couldnt find a PPA for anything for focal16:31
jamesdentonsame16:31
jrosserso really the major problem right now is we can't merge anything to os_neutron16:32
jamesdentoni reverted the ODL jobs to bionic and made them all non-voting16:32
jrosserif it means that we move ODL and anything else to nv.... ^ that16:32
jamesdenton778008 will need to merge before 77801516:33
jrosseranyway it's excellent news because those functional jobs were really hard to maintain16:33
jamesdentonand i'll need to make a small change to rename a job in 778015, but yeah, we're close16:33
jrossercool16:33
jrosserdid you see on the ML that there is talk of moving devstack to default to OVN16:34
jamesdentonyeah, read the same think 1.5 yrs ago :D16:34
jamesdenton*thing16:34
noonedeadpunklol16:37
jrosserjust looking at the bug list https://bugs.launchpad.net/openstack-ansible/+bugs?orderby=-id&start=016:37
jrosseris there anything we should look at, not sure there is much new16:37
noonedeadpunkall new things I saw were more like support requests...16:37
jrosseroh jamesdenton i was looking at this https://bugs.launchpad.net/openstack-ansible/+bug/191428116:37
openstackLaunchpad bug 1914281 in openstack-ansible "Network architectures in openstack-ansible" [Undecided,New]16:38
jrosserthe L3 routed example is just absurdly wrong16:38
jrosserall the /24 networks are scrambled up between the example config and the text16:38
jamesdentonyikes, ok16:38
jrosserall the same networks /24 dont fall into a larger contiguous CIDR as far as i could see16:39
gshippeyhttps://bugs.launchpad.net/openstack-ansible/+bug/1911482 think this one can be closed16:44
openstackLaunchpad bug 1911482 in openstack-ansible "neutron-l3-agent broken after train upgrade" [Undecided,Incomplete]16:44
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_nova master: Do not use service_facts  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/77764416:48
gshippeyhttps://bugs.launchpad.net/openstack-ansible/+bug/1857899 and https://bugs.launchpad.net/openstack-ansible/+bug/1915617 seem to be the same issue, might be worth marking the second one as a duplicate and confirming the first one16:49
openstackLaunchpad bug 1857899 in openstack-ansible "controllerX-gnocchi-container missing dependency to libxml2.so.2 " [Undecided,New]16:49
openstackLaunchpad bug 1915617 in openstack-ansible "python-libxml2 missing on gnocchi container" [Undecided,New]16:49
jrosserhrrm yes the gnocchi ansible role looks like it needs some attention there16:51
jrosserit doesnt have a difference between target vs. build distro packages16:51
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_gnocchi master: Provide different package lists for install and wheel build  https://review.opendev.org/c/openstack/openstack-ansible-os_gnocchi/+/77822216:57
jrosserok i've made a patch, marked the 2nd bug as duplicate and updated the first bug16:58
openstackgerritJames Denton proposed openstack/openstack-ansible-os_neutron master: Add integrated tests various Neutron deployment scenarios  https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/77801516:59
jrosserwe're out of meeting time, does anyone have anything else?16:59
jrosser#endmeeting17:00
*** openstack changes topic to "Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: http://bit.ly/osa-review-board-v3"17:00
openstackMeeting ended Tue Mar  2 17:00:12 2021 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)17:00
openstackMinutes:        http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2021/openstack_ansible_meeting.2021-03-02-16.00.html17:00
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2021/openstack_ansible_meeting.2021-03-02-16.00.txt17:00
openstackLog:            http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2021/openstack_ansible_meeting.2021-03-02-16.00.log.html17:00
*** sshnaidm is now known as sshnaidm|afk17:00
gshippeynice quick fix :) I'm going to nip out and catch the last of the evening sun!17:01
openstackgerritJames Denton proposed openstack/openstack-ansible-os_neutron master: Add integrated tests various Neutron deployment scenarios  https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/77801517:05
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_gnocchi master: Provide different package lists for install and wheel build  https://review.opendev.org/c/openstack/openstack-ansible-os_gnocchi/+/77822217:10
openstackgerritMerged openstack/openstack-ansible-os_cinder master: Replace deprecated key_manager  https://review.opendev.org/c/openstack/openstack-ansible-os_cinder/+/77694317:28
*** SiavashSardari has quit IRC17:39
*** rpittau is now known as rpittau|afk17:42
*** jamesgibo has quit IRC18:04
jrosseri really wish this code was commented/documented https://github.com/openstack/openstack-ansible/blob/master/playbooks/common-tasks/dynamic-address-fact.yml18:06
jrosserit seems really complex for unclear reasons that i'm wary to break when changing it18:07
jrosseron some level this feels equivalent http://paste.openstack.org/show/803151/ but i'm curious why all the complexity with json_query18:08
openstackgerritMerged openstack/openstack-ansible stable/ussuri: Workaround nova bug  https://review.opendev.org/c/openstack/openstack-ansible/+/77810518:11
*** ajg20 has joined #openstack-ansible18:18
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: [reno] Stop publishing release notes  https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/77201818:25
*** andrewbonney has quit IRC18:38
noonedeadpunkjrosser: iirc complexity exactly because of `replace('-','_')`19:28
jrosserdid you see my paste? that seems equivalent for a container at least19:29
noonedeadpunkreplace was needed only for bare metal19:30
noonedeadpunkbut I think that can be simplified indeed. I guess I just didn't find the way back then19:30
jrosseryeah, I’m going to test this tomorrow against a real deployment and make a playbook to check that it comes out the same each time with something simpler19:31
noonedeadpunkI was really struggling until I came up to this iirc19:32
jrosserabsolutely, I’m wary of some hidden corner cases here19:33
noonedeadpunkand the thing here was, that for vxlan network I was using not bridge, but interface ib1.87d2 and dot there should not be interpreted as key to the dict19:34
noonedeadpunkbut again I could forget exact context...19:35
jrosserah indeed, we have something similar but I think make a neutron override directly for that so this code isn’t involved19:36
jrosserbond2.vlan-id sort of thing for the vxlan interface19:37
noonedeadpunkyeah. but looking at https://github.com/openstack/openstack-ansible/commit/9f6bf94d1a922553f7bc9b3a614b857b666822db#diff-81778cd8cb530cb7fde96dcab4213abae4e868fec833c2a5a47105b8571ca19a that has nothing to do with json_query19:37
noonedeadpunkok, commit msg kind of explains I guess why json_query has been used https://github.com/openstack/openstack-ansible/commit/6d9f7f23372cc607a5f624c0d9407d5b752e8ae119:38
noonedeadpunknot sure how valid nowadays tough19:38
*** juanoterocas has joined #openstack-ansible20:10
*** mcarden has joined #openstack-ansible20:14
*** ioni has joined #openstack-ansible20:17
*** spatel has quit IRC20:25
*** Underknowledge has quit IRC20:26
*** Underknowledge has joined #openstack-ansible20:26
openstackgerritMerged openstack/openstack-ansible master: Use infra mirror for ceph_client role in CI  https://review.opendev.org/c/openstack/openstack-ansible/+/77569520:41
jrosserjamesdenton: do we need to add things to here for ovn? https://github.com/openstack/openstack-ansible/blob/master/scripts/log-collect.sh#L39-L7221:00
jrosseri was looking for the ovn northd logs and couldnt find them21:00
jamesdentonprrrrrrobably?21:00
jamesdentoni've got a deploy going locally for the aio_ovn_metal scenaio21:01
* jrosser not sure what the proceses are called21:01
jamesdentonone sec21:01
jrosseri think adding whaterver prefix they hare to that list is sufficient, like systemd covers systemd*21:01
jamesdentonneutron-ovn-northd, neutron-ovn-controller, neutron-ovn-metadata-agent21:02
jamesdentoni would expect them to be in the journal21:02
jrosserhmm interesting21:02
jamesdentoni could be mistakrn,will check this deploy when its done21:03
jrossercool ok21:03
jrosserhttps://zuul.opendev.org/t/openstack/build/f34005b905844524af216846100747d4/logs21:03
jrosserargh web2.0 stuff21:03
jrosserhttps://bacfa3e13b0e097fa4b5-bb16683249f908fc1002d6892692fd50.ssl.cf5.rackcdn.com/778015/6/check/openstack-ansible-deploy-aio_metal_ovn-ubuntu-focal2/f34005b/logs/host/21:04
jamesdentonhttps://bacfa3e13b0e097fa4b5-bb16683249f908fc1002d6892692fd50.ssl.cf5.rackcdn.com/778015/6/check/openstack-ansible-deploy-aio_metal_ovn-ubuntu-focal2/f34005b/logs/host/ovn/index.html21:04
jrosseroh interesting, that must mean it's not systemd stuff21:05
* jrosser not looked at this ever21:05
jamesdentonit's been a while, sorry21:05
jrosseryeah this is what i was suspecting ovsdb_jsonrpc_server|ERR|ptcp:6641:0.0.0.0: listen failed: Address already in use21:06
jamesdentonthats the metal error huh21:06
jrosseri think so yes, it'll be needing to bind to the second address on br-mgmt i think21:07
jrosserthe one with 101 in the last octect21:07
jrosser.100 is the vip, .101 is the internal services bind address21:07
jamesdentonwasn't there a workaround for this...21:08
jamesdentonto bind to mgmt add vr 0.0.0.021:08
jamesdenton*vs21:08
jrossergiven the tests for ovn were all functional ones i don't think bind-to-mgmt affected them21:09
jrosserand an lxc job would be fine anyway21:09
jrosserthings only go bad on the metal jobs21:09
jrosserwhich i wonder if we ever had for ovn before?21:09
jamesdentonwe did not21:10
jamesdentoni can remove it and we can add it later?21:10
jamesdentonlet me just do that21:10
jrosseroh hold on i got it the wrong way round https://opendev.org/openstack/openstack-ansible/src/branch/master/etc/openstack_deploy/openstack_user_config.yml.aio.j2#L3421:11
jrosser.101 is the VIP, .100 is what the services should bind to21:11
jamesdentonis that new?21:11
jrosseryes, that was the solution for metal+bind-to-mgmt21:11
jrosserin the past the metal jobs didnt deploy haproxy so there was no issue, but now they do21:12
jamesdentonor, i can just {{ openstack_service_bind_address }}21:12
jrosserthat should do it21:12
jamesdentonk21:12
*** tsturm has quit IRC21:20
jamesdentonjrosser ovn looking good w/ that chg21:24
openstackgerritJames Denton proposed openstack/openstack-ansible-os_neutron master: Add integrated tests various Neutron deployment scenarios  https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/77801521:24
*** jbadiapa has quit IRC21:35
*** ajg20 has quit IRC21:40
*** gyee has joined #openstack-ansible21:43
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Convert host and container journal collection to python  https://review.opendev.org/c/openstack/openstack-ansible/+/73488322:14
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-lxc_hosts master: Use ansible_facts[] instead of fact variables  https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/77695922:34
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-lxc_hosts master: Optionally build container image as a local chroot  https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/77620122:49
*** juanoterocas has quit IRC22:50
*** gshippey has quit IRC23:24
*** luksky has quit IRC23:35
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Use ansible_facts[] instead of fact variables  https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/77797523:46
openstackgerritMerged openstack/openstack-ansible-ceph_client master: Use ansible_facts[] instead of fact variables  https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/77717723:55

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!