Thursday, 2020-10-29

*** calbers has quit IRC00:28
*** calbers has joined #openstack-kolla00:39
*** zzzeek has quit IRC00:42
*** zzzeek has joined #openstack-kolla00:45
*** calbers has quit IRC00:56
*** calbers has joined #openstack-kolla00:59
*** brinzhang_ has joined #openstack-kolla01:31
*** brinzhang has quit IRC01:33
*** xinliang has joined #openstack-kolla01:45
*** wuchunyang has joined #openstack-kolla01:54
*** egonzalez has quit IRC01:59
*** johnsom has quit IRC02:00
*** rpittau|afk has quit IRC02:00
*** TheJulia has quit IRC02:00
*** TheJulia has joined #openstack-kolla02:00
*** rpittau|afk has joined #openstack-kolla02:00
*** johnsom has joined #openstack-kolla02:01
*** egonzalez has joined #openstack-kolla02:02
*** wuchunyang has quit IRC02:04
*** k_mouza has joined #openstack-kolla02:06
*** wuchunyang has joined #openstack-kolla02:12
*** k_mouza has quit IRC02:14
*** xinliang has quit IRC02:22
*** wuchunyang has quit IRC02:46
*** xinliang has joined #openstack-kolla03:00
*** dking has quit IRC03:35
*** dave-mccowan has quit IRC04:12
*** k_mouza has joined #openstack-kolla04:15
*** xinliang has quit IRC04:17
*** k_mouza has quit IRC04:19
*** vishalmanchanda has joined #openstack-kolla04:25
openstackgerritzhoulinhui proposed openstack/kolla-ansible master: Remove kolla-cli from vagrant  https://review.opendev.org/75501005:03
openstackgerritzhoulinhui proposed openstack/kolla-ansible master: Remove kolla-cli from vagrant  https://review.opendev.org/75501005:03
*** evrardjp has quit IRC05:33
*** evrardjp has joined #openstack-kolla05:33
*** wuchunyang has joined #openstack-kolla05:42
*** mushrushu has quit IRC06:07
*** mushrushu has joined #openstack-kolla06:08
*** skramaja has joined #openstack-kolla06:40
*** cah_link has joined #openstack-kolla06:50
*** jaicaa has quit IRC07:00
*** jaicaa has joined #openstack-kolla07:01
*** gfidente has joined #openstack-kolla07:03
*** xinliang has joined #openstack-kolla07:05
*** sluna has joined #openstack-kolla07:35
iniazibuilding new centos8 boxes, does kolla-ansible disable firewalld and replace it with nftables?07:49
*** bengates has joined #openstack-kolla08:12
*** bengates has quit IRC08:14
*** bengates has joined #openstack-kolla08:14
*** kevko has joined #openstack-kolla08:15
kevkohi guys, has anyone tried to use maxscale with kolla ?08:16
kevko(we want to move neutron db to another 2 hosts ..because neutron db is slowing whole mariadb server)08:16
kevkoso, we are trying to use maxscale on VIP on ctrl0 and ctrl1 and use readwrite split router ..08:17
kevkobut i have some issues while testing ..so wanted to just ask if someone have some experiences with maxscale configuration08:18
*** stingrayza has joined #openstack-kolla08:39
*** rpittau|afk is now known as rpittau08:40
*** also_stingrayza has quit IRC08:41
*** dcapone2004 has quit IRC08:45
*** bengates has quit IRC08:52
*** bengates has joined #openstack-kolla08:52
*** wuchunyang has quit IRC08:57
*** wuchunyang has joined #openstack-kolla09:03
mnasiadkakevko: I guess you need to fix it by yourself, and contribute support for it to Kolla-Ansible :D09:05
*** kwazar has joined #openstack-kolla09:08
mgoddardmnasiadka: what do you make of this: https://bugs.launchpad.net/kolla-ansible/+bug/190196009:19
openstackLaunchpad bug 1901960 in kolla-ansible "[OVN] enable-chassis-as-gw setting is not needed by distributed FIP" [Undecided,New]09:19
mnasiadkamgoddard: that's about right, let me fix that09:19
mgoddardmnasiadka: sure?09:19
mgoddardmnasiadka: do you know what the consequences might be?09:20
mnasiadkamgoddard: well, currently we set it for all nodes when fip is distributed, OVN in reality takes only 5 as gateway chassis09:20
mgoddardmnasiadka: is it because computes do FIPs (DNAT) but not gateway (SNAT)?09:20
mnasiadkamgoddard: yes, that's right09:21
mnasiadkaand with current approach they also do SNAT, but as I said - OVN's limit of SNAT routing chassis is 509:21
mnasiadkaI had some WIP patch to unset gateway chassis where not required09:21
mgoddardmnasiadka: related: https://bugzilla.redhat.com/show_bug.cgi?id=157049909:21
openstackbugzilla.redhat.com bug 1570499 in openstack-tripleo-heat-templates "OVN - gateways are scheduled on compute nodes and SNAT traffic goes through them" [High,Closed: errata] - Assigned to vkommadi09:21
mnasiadkamgoddard: well, that's why I did it in the same manner in kolla-ansible, because I was basing on tripleo's implementation :)09:22
mgoddardmnasiadka: OTOH, https://bugs.launchpad.net/networking-ovn/+bug/184875709:22
openstackLaunchpad bug 1848757 in networking-ovn "external connectivity to floating ip does not work when external-ids:ovn-cms-options="enable-chassis-as-gw" not set" [Undecided,New]09:22
*** jonaspaulo has joined #openstack-kolla09:23
mnasiadkamgoddard: that one is interesting, let me check09:23
mnasiadkabut I hope it's been fixed in Neutron09:24
*** dardelean has joined #openstack-kolla09:27
openstackgerritMark Goddard proposed openstack/kolla-ansible master: kibana: Remove 6.x migration from upgrade  https://review.opendev.org/76030809:28
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/ussuri: Fix permission denied during Fernet key rotation  https://review.opendev.org/76031109:32
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: Fix permission denied during Fernet key rotation  https://review.opendev.org/76031209:32
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/stein: Fix permission denied during Fernet key rotation  https://review.opendev.org/76031309:32
openstackgerritMark Goddard proposed openstack/kolla-ansible master: WIP: CI: add experimental prometheus-efk upgrade jobs  https://review.opendev.org/76008609:34
*** jonaspaulo has quit IRC09:44
hrwhttps://review.opendev.org/#/c/758957/ is cursed09:48
patchbotpatch 758957 - kolla - build: unbreak JSON serializer on failed builds - 4 patch sets09:48
hrwevery recheck fails on something else09:48
*** k_mouza has joined #openstack-kolla09:49
mgoddardhrw: we're seeing quite a few random timeouts and things currently09:52
hrwyep09:53
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: ovn: Do not schedule SNAT routers on computes  https://review.opendev.org/76031609:53
mnasiadkamgoddard: works on Ussuri without enable-chassis-as-gw in OVSDB09:55
mnasiadkamgoddard: do you think we need to add a task to remove that setting on computes, or just write in the release note that users should unset it?09:58
mgoddardmnasiadka: it depends what the consequences are09:58
mgoddardif it causes a problem, we should unset it09:58
mnasiadkamgoddard: that your SNAT traffic might go through a compute, if the active router switches to a compute based chassis.09:59
mnasiadkait depends on your environment, if that would cause a problem09:59
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: ovn: Do not schedule SNAT routers on computes  https://review.opendev.org/76031610:06
mgoddardmnasiadka: we should probably remove it for consistency10:08
mnasiadkaI'll look into it, for now I just added a text in the reno stating users should remove that option using ovs-vsctl.10:10
*** wuchunyang has quit IRC10:10
openstackgerritMark Goddard proposed openstack/kolla-ansible master: docs: Improve multinode Docker registry setup  https://review.opendev.org/76031810:11
slunamorning all! although this patch for magnum https://review.opendev.org/#/c/757772/1 has already been merged I wanted to ask, is there a doc page explaining how to patch kolla containers?10:13
patchbotpatch 757772 - magnum (stable/train) - [fix] Sync nodegroup status before delete_complete (MERGED) - 1 patch set10:13
mgoddardhi sluna. Are you using binary or source images?10:15
slunabinary, I am afraid10:15
mgoddardsluna: for the official path, you would need to wait for RDO to include the patch in their RPMs. For important fixes they may patch, otherwise you'll need to wait for magnum to do a versioned release10:16
mgoddard(which they may do if you ask nicely)10:16
mnasiadkaand then ask nicely RDO to bump up the version in their distgit repos10:17
mgoddardalternatively, you can customise your images with a footer block that pip installs from source10:17
hrwso who will give +2+w for https://review.opendev.org/#/c/758957/ patch? it passed all tests just not all at the same time10:17
patchbotpatch 758957 - kolla - build: unbreak JSON serializer on failed builds - 4 patch sets10:17
slunamgoddard: many thanks, I commented on https://review.opendev.org/#/c/757772/1 with the steps to add a footer block, would that work?10:19
patchbotpatch 757772 - magnum (stable/train) - [fix] Sync nodegroup status before delete_complete (MERGED) - 1 patch set10:19
mgoddardsluna: http://paste.openstack.org/show/799501/10:20
slunamgoddard: thank you very much, I will give it a go10:22
*** e0ne has joined #openstack-kolla10:28
*** zzzeek has quit IRC10:28
*** kevko has quit IRC10:28
*** zzzeek has joined #openstack-kolla10:29
openstackgerritMark Goddard proposed openstack/kolla-ansible master: WIP: CI: add experimental upgrade jobs  https://review.opendev.org/76008610:35
*** stingrayza has quit IRC10:46
*** stingrayza has joined #openstack-kolla10:46
*** e0ne has quit IRC10:46
*** xinliang has quit IRC10:48
*** kevko has joined #openstack-kolla10:52
*** stingrayza has quit IRC10:59
*** e0ne has joined #openstack-kolla11:03
*** iniazi has quit IRC11:04
*** iniazi has joined #openstack-kolla11:05
slunamgoddard: one last questions, after applying your change to etc/kayobe/kolla.yml, are these the commands to run http://paste.openstack.org/show/799504/11:06
mgoddardsluna: you will need to build the magnum images locally11:06
mgoddardkayobe overcloud container image build '^magnum' --push11:07
mgoddardand no need for pull-retag-push11:07
slunamgoddard: brilliant, thank you again11:08
mgoddardsluna: np11:08
*** LinPeiWen22 has quit IRC11:14
openstackgerritSven Kieske proposed openstack/kolla-ansible master: re-add rabbitmq config for interfaces  https://review.opendev.org/75857611:16
*** stingrayza has joined #openstack-kolla11:19
slunamgoddard: sorry, I get "pip: command not found" in "seed-vm:/var/log/kolla-build.log" when I run "kayobe overcloud container image build '^magnum' --push"11:28
mgoddardsluna: add dnf -y install python3-pip && \11:33
*** dave-mccowan has joined #openstack-kolla11:44
*** stingrayza has quit IRC11:45
*** dave-mccowan has quit IRC11:48
*** stingrayza has joined #openstack-kolla11:49
*** LinPeiWen has joined #openstack-kolla11:56
*** born2bake has joined #openstack-kolla12:08
*** hrw has quit IRC12:35
slunamgoddard: many thanks! I finally had to tweak it a little bit more to make it work http://paste.openstack.org/show/799507/ but it's working now!12:44
*** Luzi has joined #openstack-kolla12:53
openstackgerritSven Kieske proposed openstack/kolla-ansible master: re-add rabbitmq config for interfaces  https://review.opendev.org/75857612:58
*** kwazar has quit IRC13:10
*** wuchunyang has joined #openstack-kolla13:45
*** jbadiapa has joined #openstack-kolla13:45
*** TrevorV has joined #openstack-kolla13:48
*** wuchunyang has quit IRC14:04
*** wuchunyang has joined #openstack-kolla14:13
*** wuchunya_ has joined #openstack-kolla14:14
*** wuchunyang has quit IRC14:18
*** vishalmanchanda has quit IRC14:24
*** dardelean has quit IRC14:35
*** wuchunya_ has quit IRC14:37
*** evrardjp has quit IRC14:38
*** evrardjp has joined #openstack-kolla14:40
openstackgerritMichal Nasiadka proposed openstack/kayobe master: Change docker_registry network_mode to host  https://review.opendev.org/76037114:42
openstackgerritMerged openstack/kolla master: build: unbreak JSON serializer on failed builds  https://review.opendev.org/75895714:43
*** cah_link has quit IRC14:48
*** cah_link has joined #openstack-kolla14:49
*** wuchunyang has joined #openstack-kolla15:03
*** skramaja has quit IRC15:07
openstackgerritMichal Nasiadka proposed openstack/kayobe master: Change docker_registry network_mode to host  https://review.opendev.org/76037115:23
*** nikparasyr has joined #openstack-kolla15:25
wuchunyangmgoddard around ?15:29
mgoddardwuchunyang: hi15:29
wuchunyangneed your help.. about https://review.opendev.org/#/c/755589/15:29
patchbotpatch 755589 - kolla-ansible - octavia: support tenant management network - 14 patch sets15:29
wuchunyanghow to create a vlan subinterface and plug into a vlan provider network ?15:30
mgoddardwuchunyang: well, I think there are two cases15:31
mgoddard1. use the auto plug into OVS in that patch, the same as for VXLAN15:31
wuchunyangyes15:31
*** cah_link has quit IRC15:32
mgoddard2. use a VLAN subinterface. In order for traffic to also pass through to neutron, normally we need to use a bridge15:32
mgoddardso eth1 -> breth1 -> veth patch -> OVS bridge15:32
mgoddardthen octavia_network_interface: breth1.12315:33
wuchunyangok, i know, we  use the second case in our prodcution.15:33
mgoddardkolla does not configure those network interfaces though. It expects breth1.123 to exist15:33
wuchunyangbut we use a flat.15:33
wuchunyangin this case, we also need to configure hosts.  and we need a physnet .15:36
*** kevko has quit IRC15:36
*** kevko has joined #openstack-kolla15:36
*** hrw has joined #openstack-kolla15:37
mgoddardwuchunyang: yes, but that is out of scope for kolla ansible15:46
*** luk4s has joined #openstack-kolla15:46
*** e0ne has quit IRC15:46
luk4sAfternoon everyone15:47
wuchunyangyes,  in that case , we need config hosts.15:47
*** e0ne has joined #openstack-kolla15:47
wuchunyangnow, we just add tenant network for CI, test, or poc.15:47
luk4sI'm having an issue with the centos-source-bifrost-deploy:ussuri prebuilt docker container. It looks like the yum/dnf configuration uses http://mirror.dfw.rax.opendev.org as the baseurl which is not reachable for me. centos-source-bifrost-deploy:10.1.0 uses http://mirror.dfw.rax.opendev.org which works.15:50
luk4sIs mirror-int.ord.rax.opendev.org temporarily down, or is it a bug in the build (internal  repository)?15:50
luk4sApologies I meant to say that centos-source-bifrost-deploy:ussuri uses http://mirror-int.ord.rax.opendev.org rather than http://mirror.dfw.rax.opendev.org15:51
*** wuchunyang has quit IRC15:53
yoctozeptoluk4s: yup, that's the downside of using prebuilt images - they use magic mirrors15:59
*** ivan_lin has quit IRC16:00
*** LinPeiWen has quit IRC16:00
yoctozeptoI'd recommend you build the image yourself16:00
*** ivan_lin has joined #openstack-kolla16:00
luk4sThanks yoctozepto. As I'm starting to learn kayobe/kolla and I'd rather use prebuilt images to save time/reduce complexity, but will look into build them myself. For now can I assume this is a bug and it will be fixed at some point?16:05
yoctozeptoluk4s: you are welcome; we did not treat it as a bug so far; please report as such and we will discuss how to handle it; for now you are likely better off rebuilding if you want to customise them16:07
luk4syoctozepto, where is the best place to report it?16:09
luk4sIs this the place https://bugs.launchpad.net/kolla?16:13
yoctozeptoluk4s: yes16:14
luk4sThanks again yoctozepto . Will submit the report.16:15
yoctozeptoluk4s: thanks!16:15
*** kevko has quit IRC16:22
*** r3ap3r has quit IRC16:40
*** r3ap3r has joined #openstack-kolla16:41
mgoddardhrw, yoctozepto: tripleo gives us some of the pieces for infra images CI https://review.opendev.org/#/q/topic:new-ci-job+(status:open+OR+status:merged)+branch:master16:42
mgoddardpossibly also required for new dockerhub limits16:42
yoctozeptomgoddard: now only to find the time to look at it!16:43
mgoddardone day16:43
yoctozeptoindeed!16:44
*** Luzi has quit IRC16:46
*** mwhahaha has quit IRC16:55
*** mwhahaha has joined #openstack-kolla16:55
*** rpittau is now known as rpittau|afk16:57
*** e0ne has quit IRC17:03
yoctozeptohrw: https://review.opendev.org/760186 quick win?17:30
patchbotpatch 760186 - kolla - [CI] Use local RDO mirror - 1 patch set17:30
yoctozeptoor mnasiadka: ^17:30
openstackgerritRadosław Piliszek proposed openstack/kolla master: mark trove images as buildable for Debian/x86-64  https://review.opendev.org/75939217:31
hrwdone17:33
yoctozeptohrw: danke17:34
hrwne nada17:35
*** k_mouza has quit IRC17:41
*** gfidente is now known as gfidente|afk17:43
*** gfidente|afk has quit IRC17:54
timssHi, I've been trying to deploy yesterdays 'master' tag of the prebuilt kolla images on Ubuntu 20.04 (source) in order to check out the work on Victoria, but it's failing on the task "Creating haproxy mysql user" inside the mariadb role handler with the error "kolla_toolbox container is not running", which indeed it is not. Fetched the latest version of the kolla-ansible master branch as well. No17:57
timssfailed tasks before this. Haven't been able to find much else, any tips to where I should start looking?17:57
timssPerhaps it's a bit too daring to jump onto the master branch without much experience, but I wasn't able to find any other tags or similar I could use to try out the 'master' tagged kolla images17:59
*** luk4s has quit IRC18:09
*** dardelean has joined #openstack-kolla18:09
*** bengates has quit IRC18:17
*** born2bake has quit IRC18:18
timssOh. I forgot to update my inventory, was still using the Ussuri one.. :) Release notes ftw, the note about splitting the common role got me on the right path.18:22
*** nikparasyr has left #openstack-kolla18:32
*** jbadiapa has quit IRC19:22
*** vesper11 has quit IRC19:35
*** TrevorV has quit IRC19:39
*** k_mouza has joined #openstack-kolla19:42
*** k_mouza has quit IRC19:46
*** born2bake has joined #openstack-kolla20:15
*** zzzeek has quit IRC20:32
*** zzzeek has joined #openstack-kolla20:33
*** vesper11 has joined #openstack-kolla21:14
*** vesper has joined #openstack-kolla21:35
*** kevko has joined #openstack-kolla21:35
*** vesper11 has quit IRC21:36
*** kevko has quit IRC21:53
*** born2bake has quit IRC23:34

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!