Monday, 2021-03-15

*** ianw has joined #openstack-kolla00:11
openstackgerritMerged openstack/kolla-ansible stable/victoria: Introduce nova_libvirt_logging_debug  https://review.opendev.org/c/openstack/kolla-ansible/+/77978500:26
*** LinPeiWen55 has joined #openstack-kolla00:36
*** oyrogerg has joined #openstack-kolla01:20
*** LinPeiWen55 has quit IRC01:36
*** LinPeiWen24 has joined #openstack-kolla01:52
*** LinPeiWen24 has quit IRC02:05
*** zzzeek has quit IRC02:09
*** zzzeek has joined #openstack-kolla02:11
*** zzzeek has quit IRC02:36
*** zzzeek has joined #openstack-kolla02:39
Aethylred...I might have gone a bit crazy with the GitLab https://gitlab.com/aethylred/kolla-image-builder03:07
Aethylredalso, if you think I might have gone a bit overboard making container images, you should see our internal GitLab-CE instance https://gitlab.com/aethylred/kolla-image-builder/container_registry03:08
*** ricolin has quit IRC03:26
*** shyamb has joined #openstack-kolla04:09
*** ricolin has joined #openstack-kolla04:12
*** Aethylred has quit IRC04:15
*** baha has joined #openstack-kolla04:16
*** vishalmanchanda has joined #openstack-kolla04:31
*** ricolin has quit IRC04:33
*** skramaja has joined #openstack-kolla04:34
*** LinPeiWen75 has joined #openstack-kolla04:55
*** shyamb has quit IRC05:09
*** k_mouza has joined #openstack-kolla05:16
*** k_mouza has quit IRC05:21
*** brinzhang has joined #openstack-kolla06:33
*** e0ne has joined #openstack-kolla06:49
*** sorin-mihai has joined #openstack-kolla06:52
*** e0ne has quit IRC07:03
*** k_mouza has joined #openstack-kolla07:12
*** k_mouza has quit IRC07:16
osmanlicilegimorning07:24
*** e0ne has joined #openstack-kolla07:36
*** e0ne has quit IRC07:36
hrwhttps://review.opendev.org/c/openstack/kolla/+/772841 (move to centos 8 stream) waits for 2nd brave core08:11
hrwmorning08:11
mnasiadkamorning08:11
mnasiadkahrw: done08:15
hrwthanks08:15
*** andrewbonney has joined #openstack-kolla08:16
*** bengates has joined #openstack-kolla08:16
*** priteau has joined #openstack-kolla08:17
*** bengates has quit IRC08:18
*** bengates has joined #openstack-kolla08:19
*** rpittau|afk is now known as rpittau08:22
*** bengates_ has joined #openstack-kolla08:26
*** bengates has quit IRC08:29
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Add missing octavia-driver-agent  https://review.opendev.org/c/openstack/kolla-ansible/+/76187208:33
*** eliaswimmer has joined #openstack-kolla08:59
*** LinPeiWen has quit IRC09:07
*** LinPeiWen has joined #openstack-kolla09:07
*** eliaswimmer has quit IRC09:11
*** k_mouza has joined #openstack-kolla09:12
*** eliaswimmer has joined #openstack-kolla09:15
*** e0ne has joined #openstack-kolla09:16
*** k_mouza has quit IRC09:16
*** e0ne has quit IRC09:40
*** k_mouza has joined #openstack-kolla09:56
mgoddardmorning10:07
*** dciabrin_ is now known as dciabrin10:12
openstackgerritMark Goddard proposed openstack/kolla-ansible master: prometheus: Collect metrics from rabbitmq  https://review.opendev.org/c/openstack/kolla-ansible/+/62833710:30
*** k-s-dean has joined #openstack-kolla10:31
openstackgerritMark Goddard proposed openstack/kolla master: WIP: Fix Ussuri builds due to RDO Virtualization GPG key  https://review.opendev.org/c/openstack/kolla/+/78053710:33
openstackgerritMerged openstack/kayobe stable/train: Performance: avoid set_fact in Kolla Ansible host vars  https://review.opendev.org/c/openstack/kayobe/+/75880810:39
*** openstackgerrit has quit IRC10:43
*** k_mouza has quit IRC11:02
*** k_mouza_ has joined #openstack-kolla11:02
*** e0ne has joined #openstack-kolla11:06
*** kevko_ has joined #openstack-kolla11:17
oyrogergHi everyone, I'm getting a bit confused about networking with a k-a deployment. Is anyone around who can try to help out?12:15
k-s-deanI'll try but I'm not a developer for kolla.12:18
kevko_listening12:18
oyrogergThank you both... I had a deployment working a long while back, but since the underlying networking has changed, I think misunderstanding has meant I haven't kept up with the right config. So, details...12:19
oyrogergbootstrap-servers and prechecks jobs run fine. deploy starts to run fine, but then a significant way in, during a neutron task, some hosts cannot contact docker.com ... and in fact network comms isn't working properly at all. The defaul route is on a bridge named 'external', and on those hosts the external bridge interface now has 'master ovs-system' in `ip -o link` output. Those without it, still have working network12:23
oyrogergDNS still works, but not ping, curl etc.12:23
k-s-deanThat sounds like an underlying network issue rather than the deployment.12:24
k-s-deanare you using a deployment host?12:24
k-s-deanor are you running kolla on the controller ?12:25
kplantwhatever interface you set as the neutron bridge can't be relied upon for host connectivity12:25
kplanti think it says so in the yaml12:25
oyrogergSo, perhaps I am giving globals.yml the wrong network variables.12:25
kplantyou need another interface for that12:25
oyrogergk-s-dean: Yes a deployment host, 'dev-kolla-admin' is where I run it. 3 controllers, 2 compute nodes for the moment. External Ceph.12:25
kplant# This is the raw interface given to neutron as its external network port. Even12:26
kplant# though an IP address can exist on this interface, it will be unusable in most12:26
kplant# configurations. It is recommended this interface not be configured with any IP12:26
kplant# addresses for that reason.12:26
oyrogergkplant: Hmm yes that might be relevant. Looking12:26
kplantafter neutron/ovs consumes your interface you lose connectivity, i'm positive :-)12:27
oyrogergYour confidence is heartening (:12:27
k-s-deanI set the default route on the management interface and use that to pull down the appropriate packages.12:28
oyrogergI'm left wondering why we're not doing that. Some legacy reasons which will need me to poke others in business hours I suspect.12:30
k-s-deanYour provider network should only be used for VM access, you will need another interface for pulling package updates etc... on your firewall enable the connection when you need package updates and shut it down after your done.12:31
k-s-deanI'm wondering if someone could answer my question, I've currently got a deployment running and everything is working ( I've actually come across a number of bugs when using backend TLS and various config files not having the CA cert set for comms ).12:34
k-s-deanCurrently I'm trying to get Designate to interoperate with Neutron Floating IP. I had this working in the past and previously on floating IP creation the VM name would be update in designate with corresponding floating IP. But at the moment what I'm seeing is that on VM creation the Fixed IP address on the private network which is VXLAN based is being updated in designate with the (VM).(zone) pointing to the fixed IP rather than the12:36
k-s-dean(VM).(zone) pointing to the floating IP12:36
k-s-deanI've tried a bunch of different settings in the designate.conf but everytime i create a VM the fixed IP gets put into DNS records rather than the floating IP.12:37
k-s-deanthe short term fix would be to use flat provider network and then it would work as expected.12:38
k-s-deanbut that would disable the ability to have private networks which I need.12:38
k-s-deanHas anyone got an suggestions on how to fix the issue. My last attempt is to try and use the kolla images from docker hub, as I built my own using kolla-build.12:42
kevko_hmm, it looks like you should use several interfaces ..12:45
kevko_oyrogerg: check this -> neutron_external_interface: "ens8,ens7" AND neutron_bridge_name: "br-ex,br-ex2"12:47
kevko_oyrogerg: these are values I have configured on my test deployment12:48
kevko_(i have two external networks for external and octavia external)12:48
*** k_mouza_ has quit IRC12:50
*** ricolin_ has joined #openstack-kolla12:50
*** ricolin_ has quit IRC12:50
*** k_mouza has joined #openstack-kolla12:50
*** ricolin has joined #openstack-kolla12:51
*** Luzi has joined #openstack-kolla12:55
oyrogergkevko_: Okay thanks. The devices are bond0.### for vlans on bond, but the notion should be the same.12:55
kevko_oyrogerg: hmm, you should define your networking in OVS container12:56
oyrogergI don't know what you mean sorry12:57
kevko_oyrogerg: this is kolla's problem when using few interfaces , i have a patch which i would like to send to zuul ..but still don't have time for it12:57
*** ricolin has quit IRC13:15
k-s-deanAny body come across this before ?13:31
k-s-deanfatal: [controller]: FAILED! => {"msg": "'project_info' is undefined"}13:31
k-s-deanSeems the prepare yaml is not being run during an upgrade13:32
*** ricolin has joined #openstack-kolla13:45
*** e0ne has quit IRC13:46
*** e0ne has joined #openstack-kolla13:46
*** openstackgerrit has joined #openstack-kolla14:00
openstackgerritPierre Riteau proposed openstack/kayobe-config-dev master: DNM: Test multiple environments  https://review.opendev.org/c/openstack/kayobe-config-dev/+/75246914:00
*** Luzi has quit IRC14:04
k-s-deanPlease could someone help me. I used to have this working.14:14
k-s-dean192-168-100-201.os.example.com.     | A    | 192.168.100.20114:14
k-s-dean10-30-0-195.os.example.com.         | A    | 10.30.0.19514:15
k-s-deanI cant get the VM name reference the floating IP14:15
k-s-deantest1234.os.example.com.            | A    | 192.168.100.20114:15
k-s-deanthe fixed IPs are being registered in DNS.14:16
k-s-deando i need to specify a different zone for nova:fixed ?14:16
openstackgerritPierre Riteau proposed openstack/kayobe master: Support multiple environments from a single configuration  https://review.opendev.org/c/openstack/kayobe/+/73486714:19
openstackgerritPierre Riteau proposed openstack/kayobe master: Add a command to create a new Kayobe environment  https://review.opendev.org/c/openstack/kayobe/+/77055314:19
openstackgerritPierre Riteau proposed openstack/kayobe master: Support passing multiple Kayobe inventory arguments  https://review.opendev.org/c/openstack/kayobe/+/77371814:19
openstackgerritPierre Riteau proposed openstack/kayobe master: Detect multiple inventories automatically  https://review.opendev.org/c/openstack/kayobe/+/77371914:19
openstackgerritPierre Riteau proposed openstack/kayobe master: Add documentation for multiple environments  https://review.opendev.org/c/openstack/kayobe/+/77055414:19
openstackgerritPierre Riteau proposed openstack/kayobe master: [DNM] Set environment for testing  https://review.opendev.org/c/openstack/kayobe/+/77341114:19
openstackgerritwu.chunyang proposed openstack/kolla-ansible master: Use Docker healthchecks for ceilometer services  https://review.opendev.org/c/openstack/kolla-ansible/+/78059714:26
*** adrian-a has joined #openstack-kolla14:30
oyrogergPossibly no surprises here, but switching to using the management network for route and gateway instead of same as neutron, deployment worked fine. Thank tiy for the help. Bedtime now!14:50
*** muhaha has joined #openstack-kolla15:47
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Add missing octavia-driver-agent  https://review.opendev.org/c/openstack/kolla-ansible/+/76187215:49
*** LinPeiWen75 has quit IRC16:00
*** adrian-a has quit IRC16:04
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Add missing octavia-driver-agent  https://review.opendev.org/c/openstack/kolla-ansible/+/76187217:04
*** rpittau is now known as rpittau|afk17:04
*** dasp_ has joined #openstack-kolla17:10
*** dasp has quit IRC17:14
*** k_mouza has quit IRC17:21
*** k_mouza has joined #openstack-kolla17:21
*** jonaspaulo has joined #openstack-kolla17:25
*** bengates_ has quit IRC17:27
openstackgerritIsaac Prior proposed openstack/kolla-ansible master: Fix fluentd v1 buffer syntax issue  https://review.opendev.org/c/openstack/kolla-ansible/+/78062917:28
openstackgerritMark Goddard proposed openstack/kolla stable/ussuri: Fix Ussuri builds due to RDO Virtualization GPG key  https://review.opendev.org/c/openstack/kolla/+/78055217:28
openstackgerritIsaac Prior proposed openstack/kolla-ansible master: Fix fluentd v1 buffer syntax issue  https://review.opendev.org/c/openstack/kolla-ansible/+/78062917:33
*** kevko_ has quit IRC17:36
*** kevko_ has joined #openstack-kolla17:36
*** muhaha has quit IRC17:56
openstackgerritMerged openstack/kayobe stable/victoria: CI: display VM console log on ping or SSH failure  https://review.opendev.org/c/openstack/kayobe/+/77993517:57
openstackgerritMerged openstack/kayobe stable/ussuri: CI: Use cached cirros image for seed vm job  https://review.opendev.org/c/openstack/kayobe/+/77993317:57
openstackgerritMerged openstack/kayobe stable/ussuri: CI: display VM console log on ping or SSH failure  https://review.opendev.org/c/openstack/kayobe/+/78007617:57
*** kevko__ has joined #openstack-kolla17:57
openstackgerritMerged openstack/kayobe stable/train: Update IPA docs and test build with extra-hardware  https://review.opendev.org/c/openstack/kayobe/+/77983917:57
openstackgerritMerged openstack/kayobe stable/ussuri: Update IPA docs and test build with extra-hardware  https://review.opendev.org/c/openstack/kayobe/+/77981117:57
*** kevko_ has quit IRC18:03
*** stackedsax has quit IRC18:03
*** k_mouza has quit IRC18:04
*** stackedsax has joined #openstack-kolla18:05
*** e0ne has quit IRC18:09
*** andrewbonney has quit IRC18:13
*** k-s-dean has quit IRC18:47
*** k-s-dean has joined #openstack-kolla18:48
*** sorin-mihai has quit IRC18:55
*** sorin-mihai has joined #openstack-kolla18:56
*** sorin-mihai has quit IRC19:05
*** wathoom_ has joined #openstack-kolla19:09
*** wathoom has quit IRC19:11
*** Mr_Freezeex has quit IRC19:11
*** gary_perkins_ has quit IRC19:11
*** Wasaac has quit IRC19:11
*** atmark has quit IRC19:11
*** gary_perkins has joined #openstack-kolla19:11
*** tbarron has quit IRC19:11
*** Wasaac has joined #openstack-kolla19:11
*** kevko__ has quit IRC19:13
*** kevko_ has joined #openstack-kolla19:29
*** mushrushu has quit IRC19:31
*** mushrushu_ has joined #openstack-kolla19:31
*** mushrushu_ is now known as mushrushu19:32
*** kevko has quit IRC19:32
openstackgerritMerged openstack/kolla stable/ussuri: Fix Ussuri builds due to RDO Virtualization GPG key  https://review.opendev.org/c/openstack/kolla/+/78055220:13
*** dciabrin has quit IRC20:17
*** dciabrin has joined #openstack-kolla20:17
*** adrian-a has joined #openstack-kolla20:27
*** adrian-a has quit IRC20:30
openstackgerritMaksim Malchuk proposed openstack/kolla-ansible master: Fix the Tempest image url variable  https://review.opendev.org/c/openstack/kolla-ansible/+/78032820:32
*** k-s-dean has quit IRC20:53
*** jonaspaulo has quit IRC20:55
*** amoralej|off has quit IRC20:56
*** ozzzo has quit IRC20:58
*** amoralej|off has joined #openstack-kolla20:58
*** ozzzo has joined #openstack-kolla20:58
*** vishalmanchanda has quit IRC21:32
*** e0ne has joined #openstack-kolla21:37
*** e0ne_ has joined #openstack-kolla21:41
*** e0ne has quit IRC21:41
*** muhaha has joined #openstack-kolla21:46
*** k-s-dean has joined #openstack-kolla21:47
*** sean-k-mooney has quit IRC21:50
*** muhaha has quit IRC21:58
*** sean-k-mooney has joined #openstack-kolla22:17
*** Aethylred has joined #openstack-kolla23:08
*** Aethylred has quit IRC23:15
*** sean-k-mooney has quit IRC23:18
*** sean-k-mooney has joined #openstack-kolla23:25
*** zijlboot_ has joined #openstack-kolla23:34
*** zijlboot has quit IRC23:36
*** e0ne has joined #openstack-kolla23:51
*** e0ne_ has quit IRC23:51

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!