Tuesday, 2021-05-04

*** dave-mccowan has quit IRC00:31
*** dave-mccowan has joined #openstack-kolla00:35
*** ebbex has quit IRC03:20
*** ebbex has joined #openstack-kolla03:22
*** cah_link has joined #openstack-kolla04:37
*** skramaja has joined #openstack-kolla05:04
*** vishalmanchanda has joined #openstack-kolla05:31
*** Tony31 has joined #openstack-kolla05:48
Tony31Hi does kolla-ansible support vlan provider network? I'm having some trouble getting the configuration correct, using kayobe to deploy. The error is :05:49
Tony31ailed: [localhost] (item={u'dest': u'neutron/ml2_conf.ini', u'src': u'ml2_conf.ini.j2', u'enabled': True}) => {"ansible_loop_var": "item", "changed": false, "item": {"dest": "neutron/ml2_conf.ini", "enabled": true, "src": "ml2_conf.ini.j2"}, "msg": "AnsibleUndefinedVariable: 'ansible.parsing.yaml.objects.AnsibleUnicode object' has no attribute05:49
Tony31'physical_network'"}05:49
*** nikparasyr has joined #openstack-kolla05:49
Tony31I think this is the config issue area. I dont understand this and cant find the associated doc:05:52
Tony31# List of Neutron ML2 network VLAN ranges to use. Each item should be a dict05:52
Tony31# containing the following items:05:52
Tony31# physical_network: The physical network05:52
Tony31# range: Range of allowed VLANs on this physical network (format <min>:<max>,05:52
Tony31# optional)05:52
Tony31kolla_neutron_ml2_network_vlan_ranges:05:52
Tony31  - physnet2:20:2005:52
*** skramaja_ has joined #openstack-kolla06:06
*** skramaja has quit IRC06:06
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: base: do not overwrite APT sources.list  https://review.opendev.org/c/openstack/kolla/+/78693806:15
*** Luzi has joined #openstack-kolla06:30
*** e0ne has joined #openstack-kolla06:46
*** rpittau|afk is now known as rpittau07:04
*** zijlboot has joined #openstack-kolla07:21
*** zijlboot_ has joined #openstack-kolla07:23
*** stingrayza has quit IRC07:24
*** zijlboot has quit IRC07:25
*** stingrayza has joined #openstack-kolla07:27
Tony31I was able to do the config like this and it has proceeded beyond the fail point:)07:31
Tony31kolla_neutron_ml2_network_vlan_ranges:07:31
Tony31  - {07:31
Tony31     'physical_network': 'physnet2',07:31
Tony31     'range': '20:20'07:31
Tony31    }07:31
*** andrewbonney has joined #openstack-kolla07:33
*** jbadiapa has joined #openstack-kolla07:52
*** devfaz has quit IRC08:07
*** devfaz has joined #openstack-kolla08:11
*** gfidente|afk is now known as gfidente08:23
hrwmorning08:33
mgoddardmorning08:33
*** zijlboot_ has quit IRC08:36
*** zijlboot has joined #openstack-kolla08:37
openstackgerritMerged openstack/kayobe-config stable/wallaby: Update .gitreview for stable/wallaby  https://review.opendev.org/c/openstack/kayobe-config/+/78914708:47
openstackgerritMerged openstack/kayobe-config stable/wallaby: Update TOX_CONSTRAINTS_FILE for stable/wallaby  https://review.opendev.org/c/openstack/kayobe-config/+/78914808:49
Tony31Hi guys I'm unable to get kayobe / vlan provider networks working. I'm using Train with Centos 7. Where should I be going for documentation on this?08:52
Tony31i suspect something amiss with the bridge / config08:53
hrwmgoddard: can you look at https://review.opendev.org/c/openstack/kolla/+/788462 patch?08:53
hrwTony31: sorry, I know even less about kayobe than you08:54
Tony31I know next to nothing about kayobe:)08:54
hrwcan only reply with 'have you considered move to centos 8?'08:54
Tony3116 months on this deployment so far:)08:54
mgoddardTony31: hi08:55
mgoddardhave you set kolla_enable_neutron_provider_networks?08:55
Tony31yes but the redhat team thought it was a great idea to deprecate and remove the RAID drivers from the kernel. So when I try and install it, it does not detect any local disks:)08:55
Tony31there is a bug for that and they have decided to add them back in but it's target is rhel 8.4 / centos 8.408:55
Tony31Hi Mark, long time no speak.08:55
Tony31Yes this has been set "kolla_enable_neutron_provider_networks = true"08:56
*** nikparasyr has quit IRC08:56
hrwTony31: you remind me one guy in Polish Amiga discord... also old IBM server with old MegaRAID card08:56
Tony31I also have edited neutron.yaml08:56
Tony31i dont know if i have completely 100% done correct config on neutron.yml08:56
Tony31will add a pastebin08:56
*** zijlboot_ has joined #openstack-kolla08:57
Tony31https://pastebin.com/9vNzx3nc08:57
Tony31in my last attempt at deployment on this last year I didnt see this neutron.yml file so I created the ml2 ini conf myself into the host config. I used flat vlan. It worked but I failed to deploy octavia. Maybe this was the reason.08:58
mgoddardTony31: the config looks reasonable. How does it fail?08:58
*** shyamb has joined #openstack-kolla08:58
*** shyam89 has joined #openstack-kolla08:58
hrwmgoddard: https://review.opendev.org/c/openstack/kolla/+/788970 would fix CI nicely09:00
Tony31I can ARP for the project router but not ping it. Same for the floating IP. So to me it looks like something wrong with the plugging in of the vlan. I'm using vlan 20 here. On the switch side, I've tried sending both tagged VLAN 20 as well us untagged traffic to see if I get a ping reply but no reply.09:00
mgoddardhrw: looking09:00
openstackgerritMerged openstack/kolla master: Revert "CI: temporarily disable CentOS/AArch64 testing"  https://review.opendev.org/c/openstack/kolla/+/78927209:00
hrwmgoddard: thx09:00
mgoddardTony31: security groups?09:01
*** shyam89 has quit IRC09:01
openstackgerritMarcin Juszkiewicz proposed openstack/kolla stable/wallaby: Revert "CI: temporarily disable CentOS/AArch64 testing"  https://review.opendev.org/c/openstack/kolla/+/78944209:01
Tony31i created a security group called "any" and allowed all icmp / tcp / udp for testing ingress09:01
*** zijlboot has quit IRC09:01
Tony31this is the host interface config09:02
Tony31osext_interface: brext09:02
Tony31osext_bridge_ports:09:02
Tony31  - enp9s0.2009:02
Tony31Is this right for provider vlan ?09:03
Tony31In the network config guide I see "example_vlan: 123" but this is for the control plane I Think09:03
*** zijlboot_ has quit IRC09:04
*** zijlboot has joined #openstack-kolla09:04
mgoddardTony31: so I guess you also have external_net_names: ["osext"]?09:04
*** e0ne has quit IRC09:04
Tony31external_net_names:09:05
Tony31  - osext09:05
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: CI: move to Debian 'bullseye' nodes  https://review.opendev.org/c/openstack/kolla/+/78823109:06
Tony31in brctl show should I have brext-ovs here?09:06
Tony31https://pastebin.com/U5fN0qhV09:06
mgoddardThe problem is that if you create a VLAN network in OpenStack, it will get double tagged, because your enp9s0.20 interface also applies a tag09:06
Tony31h09:06
Tony31ah*09:06
Tony31that could be it09:06
mgoddardhmm, strange that you have both enp9s0.20 and enp9s0 plugged into the bridge09:06
Tony31the symptom of being able to ARP but not ping feels like a VLAN tag issue09:06
Tony31maybe it happened when I was making small changes and then redeploying09:07
*** e0ne has joined #openstack-kolla09:07
mgoddardif you want to access provider vlans, I would plug enp9s0 into the bridge09:07
mgoddardthen neutron can apply the VLAN 20 tag in OVS09:07
Tony31ok i'll try and figure it out. thanks for the guidance on that09:07
mgoddardit might need a manual change to remove enp9s0.20 from the bridge09:08
Tony31thanks for the heads up! appreciated09:08
*** nikparasyr has joined #openstack-kolla09:08
mgoddardnp09:08
*** hrw has quit IRC09:12
*** hrw has joined #openstack-kolla09:14
openstackgerritMark Goddard proposed openstack/kayobe master: Ubuntu: add documentation & release note  https://review.opendev.org/c/openstack/kayobe/+/78847609:22
hrw2021-05-04 09:10:37.844146 | localhost | Hostname: debian-bullseye-rax-iad-002454091509:23
hrwmgoddard: we will be able to build bullseye on bullseye09:23
*** e0ne has quit IRC09:24
hrw2021-05-04 09:12:27.703397 | localhost | Hostname: debian-bullseye-arm64-linaro-us-regionone-002454092209:24
mgoddardhrw: great!09:24
hrwmgoddard: once those jobs finish I am gonna comment on remaining bullseye infra patches and once wheel cache is there we can migrate09:25
hrw2021-05-04 09:25:22.690889 | primary | INFO:kolla.common.utils.monasca-thresh:Step 15/18 : RUN if [[ -f /usr/etc/npmrc ]]; then         unlink /usr/etc/npmrc;     fi     && rm -f /etc/npmrc09:26
hrw2021-05-04 09:25:22.980739 | primary | INFO:kolla.common.utils.monasca-thresh: ---> Running in df3b1b42a52709:26
hrw2021-05-04 09:25:23.368430 | primary | INFO:kolla.common.utils.monasca-thresh:/bin/sh: 1: [[: not found09:26
hrwwe have bashism...09:26
hrwmgoddard: I blame you ;D09:27
hrwand myself and others who let it through review09:28
*** e0ne has joined #openstack-kolla09:28
mgoddardbash is great09:29
hrwunless Debian systems where /bin/sh == dash09:29
*** shyamb has quit IRC09:30
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: CI: drop bashism from template overrides  https://review.opendev.org/c/openstack/kolla/+/78954109:32
openstackgerritMerged openstack/kayobe-config-dev stable/wallaby: Update .gitreview for stable/wallaby  https://review.opendev.org/c/openstack/kayobe-config-dev/+/78914909:33
openstackgerritMerged openstack/kayobe-config-dev stable/wallaby: Update TOX_CONSTRAINTS_FILE for stable/wallaby  https://review.opendev.org/c/openstack/kayobe-config-dev/+/78915009:33
*** k_mouza has joined #openstack-kolla09:35
*** shyamb has joined #openstack-kolla09:44
Tony31Thanks for your help Mark, I can ping the project router now :)09:52
mgoddardGreat!09:56
hrwmgoddard: https://review.opendev.org/c/openstack/kolla/+/78823109:57
mgoddardhrw: what's going on with debian binay?09:58
hrwmgoddard: horizon failure. reported09:58
hrwmgoddard: and 'how it worked' - it didn't09:59
mgoddardhrw: so why did CI pass?09:59
hrwbecause it did not affected build09:59
mgoddardha09:59
mgoddardI see09:59
hrwok, yoctozepto and mnasiadka are celebrating long weekend today10:00
mgoddardwhy not hrw ?10:00
hrwmgoddard: long weekend ended yesterday. I take Saturday's TOIL on other day than today10:01
Tony31quick question (hopefully) before I log off, I have managed to get a whole blade to myself to do this deployment and avoid using VMs on oVirt (was a challenge before). I am trying to follow the docs as well as use knowledge learned from the all-in-one deployment. I basically have everything except storage using the one subnet (simplifying). So10:02
Tony31management as well as api stuff using 192.168.7.0/24. what I am hoping to do is build out a more complex deployment starting from this one blade. At the moment all is working (Im using external iscsi storage). I have controller and compute as well as network all in one blade. I think next on my list is to try and get octavia working. Then I think I10:02
Tony31can add another 2 blades in and run them either as exclusive compute or also have controller HA services there. Any thoughts or concerns?10:02
*** shyamb has quit IRC10:08
*** e0ne has quit IRC10:09
hrwmgoddard: marked merged patches in whiteboard10:14
mgoddardthanks10:14
hrwtrain is blocker10:15
hrwI hope that once we push wallaby the only reason for handling train requests will be c7-c8 migrations10:15
hrwINFO:kolla.common.utils.telegraf:1mW: GPG error: https://repos.influxdata.com/ubuntu focal InRelease: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY 684A14CF2582E0C510:19
hrwargh10:19
*** shyamb has joined #openstack-kolla10:20
hrwand we should already have that key...10:21
openstackgerritMerged openstack/kayobe stable/wallaby: Update .gitreview for stable/wallaby  https://review.opendev.org/c/openstack/kayobe/+/78914410:24
openstackgerritMerged openstack/kayobe master: Update master for stable/wallaby  https://review.opendev.org/c/openstack/kayobe/+/78914510:24
openstackgerritMerged openstack/kayobe master: Add Python3 xena unit tests  https://review.opendev.org/c/openstack/kayobe/+/78914610:24
*** shyamb has quit IRC10:24
*** shyamb has joined #openstack-kolla10:25
*** bengates has joined #openstack-kolla10:29
openstackgerritMerged openstack/kolla-ansible stable/stein: Add /run/netns bind mount to neutron_lbaas_agent  https://review.opendev.org/c/openstack/kolla-ansible/+/78891310:31
*** bengates has quit IRC10:32
*** zijlboot has quit IRC10:33
*** zijlboot has joined #openstack-kolla10:33
yoctozeptomgoddard, hrw: I'm just overloaded with pending tasks after the long weekend; ping me with concrete requests if needed; I will likely propose the promised deprecations later today10:36
mgoddardyoctozepto: please concrete my backyard10:36
hrwyoctozepto: if you can wait then I will have some holes in walls to fillup. can be with concrete10:37
hrwyoctozepto: https://review.opendev.org/c/openstack/kolla/+/789442 https://review.opendev.org/c/openstack/kolla/+/788231 https://review.opendev.org/c/openstack/kolla/+/78954110:38
yoctozeptothanks for making my day :-)10:39
*** vishalmanchanda has quit IRC10:39
hrwyoctozepto: yw10:40
yoctozeptohrw: done10:42
hrwthanks10:42
hrwI am waiting for 'CI: trust infra' to fail on gate before I send telegraf/influxdb apt key fix10:42
openstackgerritMerged openstack/kolla master: CI: move to Debian 'bullseye' nodes  https://review.opendev.org/c/openstack/kolla/+/78823110:48
hrwyay10:49
openstackgerritMarcin Juszkiewicz proposed openstack/kolla stable/wallaby: CI: move to Debian 'bullseye' nodes  https://review.opendev.org/c/openstack/kolla/+/78944310:49
hrwyoctozepto: https://review.opendev.org/c/openstack/kolla/+/789443 ;D10:49
yoctozeptowhat happened to influx and telegraf btw?10:55
yoctozepto(I approved that backport you linked)10:55
hrwno idea but apt key is now wrong10:57
hrwcentos repo is broken too10:57
yoctozeptoeh xD10:57
hrwINFO:kolla.common.utils.influxdb:[MIRROR] influxdb-1.8.5.x86_64.rpm: Downloading successful, but checksum doesn't match. Calculated: 43a904ea9b70da8acb1ca0d3cc9f8168b50c74aa(sha1)  Expected: b0423045a2d2c2c2e5da588b1c7f16488613f24d(sha1)10:57
hrwINFO:kolla.common.utils.influxdb:[FAILED] influxdb-1.8.5.x86_64.rpm: No more mirrors to try - All mirrors were already tried without success10:58
openstackgerritMerged openstack/kayobe master: Revert to binary images for nova  https://review.opendev.org/c/openstack/kayobe/+/78847210:59
yoctozeptowell, then they either got hacked or legitimately changed keys11:04
openstackgerritVerification of a change to openstack/kolla failed: [CI] Trust only infra mirrors  https://review.opendev.org/c/openstack/kolla/+/78897011:05
openstackgerritVerification of a change to openstack/kolla failed: Revert "CI: drop ubuntu-aarch64 job"  https://review.opendev.org/c/openstack/kolla/+/78899711:05
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: [CI] Trust only infra mirrors  https://review.opendev.org/c/openstack/kolla/+/78897011:07
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: base: use proper key for influxdb APT repository  https://review.opendev.org/c/openstack/kolla/+/78955011:07
*** Tony31 has quit IRC11:18
hrwINFO:kolla.common.utils.telegraf:The GPG keys listed for the "InfluxDB Repository - RHEL 8" repository are already installed but they are not correct for this package.11:23
hrwmgoddard: https://review.opendev.org/c/openstack/kolla/+/787513 - any opinion?11:28
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: base: use proper keys for influxdb repositories  https://review.opendev.org/c/openstack/kolla/+/78955011:30
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: [CI] Trust only infra mirrors  https://review.opendev.org/c/openstack/kolla/+/78897011:30
*** dasp has quit IRC11:31
*** dasp has joined #openstack-kolla11:33
hrwINFO:kolla.common.utils.horizon:Successfully tagged zigo1/debian-binary-horizon:12.1.011:33
*** macz_ has joined #openstack-kolla12:19
*** macz_ has quit IRC12:23
openstackgerritPierre Riteau proposed openstack/kayobe stable/wallaby: Revert to binary images for nova  https://review.opendev.org/c/openstack/kayobe/+/78944712:27
*** vishalmanchanda has joined #openstack-kolla12:44
*** shyamb has quit IRC12:45
*** dave-mccowan has quit IRC12:59
*** dave-mccowan has joined #openstack-kolla13:03
mgoddardhrw: looks reasonable, will review another time13:03
mgoddardhrw: k-a needs bullseye nodepool images too :)13:03
openstackgerritMarcin Juszkiewicz proposed openstack/kolla-ansible master: CI: move to Debian bullseye  https://review.opendev.org/c/openstack/kolla-ansible/+/78956913:21
hrwmgoddard: here you have ;D13:21
*** Luzi has quit IRC13:26
*** LinPeiWen has joined #openstack-kolla13:26
mgoddardhrw: Dziękuję Ci13:27
yoctozeptooh, how sweet <313:45
*** skramaja_ has quit IRC13:48
*** zijlboot has quit IRC13:53
*** nikparasyr has left #openstack-kolla14:28
*** zijlboot has joined #openstack-kolla14:30
*** zijlboot has quit IRC14:32
*** zijlboot_ has joined #openstack-kolla14:32
*** zijlboot_ has quit IRC14:36
*** zijlboot has joined #openstack-kolla14:39
openstackgerritMerged openstack/kolla stable/wallaby: CI: move to Debian 'bullseye' nodes  https://review.opendev.org/c/openstack/kolla/+/78944314:47
openstackgerritMerged openstack/kolla stable/wallaby: Revert "CI: temporarily disable CentOS/AArch64 testing"  https://review.opendev.org/c/openstack/kolla/+/78944214:48
*** macz_ has joined #openstack-kolla14:48
*** zijlboot has quit IRC14:56
*** zijlboot has joined #openstack-kolla14:56
*** zijlboot has quit IRC14:57
*** zijlboot has joined #openstack-kolla14:57
*** zijlboot has quit IRC14:57
*** zijlboot has joined #openstack-kolla14:58
*** zijlboot has quit IRC14:58
*** zijlboot has joined #openstack-kolla14:59
*** zijlboot has quit IRC14:59
*** zijlboot has joined #openstack-kolla15:00
*** zijlboot has quit IRC15:00
*** zijlboot has joined #openstack-kolla15:01
*** zijlboot has quit IRC15:01
*** zijlboot has joined #openstack-kolla15:02
*** zijlboot has quit IRC15:02
*** zijlboot has joined #openstack-kolla15:03
*** zijlboot has quit IRC15:03
*** zijlboot has joined #openstack-kolla15:04
*** zijlboot has quit IRC15:04
*** zijlboot has joined #openstack-kolla15:05
*** zijlboot has quit IRC15:05
*** zijlboot has joined #openstack-kolla15:05
*** zijlboot has quit IRC15:06
*** zijlboot has joined #openstack-kolla15:06
*** zijlboot has quit IRC15:07
*** zijlboot has joined #openstack-kolla15:07
*** zijlboot has quit IRC15:12
*** zijlboot has joined #openstack-kolla15:14
*** k_mouza has quit IRC15:18
*** zijlboot has quit IRC15:19
*** k_mouza has joined #openstack-kolla15:19
*** zijlboot has joined #openstack-kolla15:30
*** zijlboot has quit IRC15:31
*** k_mouza_ has joined #openstack-kolla15:31
*** zijlboot has joined #openstack-kolla15:31
*** zijlboot has quit IRC15:31
*** zijlboot has joined #openstack-kolla15:32
*** zijlboot has quit IRC15:32
*** zijlboot has joined #openstack-kolla15:32
*** zijlboot has quit IRC15:34
*** k_mouza has quit IRC15:34
openstackgerritMark Goddard proposed openstack/kayobe master: Add os_release variable, build CentOS stream images  https://review.opendev.org/c/openstack/kayobe/+/78898416:01
openstackgerritMark Goddard proposed openstack/kayobe master: Add os_release variable, build CentOS stream images  https://review.opendev.org/c/openstack/kayobe/+/78898416:03
*** LinPeiWen has quit IRC16:04
hrwand bullseye wheel cache jobs are on gate too ;D16:29
*** bsanjeewa has joined #openstack-kolla16:34
*** zijlboot has joined #openstack-kolla16:36
*** zijlboot has quit IRC16:38
*** zijlboot_ has joined #openstack-kolla16:39
*** zijlboot_ has quit IRC16:39
*** rpittau is now known as rpittau|afk16:47
yoctozeptogreat16:49
*** bsanjeewa has quit IRC16:55
*** cah_link has quit IRC16:57
*** bsanjeewa has joined #openstack-kolla16:59
*** bsanjeewa has quit IRC17:05
*** murphyslawbbs has joined #openstack-kolla17:13
*** k_mouza_ has quit IRC17:14
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: base: check for compatible distro using just sh  https://review.opendev.org/c/openstack/kolla/+/78751317:27
hrwyoctozepto: pure posix sh17:27
hrwworks in dash17:27
*** murphyslawbbs has quit IRC17:35
yoctozeptohrw: nice!17:35
hrwthx for comments17:48
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: base: check for compatible distro using just sh  https://review.opendev.org/c/openstack/kolla/+/78751317:48
*** zeestrat has quit IRC17:58
*** r3ap3r has quit IRC17:59
*** andrewbonney has quit IRC18:00
*** zeestrat has joined #openstack-kolla18:01
*** r3ap3r has joined #openstack-kolla18:01
*** andrewbonney has joined #openstack-kolla18:02
*** k_mouza has joined #openstack-kolla18:14
*** vishalmanchanda has quit IRC18:18
*** jbadiapa has quit IRC18:27
*** k_mouza has quit IRC18:38
*** andrewbonney has quit IRC19:23
*** k_mouza has joined #openstack-kolla19:31
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: [CI] Trust only infra mirrors  https://review.opendev.org/c/openstack/kolla/+/78897019:31
*** k_mouza has quit IRC19:39
*** e0ne has joined #openstack-kolla20:25
*** e0ne has quit IRC20:52
*** murphyslawbbs has joined #openstack-kolla21:27
*** murphyslawbbs has quit IRC21:34
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: Revert "CI: drop ubuntu-aarch64 job"  https://review.opendev.org/c/openstack/kolla/+/78899721:50
*** murphyslawbbs has joined #openstack-kolla21:51
*** murphyslawbbs has quit IRC21:53
*** kevko has joined #openstack-kolla22:24
*** macz_ has quit IRC22:57
*** dave-mccowan has quit IRC23:03
*** dave-mccowan has joined #openstack-kolla23:05

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!