Thursday, 2021-02-18

*** luksky has quit IRC00:33
*** pescobar has quit IRC00:35
*** pescobar has joined #openstack-kolla00:37
*** LinPeiWen has joined #openstack-kolla00:43
*** imcsk8 has joined #openstack-kolla01:40
*** zzzeek has quit IRC02:47
*** ricolin_ has joined #openstack-kolla02:48
*** zzzeek has joined #openstack-kolla02:50
*** mchlumsky0 has joined #openstack-kolla02:55
*** dmsimard8 has joined #openstack-kolla02:56
*** ricolin_ has quit IRC02:59
*** dmsimard has quit IRC02:59
*** mchlumsky has quit IRC02:59
*** priteau has quit IRC02:59
*** gouthamr has quit IRC02:59
*** dmsimard8 is now known as dmsimard02:59
*** mchlumsky0 is now known as mchlumsky02:59
*** ianw has quit IRC02:59
*** ianw has joined #openstack-kolla03:00
*** k_mouza has joined #openstack-kolla03:02
*** gouthamr has joined #openstack-kolla03:03
*** gouthamr has quit IRC03:03
*** gouthamr has joined #openstack-kolla03:06
*** gouthamr has quit IRC03:06
*** k_mouza has quit IRC03:07
*** gouthamr has joined #openstack-kolla03:11
*** gouthamr has quit IRC03:11
*** waxfire has quit IRC03:27
*** waxfire has joined #openstack-kolla03:28
*** gouthamr has joined #openstack-kolla03:28
*** gouthamr has quit IRC03:28
*** gouthamr has joined #openstack-kolla03:43
*** gouthamr has quit IRC03:43
*** gouthamr has joined #openstack-kolla04:26
*** gouthamr has quit IRC04:26
*** cah_link has joined #openstack-kolla04:51
*** skramaja has joined #openstack-kolla05:03
*** rohit02 has joined #openstack-kolla05:07
*** shyamb has joined #openstack-kolla05:23
*** shyam89 has joined #openstack-kolla05:23
*** gouthamr has joined #openstack-kolla06:01
*** k_mouza has joined #openstack-kolla06:16
*** maharg101 has joined #openstack-kolla06:16
*** k_mouza has quit IRC06:20
*** shyam89 has quit IRC06:21
*** shyamb has quit IRC06:21
*** maharg101 has quit IRC06:21
*** shyamb has joined #openstack-kolla06:21
*** shyam89 has joined #openstack-kolla06:21
*** wuchunyang has joined #openstack-kolla06:22
*** shyamb has quit IRC06:28
*** shyam89 has quit IRC06:28
*** vishalmanchanda has joined #openstack-kolla06:34
yoctozeptomorning07:17
yoctozeptodmsimard: mmm, smells like major breakage is on the horizon07:18
yoctozeptothankfully, we have our pinned07:18
wuchunyangmorning07:20
*** brinzhang has quit IRC07:45
*** brinzhang has joined #openstack-kolla07:45
*** LinPeiWen has quit IRC08:12
*** rpittau|afk is now known as rpittau08:14
*** luksky has joined #openstack-kolla08:17
*** gfidente|afk is now known as gfidente08:17
*** bengates has joined #openstack-kolla08:19
*** bengates has quit IRC08:20
*** bengates has joined #openstack-kolla08:21
*** andrewbonney has joined #openstack-kolla08:26
*** dougsz has joined #openstack-kolla08:29
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Add missing octavia-driver-agent  https://review.opendev.org/c/openstack/kolla-ansible/+/76187208:29
*** maharg101 has joined #openstack-kolla08:30
mnasiadkayoctozepto: well, we don't support 2.10 yet, maybe it's time ;)08:33
*** maharg101 has quit IRC08:40
*** LinPeiWen has joined #openstack-kolla08:59
*** brinzhang has quit IRC09:00
mnasiadkayoctozepto: https://review.opendev.org/c/openstack/kolla-ansible/+/775873 - can you have a look?09:01
hrwmorning09:08
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: CI: Move from ceph-ansible to cephadm  https://review.opendev.org/c/openstack/kolla-ansible/+/77141809:08
*** e0ne has joined #openstack-kolla09:12
*** calbers has quit IRC09:25
*** calbers has joined #openstack-kolla09:25
*** gfidente has quit IRC09:26
*** k_mouza has joined #openstack-kolla09:28
mgoddardmorning09:28
openstackgerritMark Goddard proposed openstack/kolla-ansible master: DNM: Test chrony apparmor fix  https://review.opendev.org/c/openstack/kolla-ansible/+/77641109:30
wuchunyangmorning09:30
wuchunyangmgoddard. no help in  the octavia ci failed mail09:32
*** gfidente has joined #openstack-kolla09:35
openstackgerritMark Goddard proposed openstack/kolla-ansible master: WIP: CI: monasca job follow up  https://review.opendev.org/c/openstack/kolla-ansible/+/77388110:03
*** wuchunyang has quit IRC10:03
openstackgerritMark Goddard proposed openstack/kolla-ansible master: WIP: CI: monasca job follow up  https://review.opendev.org/c/openstack/kolla-ansible/+/77388110:05
openstackgerritMark Goddard proposed openstack/kayobe master: Fix veth pair creation with VLAN interfaces  https://review.opendev.org/c/openstack/kayobe/+/77641410:22
*** alpha23 has quit IRC10:24
*** wuchunyang has joined #openstack-kolla10:39
*** wuchunyang has quit IRC10:44
openstackgerritMerged openstack/kolla-ansible master: Replace db-sock with db-nb-sock and db-sb-sock  https://review.opendev.org/c/openstack/kolla-ansible/+/77159410:50
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Add missing octavia-driver-agent  https://review.opendev.org/c/openstack/kolla-ansible/+/76187211:02
*** kevko has joined #openstack-kolla11:02
*** kevko_ has joined #openstack-kolla11:04
*** kevko has quit IRC11:04
yoctozeptomnasiadka: commented11:11
mnasiadkajust raising a bug and writing reno11:11
yoctozeptomnasiadka, mgoddard: yeah, we should probably re-evaluate 2.10 at this point11:11
mnasiadkawhat's the problem with 2.10? anything fails there?11:12
yoctozeptomnasiadka: I approved; not caring that much11:12
yoctozeptomnasiadka: it was failing before11:12
yoctozeptoon some beta release11:12
yoctozeptono idea now :-)11:12
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: DNM: Test Ansible 2.10  https://review.opendev.org/c/openstack/kolla-ansible/+/77642011:17
mnasiadkaso let's see11:17
yoctozepto++11:19
yoctozeptothe old one was https://review.opendev.org/c/openstack/kolla-ansible/+/75242011:19
yoctozepto2.10.0rc111:19
*** hjensas|afk is now known as hjensas11:20
openstackgerritDoug Szumski proposed openstack/kolla-ansible master: Remove Monasca Log Transformer  https://review.opendev.org/c/openstack/kolla-ansible/+/76990011:21
openstackgerritDoug Szumski proposed openstack/kolla-ansible master: Disable Monasca Log Metrics service by default  https://review.opendev.org/c/openstack/kolla-ansible/+/76990111:21
openstackgerritDoug Szumski proposed openstack/kolla-ansible master: Support disabling Monasca alerting pipeline  https://review.opendev.org/c/openstack/kolla-ansible/+/76990211:21
openstackgerritDoug Szumski proposed openstack/kolla-ansible master: Support bypassing Monasca Log API for control plane logs  https://review.opendev.org/c/openstack/kolla-ansible/+/77621911:21
*** kevko_ has quit IRC11:21
*** kevko has joined #openstack-kolla11:22
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: ovn: Move openvswitch related tasks to openvswitch role  https://review.opendev.org/c/openstack/kolla-ansible/+/77642111:26
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible stable/victoria: ovn: Fix disabling of gateway chassis  https://review.opendev.org/c/openstack/kolla-ansible/+/77643611:27
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible stable/ussuri: ovn: Fix disabling of gateway chassis  https://review.opendev.org/c/openstack/kolla-ansible/+/77643711:30
*** priteau has joined #openstack-kolla11:34
*** born2bake has joined #openstack-kolla11:42
*** zijlboot has joined #openstack-kolla11:43
openstackgerritMerged openstack/kolla master: Add `crudini` to ovs-dpdk containers  https://review.opendev.org/c/openstack/kolla/+/77582112:09
hrwit is good to have aarch64 machine locally to do some kolla builds ;D12:23
dmsimardyoctozepto: no major breakage worthy of a major version bump expected, it's the community package moving to semver. There'll be blog posts out layer today to explain what it means12:26
openstackgerritMerged openstack/kolla-ansible master: ovn: Fix disabling of gateway chassis  https://review.opendev.org/c/openstack/kolla-ansible/+/77587312:31
yoctozeptomnasiadka, hrw: https://review.opendev.org/c/openstack/kolla/+/77622113:13
hrwlgtm13:14
yoctozeptodmsimard: just kidding; 2.10.0rc1 broke for us so the joke stayed13:14
yoctozeptodmsimard: we will see to checking 3.0 as well13:14
yoctozeptodmsimard: thanks for the heads up (sorry I forgot to previously) :-)13:15
openstackgerritMerged openstack/kolla master: CI: publish images on a weekly basis  https://review.opendev.org/c/openstack/kolla/+/77622113:25
*** LinPeiWen has quit IRC13:39
*** wuchunyang has joined #openstack-kolla13:41
openstackgerritDoug Szumski proposed openstack/kolla-ansible master: Register Elasticsearch in Keystone  https://review.opendev.org/c/openstack/kolla-ansible/+/74412113:56
openstackgerritDoug Szumski proposed openstack/kolla-ansible master: WIP: Run Monasca Tempest in CI  https://review.opendev.org/c/openstack/kolla-ansible/+/74316413:56
mnasiadkayoctozepto: seems only upgrade jobs failed, but that's because they try to use ansible 2.10 and only 2.9 is supported14:15
yoctozeptomnasiadka: yeah, we should take ansible upgrade into account14:16
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible stable/victoria: ovn: Fix disabling of gateway chassis  https://review.opendev.org/c/openstack/kolla-ansible/+/77643614:18
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible stable/ussuri: ovn: Fix disabling of gateway chassis  https://review.opendev.org/c/openstack/kolla-ansible/+/77643714:19
dmsimardHere are the blog posts about ansible 3.0.0: https://www.ansible.com/blog/announcing-the-community-ansible-3.0.0-package && https://www.ansible.com/blog/ansible-3.0.0-qa14:29
dmsimardyoctozepto: ^14:29
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Add missing octavia-driver-agent  https://review.opendev.org/c/openstack/kolla-ansible/+/76187214:30
openstackgerritMichal Nasiadka proposed openstack/kayobe master: Add output printing to host-command-run  https://review.opendev.org/c/openstack/kayobe/+/77647114:34
yoctozeptodmsimard: thanks, will read14:39
r3ap3rQuick question, for host_vars and group_vars directories be placed in `/etc/kolla/inventory/host_vars/control01` as an example for kolla-ansible usage?14:49
*** wuchunyang has quit IRC14:49
r3ap3rI'm working on breaking things out into "best practices" which is why I ask. I know normally it would be `/etc/ansible/host_vars/{target}` but I'm not sure if that is correct usage for kolla-ansible and the docs from the `multinode` page just isn't  clicking for me for some reason.15:00
*** dave-mccowan has joined #openstack-kolla15:11
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: CI: Move from ceph-ansible to cephadm  https://review.opendev.org/c/openstack/kolla-ansible/+/77141815:12
openstackgerritArthur Outhenin-Chalandre proposed openstack/kolla-ansible master: Add `kolla_externally_managed_cert` option  https://review.opendev.org/c/openstack/kolla-ansible/+/77288615:16
mgoddardr3ap3r: it is up to you. The inventory is specified via -i15:16
r3ap3rmgoddard: I was trying to reduce the amount of "things" I add to the inventory file. The file itself I don't have a problem with but I'm moving my network interface information from my `multinode` inventory file to a `host_vars` directory and basically wanted to know if it needs to be `/etc/kolla/inventory/host_vars/` or `/etc/kolla/host_vars/` or maybe even something else I just haven't seen or thought of?15:18
mgoddardr3ap3r: it needs to be in the same directory as your inventory file15:19
mgoddardr3ap3r: so if your inventory is /path/to/inventory then host_vars will be looked for in /path/to/host_vars15:20
r3ap3rmgoddard: Oh ok, hence the following in the docs. It doesn't really matter, just as long as my `multinode` file is in the same directory as you stated above.15:22
r3ap3r```inventory/15:22
r3ap3r  group_vars/15:22
r3ap3r    control15:22
r3ap3r  host_vars/15:22
r3ap3r    control0115:22
r3ap3r  multinode```15:22
mgoddardright15:22
r3ap3rOk, it seems I just needed to talk it out with someone, it makes total sense now. Thanks.15:22
yoctozeptomgoddard, r3ap3r: one thing to remember is that we use group_vars/all for kolla-ansible internally15:36
r3ap3ryoctozepto: just as long as I remove the network interfaces from the `globals.yml` and then define them in my individual `/etc/kolla/inventory/host_vars/{target}` files respectivly, the `group_vars/all` you are referencing shouldn't matter right? I haven't looked at `group_vars/all` yet.15:42
*** k_mouza has quit IRC15:44
*** k_mouza has joined #openstack-kolla15:44
r3ap3ryoctozepto: I'm using a different "interface" for `kolla_external_vip`, `api_interface`, etc.... but also have different network cards in my Control nodes vs my Compute nodes so they are completely different, hence me trying to break it out into my `/etc/kolla/inventory/host_vars/{target}` files.15:44
*** rohit02 has quit IRC15:45
r3ap3rEventually, I'm working on getting some computes with some GPU/FPGA so Cyborg will be a thing and another reason to move to a "directory" style approach to managing hosts instead of doing everything in the `multinode` inventory file.15:46
*** rohit02 has joined #openstack-kolla15:46
*** risson has quit IRC15:50
*** risson has joined #openstack-kolla15:50
ozzzolast night I was trying to change nova and neutron default quotas on one of our clusters. I changed /etc/kolla/config/nova.conf and /etc/kolla/config/neutron.conf and then ran: kolla-ansible -i ./multinode deploy -–tags "nova,neutron"15:55
ozzzomy neutron containers restarted and the neutron default quotas changed, but the nova containers did not restart, and the nova default quotas did not change15:55
ozzzoI looked in the nova_api containers at /etc/nova/nova.conf and did not see a [default] section, so I restarted them on all 3 controllers. After that I saaw the correct [default] section in nova.conf, but the nova default quotas still didn't change15:57
ozzzowhat am I missing? This is my /etc/kolla/config/nova.conf:15:57
ozzzohttps://paste.ubuntu.com/p/Jz3hyBMFZW/15:58
*** vishalmanchanda has quit IRC16:02
*** skramaja has quit IRC16:08
*** cah_link has quit IRC16:25
*** cah_link has joined #openstack-kolla16:25
*** cah_link has quit IRC16:30
*** cah_link has joined #openstack-kolla16:32
r3ap3rozzzo: The nova.conf looks good to me outside of line 16, missing the spaces between the `=` sign but that is probably just my ocd? Also, I think you should use `reconfigure` instead of `deploy` as `reconfigure` will generate a new configuration whereas `deploy` will just start already deployed containers without modifying their current configurations. My understanding of the commands may be a little off though.16:42
*** kevko has quit IRC16:47
ozzzoI don't think the missing spaces are causing trouble; those are in /etc/kolla/config/nova.conf on the build server. In the container /etc/nova/nova.conf I see it spaced correctly16:50
r3ap3rI agree, I don't think the spaces have anything to do with your problem. I was thinking maybe the `reconfigure` would have done something that the `deploy` wouldn't in regards to the quotas not populating correctly.16:54
ozzzoThis is the nova.conf inside the container: https://paste.ubuntu.com/p/3Z5mFV7bf5/16:54
ozzzoI see the correct quota settings at the bottom16:55
ozzzoit seems like restarting the container should make it pick up the new settings16:55
ozzzoThis same procedure worked on a different train cluster16:56
r3ap3rYeah, the quotas are there in black and white. Weird?16:56
priteaur3ap3r: deploy and reconfigure do the same thing most of the time. You are confusing with deploy-containers16:56
r3ap3rpriteau: deploy-containers does NOT change the configs though, just deploys new containers that have been staged. I read that deploy "is used to deploy and and start all Kolla containers" so I figured if the containers were already deployed, it wouldn't bother copying over new configs and that is what reconfigure was for. My fault for not going through all of the playbooks yet.17:00
*** luksky has quit IRC17:05
openstackgerritMark Goddard proposed openstack/kayobe master: WIP: Ubuntu: support systemd-networkd  https://review.opendev.org/c/openstack/kayobe/+/77650017:14
*** e0ne has quit IRC17:23
yoctozeptor3ap3r: yes, you override that one17:27
ozzzodo I need to delete the nova_api containers and rebuild them?17:30
*** bengates has quit IRC17:30
*** dougsz has quit IRC17:32
*** rpittau is now known as rpittau|afk17:47
r3ap3ryoctozepto: ok cool. Thanks. :-)17:48
*** imcsk8 has quit IRC17:49
*** imcsk8 has joined #openstack-kolla17:51
priteauozzzo: It probably has nothing to do with Kolla Ansible, but with the way Nova quota work17:53
priteauSee the note at the end of this section: https://docs.openstack.org/nova/latest/admin/quotas.html#checking-quota17:53
*** maharg101 has joined #openstack-kolla17:53
priteauThe API sets the limit in the quota_classes table. Once a default limit is set via the default quota class, that takes precedence over any changes to that resource limit in the configuration options. In other words, once you’ve changed things via the API, you either have to keep those synchronized with the configuration values or remove the default limit from the database manually as there is no REST API for removing quota class valu17:53
priteaues from the database.17:53
*** luksky has joined #openstack-kolla17:54
ozzzopriteau: does that mean that we can never go back to configuring via nova.conf, if someone has used the API to change nova quotas?17:57
*** e0ne has joined #openstack-kolla18:01
*** k_mouza has quit IRC18:04
*** bengates has joined #openstack-kolla18:11
ozzzowhen I look in the nova database, the quota tables are all empty18:11
ozzzodoes that mean that nobody used the API to change quotas?18:12
*** bengates has quit IRC18:15
*** wuchunyang has joined #openstack-kolla18:15
ozzzoafter reading the doc again, it looks like nobody has used the API to change the quotas, so there must be something else wrong18:16
*** jonaspaulo has joined #openstack-kolla18:18
*** wuchunyang has quit IRC18:20
*** jonaspaulo has quit IRC18:33
*** andrewbonney has quit IRC18:34
*** maharg101 has quit IRC18:44
*** bengates has joined #openstack-kolla18:52
*** bengates has quit IRC18:56
rohit02hi team,getting this error "unable to load SSL private key from PEM file '/etc/haproxy/haproxy.pem'" on centos 8 openstack kolla ussuri19:08
*** e0ne_ has joined #openstack-kolla19:08
*** e0ne has quit IRC19:08
*** stackedsax has quit IRC19:15
*** r3ap3r has quit IRC19:15
*** zeestrat has quit IRC19:15
*** mgoddard has quit IRC19:17
*** mgoddard has joined #openstack-kolla19:18
*** bengates has joined #openstack-kolla19:39
openstackgerritMark Goddard proposed openstack/kayobe master: WIP: Ubuntu: support systemd-networkd  https://review.opendev.org/c/openstack/kayobe/+/77650019:39
*** bengates has quit IRC19:44
*** stackedsax has joined #openstack-kolla19:49
*** r3ap3r has joined #openstack-kolla19:51
*** zeestrat has joined #openstack-kolla19:51
*** e0ne_ has quit IRC20:09
*** e0ne has joined #openstack-kolla20:22
*** e0ne_ has joined #openstack-kolla20:24
*** e0ne has quit IRC20:24
*** k_mouza has joined #openstack-kolla20:29
*** bengates has joined #openstack-kolla20:32
*** k_mouza has quit IRC20:34
*** bengates has quit IRC20:37
*** tbarron|out has joined #openstack-kolla20:38
*** maharg101 has joined #openstack-kolla20:41
*** maharg101 has quit IRC20:46
*** dking has joined #openstack-kolla21:04
*** zeestrat has quit IRC21:05
*** r3ap3r has quit IRC21:05
*** stackedsax has quit IRC21:05
*** stackedsax has joined #openstack-kolla21:13
*** r3ap3r has joined #openstack-kolla21:16
*** zeestrat has joined #openstack-kolla21:16
dardeleandon't I need to run bootstrap as part of the upgrade process? for example train -> ussuri, to update the docker and stuff21:29
ozzzoturns out the quota settings aren't in the nova db; they are in the nova_api db21:33
*** gfidente has quit IRC21:40
dardeleanhmm, maybe I should do a PR with upgrade process updates :)21:56
kplantplease do :>23:05
dardeleanyeah, there are a few things that need to be addresses, still going to the process23:07
*** mchlumsky has quit IRC23:09
*** cah_link has quit IRC23:14
*** peeejayz has joined #openstack-kolla23:39
peeejayzHey all, trying to get Monaska setup with Kolla-ansible, the monaska setup is erroring with23:40
peeejayz"Kafka error: Subscribed topic not available: retry-notifications: Broker: Unknown topic or partition" - I'm not really savvy with Kafka yet, any ideas?23:40

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!