| *** k_mouza has quit IRC | 00:04 | |
| *** macz_ has joined #openstack-kolla | 01:15 | |
| *** macz_ has quit IRC | 01:19 | |
| openstackgerrit | wu.chunyang proposed openstack/kolla-ansible stable/victoria: Fix cyborg api doesn't listen on api interface https://review.opendev.org/c/openstack/kolla-ansible/+/790167 | 01:29 |
|---|---|---|
| *** wuchunyang has joined #openstack-kolla | 02:03 | |
| *** ivan_lin has joined #openstack-kolla | 02:56 | |
| *** zzzeek has quit IRC | 02:56 | |
| *** LinPeiWen42 has quit IRC | 02:57 | |
| *** LinPeiWen has quit IRC | 02:58 | |
| *** murphyslawbbs has joined #openstack-kolla | 03:01 | |
| *** zzzeek has joined #openstack-kolla | 03:04 | |
| *** macz_ has joined #openstack-kolla | 03:09 | |
| *** zzzeek has quit IRC | 03:10 | |
| *** zzzeek has joined #openstack-kolla | 03:11 | |
| *** macz_ has quit IRC | 03:13 | |
| *** ysirndjuro has quit IRC | 03:14 | |
| *** zzzeek has quit IRC | 03:20 | |
| *** zzzeek has joined #openstack-kolla | 03:21 | |
| *** zzzeek has quit IRC | 03:23 | |
| *** zzzeek has joined #openstack-kolla | 03:26 | |
| *** murphyslawbbs has quit IRC | 03:42 | |
| *** k_mouza has joined #openstack-kolla | 03:45 | |
| *** k_mouza has quit IRC | 03:49 | |
| *** wuchunyang has quit IRC | 04:03 | |
| *** cah_link has joined #openstack-kolla | 04:06 | |
| *** bsanjeewa has joined #openstack-kolla | 04:52 | |
| *** bsanjeewa has quit IRC | 04:58 | |
| *** murphyslawbbs has joined #openstack-kolla | 04:58 | |
| *** kevko has joined #openstack-kolla | 05:00 | |
| *** murphyslawbbs has quit IRC | 05:08 | |
| *** macz_ has joined #openstack-kolla | 05:10 | |
| *** shyamb has joined #openstack-kolla | 05:12 | |
| *** macz_ has quit IRC | 05:15 | |
| *** LinPeiWen has joined #openstack-kolla | 05:21 | |
| *** Luzi has joined #openstack-kolla | 05:41 | |
| *** k_mouza has joined #openstack-kolla | 05:46 | |
| *** k_mouza has quit IRC | 05:51 | |
| *** jamesbenson has joined #openstack-kolla | 05:53 | |
| *** jamesbenson has quit IRC | 06:25 | |
| hrw | morning | 06:33 |
| *** vishalmanchanda has joined #openstack-kolla | 06:34 | |
| yoctozepto | morning | 06:36 |
| osmanlicilegi | morning | 06:37 |
| *** macz_ has joined #openstack-kolla | 06:39 | |
| *** macz_ has quit IRC | 06:43 | |
| *** wuchunyang has joined #openstack-kolla | 07:03 | |
| *** rpittau|afk is now known as rpittau | 07:05 | |
| *** shyamb has quit IRC | 07:10 | |
| *** andrewbonney has joined #openstack-kolla | 07:11 | |
| *** e0ne has joined #openstack-kolla | 07:12 | |
| *** jamesbenson has joined #openstack-kolla | 07:16 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: [DNM] Debug UCA Wallaby Ubuntu upgrade (Radek edition) https://review.opendev.org/c/openstack/kolla-ansible/+/790148 | 07:26 |
| hrw | I have UCA patch on top of current UCA one | 07:27 |
| hrw | but will wait for day60 with it | 07:27 |
| yoctozepto | I hope we soon find out the issue with current uca we have | 07:29 |
| yoctozepto | it has been pinpointed to router not being pingable by mnasiadka | 07:29 |
| yoctozepto | and now I have confirmed linuxbridge is not affected | 07:29 |
| mnasiadka | so it's OVS | 07:29 |
| yoctozepto | now trying for ovn whether their ovs config works | 07:29 |
| yoctozepto | seems so | 07:30 |
| yoctozepto | but then again - what in it? | 07:30 |
| yoctozepto | it literally always worked so far | 07:30 |
| yoctozepto | ovs logs look happy | 07:31 |
| yoctozepto | as if it set up everything again | 07:31 |
| *** jamesbenson has quit IRC | 07:31 | |
| mnasiadka | well, then if OVN works - then maybe something with neutron-l3-agent | 07:32 |
| mnasiadka | it might be really hard to pinpoint the failure... | 07:32 |
| yoctozepto | yeah, that's what I want to pinpoint now | 07:32 |
| yoctozepto | but then again | 07:33 |
| mnasiadka | another option is to remove the router and create it once again :D | 07:33 |
| yoctozepto | neutron-l3-agent got updated anyway | 07:33 |
| yoctozepto | mnasiadka: yeah, let's make upgrade breaking, sure | 07:33 |
| mnasiadka | I think we are not cleaning up anything during l3-agent restart | 07:33 |
| yoctozepto | so it's more like incompat between it and new ovs then | 07:33 |
| mnasiadka | but then it will be breaking ;) | 07:33 |
| mnasiadka | I don't think Ubuntu has way newer OVS than in Red Hat FDP | 07:33 |
| yoctozepto | it should not but let's see | 07:34 |
| yoctozepto | 2.15.0 | 07:34 |
| yoctozepto | what did red hat have? | 07:34 |
| mnasiadka | 2.15.0? | 07:35 |
| mnasiadka | in focal-updates? | 07:35 |
| mnasiadka | wtf | 07:35 |
| mnasiadka | CentOS is still on 2.13 | 07:35 |
| yoctozepto | 2.13.0 | 07:35 |
| yoctozepto | so it's 2 versions up | 07:35 |
| yoctozepto | and it's not really semver | 07:35 |
| yoctozepto | so perhaps something really broke | 07:36 |
| yoctozepto | like, it can't handle resources from the previous version | 07:36 |
| yoctozepto | what was ovs before | 07:36 |
| yoctozepto | let's see | 07:36 |
| yoctozepto | 2.13.1 | 07:36 |
| yoctozepto | so a bump from 2.13.1 to 2.15.0 huh | 07:37 |
| yoctozepto | now wonder if ovn manages it properly to handle this situation | 07:37 |
| yoctozepto | I wonder how grenade fares, qa should be getting into this bump too | 07:38 |
| mnasiadka | well, time to run ovn in upgrade job and see ;) | 07:38 |
| mnasiadka | maybe since devstack is trying to default to ml2/ovn, we should do the same | 07:39 |
| mnasiadka | but then most users probably have ml2/ovs :D | 07:39 |
| yoctozepto | ok, we are not activating UCA on focal | 07:40 |
| yoctozepto | hence can't hit this | 07:41 |
| yoctozepto | i mean, we in qa | 07:41 |
| hrw | UCA is always enabled | 07:41 |
| yoctozepto | ? | 07:42 |
| yoctozepto | I'm talking devstack now | 07:43 |
| hrw | ah | 07:43 |
| hrw | sorry | 07:43 |
| yoctozepto | np | 07:43 |
| yoctozepto | mnasiadka: yeah, that is worrying | 07:43 |
| yoctozepto | fwiw, ovn has better design | 07:43 |
| yoctozepto | but the migration is just pain | 07:43 |
| yoctozepto | unless you are willing to have nice downtime | 07:44 |
| mnasiadka | well, in theory it's not so bad, but haven't tested the tripleo procedure ;) | 07:44 |
| yoctozepto | I wonder how multinode upgrades work though | 07:44 |
| yoctozepto | the router is not set ha | 07:44 |
| yoctozepto | so it's on one host | 07:45 |
| mnasiadka | yoctozepto: actually we could pin to 2.13 and check if it works then | 07:45 |
| yoctozepto | mnasiadka: well, that's almost guaranteed then | 07:45 |
| yoctozepto | just keep victoria enabled | 07:45 |
| yoctozepto | and pin | 07:45 |
| yoctozepto | though ugly | 07:45 |
| yoctozepto | but back to that multinode | 07:45 |
| yoctozepto | I wonder how to explain it | 07:45 |
| mnasiadka | well, UCA Wallaby enabled and pin to 2.13 - if that allows us to release with a bug, why not... | 07:46 |
| mnasiadka | yeah, multinode bloody works | 07:46 |
| yoctozepto | mnasiadka: you need victoria to get 2.13 version I think? | 07:47 |
| yoctozepto | ah no | 07:48 |
| mnasiadka | yoctozepto: well, 2.13.1 is in focal-updates - https://packages.ubuntu.com/focal-updates/openvswitch-switch | 07:48 |
| yoctozepto | it's in base | 07:48 |
| yoctozepto | yeah, yeah | 07:48 |
| *** k_mouza has joined #openstack-kolla | 07:48 | |
| yoctozepto | ok, that makes it much less ugly | 07:48 |
| yoctozepto | but if it allows us to release :-) | 07:48 |
| yoctozepto | ok, so the explanation for singlenode is plausible | 07:49 |
| yoctozepto | we bump ovs and it cannot properly control the previously existing switch | 07:49 |
| yoctozepto | bug in ovs if you ask me but perhaps they don't guarantee it with two versions bump | 07:49 |
| yoctozepto | yet that multinode | 07:50 |
| yoctozepto | ... | 07:50 |
| hrw | so 1. pin to 2.13 2. release 3. remove pin? | 07:50 |
| mnasiadka | that's plan B I guess | 07:51 |
| yoctozepto | yup | 07:51 |
| yoctozepto | at least we have it | 07:51 |
| mnasiadka | the only thing that really changed is the openvswitch module, if you use the one delivered from OVS tree - you need to switch to the one from upstream kernel | 07:52 |
| yoctozepto | I wonder if uca wallaby contains 2.14 we could try :D | 07:52 |
| *** k_mouza has quit IRC | 07:52 | |
| yoctozepto | mnasiadka: oh, right, but we are not changing the kernel module | 07:53 |
| mnasiadka | and I think it's installed from kernel package, so we shouldn't do anything | 07:54 |
| yoctozepto | indeed | 07:54 |
| yoctozepto | but let's check | 07:54 |
| yoctozepto | where do you come from, where do you go | 07:54 |
| yoctozepto | cotton-eyed joe | 07:55 |
| mnasiadka | yep, it comes from linux-modules deb package | 07:55 |
| yoctozepto | all right | 07:55 |
| hrw | Focal has 2.13, wallaby/xena have 2.15 | 07:56 |
| hrw | in uca | 07:56 |
| mnasiadka | hmm, do we ever try to update the schema in OVSDB? | 07:56 |
| yoctozepto | not remember | 07:56 |
| hrw | Debian has 2.15 | 07:56 |
| yoctozepto | yeah, with debian we grew from 2.10 to 2.15 | 07:57 |
| yoctozepto | and we succeed with tests | 07:57 |
| yoctozepto | so wth | 07:57 |
| *** fuhrmannb has joined #openstack-kolla | 07:58 | |
| mnasiadka | we do - https://github.com/openstack/kolla-ansible/blob/a52cf61b2234d2f078dd2893dd37de63e20ea1aa/ansible/roles/openvswitch/templates/start-ovsdb-server.j2#L6 | 07:58 |
| yoctozepto | so then what? a particular bug in ovs in ubuntu? | 07:59 |
| yoctozepto | all right, I think we are out of ideas for the moment | 07:59 |
| yoctozepto | thanks for this ad-hoc meeting | 07:59 |
| yoctozepto | let's wait for ovn results | 07:59 |
| yoctozepto | (very curious cause it updates octavia too, and, well, we never tried updating either yet) | 08:00 |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe master: Make docker registry network mode configurable https://review.opendev.org/c/openstack/kayobe/+/789791 | 08:06 |
| mnasiadka | let me go ask Neutron guys if they ever tested with 2.15 :) | 08:07 |
| yoctozepto | mnasiadka: debian works (2.10 -> 2.15) | 08:07 |
| yoctozepto | in case you missed | 08:08 |
| yoctozepto | anyhow, just noticed the "revert infra mirrors" logic failed with new "trusted" attribute | 08:08 |
| yoctozepto | or I am looking at the wrong place | 08:09 |
| yoctozepto | yes, I was | 08:10 |
| yoctozepto | oof | 08:10 |
| mnasiadka | yoctozepto: ugh, debian is 2.15.0 or 2.15.90? | 08:10 |
| yoctozepto | 2.15.0 | 08:11 |
| yoctozepto | what is 2.15.90? | 08:11 |
| yoctozepto | ah, that could have been a stability joke | 08:11 |
| mnasiadka | not yet released, but more or less already available ;) | 08:11 |
| openstackgerrit | Merged openstack/kolla-ansible stable/wallaby: Add Monasca Grafana deprecation notice https://review.opendev.org/c/openstack/kolla-ansible/+/788438 | 08:11 |
| *** shyamb has joined #openstack-kolla | 08:14 | |
| *** e0ne has quit IRC | 08:15 | |
| *** LinPeiWen has quit IRC | 08:16 | |
| *** ivan_lin has quit IRC | 08:17 | |
| *** ivan_lin has joined #openstack-kolla | 08:17 | |
| mnasiadka | yoctozepto: I guess Debian Bullseye has a bit newer kernel than Ubuntu Focal? | 08:18 |
| yoctozepto | 2021-05-07 08:12:50.549 7 WARNING octavia.api.drivers.driver_factory [req-123b5c76-dc99-4828-8443-7d4308f07430 - 91503fce2acc4199b42f8a47437db9ab - default default] Requested provider driver 'ovn' was not enabled in the configuration file. | 08:18 |
| yoctozepto | mnasiadka: it does | 08:19 |
| yoctozepto | 5.8 vs 5.10 | 08:20 |
| mnasiadka | yoctozepto: not enabled? :D | 08:21 |
| *** LinPeiWen has joined #openstack-kolla | 08:21 | |
| yoctozepto | yeah, that's the error message | 08:21 |
| yoctozepto | perhaps some conditional failed | 08:21 |
| mnasiadka | it should be always enabled when neutron_plugin_agent == ovn | 08:21 |
| yoctozepto | I had to downscale to single node | 08:21 |
| openstackgerrit | Will Szumski proposed openstack/kayobe master: Adds support for configuring chrony https://review.opendev.org/c/openstack/kayobe/+/784460 | 08:22 |
| yoctozepto | https://e81e6b81331830d4903c-5acdef5dc10478cee5291df1596ec66a.ssl.cf1.rackcdn.com/790148/2/check/kolla-ansible-ubuntu-source-ovn-upgrade/2921a0f/primary/logs/kolla_configs/globals.yml | 08:23 |
| openstackgerrit | Zijian Guo proposed openstack/kolla-ansible master: Make sure the file permissions are correct https://review.opendev.org/c/openstack/kolla-ansible/+/790207 | 08:23 |
| yoctozepto | https://e81e6b81331830d4903c-5acdef5dc10478cee5291df1596ec66a.ssl.cf1.rackcdn.com/790148/2/check/kolla-ansible-ubuntu-source-ovn-upgrade/2921a0f/primary/logs/kolla_configs/octavia-api/octavia.conf | 08:24 |
| yoctozepto | odd ;d | 08:24 |
| openstackgerrit | Will Szumski proposed openstack/kayobe master: Adds support for configuring chrony https://review.opendev.org/c/openstack/kayobe/+/784460 | 08:24 |
| hrw | Focal is on 5.4 kernel by default. 5.8 is HWE | 08:24 |
| *** ivan_lin has quit IRC | 08:25 | |
| yoctozepto | true that, hrw | 08:26 |
| yoctozepto | in CI it's 5.4 | 08:26 |
| yoctozepto | perhaps that is the issue | 08:26 |
| yoctozepto | that they expect hwe for uca | 08:26 |
| yoctozepto | anyhow, why octavia ignored ovn | 08:27 |
| hrw | no idea | 08:27 |
| yoctozepto | is very interesting :D | 08:27 |
| *** gfidente|afk is now known as gfidente | 08:27 | |
| hrw | hm. killed firefox. got 17GB ram back | 08:28 |
| yoctozepto | shappens | 08:28 |
| yoctozepto | mnasiadka: any idea on that octavia oddity? | 08:29 |
| mnasiadka | yoctozepto: octavia.conf did not template out once again to include drivers enabled? | 08:29 |
| mnasiadka | I don't think we have that in victoria, but it's there in master | 08:29 |
| mnasiadka | well, we have [api_settings] twice in the template | 08:29 |
| mnasiadka | but that shouldn't matter | 08:29 |
| yoctozepto | should it template twice? | 08:29 |
| yoctozepto | I never used it | 08:30 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: octavia: Fix duplicate api_settings https://review.opendev.org/c/openstack/kolla-ansible/+/790208 | 08:31 |
| mnasiadka | no, I mean on upgrade it should generate new octavia.conf | 08:31 |
| mnasiadka | and it seems it's not doing that | 08:31 |
| yoctozepto | mnasiadka: it's before upgrade | 08:32 |
| *** xinliang has joined #openstack-kolla | 08:32 | |
| mnasiadka | ah, then we have a feature, that doesn't work before upgrade :D | 08:32 |
| mnasiadka | the commit was never backported to victoria | 08:32 |
| yoctozepto | ah | 08:32 |
| yoctozepto | master goes from vicky still | 08:32 |
| yoctozepto | I'll just disable octavia lol | 08:33 |
| openstackgerrit | Merged openstack/kolla-ansible stable/victoria: Pin ansible to <2.10.0 in test-requirements https://review.opendev.org/c/openstack/kolla-ansible/+/790134 | 08:33 |
| fuhrmannb | Hi, got a question about kolla-ansible release version: is it supported to deploy OpenStack N-1 version with kolla-ansible N version? Example: deploy OpenStack Ussuri images with kolla-ansible Victoria. | 08:34 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: [DNM] Debug UCA Wallaby Ubuntu upgrade (Radek edition) https://review.opendev.org/c/openstack/kolla-ansible/+/790148 | 08:35 |
| yoctozepto | fuhrmannb: hi, it's not supported | 08:35 |
| yoctozepto | it may work but may not | 08:35 |
| fuhrmannb | Ok, thanks for you answer :) | 08:35 |
| yoctozepto | yw | 08:35 |
| *** LinPeiWen70 has joined #openstack-kolla | 08:39 | |
| *** macz_ has joined #openstack-kolla | 08:40 | |
| hrw | fuhrmannb: and it may add extra issues | 08:40 |
| *** hjensas|afk is now known as hjensas | 08:41 | |
| yoctozepto | hrw: let's merge train saviour https://review.opendev.org/c/openstack/kolla/+/787985 | 08:43 |
| hrw | merge till it passes | 08:43 |
| *** macz_ has quit IRC | 08:45 | |
| mnasiadka | yoctozepto: https://review.opendev.org/c/openstack/kolla-ansible/+/790024 | 08:56 |
| mnasiadka | and then https://review.opendev.org/c/openstack/kolla-ansible/+/780919/6 | 08:56 |
| mnasiadka | :D | 08:56 |
| yoctozepto | mnasiadka: both done | 09:02 |
| yoctozepto | just wondering | 09:02 |
| yoctozepto | is the first one just for clarity's sake? | 09:03 |
| mnasiadka | so, community.openvswitch modules are written in a crappy way, so if you send value and state: absent - they malform the ovs-vsctl command line - so there was a bug it wasn't really removing anything (well, failed on removing) | 09:04 |
| yoctozepto | mnasiadka: ok, missing that in the message but meh ;p | 09:14 |
| yoctozepto | I'm too kind to block it now | 09:14 |
| mnasiadka | thank you for your kindness, master yoctozepto | 09:16 |
| mnasiadka | ;) | 09:16 |
| openstackgerrit | Zijian Guo proposed openstack/kolla-ansible master: Make sure the file permissions are correct for barbican https://review.opendev.org/c/openstack/kolla-ansible/+/790207 | 09:25 |
| *** jamesbenson has joined #openstack-kolla | 09:32 | |
| *** jamesbenson has quit IRC | 09:36 | |
| yoctozepto | mnasiadka: :-) | 09:38 |
| yoctozepto | mnasiadka: and ovn works | 09:38 |
| mnasiadka | yoctozepto: gah | 09:38 |
| yoctozepto | unless it was random luck | 09:38 |
| yoctozepto | let me recheck | 09:38 |
| mnasiadka | yoctozepto: that's another option | 09:38 |
| yoctozepto | let's go for 5 runs | 09:40 |
| yoctozepto | or 6 | 09:41 |
| yoctozepto | if none fails on that issue | 09:41 |
| yoctozepto | then it's just plain ovs that is affected now | 09:41 |
| yoctozepto | (and only singlenode) | 09:41 |
| yoctozepto | very interesting | 09:41 |
| mnasiadka | maybe that's some race condition that is visible on singlenode, but not existent (rarely existent) in multinode due to slower processing of tasks | 09:48 |
| yoctozepto | maybe, but we wait quite a bit | 09:51 |
| yoctozepto | and ovn seems snappy | 09:51 |
| kevko | hi guys, have you already tried wallaby on debian bullseye ? | 09:51 |
| yoctozepto | so it's like neutron ovs agent being much slower? | 09:51 |
| yoctozepto | kevko: yes | 09:51 |
| kevko | hmm | 09:52 |
| yoctozepto | it works, just with buster host | 09:52 |
| yoctozepto | but bullseye in the images | 09:52 |
| yoctozepto | bullseye host fails on cgroups support in nova | 09:52 |
| kevko | hmm, I have ubuntu 20.04 host and bullseye images | 09:52 |
| yoctozepto | https://etherpad.opendev.org/p/KollaWhiteBoard | 09:52 |
| yoctozepto | that should work too | 09:52 |
| yoctozepto | what issue are you facing? | 09:53 |
| kevko | 2021-05-07 9:44:32 0 [ERROR] WSREP: Process completed with error: wsrep_sst_mariabackup --role 'joiner' --address ......... | 09:53 |
| kevko | emporarily unavailable | 09:53 |
| kevko | WSREP_SST: [ERROR] Possible timeout in receiving first data from (20210507 09:44:32.966) | 09:53 |
| yoctozepto | odd | 09:53 |
| kevko | /usr//bin/wsrep_sst_mariabackup: line 631: donor in gtid stage: exit codes: 124: command not found | 09:53 |
| kevko | btw, thanks for +w on ansible pin review mgoddard and yoctozepto :) | 09:54 |
| mgoddard | kevko: np | 09:54 |
| mgoddard | kevko: now I have your attention, mariadb docs? :p | 09:55 |
| kevko | i have it in my mind :) | 09:55 |
| yoctozepto | kevko: np | 09:55 |
| kevko | or let's say todolist | 09:55 |
| mgoddard | kevko: ok. I'd like to release wallaby with them | 09:56 |
| kevko | btw, if you remember on ptg you were asking me for config of proxysql max_writers and writer_is_also reader etc ... and you were surprised that reader group is empty ..it's because kolla has no mariadb nodes with read_only flag | 09:57 |
| kevko | so proxysql will not add they to group ..so result is same as haproxy ..one writer and others are backu | 09:58 |
| *** macz_ has joined #openstack-kolla | 10:02 | |
| *** jamesbenson has joined #openstack-kolla | 10:05 | |
| *** macz_ has quit IRC | 10:06 | |
| openstackgerrit | Merged openstack/kolla stable/train: rabbitmq: Move to packagecloud https://review.opendev.org/c/openstack/kolla/+/787985 | 10:08 |
| kevko | yoctozepto: so do you know where I have a problem ? | 10:08 |
| *** jamesbenson has quit IRC | 10:09 | |
| yoctozepto | kevko: nope, sorry | 10:10 |
| yoctozepto | are you using our images? | 10:10 |
| kevko | hm, thanks | 10:10 |
| yoctozepto | because we are building wallaby with bullseye | 10:10 |
| kevko | yoctozepto: yeah, sure | 10:10 |
| yoctozepto | when you ask for debian | 10:10 |
| yoctozepto | ack | 10:10 |
| yoctozepto | maybe hrw saw this issue | 10:10 |
| *** brinzhang_ has quit IRC | 10:11 | |
| kevko | I have pipeline to build openstack in all versions ..wallaby is failing for me now | 10:11 |
| yoctozepto | it works in CI :-) | 10:12 |
| *** k_mouza has joined #openstack-kolla | 10:19 | |
| kevko | yoctozepto: well, i ran recovery and it works .. | 10:19 |
| kevko | weird | 10:19 |
| *** wuchunyang has quit IRC | 10:23 | |
| openstackgerrit | Merged openstack/kolla-ansible master: ovn: omit unnecessary bridge mappings https://review.opendev.org/c/openstack/kolla-ansible/+/790024 | 10:26 |
| openstackgerrit | Merged openstack/kolla-ansible master: ovn: make DVR work on VLAN tenant networks https://review.opendev.org/c/openstack/kolla-ansible/+/780919 | 10:26 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible stable/wallaby: ovn: omit unnecessary bridge mappings https://review.opendev.org/c/openstack/kolla-ansible/+/790172 | 10:31 |
| priteau | yoctozepto: is this the new it works in devstack? | 10:35 |
| *** Luzi has quit IRC | 10:41 | |
| *** kevko has quit IRC | 10:49 | |
| *** xinliang has quit IRC | 10:54 | |
| *** jamesbenson has joined #openstack-kolla | 10:55 | |
| *** Luzi has joined #openstack-kolla | 10:56 | |
| *** jamesbenson has quit IRC | 11:00 | |
| openstackgerrit | Merged openstack/kolla-ansible stable/victoria: Fix cyborg api doesn't listen on api interface https://review.opendev.org/c/openstack/kolla-ansible/+/790167 | 11:05 |
| openstackgerrit | Merged openstack/kayobe stable/victoria: Sync the names and content of the repo-files for CentOS8 https://review.opendev.org/c/openstack/kayobe/+/790071 | 11:06 |
| openstackgerrit | Merged openstack/kolla-ansible stable/ussuri: masakari: fix minor issues with instance monitor https://review.opendev.org/c/openstack/kolla-ansible/+/789750 | 11:15 |
| *** kevko has joined #openstack-kolla | 11:15 | |
| *** shyamb has quit IRC | 11:16 | |
| *** Gilou has quit IRC | 11:24 | |
| *** jamesbenson has joined #openstack-kolla | 11:35 | |
| *** jamesbenson has quit IRC | 11:40 | |
| *** bsanjeewa has joined #openstack-kolla | 11:43 | |
| *** shyamb has joined #openstack-kolla | 11:43 | |
| *** jamesbenson has joined #openstack-kolla | 11:45 | |
| openstackgerrit | Merged openstack/kayobe stable/wallaby: Ubuntu: add documentation & release note https://review.opendev.org/c/openstack/kayobe/+/789869 | 11:47 |
| *** bsanjeewa has quit IRC | 11:48 | |
| *** bsanjeewa has joined #openstack-kolla | 11:52 | |
| *** bsanjeewa has quit IRC | 11:56 | |
| *** bsanjeewa has joined #openstack-kolla | 11:57 | |
| *** macz_ has joined #openstack-kolla | 12:02 | |
| *** macz_ has quit IRC | 12:07 | |
| *** brinzhang has joined #openstack-kolla | 12:14 | |
| *** shyamb has quit IRC | 12:18 | |
| kevko | mgoddard: found small bug in octavia auto configure .. you are writing ssh private key in /etc/kolla/octavia-worker even if user auto configure disabled .. | 12:18 |
| mnasiadka | kevko: did you report it on launchpad? | 12:19 |
| kevko | mnasiadka: nope, just found it | 12:19 |
| mnasiadka | kevko: well, launchpad is the place for bugs, if it's not there - we'll forget :) | 12:19 |
| *** k_mouza has quit IRC | 12:21 | |
| *** k_mouza has joined #openstack-kolla | 12:22 | |
| *** bsanjeewa has quit IRC | 12:24 | |
| kevko | mnasiadka: https://bugs.launchpad.net/kolla-ansible/+bug/1927727 | 12:32 |
| openstack | Launchpad bug 1927727 in kolla-ansible "Kolla-ansible is writing amp_ssh_key from passwords even if user disabled octavia auto configure" [Undecided,New] | 12:32 |
| mnasiadka | gracias senor | 12:32 |
| *** jamesbenson has quit IRC | 12:32 | |
| openstackgerrit | Michal Arbet proposed openstack/kolla-ansible master: Do not write octavia_amp_ssh_key if auto_config disabled https://review.opendev.org/c/openstack/kolla-ansible/+/790234 | 12:34 |
| *** jamesbenson has joined #openstack-kolla | 12:50 | |
| yoctozepto | mnasiadka: ovn broke the same | 12:51 |
| yoctozepto | so it's just that ovs | 12:51 |
| yoctozepto | priteau: I did not understand the question, sorry | 12:52 |
| mnasiadka | yoctozepto: so let's pin that OVS for now and let's check | 12:52 |
| yoctozepto | mnasiadka: ++ | 12:52 |
| yoctozepto | either you, mnasiadka, or hrw, pin that and we merge that uca bump | 12:53 |
| *** jamesbenson has quit IRC | 12:55 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla master: [release] Use UCA Wallaby https://review.opendev.org/c/openstack/kolla/+/782308 | 13:07 |
| mnasiadka | ok, let's see | 13:07 |
| *** e0ne has joined #openstack-kolla | 13:09 | |
| *** hjensas has quit IRC | 13:18 | |
| *** kevko has quit IRC | 13:19 | |
| *** k_mouza_ has joined #openstack-kolla | 13:19 | |
| *** kevko has joined #openstack-kolla | 13:21 | |
| *** k_mouza has quit IRC | 13:23 | |
| *** k_mouza has joined #openstack-kolla | 13:24 | |
| *** k_mouza_ has quit IRC | 13:27 | |
| openstackgerrit | Verification of a change to openstack/kolla-ansible failed: masakari: fix minor issues with instance monitor https://review.opendev.org/c/openstack/kolla-ansible/+/789749 | 13:29 |
| *** bsanjeewa has joined #openstack-kolla | 13:31 | |
| *** hjensas has joined #openstack-kolla | 13:36 | |
| *** bsanjeewa has quit IRC | 13:36 | |
| *** jamesbenson has joined #openstack-kolla | 13:40 | |
| *** cah_link has quit IRC | 13:44 | |
| *** jamesbenson has quit IRC | 13:44 | |
| *** Luzi has quit IRC | 14:00 | |
| openstackgerrit | Maksim Malchuk proposed openstack/kayobe stable/ussuri: Sync the names and content of the repo-files for CentOS8 https://review.opendev.org/c/openstack/kayobe/+/790247 | 14:01 |
| *** macz_ has joined #openstack-kolla | 14:03 | |
| mnasiadka | yoctozepto: passed at first check run, will recheck once centos jobs will finish | 14:05 |
| *** macz_ has quit IRC | 14:07 | |
| *** kevko has quit IRC | 14:09 | |
| *** cah_link has joined #openstack-kolla | 14:11 | |
| *** jamesbenson has joined #openstack-kolla | 14:12 | |
| mnasiadka | yoctozepto: what's interesting centos 8s has ovs 2.15 in nfv8s repo - but we're installing 2.13 for some reason | 14:13 |
| *** rpittau is now known as rpittau|afk | 14:29 | |
| yoctozepto | oh | 14:31 |
| yoctozepto | but via pin? | 14:31 |
| yoctozepto | or just so happens? | 14:31 |
| *** k_mouza_ has joined #openstack-kolla | 14:35 | |
| *** k_mouza_ has quit IRC | 14:38 | |
| *** k_mouza_ has joined #openstack-kolla | 14:38 | |
| *** k_mouza__ has joined #openstack-kolla | 14:39 | |
| *** k_mouza has quit IRC | 14:40 | |
| *** kevko has joined #openstack-kolla | 14:41 | |
| *** cah_link has quit IRC | 14:42 | |
| *** k_mouza_ has quit IRC | 14:43 | |
| *** k_mouza__ has quit IRC | 14:49 | |
| *** k_mouza has joined #openstack-kolla | 14:50 | |
| *** e0ne has quit IRC | 14:56 | |
| *** macz_ has joined #openstack-kolla | 14:57 | |
| *** jamesbenson has quit IRC | 15:38 | |
| *** jamesbenson has joined #openstack-kolla | 15:38 | |
| *** jamesbenson has quit IRC | 15:49 | |
| *** jamesbenson has joined #openstack-kolla | 15:51 | |
| *** shyamb has joined #openstack-kolla | 15:53 | |
| openstackgerrit | Will Szumski proposed openstack/kayobe master: Adds support for configuring chrony https://review.opendev.org/c/openstack/kayobe/+/784460 | 15:56 |
| *** samcat116 has joined #openstack-kolla | 16:00 | |
| priteau | yoctozepto: it was just a joke. You said "it works in CI", made me think of "It works in DevStack" :) | 16:00 |
| yoctozepto | lol | 16:03 |
| *** jamesbenson has quit IRC | 16:04 | |
| openstackgerrit | Will Szumski proposed openstack/kayobe master: Adds support for configuring chrony https://review.opendev.org/c/openstack/kayobe/+/784460 | 16:05 |
| kevko | yoctozepto: here is log for mariadb i've asked few hours ago -> http://paste.openstack.org/show/805036/ | 16:06 |
| kevko | yoctozepto: wallaby installer .. weird is that clustercheck is 2h up but mariadb server an about 1h :( do you know why ? | 16:06 |
| openstackgerrit | Will Szumski proposed openstack/kayobe master: Adds support for configuring chrony https://review.opendev.org/c/openstack/kayobe/+/784460 | 16:09 |
| yoctozepto | kevko: probably it shut down previously? and you recovered later | 16:09 |
| *** jamesbenson has joined #openstack-kolla | 16:09 | |
| *** shyamb has quit IRC | 16:09 | |
| kevko | yoctozepto: nope, it's fresh installation ... heat stack and install from deploy machine ..during installation i was checking if everything is OK ...and it was OK .. after some time broken :( | 16:10 |
| yoctozepto | kevko: nothin in the logs from that time? | 16:20 |
| yoctozepto | perhaps resource starvation? | 16:20 |
| openstackgerrit | Verification of a change to openstack/kolla-ansible failed: masakari: fix minor issues with instance monitor https://review.opendev.org/c/openstack/kolla-ansible/+/789749 | 16:22 |
| kevko | nope | 16:23 |
| kevko | well, mariadb logs are weird .. | 16:23 |
| *** jamesbenson has quit IRC | 16:27 | |
| *** jamesbenson has joined #openstack-kolla | 16:28 | |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe master: Adds support for configuring chrony https://review.opendev.org/c/openstack/kayobe/+/784460 | 16:28 |
| *** samcat116 has quit IRC | 16:31 | |
| kevko | yoctozepto: ok, i've already found that controller1 was restarted 81 times ...weiiird ..don't know why | 16:37 |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe master: [DNM] Add jobs testing support for multiple environments https://review.opendev.org/c/openstack/kayobe/+/773411 | 16:45 |
| *** jamesbenson has quit IRC | 16:58 | |
| *** k_mouza_ has joined #openstack-kolla | 17:04 | |
| *** k_mouza has quit IRC | 17:06 | |
| *** jamesbenson has joined #openstack-kolla | 17:16 | |
| *** gfidente is now known as gfidente|afk | 17:16 | |
| *** jamesbenson has quit IRC | 17:21 | |
| *** vishalmanchanda has quit IRC | 17:23 | |
| *** jamesbenson has joined #openstack-kolla | 17:28 | |
| *** e0ne has joined #openstack-kolla | 17:28 | |
| *** k_mouza_ has quit IRC | 17:30 | |
| *** k_mouza has joined #openstack-kolla | 17:30 | |
| *** jamesbenson has quit IRC | 17:32 | |
| *** samcat116 has joined #openstack-kolla | 17:32 | |
| *** jamesbenson has joined #openstack-kolla | 17:33 | |
| *** jonaspaulo has joined #openstack-kolla | 17:34 | |
| *** k_mouza has quit IRC | 17:37 | |
| *** murphyslawbbs has joined #openstack-kolla | 17:38 | |
| *** kevko has quit IRC | 17:41 | |
| *** jonaspaulo has quit IRC | 17:52 | |
| *** brinzhang_ has joined #openstack-kolla | 17:53 | |
| *** brinzhang has quit IRC | 17:56 | |
| *** kevko has joined #openstack-kolla | 18:08 | |
| *** k_mouza has joined #openstack-kolla | 18:11 | |
| *** jamesbenson has quit IRC | 18:12 | |
| *** jamesbenson has joined #openstack-kolla | 18:13 | |
| *** k_mouza has quit IRC | 18:16 | |
| openstackgerrit | Merged openstack/kolla-ansible stable/victoria: masakari: fix minor issues with instance monitor https://review.opendev.org/c/openstack/kolla-ansible/+/789749 | 18:19 |
| *** murphyslawbbs has quit IRC | 18:24 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla stable/train: [CI] Trust only infra mirrors https://review.opendev.org/c/openstack/kolla/+/790261 | 18:25 |
| *** kevko has quit IRC | 18:27 | |
| *** murphyslawbbs has joined #openstack-kolla | 18:30 | |
| *** lxkong has quit IRC | 18:32 | |
| *** emccormick has quit IRC | 18:33 | |
| *** emccormick has joined #openstack-kolla | 18:35 | |
| *** lxkong has joined #openstack-kolla | 18:35 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla stable/train: Use Debian mirror in CI jobs https://review.opendev.org/c/openstack/kolla/+/790262 | 18:37 |
| *** vishalmanchanda has joined #openstack-kolla | 18:38 | |
| *** jamesbenson has quit IRC | 18:39 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla stable/train: CI: use Debian/Ubuntu mirrors in base image https://review.opendev.org/c/openstack/kolla/+/790263 | 18:40 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla stable/train: [CI] Trust only infra mirrors https://review.opendev.org/c/openstack/kolla/+/790261 | 18:40 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla stable/train: Ubuntu: use local APT mirrors if possible https://review.opendev.org/c/openstack/kolla/+/790264 | 18:44 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla stable/train: [CI] Trust only infra mirrors https://review.opendev.org/c/openstack/kolla/+/790261 | 18:44 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla stable/train: [CI] Trust only infra mirrors https://review.opendev.org/c/openstack/kolla/+/790261 | 18:50 |
| yoctozepto | mgoddard, mnasiadka, hrw: lots of train love ^ | 18:55 |
| samcat116 | getting this when running kayobe control host bootstrap | 19:08 |
| samcat116 | http://paste.openstack.org/show/805043/ | 19:08 |
| samcat116 | the network_interfaces for the controllers group vars is empty | 19:08 |
| *** samcat116 has quit IRC | 19:09 | |
| *** andrewbonney has quit IRC | 19:10 | |
| mnasiadka | yoctozepto: it just happens ;) | 19:28 |
| openstackgerrit | Merged openstack/kolla master: [release] Use UCA Wallaby https://review.opendev.org/c/openstack/kolla/+/782308 | 19:32 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla stable/wallaby: [release] Use UCA Wallaby https://review.opendev.org/c/openstack/kolla/+/790265 | 19:36 |
| *** samcat116 has joined #openstack-kolla | 19:58 | |
| *** Tengu has quit IRC | 20:04 | |
| *** Tengu has joined #openstack-kolla | 20:04 | |
| *** raildo has joined #openstack-kolla | 20:07 | |
| *** samcat116 has quit IRC | 20:07 | |
| *** k_mouza has joined #openstack-kolla | 20:13 | |
| *** samcat116 has joined #openstack-kolla | 20:18 | |
| *** murphyslawbbs has quit IRC | 20:20 | |
| *** jamesbenson has joined #openstack-kolla | 20:26 | |
| *** samcat116 has quit IRC | 20:37 | |
| *** murphyslawbbs has joined #openstack-kolla | 20:45 | |
| *** k_mouza has quit IRC | 20:46 | |
| *** gfidente|afk has quit IRC | 20:46 | |
| *** raildo_ has joined #openstack-kolla | 20:49 | |
| *** raildo has quit IRC | 20:52 | |
| *** vishalmanchanda has quit IRC | 20:58 | |
| *** jamesbenson has quit IRC | 21:00 | |
| *** jamesbenson has joined #openstack-kolla | 21:28 | |
| *** jamesbenson has quit IRC | 21:32 | |
| *** murphyslawbbs has quit IRC | 21:36 | |
| *** jamesbenson has joined #openstack-kolla | 21:39 | |
| openstackgerrit | Merged openstack/kolla stable/train: Fix Mistral source images to respect upper-constraints https://review.opendev.org/c/openstack/kolla/+/773014 | 21:48 |
| *** jamesbenson has quit IRC | 21:57 | |
| *** jamesbenson1 has joined #openstack-kolla | 21:57 | |
| *** e0ne has quit IRC | 22:10 | |
| *** hjensas_ has joined #openstack-kolla | 22:10 | |
| *** hjensas has quit IRC | 22:14 | |
| *** k_mouza has joined #openstack-kolla | 22:29 | |
| *** k_mouza has quit IRC | 22:34 | |
| *** jamesbenson1 has quit IRC | 22:42 | |
| *** kevko has joined #openstack-kolla | 23:04 | |
| *** macz_ has quit IRC | 23:58 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!