| opendevreview | ZhouHeng proposed openstack/neutron master: [ovn]Refusing to bind port to dead agent https://review.opendev.org/c/openstack/neutron/+/825428 | 00:26 |
|---|---|---|
| opendevreview | ZhouHeng proposed openstack/neutron-fwaas master: add ovn driver https://review.opendev.org/c/openstack/neutron-fwaas/+/836729 | 01:02 |
| opendevreview | OpenStack Proposal Bot proposed openstack/neutron master: Imported Translations from Zanata https://review.opendev.org/c/openstack/neutron/+/838078 | 04:05 |
| opendevreview | yatin proposed openstack/neutron stable/yoga: [FT] Run all .*MySQL tests in an isolated thread https://review.opendev.org/c/openstack/neutron/+/839189 | 05:41 |
| opendevreview | liuhuajie proposed openstack/neutron master: subnet-service-types use api def ALIAS in _supported_extension_aliases https://review.opendev.org/c/openstack/neutron/+/839302 | 06:59 |
| congnt | Hi zhouhenglc, do you know about this mail? (https://www.mail-archive.com/ovs-discuss@openvswitch.org/msg07535.html). Nasiadka said will submit a patch to fix deploy ovn set TCP by command line, but now i can't find this patch | 07:44 |
| opendevreview | Lajos Katona proposed openstack/networking-bgpvpn master: CI: fix weekly job https://review.opendev.org/c/openstack/networking-bgpvpn/+/839313 | 07:51 |
| zhouhenglc | congnt: I haven't paid much attention to kolla's patch submission | 07:53 |
| opendevreview | Lajos Katona proposed openstack/networking-sfc master: CI: fix weekly job https://review.opendev.org/c/openstack/networking-sfc/+/839314 | 07:55 |
| congnt | zhouhenglc: oh, i saw you commit to kolla-ansible (https://github.com/openstack/kolla-ansible/blob/stable/yoga/ansible/roles/ovn/templates/ovn-sb-db.json.j2), so i try to ask you :D! | 07:56 |
| congnt | my openstack cluster can't set probe, Is it due to this error (https://review.opendev.org/c/openstack/neutron/+/825269)? | 07:58 |
| zhouhenglc | congnt: this is fixed a parameter name | 07:59 |
| zhouhenglc | bug. | 07:59 |
| zhouhenglc | congnt: not this error | 08:00 |
| zhouhenglc | congnt: this patch is to update probe, and require connection exist. | 08:00 |
| zhouhenglc | congnt: Using kolla deployment, i'm not sure if it create the connection | 08:03 |
| congnt | zhouhenglc: yes, i deploy by kolla, so i saw nothing in connection of ovn_sb and ovn_nb | 08:04 |
| congnt | zhouhenglc: yesterday, you guide me set connection by "ovn-sbctl set-connection ptcp:6642:10.5.8.101 ptcp:6642:10.5.8.102 ptcp:6642:10.5.8.103", and set inactivity probe. But ovn_sb and ovsdb log still response inactivity probe by 5s | 08:05 |
| opendevreview | Rodolfo Alonso proposed openstack/networking-ovn stable/train: [OVN] Correctly set dns_server in dhcpv4/v6 options https://review.opendev.org/c/openstack/networking-ovn/+/838988 | 08:05 |
| congnt | is_connected is false | 08:06 |
| congnt | _uuid : bf8ac170-cf92-49e9-be6b-5d66944a72b4 | 08:06 |
| congnt | external_ids : {} | 08:06 |
| congnt | inactivity_probe : 60000 | 08:06 |
| congnt | is_connected : false | 08:06 |
| ralonsoh | bcafarel, slaweq easy ones (if you have time, and only those ones with Zuul +1) | 08:08 |
| ralonsoh | bcafarel, slaweq easy ones (if you have time, and only those ones with Zuul +1) | 08:08 |
| ralonsoh | https://review.opendev.org/q/I17aa53cea6aba8ea83187c99102a6f25fd33cfff | 08:08 |
| ralonsoh | https://review.opendev.org/q/Iced254259170972a9699aa35ae8062776e11285d | 08:08 |
| ralonsoh | thanks! | 08:08 |
| zhouhenglc | congnt: Are there 3 connections now? the inactivity_probe of each connection are 6000? | 08:09 |
| congnt | zhouhenglc: yes, I have 3 connection, but all is_connected: false | 08:10 |
| zhouhenglc | congnt: What is the sb addresses configured in ovn-controller | 08:12 |
| opendevreview | Slawek Kaplonski proposed openstack/neutron-tempest-plugin master: Consolidate neutron-tempest-plugin-api with scenario jobs https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/836912 | 08:18 |
| opendevreview | Slawek Kaplonski proposed openstack/neutron-tempest-plugin master: Consolidate neutron-tempest-plugin-api with scenario jobs https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/836912 | 08:18 |
| congnt | external_ids : {ovn-bridge-mappings="physnet1:br-ex", ovn-chassis-mac-mappings="physnet1:52:54:00:9f:53:b7", ovn-encap-ip="10.5.8.202", ovn-encap-type=geneve, ovn-openflow-probe-interval="60", ovn-remote="tcp:10.5.8.101:6642,tcp:10.5.8.102:6642,tcp:10.5.8.103:6642", ovn-remote-probe-interval="60000", system-id=compute-2} | 08:22 |
| congnt | zhouhenglc: this is my sb address on ovn-controller | 08:22 |
| zhouhenglc | congnt: I didn't find any problem | 08:29 |
| zhouhenglc | congnt: Is there a complete sb log | 08:30 |
| congnt | zhouhenglc: I think problem is deploy ovn by kolla like in this mail (https://www.mail-archive.com/ovs-discuss@openvswitch.org/msg07535.html) | 08:31 |
| zhouhenglc | congnt: What is the start command for kolla to deploy ovn-sb now | 08:33 |
| congnt | zhouhenglc: SB listen by command ovn-ctl, not create connection, so can't see any thing by command list connection | 08:33 |
| congnt | https://github.com/openstack/kolla-ansible/blob/stable/victoria/ansible/roles/ovn/templates/ovn-sb-db.json.j2#L2 | 08:33 |
| congnt | zhouhenglc: I'm asking on kolla channel | 08:34 |
| zhouhenglc | congnt: there is no connection in my current environment after deploy, and I create and set the connection by other commands | 08:36 |
| bcafarel | ralonsoh: sure, looking | 08:42 |
| congnt | zhouhenglc: Are you deploy by kolla too? | 08:43 |
| zhouhenglc | congnt: use k8s | 08:44 |
| zhouhenglc | congnt: What is the version of OVS | 08:46 |
| zhouhenglc | ? | 08:46 |
| congnt | zhouhenglc: OVS version is 2.13.1, and OVN is 20.03.1 | 08:46 |
| congnt | I saw a commit (https://github.com/ovn-org/ovn/commit/a4809a59175903a7276b3ca6d36a23dabb5fa363) improve process flow, i think we need to upgrade to OVN 20.03.2 | 08:47 |
| zhouhenglc | congnt: you can try upgrade, The version I use is 21.03, I think the problem that the connection setting does not take effect should have nothing to do with the deployment | 08:52 |
| zhouhenglc | congnt: The ovn version of my devstack environment is 20.03.2, can set connection successfully | 08:53 |
| opendevreview | liuhuajie proposed openstack/neutron master: subnet-service-types use api def ALIAS in _supported_extension_aliases https://review.opendev.org/c/openstack/neutron/+/839302 | 08:53 |
| zhouhenglc | congnt: my devstack environment, ovs version 2.13.5 | 08:54 |
| congnt | zhouhenglc: I can set connection, by seem it is not working | 08:54 |
| congnt | log ovsdb still response: tcp:127.0.0.1:47432: no response to inactivity probe after 5 seconds, disconnecting | 08:54 |
| congnt | neutron still response ovn-controller down by command (openstack network agent list). I can't create vm in this host | 08:55 |
| zhouhenglc | congnt: only compute2 is down? | 08:57 |
| congnt | yes, only it down. After some times (5, 10, 15 minutes). ovn-controller of this host is up | 08:58 |
| congnt | ovn-sbctl list Chassis | grep -i "hostname\|nb_cfg" | 09:00 |
| congnt | hostname : compute-1 | 09:00 |
| congnt | nb_cfg : 5725 | 09:00 |
| congnt | hostname : controller-2 | 09:00 |
| congnt | nb_cfg : 5725 | 09:00 |
| congnt | hostname : controller-1 | 09:00 |
| congnt | nb_cfg : 5725 | 09:00 |
| congnt | hostname : compute-2 | 09:00 |
| congnt | nb_cfg : 5723 | 09:00 |
| congnt | hostname : controller-3 | 09:00 |
| congnt | nb_cfg : 5725 | 09:00 |
| zhouhenglc | congnt: this log( inactivity probe after 5 seconds, disconnecting) in sb log? | 09:01 |
| congnt | sb log and ovsdb of compute | 09:02 |
| zhouhenglc | congnt: you can try "ovs-vsctl set manager . inactivity_probe=60000" in compute, and observe the ovsdb log | 09:03 |
| congnt | "ovs-vsctl list manager" don't show anything | 09:07 |
| congnt | seems problem how kolla deploy ovn and ovs | 09:07 |
| zhouhenglc | congnt: I'm not very inclined to the problem of deployment. I think you can try to upgrade ovs. | 09:17 |
| congnt | zhouhenglc: I will try to upgrade ovn and ovs. And plan upgrade openstack to yoga. Thank you very much for your support these days | 09:18 |
| zhouhenglc | congnt: :) | 09:19 |
| congnt | zhouhenglc: Oh, I saw neutron-fwaas back :D do we plan to add ovn driver? | 09:20 |
| zhouhenglc | congnt: yes, I am working for this. | 09:21 |
| congnt | zhouhenglc: wow, looking forward to it ^^ | 09:21 |
| opendevreview | Merged openstack/neutron stable/yoga: [L3][QoS] Remove router QoS binding when GW is removed https://review.opendev.org/c/openstack/neutron/+/839016 | 10:25 |
| opendevreview | Merged openstack/neutron stable/xena: [L3][QoS] Remove router QoS binding when GW is removed https://review.opendev.org/c/openstack/neutron/+/839017 | 10:25 |
| opendevreview | Merged openstack/neutron stable/wallaby: [L3][QoS] Remove router QoS binding when GW is removed https://review.opendev.org/c/openstack/neutron/+/839018 | 10:31 |
| opendevreview | ZhouHeng proposed openstack/neutron master: [ovn]Refusing to bind port to dead agent https://review.opendev.org/c/openstack/neutron/+/825428 | 11:04 |
| opendevreview | Lajos Katona proposed openstack/neutron-tempest-plugin master: [taas] Remove unused scenario.manager methods https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/839360 | 11:14 |
| sean-k-mooney | hum bug or feature. if you dont allow icmp packets on ingress you cant ping the default gateway when using ovn | 11:31 |
| sean-k-mooney | if you were using ml2/ovs it would be allowed becasue its a related packet to the one allowed by the egress policy | 11:32 |
| sean-k-mooney | so ml2/ovn is not acting the same as ml2/ovs with iptabels or ovs firewall | 11:32 |
| opendevreview | yatin proposed openstack/neutron master: [DNM] Test multinode ovn grenade with fixes https://review.opendev.org/c/openstack/neutron/+/836141 | 11:33 |
| lajoskatona | slaweq, ralonsoh: Hi could you please wf+1 this patch for weekly job of vpnaas: https://review.opendev.org/c/openstack/neutron-vpnaas/+/834499 ? | 11:49 |
| ralonsoh | sure | 11:51 |
| *** dasm|off is now known as dasm | 12:04 | |
| opendevreview | Merged openstack/neutron-vpnaas master: Add weekly jobs https://review.opendev.org/c/openstack/neutron-vpnaas/+/834499 | 12:31 |
| opendevreview | yatin proposed openstack/neutron master: [DNM] Test multinode ovn grenade with fixes https://review.opendev.org/c/openstack/neutron/+/836141 | 12:32 |
| opendevreview | Lajos Katona proposed openstack/tap-as-a-service master: Code cleaning: make RPC method signatures more meaningful https://review.opendev.org/c/openstack/tap-as-a-service/+/833432 | 12:37 |
| opendevreview | Rodolfo Alonso proposed openstack/neutron master: [OVS] Do not shadow "l2_agent_extensions_manager" module https://review.opendev.org/c/openstack/neutron/+/839377 | 13:16 |
| opendevreview | Bernard Cafarelli proposed openstack/neutron stable/yoga: Dropping lower constraints testing (stable Yoga) https://review.opendev.org/c/openstack/neutron/+/839190 | 13:39 |
| opendevreview | Bernard Cafarelli proposed openstack/neutron stable/yoga: Fix setting table monitoring conditions https://review.opendev.org/c/openstack/neutron/+/838702 | 13:41 |
| lajoskatona | #startmeeting networking | 14:01 |
| opendevmeet | Meeting started Tue Apr 26 14:01:47 2022 UTC and is due to finish in 60 minutes. The chair is lajoskatona. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:01 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:01 |
| opendevmeet | The meeting name has been set to 'networking' | 14:01 |
| mlavalle | o/ | 14:01 |
| lajoskatona | Hi everybody :-) | 14:01 |
| isabek | Hi! | 14:02 |
| obondarev | hi | 14:02 |
| slaweq | hi | 14:02 |
| ralonsoh | hi | 14:02 |
| bcafarel | o/ | 14:03 |
| haleyb | hi | 14:03 |
| lajoskatona | Let's start | 14:03 |
| lajoskatona | #topic Announcements | 14:04 |
| lajoskatona | The usual Zed schedule: https://releases.openstack.org/zed/schedule.html | 14:04 |
| lajoskatona | I don't know any important dates for this week :-) | 14:04 |
| rubasov | o/ | 14:04 |
| lajoskatona | at least for master | 14:04 |
| lajoskatona | [neutron] Transition Victoria to EM: https://review.opendev.org/c/openstack/releases/+/837947 | 14:04 |
| bcafarel | I was about to mention that one ^ | 14:05 |
| lajoskatona | With otherwiseguy we agreed to wait for the backport of this series: https://review.opendev.org/q/I0503037b803a3c99fb7988bc20394c111ac456db | 14:05 |
| lajoskatona | bcafarel: thanks :-) | 14:05 |
| * otherwiseguy catches up | 14:05 | |
| lajoskatona | as I remember from this morning it only hangs on yoga as waiting for https://review.opendev.org/c/openstack/neutron/+/839190 to remove l-c jobs | 14:06 |
| slaweq | my concern with that one is that I'm not sure if we are allowed to bump requirements in stable branches | 14:06 |
| slaweq | but if lajoskatona is ok with it then should be fine :) | 14:07 |
| ralonsoh | we can if there is a bug | 14:07 |
| slaweq | and bcafarel of course | 14:07 |
| otherwiseguy | and it's bumping to a new bugfix version, not an api breaking one or anything. | 14:07 |
| slaweq | ralonsoh: I remember some time ago that we couldn't bump pyroute2 version even if there was memory leak | 14:07 |
| lajoskatona | yeah last Friday we discussed it with otherwiseguy, and as I see with new ovs pkg it can fail | 14:07 |
| bcafarel | I commented on backports but I think it is good, this is needed to fix a bug and all have bumps on relevant stable branches of ovsdbapp (no api change) | 14:07 |
| ralonsoh | yes but in pyroute there is one single branch | 14:07 |
| ralonsoh | here we are creating minor versions from the stable branches | 14:08 |
| slaweq | ok, I just wanted to make sure that everyone knows about it :) | 14:08 |
| ralonsoh | https://review.opendev.org/q/topic:fix_ovs_2.17 | 14:09 |
| lajoskatona | slaweq: thanks, this is why I added a topic it here also :-) | 14:09 |
| mlavalle | +1 | 14:09 |
| lajoskatona | ok, so let's review them and hope that we can merge it and add to Victoria EM | 14:10 |
| lajoskatona | thanks for the discussion | 14:10 |
| lajoskatona | Another thing is neutron-vpnaas | 14:10 |
| lajoskatona | I sent out mail, to accept mnaser as core reviewer for the project | 14:11 |
| lajoskatona | He already started to fix the failing jobs, and in the mail thread even somebody else raised a hand for helping in the maintenance (perhaps noonedeadpunk ?) | 14:12 |
| mnaser | yep ^ | 14:13 |
| lajoskatona | mnaser: if you have pending reviews or such the Tuesday meetings are a good forum to ask the team | 14:14 |
| mnaser | okay cool, awesome, sounds good | 14:14 |
| lajoskatona | Do you have any comments or questions regarding the above topics? | 14:15 |
| mnaser | appreciate eyes on https://review.opendev.org/c/openstack/neutron-vpnaas/+/823904 and https://review.opendev.org/c/openstack/neutron-vpnaas/+/823906 -- they are quite trivial | 14:15 |
| *** arnau__ is now known as arnau | 14:16 | |
| lajoskatona | mnaser: will check, however my vpnaas background is near to zero :-) | 14:16 |
| mnaser | yeah, they are much more of "neutron made a change that vpnaas" didnt track sort of changes =P | 14:17 |
| mnaser | i.e. one around changing language from 'master' to 'primary' and vpnaas not catching up, but yeah | 14:17 |
| mlavalle | i'll look at them this morning | 14:17 |
| mlavalle | at first glance, seem pretty simple | 14:17 |
| lajoskatona | mnaser: ok, thanks for the background | 14:18 |
| lajoskatona | Ok, let's move to the next topic | 14:19 |
| lajoskatona | #topic Bugs | 14:19 |
| lajoskatona | Report from obondarev: http://lists.openstack.org/pipermail/openstack-discuss/2022-April/028294.html | 14:19 |
| opendevreview | Arnau Verdaguer proposed openstack/neutron master: [OVN][Migration] More robust checks on stop-agents https://review.opendev.org/c/openstack/neutron/+/839392 | 14:19 |
| lajoskatona | I saw one bug which needs more attention: | 14:19 |
| lajoskatona | [OVN] Frequent DB leader changes causes 'VIF creation failed' on nova side (#link https://bugs.launchpad.net/neutron/+bug/1969592 ) | 14:19 |
| bcafarel | hmm that sounds like the bug otherwiseguy was working on? (just a quick read though) | 14:20 |
| bcafarel | DB leader changes and raft appearing in logs | 14:20 |
| lajoskatona | bcafarel: really? would be a good coincidence | 14:20 |
| * otherwiseguy looks | 14:20 | |
| otherwiseguy | Yeah, basically it's "using raft doesn't work until all of those previous patches letting us use 2.17 are merged" :D | 14:21 |
| lajoskatona | otherwiseguy: thanks | 14:21 |
| lajoskatona | ahh, ok so it is another version of that | 14:21 |
| otherwiseguy | because 2.17 allows fast reconnects, which raft relies on. leadership changes where you download the whole db every 100 transactions or so while ovs does a snapshot is...bad. | 14:21 |
| lajoskatona | could you comment it on the above bug or perhaps make it a duplicate ? | 14:22 |
| otherwiseguy | will do | 14:22 |
| lajoskatona | otherwiseguy: thanks | 14:22 |
| bcafarel | one bug down :) | 14:22 |
| lajoskatona | :-) | 14:22 |
| lajoskatona | and even one down in nova, so a favor from us | 14:23 |
| mlavalle | +1 | 14:24 |
| mlavalle | lol | 14:24 |
| lajoskatona | Do you have any comments for the bugs ? | 14:24 |
| obondarev | https://bugs.launchpad.net/neutron/+bug/1969354 - got some additional info, so deserves a second look | 14:24 |
| obondarev | that's it :) | 14:25 |
| ralonsoh | the problem there seems to be the deployment tool | 14:26 |
| ralonsoh | that is not creating the connections | 14:26 |
| lajoskatona | obondarev: thanks, as I see jlibosva checked it | 14:26 |
| ralonsoh | (check today's log in this channel) | 14:26 |
| lajoskatona | ralonsoh: ahh, ok so that is related to this bug, I haven't followed closely | 14:27 |
| lajoskatona | ralonsoh: shall we add kolla-ansible in this case also to the bug to have their opinion also? | 14:27 |
| ralonsoh | yes, I think so | 14:27 |
| labedz_ | hi, have you a chance to look on: https://bugs.launchpad.net/neutron/+bug/1970216 ? | 14:28 |
| *** labedz_ is now known as labedz | 14:28 | |
| ralonsoh | sure, added to my pile | 14:29 |
| lajoskatona | for the bug deputy week: This week isabek is the deputy, and next week elvira will be, Is that ok? | 14:30 |
| slaweq | me too | 14:30 |
| elvira | yes :) | 14:30 |
| isabek | o/ | 14:30 |
| lajoskatona | elvira, isabek: thanks | 14:30 |
| lajoskatona | Actually I have nothing more for today, if you have anything to discuss, please.... | 14:31 |
| ralonsoh | not from me, thanks | 14:31 |
| slaweq | nothing from me | 14:32 |
| lajoskatona | Thanks for participating , see you online and on the coming CI meeting :-) | 14:33 |
| bcafarel | o/ | 14:33 |
| lajoskatona | #endmeeting | 14:33 |
| opendevmeet | Meeting ended Tue Apr 26 14:33:28 2022 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:33 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/networking/2022/networking.2022-04-26-14.01.html | 14:33 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/networking/2022/networking.2022-04-26-14.01.txt | 14:33 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/networking/2022/networking.2022-04-26-14.01.log.html | 14:33 |
| lajoskatona | o/ | 14:33 |
| ralonsoh | bye | 14:33 |
| slaweq | o/ | 14:33 |
| ykarel | o/ | 14:33 |
| obondarev | o/ | 14:33 |
| elvira | o/ | 14:33 |
| opendevreview | Merged openstack/neutron-tempest-plugin master: [fwaas] Remove _create_port & create_keypair https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/837275 | 14:33 |
| opendevreview | Merged openstack/neutron-tempest-plugin master: [fwaas] Remove secgroup creation related methods https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/837519 | 14:38 |
| opendevreview | Merged openstack/neutron stable/yoga: [OVN] Handle OVN agents when "Chassis" register is deleted https://review.opendev.org/c/openstack/neutron/+/839022 | 14:45 |
| opendevreview | Merged openstack/neutron stable/xena: [OVN] Handle OVN agents when "Chassis" register is deleted https://review.opendev.org/c/openstack/neutron/+/839023 | 14:57 |
| slaweq | #startmeeting neutron_ci | 15:00 |
| opendevmeet | Meeting started Tue Apr 26 15:00:23 2022 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
| opendevmeet | The meeting name has been set to 'neutron_ci' | 15:00 |
| slaweq | hi | 15:00 |
| mlavalle | o/ | 15:00 |
| ralonsoh | hi | 15:00 |
| slaweq | Grafana dashboard: https://grafana.opendev.org/d/f913631585/neutron-failure-rate?orgId=1 | 15:01 |
| bcafarel | o/ | 15:01 |
| opendevreview | Merged openstack/neutron-vpnaas master: Fix failover with L3 HA https://review.opendev.org/c/openstack/neutron-vpnaas/+/823904 | 15:02 |
| lajoskatona | o/ | 15:02 |
| slaweq | #topic Actions from previous meetings | 15:02 |
| slaweq | mlavalle to add note about rechecking with reason | 15:03 |
| mlavalle | I did | 15:03 |
| mlavalle | it turns out we already had anote | 15:03 |
| obondarev | hi | 15:03 |
| ykarel | hi | 15:03 |
| mlavalle | buried in the Neutron policies | 15:03 |
| mlavalle | so I moved it one lever higher to make it more visible | 15:03 |
| lajoskatona | good idea | 15:04 |
| slaweq | thx mlavalle | 15:04 |
| mlavalle | fixed some wording and added some examples (shamelessly stolen from Cinder) | 15:04 |
| slaweq | now harder part - we need to enforce ourselves not to recheck without giving reasons | 15:04 |
| slaweq | and also educate others during reviews | 15:04 |
| slaweq | :) | 15:04 |
| bcafarel | do what we say, not what we usually do :) | 15:05 |
| lajoskatona | https://docs.openstack.org/neutron/latest/contributor/index.html#gerrit-rechecks | 15:05 |
| slaweq | bcafarel: exactly :) | 15:05 |
| ralonsoh | link please? | 15:05 |
| mlavalle | ralonsoh: https://docs.openstack.org/neutron/latest/contributor/gerrit-recheck.html | 15:05 |
| ralonsoh | tahnks | 15:06 |
| mlavalle | ralonsoh: https://review.opendev.org/c/openstack/neutron/+/839107 | 15:06 |
| mlavalle | patch^^^ | 15:06 |
| slaweq | ok, I think we can move on | 15:07 |
| slaweq | next one | 15:07 |
| slaweq | lajoskatona to check with QA team if neutron-tempest-plugin tag for victoria EM will be done together with tempest | 15:07 |
| lajoskatona | yes I asked gmann about it | 15:07 |
| lajoskatona | I have to search for the logs, but summary: they will prepare the tag after victoria EM-ed, and they can do it for neutron-tempest-plugin | 15:07 |
| slaweq | great | 15:08 |
| slaweq | so as last step we will update our victoria jobs in neutron-tempest-plugin to use those tagged versions of tempest and neutron-tempest-plugin | 15:08 |
| lajoskatona | "we can do tempest first and then plugins. but I am waiting for victoria to be EM which should be in coming week or so" (https://meetings.opendev.org/irclogs/%23openstack-qa/%23openstack-qa.2022-04-25.log.html ) | 15:08 |
| lajoskatona | yes, exactly | 15:08 |
| slaweq | and remove those jobs from the check/gate queue in neutron-tempest-plugin repo | 15:08 |
| slaweq | thx lajoskatona | 15:09 |
| slaweq | next one | 15:09 |
| slaweq | lajoskatona to contiune checking failing py39 job in networking-odl | 15:09 |
| lajoskatona | it's on the way, but many small things to fix there (https://review.opendev.org/c/openstack/networking-odl/+/838451 ) | 15:10 |
| lajoskatona | functional is now failing due to a recent change in devstack to collect stats from jobs and they import pymysql and that is not present for functional jobs | 15:11 |
| slaweq | lajoskatona: for that one there is fix proposed already: https://review.opendev.org/c/openstack/devstack/+/839217 | 15:12 |
| lajoskatona | slaweq: cool, thanks | 15:12 |
| slaweq | I pinged gmann and other devstack cores to review it ASAP | 15:13 |
| slaweq | ok, next one | 15:13 |
| slaweq | mlavalle to check neutron-ovn-tempest-ovs-master-fedora periodic job | 15:13 |
| mlavalle | I checked it | 15:14 |
| mlavalle | the original problem was with ovs compiling / building | 15:14 |
| mlavalle | so the it failed building | 15:14 |
| mlavalle | that was fixed last week | 15:14 |
| slaweq | yeah, I saw that this job was green few times this week :) | 15:15 |
| mlavalle | it now succeeds building, but is intermitently failing a test: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_15b/periodic/opendev.org/openstack/neutron/master/neutron-ovn-tempest-ovs-master-fedora/15b5850/testr_results.html | 15:15 |
| mlavalle | so I need to investigate this latter failure | 15:15 |
| slaweq | but this test isn't really related to neutron | 15:15 |
| mlavalle | I know | 15:16 |
| mlavalle | I'll just keep an eye on it | 15:16 |
| slaweq | yes, thx a lot | 15:17 |
| mlavalle | :-) | 15:17 |
| slaweq | ok, last one from previous week | 15:17 |
| slaweq | mlavalle to check failed fips periodic job | 15:17 |
| mlavalle | with that one I got lucky | 15:18 |
| mlavalle | it has been succeeding every single time since we talked about it last week | 15:18 |
| mlavalle | https://zuul.openstack.org/builds?job_name=neutron-ovn-tempest-ovs-release-fips | 15:18 |
| mlavalle | I think that failure was a one of | 15:18 |
| slaweq | great then :) | 15:19 |
| mlavalle | because even the few failures during the preceding days were build failures | 15:19 |
| opendevreview | Merged openstack/networking-ovn stable/train: Do not announce any DNS resolver if "0.0.0.0" or "::" provided https://review.opendev.org/c/openstack/networking-ovn/+/838987 | 15:20 |
| opendevreview | Merged openstack/tap-as-a-service master: Add weekly jobs https://review.opendev.org/c/openstack/tap-as-a-service/+/834505 | 15:21 |
| slaweq | ok, that were all actions from last meeting | 15:21 |
| ykarel | ahkk https://github.com/ovn-org/ovn/commit/996ed75db776c59098b6539d0c03d43977202885 fixed that fedora ovn job | 15:21 |
| ykarel | compilation issue | 15:21 |
| slaweq | I think we can move on | 15:21 |
| slaweq | #topic Stable branches | 15:21 |
| slaweq | thx ykarel for link | 15:21 |
| bcafarel | not much this week (aka no news is good news!) | 15:22 |
| bcafarel | main point is victoria switching to EM we already talked about | 15:22 |
| slaweq | ok, thx bcafarel :) | 15:24 |
| slaweq | so next topic then | 15:24 |
| slaweq | #topic Stadium projects | 15:24 |
| slaweq | lajoskatona: any new issues in stadium's ci, except those in networking-odl? | 15:25 |
| lajoskatona | yes for weekly jobs: https://review.opendev.org/q/topic:weekly_job | 15:26 |
| lajoskatona | I just realized that for sfc and bgpvpn we have to add neutron to required projects list | 15:26 |
| lajoskatona | and I have 2 more for taas to make py310 green: py310 for taas: https://review.opendev.org/q/topic:p310_for_taas | 15:27 |
| lajoskatona | but otherwise the other stadiums seems to be green | 15:27 |
| opendevreview | Merged openstack/neutron stable/xena: Fix setting table monitoring conditions https://review.opendev.org/c/openstack/neutron/+/838783 | 15:27 |
| slaweq | I think You need to rebase those 2 taas patches | 15:28 |
| lajoskatona | slaweq: true, I will do, 2 hours ago it was green.... | 15:29 |
| slaweq | :) | 15:29 |
| slaweq | and for those weekly jobs in sfc and bgpvpn - do You have patches ready? | 15:30 |
| lajoskatona | https://review.opendev.org/q/topic:weekly_job | 15:30 |
| slaweq | ahh, sorry | 15:30 |
| slaweq | thx | 15:30 |
| lajoskatona | thanks for the attention | 15:30 |
| slaweq | +2 on both | 15:31 |
| slaweq | ok, I think we can move on | 15:32 |
| slaweq | #topic Grafana | 15:32 |
| slaweq | #link https://grafana.opendev.org/d/f913631585/neutron-failure-rate | 15:32 |
| slaweq | I noticed there is a lot of gaps there recently | 15:32 |
| slaweq | I'm not sure if that is going to be shutdown together with services like logstash too | 15:32 |
| slaweq | I hope grafana will still be up :) | 15:33 |
| lajoskatona | I haven't heard about it, so I hope not | 15:33 |
| bcafarel | no logs, no bugs? :) | 15:34 |
| bcafarel | but yeah hopefully it still works after that change | 15:34 |
| slaweq | bcafarel: I wish :P | 15:34 |
| slaweq | regarding dashboard I saw some spike to 100% of failures during the weekend | 15:35 |
| slaweq | but there was not many runs so it could be some kind of red hering | 15:35 |
| slaweq | now it seems to be ok(ish) again | 15:35 |
| slaweq | even functional jobs is pretty low with failures this week | 15:36 |
| lajoskatona | a little strange that all tempest job failure rates are 0 | 15:36 |
| slaweq | lajoskatona: I'm not worried about it :) | 15:37 |
| lajoskatona | slaweq: if it is true I like it | 15:37 |
| slaweq | :) | 15:37 |
| slaweq | anything else regarding grafana? | 15:38 |
| slaweq | or can we move on? | 15:38 |
| mlavalle | move on | 15:38 |
| lajoskatona | +1 | 15:38 |
| slaweq | #topic Rechecks | 15:38 |
| slaweq | I added it as separate topic as we discuss it every week basically | 15:39 |
| slaweq | +---------+----------+... (full message at https://matrix.org/_matrix/media/r0/download/matrix.org/fFJABtYBrfTVRoIFUycCRQHt) | 15:39 |
| slaweq | we are pretty ok with the number of rechecks | 15:39 |
| slaweq | above 1 in average this week but I checked patches which had most of the recheck | 15:39 |
| slaweq | and there were only 3 above that average: | 15:39 |
| slaweq | https://review.opendev.org/c/openstack/neutron/+/836863 - 8 rechecks - mostly hitting https://bugs.launchpad.net/neutron/+bug/1956958 | 15:40 |
| lajoskatona | these numbers for master or all branches? | 15:40 |
| slaweq | https://review.opendev.org/c/openstack/neutron/+/834952 - 5 rechecks - mostly hitting | 15:40 |
| slaweq | https://bugs.launchpad.net/neutron/+bug/1956958 | 15:40 |
| ralonsoh | ^^ https://review.opendev.org/c/openstack/neutron/+/836140 | 15:40 |
| slaweq | and https://review.opendev.org/c/openstack/neutron/+/837143 - 2 rechecks, pretty old ones | 15:40 |
| lajoskatona | the doc one was from me, It was boring at the end but I had the opportunity to force myself to do not recheck blindly | 15:41 |
| ralonsoh | I would need help with this patch | 15:41 |
| slaweq | lajoskatona: yes, those are numbers from master branch only | 15:41 |
| slaweq | lajoskatona: no worries, it's not to blame anyone here | 15:41 |
| slaweq | more to understand where and why we have those rechecks :) | 15:42 |
| lajoskatona | slaweq: no offense but that small patch for doc I keep in my memories :-) | 15:42 |
| slaweq | and it seems that https://bugs.launchpad.net/neutron/+bug/1956958 is our main problem currently :) | 15:42 |
| lajoskatona | and ralonsoh has the above patch for it : https://review.opendev.org/c/openstack/neutron/+/836140 ? | 15:42 |
| ralonsoh | yes | 15:42 |
| slaweq | ralonsoh: I remember about Your patch https://review.opendev.org/c/openstack/neutron/+/836140 and looking forward for it :) | 15:43 |
| ralonsoh | I've tested it manually | 15:43 |
| ralonsoh | but I don't know why the script is not running when called from the L3 agent | 15:43 |
| slaweq | do You need help with it? | 15:43 |
| slaweq | I can take a look | 15:43 |
| ralonsoh | that will be perfect | 15:43 |
| slaweq | ok | 15:44 |
| slaweq | I will try, but probably on Thursday or Friday | 15:44 |
| ralonsoh | no rush | 15:45 |
| slaweq | #action slaweq to check patch https://review.opendev.org/c/openstack/neutron/+/836140 | 15:45 |
| slaweq | anything else regarding rechecks today? | 15:45 |
| slaweq | or are we moving on? | 15:45 |
| lajoskatona | we can move | 15:46 |
| slaweq | #topic fullstack/functional | 15:46 |
| slaweq | here ykarel (probably) gave some examples of failures: | 15:46 |
| slaweq | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_955/834952/1/gate/neutron-functional-with-uwsgi/955ffd5/testr_results.html | 15:46 |
| slaweq | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_b61/834952/1/gate/neutron-functional-with-uwsgi/b617dc3/testr_results.html | 15:46 |
| slaweq | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_211/837681/2/check/neutron-functional-with-uwsgi/2117823/testr_results.html | 15:47 |
| ykarel | yes i think all those are related to keeplived thing? | 15:47 |
| slaweq | but IMO all of them are related to the bug Probably https://bugs.launchpad.net/neutron/+bug/1956958 and timeout while waiting for router transition | 15:47 |
| ykarel | slaweq, is it different then what ralonsoh is trying to fix with https://review.opendev.org/c/openstack/neutron/+/836140? | 15:48 |
| slaweq | and that's basically all what I have for today for functional/fullstack jobs | 15:48 |
| slaweq | ykarel: I think it's exactly the same | 15:48 |
| ralonsoh | yeah | 15:48 |
| ykarel | okk Thanks for confirmation | 15:48 |
| ykarel | also i noticed failure related to functional test stuck in stable/yoga and pushed backport https://review.opendev.org/c/openstack/neutron/+/839189 | 15:49 |
| slaweq | thx | 15:50 |
| ralonsoh | (nice patch!) | 15:50 |
| ralonsoh | hehehe | 15:50 |
| slaweq | :) | 15:51 |
| lajoskatona | LoL | 15:51 |
| slaweq | ok, lets move on | 15:51 |
| *** labedz is now known as labedz_ | 15:51 | |
| slaweq | for periodic jobs all looks mostly good | 15:51 |
| slaweq | we have failing neutron-ovn-tempest-postgres-full job but it's because of the same bug as networking-odl functional jobs | 15:52 |
| slaweq | and patch https://review.opendev.org/c/openstack/devstack/+/839217 should fix it | 15:52 |
| slaweq | so one last item for today | 15:52 |
| slaweq | #topic On Demand agenda | 15:52 |
| slaweq | I have one quick thing here | 15:52 |
| slaweq | next Tuesday will be public holiday in Poland | 15:52 |
| slaweq | so I will be off | 15:52 |
| slaweq | do we want to cancel ci meeting or someone else will chair it? | 15:53 |
| bcafarel | not public holiday here but I will be off too | 15:53 |
| ralonsoh | if we have a critical number of bugs, we can have it | 15:53 |
| ralonsoh | if not, for now, we can cancel | 15:53 |
| lajoskatona | +1 | 15:53 |
| slaweq | ok, I will check on Monday how it looks and will ping You ralonsoh to chair it or will cancel it | 15:54 |
| ralonsoh | perfect | 15:54 |
| mlavalle | +1 | 15:54 |
| slaweq | thx | 15:54 |
| slaweq | that's all from me for today | 15:54 |
| ykarel | +1 | 15:54 |
| slaweq | anything else You want to discuss, regarding our ci? | 15:54 |
| mlavalle | nothing from me | 15:54 |
| lajoskatona | nothing from me | 15:55 |
| bcafarel | nothing here | 15:55 |
| slaweq | ok, so thx for attending the meeting | 15:55 |
| slaweq | and have a great week | 15:55 |
| slaweq | o/ | 15:55 |
| obondarev | o/ | 15:55 |
| slaweq | #endmeeting | 15:55 |
| opendevmeet | Meeting ended Tue Apr 26 15:55:26 2022 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:55 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/neutron_ci/2022/neutron_ci.2022-04-26-15.00.html | 15:55 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/neutron_ci/2022/neutron_ci.2022-04-26-15.00.txt | 15:55 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/neutron_ci/2022/neutron_ci.2022-04-26-15.00.log.html | 15:55 |
| ralonsoh | bye | 15:55 |
| mlavalle | o/ | 15:55 |
| lajoskatona | o/ | 15:55 |
| ykarel | o/ | 15:56 |
| otherwiseguy | bcafarel: https://review.opendev.org/c/openstack/neutron/+/838702 has 2 +2s and just passed check gate. :D | 16:04 |
| otherwiseguy | just needs a w+1 :D | 16:04 |
| bcafarel | otherwiseguy: done though it will need l-c fix in too first https://review.opendev.org/c/openstack/neutron/+/839190/ | 16:05 |
| otherwiseguy | fun, my patch passes when it is rebased on that patch and that patch failed. | 16:05 |
| * otherwiseguy shakes his fist at CI | 16:06 | |
| opendevreview | liuhuajie proposed openstack/neutron master: Use neutron-lib subnet-service-types API def ALIAS in _supported_extension_aliases https://review.opendev.org/c/openstack/neutron/+/839302 | 16:06 |
| opendevreview | yatin proposed openstack/neutron master: [DNM] Test multinode ovn grenade with fixes https://review.opendev.org/c/openstack/neutron/+/836141 | 16:09 |
| opendevreview | Merged openstack/neutron stable/wallaby: Fix setting table monitoring conditions https://review.opendev.org/c/openstack/neutron/+/838784 | 16:12 |
| opendevreview | Lajos Katona proposed openstack/tap-as-a-service master: py310: Add rpm packages to bindep.txt https://review.opendev.org/c/openstack/tap-as-a-service/+/834880 | 16:14 |
| opendevreview | Lajos Katona proposed openstack/tap-as-a-service master: test: Make py310 passing https://review.opendev.org/c/openstack/tap-as-a-service/+/834928 | 16:15 |
| lajoskatona | ralonsoh, otherwiseguy, bcafarel: regarding https://review.opendev.org/c/openstack/neutron/+/838883 , do we have ovsdbapp release for the backport I found only wallaby (https://review.opendev.org/c/openstack/releases/+/838517 ) | 16:24 |
| otherwiseguy | lajoskatona: there is no ovsdbapp release for vicotria for that because ovsdbapp victoria wasn't affected by the bug. | 16:26 |
| ralonsoh | lajoskatona, no, https://review.opendev.org/q/Iad0d7472a7adce4a79111f94a2f33fc5b1a5c530 goes to wallaby only | 16:26 |
| lajoskatona | otherwiseguy: ok, thanks | 16:26 |
| ralonsoh | otherwiseguy, why do we need https://review.opendev.org/c/openstack/neutron/+/838883 then? | 16:26 |
| lajoskatona | ralonsoh: yeah I just found that series, thanks | 16:26 |
| otherwiseguy | ralonsoh: because it does a .condition access itself which is what is broken in ovs. | 16:27 |
| otherwiseguy | ralonsoh: ovsdbapp *also* had one in update_tables(), but that wasn't backported to victoria. | 16:27 |
| ralonsoh | otherwiseguy, ok, this is the same discussion as before. We should have ovsdbapp fix too, before merging the patch in Neutron | 16:29 |
| otherwiseguy | ralonsoh: I'm getting confused. | 16:29 |
| otherwiseguy | There is no ovsdbapp fix in victoria. | 16:30 |
| otherwiseguy | so nothing to wait on. | 16:30 |
| ralonsoh | otherwiseguy, but why there is no fix is ovsdbapp victoria? | 16:30 |
| otherwiseguy | ralonsoh: because there is no broken code in ovsdbapp victoria. update_tables() was the broken method. It is not there. | 16:30 |
| otherwiseguy | For more recent ovsdbapp/neutron, both had broken usages of .condition. Older than wallaby, only neutron has a broken usage. | 16:31 |
| ralonsoh | ok ok, now I'm reading the code in ovsdbapp | 16:31 |
| ralonsoh | yeah sorry | 16:31 |
| otherwiseguy | ralonsoh: long story short: seeing as I'd used (or at least reviewed) *two* usages of .condition in two projects, I probably should have known not to break it in ovs. :p | 16:32 |
| ralonsoh | not at all. And I'm capable of breaking code in several branches with only one commit! | 16:33 |
| opendevreview | Rodolfo Alonso proposed openstack/neutron master: [OVS] Do not shadow "l2_agent_extensions_manager" module https://review.opendev.org/c/openstack/neutron/+/839377 | 16:35 |
| lajoskatona | ralonsoh, otherwiseguy: the release patch for it: https://review.opendev.org/c/openstack/releases/+/839415 | 16:53 |
| ralonsoh | lajoskatona, thanks! | 16:53 |
| otherwiseguy | lajoskatona: thanks! | 16:53 |
| opendevreview | Merged openstack/networking-sfc master: CI: fix weekly job https://review.opendev.org/c/openstack/networking-sfc/+/839314 | 17:00 |
| opendevreview | Merged openstack/networking-bgpvpn master: CI: fix weekly job https://review.opendev.org/c/openstack/networking-bgpvpn/+/839313 | 17:22 |
| opendevreview | Merged openstack/neutron stable/yoga: [FT] Run all .*MySQL tests in an isolated thread https://review.opendev.org/c/openstack/neutron/+/839189 | 19:57 |
| opendevreview | Jakub Libosvar proposed openstack/neutron stable/yoga: [ovn][migration] Support migration to OVN from iptables firewall https://review.opendev.org/c/openstack/neutron/+/839341 | 20:27 |
| opendevreview | Jakub Libosvar proposed openstack/neutron stable/xena: [ovn][migration] Support migration to OVN from iptables firewall https://review.opendev.org/c/openstack/neutron/+/839342 | 20:27 |
| opendevreview | Jakub Libosvar proposed openstack/neutron stable/wallaby: [ovn][migration] Support migration to OVN from iptables firewall https://review.opendev.org/c/openstack/neutron/+/839343 | 20:27 |
| opendevreview | Merged openstack/neutron stable/victoria: Fix setting table monitoring conditions https://review.opendev.org/c/openstack/neutron/+/838883 | 20:36 |
| opendevreview | Merged openstack/neutron stable/xena: [DHCP] Break reference chain to any Exception object when resync https://review.opendev.org/c/openstack/neutron/+/838897 | 20:37 |
| opendevreview | Merged openstack/neutron stable/wallaby: [DHCP] Break reference chain to any Exception object when resync https://review.opendev.org/c/openstack/neutron/+/838896 | 20:37 |
| opendevreview | Merged openstack/neutron stable/victoria: [DHCP] Break reference chain to any Exception object when resync https://review.opendev.org/c/openstack/neutron/+/838898 | 20:37 |
| opendevreview | Merged openstack/neutron stable/ussuri: [DHCP] Break reference chain to any Exception object when resync https://review.opendev.org/c/openstack/neutron/+/838899 | 20:37 |
| opendevreview | Merged openstack/neutron stable/train: [DHCP] Break reference chain to any Exception object when resync https://review.opendev.org/c/openstack/neutron/+/838901 | 20:37 |
| *** dasm is now known as dasm|off | 21:40 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!