| opendevreview | Yi Yang proposed openstack/neutron master: Set network namespace and tap interface type in case of OVS DPDK https://review.opendev.org/c/openstack/neutron/+/818338 | 01:34 |
|---|---|---|
| opendevreview | Yi Yang proposed openstack/neutron master: Set network namespace and tap interface type in case of OVS DPDK https://review.opendev.org/c/openstack/neutron/+/818338 | 01:35 |
| opendevreview | Ghanshyam proposed openstack/neutron master: DNM: test tempest train-last tag https://review.opendev.org/c/openstack/neutron/+/818844 | 01:41 |
| opendevreview | Terry Wilson proposed openstack/neutron master: WIP Use neutron db for ovn agents https://review.opendev.org/c/openstack/neutron/+/818850 | 03:58 |
| opendevreview | Bernard Cafarelli proposed openstack/networking-ovn stable/train: Fix race condition retrieving logical router rows https://review.opendev.org/c/openstack/networking-ovn/+/810820 | 08:14 |
| opendevreview | yangjianfeng proposed openstack/neutron master: Improve Router callback system's publish events https://review.opendev.org/c/openstack/neutron/+/804846 | 08:28 |
| opendevreview | yangjianfeng proposed openstack/neutron master: [Server Side] L3 router support ndp proxy https://review.opendev.org/c/openstack/neutron/+/743142 | 08:28 |
| opendevreview | Oleg Bondarev proposed openstack/neutron master: Allow to use static Local IP openflow rules https://review.opendev.org/c/openstack/neutron/+/817399 | 08:50 |
| opendevreview | Oleg Bondarev proposed openstack/neutron master: Allow to use static Local IP openflow rules https://review.opendev.org/c/openstack/neutron/+/817399 | 08:51 |
| *** ykarel is now known as ykarel|lunch | 09:21 | |
| opendevreview | Slawek Kaplonski proposed openstack/neutron-tempest-plugin master: Remove ussuri jobs from the project's CI queues https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/818688 | 10:03 |
| *** blmt is now known as Guest6597 | 10:08 | |
| opendevreview | Slawek Kaplonski proposed openstack/neutron master: [Fullstack] Don't install OVN in the fullstack job https://review.opendev.org/c/openstack/neutron/+/818877 | 10:38 |
| opendevreview | Oleg Bondarev proposed openstack/neutron master: Add Local IP policy rules https://review.opendev.org/c/openstack/neutron/+/816435 | 11:36 |
| opendevreview | Oleg Bondarev proposed openstack/neutron master: Add Local IP fullstack test case https://review.opendev.org/c/openstack/neutron/+/816327 | 11:36 |
| opendevreview | Przemyslaw Szczerbik proposed openstack/neutron master: Update placement allocation of bound ports when network QoS policy is changed https://review.opendev.org/c/openstack/neutron/+/818889 | 12:02 |
| *** ykarel|lunch is now known as ykarel | 12:05 | |
| opendevreview | Merged openstack/neutron stable/xena: [ovn] Add timeout option to ovsdb-client command https://review.opendev.org/c/openstack/neutron/+/818796 | 12:15 |
| opendevreview | yatin proposed openstack/neutron master: Fix tunnel_types in ml2 ovs sample config https://review.opendev.org/c/openstack/neutron/+/818911 | 12:40 |
| *** ykarel is now known as ykarel|afk | 12:41 | |
| opendevreview | Oleg Bondarev proposed openstack/neutron master: Add Local IP fullstack test cases https://review.opendev.org/c/openstack/neutron/+/816327 | 13:14 |
| opendevreview | Merged openstack/neutron stable/victoria: [ovn] Add timeout option to ovsdb-client command https://review.opendev.org/c/openstack/neutron/+/818800 | 13:14 |
| opendevreview | Przemyslaw Szczerbik proposed openstack/neutron-tempest-plugin master: QoS min pps API tests https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/806689 | 13:22 |
| opendevreview | Przemyslaw Szczerbik proposed openstack/neutron-tempest-plugin master: Fix test_port_resource_request_inherited_policy test https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/817356 | 13:22 |
| opendevreview | Przemyslaw Szczerbik proposed openstack/neutron-tempest-plugin master: Update PortTestCasesResourceRequest for new Neutron API ext https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/817357 | 13:22 |
| opendevreview | Przemyslaw Szczerbik proposed openstack/neutron-tempest-plugin master: Test port.resource_request format with min bw and min pps rules https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/817358 | 13:22 |
| opendevreview | Rodolfo Alonso proposed openstack/neutron stable/wallaby: [OVN] External network ports (SR-IOV) QoS is handled by SR-IOV agent https://review.opendev.org/c/openstack/neutron/+/818922 | 13:56 |
| lajoskatona | #startmeeting networking | 14:00 |
| opendevmeet | Meeting started Tue Nov 23 14:00:17 2021 UTC and is due to finish in 60 minutes. The chair is lajoskatona. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
| opendevmeet | The meeting name has been set to 'networking' | 14:00 |
| mlavalle | o/ | 14:00 |
| lajoskatona | Hi everybody! | 14:00 |
| slaweq | hi | 14:00 |
| obondarev | hi | 14:00 |
| rubasov | o/ | 14:00 |
| bcafarel | o/ | 14:01 |
| lajoskatona | ok, let's start | 14:02 |
| ralonsoh | hi | 14:02 |
| lajoskatona | #topic Announcements | 14:02 |
| *** ykarel|afk is now known as ykarel | 14:02 | |
| lajoskatona | First the meeting times: it seems that the best would be to keep all meetings untouched so keep the current time slots | 14:03 |
| lajoskatona | Team meeting :Tuesday 1400UTC | 14:03 |
| lajoskatona | CI meeting Tuesday 1500TC | 14:03 |
| mlavalle | +1 Good for me | 14:03 |
| lajoskatona | Drivers meeting Friday 1400UTC | 14:03 |
| lajoskatona | good :-) | 14:04 |
| lajoskatona | If you have any comments please answer to the mails I sent today. | 14:04 |
| slaweq | so all stays like it was | 14:06 |
| slaweq | :) | 14:06 |
| slaweq | good for me | 14:06 |
| lajoskatona | It would be good to have more people from "the east" India, central asia, east asia, but hard to find good timeslot | 14:06 |
| bcafarel | no need to update my calendar, good for lazy me | 14:06 |
| obondarev | :) | 14:06 |
| lajoskatona | Nova as I know experienced with a special east asian meeting slot or more an "office-hour" but not much success | 14:06 |
| lajoskatona | bcafarel: yeah true :-) | 14:07 |
| slaweq | in neutron we had in the past 2 different time slots for the meetings which were biweekly | 14:07 |
| liuyulong | Nothing changed, good to know, p.s. 1400 UTC is 10 p.m. in Beijing. Many times, I had already go to bed. | 14:07 |
| slaweq | but we changed that as there was not a lot of people attending one of them | 14:07 |
| lajoskatona | Yeah I remember, was that more visited? | 14:07 |
| lajoskatona | liuyulong: Hi, I totally understand that | 14:08 |
| slaweq | lajoskatona: I remember that on the meeting which was around midnight my time there was maybe 2 or 3 people | 14:08 |
| slaweq | so I changed that finally to have it always on Tuesday | 14:08 |
| lajoskatona | slaweq: ok | 14:08 |
| lajoskatona | yeah that was too late for me, and if I had no special topic for it I just skipped as I remember :-) | 14:09 |
| lajoskatona | ok, I think we can jump to the next point | 14:10 |
| lajoskatona | Yoga cycle calendar https://releases.openstack.org/yoga/schedule.html | 14:10 |
| lajoskatona | the Yoga-1 release patches are out (i.e.: https://review.opendev.org/c/openstack/releases/+/818428 or https://review.opendev.org/c/openstack/releases/+/818417 ) | 14:11 |
| liuyulong | Too many running OpenStack clouds need me to take care in daytime. So, I have to go bed earlier to recover. : ) | 14:11 |
| lajoskatona | Last week the ussuri branch was transitioned to em: https://review.opendev.org/c/openstack/releases/+/817605 | 14:12 |
| lajoskatona | and networking-midonet: transition pike, queens and rocky to eol | 14:13 |
| lajoskatona | There was a mail for testing runtime: http://lists.openstack.org/pipermail/openstack-discuss/2021-November/025881.html | 14:14 |
| lajoskatona | TC decided to remove py36 from jobs and as py39 voting everywhere | 14:14 |
| lajoskatona | as I saw we have no problem with py39, do you know something to focus on regarding py39 jobs? | 14:15 |
| slaweq | I think it should be ok | 14:15 |
| lajoskatona | slaweq: ok | 14:15 |
| slaweq | according to https://grafana.opendev.org/d/BmiopeEMz/neutron-failure-rate? viewPanel=22&orgId=1&from=now-30d&to=now it seems that now it's following other ut jobs | 14:16 |
| slaweq | but about 1-2 weeks ago it was failing much more often than e.g. py36 or 38 | 14:16 |
| slaweq | so we will need to keep an eye on it | 14:16 |
| ralonsoh | (dut to timeouts, seems that py39 takes more time) | 14:16 |
| slaweq | ralonsoh: can be | 14:17 |
| lajoskatona | so grfana dashbourd should be updated perhaps to have py39 on it? I see only py38 | 14:18 |
| slaweq | lajoskatona: there is openstack-tox-py39 there | 14:19 |
| slaweq | as non-voting job | 14:19 |
| slaweq | so we will only need to update it to be "voting" | 14:20 |
| slaweq | and add to the gate queue graph | 14:20 |
| lajoskatona | slaweq: ok I see now, the board half loaded for me it seems for first.... | 14:20 |
| lajoskatona | ok, if no comments/questions for announcements, we can go to next topic | 14:21 |
| lajoskatona | #topic Bugs | 14:21 |
| bcafarel | yep py39 looks in line with other UT jobs in recent days | 14:21 |
| lajoskatona | hongbin was bug deputy last week: http://lists.openstack.org/pipermail/openstack-discuss/2021-November/025895.html | 14:21 |
| * frickler has been busy filing bugs with OVN+DNS | 14:22 | |
| lajoskatona | I checked and the found few without owner: | 14:22 |
| lajoskatona | #link https://bugs.launchpad.net/neutron/+bug/1951010 Restarting Neutron floods Nova with segment aggregates calls | 14:22 |
| lajoskatona | frickler: thanks for filing those | 14:23 |
| lajoskatona | I think this is one of those: #link https://bugs.launchpad.net/neutron/+bug/1951074 [OVN] default setting leak nameserver config from the host to instances | 14:24 |
| lajoskatona | Do you have perhaps comments or notes for the bug report? | 14:25 |
| frickler | I think it's all written there, I open to any questions as always | 14:26 |
| lajoskatona | ok | 14:26 |
| frickler | this search has all others, too | 14:27 |
| frickler | https://bugs.launchpad.net/neutron/+bugs?field.searchtext=&orderby=-importance&field.status%3Alist=NEW&field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.status%3Alist=FIXCOMMITTED&field.status%3Alist=INCOMPLETE_WITH_RESPONSE&field.status%3Alist=INCOMPLETE_WITHOUT_RESPONSE&assignee_option=any&field.assignee=&field.bug_reporter=&field.bug_commenter=&fi | 14:27 |
| frickler | eld.subscriber=&field.structural_subscriber=&field.tag=ovn+dns&field.tags_combinator=ALL&field.has_cve.used=&field.omit_dupes.used=&field.omit_dupes=on&field.affects_me.used=&field.has_patch.used=&field.has_branches.used=&field.has_branches=on&field.has_no_branches.used=&field.has_no_branches=on&field.has_blueprints.used=&field.has_blueprints=on&field.has_no_blueprints.used=&field.has_no_bluepr | 14:27 |
| mlavalle | lajoskatona: I can take a look at "Restarting Neutron floods Nova with segment aggregates calls" | 14:27 |
| frickler | ints=on&search=Search | 14:27 |
| lajoskatona | mlavalle thanks | 14:27 |
| frickler | oops, that's a long lp link. essentially look for tags "ovn"+"dns" | 14:27 |
| frickler | #link https://bugs.launchpad.net/neutron/+bugs?field.tag=ovn+dns&field.tags_combinator=ALL | 14:29 |
| lajoskatona | frickler: thanks, thats much more friendly :-) | 14:31 |
| frickler | I'm really thinking having a flag to disable all this DNS spoofing and just using dhcp-agent for that would be great | 14:31 |
| lajoskatona | For this week haleyb changed with ralonsoh to be deputy I think, at least I have seen something on irc | 14:32 |
| ralonsoh | yes | 14:32 |
| haleyb | yes, i'm out after today, thanks ralonsoh | 14:32 |
| lajoskatona | frickler: I think that was mentioned earlier as workaround, so perhaps it should be documented somewhere | 14:32 |
| lajoskatona | haleyb, ralonsoh: thanks I will update the table on the meetings wiki page | 14:33 |
| frickler | lajoskatona: I'm currently testing running with dhcp-agent, but I haven't found out how to disable the OVN spoofing part | 14:33 |
| lajoskatona | Next week I will be the deputy | 14:33 |
| lajoskatona | ok I think if there's no more comments for bugs we can jump | 14:35 |
| lajoskatona | #topic L3 subteam | 14:35 |
| lajoskatona | #link https://wiki.openstack.org/wiki/Network/Meetings#L3_subteam | 14:35 |
| lajoskatona | liuyulong: if you are still with us, do you have anything related to L3? | 14:36 |
| liuyulong | one topic | 14:36 |
| liuyulong | #link https://review.opendev.org/c/openstack/neutron-specs/+/770540 | 14:36 |
| liuyulong | What do you guys think about this spec of "elastic snat"? | 14:36 |
| liuyulong | Should we move forward? | 14:37 |
| lajoskatona | liuyulong: from my side the idea is really good and as I see the review moved to fix small things in the spec | 14:37 |
| lajoskatona | I plan to go back and check the last ps | 14:38 |
| liuyulong | It has been 9 month for this spec. Pretty slow in progress. : ) | 14:39 |
| lajoskatona | that's true | 14:40 |
| slaweq | I will review it again | 14:40 |
| liuyulong | Good, thank you guys. | 14:41 |
| liuyulong | New features are always weclomed for cloud users. : ) This is also one of the sign of the activity of the community. | 14:42 |
| mlavalle | I will review it also | 14:42 |
| lajoskatona | thanks you very much for the update and headsup | 14:43 |
| liuyulong | Something in short, port forwarding is the DNAT work, while this is SNAT. | 14:44 |
| liuyulong | The two features have some similarities. | 14:44 |
| liuyulong | OK, no more from me, please move on. | 14:46 |
| lajoskatona | liuyulong: thanks | 14:46 |
| lajoskatona | #topic ryu and os-ken | 14:46 |
| ralonsoh | No updates in Ryu repo, still following the open bugs in this project. | 14:46 |
| lajoskatona | there was no new change so we have nothing to do with os-ken | 14:46 |
| lajoskatona | ralonsoh: thanks for following it | 14:47 |
| lajoskatona | #topic On Demand Agenda | 14:47 |
| ralonsoh | I have one | 14:47 |
| ralonsoh | https://review.opendev.org/c/openstack/neutron/+/818399 | 14:47 |
| ralonsoh | I don't want to hijack this meeting | 14:47 |
| ralonsoh | so I would like your comments in the review | 14:48 |
| ralonsoh | those are the current options | 14:48 |
| ralonsoh | 1) add a config knob (config driven API) | 14:48 |
| ralonsoh | 2) use the upgrade check to emit a warning --> admin will need to change needed policies | 14:48 |
| ralonsoh | 3) something else | 14:48 |
| * mlavalle added the patch to reviews pile | 14:48 | |
| slaweq | I already commented there and I'm for option 2 personally | 14:49 |
| liuyulong | I guess you had read my last comment, from my actual cloud operation experience, it's better to let the cloud admins know things explicitly. | 14:50 |
| slaweq | liuyulong: not yet | 14:50 |
| opendevreview | mitya-eremeev-2 proposed openstack/neutron-tempest-plugin master: Set SG quota for specific project. https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/818933 | 14:50 |
| slaweq | but ralonsoh's option 2 gives such possibility, only not with config knob | 14:50 |
| ralonsoh | they'll have this option when executing the upgrade check | 14:51 |
| slaweq | admin can configure qos policy for ports from external network and then remove policy from the network itself | 14:51 |
| liuyulong | alright, maybe we can continue the disscussion in the gerrit. | 14:51 |
| ralonsoh | they'll have the information about (1) the external networks affected, (2) the FIPs and (3) the fixed ports in those networks | 14:51 |
| ralonsoh | sure | 14:51 |
| slaweq | thus nothing will really change and behaviour will be finally consistent with what is now for ports | 14:51 |
| slaweq | I don't think that config option for that will help | 14:52 |
| slaweq | this would be config driven api behaviour which IMO we shouldn't do | 14:52 |
| lajoskatona | It is open for me as well , I will check the discussion under the review | 14:52 |
| ralonsoh | thank you all | 14:53 |
| slaweq | and if we will keep it by default as it was until now, nobody will notice that really | 14:53 |
| slaweq | so everyone will still probably use it in old way | 14:53 |
| mlavalle | good point | 14:53 |
| liuyulong | maybe a add floating_qos_polidy_id to external network for the floating IPs to inherit, to save the tons of API for existing ports. | 14:55 |
| slaweq | IMO that will not be good ux to have yet another qos policy parameter to set | 14:56 |
| ralonsoh | that will fragment the API unnecessarily | 14:56 |
| liuyulong | Then you mixed L2 qos to L3 IPs. | 14:56 |
| slaweq | I think we should keep that API as consistent as possible | 14:56 |
| ralonsoh | lajoskatona, as is new | 14:56 |
| ralonsoh | as is now* | 14:56 |
| slaweq | in fact I think that this is kind of bug that it now works differently for FIPS only | 14:56 |
| lajoskatona | yeah I think the good way to have similar behaviour for ports networks and fips, gw port etc... | 14:58 |
| lajoskatona | ok, time is up, so I think we have to move this discussion back to gerrit :-) | 14:59 |
| mlavalle | I have a personal announcement to make. I am leaving my position with Yahoo, to join bcafarel's team at Red Hat, starting this coming Monday. From the community Neutron project point of view, it means I'll continue working with y'all | 14:59 |
| ralonsoh | welcome! | 14:59 |
| bcafarel | yay :) | 14:59 |
| liuyulong | floating_ip_qos_policy_id to external network can solve the problems with varity cloud settings. | 14:59 |
| lajoskatona | mlavalle: good luck:-) | 14:59 |
| lajoskatona | mlavalle: you move to France? :P | 15:00 |
| liuyulong | congras! | 15:00 |
| lajoskatona | #endmeeting | 15:00 |
| opendevmeet | Meeting ended Tue Nov 23 15:00:21 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:00 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/networking/2021/networking.2021-11-23-14.00.html | 15:00 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/networking/2021/networking.2021-11-23-14.00.txt | 15:00 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/networking/2021/networking.2021-11-23-14.00.log.html | 15:00 |
| mlavalle | Thanks! | 15:00 |
| lajoskatona | Bye | 15:00 |
| slaweq | \o/ | 15:00 |
| slaweq | and by :) | 15:00 |
| slaweq | #startmeeting neutron_ci | 15:01 |
| opendevmeet | Meeting started Tue Nov 23 15:01:05 2021 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:01 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:01 |
| opendevmeet | The meeting name has been set to 'neutron_ci' | 15:01 |
| ralonsoh | hi | 15:01 |
| slaweq | and welcome again :D | 15:01 |
| slaweq | Grafana dashboard: http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 15:01 |
| obondarev | hi | 15:02 |
| lajoskatona | Hi | 15:02 |
| slaweq | ok, lets start | 15:02 |
| slaweq | #topic Actions from previous meetings | 15:03 |
| slaweq | lajoskatona to check why make FIP down took more than 120 seconds in the L3 agent | 15:03 |
| slaweq | it was from two weeks but lajoskatona wasn't there last week | 15:03 |
| slaweq | :) | 15:03 |
| lajoskatona | I havent worked on it last week, sorry.... | 15:03 |
| bcafarel | o/ again | 15:03 |
| lajoskatona | The logs are open, but havent diged in them.... | 15:04 |
| ykarel | o/ | 15:04 |
| slaweq | hi ykarel :) | 15:04 |
| obondarev | does it still happen in the gates? | 15:04 |
| slaweq | lajoskatona: ok, so should I assign it to You this week? | 15:05 |
| slaweq | obondarev: yes, I saw it last week once: https://08d14f4ddffb82b199e7-61a732188f1643f755755f84f6310584.ssl.cf1.rackcdn.com/817525/7/check/neutron-tempest-plugin-scenario-linuxbridge/e4b6cfb/testr_results.html | 15:05 |
| lajoskatona | yes, I have to check it to close those tabs in the browser fially ;) | 15:05 |
| slaweq | #action lajoskatona to check why make FIP down took more than 120 seconds in the L3 agent | 15:05 |
| obondarev | slaweq: ack | 15:05 |
| lajoskatona | slaweq: thanks | 15:05 |
| slaweq | ok, next one | 15:06 |
| slaweq | slaweq to remove ussuri jobs from neutron-tempest-plugin queues | 15:06 |
| slaweq | Patch https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/818688 | 15:06 |
| slaweq | And it requires https://review.opendev.org/c/openstack/releases/+/818687 | 15:06 |
| slaweq | please review them when You will have few minutes | 15:07 |
| slaweq | next one | 15:07 |
| slaweq | slaweq to open LP for issue with neutron.tests.functional.plugins.ml2.drivers.ovn.mech_driver.ovsdb.test_ovsdb_monitor.TestAgentMonitor.test_network_agent_present | 15:07 |
| slaweq | Done: https://bugs.launchpad.net/neutron/+bug/1951225 | 15:07 |
| ralonsoh | BTW, we are currently working (again) on a refactor of the OVN agent code | 15:07 |
| slaweq | jlibosva is already taking care of it | 15:07 |
| ralonsoh | that could affect to this test | 15:07 |
| ralonsoh | so I'll ping him then | 15:08 |
| slaweq | I saw it couple of times this week again | 15:08 |
| obondarev | +1 | 15:08 |
| slaweq | next one | 15:08 |
| slaweq | slaweq to check failed neutron.tests.functional.agent.l3.test_keepalived_state_change.TestMonitorDaemon.test_handle_initial_state_backup | 15:08 |
| slaweq | I didn't had time (still) | 15:08 |
| slaweq | I will try to check it this week | 15:09 |
| slaweq | #action slaweq to check failed neutron.tests.functional.agent.l3.test_keepalived_state_change.TestMonitorDaemon.test_handle_initial_state_backup | 15:09 |
| slaweq | and last one | 15:09 |
| slaweq | slaweq to send email about rechecks numbers to the ML | 15:09 |
| slaweq | I did http://lists.openstack.org/pipermail/openstack-discuss/2021-November/025813.html | 15:09 |
| slaweq | and there is good feedback there | 15:09 |
| slaweq | I will collect all of that for next week's meeting and we can discuss all ideas during the meeting next week | 15:09 |
| ralonsoh | slaweq++ | 15:10 |
| slaweq | #topic Stable branches | 15:10 |
| slaweq | bcafarel: any updates? | 15:10 |
| lajoskatona | the release team is now busy with yoga-1 I suppose so perhaps the release patch will be slow to land, I will ping them to be sure | 15:10 |
| bcafarel | overall quite good this week | 15:11 |
| lajoskatona | sorry this is for the tempest-plugin stuff | 15:11 |
| slaweq | lajoskatona: thx | 15:11 |
| bcafarel | with https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/817933 merged (thanks slaweq) for older branches | 15:11 |
| slaweq | good to hear that | 15:11 |
| bcafarel | for rocky we may need to update a bit the filtered out tests https://review.opendev.org/c/openstack/neutron/+/808502 has a lot of rechecks | 15:11 |
| slaweq | yeah, I saw it | 15:11 |
| bcafarel | but >=stein are quite good, and queens too so only one branch :) | 15:12 |
| lajoskatona | by the way I have this stein patch for odl: https://review.opendev.org/c/openstack/networking-odl/+/818384 | 15:12 |
| slaweq | it's for rocky, not stein :) | 15:13 |
| slaweq | I think stein was merged recently, no? | 15:13 |
| lajoskatona | oh really the stein one is merged.... | 15:13 |
| slaweq | I will review that one tomorrow | 15:14 |
| lajoskatona | thanks | 15:14 |
| slaweq | so if that's all for stable branches, we can move on to the next topic | 15:14 |
| slaweq | #topic Stadium projects | 15:14 |
| lajoskatona | no news from them | 15:15 |
| slaweq | ok, lets move on | 15:16 |
| slaweq | #topic Grafana | 15:16 |
| slaweq | from good news - scenario jobs are suprisely good recently :) | 15:17 |
| slaweq | but there is bad news also: | 15:17 |
| slaweq | it seems that functional tests are failing often again | 15:17 |
| slaweq | and UT are also on high failure rate last few days | 15:18 |
| ralonsoh | that could be due to failed patches | 15:19 |
| obondarev | I also didn't see failed UT unrelated to the patch recently | 15:19 |
| slaweq | ralonsoh: yes, when I was checking specific patches from last week I noticed that | 15:19 |
| slaweq | there was a lot of patches with broken UT really because of the patch | 15:19 |
| slaweq | so I think we just need to keep an eye on it for next days | 15:19 |
| slaweq | but I also noticed few times timeout in the lower-constraints job, like: | 15:20 |
| slaweq | https://zuul.opendev.org/t/openstack/build/93fa264c3b0e482590369e8b31fa7546/logs | 15:20 |
| slaweq | https://zuul.opendev.org/t/openstack/build/b73ff16dc4ec4606a3244ee36f699b43/logs | 15:20 |
| slaweq | https://zuul.opendev.org/t/openstack/build/bba203de96d54d95be30b7309a902a38 | 15:20 |
| lajoskatona | the l-c job timout was not increased last time? | 15:21 |
| ralonsoh | I don't think so | 15:21 |
| lajoskatona | ok | 15:21 |
| slaweq | so maybe we should increase it too? | 15:21 |
| slaweq | as for other jobs? | 15:21 |
| ralonsoh | yes | 15:22 |
| lajoskatona | yes | 15:22 |
| lajoskatona | I can push it for review | 15:22 |
| obondarev | it should be connected to UT timeout + some gap for coverage stuff | 15:22 |
| lajoskatona | obondarev: +1 | 15:22 |
| obondarev | as far as I understand | 15:22 |
| ralonsoh | right | 15:23 |
| opendevreview | Terry Wilson proposed openstack/neutron master: WIP Use neutron db for ovn agents https://review.opendev.org/c/openstack/neutron/+/818850 | 15:23 |
| slaweq | thx | 15:24 |
| slaweq | #action lajoskatona to increase timeout of the lower-constraints job in neutron | 15:24 |
| slaweq | ok, lets move on | 15:25 |
| slaweq | #topic fullstack/functional | 15:25 |
| slaweq | in functional tests I saw mostly issues with those ovn agent tests | 15:25 |
| slaweq | ralonsoh: maybe we should mark those tests as unstable temporary until jlibosva will fix it? | 15:25 |
| slaweq | wdyt? | 15:25 |
| ralonsoh | ok | 15:26 |
| slaweq | ok, can You propose patch for that? | 15:26 |
| ralonsoh | suer | 15:26 |
| ralonsoh | sure | 15:26 |
| slaweq | thx a lot | 15:26 |
| jlibosva | is it reproducible well in the gate? I ran functional tests several times locally and didn't hit it even single time | 15:26 |
| slaweq | jlibosva: maybe not "well" but it happens pretty often I would say | 15:26 |
| slaweq | like e.g.: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_db9/816856/6/check/neutron-functional-with-uwsgi/db9ba2c/testr_results.html | 15:27 |
| slaweq | probably You can find other similar examples | 15:27 |
| ralonsoh | I'll do | 15:27 |
| slaweq | thx ralonsoh | 15:27 |
| obondarev | another: https://2636029923414340a2c8-da9bd67ce2281bb41bf3df3e007407f6.ssl.cf1.rackcdn.com/818067/2/check/neutron-functional-with-uwsgi/d20e295/testr_results.html | 15:29 |
| ralonsoh | in any case, I'll wait to the OVN agent refactor | 15:29 |
| opendevreview | yatin proposed openstack/neutron master: Fix tunnel_types in ml2 ovs sample config https://review.opendev.org/c/openstack/neutron/+/818911 | 15:29 |
| slaweq | thx obondarev | 15:29 |
| slaweq | and that's basically only issue which I saw that was repeating last week in the functional job | 15:30 |
| slaweq | regading fullstack, I proposed small improvement today https://review.opendev.org/c/openstack/neutron/+/818877 | 15:30 |
| slaweq | please check when You will have time | 15:30 |
| jlibosva | it looks like the problem there is that OVN event gets processed before mech driver initialization is completed - which the agent refactor will fix only for the agent but will not fix the root cause of it | 15:30 |
| obondarev | not sure it it's the same: https://7bed286b1abc124aef60-716c2febf7f730d66787c22f3ed0da3e.ssl.cf5.rackcdn.com/818067/2/check/neutron-functional-with-uwsgi/48adb0f/testr_results.html | 15:31 |
| obondarev | seems some other issue | 15:31 |
| jlibosva | obondarev: that looks like max_tunid is missing in NB_Global table when creating network - | 15:32 |
| jlibosva | https://7bed286b1abc124aef60-716c2febf7f730d66787c22f3ed0da3e.ssl.cf5.rackcdn.com/818067/2/check/neutron-functional-with-uwsgi/48adb0f/controller/logs/dsvm-functional-logs/neutron.tests.functional.plugins.ml2.drivers.ovn.mech_driver.test_mech_driver.TestProvnetPorts.test_network_segments_localnet_ports/testrun.txt | 15:32 |
| slaweq | obondarev: isn't that related to https://bugs.launchpad.net/neutron/+bug/1903008 ? | 15:33 |
| slaweq | or maybe it's something new | 15:34 |
| obondarev | slaweq: not sure, sorry | 15:34 |
| slaweq | it seems that the stacktrace is different there | 15:36 |
| slaweq | I will check it | 15:36 |
| slaweq | #action slaweq to check https://7bed286b1abc124aef60-716c2febf7f730d66787c22f3ed0da3e.ssl.cf5.rackcdn.com/818067/2/check/neutron-functional-with-uwsgi/48adb0f/testr_results.html | 15:36 |
| slaweq | ok, I think we can move on to the next topics now | 15:38 |
| slaweq | #topic Tempest/Scenario | 15:38 |
| slaweq | here, I found 2 or 3 times same test failing neutron_tempest_plugin.scenario.test_mac_learning.MacLearningTest in the ovn scenario job | 15:38 |
| slaweq | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_b75/815962/5/check/neutron-tempest-plugin-scenario-ovn/b75474f/testr_results.html | 15:38 |
| slaweq | https://b30211aa4f809fc4a91b-baf4f807d40559415da582760ebf9456.ssl.cf2.rackcdn.com/817525/7/check/neutron-tempest-plugin-scenario-ovn/c356679/testr_results.html | 15:38 |
| slaweq | I think we should investigate why in that test ssh is not working from time to time | 15:39 |
| slaweq | maybe it's coincidence, idk really | 15:39 |
| slaweq | anyone want's to investigate that? | 15:39 |
| slaweq | ok, if I will have time, I will try to check it | 15:41 |
| slaweq | if not, let's wait for next week :) | 15:41 |
| slaweq | I will also report LP for that | 15:41 |
| slaweq | #action slaweq to report bug about failing neutron_tempest_plugin.scenario.test_mac_learning.MacLearningTest | 15:41 |
| slaweq | and that's all what I had prepared for You for today | 15:41 |
| slaweq | we have one on demand topic | 15:42 |
| slaweq | #topic On Demand | 15:42 |
| slaweq | lajoskatona: move on with what You wanted to discuss | 15:42 |
| lajoskatona | it's about gate load | 15:42 |
| lajoskatona | history: beginning of this year a list was sent with data that Neutron is one of the biggest user of gate resources, and I asked clarkb if we can repeat the execution | 15:44 |
| lajoskatona | https://paste.opendev.org/show/bYTlHXfbX84aESK6cLMM/ | 15:44 |
| ralonsoh | (I feel myself guilty looking at those figures) | 15:45 |
| lajoskatona | the issue is that due to some zuul changes this is for only one executor so we have to have some other way to have real data for project's resource usage | 15:45 |
| slaweq | but it's clear for me that neutron is still in the very top of that list :/ | 15:45 |
| lajoskatona | In theory everything is availabel on https://graphite.opendev.org/ | 15:45 |
| lajoskatona | yeah with clarkb we checked on graphite and the results from there correlate with the paste | 15:46 |
| obondarev | and that's why we started this 'rechecks' brainstorm, right? | 15:47 |
| lajoskatona | the suggestion is to create a grafana dashboard, which I started: https://review.opendev.org/c/openstack/project-config/+/818230 | 15:47 |
| lajoskatona | the issue with it is mostly my lack of grfana background :-) | 15:47 |
| slaweq | I can't help with that :) | 15:48 |
| slaweq | sorry | 15:48 |
| lajoskatona | I suppose if we have fresh data from this we could better act to things like we have a lot of rechecks, and more jobs than other projects | 15:49 |
| obondarev | +1 | 15:49 |
| obondarev | and to track out progress with improving those numbers | 15:50 |
| obondarev | our* | 15:50 |
| slaweq | +! | 15:50 |
| slaweq | +1 | 15:50 |
| slaweq | :) | 15:50 |
| ralonsoh | yes, good idea | 15:50 |
| slaweq | thx for taking care of it lajoskatona | 15:50 |
| ralonsoh | and waiting for slaweq's summery | 15:50 |
| lajoskatona | ok, I will ask around to improve this dashboard and we can check that regularly | 15:50 |
| slaweq | ++ | 15:51 |
| opendevreview | Terry Wilson proposed openstack/neutron master: WIP Use neutron db for ovn agents https://review.opendev.org/c/openstack/neutron/+/818850 | 15:51 |
| lajoskatona | yeah I will answer for that mail too :-) | 15:51 |
| slaweq | ok, I think we are good with that topic for now | 15:52 |
| slaweq | anything else You want to discuss today? | 15:52 |
| lajoskatona | nothing from me | 15:52 |
| ralonsoh | nothing, thanks | 15:52 |
| bcafarel | all good too | 15:53 |
| slaweq | if not, we can finish the meeting I guess :) | 15:53 |
| slaweq | thx for attending the meeting today | 15:53 |
| slaweq | and have a great week | 15:53 |
| obondarev | bye everyone! | 15:53 |
| slaweq | #endmeeting | 15:53 |
| opendevmeet | Meeting ended Tue Nov 23 15:53:29 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:53 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/neutron_ci/2021/neutron_ci.2021-11-23-15.01.html | 15:53 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/neutron_ci/2021/neutron_ci.2021-11-23-15.01.txt | 15:53 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/neutron_ci/2021/neutron_ci.2021-11-23-15.01.log.html | 15:53 |
| lajoskatona | o/ | 15:53 |
| ralonsoh | bye | 15:53 |
| ykarel | slaweq, https://etherpad.opendev.org/p/neutron-ci-meetings is the etherpad for this meeting, right? | 15:53 |
| slaweq | ykarel: yes, that's agenda for that meeting | 15:54 |
| ykarel | okk there i see place: #openstack-meeting-3, should be updated | 15:54 |
| ykarel | earlier i joined in that channel | 15:54 |
| slaweq | ykarel: thx, good catch | 15:55 |
| slaweq | I forgot to update it :) | 15:55 |
| ykarel | np :) | 15:55 |
| *** ykarel is now known as ykarel|away | 15:55 | |
| opendevreview | Merged openstack/neutron stable/wallaby: [ovn] Add timeout option to ovsdb-client command https://review.opendev.org/c/openstack/neutron/+/818799 | 15:56 |
| opendevreview | Oleg Bondarev proposed openstack/neutron master: Add Local IP fullstack test cases https://review.opendev.org/c/openstack/neutron/+/816327 | 15:56 |
| opendevreview | Rodolfo Alonso proposed openstack/neutron master: Replace "target_tenant" with "target_project" in RBAC OVOs and models https://review.opendev.org/c/openstack/neutron/+/815855 | 16:11 |
| opendevreview | Terry Wilson proposed openstack/neutron master: WIP Use neutron db for ovn agents https://review.opendev.org/c/openstack/neutron/+/818850 | 16:21 |
| opendevreview | Rodolfo Alonso proposed openstack/neutron master: [OVN] Check new added segments in OVN mech driver https://review.opendev.org/c/openstack/neutron/+/816856 | 16:21 |
| opendevreview | Elvira García Ruiz proposed openstack/networking-ovn stable/train: Enhanced set of warnings if an answers file or a templates directory is used. https://review.opendev.org/c/openstack/networking-ovn/+/818985 | 16:27 |
| prometheanfire | should the job timeout be increased on wallaby too? https://review.opendev.org/818729 | 16:53 |
| erlon | ralonsoh, hey | 17:45 |
| erlon | so, I'm still trying to get the OVN FIP to work, there's not L3 agent to set the extensions for OVN right? | 17:46 |
| erlon | so, where do you set it? | 17:46 |
| ralonsoh | erlon, no, there is no agent. But you need to define the qos-fip extension | 17:47 |
| erlon | ralonsoh: where? on neutron.conf? | 17:47 |
| ralonsoh | not extension, plugin | 17:47 |
| erlon | it seems to ignore it | 17:48 |
| ralonsoh | how is your config file? | 17:48 |
| erlon | ralonsoh: https://editor.mergely.com/7OBhOF8d/ | 17:49 |
| erlon | left is ovs, right ovn | 17:50 |
| erlon | ignore the header comment "#ussuri" | 17:50 |
| ralonsoh | do you see something like this? | 17:50 |
| ralonsoh | DEBUG neutron.api.extensions [None req-3b484393-130a-40bb-a700-163430778816 None None] Loading extension file: qos_fip.py {{(pid=371648) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} | 17:50 |
| ralonsoh | DEBUG neutron.api.extensions [None req-3b484393-130a-40bb-a700-163430778816 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=371648) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} | 17:50 |
| ralonsoh | INFO neutron.api.extensions [None req-3b484393-130a-40bb-a700-163430778816 None None] Loaded extension: qos-fip | 17:50 |
| ralonsoh | when Neutron server starts | 17:50 |
| erlon | let grep it | 17:52 |
| erlon | ralonsoh: yes | 17:54 |
| erlon | '2021-11-23 16:40:15.482 485289 DEBUG neutron.api.extensions [req-47dff3e6-3371-483e-a076-f6a18591578d - - - - -] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" _check_extension /usr/lib/python3/dist-packages/neutron/api/extensions.py:416' | 17:54 |
| erlon | very same line | 17:54 |
| ralonsoh | and "Starting OVNClientQosExtension" | 17:55 |
| erlon | that one too | 17:56 |
| ralonsoh | then try to add a qos policy with a bw-limit rule | 17:56 |
| ralonsoh | and assign this qos to a FIp | 17:57 |
| ralonsoh | then search in the OVN NB DB | 17:57 |
| ralonsoh | $ ovn-nbctl find qos | 17:57 |
| erlon | ralonsoh: neutron is not adding it for the fip port | 18:03 |
| erlon | I can see it qhen I add in the internal port though | 18:04 |
| ralonsoh | what can you see? | 18:04 |
| opendevreview | Merged openstack/networking-ovn stable/train: [ovn] Add timeout option to ovsdb-client command https://review.opendev.org/c/openstack/networking-ovn/+/818803 | 18:04 |
| ralonsoh | ok, maybe I didn't say that the FIP must be assigned to a router (that means it must have a fixed port) | 18:06 |
| ralonsoh | the FIP will have a router | 18:06 |
| ralonsoh | and therefore an exit port | 18:06 |
| ralonsoh | a "resident_port" | 18:06 |
| ralonsoh | this is needed to set the qos rules on this port, linked to the FIP IP address | 18:07 |
| erlon | this after I added in the fixed ip port: | 18:07 |
| erlon | https://gist.github.com/sombrafam/eef5271996a4395845ded8e4f8c1f139 | 18:07 |
| ralonsoh | erlon, exactly | 18:07 |
| erlon | before it was empty | 18:08 |
| ralonsoh | as commented, the FIP must have a fixed port | 18:08 |
| ralonsoh | than means it is associated to a router | 18:08 |
| ralonsoh | and it has a resident port | 18:08 |
| ralonsoh | on this port OVN applies the qos rules | 18:08 |
| ralonsoh | you'll see that better here | 18:08 |
| ralonsoh | https://github.com/openstack/neutron/blob/4b1bf15f7bfae842669b61400c5469a6d7269eb6/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/extensions/qos.py#L279-L312 | 18:09 |
| opendevreview | Rodolfo Alonso proposed openstack/neutron master: [WIP] [OVN][Placement] Drive binding by placement allocation https://review.opendev.org/c/openstack/neutron/+/786478 | 18:13 |
| ralonsoh | erlon, anything else? I'm going to disconnect, is a bit late for me | 18:16 |
| erlon | ralonsoh: Im trying to understand how to link the port to the FIP | 18:17 |
| ralonsoh | ? | 18:17 |
| ralonsoh | what do you mean? | 18:17 |
| erlon | I mean, to assign the FIP to a router | 18:17 |
| ralonsoh | no no | 18:17 |
| ralonsoh | you don't assign a FIP to a router | 18:17 |
| ralonsoh | you create a FIP in an external network | 18:17 |
| erlon | right | 18:18 |
| ralonsoh | then you create a router linking the private network and the public network | 18:18 |
| ralonsoh | not public, external | 18:18 |
| erlon | I have that | 18:18 |
| ralonsoh | and then you assign the port to the FIP | 18:18 |
| erlon | without that the vms will not even talk externally | 18:18 |
| ralonsoh | right | 18:18 |
| ralonsoh | well no | 18:19 |
| ralonsoh | you can use nating | 18:19 |
| ralonsoh | you don't need a FIP to access to internet | 18:19 |
| erlon | true, I can, but when I assign a fip to the vm it will not use nat anymore | 18:19 |
| ralonsoh | you'll have DNAT | 18:20 |
| ralonsoh | https://docs.openstack.org/python-openstackclient/pike/cli/command-objects/floating-ip.html | 18:20 |
| ralonsoh | this is the CLI for floating IPs | 18:20 |
| ralonsoh | https://docs.openstack.org/python-openstackclient/pike/cli/command-objects/floating-ip.html#floating-ip-set | 18:20 |
| ralonsoh | to set a port or a fixed IP | 18:20 |
| erlon | hmm | 18:20 |
| erlon | so, Ill not hold you anymore | 18:21 |
| ralonsoh | see you | 18:21 |
| erlon | Ill keep trying and let you know tomorrow | 18:21 |
| erlon | but thanks a lot for now! | 18:21 |
| ralonsoh | yw | 18:21 |
| opendevreview | Merged openstack/neutron stable/ussuri: [ovn] Add timeout option to ovsdb-client command https://review.opendev.org/c/openstack/neutron/+/818801 | 18:59 |
| *** jamesdenton_alt is now known as jamesdenton | 20:12 | |
| opendevreview | Jakub Libosvar proposed openstack/neutron master: ovn: Wait for northd in functional tests https://review.opendev.org/c/openstack/neutron/+/819032 | 22:30 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!