Tuesday, 2024-06-18

opendevreviewLuis Tomas Bolivar proposed openstack/ovn-bgp-agent master: Ensure cr-lrp permanent ip nei entry is added on NB DB driver  https://review.opendev.org/c/openstack/ovn-bgp-agent/+/92149101:20
*** ykarel_ is now known as ykarel05:49
opendevreviewRodolfo Alonso proposed openstack/neutron master: Service workers stop re-writing the process name  https://review.opendev.org/c/openstack/neutron/+/92209506:18
opendevreviewRodolfo Alonso proposed openstack/neutron master: DNM == Test devstack patch 922125  https://review.opendev.org/c/openstack/neutron/+/92218206:44
opendevreviewJay Jahns proposed openstack/ovn-bgp-agent master: Ensure cr-lrp permanent ip nei entry is added on NB DB driver  https://review.opendev.org/c/openstack/ovn-bgp-agent/+/92149106:52
opendevreviewArtem Goncharov proposed openstack/neutron master: Restore neutron.wsgi for backwards compatibility  https://review.opendev.org/c/openstack/neutron/+/92218506:58
opendevreviewArtem Goncharov proposed openstack/neutron master: Restore neutron.wsgi for backwards compatibility  https://review.opendev.org/c/openstack/neutron/+/92218507:39
opendevreviewArtem Goncharov proposed openstack/neutron-vpnaas master: Fix neutron wsgi module location  https://review.opendev.org/c/openstack/neutron-vpnaas/+/92218908:29
gtemafrickler - backwards compatibility is a must now, since linter jobs fail in vpnaas until neutron is released with the moved module08:30
fricklerah, jobs checking against the released neutron vs. master, right08:32
opendevreviewArtem Goncharov proposed openstack/neutron-dynamic-routing master: Fix neutron wsgi module location  https://review.opendev.org/c/openstack/neutron-dynamic-routing/+/92219008:32
gtemacorrect, and now we have broken jobs so restoring compat for a while is definitely not a wrong step08:33
fricklerack08:35
opendevreviewArtem Goncharov proposed openstack/neutron master: Restore neutron.wsgi for backwards compatibility  https://review.opendev.org/c/openstack/neutron/+/92218508:36
opendevreviewArtem Goncharov proposed openstack/neutron master: Restore neutron.wsgi for backwards compatibility  https://review.opendev.org/c/openstack/neutron/+/92218511:50
jshen28HI12:26
opendevreviewGaudenz Steinlin proposed openstack/neutron master: Add L3 HA fullstack failover tests  https://review.opendev.org/c/openstack/neutron/+/91742913:01
opendevreviewGaudenz Steinlin proposed openstack/neutron master: Add conntrackd support to HA routers in L3 agent  https://review.opendev.org/c/openstack/neutron/+/91743013:01
d1nuc0mHi guys, an advice on a sensible config - when using neutron apache wsgi, how many workers/threads should be allocated?13:34
opendevreviewyatin proposed openstack/neutron master: [FT] Run test_periodic_sync_routers_task tests serially  https://review.opendev.org/c/openstack/neutron/+/92221813:49
ykarelfrickler, can you check https://github.com/cirros-dev/cirros/pull/116 when get a chance13:55
*** haleyb|out is now known as haleyb13:57
haleybhi, just had to restart browser, one second for meeting...14:01
haleyb#startmeeting networking14:01
opendevmeetMeeting started Tue Jun 18 14:01:59 2024 UTC and is due to finish in 60 minutes.  The chair is haleyb. Information about MeetBot at http://wiki.debian.org/MeetBot.14:01
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:01
opendevmeetThe meeting name has been set to 'networking'14:01
haleybPing list: bcafarel, elvira, frickler, mlavalle, mtomaska, obondarev, slaweq, tobias-urdin, ykarel, lajoskatona, jlibosva, averdagu, amotoki, haleyb, ralonsoh14:02
mlavalle\o14:02
ihrachys_o/14:02
ralonsohhello14:02
slaweqo/14:02
rubasovo/14:02
ykarelo/14:02
haleyb#topic announcements14:03
haleybWe are now in Dalmatian release week (R - 14)14:03
haleyb#link https://releases.openstack.org/dalmatian/schedule.html14:04
haleybThe Dalmatian-2 milestone will happen next month, on July 4th, 202414:04
haleybAt milestone-2, the release team will propose releases for any library that has not been otherwise released since milestone-114:04
haleybSo anything we want to get out there in beta form should try and land by then14:05
haleybOne of those things that we did land last week was changing the DB load strategy to 'selectin', so if you notice any differences or DB issues please raise them14:07
mlavalleack14:07
fricklershould this improve performance?14:07
ralonsohyes with the nested resources14:08
ralonsohfor example tags of a port14:08
fricklerok, so would need dedicated test cases? did anyone actually perform some load tests?14:09
fricklerbut also we can discuss this later in open discussion14:10
ralonsohthat would be desirable, for sure14:10
haleybfrickler: i did not, it was more driven by our ML discussion with Mike14:11
haleybi have been out for a few days, was there anything important that happened that i should be aware of?14:12
fricklerthere was the wsgi issue gtema pushed earlier today14:12
frickler#link https://review.opendev.org/c/openstack/neutron/+/92218514:12
fricklerbreaking vpnaas and n-d-r iiuc14:13
haleybfrickler: ack, let's talk about that in bugs in a second14:13
haleybmy only other announcement is tomorrow is a US holiday for some (Juneteenth), I am out not sure about others14:14
mlavallewe will be out as well in the USA14:15
haleyb#topic bugs14:15
haleybmlavalle: ack14:15
haleybobondarev was the bug deputy last week14:16
haleyb#link https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/QKSMGG3AKXKMVCIJWNSBUKNHAT3SOLFG/14:16
haleybwe can talk about the wsgi issue first14:16
haleyb#link https://bugs.launchpad.net/neutron/+bug/206968914:17
haleyb#link https://review.opendev.org/c/openstack/neutron/+/92218514:18
ihrachys_still pep8ing even though noqa is added?14:18
gtemayes, and that drives me crazy - locally it passed14:19
haleybi think you have to give the W number after14:19
haleyb?14:19
ihrachys_that's pylint, maybe have a different ignore comment?14:19
gtemacan try, but here there are 2 Ws14:19
haleybi'm sure we can figure it out, maybe it's just different versions of things?14:21
haleybis the end goal to fix those extensions?14:21
ralonsohthere are patches to fix them14:21
gtemayes, there are 2 patches for the extensions14:21
ralonsohhttps://review.opendev.org/c/openstack/neutron-dynamic-routing/+/92219014:21
gtemaone surprisingly passing (while locally pep failed logically)14:22
ralonsohhttps://review.opendev.org/c/openstack/neutron-vpnaas/+/92218914:22
gtemaanother fail14:22
haleybgtema: so we can un-do this workaround once those merge?14:23
gtemayes. Problem is that you can actually merge extensions fixes after you release neutron14:23
gtemathen merge/release extensions and then undo neutron change14:23
haleybok, so we have to do a release for ndr and vpnaas first, got it14:25
haleybsorry about the breakage, luckily it was a simple fix14:25
gtemanp14:25
haleybnext bug14:26
haleyb#link https://bugs.launchpad.net/neutron/+bug/206948214:27
haleybipv6-only metadata doesn't work with OVN14:27
haleybmlavalle: i wonder if i broke this with recent metadata work14:27
mlavallehaleyb: I will take a look. Thanks. I'll fix it anyway 14:28
mlavallebut I doubt your recent work is the culprit. I think the problem came since Daniel's original patch14:29
haleybmlavalle: there was another change in progress to retry getting the metadata port, it shouldn't actually be required but will find it in case it helps at all14:30
mlavalleok, thanks14:30
haleybthanks for looking into this14:30
mlavalle:-)14:31
haleybnext bug14:31
haleyb#link https://bugs.launchpad.net/neutron/+bug/206906114:31
haleybInvestigate 'selectin' relation optimization with newer SQLAlchemy14:31
haleybmtomaska1: is there more to this than the reverts?14:32
ihrachys_I think that's a bug to explore what the revert broke (potentially)14:32
ralonsohbut we already merge the revert and the selectin patch14:33
ihrachys_(that it talks about a particular solutuion - selectin - I think is wrong. selectin may have nothing to do with the effect of the revert.)14:33
ralonsohwe can use this patch for what was commented before: to test the performance14:33
ralonsohright, the description doesn't match the title14:34
haleybralonsoh: ack, especially since tags is one of the areas it should help14:35
ihrachys_we can definitely use this LP for perf testing for selectin. but we should then have another LP to check if revert didn't break something else - which was the original explanation given in the revert commit message as to why this LP exists.14:35
ralonsohit is easy to create a resource (port) and multiple tags to test that14:35
ihrachys_ok well maybe not the "in commit message" but in "discussions around the patch" is more correct. I see the commit message still says it's about selectin.14:36
ralonsohsorry, I don't understand your comment here14:36
ralonsohthe original code was working and was tested14:37
ihrachys_I mean that the revert was merged with no thought given as to whether it broke anything (while fixing an issue with tags slowliness). I *hoped* that we will follow up with checking it.14:37
ralonsohthe patch changing the load method to "joined" didn't change the results (and the tests are still valid)14:37
ralonsohright, that was manually tested but there are not tests to validate that14:38
ihrachys_(I assume there was a good reason for the original patch to merge here; could be wrong)14:38
ralonsohwe can try that in rally, maybe14:38
ihrachys_regardless, something to explore I think - check the "number of sql select queries; try to understand if they regressed and whether it's an indicator of a problem..."14:38
ralonsohno, that was just cosmetic (the number of queries)14:39
ralonsohnot to be always pointed by the U/S QA team, blaming us for the poor performance14:39
ihrachys_welp that sounds really bad14:40
ralonsohselectin will fix both: number of queries and performance14:40
ihrachys_ok14:40
haleybso that bug just needs an owner, not sure if mtomaska1 will be able to look but can follow-up with him14:41
haleybnext bug14:43
haleyb#link https://bugs.launchpad.net/neutron/+bug/206920114:43
haleybovn octavia provider related14:43
haleybi'll have to ping fernando, don't see him here14:44
ralonsohtoday is offline14:44
haleybralonsoh: ack, thanks14:45
haleybhave a few more bugs14:45
haleyb#link https://bugs.launchpad.net/neutron/+bug/206954314:45
haleybinstance tap port has dead vlan when parent port for trunk14:45
haleybi see rubasov just picked this up, thanks!14:45
rubasovI'll take a look14:45
haleybnext14:46
haleyb#link https://bugs.launchpad.net/neutron/+bug/206907114:47
haleybaddress pair not working with oslo policy http check14:47
haleyboleg thought might be a formatting issue in their policy file, waiting for response14:47
ralonsohhmmm I've seen that before, I can confirm that testing it14:48
ralonsohthis is because we are not defining something in the API14:48
ralonsohthis is why is trying to convert neutron_lib.constants.Sentinel14:48
ralonsohI think that could be legit14:48
ralonsohI'll take it14:49
haleybralonsoh: thanks14:49
haleybthere are two more bug, might as well go through quickly14:50
haleyb#link https://bugs.launchpad.net/neutron/+bug/206940914:51
haleybAddding route in qrouter namesapce failing as Nexthop has invalid gateway14:51
haleybthe submittor took ownership, i'll follow to see if there are other responses14:52
haleyblast one14:52
haleyb#link https://bugs.launchpad.net/neutron/+bug/206914914:52
haleybDesignate DNS and SSLError 52429714:53
haleybso deleting FIP that has DNS entry gives an error14:54
haleybas far as i knew this was working correctly, will have to wait for more info14:55
johnsomIt seems like we should have test coverage for this scenario14:56
haleybjohnsom: seems like it. this is a pretty basic scenario that should be working14:57
ihrachys_what's special about the scenario? don't we deploy designate apis via tls in designate gate?14:57
johnsomOn the Designate side, we co-gate with neutron-tempest-plugin-designate-scenario, but I don't think that runs with TLS14:58
johnsomI don't know if there is a neutron job running with TLS14:59
ralonsohtempest-multinode-full-py314:59
johnsomAh, cool. So now the question is does the test suite cover the "insecure" option as mentioned on the bug. Though, I'm not sure the error relates to a validation issue.15:01
haleybjohnsom: not sure about insecure testing15:02
ralonsohsorry, folks, I need to drop in 1 minute15:02
haleybwe are actually over time and neutron-ci meeting needs to start15:02
slaweqI have to drop too15:03
slaweqsee You15:03
haleybwe can try and work that issue in the bug to narrow it down15:03
haleybthanks for coming everyone and have a good week15:03
haleyb#endmeeting15:03
opendevmeetMeeting ended Tue Jun 18 15:03:32 2024 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:03
opendevmeetMinutes:        https://meetings.opendev.org/meetings/networking/2024/networking.2024-06-18-14.01.html15:03
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/networking/2024/networking.2024-06-18-14.01.txt15:03
opendevmeetLog:            https://meetings.opendev.org/meetings/networking/2024/networking.2024-06-18-14.01.log.html15:03
mlavalle\o15:03
opendevreviewArtem Goncharov proposed openstack/neutron master: Restore neutron.wsgi for backwards compatibility  https://review.opendev.org/c/openstack/neutron/+/92218515:03
ykarel#startmeeting neutron_ci15:04
opendevmeetMeeting started Tue Jun 18 15:04:19 2024 UTC and is due to finish in 60 minutes.  The chair is ykarel. Information about MeetBot at http://wiki.debian.org/MeetBot.15:04
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:04
opendevmeetThe meeting name has been set to 'neutron_ci'15:04
ykarelPing list: bcafarel, lajoskatona, mlavalle, mtomaska, ralonsoh, ykarel, jlibosva, elvira15:04
ykarelhello everyone15:04
ykarelit's on IRC today15:05
bcafarelo/15:05
mlavalle\o15:05
ykarelk let's start with topics15:07
ykarel#topic Actions from previous meetings15:07
ykarelslaweq to add ovn grenade to check queue15:08
ykarelslaweq mentioned will not be around for the meeting15:08
ykarelhe pushed https://review.opendev.org/c/openstack/neutron/+/921835, which already merged15:08
ykarelthx slaweq 15:08
ykarelmlavalle to check failures in test_direct_route_for_address_scope15:08
mlavalleI checked it. Didn't happen agein the entire week15:08
mlavalleI think it was a one of15:09
ykarelok did find something in logs what triggered the issue?15:09
mlavalleit was a time out15:10
mlavallepinging15:10
ykarelhmm ok just checked so logs would not have much for that15:10
mlavallemore than a timeout, responses didin'r arrive to pinfs15:10
mlavallepings15:10
mlavalleyeah, so not much to investigate15:10
ykarelk if we see it again can try to see if can reproduce locally15:11
ykarelthx mlavalle for checking15:11
mlavallefor now, it must have been a network15:11
mlavalleproblem15:11
ykarelykarel to check test_metadata_proxy_rate_limiting_ipv615:11
ykarelReported https://bugs.launchpad.net/neutron/+bug/206974415:11
ykarelProposed https://review.opendev.org/c/openstack/neutron/+/92221815:12
ykarelplease review when get a chance15:12
ykarelykarel to check tempest failures in enforce-scope job15:12
ykarelSame issue as https://bugs.launchpad.net/neutron/+bug/204554915:12
ykarelProposed https://github.com/cirros-dev/cirros/pull/11615:13
ykarelif that do not merge soon, we can considering moving affected jobs to older cirros version i.e 0.5.315:13
ykarelseen around 15 failures in last 2 weeks15:13
ykareland the issue in itself exists from quite long, likely from time we switched to cirros 0.6.0+15:14
ykarelthat's it on this15:14
ykarellajoskatona to check fullstack failure  test_configurations_are_synced_towards_placement15:14
ykarelseems lajos not around today, will readd action15:15
ykarel#action lajoskatona to check fullstack failure  test_configurations_are_synced_towards_placement15:15
ykarel#topic Stable branches15:15
ykarelbcafarel, any update here?15:16
ykarelcouple of patches merged in stable branches, overall looks good15:16
bcafarelstable branches behaved while I was on PTO last week :) looking good in the recent backports (I have not checked periodic yet)15:16
ykarelunmaintained branches have some issues15:16
ykarelwill check those later15:17
ykarelthx bcafarel 15:17
ykarel#topic Stadium projects15:17
ykarelsfc/bagpipe still broken15:17
ykarelknown issues15:17
ykarel- https://bugs.launchpad.net/neutron/+bug/206872715:17
ykarel- https://bugs.launchpad.net/neutron/+bug/206745215:17
ykarel#topic Rechecks15:18
ykareljust 1 bare recheck out of 1615:18
ykarellet's keep doing it15:18
ykarel#topic fullstack/functional15:18
mlavalle+115:18
ykareltest_agent_list15:18
ykarelhttps://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_076/periodic/opendev.org/openstack/neutron/master/neutron-functional-with-oslo-master/0763173/testr_results.html15:18
ykarelhttps://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_7c1/921609/1/check/neutron-functional-with-uwsgi/7c14741/testr_results.html15:18
ykarelseen twice in master and victoria, so need to check what's triggering this15:19
ykarelany volunteer to check this?15:19
mlavalleI'll check it15:19
mlavallein fact I saw it last  night15:19
ykarelthx mlavalle 15:19
ykarel#action mlavalle to check failures for test_agent_list ft test15:20
ykareltest_floatingip_mac_bindings15:20
ykarelseen once https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_e4e/921942/1/gate/neutron-functional-with-uwsgi/e4e2d01/testr_results.html15:20
ykarelold bug where there were some fixes pushed https://bugs.launchpad.net/neutron/+bug/195500815:20
ykarelwill just update that for now15:21
ykarel#topic Rally jobs15:21
ykarelrally jobs broken in unmaintained branches https://bugs.launchpad.net/neutron/+bug/206970415:21
ykareli think we could just drop these from unmaintained branches15:22
bcafarelI wonder if keeping rally jobs is worth it for unmaintained15:22
bcafarelok you typed faster ykarel :)15:22
ykarelwill you send patches to drop those :?15:23
bcafarelcan do!15:23
ykarelthx bcafarel 15:23
ykarel#action bcafarel to drop rally jobs from yoga/xena15:23
ykarel#topic Periodic15:24
ykareldevstack-tobiko-neutron broken on bobcat+ releases running on ubuntu-jammy15:24
ykarelhttps://zuul.openstack.org/builds?job_name=devstack-tobiko-neutron&project=openstack%2Fneutron&branch=master&branch=stable%2F2024.1&branch=stable%2F2023.2&skip=015:24
ykarelIt's already fixed today by https://review.opendev.org/c/x/tobiko/+/922184 from Eduardo15:24
opendevreviewMerged openstack/neutron-vpnaas master: Fix neutron wsgi module location  https://review.opendev.org/c/openstack/neutron-vpnaas/+/92218915:24
ykarelunmaintained/zed fips 9-stream jobs broken15:25
ykarelhttps://zuul.openstack.org/builds?job_name=neutron-ovn-tempest-ovs-release-fips&job_name=neutron-ovs-tempest-fips&project=openstack%2Fneutron&branch=unmaintained%2Fzed&skip=015:25
ykarelwe can drop these too15:25
ykarelanyone willing to send patch for these?15:25
ykarelk i will send that15:26
ykarel#action ykarel to send patch to drop fips jobs from unmaintained branches15:26
ykarel#topic Grafana15:26
ykarelhttps://grafana.opendev.org/d/f913631585/neutron-failure-rate15:26
ykarellet's have quick look here too15:27
ykarelsome spikes in gate and that's related to cirros issue above15:27
ykarelthere are some spikes in pep8 but that's related to patch as seen in previous meeting15:28
ykarelsome other spikes too but those looks related to patches itself15:29
ykarelanything to add?15:29
bcafarelall good from me15:29
mlavallesame here15:30
ykarelok15:30
ykarel#topic On Demand15:30
ykarelanything would like to raise here?15:30
mlavallenoting from me15:31
bcafareljumping in another meeting, so good timing (and nothing either)15:33
ykarelthx mlavalle bcafarel for joining15:33
ykarel#endmeeting15:33
opendevmeetMeeting ended Tue Jun 18 15:33:44 2024 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:33
opendevmeetMinutes:        https://meetings.opendev.org/meetings/neutron_ci/2024/neutron_ci.2024-06-18-15.04.html15:33
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/neutron_ci/2024/neutron_ci.2024-06-18-15.04.txt15:33
opendevmeetLog:            https://meetings.opendev.org/meetings/neutron_ci/2024/neutron_ci.2024-06-18-15.04.log.html15:33
mlavalle\o15:33
opendevreviewBernard Cafarelli proposed openstack/neutron unmaintained/yoga: [unmaintained] Drop rally jobs  https://review.opendev.org/c/openstack/neutron/+/92223015:38
*** ykarel is now known as ykarel|away15:39
opendevreviewBernard Cafarelli proposed openstack/neutron unmaintained/xena: [unmaintained] Drop rally jobs  https://review.opendev.org/c/openstack/neutron/+/92223115:40
opendevreviewBernard Cafarelli proposed openstack/neutron unmaintained/xena: [unmaintained] Drop rally jobs  https://review.opendev.org/c/openstack/neutron/+/92223115:43
opendevreviewBernard Cafarelli proposed openstack/neutron unmaintained/wallaby: [unmaintained] Drop rally jobs  https://review.opendev.org/c/openstack/neutron/+/92223215:48
opendevreviewBernard Cafarelli proposed openstack/neutron unmaintained/victoria: [unmaintained] Drop rally jobs  https://review.opendev.org/c/openstack/neutron/+/92223315:54
opendevreviewJay Jahns proposed openstack/ovn-bgp-agent master: Ensure cr-lrp permanent ip nei entry is added on NB DB driver  https://review.opendev.org/c/openstack/ovn-bgp-agent/+/92149116:42
opendevreviewMerged openstack/neutron stable/2024.1: Revert "[OVN] Prevent Trunk creation/deletion with parent port bound"  https://review.opendev.org/c/openstack/neutron/+/92160617:10
opendevreviewJay Jahns proposed openstack/ovn-bgp-agent master: Ensure cr-lrp permanent ip nei entry is added on NB DB driver  https://review.opendev.org/c/openstack/ovn-bgp-agent/+/92149119:23
opendevreviewMerged openstack/neutron stable/2023.2: Revert "Use HasStandardAttributes as parent class for Tags DB model"  https://review.opendev.org/c/openstack/neutron/+/92156819:46
opendevreviewMerged openstack/neutron-lib master: Add the ability to define the ``BaseWorker.set_proctitle`` flag  https://review.opendev.org/c/openstack/neutron-lib/+/92208520:09
opendevreviewMerged openstack/neutron master: Add new neutron.wsgi module  https://review.opendev.org/c/openstack/neutron/+/91640721:15
opendevreviewMerged openstack/neutron master: Set the Neutron server workers name  https://review.opendev.org/c/openstack/neutron/+/92209021:17
haleybmlavalle: btw the metadata patch i was talking about is https://review.opendev.org/c/openstack/neutron/+/88148722:05
mlavallehaleyb: thanks22:18
mlavallehaleyb: btw, congrats on the Celtics. 18th championship!22:19
haleybmlavalle: thanks, all that TV watching paid off :) Parade will be crazy Friday22:20
*** haleyb is now known as haleyb|out22:27
opendevreviewMerged openstack/neutron master: [FT] Run test_periodic_sync_routers_task tests serially  https://review.opendev.org/c/openstack/neutron/+/92221822:47
mnaserfriendly ping about https://review.opendev.org/c/openstack/neutron/+/921035 again please23:22
opendevreviewJay Jahns proposed openstack/ovn-bgp-agent master: Ensure cr-lrp permanent ip nei entry is added on NB DB driver  https://review.opendev.org/c/openstack/ovn-bgp-agent/+/92149123:55

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!