Monday, 2025-02-24

opendevreviewRodolfo Alonso proposed openstack/neutron master: [eventlet-removal] Remove the usage of eventlet in the DHCP agent  https://review.opendev.org/c/openstack/neutron/+/94253007:31
opendevreviewyatin proposed openstack/ovsdbapp master: Added method and command to allow setting 'dns.options' column  https://review.opendev.org/c/openstack/ovsdbapp/+/94236707:50
opendevreviewMaor Blaustein proposed x/whitebox-neutron-tempest-plugin master: [DNM] Fail on purpose for debugging  https://review.opendev.org/c/x/whitebox-neutron-tempest-plugin/+/94253608:38
opendevreviewMaor Blaustein proposed x/whitebox-neutron-tempest-plugin master: Test verifies BZ#2214566/OSPRH-13533 doesn't regress  https://review.opendev.org/c/x/whitebox-neutron-tempest-plugin/+/94193009:09
opendevreviewRodolfo Alonso proposed openstack/os-ken master: [cmd] Import the correct version variable  https://review.opendev.org/c/openstack/os-ken/+/94256610:26
opendevreviewRodolfo Alonso proposed x/whitebox-neutron-tempest-plugin master: Physical network max-bw QoS is applied on the localnet port  https://review.opendev.org/c/x/whitebox-neutron-tempest-plugin/+/94256710:35
opendevreviewMerged openstack/neutron master: [OVN][QoS] Don't change the input parameter in ``_add_port_qos_rules``  https://review.opendev.org/c/openstack/neutron/+/94251611:21
opendevreviewRodolfo Alonso proposed x/whitebox-neutron-tempest-plugin master: Physical network max-bw QoS is applied on the localnet port  https://review.opendev.org/c/x/whitebox-neutron-tempest-plugin/+/94256712:44
opendevreviewMerged openstack/neutron master: Ensure string type in provnet-network-type ext_id  https://review.opendev.org/c/openstack/neutron/+/94215612:54
opendevreviewMerged openstack/neutron master: Fix wrong rejex for [ovs] ovsdb_connection  https://review.opendev.org/c/openstack/neutron/+/94241213:04
opendevreviewRodolfo Alonso proposed openstack/neutron master: WIP == [eventlet-removal] Replace ``eventlet.spawn_n`` usage  https://review.opendev.org/c/openstack/neutron/+/93841113:17
opendevreviewMerged openstack/tap-as-a-service master: CLI for Tap Mirrors  https://review.opendev.org/c/openstack/tap-as-a-service/+/88608513:17
opendevreviewMerged openstack/tap-as-a-service master: Documentation for tap-mirrors  https://review.opendev.org/c/openstack/tap-as-a-service/+/90722013:17
opendevreviewRodolfo Alonso proposed openstack/neutron master: [eventlet-removal] Replace ``eventlet.spawn_n`` usage  https://review.opendev.org/c/openstack/neutron/+/93854113:18
opendevreviewElod Illes proposed openstack/networking-bagpipe unmaintained/2023.1: [CI] Remove periodic stable jobs from unmaintained branch  https://review.opendev.org/c/openstack/networking-bagpipe/+/94258413:27
opendevreviewyatin proposed openstack/neutron master: [OVN] Add option to allow configuring dns ovn-owned  https://review.opendev.org/c/openstack/neutron/+/94237313:34
opendevreviewTakashi Kajinami proposed openstack/neutron-vpnaas master: Use consistent regex to validate ovsdb_connection  https://review.opendev.org/c/openstack/neutron-vpnaas/+/94258814:28
opendevreviewTakashi Kajinami proposed openstack/neutron master: Validate ovn_nb/sb_connection in config parser  https://review.opendev.org/c/openstack/neutron/+/94258914:37
opendevreviewTakashi Kajinami proposed openstack/ovn-octavia-provider master: Validate ovn_nb/sb_connection in config parser  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/94259114:56
opendevreviewTakashi Kajinami proposed openstack/ovn-octavia-provider master: Drop unused environment  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/94259214:57
ykarel#startmeeting neutron_ci15:01
opendevmeetMeeting started Mon Feb 24 15:01:16 2025 UTC and is due to finish in 60 minutes.  The chair is ykarel. Information about MeetBot at http://wiki.debian.org/MeetBot.15:01
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:01
opendevmeetThe meeting name has been set to 'neutron_ci'15:01
ykarelPing list: bcafarel, lajoskatona, slawek, mlavalle, mtomaska, ralonsoh, ykarel, jlibosva, elvira15:01
ralonsohhello15:01
bcafarelo/15:01
slaweqo/15:02
mblueo/15:04
ykarelHello everyone, let's start with topics from previous week15:04
ykarel#topic Actions from previous meetings15:04
ykarelralonsoh to move maintenance test to concurrency 115:04
mtomaskao/15:04
ykarel#link https://review.opendev.org/c/openstack/neutron/+/94194115:05
ykarelalready merged15:05
ykarelthx ralonsoh 15:05
ralonsohyw15:05
ykarel    ralonsoh to check fullstack issue triggered by patch 937843 or any related eventlet removal patches15:05
ralonsohI didn't see any relation between the merged patch and these errors15:05
ralonsohactually I was able to reproduce some of them (locally) without this patch15:05
ykarelohkk able to consistantly reproduce?15:06
ralonsohno, randomly only15:06
ykarelwe still seeing these failures15:06
ykarelokk15:06
ykarelyou reported some bug for this already?15:06
ralonsohno, I'm still checking it15:06
ralonsohbut I'll do it today15:06
ykarelk thx ralonsoh 15:07
ykarel#topic Stable branches15:07
ykarelperiodic wise seen one failure in 2024.115:07
ykarelcouple of patches merged last week in stable branches15:07
lajoskatonao/15:08
ykarelbcafarel, anything else to add ^15:08
bcafarelyes, overall quiet week, not too many patches and they got in without trouble15:08
bcafarelthough thanks for catching the periodic one I had not checked that15:08
ykarelk thx for the updates15:09
ykarel#topic Stadium projects15:09
ykarelFinally green after many weeks :)15:09
ykarellajoskatona, anything else to add15:09
lajoskatonayes, thanks all for the attention and reviews and help15:09
lajoskatonahope this will keep till the release :-)15:10
ykarel++15:10
bcafarel+115:10
ykarel#topic Rechecks15:11
ykarelless activity in master this week, 3 merged with 0 rechecks15:11
ykarelbare recheck wise it was bit higher 12/4515:11
ykarelmost of the bare rechecks in few patches15:12
ykarellet's keep avoiding bare rechecks15:12
ykarelNow let's check failures15:12
ykarel#topic fullstack/functional15:12
ykarel- functional wait_until_true failures as last week15:12
ykarel    - https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_bc6/periodic/opendev.org/openstack/neutron/master/neutron-functional/bc60662/testr_results.html15:12
ykarel    - https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_4e4/periodic/opendev.org/openstack/neutron/master/neutron-functional/4e4cdde/testr_results.html15:12
ykarel    - https://0398d1fc47f7068c1379-e807054499ce854694349e023b0ab289.ssl.cf1.rackcdn.com/periodic/opendev.org/openstack/neutron/master/neutron-fullstack-fips/a3491fa/testr_results.html15:12
ykarelthis is same we discussed above and ralonsoh already looking into it15:13
ralonsohI'll check these new ones15:13
ykarel- test_securitygroup(ovs-openflow)15:13
ykarel    - https://227c79f6282be3c4ba5c-c685ac7d1fe5f5adbb4d0f30da5e685e.ssl.cf2.rackcdn.com/periodic/opendev.org/openstack/neutron/master/neutron-fullstack/ecd2d79/testr_results.html15:13
ykarel    - https://d7dc64ccb2654383b602-73af3e7fb0ca2f6ff45efb1cdea09ef7.ssl.cf2.rackcdn.com/941459/1/gate/neutron-fullstack/50b4a4c/testr_results.html15:13
ykarelwe still not eventlet free yet, right?15:14
ykarelas seeing the traces in the failures15:14
ralonsohyes, specially the tests, that are still importing eventlet15:14
ralonsohall of them15:14
ykarelohkk15:14
lajoskatonayou mean both funvctional and fullstack use eventlet now?15:15
ralonsohYES15:15
ralonsohsorry15:15
ralonsohyes15:15
lajoskatonaif we have working code without eventlet those test will fail anyway, or shall we have a mixed state where the prod code is eventletless but functional is not for example?15:16
lajoskatonathis part was out of my horizon till this time sorry for dumb question15:16
ralonsohthe point is that the code we are pushing now should work with both15:16
ralonsohbut we can start segregating the UTs/FT/fullstack tests15:17
lajoskatonaralonsoh: ack, thats what I hopes based on my patch for dhcp for example15:17
ralonsohand create jobs with and without eventlet15:17
ralonsohlajoskatona, yes, exactly15:17
ralonsoh#link https://review.opendev.org/c/openstack/neutron/+/94239315:18
ykarelsorry but if we are going to eventlet free, why we need to keep testing both?15:18
ykarelor eventlet free will be next release15:18
ralonsohbecause tests cover parts of the code that are still not migrated15:19
ralonsohfor example: L3 agent is still using eventlet pools15:19
ralonsohwe also need to refactor some parts of the tests, that are using eventlet methods15:19
ralonsohthe amount of work is huge yet...15:19
lajoskatonaand we are close to the FF date https://releases.openstack.org/epoxy/schedule.html15:19
ykarelok you meant until everything migrated to keep both versions, and drop extra job once migration finishes15:19
ralonsohyes15:20
ykarelthx15:20
ralonsohlajoskatona, yes but we don't need to remove eventlet completely in this release15:20
lajoskatonaralonsoh: yes, that was what I wanted to say, thanks15:20
ykarelohk coming back to above failures, anyone willing to check these failures?15:21
slaweqwhich ones? Those related to the fullstack security group tests?15:21
ralonsohyes15:22
slaweqI think I was checking some random failures in those tests in the past but I may be mixing it with something else also15:23
slaweqand this week I don't think I will have time for it15:23
ykareli will be also out mostly this week15:24
ykarelack let's start with opening a bug for it15:24
ykareli will open that15:25
ykarel#action ykarel to open bug for fullstack security group test failures15:25
ykareltest_metadata_not_provisioned_on_foreign_additional_chassis_change15:26
slaweqI found https://bugs.launchpad.net/neutron/+bug/1871908 but this should be fixed15:26
ykarelAssertionError: NoDatapathProvision not raised.15:26
slaweqso it is probably some different issue now15:26
ykarel    - https://a7dbc1742e9a3f72e252-f52818fbddf6bbc6fa2f220fdc17218b.ssl.cf1.rackcdn.com/periodic/opendev.org/openstack/neutron/stable/2024.1/neutron-functional/fb76481/testr_results.html15:26
slaweqor it wasn't really fixed properly15:26
ykarelseen once, anyone recall seeing similar in past?15:26
ralonsohno sorry15:27
ykarelslaweq, thx when reporting new one will check that bug too15:27
ykarelk can keep a watch on it for now as seen just once15:28
ykareltest_trunk_creation_with_subports15:29
ykarelfailed as oslo_privsep.daemon.FailedToDropPrivileges: privsep helper command exited non-zero (96)15:29
ykarelhttps://f0f27d8bde84b9d726b9-26f184bb59af339cfe698349cbda4177.ssl.cf2.rackcdn.com/periodic/opendev.org/openstack/neutron/master/neutron-functional/e356bb0/testr_results.html15:29
ykarelseen this also once15:30
ralonsohlet me check the logs of this one15:30
ykarelk thx15:31
ykarel#action ralonsoh to check privsep related failure in functional job15:31
ykarel#topic Periodic15:31
ykarelhttps://zuul.openstack.org/builds?job_name=neutron-functional-with-pyroute2-master&project=openstack/neutron15:32
ykarelsome recent change in pyroute2 broke this job15:32
ralonsohI'll check with latest code15:33
ralonsohthere are many patches recently in pyroute215:33
ykarelralonsoh, so you will also report the lp bug/ pyroute2 issue for this?15:33
ralonsohfor sure15:33
ykarelyes seems some new branch got merged15:33
ykarelor a pr with multiple series of commits, i didn't checked that15:34
ralonsohI'15:34
ykarel#action ralonsoh to check pyroute2 functional failures15:34
ralonsohI'll check patch by patch15:34
ralonsohsince feb 19, that we have the first error in periodic15:34
ykarelk thx15:35
ykarelhttps://zuul.openstack.org/builds?job_name=neutron-functional-with-pyroute2-master&project=openstack/neutron15:35
ykarellast 2 runs failed but different test failures15:36
ralonsohyeah... I'll check that manually15:36
ykarelthx for this too :)15:36
ykarelsorry wrong link15:37
ykarelhttps://zuul.openstack.org/builds?job_name=neutron-functional-with-oslo-master&project=openstack/neutron15:37
ralonsohahhh ok15:37
opendevreviewMerged openstack/neutron-tempest-plugin master: Add scenario tests for the Vlan QinQ feature  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/93777815:37
ralonsohlet me send a testing patch15:37
ralonsohbecause these errors could be random15:38
ykarel++ yes that should be quick and good15:38
ralonsohI'll confirm that with this patch15:38
ykarel#action ralonsoh to confirm failure with oslo master function job15:38
ykarel- https://zuul.openstack.org/builds?job_name=openstacksdk-functional-devstack-networking&project=openstack%2Fneutron&branch=stable%2F2024.1&skip=015:38
ykarellast one for stable/2024.115:39
ralonsoh2025-02-24 03:01:47.575562 | controller |     openstacksdk 4.3.1.dev26 depends on typing-extensions>=4.12.015:39
ralonsoh2025-02-24 03:01:47.575584 | controller |     The user requested (constraint) typing-extensions===4.9.015:39
ralonsohthat seems an clash in requirements15:39
ykarelyes looks job issue, master openstacksdk not compatible with stable/2024.1 upper-constratints15:40
ykarelnormally for such cases job is fixed to use stable version of openstacksdk15:40
ralonsohwhy are we using master?15:40
ralonsohyeah, that was my question15:40
ykareli recall fixing similar in past15:40
ykareli will send a patch for it15:40
ralonsohcool15:40
ykarelthe sdk team want to use master for stable branches till it could be used15:40
ralonsohahhh ok15:41
ykarel#action ykarel to send fix for openstacksdk job 2024.115:41
ykarel#topic Grafana15:41
ykarellet's also check https://grafana.opendev.org/d/f913631585/neutron-failure-rate15:41
ralonsoh(is not working for me)15:42
lajoskatonathere's warnings on the page like "The panel requires angular (deprecated)" it just on my side?15:42
ralonsohsame15:42
slaweqyeah, I was just going to ask the same about this warning15:42
slaweqI see graphs still but there is warning in each of them also on top15:43
ralonsohok, now is refreshing for me15:43
ykarelyes i too just seeing the warning15:44
ralonsohI see high spikes in FTs and fullstack15:44
ykarelit was quite week, so less bits in gate queue and no failures15:44
opendevreviewMerged openstack/ovsdbapp master: Added method and command to allow setting 'dns.options' column  https://review.opendev.org/c/openstack/ovsdbapp/+/94236715:45
ykarelyes in ft and fullstack from what i saw it was patch specific or similar issues we discussed above15:45
ralonsohright15:45
slaweqralonsoh especially functional has high failure rate, around 50-60%15:45
ykarelyes15:47
ykarelwe should be good once we have current known issues fixed for these15:48
ykarel#topic On Demand15:49
ykarelanything else you would like to raise?15:49
ralonsohnothing15:50
lajoskatonanothing from me15:50
slaweqnope15:50
bcafarelall good15:50
ykarelk in that case let's close early and have everyone 8 minutes back15:51
ykarelthx everyone for joining15:51
ykarel#endmeeting15:51
opendevmeetMeeting ended Mon Feb 24 15:51:47 2025 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:51
opendevmeetMinutes:        https://meetings.opendev.org/meetings/neutron_ci/2025/neutron_ci.2025-02-24-15.01.html15:51
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/neutron_ci/2025/neutron_ci.2025-02-24-15.01.txt15:51
opendevmeetLog:            https://meetings.opendev.org/meetings/neutron_ci/2025/neutron_ci.2025-02-24-15.01.log.html15:51
ralonsohbye! ykarel have a nice week15:51
lajoskatonaBye15:52
opendevreviewRodolfo Alonso proposed openstack/neutron master: DNM - Test errors in ``neutron-functional-with-oslo-master``  https://review.opendev.org/c/openstack/neutron/+/94261516:18
opendevreviewmitya-eremeev-2 proposed openstack/neutron master: Fix oslo.log for L3 and DHCP agents  https://review.opendev.org/c/openstack/neutron/+/94262216:55
opendevreviewJakub Libosvar proposed openstack/ovn-bgp-agent master: Use OS_TEST_PATH evironment variable to define tests location  https://review.opendev.org/c/openstack/ovn-bgp-agent/+/94262917:23
opendevreviewMerged openstack/neutron master: Fix some trivial pylint errors in test_utils  https://review.opendev.org/c/openstack/neutron/+/94230519:59
opendevreviewMerged openstack/ovn-bgp-agent stable/2024.2: Handle trimming of vlan interface namings  https://review.opendev.org/c/openstack/ovn-bgp-agent/+/93665121:16
opendevreviewMerged openstack/ovn-bgp-agent stable/2024.1: Handle trimming of vlan interface namings  https://review.opendev.org/c/openstack/ovn-bgp-agent/+/93665221:16
opendevreviewMerged openstack/ovn-bgp-agent stable/2023.2: Handle trimming of vlan interface namings  https://review.opendev.org/c/openstack/ovn-bgp-agent/+/93665321:16

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!