| opendevreview | Dr. Jens Harbott proposed openstack/networking-bgpvpn stable/2023.1: [CI][stable-only] drop tripleo job https://review.opendev.org/c/openstack/networking-bgpvpn/+/915940 | 05:09 |
|---|---|---|
| *** elodilles_pto is now known as elodilles | 07:17 | |
| opendevreview | Takashi Kajinami proposed openstack/networking-bgpvpn stable/2023.1: Remove TripleO job https://review.opendev.org/c/openstack/networking-bgpvpn/+/915947 | 08:26 |
| samcat116 | Hello, I posted a few days ago about seeing some odd behavior when trying to delete a large amount of instances at once on one compute host (over 100 vms with 10 ports per vm). When deleting, Nova sets the instances to error as its getting nova.exception.NeutronAdminCredentialConfigurationInvalid when trying to deallocate the ports. On the neutron side I can see warnings for token authorization failed and the 401 errors for the GET | 13:20 |
| samcat116 | requests on these ports. The token in the config here isn't changing and must be correct as spinning up all these vms worked, so not sure what this means. Any ideas on how to troubleshoot further? | 13:20 |
| opendevreview | yatin proposed openstack/neutron master: Mark L3HA dvr tests unstable https://review.opendev.org/c/openstack/neutron/+/915990 | 13:33 |
| opendevreview | Lajos Katona proposed openstack/neutron-vpnaas master: Remove shell parameter from the call of subprocess_popen https://review.opendev.org/c/openstack/neutron-vpnaas/+/915991 | 13:40 |
| opendevreview | Lajos Katona proposed openstack/neutron master: Bandit: Remove bandit B604 from skip list https://review.opendev.org/c/openstack/neutron/+/915467 | 13:41 |
| haleyb | #startmeeting networking | 14:00 |
| opendevmeet | Meeting started Tue Apr 16 14:00:50 2024 UTC and is due to finish in 60 minutes. The chair is haleyb. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
| opendevmeet | The meeting name has been set to 'networking' | 14:00 |
| ihrachys | o/ | 14:00 |
| haleyb | Ping list: bcafarel, elvira, frickler, mlavalle, mtomaska, obondarev, slaweq, tobias-urdin, ykarel, lajoskatona, jlibosva, averdagu, amotoki, haleyb, ralonsoh | 14:00 |
| mlavalle | \o | 14:00 |
| jlibosva | o/ | 14:00 |
| ykarel | o/ | 14:00 |
| rubasov | o/ | 14:01 |
| elvira | o/ | 14:01 |
| obondarev | o/ | 14:01 |
| frickler | \o | 14:01 |
| haleyb | ok, i'll get started | 14:02 |
| lajoskatona | o/ | 14:02 |
| haleyb | #topic announcements | 14:02 |
| haleyb | this will probably be a short meeting as i've been out a few days and still going through my backlog, if there are fires somewhere please let me know | 14:03 |
| haleyb | We are now in Dalmatian release week (R - 24) | 14:03 |
| haleyb | thanks again for attending the PTG last week, I will work on getting a write-up done for the ML soon | 14:03 |
| lajoskatona | thanks for moderating and driving it :-) | 14:04 |
| haleyb | Reminder: If you have a topic for the drivers meeting on Friday, please add it to the wiki @ https://wiki.openstack.org/wiki/Meetings/NeutronDrivers | 14:04 |
| haleyb | for now i don't see anything new on the RFE list, but will check thursday | 14:05 |
| haleyb | lajoskatona: np, hopefully people found it productive | 14:05 |
| bcafarel | late o/ | 14:06 |
| haleyb | i did not have any other announcements | 14:06 |
| haleyb | bcafarel: just in time | 14:06 |
| haleyb | #topic bugs | 14:06 |
| bcafarel | :) | 14:06 |
| haleyb | bcafarel was bug deputy last week, his report is at | 14:06 |
| haleyb | #link https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/YBZCITD44VLW2LGSHTOJUJSBLARL4SFQ/ | 14:06 |
| haleyb | there were a couple of unassigned that might need owners | 14:07 |
| haleyb | #link https://bugs.launchpad.net/neutron/+bug/2059405 | 14:07 |
| haleyb | OVN DNS not working as documented | 14:07 |
| haleyb | the best I could do is boot a devstack and try some of the commands, i saw similar failures | 14:08 |
| haleyb | but it needs an owner | 14:09 |
| haleyb | it could just be a config issue... | 14:10 |
| ykarel | haleyb, so you also saw that REFUSED responses? | 14:10 |
| ykarel | in devstack tests | 14:10 |
| haleyb | ykarel: i believe so, i had to use nslookup since it was cirros but responses were similar | 14:11 |
| ykarel | and i recall ovn responses only when there was some nameserver defined in /etc/resolv.conf | 14:11 |
| ykarel | haleyb, ack, so may be there some issue then | 14:12 |
| ykarel | i can try to look at it | 14:12 |
| frickler | the .local domain could also be treated special | 14:12 |
| haleyb | maybe, the bug was a kolla deploy so if we could reproduce on a "real" deployment would be good | 14:13 |
| haleyb | ykarel: thanks, i'm watching it and can respond to any questions on my setup once it's up again | 14:15 |
| haleyb | frickler: that's a good question, not sure about .local exactly | 14:16 |
| haleyb | next bug is | 14:16 |
| ykarel | haleyb, ack | 14:16 |
| haleyb | #link https://bugs.launchpad.net/neutron/+bug/2060828 | 14:16 |
| haleyb | [OVN] Changing public network MTU does not update router port gateway_mtu option | 14:16 |
| haleyb | bug has steps to reproduce, just need to verify behavior | 14:19 |
| haleyb | i can try and look but might be a few days | 14:20 |
| haleyb | the only other new bugs were related to floating ip API behavior | 14:21 |
| haleyb | we talked about this at PTG, just need to wait for nova to respond | 14:22 |
| haleyb | not sure there is anything broken in the neutron API at least | 14:22 |
| haleyb | any other bugs for discussion? | 14:23 |
| haleyb | this week elvira is the deputy, next week is slaweq | 14:24 |
| haleyb | Current bug count this week: 720, same as from last week (i will work on getting better metrics :) | 14:24 |
| haleyb | #topic specs | 14:25 |
| haleyb | #link https://review.opendev.org/q/project:openstack%252Fneutron-specs+status:open | 14:25 |
| elvira | ack :) | 14:25 |
| haleyb | we merged one spec last week, just one remaining, is also BGP-related | 14:26 |
| haleyb | if anyone has cycles | 14:26 |
| haleyb | #link https://review.opendev.org/c/openstack/neutron-specs/+/899210 | 14:26 |
| haleyb | elvira: thanks! | 14:26 |
| haleyb | ok, moving on | 14:27 |
| haleyb | #topic community goals | 14:27 |
| haleyb | i did see slaweq's email regarding Manager S-RBAC role | 14:28 |
| haleyb | lajoskatona: is there a new sdk version such that you can continue horizon work? | 14:29 |
| lajoskatona | I will propose a release patch for openstackSDK to have a release for https://review.opendev.org/c/openstack/openstacksdk/+/909656 and push Horizon work forward | 14:29 |
| lajoskatona | no new version | 14:29 |
| haleyb | ack, thanks | 14:29 |
| haleyb | #topic on_demand | 14:30 |
| haleyb | does anyone have a topic? | 14:30 |
| jlibosva | I have one if I may :) | 14:30 |
| haleyb | sure, go ahead | 14:30 |
| jlibosva | IIRC it was mentioned at the PTG and a few minutes ago too, that we're at 720 open bugs atm and at the last PTG time frame the bug count was roughly the same | 14:31 |
| jlibosva | so I thought about it and quickly scrubbed through the bug list and I see the oldest bug is from 2014 and roughly 450 bugs are 2 years old and older | 14:31 |
| haleyb | jlibosva: yes, the 720 number was the same as last cycle | 14:32 |
| jlibosva | I know what some projects like Fedora close bugs that were reported against a release version that is EOL - so that made me thinking - we are most likely not gonna solve all those 700+ bugs and lot of them lose attention over time | 14:33 |
| haleyb | there are a lot of bugs that old, i'm not sure we came to a conclusion as what to do with those as it will take a lot of resources to just reproduce each one | 14:33 |
| jlibosva | so I thought what if we just brute-force close bugs that are X-years old or older, and do some periodic bug scrubbing of low priority/wishlist bugs | 14:33 |
| jlibosva | it seems we did good job with triaging so we have usually the importance set | 14:34 |
| lajoskatona | isn't there some launchpad macro or setting for that? | 14:34 |
| haleyb | jlibosva: i think that is a good idea | 14:34 |
| ykarel | +1 sounds good, like we do auto abandon for reviews which are stale | 14:34 |
| jlibosva | I don't know that, I wanted to bring up this idea as it seems if the bug count is steady over cycles then it is not gonna change and we have to do something differently :) | 14:34 |
| jlibosva | there is also the "heat" of bugs which seems to be mostly low (6) in most cases | 14:35 |
| lajoskatona | +1 | 14:35 |
| jlibosva | and if some bug we close was actually important and bothered people, it's eventually gonna come back to us | 14:35 |
| haleyb | i know there is an abandon script for reviews at least, and i've seen bugs get closed, maybe depends on state? | 14:35 |
| jlibosva | I haven't inspected the tooling :) sorry | 14:36 |
| haleyb | jlibosva: right, and we can close with that type of comment "please re-open if necessary..." | 14:36 |
| jlibosva | yep | 14:36 |
| ykarel | i think incomplete bugs get cloes automatically after some time | 14:36 |
| jlibosva | so my idea was having like two buckets - old bugs and low/whishlist bugs | 14:36 |
| haleyb | we only have tools/abandon_old_reviews.sh | 14:36 |
| jlibosva | the old bugs closed automatically - that would put us to roughly 270 bugs to go over manually | 14:37 |
| ihrachys | this is a good idea; close and ask to reopen if can reproduce on latest. for scrubbing - will need space allocated for this somewhere. | 14:37 |
| jlibosva | right, so for example this meeting got to open agenda half way through. maybe we could use the extra half hour or do some dedicated meeting - like CI meeting | 14:38 |
| ihrachys | maybe PTL could declare a bug fest maybe and we would block the time for this as a group | 14:38 |
| haleyb | ihrachys: bug fest is every day! :) | 14:39 |
| ihrachys | it's every day, then it's never the day :) | 14:39 |
| haleyb | last cycle we did have review day(s), i am fine doing a bug fest if people find it useful | 14:39 |
| haleyb | the other option if have the weekly bug deputy close XX old bugs during their cycle | 14:40 |
| lajoskatona | for me the later one can also work | 14:42 |
| haleyb | ihrachys: i do like the bug fest idea, just have to make sure to not duplicate effort, like two people looking at same bug (if even for 10 minutes), then closing | 14:43 |
| jlibosva | or every contributor can check "Assigned bugs" - there is a filter prepared - like I just looked and I have some, maybe I'm the only one, dunno - but maybe we could just get back to those that are assigned to us | 14:43 |
| jlibosva | in my case it's just that I forgot and never got back, or had a patch that got merged but LP was not updated, or patch abandoned but LP remained in In Progress | 14:43 |
| haleyb | jlibosva: ack, that would be a good idea for everyone, especially with caracal release the bot should have closed anything that merged | 14:45 |
| haleyb | i know rodolfo had a list of bugs he closed in an etherpad, i can create one or a query with "stale" bugs | 14:46 |
| haleyb | and then can pick a day/days for people to look and close | 14:47 |
| haleyb | jlibosva: thanks for the suggestion, I will work on something official, at minimum we should have a >5 years type query | 14:48 |
| jlibosva | ack, thank you | 14:48 |
| lajoskatona | thanks for the discussion and ideas | 14:49 |
| haleyb | any other topics? | 14:50 |
| haleyb | if not there is CI meeting in :10 | 14:50 |
| haleyb | ykarel: video or irc? | 14:50 |
| ykarel | video | 14:50 |
| haleyb | ok, thanks everyone for coming | 14:51 |
| haleyb | #endmeeting | 14:51 |
| opendevmeet | Meeting ended Tue Apr 16 14:51:23 2024 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:51 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/networking/2024/networking.2024-04-16-14.00.html | 14:51 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/networking/2024/networking.2024-04-16-14.00.txt | 14:51 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/networking/2024/networking.2024-04-16-14.00.log.html | 14:51 |
| lajoskatona | o/ | 14:51 |
| jlibosva | o/ | 14:51 |
| ykarel | #startmeeting neutron_ci | 15:00 |
| opendevmeet | Meeting started Tue Apr 16 15:00:56 2024 UTC and is due to finish in 60 minutes. The chair is ykarel. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
| opendevmeet | The meeting name has been set to 'neutron_ci' | 15:00 |
| ykarel | Ping list: bcafarel, lajoskatona, mlavalle, mtomaska, ralonsoh, ykarel, jlibosva, elvira | 15:01 |
| ykarel | This will be video meeting today: https://meetpad.opendev.org/neutron-ci-meetings | 15:01 |
| lajoskatona | o/ | 15:01 |
| ykarel | #topic Actions from previous meetings | 15:04 |
| ykarel | ykarel to compile list of failure cases and see if those can be marked unstable until we have a fix | 15:04 |
| ykarel | https://review.opendev.org/c/openstack/neutron/+/915990 | 15:04 |
| ykarel | slaweq to drop tobiko jobs from unmaintained branches | 15:05 |
| ykarel | https://review.opendev.org/q/topic:%22clean-tobiko-job%22 | 15:05 |
| ykarel | #topic Stable branches | 15:06 |
| ykarel | all good, not much activity | 15:06 |
| ykarel | #topic Stadium projects | 15:06 |
| ykarel | fwaas https://zuul.openstack.org/build/33f4325296024161918112d2a740e593 | 15:06 |
| ykarel | #action lajoskatona to file a bug for fwass intermittent failure and reach out to someone involved | 15:08 |
| ykarel | #topic Rechecks | 15:08 |
| ykarel | #topic fullstack/functional | 15:09 |
| ykarel | NetowrkInterfaceNotFound | 15:09 |
| ykarel | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_70c/periodic/opendev.org/openstack/neutron/master/neutron-functional/70cc2a4/testr_results.html | 15:09 |
| ykarel | https://b12a720b4c5befd8c201-325b4a96905c9937625b58a50d186e45.ssl.cf5.rackcdn.com/periodic/opendev.org/openstack/neutron/master/neutron-functional-with-sqlalchemy-master/e2237a2/testr_results.html | 15:09 |
| ykarel | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_0a2/periodic/opendev.org/openstack/neutron/master/neutron-functional-with-oslo-master/0a26fff/testr_results.html | 15:09 |
| ykarel | test_ovn_nb_sync_off | 15:09 |
| ykarel | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_7f6/periodic/opendev.org/openstack/neutron/master/neutron-functional-with-pyroute2-master/7f6e7f8/testr_results.html | 15:09 |
| ykarel | #action mlavalle to check failures in test_ovn_nb_sync_off functional test | 15:10 |
| ykarel | #topic Tempest/Scenario | 15:10 |
| ykarel | kernel panic | 15:10 |
| ykarel | https://a8454a07cbd3a00ca0e4-1c1963d5eb36b08098ebf82f40f554d5.ssl.cf5.rackcdn.com/periodic/opendev.org/openstack/neutron/master/neutron-ovn-tempest-with-neutron-lib-master/b0159ac/testr_results.html | 15:10 |
| ykarel | #action ykarel to push cirros image switch for kernel panic | 15:12 |
| ykarel | test_create_and_update_port_with_dns_name | 15:12 |
| ykarel | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_b51/914260/2/gate/neutron-tempest-plugin-openvswitch-enforce-scope-old-defaults/b51575b/testr_results.html | 15:12 |
| ykarel | https://a2cd5747e9df40c0c253-4cf4bb096d4774f141f32d30757edf40.ssl.cf5.rackcdn.com/915467/1/check/neutron-tempest-plugin-openvswitch-enforce-scope-old-defaults/b6aae17/testr_results.html | 15:12 |
| ykarel | #action to check metadata failures in enforce-scope-old-defautls job | 15:14 |
| ykarel | #topic Periodic | 15:14 |
| ykarel | https://zuul.openstack.org/builds?job_name=neutron-ovn-tempest-ovs-release-fips&job_name=neutron-functional-with-uwsgi-fips&branch=stable%2F2024.1 | 15:14 |
| ykarel | https://softwarefactory-project.io/r/c/software-factory/sf-infra/+/31311 | 15:15 |
| ykarel | https://zuul.openstack.org/builds?job_name=ironic-tempest-ipa-wholedisk-bios-agent_ipmitool-tinyipa&project=openstack%252Fneutron&branch=unmaintained%252Fwallaby | 15:15 |
| ykarel | #action lajoskatona to send patch to drop ironic job from unmaintained/wallaby | 15:17 |
| ykarel | https://zuul.openstack.org/builds?job_name=neutron-tempest-mariadb-full&job_name=neutron-tempest-postgres-full&branch=unmaintained%2Fvictoria&skip=0 | 15:18 |
| ykarel | #action lajoskatona to push patch to drop failing jobs in victoria | 15:19 |
| ykarel | #topic Grafana | 15:19 |
| ykarel | https://grafana.opendev.org/d/f913631585/neutron-failure-rate | 15:19 |
| ykarel | #topic On Demand | 15:20 |
| ykarel | #endmeeting | 15:20 |
| opendevmeet | Meeting ended Tue Apr 16 15:20:49 2024 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:20 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/neutron_ci/2024/neutron_ci.2024-04-16-15.00.html | 15:20 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/neutron_ci/2024/neutron_ci.2024-04-16-15.00.txt | 15:20 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/neutron_ci/2024/neutron_ci.2024-04-16-15.00.log.html | 15:20 |
| *** haleyb_ is now known as haleyb | 15:27 | |
| ykarel | :x | 15:41 |
| opendevreview | Merged openstack/neutron stable/2024.1: Fixing the 500 HTTP code in the metadata service if Nova is down https://review.opendev.org/c/openstack/neutron/+/914260 | 16:04 |
| elodilles | bcafarel: hi, i saw that you were sad about not being member of openstack-unmaintained-core group so I've added you o:) i hope that's not a problem o:) Such experienced stable maintainers as you, are always welcome among the 'unmaintainers' :) | 16:28 |
| ykarel | samcat116, i think would be good to report a launchpad bug https://bugs.launchpad.net/neutron/ with details about setup, neutron/nova configurations, OpenStack version, Tracebacks, any relevant logs(with debug enabled), reproducibility, etc. | 16:29 |
| *** ykarel is now known as ykarel|away | 16:30 | |
| samcat116 | I think its essentially this bug: https://bugs.launchpad.net/nova/+bug/1931707, however I don't know if its on the neutron or nova side | 16:51 |
| samcat116 | I can reproduce it far more often than described in that bug, hit 150/1000 vms yesterday | 16:51 |
| opendevreview | Merged openstack/neutron master: Mark L3HA dvr tests unstable https://review.opendev.org/c/openstack/neutron/+/915990 | 17:15 |
| opendevreview | Merged openstack/neutron unmaintained/xena: Remove tobiko job from the periodic queue https://review.opendev.org/c/openstack/neutron/+/914976 | 17:15 |
| opendevreview | Merged openstack/neutron unmaintained/wallaby: Remove tobiko job from the periodic queue https://review.opendev.org/c/openstack/neutron/+/914977 | 17:15 |
| *** dmellado03 is now known as dmellado0 | 20:22 | |
| opendevreview | Merged openstack/networking-bgpvpn stable/2023.1: [CI][stable-only] drop tripleo job https://review.opendev.org/c/openstack/networking-bgpvpn/+/915940 | 20:30 |
| opendevreview | Brian Haley proposed openstack/neutron stable/zed: Fix KeyError failure in _sync_subnet_dhcp_options() https://review.opendev.org/c/openstack/neutron/+/915956 | 20:57 |
| opendevreview | Merged openstack/neutron master: More precise flow table cleaning https://review.opendev.org/c/openstack/neutron/+/915302 | 21:47 |
| opendevreview | Merged openstack/neutron master: Use native IntOpt for overlay_ip_version https://review.opendev.org/c/openstack/neutron/+/915206 | 21:47 |
| *** dmitriis is now known as Guest1333 | 23:06 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!