| opendevreview | Takashi Kajinami proposed openstack/neutron master: Replace deprecated is_advsvc https://review.opendev.org/c/openstack/neutron/+/931574 | 06:57 |
|---|---|---|
| opendevreview | Takashi Kajinami proposed openstack/neutron-lib master: Replace deprecated is_advsvc https://review.opendev.org/c/openstack/neutron-lib/+/931613 | 06:59 |
| opendevreview | Aleksandr Chudinov proposed openstack/neutron master: [OVN] Update lsp host id when cr port is updated with chassis https://review.opendev.org/c/openstack/neutron/+/931632 | 10:09 |
| ralonsoh | slaweq, hello! if you have 1 min, please check https://review.opendev.org/c/openstack/neutron/+/931015 | 10:29 |
| ralonsoh | thanks! | 10:29 |
| opendevreview | Takashi Kajinami proposed openstack/neutron master: Replace deprecated is_advsvc https://review.opendev.org/c/openstack/neutron/+/931574 | 10:41 |
| slaweq | ralonsoh approved | 10:49 |
| ralonsoh | slaweq, thanks! | 10:49 |
| opendevreview | Aleksandr Chudinov proposed openstack/neutron master: [OVN] Update lsp host id when cr port is updated with chassis https://review.opendev.org/c/openstack/neutron/+/931632 | 10:53 |
| opendevreview | Aleksandr Chudinov proposed openstack/neutron master: [OVN] Update lsp host id when cr port is updated with chassis https://review.opendev.org/c/openstack/neutron/+/931632 | 10:53 |
| opendevreview | Rodolfo Alonso proposed openstack/neutron master: WIP == Add extension "uplink-status-propagation-updatable" https://review.opendev.org/c/openstack/neutron/+/931641 | 10:58 |
| opendevreview | Merged openstack/neutron master: Set distributed flag to NB_Global https://review.opendev.org/c/openstack/neutron/+/931067 | 11:50 |
| *** jlibosva is now known as Guest5660 | 12:15 | |
| opendevreview | Rodolfo Alonso proposed openstack/neutron master: [OVN] Check metadata HA proxy configuration before restart https://review.opendev.org/c/openstack/neutron/+/929604 | 12:59 |
| opendevreview | Rodolfo Alonso proposed openstack/neutron master: [OVN] Check metadata HA proxy configuration before restart https://review.opendev.org/c/openstack/neutron/+/929604 | 13:08 |
| *** ykarel_ is now known as ykarel | 14:01 | |
| ykarel | #startmeeting neutron_ci | 14:02 |
| opendevmeet | Meeting started Mon Oct 7 14:02:05 2024 UTC and is due to finish in 60 minutes. The chair is ykarel. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:02 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:02 |
| opendevmeet | The meeting name has been set to 'neutron_ci' | 14:02 |
| ykarel | Ping list: bcafarel, lajoskatona, slawek, mlavalle, mtomaska, ralonsoh, ykarel, jlibosva, elvira | 14:02 |
| ralonsoh | hello! | 14:02 |
| ralonsoh | IRC today, right? | 14:02 |
| ykarel | yeap | 14:03 |
| slaweq | hi | 14:03 |
| ykarel | k i think we can start, low on attendance today | 14:06 |
| ykarel | #topic Actions from previous meetings | 14:06 |
| ykarel | ralonsoh to check failure with fips job in 2023.1 and zed | 14:06 |
| ralonsoh | #link https://review.opendev.org/q/topic:%22bug/2083482%22 | 14:06 |
| ykarel | thx ralonsoh | 14:07 |
| ykarel | slaweq to check UT failure 2081868 | 14:07 |
| slaweq | I did patch https://review.opendev.org/c/openstack/neutron/+/931036 | 14:07 |
| slaweq | hopefully if same issue will happen next time, it will tell us more about real error returned from the server | 14:08 |
| ykarel | k merged already, thx slaweq | 14:08 |
| ykarel | ykarel checking with #rdo for 2024.2 centos 9-stream failures | 14:08 |
| ykarel | a WIP patch https://review.opendev.org/c/openstack/devstack/+/930913 is there | 14:09 |
| ykarel | also RDO about to be released in coming days that should also resolve this | 14:09 |
| ykarel | #topic Stable branches | 14:09 |
| ykarel | no much activity on stable this week | 14:10 |
| ykarel | there were failures in periodic failures but those are known ones | 14:10 |
| ykarel | #topic Stadium projects | 14:10 |
| ykarel | all green in periodics | 14:10 |
| ykarel | lajoskatona seems not around, if we have any other update for stadiums | 14:11 |
| ykarel | #topic Rechecks | 14:11 |
| ykarel | not bad, we had 6/38 bare rechecks | 14:12 |
| ykarel | 2 of these were mine in a test patch :( | 14:12 |
| ralonsoh | hehehe | 14:12 |
| ykarel | #topic fullstack/functional | 14:13 |
| ykarel | fullstack MismatchError: 2 != 1: More than one active HA routers https://bugs.launchpad.net/neutron/+bug/2083609 | 14:13 |
| ykarel | we have seen couple of failures for this | 14:13 |
| slaweq | I can try to take a look if I will have some time | 14:13 |
| ralonsoh | yeah, I'll try to check it this week | 14:14 |
| ykarel | ralonsoh do you recall this? i recall u mentioned you seen that in some of your test patch? | 14:14 |
| ralonsoh | yes, in the WSGI one | 14:14 |
| ralonsoh | (hmmm maybe no..., I need to check that) | 14:14 |
| ralonsoh | I'll debug it this week | 14:14 |
| ykarel | ok so whom should i assign this, 2 volunteers :) | 14:14 |
| ralonsoh | sorry, I didn't see slaweq comment! | 14:15 |
| ralonsoh | my bad (replying in other window in another chat) | 14:15 |
| slaweq | please assign to my as ralonsoh already have a lot of things on his plate | 14:16 |
| ykarel | k thx | 14:16 |
| ykarel | #action slawek to check https://bugs.launchpad.net/neutron/+bug/2083609 | 14:16 |
| slaweq | thx | 14:16 |
| ykarel | functional Too many open files https://bugs.launchpad.net/neutron/+bug/2080199 | 14:16 |
| ykarel | we still hitting this | 14:16 |
| slaweq | there was patch from ralonsoh I think to close ovsdb connections in tests, no? | 14:17 |
| ykarel | ralonsoh, i commented on your patch , can you confirm that | 14:17 |
| slaweq | shouldn't it help maybe for this? | 14:17 |
| ralonsoh | yes but this is not enough | 14:17 |
| ralonsoh | it reduces the number of files, but not all | 14:17 |
| ralonsoh | we should increase the limit | 14:18 |
| ykarel | k thx for confirming, as i saw multiple failures in test patches | 14:18 |
| ykarel | ok so should we revise https://review.opendev.org/c/openstack/neutron/+/928759 and get that in? | 14:18 |
| ykarel | i commented what worked for increasing ulimit persistantly | 14:19 |
| ralonsoh | cool | 14:20 |
| ykarel | k then will update that patch | 14:20 |
| ralonsoh | rebase on top of master | 14:20 |
| ralonsoh | to have mine too | 14:20 |
| ykarel | ++ | 14:20 |
| ykarel | #topic Tempest/Scenario | 14:21 |
| ykarel | neutron api fail while creating resources devstack setup https://bugs.launchpad.net/neutron/+bug/2083570 | 14:21 |
| ykarel | tempest failure deleting router port https://bugs.launchpad.net/neutron/+bug/2083287 | 14:21 |
| ykarel | these also seen multiple times, and with timing seems related to wsgi switch patches | 14:21 |
| ykarel | but would need to be confirmed | 14:21 |
| ykarel | seen only in master as of now | 14:21 |
| ralonsoh | we have migrated only the OVS jobs | 14:22 |
| ralonsoh | the OVN patch is still in gerrit (and every time I recheck there is a new failure, not only in master) | 14:23 |
| lajoskatona | o/ | 14:23 |
| ykarel | mmm but i have seen some ovn parent jobs modified | 14:23 |
| ykarel | https://review.opendev.org/c/openstack/neutron/+/924317 | 14:23 |
| ralonsoh | right, in Neutron, but most of the jobs are in the n-t-p patch | 14:24 |
| ralonsoh | but yes, we have some OVN jobs | 14:24 |
| ykarel | and the above failures are seen only on those modified jobs | 14:24 |
| ralonsoh | so that's a big problem... | 14:24 |
| ralonsoh | we need wsgi API working fine | 14:25 |
| ykarel | yes | 14:25 |
| ykarel | k thx it could be related than to the switch | 14:26 |
| ykarel | so we could revert that for time being to unblock gate | 14:27 |
| ykarel | ok ? or you see it could be fixed easily? | 14:28 |
| ralonsoh | tomorrow morning I'll debug it and ping you | 14:28 |
| ralonsoh | I'll take this as high priority | 14:28 |
| ykarel | thx ralonsoh | 14:28 |
| ykarel | #action ralonsoh to check for issues triggered by wsgi switch | 14:29 |
| ykarel | #topic Grafana | 14:29 |
| ykarel | https://grafana.opendev.org/d/f913631585/neutron-failure-rate | 14:29 |
| ykarel | let's also have quick look here | 14:29 |
| lajoskatona | the unit test graph seems quite empty, perhaps because it waits for py311, and now we have py312? | 14:31 |
| ykarel | gate queue has few spikes and all those mentioned above, basically fullstack, functional and those api calls | 14:32 |
| haleyb | do we need to update the dashboard? jobs have changed a bit recently (and some still in progress) | 14:33 |
| ykarel | lajoskatona, haleyb yeap right, the dashboard needs update | 14:35 |
| lajoskatona | As I see yes: https://opendev.org/openstack/project-config/src/branch/master/grafana/neutron.yaml | 14:35 |
| ykarel | anyone would like to push the update to ^ ? | 14:36 |
| haleyb | i can take that | 14:36 |
| ykarel | thx haleyb | 14:36 |
| lajoskatona | I can change that, but on the dev-list there was a mail to perhaps have more py jobs between py39 and py312 | 14:36 |
| lajoskatona | so perhaps it will change in the coming weeks :-) | 14:37 |
| ykarel | #action haleyb to update grafana dashboard | 14:37 |
| ykarel | #topic On Demand | 14:37 |
| ykarel | anything you would like to raise now? | 14:37 |
| ralonsoh | no thanks | 14:38 |
| lajoskatona | nothing from me | 14:38 |
| ykarel | k i have a one | 14:38 |
| ykarel | it's regarding postgres testing | 14:38 |
| ykarel | ironic team planning to drop it https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/MVHR5WZFEDOZA4ESBN5764EVP67GKOS5/ | 14:38 |
| ralonsoh | I saw it | 14:39 |
| ralonsoh | And, to be honest, I support dropping it | 14:39 |
| ykarel | so wanted to check if we have some case for this to keep it running? | 14:39 |
| ralonsoh | we have many problems related to postgre and, to be honest, I don't know if that really works | 14:39 |
| ralonsoh | because I know there are some projects that doesn't work with this DB | 14:39 |
| slaweq | according to https://www.openstack.org/analytics/ it is used by around 5% of users | 14:40 |
| slaweq | but IMO we can maybe deprecate/remove support for it too | 14:41 |
| ralonsoh | I'll check it but I remember at least 4 issues related with this DB in the last 6 months | 14:41 |
| slaweq | maybe this should be email to the ML to ask other projects about the same and in general what community things about such move | 14:41 |
| ykarel | yeap multiple issues but all related to neutron changes | 14:41 |
| ykarel | also we can have this topic in PTG | 14:42 |
| ykarel | may be for TC ? | 14:42 |
| ralonsoh | yes, most of the times because posgre is more strict in the sql parsing | 14:42 |
| slaweq | but this should be probably topic for some session with operators, to listen their feedback about it, no? | 14:42 |
| ykarel | yes that would be better place, need to check where/when that session is | 14:44 |
| ralonsoh | agree with creating an operators feedback session | 14:44 |
| ralonsoh | haleyb, ^ | 14:44 |
| lajoskatona | +1 | 14:45 |
| ralonsoh | should that be created by TC? because this is a generic topic | 14:45 |
| ralonsoh | not only Neutron related | 14:45 |
| ralonsoh | just to open the audience target | 14:45 |
| slaweq | I don't know if there is session like that already scheduled | 14:46 |
| slaweq | but if there will be, we should add this topic there | 14:46 |
| haleyb | adding to etherpad | 14:46 |
| ralonsoh | perfect! | 14:46 |
| ykarel | thx haleyb | 14:46 |
| ykarel | i think that's it for today, thx everyone for joining | 14:47 |
| ykarel | #endmeeting | 14:47 |
| opendevmeet | Meeting ended Mon Oct 7 14:47:18 2024 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:47 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/neutron_ci/2024/neutron_ci.2024-10-07-14.02.html | 14:47 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/neutron_ci/2024/neutron_ci.2024-10-07-14.02.txt | 14:47 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/neutron_ci/2024/neutron_ci.2024-10-07-14.02.log.html | 14:47 |
| lajoskatona | Bye! | 14:47 |
| ralonsoh | bye | 14:47 |
| slaweq | bye | 14:48 |
| opendevreview | Jakub Libosvar proposed openstack/ovn-bgp-agent master: Expose FIP if external_mac was set https://review.opendev.org/c/openstack/ovn-bgp-agent/+/930784 | 15:02 |
| opendevreview | Merged openstack/neutron master: Drop usage of importlib_metadata https://review.opendev.org/c/openstack/neutron/+/931515 | 15:58 |
| opendevreview | Brian Haley proposed openstack/neutron-lib master: Use py312 for all neutron-lib jobs https://review.opendev.org/c/openstack/neutron-lib/+/931680 | 16:04 |
| haleyb | ykarel: https://review.opendev.org/c/openstack/project-config/+/931682 - there was a lot of things out of date there | 16:15 |
| opendevreview | Merged openstack/neutron master: Remove deprecated OVN LR external_id options https://review.opendev.org/c/openstack/neutron/+/931245 | 17:04 |
| opendevreview | Brian Haley proposed openstack/neutron-lib master: Use py312 for all neutron-lib jobs https://review.opendev.org/c/openstack/neutron-lib/+/931680 | 18:28 |
| opendevreview | Ihar Hrachyshka proposed openstack/neutron master: [OVN] Check metadata HA proxy configuration before restart https://review.opendev.org/c/openstack/neutron/+/929604 | 19:53 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!