*** tbachman_ is now known as tbachman | 03:53 | |
opendevreview | yatin proposed openstack/neutron master: Switch Fips fullstack/functional tests to py3.8 https://review.opendev.org/c/openstack/neutron/+/843252 | 05:32 |
---|---|---|
opendevreview | yatin proposed openstack/neutron-tempest-plugin master: Skip tempest jobs on functional roles/playbooks changes https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/843989 | 05:50 |
opendevreview | yatin proposed openstack/neutron master: Switch Fips fullstack/functional tests to py3.8 https://review.opendev.org/c/openstack/neutron/+/843252 | 05:52 |
opendevreview | yatin proposed openstack/neutron-tempest-plugin master: Skip tempest jobs on functional roles/playbooks changes https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/843989 | 06:02 |
opendevreview | yatin proposed openstack/neutron master: Skip non-functional jobs on functional roles/playbooks changes https://review.opendev.org/c/openstack/neutron/+/843992 | 06:02 |
opendevreview | yatin proposed openstack/neutron master: Switch Fips fullstack/functional tests to py3.8 https://review.opendev.org/c/openstack/neutron/+/843252 | 06:03 |
opendevreview | yatin proposed openstack/neutron stable/yoga: Switch fips scenario jobs to Centos stream 9 https://review.opendev.org/c/openstack/neutron/+/843824 | 06:17 |
opendevreview | yatin proposed openstack/neutron stable/yoga: [DNM] Test yoga switch c9-stream https://review.opendev.org/c/openstack/neutron/+/843994 | 06:37 |
opendevreview | Merged openstack/neutron stable/train: [Train Only] Do not run grenade-skip-level job https://review.opendev.org/c/openstack/neutron/+/841698 | 07:26 |
opendevreview | yatin proposed openstack/neutron master: [DNM] Test multinode ovn grenade with fixes https://review.opendev.org/c/openstack/neutron/+/836141 | 07:43 |
lucasagomes | ralonsoh, thanks so much for the review at https://review.opendev.org/c/openstack/neutron/+/840316 | 08:20 |
lucasagomes | ralonsoh, I replied to the comments inline | 08:20 |
ralonsoh | lucasagomes, checking now | 08:20 |
lucasagomes | no rush! Thank u | 08:20 |
ykarel | lajoskatona, can you readd workflow on https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/838053 | 08:29 |
ykarel | somehow it didn't went to gate after depends-on are merged | 08:30 |
lajoskatona | ykarel: let's see if flapping it helps | 08:30 |
ykarel | lajoskatona, it worked, Thanks | 08:31 |
lajoskatona | ykarel: recheck was it I think | 08:31 |
ykarel | recheck shouldn't be needed i think | 08:32 |
ykarel | if +W and zuul+1 are there | 08:32 |
ykarel | lucasagomes, can you please check https://review.opendev.org/c/openstack/networking-ovn/+/843391 | 08:35 |
frickler | ralonsoh: fyi I'm seeing sdk network job ooming since yesterday, the timing with your sqla fix seems at least suspicous, do you know if some memore impact is expected? e.g. https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_b7b/843968/1/check/openstacksdk-functional-devstack-networking/b7b0921/controller/logs/syslog.txt | 08:36 |
frickler | *memory | 08:36 |
ralonsoh | frickler, no, should be the opposite | 08:37 |
lucasagomes | ykarel, will do | 08:38 |
ralonsoh | frickler, what fix are you talking about? | 08:39 |
ykarel | Thanks lucasagomes | 08:39 |
frickler | ralonsoh: I was mainly thinking about https://review.opendev.org/c/openstack/neutron/+/842468 , because iiuc that has been the fix for some unstable failures we saw earlier | 08:40 |
frickler | ralonsoh: but in fact it could also happen the other way round: neutron faster => tempest does more things in parallel => (b)oom | 08:41 |
frickler | maybe I should try to serialize tempest in that job to see if it helps | 08:43 |
ralonsoh | frickler, there are OOM in jobs executed 4 days ago | 08:43 |
ralonsoh | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_6dd/843448/1/check/openstacksdk-functional-devstack-networking/6ddf259/controller/logs/syslog.txt | 08:44 |
ralonsoh | frickler, and this job is running with designate and octavia | 08:45 |
ralonsoh | this is a lot | 08:45 |
frickler | ralonsoh: interested, that job oomed and still testing passed. so maybe those ooms aren't as relevant as I thought | 08:46 |
ralonsoh | frickler, in neutron we stop cinder and switft | 08:47 |
ralonsoh | https://github.com/openstack/neutron/blob/master/zuul.d/tempest-multinode.yaml#L125-L135 | 08:47 |
ralonsoh | maybe that could be done in sdk too | 08:47 |
ralonsoh | at least in this job | 08:47 |
frickler | ralonsoh: yes, sounds like a good idea | 08:47 |
frickler | swift was already disabled, trying without cinder now | 08:52 |
opendevreview | Fernando Royo proposed openstack/ovn-octavia-provider stable/yoga: Fix request to OVN NB DB API https://review.opendev.org/c/openstack/ovn-octavia-provider/+/844012 | 09:06 |
opendevreview | Fernando Royo proposed openstack/ovn-octavia-provider stable/xena: Fix request to OVN NB DB API https://review.opendev.org/c/openstack/ovn-octavia-provider/+/844013 | 09:07 |
opendevreview | Fernando Royo proposed openstack/ovn-octavia-provider stable/wallaby: Fix request to OVN NB DB API https://review.opendev.org/c/openstack/ovn-octavia-provider/+/844014 | 09:09 |
ralonsoh | lucasagomes, if you have 1 min: https://review.opendev.org/c/openstack/neutron/+/843247 | 09:11 |
ralonsoh | thanks in advance | 09:11 |
lucasagomes | ralonsoh, sure will take a look | 09:12 |
opendevreview | Rodolfo Alonso proposed openstack/neutron stable/yoga: [Trunk] Check if parent port belongs to OVN to activate https://review.opendev.org/c/openstack/neutron/+/844016 | 09:19 |
opendevreview | Rodolfo Alonso proposed openstack/neutron stable/xena: [Trunk] Check if parent port belongs to OVN to activate https://review.opendev.org/c/openstack/neutron/+/844017 | 09:19 |
opendevreview | Rodolfo Alonso proposed openstack/neutron stable/wallaby: [Trunk] Check if parent port belongs to OVN to activate https://review.opendev.org/c/openstack/neutron/+/844018 | 09:19 |
opendevreview | Rodolfo Alonso proposed openstack/neutron stable/victoria: [Trunk] Check if parent port belongs to OVN to activate https://review.opendev.org/c/openstack/neutron/+/844019 | 09:20 |
opendevreview | Rodolfo Alonso proposed openstack/neutron stable/ussuri: [Trunk] Check if parent port belongs to OVN to activate https://review.opendev.org/c/openstack/neutron/+/844020 | 09:20 |
opendevreview | Merged openstack/neutron master: Check the Chassis_Private nb_cfg_timestamp with current value https://review.opendev.org/c/openstack/neutron/+/842471 | 09:20 |
*** sean-k-mooney2 is now known as sean-k-mooney | 09:49 | |
*** tbachman_ is now known as tbachman | 09:57 | |
opendevreview | Lajos Katona proposed openstack/tap-as-a-service master: Switch away from Mock auto_spec=True https://review.opendev.org/c/openstack/tap-as-a-service/+/821445 | 10:09 |
opendevreview | Rodolfo Alonso proposed openstack/neutron master: [sqlalchemy-20] Add the needed DB context decorators in ``db.api`` https://review.opendev.org/c/openstack/neutron/+/844024 | 10:28 |
ralonsoh | folks, if you have time, please check | 10:43 |
ralonsoh | https://review.opendev.org/c/openstack/neutron/+/843256 | 10:43 |
ralonsoh | https://review.opendev.org/c/openstack/neutron/+/844024 | 10:43 |
ralonsoh | thanks in advance | 10:43 |
opendevreview | Fernando Royo proposed openstack/ovn-octavia-provider master: Fix way of calculate LB status after HM event https://review.opendev.org/c/openstack/ovn-octavia-provider/+/843308 | 10:43 |
opendevreview | yatin proposed openstack/neutron stable/yoga: [DNM] Test yoga fips job https://review.opendev.org/c/openstack/neutron/+/843994 | 10:52 |
sahid | o/ ralonsoh, a gentle notice to let you know that i have replied to your comment https://review.opendev.org/c/openstack/neutron/+/839478/ | 10:53 |
ralonsoh | sahid, sure, let me check | 10:53 |
sahid | thank you, no hurry at all :-) | 10:54 |
opendevreview | Fernando Royo proposed openstack/ovn-octavia-provider master: Fix way of calculate LB status after HM event https://review.opendev.org/c/openstack/ovn-octavia-provider/+/843308 | 11:10 |
ralonsoh | sahid, you should push all patches one in top of other | 11:10 |
ralonsoh | and the server side patches should be pushed first | 11:10 |
ralonsoh | then the agent ones (DHCP, OVS, etc) | 11:11 |
opendevreview | Merged openstack/networking-ovn stable/train: Revert "Use Port_Binding up column to set Neutron port status" https://review.opendev.org/c/openstack/networking-ovn/+/843391 | 11:16 |
opendevreview | Merged openstack/ovn-octavia-provider master: Fix Load balancer remains on PENDING_CREATE https://review.opendev.org/c/openstack/ovn-octavia-provider/+/842382 | 12:19 |
sahid | ralonsoh: let me double check, my understanding is that, at that point there are no server side change, the whole point is to make in-memory datastructure able to accept different mapping, from 1:1 to 1:n, input/output of rpc should not change | 12:45 |
sahid | but I may have missed something, do you have specific pointer that you can share with me? | 12:46 |
opendevreview | Merged openstack/neutron stable/yoga: Remove session active check in "_add_segment_host_mapping_for_segment" https://review.opendev.org/c/openstack/neutron/+/843624 | 12:48 |
ralonsoh | sahid, for example: this should never happen | 12:51 |
ralonsoh | https://review.opendev.org/c/openstack/neutron/+/839479/7/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py | 12:51 |
ralonsoh | we can't try to update a segmentation ID if the network has several segments | 12:52 |
sahid | hum, yes i'm totally agree, the behavior stay the same here | 12:54 |
sahid | i'm very sorry i can see that you are trying to show me something but i'm not able to see it :-) | 12:54 |
* sahid has connection issue | 13:01 | |
opendevreview | Slawek Kaplonski proposed openstack/neutron-lib master: Rehome ovsfw constants and utils modules https://review.opendev.org/c/openstack/neutron-lib/+/839564 | 13:02 |
slaweq | ralonsoh lajoskatona mlavalle hi, when You will have few minutes, please check ^^ | 13:03 |
slaweq | thx in advance | 13:03 |
ralonsoh | slaweq, sure | 13:09 |
lajoskatona | slaweq: I will check it | 13:11 |
slaweq | thx a lot | 13:25 |
opendevreview | Fernando Royo proposed openstack/ovn-octavia-provider stable/yoga: Fix Load balancer remains on PENDING_CREATE https://review.opendev.org/c/openstack/ovn-octavia-provider/+/844055 | 13:37 |
opendevreview | Fernando Royo proposed openstack/ovn-octavia-provider stable/xena: Fix Load balancer remains on PENDING_CREATE https://review.opendev.org/c/openstack/ovn-octavia-provider/+/844056 | 13:38 |
opendevreview | Fernando Royo proposed openstack/ovn-octavia-provider stable/wallaby: Fix Load balancer remains on PENDING_CREATE https://review.opendev.org/c/openstack/ovn-octavia-provider/+/844057 | 13:38 |
opendevreview | Fernando Royo proposed openstack/ovn-octavia-provider stable/victoria: Fix Load balancer remains on PENDING_CREATE https://review.opendev.org/c/openstack/ovn-octavia-provider/+/844058 | 13:39 |
*** whoami-rajat__ is now known as whoami-rajat | 13:42 | |
opendevreview | Fernando Royo proposed openstack/ovn-octavia-provider stable/ussuri: Fix Load balancer remains on PENDING_CREATE https://review.opendev.org/c/openstack/ovn-octavia-provider/+/844059 | 13:45 |
opendevreview | Rodolfo Alonso proposed openstack/neutron master: [sqlalchemy-20] Add the needed DB context decorators in ``db.api`` https://review.opendev.org/c/openstack/neutron/+/844024 | 13:49 |
lajoskatona | #startmeeting networking | 14:00 |
opendevmeet | Meeting started Tue May 31 14:00:24 2022 UTC and is due to finish in 60 minutes. The chair is lajoskatona. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
opendevmeet | The meeting name has been set to 'networking' | 14:00 |
mlavalle | o/ | 14:00 |
lajoskatona | o/ | 14:00 |
isabek__ | hi | 14:00 |
ralonsoh | hi | 14:00 |
haleyb | hi | 14:00 |
slaweq | hi | 14:00 |
bcafarel | o/ | 14:01 |
lajoskatona | Let's start it :-) | 14:02 |
lajoskatona | #topic Announcements | 14:02 |
amotoki | hi | 14:02 |
rubasov | o/ | 14:02 |
elvira | hi! | 14:02 |
obondarev | hi | 14:02 |
lajoskatona | The usual Zed schedule: https://releases.openstack.org/zed/schedule.html | 14:02 |
lajoskatona | And I repeat the release countdown mail for week R-19, May 23 - 27: http://lists.openstack.org/pipermail/openstack-discuss/2022-May/028616.html | 14:02 |
lajoskatona | as this one was the last, and I treat this as stll actual | 14:03 |
ykarel | hi | 14:03 |
lajoskatona | for relase things, please keep an eye on create EOL tags for neutron-vpnaas: #link https://review.opendev.org/c/openstack/releases/+/843167 | 14:04 |
lajoskatona | It's actually hanging because Dmitriy Rabotyagov ( noonedeadpunk ) asked to keep Victoria alive | 14:04 |
lajoskatona | and elodilles asked to double check old legacy jobs and delete them before eoling any branch | 14:05 |
lajoskatona | I would like to ask your opinion before sending out mail about EOL queens, rocky, stein branches for stadiums | 14:06 |
ralonsoh | I have no objection | 14:07 |
bcafarel | as far as I remember these branches for stadium were *really* quiet for a while already | 14:07 |
lajoskatona | as neutron-dynamic-routing already closed perhaps till train, and vpnaas is on its way to EOL also some branch | 14:07 |
lajoskatona | bcafarel: exactly and perhaps we can safe some CPU cycles with the deletion of those old periodic jobs | 14:07 |
lajoskatona | if we have any for them | 14:07 |
mlavalle | +1 | 14:08 |
slaweq | +1 from me | 14:08 |
lajoskatona | ok, thanks | 14:08 |
bcafarel | +1 also asking for EOL sounds good we will see if there is any interest for these branches | 14:08 |
lajoskatona | I will send out mails about it | 14:08 |
obondarev | +1 | 14:08 |
amotoki | +1 | 14:08 |
ykarel | +1 | 14:08 |
lajoskatona | Next announcement: | 14:09 |
lajoskatona | Propose Yatin Karel, ykarel for Neutron core team | 14:09 |
lajoskatona | http://lists.openstack.org/pipermail/openstack-discuss/2022-May/028659.html | 14:09 |
lajoskatona | I close the voting and welcome ykarel in the team:-) | 14:10 |
ralonsoh | ykarel congrats! | 14:10 |
bcafarel | congratulations ykarel!!! | 14:10 |
amotoki | ykarel: congrats | 14:10 |
mlavalle | congrats to the new core team member. Welcome! | 14:10 |
elvira | congratulations ykarel! | 14:10 |
lajoskatona | ykarel: thanks for your help with keeping things running :-) | 14:10 |
slaweq | ykarel congrats! | 14:10 |
ykarel | Thanks all \o/ | 14:11 |
obondarev | welcome ykarel! | 14:11 |
lajoskatona | Is there any questions, comments for announcements? | 14:12 |
lajoskatona | then let's move on | 14:12 |
lajoskatona | #topic Bugs | 14:13 |
lajoskatona | Report from bcafarel: #link http://lists.openstack.org/pipermail/openstack-discuss/2022-May/028738.html | 14:13 |
lajoskatona | I saw perhaps 2 without owner: | 14:13 |
lajoskatona | Neutron RBAC not sharing subnet - #link https://bugs.launchpad.net/neutron/+bug/1975603 | 14:13 |
bcafarel | this one has potential fix at https://review.opendev.org/c/openstack/neutron/+/843871 but needs review (amorin noted it may re-introduce old bug) | 14:15 |
slaweq | TBH for me it's not even a bug but more like improvement | 14:15 |
lajoskatona | The question is something like this: I have a router from tenant A, and a subnet on a shared (with network rbac API) net from tenant B, if I try to add the subnet to router it fails | 14:15 |
slaweq | as we never said that subnets are supported by RBAC | 14:16 |
ralonsoh | slaweq, subnets should mimic the network RBAC | 14:16 |
ralonsoh | but yes, this should be consider an improvement | 14:16 |
lajoskatona | ralonsoh: yeah that was my first idea also, but I feel gaps which I don't see exactly here :-) | 14:16 |
amotoki | I think the workaround is to create a port in the shared subnet and then add it to a router. | 14:16 |
amotoki | the difference is a gateway is used or not. | 14:16 |
slaweq | I think it's similar to what we have with SG and SG rules | 14:17 |
lajoskatona | amotoki: sounds interesting | 14:17 |
slaweq | it's similar problem | 14:17 |
ralonsoh | ^^ right | 14:17 |
mlavalle | so make net / subnets behavior parallel to sg / sg rules as far as rbac | 14:17 |
lajoskatona | I will check this workaround and discuss it with amorin and check how sg sg rule sharing works to see the difference | 14:18 |
lajoskatona | but I agree to have both work the same way | 14:18 |
lajoskatona | ok, thanks I check it with amorin and check it more | 14:19 |
mlavalle | maybe continue the conersation in amorin's patch? | 14:19 |
lajoskatona | mlavalle: sure I will check that also (I just seen that amorin pushed a patch) | 14:19 |
mlavalle | I want to know what happens :-) | 14:19 |
lajoskatona | mlavalle: :-) being informed is important | 14:20 |
lajoskatona | The next bug which I found: | 14:21 |
lajoskatona | difference in execution time between admin/non-admin call - #link https://bugs.launchpad.net/neutron/+bug/1975828 | 14:21 |
lajoskatona | this is let's say the 2nd part of https://bugs.launchpad.net/neutron/+bug/1973349 (Slow queries after upgrade to Xena ) | 14:22 |
ralonsoh | I still need to reproduce it and check why is this happening | 14:22 |
ralonsoh | the first part is solved | 14:22 |
lajoskatona | ralonsoh: thanks, yes I was looking for the patch for it | 14:23 |
ralonsoh | https://review.opendev.org/c/openstack/neutron/+/841761 | 14:23 |
lajoskatona | thanks for checking it | 14:23 |
mlavalle | is this latest bug with master? | 14:23 |
ralonsoh | no idea, I still need to check it | 14:23 |
lajoskatona | mlavalle: the original bug was reported for Xena | 14:24 |
mlavalle | yeah, I realize that, but this latter bug doesn't specify | 14:25 |
lajoskatona | mlavalle: my mistake, I just blindly copy-pasted the 2nd question from the original one | 14:25 |
mlavalle | ok, I will assume Xena | 14:26 |
mlavalle | let's move on | 14:26 |
lajoskatona | bcafarel: is there anything more to discuss from last week's bugs? | 14:26 |
bcafarel | lajoskatona: all good I had the same 2 bugs in my "to mention" list - others have patches merged or well in the review process | 14:26 |
opendevreview | yatin proposed openstack/neutron master: [DNM][FT] debug logs https://review.opendev.org/c/openstack/neutron/+/843791 | 14:27 |
lajoskatona | bcafarel: thanks, sounds good | 14:27 |
lajoskatona | ok, let's move | 14:27 |
lajoskatona | This week haleyb is the deputy and next week amotoki will be. | 14:27 |
lajoskatona | amotoki: is that works for you? | 14:27 |
amotoki | lajoskatona: works for me | 14:27 |
lajoskatona | amotoki: ok, thanks :-) | 14:27 |
lajoskatona | #topic On Demand Agenda | 14:28 |
lajoskatona | Is there anything you would like to discuss? | 14:28 |
amotoki | i have one small thing | 14:28 |
lajoskatona | amotoki: please tell us | 14:29 |
amotoki | regarding vpnaas, mnaser proposed the removal of feature/lbaasv2. it is a part of branch cleanup | 14:29 |
amotoki | https://lists.openstack.org/pipermail/openstack-discuss/2022-May/028683.html | 14:29 |
amotoki | it looks fine to drop the branch without tagging the head | 14:29 |
amotoki | as it was covered by the corresponding branch in the neutron repo completely (as already mentioned in the ML thread). | 14:29 |
amotoki | I would like to double check it here in our meeting | 14:30 |
amotoki | thought? | 14:30 |
lajoskatona | amotoki: good that you mentioned it. thanks | 14:30 |
lajoskatona | I just checked your comments, and your memories looks correct, it really looks like it was a step to cut out fwaas | 14:31 |
amotoki | lajoskatona: exactly | 14:31 |
amotoki | we applied the same process when we split out advanced services. it is true for vpnaas, fwaas, lbaas and dynamic-routing | 14:32 |
lajoskatona | this week when I checked other stadiums found similar branches so I have to double check, and perhaps we can remove those also, I will mention them in the mail for EOL-ing old branches | 14:32 |
amotoki | lajoskatona: +1 | 14:32 |
lajoskatona | if there's no more topics we can close for today | 14:34 |
liuyulong | #link https://review.opendev.org/q/topic:packet_rate_limit Hi guys, request for review again, it is fine to get in now. Thank you for your time. : ) | 14:34 |
lajoskatona | liuyulong: welcome, I will check again for sure the hanging ones | 14:34 |
liuyulong | New features with no harm to existing code, so it is safe to get merged. | 14:35 |
liuyulong | lajoskatona, Thank you. : ) | 14:35 |
opendevreview | Fernando Royo proposed openstack/ovn-octavia-provider stable/ussuri: Fix Load balancer remains on PENDING_CREATE https://review.opendev.org/c/openstack/ovn-octavia-provider/+/844059 | 14:37 |
lajoskatona | Let's save ~23 minutes then:-) | 14:37 |
bcafarel | \o/ | 14:37 |
lajoskatona | #endmeeting | 14:37 |
opendevmeet | Meeting ended Tue May 31 14:37:22 2022 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:37 |
opendevmeet | Minutes: https://meetings.opendev.org/meetings/networking/2022/networking.2022-05-31-14.00.html | 14:37 |
opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/networking/2022/networking.2022-05-31-14.00.txt | 14:37 |
opendevmeet | Log: https://meetings.opendev.org/meetings/networking/2022/networking.2022-05-31-14.00.log.html | 14:37 |
slaweq | o/ | 14:37 |
lajoskatona | o/ | 14:37 |
ralonsoh | bye | 14:37 |
rubasov | o/ | 14:37 |
amotoki | o/ | 14:37 |
mlavalle | o/ | 14:37 |
ykarel | o/ | 14:37 |
elvira | o/ | 14:37 |
obondarev | o/ | 14:38 |
*** elvira1 is now known as elvira | 14:46 | |
slaweq | #startmeeting neutron_ci | 15:00 |
opendevmeet | Meeting started Tue May 31 15:00:11 2022 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
opendevmeet | The meeting name has been set to 'neutron_ci' | 15:00 |
bcafarel | o/ again | 15:00 |
slaweq | ralonsoh lajoskatona bcafarel ykarel obondarev mlavalle ping, CI meeting is starting | 15:01 |
ralonsoh | hi sorry | 15:01 |
obondarev | hi | 15:01 |
ykarel | o/ | 15:01 |
mlavalle | o/ | 15:01 |
lajoskatona | Hi | 15:02 |
slaweq | ok, lets start as we have quorum already | 15:02 |
slaweq | Grafana dashboard: https://grafana.opendev.org/d/f913631585/neutron-failure-rate?orgId=1 | 15:02 |
slaweq | #topic Actions from previous meetings | 15:03 |
slaweq | mlavalle to propose making things not supported framework in Neutron | 15:03 |
mlavalle | didn't make progress on that last week. I'll work on it this week | 15:03 |
slaweq | ok | 15:03 |
slaweq | #action mlavalle to propose making things not supported framework in Neutron | 15:04 |
slaweq | lets not forget about it :) | 15:04 |
slaweq | next one | 15:04 |
slaweq | ykarel will propose to use other cirros image to avoid kernel panics | 15:04 |
ykarel | Done https://review.opendev.org/q/I34f3bbf7d30ddce23758ffb513abff0500b1fad6 | 15:04 |
ykarel | merged till wallaby | 15:05 |
slaweq | thx a lot | 15:05 |
ykarel | do we need to backport to older branches too | 15:05 |
opendevreview | Rodolfo Alonso proposed openstack/neutron master: [WIP] Skip "PortBindingChassisEvent" if revision number changes https://review.opendev.org/c/openstack/neutron/+/842147 | 15:05 |
ykarel | for singlenodes jobs also it was backported till wallaby, so i did same to multinodes | 15:05 |
slaweq | I think it's enough | 15:06 |
ykarel | k | 15:06 |
slaweq | next one | 15:06 |
slaweq | ykarel to check fips issues in periodic jobs https://zuul.openstack.org/build/8a3af48f193141feb6e5dd496e66e58a | 15:06 |
ykarel | i checked that and pushed https://review.opendev.org/c/openstack/neutron/+/843245 to switch those jobs to c9-stream | 15:07 |
ykarel | but faced couple of issues and reported https://bugs.launchpad.net/neutron/+bug/1976323 | 15:07 |
ykarel | and to unblock this job until all issues in c9-stream are fixed pushed https://review.opendev.org/c/openstack/neutron/+/843252 | 15:07 |
ykarel | to use python3.8 in c8-stream itself | 15:07 |
ykarel | this is working fine | 15:07 |
lajoskatona | ykarel: nice one | 15:08 |
ykarel | also noticed scenario fips job in yoga broken due to py3.6+ tempest master | 15:08 |
slaweq | ykarel thx, I can assign that bug to myself and work on this centos9 stream issues | 15:08 |
ykarel | pushed https://review.opendev.org/c/openstack/neutron/+/843824 | 15:08 |
ykarel | slaweq, okk, i didn't digged much, just checked functional issues are reproducable locally | 15:09 |
slaweq | k, I will deploy box with c9s and will work on it | 15:10 |
slaweq | for now using py38 and c8s should be enough IMO | 15:10 |
ykarel | ack | 15:10 |
slaweq | #action slaweq to fix functiona/fullstack failures on centos 9 stream: https://bugs.launchpad.net/neutron/+bug/1976323 | 15:10 |
slaweq | so last AI from last week: | 15:11 |
slaweq | lajoskatona to update UT periodic jobs to use at least py38 | 15:11 |
lajoskatona | I checked, but was slow and gmann fixed it before me: | 15:11 |
lajoskatona | https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/842646 | 15:11 |
slaweq | thx gmann and lajoskatona :) | 15:12 |
lajoskatona | I just run after the events :-) | 15:12 |
slaweq | ok, so that were all AI from last week | 15:12 |
slaweq | I think we can move on | 15:13 |
slaweq | #topic Stable branches | 15:13 |
slaweq | any news here bcafarel | 15:13 |
bcafarel | let's see, wallaby and newer are good | 15:13 |
bcafarel | for older branches you probably saw the gate issue mail (dropped py36 in tempest etc) - thanks gmann for working on these fixes | 15:13 |
gmann | devstack patches merged now | 15:14 |
bcafarel | https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/838053 is close to merge for ussuri/victoria then we will need https://review.opendev.org/c/openstack/neutron/+/843781 for ussuri | 15:14 |
gmann | yeah | 15:14 |
ykarel | train should also be good one of my patch merged today | 15:14 |
gmann | yeah train is already pinned before | 15:14 |
lajoskatona | gmann: thanks | 15:14 |
slaweq | thx for working on this | 15:15 |
slaweq | anything else regarding stable branches or can we move on? | 15:16 |
bcafarel | rest is good :) we can move on | 15:16 |
slaweq | thx | 15:16 |
slaweq | #topic Stadium projects | 15:17 |
slaweq | lajoskatona anything new here? | 15:17 |
lajoskatona | nothing extra from me | 15:17 |
slaweq | ++ | 15:17 |
slaweq | no news is good news generally | 15:17 |
slaweq | at least in that meeting :) | 15:17 |
lajoskatona | as mentioned on previous meeting I will send out to EOl old branches | 15:17 |
lajoskatona | slaweq: agree :-) | 15:17 |
ykarel | is issue with networking-sfc known? | 15:17 |
ykarel | i saw it too affected by sqlalchemy 2 changes | 15:17 |
slaweq | ykarel what issue exactly? | 15:18 |
ralonsoh | yes | 15:18 |
ralonsoh | it is reported | 15:18 |
lajoskatona | ykarel: I saw tempest failure, is that you mean? | 15:18 |
ralonsoh | https://bugs.launchpad.net/neutron/+bug/1976360 | 15:18 |
ykarel | yes i meant ^ one | 15:18 |
ykarel | seen in neutron-tempest-plugin patch | 15:18 |
ralonsoh | I'll push a patch tomorrow (but you can take it, if you want) | 15:19 |
lajoskatona | thanks, I can check this one | 15:19 |
ralonsoh | cool | 15:19 |
slaweq | ++ | 15:19 |
ykarel | i can check but tomorrow only | 15:19 |
lajoskatona | this morning I hoped it is temporary glitch, and havent cheked the logs in detail | 15:20 |
ralonsoh | nope, it is legit | 15:20 |
ykarel | ralonsoh, ok i will assign myself and push a patch in my morning | 15:20 |
ralonsoh | ykarel++ | 15:20 |
slaweq | thx ykarel and ralonsoh | 15:21 |
slaweq | I think we can move on to the next topic | 15:21 |
slaweq | #topic Grafana | 15:21 |
slaweq | first of all we need to remove emove lower-constraints and py36 jobs from the graphs | 15:21 |
slaweq | anyone wants to do this? | 15:21 |
ralonsoh | I can | 15:22 |
slaweq | thx ralonsoh | 15:22 |
slaweq | #action ralonsoh to remove lower-constraints and py36 jobs from the graphs in grafana | 15:22 |
slaweq | other than that I still see that functional tests job is our biggest pain | 15:22 |
slaweq | good thing is that our scenario jobs are really good recently | 15:23 |
slaweq | for functional tests still our biggest issue is the one with timeouts during ha router's state transition | 15:24 |
slaweq | so I was thinking today that maybe we can temporary mark all tests which are doing such transition as unstable | 15:24 |
slaweq | wdyt? | 15:24 |
ralonsoh | fine for me | 15:24 |
obondarev | +1 | 15:24 |
bcafarel | +1 that's our biggest offender currently | 15:24 |
mlavalle | +1 | 15:24 |
ykarel | +1 | 15:24 |
lajoskatona | +1 | 15:25 |
slaweq | so I will propose patch tomorrow | 15:25 |
slaweq | #action slaweq to mark functional l3 ha tests as unstable temporary | 15:25 |
slaweq | anything else regarding grafana? | 15:25 |
slaweq | or can we move on? | 15:25 |
mlavalle | let's move on | 15:26 |
lajoskatona | +1 | 15:26 |
slaweq | #topic Rechecks | 15:26 |
slaweq | rechecks in last weeks were mostly below 1 in average: | 15:27 |
slaweq | | 2022-17 | 0.77 |... (full message at https://matrix.org/_matrix/media/r0/download/matrix.org/DzfbWLzrhYzumKNEejtutJsy) | 15:27 |
slaweq | so it's still pretty good IMO | 15:27 |
slaweq | Gate failure bugs: https://tinyurl.com/2p9x6yr2 - we have 27 bugs opened, -1 from last week | 15:27 |
slaweq | thx for working on some of them | 15:27 |
slaweq | last topic for today | 15:28 |
slaweq | #topic Periodic | 15:28 |
slaweq | we have couple of jobs broken there | 15:28 |
slaweq | first one: | 15:28 |
slaweq | propose-translation-update is broken | 15:28 |
slaweq | https://zuul.openstack.org/build/5504f6afb3ce46fdad29afd9e0b59e19 | 15:28 |
slaweq | it seems that it's broken since 29.05 | 15:29 |
slaweq | https://zuul.openstack.org/buildset/779c07f580cb42fabeba7ad5e6640a1c | 15:29 |
ralonsoh | I'll check installing it manually. Maybe this is just a problem with some pypi versions | 15:29 |
ykarel | i heard it's related to py3.6 | 15:29 |
ralonsoh | can we move it to 38? | 15:30 |
ykarel | there are some constraints that i hear | 15:30 |
slaweq | ralonsoh probably we should :) | 15:30 |
ykarel | frickler likely have more context on ^ | 15:30 |
ykarel | but it's a known issue, not just for neutron | 15:30 |
slaweq | ykarel ok, thx. So lets monitor it for now :) | 15:31 |
lajoskatona | ykarel: so perhaps common soultion will be for it | 15:31 |
ykarel | yes | 15:31 |
slaweq | next one is about openstack-tox-py39-with-oslo-master which is also broken | 15:32 |
ralonsoh | do you have a link? | 15:32 |
slaweq | https://zuul.openstack.org/build/7aef47045c9649a58d28d87e86839f1e | 15:32 |
ykarel | ERROR: InterpreterNotFound: python3.9 | 15:33 |
ykarel | as it's running on ubuntu-focal | 15:33 |
slaweq | yeah | 15:33 |
slaweq | but it's strange for me | 15:33 |
slaweq | similar job with neutron-lib master is fine https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_687/periodic/opendev.org/openstack/neutron/master/openstack-tox-py39-with-neutron-lib-master/6875d5b/job-output.txt | 15:33 |
slaweq | also on focal | 15:34 |
ralonsoh | https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/842646 | 15:35 |
ralonsoh | that was added 9 days ago | 15:35 |
ralonsoh | when moving from 36 to 39 | 15:35 |
slaweq | yeah together with other jobs | 15:35 |
slaweq | like the one with neutron-lib-master | 15:36 |
ralonsoh | actually there is a comment from frickler saying "This doesn't work, bionic lacks py39." | 15:36 |
lajoskatona | yes as both is on focal it is strange | 15:36 |
ralonsoh | but in focal, the default interpreter is 38, right? | 15:37 |
ralonsoh | you need to manually install 39 | 15:37 |
lajoskatona | you are right, | 15:37 |
slaweq | ok, I will compare those jobs and check why it's working differently | 15:37 |
lajoskatona | so in one case we got an image with preinstalled py39? | 15:37 |
slaweq | and I will report bug for it | 15:37 |
ralonsoh | thanks | 15:37 |
slaweq | #action slaweq to report bug and check failing openstack-tox-py39-with-oslo-master periodic job | 15:38 |
slaweq | last one: | 15:38 |
slaweq | neutron-ovn-tempest-ovs-master-fedora is broken, but it seems that it's not related to Neutron | 15:38 |
slaweq | there is one test failing there since at least few days | 15:38 |
slaweq | but it's not really neutron related test | 15:38 |
slaweq | so maybe we should simply blacklist that test? | 15:38 |
slaweq | https://zuul.openstack.org/build/f265a35aa43649d1baa291d9e711b359 | 15:39 |
ralonsoh | what's the issue? a missing image? | 15:39 |
slaweq | maybe we can ask glance/nova teams if they know that issue already | 15:39 |
slaweq | ralonsoh I didn't check it but my guess is that this test is creating image from running vm and can't find it later | 15:40 |
ralonsoh | that's curious: this image disappears in a gap of 2 seconds | 15:40 |
ralonsoh | but yes | 15:40 |
ralonsoh | Nova folks could provide more info | 15:40 |
mlavalle | +1 | 15:41 |
slaweq | I will talk with them tomorrow and I will report bug if necessary | 15:41 |
lajoskatona | +1 | 15:41 |
ykarel | +1 | 15:41 |
ralonsoh | because this is not breaking the CI, we can leave it | 15:41 |
slaweq | #action slaweq to talk with nova team about issue in | 15:41 |
opendevreview | Merged openstack/os-vif master: Delete trunk bridges to avoid race with Neutron https://review.opendev.org/c/openstack/os-vif/+/841499 | 15:41 |
slaweq | * issue in neutron-ovn-tempest-ovs-master-fedora | 15:41 |
slaweq | ok, that's all what I had for today | 15:42 |
slaweq | anything else You want to discuss? | 15:42 |
slaweq | ahh, sorry | 15:42 |
ralonsoh | two topics | 15:42 |
ralonsoh | quick | 15:42 |
slaweq | one last thing | 15:42 |
slaweq | but ralonsoh go on with Yours | 15:42 |
ralonsoh | please, go on | 15:42 |
slaweq | #topic On Demand agenda | 15:43 |
slaweq | thx | 15:43 |
slaweq | I will be fast | 15:43 |
slaweq | next week I will be in Berlin | 15:43 |
slaweq | should I cancel ci meeting? | 15:43 |
slaweq | or do You want to do it? | 15:43 |
ralonsoh | ok to cancel it | 15:43 |
slaweq | I will not have time to attend probably | 15:43 |
mlavalle | +1 | 15:43 |
ykarel | +1 | 15:43 |
lajoskatona | good that you mention it, I will be there too, so I will cancel the team meeting | 15:44 |
slaweq | ++ | 15:44 |
slaweq | thx | 15:44 |
mlavalle | ok | 15:44 |
mlavalle | no meetings next Tuesday | 15:44 |
slaweq | ok, ralonsoh: Your turn 😃 | 15:44 |
ralonsoh | thanks | 15:44 |
ralonsoh | about the sqlalchemy issues, please add the [sqlachemy-20] prefix in the description | 15:44 |
ralonsoh | and sorry for so many of them | 15:44 |
ralonsoh | but they are difficult to spot | 15:44 |
ralonsoh | and second | 15:45 |
ralonsoh | os-ken UT is based on "nose" library | 15:45 |
ralonsoh | totally unsupported in py310 | 15:45 |
ralonsoh | and "nose2" is not a replacement | 15:45 |
ralonsoh | so the idea is to move UT to unittest | 15:45 |
ralonsoh | of course, as usual, this is not trivial nor easy | 15:45 |
ralonsoh | but we have time for this | 15:45 |
ralonsoh | that's all | 15:45 |
lajoskatona | ralonsoh: good catch | 15:45 |
ralonsoh | btw, I'll open a bug for this | 15:46 |
slaweq | ralonsoh++ | 15:46 |
slaweq | please remember that we use storyboard for os-ken bugs | 15:46 |
ralonsoh | sure | 15:46 |
slaweq | about prefix [sqlachemy-20] | 15:46 |
slaweq | do You want it to be added to bug titles in LP? | 15:46 |
slaweq | or to the patches? | 15:47 |
ralonsoh | yes | 15:47 |
ralonsoh | just to group the "shame"... | 15:47 |
slaweq | or both? | 15:47 |
ralonsoh | LP is fine, I think | 15:47 |
mlavalle | ok | 15:47 |
slaweq | maybe better would be to add such tag to the bugs in LP? | 15:47 |
slaweq | instead of title's prefix | 15:47 |
ralonsoh | agree with this too | 15:47 |
ralonsoh | perfect then | 15:47 |
lajoskatona | +1 for tag | 15:48 |
slaweq | ok, so lets add tag sqlalchemy-20 for such bugs | 15:48 |
slaweq | if there is nothing else for today, I think we can finish this meeting | 15:49 |
ykarel | just one thing | 15:49 |
ykarel | i have pushed some patches to devstack and grenade to make ovn-grenade job green, testing in https://review.opendev.org/c/openstack/neutron/+/836141 | 15:49 |
slaweq | sure ykarel | 15:49 |
ykarel | please check these, this will also be needed for tick-tick upgrades | 15:49 |
slaweq | ++ thx a lot | 15:49 |
slaweq | I will check them tomorrow | 15:49 |
ykarel | and also one backport from lajoskatona https://review.opendev.org/c/openstack/neutron/+/837681 | 15:50 |
ykarel | ^ needed for stable/wallaby too as pyroute2 updated there | 15:50 |
mlavalle | I'll check the backport | 15:50 |
slaweq | me too | 15:51 |
slaweq | ok, now I think we can finish the meeting :) | 15:52 |
slaweq | thx for attending | 15:52 |
slaweq | have a great week and see You all online | 15:52 |
bcafarel | o/ | 15:52 |
ralonsoh | bye! | 15:52 |
slaweq | and lajoskatona see You in Berlin in person finally :) | 15:53 |
lajoskatona | o/ | 15:53 |
ralonsoh | hehehe | 15:53 |
mlavalle | o/ | 15:53 |
slaweq | #endmeeting | 15:53 |
opendevmeet | Meeting ended Tue May 31 15:53:12 2022 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:53 |
opendevmeet | Minutes: https://meetings.opendev.org/meetings/neutron_ci/2022/neutron_ci.2022-05-31-15.00.html | 15:53 |
opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/neutron_ci/2022/neutron_ci.2022-05-31-15.00.txt | 15:53 |
opendevmeet | Log: https://meetings.opendev.org/meetings/neutron_ci/2022/neutron_ci.2022-05-31-15.00.log.html | 15:53 |
lajoskatona | slaweq: sure :-) | 15:53 |
mlavalle | have a nice trip slaweq and lajoskatona | 15:53 |
slaweq | we need to go for some beer :) | 15:53 |
slaweq | thx mlavalle | 15:53 |
opendevreview | Fernando Royo proposed openstack/networking-ovn stable/train: Fix Load balancer remains on PENDING_CREATE https://review.opendev.org/c/openstack/networking-ovn/+/844103 | 16:14 |
opendevreview | Merged openstack/ovn-octavia-provider master: Fix way of calculate LB status after HM event https://review.opendev.org/c/openstack/ovn-octavia-provider/+/843308 | 16:28 |
opendevreview | Pedro Henrique Pereira Martins proposed openstack/python-neutronclient master: Add support to floating ip port forwarding https://review.opendev.org/c/openstack/python-neutronclient/+/837725 | 17:35 |
opendevreview | Jakub Libosvar proposed openstack/neutron stable/yoga: [OVN][Migration] More robust checks on stop-agents https://review.opendev.org/c/openstack/neutron/+/844074 | 18:05 |
opendevreview | Jakub Libosvar proposed openstack/neutron stable/xena: [OVN][Migration] More robust checks on stop-agents https://review.opendev.org/c/openstack/neutron/+/844075 | 18:05 |
opendevreview | Jakub Libosvar proposed openstack/neutron stable/wallaby: [OVN][Migration] More robust checks on stop-agents https://review.opendev.org/c/openstack/neutron/+/844076 | 18:05 |
opendevreview | Merged openstack/neutron master: [Trunk] Check if parent port belongs to OVN to activate https://review.opendev.org/c/openstack/neutron/+/843247 | 19:55 |
opendevreview | Merged openstack/neutron-tempest-plugin master: Pin neutron-tempest-plugin for ussuri/victoria jobs https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/838053 | 19:55 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!