*** yamamoto has quit IRC | 00:10 | |
*** yamamoto has joined #openstack-meeting-3 | 00:11 | |
*** yamamoto has quit IRC | 00:16 | |
*** yamamoto has joined #openstack-meeting-3 | 00:25 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 00:29 | |
*** jamesmcarthur has quit IRC | 00:33 | |
*** mlavalle has quit IRC | 01:04 | |
*** baojg has joined #openstack-meeting-3 | 01:40 | |
*** macz_ has quit IRC | 01:43 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 01:44 | |
*** jamesmcarthur has quit IRC | 02:07 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 02:12 | |
*** macz_ has joined #openstack-meeting-3 | 02:21 | |
*** macz_ has quit IRC | 02:30 | |
*** jamesmcarthur has quit IRC | 02:50 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 02:51 | |
*** jamesmcarthur has quit IRC | 02:56 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 03:14 | |
*** jamesmcarthur has quit IRC | 03:41 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 03:43 | |
*** jamesmcarthur has quit IRC | 03:48 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 03:49 | |
*** jamesmcarthur has quit IRC | 03:54 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 04:13 | |
*** jamesmcarthur has quit IRC | 04:16 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 04:16 | |
*** macz_ has joined #openstack-meeting-3 | 04:47 | |
*** macz_ has quit IRC | 04:52 | |
*** haleyb has quit IRC | 05:09 | |
*** jamesmcarthur has quit IRC | 05:25 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 05:26 | |
*** jamesmcarthur has quit IRC | 05:32 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 05:55 | |
*** spotz has quit IRC | 06:54 | |
*** jamesmcarthur has quit IRC | 07:17 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 07:32 | |
*** eolivare has joined #openstack-meeting-3 | 07:37 | |
*** jamesmcarthur has quit IRC | 07:38 | |
*** ralonsoh has joined #openstack-meeting-3 | 07:52 | |
*** slaweq has joined #openstack-meeting-3 | 07:59 | |
*** tosky has joined #openstack-meeting-3 | 08:45 | |
*** lkoranda has joined #openstack-meeting-3 | 09:27 | |
*** yamamoto has quit IRC | 09:29 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 09:35 | |
*** jamesmcarthur has quit IRC | 09:40 | |
*** e0ne has joined #openstack-meeting-3 | 09:49 | |
*** yamamoto has joined #openstack-meeting-3 | 10:04 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 10:08 | |
*** e0ne has quit IRC | 10:11 | |
*** e0ne has joined #openstack-meeting-3 | 10:11 | |
*** jamesmcarthur has quit IRC | 10:13 | |
*** yamamoto has quit IRC | 10:15 | |
*** ricolin has quit IRC | 10:28 | |
*** e0ne has quit IRC | 10:50 | |
*** baojg has quit IRC | 11:32 | |
*** baojg has joined #openstack-meeting-3 | 11:34 | |
*** baojg has quit IRC | 11:34 | |
*** baojg has joined #openstack-meeting-3 | 11:35 | |
*** baojg has quit IRC | 11:35 | |
*** baojg has joined #openstack-meeting-3 | 11:36 | |
*** baojg has joined #openstack-meeting-3 | 11:36 | |
*** baojg has quit IRC | 11:37 | |
*** baojg has joined #openstack-meeting-3 | 11:37 | |
*** baojg has joined #openstack-meeting-3 | 11:38 | |
*** baojg has joined #openstack-meeting-3 | 11:39 | |
*** baojg has joined #openstack-meeting-3 | 11:39 | |
*** baojg has quit IRC | 11:40 | |
*** baojg has joined #openstack-meeting-3 | 11:40 | |
*** baojg has quit IRC | 11:41 | |
*** baojg has joined #openstack-meeting-3 | 11:41 | |
*** baojg has joined #openstack-meeting-3 | 11:42 | |
*** baojg has quit IRC | 11:42 | |
*** baojg has joined #openstack-meeting-3 | 11:43 | |
*** baojg has joined #openstack-meeting-3 | 11:43 | |
*** baojg has quit IRC | 11:44 | |
*** yamamoto has joined #openstack-meeting-3 | 11:46 | |
*** baojg has joined #openstack-meeting-3 | 12:04 | |
*** baojg has quit IRC | 12:07 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 12:12 | |
*** eolivare has quit IRC | 12:16 | |
*** jamesmcarthur has quit IRC | 12:17 | |
*** yamamoto has quit IRC | 12:23 | |
*** ricolin has joined #openstack-meeting-3 | 12:34 | |
*** yamamoto has joined #openstack-meeting-3 | 13:03 | |
*** yamamoto has quit IRC | 13:09 | |
*** eolivare has joined #openstack-meeting-3 | 13:22 | |
*** macz_ has joined #openstack-meeting-3 | 13:45 | |
*** macz_ has quit IRC | 13:50 | |
*** obondarev has joined #openstack-meeting-3 | 13:55 | |
*** mlavalle has joined #openstack-meeting-3 | 13:57 | |
slaweq | #startmeeting networking | 14:00 |
---|---|---|
openstack | Meeting started Tue Jan 26 14:00:21 2021 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
*** openstack changes topic to " (Meeting topic: networking)" | 14:00 | |
openstack | The meeting name has been set to 'networking' | 14:00 |
mlavalle | o/ | 14:00 |
obondarev | hi | 14:00 |
slaweq | hello at the team meeting :) | 14:00 |
rubasov | hi | 14:01 |
slaweq | lets wait few more minutes for others to join | 14:01 |
ralonsoh | hi | 14:03 |
slaweq | ok, lets start | 14:04 |
slaweq | #topic announcements | 14:04 |
*** openstack changes topic to "announcements (Meeting topic: networking)" | 14:04 | |
slaweq | I don't have many annoncements for today | 14:04 |
slaweq | just schedule reminder | 14:04 |
slaweq | We just reached W-2 milestone, next milestone will be in March 8th | 14:04 |
slaweq | so we are going to Wallaby-3 now | 14:05 |
slaweq | we are closer and closer to Wallaby release :) | 14:05 |
slaweq | please keep that in mind | 14:05 |
slaweq | bcafarel also proposed new releases for stable branches | 14:05 |
slaweq | I +1'ed them today | 14:05 |
slaweq | so we should have new releases soon I think | 14:06 |
slaweq | and that are all announcements from me today | 14:06 |
slaweq | anything else You want to add? | 14:06 |
mlavalle | not from me | 14:06 |
ralonsoh | no | 14:06 |
*** macz_ has joined #openstack-meeting-3 | 14:06 | |
slaweq | ok, so let's go to the next topic | 14:07 |
slaweq | #topic Blueprints | 14:07 |
*** openstack changes topic to "Blueprints (Meeting topic: networking)" | 14:07 | |
slaweq | https://bugs.launchpad.net/neutron/+milestone/wallaby-3 | 14:07 |
slaweq | I moved opened BPs from Wallaby-2 to 3 for now | 14:07 |
bcafarel | one reboot later, late o/ | 14:08 |
slaweq | and I closed https://blueprints.launchpad.net/neutron/+spec/enginefacade-switch finally | 14:08 |
slaweq | there is still networking-midonet patch related to that BP but gate of that project is broken currently | 14:08 |
slaweq | I don't see any point to keep this BP open anymore | 14:08 |
slaweq | 4 years is enough :) | 14:08 |
slaweq | thx ralonsoh, mlavalle and others for help with that | 14:08 |
ralonsoh | yw | 14:09 |
mlavalle | \o/ | 14:09 |
slaweq | regarding https://blueprints.launchpad.net/neutron/+spec/secure-bac-roles | 14:09 |
slaweq | sorry https://blueprints.launchpad.net/neutron/+spec/secure-rbac-roles | 14:09 |
slaweq | we are slowly merging patches which deprecates old policies | 14:09 |
slaweq | https://review.opendev.org/q/topic:%2522secure-rbac%2522+(status:open+OR+status:merged)+project:openstack/neutron, | 14:09 |
slaweq | for many of them there is one +2 already | 14:10 |
slaweq | so we need another one | 14:10 |
slaweq | please review them if You have some time | 14:10 |
mlavalle | I'll take a look today | 14:10 |
slaweq | thx mlavalle | 14:10 |
slaweq | I will talk with lbragstad about testing of those new policies and will start working on it ASAP | 14:11 |
*** macz_ has quit IRC | 14:11 | |
*** lajoskatona has joined #openstack-meeting-3 | 14:11 | |
lajoskatona | Hi | 14:11 |
slaweq | hi lajoskatona | 14:11 |
slaweq | and last thing from me | 14:11 |
lajoskatona | sorry for being late.... | 14:11 |
slaweq | regarding https://blueprints.launchpad.net/neutron/+spec/default-dns-zone-per-tenant | 14:12 |
slaweq | there is patch https://review.opendev.org/#/c/686343/ which is ready for review | 14:12 |
slaweq | please also take a look at it when You will have time | 14:12 |
slaweq | it's low priority BP but it's old one and I would like to close it finally | 14:12 |
mlavalle | added to my pile | 14:12 |
slaweq | thx mlavalle | 14:12 |
slaweq | that's all from me regarding BPs for today | 14:12 |
slaweq | any other updates? | 14:13 |
mlavalle | Regarding address groups... | 14:13 |
mlavalle | I am implementing RBAC for it. I have this neutron-lib API definition patch ready for review: https://review.opendev.org/c/openstack/neutron-lib/+/771892 | 14:13 |
*** haleyb has joined #openstack-meeting-3 | 14:14 | |
mlavalle | Hopefully we can merge AND realease it soon, so implementtion can move forward smoothly on the Neutron side | 14:14 |
slaweq | I will review that ASAP | 14:14 |
*** jamesmcarthur has joined #openstack-meeting-3 | 14:14 | |
mlavalle | Also have the Neutron side in a WIP patch: https://review.opendev.org/c/openstack/neutron/+/772460 | 14:14 |
mlavalle | I will clean it up today and tomorrow and hopefully will be ready for review later this week | 14:15 |
mlavalle | That's all from me | 14:15 |
slaweq | https://review.opendev.org/c/openstack/neutron/+/757650 is also ready for review, right? | 14:15 |
ralonsoh | (I need to review that one...) | 14:16 |
slaweq | me too :) | 14:17 |
slaweq | I see know that Hang Yang replied to my last comments there | 14:17 |
slaweq | I will review it asap | 14:17 |
slaweq | ok, I think we can move on to the next topic | 14:18 |
slaweq | #topic Community Goals | 14:18 |
*** openstack changes topic to "Community Goals (Meeting topic: networking)" | 14:18 | |
slaweq | I'm not sure if amotoki is here today | 14:18 |
slaweq | but regarding Migrate RBAC Policy Format from JSON to YAML | 14:18 |
slaweq | we already merged both listed patches | 14:18 |
slaweq | so I think we are good with this one | 14:18 |
slaweq | ralonsoh: any updates about rootwrap? | 14:19 |
ralonsoh | yes, one sec | 14:19 |
ralonsoh | https://review.opendev.org/c/openstack/neutron/+/772068 | 14:19 |
ralonsoh | apart from an error in FT, should work | 14:19 |
*** yamamoto has joined #openstack-meeting-3 | 14:19 | |
*** jamesmcarthur has quit IRC | 14:19 | |
slaweq | right, I saw this functional tests failure today :) | 14:19 |
ralonsoh | and then I'll write a mail about what to do with those commands executed inside a service | 14:20 |
amotoki | slaweq: your understanding is correct. (i discused py27 gate faiure in #-qa) | 14:20 |
slaweq | amotoki: thx for confirmation :) | 14:21 |
ralonsoh | because we can't use privsep if those processes are going to be long lived processes | 14:21 |
ralonsoh | (but that could be addressed in a mail) | 14:21 |
bcafarel | stable gate failure was bound to happen, things were fine for more than a week | 14:21 |
slaweq | ralonsoh: ok, thx for update | 14:22 |
slaweq | lets move on to the next topic then | 14:22 |
slaweq | #topic Bugs | 14:22 |
*** openstack changes topic to "Bugs (Meeting topic: networking)" | 14:22 | |
rubasov | report: http://lists.openstack.org/pipermail/openstack-discuss/2021-January/020008.html | 14:23 |
slaweq | thx rubasov | 14:23 |
slaweq | You were faster than me :) | 14:23 |
rubasov | :-) | 14:23 |
slaweq | any bugs You want to highlight today? | 14:23 |
rubasov | there's only I wanted to mention | 14:23 |
rubasov | this lost ovs flow bug is unassigned: https://bugs.launchpad.net/neutron/+bug/1912651 | 14:23 |
openstack | Launchpad bug 1912651 in neutron "ovs flows are not readded when ovsdb-server/ovs-vswitchd are restarted." [Medium,Confirmed] | 14:23 |
ralonsoh | I need to debug this one but I didn't have timee | 14:24 |
ralonsoh | sorry | 14:24 |
rubasov | np, thanks already | 14:24 |
ralonsoh | (I'll take it) | 14:24 |
*** yamamoto has quit IRC | 14:24 | |
slaweq | I remember I was fixing some similar issues but IIRC it was for some dvr related flows | 14:24 |
slaweq | here it seems to be related to firewall | 14:25 |
ralonsoh | but this is related to conj(1/2) flows | 14:25 |
ralonsoh | anyway, should be debugged | 14:25 |
slaweq | yep | 14:25 |
slaweq | I can also take a look if I will have time | 14:25 |
rubasov | and I forgot to add one bug to the report, sorry for that: https://bugs.launchpad.net/neutron/+bug/1912747 | 14:26 |
openstack | Launchpad bug 1912747 in neutron "security group does not verify the tenant id" [High,Confirmed] - Assigned to zhanghao (zhanghao2) | 14:26 |
ralonsoh | I didn't have any reply from keystone guys about what user should be used there | 14:26 |
ralonsoh | but as you commented, the api-paste feature can be used | 14:27 |
ralonsoh | note: nova user should have "system" role | 14:27 |
ralonsoh | (this is configured by default in devstack) | 14:27 |
slaweq | rubasov: patch which I mentioned require some configuration changes | 14:27 |
slaweq | maybe it wasn't applied in the reporter's env? | 14:27 |
rubasov | I was just about to ask if I was missing something | 14:27 |
rubasov | but then it's probably not applied to my env either ;-) | 14:28 |
slaweq | ok, I see now that there are also some errors 500 when on e.g. GET requests | 14:29 |
slaweq | so that can be different issue | 14:29 |
rubasov | slaweq: can you please add a comment there about what configuration is needed? | 14:29 |
slaweq | rubasov: sure, I will | 14:29 |
rubasov | then I can re-check | 14:29 |
rubasov | thank you | 14:29 |
ralonsoh | I said that: you need to add the api-paste plugin and configure nova with "system" role | 14:30 |
rubasov | oh ok | 14:30 |
rubasov | thanks | 14:30 |
rubasov | that's all I wanted to bring up here | 14:31 |
slaweq | thx rubasov | 14:32 |
rubasov | sure | 14:32 |
slaweq | this week our bug deputy is ralonsoh | 14:32 |
mlavalle | we are in good hands! | 14:32 |
slaweq | yep | 14:32 |
slaweq | bcafarel: amotoki: You mentioned some new gate failure in stable branches | 14:33 |
slaweq | is it rerported somewhere? | 14:33 |
slaweq | *reported | 14:33 |
amotoki | https://bugs.launchpad.net/devstack/+bug/1913283 | 14:33 |
openstack | Launchpad bug 1913283 in devstack "get-pip.py no longer supports py27" [Critical,Triaged] | 14:33 |
bcafarel | "pip 21 heads-up (Python 2 support gone)" on openstack-discuss | 14:33 |
bcafarel | ah LP link is better :) | 14:33 |
amotoki | it is caused by get-pip.py with py27. | 14:33 |
slaweq | amotoki: thx | 14:33 |
amotoki | devstack in train and older branches are now broken | 14:34 |
slaweq | so (yet another) chapter of the py2.7 drama :) | 14:34 |
slaweq | I see that patches are already proposed | 14:34 |
bcafarel | yes, these strange folks still using py2 in 2021 :) | 14:34 |
slaweq | so it should be fixed soon I hope | 14:35 |
slaweq | bcafarel: exactly | 14:35 |
slaweq | who cares about stable branches :P | 14:35 |
slaweq | let's kill them all with fire! | 14:35 |
slaweq | ;) | 14:35 |
bcafarel | you heard the PTL, folks! :) | 14:35 |
slaweq | LOL | 14:36 |
amotoki | :) | 14:36 |
slaweq | damm, I forgot that I'm ptl here :P | 14:36 |
slaweq | ok | 14:36 |
slaweq | and seriously, thx for taking care of it | 14:36 |
slaweq | anything else You want to discuss today? | 14:36 |
slaweq | if not, I will give You few minutes back | 14:37 |
ralonsoh | no thanks | 14:37 |
slaweq | ok | 14:38 |
slaweq | so thx for attending the meeting today | 14:38 |
* bcafarel goes to fetch coffee before ci meeting | 14:38 | |
slaweq | and have a great week | 14:38 |
lajoskatona | +1 | 14:38 |
slaweq | o/ | 14:38 |
ralonsoh | bye | 14:38 |
slaweq | #endmeeting | 14:38 |
lajoskatona | o/ | 14:38 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 14:38 | |
rubasov | o/ | 14:38 |
openstack | Meeting ended Tue Jan 26 14:38:30 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:38 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/networking/2021/networking.2021-01-26-14.00.html | 14:38 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/networking/2021/networking.2021-01-26-14.00.txt | 14:38 |
amotoki | o/ | 14:38 |
openstack | Log: http://eavesdrop.openstack.org/meetings/networking/2021/networking.2021-01-26-14.00.log.html | 14:38 |
*** jamesmcarthur has joined #openstack-meeting-3 | 14:45 | |
slaweq | #startmeeting neutron_ci | 15:00 |
openstack | Meeting started Tue Jan 26 15:00:22 2021 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
slaweq | welcome again | 15:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
*** openstack changes topic to " (Meeting topic: neutron_ci)" | 15:00 | |
openstack | The meeting name has been set to 'neutron_ci' | 15:00 |
bcafarel | o/ | 15:00 |
lajoskatona | o/ | 15:00 |
slaweq | Grafana dashboard: http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 15:01 |
slaweq | Please open now :) | 15:01 |
ralonsoh | hi | 15:01 |
slaweq | as we have already our regular attendees, let's start | 15:02 |
slaweq | #topic Actions from previous meetings | 15:02 |
*** openstack changes topic to "Actions from previous meetings (Meeting topic: neutron_ci)" | 15:02 | |
slaweq | slaweq to move 3rd-party jobs to periodic queue | 15:02 |
slaweq | Patch https://review.opendev.org/c/openstack/neutron/+/771486 | 15:02 |
slaweq | it's merged now | 15:02 |
slaweq | next one | 15:02 |
slaweq | ralonsoh to check problem with (not) deleted pid files in functional tests | 15:02 |
ralonsoh | sorry, for the next week | 15:02 |
slaweq | sure | 15:02 |
slaweq | #action ralonsoh to check problem with (not) deleted pid files in functional tests | 15:03 |
slaweq | next one | 15:03 |
slaweq | ralonsoh to check failing periodic task in functional test | 15:03 |
ralonsoh | I'm still reviewing this | 15:03 |
*** jamesmcarthur has quit IRC | 15:03 | |
ralonsoh | (sorry, I'm not lazy but overloaded) | 15:04 |
*** jamesmcarthur has joined #openstack-meeting-3 | 15:04 | |
*** obondarev has quit IRC | 15:04 | |
slaweq | ralonsoh: I know :) | 15:04 |
slaweq | no worries | 15:04 |
*** ralonsoh has quit IRC | 15:04 | |
slaweq | and his gone :P | 15:04 |
*** ralonsoh has joined #openstack-meeting-3 | 15:04 | |
slaweq | ralonsoh: do You want me to add it as action item for You for next meeting too? | 15:05 |
ralonsoh | sure | 15:05 |
slaweq | #action ralonsoh to check failing periodic task in functional test | 15:05 |
slaweq | thx | 15:05 |
slaweq | next one | 15:05 |
slaweq | slaweq to check missing interface in namespace in functional tests | 15:05 |
slaweq | I was checking that issue | 15:05 |
slaweq | and I have no idea why this exception was raised there. Maybe it was some strange race condition because this interface was added, deleted, and then again added and deleted from ovs. | 15:06 |
slaweq | I didn't found any other cases like that so I will not bother with that more now. | 15:06 |
slaweq | and the last one for today | 15:07 |
slaweq | ralonsoh to check failing neutron.tests.functional.services.ovn_l3.test_plugin.TestRouter.test_gateway_chassis_rebalance test | 15:07 |
ralonsoh | https://review.opendev.org/c/openstack/neutron/+/771489 | 15:07 |
ralonsoh | but this is just to provide info | 15:07 |
ralonsoh | because when the lbp does not appear, we don't know what port we are talkign about | 15:07 |
ralonsoh | now we can check that in the SB and NB logs | 15:08 |
slaweq | sure | 15:08 |
slaweq | but we have bug reported | 15:08 |
ralonsoh | yes | 15:08 |
slaweq | and now this additional info in logs | 15:08 |
ralonsoh | https://bugs.launchpad.net/neutron/+bug/1912369 | 15:08 |
openstack | Launchpad bug 1912369 in neutron "[FT] "test_gateway_chassis_rebalance" failing because lrp is not bound" [High,Confirmed] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez) | 15:08 |
slaweq | so hopefully we will not lost this issue from radars and will fix it some day | 15:08 |
slaweq | thx ralonsoh | 15:08 |
slaweq | ok, that was all action items for this week | 15:09 |
slaweq | #topic Stadium projects | 15:09 |
*** openstack changes topic to "Stadium projects (Meeting topic: neutron_ci)" | 15:09 | |
slaweq | as I mentioned in the previous meeting, networking-midonet gate is now broken | 15:09 |
slaweq | I sent email to Sam Morrison who is maintainer of it | 15:10 |
slaweq | I hope he will check that soon | 15:10 |
slaweq | anything else regarding other stadium projects and ci? | 15:10 |
lajoskatona | huh, | 15:10 |
lajoskatona | I checked before the meeting odl and bgpvpn, for those I have patches to fix master first | 15:11 |
lajoskatona | I switched l-c job to non-voting, I have no spare time recently to fix that :-( | 15:11 |
lajoskatona | If you have time to check those, that would be great | 15:11 |
slaweq | lajoskatona: ok, please give us links to the patches | 15:12 |
slaweq | I will review them today | 15:12 |
lajoskatona | than we can move back to stable vranches to fix them as well, but hearing the news about the new pip issue/feature with no py27 support.... | 15:12 |
lajoskatona | ok I collect them | 15:12 |
bcafarel | yes we have a short downtime before resuming snipping out l-c on stable | 15:13 |
lajoskatona | networking-odl: https://review.opendev.org/c/openstack/networking-odl/+/769877 & bgpvpn: https://review.opendev.org/c/openstack/networking-bgpvpn/+/771219 | 15:13 |
slaweq | thx lajoskatona | 15:14 |
slaweq | I actually already +2 one of them :) | 15:14 |
lajoskatona | thanks | 15:15 |
slaweq | ok, so I think we can move on | 15:15 |
slaweq | #topic Stable branches | 15:15 |
*** openstack changes topic to "Stable branches (Meeting topic: neutron_ci)" | 15:15 | |
slaweq | Victoria dashboard: https://grafana.opendev.org/d/HUCHup2Gz/neutron-failure-rate-previous-stable-release?orgId=1 | 15:15 |
slaweq | Ussuri dashboard: https://grafana.opendev.org/d/smqHXphMk/neutron-failure-rate-older-stable-release?orgId=1 | 15:15 |
slaweq | for victoria and ussuri I think all is good this week | 15:15 |
slaweq | and for older we already know about py27 issue | 15:15 |
slaweq | is there anything else to talk today? | 15:15 |
bcafarel | yes, it was good thing we pushed on merging stuff for stable releases last week | 15:15 |
bcafarel | so backlog is back to manageable | 15:16 |
ralonsoh | +1 | 15:16 |
slaweq | I agree | 15:17 |
slaweq | ok, next topic | 15:17 |
slaweq | #topic Grafana | 15:17 |
*** openstack changes topic to "Grafana (Meeting topic: neutron_ci)" | 15:17 | |
slaweq | http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 15:18 |
slaweq | I need to update dashboard again | 15:18 |
slaweq | as we made many changes in jobs config recently | 15:18 |
slaweq | #action slaweq to update grafana dashboard | 15:18 |
slaweq | other than that I think that our dashboard looks pretty ok | 15:19 |
slaweq | I don't see any urgent issues there really | 15:19 |
slaweq | even number of rechecks on patches is significantly lower recently | 15:20 |
slaweq | do You want to discuss about something related to our grafana? | 15:20 |
bcafarel | seems good-looking to me | 15:22 |
slaweq | ok, lets move on | 15:22 |
slaweq | #topic fullstack/functional | 15:22 |
*** openstack changes topic to "fullstack/functional (Meeting topic: neutron_ci)" | 15:22 | |
slaweq | I found just few failures which I want to show You today | 15:23 |
slaweq | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_c2e/767922/9/gate/neutron-functional-with-uwsgi/c2e764b/testr_results.html | 15:23 |
ralonsoh | during the interface creation | 15:23 |
slaweq | ralonsoh: yes, did You saw it already? | 15:24 |
ralonsoh | yes, but this is similar to the occasional tiemout problems we have in the CI | 15:25 |
ralonsoh | and I don't know how to address them | 15:25 |
slaweq | is it normal that in the log from this test there is ovsdb-monitor output: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_c2e/767922/9/gate/neutron-functional-with-uwsgi/c2e764b/controller/logs/dsvm-functional-logs/neutron.tests.functional.agent.linux.test_linuxbridge_arp_protect.LinuxBridgeARPSpoofTestCase.test_arp_correct_protection.txt | 15:25 |
slaweq | this is linuxbridge test | 15:26 |
ralonsoh | I don't know if this is a problem in privsep and how it handles the threads waiting for a reply | 15:26 |
slaweq | so You are saying that this output logged in that test case can be from the other test really? | 15:27 |
slaweq | or did I missunderstood something? | 15:27 |
ralonsoh | not really | 15:27 |
ralonsoh | what I'm saying is that the source of the problem could be the same | 15:28 |
ralonsoh | for all those timeouts in the CI | 15:28 |
slaweq | ahh, ok | 15:28 |
slaweq | I see | 15:28 |
ralonsoh | and could be in privsep | 15:28 |
slaweq | ok, I will report this bug in LP to have it there | 15:29 |
slaweq | and maybe someone will take a look at it someday | 15:29 |
slaweq | ok, next one | 15:30 |
slaweq | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_bd4/periodic/opendev.org/openstack/neutron/master/neutron-functional/bd41252/testr_results.html | 15:30 |
slaweq | #action slaweq to report functional tests timeout in LP | 15:31 |
slaweq | this second one is ovn related | 15:31 |
slaweq | ralonsoh: did You saw it before? | 15:31 |
slaweq | sorry | 15:31 |
slaweq | we already spoke about it | 15:31 |
ralonsoh | yes heheheheh | 15:31 |
slaweq | there wasn't question :) | 15:31 |
slaweq | maybe it has already Your extra logging? | 15:32 |
ralonsoh | no, I didn't see anything with the extra logging | 15:32 |
ralonsoh | sorry | 15:32 |
slaweq | strange | 15:33 |
slaweq | Your patch was merged 20.01 | 15:33 |
slaweq | and that failure is from 25.01 | 15:33 |
slaweq | and it's periodic job | 15:33 |
*** yamamoto has joined #openstack-meeting-3 | 15:33 | |
ralonsoh | ahh sorry | 15:33 |
slaweq | so it should have this extra logs | 15:33 |
ralonsoh | I didn't check those logs | 15:33 |
ralonsoh | let me check that tomorrow | 15:34 |
slaweq | sure | 15:34 |
slaweq | it has error like: | 15:34 |
slaweq | AssertionError: False is not true : lrp cr-lrp-4baa4344-e12a-4fa5-bb98-ced0aff32a57 failed to bind | 15:34 |
slaweq | so there is Your log added there | 15:34 |
ralonsoh | yeah] | 15:34 |
slaweq | maybe it will be helpful for You | 15:34 |
slaweq | :) | 15:34 |
slaweq | I pasted link to that failure in the LP's comment | 15:35 |
ralonsoh | (i was doinf this now hehehe) | 15:35 |
slaweq | ok, that's all about functional tests | 15:35 |
slaweq | now fullstack | 15:35 |
slaweq | https://c8aca39fc5ef53efe51e-9b8733996223bc8ec92919ead98525d0.ssl.cf2.rackcdn.com/771903/4/check/neutron-fullstack-with-uwsgi/c26c740/testr_results.html | 15:35 |
slaweq | I didn't check but this looks for me like some overloaded node maybe | 15:36 |
ralonsoh | looks like, timeouts while deploying the services | 15:36 |
slaweq | yes | 15:36 |
slaweq | so lets don't bother with that for now | 15:36 |
slaweq | :) | 15:36 |
slaweq | #topic Tempest/Scenario | 15:36 |
*** openstack changes topic to "Tempest/Scenario (Meeting topic: neutron_ci)" | 15:37 | |
slaweq | here I have 2 failures for You | 15:37 |
slaweq | test_metadata_routed failure: | 15:37 |
slaweq | https://1f381f2949ecc1bf5cc8-62271a11c17b6e7ed1bc2d4fe711d2ec.ssl.cf5.rackcdn.com/771947/2/check/neutron-tempest-plugin-scenario-openvswitch-iptables_hybrid/4a84eb2/testr_results.html | 15:37 |
slaweq | Failed to connect to fe80::a9fe:a9fe port 80: No route to host | 15:38 |
slaweq | first of all, there is missing console output in case of such failure | 15:38 |
slaweq | and then we need to understand why there wasn't route to that IPv6 address | 15:38 |
slaweq | maybe IPv6 was disabled in the instance? Maybe it's some race condition? | 15:38 |
slaweq | rubasov: I think it was test added by You, would You have some time to check it maybe ^^? | 15:39 |
lajoskatona | slaweq: I check it with rubasov | 15:39 |
slaweq | lajoskatona: thx a lot | 15:40 |
slaweq | #action lajoskatona to check with rubasov test_metadata_routed failure | 15:40 |
slaweq | so last one for today | 15:40 |
slaweq | https://54c503404da20ff97888-1e6c6bc44b22b869bdbf76d87d9eca83.ssl.cf2.rackcdn.com/771947/2/check/neutron-tempest-multinode-full-py3/03f7c14/testr_results.html | 15:40 |
slaweq | it is (again) some ssh failure in 2 tests | 15:40 |
slaweq | AuthenticationFailed exception | 15:41 |
ralonsoh | ? | 15:41 |
ralonsoh | is a SSHTimeout | 15:41 |
ralonsoh | at least the last link | 15:42 |
slaweq | Yes, but this SSHTimeout is due to paramiko.ssh_exception.AuthenticationException: Authentication failed. | 15:42 |
slaweq | in both tests | 15:42 |
ralonsoh | ah ok, thanks! | 15:42 |
ralonsoh | yes, sorrry | 15:42 |
slaweq | and I don't see there any attempt to get console output | 15:42 |
slaweq | so seems for me like our old paramiko bug again | 15:42 |
slaweq | I will check it in tempest | 15:42 |
slaweq | #action slaweq to check why console output wasn't checked in the failed tests from tempest.api.compute.servers.test_create_server.ServersTestJSON | 15:43 |
slaweq | and that's all from me for today | 15:44 |
slaweq | anything else regarding our ci to discuss today? | 15:44 |
ralonsoh | no | 15:44 |
lajoskatona | no | 15:45 |
slaweq | ok, so I'm giving You 15 minutes back | 15:45 |
slaweq | thx for attending | 15:45 |
slaweq | o/ | 15:45 |
slaweq | #endmeeting | 15:45 |
lajoskatona | Bye | 15:45 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 15:45 | |
openstack | Meeting ended Tue Jan 26 15:45:56 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:45 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_ci/2021/neutron_ci.2021-01-26-15.00.html | 15:45 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_ci/2021/neutron_ci.2021-01-26-15.00.txt | 15:45 |
openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_ci/2021/neutron_ci.2021-01-26-15.00.log.html | 15:46 |
*** lajoskatona has left #openstack-meeting-3 | 15:46 | |
ralonsoh | bye | 15:46 |
bcafarel | o/ | 15:46 |
*** yamamoto has quit IRC | 15:56 | |
*** macz_ has joined #openstack-meeting-3 | 16:02 | |
*** macz_ has quit IRC | 16:02 | |
*** jamesmcarthur has quit IRC | 16:13 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 16:13 | |
*** jamesmcarthur has quit IRC | 16:17 | |
*** lkoranda has quit IRC | 16:20 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 16:24 | |
*** e0ne has joined #openstack-meeting-3 | 16:27 | |
*** artom has quit IRC | 16:28 | |
*** artom has joined #openstack-meeting-3 | 16:29 | |
*** mlavalle has quit IRC | 16:44 | |
*** mlavalle has joined #openstack-meeting-3 | 16:45 | |
*** yamamoto has joined #openstack-meeting-3 | 17:56 | |
*** yamamoto has quit IRC | 18:23 | |
*** jamesmcarthur has quit IRC | 18:37 | |
*** eolivare has quit IRC | 18:41 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 18:44 | |
*** jamesmcarthur has quit IRC | 18:46 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 18:48 | |
*** e0ne has quit IRC | 18:59 | |
*** jamesmcarthur has quit IRC | 19:03 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 19:08 | |
*** jamesmcarthur has quit IRC | 19:10 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 19:13 | |
*** jamesmcarthur has quit IRC | 19:14 | |
*** e0ne has joined #openstack-meeting-3 | 19:30 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 19:31 | |
*** e0ne has quit IRC | 19:32 | |
*** yamamoto has joined #openstack-meeting-3 | 20:22 | |
*** ralonsoh has quit IRC | 20:42 | |
*** yamamoto has quit IRC | 20:53 | |
*** raildo has quit IRC | 21:47 | |
*** jamesmcarthur has quit IRC | 21:49 | |
*** slaweq has quit IRC | 22:08 | |
*** yamamoto has joined #openstack-meeting-3 | 22:19 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 22:29 | |
*** jamesmcarthur has quit IRC | 22:33 | |
*** tosky has quit IRC | 23:18 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!