*** slaweq has joined #openstack-meeting-3 | 00:11 | |
*** slaweq has quit IRC | 00:15 | |
*** igordc has joined #openstack-meeting-3 | 00:21 | |
*** yamamoto has joined #openstack-meeting-3 | 00:23 | |
*** yamamoto has quit IRC | 00:28 | |
*** macz_ has quit IRC | 00:33 | |
*** igordc has quit IRC | 00:40 | |
*** njohnston_ has joined #openstack-meeting-3 | 01:01 | |
*** njohnston_ is now known as njohnston|phone | 01:01 | |
*** slaweq has joined #openstack-meeting-3 | 01:11 | |
*** slaweq has quit IRC | 01:16 | |
*** igordc has joined #openstack-meeting-3 | 01:20 | |
*** njohnston|phone has quit IRC | 01:26 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 01:30 | |
*** igordc has quit IRC | 01:33 | |
*** jamesmcarthur has quit IRC | 01:39 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 01:40 | |
*** jamesmcarthur has quit IRC | 01:54 | |
*** yamamoto has joined #openstack-meeting-3 | 01:55 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 01:57 | |
*** jamesmcarthur has quit IRC | 02:08 | |
*** yamamoto has quit IRC | 02:09 | |
*** yamamoto has joined #openstack-meeting-3 | 02:09 | |
*** slaweq has joined #openstack-meeting-3 | 02:11 | |
*** slaweq has quit IRC | 02:15 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 02:16 | |
*** tsmith_ has joined #openstack-meeting-3 | 02:17 | |
*** tsmith2 has quit IRC | 02:20 | |
*** tsmith_ is now known as tsmith2 | 02:20 | |
*** diablo_rojo has quit IRC | 02:48 | |
*** hongbin has joined #openstack-meeting-3 | 02:50 | |
*** slaweq has joined #openstack-meeting-3 | 03:11 | |
*** jamesmcarthur has quit IRC | 03:13 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 03:14 | |
*** slaweq has quit IRC | 03:16 | |
*** apetrich has quit IRC | 03:18 | |
*** links has joined #openstack-meeting-3 | 03:19 | |
*** jamesmcarthur has quit IRC | 03:31 | |
*** psachin has joined #openstack-meeting-3 | 03:33 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 03:53 | |
*** apetrich has joined #openstack-meeting-3 | 03:56 | |
*** slaweq has joined #openstack-meeting-3 | 04:11 | |
*** slaweq has quit IRC | 04:17 | |
*** jamesmcarthur has quit IRC | 04:50 | |
*** hongbin has quit IRC | 04:54 | |
*** diablo_rojo has joined #openstack-meeting-3 | 05:04 | |
*** haleyb is now known as haleyb|away | 05:05 | |
*** slaweq has joined #openstack-meeting-3 | 05:11 | |
*** slaweq has quit IRC | 05:15 | |
*** igordc has joined #openstack-meeting-3 | 05:38 | |
*** yamamoto has quit IRC | 05:56 | |
*** slaweq has joined #openstack-meeting-3 | 06:11 | |
*** yamamoto has joined #openstack-meeting-3 | 06:11 | |
*** igordc has quit IRC | 06:11 | |
*** slaweq has quit IRC | 06:16 | |
*** diablo_rojo has quit IRC | 06:17 | |
*** e0ne has quit IRC | 06:55 | |
*** lpetrut has joined #openstack-meeting-3 | 07:05 | |
*** lpetrut has quit IRC | 07:06 | |
*** lpetrut has joined #openstack-meeting-3 | 07:06 | |
*** slaweq has joined #openstack-meeting-3 | 07:11 | |
*** slaweq has quit IRC | 07:15 | |
*** yamamoto has quit IRC | 07:25 | |
*** slaweq has joined #openstack-meeting-3 | 07:38 | |
*** slaweq has quit IRC | 07:43 | |
*** slaweq has joined #openstack-meeting-3 | 07:49 | |
*** kozhukalov has quit IRC | 07:51 | |
*** yamamoto has joined #openstack-meeting-3 | 08:01 | |
*** yamamoto has quit IRC | 08:06 | |
*** kozhukalov has joined #openstack-meeting-3 | 08:13 | |
*** maciejjozefczyk has joined #openstack-meeting-3 | 08:14 | |
*** yamamoto has joined #openstack-meeting-3 | 08:32 | |
*** ralonsoh has joined #openstack-meeting-3 | 08:33 | |
*** kozhukalov has quit IRC | 08:39 | |
*** e0ne has joined #openstack-meeting-3 | 09:05 | |
*** yamamoto has quit IRC | 09:44 | |
*** apetrich has quit IRC | 09:52 | |
*** yamamoto has joined #openstack-meeting-3 | 10:22 | |
*** yamamoto has quit IRC | 10:27 | |
*** rubasov has joined #openstack-meeting-3 | 10:34 | |
*** psachin has quit IRC | 11:33 | |
*** psachin has joined #openstack-meeting-3 | 11:37 | |
*** psachin has quit IRC | 11:49 | |
*** apetrich has joined #openstack-meeting-3 | 12:01 | |
*** raildo has joined #openstack-meeting-3 | 12:19 | |
*** yamamoto has joined #openstack-meeting-3 | 12:27 | |
*** yamamoto has quit IRC | 12:28 | |
*** liuyulong has joined #openstack-meeting-3 | 13:01 | |
*** yamamoto has joined #openstack-meeting-3 | 13:01 | |
*** yamamoto has quit IRC | 13:06 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 13:23 | |
*** jamesmcarthur has quit IRC | 13:23 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 13:24 | |
*** jamesmcarthur has quit IRC | 13:32 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 13:33 | |
*** jamesmcarthur has quit IRC | 13:38 | |
*** rubasov has quit IRC | 14:01 | |
*** yamamoto has joined #openstack-meeting-3 | 14:06 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 14:11 | |
*** psachin has joined #openstack-meeting-3 | 14:16 | |
*** jamesmcarthur has quit IRC | 14:18 | |
*** ricolin has quit IRC | 14:25 | |
*** rubasov has joined #openstack-meeting-3 | 14:31 | |
*** links has quit IRC | 14:45 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 14:53 | |
*** jamesmcarthur has quit IRC | 14:58 | |
*** psachin has quit IRC | 15:00 | |
slaweq | #startmeeting neutron_ci | 15:00 |
---|---|---|
openstack | Meeting started Wed Mar 4 15:00:26 2020 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
slaweq | hi | 15:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
ralonsoh | hi | 15:00 |
*** openstack changes topic to " (Meeting topic: neutron_ci)" | 15:00 | |
openstack | The meeting name has been set to 'neutron_ci' | 15:00 |
njohnston | o/ | 15:00 |
slaweq | please give me 3 minutes before we will start | 15:00 |
bcafarel | that gave me time to find the way to this channel | 15:02 |
slaweq | ok, I'm ready now | 15:02 |
slaweq | first of all | 15:03 |
slaweq | Grafana dashboard: http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 15:03 |
slaweq | #topic Actions from previous meetings | 15:03 |
*** openstack changes topic to "Actions from previous meetings (Meeting topic: neutron_ci)" | 15:03 | |
slaweq | first one: | 15:03 |
slaweq | slaweq to drop neutron-tempest-dvr job and finally replace it with neutron-tempest-dvr-ha-multinode-full | 15:03 |
slaweq | Done: https://review.opendev.org/#/c/710071/ | 15:03 |
slaweq | and the second one | 15:03 |
slaweq | ralonsoh to check periodic neutron-ovn-tempest-ovs-master-fedora job's failures | 15:03 |
ralonsoh | yes, that problem was caused by a OVN test failure | 15:04 |
ralonsoh | actually by an OVN problem | 15:04 |
ralonsoh | this is now solved and released | 15:04 |
slaweq | thx ralonsoh | 15:04 |
slaweq | I saw this test passed e.g. yesterday | 15:06 |
slaweq | and that's all actions from last week | 15:06 |
slaweq | #topic Stadium projects | 15:06 |
*** openstack changes topic to "Stadium projects (Meeting topic: neutron_ci)" | 15:06 | |
slaweq | standardize on zuul v3 | 15:07 |
slaweq | Etherpad: https://etherpad.openstack.org/p/neutron-train-zuulv3-py27drop | 15:07 |
slaweq | I think that my 2 patches for neutron-vpnaas jobs are ready to review | 15:07 |
njohnston | excellent, I will take a look | 15:07 |
slaweq | njohnston: thx | 15:08 |
slaweq | from other projects which I see we are still missing patches for networking-odl and midonet | 15:08 |
slaweq | and that would be all IMO | 15:08 |
bcafarel | next we wan start tackling W goals then? ;) | 15:09 |
slaweq | but community seems to slow for us :P | 15:10 |
slaweq | *to be to slow | 15:10 |
slaweq | anything else related to the stadium projects? | 15:11 |
slaweq | or can we move on? | 15:11 |
bcafarel | nothing from me | 15:12 |
slaweq | ok, so lets move on | 15:13 |
slaweq | #topic Grafana | 15:13 |
*** openstack changes topic to "Grafana (Meeting topic: neutron_ci)" | 15:13 | |
slaweq | #link http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 15:13 |
slaweq | generally this week it isn't bad | 15:14 |
slaweq | functional jobs went down a bit | 15:15 |
slaweq | non-voting ovn jobs are going down nicely too | 15:15 |
slaweq | neutron-tempest-plugin jobs are below 10% of failures (except this dvr multinode one which is still non-voting) | 15:16 |
slaweq | but I again collected some stats about number of rechecks from last few weeks | 15:16 |
slaweq | week 5 of 2020 - 3.9 | 15:16 |
slaweq | week 6 of 2020 - 5.8 | 15:16 |
slaweq | week 7 of 2020 - 1.75 | 15:16 |
slaweq | week 8 of 2020 - 5.4 | 15:16 |
slaweq | week 9 of 2020 - 5.6 | 15:16 |
slaweq | week 10 of 2020 - 3.3 | 15:17 |
slaweq | and tbh that sucks :/ | 15:17 |
bcafarel | master only I suppose? | 15:17 |
slaweq | bcafarel: yes, master branch only | 15:18 |
slaweq | but I'm affraid that for stable branches it may be even worst | 15:18 |
bcafarel | oh yes | 15:18 |
*** lpetrut has quit IRC | 15:18 | |
bcafarel | so if master-only yes these are not nice numbers | 15:19 |
bcafarel | stable branches were quite unstable so far in 2020, but well most for known reasons | 15:19 |
slaweq | yes, I know about reasons | 15:19 |
slaweq | but still - that sucks :/ | 15:19 |
slaweq | I don't know how but we should do better | 15:19 |
slaweq | :) | 15:19 |
slaweq | ok, anything else related to grafana? | 15:20 |
slaweq | ahh, one small thing - we need to remove neutron-tempest-dvr job from grafana now, I will send patch for that | 15:22 |
slaweq | #action slaweq to remove neutron-tempest-dvr job from grafana | 15:22 |
slaweq | ok, so lets go to the next topics | 15:22 |
slaweq | #topic fullstack/functional | 15:22 |
*** openstack changes topic to "fullstack/functional (Meeting topic: neutron_ci)" | 15:22 | |
slaweq | as usually I went through failures from last few days | 15:22 |
slaweq | and I didn't found too many (new) problems in fact | 15:22 |
slaweq | for functional job there is bug https://bugs.launchpad.net/neutron/+bug/1865453 | 15:23 |
openstack | Launchpad bug 1865453 in neutron "neutron.tests.functional.plugins.ml2.drivers.ovn.mech_driver.test_mech_driver.TestVirtualPorts.test_virtual_port_created_before fails randomly" [High,Confirmed] | 15:23 |
slaweq | failures like: | 15:23 |
slaweq | https://1af8099e455ea1c4b83e-70dbf706fcc5aea923a17246b1623369.ssl.cf1.rackcdn.com/710558/4/check/neutron-functional/a4c7cdd/testr_results.html | 15:23 |
slaweq | https://87ace9534a53ef030fdb-5ceaba4a59a2578b108bb2f456b59bef.ssl.cf5.rackcdn.com/710782/3/check/neutron-functional/fcf5a14/testr_results.html (different test from the same module) | 15:23 |
ralonsoh | this is already solved | 15:23 |
ralonsoh | that was a problem in OVN | 15:23 |
maciejjozefczyk | ralonsoh, no, this is different case | 15:23 |
ralonsoh | ah ok sorry | 15:23 |
ralonsoh | ah yes | 15:23 |
maciejjozefczyk | the case about port type has been fixed, but slaweq found other logs from the same class ;( | 15:24 |
slaweq | ralonsoh: it's error on assertion of uuids | 15:24 |
maciejjozefczyk | yes | 15:24 |
maciejjozefczyk | I'm gonna take a look on this one | 15:24 |
slaweq | maciejjozefczyk: you welcome :P | 15:24 |
maciejjozefczyk | slaweq, ;) | 15:24 |
slaweq | thx maciejjozefczyk | 15:24 |
slaweq | #action maciejjozefczyk to take a look at https://bugs.launchpad.net/neutron/+bug/1865453 | 15:24 |
openstack | Launchpad bug 1865453 in neutron "neutron.tests.functional.plugins.ml2.drivers.ovn.mech_driver.test_mech_driver.TestVirtualPorts.test_virtual_port_created_before fails randomly" [High,Confirmed] | 15:24 |
slaweq | now You are really volunteered for it for this week ;) | 15:25 |
ralonsoh | maybe this problem is due to a race condition, creating several ports at the same time in different tests | 15:25 |
ralonsoh | but we can discuss this in launchpad | 15:25 |
slaweq | sure ralonsoh, that can works too for me | 15:26 |
maciejjozefczyk | slaweq, we'll figure out whats wrong, potentially race condition | 15:27 |
slaweq | thx maciejjozefczyk and ralonsoh :) | 15:27 |
slaweq | ok, lets move on | 15:27 |
slaweq | Deletion of namespace issue (again) | 15:27 |
slaweq | https://97c37a5ba6a0beef442c-e131daf8cc02ece8b285c96d25e8c4eb.ssl.cf2.rackcdn.com/709110/2/check/neutron-functional/dad905e/testr_results.html | 15:27 |
slaweq | ralonsoh: You should be familiar with this :/ | 15:28 |
ralonsoh | I'll take a look at this again | 15:28 |
slaweq | it's from today morning | 15:28 |
*** jamesmcarthur has joined #openstack-meeting-3 | 15:28 | |
slaweq | and that's all about functional job from me for today | 15:29 |
slaweq | do You have anything else You want to discuss? | 15:29 |
ralonsoh | no | 15:29 |
njohnston | I saw one failure today in neutron.tests.functional.plugins.ml2.drivers.ovn.mech_driver.test_mech_driver.TestVirtualPorts, cecking to see if it happens elsewhere https://87ace9534a53ef030fdb-5ceaba4a59a2578b108bb2f456b59bef.ssl.cf5.rackcdn.com/710782/3/check/neutron-functional/fcf5a14/testr_results.html | 15:30 |
njohnston | otherwise nothing | 15:30 |
slaweq | njohnston: I think it's the same issue like in https://bugs.launchpad.net/neutron/+bug/1865453 | 15:30 |
openstack | Launchpad bug 1865453 in neutron "neutron.tests.functional.plugins.ml2.drivers.ovn.mech_driver.test_mech_driver.TestVirtualPorts.test_virtual_port_created_before fails randomly" [High,Confirmed] - Assigned to Maciej Jozefczyk (maciej.jozefczyk) | 15:30 |
ralonsoh | most likely | 15:31 |
slaweq | so if there is nothing else, lets move on | 15:31 |
slaweq | #topic Tempest/Scenario | 15:31 |
*** openstack changes topic to "Tempest/Scenario (Meeting topic: neutron_ci)" | 15:31 | |
slaweq | neutron_tempest_plugin.scenario.test_multicast.MulticastTestIPv4 failing often on deletion of server | 15:31 |
slaweq | https://e485228b4bd099d97917-b4e19c98e06eb23bd3ecd1208eab0884.ssl.cf2.rackcdn.com/703376/14/check/neutron-tempest-plugin-scenario-openvswitch-iptables_hybrid/35cab23/testr_results.html | 15:31 |
slaweq | I saw it already couple of times | 15:32 |
slaweq | is there anyone who wants to take a look at this? | 15:32 |
ralonsoh | I can | 15:32 |
slaweq | thx ralonsoh | 15:32 |
slaweq | will You also open LP for that? | 15:32 |
ralonsoh | (I think lucas sent a patch for this one, I need to check) | 15:32 |
ralonsoh | slaweq, sure | 15:32 |
slaweq | would be great, thx | 15:33 |
slaweq | #action ralonsoh to check "neutron_tempest_plugin.scenario.test_multicast.MulticastTestIPv4 failing often on deletion of server" | 15:33 |
slaweq | and another issue which I found is | 15:33 |
slaweq | Problem with logging of console output: | 15:33 |
slaweq | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_dc4/706152/11/check/neutron-tempest-plugin-scenario-openvswitch/dc49892/testr_results.html | 15:33 |
slaweq | and that's probably caused by my patch which was merged recently | 15:33 |
*** jamesmcarthur has quit IRC | 15:33 | |
slaweq | so I will take a look at it | 15:33 |
ralonsoh | ups, that's mine | 15:34 |
slaweq | yours? | 15:34 |
ralonsoh | I think so, I'll check that | 15:34 |
slaweq | ok, thx a lot | 15:34 |
slaweq | that's probably some trivial issue to fix | 15:34 |
slaweq | and it's not reason why test failed | 15:34 |
slaweq | but that error happend after failure of ssh or ping | 15:35 |
slaweq | but would be good to get it fixed to see this console output | 15:35 |
slaweq | according to random ssh issues in dvr jobs I still didn't had time to check it locally | 15:36 |
ralonsoh | (ok, not mine, I added the next method, not this one) | 15:36 |
slaweq | ralonsoh: ok, I will check that | 15:36 |
slaweq | #action slaweq to check problem with console output in scenario test | 15:36 |
slaweq | ok, and that's all what I have for today actually | 15:37 |
slaweq | do You have anything else regarding scenario jobs, or ci in generall? | 15:37 |
ralonsoh | no | 15:37 |
bcafarel | nope | 15:38 |
slaweq | great | 15:38 |
slaweq | so lets finish a bit earlier today | 15:38 |
slaweq | thx for attending and see You next week | 15:38 |
slaweq | o/ | 15:38 |
slaweq | #endmeeting | 15:38 |
ralonsoh | bye | 15:38 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 15:38 | |
openstack | Meeting ended Wed Mar 4 15:38:51 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:38 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_ci/2020/neutron_ci.2020-03-04-15.00.html | 15:38 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_ci/2020/neutron_ci.2020-03-04-15.00.txt | 15:38 |
openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_ci/2020/neutron_ci.2020-03-04-15.00.log.html | 15:38 |
bcafarel | o/ | 15:39 |
*** psachin has joined #openstack-meeting-3 | 15:40 | |
*** yamamoto has quit IRC | 15:46 | |
*** yamamoto has joined #openstack-meeting-3 | 15:47 | |
*** yamamoto has quit IRC | 15:50 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 15:55 | |
*** psachin has quit IRC | 15:56 | |
*** psachin has joined #openstack-meeting-3 | 16:04 | |
*** jamesmcarthur has quit IRC | 16:05 | |
*** yamamoto has joined #openstack-meeting-3 | 16:27 | |
*** yamamoto has quit IRC | 16:33 | |
*** ricolin has joined #openstack-meeting-3 | 16:37 | |
*** maciejjozefczyk_ has joined #openstack-meeting-3 | 16:51 | |
*** maciejjozefczyk has quit IRC | 16:52 | |
*** negronjl has quit IRC | 16:53 | |
*** psachin has quit IRC | 16:53 | |
*** maciejjozefczyk_ has quit IRC | 16:56 | |
*** negronjl has joined #openstack-meeting-3 | 16:57 | |
*** rubasov has quit IRC | 16:58 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 17:11 | |
*** igordc has joined #openstack-meeting-3 | 17:33 | |
*** njohnston has quit IRC | 17:53 | |
*** njohnston has joined #openstack-meeting-3 | 17:57 | |
*** igordc has quit IRC | 18:04 | |
*** igordc has joined #openstack-meeting-3 | 18:05 | |
*** diablo_rojo has joined #openstack-meeting-3 | 18:11 | |
*** e0ne has quit IRC | 18:12 | |
*** igordc has quit IRC | 18:27 | |
*** igordc has joined #openstack-meeting-3 | 18:33 | |
*** jamesmcarthur has quit IRC | 18:56 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 19:22 | |
*** jamesmcarthur has quit IRC | 19:33 | |
*** ralonsoh has quit IRC | 19:38 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 19:47 | |
*** e0ne has joined #openstack-meeting-3 | 20:17 | |
*** jamesmcarthur has quit IRC | 20:49 | |
*** raildo has quit IRC | 21:02 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 21:12 | |
*** yamamoto has joined #openstack-meeting-3 | 21:43 | |
*** jamesmcarthur has quit IRC | 21:44 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 21:44 | |
*** yamamoto has quit IRC | 21:49 | |
*** jamesmcarthur has quit IRC | 21:56 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 21:57 | |
*** jamesmcarthur has quit IRC | 22:08 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 22:10 | |
*** slaweq has quit IRC | 22:21 | |
*** jamesmcarthur has quit IRC | 22:22 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 22:32 | |
*** jamesmcarthur has quit IRC | 22:37 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 22:44 | |
*** jamesmcarthur has quit IRC | 22:47 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 22:52 | |
*** jamesmcarthur has quit IRC | 22:53 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 22:54 | |
*** jamesmcarthur has quit IRC | 23:02 | |
*** jamesmcarthur has joined #openstack-meeting-3 | 23:09 | |
*** slaweq has joined #openstack-meeting-3 | 23:11 | |
*** jamesmcarthur has quit IRC | 23:12 | |
*** slaweq has quit IRC | 23:16 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!