Thursday, 2020-10-22

*** sapd1 has joined #openstack-neutron00:18
*** hamalq has quit IRC00:44
*** sapd1 has quit IRC00:45
*** sapd1 has joined #openstack-neutron01:45
openstackgerritYongli He proposed openstack/neutron-lib master: port-backend API defination  https://review.opendev.org/75916602:21
*** sapd1 has quit IRC02:34
*** songwenping__ has quit IRC02:38
*** ramishra has joined #openstack-neutron02:40
*** sapd1 has joined #openstack-neutron02:49
*** rcernin has quit IRC02:52
*** rcernin has joined #openstack-neutron02:56
openstackgerritYongli He proposed openstack/python-neutronclient master: Debug only patch for neutron port-backend API and extension  https://review.opendev.org/75917603:21
*** recyclehero has quit IRC03:36
*** lajoskatona has joined #openstack-neutron03:55
*** ratailor has joined #openstack-neutron04:18
*** kobis1 has joined #openstack-neutron04:47
*** kobis1 has quit IRC04:47
openstackgerritMerged openstack/os-vif master: Fix - os-vif fails to get the correct UpLink Representor  https://review.opendev.org/74589504:49
*** gcheresh has joined #openstack-neutron04:52
*** sapd1 has quit IRC05:41
*** recyclehero has joined #openstack-neutron05:53
*** sapd1 has joined #openstack-neutron05:58
*** recyclehero has quit IRC06:07
*** lpetrut has joined #openstack-neutron06:09
*** tbachman has quit IRC06:10
*** tbachman has joined #openstack-neutron06:15
*** macz_ has joined #openstack-neutron06:19
*** slaweq has joined #openstack-neutron06:21
*** macz_ has quit IRC06:24
*** yonglihe has joined #openstack-neutron06:30
*** recyclehero has joined #openstack-neutron06:44
*** slaweq has quit IRC06:44
*** jlibosva has joined #openstack-neutron06:45
*** slaweq has joined #openstack-neutron06:46
*** rpittau|afk is now known as rpittau06:54
*** jawad_axd has joined #openstack-neutron06:54
*** recyclehero has quit IRC07:02
*** recyclehero has joined #openstack-neutron07:03
*** ralonsoh has joined #openstack-neutron07:05
*** bengates has joined #openstack-neutron07:06
*** ccamposr__ has joined #openstack-neutron07:09
*** ccamposr has quit IRC07:12
*** tesseract has joined #openstack-neutron07:27
*** tmorin has joined #openstack-neutron07:32
*** halali_ has joined #openstack-neutron07:34
*** jpena|off is now known as jpena07:36
*** ociuhandu has joined #openstack-neutron07:41
*** rcernin has quit IRC07:42
*** grandfso has joined #openstack-neutron07:47
*** bengates has quit IRC07:48
*** bengates has joined #openstack-neutron07:48
*** rcernin has joined #openstack-neutron07:49
*** njohnston has quit IRC07:52
*** rcernin has quit IRC07:54
*** elvira has joined #openstack-neutron07:57
*** rcernin has joined #openstack-neutron08:00
*** macz_ has joined #openstack-neutron08:07
*** lucasagomes has joined #openstack-neutron08:10
*** macz_ has quit IRC08:12
*** rcernin has quit IRC08:12
*** rcernin has joined #openstack-neutron08:22
*** rcernin has quit IRC08:26
*** salmankhan has joined #openstack-neutron08:35
*** dtantsur|afk is now known as dtantsur08:56
*** iurygregory has quit IRC08:57
openstackgerritSlawek Kaplonski proposed openstack/neutron master: Add devstack-tobiko-faults-centos job to the periodic queue  https://review.opendev.org/75922509:03
slaweqralonsoh: lajoskatona: bcafarel: we didn't have ci meeting this week, but please take a look at ^^ and tell me what You think about that idea :)09:04
slaweqthx in advance09:04
ralonsohslaweq, I'll check it now09:05
lajoskatonaslaweq: ok09:13
*** rcernin has joined #openstack-neutron09:21
*** rcernin has quit IRC09:25
*** iurygregory has joined #openstack-neutron09:28
lajoskatonaslaweq: is this job defined somewhere here: https://opendev.org/x/tobiko ?09:35
*** sapd1 has quit IRC09:39
slaweqlajoskatona: no, it's in https://opendev.org/x/devstack-plugin-tobiko/src/branch/master/zuul.d/jobs.yaml#L23309:39
*** sapd1 has joined #openstack-neutron09:42
Adri2000hello! anyone feels like reviewing https://review.opendev.org/#/c/757107/ ? :) my understanding is that it impacts quite a lot of people, potentially09:45
lajoskatonaslaweq: ahhh, ok ,the hound can't find it there....09:45
lajoskatonaslaweq: http://codesearch.openstack.org/?q=devstack-tobiko-faults-centos&i=nope&files=&repos=09:46
ralonsohI had the same problem, I didn't find it09:50
*** salmankhan1 has joined #openstack-neutron09:54
ralonsohslaweq, ^^ https://review.opendev.org/#/c/757107/09:54
ralonsohand lajoskatona09:54
ralonsohif you don't mind to review the patch09:54
lajoskatonaralonsoh: I am on it :-)09:54
ralonsohthanks a lot09:54
*** salmankhan has quit IRC09:55
*** salmankhan1 is now known as salmankhan09:55
*** bengates has quit IRC10:28
*** bengates has joined #openstack-neutron10:30
*** jangutter has joined #openstack-neutron10:36
*** rcernin has joined #openstack-neutron10:43
*** rcernin has quit IRC10:48
*** tbachman has quit IRC11:04
*** jawad_axd has quit IRC11:11
*** sapd1 has quit IRC11:30
*** jpena is now known as jpena|lunch11:35
*** spatel has joined #openstack-neutron11:46
*** ratailor has quit IRC11:48
*** tmorin has quit IRC11:48
*** tmorin has joined #openstack-neutron11:49
*** tmorin has quit IRC11:49
*** spatel has quit IRC11:51
*** takamatsu has joined #openstack-neutron11:54
*** nweinber has joined #openstack-neutron11:56
*** sapd1 has joined #openstack-neutron12:08
*** sapd1 has quit IRC12:13
*** rcernin has joined #openstack-neutron12:17
*** raildo has joined #openstack-neutron12:18
*** jawad_axd has joined #openstack-neutron12:19
*** tmorin has joined #openstack-neutron12:21
*** rcernin has quit IRC12:22
*** jpena|lunch is now known as jpena12:32
openstackgerritsean mooney proposed openstack/os-vif stable/victoria: Fix - os-vif fails to get the correct UpLink Representor  https://review.opendev.org/75925512:32
openstackgerritLucas Alvares Gomes proposed openstack/neutron master: [OVN] Gate on the released version of OVN for the multinode job  https://review.opendev.org/75925712:38
*** tbachman has joined #openstack-neutron12:39
openstackgerritPavlo Shchelokovskyy proposed openstack/neutron master: Treat Forbidden as NotFound in Designate  https://review.opendev.org/75326812:48
openstackgerritMerged openstack/neutron master: "scope" conversion only just before pyroute2 method call  https://review.opendev.org/75710712:58
openstackgerritSlawek Kaplonski proposed openstack/neutron-tempest-plugin master: Check VM's console log before trying to SSH to it.  https://review.opendev.org/75896813:15
openstackgerritSlawek Kaplonski proposed openstack/networking-bgpvpn master: Rename jobs from the experimental queue  https://review.opendev.org/75810313:22
*** lpetrut has quit IRC13:22
*** tmorin has quit IRC13:27
*** jawad_axd has quit IRC13:28
slaweqralonsoh: sean-k-mooney: hi, can You maybe take a look at failure of test in https://api.us-east.open-edge.io:8080/swift/v1/AUTH_e02c11e4e2c24efc98022353c88ab506/zuul_opendev_logs_9ad/725526/6/check/neutron-tempest-plugin-scenario-linuxbridge-stein/9adcc83/testr_results.html ?13:30
slaweqralonsoh: sean-k-mooney: from nova-compute logs I see that there was error like "libvirt.libvirtError: internal error: End of file from qemu monitor" related to that instance13:30
slaweqralonsoh: sean-k-mooney: do You think it could be oom-killer who killed qemu process?13:31
ralonsohslaweq, let me check13:31
slaweqralonsoh: lajoskatona: also, can You maybe take a look at patch https://review.opendev.org/#/c/725526/ if You will have some time?13:31
slaweqralonsoh: thx a lot13:32
sean-k-mooney slaweq it might have been13:32
sean-k-mooneyill take a look13:32
sean-k-mooneyit sound like a qemu crash13:32
sean-k-mooneylooks like it hapes after a device detach13:34
sean-k-mooneythere were bugs in some version fo qemu where a device hotunplg would crash qemu13:34
sean-k-mooneythe qemu logs are here https://api.us-east.open-edge.io:8080/swift/v1/AUTH_e02c11e4e2c24efc98022353c88ab506/zuul_opendev_logs_9ad/725526/6/check/neutron-tempest-plugin-scenario-linuxbridge-stein/9adcc83/controller/logs/libvirt/qemu/index.html13:34
sean-k-mooneyjust need to fine teh one for that instas13:34
sean-k-mooney*instance13:34
sean-k-mooneynoting in the qemu log https://api.us-east.open-edge.io:8080/swift/v1/AUTH_e02c11e4e2c24efc98022353c88ab506/zuul_opendev_logs_9ad/725526/6/check/neutron-tempest-plugin-scenario-linuxbridge-stein/9adcc83/controller/logs/libvirt/qemu/instance-0000000d_log.txt13:37
*** rcernin has joined #openstack-neutron13:41
slaweqthx sean-k-mooney for taking a look at that13:41
ralonsohslaweq, do you know how much memory those controllers have?13:41
slaweqralonsoh: nope13:41
slaweqI think that some time ago (long ago) I heard something about 8GB but that may be totally wrong13:42
ralonsohslaweq, yes13:42
ralonsohthis could be13:42
ralonsohwe are always in the top of memory consumption13:42
sean-k-mooneythey have 8G13:43
openstackgerritAdrien Cunin proposed openstack/neutron stable/victoria: "scope" conversion only just before pyroute2 method call  https://review.opendev.org/75926513:43
sean-k-mooneyi dont think its an OOM issue13:43
openstackgerritAdrien Cunin proposed openstack/neutron stable/ussuri: "scope" conversion only just before pyroute2 method call  https://review.opendev.org/75926613:43
sean-k-mooneyyou could look at https://api.us-east.open-edge.io:8080/swift/v1/AUTH_e02c11e4e2c24efc98022353c88ab506/zuul_opendev_logs_9ad/725526/6/check/neutron-tempest-plugin-scenario-linuxbridge-stein/9adcc83/controller/logs/screen-peakmem_tracker.txt13:43
openstackgerritAdrien Cunin proposed openstack/neutron stable/train: "scope" conversion only just before pyroute2 method call  https://review.opendev.org/75926713:43
slaweqralonsoh: yes, look here https://zuul.opendev.org/t/openstack/build/c0ddf2963fb84c9ab83356f9a57f582a/log/zuul-info/host-info.controller.yaml#39013:44
ralonsohsean-k-mooney, I'm reviewing the dstat logs13:44
ralonsohthe peak consumption is 7.1 GB13:45
*** rcernin has quit IRC13:45
slaweqsean-k-mooney: in file which You linked me there is huge gap in time when this instance was killed13:46
sean-k-mooneyyes i just noticed that13:46
sean-k-mooneyit very helpful that way13:46
slaweqthere is basically nothing between 08:49:50 and 9:2113:46
sean-k-mooneylooking at dstat it look fine13:48
sean-k-mooneyis this a one off failure or repeatable13:49
lajoskatonaslaweq: done13:49
sean-k-mooneyif its a one off i would just recheck and see if it comes up again13:49
openstackgerritSlawek Kaplonski proposed openstack/neutron-tempest-plugin master: Use different job definition for linuxbridge jobs runs on Xenial  https://review.opendev.org/75837713:49
openstackgerritSlawek Kaplonski proposed openstack/neutron-tempest-plugin master: DNM Test queens and rocky jobs (especially linuxbridge)  https://review.opendev.org/75838113:50
openstackgerritSlawek Kaplonski proposed openstack/neutron master: Don't fail if FIP is not in port forwarding cache during cleaning  https://review.opendev.org/75411413:50
slaweqsean-k-mooney: so far I saw it once, but tbh, in other cases I didn't check exactly nova logs13:52
slaweqI will take a closer look for similar issues, and if it will repeat, I will ping You13:52
slaweqthx for checking that13:52
slaweqlajoskatona: thx a lot13:53
openstackgerritAdrien Cunin proposed openstack/neutron stable/stein: "scope" conversion only just before pyroute2 method call  https://review.opendev.org/75926913:59
sean-k-mooneyi was hoping to see something in the qemu logs to be honest but i didnt so there is not much to go on13:59
sean-k-mooneyi do know that we have had some issue with device detach in the past so you might have just randomly hit one13:59
*** takamatsu is now known as mauro|call14:04
*** mauro|call is now known as takamatsu14:04
*** Muran has joined #openstack-neutron14:10
Adri2000hello ralonsoh, not sure I understand your comment at https://review.opendev.org/#/c/759266/ - I've done all the backports directly from master, so why would I mention the victoria commit id?14:13
ralonsohAdri2000, usually the backports are done in a chain. From master to V, then the V patch to U14:14
ralonsohlet me find something14:14
Adri2000ah, didn't know that, is it specific to neutron or global to all openstaack projects?14:14
ralonsohhttps://review.opendev.org/#/c/755768/14:14
Adri2000I re-read https://docs.openstack.org/project-team-guide/stable-branches.html when doing the backports and didn't see anything there14:15
ralonsohthat's to have a full patch history14:15
*** salmankhan has quit IRC14:15
*** sapd1 has joined #openstack-neutron14:15
Adri2000I get the idea, although I'm not sure I get how it makes sense :) the ussuri commit is really not linked to the victoria commit id, so why mention it? if it's just to be able to group all these commits together, I think that's what the change ID is for? https://review.opendev.org/#/q/I55a0f4341b328af52ea3bd758a72f633fbe3abcb14:21
Adri2000also I don't think I've seen that in other openstack projects where I did cherry-picks... but if it's really a rule for neutron, then let me know and I'll edit the commit messages :) (so it means for the stein backport I'd have 4 "cherry picked from commit" lines?)14:24
ralonsohyes14:24
*** grandfso has quit IRC14:24
openstackgerritAdrien Cunin proposed openstack/neutron stable/ussuri: "scope" conversion only just before pyroute2 method call  https://review.opendev.org/75926614:27
openstackgerritAdrien Cunin proposed openstack/neutron stable/train: "scope" conversion only just before pyroute2 method call  https://review.opendev.org/75926714:30
openstackgerritAdrien Cunin proposed openstack/neutron stable/stein: "scope" conversion only just before pyroute2 method call  https://review.opendev.org/75926914:31
Adri2000ralonsoh: alright! :)14:32
*** tbachman_ has joined #openstack-neutron14:33
*** tbachman has quit IRC14:35
*** tbachman_ is now known as tbachman14:35
*** salmankhan has joined #openstack-neutron14:39
*** salmankhan1 has joined #openstack-neutron14:42
*** halali_ has quit IRC14:43
*** salmankhan has quit IRC14:43
*** salmankhan1 is now known as salmankhan14:43
*** macz_ has joined #openstack-neutron14:45
*** macz_ has quit IRC14:45
slaweqralonsoh: lajoskatona can one of You click +W in https://review.opendev.org/#/c/750888/ ?14:48
slaweqthx in advance14:48
lajoskatonaslaweq: I can't.... :-(14:49
lajoskatonaslaweq: I can just +2 on it it seems, and change priority14:49
slaweqlajoskatona: ahh, only drivers team members can approve patches in neutron-lib14:55
slaweqso ralonsoh - I hope You can do that :)14:55
*** jawad_axd has joined #openstack-neutron14:55
lajoskatonaslaweq: that was my feeling as well.14:56
openstackgerritSlawek Kaplonski proposed openstack/neutron master: Add normalized_cidr column to SG rules  https://review.opendev.org/74915814:56
openstackgerritSlawek Kaplonski proposed openstack/neutron master: Add normalized_cidr column to SG rules  https://review.opendev.org/74915814:56
ralonsohslaweq, done14:56
*** halali_ has joined #openstack-neutron14:58
*** mlavalle has joined #openstack-neutron15:00
*** gcheresh has quit IRC15:00
slaweqralonsoh: thx15:01
slaweqralonsoh: lajoskatona: about https://review.opendev.org/#/c/759225/ do You want also someone else to check it or can You maybe approve that one too?15:01
slaweq:)15:01
slaweqsorry that I'm distrurbing You a lot today but my list of opened patches become very long and I need to close finally some of them :)15:02
ralonsohslaweq, we can go for it15:02
slaweqralonsoh++ thx15:03
slaweqlajoskatona: and also if You can check https://review.opendev.org/#/c/755122/ that would be great :)15:03
mlavalleslaweq, dalvarez: can I run this only with virtualbox, i.e. no libvirt: https://github.com/danalsan/vagrants/blob/master/devstack-workshop/Vagrantfile15:04
mlavalle?15:04
slaweqmlavalle: yes, with newest version of that file You should be able to15:04
slaweqYou need to run "vagrant up --provider virtualbox" (or something like that)15:05
mlavalleok15:05
*** jawad_axd has quit IRC15:05
*** tbachman_ has joined #openstack-neutron15:10
*** tbachman has quit IRC15:11
*** tbachman_ is now known as tbachman15:11
*** gregwork has joined #openstack-neutron15:26
mlavalleslaweq: when you have a chance, please look at https://review.opendev.org/#/c/757653/. You had already +2ed it and then lajoskatona requested some minor changes15:28
*** rcernin has joined #openstack-neutron15:42
*** bengates has quit IRC15:43
*** bengates has joined #openstack-neutron15:44
*** rcernin has quit IRC15:46
*** bengates has quit IRC15:48
openstackgerritMiguel Lavalle proposed openstack/neutron master: Agent side push notifications for address groups  https://review.opendev.org/75911715:49
*** rpittau is now known as rpittau|afk15:57
jkulikhi, we stumbled over https://bugs.launchpad.net/neutron/+bug/1791233 in production. Is there any reason why the `networksegments` table doesn't have a UniqueConstraint on (network_id, physical_network)?15:59
openstackLaunchpad bug 1791233 in neutron "Redundant dynamic partial segments was allocated for the same network and physical_network" [Undecided,New]15:59
*** lucasagomes has quit IRC16:00
*** seba has joined #openstack-neutron16:00
*** hamalq has joined #openstack-neutron16:07
openstackgerritTerry Wilson proposed openstack/neutron master: Avoid race condition when processing RowEvents  https://review.opendev.org/75384716:09
*** hamalq has quit IRC16:10
*** hamalq has joined #openstack-neutron16:10
*** lajoskatona has quit IRC16:15
openstackgerritMerged openstack/neutron-lib master: Add BRODCAST_MAC constant with "FF:FF:FF:FF:FF:FF" value  https://review.opendev.org/75088816:17
*** ociuhandu_ has joined #openstack-neutron16:28
*** jpena is now known as jpena|off16:29
*** wwriverrat has quit IRC16:30
*** dtantsur is now known as dtantsur|afk16:31
*** ociuhandu has quit IRC16:32
*** ociuhandu_ has quit IRC16:32
*** gcheresh has joined #openstack-neutron16:41
*** jlibosva has quit IRC16:58
openstackgerritMerged openstack/neutron-tempest-plugin master: Improve logging of vm's console output when test fails  https://review.opendev.org/75512217:04
*** gcheresh has quit IRC17:05
*** ccamposr has joined #openstack-neutron17:06
*** ralonsoh has quit IRC17:08
*** ccamposr__ has quit IRC17:09
*** jawad_axd has joined #openstack-neutron17:17
*** lajoskatona has joined #openstack-neutron17:24
*** lajoskatona has quit IRC17:25
*** tesseract has quit IRC17:26
*** jawad_axd has quit IRC17:32
*** jlibosva has joined #openstack-neutron17:34
*** jlibosva has quit IRC17:38
*** sapd1 has quit IRC17:51
*** salmankhan1 has joined #openstack-neutron18:17
*** elvira has quit IRC18:18
*** salmankhan has quit IRC18:20
*** salmankhan1 has quit IRC18:21
openstackgerrithamza proposed openstack/neutron master: Documentation for the adding extra port  https://review.opendev.org/75931218:26
openstackgerrithamza proposed openstack/neutron master: Documentation for adding extra port conflict fix  https://review.opendev.org/75931218:29
*** KurtB has quit IRC18:35
*** eandersson has quit IRC19:10
*** ccstone has quit IRC19:10
*** ccstone has joined #openstack-neutron19:11
*** eandersson has joined #openstack-neutron19:11
slaweqmlavalle: done19:11
mlavalleslaweq: :-)19:11
*** imtiazc has joined #openstack-neutron19:18
*** halali_ has quit IRC19:24
*** halali_ has joined #openstack-neutron19:25
openstackgerritSlawek Kaplonski proposed openstack/neutron-tempest-plugin master: Add SSHExecCommandFailed to be handled in the fip_pf_connectivity  https://review.opendev.org/74896819:28
*** rcernin has joined #openstack-neutron19:43
*** Muran has quit IRC19:47
*** rcernin has quit IRC19:48
*** halali_ has quit IRC20:08
*** salmankhan has joined #openstack-neutron20:16
*** salmankhan has quit IRC20:21
*** nweinber has quit IRC20:26
*** slaweq has quit IRC20:26
*** jlibosva has joined #openstack-neutron20:52
*** gcheresh has joined #openstack-neutron20:56
*** servagem has quit IRC20:56
*** jlibosva has quit IRC20:57
*** slaweq has joined #openstack-neutron21:08
openstackgerritMerged openstack/python-neutronclient stable/victoria: Fix lower-constraints for Focal  https://review.opendev.org/75237721:11
*** slaweq has quit IRC21:27
openstackgerritMerged openstack/python-neutronclient stable/victoria: Update .gitreview for stable/victoria  https://review.opendev.org/75072721:34
*** gcheresh has quit IRC21:46
*** hamalq_ has joined #openstack-neutron21:48
*** hamalq has quit IRC21:51
*** mlavalle has quit IRC22:15
nsmedsHey everyone. Shot in the dark: has anyone experienced a situation where, using distributed virtual routers, the Keepalived healthcheck (which pings the public gateway) seems to lose connectivity to the gateway a few times a day, for ~10 seconds?22:15
nsmedsTrying to trouble very brief, very irregular outages which occur because of this.22:15
nsmedsTrying to troubleshoot*22:15
*** rcernin has joined #openstack-neutron22:30
*** rcernin has quit IRC22:49
*** rcernin has joined #openstack-neutron22:52
*** benj_ has quit IRC23:21
*** macz_ has joined #openstack-neutron23:25
*** benj_ has joined #openstack-neutron23:26
*** macz_ has quit IRC23:35
*** tbachman has quit IRC23:40
*** tbachman has joined #openstack-neutron23:41
*** tbachman_ has joined #openstack-neutron23:44
*** tbachman has quit IRC23:47
*** tbachman_ is now known as tbachman23:47

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!