| openstackgerrit | LIU Yulong proposed openstack/neutron-specs master: L3 agent self-service metering https://review.opendev.org/658511 | 00:46 |
|---|---|---|
| openstackgerrit | LIU Yulong proposed openstack/neutron-specs master: Neutron detector resource and agent https://review.opendev.org/662541 | 00:46 |
| jakeyip | otherwiseguy: hmm I didn't set any timeouts in the config, as far as I can tell. (thihs is for the latest run, in devstack). I run the sync with --ovn-ovsdb_connection_timeout 86400 , and yes it takes a long time. | 00:49 |
| *** benj_ has quit IRC | 00:56 | |
| jakeyip | otherwiseguy: may I ask where your sync currently is at? I'm currently stuck in `self.sync_acls(ctx)` - this syncs the ACLs and is the biggest transaction. Look for this in the log `ACLs-to-be-added 358434 ACLs-to-be-removed` | 00:57 |
| *** benj_ has joined #openstack-neutron | 00:58 | |
| jakeyip | otherwiseguy: without your indexing patch, trying to sync the ACL took days for us, and it got progressively slower and slower IIRC | 01:06 |
| openstackgerrit | LIU Yulong proposed openstack/neutron-specs master: L3 agent capacity and scheduling https://review.opendev.org/658451 | 01:31 |
| *** sapd__x has joined #openstack-neutron | 02:31 | |
| *** terdei has quit IRC | 02:36 | |
| *** terdei has joined #openstack-neutron | 02:41 | |
| *** hamalq has quit IRC | 03:24 | |
| *** hamalq has joined #openstack-neutron | 04:03 | |
| *** lxkong has quit IRC | 04:08 | |
| *** ociuhandu has joined #openstack-neutron | 05:07 | |
| *** ociuhandu has quit IRC | 05:11 | |
| *** sapd__x has quit IRC | 05:15 | |
| *** stephenfin has quit IRC | 05:21 | |
| *** stephenfin has joined #openstack-neutron | 05:28 | |
| *** slaweq has joined #openstack-neutron | 06:19 | |
| otherwiseguy | jakeyip: It's 1am here and at *some* point it died with: [...<ovsdbapp.schema.ovn_northbound.commands.PgAclAddCommand object at 0x7f00eaecd198>] exceeded timeout 180 seconds | 06:27 |
| otherwiseguy | It far exceeded my scrollback buffer, so that's what I get for not specifying a log file I guess. I'll try to start it running again with the timeouts set to ridiculous values/disabled where available. There is OVS.ovsdb_timeout=$big_number, OVN.ovsdb_probe_interval=0. There are also the ones you can set via ovn-nbctl set Connection ptcp:6641:0.0.0.0 inactivity_probe=0. | 06:40 |
| otherwiseguy | But ovn-northd is pegged at 100% after my sync failed finally. And doing anything w/ ovn-nbctl takes forver I'm assuming due to the size of the db (it downloads the whole db into memory every run of ovn-nbctl). | 06:43 |
| *** ociuhandu has joined #openstack-neutron | 06:45 | |
| *** ociuhandu has quit IRC | 06:53 | |
| *** hamalq has quit IRC | 07:03 | |
| *** hamalq has joined #openstack-neutron | 07:04 | |
| *** ociuhandu has joined #openstack-neutron | 07:08 | |
| *** slaweq has quit IRC | 07:16 | |
| *** ociuhandu has quit IRC | 07:18 | |
| *** lpetrut has joined #openstack-neutron | 07:21 | |
| *** slaweq has joined #openstack-neutron | 07:21 | |
| *** lpetrut has quit IRC | 07:22 | |
| *** slaweq has quit IRC | 07:26 | |
| *** gcheresh has joined #openstack-neutron | 07:46 | |
| *** slaweq has joined #openstack-neutron | 08:14 | |
| *** slaweq has quit IRC | 08:19 | |
| *** slaweq has joined #openstack-neutron | 08:32 | |
| *** gcheresh has quit IRC | 08:35 | |
| *** mjozefcz has quit IRC | 08:43 | |
| *** slaweq has quit IRC | 08:47 | |
| *** slaweq has joined #openstack-neutron | 08:48 | |
| openstackgerrit | gugug proposed openstack/neutron-lib master: Remove translation sections from setup.cfg https://review.opendev.org/730437 | 08:50 |
| *** ociuhandu has joined #openstack-neutron | 08:51 | |
| openstackgerrit | gugug proposed openstack/neutron-fwaas master: Update docstheme for style https://review.opendev.org/730439 | 08:55 |
| openstackgerrit | gugug proposed openstack/neutron-fwaas master: Update docstheme for style https://review.opendev.org/730439 | 08:56 |
| openstackgerrit | gugug proposed openstack/neutron-fwaas master: [part1]: Remove all usage of six library https://review.opendev.org/730440 | 09:00 |
| openstackgerrit | gugug proposed openstack/neutron-fwaas master: [part2]: Remove all usage of six library https://review.opendev.org/730441 | 09:05 |
| openstackgerrit | gugug proposed openstack/neutron-vpnaas master: Remove translation sections from setup.cfg https://review.opendev.org/730442 | 09:08 |
| openstackgerrit | gugug proposed openstack/neutron-vpnaas master: Update docstheme for style https://review.opendev.org/730443 | 09:10 |
| openstackgerrit | gugug proposed openstack/neutron-vpnaas master: Update docstheme for style https://review.opendev.org/730443 | 09:11 |
| openstackgerrit | gugug proposed openstack/neutron-vpnaas master: Update hacking for Python3 https://review.opendev.org/730444 | 09:13 |
| *** gcheresh has joined #openstack-neutron | 09:20 | |
| *** BakaKuna has joined #openstack-neutron | 09:26 | |
| *** ociuhandu has quit IRC | 09:45 | |
| *** ociuhandu has joined #openstack-neutron | 09:46 | |
| BakaKuna | hi all, in my cloud. When I stop a dhcp-agent, the networks hosted on that agents will be moved to working dhcp agents. I don't see the same behaviour for routers. Is that a configuration option I missed or is that a difference between routers and networks? | 09:47 |
| *** ociuhandu has quit IRC | 09:50 | |
| *** gcheresh has quit IRC | 09:56 | |
| *** slaweq has quit IRC | 10:12 | |
| *** gcheresh has joined #openstack-neutron | 10:15 | |
| *** slaweq has joined #openstack-neutron | 10:18 | |
| *** slaweq has quit IRC | 10:23 | |
| *** ociuhandu has joined #openstack-neutron | 10:25 | |
| *** gcheresh has quit IRC | 10:27 | |
| *** ociuhandu has quit IRC | 10:32 | |
| *** aedc_ has joined #openstack-neutron | 10:40 | |
| *** aedc has quit IRC | 10:41 | |
| *** aedc_ has quit IRC | 10:42 | |
| *** lxkong has joined #openstack-neutron | 10:58 | |
| *** slaweq has joined #openstack-neutron | 11:01 | |
| *** nirmoy has joined #openstack-neutron | 11:02 | |
| *** tbachman has quit IRC | 11:03 | |
| *** tbachman has joined #openstack-neutron | 11:04 | |
| *** nirmoy has quit IRC | 11:04 | |
| *** nirmoy has joined #openstack-neutron | 11:05 | |
| *** hamalq has quit IRC | 11:07 | |
| *** tbachman_ has joined #openstack-neutron | 11:10 | |
| *** tbachman has quit IRC | 11:11 | |
| *** tbachman_ is now known as tbachman | 11:11 | |
| *** nirmoy has quit IRC | 12:10 | |
| *** nirmoy has joined #openstack-neutron | 12:11 | |
| openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/neutron master: All Neutron ML2 drivers use Allocation/Endpoints OVO https://review.opendev.org/709375 | 12:13 |
| *** mjozefcz has joined #openstack-neutron | 12:13 | |
| *** tbachman has quit IRC | 12:23 | |
| *** tbachman has joined #openstack-neutron | 12:24 | |
| *** sapd__x has joined #openstack-neutron | 12:40 | |
| *** tbachman_ has joined #openstack-neutron | 12:43 | |
| *** tbachman has quit IRC | 12:44 | |
| *** tbachman_ is now known as tbachman | 12:44 | |
| openstackgerrit | zhanghao proposed openstack/python-neutronclient master: Remove usage of six.add_metaclass https://review.opendev.org/730454 | 13:31 |
| *** nirmoy has quit IRC | 14:05 | |
| *** ociuhandu has joined #openstack-neutron | 14:07 | |
| *** ociuhandu has quit IRC | 14:12 | |
| *** gcheresh has joined #openstack-neutron | 14:19 | |
| *** gcheresh has quit IRC | 14:27 | |
| *** armax has quit IRC | 14:44 | |
| *** gibi has quit IRC | 15:10 | |
| *** gibi has joined #openstack-neutron | 15:10 | |
| openstackgerrit | Merged openstack/neutron stable/rocky: Allow usage of legacy 3rd-party interface drivers https://review.opendev.org/729731 | 15:30 |
| *** sapd__x has quit IRC | 15:37 | |
| openstackgerrit | Andreas Jaeger proposed openstack/networking-bgpvpn master: Switch to newer openstackdocstheme and reno versions https://review.opendev.org/730462 | 15:40 |
| openstackgerrit | Andreas Jaeger proposed openstack/networking-midonet master: Switch to newer openstackdocstheme and reno versions https://review.opendev.org/730465 | 15:44 |
| openstackgerrit | Andreas Jaeger proposed openstack/networking-odl master: Switch to newer openstackdocstheme and reno versions https://review.opendev.org/730466 | 15:45 |
| openstackgerrit | Andreas Jaeger proposed openstack/networking-sfc master: Switch to newer openstackdocstheme and reno versions https://review.opendev.org/730467 | 15:46 |
| openstackgerrit | Andreas Jaeger proposed openstack/neutron-dynamic-routing master: Switch to newer openstackdocstheme and reno versions https://review.opendev.org/730468 | 15:48 |
| openstackgerrit | Andreas Jaeger proposed openstack/neutron-fwaas-dashboard master: Switch to newer openstackdocstheme and reno versions https://review.opendev.org/730469 | 15:49 |
| openstackgerrit | Andreas Jaeger proposed openstack/neutron-vpnaas-dashboard master: Switch to newer openstackdocstheme and reno versions https://review.opendev.org/730470 | 15:50 |
| openstackgerrit | Andreas Jaeger proposed openstack/os-ken master: Switch to newer openstackdocstheme and reno versions https://review.opendev.org/730474 | 16:09 |
| *** BakaKuna has quit IRC | 16:18 | |
| *** gcheresh has joined #openstack-neutron | 18:02 | |
| *** xiaolin has quit IRC | 18:08 | |
| *** mjozefcz has quit IRC | 18:08 | |
| *** maciejjozefczyk has joined #openstack-neutron | 18:08 | |
| *** maciejjozefczyk has quit IRC | 18:11 | |
| *** maciejjozefczyk has joined #openstack-neutron | 18:11 | |
| *** gcheresh has quit IRC | 18:20 | |
| *** gcheresh has joined #openstack-neutron | 18:21 | |
| *** gcheresh has quit IRC | 18:43 | |
| *** dmellado has quit IRC | 18:47 | |
| *** dmellado has joined #openstack-neutron | 18:49 | |
| *** jawad_axd has joined #openstack-neutron | 18:58 | |
| *** gcheresh has joined #openstack-neutron | 19:16 | |
| *** gcheresh has quit IRC | 19:28 | |
| *** jawad_axd has quit IRC | 19:36 | |
| *** jawad_axd has joined #openstack-neutron | 19:36 | |
| *** jawad_axd has quit IRC | 19:41 | |
| *** maciejjozefczyk has quit IRC | 19:42 | |
| otherwiseguy | jakeyip: finally hit the TRY_AGAIN with PgAclAddCommands when running w/ the indexing patch (I am very pleased at how much faster that is :D). It definitely looks like it is because of hitting timeouts. First timeout I was hitting was the ovsdb_connection_timeout, after setting that to 100000 and ovsdb_probe_interval=0 (ping from client to server) I hit the NBDB Connection.probe_interval timeout of 60s (ping from server | 19:46 |
| otherwiseguy | to client!). So I've now set that to zero and am re-running. | 19:46 |
| *** hjensas has quit IRC | 20:34 | |
| *** hjensas has joined #openstack-neutron | 20:38 | |
| *** gcheresh has joined #openstack-neutron | 20:41 | |
| *** ociuhandu has joined #openstack-neutron | 20:47 | |
| *** mmethot has quit IRC | 20:55 | |
| *** hjensas_ has joined #openstack-neutron | 20:59 | |
| *** ociuhandu has quit IRC | 21:00 | |
| *** hjensas has quit IRC | 21:03 | |
| *** gcheresh has quit IRC | 21:17 | |
| *** hjensas__ has joined #openstack-neutron | 21:18 | |
| *** hjensas_ has quit IRC | 21:21 | |
| *** ociuhandu has joined #openstack-neutron | 21:35 | |
| *** ociuhandu has quit IRC | 21:41 | |
| *** mmethot has joined #openstack-neutron | 22:15 | |
| *** slaweq has quit IRC | 23:05 | |
| *** slaweq has joined #openstack-neutron | 23:10 | |
| *** sapd__x has joined #openstack-neutron | 23:11 | |
| *** slaweq has quit IRC | 23:15 | |
| *** jawad_axd has joined #openstack-neutron | 23:24 | |
| *** jawad_axd has quit IRC | 23:29 | |
| *** waleedm_ has joined #openstack-neutron | 23:56 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!