| *** macz has quit IRC | 00:05 | |
| *** mattw4 has quit IRC | 00:12 | |
| *** goldyfruit_ has quit IRC | 00:20 | |
| *** mmethot_ has quit IRC | 00:21 | |
| *** mmethot has joined #openstack-neutron | 00:22 | |
| openstackgerrit | Merged openstack/neutron master: Update security group rule if port range is all ports https://review.opendev.org/689050 | 00:23 |
|---|---|---|
| openstackgerrit | Merged openstack/neutron stable/train: NetcatTester.stop_processes skip "No such process" exception https://review.opendev.org/695656 | 00:31 |
| *** mvkr has quit IRC | 01:04 | |
| *** goldyfruit_ has joined #openstack-neutron | 01:05 | |
| *** awalende has joined #openstack-neutron | 01:05 | |
| *** awalende has quit IRC | 01:10 | |
| *** nanzha has joined #openstack-neutron | 01:10 | |
| *** ociuhandu has joined #openstack-neutron | 01:12 | |
| *** igordc has quit IRC | 01:13 | |
| *** mvkr has joined #openstack-neutron | 01:17 | |
| *** nanzha has quit IRC | 01:19 | |
| *** nanzha has joined #openstack-neutron | 01:19 | |
| *** ociuhandu has quit IRC | 01:28 | |
| *** ociuhandu has joined #openstack-neutron | 01:40 | |
| *** ociuhandu has quit IRC | 01:44 | |
| openstackgerrit | Reedip proposed openstack/neutron master: Dont schedule Network, respecting network_auto_schedule config https://review.opendev.org/693645 | 01:55 |
| *** armax has quit IRC | 01:57 | |
| *** nanzha has quit IRC | 01:58 | |
| *** nanzha has joined #openstack-neutron | 02:10 | |
| *** armax has joined #openstack-neutron | 02:31 | |
| *** ociuhandu has joined #openstack-neutron | 02:38 | |
| openstackgerrit | Merged openstack/neutron-vpnaas master: Use cidr from tempest config project_network_v6_cidr https://review.opendev.org/695461 | 02:47 |
| *** ociuhandu has quit IRC | 02:48 | |
| *** nanzha has quit IRC | 02:52 | |
| *** nanzha has joined #openstack-neutron | 02:53 | |
| *** chenhaw has joined #openstack-neutron | 02:53 | |
| *** tonyb has joined #openstack-neutron | 03:00 | |
| *** awalende has joined #openstack-neutron | 03:13 | |
| *** awalende has quit IRC | 03:18 | |
| *** dsneddon has quit IRC | 03:40 | |
| *** ociuhandu has joined #openstack-neutron | 03:43 | |
| *** ociuhandu has quit IRC | 03:47 | |
| *** nanzha has quit IRC | 03:50 | |
| *** ociuhandu has joined #openstack-neutron | 03:53 | |
| *** nanzha has joined #openstack-neutron | 03:55 | |
| *** hongbin has joined #openstack-neutron | 04:00 | |
| *** ociuhandu has quit IRC | 04:01 | |
| *** ociuhandu has joined #openstack-neutron | 04:02 | |
| *** ociuhandu has quit IRC | 04:07 | |
| *** dsneddon has joined #openstack-neutron | 04:08 | |
| *** dsneddon has quit IRC | 04:13 | |
| *** ccamposr__ has joined #openstack-neutron | 04:33 | |
| *** ccamposr has quit IRC | 04:36 | |
| *** dsneddon has joined #openstack-neutron | 05:02 | |
| *** ratailor has joined #openstack-neutron | 05:11 | |
| *** nanzha has quit IRC | 05:20 | |
| *** nanzha has joined #openstack-neutron | 05:24 | |
| *** gcheresh_ has joined #openstack-neutron | 05:25 | |
| *** ociuhandu has joined #openstack-neutron | 05:30 | |
| *** ociuhandu has quit IRC | 05:35 | |
| *** tkajinam has quit IRC | 05:37 | |
| *** tkajinam has joined #openstack-neutron | 05:38 | |
| *** lajoskatona has joined #openstack-neutron | 05:43 | |
| *** gcheresh_ has quit IRC | 05:44 | |
| *** markmcclain has quit IRC | 05:56 | |
| *** markmcclain has joined #openstack-neutron | 05:57 | |
| *** nanzha has quit IRC | 06:05 | |
| *** nanzha has joined #openstack-neutron | 06:06 | |
| *** hongbin has quit IRC | 06:18 | |
| *** sapd1 has joined #openstack-neutron | 06:28 | |
| *** pcaruana has joined #openstack-neutron | 06:32 | |
| *** ratailor has quit IRC | 06:38 | |
| *** ratailor has joined #openstack-neutron | 06:42 | |
| *** yedongcan has joined #openstack-neutron | 06:42 | |
| *** nanzha has quit IRC | 06:45 | |
| *** nanzha has joined #openstack-neutron | 06:54 | |
| *** sapd1 has quit IRC | 06:57 | |
| *** nanzha has quit IRC | 06:59 | |
| *** nanzha has joined #openstack-neutron | 07:08 | |
| *** nanzha has quit IRC | 07:20 | |
| *** nanzha has joined #openstack-neutron | 07:21 | |
| *** slaweq has joined #openstack-neutron | 07:23 | |
| *** bobmel has joined #openstack-neutron | 07:25 | |
| *** chenhaw has quit IRC | 07:26 | |
| *** chenhaw has joined #openstack-neutron | 07:26 | |
| *** slaweq has quit IRC | 07:28 | |
| *** nanzha has quit IRC | 07:44 | |
| *** gcheresh_ has joined #openstack-neutron | 07:45 | |
| *** gcheresh has joined #openstack-neutron | 07:49 | |
| *** gcheresh_ has quit IRC | 07:50 | |
| openstackgerrit | Eran Kuris proposed openstack/networking-ovn master: Added OSP16 & train to pluging spec. https://review.opendev.org/696027 | 07:51 |
| openstackgerrit | Eran Kuris proposed openstack/networking-ovn stable/train: Added OSP16 & train to pluging spec. https://review.opendev.org/696029 | 07:57 |
| *** slaweq has joined #openstack-neutron | 07:57 | |
| *** nanzha has joined #openstack-neutron | 07:58 | |
| *** chenhaw has quit IRC | 08:01 | |
| *** maciejjozefczyk has joined #openstack-neutron | 08:02 | |
| slaweq | amotoki: hi, will You maybe have time to review https://review.opendev.org/#/c/658414/ today? | 08:06 |
| *** tesseract has joined #openstack-neutron | 08:16 | |
| *** ratailor has quit IRC | 08:17 | |
| *** ratailor_ has joined #openstack-neutron | 08:18 | |
| *** chenhaw has joined #openstack-neutron | 08:18 | |
| *** tkajinam has quit IRC | 08:19 | |
| *** rubasov has quit IRC | 08:26 | |
| *** rubasov has joined #openstack-neutron | 08:27 | |
| *** jlibosva has joined #openstack-neutron | 08:29 | |
| *** nanzha has quit IRC | 08:33 | |
| *** ccamposr__ has quit IRC | 08:41 | |
| *** ccamposr__ has joined #openstack-neutron | 08:42 | |
| *** nanzha has joined #openstack-neutron | 08:43 | |
| *** jpena|off is now known as jpena | 08:44 | |
| *** pbandark has joined #openstack-neutron | 08:45 | |
| *** dsneddon has quit IRC | 08:50 | |
| *** ralonsoh has joined #openstack-neutron | 08:53 | |
| *** lucasagomes has joined #openstack-neutron | 08:57 | |
| *** priteau has joined #openstack-neutron | 08:58 | |
| *** macz has joined #openstack-neutron | 08:59 | |
| *** macz has quit IRC | 09:03 | |
| *** tssurya has joined #openstack-neutron | 09:04 | |
| *** ociuhandu has joined #openstack-neutron | 09:04 | |
| openstackgerrit | Merged openstack/networking-odl master: Remove networking-odl python2 jobs https://review.opendev.org/687858 | 09:05 |
| *** ociuhandu has quit IRC | 09:08 | |
| *** nanzha has quit IRC | 09:09 | |
| *** nanzha has joined #openstack-neutron | 09:10 | |
| amotoki | slaweq: hi, sure. I will check it today. | 09:12 |
| slaweq | amotoki: thx a lot | 09:12 |
| amotoki | I was PTO yesterday after returning from San Diego :) | 09:12 |
| openstackgerrit | Bin Lu proposed openstack/neutron master: add optional argument metric to set metric for routes https://review.opendev.org/639585 | 09:15 |
| openstackgerrit | Maciej Józefczyk proposed openstack/networking-ovn master: Fallback to default network_driver value if octavia not present https://review.opendev.org/695858 | 09:15 |
| *** dsneddon has joined #openstack-neutron | 09:24 | |
| *** nanzha has quit IRC | 09:29 | |
| openstackgerrit | Noy fridman proposed openstack/neutron-tempest-plugin master: Add test to create policy with multiple rules https://review.opendev.org/695914 | 09:29 |
| *** nanzha has joined #openstack-neutron | 09:33 | |
| *** ociuhandu has joined #openstack-neutron | 09:37 | |
| *** davidsha has joined #openstack-neutron | 09:41 | |
| *** ociuhandu has quit IRC | 09:43 | |
| openstackgerrit | Merged openstack/neutron-lib master: Remove 'interconnection' API extension definition (neutron-interconnection) https://review.opendev.org/694466 | 09:44 |
| *** ociuhandu has joined #openstack-neutron | 09:44 | |
| *** abaindur has quit IRC | 09:47 | |
| *** ociuhandu has quit IRC | 09:48 | |
| *** nanzha has quit IRC | 09:59 | |
| *** dsneddon has quit IRC | 09:59 | |
| *** ociuhandu has joined #openstack-neutron | 10:00 | |
| *** nanzha has joined #openstack-neutron | 10:09 | |
| *** ccamposr__ has quit IRC | 10:16 | |
| *** dsneddon has joined #openstack-neutron | 10:19 | |
| *** mkrai has joined #openstack-neutron | 10:20 | |
| mkrai | Hi, I am trying to understand Neutron code. Can some point the code to network create API method in neutron repo? Thanks in advance | 10:20 |
| *** dsneddon has quit IRC | 10:25 | |
| *** ivve has joined #openstack-neutron | 10:35 | |
| ivve | hello | 10:38 |
| ivve | seems neutron 14.0.2 is not compatible with 14.0.3? RemoteError: Remote error: InvalidTargetVersion Invalid target version 1.5 from ovs neutron agent as well as neutron server | 10:39 |
| ivve | im seeing this on a fresh deployed compute into a stack with 14.0.2 | 10:40 |
| ivve | the fresh compute has 14.0.3 | 10:40 |
| openstackgerrit | Merged openstack/neutron-vpnaas master: Switch to Ussuri jobs https://review.opendev.org/691216 | 10:45 |
| openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/neutron master: [WIP] [OVN] Add DB tables for OVN backend https://review.opendev.org/695969 | 10:46 |
| *** ccamposr has joined #openstack-neutron | 10:47 | |
| *** lpetrut has joined #openstack-neutron | 10:52 | |
| frickler | ivve: the usual upgrade procedure would be to upgrade controllers and network nodes first. though I agree that this should not happen for a patch release. minor version bumps are happening far too seldom | 10:53 |
| ivve | frickler: yeah i didn't bother to upgrade anything else as it is such a minor | 10:55 |
| openstackgerrit | Maciej Józefczyk proposed openstack/networking-ovn master: Add support for multiple L4 protocols withing same LB https://review.opendev.org/671293 | 10:55 |
| *** jlibosva has quit IRC | 10:55 | |
| ivve | so neither are upgraded, and this went into stein stable (via kolla) | 10:55 |
| *** takamatsu has quit IRC | 10:55 | |
| ivve | but also observe i said "seems" :) | 10:56 |
| ivve | my conclusion isn't 100% yet | 10:56 |
| ivve | im testing an older container just to be sure | 10:56 |
| ivve | but its 2 hosts with the exact 14.0.3 version that are misbehaving and i have some 55ish working with 14.0.2 | 10:56 |
| ivve | redeployed them just to be sure but same thing is happening | 10:57 |
| *** dsneddon has joined #openstack-neutron | 10:58 | |
| frickler | ivve: I'd say https://review.opendev.org/669360 is the culprit | 11:00 |
| *** ociuhandu has quit IRC | 11:03 | |
| ivve | thanks frickler | 11:04 |
| ivve | im testing and older version in about an hour, lunchtime now :) | 11:04 |
| openstackgerrit | Federico Ressi proposed openstack/networking-ovn master: Use pip_install to install six python module https://review.opendev.org/694987 | 11:05 |
| *** nanzha has quit IRC | 11:07 | |
| *** ccamposr has quit IRC | 11:08 | |
| *** nanzha has joined #openstack-neutron | 11:10 | |
| *** nanzha has quit IRC | 11:17 | |
| *** priteau has quit IRC | 11:19 | |
| *** nanzha has joined #openstack-neutron | 11:24 | |
| *** nanzha has quit IRC | 11:29 | |
| *** nanzha has joined #openstack-neutron | 11:29 | |
| *** dsneddon has quit IRC | 11:30 | |
| *** yedongcan has left #openstack-neutron | 11:32 | |
| *** tbachman has quit IRC | 11:40 | |
| *** rcernin has quit IRC | 11:40 | |
| *** ociuhandu has joined #openstack-neutron | 11:41 | |
| *** macz has joined #openstack-neutron | 11:41 | |
| openstackgerrit | Merged openstack/neutron stable/queens: Run revision bump operations en masse https://review.opendev.org/695693 | 11:41 |
| *** mkrai has quit IRC | 11:44 | |
| *** macz has quit IRC | 11:45 | |
| *** ociuhandu has quit IRC | 11:46 | |
| openstackgerrit | Aditya Reddy Nagaram proposed openstack/neutron-lib master: Support for stateless security groups https://review.opendev.org/696070 | 11:55 |
| openstackgerrit | Aditya Reddy Nagaram proposed openstack/neutron master: [WIP] Support for stateless security groups https://review.opendev.org/572767 | 11:59 |
| *** mkrai has joined #openstack-neutron | 12:03 | |
| *** dsneddon has joined #openstack-neutron | 12:03 | |
| *** klippo has joined #openstack-neutron | 12:14 | |
| *** jlibosva has joined #openstack-neutron | 12:18 | |
| *** dtantsur|afk is now known as dtantsur | 12:20 | |
| *** jlibosva has quit IRC | 12:29 | |
| *** jlibosva has joined #openstack-neutron | 12:32 | |
| openstackgerrit | Pedro Henrique Pereira Martins proposed openstack/neutron-lib master: Add description field in port forwarding API https://review.opendev.org/692580 | 12:37 |
| *** sean-k-mooney has quit IRC | 12:39 | |
| *** sean-k-mooney has joined #openstack-neutron | 12:40 | |
| *** nanzha has quit IRC | 12:45 | |
| ivve | https://bugs.launchpad.net/neutron/+bug/1854050 | 12:46 |
| openstack | Launchpad bug 1854050 in neutron "minor versions 14.0.2 & 14.0.3 are not compatible in dvr-ha" [Undecided,New] | 12:46 |
| ivve | i have a feeling this is a critical bug | 12:47 |
| *** jawad_axd has joined #openstack-neutron | 12:48 | |
| *** ratailor_ has quit IRC | 13:03 | |
| *** tbachman has joined #openstack-neutron | 13:04 | |
| *** dsneddon has quit IRC | 13:08 | |
| *** tbachman has quit IRC | 13:08 | |
| *** goldyfruit_ has quit IRC | 13:08 | |
| *** tbachman has joined #openstack-neutron | 13:16 | |
| *** ociuhandu has joined #openstack-neutron | 13:20 | |
| *** liuyulong has joined #openstack-neutron | 13:23 | |
| *** ociuhandu has quit IRC | 13:26 | |
| *** jpena is now known as jpena|lunch | 13:26 | |
| *** bobmel has quit IRC | 13:27 | |
| *** tbachman has quit IRC | 13:27 | |
| *** bobmel has joined #openstack-neutron | 13:27 | |
| *** tbachman has joined #openstack-neutron | 13:31 | |
| openstackgerrit | Aditya Reddy Nagaram proposed openstack/neutron-lib master: Support for stateless security groups https://review.opendev.org/696070 | 13:32 |
| *** dsneddon has joined #openstack-neutron | 13:36 | |
| openstackgerrit | Aditya Reddy Nagaram proposed openstack/neutron-lib master: add security-group-stateful api extension https://review.opendev.org/696070 | 13:37 |
| openstackgerrit | Gregoire Mahe proposed openstack/neutron master: Allow to parse keywords in dns labels https://review.opendev.org/686343 | 13:46 |
| openstackgerrit | LIU Yulong proposed openstack/neutron master: Not process port security groups twice https://review.opendev.org/693484 | 13:53 |
| openstackgerrit | Elod Illes proposed openstack/networking-bagpipe stable/queens: Add local bindep.txt and make unit tests pass https://review.opendev.org/657828 | 13:58 |
| *** tkajinam has joined #openstack-neutron | 14:00 | |
| *** jpena|lunch is now known as jpena | 14:18 | |
| openstackgerrit | Slawek Kaplonski proposed openstack/neutron master: Rehome networking-ovn CI jobs to neutron repository https://review.opendev.org/696094 | 14:18 |
| openstackgerrit | Slawek Kaplonski proposed openstack/neutron master: Rehome networking-ovn CI jobs to neutron repository https://review.opendev.org/696094 | 14:20 |
| *** ociuhandu has joined #openstack-neutron | 14:22 | |
| liuyulong | These is an official python3.7 rpm release for CentOS7? | 14:24 |
| *** ociuhandu has quit IRC | 14:27 | |
| openstackgerrit | Nate Johnston proposed openstack/neutron master: [DNM] Test py36 unit tests https://review.opendev.org/696096 | 14:28 |
| *** dsneddon has quit IRC | 14:33 | |
| openstackgerrit | Lajos Katona proposed openstack/neutron master: use objects common_types from neutron-lib https://review.opendev.org/664646 | 14:35 |
| *** goldyfruit has joined #openstack-neutron | 14:36 | |
| *** dsneddon has joined #openstack-neutron | 14:38 | |
| *** goldyfruit_ has joined #openstack-neutron | 14:38 | |
| *** goldyfruit has quit IRC | 14:41 | |
| *** dsneddon has quit IRC | 14:45 | |
| *** jawad_axd has quit IRC | 14:48 | |
| *** ociuhandu has joined #openstack-neutron | 14:49 | |
| openstackgerrit | Aditya Reddy Nagaram proposed openstack/neutron-lib master: add security-group-stateful api extension https://review.opendev.org/696070 | 14:50 |
| openstackgerrit | Aditya Reddy Nagaram proposed openstack/neutron-lib master: add stateful-security-group api extension https://review.opendev.org/696070 | 14:52 |
| *** ociuhandu has quit IRC | 14:54 | |
| openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/neutron master: [WIP] [OVN] Add hash ring methods https://review.opendev.org/696103 | 15:06 |
| *** dsneddon has joined #openstack-neutron | 15:10 | |
| openstackgerrit | Maciej Józefczyk proposed openstack/networking-ovn master: Add support for multiple L4 protocols withing same LB https://review.opendev.org/671293 | 15:12 |
| *** ociuhandu has joined #openstack-neutron | 15:19 | |
| *** tkajinam has quit IRC | 15:19 | |
| openstackgerrit | Maciej Józefczyk proposed openstack/networking-ovn master: Add gateway chassis rebalance script https://review.opendev.org/663046 | 15:25 |
| openstackgerrit | Maciej Józefczyk proposed openstack/networking-ovn master: Disable voting for tripleo-ci-centos-7-containers-multinode https://review.opendev.org/665092 | 15:26 |
| openstackgerrit | Maciej Józefczyk proposed openstack/networking-ovn master: Add gateway chassis rebalance script https://review.opendev.org/663046 | 15:26 |
| *** ociuhandu has quit IRC | 15:28 | |
| *** lajoskatona has quit IRC | 15:32 | |
| *** ociuhandu has joined #openstack-neutron | 15:42 | |
| *** awalende has joined #openstack-neutron | 15:45 | |
| openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/neutron master: [OVN] Add DB tables for OVN backend https://review.opendev.org/695969 | 15:46 |
| *** awalende has quit IRC | 15:50 | |
| *** mlavalle has joined #openstack-neutron | 15:51 | |
| *** ccamposr has joined #openstack-neutron | 15:53 | |
| *** spatel has joined #openstack-neutron | 15:54 | |
| openstackgerrit | Aditya Reddy Nagaram proposed openstack/neutron master: [WIP] Support for stateless security groups https://review.opendev.org/572767 | 16:00 |
| openstackgerrit | Maciej Józefczyk proposed openstack/neutron master: Move OVN constants to neutron tree https://review.opendev.org/696118 | 16:01 |
| openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/neutron master: Do not inherit from built-in "dict" https://review.opendev.org/691874 | 16:01 |
| *** ivve has quit IRC | 16:02 | |
| openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/neutron master: [OVN] Add hash ring methods https://review.opendev.org/696103 | 16:02 |
| *** dtantsur is now known as dtantsur|afk | 16:03 | |
| openstackgerrit | Terry Wilson proposed openstack/networking-ovn master: Fix agent extension support after hashring merge https://review.opendev.org/694840 | 16:03 |
| openstackgerrit | Terry Wilson proposed openstack/networking-ovn master: Fix agent extension support after hashring merge https://review.opendev.org/694840 | 16:08 |
| *** gcheresh has quit IRC | 16:10 | |
| *** davidsha has quit IRC | 16:11 | |
| *** ijw has joined #openstack-neutron | 16:14 | |
| openstackgerrit | Federico Ressi proposed openstack/networking-ovn master: Use pip_install to install six python module https://review.opendev.org/694987 | 16:18 |
| openstackgerrit | Federico Ressi proposed openstack/networking-ovn master: Use pip_install to install six python module https://review.opendev.org/694987 | 16:18 |
| *** jangutter has quit IRC | 16:22 | |
| *** tesseract has quit IRC | 16:23 | |
| *** ociuhandu has quit IRC | 16:33 | |
| *** ociuhandu has joined #openstack-neutron | 16:34 | |
| openstackgerrit | Bernard Cafarelli proposed openstack/networking-sfc master: Drop python 2 support and testing https://review.opendev.org/696128 | 16:38 |
| gibi | mlavalle: hi! just a heads up I opened a bug about the missing api documentation for the multiple port binding api https://bugs.launchpad.net/neutron/+bug/1853873 if I know corretly you were the author of the implementation of that api | 16:38 |
| openstack | Launchpad bug 1853873 in neutron "The /v2.0/ports/{port_id}/bindings APIs are not documented" [Medium,New] - Assigned to Chason Chan (chen-xing) | 16:38 |
| mlavalle | gibi: Thanks! | 16:39 |
| *** jlibosva has quit IRC | 16:39 | |
| *** jpena is now known as jpena|brb | 16:45 | |
| *** macz has joined #openstack-neutron | 16:45 | |
| *** lucasagomes has quit IRC | 16:46 | |
| *** mkrai has quit IRC | 16:47 | |
| njohnston | slaweq: FYI do you know who runs the Mellanox CI? It looks like that has not run on Neutron changes since Nov 20th. | 16:56 |
| slaweq | njohnston: I have no idea | 16:57 |
| slaweq | but I would start asking from adrianc :) | 16:57 |
| njohnston | mlavalle: Did you get the mail I sent about the profiling decorator? | 16:57 |
| mlavalle | njohnston: I just read it | 16:57 |
| * slaweq is going afk for now, will be back online later tonight probably | 16:58 | |
| njohnston | adrianc: Hi! Do you know who runs the Mellanox CI? It looks like that has not run on Neutron changes since Nov 20th. | 16:58 |
| njohnston | mlavalle: I am mostly worried that I am using it wrong | 16:58 |
| mlavalle | njohnston: yeah, it looks odd | 17:01 |
| mlavalle | this is an example: https://review.opendev.org/#/c/689640/4/neutron/plugins/ml2/plugin.py | 17:02 |
| mlavalle | are you using it like this? | 17:02 |
| njohnston | mlavalle: I believe so: https://review.opendev.org/#/c/695307/2/neutron/plugins/ml2/plugin.py | 17:04 |
| *** ivve has joined #openstack-neutron | 17:06 | |
| openstackgerrit | Nate Johnston proposed openstack/neutron master: [DNM] profile create_port to find slowness https://review.opendev.org/695307 | 17:06 |
| mlavalle | njohnston: that paste you included in the email, came from one job in specific, right? | 17:13 |
| njohnston | mlavalle: Yeah, it came from https://9e08b63720ebd1424e24-d183cc649f1ed183c61dad720f170c6c.ssl.cf1.rackcdn.com/695307/2/check/neutron-rally-task/030fbf9/controller/logs/screen-q-svc.txt.gz | 17:14 |
| njohnston | I just picked an example of a port creation that was longer than the 60 second point when a client would timeout the request | 17:15 |
| *** ociuhandu has quit IRC | 17:15 | |
| *** bobmel has quit IRC | 17:19 | |
| *** njohnston is now known as njohnston|lunch | 17:19 | |
| mlavalle | ok, I'll look at the results of the latest revision | 17:20 |
| *** igordc has joined #openstack-neutron | 17:20 | |
| mlavalle | at some point soon. Do you have a pressing deadline you want to meet using this tool? | 17:21 |
| *** jpena|brb is now known as jpena | 17:21 | |
| *** spatel has quit IRC | 17:28 | |
| openstackgerrit | Aditya Reddy Nagaram proposed openstack/neutron-lib master: add stateful-security-group api extension https://review.opendev.org/696070 | 17:41 |
| openstackgerrit | Ghanshyam Mann proposed openstack/python-neutronclient master: Move grenade neutron-lib job to py3 and in python-neutronclient repo https://review.opendev.org/695789 | 17:45 |
| *** openstackgerrit has quit IRC | 17:49 | |
| *** tbachman has quit IRC | 18:10 | |
| *** tssurya has quit IRC | 18:12 | |
| *** armax has quit IRC | 18:14 | |
| *** ijw has quit IRC | 18:26 | |
| *** jpena is now known as jpena|off | 18:31 | |
| *** njohnston|lunch is now known as njohnston | 18:33 | |
| njohnston | mlavalle: No deadline, just trying to debug an issue :-) | 18:33 |
| njohnston | mlavalle: Thanks for taking a look | 18:33 |
| mlavalle | njohnston: cool. I'll keep an eye on the patch and leave my comments there | 18:34 |
| njohnston | mlavalle: The background is that I was contacted by one of the Octavia guys because port creation was so slow that it was causing their CI to break, because port creation was > 60s | 18:35 |
| *** ijw has joined #openstack-neutron | 18:37 | |
| mlavalle | that's useful backgraound. Yeah, I'll help as much as I can and lets get those Octavia guys (like rm_work of johnsom) off of our backs | 18:38 |
| johnsom | lol | 18:38 |
| rm_work | lol | 18:39 |
| mlavalle | The Octavia Northwesterners | 18:39 |
| johnsom | I resemble that remark | 18:39 |
| rm_work | hey, everyone's northwest of something | 18:39 |
| *** ijw has quit IRC | 18:40 | |
| rm_work | so in a way, we're ALL northwesterners :) | 18:40 |
| *** ijw has joined #openstack-neutron | 18:40 | |
| mlavalle | rm_work: that's true. as always, you have a smart response :-) | 18:40 |
| *** goldyfruit___ has joined #openstack-neutron | 18:41 | |
| rm_work | if i can't make sarcastic / witty responses, what's the point of life ;) | 18:42 |
| *** goldyfruit_ has quit IRC | 18:43 | |
| *** ralonsoh has quit IRC | 18:51 | |
| *** goldyfruit_ has joined #openstack-neutron | 18:51 | |
| *** goldyfruit___ has quit IRC | 18:54 | |
| *** CeeMac has quit IRC | 18:57 | |
| *** aedc has joined #openstack-neutron | 18:57 | |
| *** gcheresh has joined #openstack-neutron | 19:02 | |
| *** ijw_ has joined #openstack-neutron | 19:03 | |
| *** ijw has quit IRC | 19:06 | |
| *** goldyfruit_ has quit IRC | 19:07 | |
| *** maciejjozefczyk has quit IRC | 19:08 | |
| *** lpetrut has quit IRC | 19:08 | |
| *** goldyfruit has joined #openstack-neutron | 19:09 | |
| *** goldyfruit_ has joined #openstack-neutron | 19:19 | |
| *** bobmel has joined #openstack-neutron | 19:20 | |
| *** goldyfruit has quit IRC | 19:22 | |
| *** bobmel has quit IRC | 19:25 | |
| *** lajoskatona has joined #openstack-neutron | 19:36 | |
| *** aedc has quit IRC | 19:38 | |
| *** aedc has joined #openstack-neutron | 19:39 | |
| *** abaindur has joined #openstack-neutron | 19:39 | |
| *** abaindur has quit IRC | 19:40 | |
| *** abaindur has joined #openstack-neutron | 19:40 | |
| abaindur | anyone know why this function does not actually do anything except LOG an error message? https://github.com/openstack/neutron/blob/master/neutron/db/agents_db.py#L539 | 19:59 |
| abaindur | it's called from server side report_state RPC handler. the agent timestamp is not ignored as it is in case where its older than server start time | 20:01 |
| abaindur | https://github.com/openstack/neutron/blob/master/neutron/db/agents_db.py#L509 | 20:01 |
| abaindur | shouldn't we discard instead of writing to DB in such case where time diff is > agent down time? whats the purpose of just logging error msg? | 20:02 |
| *** numans has quit IRC | 20:04 | |
| *** aedc has quit IRC | 20:10 | |
| *** goldyfruit___ has joined #openstack-neutron | 20:17 | |
| *** goldyfruit_ has quit IRC | 20:20 | |
| *** goldyfruit_ has joined #openstack-neutron | 20:21 | |
| *** goldyfruit___ has quit IRC | 20:24 | |
| njohnston | abaindur: Read https://bugs.launchpad.net/neutron/+bug/1432582 for the reasoning that went into the decision | 20:25 |
| openstack | Launchpad bug 1432582 in neutron "OVS agent shows connected to AMQP but neutron server rejects the request." [Undecided,Fix released] - Assigned to Sudipta Biswas (sbiswas7) | 20:25 |
| abaindur | yea I read that - wondering why we don't return though? What is the purpose of writing to the DB an old timestamp, one that we know will still mark agent as dead? | 20:25 |
| abaindur | as I understand, the purpose of that bug/fix was basically, to change it from a debug to raise an error | 20:27 |
| njohnston | abaindur: What's the tangible difference between logging and writing to DB versus just logging? | 20:27 |
| njohnston | to put it another way: what if it isn't the compute that has the wrong time, but rather the controller? | 20:28 |
| abaindur | Was looking at it in relation to https://bugs.launchpad.net/neutron/+bug/1853071 | 20:28 |
| openstack | Launchpad bug 1853071 in neutron "AMQP disconnects, q-reports-plugin queue grows, leading to DBDeadlocks while trying to update agent heartbeats" [High,New] | 20:28 |
| abaindur | it puts uneccesary strain on RPC workers and extra DB connections, potentially leading to that issue | 20:28 |
| abaindur | suppose neutron-server is down for some time, or the DB is down. the q-reports-plugin Rabbit quueue grows as agents keep sending heartbeats. | 20:29 |
| abaindur | when server recovers, it has to process hundreds, thousands of heartbeats. the only effect is they will be stale, but neutron instead if busy processing those | 20:30 |
| *** lajoskatona has quit IRC | 20:39 | |
| *** gcheresh has quit IRC | 20:44 | |
| abaindur | njohnston: and i guess that commit only even logs error message initially, when agent first reports state. I was talking about discarding all HB timestamps that are older than agent_down_time - not just the initial one | 20:45 |
| *** pbandark has quit IRC | 20:45 | |
| njohnston | abaindur: I think the change you recommend is a good one, I would +2 it | 20:45 |
| abaindur | fyi - i tried and while it doesnt fix the DBDeadlock in bug above, it does help alleviate rabbit queue growth/size | 20:46 |
| eandersson | Yea the DBDeadlock hits us bad at larger scale | 20:48 |
| eandersson | It is especially bad after an upgrade for some reason. | 20:48 |
| eandersson | Takes hours for the control plane to recover. | 20:48 |
| *** bobmel has joined #openstack-neutron | 20:51 | |
| abaindur | eandersson: I found the fix to this issue | 20:51 |
| abaindur | we need to enable new OVO engine facade for agent and port DB objects | 20:52 |
| abaindur | https://opendev.org/openstack/neutron/commit/6f83466307fb21aee5bb596974644d457ae1fa60 | 20:53 |
| abaindur | Now I dont fully understand why the fix works (using the new context manager thats set when new_facade = True), but it works | 20:53 |
| *** bobmel has quit IRC | 20:55 | |
| *** gcheresh has joined #openstack-neutron | 20:56 | |
| njohnston | slaweq mlavalle ^^ engine facade FTW | 21:01 |
| *** armax has joined #openstack-neutron | 21:03 | |
| *** threestrands has joined #openstack-neutron | 21:27 | |
| abaindur | Why isn't everything using new_facade? or why is it not set in base base.NeutronDbObject? | 21:30 |
| *** tbachman has joined #openstack-neutron | 21:30 | |
| *** Satarel has quit IRC | 21:31 | |
| *** igordc has quit IRC | 21:33 | |
| abaindur | njohnston: any reason why every object class isnt using new_facade? | 21:35 |
| njohnston | abaindur: There are a variety of things that break when you turn on the new facade globally. There are a number of context usages that need to be sorted out. I believe it is currently being worked on by mlavalle. | 21:35 |
| abaindur | yea i saw some commits that reverted new engine code, like https://bugs.launchpad.net/neutron/+bug/1744829 | 21:36 |
| openstack | Launchpad bug 1744829 in neutron "Avoid mixed usage of old and new transaction styles" [High,Fix released] - Assigned to Lujin Luo (luo-lujin) | 21:36 |
| njohnston | abaindur: If you set new_facade = True in the base object in a DNM change you'll see | 21:36 |
| abaindur | DNM? | 21:36 |
| *** ijw_ has quit IRC | 21:36 | |
| *** openstackgerrit has joined #openstack-neutron | 21:37 | |
| openstackgerrit | Nate Johnston proposed openstack/neutron master: [DNR] Check new engine facade effectiveness https://review.opendev.org/602035 | 21:37 |
| abaindur | For now, in our easy to repro setup, we turned it on in Agent and PortBinding class only (since some of the stuck Deadlock'd transactions showed queries in history on those tables) | 21:37 |
| njohnston | DNM = Do Not Merge | 21:38 |
| abaindur | but i am wondering about side effects even from this | 21:38 |
| *** igordc has joined #openstack-neutron | 21:39 | |
| njohnston | abaindur: I revivied an old change that checks this, we can watch https://review.opendev.org/#/c/602035/ and see how bad the breakage is | 21:39 |
| abaindur | Do you foresee a problem with for now, at least enabling it on Agent (and maybe portBinding classes?) | 21:40 |
| abaindur | as a fix for https://bugs.launchpad.net/neutron/+bug/1853071 | 21:41 |
| openstack | Launchpad bug 1853071 in neutron "AMQP disconnects, q-reports-plugin queue grows, leading to DBDeadlocks while trying to update agent heartbeats" [High,New] | 21:41 |
| njohnston | abaindur: I would say, push an upstream change with just those and let's see how bad the tests break, to start | 21:41 |
| njohnston | abaindur: I can help you work through the issues, I have some background with engine facade | 21:41 |
| *** gcheresh has quit IRC | 21:52 | |
| eandersson | btw talking about db. Has security group performs been fixed yet? | 21:58 |
| eandersson | In Rocky with our large site the API is unusable. | 21:58 |
| *** abaindur has quit IRC | 22:01 | |
| *** abaindur has joined #openstack-neutron | 22:01 | |
| *** ociuhandu has joined #openstack-neutron | 22:02 | |
| *** rcernin has joined #openstack-neutron | 22:04 | |
| *** bobmel has joined #openstack-neutron | 22:06 | |
| *** ociuhandu has quit IRC | 22:08 | |
| *** bobmel has quit IRC | 22:11 | |
| *** pcaruana has quit IRC | 22:16 | |
| *** bobmel has joined #openstack-neutron | 22:20 | |
| abaindur | njohnston: failing unit tests on my end just now | 22:21 |
| abaindur | oslo_db.exception.DBReferenceError: (sqlite3.IntegrityError) foreign key constraint failed [SQL: u'INSERT INTO ports (project_id, id, name, network_id, mac_address, admin_state_up, status, device_id, device_owner, ip_allocation, standard_attr_id) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)'] [parameters: (None, 'a9124d5d-6453-4d8f-83e7-c79e3720d3c9', None, 'bb9a094c-edf0-4d35-8553-d8296a97a73e', 'fa:16:3e:3d:46:76', 1, 'ACTIVE', '014 | 22:21 |
| abaindur | 6dea6-ff57-4e00-a23d-2a49a8518bd0', 'network:router_ha_interface', None, 2)] (Background on this error at: http://sqlalche.me/e/gkpj) | 22:21 |
| abaindur | in test__get_ha_router_interface_ids_with_ha_replicated_port | 22:22 |
| abaindur | 17 failures total, some different: http://paste.openstack.org/show/786760/ | 22:25 |
| *** bobmel has quit IRC | 22:27 | |
| openstackgerrit | Flavio Fernandes proposed openstack/networking-ovn master: DNM: This is a hack, please ignore https://review.opendev.org/696200 | 22:30 |
| *** slaweq has quit IRC | 22:37 | |
| *** armax has quit IRC | 22:42 | |
| *** tkajinam has joined #openstack-neutron | 23:08 | |
| *** slaweq has joined #openstack-neutron | 23:11 | |
| *** goldyfruit___ has joined #openstack-neutron | 23:13 | |
| *** slaweq has quit IRC | 23:15 | |
| *** goldyfruit_ has quit IRC | 23:16 | |
| *** goldyfruit_ has joined #openstack-neutron | 23:17 | |
| *** goldyfruit___ has quit IRC | 23:20 | |
| *** ociuhandu has joined #openstack-neutron | 23:30 | |
| *** ociuhandu has quit IRC | 23:35 | |
| *** armax has joined #openstack-neutron | 23:38 | |
| *** goldyfruit_ has quit IRC | 23:49 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!