*** armax has quit IRC | 00:00 | |
*** dtruong has quit IRC | 00:12 | |
*** dtruong has joined #openstack-lbaas | 00:12 | |
*** threestrands has joined #openstack-lbaas | 00:50 | |
*** armax has joined #openstack-lbaas | 01:04 | |
*** yamamoto has joined #openstack-lbaas | 01:25 | |
*** sapd1_x has joined #openstack-lbaas | 01:34 | |
*** spatel has joined #openstack-lbaas | 01:35 | |
*** mithilarun has quit IRC | 01:46 | |
*** yamamoto has quit IRC | 02:19 | |
*** spatel has quit IRC | 03:06 | |
*** yamamoto has joined #openstack-lbaas | 03:08 | |
*** yamamoto has quit IRC | 03:15 | |
*** goldyfruit_ has quit IRC | 04:04 | |
*** sapd1_x has quit IRC | 06:17 | |
*** gcheresh_ has joined #openstack-lbaas | 06:26 | |
*** sapd1_x has joined #openstack-lbaas | 06:30 | |
*** ccamposr has joined #openstack-lbaas | 07:12 | |
*** luksky has joined #openstack-lbaas | 07:20 | |
*** sapd1_x has quit IRC | 07:32 | |
openstackgerrit | Ann Taraday proposed openstack/octavia master: Testing https://review.opendev.org/697213 | 07:40 |
---|---|---|
*** maciejjozefczyk has joined #openstack-lbaas | 07:54 | |
*** tesseract has joined #openstack-lbaas | 08:03 | |
*** tkajinam has quit IRC | 08:08 | |
*** rpittau|afk is now known as rpittau | 08:08 | |
*** rcernin has quit IRC | 08:20 | |
*** luksky has quit IRC | 08:28 | |
*** luksky has joined #openstack-lbaas | 08:31 | |
*** luksky has quit IRC | 09:26 | |
*** threestrands has quit IRC | 09:47 | |
openstackgerrit | Ann Taraday proposed openstack/octavia master: Testing https://review.opendev.org/697213 | 10:09 |
*** luksky has joined #openstack-lbaas | 10:29 | |
*** psachin has joined #openstack-lbaas | 10:36 | |
*** pcaruana has quit IRC | 10:57 | |
*** psachin has quit IRC | 11:18 | |
openstackgerrit | Ann Taraday proposed openstack/octavia master: Testing https://review.opendev.org/697213 | 11:21 |
*** pcaruana has joined #openstack-lbaas | 11:40 | |
*** AlexStaf has joined #openstack-lbaas | 11:46 | |
*** rpittau is now known as rpittau|bbl | 11:53 | |
openstackgerrit | Ann Taraday proposed openstack/octavia-tempest-plugin master: TEST https://review.opendev.org/704783 | 11:56 |
*** ramishra has quit IRC | 12:08 | |
*** ramishra has joined #openstack-lbaas | 12:13 | |
*** salmankhan has joined #openstack-lbaas | 12:23 | |
*** ramishra has quit IRC | 12:50 | |
*** goldyfruit_ has joined #openstack-lbaas | 13:01 | |
*** maciejjozefczyk has quit IRC | 13:14 | |
*** rpittau|bbl is now known as rpittau | 13:30 | |
*** ramishra_ has joined #openstack-lbaas | 13:36 | |
*** maciejjozefczyk has joined #openstack-lbaas | 13:39 | |
*** strigazi has quit IRC | 13:56 | |
*** strigazi has joined #openstack-lbaas | 14:02 | |
*** KeithMnemonic has joined #openstack-lbaas | 14:20 | |
*** TrevorV has joined #openstack-lbaas | 14:21 | |
*** spatel has joined #openstack-lbaas | 14:36 | |
*** spatel has quit IRC | 14:40 | |
*** ccamposr has quit IRC | 14:48 | |
*** ccamposr has joined #openstack-lbaas | 14:48 | |
*** spatel has joined #openstack-lbaas | 14:48 | |
*** AlexStaf has quit IRC | 14:51 | |
*** spatel has quit IRC | 14:54 | |
*** Trevor_V has joined #openstack-lbaas | 14:55 | |
*** Trevor__V has joined #openstack-lbaas | 14:57 | |
*** TrevorV has quit IRC | 14:58 | |
*** Trevor_V has quit IRC | 15:00 | |
*** TrevorV has joined #openstack-lbaas | 15:12 | |
*** Trevor__V has quit IRC | 15:15 | |
*** ataraday_ has joined #openstack-lbaas | 15:18 | |
*** Trevor_V has joined #openstack-lbaas | 15:38 | |
*** TrevorV has quit IRC | 15:41 | |
*** gcheresh_ has quit IRC | 15:42 | |
rm_work | #startmeeting Octavia | 16:00 |
openstack | Meeting started Wed Jan 29 16:00:02 2020 UTC and is due to finish in 60 minutes. The chair is rm_work. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
*** openstack changes topic to " (Meeting topic: Octavia)" | 16:00 | |
openstack | The meeting name has been set to 'octavia' | 16:00 |
rm_work | #chair johnsom | 16:00 |
openstack | Current chairs: johnsom rm_work | 16:00 |
rm_work | #chair cgoncalves | 16:00 |
openstack | Current chairs: cgoncalves johnsom rm_work | 16:00 |
cgoncalves | hi | 16:00 |
johnsom | o/ | 16:00 |
rm_work | o/ | 16:00 |
haleyb | hi | 16:00 |
ataraday_ | hi | 16:00 |
rm_work | looks like just a few of us today | 16:02 |
rm_work | or maybe this is the norm? anywho | 16:02 |
rm_work | #topic Announcements | 16:02 |
*** openstack changes topic to "Announcements (Meeting topic: Octavia)" | 16:02 | |
johnsom | The NDSU students working on TLS ciphers and protocols start today! | 16:02 |
rm_work | I was about to say that :D | 16:02 |
johnsom | We are doing an introduction meeting for them later today. | 16:02 |
cgoncalves | awesome! if you are reading this, welcome!! | 16:03 |
johnsom | #link https://www.openstack.org/foundation/2019-openstack-foundation-annual-report | 16:03 |
johnsom | We are also mentioned in the annual report for this effort. | 16:03 |
*** ccamposr has quit IRC | 16:03 | |
cgoncalves | spotlight on the project! | 16:04 |
rm_work | So that's all I have... Anyone else have anything to announce? | 16:04 |
johnsom | Nothing else from me | 16:07 |
rm_work | going once... going once... going twice... going three times.... going five times... | 16:07 |
rm_work | #topic Brief progress reports / bugs needing review | 16:07 |
*** openstack changes topic to "Brief progress reports / bugs needing review (Meeting topic: Octavia)" | 16:08 | |
haleyb | a talkative crowd today | 16:09 |
rm_work | apparently | 16:09 |
cgoncalves | I spent some time reviewing stuff, particularly jobboard patches. many merged | 16:10 |
rm_work | So, I've resurrected the patch that allows UDP pool HMs to use other protocols | 16:10 |
johnsom | So, failover flow.... It is working in the lab, I am at the "clean it up" and testing phase. | 16:10 |
rm_work | #link https://review.opendev.org/#/c/589180/ | 16:10 |
johnsom | Recently I have been looking at the SINGLE topology testing. | 16:10 |
ataraday_ | cgoncalves, rm_work thanks a lot for reviews! Just one change letf :) | 16:11 |
rm_work | We ran into issues with the UDP healthcheck in our environment (it's ... not a great design, but I guess it's the best we can do generically) so we need to be able to use other types on a UDP LB | 16:11 |
johnsom | For SINGLE LBs, I have dropped the outage time down to a second or two for manual failovers. This is a huge improvement. | 16:11 |
rm_work | ataraday_: so close! :D | 16:11 |
*** maciejjozefczyk has quit IRC | 16:11 | |
rm_work | johnsom: o/ does it create an amp in parallel before the delete of the old one? | 16:12 |
johnsom | Right now I am working to debug an IPv6 DAD issue triggered by my new code to speed up the SINGLE topology failover. | 16:12 |
rm_work | which is what we were avoiding previously due to "possible resource constraints" but i kinda thought was a BS reason | 16:12 |
ataraday_ | rm_work, yeah, just the main change :D | 16:12 |
johnsom | rm_work, it does build prior to failover, so yes, if there is a quota/capacity constraint it will now fail. This is what also raised this DAD issue. | 16:13 |
johnsom | Duplicate Address Detection (DAD) | 16:13 |
rm_work | I just figured your kids came back home and kept interrupting you :D | 16:13 |
cgoncalves | ataraday_, great work on your patches! you asked a question today on Gerrit if amphorav2 should be default in Ussuri. we could discuss it here today if you'd like | 16:14 |
rm_work | I have a couple of patches that I worked on that are good to go I think, could just use more reviews and a push :D | 16:14 |
rm_work | #link https://review.opendev.org/#/c/699521/ | 16:14 |
rm_work | ^^ to add more functionality to AZs | 16:15 |
rm_work | #link https://review.opendev.org/#/c/702535/ | 16:15 |
johnsom | The rebase is going to be a nightmare I think.... | 16:15 |
haleyb | johnsom: ping me if you need help with DAD, if it's failing is there a loop? | 16:15 |
rm_work | ^^ allow configuring whether you want to force one-armed | 16:15 |
johnsom | I have also done some significant refactoring around the amphorae driver and backend to clean up some "issues". | 16:15 |
johnsom | haleyb I have fixed these issues before. It's a sequencing issue with the new accelerated failover. I just found it in testing last night, so will look at it and fix it today. | 16:16 |
haleyb | ack | 16:16 |
johnsom | Last time I tested, SINGLE completely rebuilds the amphora in around 30 seconds, Act/Stdby in around 70 seconds. Outage time is a second or less for both. Switching to VRRP version 3 will drop it even more. I have a followup patch for that started. | 16:17 |
cgoncalves | you're on fire! | 16:18 |
johnsom | Still fully backport-able. No image roll needed, but would help bring down the SINGLE outage time. | 16:19 |
johnsom | Anyway, that and reviews have been my focus over the last week. | 16:20 |
haleyb | i'd like to ask for some of my py2 removal patches to get some reviews, we're seeing other repos randomly get bitten as third party library support goes away, would be good to get ahead of it | 16:21 |
haleyb | except for the six removal they're all pretty small | 16:21 |
haleyb | johnsom: should i put some on your list? | 16:22 |
johnsom | haleyb I think I have already been bugging you about some of those... grin | 16:22 |
johnsom | haleyb But, yes, please make sure they are on the priority list. | 16:22 |
ataraday_ | cgoncalves, It can be discussed on gerrit :) I put question to highlight this point. Should be 'amphorav2' amoung enabled_provider_drivers by default or not | 16:23 |
haleyb | johnsom: yes, and i think i've re-spun most, i'll verify and add to list | 16:23 |
johnsom | #link https://etherpad.openstack.org/p/octavia-priority-reviews | 16:23 |
johnsom | Just in case someone doesn't have it | 16:23 |
rm_work | also this one I just rebased: | 16:25 |
openstackgerrit | Adam Harwell proposed openstack/octavia master: Update the lb_id on an amp earlier if we know it https://review.opendev.org/698082 | 16:25 |
rm_work | which was a combination of what ataraday_ and I did independently (though she did it first and I was just blind, lol) | 16:26 |
*** numans has quit IRC | 16:28 | |
rm_work | ok so I guess it's time for: | 16:30 |
rm_work | #topic Open Discussion | 16:30 |
*** openstack changes topic to "Open Discussion (Meeting topic: Octavia)" | 16:30 | |
cgoncalves | I'd like to get input from the team on enabling KVM instead of QEMU, when possible, in the CI jobs | 16:32 |
rm_work | we've bounced around on this a lot | 16:32 |
johnsom | I am planning to finish up the basic cleanup stuffs and dev testing, then I will probably post failover with broken tests for v1 only. Followup will be with fixed tests. | 16:32 |
rm_work | we do it, and then it works for a bit, and then jobs start breaking, and then we have to disable it | 16:32 |
rm_work | we can try again, but just be aware | 16:32 |
rm_work | this'll be like the third time | 16:32 |
cgoncalves | context is that there are some nodepool providers that provide nested virtualization but we are not leveraging because of bugs in the ubuntu kernel | 16:32 |
johnsom | I am good with turning it on again if we seem to have passing tests across the nodepool providers. | 16:33 |
johnsom | We can hope that the kernel bug is now fixed and deployed across the nodepool fleet | 16:33 |
cgoncalves | although, I think root caused it to one particular provider (vexxhost) having not exact/best-matching CPU models than the actual physical CPU | 16:34 |
johnsom | We ran for a year and a half with it on without any issues, so I'm not worried about it in *general* | 16:34 |
cgoncalves | #link https://review.opendev.org/#/c/702921/ | 16:34 |
johnsom | Last root cause I found in partnership with OVH was a kernel KVM bug with certain guest and host kernel versions. | 16:34 |
cgoncalves | note there's a depends-on for a devstack patch | 16:34 |
cgoncalves | in testing, seems to work fine at OVH | 16:35 |
cgoncalves | the problematic one was vexxhost because of the CPU model | 16:35 |
johnsom | Yeah, it's been a long time since we tried it again to see if there is a fix out. | 16:35 |
cgoncalves | setting cpu model to host-passthrough in libvirt helped | 16:35 |
cgoncalves | there's more information on the commit message that may better explain the context and proposal | 16:37 |
cgoncalves | maybe I should give folks some time to digest it. we can talk about it again next week or in Gerrit | 16:38 |
rm_work | its prolly fine to try again | 16:38 |
cgoncalves | works for me. I'll make sure the devstack patch merges | 16:39 |
*** luksky has quit IRC | 16:42 | |
rm_work | anything else or should we call it for today? | 16:43 |
rm_work | ok, calling it, thanks folks | 16:50 |
rm_work | #endmeeting | 16:50 |
*** openstack changes topic to "Discussions for OpenStack Octavia | Priority bug review list: https://etherpad.openstack.org/p/octavia-priority-reviews" | 16:50 | |
openstack | Meeting ended Wed Jan 29 16:50:26 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:50 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/octavia/2020/octavia.2020-01-29-16.00.html | 16:50 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/octavia/2020/octavia.2020-01-29-16.00.txt | 16:50 |
openstack | Log: http://eavesdrop.openstack.org/meetings/octavia/2020/octavia.2020-01-29-16.00.log.html | 16:50 |
johnsom | o/ | 16:50 |
*** mithilarun has joined #openstack-lbaas | 17:08 | |
*** mithilarun has quit IRC | 17:09 | |
*** ataraday_ has quit IRC | 17:28 | |
*** rpittau is now known as rpittau|afk | 17:33 | |
*** salmankhan has quit IRC | 17:51 | |
*** mithilarun has joined #openstack-lbaas | 18:00 | |
*** luksky has joined #openstack-lbaas | 18:09 | |
*** mithilarun has quit IRC | 18:10 | |
*** mithilarun has joined #openstack-lbaas | 18:10 | |
*** ramishra_ has quit IRC | 18:37 | |
*** gcheresh_ has joined #openstack-lbaas | 18:48 | |
*** tesseract has quit IRC | 18:59 | |
*** spatel has joined #openstack-lbaas | 19:02 | |
*** mithilarun has quit IRC | 19:20 | |
*** mithilarun has joined #openstack-lbaas | 19:24 | |
*** spatel has quit IRC | 19:30 | |
*** gcheresh_ has quit IRC | 19:35 | |
openstackgerrit | Merged openstack/octavia stable/queens: Add listener and pool protocol validation https://review.opendev.org/702102 | 19:53 |
*** gmann is now known as gmann_afk | 19:57 | |
*** dawzon has joined #openstack-lbaas | 19:58 | |
cgoncalves | ^ only took 12 rechecks | 20:15 |
rm_work | <_< | 20:20 |
rm_work | does that mean every patch we want to merge into queens from now on should also be expected to take 12 rechecks? <_< | 20:21 |
cgoncalves | no. could be also 11 or 13 | 20:22 |
rm_work | ah you're right | 20:22 |
rm_work | never mind then | 20:22 |
cgoncalves | sorry, bad joke xD | 20:22 |
rm_work | i thought it was good :D | 20:23 |
johnsom | I have no idea why that ifup issue is occurring on that queens gate. I think I have tried my ideas that seemed to work local. | 20:26 |
*** dawzon has quit IRC | 20:53 | |
*** gmann_afk is now known as gmann | 21:17 | |
*** rcernin has joined #openstack-lbaas | 21:32 | |
*** Trevor_V has quit IRC | 22:31 | |
*** tkajinam has joined #openstack-lbaas | 23:07 | |
*** spatel has joined #openstack-lbaas | 23:14 | |
*** spatel has quit IRC | 23:19 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!