Wednesday, 2020-01-22

*** born2bake has quit IRC00:24
*** ccamposr__ has quit IRC00:48
*** ccamposr__ has joined #openstack-lbaas00:56
*** ccamposr__ has joined #openstack-lbaas00:57
*** mithilarun has quit IRC01:15
*** ccamposr__ has quit IRC01:17
*** ccamposr__ has joined #openstack-lbaas01:20
*** ccamposr__ has quit IRC01:26
*** yamamoto has joined #openstack-lbaas01:42
*** yamamoto has quit IRC01:53
*** yamamoto has joined #openstack-lbaas02:23
*** ramishra has joined #openstack-lbaas02:54
*** yamamoto has quit IRC03:27
*** ramishra has quit IRC04:03
*** yamamoto has joined #openstack-lbaas04:56
*** ccamposr has joined #openstack-lbaas05:10
*** ramishra has joined #openstack-lbaas06:04
*** AlexStaf has joined #openstack-lbaas07:04
*** vishalmanchanda has quit IRC07:24
*** ivve has quit IRC07:30
cgoncalvesLB full failover? nice!!07:31
*** rpittau|afk is now known as rpittau07:37
*** gcheresh has joined #openstack-lbaas07:59
*** tesseract has joined #openstack-lbaas08:08
*** maciejjozefczyk_ has joined #openstack-lbaas08:08
*** tesseract has quit IRC08:09
*** tesseract has joined #openstack-lbaas08:09
*** tkajinam has quit IRC08:10
*** ivve has joined #openstack-lbaas08:37
*** yamamoto has quit IRC09:02
*** gcheresh has quit IRC09:15
*** gcheresh has joined #openstack-lbaas09:17
openstackgerritCarlos Goncalves proposed openstack/octavia-tempest-plugin master: Add tests for allowed CIDRs in listeners  https://review.opendev.org/70262909:40
openstackgerritCarlos Goncalves proposed openstack/octavia-tempest-plugin master: Add tests for allowed CIDRs in listeners  https://review.opendev.org/70262909:44
*** maciejjozefczyk_ is now known as maciejjozefczyk10:10
*** ataraday_ has joined #openstack-lbaas10:33
*** pcaruana has joined #openstack-lbaas11:02
openstackgerritAnn Taraday proposed openstack/octavia master: Increase sleep in health_check in case of DBConnectionError  https://review.opendev.org/70376911:06
*** rpittau is now known as rpittau|bbl11:41
*** ivve has quit IRC12:12
*** dmellado has quit IRC12:24
*** dmellado has joined #openstack-lbaas12:26
*** ivve has joined #openstack-lbaas12:38
*** ccamposr has quit IRC12:47
*** ccamposr has joined #openstack-lbaas12:47
*** TrevorV has joined #openstack-lbaas12:57
*** goldyfruit has joined #openstack-lbaas13:04
dulekcgoncalves: Hello! I just tried the CentOS 8 amphora and seems like it never gets up: https://review.opendev.org/#/c/703768/.13:08
dulekcgoncalves: Any idea if it's supposed to work?13:08
*** yamamoto has joined #openstack-lbaas13:08
*** rpittau|bbl is now known as rpittau13:20
cgoncalvesdulek, hi. it's been on my to-do list. CentOS 8.1 release broke DIB but that got fixed and released. there might be something else also going on13:38
dulekcgoncalves: Cool, thanks!13:50
*** yamamoto has quit IRC14:01
*** rcernin has quit IRC14:03
*** yamamoto has joined #openstack-lbaas14:10
*** yamamoto has quit IRC14:10
*** yamamoto has joined #openstack-lbaas14:10
*** yamamoto has quit IRC14:15
*** Trevor_V has joined #openstack-lbaas14:54
*** TrevorV has quit IRC14:58
*** vishalmanchanda has joined #openstack-lbaas14:59
*** generalfuzz has joined #openstack-lbaas15:06
*** luksky has joined #openstack-lbaas15:33
lukskyhello15:33
lukskyi have a problem with amphora-agent inside amphora:15:33
lukskyroot@amphora-98fcefb4-759d-4c74-927d-b2cea70cccc3:~# /usr/local/bin/amphora-agent --config-file /etc/octavia/amphora-agent.conf15:33
lukskyTraceback (most recent call last):15:33
luksky  File "/usr/local/bin/amphora-agent", line 7, in <module>15:33
luksky    from octavia.cmd.agent import main15:34
luksky  File "/usr/local/lib/python2.7/dist-packages/octavia/cmd/agent.py", line 21, in <module>15:34
luksky    import gunicorn.app.base15:34
lukskyImportError: No module named gunicorn.app.base15:34
lukskyroot@amphora-98fcefb4-759d-4c74-927d-b2cea70cccc3:~#15:34
lukskyit is queens, version of octavia 2.1.215:34
*** goldyfruit has quit IRC15:48
*** goldyfruit has joined #openstack-lbaas15:48
*** TrevorV has joined #openstack-lbaas15:55
*** gcheresh has quit IRC15:57
cgoncalvesluksky, we are about to start the weekly team meeting. would it be possible to chat after it ends?15:58
*** Trevor_V has quit IRC15:58
cgoncalvesluksky, how have you created the amphora image? it looks like gunicorn (a requirement) is not installed15:59
rm_work#startmeeting Octavia16:00
openstackMeeting started Wed Jan 22 16:00:02 2020 UTC and is due to finish in 60 minutes.  The chair is rm_work. Information about MeetBot at http://wiki.debian.org/MeetBot.16:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:00
*** openstack changes topic to " (Meeting topic: Octavia)"16:00
openstackThe meeting name has been set to 'octavia'16:00
rm_work#chair johnsom16:00
openstackCurrent chairs: johnsom rm_work16:00
rm_work#chair cgoncalves16:00
openstackCurrent chairs: cgoncalves johnsom rm_work16:00
rm_worko/16:00
gthiemongeHi16:00
johnsomo/16:00
haleybo/16:00
cgoncalveso/16:00
rm_work#topic Announcements16:01
*** openstack changes topic to "Announcements (Meeting topic: Octavia)"16:01
rm_workUmm... Not sure I have any real announcements today. Anyone?16:02
johnsomI have one:16:02
johnsom#link http://lists.openstack.org/pipermail/openstack-discuss/2020-January/012097.html16:02
johnsomThe release team is changing how the wheels are being built.16:02
johnsomWe *may* need to make a change on the stable branches for this.16:03
lukskyOK, that is fine16:03
lukskyI created it this way:16:03
johnsomI have not had time to read/internalize that yet, but wanted to raise it in case we have release issues or someone had time to take a look.16:03
ataraday_hi16:04
luksky(DEVEL)[root@test1 ~/octavia]# git checkout 89a2f6e16:04
luksky(DEVEL)[root@test1 ~/octavia]# cd octavia/diskimage-create16:04
rm_workI thought we actually did have that set locally?16:04
luksky(DEVEL)[root@test1 ~/octavia/diskimage-create]# ./diskimage-create.sh16:04
johnsomI know we did at one point, but I think someone removed them16:04
rm_workI remembered removing it in our patch to drop py216:04
rm_workI thought16:04
johnsomluksky Can you post this after the meeting?16:05
rm_workCan check later I guess16:05
johnsomOk, thanks16:05
johnsomAlso, nominations for "W" naming are starting I guess:16:05
rm_workEither way I think it's not the end of the world16:05
johnsom#link http://lists.openstack.org/pipermail/openstack-discuss/2020-January/012123.html16:05
rm_workIf it's not there in stable, it'll still work, just takes a little longer to install because it requires the wheel build to happen locally16:06
johnsomYeah, I think it would mean that no py2 compatible wheel would be made by OpenStack.16:06
haleybwe could start having issues with tempest-plugin jobs eventually like neutron did too, once we release an octavia-lib without py2 support, luckily i think i know the way around that one16:06
lukskyok16:06
johnsomThat is all I have for announcements16:07
rm_workWait, no more two summits per year? Did I miss that announcement? lol16:07
haleybwe'll need to start having midcycles to make up for it :-p16:09
johnsomOh, I should say that tickets for the PTG are now available:16:09
cgoncalveshaleyb, +116:09
johnsom#link https://www.openstack.org/ptg16:09
rm_workDo we need to get those separately?16:10
johnsomIt appears to be one ticket16:10
johnsomI don't know if there is an ATC discount or not16:11
rm_workHmm k16:14
johnsomIt was not in the e-mail I saw.16:14
rm_workWell, moving on16:14
rm_workErr, do you have the next topic copied? I'm on mobile ;)16:14
rm_workAh I got it16:15
rm_work#topic Brief progress reports / bugs needing review16:15
*** openstack changes topic to "Brief progress reports / bugs needing review (Meeting topic: Octavia)"16:15
johnsomSorry, I didn't have my cheat sheet open either.16:16
rm_workSo, I've been super crazy stuck internally, almost non-present here for a bit16:16
johnsomI now have the new failover flow working in the lab. It rebuilds a standalone LB in about 30 seconds (includes nova boot time).16:16
ataraday_Want to highligt jobboard changes16:17
ataraday_#link https://review.opendev.org/#/q/status:open+project:openstack/octavia+branch:master+topic:jobboard16:17
rm_workBut I have a couple of patches I need to probably rebase and check for comments and update16:17
johnsomActive/Standby also works now. It's about 70 seconds because it sequentially rebuilds the amphora to limit failover downtime.16:17
rm_workAh yeah, I'll find time to review those again16:17
ataraday_we are going to have it in U cycle? :)16:17
johnsomI have some optimization to do there to make the VIP come up sooner, then on to fixing tests.16:18
johnsomCurrently I plan to post a v1 (non-jobboard) patch first, then circle back for a second patch on v2. This is to make backporting easier.16:18
johnsomWe will get it in "U" I'm pretty sure.16:19
johnsomUssuri-2 milestone is the week of February 10th16:19
cgoncalvesI started reviewing the jobboard patches. I paused with code review on the third one in the chain but tested on devstack jobboard and looks really good. again, thank you ataraday_!16:20
johnsomI also need to get back to reviewing that, but I have prioritized getting failover flow improvements done.16:20
cgoncalvesI've spent some time on the CI side: fixing some, adding others, etc, plus testing nested-virtualization to speed up the jobs when possible16:22
haleybFor anyone needing some light reviews, I have a few py2 cleanup ones in both octavia/octavia-lib16:24
rm_workAlright, well ping me directly if you need reviews, I'm still head down for a little bit, going to have to work on a kinda weird patch this week :/16:25
cgoncalvesthis reminds me that, dulek, we do have a fix for the centos 8 amphora posted. I had completely forgotten about it, sorry.16:25
haleybcgoncalves: i saw your review adding jobs, can do a failure dashboard follow-on once it merges16:25
rm_workAh I should look at that, as we use that internally now16:25
cgoncalves#link https://review.opendev.org/#/c/698885/16:26
cgoncalveshaleyb, sounds good, thanks16:26
dulekcgoncalves: No problem at all, I just tried switching our gates to CentOS amp today as Toni was disgusted we're using Ubuntu one. :D And then I realized it doesn't seem to work.16:26
cgoncalvesdulek, see link I just pasted16:26
dulekcgoncalves: I added it as Depends-On, let's see.16:28
*** ivve has quit IRC16:28
rm_workOk, think we're ready for:16:30
rm_work#topic Open Discussion16:30
*** openstack changes topic to "Open Discussion (Meeting topic: Octavia)"16:30
cgoncalvesah, I have one.16:31
cgoncalvesI have this patch that I'd like to discuss with the team16:32
cgoncalves#link https://review.opendev.org/#/c/702845/16:32
cgoncalvesit adds new jobs to the check queue but also to the gate (hence voting)16:33
cgoncalvesthey are: spare pool, active-standby and cinder16:33
johnsomWith the current/up coming distro releases, keepalived is rolling over to 2.x.x. I think we should consider switching to VRRP v3 only. This brings some concerns about compatibility with existing amphora.  I think the only use case where we would end up in with one v2 and one v3 is failover. Most of those would be full load balancers, but if someone triggered an amphora failover of just one amp in a pair we16:33
johnsommight have an issue.  I have not investigated this yet.16:33
johnsomVRRP v3 brings faster failover and better IPv6 support among other enhancements.16:34
cgoncalvesthe team has been cautious about adding jobs that rely on other projects. in this patch, I propose adding one that relies on cinder.16:34
*** gcheresh has joined #openstack-lbaas16:34
cgoncalvesoops, sorry johnsom. let's discuss your topic first16:34
johnsomMy personal feeling is I don't want a gate job that depends on cinder.16:35
johnsomcgoncalves It's fine, mine is more of a "think about it"16:35
*** armax has joined #openstack-lbaas16:35
johnsomHistorically I have purposely disabled cinder in our tempest tests (it's on by default) because they have broke job runs, usually with broken dependencies.16:36
cgoncalvesmaybe we can discuss first the other two jobs: spare pool and active-standby. these are important features in Octavia that provides high-availability. would anyone not agree to adding those to the gate?16:36
johnsomUntil this volume based amphora, we did not need cinder.16:36
cgoncalveslol, we keep on conflicting xD16:37
johnsomI think both of spares and act/stdby need to be voting.16:38
rm_workYes16:38
johnsomIt would be nice to have multi-node working, especially for act/stdby16:38
johnsomAlso, now with flavors supporting topology, we can probably consolidate some of these tests.16:38
rm_workUgh, yeah, we've kinda put that on hold right? No one is looking at it recently?16:39
cgoncalvesthe two-node job started failing because devstack dropped Xenial support. there's a patch up to fix it16:39
cgoncalves#link https://review.opendev.org/#/c/703365/16:39
johnsomYeah, it would be super great if someone could work on multi-node16:39
johnsomWell, it was broken before that too, but maybe that is fixed now too16:39
rm_workYeah it's been broken for a while, didn't think that was what broke it16:40
haleybi can look once that merges, looking at the grenade job too16:40
cgoncalvesI didn't look other problems, just upgraded to bionic and it passed but may be unstable16:40
rm_workHmm k16:41
johnsomhaleyb Thank you!16:41
rm_workYeah can try to get that to pass and merge soon16:41
cgoncalvesso what I'm understanding is that no one disagrees with adding spare pool and active-standby to the gate, and cinder should be non-voting. if that's so, I will update the patch16:41
rm_workYep16:42
openstackgerritCarlos Goncalves proposed openstack/octavia master: Fix jobs not running and add new ones to the gate  https://review.opendev.org/70284516:43
johnsomcgoncalves Gave my +2 to the bionic nodes based on the previous run issue.16:43
cgoncalvesthanks!16:44
rm_workOk, anything else?16:45
*** luksky has quit IRC16:47
rm_workGuess not? Thanks for coming today!16:47
johnsomo/16:47
rm_workMake sure to toss a coin to your Witcher, folks. He's a friend to humanity.16:47
rm_work#endmeeting16:47
*** openstack changes topic to "Discussions for OpenStack Octavia | Priority bug review list: https://etherpad.openstack.org/p/octavia-priority-reviews"16:47
openstackMeeting ended Wed Jan 22 16:47:42 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:47
openstackMinutes:        http://eavesdrop.openstack.org/meetings/octavia/2020/octavia.2020-01-22-16.00.html16:47
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/octavia/2020/octavia.2020-01-22-16.00.txt16:47
openstackLog:            http://eavesdrop.openstack.org/meetings/octavia/2020/octavia.2020-01-22-16.00.log.html16:47
johnsomluksky Hi, thanks for waiting16:48
rm_work(didn't wait)16:48
johnsomSince you are on queens, I suspect it is pulling in the wrong version of the amphora agent.16:48
johnsomoh, bummer16:48
rm_workMaybe will be back :)16:49
johnsompretty sure the issue was DIB_REPOREF_amphora_agent16:49
rm_workI still don't understand what you didn't like about my patch to make that automatic16:49
johnsomSince they were back on queens16:49
johnsomI think it was the cache issue causes the build to fail16:49
johnsomYou have to go into the build cache and delete the amphora-agent cache16:50
rm_workYeah I wasn't able to replicate16:50
rm_workBut maybe that could be added?16:50
cgoncalvesyup, DIB_REPOREF_amphora_agent. I always have to check the name in the docs16:51
johnsomYeah, or fix DIB to not break when it can't find the reference in the cached version.16:52
*** gcheresh has quit IRC16:53
rm_workHmm yeah16:55
*** rpittau is now known as rpittau|afk17:03
*** mithilarun has joined #openstack-lbaas17:19
*** TMM has joined #openstack-lbaas17:22
TMMhi all! I have a question about octavia: I have a totally working setup but it appears that if I try to set a security group on the port for the listener of a loadbalancer the iptables rules don't get implemented on the amphora instance. How is this supposed to work?17:23
johnsomTMM The security groups for the load balancer are automatically handled by Octavia. They cannot be changed by end users.17:24
TMMIs it possible to set ACLs on a loadbalancer at all?17:24
johnsomYes17:24
johnsomhttps://docs.openstack.org/api-ref/load-balancer/v2/index.html?expanded=create-listener-detail#create-listener17:25
johnsomallowed_cidrs17:25
cgoncalves+ example: https://docs.openstack.org/octavia/latest/user/guides/basic-cookbook.html#deploy-a-load-balancer-with-access-control-list17:25
johnsomAh, yeah, I forgot it was in the cookbook. Nice17:26
TMMOK, I didn't see that property when using 'openstack loadbalancer listener show' so maybe my openstack cli is outdated17:27
TMMIs this a very new feature?17:29
cgoncalvesyes, available since Train release17:31
TMMOK17:32
TMMThank you a lot17:33
TMMI'll just upgrade the octavia component17:33
TMMStill need to upgrade from Queens for the rest of the components. I think we're on Stein for Octavia17:33
*** mithilar_ has joined #openstack-lbaas17:38
*** mithilarun has quit IRC17:41
openstackgerritCarlos Goncalves proposed openstack/octavia master: Add listener allowed_cidrs to the feature matrix  https://review.opendev.org/70385117:54
openstackgerritCarlos Goncalves proposed openstack/octavia master: Add listener allowed_cidrs to the feature matrix  https://review.opendev.org/70385117:57
*** born2bake has joined #openstack-lbaas17:58
TMMIs there anything in particular I need to keep in mind when upgrading octavia? Will I have to redeploy all the amporae?18:06
johnsomTMM All of the important details for upgrades are in the release notes: https://docs.openstack.org/releasenotes/octavia/18:07
TMMty18:08
*** mithilar_ has quit IRC18:10
*** vishalmanchanda has quit IRC18:17
*** goldyfruit has quit IRC18:24
*** goldyfruit has joined #openstack-lbaas18:24
*** mithilarun has joined #openstack-lbaas18:30
*** tesseract has quit IRC18:40
*** yamamoto has joined #openstack-lbaas18:59
*** yamamoto has quit IRC19:04
*** luksky has joined #openstack-lbaas19:13
*** mithilarun has quit IRC19:18
*** goldyfruit has quit IRC19:27
*** mithilarun has joined #openstack-lbaas19:29
*** mithilarun has quit IRC19:33
*** maciejjozefczyk has quit IRC19:35
*** gmann is now known as gmann_afk19:38
*** mithilarun has joined #openstack-lbaas19:43
*** goldyfruit has joined #openstack-lbaas19:48
*** mithilarun has quit IRC19:48
born2bakejohnsom hi, question: neutron services shall be on the same machine where octavia is deployed or it is possible to have them on separate machines?20:04
johnsomborn2bake separate is fine. Unlike neutron-lbaas, Octavia has no dependency on being co-located with neutron.20:05
*** gmann_afk is now known as gmann20:18
TMMI run my octavia control plane in a VM on top of Nova, works great20:28
*** mithilarun has joined #openstack-lbaas20:28
*** mithilarun has quit IRC20:33
*** servagem has quit IRC20:48
*** gcheresh has joined #openstack-lbaas20:51
*** goldyfruit has quit IRC20:58
*** goldyfruit has joined #openstack-lbaas20:59
*** pcaruana has quit IRC21:07
*** mithilarun has joined #openstack-lbaas21:10
*** goldyfruit has quit IRC21:15
*** goldyfruit has joined #openstack-lbaas21:16
*** mithilarun has quit IRC21:34
*** mithilarun has joined #openstack-lbaas21:36
*** rcernin has joined #openstack-lbaas21:50
*** gcheresh has quit IRC21:51
*** goldyfruit_ has joined #openstack-lbaas22:01
*** goldyfruit has quit IRC22:02
*** armax_ has joined #openstack-lbaas22:07
*** armax has quit IRC22:12
*** armax_ is now known as armax22:12
*** goldyfruit_ has quit IRC22:34
*** goldyfruit_ has joined #openstack-lbaas22:35
*** born2bake has quit IRC22:35
*** TrevorV has quit IRC22:37
*** goldyfruit has joined #openstack-lbaas22:41
*** goldyfruit_ has quit IRC22:42
*** tkajinam has joined #openstack-lbaas23:07

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!