Wednesday, 2018-03-14

*** fnaval has joined #openstack-lbaas01:00
*** JudeC has quit IRC01:08
*** harlowja has quit IRC01:20
openstackgerritMerged openstack/octavia master: Add license for empty __init__.py  https://review.openstack.org/53476501:22
*** jaff_cheng has joined #openstack-lbaas01:58
*** AlexeyAbashkin has joined #openstack-lbaas02:36
*** AlexeyAbashkin has quit IRC02:40
openstackgerritMichael Johnson proposed openstack/octavia master: Reduce stestr concurrency to 1 for tempest jobs  https://review.openstack.org/55180102:50
openstackgerritMichael Johnson proposed openstack/octavia master: Change import order  https://review.openstack.org/53465602:50
openstackgerritMichael Johnson proposed openstack/octavia master: Fix functional jobs  https://review.openstack.org/55178902:51
*** AlexeyAbashkin has joined #openstack-lbaas03:36
*** AlexeyAbashkin has quit IRC03:40
openstackgerritHengqing Hu proposed openstack/octavia-dashboard master: Add l7 support  https://review.openstack.org/55194703:46
openstackgerritHengqing Hu proposed openstack/octavia-dashboard master: Add rbac support for octavia service apis  https://review.openstack.org/55031903:59
*** atoth has quit IRC04:05
*** harlowja has joined #openstack-lbaas04:12
*** ianychoi_ has joined #openstack-lbaas04:12
*** ianychoi has quit IRC04:15
*** links has joined #openstack-lbaas04:22
*** harlowja has quit IRC04:40
*** gcheresh has joined #openstack-lbaas04:46
*** gcheresh has quit IRC04:53
*** jrForceflow has joined #openstack-lbaas05:00
*** nprene0 has joined #openstack-lbaas05:02
*** jrForceflow has quit IRC05:02
*** nprene0 has quit IRC05:02
openstackgerritAdam Harwell proposed openstack/octavia master: Updated from global requirements  https://review.openstack.org/55219305:11
*** fnaval has quit IRC05:12
openstackgerritAdam Harwell proposed openstack/octavia master: Devstack plugin image build option quoting fix  https://review.openstack.org/55264105:13
rm_workxgerman_: the -1 was because i wanted you to do what carlos said and make it a normal gate check periodically so we could see it run :P the comment about the merge conflict was incidental T_T05:15
rm_works/periodically/temporarily/05:16
openstackgerritAdam Harwell proposed openstack/octavia master: Properly test access to tls_refs in the API layer  https://review.openstack.org/55030305:19
openstackgerritAdam Harwell proposed openstack/octavia master: [WIP] Automatically set Barbican ACLs  https://review.openstack.org/55254905:22
*** fnaval has joined #openstack-lbaas05:29
*** fnaval has quit IRC05:33
openstackgerritMerged openstack/octavia master: Change import order  https://review.openstack.org/53465605:41
openstackgerritOpenStack Proposal Bot proposed openstack/neutron-lbaas master: Updated from global requirements  https://review.openstack.org/55277205:44
openstackgerritMerged openstack/octavia master: Fix functional jobs  https://review.openstack.org/55178905:45
*** fnaval has joined #openstack-lbaas05:45
openstackgerritOpenStack Proposal Bot proposed openstack/octavia master: Updated from global requirements  https://review.openstack.org/55219305:47
*** fnaval has quit IRC05:50
openstackgerritAdam Harwell proposed openstack/octavia master: Allow members to be set as "backup"  https://review.openstack.org/55263205:55
openstackgerritMerged openstack/octavia master: Reduce stestr concurrency to 1 for tempest jobs  https://review.openstack.org/55180105:56
rm_workcgoncalves: you on?05:58
rm_workmind if i push a quick edit to your grenade job? just need to remove a reference to octavia-dashboard05:59
rm_workso it'll hopefully actually run05:59
rm_workeh you can just overwrite my change if you want, it won't matter06:00
openstackgerritAdam Harwell proposed openstack/octavia master: Add grenade support  https://review.openstack.org/54965406:00
*** gcheresh has joined #openstack-lbaas06:02
*** fnaval has joined #openstack-lbaas06:16
*** fnaval has quit IRC06:21
*** gcheresh has quit IRC06:22
*** fnaval has joined #openstack-lbaas06:33
*** fnaval has quit IRC06:37
*** mestery has quit IRC06:39
*** dims has quit IRC06:41
*** dims has joined #openstack-lbaas06:43
*** mestery has joined #openstack-lbaas06:43
*** ianychoi__ has joined #openstack-lbaas06:43
*** ianychoi_ has quit IRC06:46
*** dims has quit IRC06:48
*** dims has joined #openstack-lbaas06:49
*** ianychoi__ is now known as ianychoi06:51
*** kobis has joined #openstack-lbaas07:01
*** pcaruana has joined #openstack-lbaas07:04
*** fnaval has joined #openstack-lbaas07:07
*** fnaval has quit IRC07:11
*** jaff_cheng has quit IRC07:45
*** jaff_cheng has joined #openstack-lbaas07:46
*** AlexeyAbashkin has joined #openstack-lbaas07:57
*** gcheresh has joined #openstack-lbaas08:03
*** fnaval has joined #openstack-lbaas08:07
*** fnaval has quit IRC08:11
*** gcheresh has quit IRC08:12
*** tesseract has joined #openstack-lbaas08:14
*** gcheresh has joined #openstack-lbaas08:55
*** yamamoto_ has joined #openstack-lbaas09:18
*** yamamoto has quit IRC09:22
*** mangelm has joined #openstack-lbaas09:23
mangelmHi everyone, I'm just starting with Octavia (reading docs for now). But I still haven't figured out if octavia is able to scale and have multiple lbaas per tenant....is is possible to scale the load balancer in case one is not enough? (for a single tenant)09:31
*** gcheresh has quit IRC09:47
*** jaff_cheng has quit IRC10:03
*** jaff_cheng has joined #openstack-lbaas10:04
*** fnaval has joined #openstack-lbaas10:06
*** fnaval has quit IRC10:11
mangelmor said with another words... is the distributor for active-active (to select multiple amphora) already implemented and working? I mean, is it something that can be used in Pike/Queens?10:12
*** rcernin has quit IRC10:13
*** jaff_cheng has quit IRC10:23
*** salmankhan has joined #openstack-lbaas10:33
*** gcheresh has joined #openstack-lbaas11:06
*** fnaval has joined #openstack-lbaas11:06
*** ianychoi has quit IRC11:07
*** fnaval has quit IRC11:11
*** ianychoi has joined #openstack-lbaas11:13
*** HW-Peter has quit IRC11:22
*** KeithMnemonic has joined #openstack-lbaas11:44
cgoncalvesrm_work: you defused my grenade :( now it doesn't pass gate11:47
*** gcheresh has quit IRC11:58
*** salmankhan has quit IRC12:02
*** salmankhan has joined #openstack-lbaas12:02
*** fnaval has joined #openstack-lbaas12:07
*** fnaval has quit IRC12:11
*** yamamoto_ has quit IRC12:17
*** yamamoto has joined #openstack-lbaas12:18
*** atoth has joined #openstack-lbaas12:26
*** yamamoto has quit IRC12:38
*** yamamoto has joined #openstack-lbaas12:39
*** yamamoto has quit IRC12:44
*** yamamoto has joined #openstack-lbaas12:55
*** yamamoto has quit IRC12:59
*** yamamoto has joined #openstack-lbaas13:10
*** yamamoto has quit IRC13:15
*** yamamoto has joined #openstack-lbaas13:25
*** yamamoto has quit IRC13:29
*** yamamoto has joined #openstack-lbaas13:40
*** yamamoto has quit IRC13:44
*** yamamoto has joined #openstack-lbaas13:54
*** yamamoto has quit IRC13:55
*** yamamoto has joined #openstack-lbaas13:55
*** yamamoto has quit IRC13:55
*** atoth has quit IRC13:59
xgerman_mangelm: no, distributor is still underooment14:11
xgerman_under development14:11
*** atoth has joined #openstack-lbaas14:12
xgerman_rm_work: cgoncalves  I was running it as a check job for a while — what do we want to prove with turning it into one again?14:12
cgoncalvesxgerman_: not me, rm_work's14:14
xgerman_ok, let’s see how he responds…14:15
cgoncalvesxgerman_: I think he wants to see it passing as a check job with latest patch before merging14:15
*** kobis has quit IRC14:20
*** kobis has joined #openstack-lbaas14:21
*** kobis has quit IRC14:21
*** fnaval has joined #openstack-lbaas14:24
rm_workyes that was the case14:27
rm_workcgoncalves: your grenade was failing immediately because it was missing the dashboard job :P it should get farther now14:28
rm_workwhere did it fail this time...14:28
rm_workah, much farther14:28
rm_workwtf it timed out? >_> http://logs.openstack.org/54/549654/24/check/octavia-grenade/9bb13e7/job-output.txt.gz#_2018-03-14_08_58_15_05310914:29
rm_worksomething has a bad timeout value i think14:29
rm_workwe know it should take a while and it is set to time out at only 9 minutes? >_>14:30
rm_workit seems it was working fine until it was killed14:31
rm_workwhat caused it to die...14:31
cgoncalvesrm_work: it was not failing when dashboard was in there14:32
rm_workright, you only half removed dashboard when you removed it ;)14:32
cgoncalvesbut not having it now is not the troublemaker14:32
rm_workbut now that part is fixed14:33
cgoncalvesah, oops14:33
rm_workwhat's breaking it now is that i believe maybe the timeout default is not as long as I thought14:33
rm_workso maybe we need to put the timeout back14:33
rm_workyou removed that also, right?14:33
cgoncalvesyes... it's not defaulting to 7800 seconds from parent job?!14:34
cgoncalvesi'll re-add it14:34
rm_worknot sure14:34
rm_workit might be something else14:34
rm_workbut see the timeout there is set to 9?14:34
rm_workwhich approximately matches the time i see on the job14:34
rm_workor maybe i'm misreading that14:34
xgerman_rm_work so you think me removing a line breaks the whole thing?14:35
rm_workxgerman_: wait what?14:35
rm_worki just have never seen it run, i have no idea14:35
rm_workis there a run in the history somewhere that it was a check job that I can see?14:36
xgerman_well, I had it run for like a couple of patch sets14:36
rm_workok, do you remember which ones?14:36
xgerman_not sure if they keep jenkins history14:36
rm_workI will look14:36
rm_workit should14:36
xgerman_k14:36
xgerman_what does operating sttaus NO_MONITOR mean those days?14:36
rm_workcgoncalves: oh i think it's `timeout -s 9 ${REMAINING_TIME}m` where $REMAINING_TIME must be set low?14:36
rm_worknot sure where there that comes from14:37
rm_workand i don't have the `timeout` binary locally to see a manpage or help doc14:38
*** salmankhan has quit IRC14:38
cgoncalvesrm_work: ah, I thought I had it set to ihnerit from octavia-legacy-dsvm-base (where timeout: 7800)14:41
cgoncalvesinstead it's from legacy-dsvm-base14:41
rm_workah, fix it and maybe it'll be good :)14:42
rm_workdoes that change anything else?14:42
cgoncalvesit should yes14:42
cgoncalvestrying...14:42
openstackgerritCarlos Goncalves proposed openstack/octavia master: Add grenade support  https://review.openstack.org/54965414:42
*** salmankhan has joined #openstack-lbaas14:49
*** yamamoto has joined #openstack-lbaas14:55
mangelmxgerman_, thanks!15:00
mangelmxgerman_, do you know if there is a planned released date for distributor?15:00
*** yamamoto has quit IRC15:02
johnsommangelm FYI, you can have multiple load balancers per tenant with different VIP addresses and multiple ports on the load balancers. It's just the Active/Active topology is not ready yet. Hopefully in Rocky15:03
*** numans_ has joined #openstack-lbaas15:04
*** numans has quit IRC15:05
*** links has quit IRC15:18
xgerman_and another person is slamming us on the k8s Slack…15:19
*** salmankhan has quit IRC15:20
*** salmankhan has joined #openstack-lbaas15:20
xgerman_https://www.irccloud.com/pastebin/oyoVN6b0/15:20
xgerman_I guess we shoudl just fold and work for nginx15:20
mangelmjohnsom, Well my intention was to have only one VIP, that is, I was interested about the active/active scheme. Thanks anyway!!15:24
rm_workaww, missed the pastebin15:26
xgerman_and we are in LBaaS V1 -> V2 upgrade15:30
openstackgerritAdam Harwell proposed openstack/octavia master: Fix amp failover where failover already failed  https://review.openstack.org/54898915:31
openstackgerritAdam Harwell proposed openstack/octavia master: When SG delete fails on vip deallocate, try harder  https://review.openstack.org/54926315:31
openstackgerritAdam Harwell proposed openstack/octavia master: Update HAProxy version for Centos  https://review.openstack.org/54842015:32
rm_worksome rebases ^^15:32
rm_workxgerman_: wait what are you talking about now?15:32
xgerman_rm_work I have a spirited discussion in the k8s OpenStack slack and they just pulled the V1->V2 migration card…15:33
openstackgerritAdam Harwell proposed openstack/octavia master: Reduce runtime for l7rule too_many_rules test  https://review.openstack.org/54899115:33
rm_workxgerman_: should i ... look at that?15:34
xgerman_if you like to see what we are up at15:34
johnsomWhat channel is this?15:34
xgerman_k8s sig-openstack15:34
johnsomRemind them that those folks aren't even here anymore15:34
johnsomI don't see that on the openstack IRC channel list15:36
openstackgerritCarlos Goncalves proposed openstack/neutron-lbaas master: [DNM]: Test CI  https://review.openstack.org/55008515:36
rm_workit's in their slack15:36
xgerman_yes, it’s in slack15:37
johnsomAh, so not OpenStack?15:37
xgerman_yes, the openstack -k8 people hang ou tin the k8s slack15:38
openstackgerritAdam Harwell proposed openstack/octavia master: WIP: Floating IP Network Driver (spans L3s)  https://review.openstack.org/43561215:38
johnsomDefinitely a bit tired of people going on about LBaaSv1 which was never released as a stable API and clearly nobody cared enough about LBaaSv1 to write a migration.15:41
xgerman_yes —15:46
xgerman_thanks rm_work15:53
xgerman_now you see what I have been up to ;-)15:53
rm_workheh15:53
rm_worki mean, this kind of confusion is totally understandable15:53
rm_workwe've done a shit job at messaging outside of our little walled garden15:54
rm_workand our docs are still a mess, I don't blame people who tried to install octavia using them and failed15:54
johnsomSo, my calendar just went sideways, the meeting time shows 2pm on it now instead of 1pm. So... double check that your calendars aren't fishy too15:54
rm_workah was it hooked to UTC or PST? :P15:54
johnsomrm_works Docs are getting better...  <sad face>15:54
johnsomI booked it UTC, but outlook seems to have not cared15:55
rm_workyeah, but people who have looked once and given up, don't always look again. and no use trying to pretend they're great15:55
johnsomIt even moved my lunch time, which wasn't utc, so...  very strange15:55
rm_workit's disingenuous15:55
rm_worklolwut15:55
rm_workjohnsom: so if you wouldn't mind: https://review.openstack.org/552641 is a high priority for me, is kinda making my stack builds a PITA15:58
rm_workand is trivial15:58
*** yamamoto has joined #openstack-lbaas15:58
rm_workhttps://review.openstack.org/548991 is also trivial and speeds up my testing a lot15:58
rm_workand this is a nobrainer as well: https://review.openstack.org/55219315:58
rm_workxgerman_: ^^ you too, for any of those you have time for15:58
johnsomYeah, so it's MAC outlook, and only this week, next week is fine. If I open the meetings it's fine.  Ugh.15:59
openstackgerritAdam Harwell proposed openstack/octavia master: DNM: Remove PING type from HM options list  https://review.openstack.org/52843915:59
*** yamamoto has quit IRC16:04
*** atoth has quit IRC16:04
xgerman_johnsom: our meeting is not at 1 pm pacific?16:07
johnsomYeah, 20:00 UTC16:07
johnsomrm_work Have a minute to talk about https://review.openstack.org/#/c/548989?16:08
rm_workprolly, one sec16:10
rm_workmy everything crashed16:10
rm_worktrying to get back up and running16:10
johnsomOk, NP16:10
rm_workugh i lost like 6 months of tabs T_T16:11
rm_workhave to go dig through my history and try to remember what was where16:12
rm_workomfg my internet ... is being... so slow16:13
rm_workjohnsom: ok well, while i wait 20 minutes for gerrit to load... what did you want to talk about regarding that CR?16:15
johnsomSo, I see you made some changes to the "Busy" gating that I don't understand16:16
johnsomWhy did you move when we put an amp into "busy" during failover16:16
rm_workok16:16
*** atoth has joined #openstack-lbaas16:17
rm_workin the flows?16:17
johnsomyea16:17
rm_worklet me look16:17
johnsomyeah.  https://review.openstack.org/#/c/548989/3/octavia/controller/worker/flows/amphora_flows.py16:17
rm_workwe were talking about this AS I was coding it, so it was per what we were discussing at the time16:17
rm_workone sec, it's going to take about 5min to load that page16:17
rm_workoh nm there we go16:17
johnsomYeah, I remember talking about some of this, but the busy part throws me off16:18
rm_workah, so16:18
rm_work"DisableAmphoraHealthMonitoring" is literally "delete the record for that amp-id from the health table"16:19
rm_workso at this point, it will be BUSY (1). It was moved out from *before* the MarkDeleted for the amp, to after16:20
rm_workso that we wouldn't ever have an amp without a health record in a state that wasn't DELETED16:20
rm_workerr16:21
rm_workthough hmm16:21
rm_worki think the main reason had to do with preventing cleanup too early16:21
rm_workbut that may be fixed elsewhere now16:21
* cgoncalves swears didn't break anything this time https://review.openstack.org/#/c/550085/16:21
rm_workwut http://logs.openstack.org/85/550085/4/check/openstack-tox-pep8/e5f9981/job-output.txt.gz#_2018-03-14_15_42_23_05129516:23
rm_workCould not satisfy constraints for 'neutron': installation from path or url cannot be constrained to a version16:23
cgoncalvesdo we need to q- -> neutron- ??16:25
xgerman_probably16:25
johnsomI thought there was a patch up for that already16:28
cgoncalvesjohnsom: for octavia16:29
cgoncalvesI've been reading rumors today of devstack dropping neutron-legacy or something16:29
*** AlexeyAbashkin has quit IRC16:30
johnsomhttps://review.openstack.org/55249316:30
cgoncalveshttps://review.openstack.org/#/c/552503/16:30
johnsomThough that does not look complete16:30
cgoncalvesmay not be applicable after revert patch in devstack16:31
*** KeithMnemonic has quit IRC16:32
*** kobis has joined #openstack-lbaas16:33
rm_workerr16:34
rm_workthat looks like a pip change or something tho?16:34
rm_worklike why suddenly can it not use constraints to install the neutron package16:34
cgoncalvesbecause of... supernatural reasons16:35
johnsomYeah, I'm trying to see *why* it is installing neutron, it's not in our requirements16:35
johnsomAh tox_install16:35
johnsomwe really shouldn't need that anymore... I adapted it, but16:36
rm_workyeah16:39
rm_workinfra is saying that we should just be able to list neutron as a normal requirement now16:39
rm_worki know we had a funky method before16:40
cgoncalvesand why are octavia-v1-dsvm-*-scenario-multinode jobs suddently failing in https://review.openstack.org/#/c/549654/16:40
johnsomWelcome to the start of a new cycle....16:40
johnsomAt least it's happening now and not two weeks before release16:41
*** kobis has quit IRC16:41
cgoncalvesnot to mention work downstream16:42
openstackgerritMichael Johnson proposed openstack/neutron-lbaas master: Remove tox_install.sh  https://review.openstack.org/55297816:50
johnsomSo, it looks like I had a typo in my work around for this, but I'm going to give it a go to fully remove it now.16:51
rm_workour requirements.txt already HAD neutron? :P16:54
johnsomNo, fixing16:54
*** kobis has joined #openstack-lbaas16:55
openstackgerritMichael Johnson proposed openstack/neutron-lbaas master: Remove tox_install.sh  https://review.openstack.org/55297816:55
*** kobis1 has joined #openstack-lbaas16:58
*** yamamoto has joined #openstack-lbaas16:59
*** sapd_ has joined #openstack-lbaas17:01
*** kobis has quit IRC17:01
*** sapd has quit IRC17:05
*** yamamoto has quit IRC17:05
openstackgerritMichael Johnson proposed openstack/neutron-lbaas-dashboard master: Remove tox_install  https://review.openstack.org/55298517:16
*** pcaruana has quit IRC17:18
*** Swami has joined #openstack-lbaas17:25
openstackgerritMichael Johnson proposed openstack/octavia-dashboard master: Remove tox_install  https://review.openstack.org/55298717:28
johnsomOk, those three remove tox_install from our repos17:28
*** kobis1 has quit IRC17:29
rm_worklet's hope it "just works" I guess :P17:29
rm_worki guess it does seem to17:30
johnsomYeah, I ran the tests local17:30
*** imacdonn has quit IRC17:44
*** imacdonn has joined #openstack-lbaas17:44
*** links has joined #openstack-lbaas17:57
*** yamamoto has joined #openstack-lbaas18:01
*** sshank has joined #openstack-lbaas18:01
*** yamamoto has quit IRC18:06
*** sshank has quit IRC18:07
*** AlexeyAbashkin has joined #openstack-lbaas18:07
*** harlowja has joined #openstack-lbaas18:11
*** AlexeyAbashkin has quit IRC18:11
*** salmankhan has quit IRC18:13
imacdonnis neutron-lbaasv2-dsvm-* CI broken at the moment ?18:42
imacdonnor do I need a rebase? hmm18:42
rm_workyes18:45
rm_workeverything is broken18:45
imacdonnheh ok18:45
rm_workwaiting on some fixes to pass and merge18:45
imacdonnok .. I'll try later .. thanks18:46
*** jniesz has joined #openstack-lbaas18:54
*** longstaff has joined #openstack-lbaas18:54
*** yamamoto has joined #openstack-lbaas19:02
johnsomCores can start review/merge those fixes: https://review.openstack.org/#/c/552978/19:05
*** yamamoto has quit IRC19:07
rm_workerr, i guess read Andreas' comments19:11
*** AJaeger has joined #openstack-lbaas19:14
AJaegerrm_work: I'm here now to continue discussion...19:14
rm_workso we can wait and just do it the right way the first time19:14
rm_workjust need johnsom to update his patch19:14
rm_workor I guess I / you could do it19:14
AJaegerjohnsom: are you around? Or shall I quickly fix it?19:14
AJaegerYes, I can...19:14
rm_workhe won't mind if you do it I think19:14
AJaeger;)19:15
openstackgerritAndreas Jaeger proposed openstack/neutron-lbaas master: Remove tox_install.sh  https://review.openstack.org/55297819:16
AJaegerrm_work, johnsom ^19:16
* AJaeger handles the other reviews as well quikcly19:17
openstackgerritAndreas Jaeger proposed openstack/octavia-dashboard master: Remove tox_install  https://review.openstack.org/55298719:18
*** tesseract has quit IRC19:20
*** links has quit IRC19:34
johnsomCool, thanks.  Ran to make lunch19:41
AJaegerjohnsom: thanks for pushing first version out - and sorry for breakage19:41
AJaegerWe weren't aware of tha tside effect ;(19:41
johnsomNo worries19:41
*** atoth has quit IRC19:59
johnsom#startmeeting Octavia20:00
openstackMeeting started Wed Mar 14 20:00:02 2018 UTC and is due to finish in 60 minutes.  The chair is johnsom. Information about MeetBot at http://wiki.debian.org/MeetBot.20:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.20:00
*** openstack changes topic to " (Meeting topic: Octavia)"20:00
openstackThe meeting name has been set to 'octavia'20:00
johnsomHi folks!20:00
xgerman_o/20:00
longstaffhi20:00
johnsomLet's see how many people show up after the DST change20:00
cgoncalveshi20:00
rm_worko/20:00
jnieszhi20:00
* rm_work uses the strategy of just paying attention to the channel and having no idea when the meeting will actually start20:00
johnsomNot bad20:00
johnsomThat is a bonus of having the meeting in channel20:01
johnsom#topic Announcements20:01
*** openstack changes topic to "Announcements (Meeting topic: Octavia)"20:01
rm_workyeah i love it20:01
johnsomQueens Released!20:01
johnsomIn case you missed it, queens is out the door.20:01
johnsomThank you all for your contributions to our Queens release20:01
*** gcheresh has joined #openstack-lbaas20:02
johnsomIt seems we had a hiccup with some global-requirements, but we will talk about that later in the agenda.20:02
johnsomOtherwise it's a pretty good release.20:02
*** yamamoto has joined #openstack-lbaas20:03
johnsomIn case you were not able to make the Rocky PTG, I attempted to take notes in the etherpad20:03
johnsom#link https://etherpad.openstack.org/p/octavia-ptg-rocky20:03
johnsomOnce I dig out a bit more I will try to send out a summary e-mail.20:03
johnsomAlso, the naming for the "S" series is out for a vote. Check you OpenStack e-mail for your voting link.20:04
johnsomThe theme is around Berlin as that is where the summit will be.20:04
johnsomI still have a stack of windows for e-mails I need to read, so that is about all of the announcements I have today. Anything I missed?20:05
johnsom#topic Brief progress reports / bugs needing review20:05
*** openstack changes topic to "Brief progress reports / bugs needing review (Meeting topic: Octavia)"20:05
johnsomI am still getting caught up after travelling for two weeks.  Mostly I have been working on gate fixes, catching up on e-mails, expense reports, etc.20:06
rm_workyeah the gate currently is ... :/20:07
johnsomAlso catching up on reviews.  There was a lot of work done while I was in Ireland.20:07
rm_worki have a list of patches i'd like eyes on, i guess i can start posting20:07
johnsomI have also started to clean out the neutron-lbaas patches.  Some had not been touched in two years, so very clearly needed abandoned.20:07
*** yamamoto has quit IRC20:08
rm_workhttps://review.openstack.org/549263 and https://review.openstack.org/548989 and https://review.openstack.org/55030320:08
johnsomcgoncalves I see you had some stuff in the agenda, feel free to share here.20:09
rm_workand https://review.openstack.org/552641 just needs a +2/+A once the gate fixes merge (don't do it yet)20:09
cgoncalvesI wanted to share that we have recently faced some gate issues that led us to migrate from testr/ostestr to stestr which is the new tool for running tests in OpenStack. testr is not maintained and ostestr was a wrapper of it; stestr is a fork of testr20:10
rm_worki feel like we've done this about 3 different times for 4 different projects <_<20:11
johnsomYep, cool. Funny that we migrated to ostestr like a year ago....20:11
cgoncalvesoctavia and neutron-lbaas got migrated already. we need to do the same now for client, dashboard and tempest projects20:11
johnsomMy plan is to address some comments on the tempest plugin patch and update it for PTG discussions.20:12
cgoncalveswe also faced some other issues but turned out to be because of running jobs in parallel20:12
johnsomThen I want to focus on the driver code20:12
*** gcheresh has quit IRC20:12
cgoncalvesthe other item I put on the agenda was grenade: https://review.openstack.org/#/c/549654/20:13
*** gcheresh has joined #openstack-lbaas20:13
cgoncalvesthe patch has a depends-on btw20:13
johnsomYes, cool stuff!  I haven't had a chance to look at it, but I'm excited that we are working towards declaring upgradablility20:13
cgoncalvesthe grenade now verifies successfull upgrading from queens to master and no dataplane downtime20:14
cgoncalvesoh, we also started looking at performance/scale20:14
cgoncalvesNir has started this with a patch submitted to Rally: https://review.openstack.org/#/c/551024/20:14
johnsomNice!  I am interested to read it and learn about the grenade jobs.20:14
cgoncalveswe have got baremetal machines internally and we plan to have data by last week of March20:15
johnsomNice20:15
johnsom#topic Other OpenStack activities of note20:16
*** openstack changes topic to "Other OpenStack activities of note (Meeting topic: Octavia)"20:16
johnsomA few things are falling out of PTG discussions. This is the first one I have had time to read.20:16
johnsom#link http://lists.openstack.org/pipermail/openstack-dev/2018-March/128175.html20:17
cgoncalvesalso... (sorry!) soon Octavia will work when firewall is set to openvswitch, which until now would fail at load balancer creation20:17
johnsomAh, so there is a fix for OVSFW?20:17
cgoncalveshttps://review.openstack.org/#/c/550421/20:17
cgoncalveshttps://review.openstack.org/#/c/550431/ validates the patch20:17
johnsomAlong those lines, there is another issue in neutron DVR that can cause us problems:20:18
johnsom#link https://bugs.launchpad.net/neutron/+bug/175343420:18
openstackLaunchpad bug 1753434 in neutron "Unbound ports floating ip not working with address scopes in DVR HA " [Undecided,Confirmed]20:18
johnsomIn case anyone is using DVR20:18
johnsomMy item of note above was that there is work on a new oslo library for quotas.  I looked for this when I was doing the quota work for Octavia. So, this is good stuff.20:19
johnsomI will try to highlight the others next week once I get through my stack of stuff to read.20:19
johnsom#topic Open Discussion20:20
*** openstack changes topic to "Open Discussion (Meeting topic: Octavia)"20:20
cgoncalvesI added "Gate with lower-requirements.txt and workflow to ensure dependencies bumped in requirements.txt (i.e. a prereq before merging patches?)"20:21
johnsomcgoncalves Put an item on the agenda about the new lower-constraints requirements is starting20:21
cgoncalveswe have recently discovered that our requirements.txt is a bit behind what are our requirements20:21
johnsomThis is what I came up with after looking into the issues we had with the two requirements in queens20:22
cgoncalvesright20:22
cgoncalvesI would like to discuss ways we could improve this situation20:22
johnsomThis lower-constraint seems to be super new and talking with the requirements team, we might be the first to use it.20:22
rm_workwell, i still hold that this is a symptom of the way g-r works in openstack, and that we got stuck in kind of a hard spot20:23
johnsomMy thought is to setup a gate using this lower-constraints file and run through the py27 and functional tests with no-op.20:23
cgoncalvesin our dev envs and at gate we may not face such issues because we have recent lib versions installed, so we dont detect that requirements.txt gets outdated when we modify code20:23
xgerman_yeah, and then there is my nique problem with privsep and the broken msgpack20:23
rm_workand that in general, things need to be packaged/deployed using the same stuff we use in testing, which is to say "upper-constraints.txt"20:23
johnsomAgreed, it is an oddity in the requirements setup20:23
cgoncalvesjohnsom: functional and no-op are enough?20:24
johnsomcgoncalves, I  think so.  Do you think we need a full dsvm?20:25
cgoncalvesI don't know, therefor my question :)20:25
cgoncalvesone other idea would be using our requirements.txt20:25
johnsomIt would have caught these two issues20:25
johnsomUmm, we are using our requirements.txt....20:26
xgerman_yes20:26
rm_workrequirements.txt is all >=20:26
rm_workthe issue is that if you don't use u-c values for packages when packaging20:26
xgerman_and we use the gloval requirements indirectly in the gates20:26
johnsomRight, it assumes to pull whatever the latest is20:26
rm_workand just guess at "something that matches" ...20:26
cgoncalveswell, but that didn't prevent us from shipping a kind-of broken octavia20:26
rm_workcgoncalves: IMO it isn't broken20:27
rm_workwhen I deployed / build images for deploy, i followed guidelines which are to use u-c20:27
rm_workand everything was fine20:27
rm_worku-c details explicitly which packages are used in testing20:27
cgoncalvesrm_work: if you clone octavia repo only and follow the docs probably you end up installing from requirements.txt20:27
rm_workand are therefore the packages that should be used in deployments20:28
rm_workyou also end up installing neutron-lbaas20:28
rm_worki wouldn'tuse our docs as a good example of what to do20:28
johnsomRight, but it is valid that we should be making sure G-R gets updated to our bare-minimum requirements.  Thus, why I am proposing a gate that runs with lower-constraint20:28
rm_worksee the global openstack docs20:28
cgoncalvesok20:28
cgoncalvesjohnsom: +120:28
johnsomcgoncalves Yes, installing with requirements.txt will work correctly and not have an issue20:28
cgoncalvesjohnsom: if we proceed with that, would we block patches from being merged before bumping in g-r?20:29
cgoncalvesjohnsom: in queens you will have issues. their names are: jinja2 and pyOpenSSL :)20:29
johnsomFollowing the docs will lead to a successful install.20:29
johnsomcgoncalves no. it will go pull the latest for those two packages, which will succeed20:30
cgoncalvesmeh, assuming that you pull the latest yes20:31
rm_workcgoncalves: it WILL pull latest, if you pass requirements.txt to pip20:31
rm_workthat's what requirements.txt *has*20:31
johnsomAs for the lower-constraint gate, yes, it would block patches from merging until G-R is updated.20:31
rm_work>=20:31
cgoncalvesif the system already has minimum required and turns out to not be good enough, then no20:31
rm_workah, if you don't use -U and you already have random system python packages installed, then yes, ugh20:32
cgoncalvesjohnsom: +1 for blocking patches20:32
rm_worksystem python needs to DIAF20:32
rm_work*system python environment20:32
* cgoncalves looks up for DIAF20:32
rm_workdie in a fire20:32
cgoncalvesheh :)20:32
johnsomI kind of agree that packaged python modules tend to lead to nothing but trouble20:32
xgerman_+120:33
johnsomBut anyway, we have rat holed a bit here.20:33
rm_workabsolutely everything should be deployed in a virtualenv, no exceptions20:33
johnsomDoes anyone have any comments about the lower-constraint gate?  Are we in favor?20:33
rm_worki'm not sure i understand how it works20:33
rm_workbut sure20:33
cgoncalveswe have to play well with distros, after all majority of users install from distro packages ;)20:33
cgoncalvesin favor20:34
johnsomrm_work it will install using the minimum versions of the packages in requirements.txt20:34
rm_workyes, you can play well with distros by ignoring their system packages and using a virtualenv :P20:34
rm_workthis doesn't impact the distro in any way20:34
rm_workand is in fact very friendly to it by ignoring it altogether and being extremely low impact20:34
johnsomI know of distros that ship venvs too...20:34
cgoncalvesmobing on..... :P20:35
cgoncalves*moving20:35
johnsomgrin20:35
*** AlexeyAbashkin has joined #openstack-lbaas20:36
johnsomOk, I will put together a gate, non-voting for now so we can try this out. I'm a bit nervous as it's "new" for requirements team.20:36
johnsomProbably will need a py27 and py35, but maybe just start with py2720:37
johnsomWe don't really have any version specific requirements if I remember right.20:37
johnsomOther topics for open discussion today?20:38
cgoncalvesyes20:38
johnsomlol20:38
cgoncalvesI would like to bring up the topic of backports20:38
cgoncalvescould we have devs also proposing backporting stuff to stable/* ?20:39
cgoncalvesso far I have got the impression that it is a best effort, occasional20:40
johnsomTypically that is handled by a stable maintenance sub-team.20:40
*** AlexeyAbashkin has quit IRC20:40
rm_workcgoncalves: congrats on being the first member of the stable maintenance subteam for Octavia!20:40
cgoncalveshmm I don't recall seen anyone from that sub-team proposing20:40
johnsomWe however are a small team, so that doesn't really exist except for cgoncalves volunteering20:40
* rm_work claps for cgoncalves 20:40
cgoncalvesrm_work: lol20:40
* johnsom Congratulates cgoncalvess20:41
cgoncalvesI'm okay with that20:41
xgerman_yep, I would lobe the stable subtem to backport some of the recent hm fixes to Pike20:41
cgoncalvesbecause down the road it will save me lots of time with customer tickets20:41
johnsomAnyway, the trick here is they backports need to be proposed after the patch has merged on master. So a bit async20:41
johnsomYeah, anyone can propose a backport.  I have kind of being going on the "If someone needs it" approach (feel free to fire the PTL).20:42
xgerman_if we do we will do it by tweet20:42
cgoncalvesI'd suggest, whenever possible, to leave a comment or even add a tag to the commit message that the patch is backport material20:42
johnsomThe key part is making sure it meets the policy:20:43
johnsom#link https://docs.openstack.org/project-team-guide/stable-branches.html20:43
cgoncalvessure20:43
johnsomSo, yes, it would be nice to take with backport potential.  Please feel free to propose things.  Please propose them after the master has merged.20:45
johnsomcgoncalves Do you have a cadence you would like to see for dot releases of the stable branches?20:46
cgoncalveswill do20:46
cgoncalvesnot really20:46
johnsomAgain, my approach has been roughly at release cycles and if folks request them.20:46
johnsomok20:47
xgerman_yeah, I usually run off a SHA20:47
cgoncalveson our side we like to be proactive and backport whenever applicable20:47
xgerman_ok, sounds good20:47
johnsomYeah, not a problem.20:47
johnsomOk, other topics today?20:48
* cgoncalves feels observed....20:48
johnsomHahaha20:49
cgoncalvesno20:49
johnsomI need to go dig into the periodic stable jobs too. Not sure if those ever got put back after the zuulv3 stuff20:51
johnsomWe had a nice health dashboard I used to track those, but that is now gone.20:51
cgoncalveshttp://status.openstack.org/openstack-health/20:51
AJaegerjohnsom: periodic-stable-jobs-neutron run for neutron-lbaas20:52
cgoncalvesAJaeger: hi. do you have an ETA for grenade zuul v3 native job?20:53
AJaegercheck also http://zuul.openstack.org/builds.html?project=openstack%2Fneutron-lbaas&pipeline=periodic-stable20:53
AJaegercgoncalves: no - best ask QA team20:53
johnsomAh, it's working again. cool. Yeah, looks like the stable periodics are gone20:53
cgoncalvesAJaeger: ack20:53
AJaegerjohnsom: those get renamed, we might have forgotten to update the dashboard ;(20:53
johnsomAh, that is why I couldn't find them. periodic-stable.20:54
johnsomHmm, wish it had the branch in there somewhere20:54
AJaegerjohnsom: not in that display yet ;(20:55
rm_worklooks like https://review.openstack.org/#/c/552978/ is about to pass and needs +A20:55
johnsomAt least they are all passing.... grin20:55
rm_workthere it goes20:55
AJaegerso, something wrong with them? ;)20:55
rm_work+A plz20:55
johnsomYeah, good question.  hahaha20:56
johnsomOk, a few minutes left, anything else today?20:56
rm_workyes, someone, right now, should +A https://review.openstack.org/#/c/552978/ :P20:57
johnsomOk, thanks folks20:57
johnsom#endmeeting20:57
*** openstack changes topic to "Discussion of OpenStack Load Balancing (Octavia) | Rocky is open for development!"20:57
openstackMeeting ended Wed Mar 14 20:57:12 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)20:57
openstackMinutes:        http://eavesdrop.openstack.org/meetings/octavia/2018/octavia.2018-03-14-20.00.html20:57
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/octavia/2018/octavia.2018-03-14-20.00.txt20:57
openstackLog:            http://eavesdrop.openstack.org/meetings/octavia/2018/octavia.2018-03-14-20.00.log.html20:57
*** longstaff has quit IRC20:57
rm_workstill waiting20:58
rm_workxgerman_: https://review.openstack.org/#/c/552978/21:00
johnsomIt's my patch, so I would prefer not to, but I will since it's a gate issue if another core doesn't step up21:00
rm_worki mean21:00
johnsomAnd in fairness Nir is out this week21:00
rm_worki'm counting down from like, 6021:00
rm_workbefore i do it myself too21:01
rm_workcool xgerman_ got it :P21:01
xgerman_why do we need neutron?21:01
rm_workneutron-lbaas :P21:01
johnsomhttps://review.openstack.org/552985 and https://review.openstack.org/55298721:01
xgerman_we didn’t need it before21:02
rm_workjust an extension, we don't have our own service21:02
xgerman_ok…21:02
rm_workwe used to install it via this weird workaround21:02
johnsomOh, those didn't get fixed, hold up21:02
rm_workyeah AJaeger didn't get to all of them i think21:02
rm_workjust a couple21:02
openstackgerritMichael Johnson proposed openstack/neutron-lbaas-dashboard master: Remove tox_install  https://review.openstack.org/55298521:03
johnsomOk, yeah, he got https://review.openstack.org/#/c/552987/ so it is ready too21:03
AJaegerdid I forget to push this up;( sorry21:04
AJaegerxgerman_: le tme double check21:04
xgerman_ok21:04
*** yamamoto has joined #openstack-lbaas21:04
AJaegerxgerman_: https://review.openstack.org/#/c/552978/3/tools/tox_install.sh installed neutron21:05
AJaegerxgerman_: if you don't need it, we can remove...21:05
xgerman_no, no, we need it21:06
AJaegerxgerman_: I see lines like "from neutron.api import extensions", so expect you need it21:06
xgerman_yep21:06
AJaegerxgerman_: we just install it differently now21:06
xgerman_well,  doesn’t matter since we are not ina ctive development there but not pulling in neutron-libs/neutron from git makes patches break until they release soemthing21:07
AJaegerxgerman_: the change still pulls neutron from git21:08
*** rcernin has joined #openstack-lbaas21:08
xgerman_ok, sweet21:08
johnsomBasically the new zuul system clones the right versions for us without the need for zuul-cloner anymore21:08
AJaegerxgerman_: OpenStack CI with tox-siblings does that for you21:08
xgerman_ok, sounds good21:08
AJaegerjohnsom: indeed21:08
xgerman_just remember I had to wait forever for my patch to work in neutron-fwaas21:08
xgerman_sine the neutron-lib was always too old21:09
johnsomSounds like that repo wasn't setup right21:09
xgerman_well, that’sentirely possible21:09
*** yamamoto has quit IRC21:10
*** gcheresh has quit IRC21:12
AJaegerxgerman_: if it happesn again, let's discuss on #openstack-infra and check the setup...21:13
*** AJaeger has left #openstack-lbaas21:34
rm_workugh this gate stuff22:06
*** yamamoto has joined #openstack-lbaas22:06
rm_worktrying to clean up some stuff internally while i wait but impatience is still killing me :P22:07
*** yamamoto has quit IRC22:12
rm_workjohnsom: will you remove your -1 already on https://review.openstack.org/#/c/548991/ lol22:15
rm_workit keeps catching my eye when i'm scanning for comments22:16
johnsomhttps://review.openstack.org/55298722:22
rm_workdone22:27
rm_workaugh so much time remaining22:28
rm_worki have to afk for like an hour i think, in a few min, and this thing isn't going to merge before then22:29
rm_workcan someone recheck aaaaallll of the -1 zuul stuff22:29
rm_workonce it merges?22:29
openstackgerritMerged openstack/octavia-dashboard master: Remove tox_install  https://review.openstack.org/55298723:00
*** mangelm has quit IRC23:04
*** yamamoto has joined #openstack-lbaas23:07
*** yamamoto has quit IRC23:12
*** fnaval has quit IRC23:18
openstackgerritMerged openstack/neutron-lbaas master: Remove tox_install.sh  https://review.openstack.org/55297823:27

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!