Monday, 2019-03-25

*** luksky has quit IRC00:02
johnsomAh, I was looking at mis matched, not non existent. So, yeah, will take a look tomorrow00:03
*** sapd1_x has quit IRC00:12
*** hongbin has joined #openstack-lbaas01:05
*** psachin has joined #openstack-lbaas01:57
*** Dinesh_Bhor has quit IRC02:07
*** ricolin has joined #openstack-lbaas02:26
openstackgerritpengyuesheng proposed openstack/neutron-lbaas-dashboard master: Prompt error when timeout is greater than interval  https://review.openstack.org/62147702:51
*** hongbin_ has joined #openstack-lbaas03:21
*** hongbin has quit IRC03:23
*** hongbin_ has quit IRC03:59
openstackgerritMerged openstack/octavia master: Make sure the expected codes list is sorted  https://review.openstack.org/64536304:12
*** ramishra has joined #openstack-lbaas04:35
openstackgerritMerged openstack/neutron-lbaas master: neutron-lbaas haproxy agent prevent vif unplug when failover occurs  https://review.openstack.org/57896605:39
openstackgerritMerged openstack/neutron-lbaas master: Feature correction: L7Policy/Rule for A10Networks  https://review.openstack.org/63957105:39
*** yamamoto has quit IRC06:24
*** ivve has joined #openstack-lbaas06:37
*** sapd1 has quit IRC06:44
*** pcaruana has joined #openstack-lbaas07:07
*** ramishra_ has joined #openstack-lbaas07:07
*** ramishra has quit IRC07:09
*** sapd1_x has joined #openstack-lbaas07:10
*** yamamoto has joined #openstack-lbaas07:14
*** velizarx has joined #openstack-lbaas07:18
*** sapd1_x has quit IRC07:25
*** numans_ has joined #openstack-lbaas07:31
*** gthiemonge has joined #openstack-lbaas07:32
*** oanson has joined #openstack-lbaas07:37
*** velizarx has quit IRC07:46
*** velizarx has joined #openstack-lbaas07:50
*** gcheresh has joined #openstack-lbaas07:56
*** yamamoto has quit IRC07:56
*** yamamoto has joined #openstack-lbaas08:00
*** yamamoto has quit IRC08:02
*** yamamoto has joined #openstack-lbaas08:03
*** luksky has joined #openstack-lbaas08:18
*** rpittau|afk is now known as rpittau08:22
*** velizarx has quit IRC08:25
*** velizarx has joined #openstack-lbaas08:29
*** Dinesh_Bhor has joined #openstack-lbaas08:40
*** velizarx has quit IRC08:41
*** velizarx has joined #openstack-lbaas08:47
*** ramishra_ is now known as ramishra08:49
*** yamamoto has quit IRC08:56
*** ivve has quit IRC09:10
*** ccamposr has joined #openstack-lbaas09:19
*** yamamoto has joined #openstack-lbaas09:23
*** yamamoto has quit IRC09:30
*** yamamoto has joined #openstack-lbaas09:41
*** yamamoto has quit IRC09:45
*** ivve has joined #openstack-lbaas09:52
openstackgerritCarlos Goncalves proposed openstack/octavia stable/rocky: DNM: Gate check  https://review.openstack.org/62800710:17
*** ivve has quit IRC10:21
*** yamamoto has joined #openstack-lbaas10:24
*** yamamoto has quit IRC10:29
openstackgerritCarlos Goncalves proposed openstack/octavia stable/queens: Slightly reorder member flows  https://review.openstack.org/64738110:30
*** yamamoto has joined #openstack-lbaas10:36
*** trident has quit IRC10:43
*** yamamoto has quit IRC10:47
*** yamamoto has joined #openstack-lbaas10:48
*** ivve has joined #openstack-lbaas10:50
*** trident has joined #openstack-lbaas11:08
*** psachin has quit IRC11:16
*** ivve has quit IRC11:19
*** sapd1_x has joined #openstack-lbaas11:22
*** rcernin has quit IRC11:31
*** henriqueof has quit IRC11:38
*** luksky has quit IRC11:39
*** amuller has joined #openstack-lbaas11:49
*** yamamoto has quit IRC11:52
openstackgerritAnn Taraday proposed openstack/octavia master: [WIP]PoC Octavia taskflow persistence  https://review.openstack.org/64740611:59
*** ramishra has quit IRC12:08
*** ramishra has joined #openstack-lbaas12:13
*** luksky has joined #openstack-lbaas12:15
*** yamamoto has joined #openstack-lbaas12:21
*** trown|outtypewww is now known as trown12:22
*** velizarx has quit IRC12:25
*** velizarx has joined #openstack-lbaas12:25
*** logan- has quit IRC12:27
*** logan- has joined #openstack-lbaas12:31
*** ricolin has quit IRC12:37
*** gcheresh has quit IRC12:42
*** gcheresh has joined #openstack-lbaas12:42
*** henriqueof has joined #openstack-lbaas12:42
*** velizarx has quit IRC12:58
*** velizarx has joined #openstack-lbaas12:59
*** ivve has joined #openstack-lbaas13:15
*** trident has quit IRC13:27
*** irclogbot_0 has joined #openstack-lbaas13:28
*** trident has joined #openstack-lbaas13:29
*** altlogbot_0 has quit IRC13:31
*** altlogbot_2 has joined #openstack-lbaas13:32
*** irclogbot_0 has quit IRC13:38
*** irclogbot_0 has joined #openstack-lbaas13:39
*** ivve has quit IRC14:11
*** ivve has joined #openstack-lbaas14:23
*** fnaval has joined #openstack-lbaas14:55
*** yboaron has joined #openstack-lbaas15:06
*** sapd1_x has quit IRC15:13
*** fnaval has quit IRC15:19
*** fnaval_ has joined #openstack-lbaas15:19
cgoncalvesstable/rocky grenade job is driving me nuts! I simply can't reproduce the issue seeing in Zuul locally, neither running grenade or manually15:52
cgoncalveseth2 is configured properly in amphora-haproxy netns15:52
johnsomTrade you the multi-node job15:54
cgoncalvesoctavia-v2-dsvm-scenario-two-nodeSUCCESS in 1h 49m 51s (non-voting)15:56
cgoncalveswhat about it?15:56
johnsomIt fails when it tries to do IPv6 to the secondary node. The randomness is if the traffic test lands on the secondary15:57
johnsomUnless it's magically fixed. (I was pretty sure it was a neutron bug, just didn't get it isolated yet)15:57
cgoncalvescrazy idea: let's disable secondary. we get both jobs passing. deal? :D15:58
*** yboaron has quit IRC15:58
johnsomlol, I was going to say "no trade if it's fixed"15:58
*** gcheresh has quit IRC16:05
cgoncalvesI'm tempted to ask infra team to allocate a node for testing16:06
johnsomWell, let me look at it today. I will do that after I get a stack running and look at Kong's issue from yesterday.16:07
cgoncalvesthank you! I'll continue looking around though16:13
johnsom+116:14
*** trown is now known as trown|lunch16:14
*** ricolin has joined #openstack-lbaas16:18
*** luksky has quit IRC16:23
*** ricolin has quit IRC16:24
*** ivve has quit IRC16:26
*** yamamoto has quit IRC16:30
*** gcheresh has joined #openstack-lbaas16:31
*** yamamoto has joined #openstack-lbaas16:32
*** ramishra has quit IRC16:43
*** AlexStaf has quit IRC17:06
*** AlexStaf has joined #openstack-lbaas17:06
*** rpittau is now known as rpittau|afk17:22
*** trown|lunch is now known as trown17:25
*** ccamposr has quit IRC17:36
*** yamamoto has quit IRC17:39
*** ivve has joined #openstack-lbaas17:48
*** mmdurrant has joined #openstack-lbaas18:07
mmdurrantI have a question I cannot answer looking @ code.18:07
mmdurrantWhere do project ids for amphorae get specified in the tasks/workflow ? I'm trying to find out where the project ID from my API command gets set in the instance/LB being created and ... it's a mystery18:08
johnsommmdurrant The amphora are owned but the service, not the user, so they get created under the account specified in the "service_auth" section of the octavia.conf.  This section is picked up by the OpenStack clients here: https://github.com/openstack/octavia/blob/master/octavia/common/keystone.py#L3718:11
*** yamamoto has joined #openstack-lbaas18:18
mmdurrantAHHHHHHHHHHHHHHHH18:19
mmdurrantThank you!18:19
*** gthiemonge has quit IRC18:24
*** yamamoto has quit IRC18:25
*** luksky has joined #openstack-lbaas18:26
*** AlexStaf has quit IRC18:36
*** AlexStaf has joined #openstack-lbaas18:36
*** ivve has quit IRC18:57
*** gcheresh has quit IRC18:58
*** velizarx has quit IRC19:01
*** yamamoto has joined #openstack-lbaas19:17
*** yamamoto has quit IRC19:23
*** abaindur has joined #openstack-lbaas19:30
*** abaindur has quit IRC19:32
*** abaindur has joined #openstack-lbaas19:32
*** amuller has quit IRC19:40
*** abaindur has quit IRC19:55
*** abaindur has joined #openstack-lbaas20:04
johnsomcgoncalves Yeah, this is a good one....20:12
*** pcaruana has quit IRC20:23
openstackgerritMichael Johnson proposed openstack/octavia stable/rocky: DNM: Gate check  https://review.openstack.org/62800720:29
*** abaindur has quit IRC20:36
*** abaindur has joined #openstack-lbaas20:39
abainduris there a recommendation of ubuntu vs centos for the amphora image? or does it not matter?20:43
johnsomIt is pretty much up to you.20:47
*** abaindur has quit IRC20:53
*** abaindur has joined #openstack-lbaas20:55
*** abaindur has quit IRC21:02
*** trown is now known as trown|outtypewww21:04
*** yamamoto has joined #openstack-lbaas21:06
*** abaindur has joined #openstack-lbaas21:08
*** yamamoto has quit IRC21:11
*** abaindur has quit IRC21:15
colin-do most of you operate your amp fleets on unbuntu? just curious21:32
colin-i do for now21:32
colin-until a compelling reason not to presents itself :)21:32
openstackgerritMichael Johnson proposed openstack/octavia stable/rocky: DNM: Gate check  https://review.openstack.org/62800721:38
openstackgerritCarlos Goncalves proposed openstack/octavia stable/rocky: DNM: Gate check  https://review.openstack.org/62800721:39
*** yamamoto has joined #openstack-lbaas21:39
cgoncalvesooops! we both edited at the same time21:39
openstackgerritCarlos Goncalves proposed openstack/octavia stable/rocky: DNM: Gate check  https://review.openstack.org/62800721:40
johnsomlol21:40
johnsomI'm just full of typos today21:40
johnsomProbably should not be doing two patches at the same time....21:41
cgoncalvesheh21:42
cgoncalvesdid you try running grenade locally? any suspicious about what it could be?21:42
johnsomI tried out the scenario, including five different image combinations.  Couldn't get it to fail21:43
johnsomIt's using the queens image BTW, which I think we are testing rocky->stein here21:44
*** velizarx has joined #openstack-lbaas21:44
johnsomBut it didn't matter, the queens image passed as well21:44
*** yamamoto has quit IRC21:45
*** abaindur has joined #openstack-lbaas22:06
*** abaindur has quit IRC22:08
lxkongjohnsom: hi, could anyone from the team help us to fix this issue https://storyboard.openstack.org/#!/story/2004283 if it's an easy one? I'm too busy with the customer support(k8s stuff) recently, otherwise i could definitely raise my hand.22:08
*** abaindur has joined #openstack-lbaas22:08
johnsomlxkong I'm already working on that22:09
lxkongjohnsom: great, thanks a lot, and do you think it could be backported?22:09
*** velizarx has quit IRC22:09
johnsomYes. I'm still struggling to reproduce it, but I get the issue.  What version are you running on?22:10
lxkong1 sec22:10
lxkonghttp://paste.openstack.org/show/748342/22:11
lxkongmy testing was based on this devstack env22:11
johnsomOk22:11
*** rcernin has joined #openstack-lbaas22:14
*** ivve has joined #openstack-lbaas22:25
openstackgerritMichael Johnson proposed openstack/python-octaviaclient master: Make sure we always requests JSON responses  https://review.openstack.org/64762822:27
johnsomlxkong Try this: https://review.openstack.org/64762822:27
* lxkong is replacing the code in his devstack22:28
lxkongjohnsom: should the `{'Content-Type': 'application/json'}` be `{'Accept': 'application/json'}`?22:37
lxkongi can still see the exception with that patch22:37
johnsomThat actually is probably the case yes22:38
* lxkong is trying Accept22:38
lxkongAccept works22:39
lxkonghttps://www.irccloud.com/pastebin/lQrOPgLG/22:39
johnsomCool, I will fix the patch22:39
openstackgerritMichael Johnson proposed openstack/python-octaviaclient master: Make sure we always requests JSON responses  https://review.openstack.org/64762822:40
lxkongjohnsom: but i don't know why the client is trying to get `faultstring` instead of `description`?22:41
lxkongapprently this error object doesn't have faultstring22:41
johnsomYeah, that is odd, they all should have faultstring22:41
lxkongjohnsom: could you please hold that patch for a little bit? i need to do an integration test with Heat.22:43
johnsomSure22:43
lxkongthat's the scenario where the issue was found22:43
*** yamamoto has joined #openstack-lbaas22:57
johnsomcgoncalves Well, I think I see a race condition. I had seen this randomly and not understood it.23:01
johnsomBasically when the netns systemd service was added, it's unordered, so it can start after the agent has started. The agent is in the middle of setting up the netns/interface files and the systemd service comes along and ALSO tries...23:02
*** yamamoto has quit IRC23:04
openstackgerritMichael Johnson proposed openstack/octavia master: Fix a systemd race condition in the amphora  https://review.openstack.org/64763223:11
openstackgerritMichael Johnson proposed openstack/octavia stable/rocky: DNM: Gate check  https://review.openstack.org/62800723:13
colin-what's the observed behavior with the amp race condition when that starts in the wrong order?23:17
colin-just curious if i'm encountering it23:17
johnsomcolin- Amphora agent returned unexpected result code 500 with response {u'message': u'Error plugging network', u'details': u'RTNETLINK answers: File exists\nFailed to bring up eth2.\n'}23:19
colin-thx23:21
*** fnaval_ has quit IRC23:22
*** fnaval has joined #openstack-lbaas23:42
*** fnaval has quit IRC23:42
*** fnaval has joined #openstack-lbaas23:47
*** fnaval has quit IRC23:48

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!