Thursday, 2016-05-26

*** openstack has joined #openstack-lbaas00:05
openstackgerritPhillip Toohill proposed openstack/octavia: Allowing for a host amphora configuration  https://review.openstack.org/31723600:13
*** harlowja has joined #openstack-lbaas00:19
openstackgerritMerged openstack/octavia: Implement custom header support for Octavia  https://review.openstack.org/25790100:21
*** sbalukoff has quit IRC00:28
*** meghal has joined #openstack-lbaas00:30
*** sbalukoff has joined #openstack-lbaas00:39
*** chlong has quit IRC00:46
*** openstack has joined #openstack-lbaas00:57
*** meghal has quit IRC00:58
*** sbalukoff has joined #openstack-lbaas01:02
*** piet has quit IRC01:10
*** cody-somerville has quit IRC01:15
*** cody-somerville_ has quit IRC01:17
*** piet has joined #openstack-lbaas01:18
*** hockeynut has quit IRC01:21
*** hockeynut has joined #openstack-lbaas01:21
*** meghal has joined #openstack-lbaas01:24
*** piet has quit IRC01:31
*** kevo has quit IRC01:38
*** bana_k has quit IRC01:38
*** ducttape_ has joined #openstack-lbaas01:42
a2hillscenario no likey me01:46
*** openstackgerrit has quit IRC01:49
*** yamamot__ has joined #openstack-lbaas01:50
*** alhu has joined #openstack-lbaas01:52
*** cody-somerville has joined #openstack-lbaas01:53
*** cody-somerville has quit IRC01:53
*** cody-somerville has joined #openstack-lbaas01:53
a2hillblogan: is it because of timeouts on vm create that im seeing for scenario? Not sure the status of scenarios at this point01:55
bloganthe last test run i saw was on teh 18th which was before adam had his fix in for keystone v2/v3 changes, so all tests failed01:55
a2hilloh, but on mine it just ran i thought01:56
a2hillill dig some more01:56
a2hilli just resubmitted that patch not too long ago and looks like it failed01:56
*** ducttape_ has quit IRC01:57
*** openstackgerrit has joined #openstack-lbaas01:58
*** cody-somerville has quit IRC01:58
*** chlong has joined #openstack-lbaas01:59
*** yamamot__ has quit IRC02:05
*** crc32 has joined #openstack-lbaas02:07
*** cody-somerville_ has joined #openstack-lbaas02:07
*** bana_k has joined #openstack-lbaas02:35
*** openstack has joined #openstack-lbaas02:41
*** yuanying has quit IRC02:50
*** bana_k has quit IRC02:56
*** fnaval has quit IRC02:59
*** cody-somerville_ has quit IRC03:01
*** meghal has quit IRC03:13
*** fnaval has joined #openstack-lbaas03:13
*** crc32 has quit IRC03:14
*** fnaval_ has joined #openstack-lbaas03:15
*** meghal has joined #openstack-lbaas03:17
*** fnaval has quit IRC03:18
*** meghal has quit IRC03:21
*** meghal has joined #openstack-lbaas03:25
*** bana_k has joined #openstack-lbaas03:25
*** yuanying has joined #openstack-lbaas03:30
*** armax has quit IRC03:32
*** links has joined #openstack-lbaas03:34
*** cody-somerville_ has joined #openstack-lbaas03:40
*** fawadkhaliq has joined #openstack-lbaas03:42
*** ducttape_ has quit IRC03:43
*** yuanying has quit IRC03:45
*** piet has joined #openstack-lbaas03:46
*** yuanying has joined #openstack-lbaas03:47
*** ducttape_ has joined #openstack-lbaas03:54
*** fawadkhaliq has quit IRC03:56
*** piet has quit IRC04:03
*** ducttape_ has quit IRC04:07
*** bana_k has quit IRC04:13
*** alhu has quit IRC04:14
*** chlong has quit IRC04:15
*** chlong has joined #openstack-lbaas04:34
*** cody-somerville_ has quit IRC04:37
*** fnaval has joined #openstack-lbaas04:48
*** fnaval_ has quit IRC04:51
*** fawadkhaliq has joined #openstack-lbaas04:57
*** meghal has quit IRC05:06
*** ducttape_ has joined #openstack-lbaas05:08
*** ducttape_ has quit IRC05:12
*** mixos has quit IRC05:16
*** sbalukoff has quit IRC05:19
*** yamamot__ has joined #openstack-lbaas05:21
*** sbalukoff has joined #openstack-lbaas05:30
*** anilvenkata has joined #openstack-lbaas05:31
*** chlong has quit IRC05:47
*** rcernin has joined #openstack-lbaas05:54
*** chlong has joined #openstack-lbaas05:59
*** woodster_ has quit IRC06:08
*** ducttape_ has joined #openstack-lbaas06:09
*** bana_k has joined #openstack-lbaas06:12
*** kevo has joined #openstack-lbaas06:12
*** ducttape_ has quit IRC06:14
*** kevo has quit IRC06:14
*** kobis has joined #openstack-lbaas06:18
*** Alex_Stef has quit IRC06:18
*** numans has joined #openstack-lbaas06:31
*** openstack has joined #openstack-lbaas06:56
openstackgerritMerged openstack/octavia: Small cleanup of plugin.sh  https://review.openstack.org/32110806:58
*** ducttape_ has joined #openstack-lbaas07:10
*** ducttape_ has quit IRC07:14
*** bana_k has quit IRC07:30
openstackgerritValleriya Perelman proposed openstack/octavia: Fixed unit test for amphorae backend utils  https://review.openstack.org/32139807:45
*** Alex_Stef has joined #openstack-lbaas07:52
duvarenkovHi! Can I somehow get listener/loadbalancer id through neutron api from l7policy? This method https://github.com/openstack/python-neutronclient/blob/master/neutronclient/v2_0/client.py#L1005 passes the dict with all attributes of l7policy but according listener.08:02
*** chlong has quit IRC08:04
*** nokes has joined #openstack-lbaas08:06
*** nokes is now known as noshankus08:07
*** kodokuu has joined #openstack-lbaas08:10
*** ducttape_ has joined #openstack-lbaas08:10
kodokuuHi, anyone can tell me where in the code, lbaas create the port in OVS ?08:11
*** ihrachys has joined #openstack-lbaas08:12
*** ducttape_ has quit IRC08:15
*** dmk0202 has joined #openstack-lbaas08:23
openstackgerritEvgeny Fedoruk proposed openstack/neutron-lbaas: Fixing creation of shared pool  https://review.openstack.org/32141308:32
noshankusAnyone had issues connecting to ssh using lbaasv2? "ssh_exchange_identification: Connection closed by remote host" - works fine without lb if I add a floating IP on the host in the pool08:32
openstackgerritEvgeny Fedoruk proposed openstack/neutron-lbaas: Fixing creation of shared pool  https://review.openstack.org/32141308:36
noshankusBork! My sillyness... not to worry - solved09:00
*** tesseract has joined #openstack-lbaas09:02
kodokuuHi, anyone can tell me where in the code, lbaas create the port in OVS ?09:11
*** ducttape_ has joined #openstack-lbaas09:11
*** eezhova has joined #openstack-lbaas09:14
*** ducttape_ has quit IRC09:16
openstackgerritPhillip Toohill proposed openstack/octavia: Network driver should generate network configs  https://review.openstack.org/31707509:23
a2hillkodokuu: the devstack plugin within the octavia project should be what youre looking for.09:24
*** yamamot__ has quit IRC09:50
*** prabampm1 has joined #openstack-lbaas09:53
*** prabampm has quit IRC09:53
*** prabampm1 has quit IRC09:57
*** fawadkhaliq has quit IRC09:57
*** fawadkhaliq has joined #openstack-lbaas09:58
kodokuua2hill why devstack can help  me ?09:59
kodokuuI search the code in neutron_lbaas where the service add the port in OVS. for modify this section09:59
sbelouskodokuu: I think, a2hill meant this: https://github.com/openstack/octavia/blob/master/devstack/plugin.sh#L132 it's not what you need?10:06
kodokuuI use lbaasV110:08
kodokuuno octavia :/10:08
kodokuuand this code is where octavia add br-int10:09
kodokuuI need the code when lbaas add port for each LB (pool)10:09
kodokuuthe tap interface10:09
kodokuubecause I need to add a tag pot (vlan) on each TAP interface in my OVS10:10
kodokuu(vmware driver no support openvswitch agent)10:10
*** prabampm has joined #openstack-lbaas10:11
*** ducttape_ has joined #openstack-lbaas10:12
*** ducttape_ has quit IRC10:16
*** rtheis has joined #openstack-lbaas10:31
*** links has quit IRC11:08
openstackgerritAviv proposed openstack/octavia: TimeOutException is now reachable  https://review.openstack.org/31964411:10
*** eezhova has quit IRC11:12
*** ducttape_ has joined #openstack-lbaas11:13
kodokuusbelous do you have idea who can help me for that ?11:15
openstackgerritAviv proposed openstack/octavia: TimeOutException is now reachable  https://review.openstack.org/31964411:15
sbelouskodokuu: sorry, I don't know :( may be sbalukoff or dougwig11:17
*** ducttape_ has quit IRC11:18
*** eezhova has joined #openstack-lbaas11:21
openstackgerritAviv proposed openstack/octavia: TimeOutException is now reachable  https://review.openstack.org/31964411:22
openstackgerritValleriya Perelman proposed openstack/octavia: WIP: ACTIVE-ACTIVE Topology OVS-based Distributor Backend  https://review.openstack.org/32042211:35
openstackgerritValleriya Perelman proposed openstack/octavia: ACTIVE-ACTIVE Topology Initial Distributor Noop Driver  https://review.openstack.org/31300611:35
openstackgerritValleriya Perelman proposed openstack/octavia: WIP: ACTIVE-ACTIVE Topology OVS-based Distributor Driver  https://review.openstack.org/31762911:35
*** prabampm has quit IRC11:45
*** prabampm has joined #openstack-lbaas11:55
*** yamamoto has joined #openstack-lbaas11:56
*** ducttape_ has joined #openstack-lbaas12:06
*** piet has joined #openstack-lbaas12:14
*** eezhova has quit IRC12:15
*** piet has quit IRC12:27
*** yamamoto has quit IRC12:30
*** yamamoto has joined #openstack-lbaas12:30
*** ducttape_ has quit IRC12:37
*** piet has joined #openstack-lbaas12:39
*** matt-borland has joined #openstack-lbaas12:52
*** yamamoto has quit IRC12:52
*** piet has quit IRC12:53
*** yamamoto has joined #openstack-lbaas12:54
*** eezhova has joined #openstack-lbaas13:06
*** eezhova has quit IRC13:08
*** eezhova has joined #openstack-lbaas13:08
*** piet has joined #openstack-lbaas13:21
*** diogogmt has joined #openstack-lbaas13:23
*** yamamoto has quit IRC13:23
*** ducttape_ has joined #openstack-lbaas13:27
*** ducttape_ has quit IRC13:31
*** yamamoto has joined #openstack-lbaas13:33
*** yamamoto has quit IRC13:37
*** yamamoto has joined #openstack-lbaas13:40
*** diogogmt has quit IRC13:43
ajo_ping blogan dougwig : https://review.openstack.org/#/q/status:open+project:openstack/octavia+branch:master+topic:multinode-devstack  a series of patches I'm sending (just the start) to be able to make a multinode octavia controller13:46
ajo_with devstack13:46
kodokuusbelous I find my code https://github.com/openstack/neutron-lbaas/blob/master/neutron_lbaas/drivers/haproxy/namespace_driver.py#L27913:47
ajo_My intent is to make possible to deploy a set of X * [o-api, o-cw, o-hm, o-hk]13:47
ajo_and put a load balancer in front of the API's13:47
ajo_every node would have it's own port on the management network, of course,13:48
*** yamamoto has quit IRC13:50
*** prabampm has quit IRC13:52
*** Alex_Stef has quit IRC13:54
*** yamamoto has joined #openstack-lbaas14:04
*** ducttape_ has joined #openstack-lbaas14:05
*** mixos has joined #openstack-lbaas14:26
*** fnaval has quit IRC14:29
*** fnaval has joined #openstack-lbaas14:45
*** anilvenkata has quit IRC14:54
*** armax has joined #openstack-lbaas14:59
*** mixos has quit IRC15:00
*** dmk0202 has quit IRC15:04
*** piet has quit IRC15:13
*** TrevorV has joined #openstack-lbaas15:15
*** TrevorV has quit IRC15:15
*** TrevorV has joined #openstack-lbaas15:16
*** rcernin has quit IRC15:19
xgermanajo_ good stuff…15:25
*** tesseract has quit IRC15:34
ajo_hi xgerman  :)15:35
ajo_thanks, I hope my patches don't look crazy, does my plan seem sane ?15:35
ajo_xgerman, specifically:15:36
ajo_[15:47]  <ajo_> My intent is to make possible to deploy a set of X * [o-api, o-cw, o-hm, o-hk]15:36
ajo_[15:47]  <ajo_> and put a load balancer in front of the API's15:36
johnsomI have posted comments on both15:36
*** piet has joined #openstack-lbaas15:36
ajo_hi johnsom thanks :)15:36
xgermanyeah, I think your plan sounds sane ;-)15:36
johnsomThat will work.  Just make sure the LB you put in front of the API has appropriate timeouts to not cut the connection too early.15:36
johnsomI have seen people have that problem15:37
ajo_johnsom, we need the pregenerated, because we need them to be equal across all the controller nodes15:37
*** eezhova has quit IRC15:37
ajo_johnsom, and devstack is not very good at synchronizing that stuff across nodes15:37
*** eezhova has joined #openstack-lbaas15:38
ajo_johnsom, it's just for development, so it should not be harmful or risky, think if vagrant, they require an insecure key on the boxes (or vagrant/vagrant user/pass) for it to work15:38
ajo_then they replace the key afterwards but..15:38
ajo_I don't know15:38
openstackgerritTrevor Vardeman proposed openstack/neutron-lbaas: Add Health Monitor Max Retries Down  https://review.openstack.org/30608415:38
ajo_johnsom, may be we can start with this, and move into something more elaborated later, I just need something to sync the ssh key across all controller nodes without fiddling with ansible15:39
ajo_xgerman: thanks for the confirmation,15:39
ajo_johnsom, thanks for the LB details advice, we will review that when I have it ready15:40
*** diogogmt has joined #openstack-lbaas15:41
*** kobis has quit IRC15:44
*** minwang2 has joined #openstack-lbaas15:45
*** mixos has joined #openstack-lbaas15:51
*** perelman has quit IRC15:52
*** bana_k has joined #openstack-lbaas15:53
*** eezhova has quit IRC15:59
*** perelman has joined #openstack-lbaas16:02
*** piet has quit IRC16:08
*** meghal has joined #openstack-lbaas16:11
*** meghal1 has joined #openstack-lbaas16:12
*** meghal has quit IRC16:16
*** minwang2 has quit IRC16:18
*** cody-somerville has joined #openstack-lbaas16:22
*** madhu_ak has joined #openstack-lbaas16:23
TrevorVhey johnsom you around?16:25
johnsomTrevorV Pong16:27
*** numans has quit IRC16:28
TrevorVHey so I still have that one bug assigned to myself for the initial create heartbeat.  Is that still a valid concern?16:28
johnsomAh, yes.  I think we left it because it was causing the gates to failover during tests16:29
TrevorVRight, it caused failovers too quickly16:29
TrevorVSo did someone else up and fix it with some other changes we have, or is it still a valid concern?16:29
johnsomIt is still open to my knowledge16:30
TrevorVAlright, then I'm going to put some time on that this/next week16:30
johnsomOk, sounds good16:30
TrevorVI just hope I can fully commit to it, I am moving this weekend to a new place in SA.  o_016:32
johnsomOh cool.  Congratulations!  (I assume)16:33
TrevorVThanks!  (Just more renting, nothing major :D  )16:33
*** noshankus has quit IRC16:34
*** bana_k has quit IRC16:35
*** ajmiller__ has quit IRC16:39
*** perelman has quit IRC16:44
*** ajmiller has joined #openstack-lbaas16:48
*** ducttape_ has quit IRC16:54
*** cody-somerville has quit IRC16:54
*** cody-somerville has joined #openstack-lbaas16:55
*** cody-somerville has joined #openstack-lbaas16:55
*** ducttape_ has joined #openstack-lbaas16:56
*** bana_k has joined #openstack-lbaas16:59
*** minwang2 has joined #openstack-lbaas17:00
*** ducttape_ has quit IRC17:01
*** ducttape_ has joined #openstack-lbaas17:01
*** ducttape_ has quit IRC17:03
*** ajmiller_ has joined #openstack-lbaas17:03
*** ducttape_ has joined #openstack-lbaas17:04
*** mixos has quit IRC17:04
*** fawadkhaliq has quit IRC17:07
*** ajmiller has quit IRC17:07
*** numans has joined #openstack-lbaas17:09
*** mixos has joined #openstack-lbaas17:10
*** fawadkhaliq has joined #openstack-lbaas17:27
*** bana_k has quit IRC17:28
*** bana_k has joined #openstack-lbaas17:38
*** SumitNaiksatam has joined #openstack-lbaas17:41
*** meghal1 has quit IRC18:04
*** ihrachys has quit IRC18:12
*** kodokuu has quit IRC18:22
openstackgerritPhillip Toohill proposed openstack/octavia: Allowing for a host amphora configuration  https://review.openstack.org/31723618:25
*** ducttape_ has quit IRC18:43
*** madhu_ak has quit IRC18:48
*** ducttape_ has joined #openstack-lbaas18:50
*** ducttape_ has quit IRC18:55
*** ducttape_ has joined #openstack-lbaas18:56
*** ducttape_ has quit IRC18:57
*** ducttape_ has joined #openstack-lbaas18:58
*** meghal has joined #openstack-lbaas19:10
*** fawadkhaliq has quit IRC19:16
*** ducttape_ has quit IRC19:35
*** crc32 has joined #openstack-lbaas19:36
*** ducttape_ has joined #openstack-lbaas19:42
*** ducttape_ has quit IRC19:45
*** ihrachys has joined #openstack-lbaas19:57
*** minwang2 has quit IRC20:03
*** kevo has joined #openstack-lbaas20:29
*** woodster_ has joined #openstack-lbaas20:40
*** numans has quit IRC20:41
*** minwang2 has joined #openstack-lbaas20:48
*** rtheis has quit IRC20:56
*** diogogmt has quit IRC20:58
*** meghal1 has joined #openstack-lbaas21:03
*** diogogmt has joined #openstack-lbaas21:05
*** meghal has quit IRC21:06
*** meghal has joined #openstack-lbaas21:16
*** meghal1 has quit IRC21:20
openstackgerritLingxian Kong proposed openstack/octavia: Add timestamp to octavia resources  https://review.openstack.org/30925321:43
*** matt-borland has quit IRC21:58
*** meghal has quit IRC21:59
*** meghal has joined #openstack-lbaas22:00
*** amotoki has joined #openstack-lbaas22:02
*** armax_ has joined #openstack-lbaas22:12
*** armax has quit IRC22:13
*** armax_ is now known as armax22:13
*** cody-somerville has quit IRC22:18
*** mixos has quit IRC22:18
*** diogogmt has quit IRC22:23
*** diogogmt has joined #openstack-lbaas22:35
*** ducttape_ has joined #openstack-lbaas22:42
*** ducttape_ has quit IRC22:44
*** ducttape_ has joined #openstack-lbaas22:48
*** crc32 has quit IRC22:52
*** TrevorV has quit IRC22:54
kevoHi, bringing up octavia up on a non-devstack environment.  When I create a load balancer, it would fail to plug the vip and return NotFound: Not Found Error. And from the upstart/amphora-agent log it’s returning 192.168.0.3 - - [26/May/2016 22:45:55] "POST /0.5/plug/vip/10.200.0.120 HTTP/1.1" 404 -. Any ideas what could be the issue?22:54
blogankevo: seeing this error in the gate sometimes, not sure what ti is22:55
kevoblogan: Oh, ok. Is it just sometimes? I'm getting it all the time.22:58
johnsomNot Found is usually a later error from the revert calls.22:59
johnsomThere should be the true error higher in the log that is not part of a revert22:59
kevojohnsom: Are you talking about the octavia-controller or the amphora-agent?23:02
johnsomcontroller23:02
kevoi don't see any error message before that23:03
kevohere is the controller log23:03
kevohttps://gist.github.com/KevoTran/61b42936506465f08ad2775f3af0c87d23:03
johnsomkevo Can you paste your full controller log into a gist?23:03
johnsomAh, thanks, looking23:03
johnsomkevo this line is the key error:23:05
johnsom2016-05-26 22:45:56.673 32561 WARNING octavia.controller.worker.controller_worker [-] Task 'octavia.controller.worker.tasks.amphora_driver_tasks.AmphoraPostVIPPlug' (0cdf3464-aeb6-47ce-82cf-cb37c7289363) transitioned into state 'FAILURE' from state 'RUNNING'23:05
johnsomThis means the controller was unable to connect to the agent REST port on the amphora23:05
johnsomThis could be that the amphora didn't boot correctly, or the management network is not working right, etc.23:06
kevoI am able to ssh to the amp from mgmgt n.w and I am able to do a curl for info n all23:07
a2hillits been doing that same error in the scenarios for the gate on the latest patches23:07
johnsomMy guess would be there is a networking issue between the controller and the amphora23:07
kevoactually my amphora-agent log also has some error23:08
kevohttps://gist.github.com/KevoTran/5b26d8829a20b80f00edbb00763609f923:08
kevojohnsom,  It first gets an 202 and then broken pipe n then leads to a 40423:09
johnsomOk, yes, I have seen this.  The controller settings are too low for your hardware.23:09
johnsomJust a second, I will send you the settings I think you need to increase23:09
a2hillcan we make these same adjustments for the gates?23:11
johnsoma2hill rm_work was pushing back on some of those changes23:11
a2hillah, rm_work around? Is there a patch or anything johnsom ?23:12
johnsomkevo These two in octavia.conf23:12
johnsom# rest_request_conn_timeout = 1023:12
johnsom# rest_request_read_timeout = 6023:12
johnsoma2hill yeah, just a second23:12
kevoJohnson, I'll try that out and I'll let you know. Thanks23:13
johnsoma2hill https://review.openstack.org/#/c/305512/23:13
a2hillThanks johnsom @23:13
johnsomNeeds rebased for the other fixes we have done for session23:13
a2hill!23:13
*** ducttape_ has quit IRC23:14
kevoJohnson: Should i increase those values? Or that default is fine?23:15
johnsomkevo I think you need to increase those values23:15
*** ducttape_ has joined #openstack-lbaas23:15
*** ducttape_ has quit IRC23:16
*** ducttape_ has joined #openstack-lbaas23:16
johnsoma2hill If you are inspired to play with this, please feel free to update the patch, etc.23:17
*** ihrachys has quit IRC23:20
*** ihrachys has joined #openstack-lbaas23:21
*** meghal has quit IRC23:23
*** ihrachys has quit IRC23:25
a2hillI may have to in order to get required stuff merged. Think im calling it a day on that note though ;)23:26
*** meghal has joined #openstack-lbaas23:31
*** meghal has quit IRC23:41

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!