Wednesday, 2016-04-27

bogdan_could it be a problem that my amphora network was created by admin user but octavia is configured to run with octavia user?00:17
*** fnaval has quit IRC00:28
*** armax has quit IRC00:34
*** bogdan_ has quit IRC00:37
*** woodster_ has quit IRC00:38
*** diogogmt has joined #openstack-lbaas00:40
*** kevo has quit IRC00:57
*** kobis has quit IRC01:10
*** kobis has joined #openstack-lbaas01:10
*** harlowja has joined #openstack-lbaas01:22
*** Alex_Stef has quit IRC01:34
*** Alex_Stef has joined #openstack-lbaas01:39
*** amit213 has joined #openstack-lbaas01:42
openstackgerritAishwarya Thangappa proposed openstack/octavia: Adds a new feature to limit the amphora build rate  https://review.openstack.org/30330401:50
*** jaff_cheng has joined #openstack-lbaas01:57
*** harlowja has quit IRC02:39
*** bana_k has joined #openstack-lbaas02:41
bharathmbogdan_: Make sure you have a route between the network octavia worker is running on and octavia management network (typically neutron provider network)03:00
bharathmYou can use bind_host option in octavia.conf to make sure octavia runs on the desired interface03:01
*** kobis has quit IRC03:11
*** armax has joined #openstack-lbaas03:15
*** kobis has joined #openstack-lbaas03:27
*** fawadkhaliq has joined #openstack-lbaas03:27
*** fawadkhaliq has quit IRC03:32
*** links has joined #openstack-lbaas03:36
*** alhu has joined #openstack-lbaas03:42
*** armax has quit IRC05:05
*** bana_k has quit IRC05:15
*** bana_k has joined #openstack-lbaas05:16
*** prabampm has joined #openstack-lbaas05:27
*** cody-somerville has joined #openstack-lbaas05:29
*** eranra has quit IRC05:29
*** fnaval has joined #openstack-lbaas05:45
*** numans has joined #openstack-lbaas05:48
*** bana_k has quit IRC05:51
*** sbalukoff has joined #openstack-lbaas06:17
*** Alex_Stef has quit IRC06:25
*** Alex_Stef has joined #openstack-lbaas06:38
*** madhu_ak has quit IRC06:40
*** amitry has quit IRC06:52
*** basilAB has quit IRC06:52
*** basilAB has joined #openstack-lbaas06:54
*** amitry has joined #openstack-lbaas06:54
*** banszmar has quit IRC06:56
*** afranc has quit IRC06:57
*** xgerman has quit IRC06:58
*** basilAB has quit IRC06:59
*** ctracey has quit IRC06:59
*** basilAB has joined #openstack-lbaas07:01
*** alhu has quit IRC07:02
*** ctracey has joined #openstack-lbaas07:02
*** xgerman has joined #openstack-lbaas07:03
*** sbalukoff has quit IRC07:05
*** alhu has joined #openstack-lbaas07:05
*** sbalukoff has joined #openstack-lbaas07:06
*** afranc has joined #openstack-lbaas07:08
*** afranc has quit IRC07:13
*** anilvenkata has joined #openstack-lbaas07:14
*** banszmar has joined #openstack-lbaas07:24
*** afranc has joined #openstack-lbaas07:24
*** eranra has joined #openstack-lbaas07:29
jaff_chengHi,all,I have a question08:00
jaff_chengHi,all,I have a question about lbaasv2 dashboard08:00
jaff_chengI noticed that I can't input some arguments from dashboard like connection_limit and session_persistent.08:02
jaff_chengAre they hidden intentionally or not yet done?08:05
*** bogdan has joined #openstack-lbaas08:25
*** numans has quit IRC08:28
*** numans has joined #openstack-lbaas08:30
bogdanbharathm, you there?08:38
bogdanyou said "Make sure you have a route between the network octavia worker is running on and octavia management network (typically neutron provider network)"08:38
bogdanby what means should I create a route? Neutron router?08:39
*** bana_k has joined #openstack-lbaas08:55
*** bana_k has quit IRC09:05
*** Alex_Stef has quit IRC09:13
*** Alex_Stef has joined #openstack-lbaas09:14
kongbogdan: IIUC, if octavia worker is running on network node, it can talk with amphora vms in management network.09:18
*** numans has quit IRC09:34
*** numans has joined #openstack-lbaas09:47
bogdanwhy would the octavia management network typically be the neutron provider network? - that would mean that each amphora will consume an IP from my provider network09:56
bogdankong, my octavia worker is installed on the same host as neutron (and all the rest of the openstack services) but the amphora is in a private subnet, how should I provide routing between the two? I have a router that connects the private subnet and the external network in Neutron09:57
bogdanmy so called "LB network" is a regular neutron private network (created with neutron commands) which has a router to the provider network, where my octavia worker is installed10:00
kongbogdan: all the private network in neutron have their gateway in network node(I'm not sure if it's still right in DVR scenario), so if your octavia worker running on that node, it can talk directly with amphora vms.10:10
bogdankong, how can I troubleshoot this?10:10
kongbogdan: you could try ping the amphora management ip in your network node10:11
bogdanip netns exec  .. wget from the worker host I can reach the amphora, but worker rest driver cannot reach - it says timeout10:11
kongbogdan: that's my understanding, I hope I'm right :-)10:11
bogdankong, yes, I am pinging, ssh-ing, http-ing the amphora from my worker/neutron host10:12
kongyes, you will see many timout logs for the worker10:12
bogdanbut the rest driver code for whatever reason times out10:12
kongbogdan:  can you show me your log?10:13
bogdanbut I can do these only via the proper namespace, not directly10:13
bogdanChanged the worker code to log exception:10:14
bogdanexcept (requests.ConnectionError, requests.Timeout) as ex:     LOG.exception(ex)10:14
bogdanin octavia/amphorae/drivers/haproxy/rest_api_driver.py10:14
kongbogdan: you can use http://paste.openstack.org/10:14
bogdanwas getting 2016-04-27 01:24:26.329 19614 ERROR octavia.amphorae.drivers.haproxy.rest_api_driver ConnectionError: HTTPSConnectionPool(host='10.1.0.6', port=9443): Max retries exceeded with url: /0.5/plug/vip/192.168.1.17 (Caused by ProxyError('Cannot connect to proxy.', error('Tunnel connection failed: 403 Forbidden',)))10:14
bogdanbecause I am in a proxied environment10:14
bogdanafter fixing the3 no_proxy env var I started getting the timeout10:15
bogdanConnectTimeout: HTTPSConnectionPool(host='10.1.0.8', port=9443): Max retries exceeded with url: /0.5/plug/vip/192.168.1.25 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f69f2ab8150>, 'Connection to 10.1.0.8 timed out. (connect timeout=10.0)'))10:15
bogdanok here is the story in http://paste.openstack.org/show/495492/10:16
bogdanbtw, I had to re-create the lb after fixing the no_proxy env var, that is why the IPs are different in the log out there10:17
*** numans has quit IRC10:19
kongbogdan: sorry, I've no idea about your question :-(10:21
kongi also want to know the anwer10:25
bogdankong, in the docs I see "This is the subnet that controllers will use to communicate with amphorae. This means that controllers must have connectivity (either layer 2 or routed) to this subnet in order to function, and visa versa. Since amphorae will be communicating on it, this means the network is not part of the “undercloud.”"10:26
bogdanI am not sure how to read this  - "must have connectivity (either layer 2 or routed)", any idea how should I configure this routing?10:26
kongbogdan: actually, I just installed octavia using devstack in all-in-one mode10:27
bogdanok10:27
kongand my knowledge about that is got from the installation script10:27
bogdanok, maybe I have an eye on the install script, where is it?10:28
kongbogdan: https://github.com/openstack/octavia/blob/master/devstack/plugin.sh10:28
bogdanok, let me check what it does10:28
*** numans has joined #openstack-lbaas10:31
*** jaff_cheng has quit IRC10:32
*** alhu has quit IRC10:51
*** rcernin has joined #openstack-lbaas10:53
bogdanin the octavia.conf I see # Nova parameters to use when booting amphora ... # amp_ssh_key_name = which I believe is the name of the keypair in nova, while in the devstack/plugin.sh I see ssh-gen  used and iniset $OCTAVIA_CONF controller_worker amp_ssh_key_name ${OCTAVIA_AMP_SSH_KEY_NAME}11:02
bogdanso which of the two is correct?11:02
bogdanalso in devstack I see  iniset $OCTAVIA_CONF haproxy_amphora key_path ${OCTAVIA_AMP_SSH_KEY_PATH} while there is no such parameter in octavia.conf example or in docs11:03
bogdanshall I set this?11:03
bogdanok I saw the answer nova keypair-add --pub-key ${OCTAVIA_AMP_SSH_KEY_PATH}.pub ${OCTAVIA_AMP_SSH_KEY_NAME}11:27
*** diogogmt has quit IRC11:31
*** diogogmt has joined #openstack-lbaas11:35
*** diogogmt has quit IRC11:41
*** diogogmt has joined #openstack-lbaas11:44
*** ducttape_ has joined #openstack-lbaas11:51
*** ducttape_ has quit IRC11:56
*** yamamoto has joined #openstack-lbaas12:15
*** eranra has quit IRC12:23
*** links has quit IRC12:33
*** Alex_Stef has quit IRC12:37
*** Alex_Stef has joined #openstack-lbaas12:39
*** alhu has joined #openstack-lbaas12:41
*** alhu has quit IRC12:44
*** armax has joined #openstack-lbaas12:50
*** alhu has joined #openstack-lbaas12:59
*** alhu has quit IRC13:01
*** bogdan has quit IRC13:05
*** jaff_cheng has joined #openstack-lbaas13:18
*** kobis has quit IRC13:20
*** yamamoto has quit IRC13:24
*** sbalukoff has quit IRC13:33
*** alhu has joined #openstack-lbaas13:39
*** diogogmt has quit IRC13:40
*** alhu has quit IRC13:41
*** armax has quit IRC13:56
*** links has joined #openstack-lbaas13:59
*** amotoki has joined #openstack-lbaas14:03
*** sbalukoff has joined #openstack-lbaas14:05
*** amotoki has quit IRC14:08
*** mixos has joined #openstack-lbaas14:08
*** minwang2 has joined #openstack-lbaas14:09
*** kobis has joined #openstack-lbaas14:13
*** amotoki has joined #openstack-lbaas14:18
*** links has quit IRC14:18
openstackgerritElena Ezhova proposed openstack/neutron-lbaas: Validate that subnet exists before adding member to pool  https://review.openstack.org/31049014:26
*** ajmiller__ has joined #openstack-lbaas14:29
*** ducttape_ has joined #openstack-lbaas14:31
*** ajmiller_ has quit IRC14:33
*** kbyrne has joined #openstack-lbaas14:39
*** ducttape_ has quit IRC14:44
*** jaff_cheng has quit IRC14:45
*** amotoki has quit IRC14:46
*** sbalukoff has quit IRC14:48
*** permalac has joined #openstack-lbaas14:56
*** bogdan has joined #openstack-lbaas14:58
bogdanis it possible to run Octavia in a linuxbridge environment (and not OpenVSwitch), for example how to translate sudo ovs-vsctl -- --may-exist add-port ${OVS_BRIDGE:-br-int} o-hm0   -- set Interface o-hm0 type=internal   -- set Interface o-hm0 external-ids:iface-status=active  -- set Interface o-hm0 external-ids:attached-mac=$MGMT_PORT_MAC -- set Interface o-hm0 external-ids:iface-id=$MGMT_PORT_ID14:58
*** harlowja has joined #openstack-lbaas15:01
*** bogdan has quit IRC15:04
*** prabampm has quit IRC15:09
*** woodster_ has joined #openstack-lbaas15:14
*** amotoki has joined #openstack-lbaas15:14
*** eranra has joined #openstack-lbaas15:22
*** harlowja has quit IRC15:26
*** mixos has quit IRC15:28
*** eranra has quit IRC15:30
*** amotoki has quit IRC15:31
*** diogogmt has joined #openstack-lbaas15:35
*** mixos has joined #openstack-lbaas15:39
*** harlowja has joined #openstack-lbaas15:39
*** eranra has joined #openstack-lbaas15:42
*** sbalukoff has joined #openstack-lbaas15:43
*** numans has quit IRC15:43
*** harlowja has quit IRC15:44
*** eranra has quit IRC15:44
*** eranra has joined #openstack-lbaas15:44
*** dmk0202 has joined #openstack-lbaas15:45
*** amotoki has joined #openstack-lbaas15:46
*** mixos has quit IRC15:49
*** yamamoto has joined #openstack-lbaas15:49
*** harlowja has joined #openstack-lbaas15:50
*** eranra has quit IRC15:53
*** yamamoto has quit IRC15:53
*** ducttape_ has joined #openstack-lbaas15:58
rm_workhmmmmm16:01
*** yamamoto has joined #openstack-lbaas16:01
*** kobis has quit IRC16:03
*** yamamoto has quit IRC16:03
*** neelashah has joined #openstack-lbaas16:04
rm_workptoohill: you around?16:06
*** yamamoto has joined #openstack-lbaas16:06
*** dmk0202 has quit IRC16:08
*** yamamoto has quit IRC16:09
*** harlowja has quit IRC16:12
*** fnaval has quit IRC16:17
*** ducttape_ has quit IRC16:17
*** ducttape_ has joined #openstack-lbaas16:18
*** kobis has joined #openstack-lbaas16:18
*** armax has joined #openstack-lbaas16:21
*** diogogmt has quit IRC16:30
*** harlowja has joined #openstack-lbaas16:31
*** diogogmt has joined #openstack-lbaas16:31
*** harlowja has quit IRC16:33
*** armax has quit IRC16:33
*** cody-somerville has quit IRC16:34
*** sbalukoff has quit IRC16:38
*** madhu_ak has joined #openstack-lbaas16:39
*** ducttape_ has quit IRC16:41
*** alhu has joined #openstack-lbaas16:42
*** amotoki has quit IRC16:44
*** alhu1 has joined #openstack-lbaas16:49
*** ChrisBenson has quit IRC16:49
*** ducttape_ has joined #openstack-lbaas16:50
*** amotoki has joined #openstack-lbaas16:51
*** alhu has quit IRC16:52
*** harlowja has joined #openstack-lbaas17:05
*** bogdan has joined #openstack-lbaas17:11
*** diogogmt has quit IRC17:11
bogdanis it possible to run Octavia with Linux Bridge or shall I go for OVS?17:11
*** neelashah has quit IRC17:13
*** alhu1 has quit IRC17:14
*** armax has joined #openstack-lbaas17:14
*** alhu has joined #openstack-lbaas17:14
*** alhu has quit IRC17:14
*** diogogmt has joined #openstack-lbaas17:16
*** harlowja has quit IRC17:18
*** minwang2 has quit IRC17:19
*** alhu has joined #openstack-lbaas17:19
*** alhu has quit IRC17:20
*** kevo has joined #openstack-lbaas17:26
*** amotoki has quit IRC17:33
*** ducttape_ has quit IRC17:33
*** kobis has quit IRC17:38
*** armax has quit IRC17:40
*** mixos has joined #openstack-lbaas17:43
*** yamamoto has joined #openstack-lbaas17:45
bogdanis it possible to run Octavia with Linux Bridge or shall I go for OVS?17:48
*** numans has joined #openstack-lbaas17:48
*** rcernin has quit IRC17:50
*** minwang2 has joined #openstack-lbaas17:50
*** yamamoto has quit IRC17:50
*** amotoki has joined #openstack-lbaas17:52
FritoI've not replied b/c I honestly don't know. I'm running the default (OpenVSwitch) for what it's worth.17:53
FritoYou might get a response after summit winds down today. Not sure though.17:56
*** nmagnezi has joined #openstack-lbaas17:58
*** numans has quit IRC18:00
*** numans has joined #openstack-lbaas18:04
*** mixos has quit IRC18:08
*** mixos has joined #openstack-lbaas18:10
*** anilvenkata has quit IRC18:16
*** nmagnezi has quit IRC18:16
bogdanyeah, let's wait a bit18:19
*** ducttape_ has joined #openstack-lbaas18:26
*** Aish has joined #openstack-lbaas18:26
*** kobis has joined #openstack-lbaas18:34
openstackgerritmin wang proposed openstack/octavia: Add failover scenario test for octavia  https://review.openstack.org/30962518:36
*** yamamoto has joined #openstack-lbaas18:39
*** ducttape_ has quit IRC18:41
*** rcernin has joined #openstack-lbaas18:42
*** amotoki has quit IRC18:43
*** ducttape_ has joined #openstack-lbaas18:44
*** armax has joined #openstack-lbaas18:45
*** alhu has joined #openstack-lbaas18:45
*** harlowja has joined #openstack-lbaas18:45
*** yamamoto has quit IRC18:46
*** mixos has quit IRC18:47
openstackgerritAishwarya Thangappa proposed openstack/octavia: Adds a new feature to limit the amphora build rate  https://review.openstack.org/30330418:47
*** amotoki has joined #openstack-lbaas18:48
*** yamamoto has joined #openstack-lbaas18:50
*** neelashah has joined #openstack-lbaas18:50
*** kobis has quit IRC18:51
*** permalac has quit IRC18:51
*** mixos has joined #openstack-lbaas18:51
*** neelashah has quit IRC18:51
*** yamamoto has quit IRC18:55
*** yamamoto has joined #openstack-lbaas18:55
*** kobis has joined #openstack-lbaas18:56
*** yamamoto has quit IRC18:57
*** yamamoto has joined #openstack-lbaas19:00
*** yamamoto has quit IRC19:04
*** cody-somerville has joined #openstack-lbaas19:18
*** mixos has quit IRC19:23
*** yamamoto has joined #openstack-lbaas19:26
*** ducttape_ has quit IRC19:27
*** alhu has quit IRC19:29
*** harlowja has quit IRC19:30
*** ducttape_ has joined #openstack-lbaas19:30
*** armax has quit IRC19:30
*** harlowja has joined #openstack-lbaas19:30
*** harlowja has quit IRC19:30
bogdananyone to advise on Octavia on linux bridge?19:31
*** yamamoto has quit IRC19:31
*** mixos has joined #openstack-lbaas19:32
*** ducttape_ has quit IRC19:34
*** cody-somerville has quit IRC19:36
*** ducttape_ has joined #openstack-lbaas19:38
*** kobis has quit IRC19:39
*** mixos has quit IRC19:42
*** Aish has left #openstack-lbaas19:45
*** armax has joined #openstack-lbaas19:45
*** mixos has joined #openstack-lbaas19:46
*** kobis has joined #openstack-lbaas19:48
*** shakamunyi has quit IRC19:50
*** numans has quit IRC19:59
*** alhu has joined #openstack-lbaas20:04
bloganbogdan: the devstack plugin for octavia won't work with health checks right now with anything but ovs, but if you're not deploying into a single machine devstack it should work, but i'm not sure if anyone has tested with lb20:04
*** matt-borland has joined #openstack-lbaas20:04
*** alhu1 has joined #openstack-lbaas20:06
*** alhu has quit IRC20:08
*** armax has quit IRC20:09
bogdanblogan, I am not using devstack and I think most of the things work so far - the only missing piece is that REST driver cannot access the amphora and from what I see the reason is that there is no direct visibility between the provider network where worker lives and the amphora network20:11
bogdanblogan, I see in the octavia/plugin.sh an ovs command to connect these, so my question is how can I do that with linux bridge20:11
*** amotoki has quit IRC20:11
bogdanprobably it is something quite trivial but I am not sure how to do it20:12
bogdanI believe brctl addif is equivalent to ovs-vsctl add-port but not sure how to configure it so that Octavia can bind to that port/interface20:13
bloganbogdan: basically all that command is doing is allowing heartbeats to reach the controller20:13
bogdanok but how do you resolve the connectivity between worker and amphora? the only way I could do it was by using ip netns exec ...20:14
bogdanbut the python code in worker/rest driver needs some more direct visibility between networks20:14
*** amotoki has joined #openstack-lbaas20:15
bloganbogdan: yeah i can't remember exactly what that piece of ovs code does right now, unfortunately i wrote it, but i'm pretty sure its similar to just doing a veth pair to the namespace20:15
bloganbut i'm not sure20:15
blogani'll try to look at it later, gotta go to the next session20:15
bogdan10x!20:15
blogansorry to briefly answer and run20:15
bogdanare you saying that the code already takes care of connecting the two networks? if so then I have to troubleshoot that piece, I was so far with the impression that I did not configure something for this visibility to happen, if it is expected that Octavia code handles this then I have to debug it because it does not work at my side20:19
bogdanaaa, you meant the plugin.sh piece of code? ok. but then you say that this only takes care of the heartbeats, if this is the case then what should I do to let packets from the worker network to reach the lb_mgmt_network?20:21
*** alhu1 has quit IRC20:25
*** alhu has joined #openstack-lbaas20:29
*** yamamoto has joined #openstack-lbaas20:32
*** openstackgerrit has quit IRC20:32
*** armax has joined #openstack-lbaas20:33
*** openstackgerrit has joined #openstack-lbaas20:33
*** alhu has quit IRC20:35
*** kobis has quit IRC20:36
*** kobis has joined #openstack-lbaas20:36
*** harlowja has joined #openstack-lbaas20:36
*** kobis has quit IRC20:40
*** mixos has quit IRC20:58
*** matt-borland has quit IRC20:58
*** ducttape_ has quit IRC21:03
*** ducttape_ has joined #openstack-lbaas21:06
*** kobis has joined #openstack-lbaas21:06
*** yamamoto has quit IRC21:07
*** mixos has joined #openstack-lbaas21:08
*** armax has quit IRC21:08
*** harlowja has quit IRC21:10
*** kobis has quit IRC21:12
*** mixos has quit IRC21:12
*** amotoki has quit IRC21:15
*** ducttape_ has quit IRC21:17
*** amotoki has joined #openstack-lbaas21:18
*** kobis has joined #openstack-lbaas21:19
*** alhu has joined #openstack-lbaas21:24
*** armax has joined #openstack-lbaas21:27
*** armax has quit IRC21:28
*** mixos has joined #openstack-lbaas21:29
*** rcernin has quit IRC21:29
*** yamamoto has joined #openstack-lbaas21:33
*** armax has joined #openstack-lbaas21:33
*** bharathm has quit IRC21:41
bogdanI am getting ERROR octavia.compute.drivers.nova_driver BadRequest: Unable to find security_group with name 'd3cb6cec-08c0-4f0f-8747-e863bebfc0d3' (HTTP 400) (Request-ID: req-a31714e4-0f11-4521-b92f-af7ac897c4f6)21:44
bogdanand this is if I use export OCTAVIA_MGMT_SEC_GRP_ID=$(nova secgroup-list | awk ' / lb-mgmt-sec-grp / {print $2}') openstack-config --set /etc/octavia/octavia.conf controller_worker amp_secgroup_list $OCTAVIA_MGMT_SEC_GRP_ID21:44
bogdanbut if I use amp_secgroup_list = default then nova instance creation succeeds21:44
bogdanhow come that in devstack it is working and not working at my side?21:45
bogdanok, my bad -  I have created the sec group in the wrong project thus nova was not able to find it via ID...21:51
*** amotoki has quit IRC21:55
*** amotoki has joined #openstack-lbaas21:55
*** ducttape_ has joined #openstack-lbaas22:02
*** ducttape_ has quit IRC22:02
*** yamamoto has quit IRC22:05
*** armax has quit IRC22:10
*** amotoki has quit IRC22:12
*** woodster_ has quit IRC22:18
*** amotoki has joined #openstack-lbaas22:23
*** armax has joined #openstack-lbaas22:35
*** yamamoto has joined #openstack-lbaas22:38
*** alhu has quit IRC22:43
*** armax has quit IRC22:43
*** crc32 has joined #openstack-lbaas22:43
*** armax has joined #openstack-lbaas22:50
bogdananyone in here?22:51
*** yamamoto has quit IRC23:00
*** armax has quit IRC23:00
*** alhu has joined #openstack-lbaas23:01
*** amotoki has quit IRC23:02
*** alhu has quit IRC23:03
*** kobis has quit IRC23:03
*** neelashah has joined #openstack-lbaas23:11
*** crc32 has quit IRC23:17
*** amotoki has joined #openstack-lbaas23:19
*** amotoki has quit IRC23:20
*** mixos has quit IRC23:20
*** kobis has joined #openstack-lbaas23:28
*** alhu has joined #openstack-lbaas23:46
*** diogogmt has quit IRC23:55

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!