Wednesday, 2016-04-13

*** ChrisBenson has quit IRC00:09
*** yuanying has joined #openstack-lbaas00:10
*** Purandar has quit IRC00:12
*** minwang2 has quit IRC00:17
*** reedip__ has joined #openstack-lbaas00:20
*** fawadkhaliq has quit IRC00:21
*** fawadkhaliq has joined #openstack-lbaas00:21
*** ducttape_ has joined #openstack-lbaas00:28
*** ducttape_ has quit IRC00:30
*** ducttape_ has joined #openstack-lbaas00:34
*** Purandar has joined #openstack-lbaas00:42
*** minwang2 has joined #openstack-lbaas00:43
*** ducttape_ has quit IRC00:43
*** minwang2 has quit IRC01:03
*** Purandar has quit IRC01:05
*** fnaval has quit IRC01:08
*** fnaval has joined #openstack-lbaas01:21
*** madhu_ak has quit IRC01:27
*** ChrisBenson has joined #openstack-lbaas01:40
*** bana_k has quit IRC01:43
*** fawadkhaliq has quit IRC01:43
*** fawadkhaliq has joined #openstack-lbaas01:44
*** reedip__ has quit IRC01:45
*** reedip__ has joined #openstack-lbaas01:46
*** ktrmzn has quit IRC01:46
*** yamamot__ has joined #openstack-lbaas02:00
*** yamamoto has quit IRC02:03
*** Purandar has joined #openstack-lbaas02:26
*** amotoki has quit IRC02:38
*** yuanying has quit IRC02:54
*** armax has quit IRC02:59
*** yamamot__ has quit IRC03:20
*** yamamot__ has joined #openstack-lbaas03:21
*** fawadkhaliq has quit IRC03:22
*** fawadkhaliq has joined #openstack-lbaas03:23
*** yamamot__ has quit IRC03:26
*** ktrmzn has joined #openstack-lbaas03:31
*** bana_k has joined #openstack-lbaas03:38
*** ChrisBenson has quit IRC03:39
*** ChrisBenson has joined #openstack-lbaas03:39
*** Purandar has quit IRC03:40
*** prabampm has joined #openstack-lbaas03:42
*** yuanying has joined #openstack-lbaas03:47
*** amotoki has joined #openstack-lbaas03:51
*** ChrisBenson1 has joined #openstack-lbaas04:00
*** ChrisBenson has quit IRC04:00
*** Purandar has joined #openstack-lbaas04:03
*** yamamot__ has joined #openstack-lbaas04:04
*** links has joined #openstack-lbaas04:46
*** neelashah has quit IRC05:00
*** amotoki_ has joined #openstack-lbaas05:02
*** amotoki has quit IRC05:06
*** woodster_ has quit IRC05:07
*** Purandar has quit IRC05:10
*** fawadkhaliq has quit IRC05:11
*** fawadkhaliq has joined #openstack-lbaas05:11
*** cody-somerville has quit IRC05:17
*** ihrachys has joined #openstack-lbaas05:17
*** mestery has quit IRC05:17
*** fawadkhaliq has quit IRC05:20
*** fawadkhaliq has joined #openstack-lbaas05:20
*** mestery has joined #openstack-lbaas05:23
*** yamamot__ has quit IRC05:28
*** yamamot__ has joined #openstack-lbaas05:29
*** anilvenkata has joined #openstack-lbaas05:31
*** cody-somerville has joined #openstack-lbaas05:32
*** yamamo___ has joined #openstack-lbaas05:34
*** yamamot__ has quit IRC05:36
*** rcernin has joined #openstack-lbaas05:56
*** cody-somerville has quit IRC05:57
*** bana_k has quit IRC06:00
*** yamamo___ has quit IRC06:10
*** yamamot__ has joined #openstack-lbaas06:11
*** numans has joined #openstack-lbaas06:22
*** kobis has joined #openstack-lbaas06:32
*** tesseract has joined #openstack-lbaas06:46
*** tesseract is now known as Guest1269906:46
*** divya has quit IRC06:51
*** nmagnezi has joined #openstack-lbaas07:06
*** fawadkhaliq has quit IRC07:10
*** Alex_Stef has joined #openstack-lbaas07:15
*** bana_k has joined #openstack-lbaas07:51
openstackgerritThomas Bechtold proposed openstack/neutron-lbaas: Fix doc build if git is absent  https://review.openstack.org/30502707:55
*** Alex_Stef has quit IRC08:05
*** jschwarz has joined #openstack-lbaas08:05
openstackgerritKobi Samoray proposed openstack/neutron-lbaas: (WIP) Add support for HTTP custom headers  https://review.openstack.org/25596308:07
*** ChrisBenson1 has quit IRC08:10
*** Alex_Stef has joined #openstack-lbaas08:17
*** amotoki_ has quit IRC08:23
*** bana_k has quit IRC08:27
*** ktrmzn has quit IRC08:42
openstackgerritKobi Samoray proposed openstack/neutron-lbaas: (WIP) Add support for HTTP custom headers  https://review.openstack.org/25596309:20
*** mestery_ has joined #openstack-lbaas09:40
*** jorgem| has joined #openstack-lbaas09:41
*** numans has quit IRC09:47
*** mestery has quit IRC09:47
*** chlong has quit IRC09:47
*** barclaac has quit IRC09:47
*** dougwig has quit IRC09:47
*** jorgem has quit IRC09:47
*** mestery_ is now known as mestery09:47
*** barclaac has joined #openstack-lbaas09:48
*** numans has joined #openstack-lbaas09:54
*** chlong has joined #openstack-lbaas09:54
*** banszmar has quit IRC10:19
*** amotoki has joined #openstack-lbaas10:22
*** yamamot__ has quit IRC10:25
*** nmagnezi has quit IRC10:27
*** johnsom_ has joined #openstack-lbaas10:30
*** johnsom has quit IRC10:33
*** openstack has joined #openstack-lbaas11:33
*** openstackgerrit has quit IRC11:35
*** bradjones has quit IRC11:35
*** ptoohill has quit IRC11:35
*** amotoki has quit IRC11:36
*** klindgren_ has quit IRC11:36
*** _laco has quit IRC11:36
*** nmagnezi has quit IRC11:37
*** links has quit IRC11:37
*** bradjones has joined #openstack-lbaas11:41
*** bradjones has quit IRC11:41
*** bradjones has joined #openstack-lbaas11:41
*** ptoohill has joined #openstack-lbaas11:42
*** amotoki has joined #openstack-lbaas11:42
*** haypo has joined #openstack-lbaas11:47
haypohello. i have a serie of 3 patches to port Neutron LBaaS to Python 3: https://review.openstack.org/#/c/288413/ - they already got a +2 from ihrachys, here is someone else available to review them and help me to port this code to py3?11:47
haypoit looks like Neutron LBaaS is the last huge Neutron component which is not compatible with python 3 yet11:47
*** nmagnezi has joined #openstack-lbaas11:49
*** links has joined #openstack-lbaas11:50
*** openstackgerrit has joined #openstack-lbaas11:51
*** nmagnezi has quit IRC11:54
*** _laco has joined #openstack-lbaas11:54
*** ducttape_ has joined #openstack-lbaas12:07
*** amotoki has quit IRC12:08
*** fnaval has quit IRC12:09
*** nmagnezi has joined #openstack-lbaas12:13
*** yamamoto has joined #openstack-lbaas12:14
*** ducttape_ has quit IRC12:30
*** yamamoto has quit IRC12:31
*** matt-borland has joined #openstack-lbaas12:57
*** amotoki has joined #openstack-lbaas12:59
*** yamamoto has joined #openstack-lbaas13:02
*** amotoki has quit IRC13:07
*** neelashah has joined #openstack-lbaas13:08
*** woodster_ has joined #openstack-lbaas13:08
*** Bjoern_ has joined #openstack-lbaas13:25
*** Bjoern_ is now known as Bjoern_zZzZzZzZ13:25
openstackgerritKobi Samoray proposed openstack/neutron-lbaas: Add support for HTTP custom headers  https://review.openstack.org/25596313:27
*** clduser_ has joined #openstack-lbaas13:38
*** haypo_ has joined #openstack-lbaas13:38
*** prabampm has quit IRC13:43
*** Alex_Stef has quit IRC13:43
*** haypo has quit IRC13:43
*** clduser has quit IRC13:43
openstackgerritChristian Zunker proposed openstack/neutron-lbaas: Prevent LBaaS agent from filling up logs.  https://review.openstack.org/30528413:46
*** Alex_Stef has joined #openstack-lbaas13:49
*** prabampm has joined #openstack-lbaas13:57
*** minwang2 has joined #openstack-lbaas13:58
*** itsuugo has quit IRC14:02
*** markvan has quit IRC14:04
*** minwang2 has quit IRC14:06
*** minwang2 has joined #openstack-lbaas14:06
*** itsuugo has joined #openstack-lbaas14:08
*** markvan has joined #openstack-lbaas14:08
*** reedip__ has quit IRC14:09
*** links has quit IRC14:13
*** prabampm1 has joined #openstack-lbaas14:17
*** prabampm has quit IRC14:19
*** TrevorV has joined #openstack-lbaas14:22
*** anilvenkata has quit IRC14:23
*** minwang2 has quit IRC14:29
*** minwang2 has joined #openstack-lbaas14:32
*** johnsom_ has quit IRC14:35
*** matt-borland_ has joined #openstack-lbaas14:35
*** johnsom has joined #openstack-lbaas14:35
*** neelashah1 has joined #openstack-lbaas14:36
*** neelashah has quit IRC14:37
*** prabampm1 has quit IRC14:38
*** prabampm has joined #openstack-lbaas14:38
*** matt-borland has quit IRC14:38
*** ducttape_ has joined #openstack-lbaas14:45
*** ducttape_ has quit IRC14:45
*** ducttape_ has joined #openstack-lbaas14:45
*** cody-somerville has joined #openstack-lbaas15:02
*** doug-fish has joined #openstack-lbaas15:10
*** jschwarz has quit IRC15:10
*** kobis has quit IRC15:13
*** nmagnezi has quit IRC15:15
*** armax has joined #openstack-lbaas15:17
*** nmagnezi has joined #openstack-lbaas15:18
bloganhaypo ping15:21
*** armax has quit IRC15:22
*** Guest12699 has quit IRC15:28
*** armax has joined #openstack-lbaas15:30
*** ducttape_ has quit IRC15:36
haypo_blogan: hey15:37
*** haypo_ is now known as haypo15:37
*** ducttape_ has joined #openstack-lbaas15:37
bloganhaypo: quick question about https://review.openstack.org/#/c/297080/3/neutron_lbaas/agent/agent_manager.py15:37
*** rtheis_ has joined #openstack-lbaas15:37
bloganthe comment you added, i dont see that loop modifying the dictioanry15:37
*** johnsom_ has joined #openstack-lbaas15:37
haypoblogan: i guess that self._destroy_loadbalancer() modifies the instance_mapping, i don't recall15:37
bloganhmm you might be rgiht, hold on15:38
bloganhaypo: yeah you're right, sorry :)15:38
blogani thought the destroy_loadbalancer was a driver call in which case it wouldn't ahve access to that dictionary, but i misread15:38
*** bana_k has joined #openstack-lbaas15:38
*** openstack has joined #openstack-lbaas16:10
openstackgerritMerged openstack/neutron-lbaas: Port agent_manager to Python 3  https://review.openstack.org/29708016:16
*** ChrisBenson has joined #openstack-lbaas16:17
*** Bjoern_zZzZzZzZ has quit IRC16:21
*** _ducttape_ has joined #openstack-lbaas16:25
haypooh nice, my 3 python 3 patches were merged, cool. i will write new patches to continue the port :) thanks16:26
*** ducttape_ has quit IRC16:27
*** rcernin has quit IRC16:39
bloganhaypo: i used to hate python 3 but i've gone through the 50 stages of grief and have finally accepted and look forward to moving to it and gitting rid of python 216:39
*** jschwarz has joined #openstack-lbaas16:42
*** Purandar has quit IRC16:43
rm_workI love Python3 and tried to port as much as possible to it but I only really touch the Octavia side :/16:50
rm_workjohnsom: https://review.openstack.org/#/c/298424/2 do you want me to fix the upstart side too?16:50
rm_workwhat I have there is kind-of a hack, the real solution is to not use werkzeug and serve this thing with a real WSGI engine like gunicorn16:51
rm_workand it won't be dumb16:51
johnsomrm_work Yeah, I think it would be best to keep those aligned.  Our reference image is upstart based16:51
*** madhu_ak has joined #openstack-lbaas16:52
rm_workthat patch only fixes the bug if you actually call stop or restart16:52
rm_workbut I assume that IS the bug?16:52
johnsomHey, I am in favor of that work too.  These port games are a problem16:52
*** neelashah has quit IRC16:53
rm_workso, the problem is that I have no idea how upstart works16:53
johnsomThe bug I know of is if you restart the agent the port comes back as "in use"16:53
rm_workand I DID glance at it, but it looks like dark magic to me16:53
rm_workyes so that's due to a wergzeug bug16:53
rm_workwerkzeug spawns a parent process and two child processes to serve the agent API, and when you kill the parent (which is what all the init scripts do) it kills the parent and one child, and one child remains running orphaned, which happens to be the one holding the port16:54
johnsomUp until this patch, both the sysvinit and upstart side have been in sync16:54
rm_workit's an OOOOOLD bug16:54
*** neelashah has joined #openstack-lbaas16:54
rm_workerr, the upstart side has like no code that i saw16:54
rm_workit's just like16:54
*** kevo has quit IRC16:54
*** amotoki has quit IRC16:54
rm_worka definition of the daemon name, and runlevels16:55
rm_workit looks like magic to me16:55
rm_workit has literally just 5 non-whitespace lines, and one of them is the description16:55
johnsomThis is super helpful: http://upstart.ubuntu.com/cookbook/16:55
rm_workI am not positive we CAN fix the bug in upstart16:56
rm_workwithout maybe an intermediate script?16:56
johnsomThere are pre- and post- start/stop blocks available, which may be what you are looking for16:56
haypoblogan: hum, ok16:56
rm_workah16:56
rm_workhmm ok16:56
haypoblogan: python 3 is a much better language, but py2+3 in the same code base sucks16:56
johnsomI'm using that in my haproxy upstart script for namespace16:56
johnsomrm_work Which could you a review BTW (grin) https://review.openstack.org/#/c/300292/16:57
johnsomhttps://review.openstack.org/#/c/300292/13/octavia/amphorae/backends/agent/api_server/templates/upstart.conf.j216:57
bloganhaypo: thats what i mean, i was more angry that there's these backwards incompatible changes16:57
bloganpretty sure a lot of people had that sentiment16:58
rm_workjohnsom: so I know nothing about network namespaces, but I can review that for ... like, syntax and basic logic :P16:58
blogani don't deny its better16:58
rm_workwell a lot of that is WHY I think it's better16:58
rm_workthey got rid of a lot of the dumb stuff in py216:58
rm_workwhich they couldn't have done without breaking compat16:59
haypoblogan: the migration is painful. if you start a fresh project with py3, the major enhancements of py3 will become obvious to you ;)17:00
rm_workjohnsom: wait i don't even see the upstart template in my codebase, wut17:00
rm_workneed to figure out why it isn't even here17:01
rm_workoh nm wrong place17:01
rm_workjohnsom: hmm i think maybe i've actually been editing this file in the wrong place anyway17:02
johnsomI am guessing that we will eventually need to move to systemd17:02
rm_workI was editing the sample in the bin directory, not the templates >_17:02
rm_work>_>17:02
rm_workerr, in etc/17:02
rm_workneither of sysvinit.conf.j2 or upstart.conf.j2 are what i was editing17:03
johnsomWell, the amp-agent upstart is in etc/  The haproxy template I shared as an example is elsewhere17:03
rm_workoctavia/amphorae/backends/agent/api_server/templates/sysvinit.conf.j217:03
rm_workthose17:03
rm_workyou are editing them in your patch17:04
johnsomThose are haproxy scripts17:04
rm_workoh17:04
rm_workah yes i see17:04
rm_workok phew, making more sense17:04
rm_worki am super tired right now, about to go to sleep <_<17:04
rm_workI'll try to fix the other bit when I wake up17:05
rm_workjohnsom: also, for LBaaS Talk, what did you want me to do a section on? TLS Termination? or did someone else already have that17:06
rm_workI started working on trying to record a video demo, but it feels like it's pretty much just an addendum to the normal workflow17:06
johnsomAll I have right now is L7 and Horizon demos.  I plan to talk about new features/future plans17:06
johnsomSo, TLS would be an option17:07
rm_workI'm not sure whether I can commit to getting something done for that or not17:08
johnsomOk17:08
rm_workI barely have any actual time before the summit, I have a lot of PTO in the next two weeks17:09
johnsomI think we will have enough content, so if you want to take a pass that is cool17:09
rm_workfrom traveling17:09
rm_workthat might be best -- then I can focus on geting extra VMs up and tested for the hands-on demo17:09
rm_workwhich is the one talk I actually knew I was on :P17:09
johnsomOk, sounds good17:09
xgerman+117:14
*** bana_k has joined #openstack-lbaas17:14
*** minwang2 has quit IRC17:23
*** Bjoern_ has joined #openstack-lbaas17:25
*** Aish has joined #openstack-lbaas17:25
*** neelashah has quit IRC17:25
*** Purandar has joined #openstack-lbaas17:29
*** Bjoern_ has quit IRC17:29
*** doug-fis_ has quit IRC17:32
*** ChrisBenson has quit IRC17:32
*** ChrisBenson has joined #openstack-lbaas17:32
*** Aish has quit IRC17:34
*** doug-fish has joined #openstack-lbaas17:40
*** ChrisBenson has quit IRC17:41
*** ChrisBenson has joined #openstack-lbaas17:42
*** woodster_ has quit IRC17:44
*** crc32 has joined #openstack-lbaas17:44
*** Purandar has quit IRC17:45
*** Aish has joined #openstack-lbaas17:45
*** minwang2 has joined #openstack-lbaas17:47
*** prabampm has quit IRC18:01
*** armax has quit IRC18:04
*** prabampm has joined #openstack-lbaas18:04
*** prabampm has quit IRC18:15
*** cody-somerville has quit IRC18:19
TrevorVanyone know where evgeny is these days?18:24
*** haleyb has left #openstack-lbaas18:26
*** klindgren__ is now known as klindgren18:29
*** minwang2_ has joined #openstack-lbaas18:36
*** johnsom_ has joined #openstack-lbaas18:36
*** rtheis has joined #openstack-lbaas18:37
*** minwang2 has quit IRC18:38
*** minwang2_ is now known as minwang218:38
*** johnsom has quit IRC18:39
*** crc32_znc has quit IRC18:39
*** hockeynut has quit IRC18:39
*** yamamoto has quit IRC18:39
*** rtheis_ has quit IRC18:39
*** openstackgerrit has quit IRC18:39
*** kong has quit IRC18:41
*** doug-fish has quit IRC18:42
*** doug-fish has joined #openstack-lbaas18:43
*** jschwarz has quit IRC18:43
*** doug-fis_ has joined #openstack-lbaas18:44
*** hockeynut has joined #openstack-lbaas18:44
*** crc32 has quit IRC18:45
*** crc32|znc has joined #openstack-lbaas18:45
*** doug-fish has quit IRC18:47
*** armax has joined #openstack-lbaas18:50
*** amotoki has joined #openstack-lbaas18:55
*** openstackgerrit has joined #openstack-lbaas18:56
*** woodster_ has joined #openstack-lbaas18:58
*** amotoki has quit IRC19:00
*** neelashah has joined #openstack-lbaas19:01
fnavalthanks for the review madhu_ak19:09
*** kong has joined #openstack-lbaas19:09
fnavalneutron-lbaas cores please review: https://review.openstack.org/#/c/164828/19:09
fnavalthanks in advance19:09
*** haypo has left #openstack-lbaas19:17
*** Aish has left #openstack-lbaas19:20
openstackgerritFranklin Naval proposed openstack/neutron-lbaas: Tempest API tests using testscenarios for create/update loadbalancer  https://review.openstack.org/17802219:22
openstackgerritFranklin Naval proposed openstack/neutron-lbaas: Tempest API tests using testscenarios for create/update pool  https://review.openstack.org/18001919:22
*** ajmiller has quit IRC19:25
*** yamamoto has joined #openstack-lbaas19:40
*** HenryG_ has joined #openstack-lbaas19:46
*** yamamoto has quit IRC19:47
*** doug-fis_ has quit IRC19:48
*** bradjones has quit IRC19:48
*** redrobot has quit IRC19:48
*** HenryG has quit IRC19:48
*** HenryG_ is now known as HenryG19:49
*** bradjones_ has joined #openstack-lbaas19:53
*** bradjones_ has quit IRC19:53
*** bradjones_ has joined #openstack-lbaas19:53
*** _ducttape_ has quit IRC19:55
*** amotoki has joined #openstack-lbaas19:56
*** doug-fis_ has joined #openstack-lbaas19:57
*** bradjones has joined #openstack-lbaas19:57
*** redrobot has joined #openstack-lbaas19:57
johnsom_Octavia meeting starting soon on #openstack-meeting-alt19:59
*** amotoki has quit IRC20:01
*** doug-fis_ has quit IRC20:04
*** bradjones has quit IRC20:04
*** redrobot has quit IRC20:04
*** bradjones_ is now known as bradjones20:04
*** dougw2 has joined #openstack-lbaas20:05
*** doug-fish has joined #openstack-lbaas20:07
*** doug-fish has quit IRC20:08
*** doug-fish has joined #openstack-lbaas20:08
*** ducttape_ has joined #openstack-lbaas20:09
*** doug-fis_ has joined #openstack-lbaas20:09
*** redrobot has joined #openstack-lbaas20:09
*** doug-fis_ has quit IRC20:11
*** _ducttape_ has joined #openstack-lbaas20:13
*** ducttape_ has quit IRC20:15
*** redrobot has quit IRC20:15
*** armax has quit IRC20:19
*** redrobot has joined #openstack-lbaas20:23
*** redrobot is now known as Guest7878620:24
*** krotscheck is now known as krotscheck_dcm20:36
*** neelashah1 has joined #openstack-lbaas20:36
*** minwang2_ has joined #openstack-lbaas20:37
*** johnsom has joined #openstack-lbaas20:40
*** raginbaj- has joined #openstack-lbaas20:43
*** Guest78786 is now known as redrobot20:43
*** TrevorV2 has joined #openstack-lbaas20:44
*** ajo_ has joined #openstack-lbaas20:45
*** neelashah has quit IRC20:47
*** johnsom_ has quit IRC20:47
*** minwang2 has quit IRC20:47
*** TrevorV has quit IRC20:47
*** harlowja has quit IRC20:47
*** ajo has quit IRC20:47
*** raginbajin has quit IRC20:47
*** cgross has quit IRC20:47
*** minwang2_ is now known as minwang220:47
*** raginbaj- is now known as raginbajin20:47
*** cgross has joined #openstack-lbaas20:52
konghi, guys, any progress on https://review.openstack.org/#/c/298803?20:57
johnsomkong good question.  mestery could you take a look at a stable mitaka backport?  https://review.openstack.org/#/c/29880320:58
kongjohnsom, mestery, thanks!21:00
kongjohnsom: do yo know how can I ssh to amphorae vm? I found it still slow on my devstack, even I used spare pool.21:03
kongI wanna know what exactly happened inside the vm21:04
johnsomYeah, you should be able to ssh in.  If it's a standard devstack install you can 'ssh -i /etc/octavia/.ssh/octavia_ssh_key ubuntu@<mgmt IP>21:05
johnsomThat is the ssh key the devstack script creates and loads into the amps.21:06
kongjohnsom: I did another failover testing yesterday, for backup vm, the step AmphoraPostVIPPlug failed again :-(21:10
kongInternalServerError: Internal Server Error21:10
johnsomdid you check the nova instance log?  Had it booted?21:11
kongI have spare pool with number =1, it had been a long time after that I did the failover21:11
johnsomHmm21:12
kongthe function is stable in your devstack, right?21:12
johnsomYes21:13
*** cody-somerville has joined #openstack-lbaas21:13
kongweird21:13
*** kevo has joined #openstack-lbaas21:13
*** rtheis has quit IRC21:15
*** cody-somerville has quit IRC21:18
kongjohnsom: the location of amphorae-agent log?21:20
johnsomkong /var/log/upstart/amphora-agent21:20
kongjohnsom: is it normal that there are 3 processes related to amphorae-agent inside the vm? http://paste.openstack.org/show/493994/21:21
johnsomYes21:21
*** neelashah1 has quit IRC21:22
*** doug-fish has quit IRC21:22
kongjohnsom: ooh, it was abnormal inside the vm...21:22
openstackgerritTrevor Vardeman proposed openstack/neutron-lbaas: WIP - Get Me A LB  https://review.openstack.org/25720121:22
*** doug-fish has joined #openstack-lbaas21:23
johnsomkong As rm _work mentioned earlier today: werkzeug spawns a parent process and two child processes to serve the agent API21:23
openstackgerritTrevor Vardeman proposed openstack/neutron-lbaas: Get Me A LB  https://review.openstack.org/25720121:23
TrevorV2johnsom xgerman blogan I'm out for the day, if you guys could consume this for me, and let me know where I've messed up (I'm sure I have)21:24
*** cody-somerville has joined #openstack-lbaas21:24
*** cody-somerville has quit IRC21:24
*** cody-somerville has joined #openstack-lbaas21:24
TrevorV2https://review.openstack.org/#/c/25720121:24
TrevorV2Thanks guys!21:24
TrevorV2See ya later!21:24
*** TrevorV2 has quit IRC21:24
kongjohnsom: i mean, in the amphorae vm log, I will copy that, really appreciate if you can take a look if you're available now21:24
johnsomSure21:24
kongjohnsom: http://paste.openstack.org/show/493996/21:25
kongjohnsom: it's the reason why plug vip failed21:25
kongafter 1500 times retry21:26
*** doug-fish has quit IRC21:26
*** doug-fish has joined #openstack-lbaas21:26
johnsomWell that is a problem21:27
kongjohnsom: ?21:27
johnsomI have heard of one other person seeing that error21:27
kongi am lucky21:27
kong:-)21:28
*** _ducttape_ has quit IRC21:31
*** armax has joined #openstack-lbaas21:31
*** doug-fish has quit IRC21:31
kongjohnsom: I21:32
johnsomkong Can you try increasing these settings (significantly) rest_request_conn_timeout = 10 and rest_request_read_timeout = 6021:32
kongwill test it again. I don't believe I'm lucky each time21:32
johnsomrestart the o-cw and deploy a new amp?21:32
*** doug-fish has joined #openstack-lbaas21:32
johnsomI suspect it gets worse as the number of VMs goes up inside your devstack21:32
kongI have 5 vm in totaly21:33
kongtotal21:33
*** doug-fis_ has joined #openstack-lbaas21:35
kongjohnsom: sure, I can test according to your suggrestion21:35
johnsomthe broken pipe error you see is the agent trying to send a response back, but the other side has closed the connection21:35
johnsomI just wonder if those are two low for some scenarios21:36
kongjohnsom: ok, will test it today21:36
kongbtw, if I use spare pool, the anti-affinity policy will not be applied, right?21:36
johnsomkong Thank you!21:36
kongjohnsom: it is what i need to figure out21:37
johnsomCorrect21:37
*** matt-borland_ has quit IRC21:37
*** doug-fish has quit IRC21:37
johnsomMaybe try 300 for both, just to give it a large number21:39
kongjohnsom: yeah, i already modified, both 30021:39
kong:-)21:39
johnsomGreat minds think alike21:40
*** doug-fis_ has quit IRC21:40
konghaha21:40
*** bank_ has joined #openstack-lbaas21:40
*** cody-somerville has quit IRC21:41
*** cgross has quit IRC21:41
*** bana_k has quit IRC21:41
*** doug-fish has joined #openstack-lbaas21:44
*** cgross has joined #openstack-lbaas21:46
*** doug-fish has quit IRC21:49
*** doug-fish has joined #openstack-lbaas21:57
*** cody-somerville has joined #openstack-lbaas21:57
*** doug-fish has quit IRC22:01
*** harlowja has joined #openstack-lbaas22:07
*** _laco has quit IRC22:11
openstackgerritMichael Johnson proposed openstack/octavia: Add debug logging for rest driver retry.  https://review.openstack.org/30551222:18
*** ducttape_ has joined #openstack-lbaas22:19
*** _laco has joined #openstack-lbaas22:25
*** ducttape_ has quit IRC22:30
mesteryJohnsom: 298803 is ready to merge?22:30
mesteryHave Ihar's comments been addressed?22:30
mesteryOr concerns?22:30
johnsommestery yes, Ihar removed his -122:30
mesteryNice22:30
johnsomThanks!22:31
kongmestery: thanks!22:31
mesteryInto the queue it goes!22:31
*** ChrisBenson has quit IRC22:48
*** ChrisBenson has joined #openstack-lbaas22:48
*** reedip__ has joined #openstack-lbaas22:59
*** ducttape_ has joined #openstack-lbaas23:09
*** doug-fish has joined #openstack-lbaas23:10
*** doug-fish has quit IRC23:14
*** ChrisBenson has quit IRC23:18
*** ChrisBenson has joined #openstack-lbaas23:20
openstackgerritMichael Johnson proposed openstack/octavia: Adjusts REST driver timeouts and add debug logging  https://review.openstack.org/30551223:35
openstackgerritMichael Johnson proposed openstack/neutron-lbaas: Improve session persistence gate issue  https://review.openstack.org/27887423:38
*** klindgren has quit IRC23:38
*** klindgren has joined #openstack-lbaas23:38
johnsomTry giving it the old one-two punch...23:40
openstackgerritFranklin Naval proposed openstack/neutron-lbaas: Neutron-LBaaS: Update/Delete LB Admin Tests  https://review.openstack.org/30552523:43
kongjohnsom: your suggestion works23:46
johnsomOh good.23:46
kongjohnsom: I have done a bunch of tests23:46
kongso far so good23:46
kongjohnsom: http://paste.openstack.org/show/494009/23:46
johnsomNice and clean23:47
johnsomkong FYI, I just proposed a patch bumping those defaults up to 120.  https://review.openstack.org/#/c/305512/23:48
kongjohnsom: I think that should be documented23:48
kongjohnsom: yes, I saw that23:49
*** ducttape_ has quit IRC23:50
johnsomkong They are documented here: http://docs.openstack.org/developer/octavia/config-reference/octavia-config-table.html but they should go in the operator guide.23:50
*** bank_ has quit IRC23:50
*** ajmiller has joined #openstack-lbaas23:50
johnsomkong Would you mind commenting on this bug? https://bugs.launchpad.net/octavia/+bug/155836823:50
openstackLaunchpad bug 1558368 in octavia "Docs: Operator installation guide needed" [High,In progress] - Assigned to Stephen Balukoff (sbalukoff)23:50
kongjohnsom: I mean, the doc should not only describe what's the configuration's meaning, should give some recommendation for different deployment scenarios(e.g. for devstack )23:52
*** ajmiller_ has joined #openstack-lbaas23:52
johnsomYeah, these are hard as most of us don't have that problem.  It's dependent on the hardware/VM folks are using.23:53
*** ajmiller has quit IRC23:55
*** amotoki has joined #openstack-lbaas23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!