| *** ducttape_ has joined #openstack-lbaas | 00:06 | |
| *** yamamoto has joined #openstack-lbaas | 00:10 | |
| *** portdirect has quit IRC | 00:15 | |
| *** portdirect has joined #openstack-lbaas | 00:15 | |
| *** ducttape_ has quit IRC | 00:27 | |
| *** cody-somerville has quit IRC | 00:28 | |
| *** ducttape_ has joined #openstack-lbaas | 01:27 | |
| *** ducttape_ has quit IRC | 01:32 | |
| *** cody-somerville has joined #openstack-lbaas | 01:42 | |
| *** cody-somerville has quit IRC | 01:53 | |
| *** bana_k has joined #openstack-lbaas | 02:09 | |
| *** bana_k has quit IRC | 02:26 | |
| *** bana_k has joined #openstack-lbaas | 02:35 | |
| *** gongysh has joined #openstack-lbaas | 02:47 | |
| *** links has joined #openstack-lbaas | 02:55 | |
| *** gongysh has quit IRC | 03:08 | |
| *** fnaval has quit IRC | 03:21 | |
| *** fnaval has joined #openstack-lbaas | 03:22 | |
| *** ducttape_ has joined #openstack-lbaas | 03:29 | |
| *** ducttape_ has quit IRC | 03:34 | |
| *** sputnik13 has joined #openstack-lbaas | 03:52 | |
| *** bana_k has quit IRC | 03:57 | |
| *** links has quit IRC | 04:06 | |
| *** gongysh has joined #openstack-lbaas | 04:32 | |
| *** gongysh has quit IRC | 04:37 | |
| *** gongysh has joined #openstack-lbaas | 04:40 | |
| *** sputnik13 has quit IRC | 04:49 | |
| *** cody-somerville has joined #openstack-lbaas | 04:55 | |
| *** cody-somerville has quit IRC | 04:55 | |
| *** cody-somerville has joined #openstack-lbaas | 04:55 | |
| *** sputnik13 has joined #openstack-lbaas | 04:59 | |
| *** gongysh has quit IRC | 06:41 | |
| *** bana_k has joined #openstack-lbaas | 06:51 | |
| *** ihrachys has joined #openstack-lbaas | 07:12 | |
| *** bana_k has quit IRC | 07:27 | |
| *** ihrachys has quit IRC | 07:36 | |
| *** rcernin has joined #openstack-lbaas | 07:43 | |
| *** ihrachys has joined #openstack-lbaas | 07:51 | |
| *** ihrachys has quit IRC | 07:53 | |
| *** amotoki has joined #openstack-lbaas | 08:00 | |
| *** amotoki has quit IRC | 08:17 | |
| *** ipsecguy has quit IRC | 08:25 | |
| *** ipsecguy has joined #openstack-lbaas | 08:26 | |
| *** ducttape_ has joined #openstack-lbaas | 08:34 | |
| *** ducttape_ has quit IRC | 08:39 | |
| *** ipsecguy has quit IRC | 08:47 | |
| *** ipsecguy_ has joined #openstack-lbaas | 08:47 | |
| *** ducttape_ has joined #openstack-lbaas | 09:35 | |
| *** tesseract has joined #openstack-lbaas | 09:37 | |
| *** tesseract is now known as Guest41642 | 09:38 | |
| *** ducttape_ has quit IRC | 09:40 | |
| *** ducttape_ has joined #openstack-lbaas | 10:36 | |
| *** ducttape_ has quit IRC | 10:41 | |
| rm_work | hmm so 409 at http://logs.openstack.org/58/386758/5/check/gate-neutron-lbaasv2-dsvm-scenario/2d3318d/logs/screen-o-cw.txt.gz#_2016-10-15_15_07_34_643 then cleanup at http://logs.openstack.org/58/386758/5/check/gate-neutron-lbaasv2-dsvm-scenario/2d3318d/logs/screen-o-cw.txt.gz#_2016-10-15_15_09_06_544 fails on the SG -- that seems VERY common... | 11:22 |
|---|---|---|
| rm_work | notice at the 409, we get a failure to connect, then we get an SNI validation warning, then ANOTHER failure, then we get the 409 with the vip already set up | 11:23 |
| rm_work | the SNI warning is from the previous call (with the fail), which means it got as far as processing the certs and then failed on timeout? | 11:23 |
| rm_work | is the plug vip operation just too long and will always time out with current settings? maybe that is what you were saying earlier johnsom | 11:23 |
| rm_work | johnsom: i was assuming it was timing out due to an *abnormal* slowness like on the first request after booting the api process, or too early in the boot process when other stuff was running, but maybe it just ALWAYS takes that long to bring up a VIP :/ | 11:24 |
| rm_work | i'm going to try changing the timeouts for the amp connection a bit | 11:24 |
| *** ducttape_ has joined #openstack-lbaas | 11:37 | |
| openstackgerrit | Adam Harwell proposed openstack/octavia: Run amphora agent with gunicorn https://review.openstack.org/386758 | 11:38 |
| rm_work | tweaking some stuff to see if it helps... | 11:38 |
| rm_work | the port_detach_timeout doesn't seem to be used? or else i guess it's probably used in a way that isn't what i expecy | 11:38 |
| rm_work | *expect | 11:38 |
| rm_work | I am kinda assuming that the port is still in the process of detaching when we try to remove the SG, which happens *immediately*, and only retries for about 20 seconds -- if we try for longer or wait a bit, it might actually be successful | 11:39 |
| rm_work | we'll see | 11:39 |
| rm_work | just testing stuff at the moment | 11:39 |
| *** ducttape_ has quit IRC | 11:41 | |
| *** sputnik13 has quit IRC | 12:21 | |
| *** ducttape_ has joined #openstack-lbaas | 13:19 | |
| *** ducttape_ has quit IRC | 13:54 | |
| *** ihrachys has joined #openstack-lbaas | 14:31 | |
| *** ducttape_ has joined #openstack-lbaas | 14:41 | |
| *** _ducttape_ has joined #openstack-lbaas | 15:02 | |
| *** ducttape_ has quit IRC | 15:02 | |
| *** Guest41642 has quit IRC | 15:05 | |
| *** ihrachys has quit IRC | 15:11 | |
| rm_work | wtf | 15:23 |
| rm_work | http://logs.openstack.org/58/386758/6/check/gate-neutron-lbaasv2-dsvm-scenario/cf0cd22/logs/screen-o-cw.txt.gz#_2016-10-16_12_07_10_539 | 15:23 |
| rm_work | it timed out in like 30 seconds | 15:23 |
| rm_work | and then 409'd the next request | 15:23 |
| rm_work | what is up with that | 15:23 |
| openstackgerrit | Adam Harwell proposed openstack/octavia: Run amphora agent with gunicorn https://review.openstack.org/386758 | 15:26 |
| *** _ducttape_ has quit IRC | 15:34 | |
| rm_work | ah i think gunicorn timeout defaults to 30s on the amp side | 15:56 |
| rm_work | so trying first to hardcode that to 2m and see if it changes the timeout period / gets rid of the issue | 15:56 |
| rm_work | if so, i'll move that to config | 15:56 |
| *** ducttape_ has joined #openstack-lbaas | 16:05 | |
| *** pcaruana has joined #openstack-lbaas | 16:05 | |
| openstackgerrit | Adam Harwell proposed openstack/octavia: Run amphora agent with gunicorn https://review.openstack.org/386758 | 16:20 |
| rm_work | whoops | 16:27 |
| rm_work | tests | 16:27 |
| openstackgerrit | Adam Harwell proposed openstack/octavia: Run amphora agent with gunicorn https://review.openstack.org/386758 | 16:27 |
| rm_work | obviously I am using TDD >_> | 16:27 |
| *** ducttape_ has quit IRC | 16:41 | |
| rm_work | so yeah, about 42 seconds to plug a VIP | 16:41 |
| rm_work | just outside the 30s timeout range on the default gunicorn settings... so that one's fixed | 16:41 |
| rm_work | but now seeing 404s randomly | 16:42 |
| rm_work | like, only certain amps | 16:42 |
| rm_work | blegh | 16:42 |
| rm_work | i assume that's because gunicorn is responding but the app code isn't loaded properly yet? which actually should be impossible, so that can't be it... | 16:43 |
| rm_work | with preload set, the app code is loaded before the gunicorn worker forks | 16:43 |
| *** rcernin has quit IRC | 16:44 | |
| *** bana_k has joined #openstack-lbaas | 16:56 | |
| rm_work | the security group errors also seem to have cleaned up with my settings tweak? but, that could be coincidental, because they tend to coincide with other failures, I think | 17:08 |
| *** rcernin has joined #openstack-lbaas | 17:08 | |
| *** ihrachys has joined #openstack-lbaas | 17:24 | |
| *** bana_k has quit IRC | 17:24 | |
| *** ihrachys has quit IRC | 17:29 | |
| *** ducttape_ has joined #openstack-lbaas | 17:42 | |
| *** ducttape_ has quit IRC | 17:46 | |
| *** ihrachys has joined #openstack-lbaas | 18:02 | |
| *** ihrachys has quit IRC | 18:05 | |
| *** ihrachys has joined #openstack-lbaas | 18:07 | |
| openstackgerrit | Lubosz Kosnik (diltram) proposed openstack/octavia: Adds a new feature to limit the amphora build rate https://review.openstack.org/303304 | 18:30 |
| *** rcernin has quit IRC | 19:47 | |
| *** ihrachys has quit IRC | 19:54 | |
| *** ducttape_ has joined #openstack-lbaas | 19:56 | |
| *** pcaruana has quit IRC | 20:06 | |
| *** ducttape_ has quit IRC | 20:21 | |
| *** cody-somerville has quit IRC | 21:19 | |
| *** ducttape_ has joined #openstack-lbaas | 21:21 | |
| *** ducttape_ has quit IRC | 21:27 | |
| *** ducttape_ has joined #openstack-lbaas | 21:42 | |
| *** ducttape_ has quit IRC | 21:55 | |
| *** ducttape_ has joined #openstack-lbaas | 22:15 | |
| *** cody-somerville has joined #openstack-lbaas | 22:21 | |
| *** cody-somerville has quit IRC | 22:21 | |
| *** cody-somerville has joined #openstack-lbaas | 22:21 | |
| *** ducttape_ has quit IRC | 22:47 | |
| *** ducttape_ has joined #openstack-lbaas | 23:02 | |
| *** gtrxcb has joined #openstack-lbaas | 23:05 | |
| *** gtrxcb has quit IRC | 23:07 | |
| *** gtrxcb has joined #openstack-lbaas | 23:08 | |
| *** ducttape_ has quit IRC | 23:42 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!