Wednesday, 2017-02-22

*** armax has joined #openstack-lbaas00:04
johnsomIt is a late night for me.  I will ping you if I get some time00:18
johnsomHaving dinner with the release team00:31
rm_workhave fun!00:32
*** amotoki has joined #openstack-lbaas00:35
*** amotoki has quit IRC00:35
*** armax has quit IRC00:48
*** csomerville has quit IRC00:50
*** catintheroof has quit IRC00:51
*** ShaneR_ has joined #openstack-lbaas00:52
*** armax has joined #openstack-lbaas01:04
*** gongysh has joined #openstack-lbaas01:15
*** ducttape_ has quit IRC01:19
*** ducttape_ has joined #openstack-lbaas01:20
*** yamamoto_ has joined #openstack-lbaas01:20
*** openstackgerrit has quit IRC01:23
*** ducnc has quit IRC01:31
*** ducnc has joined #openstack-lbaas01:31
*** openstackgerrit has joined #openstack-lbaas01:33
openstackgerritcheng proposed openstack/neutron-lbaas master: Add decorator for lbaasv2 get_l7policies  https://review.openstack.org/43365801:33
*** fnaval has quit IRC01:35
*** fnaval has joined #openstack-lbaas01:36
*** yamamoto_ has quit IRC01:40
*** yamamoto_ has joined #openstack-lbaas01:41
*** yamamoto_ has quit IRC02:09
*** yamamoto_ has joined #openstack-lbaas02:19
*** yamamoto_ has quit IRC02:24
*** yuanying has quit IRC02:32
*** yamamoto_ has joined #openstack-lbaas02:35
*** yamamoto_ has quit IRC02:39
*** yamamoto_ has joined #openstack-lbaas02:50
*** sanfern has joined #openstack-lbaas02:52
*** yamamoto_ has quit IRC02:54
*** yamamoto_ has joined #openstack-lbaas03:05
*** KeithMnemonic has joined #openstack-lbaas03:05
*** yamamoto_ has quit IRC03:09
*** gongysh has quit IRC03:14
*** KeithMnemonic has quit IRC03:15
*** gongysh has joined #openstack-lbaas03:15
*** yamamoto_ has joined #openstack-lbaas03:20
*** yamamoto_ has quit IRC03:24
*** yuanying has joined #openstack-lbaas03:34
*** yamamoto_ has joined #openstack-lbaas03:35
rm_workwtffff03:35
*** yamamoto_ has quit IRC03:39
*** yamamoto_ has joined #openstack-lbaas03:49
*** yamamoto_ has quit IRC03:54
*** links has joined #openstack-lbaas03:58
rm_workWOOO failover working with FLIP driver03:59
* rm_work dies03:59
*** yamamoto_ has joined #openstack-lbaas04:05
*** yamamoto_ has quit IRC04:09
*** yamamoto_ has joined #openstack-lbaas04:20
*** yamamoto_ has quit IRC04:24
*** kobis has joined #openstack-lbaas04:30
*** shane has quit IRC05:08
*** yamamoto_ has joined #openstack-lbaas05:27
*** yamamoto_ has quit IRC05:32
*** gongysh has quit IRC05:40
*** fnaval has quit IRC06:15
*** ShaneR_ has quit IRC06:20
*** yamamoto_ has joined #openstack-lbaas06:29
*** gcheresh has joined #openstack-lbaas06:29
*** Alex_Staf has joined #openstack-lbaas06:31
*** krypto has joined #openstack-lbaas06:32
*** armax has quit IRC06:34
*** yamamoto_ has quit IRC06:34
*** cody-somerville has joined #openstack-lbaas06:37
*** cody-somerville has quit IRC06:37
*** cody-somerville has joined #openstack-lbaas06:37
*** csomerville has joined #openstack-lbaas06:47
*** cody-somerville has quit IRC06:47
*** cody-somerville has joined #openstack-lbaas06:56
*** csomerville has quit IRC06:58
*** reedip_ has quit IRC07:07
*** rcernin has joined #openstack-lbaas07:08
*** tesseract has joined #openstack-lbaas07:10
*** reedip_ has joined #openstack-lbaas07:21
*** yamamoto_ has joined #openstack-lbaas07:31
*** yuanying has quit IRC07:33
*** yamamoto_ has quit IRC07:37
*** kobis has quit IRC07:42
*** eezhova has joined #openstack-lbaas07:43
*** jsheeren has joined #openstack-lbaas07:44
*** Alex_Staf has quit IRC07:53
*** kobis has joined #openstack-lbaas08:11
*** yuanying has joined #openstack-lbaas08:15
*** yamamoto has joined #openstack-lbaas08:33
*** yamamoto has quit IRC08:40
*** gongysh has joined #openstack-lbaas08:46
openstackgerritReedip proposed openstack/neutron-lbaas master: Assign dns-name to port during LB creation  https://review.openstack.org/40477408:55
openstackgerritReedip proposed openstack/neutron-lbaas master: Assign dns-name to port during LB creation  https://review.openstack.org/40477409:08
*** jsheeren has left #openstack-lbaas09:10
*** Alex_Staf has joined #openstack-lbaas09:17
*** belharar has joined #openstack-lbaas09:26
*** yamamoto has joined #openstack-lbaas09:26
*** ducnc has quit IRC09:35
*** shane has joined #openstack-lbaas09:44
*** gongysh has quit IRC09:48
*** krypto has quit IRC10:13
*** krypto has joined #openstack-lbaas10:13
*** krypto has quit IRC10:13
*** krypto has joined #openstack-lbaas10:13
*** yamamoto_ has joined #openstack-lbaas10:21
*** yamamoto has quit IRC10:21
*** links has quit IRC10:32
*** shane has quit IRC10:32
openstackgerritZhixin Li proposed openstack/neutron-lbaas master: Expose provisioning_status and operating_status for all top level objects  https://review.openstack.org/40578010:55
*** ShaneR has joined #openstack-lbaas10:59
*** ShaneR has quit IRC11:09
*** sanfern has quit IRC11:19
*** jsheeren has joined #openstack-lbaas11:35
*** krypto has quit IRC11:58
*** krypto has joined #openstack-lbaas11:59
*** krypto has quit IRC11:59
*** krypto has joined #openstack-lbaas11:59
*** tesseract has quit IRC12:06
*** tesseract has joined #openstack-lbaas12:06
*** tesseract is now known as tesseract-RH12:07
*** krypto has quit IRC12:10
*** krypto has joined #openstack-lbaas12:11
*** krypto has quit IRC12:16
*** armax has joined #openstack-lbaas12:43
*** pcaruana has joined #openstack-lbaas12:44
*** links has joined #openstack-lbaas13:06
*** mdurrant_ has joined #openstack-lbaas13:07
*** mdurrant has quit IRC13:10
*** chlong has quit IRC13:18
*** darrenc has quit IRC13:35
*** belharar has quit IRC13:35
*** darrenc has joined #openstack-lbaas13:37
*** armax has quit IRC13:38
*** yamamoto_ has quit IRC13:41
*** yamamoto has joined #openstack-lbaas13:43
*** yamamoto has quit IRC13:44
*** amotoki has joined #openstack-lbaas14:00
*** m-greene has joined #openstack-lbaas14:01
*** m-greene has quit IRC14:03
*** armax has joined #openstack-lbaas14:05
*** yamamoto has joined #openstack-lbaas14:06
*** m-greene has joined #openstack-lbaas14:10
*** m-greene has quit IRC14:10
*** KeithMnemonic has joined #openstack-lbaas14:11
*** matt-borland has joined #openstack-lbaas14:18
*** yamamoto has quit IRC14:18
*** yamamoto has joined #openstack-lbaas14:21
*** reedip_1 has joined #openstack-lbaas14:22
*** chlong has joined #openstack-lbaas14:26
*** links has quit IRC14:41
johnsomblogan ping14:43
*** tesseract-RH has quit IRC14:44
*** jsheeren has left #openstack-lbaas14:45
*** yamamoto has quit IRC14:50
*** aleph1 has quit IRC14:51
*** aleph1 has joined #openstack-lbaas14:51
*** yamamoto has joined #openstack-lbaas14:53
*** tesseract-RH has joined #openstack-lbaas15:00
*** sanfern has joined #openstack-lbaas15:02
*** reedip_ has quit IRC15:07
*** armax has quit IRC15:08
*** yamamoto has quit IRC15:08
*** reedip_ has joined #openstack-lbaas15:20
*** armax has joined #openstack-lbaas15:23
*** yamamoto has joined #openstack-lbaas15:30
*** fnaval has joined #openstack-lbaas15:32
*** yamamoto has quit IRC15:35
*** yamamoto has joined #openstack-lbaas15:36
*** catintheroof has joined #openstack-lbaas15:43
johnsomKeithMnemonic https://docs.openstack.org/developer/octavia/guides/basic-cookbook.html#deploy-a-tls-terminated-https-load-balancer15:45
xgermanhttps://docs.hpcloud.com/hos-3.x/helion/userguide/lbaas.html15:45
*** alee has joined #openstack-lbaas15:48
*** dave-mcc_ has joined #openstack-lbaas15:49
johnsomhttps://docs.openstack.org/developer/octavia/guides/basic-cookbook.html#deploy-a-tls-terminated-https-load-balancer15:49
*** jmccrory has joined #openstack-lbaas15:49
*** r-browne has joined #openstack-lbaas15:53
*** r-browne has left #openstack-lbaas15:54
*** r-browne has joined #openstack-lbaas15:55
ankur-gupta-f1johnsom: ping15:59
*** yamamoto has quit IRC15:59
*** yamamoto has joined #openstack-lbaas15:59
*** r-browne has quit IRC16:02
*** gcheresh has quit IRC16:05
*** tesseract-RH has quit IRC16:11
*** KeithMnemonic has quit IRC16:18
*** KeithMnemonic has joined #openstack-lbaas16:19
*** kobis1 has joined #openstack-lbaas16:20
*** kobis has quit IRC16:20
*** kobis1 has quit IRC16:24
*** kobis has joined #openstack-lbaas16:24
nmagnezijohnsom, o/16:27
bloganjohnsom: pong16:28
*** kobis has quit IRC16:30
*** catintheroof has quit IRC16:33
*** catintheroof has joined #openstack-lbaas16:38
*** catintheroof has quit IRC16:38
*** catintheroof has joined #openstack-lbaas16:38
*** yamamoto has quit IRC16:39
*** KeithMnemonic has quit IRC16:40
*** yamamoto has joined #openstack-lbaas16:40
*** catintheroof has quit IRC16:43
*** reedip_1 has quit IRC16:50
*** amotoki has quit IRC16:50
*** catintheroof has joined #openstack-lbaas16:53
*** Alex_Staf has quit IRC16:55
*** yamamoto has quit IRC16:55
*** catintheroof has quit IRC16:58
openstackgerritAnkur proposed openstack/octavia master: Add tempesttest for the N-LBaaS API  https://review.openstack.org/41369717:00
*** yamamoto has joined #openstack-lbaas17:05
*** rcernin has quit IRC17:05
*** armax has quit IRC17:08
*** amotoki has joined #openstack-lbaas17:11
johnsomblogan Sorry, got pulled into a discussion.  My question was about who creates the VIP port in the vendor driver scenario in nlbaas?  Do we allow the drivers to manage /create the VIP or do we always pass them a VIP?17:14
*** dave-mcc_ has quit IRC17:14
*** catintheroof has joined #openstack-lbaas17:15
*** alee has quit IRC17:15
bloganjohnsom: a driver has the option to say it'll handle allocating a vip, but that was added for special octavia scenarios, no other driver made use of it, so all the other drivers expected the vip port to be created before it got passed control17:15
ankur-gupta-f4But the shim!!17:16
johnsomblogan Ok, thanks!17:17
bloganjohnsom: as part of the shim work i did, i did handle that case so that the shim would go create a neutron port first and then pass control to the shimmed driver17:17
*** catintheroof has quit IRC17:18
*** catintheroof has joined #openstack-lbaas17:19
*** yamamoto has quit IRC17:43
*** dave-mccowan has joined #openstack-lbaas17:50
*** bcafarel has quit IRC17:50
*** dave-mccowan has quit IRC17:55
*** dave-mccowan has joined #openstack-lbaas17:55
*** dave-mccowan has quit IRC18:01
*** armax has joined #openstack-lbaas18:04
*** dave-mccowan has joined #openstack-lbaas18:10
*** armax has quit IRC18:13
*** reedip_1 has joined #openstack-lbaas18:19
*** yamamoto has joined #openstack-lbaas18:24
*** amotoki has quit IRC18:24
*** alee has joined #openstack-lbaas18:25
*** bbbbzhao_ has joined #openstack-lbaas18:28
*** armax has joined #openstack-lbaas18:28
*** amotoki has joined #openstack-lbaas18:29
*** KeithMnemonic has joined #openstack-lbaas18:49
*** cody-somerville has quit IRC18:55
*** cody-somerville has joined #openstack-lbaas18:55
*** cody-somerville has quit IRC18:55
*** cody-somerville has joined #openstack-lbaas18:55
*** yamamoto has quit IRC19:03
*** yamamoto has joined #openstack-lbaas19:04
*** yamamoto has quit IRC19:13
*** yamamoto has joined #openstack-lbaas19:14
*** rcernin has joined #openstack-lbaas19:25
*** gcheresh has joined #openstack-lbaas19:36
*** dileepr has joined #openstack-lbaas19:38
*** catintheroof has quit IRC19:48
*** yamamoto has quit IRC19:50
*** anilvenkata has joined #openstack-lbaas19:51
*** csomerville has joined #openstack-lbaas19:56
*** cody-somerville has quit IRC19:59
rm_workjohnsom / blogan: wait, so does n-lbaas create the vip port *during* the API call, so it can return an ip_address for the VIP in the initial create call??20:10
*** catintheroof has joined #openstack-lbaas20:11
*** catintheroof has quit IRC20:11
*** catintheroof has joined #openstack-lbaas20:12
ankur-gupta-f4rm_work: https://github.com/openstack/neutron-lbaas/blob/master/neutron_lbaas/db/loadbalancer/loadbalancer_dbv2.py#L12120:13
ankur-gupta-f4https://github.com/openstack/neutron-lbaas/blob/master/neutron_lbaas/db/loadbalancer/loadbalancer_dbv2.py#L329 though apparently in different transaction20:14
*** reedip_1 has quit IRC20:16
*** reedip_1 has joined #openstack-lbaas20:17
*** anilvenkata has quit IRC20:20
bloganrm_work: https://github.com/openstack/neutron-lbaas/blob/master/neutron_lbaas/db/loadbalancer/loadbalancer_dbv2.py#L33120:22
bloganrm_work: so yes20:22
*** chlong has quit IRC20:33
*** chlong has joined #openstack-lbaas20:35
*** KeithMnemonic has quit IRC20:39
*** cpuga has joined #openstack-lbaas20:41
*** cpuga has quit IRC20:46
*** mugsie has quit IRC20:50
rm_workjohnsom: pretty sure I just found a bug where if the amp gets deleted in nova, we'll leave behind the orphaned vrrp_port20:54
rm_workalso, fixed it20:54
rm_workwas that something we were aware of?20:55
johnsomNo, I did a ton of work to make sure that didn't happen in Newton, so curious how it was actually happening20:55
rm_workwhat actually cleans up the ports?20:56
rm_worknot seeing that code20:56
*** ShaneR_ has joined #openstack-lbaas20:57
johnsomWell, for VRRP that is the base port, so it should be deleted when the nova instance is deleted.20:57
johnsomNo,20:57
rm_workthe only thing i even see for cleaning up ports on failover is something I added, and the trick is that you need to clean them up by name, because looking for plugged interfaces on a deleted VM doesn't come up with anything20:57
johnsomThat is owned by us, that is in the failover flow20:57
rm_workOH yeah nevermind20:57
rm_workderp20:58
rm_workit's only a thing with flips20:58
rm_workthis is why I asked, seemed to obvious20:58
rm_work*too20:58
*** shane has joined #openstack-lbaas20:58
rm_workjohnsom: last question for a bit: https://github.com/openstack/octavia/blob/master/octavia/controller/worker/flows/amphora_flows.py#L32621:07
rm_workWHY?21:07
rm_worki can't see any harm in setting it now21:07
rm_workin fact, it seems it would break anti-affinity by NOY21:07
rm_work*NOT21:07
johnsomlook21:07
*** mugsie has joined #openstack-lbaas21:08
*** pcaruana has quit IRC21:12
rm_workignore me if you're actually in meetings and stuff, obviously :P21:12
rm_workdon't know what's going on over there presently21:12
johnsomRight, the comment is really just capturing that this setting doesn't really get implemented filled in until later.  We just have to put a value in here because we are reusing the flow21:14
johnsomSorry, yeah in a meeting talking about what we should do about the 'agent" list21:15
johnsomSorry, I should be updating etherpad more.21:15
rm_workjohnsom: I think you will miss anti-affinity if you don't give it the correct role there21:17
rm_workALSO, I don't see any reason why you would AVOID setting it correctly to begin with, since passing it there means you don't need to set it later21:17
johnsomThere was some need to actually define that later, I can't remember off my head now.  To busy in this discussion to dig through code21:19
rm_workand other flows could be expecting to know what role they're dealing with21:19
rm_workkk21:19
rm_worki'll hit you up later21:19
*** amotoki has quit IRC21:24
*** chlong has quit IRC21:25
*** anilvenkata has joined #openstack-lbaas21:26
*** armax has quit IRC21:29
*** mariusv has quit IRC21:31
*** reedip_1 has quit IRC21:32
*** lunarlamp has joined #openstack-lbaas21:37
*** chlong has joined #openstack-lbaas21:39
*** amotoki has joined #openstack-lbaas21:39
*** anilvenkata has quit IRC21:42
*** gcheresh has quit IRC21:45
*** KeithMnemonic has joined #openstack-lbaas21:53
*** armax has joined #openstack-lbaas21:57
*** reedip_1 has joined #openstack-lbaas22:05
*** shane is now known as ShaneDavidson22:06
*** amotoki has quit IRC22:07
*** chlong has quit IRC22:10
*** yamamoto has joined #openstack-lbaas22:18
*** amotoki has joined #openstack-lbaas22:21
*** amotoki has quit IRC22:22
*** amotoki has joined #openstack-lbaas22:23
*** KeithMnemonic has quit IRC22:24
*** KeithMnemonic has joined #openstack-lbaas22:25
*** eezhova has quit IRC22:26
*** reedip_1 has quit IRC22:27
*** amotoki has quit IRC22:28
*** matt-borland has quit IRC22:30
*** amotoki has joined #openstack-lbaas22:36
*** dave-mccowan has quit IRC22:46
*** alee has quit IRC22:46
*** catintheroof has quit IRC22:47
*** fnaval has quit IRC23:10
rm_workjohnsom: looks like cascade-deleting a LB doesn't clean up quotas for pools or members23:16
rm_workchecking into it23:17
johnsomYou are making me feel unworthy.....23:17
johnsomI went down that strange side flow that was created for that23:18
johnsomI must have missed something23:18
rm_workinteresting, also randomly i get this from some amphora, i wonder if it is a clock thing?23:19
rm_work/10.32.47.19223:19
rm_workerr23:19
rm_worknot that23:19
*** ShaneR_ has quit IRC23:19
rm_work[2017-02-22 23:18:24 +0000] [1330] [DEBUG] Invalid request from ip=::ffff:10.32.60.187: [SSL: SSL_SESSION_ID_CALLBACK_FAILED] ssl session id callback failed (_ssl.c:1977)23:19
rm_work[2017-02-22 23:18:25 +0000] [1330] [DEBUG] Error processing SSL request.23:19
rm_workthat23:19
*** armax has quit IRC23:19
rm_work(in the amphora-agent log; the controller just sees a connect failure and keeps retrying)23:20
johnsomThat is the amp isn't responding fast enough and the requests timeout on the controller is cutting the connection before the amp agent responds.23:25
johnsomSlow amp vm?23:25
johnsomI haven't seen that since we went gunicorn23:25
johnsomWe have a config setting you can turn up23:26
johnsomTake a look at an amp debug log and see what step is taking so long in the amp agent23:27
rm_worki had turned it down23:27
*** rcernin has quit IRC23:27
rm_workbut it's failing wellllll inside that time23:27
rm_worklike, instantly23:27
rm_workit was on the plug_vip23:27
johnsomHmm, yeah, maybe check clock skew23:28
rm_workit's just like23:28
rm_workone bad amp23:28
rm_workand it got deleted T_T23:28
rm_workoh maybe it didn't23:28
rm_workanyway, the other thing i'm noticing23:29
johnsomI had that happen when the if-up was doing something dumb, like there was no dhcp on the net23:29
rm_workis that EVERY delete appears to be a cascade?23:29
rm_workI mean, I definitely didn't pass anything that said "cacade=True"23:29
rm_worktrying to trace through why that'd be the case23:30
*** ShaneR_ has joined #openstack-lbaas23:32
rm_workunless ... the only difference between "delete" and "cascade delete" is the pools?23:33
rm_workbut, they're getting deleted anyway23:33
rm_work...23:33
rm_workthis is a little bit confusing23:37
rm_workso it's SUPPOSED to be:23:38
rm_workhttp://octavia_api:9876/loadbalancers/<lbid>/delete_cascade23:39
rm_workit seems23:39
rm_workerr, forgot /v1/ whatever23:39
rm_workanyway23:39
rm_worki'm definitely not calling it with that23:39
rm_workah yeah sooooo23:43
rm_workregular delete: cascades, except doesn't clean up quotas for pool/members23:44
rm_workcascade delete: has an exception because the flow is wrong >_>23:44
rm_work2017-02-22 16:43:31.506 7635 ERROR oslo_messaging.rpc.server MissingDependencies: 'linear_flow.Flow: octavia-delete-loadbalancer-flow(len=12)' requires ['pool_child_count'] but no other entity produces said requirements23:45
rm_workget_delete_pool_flow_internal is missing some stuff23:48
rm_workk i think i got it23:58
rm_workcascade_delete should work now? though that doesn't explain why the regular delete DOES a cascade delete >_>23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!