Wednesday, 2018-07-18

*** longkb has joined #openstack-lbaas00:33
*** threestrands has joined #openstack-lbaas00:40
*** threestrands has quit IRC00:40
*** threestrands has joined #openstack-lbaas00:40
*** harlowja has quit IRC01:13
*** JudeC has quit IRC01:17
*** annp has quit IRC01:43
*** hongbin has joined #openstack-lbaas01:57
*** logan- has quit IRC02:20
*** logan- has joined #openstack-lbaas02:21
*** ramishra has joined #openstack-lbaas02:55
*** annp has joined #openstack-lbaas03:11
*** hongbin has quit IRC03:49
*** yboaron has joined #openstack-lbaas03:56
*** kobis has joined #openstack-lbaas04:47
*** kobis has quit IRC04:51
*** dayou has joined #openstack-lbaas05:09
*** openstackgerrit has quit IRC05:10
*** links has joined #openstack-lbaas05:15
*** PagliaccisCloud has quit IRC05:16
*** lxkong has quit IRC05:16
*** dayou_ has quit IRC05:16
*** johnsom has quit IRC05:16
*** ctracey has quit IRC05:16
*** coreycb has quit IRC05:16
*** beisner has quit IRC05:16
*** jmccrory has quit IRC05:16
*** openstackgerrit has joined #openstack-lbaas05:17
openstackgerritYang JianFeng proposed openstack/octavia master: Add compute_flavor field for amphora api  https://review.openstack.org/58291405:17
*** JudeC has joined #openstack-lbaas05:18
*** PagliaccisCloud has joined #openstack-lbaas05:19
*** harlowja has joined #openstack-lbaas05:28
*** harlowja has quit IRC05:32
*** lxkong has joined #openstack-lbaas05:35
*** johnsom has joined #openstack-lbaas05:35
*** ctracey has joined #openstack-lbaas05:35
*** coreycb has joined #openstack-lbaas05:35
*** beisner has joined #openstack-lbaas05:35
*** jmccrory has joined #openstack-lbaas05:35
*** ianychoi has joined #openstack-lbaas05:43
*** dayou has quit IRC05:53
*** dayou has joined #openstack-lbaas05:54
*** phuoc_ has joined #openstack-lbaas06:26
*** phuoc has quit IRC06:29
*** pcaruana has joined #openstack-lbaas06:35
openstackgerritTuan Do Anh proposed openstack/neutron-lbaas master: Add release notes link in README  https://review.openstack.org/58126906:53
openstackgerritTuan Do Anh proposed openstack/octavia master: Update pypi url to new url  https://review.openstack.org/58209406:54
*** ispp has joined #openstack-lbaas07:00
*** peereb has joined #openstack-lbaas07:09
*** tesseract has joined #openstack-lbaas07:18
*** rcernin has quit IRC07:28
*** velizarx has joined #openstack-lbaas07:42
*** AlexeyAbashkin has joined #openstack-lbaas07:45
*** ktibi has joined #openstack-lbaas07:50
*** apuimedo has joined #openstack-lbaas07:51
cgoncalveswe should see green light from our gates now. https://review.openstack.org/#/c/583413/07:55
openstackgerritCarlos Goncalves proposed openstack/octavia master: Correct naming for quota resources  https://review.openstack.org/55967207:55
*** velizarx has quit IRC08:02
*** velizarx has joined #openstack-lbaas08:10
*** velizarx has quit IRC08:14
*** JudeC has quit IRC08:33
*** velizarx has joined #openstack-lbaas08:33
*** kobis has joined #openstack-lbaas08:39
*** threestrands has quit IRC08:51
*** salmankhan has joined #openstack-lbaas08:54
*** velizarx has quit IRC09:17
*** velizarx has joined #openstack-lbaas09:20
openstackgerritAdit Sarfaty proposed openstack/octavia master: Use object instead of object id in the drivers delete callbacks  https://review.openstack.org/57197409:30
*** evgenyf has joined #openstack-lbaas09:44
*** atoth has quit IRC10:14
*** kobis has quit IRC10:14
*** kobis has joined #openstack-lbaas10:17
*** kobis has quit IRC10:24
*** kobis has joined #openstack-lbaas10:35
*** dmellado has quit IRC10:36
*** dmellado has joined #openstack-lbaas10:42
*** annp has quit IRC11:00
*** atoth has joined #openstack-lbaas11:03
openstackgerritMerged openstack/octavia master: Add a config to surpress amphora logging  https://review.openstack.org/56674111:10
*** longkb has quit IRC11:55
*** velizarx has quit IRC12:18
*** amuller has joined #openstack-lbaas12:32
*** erjacobs has joined #openstack-lbaas12:33
*** velizarx has joined #openstack-lbaas12:34
*** kobis has quit IRC12:36
cgoncalvesdayou, hi. FYI not worth rechecking changes that depends on other changes that failed to merge and are still not verified :)12:59
dayoucgoncalves: aha, thanks, got it!13:00
cgoncalveshttps://review.openstack.org/#/c/577114/ is the one blocking other stable/queens patches13:01
cgoncalvesshould be merged soon13:01
*** velizarx has quit IRC13:59
*** velizarx has joined #openstack-lbaas14:02
*** kobis has joined #openstack-lbaas14:04
*** kobis has quit IRC14:17
*** peereb has quit IRC14:51
*** pcaruana has quit IRC14:56
*** yboaron has quit IRC14:57
*** kobis has joined #openstack-lbaas15:02
*** evgenyf has quit IRC15:09
*** kobis has quit IRC15:16
*** velizarx has quit IRC15:26
*** JudeC has joined #openstack-lbaas15:38
*** erjacobs has quit IRC15:41
*** ispp has quit IRC15:41
*** JudeC has quit IRC15:45
*** ktibi has quit IRC15:53
*** links has quit IRC15:55
*** pcaruana has joined #openstack-lbaas16:00
*** amuller has quit IRC16:07
*** JudeC has joined #openstack-lbaas16:25
*** AlexeyAbashkin has quit IRC16:36
*** AlexeyAbashkin has joined #openstack-lbaas16:39
*** AlexeyAbashkin has quit IRC16:43
*** atoth has quit IRC16:58
*** atoth has joined #openstack-lbaas16:58
*** tesseract has quit IRC17:35
*** atoth has quit IRC17:39
*** atoth has joined #openstack-lbaas17:40
*** JudeC has quit IRC17:42
*** JudeC has joined #openstack-lbaas17:59
*** JudeC has quit IRC18:03
*** JudeC has joined #openstack-lbaas18:07
*** pcaruana has quit IRC18:08
*** JudeC has quit IRC18:12
openstackgerritHongbin Lu proposed openstack/octavia master: [DNM] Test neutron change  https://review.openstack.org/58368918:21
*** kobis has joined #openstack-lbaas18:22
*** kobis has quit IRC18:24
*** kobis has joined #openstack-lbaas18:27
*** JudeC has joined #openstack-lbaas18:27
*** JudeC has quit IRC18:32
*** JudeC has joined #openstack-lbaas18:34
*** ramishra has quit IRC18:35
*** kobis has quit IRC18:35
*** amuller has joined #openstack-lbaas18:37
*** atoth has quit IRC18:39
*** amuller has quit IRC18:48
*** JudeC has quit IRC18:51
*** harlowja has joined #openstack-lbaas18:54
*** fnaval has quit IRC18:54
*** fnaval has joined #openstack-lbaas18:55
*** salmankhan has quit IRC18:59
*** JudeC has joined #openstack-lbaas19:18
*** JudeC has quit IRC19:31
*** atoth has joined #openstack-lbaas19:43
rm_workhey johnsom, any idea wtf this could happen? http://paste.openstack.org/show/QFHOLSYmDvRJ45Bn2q9N/19:51
rm_worki do a curl on the amp, get one thing, do it off the amp, get another19:51
rm_work10.x.x.x is the VIP (i'm outside the netns)19:51
rm_workand the :80 is ... dumb, i am not sure why but the user insists it needs to be on 80 even though it's set to HTTPS mode and the backend members are all :44319:52
johnsomrm_work Well, on the amp, outside the netns you are connecting via the amp's default route, so likely hitting another host. There is no route from outside the netns to the VIP in the netns (by design).19:54
rm_workumm wut19:54
johnsomTo hit the vip from inside the amp, you must be inside the netns and up the loopback inteface (inside the netns).19:55
rm_workwtf host would respond on this same IP19:55
johnsomThen you will be sure you are hitting the VIP19:55
rm_workwtf even19:55
johnsomThat my friend is for you to figure out what that windows IIS server is....19:55
johnsomServer: Microsoft-IIS/10.019:56
rm_workhow am i getting constant responses on the *VIP* address19:56
johnsomThat isn't us!19:56
rm_workwtf19:56
johnsomGuess it could be the member server though19:56
johnsomDo the certs match?  You snipped the content.19:57
*** atoth has quit IRC19:59
rm_workhmm19:59
*** atoth has joined #openstack-lbaas19:59
rm_workyes20:00
rm_workbut yeah it doesn't look like it's going through haproxy for these lol20:00
rm_workwatching the logs20:00
rm_workrequests from inside don't make a connection log line20:01
johnsom#startmeeting Octavia20:01
openstackMeeting started Wed Jul 18 20:01:00 2018 UTC and is due to finish in 60 minutes.  The chair is johnsom. Information about MeetBot at http://wiki.debian.org/MeetBot.20:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.20:01
*** openstack changes topic to " (Meeting topic: Octavia)"20:01
openstackThe meeting name has been set to 'octavia'20:01
johnsomHi all20:01
johnsom#topic Announcements20:01
*** openstack changes topic to "Announcements (Meeting topic: Octavia)"20:01
johnsomThe Rocky priority bugs list is still going on....20:01
cgoncalveshi20:02
johnsom#link https://etherpad.openstack.org/p/octavia-priority-reviews20:02
johnsomplease help with reviews!20:02
johnsomAlso, our python-octaviaclient release deadline is next week: July 26th20:02
johnsomWe have two patches we want in, backup members and UDP20:02
cgoncalveswe've made really good progress. only one patch in WIP. 38 tracked patches merged20:03
johnsomI have used the UDP will success, just need to finish reviewing it20:03
johnsomYeah, we have20:03
johnsomSome big stuff still open though20:03
cgoncalvesshould we merge the UDP client patch before the server-side work?20:03
johnsomAny other announcements?20:04
johnsomWell, if we are confident we can get UDP in, I think so.  The user will get a sane error if the API doesn't support UDP20:04
cgoncalvesok. good enough20:05
johnsomThey should get a 400 with protocol not supported20:05
johnsom#topic Brief progress reports / bugs needing review20:06
*** openstack changes topic to "Brief progress reports / bugs needing review (Meeting topic: Octavia)"20:06
johnsomI have been doing some reviews, but have been mostly focused on an internal fire drill.20:06
nmagneziO/20:06
johnsomIf I can get something working today, I should be in good shape to focus upstream again.20:07
johnsomI have an environment setup to address the issue cgoncalves noted on the dual down amp patch.  Just need time to focus on it to fix it.20:07
johnsomAny other updates today?20:08
nmagneziI hope we'll have this merged soon20:09
nmagnezi#link https://review.openstack.org/#/c/580724/420:09
johnsomFeature freeze is also next week, so...20:09
nmagneziThe back port for queens is already in place20:09
cgoncalvespatch "Automatically set Barbican ACLs" is ready for reviewing. this is something I'd like to have merged soon20:09
cgoncalves#link https://review.openstack.org/55254920:10
johnsomTimed out on functional... sigh20:10
johnsomYeah, me too20:10
johnsomThanks for helping track down the DIB/pylint issue BTW20:11
cgoncalvessure, glad I could help20:11
johnsom#topic Open Discussion20:12
*** openstack changes topic to "Open Discussion (Meeting topic: Octavia)"20:12
johnsomOther topics today?20:12
johnsomIt's a real bummer this internal thing landed early and right at the end of the cycle.20:12
cgoncalvesmerge open queens backports and tag20:12
johnsomYes. Please ping me if you think we have in what we need.  A second set of eyes tracking that would be helpful20:13
johnsomI reviewed a bunch of backport stuff yesterday20:13
cgoncalvesoh, wait. most got merged a few hours ago20:13
cgoncalvesI think we could tag it as is now20:14
johnsomAren't we missing limits and the failover fix?20:14
nmagneziLet's also include https://review.openstack.org/#/c/583233/ :-)20:14
*** JudeC has joined #openstack-lbaas20:15
cgoncalvesif we can have them merged soon, yes :)20:15
cgoncalvesfailover fix is super important, definitely20:16
johnsomyes20:16
johnsomAny other topics today?20:17
johnsomI'm seeing some people kill -9 the controllers which leaves things in a bad state.20:18
nmagneziAnd story filed for this? To get some more details..20:19
johnsomI'm toying with the idea of having the controllers have Ids of some sort.  Then when a controller takes ownership of an object, we save the owning contorller ID in the DB. Then if someone kill -9 the controller, it can search on startup and if there is an object marked as the controller owning it, it would automatically move it to ERROR.20:20
johnsomKind of an interim solution until someone takes on the flow recovery work20:20
johnsomusing taskflow20:20
johnsomThoughts? (other than file a story, grin)20:21
johnsomHa, ok then20:23
johnsomIn the interim interim I'm telling folks to stop doing that and use graceful shutdown20:23
nmagneziHaha20:24
johnsomAny other topics today?20:25
johnsomOtherwise I will close out the meeting and go back to fighting RPC issues in third party code....20:26
cgoncalvesgo for it :)20:26
johnsomOk, thanks folks!  Have a good week20:26
johnsom#endmeeting20:26
*** openstack changes topic to "Discussion of OpenStack Load Balancing (Octavia) | https://etherpad.openstack.org/p/octavia-priority-reviews"20:26
openstackMeeting ended Wed Jul 18 20:26:57 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)20:26
openstackMinutes:        http://eavesdrop.openstack.org/meetings/octavia/2018/octavia.2018-07-18-20.01.html20:27
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/octavia/2018/octavia.2018-07-18-20.01.txt20:27
openstackLog:            http://eavesdrop.openstack.org/meetings/octavia/2018/octavia.2018-07-18-20.01.log.html20:27
rm_workjohnsom: BTW, i realized why i have a route in -- because I use FLIPs :P20:28
johnsomSo figured out your issue?20:28
rm_workso it's possible to access the inside of the netns, from outside20:28
rm_workno, issue is still perplexing20:28
rm_workso that IIS server IS one of the backends20:28
johnsomIs it super slow to respond?20:28
rm_workthe log message just doesn't show up for the whole "timeout" period20:28
johnsomCould it be a timeout setting?20:29
rm_worki get for 403 immediately20:29
johnsomRight, haproxy, by default, doesn't drop the log line until the session is finished20:29
rm_workbut then the haproxy log gives me a line after the timeout period that says the server disconnected20:29
rm_workyeah20:29
rm_workbut only when i do the curl from on the amp20:29
rm_worklol20:29
rm_workwhen i do the curl off the amp, i get the SSLRead error20:29
rm_worki wonder if it's my curl build20:29
rm_workyeah wtf20:30
rm_workif i do it with wget i get the same thing20:30
rm_worki mean, as on the amp20:30
rm_workso my curl is just f'd20:30
rm_workOSX curl20:30
rm_workwonder if i can get one from homebrew20:31
rm_workhmm, homebrew curl has the same issue20:33
johnsomYeah, I was just going to say, that code is specific to macos so I can't look it up20:33
johnsomIt's something proprietary in their SSL library20:34
johnsomSo, use an ubuntu vm....  grin20:34
johnsomOr dig through macos SDKs to see if you can find the header file that has that code in it....20:34
rm_workahh20:43
rm_work`brew install curl --with-openssl`20:43
rm_workmac SSL lib is shit20:43
rm_workon Yosemite20:43
rm_workoh, i'm on El Capitan20:43
rm_workbut same deal20:43
rm_workit's too old/broken to negotiate with newer servers20:44
rm_workyep ok error goes away now20:46
*** rtjure has joined #openstack-lbaas20:50
*** rtjure has quit IRC20:57
*** kobis has joined #openstack-lbaas20:57
rm_worki still don't understand why we can't update the Type of a HM20:57
rm_workseems arbitrary20:58
rm_worksure you can delete / create, but that's two ops instead of one, and leaves the LB without a HM for a moment20:58
rm_workjust seems awkward20:58
*** rtjure has joined #openstack-lbaas21:00
*** kobis has quit IRC21:03
*** salmankhan has joined #openstack-lbaas21:07
johnsomWe figured out the reason for that a while ago...21:38
johnsomHowever I don't remember now21:38
johnsomI think it was because if you have an HTTP HM, then switch to TCP, all of the HTTP options like url_path, etc. would have to be specified as null/None to clear them out. So that command becomes massive instead of just delete/create21:40
rm_workyeah all that means is that we're lazy22:06
rm_workbecause we could do that on the API side easily lol22:06
openstackgerritMerged openstack/octavia master: Add the missing markup for the hyperlink title  https://review.openstack.org/58165022:06
*** salmankhan has quit IRC22:21
*** rcernin has joined #openstack-lbaas22:32
*** fnaval has quit IRC22:54
openstackgerritMerged openstack/octavia master: Add lb_id comment to amp haproxy listener config  https://review.openstack.org/57273023:35
*** threestrands has joined #openstack-lbaas23:50
*** threestrands has quit IRC23:50
*** threestrands has joined #openstack-lbaas23:50

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!