Friday, 2017-05-05

harlowjarm_work well sort of, thinking about how u turn things off (in deterministic) or make them crash tolerant (so they don't poo everywhere)  is what i do :-P00:00
harlowjaone solution i ended up at was taskflow00:00
xgermanand we are using it ;-)00:01
rm_workyes, and I have come around to appreciating it00:01
harlowjalol00:01
rm_workit's just funny how often the answer to anything is taskflow ^_^00:01
harlowjawell livness is tooz :-P00:02
harlowjaha00:02
harlowjaso i just switched the 't' to a different one00:02
harlowjalol00:02
xgermanI am not so on board with etcd — I don’t like there insistence on 3 servers for redundancy00:04
harlowjathats mainly a side-effect of there usage of RAFT consenus algorithm internally00:05
xgermanyep, and if 1/3 fails it stops accepting stuff00:05
xgermanand goes read only00:06
harlowjalikely00:06
harlowjathough i'd assume anyone operating a cloud is already used to this 3 rule00:06
*** sshank has quit IRC00:06
harlowjafor mysql, or galera, or ...00:06
xgermanwell, you can run all those things ACTIVE-PASSIVE if you choose to do so00:07
xgermanpretty sure galera still writes./reads even if a node fails00:08
*** fnaval has quit IRC00:09
harlowjadoesn't need a concept of quorum?00:09
*** JudeC has quit IRC00:09
xgermanhttp://galeracluster.com/documentation-webpages/recovery.html00:09
xgermantwo are enough00:09
harlowjakk, must have a slightly different consistently model00:10
harlowja*consistency00:10
xgermanyep00:12
xgermanalso it can run master/slave00:12
xgermanif we would go the toonz (etcd) way we would be a victim of etcd-reduduancy and galera00:14
xgermanunless we cut galera out in that case00:14
xgermanwhich would decrease our redundancy00:14
xgermanso *shrug*00:14
harlowjaso then another question becomes, who is using galera with octavia :-P00:16
xgermanI think we are dead in the water without our DB00:20
harlowjasuper-dead?00:20
harlowjaor mostly dead?00:20
harlowjaor super-mostly dead00:21
xgermanour control plane is dead; load balancers wil work00:21
harlowjalol00:21
xgermanbut DBs have been around +50 years and mankind has figured out how to keep them availble 99.99900:22
*** jerrygb has joined #openstack-lbaas00:22
harlowjanot enough 9s00:25
harlowjalol00:25
*** jerrygb has quit IRC00:26
*** JudeC has joined #openstack-lbaas00:27
*** sanfern has joined #openstack-lbaas00:44
*** sshank has joined #openstack-lbaas00:45
*** sshank has quit IRC00:50
*** yamamoto has joined #openstack-lbaas00:51
*** yamamoto has quit IRC00:54
*** MoguCloud has quit IRC00:57
*** JudeC has quit IRC01:00
*** eandersson has quit IRC01:06
*** JudeC has joined #openstack-lbaas01:14
rm_workugh waiting for the DIB fix to make it through the gate so i can start rechecking stuff01:23
rm_workit was basically through and then one of the jobs randomly broke on a connection error01:23
rm_workso had to recheck >_<01:23
rm_workwhich means check + gate T_T01:24
rm_workblegh01:24
*** sanfern has quit IRC01:36
rm_workok here goes again >_<01:45
*** gongysh has joined #openstack-lbaas02:10
*** jerrygb has joined #openstack-lbaas02:11
*** armax has quit IRC02:12
*** fnaval has joined #openstack-lbaas02:19
openstackgerritOpenStack Proposal Bot proposed openstack/neutron-lbaas master: Updated from global requirements  https://review.openstack.org/46211102:26
*** jerrygb has quit IRC03:07
*** fnaval has quit IRC03:17
*** fnaval has joined #openstack-lbaas03:19
*** armax has joined #openstack-lbaas03:25
openstackgerritJude Cross proposed openstack/python-octaviaclient master: [WIP] Add l7rule commands to client  https://review.openstack.org/46280803:28
*** JudeC has quit IRC03:36
*** yamamoto has joined #openstack-lbaas03:42
*** yamamoto has quit IRC03:50
*** armax has quit IRC04:00
*** gongysh has quit IRC04:20
*** armax has joined #openstack-lbaas04:27
openstackgerritMerged openstack/octavia master: Remove log translations from octavia  https://review.openstack.org/44787204:30
*** armax has quit IRC04:41
*** mdavidson has quit IRC04:49
*** mdavidson has joined #openstack-lbaas05:02
openstackgerritMerged openstack/octavia master: Add some hacking checks borrowed from neutron  https://review.openstack.org/46233405:06
*** fnaval has quit IRC05:07
*** gcheresh has joined #openstack-lbaas05:12
*** links has joined #openstack-lbaas05:13
*** gongysh has joined #openstack-lbaas05:19
*** JudeC has joined #openstack-lbaas05:21
*** gcheresh has quit IRC05:21
openstackgerritJude Cross proposed openstack/python-octaviaclient master: [WIP] Add l7rule commands to client  https://review.openstack.org/46280805:21
openstackgerritcheng proposed openstack/octavia master: Add monitor address and port to pool member  https://review.openstack.org/46164905:32
*** JudeC has quit IRC05:50
openstackgerritIan Wienand proposed openstack/octavia master: [DNM] testing dib block-device refactor  https://review.openstack.org/46282405:51
*** cpuga has joined #openstack-lbaas06:03
*** cpuga has quit IRC06:03
*** links has quit IRC06:04
*** pcaruana has joined #openstack-lbaas06:11
*** links has joined #openstack-lbaas06:22
*** voelzmo has joined #openstack-lbaas06:26
*** gongysh has quit IRC06:37
openstackgerritAdam Harwell proposed openstack/octavia master: Add support for single-create for APIv2  https://review.openstack.org/45903206:38
openstackgerritAdam Harwell proposed openstack/octavia master: Implement sorting and pagination for octavia  https://review.openstack.org/38214706:43
openstackgerritAdam Harwell proposed openstack/octavia master: Implement sorting and pagination for octavia  https://review.openstack.org/38214706:50
*** links has quit IRC06:55
*** tesseract has joined #openstack-lbaas07:07
*** gongysh has joined #openstack-lbaas07:18
openstackgerritAdam Harwell proposed openstack/octavia master: WIP: Floating IP Network Driver (spans L3s)  https://review.openstack.org/43561207:25
*** gcheresh has joined #openstack-lbaas07:33
*** links has joined #openstack-lbaas07:57
*** bzhao has quit IRC08:01
*** bzhao has joined #openstack-lbaas08:03
*** cpuga has joined #openstack-lbaas08:05
*** cpuga has quit IRC08:09
*** links has quit IRC08:27
voelzmoHello friends of the loadbalancers! Any thoughts on https://bugs.launchpad.net/octavia/+bug/1682408 ?08:55
openstackLaunchpad bug 1682408 in octavia "Delete LBaaSv2 pool membership on port deletion" [Undecided,New]08:55
openstackgerritAdam Harwell proposed openstack/octavia master: Noop network driver should provide a more hydrated network  https://review.openstack.org/46288609:41
*** ipsecguy_ has quit IRC10:09
openstackgerritAdam Harwell proposed openstack/octavia master: Don't show deleted objects in v2 API  https://review.openstack.org/46291010:45
openstackgerritAdam Harwell proposed openstack/octavia master: Noop network driver should provide a more hydrated network  https://review.openstack.org/46288610:46
*** KeithMnemonic2 has joined #openstack-lbaas10:48
rm_workOK smashed a few bugs10:50
rm_workthat were impacting stuff I'm trying to do10:50
rm_workI don't necessarily agree with the "not showing deleted objects" thing10:51
rm_workbut10:51
rm_workwhatever10:51
rm_worki'm actually kinda on the fence and if it's a bug I guess we can fix it10:51
*** KeithMnemonic1 has quit IRC10:51
*** ipsecguy has joined #openstack-lbaas10:53
*** ipsecguy has quit IRC10:56
*** ipsecguy has joined #openstack-lbaas10:56
*** yamamoto has joined #openstack-lbaas11:05
*** gongysh has quit IRC11:08
rm_workxgerman: ok my script should be working now, though I'd kinda like to try to land a few patches today before we run it11:12
*** yamamoto has quit IRC11:13
rm_workspecifically a couple of bugfixes11:13
rm_workhttps://review.openstack.org/46291011:13
xgermanOk. Sounds good --11:13
rm_workand https://review.openstack.org/46275011:13
rm_workthough... i guess the second one isn't visible so prolly doesn't matter11:13
xgermanWill look in 2 hours11:13
rm_workbut also I would like to change our api from running with apache to running with uwsgi11:14
rm_workso it goes back into the screen11:14
rm_workbecause ... it not being in the screen is shitty11:14
rm_workand they changed the goal to uwsgi so we need to do it anyway11:14
rm_workmaybe you or johnsom or someone could do that this morning?11:14
rm_workI really need to sleep now11:15
rm_workor ... whatever, maybe i can look at it11:15
*** jerrygb has joined #openstack-lbaas11:18
*** yamamoto has joined #openstack-lbaas11:20
*** yamamoto has quit IRC11:23
rm_workeh, i guess i can just set OCTAVIA_USE_MOD_WSGI=False11:30
rm_workand it'll use the old thing11:30
rm_workwhich is fine11:30
*** tesseract has quit IRC11:43
*** tesseract has joined #openstack-lbaas11:43
rm_workwtf where is our api-ref hosted11:47
rm_workdo they not actually build and host it anywhere?11:47
*** chlong has joined #openstack-lbaas12:04
*** cpuga has joined #openstack-lbaas12:06
*** yamamoto has joined #openstack-lbaas12:08
*** yamamoto has quit IRC12:08
*** voelzmo has quit IRC12:09
*** cpuga has quit IRC12:11
*** voelzmo has joined #openstack-lbaas12:12
*** jerrygb has quit IRC12:23
*** cpuga has joined #openstack-lbaas12:25
*** jerrygb has joined #openstack-lbaas12:25
*** cpuga has quit IRC12:29
*** yamamoto has joined #openstack-lbaas12:48
*** krypto has joined #openstack-lbaas12:50
*** ipsecguy_ has joined #openstack-lbaas12:57
*** tesseract has quit IRC13:02
*** ipsecguy has quit IRC13:02
*** yamamoto has quit IRC13:12
*** catintheroof has joined #openstack-lbaas13:13
*** tesseract has joined #openstack-lbaas13:14
*** tesseract has quit IRC13:26
*** tesseract has joined #openstack-lbaas13:27
*** KeithMnemonic2 has quit IRC13:58
*** sanfern has joined #openstack-lbaas14:06
*** fnaval has joined #openstack-lbaas14:06
*** fnaval_ has joined #openstack-lbaas14:08
*** fnaval has quit IRC14:11
*** bzhao has quit IRC14:14
*** bzhao has joined #openstack-lbaas14:14
*** ianychoi has quit IRC14:27
*** cpuga has joined #openstack-lbaas14:31
*** cpuga_ has joined #openstack-lbaas14:33
*** cpuga has quit IRC14:36
*** ianychoi has joined #openstack-lbaas14:47
*** chlong has quit IRC14:47
*** fnaval_ has quit IRC14:56
*** voelzmo has quit IRC15:05
*** armax has joined #openstack-lbaas15:05
*** cody-somerville has joined #openstack-lbaas15:09
*** armax_ has joined #openstack-lbaas15:09
*** armax has quit IRC15:10
*** armax_ is now known as armax15:10
johnsomrm_work https://developer.openstack.org/api-ref/load-balancer/15:25
johnsomI haven't linked it on docs.openstack.org yet because we are very WIP at the moment, but by the end of Pike we will have a link from the main API page15:32
*** sshank has joined #openstack-lbaas15:38
*** JudeC has joined #openstack-lbaas15:39
*** JudeC has quit IRC16:20
*** krypto has quit IRC16:32
*** krypto has joined #openstack-lbaas16:32
*** blogan has joined #openstack-lbaas16:33
xgermanjohnsom: https://www.openstack.org/summit/boston-2017/summit-schedule/events/17859/octavia-load-balancing-for-openstack?BackURL=https%3A%2F%2Fwww.openstack.org%2Fsummit%2Fboston-2017%2Fsummit-schedule%2Fglobal-search%3Ft%3Deichberger%23eventid%3D17859 has still Lubosz + when is the project update?16:33
xgermanI probably should ask about where, too16:33
johnsomxgerman https://etherpad.openstack.org/p/octavia-pike-summit16:34
xgermanok, added it to my calendar16:36
*** JudeC has joined #openstack-lbaas16:36
*** fnaval has joined #openstack-lbaas16:39
xgermannow I will be reminded 15 minutes prior ;-16:39
xgerman)16:39
*** dlundquist has quit IRC16:50
*** dlundquist has joined #openstack-lbaas16:50
*** cpuga_ has quit IRC16:52
openstackgerritMerged openstack/octavia master: Purge more tenant_id references that I missed  https://review.openstack.org/46275016:54
*** harlowja has quit IRC17:03
*** gcheresh has quit IRC17:13
*** blogan_ has joined #openstack-lbaas17:16
*** blogan has quit IRC17:17
*** JudeC has quit IRC17:19
*** tongl has joined #openstack-lbaas17:25
openstackgerritMerged openstack/neutron-lbaas master: Remove get_namespace from API extensions  https://review.openstack.org/46083117:29
openstackgerritMerged openstack/neutron-lbaas master: Updated from global requirements  https://review.openstack.org/46211117:29
*** sanfern has quit IRC17:39
*** JudeC has joined #openstack-lbaas17:41
openstackgerritMichael Johnson proposed openstack/octavia master: Don't show deleted objects in v2 API  https://review.openstack.org/46291017:43
*** cpuga has joined #openstack-lbaas18:00
*** gcheresh has joined #openstack-lbaas18:00
*** cpuga has quit IRC18:04
*** cpuga has joined #openstack-lbaas18:04
*** cpuga_ has joined #openstack-lbaas18:06
*** cpuga has quit IRC18:09
*** pcaruana has quit IRC18:10
*** openstackgerrit has quit IRC18:18
*** tesseract has quit IRC18:30
*** openstackgerrit has joined #openstack-lbaas18:36
openstackgerritElancheran S proposed openstack/python-octaviaclient master: Add Listener commands to client  https://review.openstack.org/46123118:36
openstackgerritElancheran S proposed openstack/python-octaviaclient master: Add loadbalancer commands to client  https://review.openstack.org/45451618:36
openstackgerritElancheran S proposed openstack/python-octaviaclient master: Add pool commands to client  https://review.openstack.org/46199218:36
openstackgerritElancheran S proposed openstack/python-octaviaclient master: This patch implements member create, list, show, set, and delete within the openstack client.  https://review.openstack.org/46303518:36
openstackgerritMerged openstack/octavia master: Noop network driver should provide a more hydrated network  https://review.openstack.org/46288618:44
*** krypto has quit IRC18:51
openstackgerritElancheran S proposed openstack/python-octaviaclient master: This patch implements member create, list, show, set, and delete within the openstack client.  https://review.openstack.org/46303519:25
*** voelzmo has joined #openstack-lbaas19:25
*** cpuga_ has quit IRC19:29
*** catintheroof has quit IRC19:36
*** catintheroof has joined #openstack-lbaas19:37
*** catintheroof has quit IRC19:42
*** sanfern has joined #openstack-lbaas19:47
*** harlowja has joined #openstack-lbaas19:48
*** sanfern has quit IRC19:53
*** harlowja has quit IRC19:56
openstackgerritMerged openstack/octavia master: Don't show deleted objects in v2 API  https://review.openstack.org/46291020:06
openstackgerritElancheran S proposed openstack/python-octaviaclient master: This patch implements member create, list, show, set, and delete within the openstack client.  https://review.openstack.org/46303520:20
openstackgerritElancheran S proposed openstack/python-octaviaclient master: This patch implements member create, list, show, set, and delete within the openstack client.  https://review.openstack.org/46303520:21
openstackgerritElancheran S proposed openstack/python-octaviaclient master: Add member commands to client  https://review.openstack.org/46303520:22
*** chlong has joined #openstack-lbaas20:27
*** gcheresh has quit IRC20:49
*** voelzmo has quit IRC20:50
*** jerrygb has quit IRC20:53
openstackgerritElancheran S proposed openstack/python-octaviaclient master: Add member commands to client  https://review.openstack.org/46303520:59
*** cpuga has joined #openstack-lbaas21:01
rm_workjohnsom: replied21:03
johnsomCool!21:04
johnsomDuh, yep.  Ok, a rebase and we can merge single call and sorting IMO21:05
johnsomDo you want me to do the rebase?21:05
rm_workI'll do it21:05
rm_workahh lolol I missed a constant on the deleted patch21:05
rm_worki did it right on the other side T_T21:05
rm_workwas a bit tired by then, heh21:06
rm_workyou got it though, cool21:06
johnsomYep21:06
johnsomI'm just finishing the 101 slides21:06
xgermanNice!21:07
rm_workjust running tests after rebase and i'll push up21:08
rm_workso much rebasing recently21:08
xgermanNo kidding21:08
openstackgerritAdam Harwell proposed openstack/octavia master: Add support for single-create for APIv2  https://review.openstack.org/45903221:10
*** chlong has quit IRC21:22
johnsomOk, I thnk the 101 slides are in good shape.  Make edits if you need21:22
*** cpuga_ has joined #openstack-lbaas21:22
rm_workrunning tests on the paging/sorting rebase21:26
*** cpuga has quit IRC21:26
rm_workugh i have no idea how this is going to work next week21:26
rm_workalso I am seriously actually getting sick and I'm worried about my voice :/21:26
rm_worki hope this passes quickly21:27
johnsomUgh, well, I guess German can try phoning a friend...  Ha21:27
johnsomI can be the ginormous talking head21:27
openstackgerritAdam Harwell proposed openstack/octavia master: Implement sorting and pagination for octavia  https://review.openstack.org/38214721:28
rm_workOK21:28
rm_workfeel free to +2/+A and all that again soon, once this passes scenarios again21:28
johnsomI have +2'd them21:29
xgermanOuch.21:29
johnsomArgh...  Now multinode on newton is broken: /opt/stack/new/octavia/devstack/plugin.sh:source:330 :   die 'The neutron q-svc service must be enabled to use octavia'21:33
johnsomPlaying wack-a-mole with third party breakage is getting to be a full time job21:33
*** harlowja has joined #openstack-lbaas21:34
rm_worki reproposed the DIB co-gate21:34
johnsomYeah, they can't deny they broke us this time.21:34
johnsomHopefully they will take it21:34
openstackgerritAdam Harwell proposed openstack/octavia master: WIP: Floating IP Network Driver (spans L3s)  https://review.openstack.org/43561221:35
johnsomxgerman Did you start slide for the normal LBaaS talk?21:45
xgermannope21:45
xgermanbut I have a flight on Sunday (learned from omrig)21:45
johnsomOk, I will try to put something together, at least a start21:45
xgermanalso if I am the only speaker we can use the RAX template21:46
johnsomI think both 101 and project update are reasonable.  Project update might be a little light, but I'm not sure with the format of those sessions21:46
xgermanyeah21:46
*** mixos has joined #openstack-lbaas21:46
xgermanI will practice the night before21:46
xgermanalso I usually write my sldies at the conference so nothing new ;-)21:47
johnsomYeah, I know I am the one that can't stand doing that.....21:47
xgerman:-)21:48
rm_worklol21:48
rm_workwhich ones do you actually want me to help with xgerman21:48
rm_workI figure I can do about half the speaking at all of them, assuming my voice is OK21:48
xgermanlet’s decide that when/if you have your voice ;-)21:48
rm_workheh yeah21:48
rm_workhopefully will be OK with a mic21:48
* xgerman parys21:49
rm_workit seems like every summit i get sick and have to actually use a mic instead of getting to just broadcast with my auditorium voice21:49
xgermanbummer - I think the talks are received better if more than one person talks21:49
johnsomYeah, me too21:50
rm_workyeah IMO I should be able to talk at least a bit21:50
rm_workjust won't be able to OWN it like I was hoping21:50
xgermanok, just send me the slides and I will work on them in the plane/Saturday/hotel21:50
rm_workxgerman: I'll plan to meet up with you Monday morning21:51
rm_workand do last minute prep for the demo21:51
xgermank21:51
rm_workmaybe a runthrough21:51
rm_workerr, lab21:51
rm_workwill you be on tomorrow?21:51
rm_workI think I want to do the script tomorrow21:51
*** mixos has quit IRC21:51
rm_workI'll lock it to a specific version of devstack/octavia21:51
xgermanok, let me know when you need me and I can make time. Otherwise I usually have my cell with irc with me21:52
rm_worktempted to tell it to use stable nova/neutron lol21:52
rm_workah ok21:52
xgerman:-)21:52
johnsomYeah, I can probably be summoned and help out some over the weekend if you need a hand.21:52
rm_workkk21:53
rm_worklet me test a login against one of those IPs and make sure i can get in at least21:53
rm_workhave you tried xgerman?21:53
xgermanthe lab slides are 99% done21:53
xgermanyes, but last week21:53
xgermanoh, I could log in the 1st student machine21:53
johnsomJust sent you guys the link to the Main LBaaS talk slides I am starting.21:54
xgermanok, so all the links are still current?21:54
xgermanif so will work over the weekend on them21:55
johnsomYes, they should all pull down the current version.  I will be working on that last one for a while here, so...21:56
johnsomAt least I think the link points to the latest version.  Check the 101 and see if it is fully filled out21:57
openstackgerritElancheran S proposed openstack/python-octaviaclient master: Add member commands to client  https://review.openstack.org/46303521:57
rm_workpssh -h ~/workspace/ovh_ips -l ubuntu -x "-oStrictHostKeyChecking=no -i ~/.ssh/ovh_lab_rsa" whoami22:00
rm_workusing that to do stuff22:00
rm_workcan log in to all 100 hosts22:00
rm_work:)22:00
johnsomNice22:01
rm_worki'm splitting off one IP to do testing on though22:01
rm_workI am guessing there's no way to reset these :/22:01
rm_workso if something breaks...22:01
rm_workugh22:01
rm_workI guess we'd be stuck doing it monday morning again and crossing fingers22:01
rm_workactually what I need from one of you maybe is to log in to my test box when i'm finished setting it up, and really give it a workout22:02
rm_workto make sure everything *works*22:02
rm_workjohnsom: i'm sure you have test scripts sitting around22:02
johnsomYep, I do.  Just let me know when...22:03
rm_workk22:04
rm_workprobably it'll be tomorrow22:04
*** cpuga has joined #openstack-lbaas22:09
*** cpuga has quit IRC22:12
*** cpuga_ has quit IRC22:13
*** fnaval has quit IRC22:17
openstackgerritElancheran S proposed openstack/python-octaviaclient master: Add member commands to client  https://review.openstack.org/46303522:25
*** sshank has quit IRC22:35
rm_workxgerman: need that sweet +A for single-create22:36
rm_workand it'll release the kraken for both that and pagination22:36
xgermanit works now?22:37
rm_workerr22:37
rm_workwell22:37
rm_workneed you to re-test then22:37
rm_workbecause I was never able to reproduce any of your issues22:37
rm_workor michael's22:37
rm_workand he's +2'd now22:37
rm_workI think you guys had some weird devstack issues...22:37
xgermank22:38
rm_workxgerman: definitely re-test22:38
rm_workand let me know if anything weird happens22:38
rm_worki need to go afk for about 30m so you have some time :)22:38
xgermanwon’t happen that soon anyway - maybe when kids are in bed and I understand how to set up devstack (are those ubuntu issues fixed?)22:39
rm_workumm22:39
rm_worknot sure22:39
rm_workbut yeah k np22:39
johnsomYeah, my issues were systemd related22:53
johnsomI got a good test today22:53
rm_worki switched my scripts to USE_SCREEN and turned off our MOD_UWSGI22:58
rm_workgood times22:58
*** catinthe_ has joined #openstack-lbaas23:14
*** blogan_ has quit IRC23:21
xgermanok, trying with a freshly cloned devstack - wish me luck23:34
*** chlong has joined #openstack-lbaas23:43
*** JudeC has quit IRC23:47
*** gongysh has joined #openstack-lbaas23:47
*** JudeC has joined #openstack-lbaas23:49
*** JudeC has quit IRC23:53

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!