Wednesday, 2016-05-04

*** ssurana has joined #openstack-kolla00:09
*** Jeffrey4l has joined #openstack-kolla00:10
*** fragatin_ has joined #openstack-kolla00:11
*** fragatin_ has quit IRC00:14
*** fragatina has quit IRC00:14
*** fragatina has joined #openstack-kolla00:15
*** banix has joined #openstack-kolla00:25
*** MarMat has quit IRC00:28
*** unicell has quit IRC00:36
*** dwalsh has quit IRC00:44
*** fragatin_ has joined #openstack-kolla01:12
*** sdake has quit IRC01:13
*** fragatin_ has quit IRC01:14
*** fragatina has quit IRC01:16
*** callahanca has joined #openstack-kolla01:17
*** kjelly1 has quit IRC01:30
*** ozialien10 has joined #openstack-kolla01:46
*** ozialien10 has quit IRC01:46
*** ozialien10 has joined #openstack-kolla01:47
*** sbezverk has quit IRC01:47
*** sbezverk has joined #openstack-kolla01:48
*** rstarmer has joined #openstack-kolla01:54
openstackgerritJack ning proposed openstack/kolla: Added webroot config to dashboard  https://review.openstack.org/30692802:04
*** ravig has joined #openstack-kolla02:05
*** dolpher has joined #openstack-kolla02:13
openstackgerritMauricio Lima proposed openstack/kolla: Add a CONTRIBUTING.rst for Kolla  https://review.openstack.org/30540202:27
openstackgerritMauricio Lima proposed openstack/kolla: Add a CONTRIBUTING.rst for Kolla  https://review.openstack.org/30540202:28
*** fragatina has joined #openstack-kolla02:31
*** mark-casey has joined #openstack-kolla02:38
*** ozialien10 has quit IRC02:52
*** ozialien10 has joined #openstack-kolla02:52
*** akscram has quit IRC02:54
*** ssurana has quit IRC02:54
*** akscram has joined #openstack-kolla02:55
*** mark-casey has quit IRC02:56
*** mummer has joined #openstack-kolla02:59
*** banix has quit IRC03:02
*** dave-mccowan has quit IRC03:10
*** mummer has quit IRC03:11
*** vhosakot has quit IRC03:17
*** daneyon_ has joined #openstack-kolla03:19
*** daneyon_ has quit IRC03:24
*** jackning has quit IRC03:29
*** fragatina has quit IRC03:56
*** fragatina has joined #openstack-kolla03:56
*** jtriley has quit IRC04:27
*** huikang has joined #openstack-kolla04:30
*** huikang has quit IRC04:30
*** reddydodda has joined #openstack-kolla04:30
*** ravig has quit IRC04:45
*** fragatina has quit IRC05:15
*** jtriley has joined #openstack-kolla05:23
*** akscram has quit IRC05:26
*** jtriley has quit IRC05:28
*** akscram has joined #openstack-kolla05:28
*** ayoung has quit IRC05:31
*** dolpher has quit IRC05:31
*** dolpher has joined #openstack-kolla05:31
*** mnaser has quit IRC05:41
*** SiRiuS has joined #openstack-kolla06:00
*** daneyon_ has joined #openstack-kolla06:01
*** mnaser has joined #openstack-kolla06:03
*** jrist has quit IRC06:06
*** daneyon_ has quit IRC06:06
*** salv-orlando has joined #openstack-kolla06:07
*** openstackgerrit has quit IRC06:17
*** openstackgerrit has joined #openstack-kolla06:18
*** jtriley has joined #openstack-kolla06:24
*** stvnoyes has joined #openstack-kolla06:26
*** jtriley has quit IRC06:30
*** sbezverk has quit IRC06:32
*** salv-orlando has quit IRC06:36
*** sbezverk has joined #openstack-kolla06:38
*** Serlex has joined #openstack-kolla07:00
*** sacharya has quit IRC07:05
*** Mr_Broken has joined #openstack-kolla07:07
openstackgerritMD NADEEM proposed openstack/kolla: Spec: Deploy Kolla images using Kubernetes  https://review.openstack.org/30418207:07
*** jmccarthy has joined #openstack-kolla07:11
*** jmccarthy has left #openstack-kolla07:14
*** Serlex has quit IRC07:18
*** jrist has joined #openstack-kolla07:20
*** rstarmer has quit IRC07:21
*** jtriley has joined #openstack-kolla07:26
*** jtriley has quit IRC07:31
*** mickt has joined #openstack-kolla07:33
*** salv-orlando has joined #openstack-kolla07:36
micktGood morning all, anyone know in the absense of ceilometer-alarm-notifier & ceilometer-alarm-evaluator if I must use aodh for alrams or is there a simpler method to use short term?07:37
*** jrist has quit IRC07:38
*** mikelk has joined #openstack-kolla07:39
*** salv-orlando has quit IRC07:41
*** ayoung has joined #openstack-kolla07:49
*** dmk0202 has joined #openstack-kolla07:54
*** shardy has joined #openstack-kolla07:56
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/kolla: Spec: Deploy Kolla images using Kubernetes  https://review.openstack.org/30418207:57
*** sacharya has joined #openstack-kolla08:06
*** Serlex has joined #openstack-kolla08:07
*** reddydodda has quit IRC08:10
*** sacharya has quit IRC08:11
*** sbezverk has quit IRC08:11
*** mbound has joined #openstack-kolla08:11
*** sbezverk has joined #openstack-kolla08:13
*** mickt has quit IRC08:27
*** jtriley has joined #openstack-kolla08:27
*** ozialien10 has quit IRC08:28
*** ozialien10 has joined #openstack-kolla08:29
*** jtriley has quit IRC08:32
*** jrist has joined #openstack-kolla08:33
*** gfidente has joined #openstack-kolla08:33
*** gfidente has joined #openstack-kolla08:33
*** salv-orlando has joined #openstack-kolla08:38
*** salv-orlando has quit IRC08:42
*** daneyon_ has joined #openstack-kolla08:44
*** daneyon_ has quit IRC08:49
*** SiRiuS has quit IRC08:54
*** SiRiuS has joined #openstack-kolla09:00
*** dolpher has quit IRC09:00
*** pbourke has joined #openstack-kolla09:06
*** neilus has joined #openstack-kolla09:07
*** sacharya has joined #openstack-kolla09:07
*** sacharya has quit IRC09:12
*** prithiv has joined #openstack-kolla09:23
*** jtriley has joined #openstack-kolla09:27
*** jtriley has quit IRC09:32
*** mbound has quit IRC09:35
*** salv-orlando has joined #openstack-kolla09:38
*** salv-orlando has quit IRC09:43
*** prithiv has quit IRC09:45
*** mbound has joined #openstack-kolla09:51
*** athomas has quit IRC09:55
*** fragatina has joined #openstack-kolla09:59
*** dmk0202 has quit IRC09:59
*** jrist has quit IRC10:02
*** athomas has joined #openstack-kolla10:02
*** SiRiuS has quit IRC10:06
*** prithiv has joined #openstack-kolla10:06
*** prithiv has quit IRC10:08
*** prithiv has joined #openstack-kolla10:09
*** prithiv has quit IRC10:10
*** prithiv has joined #openstack-kolla10:10
*** prithiv has quit IRC10:11
*** SiRiuS has joined #openstack-kolla10:11
*** prithiv has joined #openstack-kolla10:12
*** ccesario___ has quit IRC10:15
*** ozialien10 has quit IRC10:18
*** ozialien10 has joined #openstack-kolla10:18
*** jtriley has joined #openstack-kolla10:28
*** dwalsh has joined #openstack-kolla10:32
*** jtriley has quit IRC10:34
*** salv-orlando has joined #openstack-kolla10:40
*** jrist has joined #openstack-kolla10:45
*** salv-orlando has quit IRC10:45
*** Mr_Broken has quit IRC10:46
*** Mr_Broken has joined #openstack-kolla10:46
*** prithiv has quit IRC10:47
*** allen_gao has quit IRC10:47
*** Mr_Broken has quit IRC10:51
*** dave-mccowan has joined #openstack-kolla10:51
*** allen_gao has joined #openstack-kolla10:52
*** ccesario___ has joined #openstack-kolla10:56
*** prithiv has joined #openstack-kolla10:58
*** asalkeld has quit IRC10:59
*** prithiv has quit IRC10:59
*** prithiv has joined #openstack-kolla11:04
*** prithiv has quit IRC11:05
*** sacharya has joined #openstack-kolla11:08
*** sacharya has quit IRC11:13
*** Mr_Broken has joined #openstack-kolla11:17
*** jtriley has joined #openstack-kolla11:23
*** banix has joined #openstack-kolla11:33
mlimamorning guys11:36
*** jtriley has quit IRC11:40
*** rhallisey has joined #openstack-kolla11:40
*** salv-orlando has joined #openstack-kolla11:40
*** mbound has quit IRC11:42
*** banix has quit IRC11:45
*** salv-orlando has quit IRC11:46
*** jtriley has joined #openstack-kolla11:57
*** jtriley has quit IRC12:02
*** dwalsh has quit IRC12:04
openstackgerritMauricio Lima proposed openstack/kolla: Add a CONTRIBUTING.rst for Kolla  https://review.openstack.org/30540212:10
*** prithiv has joined #openstack-kolla12:12
*** mbound has joined #openstack-kolla12:16
*** daneyon_ has joined #openstack-kolla12:20
*** ccesario___ has quit IRC12:23
*** dave-mcc_ has joined #openstack-kolla12:24
*** ozialien10 has quit IRC12:24
*** ozialien10 has joined #openstack-kolla12:25
*** daneyon_ has quit IRC12:25
*** Mr_Broken has quit IRC12:27
*** Mr_Broken has joined #openstack-kolla12:27
*** dave-mccowan has quit IRC12:27
*** prithiv has quit IRC12:28
*** prithiv has joined #openstack-kolla12:30
*** Mr_Broken has quit IRC12:31
*** stvnoyes has left #openstack-kolla12:32
*** signed8bit has joined #openstack-kolla12:38
*** salv-orlando has joined #openstack-kolla12:41
*** jtriley has joined #openstack-kolla12:45
*** salv-orlando has quit IRC12:46
*** SiRiuS has quit IRC12:56
*** reddydodda has joined #openstack-kolla12:59
*** rstarmer has joined #openstack-kolla13:00
*** rstarmer has quit IRC13:00
Jeffrey4ldo we have meeting today at 16:30 UTC?13:00
Jeffrey4lgood night guys. lol13:00
*** gfidente has quit IRC13:05
*** gfidente has joined #openstack-kolla13:06
*** gfidente has quit IRC13:06
*** gfidente has joined #openstack-kolla13:06
*** Mr_Broken has joined #openstack-kolla13:06
*** salv-orlando has joined #openstack-kolla13:09
*** sacharya has joined #openstack-kolla13:09
*** SiRiuS has joined #openstack-kolla13:10
*** Mr_Broken has quit IRC13:11
*** Mr_Broken has joined #openstack-kolla13:12
*** salv-orlando has quit IRC13:13
*** ravig has joined #openstack-kolla13:13
*** sacharya has quit IRC13:14
*** coolsvap has quit IRC13:18
*** prithiv has quit IRC13:18
*** sbezverk has quit IRC13:20
*** reddydodda has quit IRC13:21
*** esharao has joined #openstack-kolla13:24
*** esharao has quit IRC13:25
*** diogogmt has quit IRC13:28
*** inc0 has joined #openstack-kolla13:31
*** geseib has joined #openstack-kolla13:32
*** diogogmt has joined #openstack-kolla13:32
*** reddydodda has joined #openstack-kolla13:34
*** ssurana has joined #openstack-kolla13:34
*** diogogmt has quit IRC13:43
*** sdake has joined #openstack-kolla13:48
*** sdake has quit IRC13:48
*** sbezverk has joined #openstack-kolla13:54
*** mbound has quit IRC13:54
*** SiRiuS has quit IRC13:55
*** mbound has joined #openstack-kolla13:55
*** dave-mcc_ has quit IRC13:57
*** prithiv has joined #openstack-kolla14:01
*** jeh has quit IRC14:03
*** diogogmt has joined #openstack-kolla14:03
*** sdake has joined #openstack-kolla14:06
sdakemorning14:07
*** mbound has quit IRC14:08
Jeffrey4lsdake, morning. do we have meeting today?14:08
pbourkehey14:08
*** jeh has joined #openstack-kolla14:09
*** jeh has joined #openstack-kolla14:09
sdakemeeting today - persoanlly I'd feel like cancelling it14:09
sdakegive people a week off14:09
sdakeup to folks in channel14:09
*** prithiv has quit IRC14:09
*** salv-orlando has joined #openstack-kolla14:10
Jeffrey4lone thing I want to talk. could you check the comments in this https://review.openstack.org/30692814:10
Jeffrey4lsdake, pbourke ^14:10
*** dwalsh has joined #openstack-kolla14:10
pbourkeJeffrey4l: let me review your comments14:10
Jeffrey4lcool. thanks.14:11
*** ccesario___ has joined #openstack-kolla14:11
pbourkeJeffrey4l: I see what you mean14:12
pbourketill now the policy around config is a little loosely defined I think14:13
*** dmk0202 has joined #openstack-kolla14:14
pbourkewhat he's doing in that patch is not different to how things currently work14:14
*** salv-orlando has quit IRC14:15
Jeffrey4lyes. the current config file policy is not clear.14:16
Jeffrey4lbut what do you mean by `what he's doing in that patch is not different to how things currently work`14:16
*** absubram has joined #openstack-kolla14:16
*** ravig has quit IRC14:17
pbourkeI mean the way jack ning has implemented that patch is the same way the rest of the config is done in kolla14:21
mlimaguys, i need someone to test it https://review.openstack.org/#/c/310261/14:22
patchbotmlima: patch 310261 - kolla - Make Heka collect Ceph logs14:22
pbourkemlima: i will test14:22
mlimaThank you pbourke14:22
mlimapbourke, look the Jeffrey4l comments14:24
mlima:)14:24
*** salv-orlando has joined #openstack-kolla14:24
Jeffrey4lpbourke, but it is bad. right? he is export one option to the global. along with the more and more requirement, the global option will be a disaster.14:24
pbourkeJeffrey4l: I absolutely agree14:24
pbourkeJeffrey4l: it needs to be discussed14:24
Jeffrey4lcool14:25
*** ccesario___ has quit IRC14:25
pbourkemailing list would probably be best, give people some time to think14:25
Jeffrey4lOK. I will post a mail.14:25
Jeffrey4lthanks.14:25
pbourkesuggest we lay out how it currently works, what needs to change, and document it14:26
*** huikang has joined #openstack-kolla14:26
pbourkethanks Jeffrey4l14:26
Jeffrey4lactually, i have no better idea for this. :(14:26
pbourkewe'll come up with something14:27
Jeffrey4lyea14:27
huikanghi, will the kolla meeting be held today?14:28
huikangin one hour?14:28
pbourkehuikang: yes, though it may be cancelled14:28
pbourkeup to sdake14:28
*** salv-orlando has quit IRC14:29
*** mbound has joined #openstack-kolla14:29
huikangpbourke, thanks. I want to make sure I convert the time zone correctly14:29
sdakeup to folks in channel really14:29
Lyncosccesario ping14:29
sdakemy face is still melted from last week14:29
huikangnice14:29
ccesarioLyncos, pong14:30
ccesarioLyncos, http://paste.openstack.org/show/496085/14:30
LyncosHow it went with 16.04 ?14:30
ccesariobinary mode14:30
LyncosWhat about source ?14:30
*** ozialien10 has quit IRC14:31
Lyncoswe decided to go with source instead of binary as it seems binary is not well tested by the community14:31
ccesariore-checking now... yestearday it was working... but i did ome changes... need check again14:31
Lyncosok cool14:31
ccesarioLyncos, build the iamges now14:31
Lyncosyou not deploying ceph right ?14:31
ccesarioright... no resources for it :(14:32
LyncosI'm wondering about having ceph Infernalis instead of hammer14:32
*** prithiv has joined #openstack-kolla14:32
*** dmk0202 has quit IRC14:33
pbourkeim testing ceph with vagrant14:33
pbourkeworks quite well14:33
*** SiRiuS has joined #openstack-kolla14:33
Lyncospbourke: ceph hammer ?14:33
pbourkeLyncos: i think so, whatever is the current rpms14:34
Lyncosok14:34
*** mbound has quit IRC14:34
*** v1k0d3n has quit IRC14:36
pbourkedoes heka go through haproxy?14:36
pbourkeim assuming yes14:36
prithivfor me, in multinode, no14:36
dimssdake : someone got excited about pypi version for kolla-kubernetes? :)14:41
*** signed8bit is now known as signed8bit_Zzz14:46
pbourkemlima: does it work for you? I'm not seeing any ceph entries under /var/log/kolla in heka, but may be missing something14:47
*** ssurana has quit IRC14:48
*** ccesario___ has joined #openstack-kolla14:49
*** mbound has joined #openstack-kolla14:53
*** salv-orlando has joined #openstack-kolla14:54
*** haplo37 has joined #openstack-kolla14:58
*** salv-orlando has quit IRC14:59
*** mark-casey has joined #openstack-kolla15:02
*** daneyon_ has joined #openstack-kolla15:03
*** sbezverk has quit IRC15:04
mark-caseyrhallisey: ping15:07
ccesarioLyncos, http://paste.openstack.org/show/496092/15:07
*** daneyon_ has quit IRC15:08
*** egonzalez has joined #openstack-kolla15:08
Lyncosit looks promising15:08
ccesariodeploying now....15:09
*** sacharya has joined #openstack-kolla15:10
ccesarioLyncos, http://sprunge.us/NOiY15:10
mlima pbourke yes, it work for me :/15:11
*** sacharya has quit IRC15:14
rhalliseymark-casey, hye15:15
rhalliseyhi15:15
*** neilus1 has joined #openstack-kolla15:15
*** MarMat has joined #openstack-kolla15:15
elemoine_pbourke: yes heka goes through haproxy (heka accesses ES through the vip)15:16
*** reddydodda has quit IRC15:17
ccesariopbourke, I have tested it too and I could see ceph entries under /var/log/kolla15:17
*** absubram has quit IRC15:17
*** neilus has quit IRC15:17
*** absubram has joined #openstack-kolla15:18
*** absubram has quit IRC15:19
*** egonzalez has quit IRC15:19
openstackgerritMerged openstack/kolla: Cleanup Mesos/Marathon related work  https://review.openstack.org/31204115:20
*** vhosakot has joined #openstack-kolla15:21
mark-caseyrhallisey: actually I guess I should add this as a comment on kubernetes spec instead (and will) but I'm pretty sure there is a way to use the DB cluster itself to roll back DB changes during an upgrade. You'd more or less force split brain to happen and if you need to go back you just rebootstrap from the node that was out of sync during upgrade15:22
*** egonzalez has joined #openstack-kolla15:22
rhalliseymark-casey, SAP has an interesting solution there too15:23
rhalliseythey have a db per service15:23
rhalliseymark-casey, cool drop a comment in the spec15:23
*** Mr_Broken has quit IRC15:23
*** Mr_Broken has joined #openstack-kolla15:24
mark-caseyrhallisey: will do. would you happen to have another sentence on how db per service works?15:24
rhalliseymark-casey, I don't know much more about it.  Without looking at the SAP work, I'm not sure what it looks like15:25
rhalliseyit was only described to me15:25
mark-caseyrhallisey: no worries :)15:25
rhalliseyand they said it worked15:25
vhosakotmeeting in 1 hr 4 mins15:26
*** neilus1 has quit IRC15:28
*** Mr_Broken has quit IRC15:28
huikangvhosakot, when will the kolla meeting start?15:29
vhosakothuikang: meeting in 1 hr 1 min15:29
huikangthanks. has the time changed?15:30
huikangI though it is 16:30 UTC15:30
vhosakotyep... it is 15:30 UTC now :)   the meeting time did not change15:31
vhosakotI remind meeting time so everyone knows! :)15:31
huikangmy calculation is wrong then. thanks for reminding15:31
*** egonzalez has quit IRC15:33
*** absubram has joined #openstack-kolla15:34
*** fragatina has quit IRC15:37
*** Mr_Broken has joined #openstack-kolla15:38
*** sdake_ has joined #openstack-kolla15:40
rhalliseysdake_, just fixed it15:41
sdake_cool15:41
openstackgerritMerged openstack/kolla: Remove the eth1 up and down manually in the rax-ord node  https://review.openstack.org/31063415:42
sdake_i think that docimapct ting needs to be changed too15:42
sdake_so the doc impact bugs go to the ocrrect launchpad traker15:42
*** sdake has quit IRC15:43
*** mikelk has quit IRC15:43
*** salv-orlando has joined #openstack-kolla15:44
*** egonzalez has joined #openstack-kolla15:45
vhosakotsdake_: many email threads post-summit.. will each thread be discussed and closed on today's meeting ? or, we close them in the ML ?15:46
*** sdake_ has quit IRC15:46
*** neilus has joined #openstack-kolla15:46
*** geseib has quit IRC15:47
*** geseib has joined #openstack-kolla15:47
*** v1k0d3n has joined #openstack-kolla15:52
ccesarioLyncos, done ... source mode is working on xenial :)15:53
LyncosAwesome !15:53
*** ravig has joined #openstack-kolla15:53
*** Mr_Broken has quit IRC15:53
ccesarioLyncos, I have a dirty patch ... would like to test?15:53
*** Mr_Broken has joined #openstack-kolla15:54
LyncosI'm not 100% ready to test .. maybe later today (we are setting up our pipeline right now)15:54
Lyncosbut shoot the dirty15:54
*** sacharya has joined #openstack-kolla15:57
*** banix has joined #openstack-kolla15:57
*** Mr_Broken has quit IRC15:58
*** prithiv has quit IRC15:58
*** salv-orlando has quit IRC15:59
*** prithiv has joined #openstack-kolla16:00
*** salv-orlando has joined #openstack-kolla16:00
*** salv-orlando has quit IRC16:03
*** sbezverk has joined #openstack-kolla16:04
vhosakotI have not been able to keep up with all the email threads... here is the list of emails post-summit.... I think we need to discuss the important ones in the meeting and close outstanding issues in these emails...http://paste.openstack.org/show/496099/16:05
vhosakothttp://paste.openstack.org/show/496099/16:05
*** athomas has quit IRC16:06
inc0there is one more16:06
inc0ansible 216:06
inc0we didn't talk about it on summit16:06
vhosakotinc0: thanks for brining it up!  is there an email about ansible 2.0 ?16:07
inc0no16:07
inc0let's quickly chat on meeting and then either send email or just start doing16:07
inc0btw I already started doing;)16:07
vhosakotah.. cool...16:07
inc0I'll try to post a review with non-exploding ansible2 deploy soon16:08
inc0then we need to refactor our code to make use of it, not just stop it from exploding16:08
vhosakotis there a bp to move kolla to ansible 2.0 ?16:08
inc0I don't think so16:09
inc0we need to solve paperwork16:09
vhosakotinc0: cool.. we can discuss in meeting16:09
inc0yup yup16:09
*** ravig has quit IRC16:10
*** ravig has joined #openstack-kolla16:11
*** fragatina has joined #openstack-kolla16:13
Jeffrey4lfyi, i register one bp for upgrade to ansible2.0 https://blueprints.launchpad.net/kolla/+spec/ansible216:13
*** dwalsh has quit IRC16:13
vhosakotJeffrey4l: thanks!  we can work items later16:14
*** athomas has joined #openstack-kolla16:14
inc0thanks Jeffrey4l16:15
Jeffrey4l:D16:16
*** mummer has joined #openstack-kolla16:16
Jeffrey4lwork is already started. https://review.openstack.org/31162516:18
*** ccesario___ has quit IRC16:18
*** daneyon has quit IRC16:20
inc0thats toolbox16:20
inc0toolbox was always 2.016:20
*** dwalsh has joined #openstack-kolla16:20
inc0issue is with our kolla_docker, merge confs and such16:21
vhosakotinc0: how is kolla_docker related to Ansible ?  this way ?  -->     https://github.com/openstack/kolla/blob/master/ansible/library/kolla_docker.py#L70116:22
*** ravig has quit IRC16:23
inc0it's ansible module16:23
inc0so pretty much;)16:23
vhosakotright..16:23
vhosakotinc0: I think we need tp add all of this as work items16:23
vhosakotin the bp16:23
inc0and that is what changed mostly 1->216:23
inc0API of modules16:23
*** mbound has quit IRC16:23
*** sdake has joined #openstack-kolla16:24
Jeffrey4lI think we should unify the kolla_toolbox ansible and the outer ansible version.16:24
sdakerhallisey inc0 i have a personal conflict today for our meeting time, and I think it makes sense to give people some time off to digest last week and get some R&R16:24
sdakeso I'm in favor of cancelling todays meeting, but if one of youw ant to run it, that also wfm16:25
Jeffrey4lthe module is not compatible between version 1 and version 2. especially for the kolla_docker.py16:25
inc0sdake, fair enough, I won't oppose to that16:25
vhosakotsdake: I dont know the steps to run the meeting... rhallisey can you run today's meeting.. I can collect notes16:25
inc0we need kolla_docker outside kolla_toolbox...because we need to deploy kolla_toolbox with kolla_docker;)16:26
*** egonzalez90 has joined #openstack-kolla16:26
*** ravig has joined #openstack-kolla16:26
inc0I can run meeting as well16:26
sdakeya might as well give inc0 a crack at it16:26
sdakeif your going to do it16:26
vhosakotsdake: I'm fine with skipping the meeting as well as a week's time is good to decide more about things16:26
vhosakotcool16:26
sdakemother is not well - need to tend to family first16:26
inc0yup, family comes first, all the best to your mom sdake !16:27
vhosakotsdake: got it... take care.. we'll do it16:27
*** ravig has quit IRC16:27
vhosakotso inc0: will you run the meeting ?16:27
*** ravig has joined #openstack-kolla16:27
inc0ok16:28
vhosakotcool16:28
*** egonzalez has quit IRC16:29
*** ozialien10 has joined #openstack-kolla16:29
*** britthouser has joined #openstack-kolla16:29
*** huikang_ has joined #openstack-kolla16:34
openstackgerritPrithiv proposed openstack/kolla: Deletes fake containers on cleanup related-bug: 1576277  https://review.openstack.org/31262916:34
openstackbug 1576277 in kolla "cleanup-containers doesn't remove ovs and compute fake containers" [Medium,In progress] https://launchpad.net/bugs/1576277 - Assigned to Prithiv (prithiv)16:34
*** egonzalez has joined #openstack-kolla16:37
*** egonzalez90 has quit IRC16:37
*** egonzalez has quit IRC16:37
*** steveeJ has quit IRC16:38
*** signed8bit_Zzz is now known as signed8bit16:40
*** huikang has quit IRC16:41
openstackgerritPrithiv proposed openstack/kolla: Deletes fake containers on cleanup Closes-Bug: 1576277  https://review.openstack.org/31262916:45
openstackbug 1576277 in kolla "cleanup-containers doesn't remove ovs and compute fake containers" [Medium,In progress] https://launchpad.net/bugs/1576277 - Assigned to Prithiv (prithiv)16:45
*** rajathagasthya has joined #openstack-kolla16:50
*** unicell has joined #openstack-kolla16:51
*** sdake has quit IRC16:55
*** prithiv has quit IRC17:07
*** ravig has quit IRC17:09
*** ravig has joined #openstack-kolla17:10
*** dwalsh has quit IRC17:11
*** salv-orlando has joined #openstack-kolla17:12
*** dwalsh has joined #openstack-kolla17:14
*** prithiv has joined #openstack-kolla17:17
*** prithiv has quit IRC17:19
*** prithiv has joined #openstack-kolla17:20
*** prithiv has quit IRC17:20
*** diogogmt has quit IRC17:22
*** dave-mccowan has joined #openstack-kolla17:22
*** coolsvap has joined #openstack-kolla17:25
*** diogogmt has joined #openstack-kolla17:26
mlimaguys, i need someone to test it https://review.openstack.org/#/c/310261/17:29
patchbotmlima: patch 310261 - kolla - Make Heka collect Ceph logs17:29
vhosakothuikang_: pinh17:30
vhosakotping*17:30
vhosakothuikang_: is neutron-OVN also a big tent project ?17:30
huikang_hi vhosakot17:30
huikang_yes, it is networking-ovn17:30
*** ravig has quit IRC17:30
huikang_https://github.com/openstack/networking-ovn17:30
vhosakothuikang_: thanks.. yes, please go ahead and add nova-docker and ovn containers... we will get the bp's approved17:31
*** ravig has joined #openstack-kolla17:32
huikang_thanks, vhosakot. will do that17:32
vhosakothuikang_: thanks!17:32
vhosakotI will go over the kolla bugs later today17:32
huikang_sounds great17:32
*** inc0 has quit IRC17:33
*** unicell has quit IRC17:33
*** unicell1 has joined #openstack-kolla17:33
Jeffrey4lis the nova-docker really a big tent project?17:36
Jeffrey4lhuikang_, ^17:36
Jeffrey4lin my understanding, only the project in this list is big tent project. https://github.com/openstack/governance/blob/master/reference/projects.yaml17:37
Jeffrey4lnot all the projects in the https://github.com/openstack is big tent.17:37
vhosakotinc0: we did not discuss gates in meeting... https://etherpad.openstack.org/p/kolla-newton-summit-kolla-functional-gating17:39
vhosakotall, please add your names if you want to implement more kolla gates https://etherpad.openstack.org/p/kolla-newton-summit-kolla-functional-gating17:39
huikang_Jeffrey4l, it seems networking-ovn is, while not for nova-docker17:40
Jeffrey4lhuikang_, i think so.17:40
*** Serlex has quit IRC17:40
huikang_so I will hold nova-docker for now. Will file a bp for networking-ovn17:41
huikang_Jeffrey4l, thanks for correcting me17:41
huikang_vhosakot, are you saying adding name next to that etherpad?17:42
vhosakotyes please... name and IRC nick would be awesome17:42
Jeffrey4lIIRC, because the nova-docker is so immature, so it is split to it own repo. huikang_17:43
Jeffrey4lcool.17:43
huikang_vhosakot, added my name to precheck. Maybe this is the simplest one to get me familiar with the gate17:43
vhosakotcool... thanks!17:43
huikang_Jeffrey4l, yes, I agree.17:44
*** dwalsh has quit IRC17:48
*** ravig has quit IRC17:49
*** dwalsh has joined #openstack-kolla17:50
*** ravig has joined #openstack-kolla17:51
*** ravig has quit IRC17:52
*** ravig has joined #openstack-kolla17:52
*** rstarmer has joined #openstack-kolla17:56
*** salv-orlando has quit IRC18:01
*** pbourke has quit IRC18:12
Lyncosmark-casey: just making sure . you didn't find anything about the DIND problem ?18:15
*** ravig has quit IRC18:15
*** ravig has joined #openstack-kolla18:16
mark-caseyLyncos: no but I might be able to try a build today and see if my strace looks like yours18:19
mark-caseyand whether mine still finishes18:19
Lyncosok18:19
LyncosI'm wondering why it's hanging18:19
*** Kennan has quit IRC18:19
LyncosI don't really know where to start troubleshooting this18:19
*** Kennan has joined #openstack-kolla18:20
*** huikang_ has quit IRC18:21
*** barra204 has joined #openstack-kolla18:23
*** gfidente has quit IRC18:26
*** inc0 has joined #openstack-kolla18:26
*** diogogmt has quit IRC18:28
inc0howdy y'all18:29
Lyncoslooking at the kolla-build code18:31
*** ravig has quit IRC18:31
Lyncosto fix the dind problem18:31
*** Jeffrey4l has quit IRC18:34
*** shardy has quit IRC18:34
Lyncosmark-casey: If I do not push it seems to work fine18:37
Lyncosit has something to do with push18:38
mark-caseyLyncos: good to know. I wonder if it is just that the images are big and we're communication through the docker bridge18:39
LyncosIt works for most of the images ...18:39
mark-caseysomething like an MTU problem or other networky issue might not show outside of a container but might inside18:39
mark-caseytrue18:40
mark-caseywhat if you push but don't build certain containers?18:40
mark-caseyLyncos: like only build 4 containers18:41
LyncosThis what I need to test18:41
LyncosIs there a way to exclude some images ?18:41
Lyncoslike if I don't want to build mesos stuff18:42
mark-caseyLyncos: yea. build.py takes a regex for what to build18:42
*** sdake has joined #openstack-kolla18:42
mark-caseypass it a junk regex and it will print a container list to match from18:42
mark-caseyafter saying "nothing matched"18:42
Lyncosok18:42
LyncosI'll check in a few min18:42
*** ravig has joined #openstack-kolla18:43
*** ravig has quit IRC18:44
*** sdake has quit IRC18:44
*** sdake has joined #openstack-kolla18:46
vhosakotLyncos: you can use the  --profile argument for kolla-build to build a pre defined set of images...18:46
vhosakotLyncos: https://github.com/openstack/kolla/blob/master/kolla/common/config.py#L88-L9418:46
vhosakotLyncos: https://github.com/openstack/kolla/blob/master/kolla/common/config.py#L27-L5318:46
Lyncoscool18:46
inc0either that or18:46
inc0kolla-build keystone18:46
inc0will build only images that matches .*keystone.*18:47
inc0so you can build whatever you really want18:47
Lyncosok will try to figure out something18:47
vhosakotyep... passing a part of the image name will be regexp-resolved18:47
sdakesay, are folks testing liberty much18:48
sdakei'm going to give it a 3 node spin after lunch and debug it a bit18:48
*** ravig has joined #openstack-kolla18:51
*** salv-orlando has joined #openstack-kolla18:51
*** ravig has quit IRC18:52
mark-caseyinc0: vhosakot thx couldn't remember exact regex details :D18:53
*** huikang has joined #openstack-kolla18:54
*** rajathagasthya has quit IRC18:55
*** salv-orlando has quit IRC18:56
*** ravig has joined #openstack-kolla18:56
*** salv-orlando has joined #openstack-kolla18:56
LyncosI'm trying my run with a subset of images (only the main ones)18:57
*** ravig has quit IRC18:58
vhosakotsdake: cool...18:58
MarMatHi there, did anybody experience 'base' image build failure on centos during last days?18:59
MarMatit seems that there is a problem with yum.mariadb.org19:00
vhosakotsdake: Jeffrey brough up a good point about locking distro version in branches and making kolla gracefully exit with a user-friendly error when a non-supported distro version is used.... like Liberty (Ubuntu 14), Mitaka (Ubuntu 14 and Ubuntu 15), Newton (Ubuntu 16)19:00
vhosakothttp://lists.openstack.org/pipermail/openstack-dev/2016-May/093968.html19:00
vhosakotMarMat: I was searching for you in Austin :)19:00
vhosakotsdake: http://lists.openstack.org/pipermail/openstack-dev/2016-May/093968.html19:00
sdakevhosakot works for me19:00
MarMathttp://yum.mariadb.org/10.0/centos7-amd64/repodata/1e0758072a0d3c05d5c1cdb74f8cdfae685ad7ff75dff0755ecdbfff0808bae3-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found19:01
sdakeMarMat centos source?19:01
MarMatsdake yep.19:01
sdakemaster or stable/mitaka?19:02
MarMatstable/mitaka19:02
inc0MarMat, did you run build with --no-cache?19:03
sdakeMarMat I am building whole thing right now, give me 15 mins19:03
MarMatinc0 yep, build cache off19:03
sdakemarmat could be a stable/mitaka bug, - which is why I am bujidling19:04
sdakeif I can build then itisi not19:04
vhosakotMarMat: which image fails to build on centos source ? just the mariadb image ?19:04
MarMatvhosakot maybe next summit :-)19:04
MarMatvhosakot base image fails19:05
vhosakotcool..19:05
*** dwalsh has quit IRC19:05
vhosakotMarMat: which image ? all images ? or just mariadb ?19:05
MarMatvhosakot base image fails, all others are then dependent.19:05
vhosakotopenstack-base or centos-base ?19:05
MarMatjust base19:05
vhosakotMarMat: let me check if it seen in gate so we know if it is a public repo issue19:06
*** salv-orlando has quit IRC19:07
*** SiRiuS has quit IRC19:08
*** salv-orlando has joined #openstack-kolla19:08
vhosakotMarMat: both centos source and binary built fine at the gate at 1:35 pm today19:09
vhosakothttps://review.openstack.org/#/c/312629/19:09
patchbotvhosakot: patch 312629 - kolla - Deletes fake containers on cleanup Closes-Bug: 157...19:09
openstackbug 157 in Baz (deprecated) "move current_working_directory from fs/ to vu-sys/" [Medium,New] https://launchpad.net/bugs/15719:10
vhosakotMarMat: https://review.openstack.org/#/c/312629/19:10
patchbotvhosakot: patch 312629 - kolla - Deletes fake containers on cleanup Closes-Bug: 157...19:10
MarMatvhosakot ok, then i'll analyse more in depth where is the problem19:11
LyncosI'm trying to figure out why my kolla-build is failing when I specify only a small subset of images to be built.... any idea ?19:12
vhosakotMarMat: as a sanity check, I can open http://yum.mariadb.org fine in a broswer... so, the repo is up19:12
Lyncoshttp://paste.openstack.org/show/496137/19:12
vhosakotLyncos: what command did you use ?19:13
MarMatvhosakot yep that repo seems to be fine, let me analyse...19:13
vhosakotMarMat: cool19:13
*** salv-orlando has quit IRC19:13
mark-caseyLyncos: I don't see any error though. it just says some containers were unmatched so not built19:13
Lyncosbut it dosen't return 019:13
Lyncosand make my jenkins job fail19:14
Lyncos+ kolla-build --push --nocache --type source --base ubuntu --registry docker.gameloft.org:5000 --namespace dev -T 10 --include-header docker.file kolla neutron heat nova cinder glance calico horizon keystone kibana elasticsearch ironic19:14
sdakeMarMat gotta tell ya, my build is working fine :(19:15
sdakeMarMat so that likely mean syou have some type of network connectivity issue19:15
mark-caseyLyncos: if it says the correct containers were built and pushed then the non-zero exit may just be a bug. maybe you could ||true it temporarily?19:16
Lyncosmark-casey:  with that kolla-build command.. I don't have the 'haning' issue19:16
mark-caseyLyncos: I'd try disabling compression on the docker push as a test19:18
mark-caseyI'm seeing RFE for such a thing but haven't found if it landed in docker yet19:18
Lyncosdocker compression19:19
Lyncoshumm19:19
mark-caseyLyncos: not in it's storage. I'm wondering about some sort of compression on the image going over the wire19:19
rhalliseysdake, can you review my governance and infra patches for kolla-kubernetes?19:20
rhalliseyhttps://review.openstack.org/#/c/312707/19:20
patchbotrhallisey: patch 312707 - governance - Kolla-kubernetes repo19:20
mark-caseyLyncos: it's the only reason I can imagine one successfully built image pushing and another not pushing19:20
rhalliseyhttps://review.openstack.org/#/c/312592/19:20
patchbotrhallisey: patch 312592 - openstack-infra/project-config - Kolla-kubernetes19:20
*** dwalsh has joined #openstack-kolla19:21
sdakerhallisey that governance change can't be maade unttil the change is made for the new project add19:21
rhalliseyya but I needed it for a depends-on in the commit msg19:22
rhalliseyjust review the infra patch then19:22
*** sdake has quit IRC19:25
*** sdake has joined #openstack-kolla19:26
*** SiRiuS has joined #openstack-kolla19:27
*** signed8bit is now known as signed8bit_Zzz19:28
mark-caseyLyncos: looks like pushes to v2 registries are always compressed (https://github.com/docker/docker/pull/11869), so maybe this instead: https://github.com/docker/distribution/issues/46919:28
*** mbound has joined #openstack-kolla19:29
Lyncosnot sure if it make sense19:30
*** salv-orlando has joined #openstack-kolla19:30
Lyncoswhen I enable the kolla-build logs  I see ...  Trying to push / pushed   for every images... and the last message I have  is    pushed19:30
Lyncoskolla-build *debug I mean19:31
LyncosSo it's not trying to push anything19:31
Lyncosbut it is somehow related because when I don't push .. it works19:31
LyncosI'll also try with single thread19:33
*** SiRiuS has quit IRC19:35
*** dwalsh has quit IRC19:35
*** ravig has joined #openstack-kolla19:36
sdakebuilding fresh 1.1.0 for testing atm - wish me well :)19:37
inc0is building rabbitmq broken or it's jsut me?19:37
inc0ubuntu source 1.1.019:37
inc0but it might be in mitaka as well19:37
sdakehow is our patch doing in the gate inc0?19:38
inc0used to be green19:38
sdakelooks like ust centos binary is failing19:38
sdakeif it wa green when you submitted it, our gate needs to be beefed up19:38
sdakebecause it definately didn't even launch a vm to the active state19:39
*** geseib has quit IRC19:39
*** geseib has joined #openstack-kolla19:39
*** ravig has quit IRC19:41
sdake2016-04-24 01:05:43.738 | msg: Hostname has to resolve to IP address of api_interface19:45
sdakerax-ord again19:46
sdakei thought this problem was resolved19:46
*** openstackgerrit has quit IRC19:48
*** openstackgerrit has joined #openstack-kolla19:48
*** ravig has joined #openstack-kolla19:48
LyncosWhy kolla-build is not returning exit code 0 when all containers are built successfully19:50
Lyncos?19:50
*** rajathagasthya has joined #openstack-kolla19:51
*** athomas has quit IRC19:52
*** steveeJ has joined #openstack-kolla19:56
*** huikang has quit IRC19:57
*** daneyon has joined #openstack-kolla19:59
*** salv-orlando has quit IRC20:00
vhosakotLyncos: are you calling kolla-build in a bash script and expect a return code ?20:01
*** huikang__ has joined #openstack-kolla20:01
Lyncosyes20:03
LyncosIn fact I call it in jenkins in a bash build step20:04
sdakeLyncos that would be a bug20:04
sdakeplease file one and it will be fixed :)20:04
sdakefirst z stream20:04
LyncosI'll make sure it's not a jenkins related problem and will open one20:04
sdakewe are about 30 days away from that20:04
Lyncosz stream ?20:05
sdakex..y.z20:05
sdakeright now our z stream is 020:05
sdake2.0.020:05
sdakewe will go to 2.0.1 in 30 days20:05
sdakewe release a z stream every 45 days20:05
sdakewe being mostly i20:05
sdakebut the team helps fix the bugs that go into it :)20:05
LyncosWe started working on deploying OS with Calico neutron plugin20:07
Lyncoswe might push it to you guys once we finish our POC20:08
*** harlowja has quit IRC20:09
*** signed8bit_Zzz is now known as signed8bit20:09
*** athomas has joined #openstack-kolla20:11
*** salv-orlando has joined #openstack-kolla20:11
*** athomas has quit IRC20:11
*** huikang__ has quit IRC20:12
*** dmk0202 has joined #openstack-kolla20:14
sdakeLyncos souns good - i dont know tht we cam up with a fantastic way of handling plugins at summit but we had a couple options20:15
sdakei intend to send out a summary of summit once my brain is working again well ;)20:16
*** mlima has quit IRC20:16
*** dwalsh has joined #openstack-kolla20:17
LyncosRight now we doing our own way.. but we are willing to follow what ever direction you'll take if that make any sense for us off course20:18
inc0Lyncos, what's "your own way"?20:19
inc0--include-footer stuff we discussed few days ago?20:19
LyncosWe build the container with kolla .. we created a new dockerfile20:19
Lyncosand handling the rest with our ansible20:19
Lyncosnot fully integrated yet... it is just for a proof of concept20:20
sdakeLyncos we would like to make osmething the scales to all plugis20:21
sdakebut of course wont stop you since we haven't fixed it yet :)20:21
sdakenor would we otherwise20:21
Lyncosyeah I understand20:21
ccesarioLyncos, the complete patch is available there https://blueprints.launchpad.net/kolla/+spec/add-xenial-support20:21
Lyncosif you want us to test calico with your plugin thing just ask us20:21
sdakei would encourage you to not have much variance compared to upstream though, its extremely expensive to do so ;)20:22
Lyncosbut calico change a lot of default stuff20:22
Lyncosno more network node, move haproxy on controllers, move dhcp to compute nodes (each of them need dhcp)20:22
sdakegood thing ansible has j2 for conditoinal :)20:22
sdakei see architecture changes20:23
sdakewhy no network node?20:23
*** daneyon_ has joined #openstack-kolla20:23
Lyncosno need for central network node.. it is unscalable and it is the whole point of Layer3 infrastructure20:23
Lyncosthere is no LBAAS, router, nat  with calico20:23
sdakeok get that, but why not just say "network is the same as comtnrol)20:23
inc0Lyncos, where do you run neutron agents?20:23
inc0l320:24
Lyncoswe don't need L3 agents20:24
inc0oh, you're running calico?20:24
inc0thats cool20:24
Lyncosyeah20:24
inc0I'd love to hear more about your experiences with it20:24
LyncosWe love it20:24
mark-caseyIIRC calico has no bridges and runs veth to each instance20:24
sdakeright - I htink we want to keep the "network" group, but figure out how to make it work for the calico case20:24
inc0it's on higher end of my "cool projects to check" list20:24
*** von123 has joined #openstack-kolla20:24
sdakewhich in calico, would be a no-op20:24
Lyncoswe are about to deploy our L3 infra in pre-prod20:25
inc0sdake, calico changes the way you think about networking there20:25
von123hey room20:25
sdakehow many nodes20:25
sdakei know what calico doess20:25
sdake;-)20:25
inc0hey von12320:25
sdakehey von12320:25
Lyncosfor now we have 6 storages (ceph)  3 controllers and 6 computes20:25
von123I am having issues with prechecks20:25
inc0ah yeah...you're from cisco, you do network stuff20:25
von123trying to do multinode20:25
Lyncosbut we will grow as we migrate from the old crappy network20:25
*** daneyon has quit IRC20:26
von123getting the error while evaluating conditional: '169.254.'20:26
sdakeinc0 i dont do network stuff ;)20:26
von123understood20:26
Lyncosthis is our dockerfile for  calico-dhcp-agent (which replace neutron-dhcp-agent)20:27
Lyncoshttp://paste.openstack.org/show/496149/20:27
LyncosI think you will like it20:27
Lyncoswe just did not integrate centos20:27
mark-caseyvon123: what task do you get that error on?20:27
inc0looks nice20:27
von123Checking if kolla_internal_vip_address is in the same network as network_interface on all nodes20:27
inc0man if we run k8s + calico20:28
inc0it's like sdn done right20:28
LyncosI hate k8s20:28
LyncosI don't see any benefit20:28
Lyncosmaybe I just don't get it20:28
*** banix has quit IRC20:28
inc0Lyncos, imagine...no more galera cluster20:28
mark-caseyLyncos: any benefit in what?20:28
inc0and better ha for db20:28
mark-caseyinc0: why no galera?20:28
Lyncoswhy no galera yeah20:28
inc0because you run single db container20:29
inc0not clustered20:29
inc0and let k8s work ha20:29
Lyncosand what if that container die20:29
sbezverkinc0 I do network stuff :-) and as much as you would like, software will NEVER outperform hardware, so your callico it is just a toy to spend time for chldren ;-)20:29
*** barra204 has quit IRC20:29
inc0Lyncos, it got restarted20:30
Lyncoswhat if the node is dead20:30
inc0and volumes mounted20:30
Lyncoshow the data is replicated20:30
inc0it got restared somewhere20:30
inc0data never hits local disk20:30
inc0it sits safely on ceph rbd20:30
Lyncosah yeah20:30
Lyncosbut you can do the same without20:30
inc0and got connected to wherever new container runs20:31
inc0sbezverk, hold on now20:31
inc0calico can outperform ospf20:31
inc0because bgp is more lightweight20:31
LyncosWe are using calico with cumulus quagga20:31
Lyncoswith good orchestration it's way easier top automate things20:32
Lyncosthan our existing L2 cisco network20:32
Lyncos(by the way I hate cisco fexes)20:32
inc0<< grabs popcorn >>20:32
*** SiRiuS has joined #openstack-kolla20:34
sbezverkLyncos nothing against good orchestration :-) but when you talkin about moving packet from A interface to B, man nothing beats well designed forwarding asics20:34
LyncosWho said calico is not using asics ?20:35
*** salv-orlando has quit IRC20:35
mark-caseyinc0: that's interesting about no galera on k8s. I knew it handled the haproxy part but I don't see why you wouldn't want any k8s node to be able to serve DB requests20:35
Lyncosall our switches run Cumulus linux.. and everything is offloaded to asics (even iptables rules)20:35
mark-caseyby running x number of galera containers20:35
Lyncosthe only non asic point  are the computes20:35
Lyncosbut why would you like asics here ... it is really just publishing routes to BGP20:36
sdakei had an asic bit coint miner20:36
sdakeit made me 22k in profit in 4 months20:36
Lyncosalso having a full layer3 infra make any point in the one pod to be at equal distance each others..20:37
Lyncosand fully scalable20:37
Lyncosah yeah the compute is doing routing20:38
Lyncosit is much slower than using ovs right ?20:38
sbezverkLyncos do not get me wrong I am all for L3 networks, even though vxlan and stiching remote l2 domains is still widely used..20:38
Lyncosone of the reason we switch to full L3 is we are trying to reduce the stack of proprietary protocols20:39
LyncosIe .. get rid of cisco20:39
Lyncossdake please don't hate me20:40
sbezverkLyncos sure, why not, I am just curious when things go south who you are going to cry for help ;-)20:40
*** dwalsh has quit IRC20:40
sdakeLyncos i wear my community hat on irc :)20:40
mark-caseyhe isn't the only ... err Cisconian?20:40
mark-caseysbezverk: Ghostbusters20:41
LyncosIn fact .. our network team is quite weak.. so  the sysadmins will handle the network.. the reason we run linux on switches :-)20:41
sbezverkLyncos I see, I come from the world where it is reverse, sysadmin is just a show stopper, but the networking team rocks20:42
Lyncosnot here20:43
Lyncoswe only have 1 good network guy20:43
sbezverkLyncos it is great to have diversity :-) so we can live and survive20:43
Lyncosall the rest are tickets doers20:43
Lyncosyeah :-)20:43
Lyncossbezverk: I agree .. that kind of infra is not so easy to implement20:44
*** salv-orlando has joined #openstack-kolla20:44
*** ravig has quit IRC20:45
LyncosIs there a task or bug or something where we can follow/comment on the plugins implementation ?20:45
sbezverkLyncos I heard some stories from I think Rackspace who jumpped on ovs as new shiny toy, but due to instability and complexety of troubleshooting rolled back to simple and dumb linux bridge env..20:45
sdakeLyncos when i get done being on pto i plan to write a bunch of bluepirnts20:46
Lyncossbezverk: We went to L3 for that reason20:46
sdakeatm im fcoused on fixing up liberty20:46
Lyncossdake: why fixing liberty20:46
Lyncos:-)20:47
sdakewe rebranched it20:47
Lyncosok20:47
sdakeso mitaka = liberty20:47
sdakedifference being which distro of openstack is deployed20:48
Lyncosthen we'll try to do it as 'modular' as possible to make it easy to implement with kolla20:48
Lyncossbezverk: same reason we went to Calico20:49
*** daneyon_ has quit IRC20:49
Lyncosovs is too complicated20:49
inc0mark-casey, so reason I like no-galera approach is that it actually gives lower downtime20:50
sbezverkLyncos: Curious what Calico controller controls, is it a server based packet switches or some other devices?20:51
Lyncoscalico is just a translator between Agents and neutron20:53
Lyncosall the routing is done by publishing routes20:53
mark-caseyinc0: hmm. that's a strong statement. is that because galera is more complicated and so must break more or hard numbers?20:53
*** huikang has joined #openstack-kolla20:54
Lyncosthere is nothing preventing you from doing no galera without k8s20:54
inc0mark-casey, that's because when your master dies it takes a bit for quorum to reestablish new master20:54
Lyncosjust mount a ceph volume on  the controller and thats it ?20:54
inc0Lyncos, something has to care about container running20:55
inc0so you need some sort of orchiestration20:55
mark-caseyinc0: I didn't think galera had a master... it isn't async at all20:55
inc0having spof is no-good unless you will restart new one moment later20:55
inc0mark-casey, not really20:55
inc0on low level it's master-slave afaik20:55
Lyncosis galera the only reason to go with k820:56
mark-caseyinc0: https://www.percona.com/blog/2013/05/14/is-synchronous-replication-right-for-your-app/20:56
inc0Lyncos, not really, it's more about "this thing dies, it gets restarted"20:56
Lyncosok20:57
inc0so if we do it well, it's really a fire and forget thing20:57
LyncosI'm really not a big fan of kube20:57
Lyncossorry20:57
Lyncos:-)20:57
inc0remove any node from cluster, jsut turn it off20:57
inc0start new one, just put it into cluster20:57
LyncosPeople here are trying to convince me20:57
inc0no need to apologize, I wasn't sure too20:57
inc0but it turns out to be really slick in few places20:57
inc0Lyncos, tell you what, when we're done with kolla-k8s, give it a shot20:58
LyncosI'll do20:58
LyncosI was thinking K8s more to be run inside OS .. not having OS running on it20:58
Lyncosso we going to have20:58
inc0I think we can pull off better HA than what we have with ansible20:58
inc0unless we can do that, there is little value20:59
inc0but I think we can20:59
Lyncosok20:59
LyncosI see the point20:59
inc0brb, meeting20:59
*** rhallisey has quit IRC20:59
*** ravig has joined #openstack-kolla21:03
*** ravig has quit IRC21:04
*** barra204 has joined #openstack-kolla21:05
*** huikang has quit IRC21:06
*** ravig has joined #openstack-kolla21:07
*** barra204 has quit IRC21:08
*** barra204 has joined #openstack-kolla21:09
*** banix has joined #openstack-kolla21:10
*** harlowja has joined #openstack-kolla21:10
*** haplo37 has quit IRC21:12
*** mbound has quit IRC21:13
*** rstarmer has quit IRC21:23
*** daneyon has joined #openstack-kolla21:24
openstackgerritMerged openstack/kolla: Adding ability to specify capabilities and security  https://review.openstack.org/30844721:27
mark-caseyvhosakot: ping21:29
vhosakotmark-casey: pong21:29
mark-caseyyou have some experience with the prechecks right?21:30
vhosakotmark-casey: a bit.. yes21:30
mark-caseydo you remember what this is intending? https://github.com/openstack/kolla/blob/0078d9b4a172ee8c7cd14d6ba64d1ff341265990/ansible/roles/prechecks/tasks/port_checks.yml#L463-L46421:30
mark-caseyvon123 is getting "error evaulating conditional" from ansible in multinode and I was trying to assist and thought you might have a thought21:31
*** asalkeld has joined #openstack-kolla21:31
mark-caseythat is... I thought you had added some of them21:32
vhosakotmark-casey: that makes sure that kolla_internal_vip_address is in the same network range as network_interface21:32
mark-caseyvhosakot: vip_internal_address is 192.168.1.50...    and manually running it on a node gives...21:33
mark-casey 2: eth0    inet 192.168.1.37/24 brd 192.168.1.255 scope global dynamic eth0\       valid_lft 67740sec preferred_lft 67740sec21:33
*** signed8bit has quit IRC21:33
*** daneyon has quit IRC21:34
*** jtriley has quit IRC21:37
vhosakotmark-casey: yes, the precheck should pass as 192.168.1.50 (kolla_internal_vip_address) is in the range 192.168.1.37/24 (assuming your network_interface is eth0)21:38
mark-caseyvhosakot: fatal: [kolla-4] => error while evaluating conditional: '169.254.' not in kolla_internal_vip_address and 'False' in kolla_internal_vip_address | ipaddr(ip_addr_output.stdout.split()[3])21:39
vhosakotmark-casey: do you see this error on all nodes ? few nodes ? just one node ?21:40
vhosakotmark-casey: you should see the IP/hostname from Ansible output21:40
*** inc0 has quit IRC21:40
von123its on all nodes21:44
mark-caseyvhosakot: I was assisting von123. he is getting it from all nodes. ^^21:44
von123thanks mark21:44
vhosakotcool21:44
vhosakotvon123: what is your network_interface in globals.yml ?21:44
von123eth021:45
*** inc0 has joined #openstack-kolla21:47
*** fragatin_ has joined #openstack-kolla21:50
*** fragatina has quit IRC21:51
mark-caseyvhosakot: having thought a few more minutes I'm wondering if the registered value isn't blank or something in this particular case21:52
vhosakotmark-casey: yes, if the value is blank/empty, it would crash.. but, it shoulnd't be blank21:53
vhosakotvon123: can you pastebin the output of    "ip -4 -o addr show dev eth0"   from all nodes please21:53
mark-caseyno argument there :D21:54
von123vhosakot: no problem21:54
*** rajathagasthya has quit IRC21:55
vhosakotmark-casey: ip -4 -o addr show dev {{ network_interface }}      will not be empty unless  network_interface does not exist, in which case it is anwyay an invalid value in globals...21:55
*** fragatin_ has quit IRC21:57
vhosakotmark-casey: when I tested, even when network_interface does not have an IP address (due to operator error), the registered value was not black21:57
vhosakotblank*21:57
*** fragatina has joined #openstack-kolla21:57
mark-caseynice :)21:58
von123could it be that the ip command failed21:58
vhosakotvon123: can you send the full output of "kolla-ansible prechecks" in pastebin21:59
*** huikang has joined #openstack-kolla22:01
*** dmk0202 has quit IRC22:01
von123https://www.dropbox.com/s/u7ivk6nau5d3run/log4.rtf?dl=022:05
von123I found the problem22:05
von123I had to add sudo to the command and that seems to have fixed the issue22:06
*** rajathagasthya has joined #openstack-kolla22:09
*** SiRiuS has quit IRC22:10
*** huikang has quit IRC22:11
*** ravig has quit IRC22:11
*** ravig has joined #openstack-kolla22:12
*** ccesario___ has joined #openstack-kolla22:12
*** absubram has quit IRC22:15
dimssdake : want to throw in a +1 explicitly? the comments are easy to miss https://review.openstack.org/#/c/312592/22:16
patchbotdims: patch 312592 - openstack-infra/project-config - Kolla-kubernetes22:16
vhosakotvon123: using sudo or not depends on how the operator's user id is setup on the build node and operator's preveligies22:20
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla: WIP: Changes needed to deploy liberty with mitaka code  https://review.openstack.org/30839022:21
sdakeinc0 multinode http://paste.openstack.org/raw/496167/22:24
sdakedims acked thanks22:24
inc0ok, I'll take a look at it first thing tomorrow22:24
inc0guys I can't stress that enough, we need this thing tested properly22:25
sdakeya folks lets release tuesday of next week22:26
sdakewhich means we have 1 week to test22:26
sdakeplease lets get er done22:26
sbezverksdake it is the same issue I hit the other day!22:26
von123vhosakot: yeah when you told me to run it on each node tried to run a loop and ...22:26
sdakesbezverk using liberty or some other branch?22:27
sbezverksdake and some how you magical fix helped22:27
vhosakotvon123: cool.. that precheck is supposed to run on each node22:27
sbezverkmaster and stable/mitaka22:27
sdakesbezverk was it a one off issue?22:28
sbezverksdake I tested your fix on master though22:28
*** inc0 has quit IRC22:28
sbezverksdake no it was 100% reproducible22:28
sdakewhat was my fix?22:28
sdakethe kazoo removal?22:29
sbezverksdake :-) yep22:29
von123vhosakot: if we wanted to change the base openstack repo how would we do that22:32
vhosakotvon123: you mean change the repo used by openstack-base's Dockerfile ?22:33
von123vhosakot: will we want to install kilo but it keeps install mitaka22:34
vhosakotvon123: you'd have to point the individual services to stable/kilo in kolla-build.conf.... https://github.com/openstack/kolla/blame/master/doc/image-building.rst#L11222:36
vhosakotvon123: if you're building from source, another way would be to use the kilo packages in tarballs.openstack.org instead of master  ->  https://github.com/openstack/kolla/blob/master/kolla/common/config.py#L149-L24322:39
sdakesbezverk did my fix for master make it to liberty?22:41
*** mark-casey has left #openstack-kolla22:46
*** mbound has joined #openstack-kolla22:46
sbezverksdake I have not done any cherrypikcing, have no rights ;-) so if you have not done it then no22:49
sdakeanyone can cherrypick22:50
openstackgerritSteven Dake proposed openstack/kolla: Remove dependencies on kazoo and friends  https://review.openstack.org/31277622:50
sbezverksdake in this case it requires another mentoring webex22:52
*** harlowja has quit IRC22:52
*** harlowja has joined #openstack-kolla22:53
openstackgerritSteven Dake proposed openstack/kolla: Remove dependencies on kazoo and friends  https://review.openstack.org/31277722:54
*** ravig has quit IRC22:54
*** banix has quit IRC22:54
*** vhosakot has quit IRC22:54
openstackgerritSteven Dake proposed openstack/kolla: Remove dependencies on kazoo and friends  https://review.openstack.org/31277622:56
sdakecore reviewer cats, need those acked especiall yteh liberty version :)22:57
von123all: when deploying multinode do you have to run build.py on each node?22:57
sdakevon not if you usea registry22:57
sdakebut atm it looks like mitaka may be broken multinode22:57
sdakeuntil those patche aboe hit the repo22:58
*** ccesario___ has quit IRC22:58
*** dwalsh has joined #openstack-kolla23:09
*** banix has joined #openstack-kolla23:15
*** mummer has quit IRC23:20
*** dwalsh has quit IRC23:23
*** sacharya has quit IRC23:33
*** rajathagasthya has quit IRC23:35
*** sdake has quit IRC23:37
*** salv-orlando has quit IRC23:39
*** fragatina has quit IRC23:39
*** fragatina has joined #openstack-kolla23:40
*** mummer has joined #openstack-kolla23:40
openstackgerritCarlos Cesario proposed openstack/kolla: Add xenial support - (Ubuntu 16.04)  https://review.openstack.org/31278923:40
*** banix has quit IRC23:44
*** rajathagasthya has joined #openstack-kolla23:48
*** mbound has quit IRC23:48
*** huikang has joined #openstack-kolla23:50
*** rajathagasthya has quit IRC23:54
*** von123 has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!