Wednesday, 2016-06-08

*** cloudnautique has joined #openstack-kolla00:00
*** ravig has joined #openstack-kolla00:02
cloudnautiqueHello, is there any docs on how to setup neutron with network bridging using kolla00:03
cloudnautiqueI am able to deploy repeatedly with Kolla with broken networking :)00:03
cloudnautiquein the sense, that its failing to allocate ports00:03
cloudnautiqueneutrong->linuxbridge00:04
kklimondawhat version of docker does current stable/liberty support?00:07
kklimondahmm00:09
*** dwalsh has joined #openstack-kolla00:10
Mech422kklimonda: Not sure about stable/liberty - stable/mitaka wanted docker 1.10+ I think ?00:11
Mech422cloudnautique: not sure - Kolla is pretty OVS focused atm.  I haven't seen any docs on alternate network configs yet00:12
kklimondayeah, stable/liberty does too00:12
kklimondasomehow images I've built (only this particular tag) aren't showing up when I query my registry from nodes I'm deploying OS on..00:13
Mech422kklimonda: did you change the default registry port, add the --insecure-registry option to docker startup, and restart the docker daemons on the nodes ?00:19
kklimondaah, I see the problem - didn't set push to True00:20
kklimondaso the images were available on the node I've built them on, but weren't pushed to the repository00:21
*** ravig has quit IRC00:22
*** Jeffrey4l has quit IRC00:24
openstackgerritDavid Wang proposed openstack/kolla-kubernetes: Added kolla-kubernetes specific instructions for Docs and Tests  https://review.openstack.org/32676900:32
dcwangmit01^ First commit :)00:33
Mech422dcwangmit01: grats :-)00:36
*** ssurana has quit IRC00:39
*** kbyrne has quit IRC00:40
*** kbyrne has joined #openstack-kolla00:42
*** zhiwei has joined #openstack-kolla00:43
*** ravig has joined #openstack-kolla00:45
*** zhiwei has quit IRC00:48
*** rhallisey has quit IRC00:48
openstackgerritHui Kang proposed openstack/kolla: Create openvswitch-vswichd/db-server for individual fake nova compute  https://review.openstack.org/32677300:50
*** salv-orlando has quit IRC00:53
*** salv-orlando has joined #openstack-kolla00:53
*** dwalsh has quit IRC00:57
*** godleon has quit IRC00:59
*** rahuls has quit IRC01:00
*** diogogmt has joined #openstack-kolla01:24
*** zhiwei has joined #openstack-kolla01:26
*** phuongnh has joined #openstack-kolla01:29
*** tzn has joined #openstack-kolla01:38
*** signed8bit_Zzz is now known as signed8bit01:43
*** tzn has quit IRC01:43
*** signed8b_ has joined #openstack-kolla01:44
*** signed8bit has quit IRC01:47
*** sacharya has joined #openstack-kolla01:59
*** signed8b_ is now known as signed8bit_Zzz02:00
*** iceyao has joined #openstack-kolla02:04
*** iceyao has quit IRC02:28
*** iceyao has joined #openstack-kolla02:29
*** iceyao_ has joined #openstack-kolla02:31
*** sdake has joined #openstack-kolla02:32
*** sdake has quit IRC02:34
*** iceyao has quit IRC02:34
*** coolsvap has joined #openstack-kolla02:44
*** openstackgerrit has quit IRC02:47
*** openstackgerrit has joined #openstack-kolla02:48
*** dave-mccowan has quit IRC02:54
*** fragatina has quit IRC03:19
*** tzn has joined #openstack-kolla03:27
*** sdake has joined #openstack-kolla03:28
*** tzn has quit IRC03:31
*** diogogmt has quit IRC03:32
*** ravig has quit IRC03:33
*** absubram has joined #openstack-kolla03:41
*** sdake has quit IRC03:53
*** daneyon_ has joined #openstack-kolla04:07
*** daneyon_ has quit IRC04:12
*** fragatina has joined #openstack-kolla04:17
*** ravig has joined #openstack-kolla04:20
*** fragatina has quit IRC04:22
*** salv-orl_ has joined #openstack-kolla04:24
*** SiRiuS__ has joined #openstack-kolla04:26
*** salv-orlando has quit IRC04:27
*** fragatina has joined #openstack-kolla04:38
*** fragatina has quit IRC04:40
*** fragatina has joined #openstack-kolla04:40
*** fragatin_ has joined #openstack-kolla04:41
*** fragatina has quit IRC04:44
*** v1k0d3n has quit IRC04:57
*** sdake has joined #openstack-kolla05:01
*** salv-orl_ has quit IRC05:03
*** salv-orlando has joined #openstack-kolla05:03
*** tzn has joined #openstack-kolla05:15
*** tzn has quit IRC05:20
*** sacharya has quit IRC05:22
*** sdake has quit IRC05:32
*** fragatin_ has quit IRC05:36
*** tfukushima has joined #openstack-kolla05:49
*** daneyon_ has joined #openstack-kolla05:56
*** daneyon_ has quit IRC06:00
*** v1k0d3n has joined #openstack-kolla06:03
openstackgerritMd Nadeem proposed openstack/kolla: Added unit test for kolla_docker  https://review.openstack.org/28513806:11
*** lifeless has quit IRC06:13
openstackgerritMd Nadeem proposed openstack/kolla: Added unit test for check container  https://review.openstack.org/28651306:18
*** Mr_Broken has joined #openstack-kolla06:18
*** sacharya has joined #openstack-kolla06:22
*** sacharya has quit IRC06:27
*** ravig has quit IRC06:28
*** ravig has joined #openstack-kolla06:30
*** jpeeler has quit IRC06:47
*** openstackgerrit has quit IRC06:48
*** openstackgerrit has joined #openstack-kolla06:48
*** sdake has joined #openstack-kolla06:54
*** jpeeler has joined #openstack-kolla06:55
*** belmoreira has joined #openstack-kolla07:00
*** salv-orlando has quit IRC07:02
*** tzn has joined #openstack-kolla07:03
*** salv-orlando has joined #openstack-kolla07:03
*** coolsvap has quit IRC07:04
*** coolsvap has joined #openstack-kolla07:04
*** tzn has quit IRC07:07
*** sdake has quit IRC07:10
*** sacharya has joined #openstack-kolla07:24
*** mikelk has joined #openstack-kolla07:25
*** ravig has quit IRC07:28
*** sacharya has quit IRC07:28
*** matrohon has joined #openstack-kolla07:29
*** salv-orlando has quit IRC07:32
*** salv-orlando has joined #openstack-kolla07:32
*** Liuqing has joined #openstack-kolla07:37
*** shardy has joined #openstack-kolla07:39
*** daneyon_ has joined #openstack-kolla07:44
*** openstackgerrit has quit IRC07:48
*** openstackgerrit has joined #openstack-kolla07:48
*** daneyon_ has quit IRC07:49
*** Jeffrey4l has joined #openstack-kolla07:50
*** Liuqing has quit IRC07:52
*** salv-orlando has quit IRC08:10
*** salv-orlando has joined #openstack-kolla08:11
*** tyrola has joined #openstack-kolla08:34
*** dmk0202 has joined #openstack-kolla08:37
*** tzn has joined #openstack-kolla08:42
*** Serlex has joined #openstack-kolla08:42
*** tzn has quit IRC08:43
*** tzn has joined #openstack-kolla08:47
*** openstackgerrit has quit IRC08:48
*** openstackgerrit has joined #openstack-kolla08:48
*** jmccarthy1 has joined #openstack-kolla08:52
*** iceyao_ has quit IRC08:53
*** jmccarthy1 has quit IRC09:01
*** tyrola has quit IRC09:07
*** sdake has joined #openstack-kolla09:16
*** belmoreira has quit IRC09:19
*** wmiller has joined #openstack-kolla09:21
*** sacharya has joined #openstack-kolla09:24
*** sacharya has quit IRC09:29
*** tfukushima has quit IRC09:32
*** tfukushima has joined #openstack-kolla09:32
*** Mr_Broken has quit IRC09:37
*** Mr_Broken has joined #openstack-kolla09:37
*** jmccarthy1 has joined #openstack-kolla09:37
*** Mr_Broken has quit IRC09:42
mdnadeem_Jeffrey4l, Please let me know if ansible 2.0 support is done or still you need to update kolla_docker.py file, if not then i will resume the unit test case writing for kolla_docker.py file (https://blueprints.launchpad.net/kolla/+spec/ansible-unit-tests) ?09:47
*** belmoreira has joined #openstack-kolla09:48
*** sdake has quit IRC09:49
*** iceyao has joined #openstack-kolla09:53
*** iceyao has quit IRC09:58
*** tzn has quit IRC10:11
*** pbourke has quit IRC10:12
*** jamie_h has joined #openstack-kolla10:12
*** pbourke has joined #openstack-kolla10:13
*** matrohon has quit IRC10:21
*** salv-orl_ has joined #openstack-kolla10:25
*** jmccarthy1 has left #openstack-kolla10:26
*** daneyon_ has joined #openstack-kolla10:27
*** salv-orlando has quit IRC10:28
*** mbound has joined #openstack-kolla10:29
*** daneyon_ has quit IRC10:31
*** salv-orl_ has quit IRC10:34
*** salv-orlando has joined #openstack-kolla10:34
*** Mr_Broken has joined #openstack-kolla10:35
*** rhallisey has joined #openstack-kolla10:41
*** Mr_Broken has quit IRC10:54
*** Mr_Broken has joined #openstack-kolla10:57
*** rhallisey has quit IRC10:59
*** phuongnh has quit IRC11:10
*** sacharya has joined #openstack-kolla11:25
*** diogogmt has joined #openstack-kolla11:27
*** sacharya has quit IRC11:30
*** mliima has joined #openstack-kolla11:31
*** tfukushima has quit IRC11:32
*** jmccarthy has quit IRC11:37
*** jmccarthy has joined #openstack-kolla11:38
*** rhallisey has joined #openstack-kolla11:40
*** sdake has joined #openstack-kolla11:44
sdakemorning11:46
coolsvapmorning sdake11:48
*** alyson_ has joined #openstack-kolla11:48
coolsvapsdake, i want to request for making the meeting time again UTC 1600 for all meetings unless there are major objections11:51
sdakecoolsvap please do so on the mailing list11:52
sdakeand morning to ya :)11:52
coolsvapsdake, let me do it11:52
*** tzn has joined #openstack-kolla11:53
*** salv-orlando has quit IRC11:59
*** Mr_Broken has quit IRC11:59
*** salv-orlando has joined #openstack-kolla12:00
*** Mr_Broken has joined #openstack-kolla12:00
*** Mr_Broken has quit IRC12:00
*** Mr_Broken has joined #openstack-kolla12:00
*** dwalsh has joined #openstack-kolla12:01
*** diogogmt has quit IRC12:05
*** ayoung has quit IRC12:07
*** sdake has quit IRC12:13
Jeffrey4lmdnadeem_, still around?12:14
Jeffrey4lmdnadeem_, the ansible 2.0 support is done.12:14
*** salv-orl_ has joined #openstack-kolla12:15
Jeffrey4lnow kolla master works with ansible 2.0 and ansible 2.112:15
ccesarioJeffrey4l, nice work!!  I have testing it12:17
ccesarioand it works very nice!12:18
Jeffrey4lcool. thanks c12:18
*** salv-orlando has quit IRC12:19
ccesarioit seems that build.py is broken after in the master branch12:20
ccesariohttp://paste.openstack.org/show/508911/12:20
ccesario(I just update my local rep.... )12:20
ccesariocould someone can check it .. please?12:21
coolsvapccesario, you will need to do pip install -U kolla12:28
coolsvapor something you do on local env to update kolla12:28
coolsvapthere is new module added in recent review12:28
coolsvapccesario, are you able to do it?12:32
ccesariocoolsvap, yep... let me try12:34
ccesariocoolsvap, it works...12:35
ccesarioroot@kolla-dev:/var/src/kolla-master# kolla-build --version12:35
ccesario2.0.112:35
*** signed8bit_Zzz is now known as signed8b_12:36
ccesariocoolsvap, tools/build.py will not be supported ?12:36
ccesarioI mean, tools/build.py call ... :)12:36
coolsvapit will be12:37
coolsvapit will be supported12:37
ccesariocoolsvap, right :) .. thanks by info12:38
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Kolla Kubernetes Service Discovery BP  https://review.openstack.org/31753712:51
sbezverk_ccesario ping13:04
*** inc0 has joined #openstack-kolla13:07
ccesariosbezverk_, pong13:09
*** dwalsh has quit IRC13:09
sbezverk_ccesario do you still see issue with cinder?13:10
inc0good morning13:11
ccesariosbezverk_, yes13:12
sbezverk_can you get me cinder.conf from cinder_volume?13:12
*** signed8b_ is now known as signed8bit_Zzz13:19
*** ppowell has joined #openstack-kolla13:23
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla: Add customizations for apt keys and packages  https://review.openstack.org/32668813:24
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla: Add customizations for apt keys and packages  https://review.openstack.org/32668813:26
*** Mr_Broken has quit IRC13:26
*** ayoung has joined #openstack-kolla13:26
*** Mr_Broken has joined #openstack-kolla13:27
inc0pbourke, mandre have you seen this one? https://review.openstack.org/#/c/326734/213:27
patchbotinc0: patch 326734 - kolla - Macro install packages13:27
pbourkeinc0: not yet!13:27
*** dwalsh has joined #openstack-kolla13:27
openstackgerritJeffrey Zhang proposed openstack/kolla: Implement Rally Dockerfile  https://review.openstack.org/32641413:30
*** Mr_Broken has quit IRC13:31
inc0so with this macro we'll get 2 things13:34
inc01. customization of packages13:34
inc0all can be overrided as long as it's either block or variable13:34
inc02. instad of if centos => yum install foo bar centos-barfoo elif ubuntu => foo bar ubu-barfoo13:35
inc0we can go packages = [bar, foo] if centos packages = packages + centos-barfoo ===> install_packages(packages)13:36
dmsimardubu-barfoo13:36
dmsimardhas a nice ring to it.13:36
* dmsimard crawls back into his cave13:36
inc0:D13:37
*** ravig has joined #openstack-kolla13:39
*** ravig has quit IRC13:42
*** mbound has quit IRC13:43
*** ravig has joined #openstack-kolla13:45
openstackgerritJeffrey Zhang proposed openstack/kolla: Run more kolla-ansible task in the gate  https://review.openstack.org/32628113:46
*** ravig has quit IRC13:46
openstackgerritJeffrey Zhang proposed openstack/kolla: Run more kolla-ansible task in the gate  https://review.openstack.org/32628113:49
*** jtriley has joined #openstack-kolla13:49
*** jtriley has quit IRC13:49
*** jtriley has joined #openstack-kolla13:50
*** jtriley has quit IRC13:50
*** jtriley has joined #openstack-kolla13:50
mag009_good morning13:52
inc0Jeffrey4l, so issue with more tasks is that infra would like to have short living tasks13:53
inc0but since to do upgrade/reconfigure you need to do deploy anyway13:53
inc0hey mag009_13:53
Jeffrey4linc0, so you may you are OK with my PS, right?13:54
Jeffrey4ls/may/mean/13:55
inc0yeah13:55
Jeffrey4lcool13:55
Jeffrey4lbut more work should be done. for the upgrade, we need do a real upgrade, like from liberty to mitaka.13:56
inc0Jeffrey4l, I've put that into comment;)13:56
Jeffrey4lthanks.13:56
inc0most importantly we need multi noe13:56
inc0node13:56
*** d_code has joined #openstack-kolla14:06
Jeffrey4lyes. I have started that works :D14:07
*** signed8bit_Zzz is now known as signed8b_14:10
*** dave-mccowan has joined #openstack-kolla14:26
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla: Add customizations for apt keys and packages  https://review.openstack.org/32668814:30
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla: Macro install packages  https://review.openstack.org/32673414:30
openstackgerritJeffrey Zhang proposed openstack/kolla: Run more kolla-ansible task in the gate  https://review.openstack.org/32628114:45
*** severion has joined #openstack-kolla14:46
*** v1k0d3n has quit IRC14:48
*** thumpba has joined #openstack-kolla14:54
*** zhiwei has quit IRC14:55
*** salv-orl_ has quit IRC14:56
*** salv-orlando has joined #openstack-kolla14:57
*** huikang has joined #openstack-kolla15:15
*** david-lyle has joined #openstack-kolla15:22
wirehead_Heh.  A real upgrade, like from liberty to mitaka, will be where we determine if we've won.15:25
inc0wirehead_, we did won15:28
inc0lib -> mitaka works15:28
inc0we need to figure out to put it to gates th15:28
inc0o15:28
inc0to test upgrades per patch15:28
wirehead_Gates or it didn't happen?15:29
*** dmk0202 has quit IRC15:29
*** mikelk has quit IRC15:36
openstackgerritJeffrey Zhang proposed openstack/kolla: Implement Rally Dockerfile  https://review.openstack.org/32641415:38
*** mliima is now known as mliima_away15:39
inc0pbourke, mandre I need an advice15:44
inc0anyone really15:45
inc0https://review.openstack.org/#/c/326688/415:45
patchbotinc0: patch 326688 - kolla - Add customizations for apt keys and packages15:45
*** belmoreira has quit IRC15:46
inc0so when we set a variable, we can't really modify it, as all the set in customization happends before this is executed15:46
*** vhosakot has joined #openstack-kolla15:46
inc0and I dont really want to have _append variables and such15:46
*** sacharya has joined #openstack-kolla15:47
*** daneyon_ has joined #openstack-kolla15:51
pbourkeinc0: maybe this patch had progressed since I last looked15:53
mandreinc0: so, I think there is no way around having to define 2 variables15:53
pbourkeinc0: I thought users would just replace the whole block15:53
inc0pbourke, blocks will mess up var scope15:53
inc0they can't publish variable up15:54
mandreinc0: you'll have for instance {% set base_apt_packages = [our, list, of, packages] + base_apt_packages_extra %}15:54
mandreif user wants to add packages to the list, he defines base_apt_packages_extra15:54
inc0yeah, but we'd also need override and remove15:55
mandreor he could simply redefine base_apt_packages to remove some15:55
inc0so an idea15:55
inc0set base_apt_packages_default in tpl15:55
inc0and then we render {{ base_apt_packages | customizable }}15:55
inc0and I'll write customizable filter in a way15:55
inc0uhh...but then we need to have access to _default15:56
inc0this is hard :(15:56
*** daneyon_ has quit IRC15:56
Davieyinc0: can you not have two _apt_packages ?  base_ and additional_ (which both can be overridden, but base is kolla defaults) ?15:56
inc0Daviey, yeah, only that will work for additions, and we also want full override and removal15:57
inc0and removal and addition15:57
*** tzn has quit IRC15:57
Davieywell having two allows you to override base_, but also append ability15:57
mandreinc0: probably the most common case by far is adding packages to the images15:58
mandreit deserve a separate variable15:58
inc0mandre, I know of at least one removal15:58
*** tzn has joined #openstack-kolla15:58
mandreinc0: which one?15:58
Davieywell removal means you need to override and remove the single package?15:58
inc0mandre, midonet needs its own ovs and it conflicts with vanilla15:59
*** Jeffrey4l has quit IRC15:59
inc0so it needs to not install vanilla and install it's own instead15:59
Davieybase should probably be base.. so if it shouldn't be in another Dockerfile, then it isn't truly base.16:00
inc0ovs is not installed in base tho16:00
mandreinc0: it's a packaging issue then16:00
DavieyOh16:00
mandremidonet's ovs package should be able to uninstall the conflicting packages by itself16:00
inc0hmm16:01
inc0I'll try to make it work with _append _remove _override16:02
inc0how about that?16:02
inc0heat_api_override = [whole, new, set]16:02
inc0heat_api_append = [just, add, these]16:02
inc0heat_api_remove = [remove, these]16:02
mandreyou don't need the override, it's synonym of the original variable name16:02
inc0and in packages we'll have {{ heat_api | customizable }}16:02
mandrein this case heat_api16:03
*** mliima_away is now known as mliima16:03
inc0yeah, that's true16:03
inc0or...16:03
inc0no actually it isn't16:03
inc0I'll try to implement it and demo on example16:03
mandreyeah, you might be right :)16:03
*** vhosakot has quit IRC16:15
*** coolsvap has quit IRC16:16
mdnadeem_inc0, Hi, last time i had tried to upgrade from liberty to mitaka on single node, however after upgrad haproxy container keep in rebooting state and my upgrade gets fail, leaving some container to 1.1.1 and some 2.0.016:17
inc0mdnadeem_, publish a bug with all the logs and such please16:17
inc0I'll take a look at it later16:17
mdnadeem_I have doubt if i am follow the correct process to upgrade, here is the steps i have followed : http://pastebin.com/5PBn4F7g16:18
*** salv-orlando has quit IRC16:18
*** salv-orlando has joined #openstack-kolla16:18
*** huikang has quit IRC16:19
mdnadeem_inc0, now i ruined my previous setup, however i would like to re-try on a new setup, It will be help full if you just confirme me, am i follow the right way to upgrade?16:20
mdnadeem_>> http://pastebin.com/5PBn4F7g16:20
inc0mdnadeem_, looks good16:21
mdnadeem_inc0, Thanks for confirmation, i have one more query16:22
mdnadeem_after, re-installing kolla (stable/mitaka), am i  supposed to delete all configuration from /etc/kolla/ which was earlier made by kolla liberty ?16:23
inc0negative16:23
inc0ansible will deal with it16:23
*** salv-orl_ has joined #openstack-kolla16:24
mdnadeem_inc0, ok, you mean After re-installing kolla(stable/mitaka), i just need to change the <openstack_version: 2.0.0> in global.yml and keep rest configuration as it is right?16:25
inc0yeah16:25
mdnadeem_inc0, Thanks you, i will try it :)16:26
*** huikang has joined #openstack-kolla16:26
*** salv-orlando has quit IRC16:27
*** ssurana has joined #openstack-kolla16:27
*** dwalsh has quit IRC16:28
d_codedoes cinder support LVM in the mitaka release of kolla?16:28
inc0d_code, nope:(16:30
d_codedamn….  sooooo  for volume support, need to use ceph?  what’s the options?16:31
openstackgerritKen Wronkiewicz proposed openstack/kolla-kubernetes: Convert Memcached to work without HostNetwork=True  https://review.openstack.org/32675716:31
inc0d_code, pretty much only ceph16:31
*** mbound has joined #openstack-kolla16:32
inc0we have lvm iscsi in newton16:32
d_codeyeah…saw the patch…I thought cinder supported it b/c of details on labeling the lvm vg “cinder-volumes”….which…that part works… just fails to mount. makes sense b/c the iscsi bits aren’t there16:33
d_codeI’ll look into ceph16:33
inc0yeah, that's how you should deal with it now16:34
*** mbound has quit IRC16:36
*** huikang has quit IRC16:39
*** dwalsh has joined #openstack-kolla16:42
*** Serlex has left #openstack-kolla16:47
*** huikang has joined #openstack-kolla16:51
*** huikang has quit IRC16:56
openstackgerritMerged openstack/kolla: setup_{RedHat,Debian}.sh, make more idempotent  https://review.openstack.org/32634716:57
*** ayoung has quit IRC17:01
*** mummer has joined #openstack-kolla17:02
*** sacharya_ has joined #openstack-kolla17:02
*** sacharya has quit IRC17:02
*** dwalsh_ has joined #openstack-kolla17:03
*** fragatina has joined #openstack-kolla17:03
*** cloudnau_ has joined #openstack-kolla17:04
*** fragatin_ has joined #openstack-kolla17:04
*** thumpba has quit IRC17:04
*** thumpba has joined #openstack-kolla17:05
openstackgerritMd Nadeem proposed openstack/kolla: WIP: Added unit test for check container  https://review.openstack.org/32724717:06
*** fragatina has quit IRC17:08
*** sdake has joined #openstack-kolla17:10
*** vhosakot has joined #openstack-kolla17:20
*** thumpba has quit IRC17:20
*** thumpba has joined #openstack-kolla17:21
*** thumpba has quit IRC17:23
*** thumpba has joined #openstack-kolla17:25
*** fabrilla has joined #openstack-kolla17:29
fabrilladeploying from master -> running   TASK: [ceph | Copying over ceph.conf] leads to the following error:17:33
fabrilla  File "/usr/local/share/kolla/ansible/action_plugins/merge_configs.py", line 22, in <module>     from ansible.plugins.action import ActionBase ImportError: No module named plugins.action17:33
*** coolsvap has joined #openstack-kolla17:33
*** coolsvap has quit IRC17:39
sdakefabrilla are you using ansible 2.0+?17:44
fabrillano 1.917:46
inc0latest master?17:47
sdakefabrilla master only works with nasible 2.0+17:48
sdakefabrilla i'm not sure whyt he docs change for thathasn't merged yet17:48
wirehead_It needs to be rebased.17:49
vhosakotfabrilla: I've seen that error in Ansible 1.9.. please move to Ansible 2.017:49
wirehead_Oh, sdake, ansible and kubernetes and IP addresses...17:50
vhosakotfabrilla: I filed this bug for it  -->  https://bugs.launchpad.net/kolla/+bug/158658717:50
openstackLaunchpad bug 1586587 in kolla "Update prechecks for Ansible 2.0.0" [Medium,In progress] - Assigned to Vikram Hosakote (vhosakot)17:50
*** tzn has quit IRC17:50
*** sdake has quit IRC17:51
*** salv-orl_ has quit IRC17:53
*** salv-orlando has joined #openstack-kolla17:53
fabrillaok, I'll move to ansible 2.0 . Thanks. I'm in the process testing on IBM Power8. Got all the containers rebuilt (not too many changes between Ubuntu 14.04 on x86 and ppc64el)17:54
*** Lyncos has quit IRC17:55
ccesariofabrilla, nice info!!!!17:56
*** signed8b_ is now known as signed8bit_Zzz18:02
*** ssurana1 has joined #openstack-kolla18:03
*** ssurana has quit IRC18:06
*** jamie_h has quit IRC18:07
*** signed8bit_Zzz is now known as signed8b_18:09
-openstackstatus- NOTICE: Zuul has been restarted to correct an error condition. Events since 17:30 may have been missed; please 'recheck' your changes if they were uploaded since then, or have "NOT_REGISTERED" errors.18:10
*** fragatin_ has quit IRC18:14
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla: Add customizations for apt keys and packages  https://review.openstack.org/32668818:15
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla: Macro install packages  https://review.openstack.org/32673418:15
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla: Customizations continued  https://review.openstack.org/32727118:15
openstackgerritDavid Wang proposed openstack/kolla-kubernetes: Added kolla-kubernetes specific instructions for Docs  https://review.openstack.org/32676918:16
*** ravig has joined #openstack-kolla18:17
*** fragatina has joined #openstack-kolla18:19
*** ravig has quit IRC18:21
*** ravig has joined #openstack-kolla18:21
openstackgerritChristian Berendt proposed openstack/kolla: Document the use of external Ceph journal drives  https://review.openstack.org/32453918:22
*** tzn has joined #openstack-kolla18:26
*** tzn has quit IRC18:27
*** tzn has joined #openstack-kolla18:27
*** ayoung has joined #openstack-kolla18:28
*** ravig has quit IRC18:28
*** tzn has quit IRC18:32
*** daneyon_ has joined #openstack-kolla18:34
*** sdake has joined #openstack-kolla18:37
*** alyson_ has quit IRC18:38
inc0sdake, https://review.openstack.org/#/c/327271/18:38
patchbotinc0: patch 327271 - kolla - Customizations continued18:38
*** daneyon_ has quit IRC18:39
sdakeinc0 looks good to me18:40
inc0so this mechanism is done18:40
inc0now it's on you to spread this around18:40
sdakeneed repos and keys18:41
sdakeand custom docker commands18:41
inc0go for it...18:41
Mech422Morning18:42
*** diogogmt has joined #openstack-kolla18:42
inc0I can't spend much more time on it18:42
Mech422inc0: oh - your macro?18:43
Mech422inc0: Did that need a 'RUN' in the dockerfile ?18:43
Mech422(the macro didn't return the run as part of the string)18:43
sdakeMech422 its on line 1118:44
sdakeinc0 what does scoped mean18:44
*** dwalsh has quit IRC18:44
*** murphyslawbbs has joined #openstack-kolla18:44
Mech422sdake: ahh cool - I didnt see it yesterday18:45
*** dwalsh_ has quit IRC18:45
sdakeinc0 what is synta of using prepend and override18:45
sdakemore specificiallly where do these words go18:45
sdakeheat_api_packages_override?18:45
*** dwalsh has joined #openstack-kolla18:46
inc0customization file18:46
*** dwalsh_ has joined #openstack-kolla18:46
sdakeinc0 that isn't what i mean18:46
inc0{% set heat_api_packages_override %}18:46
sdakethanks18:46
inc0{% set heat_api_packages_override = [new, packages] %}18:46
Mech422btw - is ansible 2.0.2 ok for Master? I'm getting a template parse error in the precheck of docker version ?18:47
inc0Mech422, yeah I don't want to add RUN in macro as we can use it in base too where we have apt-get update && istall && stuff18:47
Mech422inc0: yeah - I didn't see it in the dockerfile yesterday, but I missed you by like 2 minutes and you went home :-P18:48
inc0yeah, found out today, facepalmed and fixed it18:48
Mech422inc0: I went home once....they locked the doors...18:48
*** fragatina has quit IRC18:48
inc0so really I didn;t go anywhere, I work from home usually;)18:49
inc0I just turned off my dev vm and started video game:P18:49
Mech422inc0: yeah? me too :-)  Its definately a pants optional sort of office...18:49
murphyslawbbshi guys, what is the current ansible version required for kolla master?18:50
inc0murphyslawbbs, 2.118:50
Mech422inc0: oh - did you see the HTC Vive's are shipping in like 3 days of order now ?18:50
murphyslawbbsinc0: much obliged18:50
inc0Mech422, I ordered mine 1hr after preorder opened18:50
Mech422inc0: Oh! I'm on wrong version - that might explain parse error...18:50
*** vhosakot has quit IRC18:50
inc0so I have it for some time now18:50
inc0man, it's super cool18:51
Mech422inc0: I promised myself one for my b'day last month - but I'm waiting till this next cluster is up at work - I wouldn't get any work done if I got a vive18:51
Mech422inc0: I really want the metaglasses... but the vive is neat too18:51
inc0it is neat18:52
inc0it's totally different18:52
*** Kennan has quit IRC18:52
Mech422inc0: I'm thinking I might just get the dev kit for the meta - the production units never seem to launch18:52
*** vhosakot has joined #openstack-kolla18:52
inc0no idea, depends what you want from it18:52
*** Kennan has joined #openstack-kolla18:52
Mech422inc0: it does look pretty cool - I found some 3rd party 'glove' controllers for it too18:52
inc0you do have vive content18:52
Mech422inc0: but they gloves aren't out yet :-/18:53
murphyslawbbsI keep getting errors creating the log volume18:53
inc0murphyslawbbs, show me logs (mwhehehe)18:53
Mech422inc0: yeah - and the vive stuff looks much nicer then the rift stuff18:53
inc0I wasn't convinced about full room but now I thing it's best thing ever18:54
inc0tilt brush is amazing18:54
Mech422inc0: couple of my friends work for Daz 3D  - so they have all the toys - even had a hololens...18:54
Mech422inc0: my friend says its a decent workout since you need to move around ?18:54
inc0oh trust me it is18:55
inc0so there is game called holopoint18:55
murphyslawbbsinc0: you got it :) http://pastebin.com/XgsEG0RX18:55
inc0where you shoot arrows and dodge stuff18:55
inc0I got really tired after better game18:55
murphyslawbbsinc0: happens in multiple versions of kolla18:55
Mech422inc0: heh18:55
inc0murphyslawbbs, ansible 2.1?18:56
inc0and master?18:56
murphyslawbbsinc0: yh 2.1 and master18:56
murphyslawbbsI tried various combinations though, 1.9.4, 2.0.1 and master or stable18:57
murphyslawbbsinco0: i think my system is messed up somehoe but can't figure out what18:57
inc0hmm18:58
inc0try 1.9.4 and stable/mitaka18:58
inc0if that doesn't work then you have some issues18:58
murphyslawbbsinc0: ok18:58
inc0as this combination was tested over and over18:58
sdakeit also may be that prechecks are broken with ansible 2.118:58
sdakei dont know if anone has tested that yet18:59
sdakebut merge_configs has been ported18:59
sdakemurphyslawbbs my guess is you have the wrong version of jinja18:59
murphyslawbbsshould I wipe all docker images between these permutations?18:59
sdakeit isnt necessaryt owipe images, but yu can ifyou like19:00
sdakeyou do have to rebuild between different veresions though19:00
inc0murphyslawbbs, but for sure you need to call build with --no-cache19:00
murphyslawbbssdake ah lemme uninstall some crap and run from a virtualenv19:00
murphyslawbbsinc0: nice ty19:01
Mech422sdake: I noticed a weird template error in docker version check with master and ansible 2.0.2 - trying 2.1.0.0 now19:01
*** harlowja has quit IRC19:12
*** salv-orlando has quit IRC19:14
Mech422inc0: your at Intel right?  any idea when the xpoint stuff is coming out ?19:14
inc0nope19:14
inc0I mean I'm from Intel, but no idea19:14
*** salv-orlando has joined #openstack-kolla19:14
Mech422inc0: blah - my son wants me to build him a new machine for his b'day...seems a shame to use regular SSDs with xpoint supposedly soo close19:15
inc0well, you always have nvme19:15
*** harlowja has joined #openstack-kolla19:15
Mech422inc0: you game of nvme? is there a noticable diff between sata ssd and nvme ssd in gaming ?19:16
Mech422s/of/on/19:16
inc0I mean xpoint will be NVMe, but calling PCIe NVMe drives a regular ssd is...understatement19:16
Mech422inc0: lol19:16
inc0no, I have regular ssd,19:16
inc0disk doesn't matter that much for gaming19:16
Mech422inc0: my machine predates m.2 - so I haven't used nvme except at work19:17
inc0just load speeds, and I that's not much19:17
Mech422inc0: yeah - my load times / load screens are pretty short on the samsung evo pro's19:17
inc0better wait for geforce 1080:P19:18
Mech422inc0: but the m2 nvme stuff is almost as cheap as sata ssd's now....*sigh*19:18
Mech422soo many toys, so little time/money19:18
inc0graphic card is what really matters19:18
inc0and RAM19:18
Mech422inc0: he's getting a gtx970 - he was on a $1k budget...19:19
Mech422inc0: when he saw how expensive gfx cards can be, I think he cried :-P19:19
Mech422inc0: he's 24 now, and not getting dads hand me downs - I don't think he realized how expensive gear can be19:20
sdakewe got a mountain of bugs19:20
sdakehttps://launchpad.net/kolla/newton/newton-119:20
Mech422inc0: doing the 970gtx, an asus z170 gaming board, i5-6600K, and 16G ram19:21
Mech422inc0: then a SSD boot drive (prolly 256G) and a 3T spinner for bulk storage19:22
sdakenvme makes a huge difference for me for dev work19:26
*** ravig has joined #openstack-kolla19:26
*** diogogmt has quit IRC19:28
Mech422sdake: yeah? Hmm... I think I can get him a 250G nvme/m2 ssd for like $100 more then sata19:32
sdakei only have experience with intel 750 nvme ssds19:33
sdake750 400gb is about 380 bucks19:33
Mech422sdake: we use those at work... nice drives :-)19:33
Mech422sdake: but that would blow his budget19:33
*** ravig has quit IRC19:37
*** ravig has joined #openstack-kolla19:39
*** salv-orlando has quit IRC19:39
*** salv-orlando has joined #openstack-kolla19:40
*** dwalsh has quit IRC19:46
*** dwalsh_ has quit IRC19:46
*** ravig has quit IRC19:47
*** sdake_ has joined #openstack-kolla19:47
*** ravig has joined #openstack-kolla19:47
*** dwalsh has joined #openstack-kolla19:48
*** sdake has quit IRC19:48
*** ravig has quit IRC19:51
*** mliima has quit IRC19:51
mag009_good news19:53
inc0oh?19:54
mag009_I have a full deployement with calico19:54
mag009_:)19:54
mag009_finally19:54
inc0wooot19:54
mag009_i'll try to grab some time tomorrow or friday to submit all my changes19:55
*** Lyncos has joined #openstack-kolla20:00
inc0when do you guys thing you can go profd?20:01
Lyncosin 6 month :-)20:02
LyncosJ/K20:02
mag009_it should be pre-prod* if we can call it that way20:02
mag009_like really soon20:02
mag009_no idea i have to get this stuff merge into the main repo first ;)20:02
LyncosWe still need LDAP20:03
inc0so if you guys are running master20:03
Lyncosand fix little bugs  + some testing20:03
inc0https://review.openstack.org/#/c/324665/3 this and following patches will give you total customization of whatever20:03
patchbotinc0: patch 324665 - kolla - Mechanism for Dockerfile customization20:03
sdake_mag009_ can you write a blueprint first20:04
sdake_mag009_ otherwise the changes won't be tracked properly20:04
sdake_it  canbe as simple as "Implement Calico in Kolla"20:05
*** dwalsh has quit IRC20:05
mag009_sdake_: yep thats what I'm going to do next (tomorrow or friday)20:05
sdake_Lyncos that customizaton work should allow anyone to do anything they like with kolla20:07
sdake_without having to muck with the main code base20:07
Lyncosawesome20:07
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla: Customizations continued  https://review.openstack.org/32727120:09
inc0soo, if you want that I need tests, reviews and feedback:P20:09
*** jeblair has quit IRC20:09
inc04 patches in queue20:09
inc0about that20:09
*** jeblair has joined #openstack-kolla20:10
*** fabrilla has quit IRC20:10
*** ppowell has quit IRC20:13
*** ravig has joined #openstack-kolla20:14
sdake_Lyncos let me restate that, do anthing they want with the images20:15
sdake_Lyncos the playbooks are what they are, and i dont see any wayto customize those20:15
sdake_this is on order -> http://www.hifiplus.com/articles/kuzma-4point-14-tonearm/20:16
* sdake_ jumps for joy :)20:16
inc0where do you get music from in good enough quality?20:17
*** murphyslawbbs has quit IRC20:21
Mech422mag009_: Did you implement by 'wrapping' calico playbooks around calls to kolla-* ?20:23
Mech422mag009_: I'm thinking thats how'll I'll do midonet - run setup plays that put all the mido stuff in place, and hands off br-ex to kolla ?20:23
*** thumpba has quit IRC20:27
*** thumpba has joined #openstack-kolla20:29
*** ravig has quit IRC20:29
LyncosThe cleanup command is quite dangerous20:31
Lyncos:-)20:31
*** ravig has joined #openstack-kolla20:32
*** thumpba has quit IRC20:33
Mech422Lyncos: watch cleanup-host - it takes umm.... 'liberties' with your network config...20:35
Mech422Lyncos: tapX, vxlan, and I think 'brX' are all considered kolla's property20:35
*** dwalsh has joined #openstack-kolla20:37
*** mbound has joined #openstack-kolla20:39
*** thumpba has joined #openstack-kolla20:43
*** dave-mccowan has quit IRC20:44
inc0all your bridges are belong to us!20:44
LyncosAll our bridges are about to fall in the river20:45
Mech422inc0: london bridge is falling down ?20:45
* Mech422 sucks at this game20:45
Mech422maybe something about a bridge over troubled lans ?20:46
*** murphyslawbbs has joined #openstack-kolla20:47
*** openstackgerrit has quit IRC20:48
*** ravig has quit IRC20:48
*** openstackgerrit has joined #openstack-kolla20:48
*** ravig has joined #openstack-kolla20:48
Mech422inc0: the limitations of the new 'security' features around 'become' seem sorta arbitrary...20:49
inc0Mech422, what do you mean?20:49
Mech422inc0: if your unprivildged user has sudo ability, why doesnt it use sudo to set the right perms ?20:50
Mech422inc0: ansible 2.1 unpriviledged user 'becoming' another unpriviledged user sucks :-P20:50
inc0well, thing is, you can run become in inventory20:50
inc0just put become=True in inventory and that's all20:50
inc0oh? they changed that?;)20:51
Mech422inc0: yeah - there's a global allow_insecure_<mumble> flag too20:51
inc0lol20:51
inc0didn't see it20:51
Mech422inc0: but I run as 'stack' for 'my' setup stuff, and 'kolla' for the kolla stuff20:51
Mech422inc0: and ansible is NOT happy camper20:51
inc0uhh20:52
Mech422inc0: here's your cringe for the day: my playbooks use shell: to run kolla-ansible :-P20:52
*** SiRiuS__ has quit IRC20:53
inc0well20:54
inc0kolla-ansible is nothing more than shortcut to ansible-playbook20:54
Mech422inc0: Oh - I figured it setup paths and stuff20:54
inc0nope20:54
inc0it's just short20:54
Mech422LOL20:54
inc0if you run it first line it outputs is actual call it makes20:54
inc0if you make this call...works just fine20:55
Mech422inc0: yeah - I've seen all the @file stuff - so I figured there was prolly some path magic in there too20:55
inc0nope20:55
*** murphyslawbbs has quit IRC20:55
Mech422thats good to know20:55
Mech422it actually worked pretty well, until ansible decided to change the rules20:56
*** SiRiuS__ has joined #openstack-kolla20:56
Mech422I might just add the global insecure flag thing to 'my' playbooks - but that feels like cheating20:56
*** iceyao has joined #openstack-kolla20:56
*** thumpba has quit IRC20:56
*** dave-mccowan has joined #openstack-kolla21:00
Mech422heh - if you set allow_world_readable_tempfiles it works, but it whines about you cheating :-P21:00
*** iceyao has quit IRC21:01
*** fragatina has joined #openstack-kolla21:01
*** sdake_ has quit IRC21:01
*** dwalsh has quit IRC21:06
*** SiRiuS__ has quit IRC21:14
*** daneyon_ has joined #openstack-kolla21:17
*** daneyon_ has quit IRC21:22
*** dwalsh has joined #openstack-kolla21:22
*** rhallisey has quit IRC21:26
*** jtriley has quit IRC21:26
*** cloudnau_ has quit IRC21:27
*** dwalsh has quit IRC21:31
*** dcwangmit01 has quit IRC21:35
*** sdake has joined #openstack-kolla21:49
*** sdake has quit IRC21:54
*** sdake has joined #openstack-kolla21:55
*** vhosakot has quit IRC22:03
Mech422Is master supposed to work with ansible 2.1.0.0 ?  the version check says 2.0 ? ansible/roles/prechecks/vars/main.yml:ansible_version_max: '2.0.0'22:08
*** dcwangmit01 has joined #openstack-kolla22:08
sdakeinc0 what type of toon did you hae on diablo 3?22:09
inc0sdake, barb22:10
sdakeinc0 here is my barb http://www.diabloprogress.com/hero/riley-1783/hammer/7592565822:10
sdakemy seasonal toon atleast22:11
inc0nice, I had little over 1.2m but that was couple months ago22:11
inc0dps 1.2m22:11
inc0so few patches probably;)22:12
inc0brb22:12
sdakeyar - there i a new barb build22:12
sdakeraekor has changed22:12
sdakealso grifts above 75 were nerfed a bit22:12
sdakeneed to grind out 7 more level 80 caldesans22:13
sdakeshould take a week or so22:13
*** signed8b_ has quit IRC22:21
harlowjawtf22:22
harlowjalol22:22
harlowjai don't speak kligon22:22
harlowjalol22:22
inc0I stopped playing couple of weeks after greater rifts were introduced22:23
inc0but I should have full raekor on my old toon22:23
inc0anyway, it was on eu server22:23
inc0sdake, mind if I assign this one to myself?22:24
inc0https://blueprints.launchpad.net/kolla/+spec/third-party-plugin-support22:24
inc0so I'm mostly doing it...22:24
inc0because*22:24
sdakeinc0 sure - i just unassiged ryan as he isn't working on it22:24
harlowjabtw, sdake inc0 https://etherpad.openstack.org/p/kolla-gd-thoughts-concerns-remarks + others22:24
harlowjajust using this is a jot-down-location to help GD in a plan here22:25
harlowjafeel free to check it out, and thoughts would be cool and more22:25
* harlowja getting klindgren to write down stuff also :-P22:25
*** salv-orl_ has joined #openstack-kolla22:25
inc0harlowja, so ad puppet22:26
harlowja?22:26
inc0technically you can just replicate ansible logic with puppet22:26
inc0containers are separate thing and you're free to use them22:26
harlowjaright22:27
inc0but that;s a manual work from your part, you're free to start kolla-puppet;)22:27
harlowjathat might be a decent phase122:27
harlowjause the built images22:27
inc0well depends, you need to decide which is better, stick to ansible and learn it or rewrite it with puppet22:27
harlowjaright22:28
harlowjawho is 'steak'22:28
harlowjalol22:28
harlowjais that sdake ?22:28
harlowjabut more meaty22:28
harlowjalol22:28
*** salv-orlando has quit IRC22:28
harlowjaya, i guess so22:28
harlowjaha22:28
sdakeharlowja yes - i identified myself in the who's who section22:28
harlowjaya, i think u put steak22:29
harlowjalol22:29
harlowjawhich i found funny22:29
harlowjathat's all22:29
kklimondaany idea how much work is it going to be to (locally) backport cinder iscsi back to liberty and mitaka? I haven't yet looked into it any deeper, but a list of patches with "iscsi" isn't that long.22:29
klindgrenI see my name being pingged.22:29
inc0klindgren, sooo...we get that a lot22:30
sdakekklimonda i wouldn't expect it would be all that difficult22:30
* klindgren looks into what harlowja signed me up for22:30
sdakekklimonda but it isn't something we would do upstream22:30
inc0shouldn't be too hard22:30
sdakeshould pretty much be git cherrypick operations for the 6-10 patches involved22:30
sdakehowmany ver there are22:30
inc0sdake, maybe some unofficial docs how to pull that off since this requests is repeated22:30
kklimondasdake: sure, I already know I'll have to carry a lot of patches anyway - the deployment uses 3rd party network plugin ;)22:31
sdakekklimonda we are sorting out a reasonable way to handle plugins in newton - you may want  to backport that set of patches too22:31
klindgrenso re: ansible - we already have some ansible in use and some playbooks.  We actually use ansible to kick master-less puppet runs22:31
inc0sdake, that will be harder22:31
wirehead_klindgren: clearly you should have the foresight to have made your online handle “heat” or “nova” or “cinder”22:31
inc0since it changes build heavily22:31
inc0klindgren, well if you'd go for ansible you'll get tested solution22:32
inc0as opposed to write everything from scrach22:32
klindgrenI think what Mike was wanting was something more like why cant we jsut bind mount /etc/nova into the nova container22:32
klindgrenand I manage theconfigs that way22:32
sdakeklindgren that is exactly what happens22:33
sdakeexcept iirc its /var/lib/kolla/nova22:33
inc0sdake, no, we copy stuff22:33
sdakeinc0 oh right - on startup22:33
inc0klindgren, reason it happends is that when you change something in files there, you don't want to change containers behaviour22:34
inc0it's kinda container immutability22:34
sdakeklindgren the main reason we don't do exactly what you describe is because we want a single source of truth22:34
* klindgren hasn't looked at it. but I was told tht you create your config files in kolla, kolla creates some json thing (Iirc), then some kolla script is ran wwhich takes those config and puts them back into files22:34
klindgren?22:34
inc0klindgren, so it works like that22:34
sdakeklindgren that is semi-accoruate22:34
inc0we put configs in dir22:34
inc0bindmount this dir22:34
inc0and then on startup copy contents of dir to /etc/nova22:34
inc0if you want to pave in your own nova.conf22:35
inc0just put it there22:35
sdakethe downside of that approach is you lose single source of ruth22:35
sdakewhich means you no longer have kolla managing your configuraiton22:35
klindgrenwe already have the truth in puppet right now22:36
sdakei see so your question is more like22:36
sdake"Why can't we just have puppet lay down config files and have kolla containers pick them up"22:36
klindgrenI think for a phased approach - that would work best - or thats the feeling I get fro mthe guy who handles the puppet stuff22:36
klindgren:-D22:36
inc0totally doable22:36
wirehead_This also probably runs head-on into the problem that Kubernetes is presently having with Kolla configs. :)22:37
sdakeklindgren i think upgrades wouldn't work correctlly in this scenario22:37
wirehead_Or, a potential version of the problem.22:38
inc0you really need to evaluate which one you want - rewrite your puppet with ansible or rewrite kollas ansible with puppet22:38
klindgrenits just that on some of the servers we also have an additional team that handling things in puppet as well on those boxes.22:38
klindgrenand they do additional stuff on the server in puppet22:38
inc0at the end we only care about running container with correct mounts and such22:38
sdakeklindgren yup I understand - you have infrastructure already in place with people already trained22:38
inc0I don't expect you to call bootstraps as I assume you're migrating existing running stuff22:39
sdakefor upgrades, config files have to be modified and services restarted in a specific order22:39
inc0which means all you need to do is to lay down configs and start stuff22:39
sdakesame for reconfigure22:39
sdakeif all youc ar eabout is deployment, inc0's approach would work22:39
sdakeif you care about upgrades/reconfigure working, that would require more attention in the puppet codebase22:40
inc0well, technically pupper nor ansible is stateful22:40
inc0so you can upgrade with ansible stuff that you deployed by puppet22:40
sdakeyes, that is the part about requiring attention in the puppet code base22:40
inc0anyway, will require work.22:40
sdakeit isn't as simple as laying down a config file22:41
sdakelaying down a config file would work for the deploycase22:41
sdakenot sure about otheractions22:41
klindgrenalso - how does it work if we dont manage our mysql database.  - this is a high level question because I haven't dug into kolla at all.22:41
sdakeklindgren we want kolla to work with third party database environments22:41
sdakeklindgren whether it does now or not is an open question22:41
inc0klindgren, it's doable;) config overrides works22:42
harlowjapretty sure we can (somewhat easily) just not build the mariadb stuffs22:42
inc0just override what we lay down in terms of database connection22:42
inc0and don't deploy mariadb22:42
sdakeit can be done vvery easilly today - but its not totally easy to do22:42
sdakewe would like to make it totally easy to do in addition :)22:42
sdakecross out very easily above :)22:43
harlowjai only use it if its ultra-totally-easily-done22:43
harlowjalol22:43
harlowja;)22:43
klindgrenand re: starting services I assume these are tied into systemd?22:43
sdakeklindgren not at present22:43
sdakeklindgren kolla is only half a solution at present22:43
sdakeit deploys openstack22:43
sdakew edon't hae anythign to deploy the bare metal22:43
sdakeand no integration with the host operatng system22:43
inc0harlowja, how does writing manual configs and add enable_mariadb: false sounds to you?22:44
inc0because it's all it takes22:44
harlowjainc0 that's pretty ultra-totally-easy22:44
harlowjalol22:44
klindgrenso how do I start/restart a service that is running in a kolla container22:44
inc0docker restart nova_api22:44
inc0you restart container22:44
sdakeklindgren we dont have a kolla way to do that22:44
klindgrenasking because we need to run neutron with a higher than standard ulimit (same with rabbitmq)22:44
sdakeklindgren I would like to get to the point where we have these sorts of functioanl gaps filled22:45
inc0sdake, that is docker stuff22:45
* harlowja josh writes a bunch of code now, lol22:45
klindgrenotherwsie after a week or so the neutron api eventlet worker will exit gracefully22:45
harlowjai mean klindgren writes a bunch of code22:45
harlowjalol22:45
*** salv-orl_ has quit IRC22:45
sdakefor things like adding compute nodes, removing cmopute nodes, adding ods, removing osds, password rotation, shut down the cluster, restart a service, etc22:45
harlowjaright, those would just be more ansible stuffs to do right (and i guess new kolla commands)22:45
inc0sdake, hold your horses, we have restart22:45
sdakethese are all features I'd like to see22:45
inc0docker have restart22:45
sdakeyes but you have to login to the node to do it22:46
wirehead_Kolla-kubernetes22:46
wirehead_:)22:46
klindgrenkollanetes?22:46
inc0unless you run reconfigure without config changes22:46
harlowjawirehead_ that's 2 major systems, double the complexity imho22:46
sdakereconfigure will not restart if there aren't config changes22:46
*** salv-orlando has joined #openstack-kolla22:46
sdakespretty sure on that point22:46
sdakewould need to double check with jeffrey4l22:46
inc0or don't know enough ansible to write ansible -m shell -i <<inv>> all -a "docker restart nova_api"22:46
harlowjainc0 stop making so much sense, ha22:47
harlowja:-P22:47
inc0ansible is ssh in loop on drugs22:47
harlowjaya, pretty much22:47
*** Jeffrey4l has joined #openstack-kolla22:47
inc0learn to use it and world gets new colors22:47
inc0some of them are ugly colors, but colors nonetheless22:47
kklimonda^ doing that more gracefully would probably involve inteaction with HAProxy, and staggered restart of services on hosts - I guess that part could be implemented in kolla22:47
wirehead_Prolly depends on the user’s preferences.  Even if you are not an Ansible shop, there’s plenty of reasons to use the heck out of Ansible as a ssh in loop on drugs, as you say.22:48
inc0kklimonda, ansible suports serial22:48
sdakeinc0 what i think kklimonda means is there is no kolla implementation of restart ;)22:48
*** murphysl_ has joined #openstack-kolla22:48
inc0nor there should be imho22:48
inc0it's already doable with ansible22:49
harlowjainc0 i always liked https://pypi.python.org/pypi/plumbum (cause it has simialr remote machine capabilities, but u write python)22:49
kklimondainc0: sure, but it's just not a simple `ansible -m shell -a "..."'22:49
harlowjaand i like the python :-P22:49
sdakekklimonda agree22:49
*** murphysl_ has quit IRC22:49
sdakethings need to be restarted in order22:49
*** murphyslawbbs has joined #openstack-kolla22:49
klindgrenwe have a restartworld script that does exactly that22:49
sdakeyup22:49
sdakei htink kolla need sosmething similar down the road22:50
murphyslawbbsHi, which ansible versions would i need for stable/liberty?22:50
klindgrenbecause sometimes after rabbitmq flakes out on you - you kinda gotta restart everything that has rpc22:50
sdakebut given our other priorities, its pretty  low :)22:50
inc0murphyslawbbs, 1.9.422:50
sdakemurphyslawbbs 1.9.422:50
harlowjasounds like u just need a dependency graph and walk it (and restart in reverse order)22:50
harlowjarestart from leaf --> top of tree22:50
inc0harlowja, we already have it22:50
klindgreneh22:50
inc0upgrades follows order22:50
klindgrentop of tree - leaf :-)22:50
kklimondayeah, I'd also probably first talk to haproxy, to remove backend from it, and then wait couple of seconds for all connected clients to finish their requests, and only after that actually restart the service, and then re-enable it in haproxy.. it's obviously doable in raw ansible, by writing your own playbook, but I could imagine that being something kolla would like to support, as part of its22:51
kklimonda'operation oriented design'22:51
*** tzn has joined #openstack-kolla22:51
inc0or actually drain connections in haproxy22:51
harlowjaklindgren  guess i was thinking rabbitmq would be like the top of tree, either way, a graph/tree and just follow the order22:51
inc0thing is, I personally would rather have ops do stuff like that22:51
murphyslawbbsI'm getting this: TASK [prechecks : Checking free port for Cinder API] -- fatal: [localhost]: FAILED! => {"failed": true, "msg": "ERROR! 'dict object' has no attribute 'ipv4'"}22:51
sdakekklimonda ++22:51
harlowjaisn't kolla the robot-ops?22:51
harlowjalol22:51
kklimondainc0: what do you mean by ops in this context?22:52
inc0people22:52
harlowjawhat are these things u call people22:52
inc0so there will be 100s of operational stuff needed every now and then22:52
harlowjai live in my basement22:52
wirehead_Next year’s cloud will be a room full of mentats smoking.22:52
inc0I'd rather keep kolla out of it;)22:52
inc0and educate people to use ansible to do that22:52
klindgrenharlowja, you live in California - therefor you dont have a basement?22:53
murphyslawbbsthis is on stable/liberty + ansible 1.9.4 using the quick docs at http://docs.openstack.org/developer/kolla/quickstart.html22:53
harlowjalol22:53
sdakeinc0 ye sbut there are common use case operators have that makes sense to add operational features for22:53
kklimondainc0: ok, fair enough - it's just not as simple as saying "there is already `docker restart [service]'" ;)22:53
wirehead_Yeah, there’s always going to be room for checklists, runbooks, and judgement.22:53
sdakedocker restart is totallly unsatisifying to me for this use case22:53
kklimondaand given that kolla (in default config) deploys haproxy and services already22:53
kklimondafiguring out some common set of operations tasks may be a good idea22:54
wirehead_But providing ops users with a integrated, well-understood, and well-coded tool-belt is important.22:54
inc0so my issue is, I like KISS projects, our job is to deploy containers22:54
sdakeour job is to operate openstack clouds22:54
inc0operators job is to operate, we only make it easier22:54
murphyslawbbsinstall script is at http://pastebin.com/gnFybSVm22:54
sdakedeployment is eval to day 022:54
inc0anyway, discussion for different time22:54
sdakeafter day 0, we provide features or handling stuff22:54
klindgrenand final question re: restart.  If one restarts the server.  How do all the services/containers get started again and what assures their ordering on bootup?22:55
sdakeor/for22:55
inc0if you want to write these plays, I'll +2 it22:55
inc0klindgren, so with multinode order shouldn't really matter22:55
harlowjainc0 can u sign here please22:55
harlowja__________22:55
inc0lol22:55
sdakeroflcoptersoysoy :)22:55
*** tzn has quit IRC22:56
inc0with proper HA you should have all services;)22:56
harlowjawhen i hear someone will +2 things, i'm def getting a signature :-P22:56
inc0with aio...well we don't ensure it22:56
wirehead_Why does that say “Agreement for the acquisition and securitization of inc0’s soul”?22:56
harlowjashhh22:56
*** ravig has quit IRC22:56
inc0ehh...I'm in USA long enough to read the small print22:57
wirehead_I tried that trick on go programmers, only to realize that they don’t have souls.22:57
inc0anyway, meeting22:57
sdake3 minutes22:57
*** godleon has joined #openstack-kolla22:58
sdakeinc0 did you brainstorm midcycle topics22:58
sdakeif so, can you provide a link to them22:58
sdakeinc0 at last week's meeting22:58
inc0https://etherpad.openstack.org/p/kolla-newton-midcycle22:59
wirehead_they were brainstormed.22:59
kklimondais the metting here, or a separate channel?23:00
kklimondameeting*23:00
inc0openstack-meeting-423:01
Mech422inc0: spectators welcome ? and if so, whats openstack-meeting-4 ?23:01
inc0Mech, everyone is welcome and #openstack-meeting-4 is channel23:02
Mech422oh - irc meeting - cool23:02
Mech422thanks!23:02
*** daneyon_ has joined #openstack-kolla23:05
openstackgerritJeffrey Zhang proposed openstack/kolla: Fix the prechecks for the ansible version  https://review.openstack.org/32741023:06
kklimondawow, 7AM meeting seem rough :D23:07
kklimondawas it 6PM UTC before?23:08
*** vhosakot has joined #openstack-kolla23:08
inc0ok, I'll be off23:08
inc0thanks guys, cya tomorrow23:08
kklimondacya23:08
vhosakotmeeting ?23:08
vhosakotsorry I'm late23:08
sdakekklimonda we have alternating meetings betwen 16:30 and 23:0023:08
inc0vhosakot, canceled due to lack of people23:08
kklimondaalready finished ;D23:08
vhosakotah ok23:08
sdakewe used to only hae 16:3023:08
sdakeand we are going bck to having only at 16:3023:08
vhosakotsdake: cool23:08
*** inc0 has quit IRC23:09
vhosakotsdake: from next Wednesday, meeting is at 16:30 UTC every Wednesday ?23:10
kklimondaI seem to remember there beeing a meeting at 9:30AM PST last week?23:10
*** daneyon_ has quit IRC23:10
sdakekklimonda ya that is 16:30 utc23:10
vhosakotwe need to update https://wiki.openstack.org/wiki/Meetings/Kolla23:10
kklimondasdake: good point, apparently google gets confused by "16UTC to PST", and converts from my home TZ instead of UTC23:11
*** vhosakot has quit IRC23:14
*** jgriffith is now known as jgriffith_away23:14
*** vhosakot has joined #openstack-kolla23:14
wirehead_Also, to my great annoyance, there is no way to enter GMT times into Google Calendar.23:15
*** sacharya_ has quit IRC23:17
vhosakotI'm in EST and use this link to convert UTC to EST23:17
vhosakothttp://www.worldtimebuddy.com/utc-to-est-converter23:17
Mech422wirehead: schedule it in rejavik time23:19
Mech422wirehead_: its GMT+0 all year23:19
wirehead_OK.23:19
* Mech422 just had to google the same thing....23:19
wirehead_More reasons to like Iceland.23:21
Mech422wirehead_: Doh - I prolly should have just asked sdake what time that is, since he's in same time zone23:21
Mech422wirehead_: True23:21
wirehead_Well, all of the Arizonians here don’t have DST23:21
Mech422wirehead_: yeah - its SOOO nice not having to remember to muck with the clocks23:22
sdakeon the plus side our entire state doesn't sufer jet lag twice a year ;)23:22
*** dwalsh has joined #openstack-kolla23:23
Mech422wirehead_: when I think of all the stuff we get to skip: snow, humidity, bugs, timezones, earthquakes, tornados,etc - I don't think i'll ever move23:23
sdakeeveryone keeps datacenters in arizona becaue nothign ever goes wrong23:23
sdakebut it is hotter then hell :)23:23
Mech422sdake: I'm actually surprised there's not more DCs...23:24
Mech422sdake: its a lot better/cheaper then SFO23:24
sdakeMech422 arizona is the biggest switching center in the world iiuc23:24
sdakeerr, peering center23:24
sdakeor whatever that network nerd term is :)23:24
Mech422sdake: really? I didn't know that - I would have guessed one of the MAE's ?23:24
sdakeyup23:24
sdakeMech422 which part of az are ou in23:25
Mech422sdake: I'm in Mesa - out by sossaman and broadway... western new mexico :-P23:25
*** vhosakot has quit IRC23:25
sdakeya thats far23:25
sdakei'm at 52st and greenway23:25
Mech422ave? or st ?23:25
sdakei previousy lived in flagstaff and before that chandler23:25
sdakestreet23:26
sdakeand before that pheonix23:26
*** vhosakot has joined #openstack-kolla23:26
Mech422ahh - I used to live at 51 ave north of greenway - out by the Amex facility23:26
sdakei really love flagstaff23:26
Mech422sdake: I hear its really beautiful23:26
sdakenever been to flagstaff?23:26
Mech422never been anywhere ...23:26
sdakethe only problem with flagstaff is there are no jobs23:26
Mech422I never 'see the sites' where I live23:27
Mech422just home,work, grocery store23:27
sdakefor me its stay locked up in my house 24 hrs a day23:27
Mech422Except when I lived in spanish harlem - that was awesome place to party23:27
Mech422sdake: pretty much the same for me - got broadband, and newegg delivers :-)23:28
sdakei went to school in flagstaff for 6 years23:28
sdakeand then lived there for about 5 years as well23:28
*** ravig has joined #openstack-kolla23:28
sdakewhen my wife got a job at red hat we moved to phoenix so she would have access to the airport23:28
sdakethe other problem with flagstaff is housign is outrageous23:29
Mech422sdake: I came out to phx in like 98 on contrat to Amex, when they were consolidating everything in the phx dc23:29
sdakemy same house here in phoenix would cost a million in flagstaff23:29
Mech422sdake: sounds like SJC/SFO23:29
sdakeor maybe 750k23:29
sdakemy hosue atm is worth 380k23:29
sdakepaid 242k23:29
sdakeand its almost paid off ;)23:29
Mech422sdake: very nice :-)23:30
wirehead_You don’t even get that much for a million dollar house in SFO/SJC anymore.23:30
sdakein 2020 we are moving to a bigger place23:30
sdakeonly have 2k quare feet23:30
sdakewirehead_ one of the reasons my house is so expensive is the location is prime23:30
sdakei want to live in this same neighborhood23:30
sdakejust a bigger hosue on bigger lot23:30
wirehead_Yeah, see 1k square feet in SJC is over a million.23:31
sdakeyou know keeping up with te jonesss and all that23:31
sdakeya thats crazysauce23:31
ccesariosbezverk_, https://bugs.launchpad.net/kolla/+bug/159060323:31
openstackLaunchpad bug 1590603 in kolla "Cinder + LVM/iSCSI does not work on Ubuntu 16.04" [Undecided,New]23:31
sdakeI much prefer arizona23:31
Mech422sdake: I'm the opposite - I got 1700 square feet and don't use half of it23:31
sdakework for west coast company, make west coast salary with arizona COLA :)23:31
ccesariosbezverk_, with all details/tests23:31
sdakeMech422 my wife and i both work at hoem23:31
kklimondaheh, rents are insane in bay area too23:31
sdakeMech422 we really both need separae offices23:31
sdakeand I want a listening room for my stereo gear23:32
Mech422sdake: yeah - I got 3 bedrooms, so I turned one into a 'server' room, but I kept my 'office' in the master23:32
sdakei had 4 bedrooms23:32
sdakewe recently remodeled and turned abedroom into a closet23:32
sdake10x11 walk in closet23:32
Mech422I really need to find some 'soundproofing' for that room...23:33
wirehead_Room-inside-of-a-room, mech422.23:33
sdakeMech422 ya I want the same deal with my listening room23:33
Mech422wirehead_: nah - I'm too lazy - I just wanna muffle the server fans23:33
sdakeso my kids don't complain when I listen to music23:33
*** ravig has quit IRC23:33
Mech422its actually loud enough in there I'm suppsed to wear ear protection23:33
kklimondasdake: they are kids, they are going to complain about something anyway ;)23:33
Mech422sdake: thats why I don't use anything anymore - sons grown/gone... its just me and sometimes the girlfriend23:34
kklimondaMech422: how much hardware do you have?23:34
sdakeMech422 ya - we dont need alot of space once my children get a job and a place to live23:34
Mech422kklimonda: 2x Decll C6100 4 nodes , 1 x HP6500S 8 nodes, and a couple of 1Us23:34
kklimondaha, no wonder :)23:35
sdakeMech422 but that is a decade or moer away23:35
sdakefirst world problems, I know :)23:35
Mech422kklimonda: yeah - cheap as hell (about $250/node for 2xquad core, 24/32G ram, ipmi,etc) but noisy as hell too23:35
Mech422sdake: Heh23:36
wirehead_Noisy servers… I’m just not that much of a fan.23:37
kklimondaMech422: yeah, server hardware isn't really made to be quiet anyway23:37
sdakemy gear is quiet23:38
wirehead_I’m betting they are too carefully designed to go in and swap out fans and add PWM controllers.23:38
sdakebut I hav eto run my fans at full on my minidells or my 10gig nic overheats23:38
sdakeso, its super loud23:38
Mech422kklimonda: true - but they're tanks... and I really wanted IPMI23:38
Mech422wirehead_: I just use ipmi to shut them off when I get pissy about it23:38
kklimondaMech422: yeah, even most basic IPMI is a requirement in my books23:39
kklimondaeven for a lab23:39
sdakemy servers have pxe but no ipmi23:39
* sdake sadfaces23:39
Mech422kklimonda: especially when your doing 'lab' stuff and re-loading OS's all the time23:39
*** mbound has quit IRC23:39
*** mummer has quit IRC23:39
Mech422sdake: openipmi will let you reboot and stuff remotely23:40
Mech422sdake: it just doesn't give ya the bios console23:40
kklimondaMech422: I'd still do it over PXE, but IPMI makes the entire process much faster - chassis bootdev pxe, power reset, go for a drink23:40
sdakeMech422 yes  Iknow, long ago I worked on that codebase23:40
*** mbound has joined #openstack-kolla23:40
sdakeMech422 that code spawned from montavista software23:40
Mech422kklimonda: oh yeah - I do Foreman for pxe provisioning - so its pretty much hit the button and wait23:40
Mech422kklimonda: unless your testing new preseeds/network setups - then the ipmi is awesome :-)23:41
Mech422sdake: oh neat - I didn't know that :-)23:41
kklimondaMech422: ah yes, doing preseeds without iKVM/SoL means you will be stuck next to the machine with monitor and keyboard23:42
kklimondaat least centos installer will spawn ssh server for you23:43
kklimondathat gives you nice tmux with logs etc.23:43
Mech422oh, thats convienent :-)  CoreOS just spawns 'screw you' and doesn't even allow console login :-P23:43
kklimondadebian installer netconsole is terrible23:44
Mech422kklimonda: you know - i've used deb for dogs years, and never tried the netconsole...23:44
Mech422kklimonda: I never needed it for 'general use' and by the time I got into preseeds, I had IPMI23:44
*** mbound has quit IRC23:44
kklimondaMech422: I've tried it recently, after seeing how nice centos ssh installer is23:45
kklimondawas not impressed ;)23:45
sdakesbezverk_ ping23:47
*** ravig has joined #openstack-kolla23:47
Mech422kklimonda: thats too bad - debian usually such nice stuff23:48
Mech422sdake: you know, every time you mention monta vista I keep thinking I should look doug louder (lowder?) up...23:48
Mech422sdake: last I heard, he was at apple23:48
sdakei think its lowder23:48
sdakei didn't really know him all that well23:49
sdakeor at all23:49
Mech422sdake: you know, he was a physics professor at berkley...he handed me his resume and I thought he was applying for my job :-P23:49
Mech422sdake: ahh....23:49
Mech422sdake: _really_ nice guy - has some pretty cool stories about some probes they built in the antartic :-)23:49
sdakedidn't know that23:50
sdakemontavista hq was in funnyvale23:50
sdakeso didn't meet alot of my coworkers23:50
sdakewe had a tempe design office23:50
sdakeof aout 20 people23:50
Mech422I didn't realize MV had offices out here...23:51
sdakeMech422 ya the cost of hiring in arizona is alot cheaper then most states - if you put an office here23:51
*** ravig has quit IRC23:52
sdakethere is a good tech workforce but not alot of open jobs23:52
Mech422sdake: yeah - but tech here pays close to on par with Silly Valley...23:52
sdakeout of school i made 42k a year in 1998..23:53
sdakenow rcg's are making 100k/yr23:53
Mech422sdake: heh - only in Silly Valley/SFO....23:53
sdakeright23:53
*** rhallisey has joined #openstack-kolla23:53
Mech422sdake: programmers on the east coast seem to get treated like shit23:53
sdakeya i worked for an east coast company for 9 years23:54
Mech422sdake: even Wall St. didn't treat us nearly as good23:54
sdakeeast coast tech is different mentality23:54
Mech422yeah - yer a cost center vs a profit center :-P23:54
sdakeP&L is where the good jobs are :)23:54
sdakeor altneratively the CTO office23:55
sdakeI'm in teh cto office atm23:55
Mech422I really feel bad for all the guys back east that are gonna spend their whole careers writing maintenance code for accounting systems and never get to touch the fun stuff :-/23:55
sdakerhallisey works in westford23:55
sdakewhich is 1 hr drive from boston23:55
sdakehe gets to work on good stuff :)23:55
sdakethere is alot of good jobs on the east coast, but the pay vs cost of living isn't ideal23:56
Mech422sdake: yeah - RH has offices just up the road from my sister..23:56
Mech422umm - providence I think ?23:56
sdakeMech422 their office is in westford23:56
sdakewhich is in MA23:56
rhallisey:)23:56
Mech422and DEC used to be out there23:56
Mech422and Raytheon23:56
Mech422Boston is bio-tech now though right ?23:56
sdakeno idea23:56
sdakeeast coast to lbieral for my tastes23:57
Mech422still - compared to the armies of programmers working for insurance companies, and banks and stuff out there...23:57
Mech422the 'fun' jobs seem pretty scarce23:57
sdakelong ago the cto red hat sent me an email "I see you working in carrier grade linux - we want to hire a lead for that, and wew want yoou, but you would have to move"23:57
sdakelol move to MA23:57
sdakegot to be kidding :)23:58
Mech422is RTP/IBM still a thing ?23:58
Mech422heh23:58
Mech422yeah - erricson is desperate for Openstack guys in Texas...screw that noise23:58
sdakelater they hired me remotely23:58
sdakebecause red hat was t-4 months from shipping a product based upon software i wrote23:59
sdakecalled openais23:59
sdakeit took them 4 months to get a req unlocked23:59
Mech422openais rings a bell for some reason...23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!