| *** witlessb has quit IRC | 00:36 | |
| *** jinxing has joined #openstack-sahara | 00:40 | |
| *** egafford has quit IRC | 00:58 | |
| *** jinxing has quit IRC | 02:15 | |
| *** jinxing has joined #openstack-sahara | 02:17 | |
| *** jinxing has quit IRC | 02:35 | |
| *** jinxing has joined #openstack-sahara | 02:38 | |
| *** houming has joined #openstack-sahara | 02:50 | |
| *** coolsvap has quit IRC | 03:16 | |
| *** coolsvap has joined #openstack-sahara | 03:19 | |
| *** macjack has joined #openstack-sahara | 03:49 | |
| *** houming has quit IRC | 03:52 | |
| *** houming has joined #openstack-sahara | 03:57 | |
| *** houming has quit IRC | 04:07 | |
| *** jinxing has quit IRC | 04:18 | |
| *** agireud has quit IRC | 04:18 | |
| *** agireud has joined #openstack-sahara | 04:20 | |
| *** agireud has quit IRC | 04:25 | |
| *** agireud has joined #openstack-sahara | 04:46 | |
| *** jinxing has joined #openstack-sahara | 04:55 | |
| *** houming has joined #openstack-sahara | 05:01 | |
| openstackgerrit | Ken Chen proposed openstack/sahara-specs: Resource Check before Cluster Creation https://review.openstack.org/235110 | 05:09 |
|---|---|---|
| openstackgerrit | Ken Chen proposed openstack/sahara: Add Resource Check step and the involved base methods https://review.openstack.org/235745 | 05:12 |
| *** rcernin has joined #openstack-sahara | 05:36 | |
| *** rcernin has quit IRC | 05:42 | |
| *** sgotliv has joined #openstack-sahara | 07:04 | |
| *** rcernin has joined #openstack-sahara | 07:07 | |
| *** jinxing has quit IRC | 07:09 | |
| *** sgotliv has quit IRC | 07:12 | |
| openstackgerrit | Jaxon Wang proposed openstack/sahara: Add unit test cases for cdh plugin utils https://review.openstack.org/248068 | 07:16 |
| *** openstack has joined #openstack-sahara | 07:19 | |
| *** jinxing has joined #openstack-sahara | 07:20 | |
| *** nkrinner has joined #openstack-sahara | 07:45 | |
| *** akuznetsov has joined #openstack-sahara | 07:53 | |
| *** jinxing has quit IRC | 07:59 | |
| *** akuznetsov has quit IRC | 08:01 | |
| *** jinxing has joined #openstack-sahara | 08:04 | |
| *** thehoffau has quit IRC | 08:49 | |
| *** Poornima has joined #openstack-sahara | 08:54 | |
| *** hdd has joined #openstack-sahara | 09:00 | |
| *** sgotliv has joined #openstack-sahara | 09:04 | |
| *** vgridnev has joined #openstack-sahara | 09:29 | |
| *** witlessb has joined #openstack-sahara | 09:36 | |
| *** esikachev has joined #openstack-sahara | 09:54 | |
| *** ekarlso- has joined #openstack-sahara | 09:59 | |
| *** ekarlso has quit IRC | 10:00 | |
| *** houming has quit IRC | 10:00 | |
| *** ekarlso- is now known as ekarlso | 10:00 | |
| *** hdd_ has joined #openstack-sahara | 10:02 | |
| *** hdd has quit IRC | 10:04 | |
| *** _degorenko|afk is now known as degorenko | 10:20 | |
| *** hdd_ has quit IRC | 10:21 | |
| *** tellesnobrega_af is now known as tellesnobrega | 10:33 | |
| *** hdd has joined #openstack-sahara | 10:54 | |
| *** houming has joined #openstack-sahara | 11:37 | |
| *** hdd has quit IRC | 11:58 | |
| *** sgotliv has quit IRC | 12:21 | |
| *** jinxing has quit IRC | 13:04 | |
| *** sgotliv has joined #openstack-sahara | 13:06 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Implement custom check for Kafka Service https://review.openstack.org/242066 | 13:35 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Support of Spark EDP in Ambari plugin https://review.openstack.org/234801 | 13:35 |
| *** Poornima has quit IRC | 13:53 | |
| *** tellesnobrega is now known as tellesnobrega_af | 14:17 | |
| *** tellesnobrega_af is now known as tellesnobrega | 14:17 | |
| *** raildo is now known as raildo-afk | 14:20 | |
| *** raildo-afk is now known as raildo | 14:20 | |
| *** jinxing has joined #openstack-sahara | 14:23 | |
| openstackgerrit | Michael McCune proposed openstack/sahara: [WIP] Initial key manager implementation https://review.openstack.org/220680 | 14:49 |
| *** houming has quit IRC | 14:54 | |
| *** tmckay has joined #openstack-sahara | 14:59 | |
| *** openstackgerrit has quit IRC | 15:02 | |
| *** openstackgerrit has joined #openstack-sahara | 15:02 | |
| *** egafford has joined #openstack-sahara | 15:02 | |
| *** houming has joined #openstack-sahara | 15:03 | |
| *** houming has quit IRC | 15:24 | |
| *** jinxing has quit IRC | 15:26 | |
| *** houming has joined #openstack-sahara | 15:39 | |
| *** ViswaV_ has joined #openstack-sahara | 15:51 | |
| *** ViswaV has quit IRC | 15:52 | |
| *** rcernin has quit IRC | 16:08 | |
| *** Pablo|off| has joined #openstack-sahara | 16:14 | |
| *** Pablo|off| is now known as pcaruana | 16:15 | |
| *** houming has quit IRC | 16:17 | |
| *** esikachev has quit IRC | 16:19 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Fix job execution deletion in case of unknown plugin https://review.openstack.org/242509 | 16:30 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Fix job execution deletion in case of unknown plugin https://review.openstack.org/242509 | 16:31 |
| openstackgerrit | Michael Ionkin proposed openstack/sahara: Fix bashate errors and warnings https://review.openstack.org/248822 | 17:01 |
| *** vgridnev has quit IRC | 17:06 | |
| *** sgotliv has quit IRC | 17:16 | |
| *** rcernin has joined #openstack-sahara | 17:21 | |
| *** nkrinner has quit IRC | 17:37 | |
| openstackgerrit | David Lyle proposed openstack/sahara-dashboard: Excising Sahara content from Horizon https://review.openstack.org/248322 | 17:43 |
| openstackgerrit | lu huichun proposed openstack/sahara: Update scenario test readme file https://review.openstack.org/248841 | 17:44 |
| openstackgerrit | Ethan Gafford proposed openstack/sahara-specs: Move Image Generation Scripts into Plugins https://review.openstack.org/248842 | 17:44 |
| *** vgridnev has joined #openstack-sahara | 17:51 | |
| openstackgerrit | Michael Ionkin proposed openstack/sahara: Fix bashate warnings https://review.openstack.org/248822 | 17:55 |
| openstackgerrit | Ethan Gafford proposed openstack/sahara-specs: Move Image Generation Scripts into Plugins https://review.openstack.org/248842 | 18:05 |
| openstackgerrit | Denis Egorenko proposed openstack/puppet-sahara: Use $::os_service_default where is possible https://review.openstack.org/245253 | 18:23 |
| *** degorenko is now known as _degorenko|afk | 18:39 | |
| openstackgerrit | David Lyle proposed openstack/sahara-dashboard: Excising Sahara content from Horizon https://review.openstack.org/248322 | 18:41 |
| *** esikachev has joined #openstack-sahara | 19:13 | |
| *** sgotliv has joined #openstack-sahara | 19:22 | |
| *** ashishb has joined #openstack-sahara | 19:23 | |
| ashishb | Hello Everyone, I have a quick query related to Cluster instance customization using cloud-init / cloud-config | 19:28 |
| ashishb | as we know while creating an instance through nova boot command / UI, there is an option to pass user-data through with cloud-init or cloud-config scripts can be passed | 19:30 |
| ashishb | which can customize the instance | 19:30 |
| ashishb | is there a similar way to pass cloud-init / cloud-config scripts while creating cluster using Sahara ..? | 19:30 |
| elmiko | ashishb: good question, there might be, but i'm not aware of one immediately | 19:31 |
| elmiko | we use heat to provision instances, is there some way to pass that information through a heat template? | 19:32 |
| ashishb | so, here is what I am attempting: I have a Sahara image using which I create my cluster. Now let's say I want to deploy some mrJob packages on these nodes at cluster creation time .. | 19:33 |
| elmiko | we usually do that type of configuration/deployment inside our plugins, but that does not allow a user to add custom packages | 19:34 |
| ashishb | with nova I can achieve this using cloud-config / cloud-init or post-creation scripts (in UI), In Sahara what is the way ..? | 19:34 |
| elmiko | ashishb: would it be possible for you to create the images with those packages installed? | 19:35 |
| ashishb | elmiko: I would prefer that, however, in my case I have to use a given image where I have to bootstrap with certain (custom) packages at cluster creation time | 19:36 |
| elmiko | ah | 19:36 |
| elmiko | i think the only way to do this currently with sahara would be to create the cluster, then use some configuration management tool to add those pieces. i don't think we provide any hooks to add pieces through cloud-init. (i could be wrong, but i don't remember seeing something like this.) | 19:37 |
| ashishb | so, there are some bits of info I need to be able to dynamically inject / customize my cluster nodes with at creation time | 19:37 |
| elmiko | yea, you'd need ip address and ssh keys i'd imagine? | 19:37 |
| ashishb | yeah and I need much more, some custom packages and libs (like mrJob etc) too | 19:38 |
| elmiko | well, yea, but i assume you know what packages/libs you'd like to install? | 19:39 |
| ashishb | yes, but the thing is I need to be able to bootstrap some of these dynamically at cluster creation time ... | 19:40 |
| elmiko | hmm, so you can't add them after the cluster is created? | 19:40 |
| ashishb | so, I may not be able to bake them in the image itself | 19:40 |
| elmiko | i mean, you could write something using the python-saharaclient that would return all the ip addresses of your cluster, then deploy the packages in question using something like ansible. | 19:41 |
| elmiko | given what you are saying though, it might be a nice feature we could add. | 19:41 |
| elmiko | i'd also need to check with the team and see if maybe there is a way to access the nova feature you are talking about first though. | 19:42 |
| ashishb | yes, that would be the other way to achieve this (using config mgmt tool post cluster creation) however, I would love to have cloud-init / cloud-config at my disposal during cluster creation as an option | 19:42 |
| elmiko | thanks for bringing this up, i think the team should talk about this as a user story we can enable. | 19:43 |
| elmiko | (maybe we already do and i'm just drawing a blank on it) | 19:43 |
| elmiko | like, if you can do this through heat templates, it might be possible to modify the templates that sahara uses. | 19:44 |
| ashishb | elmiko: thanks for the help, I would appreciate if you could share any details on it .. if needed I can help with drafting any blueprint if needed for this | 19:44 |
| elmiko | awesome! | 19:44 |
| elmiko | ashishb: if you would, make a post on the mailing list talking about the feature and see if others have ideas. if it doesn't exist yet, we would love to have you help create it =) | 19:45 |
| ashishb | sure, I see something similar in AWS EMR (called Bootstrap Action) and would like if we have it in Sahara too | 19:46 |
| elmiko | yea, it sounds useful | 19:46 |
| ashishb | thanks elmiko, I post it in sahara mailing list and will look forward to the responses .. thanks again! | 19:48 |
| elmiko | np, and thanks for bringing it up ashishb | 19:48 |
| *** esikachev has quit IRC | 20:14 | |
| *** ashishb has quit IRC | 20:18 | |
| *** ViswaV_ has quit IRC | 20:44 | |
| *** ViswaV has joined #openstack-sahara | 21:01 | |
| *** krotscheck has quit IRC | 21:10 | |
| egafford | SergeyLukjanov: ping | 21:12 |
| egafford | (Hoping you're west coast US atm. If not, I'm thinking about how best to allow configuration of an image build host, in order to allow an image generation API like we discussed at summit. I'm currently thinking that image generation wants to be its own very odd provisioning plugin, for reuse's sake, but wanted to discuss with you before posting the spec, since you had Ideas on this point. :) ) | 21:15 |
| *** krotscheck has joined #openstack-sahara | 21:17 | |
| egafford | vgridnev: Do you happen to know where SergeyLukjanov physically is right now? :) | 21:19 |
| vgridnev | i'm not sure, but it looks like he at Saratov and he caught cold. | 21:23 |
| vgridnev | egafford, ^^ | 21:23 |
| egafford | vgridnev: Oh, poor Sergey. | 21:23 |
| egafford | vgridnev: Thanks for letting me know; I'll probably just post something and expect him to blow it up in a fit of sneezing. | 21:24 |
| egafford | (This spec deserves to get blown up a lot before it solidifies; it's a reasonably complex thing with a lot of implementation options.) | 21:24 |
| *** vgridnev has quit IRC | 21:27 | |
| *** vgridnev has joined #openstack-sahara | 21:28 | |
| *** david-lyle has quit IRC | 21:31 | |
| *** vgridnev has quit IRC | 21:32 | |
| *** david-lyle has joined #openstack-sahara | 21:34 | |
| *** crobertsrh is now known as _crobertsrh | 21:52 | |
| *** david-lyle has quit IRC | 21:55 | |
| *** david-lyle has joined #openstack-sahara | 22:03 | |
| *** david-lyle has quit IRC | 22:04 | |
| *** ViswaV has quit IRC | 22:18 | |
| *** rcernin has quit IRC | 22:20 | |
| *** david-lyle has joined #openstack-sahara | 22:21 | |
| *** david-lyle has quit IRC | 22:25 | |
| *** david-lyle has joined #openstack-sahara | 23:03 | |
| SergeyLukjanov | egafford, hey, yeah, I'm on sick leave now, should fully return back in a day or two at max | 23:04 |
| *** david-lyle has quit IRC | 23:05 | |
| egafford | SergeyLukjanov: Ok, feel better. :) | 23:05 |
| egafford | When you do, I'd love to chat about your vision for an image generation API; I know we both have visions about this and I'm currently working on a provisional spec, but I'd love your input. | 23:06 |
| egafford | But, no rush; mostly feel better. | 23:06 |
| *** tellesnobrega is now known as tellesnobrega_af | 23:08 | |
| *** david-lyle has joined #openstack-sahara | 23:23 | |
| *** david-lyle has quit IRC | 23:25 | |
| *** egafford has quit IRC | 23:27 | |
| *** tmckay has left #openstack-sahara | 23:29 | |
| *** david-lyle has joined #openstack-sahara | 23:35 | |
| *** david-lyle has quit IRC | 23:41 | |
| *** david-ly_ has joined #openstack-sahara | 23:41 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!