| *** tosky___ has quit IRC | 00:04 | |
| *** sgotliv has quit IRC | 00:43 | |
| *** madong__ has quit IRC | 01:01 | |
| *** larainema has joined #openstack-sahara | 01:02 | |
| *** hdd has joined #openstack-sahara | 01:25 | |
| *** openstackgerrit_ has joined #openstack-sahara | 03:11 | |
| *** dave-mccowan has quit IRC | 03:20 | |
| *** links has joined #openstack-sahara | 04:12 | |
| *** openstackgerrit_ has quit IRC | 04:14 | |
| *** Poornima has joined #openstack-sahara | 04:23 | |
| *** jamielennox is now known as jamielennox|away | 05:35 | |
| *** ashishb has joined #openstack-sahara | 05:36 | |
| *** jamielennox|away is now known as jamielennox | 05:58 | |
| *** nkrinner has joined #openstack-sahara | 05:58 | |
| *** Poornima has quit IRC | 07:07 | |
| *** jamielennox is now known as jamielennox|away | 07:08 | |
| *** Poornima has joined #openstack-sahara | 07:20 | |
| *** witlessb has joined #openstack-sahara | 07:28 | |
| *** jamielennox|away is now known as jamielennox | 07:32 | |
| *** macjack has joined #openstack-sahara | 08:26 | |
| *** macjack has quit IRC | 08:51 | |
| *** macjack has joined #openstack-sahara | 08:58 | |
| *** vgridnev has joined #openstack-sahara | 09:00 | |
| *** coolsvap_ has joined #openstack-sahara | 09:01 | |
| *** macjack has quit IRC | 09:03 | |
| *** Poornima has quit IRC | 09:03 | |
| *** Poornima has joined #openstack-sahara | 09:08 | |
| *** tosky has joined #openstack-sahara | 09:24 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Use custom flavor in gate https://review.openstack.org/220435 | 09:29 |
|---|---|---|
| *** tmckay has quit IRC | 09:57 | |
| *** coolsvap_ has quit IRC | 09:58 | |
| *** dave-mccowan has joined #openstack-sahara | 10:06 | |
| *** Poornima has quit IRC | 10:06 | |
| *** ashishb has quit IRC | 10:08 | |
| *** Poornima has joined #openstack-sahara | 10:19 | |
| *** ashishb has joined #openstack-sahara | 10:19 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Use custom flavor in gate https://review.openstack.org/220435 | 10:39 |
| *** links has quit IRC | 10:49 | |
| *** raildo-afk is now known as raildo | 12:05 | |
| *** links has joined #openstack-sahara | 12:21 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Use custom flavor in gate https://review.openstack.org/220435 | 12:35 |
| *** tmckay has joined #openstack-sahara | 13:00 | |
| *** tmckay has quit IRC | 13:01 | |
| *** tmckay has joined #openstack-sahara | 13:01 | |
| *** nkrinner has quit IRC | 13:06 | |
| *** coolsvap_ has joined #openstack-sahara | 13:08 | |
| *** nkrinner has joined #openstack-sahara | 13:08 | |
| *** raildo is now known as raildo-afk | 13:17 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Test commit https://review.openstack.org/220500 | 13:20 |
| *** raildo-afk is now known as raildo | 13:24 | |
| *** links has quit IRC | 13:27 | |
| *** Poornima has quit IRC | 13:30 | |
| *** hdd has quit IRC | 13:38 | |
| *** nkrinner has quit IRC | 14:15 | |
| *** egafford has joined #openstack-sahara | 14:26 | |
| *** esikachev has joined #openstack-sahara | 14:29 | |
| *** coolsvap_ has quit IRC | 14:41 | |
| *** dave-mccowan has quit IRC | 14:43 | |
| _crobertsrh | Hey folks, if you're looking for a good UI review to take a look at, please give https://review.openstack.org/#/c/209683/ a go. Lots of good functionality to try out, even if you're not into boring UI code :) | 14:43 |
| egafford | Thanks _crobertsrh! | 14:44 |
| *** _crobertsrh is now known as crobertsrh | 14:44 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Create ResourceGroup with volumes only it is required https://review.openstack.org/220538 | 14:48 |
| vgridnev | egafford, is there simple way to try that? | 14:50 |
| openstackgerrit | Ashish Billore proposed openstack/sahara: Update Sahara Dev Quickstart Guide https://review.openstack.org/220245 | 14:50 |
| vgridnev | egafford, I'm talking about your horizon patch | 14:51 |
| egafford | vgridnev: Well, you can fetch that Horizon commit into your devstack at /opt/stack/horizon (or wherever), restart httpd (or whatever) and check it out. | 14:51 |
| egafford | That's how I think I'd do it if I weren't doing some weird frankenstein remote development model. :) | 14:52 |
| egafford | It's all in the job template creation and launch workflows. | 14:52 |
| vgridnev | Ok, will try | 14:53 |
| egafford | vgridnev: Cool! | 14:53 |
| ashishb | ^vgridnev, I have re-submitted the quickstart guide, removing the direct links and putting place-holders for versions | 14:53 |
| egafford | I was really happy with the way the launch flow turned out in particular; we were able to create a really nice user-specified form for the job. | 14:53 |
| ashishb | hope this is fine now, we won´t have to update it per release / version support | 14:54 |
| ashishb | please have a look, thanks | 14:54 |
| *** hdd has joined #openstack-sahara | 14:54 | |
| vgridnev | ashishb, why it +610, -405? | 14:55 |
| ashishb | hmm .. seems there are line-ending got introduced | 14:56 |
| ashishb | let me correct that | 14:56 |
| *** dave-mccowan has joined #openstack-sahara | 15:00 | |
| openstackgerrit | Ashish Billore proposed openstack/sahara: Update Sahara Dev Quickstart Guide https://review.openstack.org/220245 | 15:09 |
| *** vgridnev has quit IRC | 15:29 | |
| *** dave-mccowan has quit IRC | 15:56 | |
| *** dave-mccowan has joined #openstack-sahara | 16:08 | |
| elmiko | looks like we've gotten reasonably close to covering all the docs. thanks everyone! | 16:09 |
| *** rickflare has joined #openstack-sahara | 16:14 | |
| openstackgerrit | Michael McCune proposed openstack/sahara: Updating architecture doc https://review.openstack.org/218998 | 16:19 |
| *** vgridnev has joined #openstack-sahara | 16:23 | |
| vgridnev | * | 16:23 |
| *** Erming_ has joined #openstack-sahara | 16:32 | |
| *** hdd has quit IRC | 16:43 | |
| rickflare | hello all | 16:48 |
| rickflare | I just wanted to introduce myself | 16:48 |
| tellesnobrega | hello rickflare, wellcome to sahara | 16:48 |
| rickflare | im a long time systems engineer and I do devops full time | 16:48 |
| rickflare | I have a passion for Hadoop, puppet, saltstack and python | 16:49 |
| elmiko | hi rickflare | 16:49 |
| rickflare | I was thrilled when I found out about this project and I look forward to contributing in any way possible. | 16:49 |
| elmiko | awesome! | 16:49 |
| * egafford has been talking with rickflare: sounds like he's got a lot of really useful experience with the pain of managing large clusters, and enough dev to do something about it. :) | 16:50 | |
| elmiko | nice, good to hear. we can always use more end-user experience experts =) | 16:50 |
| *** ashishb has quit IRC | 16:51 | |
| rickflare | As admin of many large hadoop clusters I know how important this will be if done right. | 16:51 |
| rickflare | tools like cloudera manager or horton works are great till you need to do something custom | 16:52 |
| elmiko | right | 16:52 |
| egafford | rickflare: Yeah... yeah. | 16:52 |
| rickflare | if sahara can scale using apache hadoop then you will win | 16:52 |
| rickflare | I have nothing against cloudera and others | 16:52 |
| crobertsrh | welcome rickflare......woooooooooooooooo! | 16:52 |
| rickflare | as they work really well | 16:52 |
| egafford | rickflare: Our mission is to make ALL those guys scale. We've got basic elasticity in all of those. MapR too, I think, though that plugin's newer. | 16:53 |
| rickflare | but I am fan of running things in a native state and not going too deep down the tunnel, so to speak. | 16:53 |
| egafford | (Also Spark and Storm.) :) | 16:53 |
| egafford | rickflare: Sure, absolutely. | 16:53 |
| rickflare | wow storm too | 16:53 |
| rickflare | thats impressive | 16:54 |
| egafford | Just wanted to note that we're distribution-friendly here. :) | 16:54 |
| egafford | tellesnobrega's been very active in getting Storm up and running. | 16:54 |
| egafford | Telles, rickflare. rickflare, tellesnobrega. | 16:54 |
| egafford | Oh, tellesnobrega, you already said hi. Good on you. | 16:55 |
| rickflare | one of the biggest issues imo with hadoop is surrounding security. I would love to see projects like freeipa and the use of kerberos implemented with sahara | 16:55 |
| egafford | rickflare: elmiko's been beating the sec drum pretty hard the last few cycles, so he's your guy there. | 16:55 |
| rickflare | this way admins can quickly monitor and admin users of the stack and keep details logs of Mapr jobs run by each user | 16:55 |
| egafford | He's actually at the security midcycle RIGHT NOW, I think. | 16:55 |
| rickflare | cool | 16:56 |
| elmiko | yes, we are coasting in to the end of midcycle ;) | 16:56 |
| rickflare | so im somewhat new to openstack so I have a learning curve there to deal with. | 16:56 |
| elmiko | and yea, rickflare, i have a presentation about possible integration efforts between sahara and kerberos identity backends | 16:56 |
| rickflare | However, I am very serious and want to see this become real. | 16:56 |
| elmiko | i think we have several options to investigate | 16:56 |
| elmiko | there are a number of factors to consider about how we could integrate this piece of openstack with kerberos/ldap | 16:57 |
| rickflare | I think one of the biggest issues is intergration of all these things. As the complexity scales, it reaches a point that when something breaks the system admin has no idea how to fix it. This is why ease of use and simple structure are key. | 16:58 |
| elmiko | agreed | 16:58 |
| rickflare | elmiko deploying ldap and kerberos from scratch is a major PITA. | 16:58 |
| rickflare | I mean securing ldap alone and making sure your policies are tight can take a long long time. | 16:59 |
| elmiko | rickflare: right, although i've been talking with the freeipa guys and they've given me hope that we could do some automation with regards to in-cluster instances of freeipa | 16:59 |
| rickflare | sweet | 17:00 |
| rickflare | well let me know | 17:00 |
| rickflare | id love to jump in and help | 17:00 |
| elmiko | will do, i'll share my slides with you too if you are curious | 17:00 |
| rickflare | absolutely | 17:00 |
| *** openstackgerrit_ has joined #openstack-sahara | 17:02 | |
| *** hdd has joined #openstack-sahara | 17:03 | |
| egafford | rickflare: If you have trouble with devstack, btw, feel free to ask here. It is a good tool, but not always the stablest, and there is no real need to suffer alone and in silence. :) | 17:03 |
| rickflare | ok | 17:04 |
| rickflare | will do | 17:04 |
| rickflare | im going to get my centos7 box up | 17:04 |
| rickflare | btw do I still need to remove NetworkManager to get any of this to work? | 17:05 |
| egafford | rickflare: Fun story: I don't really know on CentOS right now. | 17:05 |
| egafford | I don't think it'll hurt to disable and remove it, certainly, and you might as well. | 17:06 |
| rickflare | ok | 17:06 |
| *** tosky has quit IRC | 17:11 | |
| tellesnobrega | rickflare, if you have any ideas for storm or questions, just let me know and we can talk about it | 17:14 |
| *** tosky has joined #openstack-sahara | 17:15 | |
| *** esikachev has quit IRC | 17:31 | |
| *** raildo is now known as raildo-afk | 17:40 | |
| tmckay | anyone know the default cloudera manager console login? | 17:41 |
| tmckay | bah, it's generated and stored in cluster.extra | 17:43 |
| *** crobertsrh has quit IRC | 17:45 | |
| *** crobertsrh has joined #openstack-sahara | 17:46 | |
| *** crobertsrh has quit IRC | 17:48 | |
| *** raildo-afk is now known as raildo | 17:48 | |
| *** crobertsrh has joined #openstack-sahara | 17:51 | |
| *** crobertsrh has quit IRC | 17:52 | |
| *** crobertsrh has joined #openstack-sahara | 17:52 | |
| *** devlaps has joined #openstack-sahara | 17:56 | |
| tmckay | more than one way to skin a cat :) make Sahara return .extra, get it from the client | 18:01 |
| openstackgerrit | lu huichun proposed openstack/sahara: [sahara doc fix] registering image doc https://review.openstack.org/220310 | 18:12 |
| *** larainema has quit IRC | 18:20 | |
| *** larainema has joined #openstack-sahara | 18:20 | |
| openstackgerrit | lu huichun proposed openstack/python-saharaclient: Add job execution status update support https://review.openstack.org/218606 | 18:27 |
| *** crobertsrh has quit IRC | 18:27 | |
| *** vgridnev has quit IRC | 18:28 | |
| openstackgerrit | lu huichun proposed openstack/sahara: [sahara doc fix] registering image doc https://review.openstack.org/220310 | 18:28 |
| *** crobertsrh has joined #openstack-sahara | 18:29 | |
| openstackgerrit | Merged openstack/sahara: updating plugins doc https://review.openstack.org/219314 | 18:37 |
| *** ashishb has joined #openstack-sahara | 18:40 | |
| *** dave-mccowan has quit IRC | 18:51 | |
| crobertsrh | Anyone seen this with a recent devstack startup? ERROR (DiscoveryFailure): Could not determine a suitable URL for the plugin | 19:01 |
| *** ashishb has quit IRC | 19:02 | |
| crobertsrh | I am consistently getting them when my local.sh is trying to create flavors, but I've found that if I just rerun local.sh after awhile, it will succeed the second time around. | 19:03 |
| *** ashishb has joined #openstack-sahara | 19:05 | |
| tmckay | I don't know that one. Anyone know why a large flavor data node with cdh ends up with a VM disk that is 16GB? | 19:06 |
| *** vgridnev has joined #openstack-sahara | 19:09 | |
| *** dave-mccowan has joined #openstack-sahara | 19:19 | |
| *** ashishb has quit IRC | 19:26 | |
| openstackgerrit | Merged openstack/sahara: updating index doc https://review.openstack.org/219315 | 19:27 |
| tmckay | vrgridnev, hey there, question for you | 19:32 |
| *** tosky has quit IRC | 19:37 | |
| *** openstackgerrit_ has quit IRC | 20:03 | |
| *** openstackgerrit_ has joined #openstack-sahara | 20:04 | |
| *** ashishb has joined #openstack-sahara | 20:15 | |
| openstackgerrit | Merged openstack/puppet-sahara: acceptance: bump trusty packaging to trusty-proposed/liberty https://review.openstack.org/219845 | 20:15 |
| *** egafford has quit IRC | 20:16 | |
| *** tellesnobrega has quit IRC | 20:16 | |
| *** tellesnobrega has joined #openstack-sahara | 20:16 | |
| *** egafford has joined #openstack-sahara | 20:16 | |
| *** raildo is now known as raildo-afk | 20:46 | |
| *** openstackgerrit_ has quit IRC | 20:47 | |
| *** openstackgerrit_ has joined #openstack-sahara | 20:47 | |
| *** openstackgerrit_ has quit IRC | 20:48 | |
| *** crobertsrh has quit IRC | 20:48 | |
| *** openstackgerrit_ has joined #openstack-sahara | 20:48 | |
| *** crobertsrh has joined #openstack-sahara | 20:50 | |
| *** crobertsrh is now known as _crobertsrh | 20:52 | |
| *** openstackgerrit_ has quit IRC | 20:53 | |
| openstackgerrit | Ashish Billore proposed openstack/sahara: Update Sahara Dev Quickstart Guide https://review.openstack.org/220245 | 21:01 |
| *** hdd has quit IRC | 21:05 | |
| *** hdd has joined #openstack-sahara | 21:05 | |
| *** whydidyoustealmy has quit IRC | 21:11 | |
| *** whydidyoustealmy has joined #openstack-sahara | 21:18 | |
| vgridnev | tmckay, hey | 21:32 |
| openstackgerrit | Michael McCune proposed openstack/sahara: [WIP] Initial key manager and proxy passwords impl https://review.openstack.org/220680 | 21:37 |
| *** Erming_ has quit IRC | 21:40 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Test commit #1 https://review.openstack.org/220500 | 21:42 |
| *** ashishb has quit IRC | 21:43 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Test commit #2 https://review.openstack.org/220682 | 21:43 |
| vgridnev | tmckay, re-ping | 21:50 |
| tmckay | vgridnev, nevermind :) | 22:06 |
| vgridnev | Seems that I solved problem cdh and spark | 22:06 |
| vgridnev | https://review.openstack.org/#/c/220500/ | 22:07 |
| tmckay | great, that's what I was going to work on | 22:07 |
| tmckay | well, actually, spark/swift | 22:08 |
| vgridnev | yep | 22:08 |
| tmckay | vgridnev, yes, I found out with the default templates that the history server was missing | 22:08 |
| tmckay | I was using a centos image that wouldn't resize, though, and it kept me from launching 5.4 | 22:09 |
| tmckay | vgridnev, so have you tried spark/swift with this combination? | 22:09 |
| vgridnev | tmckay, I tried on CI and it passed | 22:10 |
| tmckay | ok, which test is that in the gate? | 22:11 |
| tmckay | I wanted to verify whether or not the ":" added to the classpath would solve the issue for yarn cluster mode | 22:12 |
| tmckay | biab | 22:12 |
| vgridnev | probably ":" addition is unneeded there | 22:15 |
| *** egafford has quit IRC | 22:20 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: [CDH] Fix problem with launching Spark jobs https://review.openstack.org/220500 | 22:25 |
| *** vgridnev has quit IRC | 22:34 | |
| *** egafford has joined #openstack-sahara | 23:10 | |
| *** witlessb has quit IRC | 23:11 | |
| *** jamielennox is now known as jamielennox|away | 23:13 | |
| openstackgerrit | Merged openstack/sahara: [sahara doc fix] update the statuses.rst in userdoc https://review.openstack.org/218925 | 23:45 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!