Friday, 2014-09-26

*** julienvey has quit IRC00:10
*** ViswaV_ has quit IRC00:28
*** jodah_ is now known as jodah00:56
*** jodah is now known as jodah_01:17
*** newuser has left #openstack-sahara01:28
*** bradd1 has joined #openstack-sahara01:34
*** hochi has joined #openstack-sahara02:03
*** julienvey has joined #openstack-sahara02:11
*** julienvey has quit IRC02:16
*** bradd1 has quit IRC02:32
*** julienvey has joined #openstack-sahara02:36
*** jodah_ is now known as jodah02:40
*** julienvey has quit IRC02:41
*** jodah is now known as jodah_02:44
*** julienvey has joined #openstack-sahara02:59
*** jodah_ is now known as jodah03:02
*** jodah is now known as jodah_03:03
*** alazarev has joined #openstack-sahara03:04
*** julienvey has quit IRC03:05
*** bradd1 has joined #openstack-sahara03:32
*** bradd1 has quit IRC03:32
*** zhiyan has quit IRC03:54
*** zhiyan has joined #openstack-sahara03:57
*** alazarev has quit IRC04:20
*** akuznetsov has quit IRC04:45
*** akuznetsov has joined #openstack-sahara04:47
*** julienvey has joined #openstack-sahara05:00
*** hochi has quit IRC05:03
*** julienvey has quit IRC05:05
*** hochi has joined #openstack-sahara05:17
*** vdreamarkitex has quit IRC05:37
*** juice has quit IRC06:28
*** uvirtbot has quit IRC06:28
*** SergeyLukjanov has quit IRC06:29
*** juice has joined #openstack-sahara06:35
*** SergeyLukjanov has joined #openstack-sahara06:35
*** k4n0 has joined #openstack-sahara06:37
*** uvirtbot has joined #openstack-sahara06:43
*** Longgeek has joined #openstack-sahara06:49
*** coolsvap|afk is now known as coolsvap06:55
*** julienvey has joined #openstack-sahara07:01
*** julienvey has quit IRC07:05
*** boris-42 has quit IRC07:15
*** skolekonov has joined #openstack-sahara07:23
*** tnovacik_ has joined #openstack-sahara07:33
*** tnovacik has joined #openstack-sahara07:34
*** IvanBerezovskiy has joined #openstack-sahara08:30
*** Longgeek has quit IRC08:31
*** Longgeek has joined #openstack-sahara08:35
*** tnovacik has quit IRC08:35
*** witlessb has joined #openstack-sahara08:51
*** witlessb has quit IRC08:52
*** witlessb has joined #openstack-sahara08:52
*** julienvey has joined #openstack-sahara08:59
*** Longgeek has quit IRC09:38
*** Longgeek has joined #openstack-sahara09:42
*** Longgeek has quit IRC10:11
*** hochi has quit IRC10:15
*** Longgeek has joined #openstack-sahara10:17
*** skolekonov has quit IRC10:46
zigoelmiko: FYI, I have uploaded Sahara already, it's currently in the FTP masters NEW queue...10:49
zigo<sarcastic>Hopefully, it's going to be approved before the end of the year...</sarcastic>10:49
*** skolekonov has joined #openstack-sahara10:57
*** Longgeek has quit IRC11:15
*** Longgeek has joined #openstack-sahara11:29
*** tosky has joined #openstack-sahara11:43
*** k4n0 has quit IRC11:46
*** vdreamarkitex has joined #openstack-sahara12:17
openstackgerritPierre Padrixe proposed a change to openstack/sahara-specs: Add specs for isolated development environment using Vagrant+Devstack  https://review.openstack.org/12371012:23
elmikozigo: that's great, although not so much about the queue... ;)12:34
*** coolsvap is now known as coolsvap|afk12:44
openstackgerritAdrien Vergé proposed a change to openstack/sahara: Support Cinder API version 2  https://review.openstack.org/12306812:46
*** _crobertsrh is now known as crobertsrh13:10
*** stannie has joined #openstack-sahara13:11
*** tnovacik has joined #openstack-sahara13:14
zigoelmiko: It's also available *now* form my Wheezy backport repostiory, just like for all I do...13:33
elmikocool13:34
elmikozigo: there was someone in here yesterday asking about ubuntu support for Sahara. i wasn't aware of what efforts where underway in that arena, but i figured i'd mention your work because the deb packages should work on ubuntu if all else fails, i hope...13:35
*** tnovacik has quit IRC13:48
*** bradd1 has joined #openstack-sahara13:59
*** alazarev has joined #openstack-sahara14:24
*** sreshetnyak has joined #openstack-sahara14:39
*** julienvey has quit IRC15:00
*** julienvey has joined #openstack-sahara15:00
*** julienvey has quit IRC15:01
*** julienve_ has joined #openstack-sahara15:01
*** Longgeek has quit IRC15:07
openstackgerritChad Roberts proposed a change to openstack/sahara: Adding job execution examples to UI user guide  https://review.openstack.org/12444015:18
*** anteaya has quit IRC15:23
*** alazarev has quit IRC15:23
*** IvanBerezovskiy has left #openstack-sahara15:32
SergeyLukjanovfolks15:39
SergeyLukjanovI need help to fix doc bugs15:39
SergeyLukjanovwe have time till Monday evening15:39
SergeyLukjanovI've been wrong that we could merge docs after rc115:39
SergeyLukjanovit should be final except super critical regressions15:40
SergeyLukjanovso, we have open doc bugs at https://launchpad.net/sahara/+milestone/juno-rc115:40
SergeyLukjanovtmckay, crobertsrh, alazarev15:40
elmiko=(15:40
dmitrymeSergeyLukjanov: oops15:40
crobertsrhack....just submitted a patch for one of them.15:41
elmikoSergeyLukjanov: ack15:41
dmitrymeme also ack, I have one on me15:41
tmckayok, back in a bit, I'll review/fix15:43
elmikofor https://bugs.launchpad.net/sahara/+bug/1373066 do we want to drop the Folsom/Grizzly language?15:43
uvirtbotLaunchpad bug 1373066 in sahara "[DOC] Hadoop-Swift page is outdated" [Low,Triaged]15:43
SergeyLukjanovelmiko, I think so15:43
SergeyLukjanovso, folks, please, assign bugs on you15:44
openstackgerritChad Roberts proposed a change to openstack/sahara: Adding job execution examples to UI user guide  https://review.openstack.org/12444015:47
*** julienve_ has quit IRC15:48
crobertsrhIs there anyone around with experience with the Cloudera plugin?  If not, I can go into learning mode to fill out the docs.15:55
stanniehi guys15:55
stanniecrobertsrh: I was trying to find documentation to learn about it15:55
elmikohi stannie15:56
elmikocrobertsrh: not me15:56
crobertsrhGood luck stannie :)15:56
stanniewas about to take this doc task about adding cloudera in the availability matrix15:56
stannieseemed a rapid task to be done, before leaving the office for the weekend ;)15:57
crobertsrhAbsolutely stannie, go for it!15:57
crobertsrhI'll go and have lunch instead of looking up cloudera stuff :)15:57
elmikothis patch has been merged to upstream Hadoop? https://issues.apache.org/jira/browse/HADOOP-854515:58
*** skolekonov has quit IRC15:58
stannieBon appetit crobertsrh, I am working on it :)16:05
openstackgerritPierre Padrixe proposed a change to openstack/sahara: Add CDH plugin in plugin availability matrix (userdoc)  https://review.openstack.org/12445716:17
openstackgerritPierre Padrixe proposed a change to openstack/sahara: Add CDH plugin in plugin availability matrix (userdoc)  https://review.openstack.org/12445716:18
*** alazarev has joined #openstack-sahara16:34
*** anteaya has joined #openstack-sahara16:34
*** bradd1 has left #openstack-sahara16:49
openstackgerritPierre Padrixe proposed a change to openstack/sahara: Add CDH plugin in plugin availability matrix (userdoc)  https://review.openstack.org/12445716:50
*** stannie has quit IRC16:53
*** saurabhs has joined #openstack-sahara17:12
crobertsrhIs https://bugs.launchpad.net/sahara/+bug/1356053 truly critical?  Looks like it was punted to k1.  Do we plan to change from data_processing to data-processing to fix this, or is there something else that can be done?17:13
uvirtbotLaunchpad bug 1356053 in sahara "Doesn't properly get keystone endpoint when Keystone is configured to use templated catalog" [Critical,New]17:13
elmikogood question17:14
tmckaycrobertsrh, hmmm.  I wonder if there are any compat issues.  We could make sahara look for data_processing and failing that look for data-processing, then change the naming next release17:24
tmckaywhen I run my own dev instance, I add a "data_processing" endpoint with a script.17:25
tmckaydoh, that would mean a change to the client, maybe ^^  crobertsrh, elmiko, it seems to me like we should check keystone docs for expected endpoint forms.  Maybe there is a rule for this.17:27
crobertsrhI also use local.sh to create data_processing17:28
*** ViswaV has joined #openstack-sahara17:28
crobertsrhI don't think I ever found a rule for it (I recall talking with the bug reporter when he was having troubles).17:29
tmckaytrouble is, according to the note in the linked doc, if you use a static file you can't use the API to add the endpoint17:29
crobertsrhWe did find the line in keystone that explicitly does the substitution though17:29
tmckayso you're kind of  hosed.  API lets you create "_" for type, but static file doesn't17:29
tmckayseems to me like keystone is broken, not Sahara17:29
crobertsrhThat's my thought17:29
crobertsrhI suppose we could file a bug there (or at least check to see if anyone else has)17:29
tmckaykeystone is inconsistent, next.  If you must use static files, then hack saharaclient and dashboard, or hack keystone.  My two cents17:30
tmckayack17:30
crobertsrhoooh, somebody has angered tmckay today :)17:30
tmckayeje lessons17:31
crobertsrhI have a hard time calling this a "critical" bug when 1) it might not even be ours and 2) we're punting it to K anyway17:31
tmckaycrobertsrh, it does seem like we need a little digging on keystone to figure out the right approach for fixing.17:31
crobertsrhagree17:31
tmckayagreed.  And there is a known workaround17:31
tmckaycrobertsrh, did you comment on that bug?  "Is this an issue with Sahara, or keystone?17:34
crobertsrhI could17:34
crobertsrhshould?17:34
tmckayone of us should17:34
tmckayrock paper scissors?17:34
tmckayyou go first17:34
crobertsrhScissors17:34
tmckaypaper, I guess it's you :)17:35
crobertsrhwell met17:35
tmckaylol17:35
elmikoi have been investigating saharaclient and it's authentication methods, and i think there might be some corner case bugs in there. i've been making notes, but i think the ideas i have will be more a blueprint than bug report.17:36
elmikoso, i'm not surprised about endpoint inconsistencies17:36
elmikook, really going to lunch now17:37
crobertsrhBetter hurry before dinner is ready17:37
elmikoseriously...17:37
*** sballe_ has joined #openstack-sahara17:59
crobertsrhAny chance anyone has managed to launch a cdh plugin cluster?18:07
tmckayI haven't tried for a long time18:08
crobertsrhnm...I found the cm_api package that I think I needed18:09
crobertsrhLooks like it's an extra step to install that18:09
*** tosky has quit IRC18:13
tmckayelmiko, doh.  Looks like the EDP userdoc needs to be updated re swift credentials18:19
tmckayhttp://docs.openstack.org/developer/sahara/userdoc/edp.html18:19
tmckayI guess we have both cases, the old stuff and the new stuff18:19
*** ViswaV has quit IRC18:20
tmckayelmiko, I'm assuming there is no outstanding bug/CR for it (but I might have missed it)18:20
*** ViswaV has joined #openstack-sahara18:21
*** tmckay is now known as tmckay_brb18:23
tmckay_brbelmiko, if you agree and there is no current work on this, I'll add a bug to update the EDP page re swift18:28
tmckay_brbwe can collaborate18:29
*** alazarev has quit IRC18:37
*** stannie has joined #openstack-sahara18:39
openstackgerritPierre Padrixe proposed a change to openstack/sahara-specs: Add specs for isolated development environment using Vagrant+Devstack  https://review.openstack.org/12371018:39
elmikotmckay_brb: yea, looks like it needs updating18:43
crobertsrhshould the default sahara config include the cdh and spark plugins?18:51
*** alazarev has joined #openstack-sahara18:52
elmikohmmm, currently it doesn't but i'm not sure what the correct thing to do is. my guess is no because they are still slightly on the edge.18:53
crobertsrhOk.  I was assuming that was why they aren't there.  Just making sure we want to release Juno that way.18:57
crobertsrhI constantly get burned when I fire-up my devstack and go to run a spark cluster :)18:58
elmikoit's a good question, probably best to garner more opinion18:58
crobertsrhyes.  Sadly it's Friday afternoon and I suspect many people are long gone :)  I'll try to remember for next week.19:03
elmikolol, yea. in that case going with what is already default is probably ok.19:07
*** ViswaV has quit IRC19:07
*** ViswaV has joined #openstack-sahara19:12
tmckay_brbYeah, I think other timezones are sleeping, attending parties, concerts, etc19:18
*** tmckay_brb is now known as tmckay19:18
elmikoparties?19:23
tmckayelmiko, sure, why not?19:24
tmckayelmiko, I'll add a bug for EDP doc swift updates19:24
elmikono reason, i just want in on the party =)19:24
crobertsrhtmckay is a party animal, so naturally he assumes we all are19:24
tmckayah, I see ;-)19:24
tmckaylol19:25
elmikotmckay: yea, i think it's good to at least mention that optionally creds aren't needed if proxy/domain is used.19:25
tmckayelmiko, I'll try to write it up based on your spec/impl but it will need review :)19:25
* tmckay pulls up the Juno schedule to see how much time we've got for doc bugs19:26
*** boris-42 has joined #openstack-sahara19:27
* crobertsrh finally discovered ram_allocation_ratio...cancels order for 128GB server.19:27
elmikotmckay: for sure, we probably don't need an extended discourse about proxy/domain in the edp docs. if need be put a link back to the advanced config docs.19:28
tmckayack19:28
*** alazarev has quit IRC19:29
crobertsrhelmiko:  How about if I add some notes to the alternatives (swift w/proxy, HDFS) in the dashboard user guide?  Once I can make the magic happen, I'll add an example that uses it as well.19:39
*** alazarev has joined #openstack-sahara19:40
elmikocrobertsrh: i made some comments on the review, i think it might be ok just to mention that the Swift credentials are optional based on the proxy domain stuff.19:41
crobertsrhRight.  I was aiming to make the examples themselves the shortest possible route (given a likely default setup).  I'll add a note about optional credentials at the bottom.19:43
elmikothat being said, more examples are always nice =)19:43
elmikoi was hoping that if we just mention that creds are optional enough times people will start to investigate the option19:43
crobertsrhFair enough :)  I do plan to add more examples as well.19:44
elmikocool19:44
*** bradd1 has joined #openstack-sahara19:45
crobertsrhIs there a page I can link to for the user to get more info on the proxy goodz?19:45
elmikoyes19:46
elmikosec19:46
elmikohttp://docs.openstack.org/developer/sahara/userdoc/advanced.configuration.guide.html19:46
crobertsrhGracias19:47
elmikodanada, i think.. my spanish is very weak19:47
crobertsrhyes19:48
crobertsrhclose enough though19:48
elmikolol19:48
crobertsrhas long as your French is up to heroic levels in another month19:49
elmikoi'm counting on Brooke for that19:49
crobertsrhUn autre tour sur moi19:49
elmikoif you say so19:50
crobertsrhIf I can get a critical mass of people to learn that one, I should be all set19:50
elmikook, what does it mean?19:50
crobertsrh"Another round on me"19:51
elmikolol nice!19:52
openstackgerritMichael McCune proposed a change to openstack/sahara: Updating Hadoop-Swift documentation  https://review.openstack.org/12450620:05
openstackgerritChad Roberts proposed a change to openstack/sahara: Adding job execution examples to UI user guide  https://review.openstack.org/12444020:20
tmckayhmm, do we have pep8 breakage again?20:27
elmikoi hadn't noticed20:28
tmckayyour link images CR got a pep8 error (although it's approved) and I just ran pep8 on master, it tells me that sahara.conf.sample is not up to date20:28
tmckaylooks like it's complaining about some memcache stuff20:29
elmikoi've had it do that before, usually when someone has committed an eroneous change to the .conf.sample file20:35
openstackgerritChad Roberts proposed a change to openstack/sahara: Adding job execution examples to UI user guide  https://review.openstack.org/12444020:38
*** jodah_ is now known as jodah20:40
tmckayelmiko, how do you invoke that again?20:41
tmckaysomething ran but it seemed not to matter20:41
elmikotmckay: tools/config/generate_sample.sh20:43
tmckaythat complains, unless I add -b and -p20:46
openstackgerritAndrew Lazarev proposed a change to openstack/sahara: Fixed broken pep8 after keystone update  https://review.openstack.org/12451120:47
tmckaywell, there you have it20:47
alazarevI’ve added fix for it20:47
elmikolol20:47
tmckaygenerate_sample.sh makes me angry, for some reason it doesn't run without arguments, and when it does it doesn't seem to actually change my local file20:48
elmikotmckay: also, when i run that generate_sample script i usually invoke as `tools/with_venv.sh tools/config/generate_sample.sh`20:48
crobertsrhI activated my venv first, then ran tools/config/generate_sample.sh20:48
alazarevtmckay: just do source .tox/pep8/bin/activate before commands20:49
alazarev“source .tox/pep8/bin/activate”20:49
elmikoyea, i think using the venv is recommended20:49
*** jodah is now known as jodah_20:51
*** jodah_ is now known as jodah20:51
alazarevall projects now considefing removing sample check from pep820:52
alazarevwe can discuss this too20:52
alazarevthis keystone update was the last drop20:53
*** crobertsrh is now known as _crobertsrh20:53
tmckayelmiko, so while we're here.  do you have to modify tools/with_venv.sh to make it work?20:59
tmckayit references $TOOLS/../.venv, but shouldn't that be $TOOS/.tox/.venv20:59
elmikotmckay: i did not21:00
tmckayweird21:00
elmikotry what alazarev suggested, that basically invokes the venv as well21:00
tmckaywell, ../.tox/venv21:00
*** ViswaV has quit IRC21:01
tmckayyeah, I've sourced the activate before for lots of things.  Just wonder why tools seems busted for me21:01
elmikoweird21:01
tmckaybecause I don't have a .venv, I assume21:02
elmikolet me run it and see what happens21:02
*** ViswaV has joined #openstack-sahara21:03
elmikohmm, wonder if it broke or something. i get a failure too21:03
*** ViswaV has quit IRC21:04
*** ViswaV has joined #openstack-sahara21:04
*** tmckay has quit IRC21:06
*** tmckay has joined #openstack-sahara21:07
*** bradd1 has quit IRC21:13
*** jodah is now known as jodah_21:20
*** alazarev has quit IRC21:39
*** akuznetsov has quit IRC21:39
*** ViswaV has quit IRC21:41
*** akuznetsov has joined #openstack-sahara21:41
*** ViswaV has joined #openstack-sahara22:01
*** ViswaV has quit IRC22:02
*** ViswaV_ has joined #openstack-sahara22:03
*** witlessb has quit IRC22:51
*** ViswaV_ has quit IRC23:04
*** ViswaV has joined #openstack-sahara23:04
*** alazarev has joined #openstack-sahara23:30
*** ViswaV has quit IRC23:36
openstackgerritAndrew Lazarev proposed a change to openstack/sahara: [DOC] Changed feature matrix for Spark  https://review.openstack.org/12454423:45
*** alazarev has quit IRC23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!