Friday, 2014-09-12

*** alazarev has quit IRC00:00
*** ViswaV has joined #openstack-sahara00:03
*** julienvey has joined #openstack-sahara00:06
*** RockKuo_Office has joined #openstack-sahara00:09
*** julienvey has quit IRC00:11
*** ViswaV has quit IRC00:17
*** alazarev has joined #openstack-sahara00:19
openstackgerritA change was merged to openstack/sahara: Install non deprecated DB for Cloudera Manager  https://review.openstack.org/11750101:07
*** julienvey has joined #openstack-sahara01:07
*** julienvey has quit IRC01:12
*** shakamunyi has joined #openstack-sahara01:16
*** shakamunyi has quit IRC01:24
*** shakamunyi has joined #openstack-sahara01:31
*** alazarev has quit IRC01:44
*** bradd1 has joined #openstack-sahara01:50
*** hochi has joined #openstack-sahara01:59
*** ViswaV has joined #openstack-sahara02:04
*** julienvey has joined #openstack-sahara02:08
*** ViswaV_ has joined #openstack-sahara02:11
*** julienvey has quit IRC02:12
*** ViswaV has quit IRC02:14
*** sunrenjie6 has joined #openstack-sahara02:26
*** bradd1 has quit IRC02:37
*** julienvey has joined #openstack-sahara03:08
*** derekr has left #openstack-sahara03:10
*** julienvey has quit IRC03:13
*** shakamunyi has quit IRC03:22
*** ViswaV_ has quit IRC03:24
*** chandankumar has joined #openstack-sahara03:44
*** chandankumar has quit IRC03:54
*** alazarev has joined #openstack-sahara04:02
*** julienvey has joined #openstack-sahara04:09
*** julienvey has quit IRC04:13
*** chandankumar has joined #openstack-sahara04:14
*** alazarev has quit IRC04:24
*** alazarev has joined #openstack-sahara04:38
openstackgerritchandan kumar proposed a change to openstack/sahara: Default value of 'global/namenode_opt_maxnewsize' should be 200m  https://review.openstack.org/12078604:38
*** julienvey has joined #openstack-sahara04:38
*** witlessb_ has joined #openstack-sahara04:39
*** julienvey has quit IRC04:40
*** julienvey has joined #openstack-sahara04:41
*** witlessb has quit IRC04:42
*** witlessb_ is now known as witlessb04:42
*** alazarev has quit IRC04:49
*** alazarev has joined #openstack-sahara04:50
*** ViswaV has joined #openstack-sahara04:51
*** julienvey has quit IRC04:51
*** julienvey has joined #openstack-sahara04:52
*** julienvey has quit IRC04:56
*** julienvey has joined #openstack-sahara05:00
*** julienvey has quit IRC05:05
openstackgerritA change was merged to openstack/sahara: Added missed translation for service.edp.spark  https://review.openstack.org/12009005:28
*** hochi has quit IRC05:28
*** akuznetsov has quit IRC05:29
*** alazarev has quit IRC05:45
*** chandankumar has quit IRC05:45
*** akuznetsov has joined #openstack-sahara05:53
*** hochi has joined #openstack-sahara05:59
*** ViswaV has quit IRC06:00
*** sunrenjie6 has quit IRC06:04
*** RockKuo_Office has quit IRC06:09
*** ViswaV has joined #openstack-sahara06:13
*** ViswaV has quit IRC06:38
*** k4n0 has joined #openstack-sahara06:45
*** Longgeek has joined #openstack-sahara06:47
*** tnovacik has joined #openstack-sahara06:58
*** bradd1 has joined #openstack-sahara06:58
*** RockKuo_Office has joined #openstack-sahara07:01
*** akuznetsov has quit IRC07:05
*** akuznetsov has joined #openstack-sahara07:07
*** akuznetsov has quit IRC07:12
*** tnovacik has quit IRC07:13
*** akuznetsov has joined #openstack-sahara07:17
*** akuznetsov has quit IRC07:19
*** akuznetsov has joined #openstack-sahara07:20
*** chandankumar has joined #openstack-sahara07:23
*** akuznetsov has quit IRC07:23
*** akuznetsov has joined #openstack-sahara07:35
*** akuznetsov has quit IRC07:36
*** akuznetsov has joined #openstack-sahara07:37
*** akuznetsov has quit IRC08:03
*** akuznetsov has joined #openstack-sahara08:04
*** akuznetsov has quit IRC08:05
*** tnovacik has joined #openstack-sahara08:09
*** tnovacik has quit IRC08:10
*** tnovacik has joined #openstack-sahara08:10
*** akuznetsov has joined #openstack-sahara08:11
*** bradd1 has quit IRC08:25
*** Ch00k has joined #openstack-sahara09:02
*** hochi_ has joined #openstack-sahara09:33
*** hochi has quit IRC09:35
*** Ch00k has quit IRC09:38
openstackgerritKazuki OIKAWA proposed a change to openstack/sahara-extra: Add checkstyle target  https://review.openstack.org/12104009:49
openstackgerritSergey Reshetnyak proposed a change to openstack/sahara: Fix using cinder volumes with nodemanager in HDP2  https://review.openstack.org/12104209:49
*** akuznetsov has quit IRC09:55
*** akuznetsov has joined #openstack-sahara10:00
*** akuznetsov has quit IRC10:07
*** hochi_ has quit IRC10:11
openstackgerritVitaly Gridnev proposed a change to openstack/sahara: Sahara-Dashboard docs updated  https://review.openstack.org/12004510:16
*** _mattf is now known as mattf10:53
*** RockKuo_Office has quit IRC11:01
openstackgerritAndrey Pavlov proposed a change to openstack/sahara: Fixed terminate_unneeded_clusters fail in distributed mode  https://review.openstack.org/11775011:17
*** Longgeek has quit IRC11:45
*** Longgeek has joined #openstack-sahara11:46
openstackgerritchandan kumar proposed a change to openstack/sahara: Fixed the localrc file for enabling swift services.  https://review.openstack.org/12106011:47
*** Longgeek has quit IRC11:48
*** Longgeek has joined #openstack-sahara11:51
*** Longgeek_ has joined #openstack-sahara11:53
*** Longgeek has quit IRC11:56
*** _crobertsrh is now known as crobertsrh12:05
*** Ch00k has joined #openstack-sahara12:16
*** Ch00k has quit IRC12:17
*** Ch00k_ has joined #openstack-sahara12:17
*** Ch00k has joined #openstack-sahara12:21
*** Ch00k_ has quit IRC12:21
openstackgerritA change was merged to openstack/sahara: Imported Translations from Transifex  https://review.openstack.org/12070212:30
*** Ch00k has quit IRC12:43
*** Ch00k has joined #openstack-sahara12:45
*** chandankumar has quit IRC12:47
*** akuznetsov has joined #openstack-sahara12:52
*** akuznetsov has quit IRC12:55
*** akuznetsov has joined #openstack-sahara12:56
openstackgerritKazuki OIKAWA proposed a change to openstack/sahara-extra: Add checkstyle target  https://review.openstack.org/12104012:57
*** Ch00k has quit IRC12:58
*** tmckay has quit IRC13:02
*** akuznetsov has quit IRC13:03
openstackgerritVitaly Gridnev proposed a change to openstack/sahara-specs: Added specification for adding event log  https://review.openstack.org/11905213:08
openstackgerritVitaly Gridnev proposed a change to openstack/sahara: Sahara-Dashboard docs updated  https://review.openstack.org/12004513:21
*** bradd1 has joined #openstack-sahara13:49
*** Ch00k has joined #openstack-sahara13:52
openstackgerritA change was merged to openstack/sahara: Migrate to oslo.serialization  https://review.openstack.org/12007913:57
*** tmckay has joined #openstack-sahara14:07
*** Ch00k has quit IRC14:08
*** akuznetsov has joined #openstack-sahara14:25
*** alazarev has joined #openstack-sahara14:35
*** Longgeek_ has quit IRC14:39
openstackgerritAndrew Lazarev proposed a change to openstack/sahara: Enabled check for non-critical issues in pylint  https://review.openstack.org/12083714:45
openstackgerritAndrew Lazarev proposed a change to openstack/sahara: Enabled check for non-critical issues in pylint  https://review.openstack.org/12083714:45
openstackgerritA change was merged to openstack/sahara: Renamed missing 'savanna' tags to 'sahara'  https://review.openstack.org/11996014:46
*** bradd1 has left #openstack-sahara14:53
*** ViswaV has joined #openstack-sahara14:53
SergeyLukjanovelmiko, tmckay, yay! trust-related stuff merged!14:59
elmikoSergeyLukjanov: woot =D14:59
tmckayyay!  That was a long road14:59
elmikoSergeyLukjanov: once we get the docs, ui, and hadoop-swift, we should consider closing the bug as well15:00
elmikoat some point, i'd like to talk about setting up integration/gate tests for the proxy domains, but that will require some reconfiguration of those stacks.15:01
tmckaySergeyLukjanov, alazarev, if we can get another +2 on https://review.openstack.org/#/c/119767/ (doc for proxy user) we can merge that too15:01
SergeyLukjanovelmiko, we could re-configure one of the jobs on sahara-ci I think to check it15:02
alazarevSergeyLukjanov: done15:02
elmikoSergeyLukjanov: cool15:02
SergeyLukjanovfolks, I'll be in CA starting from the Sept 17, so, more time for a day time collaboration :)15:03
elmikonice15:03
tmckayalazarev, thanks.  I think that's all the "sahara" project trust CRs15:03
alazarevtmckay: no changes in python client required for that, right?15:05
alazarevSergeyLukjanov: could you please take another look at https://review.openstack.org/#/c/117029/ ?15:06
tmckayelimiko, ^^, I don't think so15:06
SergeyLukjanovtmckay, alazarev, I think we don't need any changes for client due to the option username/password15:06
elmikotmckay, alazarev, no changes to python client15:06
tmckayyeah, username and password are just missing, and validation has been updated15:06
elmikocorrect15:07
elmikoseparate topic, are we going to update the client to accept v3 Keystone?15:07
tmckayelmiko, oh, design summit -- we still need a method for credentials with spark/swift15:07
tmckayI'll add something15:07
elmikotmckay: yea15:08
*** Longgeek has joined #openstack-sahara15:08
elmikoSergeyLukjanov, tmckay, alazarev, would it be appropriate for me to create a spec about updating saharaclient to use v3 Keystone, or is there a different process for this?15:09
alazarevelmiko: I think spec is good15:10
elmikook, cool. i wasn't sure if there was any special process for the client15:10
*** ViswaV has quit IRC15:13
SergeyLukjanovelmiko, spec is good - we have a dir in specs repo for client specs15:24
elmikoSergeyLukjanov: ack, thanks15:24
*** Longgeek has quit IRC15:24
openstackgerritA change was merged to openstack/sahara-extra: Adding /etc/ dir to location of edp-examples to reflect reality  https://review.openstack.org/12086915:34
*** alazarev has quit IRC15:56
*** alazarev has joined #openstack-sahara16:02
openstackgerritA change was merged to stackforge/sahara-ci-config: Use mirrors for CDH plugin  https://review.openstack.org/12043416:06
*** ViswaV has joined #openstack-sahara16:20
*** ViswaV_ has joined #openstack-sahara16:21
drssI saw mention that there might have been a plan to add support for apache storm for Juno, is that the case, and if so is there any documentation available?16:23
elmikodrss: yes, it has been worked on. i'll dig up the blueprint16:24
elmikodrss: https://blueprints.launchpad.net/sahara/+spec/storm-integration16:24
drsselmiko: great, thank you!16:24
elmikonp =)16:24
*** ViswaV has quit IRC16:25
*** Longgeek has joined #openstack-sahara16:25
openstackgerritchandan kumar proposed a change to openstack/sahara: Fixed the localrc file for enabling swift services  https://review.openstack.org/12106016:27
*** Longgeek has quit IRC16:30
*** k4n0 has quit IRC16:40
*** mattf is now known as _mattf16:40
*** ViswaV_ has quit IRC16:55
*** ViswaV has joined #openstack-sahara17:01
*** tmckay has left #openstack-sahara17:19
*** shar has joined #openstack-sahara18:01
*** alazarev has quit IRC18:02
*** tmckay has joined #openstack-sahara18:14
*** Longgeek has joined #openstack-sahara18:15
*** Longgeek has quit IRC18:19
*** tmckay has left #openstack-sahara18:28
*** tmckay has joined #openstack-sahara18:33
*** _mattf is now known as mattf18:45
elmikotmckay, crobertsrh, if i want to see how a default-cluster.template is used, do i need to create the cluster and then get it's json representation to see those values?18:50
crobertsrhWhere is the default-cluster.template?18:50
crobertsrhI suppose that's one way of seeing what it looks like.  I've never dealt with a default-cluster-template18:51
elmikofor example plugins/hdp/versions/version_1_3_2/resources/default-cluster.template18:51
elmikothat's the template that get's filled in, but then i'm wondering how would i double check it?18:51
elmikodo i just hit http://sahara/v1.1/tenant/cluster/id to see it?18:52
crobertsrhI think that would work18:52
elmikohere goes nothing =)18:53
*** tnovacik has quit IRC18:54
*** balles has quit IRC19:21
elmikooh well, that didn't quite work19:34
*** tmckay has quit IRC19:38
*** shar has quit IRC19:39
*** tmckay has joined #openstack-sahara19:39
*** tmckay has left #openstack-sahara19:40
*** tmckay has joined #openstack-sahara19:42
dmitrymehey elmiko, probably I can clarify, but I don’t quite understand your question :-)19:48
*** Ch00k has joined #openstack-sahara19:49
elmikodmitryme: hey19:49
elmikowell, i want to ensure that one of the configurations in the hdp default-cluster.template is getting filled in properly. how could i check that?19:50
dmitrymethat is what I don’t understand: the file you are refering to is a static resource file in Sahara19:51
elmikoi'm working on https://bugs.launchpad.net/sahara/+bug/1260835 and i want to make sure that i fill in ZOOKEEPER_HOST correctly19:51
dmitrymeaha, I see19:51
elmikoshouldn't those configuration options appear in cluster_configs if i hit the /clusters endpoint?19:52
dmitrymeI think you should get them if you access /plugins/hdp/<version> endpoint19:56
elmikook, thanks, i'll give that a try19:57
elmikodmitryme: ok, that works for the default values. is there a way to check once the template has been filled in?20:01
dmitrymeelmiko: yep, just define a cluster template in UI. While filling in the template, edit the config you wish20:02
dmitrymeafter that access the created template via /cluster_templates/<id>20:02
dmitrymeif you create cluster from that template, it will inherit the cluster_configs from the template20:03
elmikohmm, maybe i'm doing it wrong then. i tried that but cluster_configs is always coming up []20:07
dmitrymeok, can you explain what do you do?20:08
dmitrymeI mean, in details20:08
elmikook, i start by making node group templates in horizon, then create a cluster template, then launch the cluster.20:08
elmikoafter it is active, i hit /clusters/id20:08
elmikoif i'm reading the code correctly, it should fill in the ZOOKEEPER_HOST value with the ip of the zk node20:09
elmikodmitryme: i'm gonna try one more time, maybe i missed something20:11
dmitrymeelmiko: nope, it should not if I understand it correcly, the values in the file are just defaults.20:13
dmitrymewe don’t show them in cluster_configs, unless user explicitly defined them20:13
openstackgerritA change was merged to openstack/sahara: Add use of nova_kwargs for nova servers create to improve readability  https://review.openstack.org/11905120:13
elmikoso it doesn't actually use the ZOOKEEPER_HOST ip?20:14
crobertsrhAnyone seen this while trying to start a spark cluster?  http://paste.openstack.org/show/110790/20:14
crobertsrhIt's on a slightly slower machine than my main laptop, but I have no problems with hadoop clusters on it.20:15
elmikocrobertsrh: haven't seen that one20:15
crobertsrhIt's with a freshly created image.  I'll try it on my faster machine to hopefully avoid the timeout.20:15
crobertsrhI suppose it could also be my networking....neutron on the "bad" machine vs nova on my main machine.20:17
elmikolol, always blaming it on neutron...20:17
*** Ch00k has quit IRC20:19
*** tmckay has quit IRC20:38
elmikodmitryme: think i see part of the problem, these values i want only get executed for webhcat and hbase. i need to figure out how to enable them. at the least though the tests pass lol.20:49
dmitrymeelmiko: sorry, I got distracted20:50
elmikodmitryme: no problem, i've just been working on the tests. i figure if they pass i'm close =)20:50
crobertsrhLooks like the image works fine on my "fast" machine.  I'll try to see if I can bump up whatever is timing out.20:51
*** tmckay has joined #openstack-sahara20:54
dmitrymeelmiko: ok, it is my understanding that these configs do exists in the cluster, but they are not shown to the user20:54
dmitrymeI mean the one like ‘hbase.zookeeper.quorum’20:54
elmikodmitryme: that makes sense20:54
*** mattf is now known as _mattf20:55
dmitrymeif you grep ZOOKEEPER_HOST in sahara/plugins/hdp/versions/version_1_3_2/services.py , you will see places where it is substituted with the actual value20:56
elmikoi did that, i'm basically just replacing the values and making sure the tests pass.20:56
elmikoi was hoping to setup a cluster and confirm that the values are getting to the cluster, but maybe it's not necessary.20:56
dmitrymemy suggestion would be to deploy HDP with HBase and check that ‘hbase.zookeeper.quorum’ is set to the right value in hbase-site.xml20:57
elmikook, thanks. i'll give that a try20:58
dmitrymesure you will have to deploy that cluster with several zookeepers20:58
elmikoyea20:58
openstackgerritAndrew Lazarev proposed a change to openstack/sahara: Added information about sahara settings to cluster  https://review.openstack.org/11702921:03
*** crobertsrh is now known as _crobertsrh21:05
openstackgerritAndrew Lazarev proposed a change to openstack/sahara: Added information about sahara settings to cluster  https://review.openstack.org/11702921:08
*** ViswaV has quit IRC21:24
openstackgerritA change was merged to openstack/python-saharaclient: Sync oslo strutils module  https://review.openstack.org/12075121:34
*** sballe__ has joined #openstack-sahara21:37
*** sballe_ has quit IRC21:43
*** ViswaV has joined #openstack-sahara21:45
*** tmckay has quit IRC21:49
*** Longgeek has joined #openstack-sahara21:52
openstackgerritA change was merged to openstack/sahara: CDH manager-node flavor change  https://review.openstack.org/11937321:52
*** Longgeek has quit IRC21:56
*** akuznets_ has joined #openstack-sahara22:15
*** ViswaV_ has joined #openstack-sahara22:15
*** ylobankov_ has joined #openstack-sahara22:16
*** akuznetsov has quit IRC22:18
*** ylobankov has quit IRC22:18
*** _mattf has quit IRC22:18
*** drss_ has joined #openstack-sahara22:20
*** boris-42_ has joined #openstack-sahara22:22
*** openstack has joined #openstack-sahara23:36
*** sendak.freenode.net sets mode: +ns 23:36
*** sendak.freenode.net sets mode: -o openstack23:42
-sendak.freenode.net- *** Notice -- TS for #openstack-sahara changed from 1410565010 to 139419831423:42
*** sendak.freenode.net sets mode: +ct-s 23:42
*** ekarlso- has joined #openstack-sahara23:42
*** openstackgerrit has joined #openstack-sahara23:42
*** drss has joined #openstack-sahara23:42
*** ghenriks has joined #openstack-sahara23:42
*** ylobankov has joined #openstack-sahara23:42
*** witlessb has joined #openstack-sahara23:42
*** boris-42 has joined #openstack-sahara23:42
*** juice has joined #openstack-sahara23:42
*** akuznets_ has joined #openstack-sahara23:42
*** sballe__ has joined #openstack-sahara23:42
*** elmiko has joined #openstack-sahara23:42
*** miqui has joined #openstack-sahara23:42
*** oikawa has joined #openstack-sahara23:42
*** tellesnobrega has joined #openstack-sahara23:42
*** _crobertsrh has joined #openstack-sahara23:42
*** dmitryme has joined #openstack-sahara23:42
*** zhiyan has joined #openstack-sahara23:42
*** SergeyLukjanov has joined #openstack-sahara23:42
*** mikehn has joined #openstack-sahara23:42
*** NikitaKonovalov has joined #openstack-sahara23:42
*** ruhe has joined #openstack-sahara23:42
*** aignatov has joined #openstack-sahara23:42
*** anteaya has joined #openstack-sahara23:42
*** venza has joined #openstack-sahara23:42
*** sendak.freenode.net changes topic to "launchpad openid is down. login to openstack services will fail until launchpad openid is happy again"23:42
*** drss has quit IRC23:59
*** drss has joined #openstack-sahara23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!