Wednesday, 2015-03-11

*** bandarji has joined #openstack-sahara00:20
*** devlaps has joined #openstack-sahara01:31
*** tmckay has joined #openstack-sahara01:31
openstackgerritTrevor McKay proposed openstack/sahara: Move cluster template schema definition to is own file  https://review.openstack.org/16233601:36
*** macjack has joined #openstack-sahara01:46
*** witlessb has quit IRC01:47
*** devlaps has quit IRC01:51
openstackgerritTrevor McKay proposed openstack/sahara: Move cluster template schema definition to is own file  https://review.openstack.org/16233602:06
*** tmckay has quit IRC02:12
*** tmckay has joined #openstack-sahara02:12
openstackgerritTrevor McKay proposed openstack/sahara: Add an is_default field to cluster templates and node group templates  https://review.openstack.org/16092002:25
*** coolsvap has joined #openstack-sahara02:29
*** bandarji has quit IRC02:34
openstackgerritChris Buccella proposed openstack/sahara: Update cdh-plugin doc with correct centos user  https://review.openstack.org/16326802:38
openstackgerritlu huichun proposed openstack/sahara: Add a common HBase lib in hdfs on cluster start  https://review.openstack.org/16265702:52
*** hdd_ has quit IRC02:57
*** chandankumar has joined #openstack-sahara03:12
*** Poornima has joined #openstack-sahara03:14
*** coolsvap is now known as coolsvap|afk03:15
*** coolsvap|afk is now known as coolsvap03:22
*** tmckay has left #openstack-sahara03:37
*** Nikolay_St has quit IRC03:51
*** Nikolay_St has joined #openstack-sahara04:37
*** hdd_ has joined #openstack-sahara04:38
*** chandankumar has quit IRC05:17
openstackgerritlu huichun proposed openstack/sahara: Add a common HBase lib in hdfs on cluster start  https://review.openstack.org/16265705:29
openstackgerritNikolay Starodubtsev proposed openstack/sahara: Take back upstream checks for import order  https://review.openstack.org/16302106:09
*** sreshetn1 has joined #openstack-sahara06:32
*** chandankumar has joined #openstack-sahara06:41
openstackgerritSergey Reshetnyak proposed openstack/sahara: Skip job_execution tempest client test  https://review.openstack.org/16296006:53
*** akuznetsov has joined #openstack-sahara06:55
*** Nikolay_St has quit IRC06:57
*** hdd_ has quit IRC06:57
openstackgerritSergey Reshetnyak proposed openstack/sahara: Change imports after moving tempest common code  https://review.openstack.org/16331007:00
*** Poornima has quit IRC07:06
*** Nikolay_St has joined #openstack-sahara07:10
*** tnovacik has joined #openstack-sahara07:21
*** sreshetn1 has quit IRC07:45
*** coolsvap is now known as coolsvap|brb07:54
*** chlong has quit IRC08:01
*** coolsvap|brb is now known as coolsvap08:26
*** Poornima has joined #openstack-sahara08:27
*** witlessb has joined #openstack-sahara08:49
*** sreshetn1 has joined #openstack-sahara08:55
*** Poornima_K has joined #openstack-sahara09:19
*** Poornima_K has quit IRC09:19
*** Poornima_K has joined #openstack-sahara09:19
*** Poornima has quit IRC09:19
*** chandankumar has quit IRC09:32
Nikolay_Sthi all09:34
Nikolay_Stthis change is very important for our client CI: https://review.openstack.org/#/c/163335/09:34
Nikolay_Stand this important for our reviewers: https://review.openstack.org/#/c/163123/ https://review.openstack.org/#/c/163021/ https://review.openstack.org/#/c/162932/09:38
*** chandankumar has joined #openstack-sahara09:45
openstackgerritMerged stackforge/sahara-ci-config: Pin Glance client version  https://review.openstack.org/16315810:06
*** sreshetn1 has quit IRC10:13
*** chlong has joined #openstack-sahara10:23
*** tnovacik has quit IRC10:25
openstackgerritVitaly Gridnev proposed openstack/sahara: Add usages for step_type field  https://review.openstack.org/16299710:31
openstackgerritVitaly Gridnev proposed openstack/sahara: Move updating provision progress to conductor  https://review.openstack.org/15942110:31
openstackgerritDenis Egorenko proposed stackforge/sahara-ci-config: Check tests exit status from log  https://review.openstack.org/16336610:31
openstackgerritDenis Egorenko proposed stackforge/sahara-ci-config: Check tests exit status from log  https://review.openstack.org/16336610:35
*** oikawa has quit IRC10:37
*** chandankumar has quit IRC10:40
*** tosky has joined #openstack-sahara10:42
openstackgerritSergey Lukjanov proposed openstack/sahara-specs: Remove no more needed placeholder in client specs dir  https://review.openstack.org/16337310:54
openstackgerritSergey Lukjanov proposed openstack/sahara-specs: Add Liberty cycle entry/dir to specs repo  https://review.openstack.org/16337410:55
openstackgerritSergey Lukjanov proposed openstack/sahara-specs: Defere "Use trusts for cluster creation and scaling" to Liberty  https://review.openstack.org/16337510:55
openstackgerritMerged openstack/sahara-specs: Migrate to HEAT HOT language  https://review.openstack.org/15592811:04
*** Poornima_K has quit IRC11:10
*** tnovacik has joined #openstack-sahara11:16
*** akuznetsov has quit IRC11:16
openstackgerritVitaly Gridnev proposed openstack/sahara: Apply event-log feature for HDP plugin  https://review.openstack.org/15247211:20
openstackgerritKazuki OIKAWA proposed openstack/sahara-extra: Fix segment object naming that uploaded at qualified URL  https://review.openstack.org/16200511:23
*** vgridnev has quit IRC11:26
openstackgerritSergey Lukjanov proposed openstack/sahara: Migrate to oslo.policy lib instead of copy-pasted oslo-incubator  https://review.openstack.org/16338611:38
*** oikawa has joined #openstack-sahara11:39
openstackgerritMerged openstack/sahara-specs: Remove no more needed placeholder in client specs dir  https://review.openstack.org/16337311:42
openstackgerritMerged openstack/sahara-specs: Add Liberty cycle entry/dir to specs repo  https://review.openstack.org/16337411:42
openstackgerritMerged openstack/sahara-specs: Defere "Use trusts for cluster creation and scaling" to Liberty  https://review.openstack.org/16337511:42
openstackgerritMerged openstack/sahara: Take back upstream checks for commit message  https://review.openstack.org/16293211:42
openstackgerritSergey Lukjanov proposed openstack/sahara-specs: Defere "Two step scaling with Heat engine" to Liberty  https://review.openstack.org/16339412:01
openstackgerritSergey Lukjanov proposed openstack/sahara-specs: Defere "Development Environment Vagrant" to Backlog  https://review.openstack.org/16339512:01
openstackgerritSergey Lukjanov proposed openstack/sahara-specs: Defere "Cluster Suspend and Resume" to Backlog  https://review.openstack.org/16339612:01
openstackgerritMerged stackforge/sahara-ci-config: Check tests exit status from log  https://review.openstack.org/16336612:03
openstackgerritDenis Egorenko proposed stackforge/sahara-ci-config: Temporary set tempest job as non-voting  https://review.openstack.org/16339812:04
*** macjack has quit IRC12:07
openstackgerritMerged openstack/sahara: Skip job_execution tempest client test  https://review.openstack.org/16296012:18
*** sreshetn1 has joined #openstack-sahara12:22
openstackgerritArtem Osadchiy proposed openstack/sahara: Add Hue support for MapR plugin  https://review.openstack.org/14811712:42
*** chandankumar has joined #openstack-sahara12:43
openstackgerritArtem Osadchiy proposed openstack/sahara: Add support for MapR v4.0.2  https://review.openstack.org/16037512:45
openstackgerritMerged openstack/sahara-specs: Defere "Two step scaling with Heat engine" to Liberty  https://review.openstack.org/16339412:49
openstackgerritMerged openstack/sahara-specs: Defere "Development Environment Vagrant" to Backlog  https://review.openstack.org/16339512:49
openstackgerritMerged openstack/sahara-specs: Defere "Cluster Suspend and Resume" to Backlog  https://review.openstack.org/16339612:49
*** tnovacik has quit IRC12:52
*** Nikolay_St has quit IRC12:52
*** crobertsrh has joined #openstack-sahara12:55
*** tnovacik has joined #openstack-sahara12:59
SergeyLukjanovtmckay, elmiko, do you want to chair tomorrow's irc meeting? I have a feeling that alazarev will not be available at this time13:01
openstackgerritChangBo Guo(gcb) proposed openstack/sahara: Leverage dict comprehension in PEP-0274  https://review.openstack.org/16213713:04
SergeyLukjanovtellesnobrega, are you ok with deferring storm edp to liberty?13:07
tellesnobregayes13:15
tellesnobregai wont be able to finish it before13:15
elmikoSergeyLukjanov: i can do that13:16
SergeyLukjanovelmiko, cool, thx13:17
SergeyLukjanovtellesnobrega, okay, thx13:17
*** tmckay has joined #openstack-sahara13:17
*** Longgeek has joined #openstack-sahara13:19
*** tmckay has quit IRC13:19
*** tmckay has joined #openstack-sahara13:20
tellesnobregaSergeyLukjanov, no problem. I will start working on it this week. But I'm busy writing a paper so I'm not sure how much effort i can put into it13:25
SergeyLukjanovtellesnobrega, that's great that you'll have some time to work on it :)13:26
tellesnobregaSergeyLukjanov, :)13:26
openstackgerritSergey Lukjanov proposed openstack/sahara-specs: Defere "Storm EDP" to Liberty  https://review.openstack.org/16342713:27
openstackgerritSergey Lukjanov proposed openstack/sahara-specs: Remove no more needed placeholder from liberty dir  https://review.openstack.org/16342813:27
openstackgerritSergey Lukjanov proposed openstack/sahara-specs: Defere "Decompose cluster template for Heat" to Liberty  https://review.openstack.org/16342913:27
SergeyLukjanovelmiko, tmckay, do you probably know status of https://blueprints.launchpad.net/sahara/+spec/unified-job-interface-map ?13:28
*** chandankumar has quit IRC13:30
* elmiko looks13:30
elmikoSergeyLukjanov: i thought egafford had started it, but i'm not sure where it is currently. tmckay probably knows more13:32
elmikotmckay: ^^^13:32
SergeyLukjanovelmiko, tmckay, egafford, I've deferred it to liberty, if we'll feel like it could fit into the kilo release we could return it back13:35
openstackgerritSergey Lukjanov proposed openstack/sahara-specs: Defere "Unified Map to Define Job Interface" to Liberty  https://review.openstack.org/16343213:35
elmikoSergeyLukjanov: ack, do you have a link for the fpf wiki?13:35
SergeyLukjanovelmiko, working on it now, I've started with deferring non started blueprints13:36
elmikoSergeyLukjanov: ack, thanks =)13:36
SergeyLukjanovelmiko, there are default templates, job types endpoint and your barbican stuff in my head for fpf exceptions13:37
elmikoSergeyLukjanov: sounds about right, and the barbican patch is about to merge13:37
*** akuznetsov has joined #openstack-sahara13:38
tmckaySergeyLukjanov, missed the "bing" from pidgin, reading back13:40
*** Networkn3rd has quit IRC13:41
tmckaySergeyLukjanov, yes, our original thought had been just to get a spec in Kilo.  But, egafford starting implementing.  If it is in liberty, that's fine.  I think it's probably better at this point if egafford helps focus on bugs and documentation and reviews, don't you think?  Which is what I plan to do as soon as I get default-templates and job-type-endpoint done :)13:41
tmckaywe want a bug free release, with perfect docs.  And lots of tests.13:42
tmckayelmiko, thoughts? ^^13:42
elmikotmckay: i guess it depends how far along egafford is with that spec. if he's close i'd say put it up for review. otherwise i agree with you.13:43
*** Longgeek has quit IRC13:43
tmckayelmiko, ack, we can grill him when he shows up13:50
*** Longgeek has joined #openstack-sahara13:55
openstackgerritSergey Reshetnyak proposed openstack/sahara: Change imports after moving tempest common code  https://review.openstack.org/16331013:59
*** tellesnobrega_ has joined #openstack-sahara14:00
tellesnobrega_just found a translation error to portuguese in sahara. When I created a cluster template i got the message Success: Failed to create cluster template "name" in portuguese. I think that it is getting the wrong message in the translation14:02
*** egafford has joined #openstack-sahara14:02
openstackgerritSergey Reshetnyak proposed openstack/sahara: Add transient checks support in scenario tests  https://review.openstack.org/16218114:02
elmikotellesnobrega_: good find, i'm not sure about the process to fix the translations. might want to ask around in openstack-doc14:03
toskytellesnobrega_: messages are on transifex I think, you can check there14:03
tellesnobrega_elmiko, tosky thanks, i will look for it14:03
*** sreshetn1 has quit IRC14:04
toskytellesnobrega_: https://wiki.openstack.org/wiki/Translations/Infrastructure14:04
*** akuznetsov has quit IRC14:04
elmikotosky: nice14:04
tellesnobrega_tosky, thanks14:06
*** Nikolay_St has joined #openstack-sahara14:08
openstackgerritDenis Egorenko proposed stackforge/sahara-ci-config: Temporary set tempest job as non-voting  https://review.openstack.org/16339814:09
tellesnobrega_elmiko, tosky, requested permission to translate. There is so little things translated to portuguese. I will put some effort into it14:11
elmikotellesnobrega_: awesome!14:13
elmikoand obrigado ;)14:13
elmiko(i think)14:13
tellesnobrega_elmiko, de nada (you're welcome. You got obrigado right)14:15
elmiko=)14:15
SergeyLukjanovtmckay, agreed about helping with docs and reviews ;)14:29
*** akuznetsov has joined #openstack-sahara14:29
openstackgerritSergey Reshetnyak proposed openstack/sahara-image-elements: Migrate to openjdk - part 2  https://review.openstack.org/14643414:32
*** Poornima has joined #openstack-sahara14:32
openstackgerritSergey Reshetnyak proposed openstack/sahara-image-elements: Use openjdk by default for java element  https://review.openstack.org/15947314:35
openstackgerritMerged openstack/sahara: Changed heat engine to work with objects  https://review.openstack.org/15761314:40
openstackgerritMerged openstack/sahara-specs: Defere "Storm EDP" to Liberty  https://review.openstack.org/16342714:48
openstackgerritMerged openstack/sahara-specs: Remove no more needed placeholder from liberty dir  https://review.openstack.org/16342814:48
openstackgerritMerged openstack/sahara-specs: Defere "Decompose cluster template for Heat" to Liberty  https://review.openstack.org/16342914:48
openstackgerritVitaly Gridnev proposed openstack/sahara: Implement poll util and plugin poll util  https://review.openstack.org/15739214:52
openstackgerritVitaly Gridnev proposed openstack/sahara: Add usages of poll util for service modules  https://review.openstack.org/16346314:52
*** akuznetsov has quit IRC14:54
openstackgerritMerged openstack/sahara-specs: Defere "Unified Map to Define Job Interface" to Liberty  https://review.openstack.org/16343214:57
openstackgerritVitaly Gridnev proposed openstack/sahara: Update outdated sahara.conf file  https://review.openstack.org/16346514:58
*** chandankumar has joined #openstack-sahara15:00
*** tellesnobrega_ has quit IRC15:07
openstackgerritDenis Egorenko proposed stackforge/sahara-ci-config: Global refactoring of CI scripts  https://review.openstack.org/16210215:12
*** akuznetsov has joined #openstack-sahara15:23
openstackgerritMerged stackforge/sahara-ci-config: Temporary set tempest job as non-voting  https://review.openstack.org/16339815:25
*** hogepodge has quit IRC15:28
openstackgerritSergey Lukjanov proposed openstack/sahara: Migrate to oslo.policy lib instead of copy-pasted oslo-incubator  https://review.openstack.org/16338615:29
*** Nikolay_St has quit IRC15:32
*** sreshetn1 has joined #openstack-sahara15:32
openstackgerritSergey Lukjanov proposed openstack/sahara: Remove the sahara.conf.sample file  https://review.openstack.org/16348815:38
*** Networkn3rd has joined #openstack-sahara15:41
elmikocrobertsrh: guided stuff is working pretty well =)15:41
crobertsrhglad to hear it15:41
elmikocrobertsrh: my one complaint is that it allows you to create a cluster that doesn't validate. but i'm not sure if we can do anything about that15:41
crobertsrhOh, right.  Yeah, sadly, cluster templates don't validate until we try to launch them.15:42
elmikoyea15:42
crobertsrhI don't think the UI would have a reasonable way to implement that just yet15:43
elmikoagreed, but everything looks great so far15:44
*** Longgeek has quit IRC15:45
*** tosky has quit IRC15:48
*** victorfeitosa has joined #openstack-sahara15:49
*** tosky has joined #openstack-sahara15:52
*** coolsvap is now known as coolsvap|afk15:54
*** hdd_ has joined #openstack-sahara15:55
*** egafford1 has joined #openstack-sahara15:56
*** egafford1 has quit IRC15:56
*** egafford has quit IRC15:58
*** tellesnobrega has quit IRC15:58
*** tellesnobrega has joined #openstack-sahara15:59
openstackgerritNikita Konovalov proposed openstack/python-saharaclient: Add support for show_events parameter  https://review.openstack.org/15945116:05
*** witlessb has quit IRC16:06
*** witlessb has joined #openstack-sahara16:08
openstackgerritNikita Konovalov proposed openstack/python-saharaclient: Add support for show_events parameter  https://review.openstack.org/15945116:08
*** victorfeitosa has quit IRC16:12
openstackgerritSergey Kolekonov proposed stackforge/sahara-ci-config: Fix status check procedure  https://review.openstack.org/16351216:14
*** zigo_ has quit IRC16:14
*** zigo_ has joined #openstack-sahara16:14
*** tnovacik has quit IRC16:20
*** tnovacik has joined #openstack-sahara16:22
tmckayalmost 500 line program, that means 100 lines of pep8 errors :)16:36
* tmckay rolls sleeves up16:36
openstackgerritAdrien VergĂ© proposed openstack/sahara: HDP plugin: Fix Beeswax error when starting Hue  https://review.openstack.org/16266816:39
*** Longgeek has joined #openstack-sahara16:45
openstackgerritMerged openstack/sahara: Add Impala service test in cdh plugin integration test  https://review.openstack.org/15193416:46
openstackgerritDenis Egorenko proposed stackforge/sahara-ci-config: Global refactoring of CI scripts  https://review.openstack.org/16210216:49
*** egafford has joined #openstack-sahara16:50
*** openstack has joined #openstack-sahara16:54
*** Longgeek has quit IRC17:02
tellesnobregahey, have any of you guys had any problems when trying to run hadoop's terasort example?17:14
sreshetn1hey, i don't see problems :) terasort works via EDP17:18
*** chlong has quit IRC17:21
openstackgerritTrevor McKay proposed openstack/sahara: Add an is_default field to cluster templates and node group templates  https://review.openstack.org/16092017:24
*** Poornima has quit IRC17:26
tellesnobregasreshetn1, i'm able to submit it, but the nodes are being decommissioned when I run it17:32
sreshetn1what plugin, version and cluster config do you use?17:35
sreshetn1tellesnobrega: ^^^17:36
*** chandankumar has quit IRC17:36
tellesnobregasreshetn1, vanilla hadoop-2.6.017:37
tellesnobregasreshetn1, i have no clue right now what the problem might be. At first i thought it was full disk, but i ruled that out17:40
*** devlaps has joined #openstack-sahara17:42
openstackgerritTrevor McKay proposed openstack/sahara: Add an is_default field to cluster templates and node group templates  https://review.openstack.org/16092017:42
*** sreshetn1 has quit IRC17:43
*** chandankumar has joined #openstack-sahara17:44
*** chandankumar has quit IRC17:47
openstackgerritMerged stackforge/sahara-ci-config: Fix status check procedure  https://review.openstack.org/16351217:59
*** Longgeek has joined #openstack-sahara18:02
*** crobertsrh has quit IRC18:04
*** crobertsrh has joined #openstack-sahara18:04
*** Networkn3rd has quit IRC18:05
*** Longgeek has quit IRC18:09
*** chandankumar has joined #openstack-sahara18:11
openstackgerritMerged openstack/sahara: [EDP][Spark] Configure cluster for external hdfs  https://review.openstack.org/16137118:27
openstackgerritMerged openstack/sahara: Adding CDH to the list of default plugins  https://review.openstack.org/12483518:27
*** hdd_ has quit IRC18:36
*** chandankumar has quit IRC18:57
crobertsrhHmm, was the CLI updated to use data-processing rather than data_processing?19:02
elmikoi dunno, i've been adding data- and data_ just out of paranoia =)19:06
crobertsrhsahara node-group-template-create < ~croberts/src/master.ngt19:06
crobertsrhERROR: publicURL endpoint for data_processing service not found19:06
elmikoi guess not19:06
elmikoor that error message is wrong19:06
crobertsrhOther calls seem to be working19:07
elmikohuh, odd19:07
crobertsrhOh...maybe not19:07
crobertsrhthe other things that are working (from my post-stack script) are still of the http variety19:07
crobertsrhnot using CLI19:07
*** tnovacik has quit IRC19:09
*** Networkn3rd has joined #openstack-sahara19:13
openstackgerritMerged openstack/sahara: HDP plugin: Fix Bash error when starting Hue  https://review.openstack.org/16266719:17
openstackgerritMerged openstack/sahara: Added volume_local_to_instance field support  https://review.openstack.org/16073019:18
*** tosky has quit IRC19:19
*** sreshetn1 has joined #openstack-sahara19:22
openstackgerritMerged openstack/sahara: Adding barbican client and keymgr module  https://review.openstack.org/16219819:22
crobertsrhbah, figured out my CLI problem....needed the updated python-saharaclient19:23
elmikoat least it was an easy fix ;)19:32
*** Nikolay_St has joined #openstack-sahara19:34
*** chandankumar has joined #openstack-sahara19:41
*** Longgeek has joined #openstack-sahara19:54
*** Longgeek has quit IRC20:00
*** tnovacik has joined #openstack-sahara20:02
*** crobertsrh has quit IRC20:09
*** hdd_ has joined #openstack-sahara20:10
tmckayelmiko, crobertsrh, hmmm, in service validations we do not let you delete a node group template if it is referenced by a cluster template.  But this doesn't happen in the database layers, its20:23
tmckayit's at a higher level.  Do you think I should add the validation to the default template CLI?20:23
*** chandankumar has quit IRC20:24
*** sreshetn1 has quit IRC20:24
elmikotmckay: hmm, good question20:26
elmikomy instinct says yes as it should follow the other types20:26
tmckayelmiko, begs the question of why there is not a check in the db.  i guess we wanted a nice REST response20:26
elmikoyea probably20:27
tmckayprobably ought to duplicate the check, rather than put it in the CLI tool20:27
*** crobertsrh has joined #openstack-sahara20:55
*** hogepodge has joined #openstack-sahara20:58
*** tellesnobrega_ has joined #openstack-sahara21:09
*** akuznetsov has quit IRC21:10
*** tellesnobrega_ has quit IRC21:11
*** crobertsrh is now known as _crobertsrh21:12
*** sreshetn1 has joined #openstack-sahara21:21
*** sreshetn1 has quit IRC21:25
*** Networkn3rd has quit IRC21:33
*** Nikolay_St has quit IRC22:10
*** bandarji has joined #openstack-sahara22:11
*** egafford has quit IRC22:21
*** sreshetn1 has joined #openstack-sahara22:22
*** hogepodge has quit IRC22:24
*** sreshetn1 has quit IRC22:26
*** tellesnobrega_ has joined #openstack-sahara22:40
*** tellesnobrega_ has quit IRC22:41
*** Longgeek has joined #openstack-sahara22:45
*** Nikolay_St has joined #openstack-sahara22:48
*** Longgeek has quit IRC22:55
*** tnovacik has quit IRC23:02
*** hdd_ has quit IRC23:11
*** Nikolay_St has quit IRC23:16
*** Nikolay_St has joined #openstack-sahara23:18
*** Nikolay_St has quit IRC23:22
*** Nikolay_St has joined #openstack-sahara23:29
*** chlong has joined #openstack-sahara23:41
*** Nikolay_St has quit IRC23:43
*** Nikolay_St has joined #openstack-sahara23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!