Tuesday, 2015-03-24

« Monday, 2015-03-23 Index Wednesday, 2015-03-25 »
*** az__ has quit IRC00:17
*** hogepodge has quit IRC00:20
*** hogepodge has joined #openstack-sahara00:31
*** witlessb has quit IRC00:34
*** coolsvap|afk is now known as coolsvap00:50
*** Longgeek has joined #openstack-sahara00:51
*** Networkn3rd has quit IRC01:01
*** Networkn3rd has joined #openstack-sahara01:02
*** chen12 has quit IRC01:17
openstackgerritlu huichun proposed openstack/sahara: Minor refactor of the integration service test  https://review.openstack.org/16561801:27
openstackgerritMichael McCune proposed openstack/sahara: [WIP] Adding config hints for HDP plugin  https://review.openstack.org/16649402:02
*** hdd has quit IRC02:04
*** hdd has joined #openstack-sahara02:04
*** soukihei has joined #openstack-sahara02:16
soukiheiit looks like Sahara uses images to deploy nodes with Hadoop pre-installed on them. What piece within Sahara handles the configuration of the individual nodes to become aware of each other in the cluster?02:21
soukiheiI'm new to Sahara and I'm trying to understand how it functions02:21
openstackgerritlu huichun proposed openstack/sahara: Default templates for CDH  https://review.openstack.org/16499102:47
*** hdd has quit IRC02:50
*** Networkn3rd has quit IRC02:58
*** Networkn3rd has joined #openstack-sahara02:58
*** Networkn_ has joined #openstack-sahara03:10
*** Networkn3rd has quit IRC03:10
*** soukihei has quit IRC03:14
*** chandankumar has joined #openstack-sahara03:15
*** Longgeek_ has joined #openstack-sahara03:22
*** hdd has joined #openstack-sahara03:24
*** chandankumar has quit IRC03:25
*** Longgeek has quit IRC03:25
*** chandankumar has joined #openstack-sahara03:25
*** Networkn_ has quit IRC04:04
*** Networkn3rd has joined #openstack-sahara04:04
*** Poornima has joined #openstack-sahara04:13
*** zhidong has joined #openstack-sahara04:13
*** hdd has quit IRC04:16
*** hogepodge has quit IRC04:32
*** coolsvap is now known as coolsvap|afk04:44
*** chandankumar has quit IRC04:52
*** chandankumar has joined #openstack-sahara04:55
*** Poornima has quit IRC05:01
*** hogepodge has joined #openstack-sahara05:01
*** Poornima has joined #openstack-sahara05:02
*** chandankumar has quit IRC05:04
*** chandankumar has joined #openstack-sahara05:38
*** Nikolay_St has quit IRC05:40
*** Networkn3rd has quit IRC06:22
*** Networkn3rd has joined #openstack-sahara06:26
*** sparameswaran has joined #openstack-sahara06:28
*** sreshetn1 has joined #openstack-sahara06:29
openstackgerrityuntongjin proposed openstack/sahara-specs: Introduce objects into sahara. This enables objects to be passed over RPC and decouple the database implementation from SQLAlchemy.  https://review.openstack.org/16711406:29
sparameswaran Created an Ubuntu Vanilla Plugin 2.6.0 Hadoop Image using Sahara-Image-Elements. The image created successfully.But when I tried uploading it in Glance. The status shows as KILLED.  In the current Sahara UI, The vanilla plugin 2.4.1 says its deprecated , so I created a 2.6.0 image for Hadoop.06:30
sparameswarancan someone help with this issue06:30
*** tnovacik has joined #openstack-sahara06:31
*** sparameswaran has quit IRC06:41
*** pcaruana has quit IRC06:41
*** chlong has quit IRC06:42
*** sreshetn1 has quit IRC06:53
*** chlong has joined #openstack-sahara07:03
*** sreshetn1 has joined #openstack-sahara07:26
*** Networkn3rd has quit IRC07:31
*** Networkn3rd has joined #openstack-sahara07:32
*** Networkn3rd has quit IRC07:34
*** sreshetn1 has quit IRC07:35
*** Networkn3rd has joined #openstack-sahara07:43
*** Nikolay_St has joined #openstack-sahara07:47
*** sreshetn1 has joined #openstack-sahara07:48
*** Networkn3rd has quit IRC07:55
*** Longgeek_ has quit IRC07:58
*** Networkn3rd has joined #openstack-sahara07:59
*** Networkn3rd has quit IRC08:05
*** Networkn3rd has joined #openstack-sahara08:05
*** Networkn3rd has quit IRC08:11
*** Networkn3rd has joined #openstack-sahara08:11
*** chlong has quit IRC08:12
*** sreshetn1 has quit IRC08:15
*** Networkn3rd has quit IRC08:24
*** witlessb has joined #openstack-sahara08:28
*** tellesnobrega has quit IRC08:28
*** Networkn3rd has joined #openstack-sahara08:29
*** tmckay has quit IRC08:32
*** pino|work has joined #openstack-sahara08:35
openstackgerritDenis Egorenko proposed stackforge/sahara-ci-config: Run all jobs with scenario tests  https://review.openstack.org/16619008:36
*** Networkn3rd has quit IRC08:36
openstackgerritDenis Egorenko proposed stackforge/sahara-ci-config: Run tempest and python gate tests only on code change  https://review.openstack.org/16620908:37
*** tellesnobrega has joined #openstack-sahara08:40
*** Networkn3rd has joined #openstack-sahara08:43
*** Networkn3rd has quit IRC08:47
*** tmckay has joined #openstack-sahara08:48
*** Networkn3rd has joined #openstack-sahara08:48
*** Networkn3rd has quit IRC08:58
openstackgerrityuntongjin proposed openstack/sahara-specs: Introduce objects into sahara. This enables objects to be passed over RPC and decouple the database implementation from SQLAlchemy.  https://review.openstack.org/16711408:58
*** zhidong has quit IRC09:00
*** sgotliv has joined #openstack-sahara09:01
*** Networkn3rd has joined #openstack-sahara09:10
*** sreshetn1 has joined #openstack-sahara09:17
openstackgerritPino Toscano proposed openstack/sahara-image-elements: Start switching to declarative package-installs  https://review.openstack.org/16715009:53
*** Networkn3rd has quit IRC10:07
*** Networkn3rd has joined #openstack-sahara10:12
openstackgerritDenis Egorenko proposed stackforge/sahara-ci-config: Run all jobs with scenario tests  https://review.openstack.org/16619010:13
openstackgerritDenis Egorenko proposed stackforge/sahara-ci-config: Run tempest and python gate tests only on code change  https://review.openstack.org/16620910:13
*** Networkn3rd has quit IRC10:16
*** Networkn3rd has joined #openstack-sahara10:17
*** sreshetn1 has quit IRC10:18
*** Networkn_ has joined #openstack-sahara10:25
*** Networkn3rd has quit IRC10:26
*** esikachev has joined #openstack-sahara10:39
*** chandankumar_ has joined #openstack-sahara10:44
openstackgerritSergey Reshetnyak proposed stackforge/sahara-ci-config: Set public network id for tempest test  https://review.openstack.org/16692510:45
openstackgerritEvgeny Sikachev proposed openstack/sahara: Add information about cluster state in test report  https://review.openstack.org/16692810:45
*** chandankumar has quit IRC10:46
*** Networkn_ has quit IRC10:46
*** sreshetn1 has joined #openstack-sahara10:51
*** Networkn3rd has joined #openstack-sahara10:55
*** tosky has joined #openstack-sahara10:58
*** Networkn3rd has quit IRC11:29
*** Networkn3rd has joined #openstack-sahara11:30
openstackgerritSergey Reshetnyak proposed stackforge/sahara-ci-config: Set public network id for tempest test  https://review.openstack.org/16692511:33
*** Networkn_ has joined #openstack-sahara11:35
*** Networkn3rd has quit IRC11:36
*** jamielennox is now known as jamielennox|away11:45
*** Networkn_ has quit IRC11:56
openstackgerritEvgeny Sikachev proposed openstack/sahara: Add information about cluster state in test report  https://review.openstack.org/16692811:56
openstackgerritSergey Reshetnyak proposed openstack/sahara: Drop support database downgrades  https://review.openstack.org/16718912:04
openstackgerritEvgeny Sikachev proposed openstack/sahara: Add information about cluster state in test report  https://review.openstack.org/16692812:09
*** chlong has joined #openstack-sahara12:12
*** Networkn3rd has joined #openstack-sahara12:12
openstackgerritSergey Reshetnyak proposed openstack/sahara: Drop support database downgrades  https://review.openstack.org/16718912:14
*** chlong has quit IRC12:15
*** chandankumar_ has quit IRC12:18
*** sreshetn1 has quit IRC12:26
*** chlong has joined #openstack-sahara12:32
*** chlong has quit IRC12:35
*** chlong has joined #openstack-sahara12:36
openstackgerritDenis Egorenko proposed stackforge/sahara-ci-config: Run all jobs with scenario tests  https://review.openstack.org/16619012:38
*** chlong has quit IRC12:39
openstackgerritMerged stackforge/sahara-ci-config: Set public network id for tempest test  https://review.openstack.org/16692512:45
*** Poornima has quit IRC12:51
*** Networkn3rd has quit IRC12:55
*** chlong has joined #openstack-sahara12:56
*** chandankumar has joined #openstack-sahara12:57
*** tmckay has quit IRC13:14
*** tmckay has joined #openstack-sahara13:15
*** chandankumar has quit IRC13:35
*** chandankumar has joined #openstack-sahara13:41
*** egafford has joined #openstack-sahara14:00
openstackgerritEvgeny Sikachev proposed openstack/sahara: Adding plugin version information to scenario test report  https://review.openstack.org/16723414:02
*** chandankumar has quit IRC14:09
openstackgerritPino Toscano proposed openstack/sahara-image-elements: mysql: use install-packages and pkg-map elements  https://review.openstack.org/16724014:17
tellesnobregado i need barbican client installed to run sahara tests?14:33
elmikotellesnobrega: yes14:35
tellesnobregaelmiko, ok14:35
egaffordSahara did not issue a 2014.1.4, correct?14:38
tellesnobregaelmiko, i installed barbican python client, but i'm still getting No module name barbicanclient.client? do I need a specific version of barbican or the latest works fine?14:42
elmikotellesnobrega: should be the most current from pypi14:43
elmikotellesnobrega: look at requirements.txt, python-barbicanclient>=3.0.114:44
tellesnobregaelmiko, thanks14:44
elmikoegafford: looks like not14:45
elmiko(at least, i don't see it on launchpad)14:45
elmikoegafford: yea, nothing on tarballs.openstack.org either14:46
egaffordelmiko: Yeah, there's definitely nothing on tarballs; I was wondering about the why. Guess just nothing interesting to push.14:47
elmikoegafford: that's a tougher question (why), i'm not sure14:48
egaffordelmiko: Doesn't matter enormously, happily.14:49
elmikohehe14:49
elmikosaves you some packaging ;)14:49
*** Networkn3rd has joined #openstack-sahara14:49
egaffordSergeyLukjanov: If you're about, was there just nothing to push for 2014.1.4?14:52
SergeyLukjanovegafford, yeah14:53
SergeyLukjanovegafford, there are no changes since 2014.1.314:53
SergeyLukjanovegafford, we are not officially maintaining Icehouse as part of OpenStack14:53
egaffordSergeyLukjanov: All sensible.14:55
egafford=14:55
egaffordMany thanks.14:55
*** tosky has quit IRC14:55
*** tnovacik has quit IRC14:56
*** tosky has joined #openstack-sahara14:56
*** sgotliv has quit IRC15:06
openstackgerritLuigi Toscano proposed openstack/python-saharaclient: Copy functional tests from tempest CLI  https://review.openstack.org/16726715:15
*** hdd has joined #openstack-sahara15:16
*** Nikolay_St has quit IRC15:21
*** _crobertsrh is now known as crobertsrh15:36
*** chandankumar has joined #openstack-sahara15:36
*** sreshetn1 has joined #openstack-sahara15:40
openstackgerritTrevor McKay proposed openstack/sahara: Implement job-types endpoint support methods for MapR plugin  https://review.openstack.org/16549415:51
openstackgerritSergey Reshetnyak proposed openstack/sahara: Set up network client for tempest client tests  https://review.openstack.org/16728516:01
*** chlong has quit IRC16:16
*** Nikolay_St has joined #openstack-sahara16:17
openstackgerritTrevor McKay proposed openstack/sahara: Add a CLI tool for managing default templates  https://review.openstack.org/16364916:17
*** sgotliv has joined #openstack-sahara16:22
*** tnovacik has joined #openstack-sahara16:30
*** Nikolay_St has quit IRC16:30
*** Nikolay_St has joined #openstack-sahara16:32
openstackgerritlu huichun proposed openstack/sahara: Default templates for CDH  https://review.openstack.org/16499116:33
*** tnovacik has quit IRC16:40
*** hdd has quit IRC16:44
openstackgerritSergey Reshetnyak proposed openstack/sahara-image-elements: Migrate to openjdk - part 2  https://review.openstack.org/14643416:54
openstackgerritSergey Reshetnyak proposed openstack/sahara-image-elements: Use openjdk by default for java element  https://review.openstack.org/15947316:54
*** chandankumar has quit IRC16:58
*** sreshetn1 has quit IRC17:02
*** chandankumar has joined #openstack-sahara17:10
*** IBerezovskiy has quit IRC17:20
*** hdd has joined #openstack-sahara17:23
*** chandankumar has quit IRC17:27
*** az__ has joined #openstack-sahara17:31
*** az__ has quit IRC17:34
*** az__ has joined #openstack-sahara17:35
*** az__ has quit IRC17:39
*** esikachev has quit IRC17:41
*** sreshetn1 has joined #openstack-sahara17:46
*** Networkn3rd has quit IRC17:50
*** Networkn3rd has joined #openstack-sahara17:51
*** tnovacik has joined #openstack-sahara17:51
egaffordtmckay: ping17:57
tmckayegafford, hi17:57
*** sgotliv has quit IRC17:58
egaffordtmckay: Hi. Looks like multiple voices in the community want the default templates renamed to "master/worker", "master/slave", etc. So, okay. If I change the node group names, I should change the filenames. Does this affect your work at all?17:59
tmckayreally? shouldn't.  I'll just have to tweak the default config but it's very short18:00
egaffordYeah, really. :)18:00
egaffordOkay, cool; I'll get that change in immediately.18:00
egaffords/that change/those changes/18:01
*** jamielennox|away is now known as jamielennox18:04
openstackgerritEthan Gafford proposed openstack/sahara: Default templates for Vanilla  https://review.openstack.org/16478918:18
openstackgerritEthan Gafford proposed openstack/sahara: Add a CLI tool for managing default templates  https://review.openstack.org/16364918:18
*** pino|work has quit IRC18:21
*** plieb has joined #openstack-sahara18:34
pliebhi sahara folks… i am updating doc bug https://bugs.launchpad.net/sahara/+bug/137136018:35
openstackLaunchpad bug 1371360 in Sahara "[DOC] Features overview suggests Cinders to increase reliability" [Low,Confirmed] - Assigned to plieb (jliberma)18:35
pliebi sent an email to the openstack-dev mailing list tagged [sahara]18:35
pliebany input would be appreciated, cheers!18:35
pliebif it is too much of a usage question let me know and i'll ask it elsewhere18:36
elmikothanks plieb =)18:36
pliebi hope it is not too operatory18:37
pliebits not developy enough18:37
elmikoyour email seems appropriate to me, i just don't know the answer lol18:38
toskyhi plieb :)18:48
*** hdd has quit IRC18:55
tmckayvgridnev, ping18:57
tmckayelmiko, do you think I should move the default templates from underneath plugins to sahara/db/templates?18:58
tmckayI was trying to keep them near the plugins, but since it's a different dir it doesn't really matter.  And it would be self-contained this way (except for the dependencies on sahara, that is :) )18:59
*** sreshetn1 has quit IRC19:01
elmikotmckay: i think it should be in etc, but i think vgridnev makes an excellent point.19:01
elmikoi leave it up to your preference =)19:01
tmckayelmiko, clarification, not the config file, I mean the whole json file set19:02
elmikohmm19:02
tmckaymaybe leave well-enough alone at this point :)19:02
elmikoi don't have a strong opinion on that one. yea19:02
tmckayalright, I'll work on unit tests and let others chime in on the finer points19:03
elmikoi think we should either put all the stuff (conf and templates) in etc/sahara-template , or leave them in sahara/db/templates.19:03
elmikotmckay: unittests > file location quibbling19:04
elmikotmckay: was gonna ask, we have no support mapreduce.streaming config hints. does oozie support mr.streaming?19:05
tmckayelmiko, alright, I can group it all in sahara/db/templates.  I like it there because it's not "in your face".  It is a separate tool, after all19:05
elmikofair19:05
tmckayelmiko, yeah, mapreduce.streaming is a an oozie action type19:05
elmikotmckay: now, next question. do the config hints differ for streaming over normal mr?19:06
tmckayjust thinking about that.19:06
elmikok19:06
elmikojus trying to cover all the bases19:06
tmckayelmiko, I'm going to say they don't really differ.  streaming just uses shells for mapper/reducer instead of Java.19:10
tmckaySo, some Java related configs I suppose might be different but I think all in all it will be pretty much the same19:10
elmikotmckay: ok, cool. i'll put them under mapreduce. almost done with tests for hdp stuff then i'll post. i'd still like comments on the configs but it's better than what we have now.19:11
elmikoi also have a vanilla patch in the works too19:12
*** sreshetn1 has joined #openstack-sahara19:12
tmckayelmiko, btw, if you haven't found it, under http://oozie.apache.org/docs/ you can find the Workflow Functional Specification (I believe we are oozie 4)19:13
elmikotmckay: awesome, i had not found that19:13
tmckayIt gives examples of most of the actions, talks about config a little bit19:13
elmikocool, thanks19:13
tmckaythere might be something at apache that gives all the configs for Hadoop, that would be helpful :)19:14
elmikoyea really19:14
*** tellesnobrega has quit IRC19:29
*** raaka has quit IRC19:29
openstackgerritTrevor McKay proposed openstack/sahara: Add a CLI tool for managing default templates  https://review.openstack.org/16364919:30
*** tosky has quit IRC19:31
*** tellesnobrega has joined #openstack-sahara19:33
elmikotmckay: oozie doesn't support spark, so would that call be prevented before reaching the config hints for an oozie engine?19:34
tmckayelmiko, hmm, let me check19:35
elmikothanks19:35
tmckayelmiko, huh, it's actually not19:36
tmckayI mean, through the REST interface it is19:36
tmckaybut technically, job type could be anything at that point19:37
tmckayelmiko, from vanilla19:37
tmckay    def get_edp_job_types(self):19:37
tmckay        return edp_engine.EdpOozieEngine.get_supported_job_types()19:37
tmckay    def get_edp_config_hints(self, job_type):19:37
tmckay        return edp_engine.EdpOozieEngine.get_possible_job_config(job_type)19:37
tmckayelmiko, that second call could conceivably call the first method to screen19:37
elmikook, cool19:38
tmckaymaybe we should make that improvement at some point19:38
elmikojust curious if i needed a test to throwout spark, but it doesn't seem like it could make it there for an EdpOozieEngine19:38
elmikoyea, definitely19:39
openstackgerritTrevor McKay proposed openstack/sahara: Default templates for MapR  https://review.openstack.org/16620019:42
openstackgerritTrevor McKay proposed openstack/sahara: Default templates for CDH  https://review.openstack.org/16499119:42
openstackgerritTrevor McKay proposed openstack/sahara: Default templates for Spark  https://review.openstack.org/16479719:43
openstackgerritTrevor McKay proposed openstack/sahara: Default templates for Vanilla  https://review.openstack.org/16478919:43
openstackgerritTrevor McKay proposed openstack/sahara: Default templates for HDP  https://review.openstack.org/16477219:43
*** Networkn3rd has quit IRC19:48
*** Networkn3rd has joined #openstack-sahara19:48
openstackgerritMichael McCune proposed openstack/sahara: Adding config hints for HDP plugin  https://review.openstack.org/16649419:56
*** Networkn3rd has quit IRC20:08
*** Networkn3rd has joined #openstack-sahara20:13
*** plieb has left #openstack-sahara20:32
openstackgerritEthan Gafford proposed openstack/sahara: Default templates for Spark  https://review.openstack.org/16479721:00
*** sreshetn1 has quit IRC21:01
*** openstackgerrit has quit IRC21:07
*** openstackgerrit has joined #openstack-sahara21:07
*** Networkn3rd has quit IRC21:23
openstackgerritEthan Gafford proposed openstack/sahara: Default templates for HDP  https://review.openstack.org/16477221:32
*** tmckay has quit IRC21:42
*** egafford has quit IRC22:00
openstackgerritMichael McCune proposed openstack/sahara: Adding config hints for HDP plugin  https://review.openstack.org/16649422:41
openstackgerritMichael McCune proposed openstack/sahara: Adding config hints for vanilla plugin  https://review.openstack.org/16742022:41
*** tnovacik has quit IRC23:17
*** chlong has joined #openstack-sahara23:20
*** witlessb has quit IRC23:27
*** chlong has quit IRC23:35
*** chlong has joined #openstack-sahara23:35
« Monday, 2015-03-23 Index Wednesday, 2015-03-25 »

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!