Friday, 2014-04-04

*** IlyaE has joined #openstack-sahara00:18
*** IlyaE has quit IRC00:41
openstackgerritErik Bergenholtz proposed a change to openstack/sahara: Updated hdp_plugin features to align with current capabilties  https://review.openstack.org/8479700:50
openstackgerritA change was merged to openstack/sahara: Added parameters to configure a list of node group processes  https://review.openstack.org/8451001:28
*** witlessb has joined #openstack-sahara01:56
*** witlessb has quit IRC01:56
openstackgerritA change was merged to openstack/sahara: Fixed tests failures when SKIP_ALL_TESTS_FOR_PLUGIN=True  https://review.openstack.org/8441702:13
*** elmiko has quit IRC03:01
*** tmckay has quit IRC04:11
*** akuznetsov has joined #openstack-sahara04:29
*** Ch00k has joined #openstack-sahara04:32
*** tmckay has joined #openstack-sahara05:23
*** tmckay has quit IRC05:54
openstackgerritJenkins proposed a change to openstack/sahara: Imported Translations from Transifex  https://review.openstack.org/8271906:06
*** IlyaE has joined #openstack-sahara06:18
*** Ch00k has quit IRC06:21
*** Ch00k has joined #openstack-sahara06:41
*** Ch00k has quit IRC06:56
*** IlyaE has quit IRC07:11
*** IlyaE has joined #openstack-sahara07:24
*** IlyaE has quit IRC07:31
*** witlessb has joined #openstack-sahara07:38
*** Ch00k has joined #openstack-sahara07:52
*** skolekonov has joined #openstack-sahara08:05
*** akuznetsov has quit IRC08:34
*** akuznetsov has joined #openstack-sahara08:35
*** dmitryme has joined #openstack-sahara08:45
*** ErikB1 has quit IRC09:32
*** ErikB1 has joined #openstack-sahara09:39
*** tosky has joined #openstack-sahara09:54
*** Ch00k has quit IRC10:09
*** akuznetsov has quit IRC10:15
*** akuznetsov has joined #openstack-sahara10:33
*** Ch00k has joined #openstack-sahara10:46
openstackgerritDmitry Mescheryakov proposed a change to openstack/sahara: Fix up installation guide  https://review.openstack.org/8487111:14
openstackgerritYaroslav Lobankov proposed a change to openstack/sahara: Doc's update for integration tests  https://review.openstack.org/8507111:42
*** dmitryme has quit IRC11:59
*** elmiko has joined #openstack-sahara12:28
*** sballe has quit IRC12:46
*** sballe has joined #openstack-sahara12:47
*** dmitryme has joined #openstack-sahara12:51
openstackgerritChad Roberts proposed a change to openstack/sahara-dashboard: Removing backward compatibility for Folsom URLs  https://review.openstack.org/8309713:04
aignatov_crobertsrh: mattf ErikB1, tmckay, I've create etherpad with a list of fixes and patches which we think must be landed to the Icehouse13:08
aignatovhttps://etherpad.openstack.org/p/icehouse-fixes-after-rc13:08
_crobertsrhgreat...thans13:08
_crobertsrhthanks13:08
aignatovSergeyLukjanov: dmitryme ^^13:08
dmitrymeaignatov: ack, see it13:09
*** sreshetnyak has joined #openstack-sahara13:11
*** sballe has quit IRC13:18
*** sballe has joined #openstack-sahara13:18
*** _crobertsrh is now known as crobertsrh13:38
toskySergeyLukjanov: ping, when can we start talking about the plans for the tests? (I've notices this https://review.openstack.org/#/c/83317/)13:48
ylobankovtosky: I can talk to you about that13:50
toskyylobankov: oh, perfect, thanks13:51
SergeyLukjanovaignatov, thank you!13:51
SergeyLukjanovtosky, hey, please, chat with ylobankov about testing13:52
ylobankovtosky:  I would like to see your notices  https://review.openstack.org/#/c/83317/ . Let me a while13:52
SergeyLukjanovtosky, ylobankov, only one note, personally, I'm planning to prepare fake plugin and write some provisioning tests for tempest/scenarios13:52
ErikB1just updated this page: https://wiki.openstack.org/wiki/IRC13:53
SergeyLukjanovthe first goal I think should be to rewrite our current integration tests in tempest scenarios style and place them to contrib/tempest into sahara13:53
SergeyLukjanovgtg13:54
toskyoki13:55
toskyylobankov: that review request says "There is a plan to add some non compute-intensive scenarios for Sahara:" and I see few points13:55
toskyare these points already covered by the current integration tests, or should they be written in addition to the existing tests (which needs to be converted in tempest-style)?13:56
ylobankovtosky: do you have any ideas?13:57
toskymy personal situation is: I will need to do testing on Sahara, so it's pointless to duplicate the effort,13:57
toskyso if I can help with your plans, especially if they are on the same directions as mine, that would be better13:58
*** tmckay has joined #openstack-sahara13:58
tmckaybah, internet at the garage is terrible, and I forgot that it blocks my irc client13:59
tmckayand vpn13:59
tmckaybut the web irc client works13:59
tmckayhopefully they are sending me home very soon13:59
dmitrymeErikB: thanks13:59
tmckaycrobertsrh, ^^14:00
crobertsrh:)14:00
ylobankovtmckay:  For now, we have no specific plan how we will do this.14:00
tmckayylobankov, how we will do what?14:01
ylobankovtmckay: sorry14:01
toskyI guess it was for me14:01
tosky:)14:01
tmckayheh, thanks14:02
ylobankovtmckay: yes :)14:02
ylobankovtosky: yes :)14:02
*** skolekonov has quit IRC14:03
dmitrymemattf: the RDO package for Sahara UI will be called 'python-django-sahara', right?14:03
ylobankovtosky:  if you propose some ideas, it will be great14:03
dmitrymemattf: for Savanna it was 'python-django-savanna'14:03
toskyylobankov: my initial goal was to have something that runs a cluster and runs some existing, community-based, Hadoop tests on it14:04
elmikodmitryme: i think that is correct14:04
dmitrymeelmiko: good, thanks14:05
toskyylobankov: tmckay has some client-based tests which can be a starting point for that (when approved :)14:05
ylobankovtosky: a good idea14:05
tmckayIt's meant to test the client cli, but it's easy to run.14:06
toskyylobankov: if I understand it correctly, your plan is to do the conversion of the existing tests (to tempest-style) in the Juno lifecycle14:06
ylobankovtosky: yes14:06
toskyylobankov: is the review request above part of this plan, or is it needed for other test cases which are not yet covered?14:07
dmitrymeelmiko: btw how is your Sahara setup? Did you get through all the errors?14:07
ylobankovtosky: the review is for this plan14:09
toskyylobankov: ok, thanks: I guess it would be better for me to go through the existing functional tests; do you have some converted test in tempest style, just as reference?14:11
ylobankovtosky: unfortunately, we don't have such tests14:13
elmikodmitryme: for the most part yes, i've got an active hdp2 cluster :)14:13
elmikothe centos+hdp2 image created by diskimage-create.sh provided the last few problems14:14
ylobankovtosky: Now my focus is API tests14:14
*** tmckay has quit IRC14:14
toskyylobankov: which is usually the focus of Tempest14:14
toskyylobankov: are the tests under integration/ API tests already?14:15
toskyWhat do you think it would be the most challenging part of the conversion? Use the proper tempest classes, or also some changes in the logic of the tests?14:15
dmitrymeelmiko: cool, great to hear it is solved14:15
ylobankovtosky: I am working on simple API tests for Sahara. About "What do you think it would be the most challenging part of the conversion? Use the proper tempest classes, or also some changes in the logic of the tests?". I think yes14:18
toskyyes to both?14:18
tosky(use the tempest classes _and_ change the logic of the tests?)14:18
ylobankovtosky: both use the tempest classes  and change the logic of the tests14:20
toskyylobankov: ok, thanks! So I need to really study a bit of code first14:22
*** tmckay has joined #openstack-sahara14:24
ylobankovtosky: Did you have a chance to look at integration tests in Sahara?14:25
toskyylobankov: not yet, I was fighting with the cluster creation and some manual test just to learn how it works14:26
ylobankovtosky: if you have any questions about integration tests,  do not hesitate, ask me14:34
toskyylobankov: thanks, expect more noise from me in the next weeks14:34
*** tmckay has quit IRC14:35
ylobankovtosky: ok14:35
SergeyLukjanovI'm here again :)14:43
*** tmckay has joined #openstack-sahara14:50
*** tmckay has quit IRC14:54
*** DenisEgorenko has left #openstack-sahara14:54
*** tmckay has joined #openstack-sahara14:54
*** IlyaE has joined #openstack-sahara14:57
*** abonilla has joined #openstack-sahara15:36
abonillaDid Sahara already graduate?15:37
SergeyLukjanovabonilla, yup15:37
abonillaSergeyLukjanov: thanks. Has there been any effort on using ceph as the storage backend for HDFS?15:37
SergeyLukjanovabonilla, https://github.com/openstack/governance/blob/master/reference/programs.yaml#L31815:37
toskythe vote: http://git.openstack.org/cgit/openstack/governance/commit/reference/programs.yaml?id=5ed920ab4b32f9b6d4168cb7d70ba97c82cab11515:41
*** bradd1 has joined #openstack-sahara15:48
*** dmitryme has quit IRC15:57
*** ylobankov has quit IRC15:59
*** RockKuo_TW has quit IRC16:01
*** vrovachev has quit IRC16:01
tmckayanyone else having problems with testtools > 0.9.32?  Seems to be breaking16:04
elmikoSergeyLukjanov: did you see the email i sent yesterday?16:09
SergeyLukjanovelmiko, yes, that's awesome, thank you, it's in my backlog for detailed overview :) I've successfully collected a giant backlog for this weekend16:14
elmikoSergeyLukjanov: ok, thanks :)16:21
elmikoand good luck this weekend16:21
*** Ch00k has quit IRC16:32
crobertsrhtmckay:  I restacked this morning without any issue.  I did not pull the latest devstack though.16:45
tmckaycrobertsrh, at least on my box, I know that testtools 0.9.32 is okay and 0.9.35 has an import issue in the compat package.  Trying to get to the root of it.  It's an import -- how hard can it be? :)16:46
tmckaycrobertsrh, curious, what does 'pip freeze | grep testtools' give you?16:46
crobertsrhtesttools==0.9.3516:47
tmckaydoh16:47
crobertsrhwhat are you trying to run?16:47
tmckayif you go to sahara, and do testr list-tests for example, does it work?16:47
crobertsrhdo I need my venv invoked or anything?16:48
tmckaynope16:48
tmckayit breaks for me16:48
crobertsrhhttp://fpaste.org/91734/39663013/16:49
tmckaysigh.  are you F20?16:49
crobertsrhyeah, f2016:49
tmckayIt goes wrong for me here, /usr/lib/python2.7/site-packages/subunit/test_results.py16:50
crobertsrhHave you tried the uninstall/reinstall method?16:50
tmckayfrom testtools.compat import *16:50
crobertsrhI've had pip hose me a few different times....pip uninstall whatever and a reinstall has worked in the past16:50
tmckaycrobertsrh, how about this one?  pip freeze | grep subunit16:51
crobertsrhpython-subunit==0.0.1816:51
tmckayseems to be subunit that's hosing me16:51
tmckayah, I have 0.0.1516:51
tmckayk, gonna try that16:52
crobertsrhthat like 0.0.03 less....my grandpa runs that16:52
tmckaylol16:52
crobertsrhIt came standard on his edsel16:52
tmckaythe older I get, the more I think milspec makes sense16:52
tmckaycrobertsrh, okay, import error is gone.16:56
* tmckay tries devstack with new python-subunit16:56
crobertsrhgreat.  Nothing like a mystery-import-error to get your Friday really going.16:56
tmckayI think I need a venv for every application on my entire machine16:56
tmckayyeah, amazing how efficient it is16:57
openstackgerritAndrew Lazarev proposed a change to openstack/sahara: Removed impossible branch of 'if' statement  https://review.openstack.org/7912417:03
*** Ch00k has joined #openstack-sahara17:08
*** tosky has quit IRC17:13
*** IlyaE has quit IRC17:15
openstackgerritAndrew Lazarev proposed a change to openstack/sahara: Added support of multi-region environment  https://review.openstack.org/7979517:16
*** pmoosh has joined #openstack-sahara17:21
*** Ch00k has quit IRC17:27
*** Ch00k has joined #openstack-sahara17:30
*** IlyaE has joined #openstack-sahara17:34
openstackgerritAndrew Lazarev proposed a change to openstack/sahara: Forced lowercase for instance names  https://review.openstack.org/6874017:36
*** akuznetsov has quit IRC17:40
*** openstackgerrit has quit IRC18:01
*** openstackgerrit has joined #openstack-sahara18:02
*** IlyaE has quit IRC18:15
openstackgerritAndrew Lazarev proposed a change to openstack/sahara: Fixed wrong use of SaharaException  https://review.openstack.org/8543918:22
*** IlyaE has joined #openstack-sahara18:28
SergeyLukjanovelmiko, thx :)18:29
*** Ch00k has quit IRC18:32
*** bob_nettleton has joined #openstack-sahara18:56
openstackgerritAndrew Lazarev proposed a change to openstack/sahara: Fixed wrong exceptions use for decommission errors  https://review.openstack.org/8544818:59
bob_nettletonmattf, Hi, I have a question regarding blueprints in OpenStack.  We'd like to create a blueprint for improved error-handling in sahara/sahara-dashboard.  It looks like Andrew has already created a blueprint in this area: https://blueprints.launchpad.net/sahara/+spec/error-handling19:02
bob_nettletonmattf, my question is: Should I create a separate blueprint for the error handling issues we've come across, or should I append (if possible) to the existing blueprint?  If so, is this something we add to the "whiteboard" section of an existing blueprint?19:03
elmikobob_nettleton: i think mattf is out today19:07
SergeyLukjanovbob_nettleton, hey19:11
bob_nettletonSergeyLukjanvo, Hi Sergey, any advice on my blueprint question?19:12
SergeyLukjanovbob_nettleton, do you have bunch of issues with error handling, you'd like to solve or some approach you'd like to propose?19:12
SergeyLukjanovit19:12
crobertsrhbob_nettleton:  It might also be worthwhile to look at the current horizon-wide error handling stuff that is ongoing.  https://blueprints.launchpad.net/openstack/?searchtext=improve-error-message-details-for-usability19:13
SergeyLukjanovit's a very big topic, so, probably we could have an etherpad to discuss it and continue/approve it on summit if needed19:13
bob_nettletonSergeyLukjanov, not a specific approach per-se, but during some provisioning testing we came across some serious usability issues.  When any type of error occurs during a cluster start, we just get the message "Error" on the dashboard, which isn't very helpful.  :)19:13
crobertsrhLooks like so far, they have, https://review.openstack.org/#/c/76479/19:13
SergeyLukjanovbob_nettleton, re dashboard - we'll move from sahara-dashboard to horizon, so, we'll need to do it in the horizon19:13
bob_nettletoncrobertsrh, thanks for the links, I'll check this out.19:14
SergeyLukjanovcrobertsrh, nice links19:14
crobertsrhError handling is something that I'd like to talk about at summit for sure.  It's come up pretty much every day for someone19:14
SergeyLukjanovbob_nettleton, could you please compose your issues to the etherpad and I'll add it to the blueprint Andrew created19:14
*** pmoosh has quit IRC19:14
bob_nettletonSergeyLukjanov, sure, I can do that.  is there an etherpad on this topic already?19:15
SergeyLukjanovbob_nettleton, I think no, you'll be the first19:15
SergeyLukjanovadditionally, folks, please, propose this topic for the design summit19:16
SergeyLukjanovsummit.openstack.org19:16
bob_nettletoncrobertsrh, I agree, error-handling in Sahara in general is not so great.  I suppose a lot of how this will work depends upon the usability changes in Horizon.19:16
SergeyLukjanovimo "is not so great" should be "bad enough to worry about" ;)19:17
bob_nettletonSergeyLukjanov, :)19:17
SergeyLukjanovthe issue is that error handling in horizon is not so good too...19:18
crobertsrhAbsolutely.  I definitely have my eyes on their changes.  I've been meaning to test drive their CR to see what's in so far.19:18
SergeyLukjanovanyway, we should improve it a lot on server side firstly19:18
SergeyLukjanovcrobertsrh, cool19:18
SergeyLukjanovcrobertsrh, do you have any plans/dates in sahara-dashboard to horizon transition?19:18
crobertsrhMaybe instead of just "Error", the improvement will be, "Error, so your stuff failed"19:18
SergeyLukjanov:)19:19
crobertsrhI don't have any dates in mind just yet.  I've been doing some reviews on horizon itself and poking around their channel.  I suppose earlier in Juno is desirable as opposed to later.19:19
SergeyLukjanovcrobertsrh, yup,19:20
SergeyLukjanovcrobertsrh, fyi master branches in all projects are already open for Juno dev:)19:21
crobertsrhHave you seen any docs that outline what we must do in order to get our stuff merged there?19:21
bob_nettletonSergeyLukjanov, what is the link for the etherpad site for Sahara?19:22
SergeyLukjanovbob_nettleton, http://etherpad.openstack.org19:22
SergeyLukjanovcrobertsrh, hmm, 2x +2 :)19:22
bob_nettletonSergeyLukjanov, thanks!19:22
SergeyLukjanovcrobertsrh, I've already talked with their PTL and he said that he don't see any preliminary issues, we should push changes on review19:23
SergeyLukjanovcrobertsrh, IMO there are several potential issues19:23
SergeyLukjanovcrobertsrh, #1 they're trying to migrate from jquery to angularjs19:23
crobertsrhYes...I saw that :)19:24
SergeyLukjanov(all our stuff is jquery based)19:24
crobertsrhIt prompted me to take a look at angular.js19:24
SergeyLukjanov#2 we have many custom pages (it could increase review time a lot)19:24
SergeyLukjanovyou can ping NikitaKonovalov to talk about angularjs19:25
SergeyLukjanovhe know it a bit19:25
SergeyLukjanovfor storyboard19:25
crobertsrhAwesome :)  I have a hunch that it will take a fair bit of work to get our stuff moved to angular19:25
crobertsrhOf course, maybe Nikita already has it under control :)19:25
SergeyLukjanovcrobertsrh, I don't think that it'll be an easy transition ;(19:28
crobertsrhNo...my only angular experience is watching a 20min youtube video19:30
bob_nettletonSergeyLukjanov, crobertsrh, I've created an etherpad at https://etherpad.openstack.org/p/Sahara_Error_Handling_Debugging.  At this point, I've just summarized the general issues I've run into.  I'm still relatively new to Sahara and OpenStack, so I'm sure I haven't run across anything you haven't seen already.  thanks!19:33
crobertsrhGreat, thanks Bob.19:33
SergeyLukjanovbob_nettleton, thanks! I'm adding link to bp19:34
bob_nettletoncrobertsrh, SergeyLukjanov, you're welcome.  hopefully the information is at least a useful starting point, although I'm sure this will be an area that needs further examination/discussion.19:38
bob_nettletoncrobertsrh, SergeyLukjanov, I've added some other issues to the error handling etherpad that I think fit in well with this discussion.  Of course, we can always split these issues out into separate blueprints after more discussion occurs.19:53
crobertsrhsounds great.  The more ideas, the merrier19:53
*** sballe has quit IRC19:57
*** sballe has joined #openstack-sahara19:57
openstackgerritSergey Reshetnyak proposed a change to openstack/sahara: Fix big job binary objects in mysql  https://review.openstack.org/8546619:57
elmikoi'm running into some errors with keystoneclient.session, does sahara pass off urls to that module?19:58
bob_nettletoncrobertsrh, SergeyLukjanov, thanks for the help/advice on this.  Have a great weekend!20:06
crobertsrhYou too!20:06
elmikoso... anyone around who knows the keystone auth stuff?20:08
crobertsrhNot I20:09
elmikome thinks the experts have gone home for the weekend :)20:09
*** tmckay has quit IRC20:09
*** tmckay has joined #openstack-sahara20:11
*** bob_nettleton has left #openstack-sahara20:15
*** witlessb has quit IRC20:23
*** witlessb has joined #openstack-sahara20:23
*** witlessb has quit IRC20:23
*** witlessb has joined #openstack-sahara20:24
openstackgerritAndrew Lazarev proposed a change to openstack/sahara: Moved information about processes names to plugins  https://review.openstack.org/7371320:30
openstackgerritAndrew Lazarev proposed a change to openstack/sahara: Fixed wrong exceptions use for decommission errors  https://review.openstack.org/8544820:32
*** crobertsrh is now known as _crobertsrh20:35
openstackgerritAndrew Lazarev proposed a change to openstack/sahara: Added support of multi-region environment  https://review.openstack.org/7979520:35
*** tellesnobrega has quit IRC20:38
*** witlessb has quit IRC20:48
*** tellesnobrega has joined #openstack-sahara20:54
*** tmckay has quit IRC20:57
*** tmckay has joined #openstack-sahara20:58
*** bob_nettleton has joined #openstack-sahara21:06
*** bob_nettleton has left #openstack-sahara21:06
*** tmckay has quit IRC21:07
*** elmiko has quit IRC21:44
openstackgerritAndrew Lazarev proposed a change to openstack/sahara: Moved information about processes names to plugins  https://review.openstack.org/7371322:11
*** bradd1 has quit IRC22:12
*** bradd1 has joined #openstack-sahara22:22
openstackgerritA change was merged to openstack/sahara-image-elements: Actually abort on unrecognized platforms  https://review.openstack.org/8448522:26
*** abonilla has quit IRC22:39
*** abonilla has joined #openstack-sahara22:39
*** abonilla has quit IRC22:47
*** abonilla has joined #openstack-sahara22:48
*** bradd1 has quit IRC23:03

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!