Thursday, 2015-09-24

*** lvdongbing has joined #openstack-sahara00:08
openstackgerritMerged openstack/python-saharaclient: Fix functional tests in saharaclient  https://review.openstack.org/22682800:08
*** hdd has joined #openstack-sahara00:10
*** lvdongbing has quit IRC00:13
*** kgalanov_ has quit IRC00:32
*** kgalanov_ has joined #openstack-sahara00:33
*** lvdongbing has joined #openstack-sahara00:33
openstackgerritOpenStack Proposal Bot proposed openstack/python-saharaclient: Updated from global requirements  https://review.openstack.org/22111501:07
*** hdd has quit IRC01:11
*** ashishb has quit IRC01:27
*** Yanyanhu has joined #openstack-sahara01:39
*** Yanyan has joined #openstack-sahara01:40
*** Yanyanhu has quit IRC01:44
*** Yanyan has quit IRC01:44
*** Yanyanhu has joined #openstack-sahara01:45
*** hdd has joined #openstack-sahara02:14
*** Poornima has joined #openstack-sahara02:15
*** lvdongbing has quit IRC02:43
*** lvdongbing has joined #openstack-sahara02:46
*** Poornima has quit IRC02:55
*** Poornima has joined #openstack-sahara02:59
*** Venkatesh has joined #openstack-sahara03:05
*** Poornima has quit IRC03:09
*** macjack has joined #openstack-sahara03:22
openstackgerritMerged openstack/sahara: Fixed service restart in MapR plugin  https://review.openstack.org/22420803:45
*** ashishb has joined #openstack-sahara04:21
*** Yanyan has joined #openstack-sahara05:03
*** Yanyanhu has quit IRC05:06
*** hdd has quit IRC05:09
*** hdd has joined #openstack-sahara05:10
*** esikachev has joined #openstack-sahara05:11
*** ashishb has quit IRC05:14
*** ashishb has joined #openstack-sahara05:14
*** ashishb has quit IRC05:15
*** ashishb has joined #openstack-sahara05:15
*** esikachev has quit IRC05:18
*** esikachev has joined #openstack-sahara05:27
*** vgridnev has joined #openstack-sahara05:36
openstackgerritEvgeny Sikachev proposed openstack/sahara: Add ability running tests on exist cluster  https://review.openstack.org/22585405:44
openstackgerritEvgeny Sikachev proposed openstack/sahara: Add ability running tests on exist cluster  https://review.openstack.org/22585405:46
*** macjack has quit IRC05:49
*** vgridnev has quit IRC05:52
*** hdd has quit IRC05:57
*** macjack has joined #openstack-sahara05:58
*** nkrinner has joined #openstack-sahara06:00
*** vgridnev has joined #openstack-sahara06:10
*** ealcaniz has joined #openstack-sahara06:13
openstackgerritEvgeny Sikachev proposed openstack/sahara: [WIP] Run several edp jobs flows  https://review.openstack.org/22668806:13
*** vgridnev has quit IRC06:15
*** macjack has quit IRC06:20
*** ealcaniz has left #openstack-sahara06:22
*** vgridnev has joined #openstack-sahara06:25
*** esikachev has quit IRC06:44
openstackgerritVitaly Gridnev proposed openstack/sahara: Register sahara image using sahara image registry  https://review.openstack.org/22714406:47
openstackgerritVitaly Gridnev proposed openstack/sahara: Register sahara image using sahara image registry  https://review.openstack.org/22714406:50
*** larainema has joined #openstack-sahara06:59
*** madong_ has quit IRC06:59
*** larainema has quit IRC07:01
*** larainema has joined #openstack-sahara07:01
openstackgerritMerged openstack/python-saharaclient: Shows reason of failure in base.get  https://review.openstack.org/22596407:02
openstackgerritVitaly Gridnev proposed openstack/sahara: Register sahara image using sahara image registry  https://review.openstack.org/22714407:08
openstackgerritMerged openstack/python-saharaclient: Adding missed public/protected support for jobs creation  https://review.openstack.org/22099407:10
*** vgridnev has quit IRC07:18
*** stevemar has quit IRC07:20
*** stevemar has joined #openstack-sahara07:21
*** stevemar has quit IRC07:24
*** Yanyan has quit IRC07:26
*** ashishb has quit IRC07:31
*** ashishb has joined #openstack-sahara07:31
openstackgerritMerged openstack/python-saharaclient: Change ignore-errors to ignore_errors  https://review.openstack.org/22582407:39
openstackgerritMerged openstack/python-saharaclient: Remove duplicate .coverage in .gitignore file  https://review.openstack.org/22628107:39
*** vgridnev has joined #openstack-sahara07:50
*** jamielennox is now known as jamielennox|away07:53
openstackgerritAndrey Pavlov proposed openstack/python-saharaclient: Adding return of updated image for update_image, update_tags  https://review.openstack.org/22125707:58
*** witlessb has joined #openstack-sahara07:58
openstackgerritEvgeny Sikachev proposed openstack/sahara: Adding ability run several edp jobs flows  https://review.openstack.org/22668808:05
*** macjack has joined #openstack-sahara08:06
openstackgerritVitaly Gridnev proposed openstack/sahara: Register sahara image using sahara image registry  https://review.openstack.org/22714408:17
*** madong_ has joined #openstack-sahara08:31
*** larainema has quit IRC08:31
*** sgotliv has quit IRC08:36
*** sgotliv has joined #openstack-sahara08:41
*** madong_ has quit IRC09:22
openstackgerritVitaly Gridnev proposed openstack/sahara-image-elements: Allow building prepared images for Ironic  https://review.openstack.org/22165109:30
openstackgerritVitaly Gridnev proposed openstack/sahara-image-elements: Allow building prepared images for Ironic  https://review.openstack.org/22165109:34
*** tosky has joined #openstack-sahara09:42
*** lvdongbing has quit IRC09:46
vgridnevpino|work, do you know progress of this bug: https://bugs.launchpad.net/diskimage-builder/+bug/147040009:48
openstackLaunchpad bug 1470400 in diskimage-builder "element grub2 worked with centos7, but not ubuntu." [Medium,Triaged]09:48
vgridnev?09:48
* pino|work looks09:48
openstackgerritVitaly Gridnev proposed openstack/sahara-image-elements: Allow building prepared images for Ironic  https://review.openstack.org/22165109:50
openstackgerritVitaly Gridnev proposed openstack/sahara-image-elements: Allow building prepared images for Ironic  https://review.openstack.org/22165109:53
pino|workvgridnev: hm not really -- does it still happen with latest dib?09:54
vgridnevwhen my first patchset was uploaded for above CR, this issue was still presented09:55
vgridnevnot sure now09:55
pino|work~2 weeks ago09:56
pino|worklet's see09:56
*** Venkatesh has quit IRC09:57
toskymaybe something to do with the shim for secure boot?09:57
toskytesting with debian could give some hints maybe09:57
pino|worktosky: you mean like09:59
pino|work+ apt-get --option Dpkg::Options::=--force-confold --assume-yes install linux-image-generic grub-pc-bin grub-efi-amd64-signed ccache shim-signed09:59
pino|work?09:59
toskypino|work: I was checking the logs from the bug10:00
pino|workvgridnev: seems working here, at least the ubuntu invocation written in the bug completed successful in my dib vm10:02
pino|worki'm using dib from master, but there were no relevant changes since the last tag (1.1.2)10:04
vgridnevit looks like issue presented in 1.1.210:24
vgridnevnow i'm trying master10:25
openstackgerritMerged openstack/python-saharaclient: Remove `data source update` from setup.cfg  https://review.openstack.org/22595610:32
openstackgerritEvgeny Sikachev proposed openstack/sahara: Add ability running tests on exist cluster  https://review.openstack.org/22585410:34
*** EinstCrazy has joined #openstack-sahara10:34
*** Venkatesh has joined #openstack-sahara10:36
openstackgerritVitaly Gridnev proposed openstack/sahara: Register sahara image using sahara image registry  https://review.openstack.org/22714410:49
openstackgerritVitaly Gridnev proposed openstack/sahara: Fix sahara gates  https://review.openstack.org/22714410:52
*** stevemar has joined #openstack-sahara10:52
*** ealcaniz has joined #openstack-sahara10:54
*** ealcaniz has left #openstack-sahara10:54
*** stevemar has quit IRC10:55
openstackgerritEvgeny Sikachev proposed openstack/sahara: Restructure edp_jobs_flow for cdh 5.4.0 and spark  https://review.openstack.org/22722811:06
openstackgerritVitaly Gridnev proposed openstack/sahara: Use explicit version of image client in gates  https://review.openstack.org/22714411:07
*** macjack has left #openstack-sahara11:08
openstackgerritVitaly Gridnev proposed openstack/sahara: Use explicit version of image client in gates  https://review.openstack.org/22714411:09
vgridnevpino|work, have you seen that we always have c6.6 jobs failed for dib?11:27
vgridnevfor vanilla plugin11:27
pino|workvgridnev: well, it used to work in the past...11:37
*** ashishb has quit IRC12:00
*** AndreyPavlov has joined #openstack-sahara12:05
*** tmckay has joined #openstack-sahara12:05
pino|workvgridnev: regarding the grub2 element issue, do you have a log of disk-image-create -x etc?12:14
vgridnevOoops, it looks like my vm issue12:18
*** hdd has joined #openstack-sahara12:18
vgridnevhttp://paste.openstack.org/show/473862/12:19
vgridnevpino|work, ^^12:20
* pino|work looks12:20
vgridnevor not ?12:20
pino|workit does not get stuck, but dpkg fails mostly because some maintscript (preinst/postinst) failed12:21
*** tmckay has quit IRC12:23
pino|workvgridnev: what distro is on the host where you use/run disk-image-create?12:24
vgridnevubuntu12:25
pino|workhm12:25
pino|workworked fine on my f21 vm12:26
*** raildo-afk is now known as raildo12:29
*** Venkatesh has quit IRC12:32
vgridnevI will try to use another vm to do that12:35
*** jamielennox|away is now known as jamielennox12:37
*** EinstCrazy has quit IRC12:46
*** _crobertsrh is now known as crobertsrh12:47
*** stevemar has joined #openstack-sahara12:53
openstackgerritEvgeny Sikachev proposed openstack/sahara: Add ability running tests on exist cluster  https://review.openstack.org/22585412:54
*** stevemar has quit IRC12:57
openstackgerritVitaly Gridnev proposed openstack/sahara: Use explicit version of image client in gates  https://review.openstack.org/22714413:00
*** AndreyPavlov has quit IRC13:08
*** AndreyPavlov has joined #openstack-sahara13:08
*** EinstCrazy has joined #openstack-sahara13:12
*** Venkatesh has joined #openstack-sahara13:26
openstackgerritAndrey Pavlov proposed openstack/python-saharaclient: Adding update and minor fixes to Data Sources CLI  https://review.openstack.org/22171413:31
openstackgerritAndrey Pavlov proposed openstack/python-saharaclient: Adding sahara_url and endpoint_type to OpenstackClient CLI  https://review.openstack.org/22094613:31
*** tmckay has joined #openstack-sahara13:32
tellesnobregacrobertsrh, ping13:33
crobertsrhyessir?13:33
tellesnobregai have a openstack installed (kilo version)13:33
crobertsrhok13:33
tellesnobregaits not devstack13:33
crobertsrhpackstack?13:33
tellesnobregai want to change some stuff in horizon (add storm stuff) so i can test it out13:33
crobertsrhOk, should be doable.13:34
tellesnobregait was installed  following this tutorial (http://docs.openstack.org/kilo/install-guide/install/apt/content/install_dashboard.html)13:34
crobertsrhOk, so this is on ubuntu?13:34
tellesnobregayes13:34
tellesnobregai made the changes, the html part worked, i can see storm on the job list on the help and so on, but the python didn't13:35
crobertsrhI have never done such an install on ubuntu, but it should be just like changing the devstack horizon.  Make changes and then restart apache213:35
tellesnobregaafter the changes I ran python manage.py collectstatic && manage.py compress13:35
tellesnobregarestarted apache but it didn't work13:36
crobertsrhHmm13:36
tellesnobregai was hoping you had an idea on how to make that happen13:36
crobertsrhMaybe try removing the .pyc files (located in the same dir that you made .py changes in)?13:36
crobertsrhThen restart apache again?13:36
tellesnobregaok13:37
crobertsrhany luck?13:43
tellesnobregano13:44
crobertsrhI'll try bringing up an ubuntu box and making changes to the dashboard.13:45
tellesnobregathanks13:45
*** egafford has joined #openstack-sahara13:46
crobertsrhtellesnobrega:  curious.  If you make a bad change (that shouldn't even compile --- wrong syntax), does apache2 still reload?13:47
openstackgerritDenis Egorenko proposed openstack/puppet-sahara: Introduce Sahara extended logging class  https://review.openstack.org/22731013:47
crobertsrhor rather restart?13:47
openstackgerritDenis Egorenko proposed openstack/puppet-sahara: Introduce Sahara extended logging class  https://review.openstack.org/22731013:49
tellesnobregahaven't tried it13:50
*** esikachev has joined #openstack-sahara13:50
*** vsham20 has joined #openstack-sahara13:51
crobertsrhewww...ugly ubuntu theme on horizon13:54
openstackgerritZhao Lei proposed openstack/sahara: Fix spelling typo in xml files  https://review.openstack.org/22731713:54
vsham20hello...i'm new here...so can you help me with getting started?13:54
*** EinstCrazy has quit IRC13:57
crobertsrhtellesnobrega:  My change was reflected when I made a change and did service apache2 reload13:57
tellesnobregadevstack?13:58
tellesnobregavsham20, hey, welcome to sahara, whatever you need just shoot and someone will come to help13:58
tellesnobregacrobertsrh, devstack?13:59
crobertsrhNo, I just fired-up an ubuntu vm, installed the openatack-dashboard package and pointed it at my local stack.13:59
crobertsrhThen made a quick change to /usr/share/openstack-dashboard/openstack_dashboard/dashboards/project/instances/panel.py13:59
tellesnobregahum14:00
crobertsrhafter a reload, my change was there14:00
tellesnobregai just tried adding some error to the code but it still compressed and apache reloaded14:00
VenkateshHi all,14:00
Venkateshwhere the meeting discussions will happen?14:00
tellesnobregai think i will try firing a new horizon and pointing to my stack14:01
pino|work#openstack-meeting-314:01
Venkateshis it in IRC?14:01
VenkateshOk, Thanks14:01
pino|worksee also https://wiki.openstack.org/wiki/Meetings/SaharaAgenda14:01
*** weiting has joined #openstack-sahara14:01
*** hdd has quit IRC14:02
egaffordSergeyLukjanov: Meeting?14:02
SergeyLukjanovyup14:04
SergeyLukjanovjust 7am and I've been trying to understand in which channel it should be started, egafford14:04
egaffordSergeyLukjanov: :)14:05
openstackgerritSergey Reshetnyak proposed openstack/sahara: HA for NameNode and ResourceManager in HDP 2.2  https://review.openstack.org/19755114:21
*** japplewhite has joined #openstack-sahara14:21
*** jamielennox is now known as jamielennox|away14:26
*** weiting_ has joined #openstack-sahara14:29
*** weiting has quit IRC14:30
*** esikache1 has joined #openstack-sahara14:34
*** esikachev has quit IRC14:36
*** weiting has joined #openstack-sahara14:38
*** EinstCrazy has joined #openstack-sahara14:40
*** weiting_ has quit IRC14:41
*** ashishb has joined #openstack-sahara14:44
*** esikache1 has quit IRC14:48
*** stevemar has joined #openstack-sahara14:54
*** hdd has joined #openstack-sahara15:00
*** weiting has quit IRC15:03
SergeyLukjanovelmiko, I think my home or hotel internet always trying to stop working at the end of hour, heh15:06
elmikolol15:06
elmikoSergeyLukjanov: we just need to have a couple chairs in the future, HA meeting chairs ;)15:06
toskyelmiko: a point about "Supported plugin release matrix and deprecation policy", which kind of discussion is? Fishbowl, working room... I didn't check the difference in depth15:06
SergeyLukjanovelmiko, yup15:06
elmikotosky: that's a working room15:06
elmikotosky: fishbowl are for the big topics that might draw a crowd, we only have 2 of those and they are in bigger rooms15:07
SergeyLukjanovtosky, IMO working room - we need some desicion ;)15:07
elmikoworking room is a smaller team type of meeting15:07
elmikoSergeyLukjanov: lol15:07
elmikoso SergeyLukjanov, do you think that https://bugs.launchpad.net/sahara/+bug/1426398 is something that an intern could handle implementing?15:07
openstackLaunchpad bug 1426398 in Sahara "Current anti-affinity only allows instances equals to number of hypervisors" [Wishlist,Triaged]15:07
elmikoor might there be a better feature that i could use for a project?15:08
*** Venkatesh has quit IRC15:18
*** Erming_ has quit IRC15:35
openstackgerritAndrey Pavlov proposed openstack/python-saharaclient: Adding sahara_url and endpoint_type to OpenstackClient CLI  https://review.openstack.org/22094615:43
*** larainema has joined #openstack-sahara15:48
*** degorenko has quit IRC16:00
*** degorenko has joined #openstack-sahara16:01
*** AndreyPavlov has quit IRC16:14
SergeyLukjanovelmiko, I think it's question of creating few server groups in nova per cluster and smart balance vms between them16:14
SergeyLukjanovtmckay, elmiko, egafford, please take a look on patches from https://etherpad.openstack.org/p/sahara-liberty-release-patches16:15
tmckaySergeyLukjanov, will do, just starting lunch :)16:16
elmikoSergeyLukjanov: ack, thanks for the advice. that seems doable by an intern, i will write this up as a possible project for outreachy.16:16
*** nkrinner has quit IRC16:23
*** SergeyLukjanov has quit IRC16:24
*** SergeyLukjanov has joined #openstack-sahara16:24
SergeyLukjanovelmiko, yeah, I think it should be doable16:26
SergeyLukjanovelmiko, not sure about details - need to be researched16:26
elmikoSergeyLukjanov: yea, i'm gonna take a look into it during the next week or so16:27
*** EinstCrazy has quit IRC16:34
vgridnevelmiko, many things are doable for interns16:38
elmikovgridnev: i'm open to suggestions if you have a project in mind =)16:39
vgridnevno actually, that is not I wanted to say. I meant that a month ago I was also intern16:40
elmikoah, ok =)16:40
elmikoi'm just trying to figure out a project that i can scope for an intern.16:40
vgridnevAre you familiar with Murano?16:42
elmikoonly a little bit16:43
*** raildo is now known as raildo-afk16:45
*** raildo-afk is now known as raildo16:48
*** vsham20 has left #openstack-sahara16:58
*** hdd has quit IRC17:01
*** raildo is now known as raildo-afk17:24
*** raildo-afk is now known as raildo17:34
*** japplewhite has left #openstack-sahara17:41
*** hdd has joined #openstack-sahara17:46
*** tosky has quit IRC17:46
openstackgerritDenis Egorenko proposed openstack/puppet-sahara: Introduce Sahara extended logging class  https://review.openstack.org/22731018:05
*** ashishb has quit IRC18:08
*** ashishb has joined #openstack-sahara18:21
*** vsham20 has joined #openstack-sahara18:22
openstackgerritMerged openstack/sahara: Use explicit version of image client in gates  https://review.openstack.org/22714418:49
openstackgerritMerged openstack/sahara: Register SSL cert in Java keystore to access to swift via SSL  https://review.openstack.org/21674818:50
openstackgerritMerged openstack/sahara: Fix missed service message in MapR plugin  https://review.openstack.org/22562518:55
*** hdd has quit IRC19:19
*** larainema has quit IRC19:32
*** larainema has joined #openstack-sahara19:32
*** vsham20 has left #openstack-sahara19:56
tellesnobregacrobertsrh, do you know in sahara_ui where it is checked for the allowed job types to create a template?19:57
tellesnobregakilo version?19:57
tellesnobrega.19:57
crobertsrhI forget if it was changed for Kilo or not.  At one point, it was hard-coded.19:57
tellesnobregai can see storm now on the drop down to create19:58
tellesnobregabut when i try i get an error saying that its not one of the allowed types19:58
crobertsrhAt some point, it was change dto call job_types_list19:58
crobertsrhHmm, was Storm a valid job type on the server-side for Kilo?19:59
crobertsrhI'm assuming that you're getting an exception from the Sahara service rather than horizon itself.20:00
tellesnobregai was thinking that right now20:00
tellesnobregabut i enabled the plugin20:00
*** hdd has joined #openstack-sahara20:00
crobertsrhI wonder if there is another piece in there somewhere.  tmckay might know for sure.20:01
tmckaynot sure.  is horizon calling Sahara for supported job types?20:02
tmckayor is it hardcoded?  Sahara log in debug mode should show something20:02
tellesnobregaprobably not, it has its own map of plubins20:02
tellesnobregaplugins20:02
*** macjack has joined #openstack-sahara20:03
tellesnobregai got an error in sahara.log  2015-09-24 16:48:17.568 27176 ERROR sahara.utils.api [-] Validation Error occurred: error_code=400, error_message=u'Storm' is not one of ['Hive', 'Java', 'MapReduce', 'MapReduce.Streaming', 'Pig', 'Shell', 'Spark'], error_name=VALIDATION_ERROR20:03
crobertsrhI know that we now call sahara for supported job types....this is Kilo that we're talking about20:03
*** macjack has left #openstack-sahara20:03
tellesnobregai was able to start a storm cluster20:05
tellesnobregabut i'm not sure about job type in horizon20:05
tellesnobregain sahara20:06
tellesnobregai'm not sure if edp for storm was already in kilo as well20:08
tmckaytellesnobrega, hmm, there is no storm job type in kilo utils/edp.py20:12
tmckaythat is in Sahara20:12
tmckay(from stable/kilo branch)20:12
tmckaytellenobrega, if you have to run against a kilo, you might be able to grab the patches and apply them20:13
tellesnobregatmckay, i want to try that, but there are other people using this sahara20:14
tmckay:)20:14
tellesnobregaand one really important experiment is running right now20:15
tellesnobregaso i don't want to break it20:15
tellesnobregai have to think of something else, probably a devstack20:15
openstackgerritMerged openstack/sahara: Fix problem with loading Ambari configs  https://review.openstack.org/22636720:30
*** vsham20 has joined #openstack-sahara20:36
*** vsham20 has left #openstack-sahara20:37
*** raildo is now known as raildo-afk20:56
*** tmckay has left #openstack-sahara21:08
*** hdd has quit IRC21:15
*** crobertsrh is now known as _crobertsrh21:20
openstackgerritMerged openstack/python-saharaclient: Updated from global requirements  https://review.openstack.org/22111521:34
*** vgridnev has quit IRC21:44
*** witlessb has quit IRC21:46
openstackgerritMerged openstack/python-saharaclient: Updating saharaclient api docs  https://review.openstack.org/22101322:17
*** stevemar has quit IRC22:30
*** pino|work_ has joined #openstack-sahara22:45
*** pino|work has quit IRC22:48
*** hdd has joined #openstack-sahara22:57
*** stevemar has joined #openstack-sahara23:31
*** stevemar has quit IRC23:33
*** jamielennox|away is now known as jamielennox23:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!