Tuesday, 2016-07-05

*** tellesnobrega_af is now known as tellesnobrega00:31
*** tangchen has quit IRC00:47
*** tellesnobrega is now known as tellesnobrega_af00:50
*** jamielennox is now known as jamielennox|away01:09
*** jamielennox|away is now known as jamielennox01:43
*** tellesnobrega_af is now known as tellesnobrega01:44
*** jamielennox is now known as jamielennox|away01:53
*** jamielennox|away is now known as jamielennox02:43
*** rcernin has joined #openstack-sahara03:09
*** sgotliv__ has joined #openstack-sahara04:40
*** sgotliv__ has quit IRC04:59
*** Poornima has joined #openstack-sahara05:27
*** abalutoiu has joined #openstack-sahara05:36
*** itisha has quit IRC05:40
*** itisha has joined #openstack-sahara05:47
*** rcernin has quit IRC06:01
*** sgotliv__ has joined #openstack-sahara06:09
*** tellesnobrega is now known as tellesnobrega_af06:17
*** pgadiya has joined #openstack-sahara06:20
*** hogepodge has quit IRC06:25
*** hogepodge has joined #openstack-sahara06:27
*** tellesnobrega_af is now known as tellesnobrega06:30
*** rcernin has joined #openstack-sahara06:32
*** anshul has joined #openstack-sahara06:40
*** nkrinner_afk is now known as nkrinner06:44
*** pcaruana has joined #openstack-sahara06:46
*** tesseract- has joined #openstack-sahara07:09
*** vgridnev has quit IRC07:16
*** vgridnev has joined #openstack-sahara07:22
openstackgerritVitaly Gridnev proposed openstack/sahara-tests: test commit  https://review.openstack.org/33749507:24
openstackgerritVitaly Gridnev proposed openstack/sahara-tests: test commit  https://review.openstack.org/33749507:30
*** akuznetsov has joined #openstack-sahara07:30
openstackgerritPratik Gadiya proposed openstack/sahara-image-elements: [HDP2.4] Add ambari 2.2.1.0 element  https://review.openstack.org/31290507:39
openstackgerritPratik Gadiya proposed openstack/sahara-image-elements: [HDP2.4] Add ambari 2.2.1.0 element  https://review.openstack.org/31290507:45
openstackgerritPratik Gadiya proposed openstack/sahara-image-elements: [HDP2.4] Add ambari 2.2.1.0 element  https://review.openstack.org/31290507:48
*** chlong has quit IRC07:52
*** akuznetsov has quit IRC07:52
openstackgerritMaria Malyarova proposed openstack/sahara: Fixed spelling error  https://review.openstack.org/33751607:54
*** chlong has joined #openstack-sahara08:04
*** esikachev has joined #openstack-sahara08:42
*** akuznetsov has joined #openstack-sahara09:07
*** akuznetsov has quit IRC09:11
*** zemuvier has joined #openstack-sahara10:01
*** akuznetsov has joined #openstack-sahara10:08
*** akuznetsov has quit IRC10:12
openstackgerritVitaly Gridnev proposed openstack/sahara: use sessions for creating heatclient  https://review.openstack.org/32993210:23
openstackgerritVitaly Gridnev proposed openstack/sahara: use sessions for creating heatclient  https://review.openstack.org/32993210:34
openstackgerritPratik Gadiya proposed openstack/sahara-image-elements: [HDP2.4] Add ambari 2.2.1.0 element  https://review.openstack.org/31290510:43
openstackgerritVitaly Gridnev proposed openstack/sahara: Improvements on api for plugins  https://review.openstack.org/33661010:44
openstackgerritPratik Gadiya proposed openstack/sahara-image-elements: [HDP2.4] Add ambari 2.2.1.0 element  https://review.openstack.org/31290510:47
*** itisha has quit IRC10:50
*** rodrigods has quit IRC10:51
*** rodrigods has joined #openstack-sahara10:51
*** itisha has joined #openstack-sahara10:52
openstackgerritVitaly Gridnev proposed openstack/sahara-dashboard: replacing plugins into separate panel  https://review.openstack.org/33499910:55
*** akuznetsov has joined #openstack-sahara11:09
*** akuznetsov has quit IRC11:13
openstackgerritMerged openstack/sahara: Fixed spelling error  https://review.openstack.org/33751611:28
*** akuznetsov has joined #openstack-sahara12:10
*** chlong has quit IRC12:12
*** akuznetsov has quit IRC12:15
*** openstackgerrit has quit IRC12:19
*** openstackgerrit has joined #openstack-sahara12:19
*** chlong has joined #openstack-sahara12:43
openstackgerritVitaly Gridnev proposed openstack/sahara-dashboard: plugins api support  https://review.openstack.org/33655912:43
openstackgerritEvgeny Sikachev proposed openstack/sahara-tests: Fix for uploading image in sahara_cli tests  https://review.openstack.org/33710112:47
*** _elmiko_ is now known as elmiko12:59
*** Poornima has quit IRC13:00
*** tmckay has joined #openstack-sahara13:14
*** pgadiya has quit IRC13:17
openstackgerritVitaly Gridnev proposed openstack/python-saharaclient: plugin's api update support  https://review.openstack.org/33496313:20
*** links has joined #openstack-sahara13:38
*** links has quit IRC13:45
*** itisha has quit IRC13:50
*** links has joined #openstack-sahara13:55
*** links has quit IRC13:59
*** nkrinner is now known as nkrinner_afk14:08
*** permalac has quit IRC14:14
*** esikachev has quit IRC14:22
*** itisha has joined #openstack-sahara14:43
*** abalutoiu has quit IRC14:46
*** esikachev has joined #openstack-sahara14:53
*** kur1j has joined #openstack-sahara15:00
vgridnevelmiko, hey, are you around?15:02
elmikovgridnev: hey15:02
vgridnevhow your presentation passed?15:02
vgridnevactually I'm asking your to review the pagination spec from michael https://review.openstack.org/#/c/336931/15:03
elmikoit went really well, thanks =)15:03
elmikoyeah, i saw your ping. i have it open, i will review it today15:03
vgridnevok, thanks a lot15:04
elmikonp =)15:04
vgridnevI hope we can get that merged till the next meeting15:04
elmikook, it didn't look too bad on my first read15:04
*** anshul has quit IRC15:15
*** esikachev has quit IRC15:21
*** esikachev has joined #openstack-sahara15:29
*** openstackgerrit has quit IRC15:33
*** openstackgerrit has joined #openstack-sahara15:34
*** esikachev has quit IRC15:52
kur1jvgridnev: hey, its Kevin (you sent me email regarding adding Ambari-local) to the sahara-image-elements. I added the code to the sahara-image-elements project and I was able to create an image with the HDP repositories within the image.16:00
kur1jThey are in "/var/www/html/hdp" folder on the image16:01
openstackgerritMichael Ionkin proposed openstack/sahara: [DOC] Inform operators about limited quotas  https://review.openstack.org/33724516:03
kur1jI went to deploy a cluster within OS using Sahara. I changed the HDP Repo URL and HDP-UTILS repo URL within the etmplay to file:///var/www/html/hdp/centos7/2.x/updates/2.3.4.0 and file:///var/www/html/hdp-utils/repos/centos716:04
kur1jbut I get an error during the deployment saying os_type=os_type_map[client.get_host_info(ambari.fqdn())["os_type"]] KeyError: u'centos7'16:05
openstackgerritMichael Ionkin proposed openstack/sahara: [DOC] Update installation guide  https://review.openstack.org/33644716:09
*** rcernin has quit IRC16:31
vgridnevkur1j, so, you should pass http://<floating-ip-of-mirror>/hdp/centos7/2.x/updates/2.3.4.0 as HDP repo url16:32
*** tesseract- has quit IRC16:33
vgridnevsame story about HDP-utils16:33
*** pcaruana has quit IRC16:33
*** hogepodge has quit IRC16:34
*** hogepodge has joined #openstack-sahara16:41
*** hogepodge has quit IRC16:50
*** hogepodge has joined #openstack-sahara17:02
*** permalac has joined #openstack-sahara17:09
*** rcernin has joined #openstack-sahara17:16
*** hogepodge has quit IRC17:17
kur1jvgridnev: That isn't the problem. I figured it out. It looks to be an issue with the type of image that Sahara supports. I created an image based on centos7 and that isn't in the os_type_map in the deploy.py17:21
kur1jhttps://github.com/openstack/sahara/blob/stable/mitaka/sahara/plugins/ambari/deploy.py#L44-L4717:21
*** hogepodge has joined #openstack-sahara17:23
kur1jI added "centos7": "redhat7", "redhat717:24
kur1jI added "centos7": "redhat7", "redhat7": "redhad7" to the os_type_map and it deployed sucessfully17:24
*** hogepodge has quit IRC17:28
*** hogepodge has joined #openstack-sahara17:36
kur1jvgridnev: https://bugs.launchpad.net/sahara/+bug/159925217:50
openstackLaunchpad bug 1599252 in Sahara "Can't change HDP repo URL or HDP-UTILS repo URL unless on centos6" [Undecided,New]17:50
*** hogepodge has quit IRC17:55
vgridnevkur1j, nice, you may upload the fix on review18:03
kur1jvgridnev: sorry, where is that?18:09
vgridnevkur1j, http://docs.openstack.org/infra/manual/developers.html18:12
vgridnevI thought that you are familiar with how we are processing new changes to openstack18:13
kur1jvgridnev: nope18:14
-openstackstatus- NOTICE: Job instability resulting from a block storage connectivity error on mirror.iad.rax.openstack.org has been corrected; jobs running in rax-iad should be more reliable again.18:15
vgridnevkur1j, are you going to contribute then?18:22
kur1jvgridnev: Yeah, I'll do it. I just need a little bit of time to go through the process18:23
vgridnevseems like doc above should explain the process18:23
kur1jyup. I'll just have go through the process.18:23
*** hogepodge has joined #openstack-sahara18:26
kur1jare there tests for this project?18:31
kur1jsahara-image-elements that is18:31
vgridnevyeah, we are building images for each image type in gate to validate everything ok18:40
vgridnevalso we have tests that creates image, creates cluster, executing jobs and removing the cluster18:40
kur1jah, I just wanted to make sure what I had changed worked and if I needed to add any tests directly to the project.18:44
kur1jI ran through creating an image myself, and validated it worked on our cluster18:45
*** hogepodge has quit IRC18:53
*** hogepodge has joined #openstack-sahara19:00
*** sgotliv__ has quit IRC19:11
*** hogepodge has quit IRC19:27
*** hogepodge has joined #openstack-sahara19:29
*** hogepodge has quit IRC19:43
*** hogepodge has joined #openstack-sahara19:44
*** stanchan has joined #openstack-sahara20:01
*** tellesnobrega is now known as tellesnobrega_af20:27
*** hogepodge has quit IRC20:29
*** hogepodge has joined #openstack-sahara20:31
*** hogepodge has quit IRC20:45
*** hogepodge has joined #openstack-sahara20:47
*** crobertsrh is now known as _crobertsrh20:58
*** hogepodge has quit IRC21:09
*** tmckay has left #openstack-sahara21:12
*** hogepodge has joined #openstack-sahara21:14
kur1jis it not possible to run Spark jobs using Python within Sahara?21:19
vgridnevkur1j, as far as I remember, there is no difference between java and python spark jobs. anyway spark-submit should will be using for job launching. but i'm not 100% sure21:25
kur1jvgridnev: when a job fails where can you see what actually failed? other than "Done with error"?21:26
vgridnevso, it's running under /tmp/spark-edp folder21:26
vgridnevbut it will be deeper in that directory21:27
vgridnevin launch_command.log you will be able to see exact command which was executed21:29
vgridnevand error.log will be there with details of job failure21:30
kur1jah21:31
vgridnevok, anyway I can't continue helping today, it's midnight in Russia right now21:33
vgridnevbye21:34
kur1jthanks! have a good one21:34
*** kur1j has quit IRC22:32
*** itisha has quit IRC23:00
*** rcernin has quit IRC23:18
*** permalac has quit IRC23:35

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!