*** tellesnobrega_af is now known as tellesnobrega | 00:31 | |
*** tangchen has quit IRC | 00:47 | |
*** tellesnobrega is now known as tellesnobrega_af | 00:50 | |
*** jamielennox is now known as jamielennox|away | 01:09 | |
*** jamielennox|away is now known as jamielennox | 01:43 | |
*** tellesnobrega_af is now known as tellesnobrega | 01:44 | |
*** jamielennox is now known as jamielennox|away | 01:53 | |
*** jamielennox|away is now known as jamielennox | 02:43 | |
*** rcernin has joined #openstack-sahara | 03:09 | |
*** sgotliv__ has joined #openstack-sahara | 04:40 | |
*** sgotliv__ has quit IRC | 04:59 | |
*** Poornima has joined #openstack-sahara | 05:27 | |
*** abalutoiu has joined #openstack-sahara | 05:36 | |
*** itisha has quit IRC | 05:40 | |
*** itisha has joined #openstack-sahara | 05:47 | |
*** rcernin has quit IRC | 06:01 | |
*** sgotliv__ has joined #openstack-sahara | 06:09 | |
*** tellesnobrega is now known as tellesnobrega_af | 06:17 | |
*** pgadiya has joined #openstack-sahara | 06:20 | |
*** hogepodge has quit IRC | 06:25 | |
*** hogepodge has joined #openstack-sahara | 06:27 | |
*** tellesnobrega_af is now known as tellesnobrega | 06:30 | |
*** rcernin has joined #openstack-sahara | 06:32 | |
*** anshul has joined #openstack-sahara | 06:40 | |
*** nkrinner_afk is now known as nkrinner | 06:44 | |
*** pcaruana has joined #openstack-sahara | 06:46 | |
*** tesseract- has joined #openstack-sahara | 07:09 | |
*** vgridnev has quit IRC | 07:16 | |
*** vgridnev has joined #openstack-sahara | 07:22 | |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara-tests: test commit https://review.openstack.org/337495 | 07:24 |
---|---|---|
openstackgerrit | Vitaly Gridnev proposed openstack/sahara-tests: test commit https://review.openstack.org/337495 | 07:30 |
*** akuznetsov has joined #openstack-sahara | 07:30 | |
openstackgerrit | Pratik Gadiya proposed openstack/sahara-image-elements: [HDP2.4] Add ambari 2.2.1.0 element https://review.openstack.org/312905 | 07:39 |
openstackgerrit | Pratik Gadiya proposed openstack/sahara-image-elements: [HDP2.4] Add ambari 2.2.1.0 element https://review.openstack.org/312905 | 07:45 |
openstackgerrit | Pratik Gadiya proposed openstack/sahara-image-elements: [HDP2.4] Add ambari 2.2.1.0 element https://review.openstack.org/312905 | 07:48 |
*** chlong has quit IRC | 07:52 | |
*** akuznetsov has quit IRC | 07:52 | |
openstackgerrit | Maria Malyarova proposed openstack/sahara: Fixed spelling error https://review.openstack.org/337516 | 07:54 |
*** chlong has joined #openstack-sahara | 08:04 | |
*** esikachev has joined #openstack-sahara | 08:42 | |
*** akuznetsov has joined #openstack-sahara | 09:07 | |
*** akuznetsov has quit IRC | 09:11 | |
*** zemuvier has joined #openstack-sahara | 10:01 | |
*** akuznetsov has joined #openstack-sahara | 10:08 | |
*** akuznetsov has quit IRC | 10:12 | |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: use sessions for creating heatclient https://review.openstack.org/329932 | 10:23 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: use sessions for creating heatclient https://review.openstack.org/329932 | 10:34 |
openstackgerrit | Pratik Gadiya proposed openstack/sahara-image-elements: [HDP2.4] Add ambari 2.2.1.0 element https://review.openstack.org/312905 | 10:43 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Improvements on api for plugins https://review.openstack.org/336610 | 10:44 |
openstackgerrit | Pratik Gadiya proposed openstack/sahara-image-elements: [HDP2.4] Add ambari 2.2.1.0 element https://review.openstack.org/312905 | 10:47 |
*** itisha has quit IRC | 10:50 | |
*** rodrigods has quit IRC | 10:51 | |
*** rodrigods has joined #openstack-sahara | 10:51 | |
*** itisha has joined #openstack-sahara | 10:52 | |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara-dashboard: replacing plugins into separate panel https://review.openstack.org/334999 | 10:55 |
*** akuznetsov has joined #openstack-sahara | 11:09 | |
*** akuznetsov has quit IRC | 11:13 | |
openstackgerrit | Merged openstack/sahara: Fixed spelling error https://review.openstack.org/337516 | 11:28 |
*** akuznetsov has joined #openstack-sahara | 12:10 | |
*** chlong has quit IRC | 12:12 | |
*** akuznetsov has quit IRC | 12:15 | |
*** openstackgerrit has quit IRC | 12:19 | |
*** openstackgerrit has joined #openstack-sahara | 12:19 | |
*** chlong has joined #openstack-sahara | 12:43 | |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara-dashboard: plugins api support https://review.openstack.org/336559 | 12:43 |
openstackgerrit | Evgeny Sikachev proposed openstack/sahara-tests: Fix for uploading image in sahara_cli tests https://review.openstack.org/337101 | 12:47 |
*** _elmiko_ is now known as elmiko | 12:59 | |
*** Poornima has quit IRC | 13:00 | |
*** tmckay has joined #openstack-sahara | 13:14 | |
*** pgadiya has quit IRC | 13:17 | |
openstackgerrit | Vitaly Gridnev proposed openstack/python-saharaclient: plugin's api update support https://review.openstack.org/334963 | 13:20 |
*** links has joined #openstack-sahara | 13:38 | |
*** links has quit IRC | 13:45 | |
*** itisha has quit IRC | 13:50 | |
*** links has joined #openstack-sahara | 13:55 | |
*** links has quit IRC | 13:59 | |
*** nkrinner is now known as nkrinner_afk | 14:08 | |
*** permalac has quit IRC | 14:14 | |
*** esikachev has quit IRC | 14:22 | |
*** itisha has joined #openstack-sahara | 14:43 | |
*** abalutoiu has quit IRC | 14:46 | |
*** esikachev has joined #openstack-sahara | 14:53 | |
*** kur1j has joined #openstack-sahara | 15:00 | |
vgridnev | elmiko, hey, are you around? | 15:02 |
elmiko | vgridnev: hey | 15:02 |
vgridnev | how your presentation passed? | 15:02 |
vgridnev | actually I'm asking your to review the pagination spec from michael https://review.openstack.org/#/c/336931/ | 15:03 |
elmiko | it went really well, thanks =) | 15:03 |
elmiko | yeah, i saw your ping. i have it open, i will review it today | 15:03 |
vgridnev | ok, thanks a lot | 15:04 |
elmiko | np =) | 15:04 |
vgridnev | I hope we can get that merged till the next meeting | 15:04 |
elmiko | ok, it didn't look too bad on my first read | 15:04 |
*** anshul has quit IRC | 15:15 | |
*** esikachev has quit IRC | 15:21 | |
*** esikachev has joined #openstack-sahara | 15:29 | |
*** openstackgerrit has quit IRC | 15:33 | |
*** openstackgerrit has joined #openstack-sahara | 15:34 | |
*** esikachev has quit IRC | 15:52 | |
kur1j | vgridnev: hey, its Kevin (you sent me email regarding adding Ambari-local) to the sahara-image-elements. I added the code to the sahara-image-elements project and I was able to create an image with the HDP repositories within the image. | 16:00 |
kur1j | They are in "/var/www/html/hdp" folder on the image | 16:01 |
openstackgerrit | Michael Ionkin proposed openstack/sahara: [DOC] Inform operators about limited quotas https://review.openstack.org/337245 | 16:03 |
kur1j | I went to deploy a cluster within OS using Sahara. I changed the HDP Repo URL and HDP-UTILS repo URL within the etmplay to file:///var/www/html/hdp/centos7/2.x/updates/2.3.4.0 and file:///var/www/html/hdp-utils/repos/centos7 | 16:04 |
kur1j | but I get an error during the deployment saying os_type=os_type_map[client.get_host_info(ambari.fqdn())["os_type"]] KeyError: u'centos7' | 16:05 |
openstackgerrit | Michael Ionkin proposed openstack/sahara: [DOC] Update installation guide https://review.openstack.org/336447 | 16:09 |
*** rcernin has quit IRC | 16:31 | |
vgridnev | kur1j, so, you should pass http://<floating-ip-of-mirror>/hdp/centos7/2.x/updates/2.3.4.0 as HDP repo url | 16:32 |
*** tesseract- has quit IRC | 16:33 | |
vgridnev | same story about HDP-utils | 16:33 |
*** pcaruana has quit IRC | 16:33 | |
*** hogepodge has quit IRC | 16:34 | |
*** hogepodge has joined #openstack-sahara | 16:41 | |
*** hogepodge has quit IRC | 16:50 | |
*** hogepodge has joined #openstack-sahara | 17:02 | |
*** permalac has joined #openstack-sahara | 17:09 | |
*** rcernin has joined #openstack-sahara | 17:16 | |
*** hogepodge has quit IRC | 17:17 | |
kur1j | vgridnev: That isn't the problem. I figured it out. It looks to be an issue with the type of image that Sahara supports. I created an image based on centos7 and that isn't in the os_type_map in the deploy.py | 17:21 |
kur1j | https://github.com/openstack/sahara/blob/stable/mitaka/sahara/plugins/ambari/deploy.py#L44-L47 | 17:21 |
*** hogepodge has joined #openstack-sahara | 17:23 | |
kur1j | I added "centos7": "redhat7", "redhat7 | 17:24 |
kur1j | I added "centos7": "redhat7", "redhat7": "redhad7" to the os_type_map and it deployed sucessfully | 17:24 |
*** hogepodge has quit IRC | 17:28 | |
*** hogepodge has joined #openstack-sahara | 17:36 | |
kur1j | vgridnev: https://bugs.launchpad.net/sahara/+bug/1599252 | 17:50 |
openstack | Launchpad bug 1599252 in Sahara "Can't change HDP repo URL or HDP-UTILS repo URL unless on centos6" [Undecided,New] | 17:50 |
*** hogepodge has quit IRC | 17:55 | |
vgridnev | kur1j, nice, you may upload the fix on review | 18:03 |
kur1j | vgridnev: sorry, where is that? | 18:09 |
vgridnev | kur1j, http://docs.openstack.org/infra/manual/developers.html | 18:12 |
vgridnev | I thought that you are familiar with how we are processing new changes to openstack | 18:13 |
kur1j | vgridnev: nope | 18:14 |
-openstackstatus- NOTICE: Job instability resulting from a block storage connectivity error on mirror.iad.rax.openstack.org has been corrected; jobs running in rax-iad should be more reliable again. | 18:15 | |
vgridnev | kur1j, are you going to contribute then? | 18:22 |
kur1j | vgridnev: Yeah, I'll do it. I just need a little bit of time to go through the process | 18:23 |
vgridnev | seems like doc above should explain the process | 18:23 |
kur1j | yup. I'll just have go through the process. | 18:23 |
*** hogepodge has joined #openstack-sahara | 18:26 | |
kur1j | are there tests for this project? | 18:31 |
kur1j | sahara-image-elements that is | 18:31 |
vgridnev | yeah, we are building images for each image type in gate to validate everything ok | 18:40 |
vgridnev | also we have tests that creates image, creates cluster, executing jobs and removing the cluster | 18:40 |
kur1j | ah, I just wanted to make sure what I had changed worked and if I needed to add any tests directly to the project. | 18:44 |
kur1j | I ran through creating an image myself, and validated it worked on our cluster | 18:45 |
*** hogepodge has quit IRC | 18:53 | |
*** hogepodge has joined #openstack-sahara | 19:00 | |
*** sgotliv__ has quit IRC | 19:11 | |
*** hogepodge has quit IRC | 19:27 | |
*** hogepodge has joined #openstack-sahara | 19:29 | |
*** hogepodge has quit IRC | 19:43 | |
*** hogepodge has joined #openstack-sahara | 19:44 | |
*** stanchan has joined #openstack-sahara | 20:01 | |
*** tellesnobrega is now known as tellesnobrega_af | 20:27 | |
*** hogepodge has quit IRC | 20:29 | |
*** hogepodge has joined #openstack-sahara | 20:31 | |
*** hogepodge has quit IRC | 20:45 | |
*** hogepodge has joined #openstack-sahara | 20:47 | |
*** crobertsrh is now known as _crobertsrh | 20:58 | |
*** hogepodge has quit IRC | 21:09 | |
*** tmckay has left #openstack-sahara | 21:12 | |
*** hogepodge has joined #openstack-sahara | 21:14 | |
kur1j | is it not possible to run Spark jobs using Python within Sahara? | 21:19 |
vgridnev | kur1j, as far as I remember, there is no difference between java and python spark jobs. anyway spark-submit should will be using for job launching. but i'm not 100% sure | 21:25 |
kur1j | vgridnev: when a job fails where can you see what actually failed? other than "Done with error"? | 21:26 |
vgridnev | so, it's running under /tmp/spark-edp folder | 21:26 |
vgridnev | but it will be deeper in that directory | 21:27 |
vgridnev | in launch_command.log you will be able to see exact command which was executed | 21:29 |
vgridnev | and error.log will be there with details of job failure | 21:30 |
kur1j | ah | 21:31 |
vgridnev | ok, anyway I can't continue helping today, it's midnight in Russia right now | 21:33 |
vgridnev | bye | 21:34 |
kur1j | thanks! have a good one | 21:34 |
*** kur1j has quit IRC | 22:32 | |
*** itisha has quit IRC | 23:00 | |
*** rcernin has quit IRC | 23:18 | |
*** permalac has quit IRC | 23:35 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!