*** ViswaV has joined #openstack-sahara | 00:02 | |
*** agireud has quit IRC | 00:07 | |
*** agireud has joined #openstack-sahara | 00:13 | |
*** witlessb has quit IRC | 00:16 | |
*** chlong has joined #openstack-sahara | 00:16 | |
*** agireud has quit IRC | 00:18 | |
*** agireud has joined #openstack-sahara | 00:21 | |
*** poseidon1157 has quit IRC | 00:25 | |
*** jinxing has joined #openstack-sahara | 00:30 | |
openstackgerrit | Merged openstack/sahara: Remove version from setup.cfg https://review.openstack.org/252890 | 00:42 |
---|---|---|
*** agireud has quit IRC | 00:42 | |
*** jinxing has quit IRC | 00:56 | |
*** jinxing has joined #openstack-sahara | 00:58 | |
*** agireud has joined #openstack-sahara | 01:12 | |
*** agireud has quit IRC | 01:14 | |
*** agireud has joined #openstack-sahara | 01:30 | |
*** hdd has quit IRC | 01:34 | |
*** agireud has quit IRC | 01:34 | |
*** agireud has joined #openstack-sahara | 01:48 | |
*** agireud has quit IRC | 01:53 | |
*** jinxing has quit IRC | 02:00 | |
*** agireud has joined #openstack-sahara | 02:03 | |
*** ViswaV has quit IRC | 02:05 | |
*** agireud has quit IRC | 02:07 | |
*** jinxing has joined #openstack-sahara | 02:10 | |
*** ViswaV has joined #openstack-sahara | 02:12 | |
*** poseidon1157 has joined #openstack-sahara | 02:18 | |
*** poseidon1157 has joined #openstack-sahara | 02:18 | |
*** poseidon1157 has quit IRC | 02:19 | |
openstackgerrit | Jaxon Wang proposed openstack/sahara: Refine the code for CDH PluginUtils class https://review.openstack.org/250810 | 02:21 |
openstackgerrit | Jaxon Wang proposed openstack/sahara: Add unit test cases for cdh plugin utils https://review.openstack.org/248068 | 02:21 |
*** poseidon1157 has joined #openstack-sahara | 02:22 | |
*** poseidon1157 has quit IRC | 02:23 | |
*** poseidon1157 has joined #openstack-sahara | 02:29 | |
*** ViswaV has quit IRC | 02:29 | |
*** ViswaV has joined #openstack-sahara | 02:31 | |
*** adelia has joined #openstack-sahara | 02:34 | |
*** adelia has quit IRC | 02:39 | |
*** adelia has joined #openstack-sahara | 02:40 | |
*** jinxing has quit IRC | 02:42 | |
*** adelia has quit IRC | 02:44 | |
*** Poornima has joined #openstack-sahara | 02:48 | |
*** adelia has joined #openstack-sahara | 02:53 | |
*** adelia has quit IRC | 02:54 | |
*** adelia has joined #openstack-sahara | 02:54 | |
*** ViswaV has quit IRC | 02:57 | |
*** adelia has quit IRC | 02:59 | |
*** hdd has joined #openstack-sahara | 03:24 | |
*** links has joined #openstack-sahara | 04:00 | |
*** hdd has quit IRC | 04:08 | |
*** links has quit IRC | 04:23 | |
*** hdd has joined #openstack-sahara | 04:34 | |
*** agireud has joined #openstack-sahara | 04:51 | |
*** hdd has quit IRC | 04:56 | |
openstackgerrit | ChangBo Guo(gcb) proposed openstack/sahara: test: make enforce_type=True in CONF.set_override https://review.openstack.org/247427 | 05:03 |
*** links has joined #openstack-sahara | 05:09 | |
*** agireud has quit IRC | 05:23 | |
*** hdd has joined #openstack-sahara | 05:26 | |
*** agireud has joined #openstack-sahara | 05:26 | |
*** agireud has quit IRC | 05:35 | |
*** adelia has joined #openstack-sahara | 05:37 | |
*** adelia has quit IRC | 05:42 | |
*** rcernin has joined #openstack-sahara | 06:12 | |
*** hdd has quit IRC | 06:20 | |
*** poseidon1157 has quit IRC | 06:35 | |
*** agireud has joined #openstack-sahara | 06:50 | |
*** agireud has quit IRC | 06:54 | |
*** rcernin has quit IRC | 06:59 | |
*** agireud has joined #openstack-sahara | 07:04 | |
*** rcernin has joined #openstack-sahara | 07:07 | |
*** agireud has quit IRC | 07:09 | |
*** chlong has quit IRC | 07:19 | |
*** sgotliv__ has quit IRC | 07:42 | |
*** Poornima has quit IRC | 08:16 | |
*** Poornima has joined #openstack-sahara | 08:26 | |
*** Poornima has quit IRC | 08:32 | |
*** Poornima has joined #openstack-sahara | 08:35 | |
*** vgridnev has quit IRC | 08:40 | |
*** witlessb has joined #openstack-sahara | 08:54 | |
*** _degorenko|afk is now known as degorenko | 09:03 | |
-openstackstatus- NOTICE: Tox tests are broken at the moment. From openstack-infra we are working to fix them. Please don't approve changes until we notify that tox tests work again. | 09:31 | |
*** vgridnev has joined #openstack-sahara | 09:34 | |
*** sgotliv__ has joined #openstack-sahara | 10:00 | |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara-dashboard: ACL support in Sahara UI https://review.openstack.org/253418 | 10:14 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara-dashboard: ACL support in Sahara UI https://review.openstack.org/253418 | 10:19 |
*** sgotliv__ has quit IRC | 10:22 | |
*** agireud has joined #openstack-sahara | 10:29 | |
openstackgerrit | Shu Muto proposed openstack/python-saharaclient: Remove py26 support https://review.openstack.org/252246 | 10:31 |
*** openstackgerrit has quit IRC | 10:32 | |
*** openstackgerrit has joined #openstack-sahara | 10:32 | |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara-dashboard: [Sahara] Move cluster configuration to separate tab https://review.openstack.org/253424 | 10:33 |
*** agireud has quit IRC | 10:34 | |
*** Poornima has quit IRC | 10:38 | |
*** tosky has joined #openstack-sahara | 10:52 | |
*** vgridnev has quit IRC | 10:52 | |
*** vgridnev has joined #openstack-sahara | 10:54 | |
*** poseidon1157 has joined #openstack-sahara | 11:02 | |
*** esikachev has joined #openstack-sahara | 11:27 | |
*** esikachev has quit IRC | 11:31 | |
*** adelia has joined #openstack-sahara | 11:42 | |
*** chlong has joined #openstack-sahara | 11:44 | |
*** adelia has quit IRC | 11:46 | |
*** noqa_v_g1ovnie is now known as noqa_v_qoovnie | 11:58 | |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add ability to get auth token from auth plugin https://review.openstack.org/251835 | 12:14 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add ability to get auth token from auth plugin https://review.openstack.org/251835 | 12:16 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add ability to get auth token from auth plugin https://review.openstack.org/251835 | 12:21 |
*** raildo-afk is now known as raildo | 12:21 | |
*** raildo is now known as raildo-afk | 12:24 | |
*** raildo-afk is now known as raildo | 12:24 | |
*** sgotliv__ has joined #openstack-sahara | 12:31 | |
*** adelia has joined #openstack-sahara | 12:43 | |
*** adelia has quit IRC | 12:48 | |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add ability to get auth token from auth plugin https://review.openstack.org/251835 | 12:55 |
openstackgerrit | Evgeny Sikachev proposed openstack/sahara-specs: Move sahara tests to seperate repository https://review.openstack.org/250419 | 12:56 |
*** hdd has joined #openstack-sahara | 13:18 | |
*** degorenko is now known as degorenko|afk | 13:26 | |
*** sgotliv__ has quit IRC | 13:29 | |
openstackgerrit | Jaxon Wang proposed openstack/sahara: Add test cases for CDH plugin config_helper https://review.openstack.org/253494 | 13:32 |
*** poseidon1157 has quit IRC | 13:34 | |
*** poseidon1157 has joined #openstack-sahara | 13:42 | |
*** david-lyle has quit IRC | 13:43 | |
*** adelia has joined #openstack-sahara | 13:45 | |
openstackgerrit | Merged openstack/python-saharaclient: Remove py26 support https://review.openstack.org/252246 | 13:46 |
*** adelia has quit IRC | 13:50 | |
*** nkrinner has quit IRC | 13:51 | |
openstackgerrit | Merged openstack/python-saharaclient: Delete python bytecode before every test run https://review.openstack.org/252174 | 13:51 |
*** tellesnobrega is now known as tellesnobrega_af | 13:55 | |
*** _crobertsrh is now known as crobertsrh | 13:58 | |
*** raildo is now known as raildo-afk | 13:59 | |
*** degorenko|afk is now known as degorenko | 13:59 | |
*** tmckay has joined #openstack-sahara | 14:00 | |
*** nkrinner has joined #openstack-sahara | 14:02 | |
*** tmckay has left #openstack-sahara | 14:02 | |
*** links has quit IRC | 14:02 | |
*** nkrinner has quit IRC | 14:05 | |
*** tellesnobrega_af is now known as tellesnobrega | 14:15 | |
*** hdd has quit IRC | 14:19 | |
openstackgerrit | Jaxon Wang proposed openstack/sahara: Add test cases for CDH plugin config_helper https://review.openstack.org/253494 | 14:22 |
*** _mattf is now known as mattf | 14:23 | |
*** akuznetsov has joined #openstack-sahara | 14:23 | |
*** mattf has quit IRC | 14:24 | |
*** mattf has joined #openstack-sahara | 14:24 | |
*** tmckay has joined #openstack-sahara | 14:27 | |
*** adelia has joined #openstack-sahara | 14:27 | |
openstackgerrit | Denis Egorenko proposed openstack/puppet-sahara: Fix defaults for doc section https://review.openstack.org/253528 | 14:32 |
*** mattf is now known as _mattf | 14:45 | |
*** crobertsrh has quit IRC | 14:47 | |
openstackgerrit | Merged openstack/python-saharaclient: Adding indications of results after delete operations https://review.openstack.org/249784 | 14:48 |
*** crobertsrh has joined #openstack-sahara | 14:51 | |
*** hdd has joined #openstack-sahara | 14:53 | |
*** akuznetsov has quit IRC | 15:06 | |
*** tellesnobrega is now known as tellesnobrega_af | 15:09 | |
*** egafford has joined #openstack-sahara | 15:09 | |
*** degorenko has quit IRC | 15:27 | |
*** degorenko has joined #openstack-sahara | 15:31 | |
*** vgridnev has quit IRC | 15:39 | |
*** vgridnev has joined #openstack-sahara | 15:40 | |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: rewrite heat client calls https://review.openstack.org/251488 | 15:47 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: rewrite heat client calls https://review.openstack.org/251488 | 15:49 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: rewrite heat client calls https://review.openstack.org/251488 | 15:49 |
*** raildo-afk is now known as raildo | 16:10 | |
*** raildo is now known as raildo-afk | 16:11 | |
*** raildo-afk is now known as raildo | 16:12 | |
*** _mattf is now known as mattf | 16:15 | |
*** vgridnev has quit IRC | 16:18 | |
*** degorenko is now known as _degorenko|afk | 16:44 | |
*** david-lyle has joined #openstack-sahara | 16:49 | |
*** rcernin has quit IRC | 16:52 | |
-openstackstatus- NOTICE: The earlier JJB bug which disrupted tox-based job configurations has been reverted and applied; jobs seem to be running successfully for the past two hours. | 16:54 | |
*** ViswaV has joined #openstack-sahara | 16:58 | |
*** datainadequate has joined #openstack-sahara | 17:04 | |
*** datainadequate has quit IRC | 17:05 | |
*** datainadequate has joined #openstack-sahara | 17:06 | |
*** vgridnev has joined #openstack-sahara | 17:08 | |
openstackgerrit | David Lyle proposed openstack/sahara-dashboard: WIP: adding integration test support https://review.openstack.org/253614 | 17:09 |
*** david-lyle has quit IRC | 17:13 | |
datainadequate | Is this channel just for team discussions, or are general questions about Sahara appropriate here? | 17:13 |
elmiko | datainadequate: general questions are appropriate =) | 17:15 |
elmiko | really, anything about the sahara project is fair | 17:15 |
datainadequate | Thanks elmiko | 17:15 |
datainadequate | I was wondering what was happening about HDP support? I saw there was a spec to add a new plugin: http://specs.openstack.org/openstack/sahara-specs/specs/liberty/hdp-22-support.html | 17:16 |
datainadequate | But I couldn’t find any info about how this was progressing. | 17:17 |
elmiko | afaik the updated plugin is being worked on by sreshetnyak | 17:17 |
elmiko | i'm not sure on the current status though | 17:17 |
elmiko | as i recall there was a good deal of work to refactor the plugin, but you are correct in that there hasn't been a status update since the end of liberty | 17:18 |
elmiko | we do have a new ambari plugin that is under development, i imagine there might be an effort to get that in working order first. i'm not sure | 17:19 |
elmiko | vgridnev: are you still around, know anything about this ^^ (hdp 2.2) | 17:19 |
*** adelia has quit IRC | 17:19 | |
*** shakamunyi has quit IRC | 17:21 | |
vgridnev | hi, folks. Yes it's reworked plugin, but it's not fully ready because some features not implemented yet. Also, there are some bugs. That is why it's enabled by default in sahara right now | 17:22 |
vgridnev | it's not enabled, misprint | 17:22 |
elmiko | thanks vgridnev | 17:22 |
datainadequate | Ambari plugin sounds most promising to me. New HDP versions appear regularly, they’re now up to 2.3. | 17:23 |
datainadequate | Thanks vgridnev. | 17:23 |
*** adelia has joined #openstack-sahara | 17:24 | |
vgridnev | 2.3 is also supported by the plugin | 17:24 |
datainadequate | How about 2.1? <hopeful> | 17:24 |
vgridnev | no | 17:24 |
datainadequate | Oh well :) | 17:24 |
datainadequate | I have also been struggling getting CDH clusters running under Kilo. I suspect the answer is “move to Liberty”, amirite? | 17:33 |
*** adelia has quit IRC | 17:43 | |
vgridnev | datainadequate, on Kilo cdh almost stable, I think | 17:46 |
datainadequate | Hmm. Thanks vgridnev. Wonder what is going wrong then. | 17:53 |
datainadequate | The nodes are getting created ok. But when Sahara tries to start the services something always fails. sahara-all.log doesn’t have a lot of info, and I don’t know where to start looking to dig deeper. | 17:55 |
*** adelia has joined #openstack-sahara | 17:57 | |
vgridnev | could you please attach this logs? | 18:07 |
vgridnev | sahara-all logs, I think | 18:07 |
*** hdd has quit IRC | 18:14 | |
datainadequate | Sorry, I haven’t been keeping all the log data, but the error in the log was: | 18:23 |
datainadequate | 2015-12-03 14:41:24.318 30420 ERROR sahara.service.ops [-] Error during operating on cluster cdh530-default-test (reason: Failed to Provision Hadoop Cluster: Failed to Create Hive Metastore Database Tables. | 18:23 |
datainadequate | That was trying to create a cluster using Cloudera 5.3.0 plugin, using the default template provided. | 18:24 |
datainadequate | My own templates fail with the error: | 18:26 |
datainadequate | 2015-12-03 09:59:54.952 30420 ERROR sahara.service.ops [-] Error during operating on cluster byoh-cdh53-test-02b (reason: Failed to Provision Hadoop Cluster: Failed to start service. | 18:26 |
datainadequate | Error ID: 9b6ff3b7-31b5-41b9-84aa-a00eef5b4411) | 18:26 |
datainadequate | On my todo list: searching the Sahara source code to see if I can find a definition for that error code :) | 18:28 |
vgridnev | datainadequate, this code is just random uuid | 18:29 |
vgridnev | which flavors you use? | 18:29 |
datainadequate | Flavors? | 18:36 |
*** tosky has quit IRC | 18:37 | |
vgridnev | openstack flavor of vms | 18:38 |
*** mattf is now known as _mattf | 18:44 | |
*** ViswaV has quit IRC | 18:45 | |
*** ViswaV has joined #openstack-sahara | 18:49 | |
datainadequate | The base images I have to pick from are: | 18:55 |
datainadequate | sahara-kilo-cloudera-5.3.0-ubuntu-12.04.qcow2 | 18:55 |
datainadequate | sahara-kilo-cloudera-5.3.0-centos-6.6.qcow2 | 18:55 |
vgridnev | no | 18:56 |
vgridnev | I meant what is size of vms | 18:56 |
vgridnev | ram, cpu, disk | 18:56 |
datainadequate | Ah, ok. I was using a flavor called “hadoop”, but not sure how big that is. | 18:56 |
vgridnev | I don't know such flavor. It's custom flavor of your environment | 18:57 |
elmiko | datainadequate: basically, we need to know the number of CPUs, RAM, disk space. sometimes the hadoop nodes can be starved of resources which leads to errors when starting the cluster. | 19:01 |
datainadequate | Ok, makes sense. Let me take look. | 19:02 |
elmiko | flavor is the terminology used by nova (compute service) to determine these stats for a VM | 19:03 |
datainadequate | Our “hadoop” flavour has 4 VCPUs, 4GB RAM, 20GB disk. If I was to take a guess I would say that was way too little disk for Cloudera, cos Cloudera wants to install a lot of stuff. | 19:04 |
elmiko | yea could be | 19:04 |
elmiko | also, iirc, the cloudera nodes need access to the internet for installations. do those nodes have internet access? | 19:05 |
datainadequate | Yes, pretty sure they do. | 19:06 |
elmiko | k | 19:06 |
*** david-ly_ has joined #openstack-sahara | 19:06 | |
openstackgerrit | Timur Sufiev proposed openstack/sahara-dashboard: Backport changes from https://review.openstack.org/#/c/215127 https://review.openstack.org/253653 | 19:11 |
openstackgerrit | Timur Sufiev proposed openstack/sahara-dashboard: [WIP] Fight non pluggable _go_to_methods in an evil hacky way https://review.openstack.org/253654 | 19:11 |
openstackgerrit | Grigoriy Rozhkov proposed openstack/sahara: Add MapR-FS support to sahara scenario framework https://review.openstack.org/241696 | 19:13 |
*** hdd has joined #openstack-sahara | 19:21 | |
*** tellesnobrega_af is now known as tellesnobrega | 19:36 | |
*** david-ly_ is now known as david-lyle | 19:39 | |
*** datainadequate has quit IRC | 19:50 | |
*** shakamunyi has joined #openstack-sahara | 20:12 | |
openstackgerrit | Merged openstack/sahara: Adding ability disable anti_affinty check in plugin https://review.openstack.org/243638 | 20:40 |
*** poseidon1157 has quit IRC | 20:52 | |
*** raildo is now known as raildo-afk | 20:54 | |
*** adelia has quit IRC | 21:04 | |
*** witlessb has quit IRC | 21:36 | |
*** witlessb has joined #openstack-sahara | 21:37 | |
*** crobertsrh is now known as _crobertsrh | 21:59 | |
*** adelia has joined #openstack-sahara | 22:05 | |
*** adelia has quit IRC | 22:10 | |
*** david-ly_ has joined #openstack-sahara | 22:29 | |
*** david-ly_ is now known as david-lyle_ | 22:31 | |
*** david-lyle has quit IRC | 22:32 | |
*** poseidon1157 has joined #openstack-sahara | 22:49 | |
*** hdd has quit IRC | 23:16 | |
*** tellesnobrega is now known as tellesnobrega_af | 23:24 | |
*** openstack has joined #openstack-sahara | 23:36 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!