| *** thumpba has quit IRC | 00:04 | |
| *** hdd has quit IRC | 00:05 | |
| *** tmckay has joined #openstack-sahara | 00:07 | |
| *** thumpba has joined #openstack-sahara | 00:12 | |
| *** thumpba has quit IRC | 00:31 | |
| *** thumpba has joined #openstack-sahara | 00:34 | |
| *** esikachev has quit IRC | 00:49 | |
| *** tmckay has quit IRC | 00:53 | |
| *** thumpba has quit IRC | 00:55 | |
| *** brad[] has quit IRC | 01:03 | |
| *** brad[] has joined #openstack-sahara | 01:04 | |
| *** yangxi has joined #openstack-sahara | 01:40 | |
| *** tmckay has joined #openstack-sahara | 01:51 | |
| *** yangxi has quit IRC | 01:59 | |
| *** yangxi has joined #openstack-sahara | 02:02 | |
| *** hoonetorg has quit IRC | 02:20 | |
| *** hoonetorg has joined #openstack-sahara | 02:20 | |
| *** tmckay has quit IRC | 03:09 | |
| *** yangxi has quit IRC | 03:37 | |
| *** dave-mcc_ has quit IRC | 03:38 | |
| *** david-lyle_ has joined #openstack-sahara | 03:55 | |
| *** david-lyle has quit IRC | 03:57 | |
| *** links has joined #openstack-sahara | 04:07 | |
| *** thumpba has joined #openstack-sahara | 04:10 | |
| *** hdd has joined #openstack-sahara | 04:14 | |
| *** sgotliv has joined #openstack-sahara | 04:27 | |
| *** Poornima has joined #openstack-sahara | 04:36 | |
| *** pgadiya has joined #openstack-sahara | 04:53 | |
| *** links has quit IRC | 05:14 | |
| *** links has joined #openstack-sahara | 05:17 | |
| *** links has quit IRC | 05:24 | |
| *** yangxi has joined #openstack-sahara | 05:24 | |
| *** hdd has quit IRC | 05:29 | |
| *** thumpba has quit IRC | 05:47 | |
| *** links has joined #openstack-sahara | 06:03 | |
| *** rcernin has joined #openstack-sahara | 06:08 | |
| *** sverma has joined #openstack-sahara | 06:11 | |
| *** flaviodsr has quit IRC | 06:15 | |
| *** DuncanT has quit IRC | 06:15 | |
| *** flaviodsr has joined #openstack-sahara | 06:18 | |
| *** DuncanT has joined #openstack-sahara | 06:19 | |
| *** yangxi_ has joined #openstack-sahara | 06:51 | |
| *** yangxi has quit IRC | 06:54 | |
| *** tesseract has joined #openstack-sahara | 07:04 | |
| *** tesseract has quit IRC | 07:08 | |
| *** witlessb has joined #openstack-sahara | 07:12 | |
| *** esikachev has joined #openstack-sahara | 07:25 | |
| *** nkrinner has joined #openstack-sahara | 07:28 | |
| *** sgotliv_ has joined #openstack-sahara | 07:35 | |
| *** sgotliv has quit IRC | 07:37 | |
| *** yangxi_ has quit IRC | 07:38 | |
| *** sgotliv__ has joined #openstack-sahara | 07:40 | |
| *** yangxi has joined #openstack-sahara | 07:42 | |
| *** sgotliv_ has quit IRC | 07:42 | |
| *** sgotliv_ has joined #openstack-sahara | 07:43 | |
| *** yangxi_ has joined #openstack-sahara | 07:43 | |
| *** anshul has joined #openstack-sahara | 07:44 | |
| *** anshul is now known as Guest82686 | 07:44 | |
| *** sgotliv__ has quit IRC | 07:45 | |
| *** yangxi has quit IRC | 07:47 | |
| *** sgotliv_ has quit IRC | 07:48 | |
| *** sgotliv has joined #openstack-sahara | 07:50 | |
| *** sgotliv_ has joined #openstack-sahara | 07:53 | |
| *** sgotliv has quit IRC | 07:55 | |
| *** sgotliv_ has quit IRC | 07:58 | |
| *** sgotliv_ has joined #openstack-sahara | 07:58 | |
| openstackgerrit | Bhagyashri Shewale proposed openstack/python-saharaclient: Replace tempest_lib with tempest.lib https://review.openstack.org/320275 | 07:58 |
|---|---|---|
| *** pino|work has quit IRC | 08:07 | |
| *** dmk0202 has joined #openstack-sahara | 08:16 | |
| *** tosky has joined #openstack-sahara | 08:21 | |
| *** tosky has quit IRC | 08:23 | |
| *** tosky has joined #openstack-sahara | 08:26 | |
| *** pino|work has joined #openstack-sahara | 08:34 | |
| *** ig0r_ has joined #openstack-sahara | 08:40 | |
| *** yangxi_ has quit IRC | 09:21 | |
| *** yangxi has joined #openstack-sahara | 09:22 | |
| *** yangxi has quit IRC | 09:24 | |
| *** yangxi has joined #openstack-sahara | 09:27 | |
| *** zigo_ is now known as zigo | 09:28 | |
| openstackgerrit | Bhagyashri Shewale proposed openstack/python-saharaclient: Replace tempest_lib with tempest.lib https://review.openstack.org/320275 | 09:30 |
| *** yangxi has quit IRC | 09:37 | |
| *** Poornima has quit IRC | 09:37 | |
| *** Poornima has joined #openstack-sahara | 09:38 | |
| *** sgotliv has joined #openstack-sahara | 09:46 | |
| *** sgotliv_ has quit IRC | 09:47 | |
| *** yangxi has joined #openstack-sahara | 09:48 | |
| *** sgotliv_ has joined #openstack-sahara | 09:51 | |
| *** sgotliv has quit IRC | 09:52 | |
| *** Poornima has quit IRC | 09:52 | |
| *** yangxi has quit IRC | 10:03 | |
| *** Poornima has joined #openstack-sahara | 10:04 | |
| openstackgerrit | Pratik Gadiya proposed openstack/sahara-image-elements: [HDP2.4] Add ambari 2.2.1.0 element https://review.openstack.org/312905 | 10:32 |
| *** yangxi has joined #openstack-sahara | 11:03 | |
| *** yangxi has quit IRC | 11:08 | |
| *** brad[] has quit IRC | 11:16 | |
| *** tellesnobrega has quit IRC | 11:17 | |
| *** brad[] has joined #openstack-sahara | 11:25 | |
| *** abalutoiu has joined #openstack-sahara | 11:29 | |
| *** rodrigods has quit IRC | 11:31 | |
| *** rodrigods has joined #openstack-sahara | 11:31 | |
| *** degorenko has quit IRC | 11:32 | |
| *** vgridnev has quit IRC | 11:33 | |
| *** ig0r_ has quit IRC | 11:34 | |
| *** vgridnev has joined #openstack-sahara | 11:35 | |
| *** vgridnev has quit IRC | 11:40 | |
| *** vgridnev has joined #openstack-sahara | 11:40 | |
| *** degorenko has joined #openstack-sahara | 11:45 | |
| *** iberezovskiy has joined #openstack-sahara | 11:51 | |
| *** esikachev has quit IRC | 11:54 | |
| *** esikachev has joined #openstack-sahara | 11:55 | |
| *** brad[] has quit IRC | 11:56 | |
| *** jonjozwiak has joined #openstack-sahara | 11:56 | |
| *** ig0r_ has joined #openstack-sahara | 11:56 | |
| *** brad[] has joined #openstack-sahara | 11:58 | |
| *** esikachev has quit IRC | 12:05 | |
| *** jonjozwiak has quit IRC | 12:16 | |
| *** jonjozwiak has joined #openstack-sahara | 12:17 | |
| openstackgerrit | Pratik Gadiya proposed openstack/sahara-image-elements: [HDP2.4] Add ambari 2.2.1.0 element https://review.openstack.org/312905 | 12:42 |
| *** degorenko_ has joined #openstack-sahara | 12:48 | |
| *** catintheroof has joined #openstack-sahara | 12:49 | |
| *** tmckay has joined #openstack-sahara | 12:49 | |
| *** david-lyle has joined #openstack-sahara | 12:57 | |
| *** david-lyle_ has quit IRC | 13:01 | |
| *** abalutoiu_ has joined #openstack-sahara | 13:03 | |
| *** abalutoiu has quit IRC | 13:04 | |
| *** degorenko has quit IRC | 13:10 | |
| *** degorenko_ is now known as degorenko | 13:10 | |
| *** iberezovskiy has quit IRC | 13:14 | |
| *** pgadiya has quit IRC | 13:21 | |
| *** pgadiya has joined #openstack-sahara | 13:22 | |
| *** dave-mccowan has joined #openstack-sahara | 13:24 | |
| *** Poornima has quit IRC | 13:36 | |
| *** pgadiya has quit IRC | 13:36 | |
| *** egafford has joined #openstack-sahara | 13:57 | |
| *** thumpba has joined #openstack-sahara | 14:09 | |
| *** esikachev has joined #openstack-sahara | 14:09 | |
| *** thumpba has quit IRC | 14:09 | |
| *** thumpba has joined #openstack-sahara | 14:11 | |
| *** thumpba has quit IRC | 14:14 | |
| flaviodsr | hi guys, just installed sahara stable/mitaka and everything looks good, however when I try to run the pig job from sahara-tests, the job is getting killed. Trying to debug it, job-show is showing "errorMessage": "Method POST on http://10.5.0.31:5000/v3/auth/tokens/ failed, status code: 504, status line: HTTP/1.0 504 Gateway Time-out" and keystone logs are | 14:20 |
| flaviodsr | showing http://paste.openstack.org/show/498252/ every time I try to tun the job. Does anyone have any idea whats happening? | 14:20 |
| *** tmckay has quit IRC | 14:22 | |
| openstackgerrit | Merged openstack/sahara-ci-config: Remove ambari 2.4 from zuul mitaka https://review.openstack.org/317971 | 14:23 |
| tosky | does it happen also for other jobs? | 14:27 |
| *** logan- has quit IRC | 14:29 | |
| flaviodsr | it does, tried with a mapred job with same result | 14:29 |
| flaviodsr | just checked there is a bug report similar to whats happening to me (https://bugs.launchpad.net/sahara/+bug/1504140), I will try the workaround | 14:30 |
| openstack | Launchpad bug 1504140 in Sahara "[Swift] Wrong HADOOP_SWIFT_AUTH_URL for hadoop config" [Undecided,New] - Assigned to Esteban Arias (eariasn) | 14:30 |
| *** logan- has joined #openstack-sahara | 14:30 | |
| tosky | uhm, I didn't see it in my configuration; if I understand the bug correctly, it depends on how the endpoint was configured (with or without the slash) | 14:33 |
| *** tmckay has joined #openstack-sahara | 14:36 | |
| *** abalutoiu_ has quit IRC | 14:41 | |
| *** david-lyle has quit IRC | 14:42 | |
| *** rcernin has quit IRC | 14:47 | |
| *** links has quit IRC | 14:57 | |
| *** rcernin has joined #openstack-sahara | 14:59 | |
| *** sgotliv_ has quit IRC | 15:12 | |
| *** Junhongl_ has joined #openstack-sahara | 15:15 | |
| *** Junhongl_ has left #openstack-sahara | 15:20 | |
| *** Junhongl_ has joined #openstack-sahara | 15:23 | |
| *** Junhongl_ has left #openstack-sahara | 15:27 | |
| *** david-lyle has joined #openstack-sahara | 15:34 | |
| *** links has joined #openstack-sahara | 15:36 | |
| *** dmk0202 has quit IRC | 15:38 | |
| *** dmk0202 has joined #openstack-sahara | 15:38 | |
| *** Junhongl_ has joined #openstack-sahara | 15:41 | |
| *** Junhongl_ has quit IRC | 15:44 | |
| *** Junhongl_ has joined #openstack-sahara | 15:44 | |
| *** david-lyle has quit IRC | 15:45 | |
| *** david-lyle has joined #openstack-sahara | 15:45 | |
| *** Junhongl_ has quit IRC | 15:47 | |
| *** Junhongl has joined #openstack-sahara | 15:48 | |
| *** Junhongl has quit IRC | 15:51 | |
| *** david-lyle has quit IRC | 15:57 | |
| *** david-lyle has joined #openstack-sahara | 16:06 | |
| flaviodsr | tosky looking into the code I see https://github.com/openstack/sahara/blob/master/sahara/swift/utils.py#L34, however am I right assuming that using sahara_proxy should work against keystone api v3? | 16:07 |
| tosky | uhm, good question, I don't remember how/if it changed | 16:12 |
| tosky | elmiko: do you remember something about that? ^^ | 16:12 |
| * elmiko looks | 16:12 | |
| openstackgerrit | Anant Patil proposed openstack/sahara: DNM: Testing with heat convergence engine https://review.openstack.org/316667 | 16:13 |
| elmiko | flaviodsr: if you are using the proxy domain user feature, then yes keystone v3 is needed | 16:13 |
| elmiko | it will *only* work against v3 | 16:13 |
| elmiko | in these cases, the hadoop node images need to have our version of the hadoop-openstack.jar. (this is handled by our image gen. process) | 16:14 |
| elmiko | there is an upstream (from apache) version of hadoop-openstack.jar, but it only handles v2 | 16:14 |
| flaviodsr | elmiko ok good! I am using keystone v3 and this image http://sahara-files.mirantis.com/images/upstream/mitaka/sahara-mitaka-vanilla-hadoop-2.7.1-ubuntu.qcow2 | 16:15 |
| *** nkrinner is now known as nkrinner_afk | 16:16 | |
| flaviodsr | however my job is getting killed and on keystone logs I see http://paste.openstack.org/show/498252/ whenever I run a job | 16:16 |
| elmiko | weird | 16:18 |
| elmiko | are you using the proxy domains? | 16:19 |
| flaviodsr | yes | 16:19 |
| elmiko | hmm, you could always remake the hadoop-openstack jar from our sahara-extras repository to double check that the proper jar is in place | 16:20 |
| elmiko | i am unfamiliar with those errors coming from keystone. i haven't seen that before | 16:20 |
| flaviodsr | I tried without proxy domain, and got http://paste.openstack.org/show/498692/ | 16:21 |
| elmiko | when you switch to no proxy domain, did you add the user credentials to the swift objects? | 16:22 |
| flaviodsr | I did | 16:22 |
| elmiko | hmm, really odd | 16:22 |
| flaviodsr | I updated the data sources, both input and output, with my keystone credentials | 16:23 |
| elmiko | it certainly sounds like the hadoop nodes aren't sending the proper creds for the keystone interaction | 16:23 |
| elmiko | hmm, are you using TLS internally for all endpoints? | 16:23 |
| flaviodsr | no | 16:24 |
| elmiko | huh | 16:24 |
| *** dmk0202 has quit IRC | 16:24 | |
| *** ig0r_ has quit IRC | 16:24 | |
| flaviodsr | I also checked for the proxy_user_role_names if they have access to swift, and they do | 16:25 |
| elmiko | i wonder if we've introduced a regression with regards to newer keystones, that version looks pretty new | 16:25 |
| *** esikachev has quit IRC | 16:26 | |
| elmiko | and does your proxy domain support user creation? | 16:26 |
| flaviodsr | yes, its a sql backend | 16:26 |
| elmiko | (ie is it backed by database and not kerb) | 16:26 |
| elmiko | k | 16:26 |
| elmiko | sounds like you've done your homework well ;) | 16:26 |
| flaviodsr | :) | 16:26 |
| flaviodsr | I have seen the users being created on sahara_proxy domain when I rung the job, and being deleted when the job gets killed | 16:27 |
| elmiko | usually, when i run into issue like this, i do a couple things. look at the hadoop logs on the nodes to see if they report any additional errors, and then i have rebuilt the hadoop-openstack.jar from sahara-extras and manually deployed | 16:27 |
| elmiko | ok, so that part is working. it's just the nodes aren't communicating | 16:28 |
| *** catintheroof has quit IRC | 16:28 | |
| elmiko | i have a meeting, i'll be back around in a little bit | 16:28 |
| flaviodsr | alright, I will try the hadoop-openstack.jar build and I can get back later | 16:28 |
| elmiko | good luck! | 16:29 |
| flaviodsr | thanks elmiko and tosky! | 16:29 |
| flaviodsr | :) | 16:29 |
| tosky | or you can even try a full build of the guest image using sahara-image-elements | 16:29 |
| flaviodsr | sure! gona take a look into it! | 16:30 |
| *** tellesnobrega has joined #openstack-sahara | 16:32 | |
| *** Guest82686 has quit IRC | 16:43 | |
| *** hdd has joined #openstack-sahara | 17:03 | |
| *** sverma has quit IRC | 17:08 | |
| *** esikachev has joined #openstack-sahara | 17:25 | |
| openstackgerrit | Jonathan Jozwiak proposed openstack/sahara: Corrects MapR distro selection for RHEL https://review.openstack.org/320116 | 17:42 |
| *** Akanksha08 has joined #openstack-sahara | 17:57 | |
| *** david-lyle_ has joined #openstack-sahara | 18:12 | |
| *** david-lyle has quit IRC | 18:16 | |
| *** ig0r_ has joined #openstack-sahara | 18:23 | |
| *** thumpba has joined #openstack-sahara | 18:24 | |
| *** degorenko is now known as _degorenko|afk | 18:24 | |
| *** rcernin has quit IRC | 18:29 | |
| *** thumpba has quit IRC | 18:31 | |
| *** esikachev has quit IRC | 18:32 | |
| *** sverma has joined #openstack-sahara | 18:44 | |
| *** esikachev has joined #openstack-sahara | 18:46 | |
| *** links has quit IRC | 18:48 | |
| *** sverma has quit IRC | 18:49 | |
| *** Akanksha08 has quit IRC | 18:53 | |
| *** esikachev has quit IRC | 18:59 | |
| *** esikachev has joined #openstack-sahara | 19:33 | |
| *** esikachev has quit IRC | 19:38 | |
| *** tellesnobrega has quit IRC | 19:38 | |
| *** ig0r_ has quit IRC | 19:39 | |
| *** tellesnobrega has joined #openstack-sahara | 19:42 | |
| *** dmk0202 has joined #openstack-sahara | 19:54 | |
| *** sgotliv_ has joined #openstack-sahara | 20:04 | |
| *** jonjozwiak has quit IRC | 20:05 | |
| *** esikachev has joined #openstack-sahara | 20:24 | |
| *** yangxi has joined #openstack-sahara | 20:34 | |
| flaviodsr | tosky elmiko just a update, rebuilding the guest images did work :) | 20:36 |
| flaviodsr | thanks for your help guys | 20:36 |
| elmiko | \o/ | 20:37 |
| elmiko | so glad to hear it =) | 20:37 |
| *** yangxi has quit IRC | 20:39 | |
| tosky | \o/ | 20:39 |
| *** rcernin has joined #openstack-sahara | 21:02 | |
| rickflare | noice! | 21:13 |
| *** hdd has quit IRC | 21:29 | |
| *** dmk0202 has quit IRC | 21:32 | |
| *** sgotliv_ has quit IRC | 21:35 | |
| *** dmk0202 has joined #openstack-sahara | 21:37 | |
| *** rcernin has quit IRC | 21:43 | |
| *** egafford has quit IRC | 21:56 | |
| *** dmk0202 has quit IRC | 22:09 | |
| *** thumpba has joined #openstack-sahara | 22:31 | |
| *** witlessb has quit IRC | 22:45 | |
| *** esikachev has quit IRC | 22:46 | |
| *** openstackgerrit has quit IRC | 23:03 | |
| *** openstackgerrit has joined #openstack-sahara | 23:03 | |
| *** hdd has joined #openstack-sahara | 23:08 | |
| *** david-lyle_ is now known as david-lyle | 23:12 | |
| *** thumpba has quit IRC | 23:24 | |
| *** tosky has quit IRC | 23:34 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!