| openstackgerrit | zhuli proposed openstack/sahara master: Bad request exception for unsupported content type https://review.openstack.org/486479 | 00:47 |
|---|---|---|
| *** tuanluong has joined #openstack-sahara | 01:00 | |
| *** esikache1 has joined #openstack-sahara | 01:31 | |
| *** esikache1 has quit IRC | 01:35 | |
| *** chlong_ has joined #openstack-sahara | 01:45 | |
| *** chlong__ has quit IRC | 01:47 | |
| *** dave-mccowan has joined #openstack-sahara | 01:57 | |
| *** chlong__ has joined #openstack-sahara | 02:06 | |
| *** chlong_ has quit IRC | 02:07 | |
| *** dave-mccowan has quit IRC | 02:07 | |
| *** chlong_ has joined #openstack-sahara | 02:25 | |
| *** chlong__ has quit IRC | 02:27 | |
| *** akuznetsov has joined #openstack-sahara | 02:32 | |
| *** akuznetsov has quit IRC | 02:33 | |
| *** chlong__ has joined #openstack-sahara | 03:28 | |
| *** chlong_ has quit IRC | 03:28 | |
| *** chlong_ has joined #openstack-sahara | 04:01 | |
| *** chlong__ has quit IRC | 04:01 | |
| *** esikache1 has joined #openstack-sahara | 04:18 | |
| *** chlong__ has joined #openstack-sahara | 04:25 | |
| *** chlong_ has quit IRC | 04:27 | |
| *** links has joined #openstack-sahara | 04:30 | |
| *** esikache1 has quit IRC | 04:46 | |
| *** esikache1 has joined #openstack-sahara | 05:02 | |
| *** esikache1 is now known as esikachev | 05:03 | |
| *** pgadiya has joined #openstack-sahara | 05:22 | |
| *** chlong_ has joined #openstack-sahara | 05:32 | |
| *** chlong__ has quit IRC | 05:34 | |
| *** esikachev has quit IRC | 05:44 | |
| *** esikachev has joined #openstack-sahara | 05:46 | |
| *** rcernin has joined #openstack-sahara | 06:10 | |
| *** ukaynar has quit IRC | 06:36 | |
| *** anshul has joined #openstack-sahara | 06:42 | |
| *** Poornima_K has joined #openstack-sahara | 06:59 | |
| *** esikachev has quit IRC | 07:00 | |
| *** Poornima_K has quit IRC | 07:30 | |
| *** esikachev has joined #openstack-sahara | 07:46 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/sahara-dashboard master: Imported Translations from Zanata https://review.openstack.org/486938 | 08:19 |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara-image-elements master: Add support to create CDH 5.12 images https://review.openstack.org/486022 | 08:54 |
| *** mgoddard_ has joined #openstack-sahara | 09:03 | |
| *** zemuvier has joined #openstack-sahara | 09:29 | |
| *** chlong__ has joined #openstack-sahara | 09:33 | |
| *** chlong_ has quit IRC | 09:35 | |
| *** tellesnobrega has quit IRC | 10:11 | |
| *** openstackgerrit has quit IRC | 10:17 | |
| *** Poornima_K has joined #openstack-sahara | 10:30 | |
| *** chlong_ has joined #openstack-sahara | 10:51 | |
| *** Poornima_K has quit IRC | 10:52 | |
| *** chlong__ has quit IRC | 10:53 | |
| *** chlong__ has joined #openstack-sahara | 10:56 | |
| *** chlong_ has quit IRC | 10:59 | |
| *** Poornima_K has joined #openstack-sahara | 11:00 | |
| *** esikache1 has joined #openstack-sahara | 11:02 | |
| *** esikachev has quit IRC | 11:05 | |
| *** esikachev has joined #openstack-sahara | 11:14 | |
| *** esikache1 has quit IRC | 11:16 | |
| *** esikachev has quit IRC | 11:24 | |
| *** zemuvier has quit IRC | 11:27 | |
| *** Poornima_K has quit IRC | 11:28 | |
| *** chlong_ has joined #openstack-sahara | 11:45 | |
| *** chlong__ has quit IRC | 11:45 | |
| *** chlong_ has quit IRC | 11:58 | |
| *** iwonka has joined #openstack-sahara | 11:59 | |
| *** tellesnobrega has joined #openstack-sahara | 12:00 | |
| *** tuanluong has quit IRC | 12:06 | |
| *** tmckay has quit IRC | 12:08 | |
| *** links has quit IRC | 12:27 | |
| *** esikachev has joined #openstack-sahara | 12:39 | |
| *** links has joined #openstack-sahara | 12:43 | |
| *** pgadiya has quit IRC | 12:47 | |
| *** jeremyfreudberg has joined #openstack-sahara | 12:56 | |
| *** tmckay has joined #openstack-sahara | 12:56 | |
| tellesnobrega | jeremyfreudberg, are you around? | 12:59 |
| jeremyfreudberg | tellesnobrega, yes I am | 12:59 |
| tellesnobrega | remember when we talked about running spark.py jobs on sahara | 12:59 |
| tellesnobrega | you said it had an issue with swift | 13:00 |
| tellesnobrega | do you know what it is? | 13:00 |
| jeremyfreudberg | I remember saying that -- the issue is something with edp-adapt-for-spark | 13:01 |
| jeremyfreudberg | trying to remember exactly what was going on | 13:02 |
| tellesnobrega | I tried running the spark-pi.py test and it worked (it succeeded but I don't get any output) | 13:02 |
| jeremyfreudberg | so spark-pi does not do any file-io | 13:02 |
| jeremyfreudberg | i have another example job which does so some fileio, I/you can try that out | 13:03 |
| tellesnobrega | I'm now trying to run a wordcount.py | 13:03 |
| tellesnobrega | that reads from swift | 13:03 |
| tellesnobrega | that should work right? | 13:03 |
| jeremyfreudberg | yes, that should be a good way to test it | 13:03 |
| tellesnobrega | ok, just to be sure, the main class is usually main rightw | 13:04 |
| tellesnobrega | ? | 13:04 |
| jeremyfreudberg | usually | 13:05 |
| jeremyfreudberg | (Although I'm still pretty sure dummy values often/always work...) | 13:05 |
| tellesnobrega | cool | 13:05 |
| *** lucasxu has joined #openstack-sahara | 13:05 | |
| *** openstackgerrit has joined #openstack-sahara | 13:27 | |
| openstackgerrit | Iwona Kotlarska proposed openstack/python-saharaclient master: Add export of node group templates to CLI https://review.openstack.org/486721 | 13:27 |
| tellesnobrega | ltosky[m], ping | 13:27 |
| jeremyfreudberg | tellesnobrega, ping | 13:36 |
| tellesnobrega | pong | 13:36 |
| tellesnobrega | jeremyfreudberg, | 13:36 |
| jeremyfreudberg | (sadly I am not luigi, but I do have something else to mention) | 13:36 |
| jeremyfreudberg | about cdh 5.12 | 13:36 |
| tellesnobrega | lol | 13:36 |
| tellesnobrega | go ahead | 13:36 |
| *** chlong has joined #openstack-sahara | 13:37 | |
| *** tosky has joined #openstack-sahara | 13:37 | |
| tosky | tellesnobrega: pong | 13:37 |
| jeremyfreudberg | as of cdh 5.12, they do not package "cloudera navigator key trustee server" anymore, you have to download it from cloudera website | 13:37 |
| jeremyfreudberg | so this is breaking a lot of our assumptions and creating more work at the last minute | 13:38 |
| tosky | but it does not impact the old versions, right/ | 13:38 |
| tosky | ? | 13:38 |
| jeremyfreudberg | tosky, they've kept the old versions packaging online | 13:38 |
| tellesnobrega | tosky, quick question about that trust issue you were seeing on the containers deployment, what was the issue with that? | 13:38 |
| tellesnobrega | jeremyfreudberg, fall back to 5.10 for now? | 13:39 |
| tosky | tellesnobrega: the one that I described in the email: the trust is not created most likely because the configuration options that are used to set it are not set anymore | 13:39 |
| tellesnobrega | thanks | 13:40 |
| tosky | tellesnobrega: I couldn't fix it yet properly (still at the conference, but from Friday I'm fully back | 13:40 |
| jeremyfreudberg | tellesnobrega: well, 5.11, I guess | 13:40 |
| tellesnobrega | here at the univeristy I'm seeing a lot of failed to delete trusts error on sahara, trying to see if there is a connection | 13:40 |
| tellesnobrega | jeremyfreudberg, can you make sure this is packaged for 5.11? | 13:40 |
| jeremyfreudberg | i'll double-check, but according to the release notes and other observation's I've seen, they only start screwing us up with 5.12 | 13:41 |
| tosky | tellesnobrega: on the stable version? Maybe, it depends on what it's set in sahara.conf (but it's not the same issue, or you wouldn't be able to provision a cluster) | 13:41 |
| tellesnobrega | yeah, makes sense | 13:41 |
| jeremyfreudberg | one more note about cdh 5.12+ is that this download is only available with Cloudera enterprise support.... | 13:42 |
| jeremyfreudberg | the download for the navigator key trustee, I mean | 13:42 |
| jeremyfreudberg | everything else is still packaged for free | 13:42 |
| tellesnobrega | jeremyfreudberg, hmmm that makes things a little more complicated on our side | 13:42 |
| tellesnobrega | please add that to the queen ptg so we take some time to figure this out there | 13:43 |
| jeremyfreudberg | i forget exactly what we use that service for, but I guess we can't support that specific feature anymore | 13:43 |
| jeremyfreudberg | i will add it to the etherpad | 13:43 |
| tellesnobrega | please do so we can also take some time to study and see how that changes things for us | 13:45 |
| openstackgerrit | Jeremy Freudberg proposed openstack/sahara-image-elements master: Add support to create CDH 5.12 images https://review.openstack.org/486022 | 13:57 |
| openstackgerrit | Jeremy Freudberg proposed openstack/sahara-image-elements master: Add support to create CDH 5.11 images https://review.openstack.org/486022 | 13:58 |
| *** chlong has quit IRC | 14:03 | |
| *** tmckay has quit IRC | 14:06 | |
| openstackgerrit | Alex Schultz proposed openstack/puppet-sahara master: Drop -dev version for Pike M3 https://review.openstack.org/487093 | 14:15 |
| *** esikachev has quit IRC | 14:24 | |
| *** tmckay has joined #openstack-sahara | 14:24 | |
| *** links has quit IRC | 14:26 | |
| *** tellesnobrega has quit IRC | 14:31 | |
| *** jeremyfreudberg has quit IRC | 14:31 | |
| *** lucasxu has quit IRC | 14:38 | |
| *** ukaynar has joined #openstack-sahara | 14:55 | |
| openstackgerrit | Merged openstack/puppet-sahara master: Drop -dev version for Pike M3 https://review.openstack.org/487093 | 15:07 |
| openstackgerrit | Iwona Kotlarska proposed openstack/python-saharaclient master: Add export of node group templates to CLI https://review.openstack.org/486721 | 15:10 |
| *** chlong has joined #openstack-sahara | 15:15 | |
| *** rcernin has quit IRC | 15:17 | |
| *** ukaynar has quit IRC | 15:24 | |
| *** ukaynar has joined #openstack-sahara | 15:24 | |
| *** rcernin has joined #openstack-sahara | 16:14 | |
| openstackgerrit | Merged openstack/sahara-image-elements master: Build Xenial images for Vanilla and Storm https://review.openstack.org/485343 | 16:25 |
| *** lucasxu has joined #openstack-sahara | 16:26 | |
| *** tosky has quit IRC | 16:28 | |
| *** lucasxu has quit IRC | 16:28 | |
| openstackgerrit | Merged openstack/sahara-image-elements master: Change default link for Hadoop native libs https://review.openstack.org/486746 | 16:28 |
| *** esikachev has joined #openstack-sahara | 16:40 | |
| *** esikachev has quit IRC | 16:45 | |
| *** mgoddard_ has quit IRC | 16:47 | |
| *** tellesnobrega has joined #openstack-sahara | 16:47 | |
| *** lucasxu has joined #openstack-sahara | 16:54 | |
| *** links has joined #openstack-sahara | 16:55 | |
| *** tmckay has quit IRC | 17:11 | |
| *** jeremyfreudberg has joined #openstack-sahara | 17:18 | |
| openstackgerrit | Merged openstack/sahara master: Bad request exception for unsupported content type https://review.openstack.org/486479 | 17:21 |
| openstackgerrit | Jeremy Freudberg proposed openstack/sahara-image-elements master: Add support to create CDH 5.11 images https://review.openstack.org/486022 | 17:24 |
| *** tmckay has joined #openstack-sahara | 17:26 | |
| openstackgerrit | Jeremy Freudberg proposed openstack/sahara-image-elements master: Add support to create CDH 5.11 images https://review.openstack.org/486022 | 17:26 |
| jeremyfreudberg | tellesnobrega, done | 17:26 |
| tellesnobrega | jeremyfreudberg, perfect :) | 17:27 |
| tellesnobrega | thanks | 17:27 |
| jeremyfreudberg | no problem, hopefully i can get the rest of the plugin upgrade done asap | 17:28 |
| *** links has quit IRC | 17:31 | |
| *** anshul has quit IRC | 17:32 | |
| *** jeremyfreudberg has quit IRC | 17:52 | |
| *** jeremyfreudberg has joined #openstack-sahara | 17:55 | |
| *** esikachev has joined #openstack-sahara | 18:10 | |
| openstackgerrit | Merged openstack/sahara-image-elements master: Add support to create CDH 5.11 images https://review.openstack.org/486022 | 18:24 |
| jeremyfreudberg | tellesnobrega, ping | 18:45 |
| tellesnobrega | jeremyfreudberg, pong | 18:46 |
| jeremyfreudberg | do you know where I find the cloudera default config json files for each release? like here: https://github.com/openstack/sahara/tree/master/sahara/plugins/cdh/v5_9_0/resources ... I want the new ones for 5.11, but I'm not sure where we get them from | 18:46 |
| tellesnobrega | jeremyfreudberg, not sure, have to check | 18:47 |
| jeremyfreudberg | esikachev? do you know? | 18:48 |
| esikachev | hmm, no | 18:48 |
| tellesnobrega | jeremyfreudberg, when trying to download cdh 5.11 it redirects to 5.10 | 18:50 |
| jeremyfreudberg | uh, tellesnobrega, where is the context of that? | 18:50 |
| jeremyfreudberg | you mean in the image job we just merged? | 18:50 |
| tellesnobrega | just cloudera website | 18:50 |
| jeremyfreudberg | what link? | 18:51 |
| tellesnobrega | https://blog.cloudera.com/blog/2017/04/cloudera-enterprise-5-11-is-now-available/ | 18:51 |
| esikachev | sorry guys, i have to go | 18:52 |
| jeremyfreudberg | no problem esikachev | 18:52 |
| tellesnobrega | esikachev, no worries | 18:52 |
| *** esikachev has quit IRC | 18:52 | |
| jeremyfreudberg | tellesnobrega: i guess because your link is enterprise | 18:52 |
| tellesnobrega | just found the cdh manager here | 18:52 |
| jeremyfreudberg | as long as http://archive.cloudera.com/cdh5/ubuntu/xenial/amd64/cdh/dists/ is good, then we are good | 18:53 |
| tellesnobrega | cool | 18:53 |
| tellesnobrega | jeremyfreudberg, I'm trying to figure this out | 18:55 |
| jeremyfreudberg | i'm surprised we do not have doc on this | 18:56 |
| tellesnobrega | quick question for you, about the hadoop-swift.jar that walmart presented at the Boston summit, do you know if is there any work needed on that? | 18:56 |
| jeremyfreudberg | i'm not sure how much work they have left to do.... i think they are waiting for the right answer about governance | 18:57 |
| tellesnobrega | jeremyfreudberg, I was approached by people from swift asking if it would be interesting to have a discussion on that at PTG | 18:59 |
| tellesnobrega | what do you think? does it make sense? do we have anything to contribute on that? | 18:59 |
| jeremyfreudberg | the swift people were asking you? | 19:00 |
| tellesnobrega | yes | 19:00 |
| jeremyfreudberg | i'm not sure exactly what we would discuss | 19:00 |
| tellesnobrega | jeremyfreudberg, it is hard to find this files, they were originally brought in by cloudera people working with us | 19:01 |
| tellesnobrega | *these files | 19:01 |
| jeremyfreudberg | uh, so how did shu yingya get new ones for 5.9? | 19:01 |
| tellesnobrega | not sure | 19:03 |
| tellesnobrega | good question | 19:03 |
| tellesnobrega | will ping him | 19:03 |
| jeremyfreudberg | I could ping him too. going back to the swift topic for a moment | 19:04 |
| jeremyfreudberg | the most important thing that it reminds me of is that we need to have a discussion about what the future is sahara-extra repo is | 19:06 |
| jeremyfreudberg | another one for the etherpad, I guess | 19:06 |
| jeremyfreudberg | tellesnobrega: I'm still trying to wrap my head around what Swift folks are expecting us to discuss - it wasn't really our work | 19:09 |
| tellesnobrega | jeremyfreudberg, yeah, maybe they wanted to know more on the hadoop part | 19:10 |
| jeremyfreudberg | i guess cross-project communication is always good, we might as well get everyone on the same page | 19:11 |
| tellesnobrega | I will try to get more info on how we can be useful and try to see if it fits | 19:12 |
| jeremyfreudberg | cool | 19:12 |
| jeremyfreudberg | by the way, you and I are the only two certain atendees for Denver PTG, right? | 19:12 |
| jeremyfreudberg | TSP people are still waiting? | 19:12 |
| jeremyfreudberg | and luigi, yingya, ...? | 19:12 |
| tellesnobrega | so far yes | 19:13 |
| tellesnobrega | luigi is not guaranteed but it is more on going side than not going | 19:13 |
| tellesnobrega | I believe it will be at least the 3 of us now | 19:14 |
| jeremyfreudberg | ok, that's good to hear | 19:14 |
| tellesnobrega | and it will be a lot of work for us | 19:14 |
| tellesnobrega | I guarantee that | 19:14 |
| tellesnobrega | :) | 19:14 |
| jeremyfreudberg | yes, we have a ton planned this time | 19:14 |
| tellesnobrega | we do | 19:15 |
| jeremyfreudberg | it will be worth it though, i think it will send us in a good direction | 19:15 |
| tellesnobrega | can you send an email to shu yingya about the files and put me in copy | 19:15 |
| tellesnobrega | for sure | 19:15 |
| jeremyfreudberg | yes, I am sending the email to shu yingya right now | 19:15 |
| jeremyfreudberg | unfortunately he let me know earlier today hbase on vanilla is coming in late | 19:16 |
| jeremyfreudberg | tellesnobrega, email sent | 19:19 |
| tellesnobrega | jeremyfreudberg, thanks | 19:20 |
| jeremyfreudberg | it's 3am there, so we probably won't hear back for a while | 19:20 |
| tellesnobrega | jeremyfreudberg, how late? | 19:20 |
| jeremyfreudberg | regarding hbase, he didn't say exactly | 19:20 |
| tellesnobrega | maybe we can squeeze in FFE, but no promises | 19:22 |
| jeremyfreudberg | FFE would be nice, not sure if it is appropriate for something like this | 19:22 |
| jeremyfreudberg | the release cycle is never our friend, unfortunately | 19:22 |
| tellesnobrega | never | 19:23 |
| tellesnobrega | but it is something we have to live with | 19:23 |
| jeremyfreudberg | would be nice if outreachy cycle started earlier too, this twice now that the outreachy project doesn't get done before FF | 19:25 |
| jeremyfreudberg | but like you said, we will live with it | 19:25 |
| tellesnobrega | jeremyfreudberg, yeah, I've talked with some outreachy people but the dates are to match summer vacations on north and south of the globe | 19:31 |
| tellesnobrega | and I said to iwonka don't worry about merging inside this cycle, the important part is to get it done asap | 19:32 |
| tellesnobrega | but we know that stuff don't always get done in time | 19:32 |
| jeremyfreudberg | i see | 19:35 |
| jeremyfreudberg | makes sense | 19:35 |
| *** jeremyfreudberg_ has joined #openstack-sahara | 20:16 | |
| *** jeremyfreudberg has quit IRC | 20:17 | |
| *** jeremyfreudberg_ is now known as jeremyfreudberg | 20:23 | |
| *** jeremyfreudberg has quit IRC | 20:44 | |
| openstackgerrit | Iwona Kotlarska proposed openstack/python-saharaclient master: Add export of node group templates to CLI https://review.openstack.org/486721 | 21:09 |
| *** lucasxu has quit IRC | 21:09 | |
| *** tmckay has quit IRC | 21:21 | |
| *** rcernin has quit IRC | 22:58 | |
| *** chlong has quit IRC | 23:32 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!