*** IlyaE has quit IRC | 00:04 | |
*** IlyaE has joined #savanna | 00:21 | |
*** IlyaE has quit IRC | 00:23 | |
*** openstackgerrit has quit IRC | 00:24 | |
*** openstackgerrit has joined #savanna | 00:24 | |
*** IlyaE has joined #savanna | 00:31 | |
*** IlyaE has quit IRC | 00:33 | |
*** jdev789 has joined #savanna | 01:43 | |
*** jdev789 has quit IRC | 02:01 | |
*** crobertsrh has joined #savanna | 02:29 | |
*** crobertsrh is now known as _crobertsrh | 02:31 | |
*** alazarev has quit IRC | 02:43 | |
*** jmaron has quit IRC | 03:21 | |
*** jmaron has joined #savanna | 04:16 | |
*** jcooley_ has joined #savanna | 04:18 | |
*** jmaron has quit IRC | 04:21 | |
*** jcooley_ has quit IRC | 05:06 | |
*** sickboy3i has joined #savanna | 05:10 | |
*** sickboy3i has quit IRC | 05:11 | |
*** jcooley_ has joined #savanna | 05:15 | |
*** jmaron has joined #savanna | 05:18 | |
*** aignatov has joined #savanna | 05:20 | |
*** jmaron has quit IRC | 05:23 | |
*** SergeyLukjanov has joined #savanna | 05:27 | |
*** jcooley_ has quit IRC | 05:54 | |
*** jcooley_ has joined #savanna | 05:54 | |
*** jcooley_ has quit IRC | 05:59 | |
*** jcooley_ has joined #savanna | 06:02 | |
*** jcooley_ has quit IRC | 06:04 | |
*** jcooley_ has joined #savanna | 06:04 | |
*** aignatov has quit IRC | 06:12 | |
*** jmaron has joined #savanna | 06:18 | |
*** jmaron has quit IRC | 06:19 | |
*** jcooley_ has quit IRC | 06:19 | |
openstackgerrit | Minkyung Maisy Kim proposed a change to openstack/savanna-dashboard: Adding the ability to modify cluster template https://review.openstack.org/61923 | 06:29 |
---|---|---|
*** nadya_ has joined #savanna | 06:31 | |
openstackgerrit | Minkyung Maisy Kim proposed a change to openstack/savanna-dashboard: Adding the ability to modify cluster template https://review.openstack.org/61923 | 06:32 |
openstackgerrit | Minkyung Maisy Kim proposed a change to openstack/python-savannaclient: Adding the ability to modify cluster templates https://review.openstack.org/61925 | 06:34 |
*** alazarev has joined #savanna | 06:47 | |
*** alazarev has quit IRC | 06:54 | |
*** nadya_ has quit IRC | 07:03 | |
*** NikitaKonovalov has joined #savanna | 07:03 | |
*** SergeyLukjanov is now known as _SergeyLukjanov | 07:05 | |
*** _SergeyLukjanov has quit IRC | 07:06 | |
*** alazarev has joined #savanna | 07:09 | |
*** SergeyLukjanov has joined #savanna | 07:19 | |
*** jmaron has joined #savanna | 07:20 | |
*** jmaron has quit IRC | 07:25 | |
*** akuznetsov has quit IRC | 07:30 | |
*** SergeyLukjanov is now known as _SergeyLukjanov | 07:44 | |
*** _SergeyLukjanov has quit IRC | 07:45 | |
*** alazarev has quit IRC | 07:51 | |
openstackgerrit | Nikita Konovalov proposed a change to openstack/savanna: Launch integration tests with testr https://review.openstack.org/61769 | 08:01 |
*** SergeyLukjanov has joined #savanna | 08:12 | |
*** jmaron has joined #savanna | 08:20 | |
*** nprivalova has joined #savanna | 08:23 | |
*** jmaron has quit IRC | 08:25 | |
*** aignatov has joined #savanna | 08:28 | |
*** akuznetsov has joined #savanna | 08:29 | |
*** nosnos has joined #savanna | 08:55 | |
*** dmitryme has joined #savanna | 09:06 | |
*** aignatov has quit IRC | 09:18 | |
openstackgerrit | Mina Park proposed a change to openstack/savanna-dashboard: Adding the ability to modify node group template https://review.openstack.org/61941 | 09:19 |
*** aignatov has joined #savanna | 09:20 | |
*** jmaron has joined #savanna | 09:21 | |
*** SergeyLukjanov has quit IRC | 09:22 | |
*** jmaron has quit IRC | 09:26 | |
*** ylobankov has left #savanna | 09:30 | |
openstackgerrit | Alexander Ignatov proposed a change to openstack/savanna-image-elements: Firstboot script modifications https://review.openstack.org/61945 | 09:33 |
*** nosnos has quit IRC | 09:51 | |
*** aignatov has quit IRC | 10:08 | |
*** SergeyLukjanov has joined #savanna | 10:10 | |
*** nprivalova has quit IRC | 10:16 | |
*** jmaron has joined #savanna | 10:21 | |
*** jmaron has quit IRC | 10:26 | |
*** nprivalova has joined #savanna | 10:40 | |
*** aignatov has joined #savanna | 10:46 | |
*** jmaron has joined #savanna | 11:22 | |
*** jmaron has quit IRC | 11:27 | |
openstackgerrit | Nikita Konovalov proposed a change to openstack/savanna: Launch integration tests with testr https://review.openstack.org/61769 | 11:33 |
openstackgerrit | Nikita Konovalov proposed a change to openstack/savanna: Launch integration tests with testr https://review.openstack.org/61769 | 11:37 |
openstackgerrit | Nikita Konovalov proposed a change to openstack/savanna: Launch integration tests with testr https://review.openstack.org/61769 | 11:42 |
openstackgerrit | Nikita Konovalov proposed a change to openstack/savanna: Launch integration tests with testr https://review.openstack.org/61769 | 11:57 |
*** nprivalova has quit IRC | 12:03 | |
*** aignatov_ has joined #savanna | 12:03 | |
*** nprivalova has joined #savanna | 12:04 | |
*** aignatov has quit IRC | 12:05 | |
*** aignatov_ is now known as aignatov | 12:05 | |
*** dmitryme has quit IRC | 12:10 | |
*** ruhe has joined #savanna | 12:18 | |
*** jmaron has joined #savanna | 12:23 | |
*** SergeyLukjanov is now known as _SergeyLukjanov | 12:24 | |
*** _SergeyLukjanov has quit IRC | 12:25 | |
*** jmaron has quit IRC | 12:27 | |
*** dmitryme has joined #savanna | 12:29 | |
*** SergeyLukjanov has joined #savanna | 12:33 | |
*** aignatov has quit IRC | 12:51 | |
*** aignatov has joined #savanna | 12:52 | |
*** aignatov has quit IRC | 12:52 | |
*** aignatov has joined #savanna | 12:53 | |
*** aignatov has quit IRC | 12:54 | |
*** aignatov has joined #savanna | 12:55 | |
*** tmckay has quit IRC | 12:58 | |
*** _mattf is now known as mattf | 13:09 | |
*** mattf is now known as _mattf | 13:12 | |
*** _mattf is now known as mattf | 13:13 | |
openstackgerrit | A change was merged to openstack/savanna: Provisioning via Heat https://review.openstack.org/55978 | 13:16 |
*** aignatov_ has joined #savanna | 13:17 | |
*** aignatov has quit IRC | 13:19 | |
*** aignatov_ is now known as aignatov | 13:19 | |
*** jmaron has joined #savanna | 13:24 | |
*** mattf is now known as _mattf | 13:25 | |
*** akuznetsov has quit IRC | 13:25 | |
*** jmaron has quit IRC | 13:29 | |
*** _crobertsrh is now known as crobertsrh | 13:44 | |
*** akuznetsov has joined #savanna | 13:47 | |
*** _mattf is now known as mattf | 13:52 | |
*** tmckay has joined #savanna | 13:57 | |
openstackgerrit | Sergey Lukjanov proposed a change to openstack/savanna: DO NOT MERGE https://review.openstack.org/61998 | 13:59 |
*** ruhe is now known as ruhe_ | 14:12 | |
*** ruhe_ has quit IRC | 14:18 | |
tmckay | crobertsrh, ping | 14:24 |
crobertsrh | hello | 14:24 |
*** jmaron has joined #savanna | 14:25 | |
tmckay | Hey there. How hard is it to change the set up job types in the UI to Hive, Pig, MapReduce? I'm wondering if we should make an incremental commit just to change the name before I start adding stuff | 14:25 |
tmckay | "set of job types" | 14:25 |
crobertsrh | Not that hard. | 14:26 |
tmckay | or, for that matter, add Java too which will just be not implemented | 14:26 |
crobertsrh | Do you just mean change the screen name of it, or do you mean change the name of the value passed around? | 14:26 |
crobertsrh | That would require a tweak to the get_job_configs (or something like that) as well. | 14:27 |
tmckay | The value. The enum will be Hive, Pig, and MapReduce in the savanna-api, and ultimately include Java | 14:27 |
tmckay | The UI makes calls through the Rest API, correct? | 14:27 |
crobertsrh | Yep | 14:27 |
tmckay | My other thought, for compatibility, is to automagically change "JAR" to MapReduce in the REST api so that the UI doesn't break and can be changed independently | 14:28 |
tmckay | and for anyone who has REST scripts currently | 14:28 |
tmckay | That might be the way to go | 14:28 |
tmckay | backwards compatibility is always nice | 14:29 |
crobertsrh | Maybe. I'm not sure about the official stance on supporting backwards compat in the api | 14:29 |
crobertsrh | Yeah, definitely a plus | 14:29 |
tmckay | aignatov, ^^ what do you think? Should I make the savanna REST api still accept "JAR" in addition to MapReduce? | 14:30 |
*** jmaron has quit IRC | 14:30 | |
tmckay | we can mark it deprecated in the API docs | 14:30 |
tmckay | I like that it makes the commits independent | 14:31 |
*** jmaron has joined #savanna | 14:32 | |
tmckay | crobertsrh, okay, the more I think, the more I like it. That's what I'll do, and people can complain in the review if they don't like it :) | 14:32 |
*** ruhe has joined #savanna | 14:36 | |
mattf | aignatov, no need to reinvent our own bicycle -- i like it | 14:40 |
aignatov | tmckay: good approach I think, you can drop JAR definitions from REST calls completely:) | 14:43 |
tmckay | aignatov, okay, thanks | 14:43 |
aignatov | because there are no users who use EDP right now I think | 14:43 |
tmckay | :) Maybe test guys | 14:44 |
aignatov | ah, you mean integration tests, right? | 14:44 |
tmckay | Who know what crazy scripts somebody has written. But, yes, I think it doesn't need to be mentioned directly, as long as nothing breaks | 14:44 |
*** rnirmal has joined #savanna | 14:44 | |
tmckay | Yes, I've fixed up the test source under savanna, but somebody might have there own stuff | 14:44 |
tmckay | "their" | 14:45 |
aignatov | tmckay, we'll see how savanna-ci will react on tour patch with this replacement ;) | 14:47 |
aignatov | tour -> your | 14:47 |
tmckay | I think it should be okay. I'm testing right now in create_job to just change "Jar" to "MapReduce", voila! The only other place may be in job_manager, just in case someone has a Jar job in a savanna database and wants to keep it | 14:49 |
tmckay | and upgrades savanna, but keeps the database | 14:49 |
*** alazarev has joined #savanna | 14:49 | |
openstackgerrit | A change was merged to stackforge/puppet-savanna: This is the initial commit of the savanna puppet module. https://review.openstack.org/61156 | 14:57 |
*** IlyaE has joined #savanna | 14:58 | |
*** jcooley_ has joined #savanna | 15:00 | |
*** akuznetsov has quit IRC | 15:08 | |
*** akuznetsov has joined #savanna | 15:13 | |
*** jcooley_ has quit IRC | 15:37 | |
*** jcooley_ has joined #savanna | 15:38 | |
*** jcooley_ has quit IRC | 15:43 | |
*** NikitaKonovalov has quit IRC | 15:53 | |
*** ityaptin_ has quit IRC | 16:01 | |
*** ityaptin has quit IRC | 16:01 | |
*** rnirmal_ has joined #savanna | 16:02 | |
*** rnirmal has quit IRC | 16:02 | |
*** rnirmal_ is now known as rnirmal | 16:02 | |
*** jcooley_ has joined #savanna | 16:09 | |
*** jcooley_ has quit IRC | 16:21 | |
*** jcooley_ has joined #savanna | 16:21 | |
*** jcooley_ has quit IRC | 16:25 | |
*** IlyaE has quit IRC | 16:37 | |
*** openstackgerrit has quit IRC | 16:37 | |
*** IlyaE has joined #savanna | 16:38 | |
*** openstackgerrit has joined #savanna | 16:38 | |
*** alazarev has quit IRC | 16:43 | |
*** SergeyLukjanov has quit IRC | 16:43 | |
*** IlyaE_ has joined #savanna | 16:44 | |
*** dmitryme_ has joined #savanna | 16:47 | |
*** dmitryme has quit IRC | 16:47 | |
*** dmitryme_ is now known as dmitryme | 16:47 | |
*** IlyaE has quit IRC | 16:49 | |
*** openstackgerrit has quit IRC | 16:49 | |
*** IlyaE_ is now known as IlyaE | 16:49 | |
*** akuznetsov has quit IRC | 16:55 | |
*** jcooley_ has joined #savanna | 16:55 | |
*** alazarev has joined #savanna | 16:58 | |
*** alazarev has quit IRC | 16:58 | |
tmckay | aignatov, so when I run a mapred job and specify output as swift://tmckay.savanna/output, it creates swift://tmckay/output. Even though the path is correct in workflow.xml. Have you seen this? | 17:03 |
aignatov | tmckay, that's correct behaviour, "savanna" word is like a delimiter. It allows to run single hadoop cluster over multiple swift storages | 17:06 |
*** dmitryme has quit IRC | 17:06 | |
aignatov | you can observe this in the hadoop patch for swift | 17:06 |
aignatov | in savanna-extra repo | 17:07 |
tmckay | ah, I see | 17:07 |
tmckay | so it works the same on input? | 17:07 |
tmckay | that is, I should put my stuff in swift://tmckay and then specify swift://tmckay.savanna in the submission? | 17:08 |
aignatov | yes, it should work over all paths in swift :) | 17:08 |
*** dmitryme has joined #savanna | 17:08 | |
aignatov | hm, but not sure about root catalog | 17:09 |
aignatov | in swift | 17:09 |
aignatov | need to check, I don't know exactly | 17:09 |
*** nprivalova_ has joined #savanna | 17:11 | |
*** aignatov has quit IRC | 17:13 | |
*** nprivalova has quit IRC | 17:13 | |
*** nprivalova_ is now known as nprivalova | 17:13 | |
*** dmitryme has quit IRC | 17:14 | |
*** ruhe has quit IRC | 17:19 | |
*** openstackgerrit has joined #savanna | 17:22 | |
*** SergeyLukjanov has joined #savanna | 17:23 | |
*** ruhe has joined #savanna | 17:46 | |
*** SergeyLukjanov_ has joined #savanna | 17:48 | |
*** SergeyLukjanov has quit IRC | 17:48 | |
*** akuznetsov has joined #savanna | 18:06 | |
*** dmitryme has joined #savanna | 18:13 | |
*** IlyaE has quit IRC | 18:14 | |
*** IlyaE has joined #savanna | 18:15 | |
*** ruhe has quit IRC | 18:16 | |
*** nadya has joined #savanna | 18:34 | |
*** nadya is now known as Guest16065 | 18:34 | |
openstackgerrit | Trevor McKay proposed a change to openstack/savanna: Change "Jar" job type to "MapReduce" https://review.openstack.org/62058 | 18:41 |
tmckay | crobertsrh, okay, I tested this with the UI from master and it looks like things will still run without breakage ^^ | 18:56 |
crobertsrh | Awesome! | 18:57 |
crobertsrh | I'll take a peek | 18:57 |
tmckay | crobertsrh, you should be able to change "Jar" to "MapReduce" at your liesure | 18:57 |
*** IlyaE has quit IRC | 18:57 | |
crobertsrh | Ok, I'll add that to my list | 18:57 |
*** alazarev has joined #savanna | 19:00 | |
openstackgerrit | A change was merged to openstack/savanna: Launch integration tests with testr https://review.openstack.org/61769 | 19:15 |
openstackgerrit | Jonathan Maron proposed a change to openstack/savanna: Enable data locality for HDP plugin https://review.openstack.org/62064 | 19:17 |
*** IlyaE has joined #savanna | 19:20 | |
*** Guest16065 has quit IRC | 19:26 | |
*** nadya has joined #savanna | 19:37 | |
*** nadya is now known as Guest22138 | 19:38 | |
openstackgerrit | Andrew Lazarev proposed a change to openstack/savanna: Added 'gcc' to requirements. https://review.openstack.org/62070 | 19:50 |
*** tmckay has quit IRC | 19:53 | |
*** Guest22138 has quit IRC | 19:57 | |
openstackgerrit | Andrew Lazarev proposed a change to openstack/savanna: Added 'gcc' to requirements in dev instructions. https://review.openstack.org/62070 | 19:59 |
*** tmckay has joined #savanna | 20:00 | |
*** alazarev has quit IRC | 20:15 | |
*** jcooley_ has quit IRC | 20:24 | |
*** jcooley_ has joined #savanna | 20:37 | |
*** jcooley_ has quit IRC | 20:39 | |
*** crobertsrh has quit IRC | 20:58 | |
*** crobertsrh has joined #savanna | 21:03 | |
*** alazarev has joined #savanna | 21:05 | |
*** jcooley_ has joined #savanna | 21:05 | |
openstackgerrit | Andrew Lazarev proposed a change to openstack/savanna: Added 'gcc' to requirements in dev instructions https://review.openstack.org/62070 | 21:09 |
*** jmaron1 has joined #savanna | 21:23 | |
*** jmaron2 has joined #savanna | 21:27 | |
*** jmaron has quit IRC | 21:27 | |
*** jmaron1 has quit IRC | 21:27 | |
*** jcooley_ has quit IRC | 21:41 | |
openstackgerrit | Jonathan Maron proposed a change to openstack/savanna: Enable data locality for HDP plugin https://review.openstack.org/62064 | 21:48 |
*** jcooley_ has joined #savanna | 21:52 | |
*** SergeyLukjanov_ has quit IRC | 21:53 | |
*** jcooley_ has quit IRC | 21:57 | |
*** IlyaE has quit IRC | 22:00 | |
*** jcooley_ has joined #savanna | 22:01 | |
*** IlyaE has joined #savanna | 22:02 | |
*** tmckay has quit IRC | 22:09 | |
*** dmitryme has quit IRC | 22:22 | |
*** alazarev has quit IRC | 22:25 | |
*** jcooley_ has quit IRC | 22:25 | |
*** crobertsrh is now known as _crobertsrh | 22:25 | |
*** IlyaE has quit IRC | 22:26 | |
*** jmaron2 has quit IRC | 22:28 | |
*** jmaron has joined #savanna | 22:58 | |
*** jmaron has quit IRC | 23:05 | |
*** rnirmal has quit IRC | 23:20 | |
*** IlyaE has joined #savanna | 23:54 | |
*** alazarev has joined #savanna | 23:55 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!