| *** NikitaKonovalov has joined #savanna | 00:05 | |
| *** NikitaKonovalov has quit IRC | 00:09 | |
| *** dina_belova has joined #savanna | 00:33 | |
| *** dina_belova has quit IRC | 00:37 | |
| *** IlyaE has quit IRC | 00:41 | |
| *** IlyaE has joined #savanna | 00:42 | |
| *** IlyaE has quit IRC | 00:47 | |
| *** NikitaKonovalov has joined #savanna | 01:06 | |
| *** NikitaKonovalov has quit IRC | 01:10 | |
| openstackgerrit | Matthew Farrellee proposed a change to stackforge/savanna-dashboard: Fix package_data for non setuptools-git build/install https://review.openstack.org/43745 | 01:12 |
|---|---|---|
| *** dina_belova has joined #savanna | 01:33 | |
| *** dina_belova has quit IRC | 01:38 | |
| *** chandoo has joined #savanna | 01:51 | |
| *** chandoo has quit IRC | 02:02 | |
| *** NikitaKonovalov has joined #savanna | 02:06 | |
| *** NikitaKonovalov has quit IRC | 02:11 | |
| *** dina_belova has joined #savanna | 02:34 | |
| *** dina_belova has quit IRC | 02:38 | |
| *** NikitaKonovalov has joined #savanna | 03:07 | |
| *** NikitaKonovalov has quit IRC | 03:11 | |
| *** dina_belova has joined #savanna | 03:34 | |
| *** dina_belova has quit IRC | 03:39 | |
| *** NikitaKonovalov has joined #savanna | 04:07 | |
| *** NikitaKonovalov has quit IRC | 04:12 | |
| *** sacharya has quit IRC | 04:26 | |
| *** dina_belova has joined #savanna | 04:35 | |
| *** dina_belova has quit IRC | 04:39 | |
| *** akuznetsov has joined #savanna | 04:44 | |
| *** NikitaKonovalov has joined #savanna | 05:08 | |
| *** akuznetsov has quit IRC | 05:11 | |
| *** NikitaKonovalov has quit IRC | 05:13 | |
| *** SergeyLukjanov has joined #savanna | 05:17 | |
| *** dina_belova has joined #savanna | 05:35 | |
| *** dina_belova has quit IRC | 05:40 | |
| *** dina_belova has joined #savanna | 06:00 | |
| *** NikitaKonovalov has joined #savanna | 06:09 | |
| *** NikitaKonovalov has quit IRC | 06:13 | |
| *** NikitaKonovalov has joined #savanna | 06:38 | |
| *** dina_belova has quit IRC | 06:47 | |
| *** dina_belova has joined #savanna | 06:47 | |
| *** ruhe has joined #savanna | 06:49 | |
| *** dina_belova has quit IRC | 06:52 | |
| *** ruhe has quit IRC | 06:57 | |
| openstackgerrit | Sergey Lukjanov proposed a change to stackforge/savanna: Ensure that translations packaged to tarballs https://review.openstack.org/43835 | 07:02 |
| *** akuznetsov has joined #savanna | 07:03 | |
| openstackgerrit | Sergey Lukjanov proposed a change to stackforge/savanna-dashboard: Migrate to pbr https://review.openstack.org/43462 | 07:09 |
| *** NikitaKonovalov has quit IRC | 07:13 | |
| *** IlyaE has joined #savanna | 07:19 | |
| *** NikitaKonovalov has joined #savanna | 07:24 | |
| *** SergeyLukjanov has quit IRC | 07:27 | |
| *** IlyaE has quit IRC | 07:49 | |
| *** dmitryme has joined #savanna | 07:57 | |
| *** dina_belova has joined #savanna | 07:58 | |
| *** nprivalova has joined #savanna | 08:02 | |
| *** dina_belova has quit IRC | 08:02 | |
| *** ruhe has joined #savanna | 08:05 | |
| *** dmitryme has quit IRC | 08:54 | |
| *** dina_belova has joined #savanna | 08:59 | |
| *** dmitryme has joined #savanna | 08:59 | |
| *** dina_belova has quit IRC | 09:03 | |
| *** IvanBerezovskiy has joined #savanna | 09:08 | |
| *** dmitryme has quit IRC | 09:42 | |
| *** dmitryme has joined #savanna | 09:45 | |
| *** dina_belova has joined #savanna | 09:59 | |
| *** dina_belova has quit IRC | 10:04 | |
| *** NikitaKonovalov has quit IRC | 10:11 | |
| *** ruhe has quit IRC | 10:12 | |
| *** akuznetsov has quit IRC | 10:12 | |
| *** nprivalova has quit IRC | 10:17 | |
| openstackgerrit | Ivan Berezovskiy proposed a change to stackforge/savanna-extra: Add Hive DIB element https://review.openstack.org/43719 | 10:27 |
| *** IvanBerezovskiy has quit IRC | 10:27 | |
| *** bogdando has quit IRC | 10:27 | |
| *** akuznetsov has joined #savanna | 10:40 | |
| *** NikitaKonovalov has joined #savanna | 10:42 | |
| *** ruhe has joined #savanna | 10:44 | |
| *** IvanBerezovskiy has joined #savanna | 10:45 | |
| *** nprivalova has joined #savanna | 10:46 | |
| *** NikitaKonovalov has quit IRC | 10:51 | |
| *** NikitaKonovalov has joined #savanna | 10:56 | |
| *** bogdando has joined #savanna | 10:59 | |
| *** dina_belova has joined #savanna | 11:00 | |
| *** dina_belova has quit IRC | 11:04 | |
| *** nprivalova has quit IRC | 11:21 | |
| *** nprivalova has joined #savanna | 11:31 | |
| *** akuznetsov has quit IRC | 11:41 | |
| *** akuznetsov has joined #savanna | 11:44 | |
| *** akuznetsov has quit IRC | 11:59 | |
| *** dina_belova has joined #savanna | 12:00 | |
| *** dina_belova has quit IRC | 12:04 | |
| *** akuznetsov has joined #savanna | 12:10 | |
| *** _crobertsrh has quit IRC | 12:11 | |
| *** dina_belova has joined #savanna | 12:14 | |
| *** dina_belova has quit IRC | 12:18 | |
| *** IvanBerezovskiy has quit IRC | 12:23 | |
| *** crobertsrh has joined #savanna | 12:28 | |
| openstackgerrit | Nadya Privalova proposed a change to stackforge/savanna: First version of job manager https://review.openstack.org/42304 | 12:35 |
| *** nprivalova has quit IRC | 12:46 | |
| *** tmckay has joined #savanna | 12:55 | |
| *** nprivalova has joined #savanna | 13:00 | |
| *** chandoo has joined #savanna | 13:01 | |
| openstackgerrit | Nadya Privalova proposed a change to stackforge/savanna: First version of job manager https://review.openstack.org/42304 | 13:04 |
| *** dina_belova has joined #savanna | 13:14 | |
| openstackgerrit | Nikolay Mahotkin proposed a change to stackforge/savanna: Oozie + MySQL configuration https://review.openstack.org/41652 | 13:15 |
| *** dmitryme has quit IRC | 13:15 | |
| *** dina_belova has quit IRC | 13:19 | |
| *** ruhe has quit IRC | 13:19 | |
| *** ruhe has joined #savanna | 13:23 | |
| openstackgerrit | Nikolay Mahotkin proposed a change to stackforge/savanna: Oozie + MySQL configuration https://review.openstack.org/41652 | 13:28 |
| *** nprivalova has quit IRC | 13:31 | |
| *** nprivalova has joined #savanna | 13:40 | |
| *** ruhe has quit IRC | 13:42 | |
| *** dmitryme has joined #savanna | 13:42 | |
| *** ruhe has joined #savanna | 13:45 | |
| *** dmitryme has quit IRC | 14:03 | |
| *** dmitryme_ has joined #savanna | 14:03 | |
| *** ruhe has quit IRC | 14:06 | |
| openstackgerrit | Nadya Privalova proposed a change to stackforge/savanna: First version of job manager https://review.openstack.org/42304 | 14:11 |
| *** ruhe has joined #savanna | 14:11 | |
| *** sacharya has joined #savanna | 14:14 | |
| *** dina_belova has joined #savanna | 14:15 | |
| *** ruhe has quit IRC | 14:16 | |
| openstackgerrit | Nadya Privalova proposed a change to stackforge/savanna: First version of job manager https://review.openstack.org/42304 | 14:18 |
| *** dina_belova has quit IRC | 14:19 | |
| *** dina_belova has joined #savanna | 14:32 | |
| *** sacharya has quit IRC | 14:33 | |
| *** ruhe has joined #savanna | 14:33 | |
| openstackgerrit | Nadya Privalova proposed a change to stackforge/savanna: First version of job manager https://review.openstack.org/42304 | 14:41 |
| tmckay | nprivalova, ping | 14:49 |
| nprivalova | hi! | 14:49 |
| tmckay | nprivalova, hi! Just thinking ahead, we will have to decide what is the best way to retrieve binaries from other sources (swift). In this code here from the job_manager, job_binary_get_raw_data(url) could be smarter to deal with other urls, or something like "job_origin_get_binary(job_origin_id)" could wrap retrieval from swift or job_binary_get_raw_data. I think something like the second, do you agree? | 14:51 |
| tmckay | main_binary = conductor.job_binary_get_raw_data(context.ctx(),91 job_origin.url) | 14:51 |
| tmckay | oops, line wrapping | 14:51 |
| *** chandoo has quit IRC | 14:52 | |
| tmckay | Having the JobOrigin component wrap retrieval I think lines up better with previous discussions | 14:52 |
| tmckay | But, for now, there is nothing but binaries and no JobOrigin function to get them :) | 14:53 |
| nprivalova | yes, we should think about it. But we should not forget that one job may have several bin-resources | 14:54 |
| tmckay | true, like your lib param that you suggested | 14:55 |
| tmckay | nprivalova, and we need to decide on a formal url scheme to indicate internal db storage | 14:55 |
| nprivalova | yes, we have some problems with urls... | 14:56 |
| *** IlyaE has joined #savanna | 14:56 | |
| akuznetsov | tmckay and nprivalova I think that the second variant is better | 14:56 |
| *** SergeyLukjanov has joined #savanna | 14:57 | |
| nprivalova | tmckay, did you see https://review.openstack.org/#/c/43470/ ? | 14:57 |
| tmckay | nprivalova, akuznetsov, if we can spend some time designing how it "should" be, I can work on fixing up url schemes, wrappers, etc before going after swift. Internal db retrieval should be totally transparent in the job manager. | 14:58 |
| tmckay | I think I did, briefly, but I will look again | 14:58 |
| * tmckay thinks maybe he should move further East to work with savanna members :) | 15:00 | |
| *** dmitryme_ has quit IRC | 15:02 | |
| *** sacharya has joined #savanna | 15:04 | |
| akuznetsov | tmckay, nprivalova we should create a component which support different way of getting job binaries. It should provide an abstraction for this. The first candidate is a abstract method for getting job binaries for work manger | 15:04 |
| openstackgerrit | A change was merged to stackforge/savanna-extra: Add Hive DIB element https://review.openstack.org/43719 | 15:10 |
| openstackgerrit | A change was merged to stackforge/savanna-dashboard: Migrate to pbr https://review.openstack.org/43462 | 15:11 |
| openstackgerrit | A change was merged to stackforge/savanna-extra: Package with pbr https://review.openstack.org/43428 | 15:11 |
| openstackgerrit | A change was merged to stackforge/savanna: First version of job manager https://review.openstack.org/42304 | 15:11 |
| *** ruhe has quit IRC | 15:13 | |
| openstackgerrit | A change was merged to stackforge/savanna: Ensure that translations packaged to tarballs https://review.openstack.org/43835 | 15:14 |
| openstackgerrit | Dina Belova proposed a change to stackforge/savanna: Migrate to pbr https://review.openstack.org/37480 | 15:19 |
| *** dmitryme has joined #savanna | 15:22 | |
| *** ruhe has joined #savanna | 15:23 | |
| openstackgerrit | A change was merged to stackforge/savanna: Migrate to pbr https://review.openstack.org/37480 | 15:25 |
| tmckay | akuznetsov, is that just an extension of the current JobOrigin component? The blueprint still lists a "get job code" function | 15:26 |
| tmckay | https://blueprints.launchpad.net/savanna/+spec/edp-job-origin-component | 15:27 |
| akuznetsov | tmckay yes it should provide an abstraction for get job code from different job sources like swift, internal db etc. | 15:28 |
| tmckay | akuznetso, okay, I'll start working on that. | 15:29 |
| crobertsrh | nprivalova: I'm excited to see the job manager is now merged. I'd like to take it for a drive. Do you have an example of a job that I could try running? I'm a little unsure on how to generate a valid data source for input/output. | 15:40 |
| nprivalova | crobertsrh, me too :) I will send you an example by e-mail, ok? | 15:42 |
| crobertsrh | Great, thanks! | 15:42 |
| akuznetsov | crobertsrh today I commit the python client update for savanna and give you example how to run pig script on cluster | 15:43 |
| crobertsrh | awesome | 15:43 |
| *** mattf is now known as _mattf | 15:52 | |
| *** _mattf is now known as mattf | 15:58 | |
| *** rnirmal has joined #savanna | 16:09 | |
| ruhe | mattf, folks in #openstack-infra channel are discussing election process for Tuskar. maybe you can give them a hint | 16:16 |
| openstackgerrit | Ivan Berezovskiy proposed a change to stackforge/savanna-extra: Add diskimage-creating script https://review.openstack.org/43916 | 16:22 |
| mattf | ruhe, joining | 16:27 |
| *** NikitaKonovalov has quit IRC | 16:28 | |
| *** dmitryme has quit IRC | 16:38 | |
| *** akuznetsov has quit IRC | 16:39 | |
| *** dina_belova has quit IRC | 16:39 | |
| *** dina_belova has joined #savanna | 16:40 | |
| *** SergeyLukjanov has quit IRC | 16:43 | |
| *** dina_belova has quit IRC | 16:44 | |
| *** ruhe has quit IRC | 16:50 | |
| *** dina_belova has joined #savanna | 17:00 | |
| *** ruhe has joined #savanna | 17:00 | |
| *** nprivalova has quit IRC | 17:05 | |
| openstackgerrit | Yaroslav Lobankov proposed a change to stackforge/savanna: Integration test refactoring https://review.openstack.org/43925 | 17:18 |
| *** ruhe has quit IRC | 17:20 | |
| *** NikitaKonovalov has joined #savanna | 17:28 | |
| *** tmckay is now known as _tmckay | 17:29 | |
| *** dina_belova has quit IRC | 17:30 | |
| *** dina_belova has joined #savanna | 17:31 | |
| *** NikitaKonovalov has quit IRC | 17:32 | |
| *** IlyaE has quit IRC | 17:34 | |
| *** dina_belova has quit IRC | 17:35 | |
| *** NikitaKonovalov has joined #savanna | 17:35 | |
| *** NikitaKonovalov has quit IRC | 17:41 | |
| *** NikitaKonovalov has joined #savanna | 17:41 | |
| *** dina_belova has joined #savanna | 17:45 | |
| *** IlyaE has joined #savanna | 17:58 | |
| *** NikitaKonovalov has quit IRC | 17:58 | |
| *** NikitaKonovalov has joined #savanna | 17:59 | |
| *** SergeyLukjanov has joined #savanna | 18:00 | |
| *** dmitryme has joined #savanna | 18:06 | |
| *** dina_belova has quit IRC | 18:27 | |
| *** dina_belova has joined #savanna | 18:28 | |
| *** dina_belova has quit IRC | 18:32 | |
| *** _tmckay is now known as tmckay | 18:33 | |
| *** ruhe has joined #savanna | 18:39 | |
| *** NikitaKonovalov has quit IRC | 18:39 | |
| *** ruhe has quit IRC | 18:39 | |
| *** NikitaKonovalov has joined #savanna | 18:39 | |
| *** akuznetsov has joined #savanna | 18:41 | |
| *** rnirmal has quit IRC | 18:51 | |
| *** akuznetsov has quit IRC | 18:55 | |
| *** akuznetsov has joined #savanna | 18:56 | |
| *** IlyaE has quit IRC | 19:01 | |
| *** akuznetsov has quit IRC | 19:13 | |
| *** akuznetsov has joined #savanna | 19:14 | |
| tmckay | nprivalova, akuznetsov, I have a question about job_execution_update (looking at https://review.openstack.org/#/c/43470/1) | 19:18 |
| akuznetsov | tmckay what question? | 19:19 |
| tmckay | Is there some process somewhere that polls job_execution status and calls update? I only see a few calls through the REST api and conductor. How does a job execution move through different "status" values? And what are they? | 19:20 |
| tmckay | essentially, I am not familiar with execution status and the different states a job can enter | 19:21 |
| akuznetsov | we have started working on this | 19:22 |
| akuznetsov | job status it the copy from Oozei status | 19:22 |
| akuznetsov | you can look on Oozei possible status at following link http://oozie.apache.org/docs/3.3.2/client/apidocs/org/apache/oozie/client/Job.Status.html | 19:24 |
| tmckay | akuznetsov, okay, thanks. I was curious. | 19:27 |
| *** dina_belova has joined #savanna | 19:28 | |
| *** akuznetsov has quit IRC | 19:29 | |
| *** dina_belova has quit IRC | 19:33 | |
| *** dina_belova has joined #savanna | 19:39 | |
| *** akuznetsov has joined #savanna | 19:39 | |
| *** dina_belova has quit IRC | 19:43 | |
| *** akuznetsov has quit IRC | 19:51 | |
| *** dmitryme has quit IRC | 19:52 | |
| *** rnirmal has joined #savanna | 20:21 | |
| *** dina_belova has joined #savanna | 20:28 | |
| *** NikitaKonovalov has quit IRC | 20:29 | |
| *** dmitryme has joined #savanna | 20:33 | |
| *** rnirmal has quit IRC | 20:36 | |
| *** mattf is now known as _mattf | 20:46 | |
| *** openstackgerrit has quit IRC | 20:55 | |
| *** openstackgerrit has joined #savanna | 20:56 | |
| *** dmitryme has quit IRC | 21:07 | |
| *** crobertsrh is now known as _crobertsrh | 21:17 | |
| *** dina_belova has quit IRC | 21:29 | |
| *** dina_belova has joined #savanna | 21:29 | |
| *** NikitaKonovalov has joined #savanna | 21:30 | |
| *** IlyaE has joined #savanna | 21:32 | |
| *** dina_belova has quit IRC | 21:34 | |
| *** NikitaKonovalov has quit IRC | 21:34 | |
| *** SergeyLukjanov has quit IRC | 22:05 | |
| *** _crobertsrh has quit IRC | 22:15 | |
| openstackgerrit | Jonathan Maron proposed a change to stackforge/savanna: Enable the scaling up of nodes in a cluster https://review.openstack.org/43532 | 22:28 |
| *** NikitaKonovalov has joined #savanna | 22:30 | |
| *** crobertsrh has joined #savanna | 22:33 | |
| *** sacharya has quit IRC | 22:33 | |
| *** NikitaKonovalov has quit IRC | 22:35 | |
| *** dina_belova has joined #savanna | 22:40 | |
| *** dina_belova has quit IRC | 22:45 | |
| *** NikitaKonovalov has joined #savanna | 23:30 | |
| *** NikitaKonovalov has quit IRC | 23:35 | |
| *** dina_belova has joined #savanna | 23:40 | |
| *** IlyaE has quit IRC | 23:42 | |
| *** dina_belova has quit IRC | 23:45 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!