| *** pgadiya has joined #openstack-sahara | 03:35 | |
| *** pgadiya has quit IRC | 03:35 | |
| *** Bhujay has joined #openstack-sahara | 03:37 | |
| *** Bhujay has quit IRC | 03:44 | |
| *** links has joined #openstack-sahara | 04:14 | |
| *** Bhujay has joined #openstack-sahara | 04:33 | |
| *** Bhujay has quit IRC | 04:50 | |
| *** Bhujay has joined #openstack-sahara | 04:50 | |
| *** pcaruana has joined #openstack-sahara | 06:26 | |
| *** rcernin has quit IRC | 07:10 | |
| *** tosky has joined #openstack-sahara | 07:40 | |
| *** links has quit IRC | 07:50 | |
| openstackgerrit | Zhuang Changkun proposed openstack/sahara master: Replace the deleted keypair in clusters for API v2 https://review.openstack.org/539856 | 08:00 |
|---|---|---|
| Bhujay | https://docs.openstack.org/sahara/queens/user/edp.html#additional-details-for-spark-jobs - this doc shows java and scala main methods , is it possible to submit a python job ? | 08:15 |
| Bhujay | tosky:^ | 08:16 |
| tosky | Bhujay: I'm not the right one for this question; we discussed about some issues with the Spark wrapper in the past | 08:18 |
| tosky | but I don't remember if they were about the spark job wrapper in general or specifically about the ability of running python jobs | 08:18 |
| tosky | please wait for tellesnobrega or jeremyfreudberg | 08:19 |
| Bhujay | tosky , ok , thanks | 08:19 |
| Bhujay | tellesnobrega, jeremyfreudberg if you can provide me some help on running a spark python job will be great | 08:21 |
| openstackgerrit | Alessandro Nesta proposed openstack/sahara master: Updated oozie version https://review.openstack.org/573104 | 08:23 |
| * tosky wonders why people choose the name of famous Italian football players as nick here in openstack | 08:26 | |
| Bhujay | tosky , have ever hard of a wired problem , after sahara deploys the cluster with public ip , all vm in the provider network becomes inaccessible ? | 08:26 |
| tosky | uh, no | 08:29 |
| *** Bhujay has quit IRC | 08:39 | |
| *** mtsv has joined #openstack-sahara | 08:46 | |
| openstackgerrit | Zhuang Changkun proposed openstack/sahara master: Replace the deleted keypair in clusters for API v2 https://review.openstack.org/539856 | 09:15 |
| *** Bhujay has joined #openstack-sahara | 09:16 | |
| openstackgerrit | Zhuang Changkun proposed openstack/sahara master: Replace the deleted keypair in clusters for API v2 https://review.openstack.org/539856 | 10:55 |
| tellesnobrega | Bhujay, hi | 11:28 |
| tellesnobrega | I'm here | 11:28 |
| tellesnobrega | lets start from scratch | 11:28 |
| tellesnobrega | you can run a python spark job | 11:28 |
| tellesnobrega | but, and this is a bug that we are trying to fix | 11:29 |
| tellesnobrega | if the job involves getting data from swift it will break | 11:29 |
| tellesnobrega | we have a wrapper script that does this work and it is really outdated | 11:29 |
| tellesnobrega | we didn't have the time to fix it up yet | 11:29 |
| openstackgerrit | Telles Mota Vidal Nóbrega proposed openstack/sahara master: Adding CDH 5.13 https://review.openstack.org/573802 | 11:44 |
| openstackgerrit | Merged openstack/sahara master: doc: external link helper for other projects' doc https://review.openstack.org/573707 | 11:54 |
| Bhujay | tellesnobrega, thanks for your reply , how to submit the job from horizon ? do we need a python class with main method that need to be mentioned in the UI as the main class ? | 12:12 |
| tellesnobrega | yes | 12:12 |
| tellesnobrega | I'm not 100% sure, but iirc, it should be main (or whatever function is the main function from you python) | 12:15 |
| Bhujay | is the bug description there in storyboard and the location of the wrapper script ? | 12:16 |
| tellesnobrega | I don't think so | 12:16 |
| tellesnobrega | we need to update that | 12:16 |
| Bhujay | ok, I will try to run python job with swift and see what happens | 12:17 |
| tellesnobrega | thanks | 12:18 |
| *** pcaruana has quit IRC | 12:39 | |
| openstackgerrit | Merged openstack/python-saharaclient master: fix tox python3 overrides https://review.openstack.org/573351 | 13:03 |
| openstackgerrit | Merged openstack/python-saharaclient master: Remove PyPI downloads https://review.openstack.org/573271 | 13:03 |
| openstackgerrit | Merged openstack/sahara master: Updated oozie version https://review.openstack.org/573104 | 13:03 |
| openstackgerrit | Merged openstack/sahara-tests master: fix tox python3 overrides https://review.openstack.org/573999 | 13:21 |
| Bhujay | tellesnobrega, tosky the spark plugin doesn't add openstack domain info in core-site.xml and that is the main cause of swift connectivity i discussed few days back. There is no need for replacing the hadoop-openstack.jar , this alone solves the problem . if you agree i will propose the changes in plugin | 13:21 |
| tellesnobrega | sounds good to me | 13:22 |
| Bhujay | and the other thing is importing the self signed certificate , I will also try to do this | 13:23 |
| *** pcaruana has joined #openstack-sahara | 13:32 | |
| *** Bhujay has quit IRC | 13:35 | |
| openstackgerrit | zhulingjie proposed openstack/sahara-dashboard master: fix tox python3 overrides https://review.openstack.org/574260 | 13:39 |
| tosky | why was the other patch on sahara-dashboard abandoned? | 13:41 |
| tellesnobrega | which one? | 13:41 |
| tosky | 573998 | 13:42 |
| tosky | I need to understand why Doug only submitted few patches and did not purse all the others | 13:43 |
| tosky | and also why there was no announcment about this change under an [all] tag | 13:43 |
| tellesnobrega | I think he sent out an email saying that he would start this | 13:48 |
| tellesnobrega | but would need help to send the others | 13:48 |
| tosky | uhm, ok, I need to recheck | 13:48 |
| tosky | tellesnobrega: there is still one swap file in the CDH 5.13 patch | 13:49 |
| tellesnobrega | fixing it | 13:49 |
| openstackgerrit | Telles Mota Vidal Nóbrega proposed openstack/sahara master: Adding CDH 5.13 https://review.openstack.org/573802 | 13:51 |
| tosky | tellesnobrega: "is support" in the release notes (but no need to fix it now, let me find few other bugs :) | 13:57 |
| tellesnobrega | oh, my bad | 13:58 |
| tosky | np :) | 14:02 |
| *** jeremyfreudberg has joined #openstack-sahara | 14:20 | |
| openstackgerrit | Merged openstack/sahara master: doc: light cleanup of the ironic-integration page https://review.openstack.org/573733 | 14:22 |
| jeremyfreudberg | hey tosky, do you know if it's possible to use the doc external link helper ( https://review.openstack.org/#/c/573707 ) on releasenotes? | 14:34 |
| tosky | jeremyfreudberg: uhm, not sure; it's a feature provided by openstackdocstheme, but I don't think anyone ever tried that | 14:35 |
| tosky | in fact I think that my patch is one of the first real usage of the external link helper | 14:36 |
| jeremyfreudberg | i see | 14:37 |
| jeremyfreudberg | i might give it a quick try | 14:37 |
| tosky | probably faster | 14:38 |
| *** jeremyfreudberg has left #openstack-sahara | 14:54 | |
| *** jeremyfreudberg has joined #openstack-sahara | 14:55 | |
| openstackgerrit | Merged openstack/sahara-tests master: Fix NGT creation test with multiple plugin versions https://review.openstack.org/573643 | 15:25 |
| openstackgerrit | Chason Chan proposed openstack/puppet-sahara master: Stop abusing [keystone_authtoken] https://review.openstack.org/574320 | 16:05 |
| tosky | jeremyfreudberg: uh, uh ^^ | 16:14 |
| jeremyfreudberg | tosky: yes, i'm proud of my writing skills when someone copies my commit message verbatim | 16:17 |
| jeremyfreudberg | regarding the actual code, it's ruby, so... | 16:17 |
| tosky | eheh | 16:17 |
| *** jeremyfreudberg has quit IRC | 17:00 | |
| *** jeremyfreudberg has joined #openstack-sahara | 17:27 | |
| openstackgerrit | Telles Mota Vidal Nóbrega proposed openstack/sahara master: Adding CDH 5.13 https://review.openstack.org/573802 | 17:53 |
| *** jeremyfreudberg has quit IRC | 18:02 | |
| *** dave-mcc_ has quit IRC | 18:25 | |
| *** dave-mccowan has joined #openstack-sahara | 18:26 | |
| *** jeremyfreudberg has joined #openstack-sahara | 19:18 | |
| *** jeremyfreudberg has quit IRC | 19:43 | |
| -openstackstatus- NOTICE: Zuul was restarted for a software upgrade; changes uploaded or approved between 19:30 and 19:50 will need to be rechecked | 19:57 | |
| *** hoonetorg has joined #openstack-sahara | 20:05 | |
| *** jeremyfreudberg has joined #openstack-sahara | 22:10 | |
| *** rcernin has joined #openstack-sahara | 22:16 | |
| *** jeremyfreudberg has quit IRC | 22:30 | |
| *** jeremyfreudberg has joined #openstack-sahara | 22:40 | |
| openstackgerrit | Merged openstack/sahara-dashboard master: fix tox python3 overrides https://review.openstack.org/573998 | 22:55 |
| *** jeremyfreudberg has quit IRC | 22:56 | |
| *** hoonetorg has quit IRC | 23:24 | |
| *** tosky has quit IRC | 23:32 | |
| *** hoonetorg has joined #openstack-sahara | 23:36 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!