| *** ViswaV has quit IRC | 00:42 | |
| *** Networkn3rd has joined #openstack-sahara | 00:52 | |
| *** Networkn3rd has quit IRC | 01:33 | |
| *** Networkn3rd has joined #openstack-sahara | 01:46 | |
| *** bradd1 has joined #openstack-sahara | 01:51 | |
| *** witlessb has joined #openstack-sahara | 01:56 | |
| *** witlessb has quit IRC | 02:01 | |
| *** bradd1 has quit IRC | 02:12 | |
| *** bradd1 has joined #openstack-sahara | 02:17 | |
| *** ViswaV has joined #openstack-sahara | 02:35 | |
| *** ViswaV_ has joined #openstack-sahara | 02:36 | |
| *** ViswaV has quit IRC | 02:40 | |
| *** openstackgerrit has quit IRC | 02:42 | |
| *** miqui has quit IRC | 02:42 | |
| *** miqui has joined #openstack-sahara | 02:42 | |
| *** openstackgerrit has joined #openstack-sahara | 02:43 | |
| *** tellesnobrega has quit IRC | 03:12 | |
| *** anteaya has quit IRC | 03:12 | |
| *** openstackgerrit has quit IRC | 03:12 | |
| *** elmiko has quit IRC | 03:12 | |
| *** Networkn3rd has quit IRC | 03:12 | |
| *** xianghui has quit IRC | 03:12 | |
| *** sreshetnyak has quit IRC | 03:12 | |
| *** SergeyLukjanov has quit IRC | 03:12 | |
| *** ruhe has quit IRC | 03:12 | |
| *** ekarlso has quit IRC | 03:12 | |
| *** venza_ has quit IRC | 03:12 | |
| *** boris-42 has quit IRC | 03:12 | |
| *** sballe has quit IRC | 03:12 | |
| *** aignatov has quit IRC | 03:12 | |
| *** ViswaV_ has quit IRC | 03:12 | |
| *** akuznetsov has quit IRC | 03:17 | |
| *** openstackgerrit has joined #openstack-sahara | 03:20 | |
| *** ViswaV_ has joined #openstack-sahara | 03:20 | |
| *** sballe has joined #openstack-sahara | 03:20 | |
| *** xianghui has joined #openstack-sahara | 03:20 | |
| *** elmiko has joined #openstack-sahara | 03:20 | |
| *** tellesnobrega has joined #openstack-sahara | 03:20 | |
| *** boris-42 has joined #openstack-sahara | 03:20 | |
| *** ekarlso has joined #openstack-sahara | 03:20 | |
| *** SergeyLukjanov has joined #openstack-sahara | 03:20 | |
| *** sreshetnyak has joined #openstack-sahara | 03:20 | |
| *** ruhe has joined #openstack-sahara | 03:20 | |
| *** venza_ has joined #openstack-sahara | 03:20 | |
| *** aignatov has joined #openstack-sahara | 03:20 | |
| *** anteaya has joined #openstack-sahara | 03:20 | |
| *** Networkn3rd has joined #openstack-sahara | 03:27 | |
| *** Networkn3rd has quit IRC | 03:27 | |
| *** ViswaV_ has quit IRC | 03:30 | |
| *** k4n0 has joined #openstack-sahara | 04:27 | |
| *** _crobertsrh has quit IRC | 04:37 | |
| *** crobertsrh has joined #openstack-sahara | 04:50 | |
| *** akuznetsov has joined #openstack-sahara | 06:16 | |
| openstackgerrit | A change was merged to openstack/sahara: Add vanilla plugin with Hadoop 2.4.0 https://review.openstack.org/105099 | 07:15 |
|---|---|---|
| *** elmiko has quit IRC | 07:18 | |
| *** tnovacik has joined #openstack-sahara | 07:25 | |
| *** elmiko has joined #openstack-sahara | 07:29 | |
| *** Timotey has joined #openstack-sahara | 08:06 | |
| *** xianghui has quit IRC | 08:13 | |
| *** witlessb has joined #openstack-sahara | 08:24 | |
| *** xianghui has joined #openstack-sahara | 08:26 | |
| *** tosky has joined #openstack-sahara | 09:43 | |
| *** akuznetsov has quit IRC | 09:55 | |
| *** k4n0 has quit IRC | 09:55 | |
| *** tellesnobrega has quit IRC | 09:55 | |
| *** anteaya has quit IRC | 09:55 | |
| *** openstackgerrit has quit IRC | 09:56 | |
| *** sreshetnyak has quit IRC | 09:56 | |
| *** SergeyLukjanov has quit IRC | 09:56 | |
| *** ruhe has quit IRC | 09:56 | |
| *** ekarlso has quit IRC | 09:56 | |
| *** venza_ has quit IRC | 09:56 | |
| *** boris-42 has quit IRC | 09:56 | |
| *** sballe has quit IRC | 09:56 | |
| *** aignatov has quit IRC | 09:56 | |
| *** tosky has quit IRC | 09:56 | |
| *** elmiko has quit IRC | 09:56 | |
| *** tnovacik has quit IRC | 09:56 | |
| *** crobertsrh has quit IRC | 09:56 | |
| *** xianghui has quit IRC | 09:56 | |
| *** witlessb has quit IRC | 09:56 | |
| *** Timotey has quit IRC | 09:56 | |
| *** zhiyan has quit IRC | 09:56 | |
| *** dmitryme has quit IRC | 09:56 | |
| *** NikitaKonovalov has quit IRC | 09:56 | |
| *** _mattf has quit IRC | 09:56 | |
| *** miqui has quit IRC | 09:56 | |
| *** skostiuchenko1 has quit IRC | 09:56 | |
| *** _mattf has joined #openstack-sahara | 10:03 | |
| *** NikitaKonovalov has joined #openstack-sahara | 10:03 | |
| *** dmitryme has joined #openstack-sahara | 10:03 | |
| *** zhiyan has joined #openstack-sahara | 10:03 | |
| *** Timotey has joined #openstack-sahara | 10:03 | |
| *** witlessb has joined #openstack-sahara | 10:03 | |
| *** xianghui has joined #openstack-sahara | 10:03 | |
| *** crobertsrh has joined #openstack-sahara | 10:03 | |
| *** tnovacik has joined #openstack-sahara | 10:03 | |
| *** tosky has joined #openstack-sahara | 10:03 | |
| *** elmiko has joined #openstack-sahara | 10:03 | |
| *** akuznetsov has joined #openstack-sahara | 10:03 | |
| *** k4n0 has joined #openstack-sahara | 10:03 | |
| *** anteaya has joined #openstack-sahara | 10:03 | |
| *** aignatov has joined #openstack-sahara | 10:03 | |
| *** venza_ has joined #openstack-sahara | 10:03 | |
| *** ruhe has joined #openstack-sahara | 10:03 | |
| *** sreshetnyak has joined #openstack-sahara | 10:03 | |
| *** SergeyLukjanov has joined #openstack-sahara | 10:03 | |
| *** ekarlso has joined #openstack-sahara | 10:03 | |
| *** boris-42 has joined #openstack-sahara | 10:03 | |
| *** tellesnobrega has joined #openstack-sahara | 10:03 | |
| *** sballe has joined #openstack-sahara | 10:03 | |
| *** openstackgerrit has joined #openstack-sahara | 10:03 | |
| *** skostiuchenko1 has joined #openstack-sahara | 10:03 | |
| openstackgerrit | Denis Egorenko proposed a change to stackforge/sahara-ci-config: Add support for Hadoop 2.4.0 https://review.openstack.org/106051 | 10:07 |
| *** miqui has joined #openstack-sahara | 10:08 | |
| openstackgerrit | Vitaly Gridnev proposed a change to openstack/sahara: Added some changes with oslo.i18n https://review.openstack.org/106981 | 10:13 |
| *** witlessb has quit IRC | 10:22 | |
| *** witlessb has joined #openstack-sahara | 10:23 | |
| *** vrovachev has joined #openstack-sahara | 10:24 | |
| openstackgerrit | A change was merged to openstack/sahara-image-elements: Add support building images for Hadoop 2.4.0 https://review.openstack.org/105107 | 10:42 |
| openstackgerrit | Vitaly Gridnev proposed a change to openstack/sahara: Added some changes with oslo.i18n https://review.openstack.org/106981 | 10:47 |
| openstackgerrit | Denis Egorenko proposed a change to stackforge/sahara-ci-config: Reconfiguring CI scripts for use second Devstack server https://review.openstack.org/106994 | 10:59 |
| *** k4n0 has quit IRC | 11:15 | |
| openstackgerrit | Denis Egorenko proposed a change to stackforge/sahara-ci-config: Reconfiguring CI scripts for use second Devstack server https://review.openstack.org/106994 | 11:15 |
| *** openstackgerrit has quit IRC | 11:21 | |
| tellesnobrega | is there a way that i can append to an existing file using sahara remote?? | 12:15 |
| *** openstackgerrit has joined #openstack-sahara | 12:16 | |
| SergeyLukjanov | tellesnobrega, nope :( https://github.com/openstack/sahara/blob/master/sahara/utils/remote.py | 12:19 |
| SergeyLukjanov | tellesnobrega, but it seems that it's easy to impl | 12:19 |
| tellesnobrega | i saw that | 12:19 |
| tellesnobrega | where is the remote implemented, this remote.py only has abstract methods | 12:20 |
| SergeyLukjanov | tellesnobrega, https://github.com/openstack/sahara/blob/master/sahara/utils/ssh_remote.py | 12:20 |
| SergeyLukjanov | tellesnobrega, currently we have only ssh based remote | 12:20 |
| SergeyLukjanov | it's based on paramiko | 12:20 |
| tellesnobrega | hm | 12:21 |
| tellesnobrega | does this needs a spec to implement? | 12:23 |
| openstackgerrit | A change was merged to stackforge/sahara-ci-config: Add support for Hadoop 2.4.0 https://review.openstack.org/106051 | 12:25 |
| SergeyLukjanov | tellesnobrega, if you can do it - please make a small spec | 12:27 |
| tellesnobrega | sure | 12:28 |
| SergeyLukjanov | tellesnobrega, it could be useful to discuss implementation details | 12:28 |
| SergeyLukjanov | tellesnobrega, thx | 12:28 |
| openstackgerrit | Denis Egorenko proposed a change to stackforge/sahara-ci-config: Reconfiguring CI scripts for use second Devstack server https://review.openstack.org/106994 | 12:41 |
| *** Networkn3rd has joined #openstack-sahara | 12:42 | |
| openstackgerrit | susanne-balle proposed a change to openstack/sahara: Renamed Pending to PENDING fixes bug 1329526 https://review.openstack.org/107047 | 13:21 |
| tellesnobrega | SergeyLukjanov: i was trying to use ssh_remote here to check out how it works, sadly it has no tests to run. I wanted to test if with the write file method that already exists the append could be done | 13:31 |
| *** openstackgerrit has quit IRC | 13:31 | |
| tellesnobrega | it opens a file as w, do you know if it starts writing at the beginning of the file or the end? | 13:32 |
| *** 17SAAF480 has joined #openstack-sahara | 13:32 | |
| *** tmckay has joined #openstack-sahara | 13:34 | |
| 17SAAF480 | A change was merged to openstack/sahara: Fix scaling cluster Vanilla for Hadoop 2.3 https://review.openstack.org/105756 | 13:35 |
| SergeyLukjanov | tellesnobrega, "w" truncates the existing file | 13:37 |
| SergeyLukjanov | tellesnobrega, "a+" should be used for reading / appending file | 13:37 |
| tellesnobrega | hum | 13:37 |
| tellesnobrega | i see | 13:37 |
| tellesnobrega | true, its been a while since i've played with this | 13:38 |
| tellesnobrega | the implementation is pretty much the same right? | 13:38 |
| SergeyLukjanov | tellesnobrega, the "a" is only for appending, so, it should work ok for you | 13:38 |
| SergeyLukjanov | tellesnobrega, yup, like copy-paste write_to_file to append_to_file with 'w' -> 'a' :) | 13:38 |
| *** 17SAAF480 has quit IRC | 13:38 | |
| tellesnobrega | cool | 13:39 |
| *** openstackgerrit has joined #openstack-sahara | 13:39 | |
| tellesnobrega | How about tests? should i write any? i looked into the ssh_remote tests and there is only test for the escape_quotes | 13:47 |
| sballe | SergeyLukjanov, Thx :) | 13:49 |
| SergeyLukjanov | tellesnobrega, if you're able to add tests, we're always welcome :) | 13:52 |
| tellesnobrega | right now i'm a little swamped, i will write the code but the tests i will leave it out for now and maybe come back to them later if its ok | 13:53 |
| openstackgerrit | Telles Mota Vidal Nóbrega proposed a change to openstack/sahara-specs: Append to a remote existing file https://review.openstack.org/107062 | 14:01 |
| *** Networkn3rd has quit IRC | 14:04 | |
| *** sballe has quit IRC | 14:04 | |
| *** sballe has joined #openstack-sahara | 14:22 | |
| *** Networkn3rd has joined #openstack-sahara | 14:29 | |
| openstackgerrit | Denis Egorenko proposed a change to stackforge/sahara-ci-config: Add Sahara and python-saharaclient intehration tests for Hadoop 2.4 https://review.openstack.org/107066 | 14:36 |
| tellesnobrega | SergeyLukjanov: i have a question about append as root | 14:40 |
| SergeyLukjanov | tellesnobrega, what question? | 14:42 |
| tellesnobrega | the write_file writes in a different file and moves it as root | 14:43 |
| tellesnobrega | how can i do that for a append, my first though was, copying the file as root to /tmp, appending to it and moving it back | 14:43 |
| tellesnobrega | not sure if that is the best choihce | 14:43 |
| tellesnobrega | choice | 14:43 |
| *** vrovachev has quit IRC | 14:44 | |
| openstackgerrit | Denis Egorenko proposed a change to stackforge/sahara-ci-config: Reconfiguring CI scripts for use second Devstack server https://review.openstack.org/106994 | 14:50 |
| *** robsparker has joined #openstack-sahara | 14:51 | |
| tellesnobrega | for example, in storm i need to update supervisor deamon conf file that stays at /etc/supervisor/conffile | 14:52 |
| openstackgerrit | Denis Egorenko proposed a change to stackforge/sahara-ci-config: Delete spaces from config file from Vanilla2 section https://review.openstack.org/107075 | 14:55 |
| tellesnobrega | so i need root privileges to change stuff there | 14:56 |
| openstackgerrit | A change was merged to stackforge/sahara-ci-config: Delete spaces from config file from Vanilla2 section https://review.openstack.org/107075 | 15:02 |
| openstackgerrit | Andrew Lazarev proposed a change to openstack/sahara: Removed code duplication on cluster state change https://review.openstack.org/105588 | 15:13 |
| *** skolekonov has joined #openstack-sahara | 15:18 | |
| *** openstackgerrit has quit IRC | 15:21 | |
| *** IvanBerezovskiy has left #openstack-sahara | 15:35 | |
| *** skolekonov has quit IRC | 15:46 | |
| *** Timotey has quit IRC | 15:52 | |
| *** Networkn3rd has quit IRC | 15:54 | |
| *** Networkn3rd has joined #openstack-sahara | 15:54 | |
| tellesnobrega | SergeyLukjanov: does that sounds ok to you? | 16:01 |
| *** bradd1 has joined #openstack-sahara | 16:02 | |
| *** ViswaV has joined #openstack-sahara | 16:11 | |
| *** ViswaV_ has joined #openstack-sahara | 16:12 | |
| *** ViswaV has quit IRC | 16:15 | |
| dmitryme | tellesnobrega: did you consider to use execute_command(‘sed bla-bla-bla’, run_as_root=true)? | 16:19 |
| dmitryme | another options would be 1. read file 2. make changes in its contents 3. write file back | 16:20 |
| tellesnobrega | sed is used to replace right | 16:20 |
| tellesnobrega | ? | 16:20 |
| dmitryme | right | 16:21 |
| dmitryme | btw we already have helper for it | 16:21 |
| dmitryme | replace_remote_string | 16:21 |
| dmitryme | it invokes ‘sed' under the hood | 16:21 |
| tellesnobrega | i need to append to the file. I think the best way is to open as append | 16:21 |
| tellesnobrega | i saw that | 16:21 |
| tellesnobrega | the solution i wrote is as described above, i copied the file as temp file, appended to it and moved it to the right location | 16:22 |
| dmitryme | ok, then another thing I can suggest is to run ‘sudo echo “bla-bla-bla” >> /etc/supervisor/conffile | 16:23 |
| dmitryme | I’ve forgotten to add quote at the end :-) | 16:24 |
| *** ViswaV_ has quit IRC | 16:25 | |
| tellesnobrega | dmitryme: hm, that looks alright. I could use that when running as sudo, and the normal permissios as write_file does | 16:25 |
| *** Networkn3rd has quit IRC | 16:26 | |
| *** Networkn3rd has joined #openstack-sahara | 16:43 | |
| *** ViswaV has joined #openstack-sahara | 16:53 | |
| tmckay | Hi folks. I just ran a spark EDP job using the Java action on a spark cluster! Not quite finished yet -- we probably need a specific job type, and I need to write a local filesystem cleanup for uploaded files on a long running cluster, and a few other things. But "run", "status", and "terminate" works for SparkPi. | 17:06 |
| tmckay | I should probably make a WIP change request today, and then of course I should probably write a spec and a blueprint :) | 17:06 |
| tmckay | now that I know it can work | 17:06 |
| *** ViswaV has quit IRC | 17:08 | |
| *** Networkn3rd has quit IRC | 17:09 | |
| tellesnobrega | tmckay: that's awesome | 17:11 |
| *** ViswaV has joined #openstack-sahara | 17:13 | |
| tellesnobrega | elmiko: i think i have a storm plugin | 17:21 |
| tellesnobrega | now it starts the testing part | 17:21 |
| elmiko | elmiko: very cool | 17:22 |
| elmiko | looks like storm and spark will arrive in short order :) | 17:22 |
| tellesnobrega | is there a way that i can create a cluster via command line? | 17:29 |
| tellesnobrega | don't want to implement dashboard yet | 17:29 |
| elmiko | yes | 17:30 |
| * elmiko digs for docs | 17:30 | |
| tellesnobrega | found it | 17:31 |
| tellesnobrega | i was looking in the v11.py | 17:31 |
| tellesnobrega | found it on v10.py | 17:31 |
| elmiko | cool | 17:31 |
| elmiko | you can use the sahara command line client to do all those operations | 17:32 |
| tellesnobrega | nice | 17:32 |
| elmiko | i'm not seeing online docs for it, but if you type `sahara --help` you should be able to see all the operations | 17:34 |
| tosky | tellesnobrega: this is a starging point, but few commands have been changed in the meantime (apart from s/savanna/sahara/): http://spinningmatt.wordpress.com/2014/01/29/hadoop-on-openstack-with-a-cli-creating-a-cluster/ | 17:36 |
| tellesnobrega | nice, thanks | 17:37 |
| *** ViswaV_ has joined #openstack-sahara | 17:40 | |
| *** ViswaV has quit IRC | 17:43 | |
| *** ViswaV_ has quit IRC | 17:47 | |
| *** ViswaV has joined #openstack-sahara | 17:54 | |
| *** ViswaV_ has joined #openstack-sahara | 18:04 | |
| *** ViswaV has quit IRC | 18:05 | |
| *** ViswaV_ has quit IRC | 18:16 | |
| *** ViswaV has joined #openstack-sahara | 18:18 | |
| -openstackstatus- NOTICE: python2.6 jobs are failing due to bug 1342262 "virtualenv>=1.9.1 not found" A fix is out but there are still nodes built on the old stale images | 18:23 | |
| *** ChanServ changes topic to "python2.6 jobs are failing due to bug 1342262 "virtualenv>=1.9.1 not found" A fix is out but there are still nodes built on the old stale images" | 18:23 | |
| *** tosky has quit IRC | 18:39 | |
| *** bradd1 has quit IRC | 18:59 | |
| *** Networkn3rd has joined #openstack-sahara | 19:08 | |
| *** ViswaV has quit IRC | 19:15 | |
| *** Networkn3rd has quit IRC | 19:29 | |
| *** ViswaV has joined #openstack-sahara | 19:38 | |
| sballe | SergeyLukjanov, Hi Quick question. Something failed with the savanna-ci but I am not sure if I need to fix it. https://review.openstack.org/#/c/107047/ | 19:39 |
| SergeyLukjanov | sballe, hi, unfortunately it fails sometimes | 19:39 |
| SergeyLukjanov | sballe, in your case it looks like just internal lab issue - so, I | 19:40 |
| sballe | SergeyLukjanov, I looked throught the logs and I cannot tell if it is somethign I did that made it fails. My guess is taht it isn't since vanilla work | 19:40 |
| SergeyLukjanov | so, I just rechecked it using "recheck sahara-ci" | 19:40 |
| sballe | SergeyLukjanov, ook | 19:40 |
| *** openstackgerrit has joined #openstack-sahara | 19:43 | |
| *** ViswaV has quit IRC | 20:12 | |
| *** _mattf has quit IRC | 20:13 | |
| openstackgerrit | Telles Mota Vidal Nóbrega proposed a change to openstack/sahara: Append to a remote existing file https://review.openstack.org/107105 | 20:17 |
| *** mattf has joined #openstack-sahara | 20:20 | |
| *** mattf has quit IRC | 20:21 | |
| *** mattf has joined #openstack-sahara | 20:21 | |
| openstackgerrit | Andrew Lazarev proposed a change to openstack/sahara-specs: Spec for security groups management in Sahara https://review.openstack.org/107170 | 20:41 |
| *** crobertsrh is now known as _crobertsrh | 20:53 | |
| *** sballe has quit IRC | 20:58 | |
| *** mattf is now known as _mattf | 21:14 | |
| *** ViswaV has joined #openstack-sahara | 21:18 | |
| *** ViswaV_ has joined #openstack-sahara | 21:26 | |
| *** ViswaV has quit IRC | 21:29 | |
| *** tmckay has left #openstack-sahara | 21:32 | |
| *** elmiko is now known as _elmiko | 21:54 | |
| *** ViswaV has joined #openstack-sahara | 22:37 | |
| *** ViswaV_ has quit IRC | 22:37 | |
| *** ViswaV has quit IRC | 22:57 | |
| *** tnovacik has quit IRC | 23:11 | |
| *** ViswaV has joined #openstack-sahara | 23:17 | |
| *** ViswaV has quit IRC | 23:25 | |
| *** witlessb has quit IRC | 23:26 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!