Tuesday, 2014-12-23

openstackgerritlu huichun proposed openstack/sahara: Add Java type edp test in integration test of CDH plugin  https://review.openstack.org/14349901:09
*** hdd has quit IRC02:48
*** witlessb has joined #openstack-sahara02:56
*** witlessb has quit IRC03:01
*** Networkn3rd has joined #openstack-sahara04:14
*** Poornima has joined #openstack-sahara04:23
*** hdd has joined #openstack-sahara04:27
*** linqi_ has joined #openstack-sahara05:20
*** linqi_ has quit IRC05:22
*** Networkn3rd has quit IRC05:53
*** hdd has quit IRC06:36
*** hdd has joined #openstack-sahara06:36
*** hdd has quit IRC06:58
*** k4n0 has joined #openstack-sahara07:07
*** Longgeek has joined #openstack-sahara08:22
*** viktors|afk has quit IRC08:34
*** viktors has joined #openstack-sahara08:34
*** witlessb has joined #openstack-sahara08:36
*** viktors has quit IRC08:46
*** viktors has joined #openstack-sahara08:46
*** skolekonov has joined #openstack-sahara08:53
*** IvanBerezovskiy has joined #openstack-sahara10:35
*** Poornima has quit IRC11:15
openstackgerritSergey Reshetnyak proposed openstack/sahara: Minor refactoring integration tests  https://review.openstack.org/13335011:16
openstackgerritSergey Reshetnyak proposed openstack/sahara: [DO NOT MERGE] Fix for CDH IT  https://review.openstack.org/14365011:16
openstackgerritSergey Reshetnyak proposed openstack/sahara: [DO NOT MERGE] Fix for CDH IT  https://review.openstack.org/14365011:18
openstackgerritSergey Reshetnyak proposed openstack/sahara: [DO NOT MERGE] Fix for CDH IT  https://review.openstack.org/14365011:28
openstackgerritVitaly Gridnev proposed openstack/sahara: Added endpoint and utils to work with events  https://review.openstack.org/13450411:47
openstackgerritAndrey Pavlov proposed openstack/sahara-specs: Improvement of Sahara logs  https://review.openstack.org/14365111:55
openstackgerritMerged openstack/sahara: Enable auto security group for vanilla integration tests  https://review.openstack.org/13528212:06
openstackgerritDenis Egorenko proposed stackforge/sahara-ci-config: Remove Vanilla 2.3 jobs  https://review.openstack.org/14365912:15
*** _crobertsrh has quit IRC12:24
*** zhiyan has quit IRC12:24
*** zigo has quit IRC12:24
*** hogepodge has quit IRC12:24
*** aignatov has quit IRC12:24
*** alazarev has quit IRC12:24
*** juice has quit IRC12:24
*** IvanBerezovskiy has quit IRC12:24
*** Longgeek has quit IRC12:24
*** NikitaKonovalov has quit IRC12:24
*** ruhe has quit IRC12:24
*** clds_ has quit IRC12:24
*** egafford has quit IRC12:24
*** jodah has quit IRC12:24
*** venza has quit IRC12:24
*** _crobertsrh has joined #openstack-sahara12:25
*** zhiyan has joined #openstack-sahara12:26
*** zigo has joined #openstack-sahara12:26
*** hogepodge has joined #openstack-sahara12:26
*** aignatov has joined #openstack-sahara12:26
*** alazarev has joined #openstack-sahara12:26
*** juice has joined #openstack-sahara12:26
*** IvanBerezovskiy has joined #openstack-sahara12:26
*** Longgeek has joined #openstack-sahara12:26
*** NikitaKonovalov has joined #openstack-sahara12:26
*** ruhe has joined #openstack-sahara12:26
*** clds_ has joined #openstack-sahara12:26
*** egafford has joined #openstack-sahara12:28
*** jodah has joined #openstack-sahara12:28
*** venza has joined #openstack-sahara12:28
openstackgerritAndrey Pavlov proposed openstack/sahara: Adding ability to access context from openstack.common.log  https://review.openstack.org/14366312:43
openstackgerritVitaly Gridnev proposed openstack/sahara: Added endpoint and utils to work with events  https://review.openstack.org/13450412:43
*** witlessb has quit IRC12:56
*** witlessb has joined #openstack-sahara12:56
openstackgerritAndrey Pavlov proposed openstack/sahara-specs: Adding cluster/instance/job_execution ids to logs  https://review.openstack.org/14365113:00
openstackgerritAndrey Pavlov proposed openstack/sahara-specs: Adding cluster/instance/job_execution ids to logs  https://review.openstack.org/14365113:11
*** _crobertsrh is now known as crobertsrh13:52
*** tmckay has joined #openstack-sahara14:09
*** elmiko has quit IRC14:13
*** elmiko has joined #openstack-sahara14:13
openstackgerritAndrey Pavlov proposed openstack/sahara: Adding ability to access context from openstack.common.log  https://review.openstack.org/14366314:53
openstackgerritSergey Reshetnyak proposed openstack/sahara: Minor refactoring integration tests  https://review.openstack.org/13335014:59
*** k4n0 has quit IRC15:25
*** hdd has joined #openstack-sahara15:26
openstackgerritAndrey Pavlov proposed openstack/sahara-specs: Adding cluster/instance/job_execution ids to logs  https://review.openstack.org/14365115:37
openstackgerritDenis Egorenko proposed stackforge/sahara-ci-config: Add saharaclient tempest tests for Sahara  https://review.openstack.org/14368615:52
*** guo has joined #openstack-sahara16:01
openstackgerritMerged openstack/sahara: Updated from global requirements  https://review.openstack.org/14263916:03
*** guo has quit IRC16:07
tmckayoikawa_, hi.  Your Java configuration wrapper works with spark-submit and spark jobs as well :)16:13
tmckayalthough, I don't think the security manager wrapper is needed and the file location will need to be determined another way16:14
tmckayBut, the essential mechanism is the same16:14
tmckaySergeyLukjanov, ^^ so it looks from playing around that we can use a very similar wrapper for Spark to set Swift configs.  So far I have just printed config values, but I believe it will work16:17
tmckayelmiko, ^^16:18
tmckayFor spark, I think we just need to generate a tiny xml holding the swift properties (old-style cred or the proxy settings) and put it in the tmp job dir.  The swift wrapper will read from that file.16:20
*** Networkn3rd has joined #openstack-sahara16:30
elmikotmckay: the idea of having cleartext creds in a file on the servers makes me a little nervous, but maybe we can delete the file after usage or something?16:43
tmckayyeah, same thought here.  Thinking about it.16:44
*** hdd has quit IRC16:46
*** IvanBerezovskiy has left #openstack-sahara16:48
*** skolekonov has quit IRC16:50
openstackgerritSergey Reshetnyak proposed openstack/sahara: Minor refactoring integration tests  https://review.openstack.org/13335017:16
*** openstackgerrit has quit IRC17:34
*** openstackgerrit has joined #openstack-sahara17:35
*** crobertsrh has quit IRC17:56
*** witlessb has quit IRC18:35
*** crobertsrh has joined #openstack-sahara19:03
*** hdd has joined #openstack-sahara19:04
*** egafford has quit IRC19:04
SergeyLukjanovtmckay, that's really cool19:17
tmckaySergeyLukjanov, I just got it to work :)  Ugly, and we need new Sahara spark images, and some more code ....19:33
tmckayBut I did it by hand19:33
tmckayit is possible :)19:33
*** witlessb has joined #openstack-sahara19:48
*** elmiko_ has joined #openstack-sahara19:50
*** elmiko_ is now known as elmiko_lptp19:50
elmiko_lptpSergeyLukjanov: i think CI is asking weird, it keeps running this review even though it has merged. https://review.openstack.org/#/c/142578/20:47
*** tmckay has quit IRC21:33
*** amcrn has joined #openstack-sahara21:41
amcrngiven that storm + zk are now supported in sahara: are there any ongoing conversations around kafka?21:43
elmiko_lptpamcrn: i think there have been a few people talking about kafka, but it's been light so far21:44
amcrnelmiko_lptp: any idea as to whether that fits into the mission of sahara, or is that unchartered water?21:46
elmiko_lptpamcrn: a little uncharted water, but i feel that if kafka is an essential tool for streaming into storm, then we will want to investigate how we can add it to our node group processes21:47
amcrnelmiko_lptp: roger that. thanks for the info. i'll start idling in here to keep an eye/ear out for related discussions.21:48
elmiko_lptpamcrn: i think there is interest surrounding kafka, but i'm not sure we have agreed on a position in terms of how we should integrate it.21:48
elmiko_lptpamcrn: if you have strong ideas about it i would definitely encourage you to attend one of our weekly meetings and bring it, or even propose a blueprint.21:49
elmiko_lptphttps://wiki.openstack.org/wiki/Meetings/SaharaAgenda21:49
amcrnelmiko_lptp: cool, thanks.21:50
elmiko_lptpamcrn: i just noticed that page is slightly out of date, we are alternating weeks on our meetings between 1800UTC and 1400UTC to include more folks from differing timezones21:51
amcrnelmiko_lptp: noted, cheers.21:56
*** egafford has joined #openstack-sahara21:57
*** crobertsrh has quit IRC21:58
*** elmiko_lptp has quit IRC22:07
*** hdd has quit IRC22:43
*** Longgeek has quit IRC22:49
*** Networkn3rd has quit IRC22:59
*** egafford has quit IRC23:31
*** miqui_ has quit IRC23:46

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!