Monday, 2014-01-27

*** matsuhashi has joined #savanna00:09
*** matsuhashi has quit IRC00:33
*** IlyaE has joined #savanna00:41
*** matsuhashi has joined #savanna00:48
*** nosnos has joined #savanna00:58
*** IlyaE has quit IRC00:59
*** IlyaE has joined #savanna01:03
*** jcooley_ has joined #savanna01:12
*** ErikB has joined #savanna01:25
*** nosnos_ has joined #savanna01:53
*** nosnos has quit IRC01:54
*** matsuhashi has quit IRC02:26
*** matsuhashi has joined #savanna02:32
*** ErikB has quit IRC02:35
*** frankbutt has joined #savanna03:15
*** frankbutt has left #savanna03:15
*** matsuhashi has quit IRC03:18
*** matsuhashi has joined #savanna04:40
*** jcooley_ has quit IRC04:50
*** akuznetsov has joined #savanna04:59
*** IlyaE has quit IRC05:02
*** jcooley_ has joined #savanna05:11
*** jcooley_ has quit IRC05:19
*** jcooley_ has joined #savanna05:20
*** jcooley_ has quit IRC05:24
*** jcooley_ has joined #savanna06:01
*** DinaBelova_ is now known as DinaBelova06:01
*** SergeyLukjanov_ is now known as SergeyLukjanov06:04
openstackgerritJenkins proposed a change to openstack/savanna: Imported Translations from Transifex  https://review.openstack.org/6833606:06
*** jcooley_ has quit IRC06:14
*** SergeyLukjanov is now known as SergeyLukjanov_06:31
*** DinaBelova is now known as DinaBelova_06:32
*** IlyaE has joined #savanna06:35
*** Ch00k has joined #savanna06:55
*** DinaBelova_ is now known as DinaBelova06:57
*** SergeyLukjanov_ is now known as SergeyLukjanov06:57
*** Ch00k has quit IRC07:15
*** SergeyLukjanov is now known as SergeyLukjanov_07:20
*** Ch00k has joined #savanna07:21
*** Ch00k has quit IRC07:25
*** Ch00k_ has joined #savanna07:25
*** DinaBelova is now known as DinaBelova_07:30
*** Ch00k has joined #savanna07:40
*** Ch00k_ has quit IRC07:42
*** SergeyLukjanov_ is now known as SergeyLukjanov07:48
*** DinaBelova_ is now known as DinaBelova07:49
*** Ch00k has quit IRC07:52
*** qwerty_nor has joined #savanna07:53
*** IlyaE has quit IRC07:59
*** SergeyLukjanov is now known as SergeyLukjanov_08:03
*** SergeyLukjanov_ is now known as SergeyLukjanov08:03
*** Ch00k has joined #savanna08:15
*** SergeyLukjanov is now known as SergeyLukjanov_08:17
*** Ch00k has quit IRC08:18
*** Ch00k has joined #savanna08:25
*** Ch00k has quit IRC08:31
*** DinaBelova is now known as DinaBelova_08:34
*** matsuhashi has quit IRC08:36
*** matsuhashi has joined #savanna08:37
*** dmitryme has joined #savanna08:39
*** IvanBerezovskiy has joined #savanna08:44
*** _nadya_ has joined #savanna08:47
*** _nadya_ has quit IRC09:00
*** _nadya_ has joined #savanna09:01
*** Ch00k has joined #savanna09:02
*** _nadya_ has quit IRC09:13
*** _nadya_ has joined #savanna09:19
*** _nadya_ has quit IRC09:20
*** _ruhe is now known as ruhe09:35
*** Ch00k has quit IRC10:14
*** Ch00k has joined #savanna10:15
openstackgerritA change was merged to openstack/savanna-dashboard: Updated from global requirements  https://review.openstack.org/6910010:33
openstackgerritA change was merged to openstack/savanna-dashboard: Changing the args type for Pig jobs to a list  https://review.openstack.org/6846710:39
openstackgerritA change was merged to openstack/savanna-dashboard: Dashboard now ignores empty job configuration items  https://review.openstack.org/6876310:40
*** Ch00k has quit IRC10:42
*** Ch00k has joined #savanna10:43
*** NikitaKonovalov_ is now known as NikitaKonovalov10:47
openstackgerritDmitry Mescheryakov proposed a change to openstack/savanna: Make remote pluggable  https://review.openstack.org/6892411:01
*** aignatov_ is now known as aignatov11:07
*** ruhe is now known as _ruhe11:12
*** SergeyLukjanov_ is now known as SergeyLukjanov11:17
*** SergeyLukjanov is now known as SergeyLukjanov_11:33
*** DinaBelova_ is now known as DinaBelova11:39
*** _ruhe is now known as ruhe11:39
*** matsuhashi has quit IRC11:40
*** ylobankov has joined #savanna11:43
*** matsuhashi has joined #savanna11:45
*** dmitryme has quit IRC11:49
*** matsuhashi has quit IRC12:12
*** matsuhashi has joined #savanna12:13
*** DinaBelova is now known as DinaBelova_12:21
*** dmitryme has joined #savanna12:38
*** ruhe is now known as _ruhe12:52
*** _ruhe is now known as ruhe12:54
mattfSergeyLukjanov_, do you know how to get DISCOVER_DIRECTORY into .testr.conf from a shell env?12:58
openstackgerritAlexander Ignatov proposed a change to openstack/savanna: Added more strict check for heat stack statuses  https://review.openstack.org/6936013:04
*** aignatov is now known as aignatov_13:06
*** DinaBelova_ is now known as DinaBelova13:25
*** DinaBelova is now known as DinaBelova_13:31
*** SergeyLukjanov_ is now known as SergeyLukjanov13:31
*** DinaBelova_ is now known as DinaBelova13:37
*** aignatov_ is now known as aignatov13:38
SergeyLukjanovmattf, it's just an env var13:49
mattfSergeyLukjanov, the end appears to get wiped before hitting that command13:50
*** ErikB has joined #savanna14:08
*** tmckay has joined #savanna14:25
*** aignatov is now known as aignatov_14:52
*** Ch00k has quit IRC14:57
*** ruhe is now known as _ruhe15:12
*** sreshetniak has joined #savanna15:22
openstackgerritTrevor McKay proposed a change to openstack/savanna: Allow boolean "streaming" in Job JSON  https://review.openstack.org/6903515:24
*** _ruhe is now known as ruhe15:33
*** aignatov_ is now known as aignatov15:33
*** werebutt has joined #savanna15:37
*** werebutt has left #savanna15:37
*** SergeyLukjanov is now known as SergeyLukjanov_15:38
*** IlyaE has joined #savanna15:40
aignatovErikB: here?15:42
aignatovlooking at the bug https://bugs.launchpad.net/savanna/+bug/1263157, I see in the latest comments in it that public docs should be updated15:43
aignatovcould someone from HW team take a look on it?15:44
aignatovit seems that patch is pretty simple - just need to add few links to public page about HDP plugin15:45
*** SergeyLukjanov_ is now known as SergeyLukjanov15:58
*** NikitaKonovalov is now known as NikitaKonovalov_16:00
*** rnirmal has joined #savanna16:02
*** Ch00k has joined #savanna16:04
*** nosnos_ has quit IRC16:14
*** matsuhashi has quit IRC16:15
*** aignatov is now known as aignatov_16:16
*** ErikB has quit IRC16:17
*** ruhe is now known as _ruhe16:25
*** dmitryme has quit IRC16:27
*** SergeyLukjanov is now known as SergeyLukjanov_16:30
*** ErikB has joined #savanna16:36
*** DinaBelova is now known as DinaBelova_16:37
openstackgerritJonathan Maron proposed a change to openstack/savanna: Enable EDP on private neutron networks  https://review.openstack.org/6351716:40
*** DinaBelova_ is now known as DinaBelova16:41
*** sreshetniak has left #savanna16:50
*** SergeyLukjanov_ is now known as SergeyLukjanov16:54
tmckaymattf, crobertsrh, aignatov_, I had an idea.  I'm thinking about specifying values through configs with "savanna." on the front of them.  There is a precedent for this; Oozie supports some "oozie.whatever" configs to control its behavior in addition to the config values expected by Hadoop.  I'm wondering if things like the streaming mapper and reducer, and the existing "main_class" and "java_opts" could be passed as configs.16:57
mattfcontext miss for me16:58
tmckayThat would help keep the jobs executions from diverging across job types.  Right now, Java jobs have the additional main_class and java_opts, and MapReduce will have the optional "streaming" mapper and reducer16:58
tmckaymattf, I was thinking about how to specify the mapper and reducer scripts for the <streaming> tag for MapReduce.  They would be specified during job launch, just like mapper and reducer classes16:59
mattflet's discuss later16:59
tmckaySo how do we pass them?  Additional optional values in the JSON, valid only for MapReduce job types?  Or, maybe we can just make our own configs "savnna.streaming.mapper" ...17:00
tmckayack, lunch17:01
mattfi was musing on just a new type for streaming17:01
mattfbut, let's discuss later17:01
*** SergeyLukjanov is now known as SergeyLukjanov_17:03
*** _nadya_ has joined #savanna17:10
*** SergeyLukjanov_ is now known as SergeyLukjanov17:26
*** jcooley_ has joined #savanna17:34
*** SergeyLukjanov is now known as SergeyLukjanov_17:41
*** DinaBelova is now known as DinaBelova_17:52
*** DinaBelova_ is now known as DinaBelova17:56
*** akuznetsov has quit IRC18:00
*** NikitaKonovalov_ is now known as NikitaKonovalov18:02
*** akuznetsov has joined #savanna18:05
*** NikitaKonovalov is now known as NikitaKonovalov_18:05
*** NikitaKonovalov_ is now known as NikitaKonovalov18:09
*** mattf is now known as _mattf18:16
*** _mattf is now known as mattf18:17
*** jcooley_ has quit IRC18:22
*** jcooley_ has joined #savanna18:23
openstackgerritChad Roberts proposed a change to openstack/savanna-dashboard: Dashboard now hides "mains" for Java/MapReduce jobs  https://review.openstack.org/6943218:24
*** akuznetsov has quit IRC18:25
*** NikitaKonovalov is now known as NikitaKonovalov_18:27
*** _ruhe is now known as ruhe18:32
*** NikitaKonovalov_ is now known as NikitaKonovalov18:33
*** _nadya_ has quit IRC18:35
*** dmitryme has joined #savanna18:36
*** dmitryme has quit IRC18:41
openstackgerritA change was merged to openstack/savanna: Require "libs" for MapReduce and Java jobs and disallow "mains"  https://review.openstack.org/6901918:43
openstackgerritA change was merged to openstack/savanna: Updated from global requirements  https://review.openstack.org/6904518:43
openstackgerritA change was merged to openstack/savanna: Add an hdfs data source example to the rest doc  https://review.openstack.org/6877018:43
openstackgerritA change was merged to openstack/savanna: Fixed potential problems in test_periodic.py  https://review.openstack.org/6881418:43
openstackgerritA change was merged to openstack/savanna: Add a config flag to disable cluster deletion after integration test  https://review.openstack.org/6868818:43
*** DinaBelova is now known as DinaBelova_18:47
*** NikitaKonovalov is now known as NikitaKonovalov_18:53
*** SergeyLukjanov_ is now known as SergeyLukjanov18:53
*** serg_ has joined #savanna18:54
*** ErikB has quit IRC18:55
*** serg_ has left #savanna18:55
*** NikitaKonovalov_ is now known as NikitaKonovalov18:57
*** Ch00k has quit IRC19:05
*** crobertsrh has quit IRC19:08
*** crobertsrh has joined #savanna19:08
*** NikitaKonovalov is now known as NikitaKonovalov_19:12
*** ruhe is now known as _ruhe19:15
openstackgerritA change was merged to openstack/savanna: Fixed HDP plugin to support Heat engine  https://review.openstack.org/6598119:15
mattftmckay, fyi, i may have confused myself a bit w/ the jobs / job-executions renaming. so if my email doesn't make 100% sense just assume i goofed.19:16
tmckaymattf, np, just saw something in my box19:16
*** DinaBelova_ is now known as DinaBelova19:33
*** DinaBelova is now known as DinaBelova_19:34
* mattf finds the deep network filtering that only happens on his hotspot to be very frustrating19:34
* mattf wins by forwarding through vpn. haha, try to inspect the encrypted packets!19:39
* mattf finds it interesting that only keystone token-get is being filtered19:40
mattf...and only filters when the proper headers are provided. w/o the headers i get a valid nack from keystone.19:40
mattftmckay, should params be name=value or {name: value}?19:42
tmckay{name: value}.  name=value is the Oozie form in the workflow.xml19:43
mattfok, so i'll split on =19:44
* mattf will then discover splitting on = isn't ok because = is valid in the value19:44
openstackgerritA change was merged to openstack/savanna: Update Ambari Repo location and services refactoring  https://review.openstack.org/6757719:46
tmckayhmm, I wouldn't guess so.  Pig ultimately uses the same thing.  Maybe quotes?19:46
* tmckay is almost done with email response19:46
mattfok i'll stop interrupting19:47
*** qwerty_nor has quit IRC19:50
tmckaymattf, no please :)19:50
tmckaymattf, I might be tossing more detail than you need, stop me if it's too much19:51
mattftoo late!19:51
tmckayheh19:52
* mattf <3 pythong -- dict(map(lambda p: p.split('=', 1), args.param))19:52
tmckaythat's more like bash19:52
openstackgerritA change was merged to openstack/savanna: Add integration test for Oozie java action  https://review.openstack.org/6641519:54
mattfhmm, the split wouldn't be hard in bash, but consing up arrays is a pita19:54
tmckaywoohoo!  I can mark the blueprint implemented now ^^19:54
* tmckay blueprint stats +119:55
*** openstackgerrit has quit IRC20:06
*** openstackgerrit has joined #savanna20:06
*** _ruhe is now known as ruhe20:06
openstackgerritJonathan Maron proposed a change to openstack/savanna: Enable EDP on private neutron networks  https://review.openstack.org/6351720:09
*** mattf is now known as _mattf20:14
*** _mattf is now known as mattf20:14
*** jcooley_ has quit IRC20:22
*** jcooley_ has joined #savanna20:22
openstackgerritA change was merged to openstack/savanna: Disable autocreating database when start savanna  https://review.openstack.org/6863120:35
openstackgerritA change was merged to openstack/savanna: Allow boolean "streaming" in Job JSON  https://review.openstack.org/6903520:35
mattfERROR: [u'e', u'a', u'f', u'0', u'd', u'e', u'6', u'4', u'-', u'd', u'9', u'2', u'a', u'-', u'4', u'a', u'8', u'2', u'-', u'8', u'e', u'3', u'5', u'-', u'f', u'5', u'8', u'6', u'5', u'e', u'1', u'1', u'9', u'9', u'f', u'b'] has non-unique elements\20:44
mattf^^ improper use of list(), oops!20:44
*** SergeyLukjanov is now known as SergeyLukjanov_20:44
*** ruhe is now known as _ruhe20:46
openstackgerritMatthew Farrellee proposed a change to openstack/python-savannaclient: Make --bypass-url default to env(BYPASS_URL)  https://review.openstack.org/6946620:51
openstackgerritMatthew Farrellee proposed a change to openstack/python-savannaclient: Add job-template-create to CLI  https://review.openstack.org/6946720:51
*** _ruhe is now known as ruhe20:56
*** Ch00k has joined #savanna20:59
openstackgerritMatthew Farrellee proposed a change to openstack/python-savannaclient: Add job-create to CLI  https://review.openstack.org/6946821:05
*** Ch00k has quit IRC21:30
*** Ch00k has joined #savanna21:31
*** Ch00k has quit IRC21:34
*** _nadya_ has joined #savanna21:35
openstackgerritTrevor McKay proposed a change to openstack/savanna: Add <streaming> tag generation to mapreduce workflow  https://review.openstack.org/6947721:37
openstackgerritTrevor McKay proposed a change to openstack/savanna: Add <streaming> tag generation to mapreduce workflow  https://review.openstack.org/6947721:39
*** _nadya_ has quit IRC21:39
*** ruhe is now known as _ruhe21:48
*** jcooley_ has quit IRC21:53
*** jcooley_ has joined #savanna21:53
mattfSergeyLukjanov_, i think your new stevedore code needs >=0.13, not >=0.1222:04
*** rnirmal has quit IRC22:05
openstackgerritAndrew Lazarev proposed a change to openstack/savanna: Fixed potential problems with global CONF in unit tests  https://review.openstack.org/6948622:24
*** crobertsrh is now known as _crobertsrh22:28
*** _ruhe is now known as ruhe22:30
*** ruhe is now known as _ruhe22:38
*** mattf is now known as _mattf22:45
*** rnirmal has joined #savanna22:50
*** _ruhe is now known as ruhe23:22
*** ruhe is now known as _ruhe23:44

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!