Wednesday, 2015-09-02

*** hdd has joined #openstack-sahara01:06
openstackgerritKen Chen proposed openstack/sahara: Enable anti_affinity feature in scenario test  https://review.openstack.org/21917001:23
*** hdd has quit IRC01:58
*** macjack has joined #openstack-sahara02:26
*** leizhang has joined #openstack-sahara02:35
*** macjack has quit IRC02:52
*** leizhang has quit IRC02:55
*** amwong has joined #openstack-sahara03:00
openstackgerritLinPeiyu proposed openstack/sahara: Fix two minor mistakes in quickstart.rst  https://review.openstack.org/21954203:18
*** mathspanda has joined #openstack-sahara03:21
*** stanchan has joined #openstack-sahara03:41
*** hdd has joined #openstack-sahara03:43
*** links has joined #openstack-sahara03:48
*** Nikolay_St has joined #openstack-sahara04:12
*** amwong has quit IRC04:41
*** amwong has joined #openstack-sahara04:44
*** amwong has quit IRC04:46
*** amwong has joined #openstack-sahara04:47
*** amwong has quit IRC05:07
*** hdd has quit IRC05:09
*** nkrinner has joined #openstack-sahara05:35
*** Poornima has joined #openstack-sahara05:42
openstackgerritLinPeiyu proposed openstack/sahara: Modify recommend_configs arguments in vanilla 1  https://review.openstack.org/21956506:01
*** mathspanda has quit IRC06:01
*** ashishb has joined #openstack-sahara06:12
*** macjack has joined #openstack-sahara06:28
*** Nikolay_St has quit IRC06:31
*** witlessb has joined #openstack-sahara07:19
*** coolsvap_ has joined #openstack-sahara07:21
*** Nikolay_St has joined #openstack-sahara07:22
*** coolsvap_ has quit IRC07:26
*** _crobertsrh has quit IRC07:27
*** crobertsrh has joined #openstack-sahara07:34
*** pino|work has joined #openstack-sahara07:43
*** Nikolay_St has quit IRC07:52
*** larainema has quit IRC07:57
*** larainema has joined #openstack-sahara07:58
*** EinstCrazy has joined #openstack-sahara08:25
*** sanjayu has joined #openstack-sahara09:17
*** sanjayu_ has quit IRC09:21
*** tlashchova has joined #openstack-sahara09:22
ashishbHello Everyone09:27
ashishbCan someone please give me the link to sahara-liberty-vanilla-2.7.1-ubuntu-14.04.qcow2 image?09:28
*** tosky has joined #openstack-sahara09:28
ashishbI am not able to find it under Mirantis file share: http://sahara-files.mirantis.com/images/upstream/09:29
* tosky reading logs09:29
toskyashishb: there are no generated images right now, you can use sahara-image-elements to generate it yourself09:29
ashishboh .. I saw in some test client code these images being used here: https://github.com/openstack/sahara/blob/master/etc/scenario/simple-testcase.yaml09:30
ashishbso thought they should be available from somewhere09:31
ashishbanyway, for now I am trying to use this: sahara-kilo-vanilla-2.6-ubuntu-14.04.qcow2 with Hadoop 2.7.1 plugin09:31
ashishbhope it will work09:31
ashishbI am struck with the endless ¨waiting¨ state of my cluster. My issue is somewhat same as mentioned here:09:37
ashishbhttps://ask.openstack.org/en/question/53020/sahara-cluster-stuck-in-waiting-state/09:37
ashishband https://ask.openstack.org/en/question/64481/sahara-cluster-launching-stay-on-waiting/09:38
ashishbmy setup is all-in-one devstack setup with nova-network09:38
ashishbout of total 3 nodes in the cluster, 2 are worker nodes --> These are active and have floating IPs assigned correctly09:39
ashishbthe last node, which is master node is struck without Floating IP09:39
ashishball the instance are ¨Active¨ and seems to be up09:40
ashishbin the Sahara screen session it seems to be running into endless loop with calls to keystone etc09:40
ashishbany thoughts what could be wrong here ..?09:42
toskycheck better the other error messages in the logs, you should see where it's waiting09:44
toskysahara by default tries to connect to the instances using ssh, so make sure you can connect to the instances through the floating IP with a key and that instances can access internet09:44
ashishbthanks ^tosky, ssh is enabled through key. I can ssh into worker nodes from each other using the key09:46
ashishbonly master node is struck without floating / public IP09:46
*** EinstCrazy has quit IRC09:46
toskyashishb: ah, strange; did you assign a floating IP pool to the node group template of the master node?09:47
ashishb^tosky, good point .. let me verify it quickly09:47
ashishb^tosky, you are right ..! I forgot to mention the floating IP pool name in master node template09:49
ashishbmany thanks ^tosky, let me correct that :-)09:50
tosky:)09:56
*** sanjayu_ has joined #openstack-sahara10:20
*** sanjayu has quit IRC10:24
*** sgotliv has joined #openstack-sahara10:42
*** larainema has quit IRC10:54
*** larainema has joined #openstack-sahara10:54
ashishbHello ^tosky, finally my cluster is now active :-)11:07
ashishbthanks for the help11:07
toskyyou're welcome11:07
ashishbnow I am trying to run a sample map-reduce job11:07
ashishbas per the dev guide it says: after loggin to NameNode, I can su to hadoop user and run this sample:11:08
ashishb$ cd /usr/share/hadoop11:08
ashishb$ hadoop jar hadoop-examples-1.2.1.jar pi 10 10011:08
ashishbhowever, on vanilla 2.6.0 image, there is no such file / directory11:08
ashishbdo you know where can I locate the samples on Vanilla 2.6.0 ?11:09
toskyuhm, I don't have a running cluster now, but look for etc/edp-examples/hadoop2/edp-java/hadoop-mapreduce-examples-2.6.0.jar in the sahara source code (maybe try to find that file)11:13
ashishboh ..ok11:15
ashishblet me try that11:15
*** egafford has joined #openstack-sahara11:17
openstackgerritEthan Gafford proposed openstack/sahara: Minor updates to edp documentation  https://review.openstack.org/21945911:20
openstackgerritMerged openstack/sahara-image-elements: Added support of Hue 3.8.1 to MapR image elements  https://review.openstack.org/21776911:32
*** bapalm has quit IRC11:43
*** bapalm has joined #openstack-sahara11:49
*** crobertsrh has quit IRC12:18
*** madong_ has joined #openstack-sahara12:23
*** larainema has quit IRC12:23
*** tmckay has joined #openstack-sahara12:27
*** david-lyle has quit IRC12:27
*** david-lyle has joined #openstack-sahara12:28
*** raildo-afk is now known as raildo12:29
*** crobertsrh has joined #openstack-sahara12:30
egaffordcrobertsrh: New patch for job interface UI @ https://review.openstack.org/#/c/209683/ if you have time to stamp the (very positive!) changes Diane wanted.12:40
egaffordcrobertsrh: The form's all stripey now.12:40
egaffordAlso, morning!12:40
crobertsrhegafford:  Ack.  I will take another look.12:41
egaffordcrobertsrh: I can verify that the form is functional, and the changes were pretty visual-only, so hopefully it can just be a code sanity pass for you.12:42
crobertsrhSure12:43
egaffords/can verify/have verified/, for clarity.12:43
egaffordcrobertsrh: Thanks!12:49
crobertsrhHoping like crazy it will get merged for L12:50
egaffordcrobertsrh: That'd be awesome!12:50
egafford(If only so I don't have to rebase it against master for Tokyo. :D )12:50
egafford(Also for other reasons, like it's kinda useful, and having UX-only features not be in the UI is a little dubious.)12:51
*** sanjayu has joined #openstack-sahara12:55
*** sgotliv has quit IRC12:57
*** sgotliv has joined #openstack-sahara12:57
*** sanjayu_ has quit IRC12:58
NikitaKonovalov@egafford: please have a look at the comments13:03
*** sanjayu_ has joined #openstack-sahara13:04
egaffordNikitaKonovalov: Ack; I realized I had some additional var caching to do on the template, so I'll roll your comments into the next patch.13:05
egaffordThanks.13:05
egaffordNikitaKonovalov: Do you have an example of "safe wrappings" for launch.py? As this is a sec concern, I'd rather be pointed to the standard solution than try to work it out myself, if one exists.13:07
*** sanjayu has quit IRC13:07
NikitaKonovalov@egafford: yes, I'll try to find one for you13:08
egaffordNikitaKonovalov: Thank you.13:08
NikitaKonovalov@egafford: something like this https://github.com/openstack/horizon/blob/master/openstack_dashboard/contrib/sahara/content/data_processing/clusters/workflows/scale.py#L8913:11
NikitaKonovalovdecode works the same way13:11
egaffordNikitaKonovalov: Thanks very much. Normally I'd look around myself to find the right thing, but in sec cases, I prefer to ask early.13:11
*** vgridnev has joined #openstack-sahara13:13
*** links has quit IRC13:17
*** ashishb has quit IRC13:31
*** madong_ is now known as larainema13:43
*** egafford has quit IRC13:57
*** egafford has joined #openstack-sahara13:59
*** vgridnev has quit IRC14:00
*** macjack has quit IRC14:08
*** esikachev has joined #openstack-sahara14:11
*** raildo is now known as raildo-afk14:16
*** raildo-afk is now known as raildo14:17
*** Poornima has quit IRC14:22
*** pino|work_ has joined #openstack-sahara14:34
*** tosky__ has joined #openstack-sahara14:35
*** tosky has quit IRC14:36
*** pino|work has quit IRC14:36
*** pino|work_ is now known as pino|work14:36
*** pino|work_ has joined #openstack-sahara14:39
*** tosky has joined #openstack-sahara14:39
*** tosky__ has quit IRC14:41
*** pino|work has quit IRC14:41
*** pino|work_ is now known as pino|work14:41
*** ashishb has joined #openstack-sahara14:42
*** hdd has joined #openstack-sahara14:48
*** hdd has quit IRC14:50
*** hdd has joined #openstack-sahara14:50
*** krotscheck is now known as kro_afk14:59
*** kro_afk is now known as krotscheck15:04
*** nkrinner has quit IRC15:04
*** amwong has joined #openstack-sahara15:20
*** amwong has quit IRC15:27
*** amwong has joined #openstack-sahara15:31
*** amwong_ has joined #openstack-sahara16:09
*** esikachev has quit IRC16:11
*** amwong has quit IRC16:12
*** amwong_ has quit IRC16:14
*** devlaps has joined #openstack-sahara16:16
elmikojust a doc-days heads up, we have several patches in flight that could use more reviews. please have a look when you have a free moment =)16:28
elmikohttps://etherpad.openstack.org/p/sahara-liberty-doc-update-day16:28
elmikoi will beg if i have to16:28
* elmiko holds hat out16:28
elmiko"spare some reviews?"16:28
openstackgerritDenis Egorenko proposed stackforge/sahara-ci-config: Delete image by id instead of name  https://review.openstack.org/21978216:43
openstackgerritMichael McCune proposed openstack/sahara: Correcting userdoc installation guide  https://review.openstack.org/21978316:44
*** larainema has quit IRC16:45
*** larainema has joined #openstack-sahara16:46
*** sgotliv has quit IRC17:08
*** pino|work has quit IRC17:09
*** tosky has quit IRC17:10
*** pino|work has joined #openstack-sahara17:12
*** tosky has joined #openstack-sahara17:13
*** pino|work has quit IRC17:18
*** tosky has quit IRC17:18
*** pino|work has joined #openstack-sahara17:18
*** tosky has joined #openstack-sahara17:21
*** ashishb has quit IRC17:21
*** stanchan has quit IRC17:22
*** pino|work has quit IRC17:23
*** tosky has quit IRC17:26
*** tosky has joined #openstack-sahara17:28
*** tosky has quit IRC17:33
*** esikachev has joined #openstack-sahara17:47
*** esikachev has quit IRC17:56
*** madong_ has joined #openstack-sahara18:02
*** larainema has quit IRC18:03
*** ashishb has joined #openstack-sahara18:12
openstackgerritMerged stackforge/sahara-ci-config: Delete image by id instead of name  https://review.openstack.org/21978218:33
*** vgridnev has joined #openstack-sahara18:41
openstackgerritEmilien Macchi proposed openstack/puppet-sahara: acceptance: bump trusty packaging to trusty-proposed/liberty  https://review.openstack.org/21984519:09
*** coolsvap_ has joined #openstack-sahara19:09
egaffordNikitaKonovalov, crobertsrh: Thanks for feedback on https://review.openstack.org/#/c/209683/. Hopefully last patch set. NikitaKonovalov, crobertsrh and I tried to work through finding an exploit that would require safe encoding beyond the base support in the Django form element, and couldn't find one. If you can provide an example exploit, I'll try to wrap it.19:25
*** tlashchova has quit IRC19:31
elmikodo we have any idea about when the doc fixes will need to be merged for the next release?19:35
vgridnevashishb, when fix for that will be done? https://bugs.launchpad.net/sahara/+bug/148564819:41
openstackLaunchpad bug 1485648 in Sahara "[DOC] Quickstart user guide is too old" [Undecided,Confirmed] - Assigned to Ashish Billore (ashish.billore)19:41
vgridnevelmiko, I heard that docs changes should be merged before rc-119:44
elmikovgridnev: ok, great. thank you =)19:44
*** coolsvap_ has quit IRC19:45
*** hdd has quit IRC19:53
*** hdd has joined #openstack-sahara19:54
ashishb^vgridnev: Iĺl plan to submit the patch for review for https://bugs.launchpad.net/sahara/+bug/1485648 by tomorrow19:57
openstackLaunchpad bug 1485648 in Sahara "[DOC] Quickstart user guide is too old" [Undecided,Confirmed] - Assigned to Ashish Billore (ashish.billore)19:57
ashishbalso, for this patch I need the Liberty image for Hadoop Vanilla 2.7.119:58
ashishband I learnt from ^tosky that Liberty Images are not yet published19:59
ashishb^vgridnev, for now Iĺl mention sahara-kilo-vanilla-2.6-ubuntu-14.04 as the sample image for eample20:02
ashishbonce sahara-liberty-vanilla-2.7.1-ubuntu-14.04 is available, Iĺl update it20:02
ashishbhope this is fine20:02
elmikoashishb: as long as we get to it before the rc1 release, i think we will be ok20:05
ashishbok, then Iĺl go ahead with sahara-kilo-vanilla-2.6-ubuntu-14.04 for now for the doc20:05
openstackgerritMichael McCune proposed openstack/sahara: Updating the userdoc configuration  https://review.openstack.org/21986320:09
vgridnevashishb, there are much difference between 2.60 and 2.7.1, so you can just replace 2.6.0 with 2.7.1 in the final change20:18
vgridnevthere are no much difference, I meant20:18
ashishbsure ^vgridnev, on my dev setup I am running sahara-kilo-vanilla-2.6-ubuntu-14.04.qcow2 with 2.7.1 plugin20:19
vgridnevseems that l3 tag was pus20:19
vgridnevseems that l3 tag was pushed20:19
SergeyLukjanovWe're already in Liberty 3 milestone release timeframe (see https://wiki.openstack.org/wiki/Liberty_Release_Schedule for details) and Sahara L3 was actually already tagged. So, the FFE needed to merge features. To get FFE, please, contact SergeyLukjanov and add your FFE proposal to https://etherpad.openstack.org/p/sahara-liberty-ffes20:20
SergeyLukjanovThanks.20:20
ashishbmy query was about the image location url for sahara-liberty-vanilla-2.7.1-ubuntu-14.04.qcow2 on http://sahara-files.mirantis.com/images/upstream/20:21
SergeyLukjanovelmiko, tmckay, egafford, crobertsrh, sreshetnyak, aignatov. please don't merge features with explicit confirmation from me for FFE20:21
crobertsrhNot a problem :)20:21
elmikoSergeyLukjanov: i have some questions about ffe for the improved secret storage, i have a patch ready to post but i'm curious about whether we should push to include it or not.20:22
*** stanchan has joined #openstack-sahara20:22
elmikoSergeyLukjanov: will you be checking the ML?20:22
*** witlessb has quit IRC20:22
SergeyLukjanovI'll be unavailable tomorrow20:23
SergeyLukjanovML is ok20:23
elmikocool, have a fun vacation =)20:23
SergeyLukjanovlet's chat on Friday EU evening20:23
elmikook20:23
* SergeyLukjanov should be available around 7pm UTC Friday20:24
egaffordSergeyLukjanov: Ack.20:24
egaffordHave a good time!20:24
elmikoSergeyLukjanov: ack, i might just use ML, i will try to be available around then though.20:25
elmikoi'm flying back from the midcycle on friday20:25
elmikoSergeyLukjanov: we've had some good discussions about sahara during this week. we should have some good topics for summit about security20:26
SergeyLukjanovthat's great, elmiko!20:26
vgridnevSergeyLukjanov, that was -2'ed by error20:27
vgridnevhttps://review.openstack.org/#/c/219565/20:27
*** stanchan has quit IRC20:27
SergeyLukjanovvgridnev, yup, approved instead20:28
tmckaynoted on the FFE20:30
*** tmckay has quit IRC20:41
*** raildo is now known as raildo-afk20:43
*** raildo-afk is now known as raildo20:43
vgridnevcrobertsrh, it looks like you got FFE on some horizon stuff20:43
crobertsrhIndeed20:44
vgridnevhttps://launchpad.net/horizon/+milestone/liberty-rc120:44
crobertsrhI just about have a patch ready to address the comments.20:44
david-lyleI'm still reviewing today, hoping to approve before FFE required20:45
david-lylethe one in the RC has an issue20:45
crobertsrhThanks david-lyle20:47
*** vgridnev has quit IRC20:56
*** tosky has joined #openstack-sahara20:57
*** ashishb has quit IRC20:59
*** vgridnev has joined #openstack-sahara21:05
*** raildo is now known as raildo-afk21:07
openstackgerritEmilien Macchi proposed openstack/puppet-sahara: acceptance: bump trusty packaging to trusty-proposed/liberty  https://review.openstack.org/21984521:11
*** crobertsrh is now known as _crobertsrh21:11
*** egafford has quit IRC21:38
*** vgridnev has quit IRC21:38
*** hdd has quit IRC22:19
*** tosky has quit IRC22:26
openstackgerritMerged openstack/sahara: adding developer docs guidelines about clients  https://review.openstack.org/21778622:43
openstackgerritMerged openstack/sahara: Add CDH HDFS HA part in the user doc  https://review.openstack.org/21255222:45
openstackgerritMerged openstack/sahara: Updated from global requirements  https://review.openstack.org/21950322:59
openstackgerritMerged openstack/sahara: Print Heat stack before create/update to debug logs  https://review.openstack.org/21564623:00
openstackgerritMerged openstack/sahara: [doc-day] Updated development environment guide  https://review.openstack.org/21919523:03
openstackgerritMerged openstack/sahara: Update documentation for Vanilla plugin  https://review.openstack.org/21894623:14
elmikoaignatov: thank you =)23:19
*** krotscheck is now known as kro_paternity23:34

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!