Tuesday, 2015-08-18

openstackgerritSergey Lukjanov proposed openstack/sahara: [WIP] Run scenario tests for the fake plugin in gate  https://review.openstack.org/21354600:04
*** witlessb has quit IRC00:06
tellesnobregadid anything change on sahara with devstack00:07
tellesnobrega??00:07
tellesnobregai'm trying to start it but its not going up... i'm using the same local.conf that i've been using for a while with success00:08
SergeyLukjanovtellesnobrega, do you have enable_plugin sahara in local.conf/00:09
tellesnobregayeah00:09
tellesnobregaSergeyLukjanov: i used this same local.conf in a previous vm and it worked, now devstack is starting but sahara isn't being even downloaded00:10
tellesnobregaSergeyLukjanov: found the problem, thanks, i was using enable_service00:31
tellesnobregaread it wrong00:32
SergeyLukjanovtellesnobrega, yeah, I'm typing enable_service sometimes too :)00:32
tellesnobrega:)00:37
*** hdd has quit IRC00:53
openstackgerritMerged openstack/sahara-extra: Updated from global requirements  https://review.openstack.org/20672401:00
*** tiny-hands has quit IRC01:20
*** hdd has joined #openstack-sahara01:20
*** tiny-hands has joined #openstack-sahara01:21
openstackgerritMerged openstack/sahara: Remove test for job type in get_data_sources  https://review.openstack.org/20854201:23
openstackgerritMerged openstack/sahara: Updated from global requirements  https://review.openstack.org/21163301:24
openstackgerritOpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements  https://review.openstack.org/21228101:31
tellesnobregaI'm trying to set up a mapr cluster (for bug triage) but i'm getting a no volume error01:32
tellesnobregaanyone know the workaround for this01:32
*** witlessb has joined #openstack-sahara01:56
*** witlessb has quit IRC02:01
*** tmckay has quit IRC02:11
*** tmckay has joined #openstack-sahara02:11
*** tiny-hands has quit IRC02:30
*** tmckay has quit IRC02:31
*** tmckay has joined #openstack-sahara02:32
*** tmckay has quit IRC02:39
*** logan2 has quit IRC02:44
openstackgerritMerged openstack/sahara: Updated from global requirements  https://review.openstack.org/20672302:49
*** logan2 has joined #openstack-sahara03:34
*** macjack has joined #openstack-sahara03:51
*** coolsvap|away is now known as coolsvap04:10
*** hdd has quit IRC04:37
openstackgerritSergey Reshetnyak proposed openstack/sahara-image-elements: Install xfsprogs for ability to formatting volumes in XFS FS  https://review.openstack.org/21376805:06
*** nkrinner has joined #openstack-sahara05:06
*** vgridnev has joined #openstack-sahara05:34
*** vgridnev has quit IRC05:53
*** ashishb has joined #openstack-sahara05:58
*** hdd has joined #openstack-sahara06:16
*** coolsvap is now known as coolsvap|away06:22
*** macjack has quit IRC06:31
*** macjack has joined #openstack-sahara06:33
openstackgerritDenis Egorenko proposed openstack/puppet-sahara: Update parameters for Sahara  https://review.openstack.org/20598806:33
*** macjack has quit IRC06:34
*** hdd has quit IRC06:37
*** macjack has joined #openstack-sahara06:39
*** openstackgerrit_ has joined #openstack-sahara06:42
*** vgridnev has joined #openstack-sahara06:55
*** macjack has quit IRC07:08
*** macjack has joined #openstack-sahara07:11
*** vgridnev has quit IRC07:16
openstackgerritEvgeny Sikachev proposed openstack/sahara: [WIP] Run scenario tests for the fake plugin in gate  https://review.openstack.org/21354607:24
*** witlessb has joined #openstack-sahara07:27
*** sgotliv has joined #openstack-sahara07:48
openstackgerritEvgeny Sikachev proposed openstack/sahara: Implement ability of creating flavor for scenario tests  https://review.openstack.org/20356707:50
openstackgerritEvgeny Sikachev proposed openstack/sahara: [WIP] Run scenario tests for the fake plugin in gate  https://review.openstack.org/21354607:59
*** Nikolay_St has joined #openstack-sahara08:00
*** vgridnev has joined #openstack-sahara08:13
*** IBerezovskiy has joined #openstack-sahara08:25
openstackgerritEvgeny Sikachev proposed openstack/sahara: Add support of SSL in scenario tests  https://review.openstack.org/21247608:27
*** macjack has quit IRC08:30
openstackgerritVitaly Gridnev proposed openstack/sahara: Update plugin version for transient tests to vanilla 2.7.1  https://review.openstack.org/21362208:37
openstackgerritVitaly Gridnev proposed openstack/sahara: Deprecate Vanilla 2.6.0  https://review.openstack.org/21320108:37
*** macjack has joined #openstack-sahara08:50
openstackgerritSergey Reshetnyak proposed openstack/sahara-image-elements: Install xfsprogs for ability to formatting volumes in XFS FS  https://review.openstack.org/21376808:50
openstackgerritAndrey Pavlov proposed openstack/python-saharaclient: Add initial commit for integration with Openstackclient  https://review.openstack.org/20454008:57
*** shikel has quit IRC09:01
*** saneax has joined #openstack-sahara09:02
openstackgerritAndrey Pavlov proposed openstack/python-saharaclient: Add job execution update  https://review.openstack.org/20800109:05
*** sh1kel has joined #openstack-sahara09:06
*** saneax has quit IRC09:09
*** macjack has quit IRC09:11
*** macjack has joined #openstack-sahara09:13
openstackgerritSergey Lukjanov proposed openstack/sahara: Make infra engine configurable in devstack plugin  https://review.openstack.org/21354509:14
openstackgerritSergey Lukjanov proposed openstack/sahara: [WIP] Run scenario tests for the fake plugin in gate  https://review.openstack.org/21354609:14
openstackgerritSergey Lukjanov proposed openstack/sahara: Make tools/pretty_tox.sh more informative and reliable  https://review.openstack.org/21408009:14
openstackgerritSergey Lukjanov proposed openstack/sahara: [WIP] Run scenario tests for the fake plugin in gate  https://review.openstack.org/21354609:16
*** tosky has joined #openstack-sahara09:20
*** macjack has quit IRC09:20
*** macjack has joined #openstack-sahara09:22
*** macjack has quit IRC09:32
openstackgerritVitaly Gridnev proposed openstack/sahara: Add sample spark wordcount job  https://review.openstack.org/20703909:37
openstackgerritAndrey Pavlov proposed openstack/python-saharaclient: Adding updates for clusters, jobs, job binary internals  https://review.openstack.org/21366509:44
openstackgerritSergey Lukjanov proposed openstack/sahara: [WIP] Run scenario tests for the fake plugin in gate  https://review.openstack.org/21354609:45
openstackgerritSergey Lukjanov proposed openstack/sahara: Set missed admin user parameters used for trusts creation in devstack  https://review.openstack.org/21409409:45
openstackgerritAndrey Pavlov proposed openstack/python-saharaclient: Adding is_protected, is_public support  https://review.openstack.org/21409809:50
*** tiny-hands has joined #openstack-sahara09:55
*** macjack has joined #openstack-sahara09:55
toskysreshetnyak: hi, I see you nominated this bug for Juno; I guess it's a bit too late for backporting it to Juno at this point... or maybe not? https://bugs.launchpad.net/sahara/+bug/139151809:55
openstackLaunchpad bug 1391518 in Sahara "[HDP] Create HDP cluster with auto security group failed" [High,Fix released] - Assigned to Sergey Reshetnyak (sreshetniak)09:55
toskybackport the fix of course09:55
*** tiny-hands has quit IRC10:00
vgridnevtosky, I guess it was nominated very long ago10:13
toskyvgridnev: I guess so, even if I don't see when; launchpad is a bit confusing for me sometime10:13
*** saneax has joined #openstack-sahara10:31
openstackgerritAndrey Pavlov proposed openstack/sahara: Adding shared and protected resources support  https://review.openstack.org/19556810:31
*** ashishb has quit IRC10:37
*** ashishb has joined #openstack-sahara10:37
openstackgerritSergey Reshetnyak proposed openstack/sahara: [WIP] test commit  https://review.openstack.org/21413010:37
openstackgerritArtem Osadchiy proposed openstack/sahara: Add event logs for MapR plugin  https://review.openstack.org/21413410:41
*** saneax has quit IRC10:43
*** tiny-hands has joined #openstack-sahara10:47
*** sh1kel has quit IRC10:48
*** saneax has joined #openstack-sahara10:50
*** tiny-hands has quit IRC10:52
*** macjack has quit IRC11:00
*** saneax has quit IRC11:04
*** tmckay has joined #openstack-sahara11:26
*** tmckay has quit IRC11:27
*** tmckay has joined #openstack-sahara11:28
*** DuncanT has quit IRC11:38
openstackgerritAndrey Pavlov proposed openstack/sahara: Adding Grenade support for Sahara  https://review.openstack.org/19310111:38
*** saneax has joined #openstack-sahara11:41
*** tmckay has quit IRC12:11
*** egafford has joined #openstack-sahara12:16
openstackgerritAndrey Pavlov proposed openstack/sahara: Adding Grenade support for Sahara  https://review.openstack.org/19310112:17
*** nkrinner has quit IRC12:32
*** sgotliv_ has joined #openstack-sahara12:38
*** sgotliv has quit IRC12:40
openstackgerritSebastien Badia proposed openstack/puppet-sahara: Initial msync run for all Puppet OpenStack modules  https://review.openstack.org/18987712:41
*** tmckay has joined #openstack-sahara12:41
*** tmckay has quit IRC12:42
*** macjack has joined #openstack-sahara12:42
*** tmckay has joined #openstack-sahara12:42
*** saneax has quit IRC12:44
*** _crobertsrh is now known as crobertsrh12:49
*** chlong has joined #openstack-sahara12:51
openstackgerritAndrey Pavlov proposed openstack/sahara: Adding Grenade support for Sahara  https://review.openstack.org/19310113:07
tellesnobregacrobertsrh, hey i was looking at the storm job UI patch, and you -1 because the bp link is incorrect, i found the problem, the bp is marked as complete, should i create a new bp in sahara or one in horizon for this?13:13
crobertsrhI would say one for horizon13:14
*** ashishb has quit IRC13:14
crobertsrhoh wait...13:14
crobertsrhI didn't realize that marking a bp as complete13:15
crobertsrh...would kill the link13:15
crobertsrhThat doesn't seem right13:15
crobertsrhOk, I guess you're right13:16
crobertsrhI will remove my -113:16
tmckaycrobertsrh, I think that complete blueprints don't show up in the normal search13:16
crobertsrhNo need to create anything new13:16
tmckayyou can find them, but you have to use a different link.  Frustrates me all the time, honestly13:16
tmckaysomewhere I have a link saved13:17
openstackgerritMerged openstack/sahara-specs: Addding spec for Objects update support in Sahara API  https://review.openstack.org/20837813:18
*** tmckay has quit IRC13:23
*** vkmc has joined #openstack-sahara13:25
tellesnobregacrobertsrh, thanks, but i think we should have somewhere to point on the change13:25
tellesnobregawhat do you think?13:25
crobertsrhwell, like tmckay said, the bp is available still, just not from that link13:25
crobertsrhAn interested person could still find it.13:26
crobertsrhIf you created a new one, it would just get moved to "completed" anyway....and wouldn't work again.13:26
*** tmckay has joined #openstack-sahara13:30
tellesnobregacrobertsrh, syre13:30
tellesnobregasure13:30
*** saneax has joined #openstack-sahara13:32
AndreyPavlovhi guys, could you please review this change: https://review.openstack.org/#/c/19502413:36
AndreyPavlovand it would be great if you could review this ones after that: https://review.openstack.org/#/q/topic:bp/shared-protected-resources,n,z13:36
*** macjack has quit IRC13:51
*** tiny-hands has joined #openstack-sahara14:00
openstackgerritAndrey Pavlov proposed openstack/sahara: Adding Grenade support for Sahara  https://review.openstack.org/19310114:02
*** DuncanT has joined #openstack-sahara14:03
openstackgerritMichael McCune proposed openstack/sahara: adding nova to session cache  https://review.openstack.org/21420514:15
openstackgerritMerged openstack/sahara: Adding job_execution_update api call  https://review.openstack.org/19791414:22
openstackgerritMerged openstack/sahara: Adding job_update api call  https://review.openstack.org/19792414:22
openstackgerritMichael McCune proposed openstack/sahara: adding nova to session cache  https://review.openstack.org/21420514:23
*** tosky has quit IRC14:26
openstackgerritSergey Lukjanov proposed openstack/sahara: Set missed admin user parameters used for trusts creation in devstack  https://review.openstack.org/21409414:29
openstackgerritSergey Lukjanov proposed openstack/sahara: Make infra engine configurable in devstack plugin  https://review.openstack.org/21354514:29
openstackgerritSergey Lukjanov proposed openstack/sahara: Run scenario tests for the fake plugin in gate  https://review.openstack.org/21354614:29
openstackgerritSergey Lukjanov proposed openstack/sahara: Make tools/pretty_tox.sh more informative and reliable  https://review.openstack.org/21408014:29
openstackgerritSergey Lukjanov proposed openstack/sahara: Add separated dir with fake plugin scenario for gate testing  https://review.openstack.org/21421614:29
*** tosky has joined #openstack-sahara14:30
*** saneax has quit IRC14:31
*** saneax has joined #openstack-sahara14:39
openstackgerritArtem Osadchiy proposed openstack/sahara: Added support of Hadoop 2.7.0 to MapR plugin  https://review.openstack.org/20844314:42
openstackgerritArtem Osadchiy proposed openstack/sahara: Added support for MapR v5.0.0  https://review.openstack.org/20845414:42
openstackgerritVitaly Gridnev proposed openstack/sahara: Add sample spark wordcount job  https://review.openstack.org/20703914:48
openstackgerritVitaly Gridnev proposed openstack/sahara: Add sample spark wordcount job  https://review.openstack.org/20703914:50
*** Nikolay_St has quit IRC14:59
*** ylobankov has quit IRC14:59
*** AndreyPavlov has quit IRC14:59
*** sreshetnyak has quit IRC14:59
*** saneax has quit IRC14:59
*** hdd has joined #openstack-sahara15:03
*** sreshetnyak has joined #openstack-sahara15:05
*** ylobankov has joined #openstack-sahara15:06
*** AndreyPavlov has joined #openstack-sahara15:10
*** Nikolay_St has joined #openstack-sahara15:12
*** vgridnev has quit IRC15:34
*** DuncanT has quit IRC15:36
SergeyLukjanovtmckay, elmiko, tosky, folks, please, take a look at https://review.openstack.org/#/q/topic:sahara-scenario-gate,n,z15:38
SergeyLukjanovtests already passed few times, it'll be great to merge them and move the jobs to check pipeline (non-voting)15:38
tmckaySergeyLukjanov, ack, will do15:38
elmikoSergeyLukjanov: ack15:39
SergeyLukjanovtmckay, thx!15:39
SergeyLukjanovelmiko, thx :)15:39
elmikoalso, SergeyLukjanov, i responded to your comments on v2 api15:39
elmikoi think we have some of the same ideas ;)15:39
SergeyLukjanovelmiko, I'll take a look on it more later today15:39
elmikono worries, it's gonna take awhile to get it right15:39
SergeyLukjanovso, we finally have working scenario tests on fake plugin in gate15:40
elmiko\o/15:40
openstackgerritMerged openstack/sahara: Allow Sahara native urls and runtime urls to differ for datasources  https://review.openstack.org/20963415:51
*** Nikolay_St has quit IRC16:02
*** DuncanT has joined #openstack-sahara16:12
*** DWfuturetec has joined #openstack-sahara16:17
*** witlessb has quit IRC16:42
*** witlessb has joined #openstack-sahara16:43
*** ashishb has joined #openstack-sahara16:47
*** sgotliv_ has quit IRC16:59
*** Nikolay_St has joined #openstack-sahara16:59
*** tosky has quit IRC17:04
openstackgerritAndrey Pavlov proposed openstack/sahara: Adding Grenade support for Sahara  https://review.openstack.org/19310117:45
*** flaviosr has joined #openstack-sahara17:47
*** japplewhite has joined #openstack-sahara17:49
flaviosrHello, I am having a problem with sahara on a openstack multi domain enviroment. It is working on the default domain, but on another domain, when running a map reduce job it is getting killed with the following error: Workflow failed, error message[POST http://<controller-ip>:5000/v2.0/tokens/ failed on exception: java.net.SocketTimeoutException: Read timed out; For more details see:  http://wiki.apache.org/hadoop/SocketT17:50
*** DWfuturetec has quit IRC17:50
elmikolooks like it's trying to hit a v2 keystone endpoint, i don't think v2 support domains17:51
flaviosryeah17:51
elmikoi'm not sure that sahara is quite ready for multi-domain environments17:52
flaviosrdo you know how I can change that?17:52
flaviosroh, ok then17:52
elmikofirst thing to check is that sahara is using v3, this is defaulted to true17:52
elmikothen ensure that the keystone auth_url is set to a v3 endpoint17:52
flaviosrI did it17:52
elmikoare you using a swift source with that job?17:53
flaviosryeah, wait17:53
flaviosras far as i though, the keystone endpoint http://controller:5000/v2.0 should work with keystone v317:54
elmikopossibly, but i would imagine that keystone will use v2 protocols when it sees that endpoint. i'm not 100% sure on that though17:54
elmikoit may also be an issue with the hadoop-swift.jar trying to gain credentials for the swift store during the job17:55
flaviosrmaybe, I am almost sure that is a problem with keystone v3 / multio domain, as it is working on the default domain17:56
*** hdd has quit IRC17:56
flaviosrand in sahara.conf I have use_identity_api_v3=true17:57
flaviosrbut it didnt changed anything17:57
elmikoyou are most likely correct. also i don't think sahara is currently handling the user_domain_name and project_domain_name entities yet. aside from "Default"17:57
flaviosrthat should be the case17:57
elmikoflaviosr: if you wouldn't mind, could you please open a bug with the details of how you received this error?17:58
flaviosryeah, sure17:58
elmikothank you =)17:58
flaviosrthanks elmiko!17:58
*** Nikolay_St has quit IRC18:01
*** chlong has quit IRC18:06
*** apavlov has joined #openstack-sahara18:07
*** chlong has joined #openstack-sahara18:09
*** apavlov has quit IRC18:10
*** openstackgerrit_ has quit IRC18:11
*** japplewhite has quit IRC18:26
*** sanjayu_ has quit IRC18:39
*** sanjayu has joined #openstack-sahara18:40
*** melaks has joined #openstack-sahara18:51
*** DWfuturetec has joined #openstack-sahara19:04
*** hdd has joined #openstack-sahara19:05
*** melaks has quit IRC19:11
*** japplewhite has joined #openstack-sahara19:20
*** flaviosr has quit IRC19:26
*** vgridnev has joined #openstack-sahara19:34
vgridnevcrobertsrh, how to safely ping horizon folks in order to merge several changes?19:36
crobertsrhAny change in particular?19:37
crobertsrhTypically david-lyle is fairly responsive, especially if we have 3 or 4 "sahara +1s" on the review.19:37
vgridnevI suggest that https://review.openstack.org/#/c/197965/ and https://review.openstack.org/#/c/158715/ definitely can be merged19:38
vgridnevevent-log is most prior there19:40
crobertsrhYeah, I agree that those have waited long enough.19:40
crobertsrhYou can ping him if you'd like.  Otherwise, I can bring them up in tomorrow's Horizon meeting.19:41
*** egafford is now known as egafford|afk19:44
*** DWfuturetec has quit IRC19:48
*** melaks has joined #openstack-sahara19:52
*** egafford|afk is now known as egafford19:59
*** ashishb has quit IRC20:06
*** vgridnev has quit IRC21:00
*** japplewhite has quit IRC21:10
*** crobertsrh is now known as _crobertsrh21:11
openstackgerritTrevor McKay proposed openstack/sahara: Add manila nfs data sources  https://review.openstack.org/20961521:14
tmckay^^ this was just a rebase, please put your +X back21:17
tmckay:)21:17
elmikoack21:21
*** tiny-hands has quit IRC21:36
*** hdd has quit IRC21:48
*** egafford has quit IRC22:03
*** DWfuturetec has joined #openstack-sahara22:07
*** DWfuturetec has quit IRC22:14
*** DWfuturetec has joined #openstack-sahara22:27
*** melaks has quit IRC23:28
*** chlong has quit IRC23:29
*** melaks has joined #openstack-sahara23:31
SergeyLukjanovegafford, we've find a backward compat breaking change in client https://github.com/openstack/python-saharaclient/commit/7435a98a0cc8e9c1c8fb1158f553ef673812f0a823:32
SergeyLukjanovit means that 0.10.0 couldn't create jobs in kilo sahata23:32
SergeyLukjanovdue to the passed interface param23:32
tmckaySergeyLukjanov, hmm. So what do you suggest?23:38
SergeyLukjanovtmckay, I think I have a fix (it's 3am, so, not 100% sure)23:38
tmckaylol :)  Okay23:38
SergeyLukjanovand after merging fix release 0.10.123:38
tmckaywe can talk about it tomorrow23:39
tmckaySergeyLukjanov, how many previous versions of Sahara should a new client work with?23:39
tmckayI'm sure we've talked about this before, but I forget23:39
* tmckay goes high-latency23:40
SergeyLukjanovtmckay with all in theory23:40
tmckayhmm.  Tough to do as time goes on23:40
*** witlessb has quit IRC23:41
openstackgerritSergey Lukjanov proposed openstack/python-saharaclient: Fix backward compat issue for job interfaces  https://review.openstack.org/21438823:42
SergeyLukjanovtmckay ^^23:42
*** tiny-hands has joined #openstack-sahara23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!