openstackgerrit | OpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements https://review.openstack.org/327388 | 03:45 |
---|---|---|
*** links has joined #openstack-sahara | 03:46 | |
*** Poornima has joined #openstack-sahara | 04:09 | |
*** pgadiya has joined #openstack-sahara | 05:04 | |
*** rcernin|off has joined #openstack-sahara | 05:15 | |
*** sverma has joined #openstack-sahara | 05:20 | |
*** DuncanT has quit IRC | 05:24 | |
*** kgalanov has quit IRC | 05:24 | |
*** flaviodsr has quit IRC | 05:25 | |
*** zhiyan has quit IRC | 05:25 | |
*** rcernin|off has quit IRC | 05:26 | |
*** DuncanT has joined #openstack-sahara | 05:27 | |
*** kgalanov has joined #openstack-sahara | 05:28 | |
*** flaviodsr has joined #openstack-sahara | 05:28 | |
*** zhiyan has joined #openstack-sahara | 05:33 | |
*** itisha has quit IRC | 06:00 | |
*** rcernin|off has joined #openstack-sahara | 06:14 | |
*** rcernin|off is now known as rcernin | 06:21 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/sahara-dashboard: Imported Translations from Zanata https://review.openstack.org/327478 | 06:23 |
*** Guest8385 has joined #openstack-sahara | 06:29 | |
*** abalutoiu has joined #openstack-sahara | 06:38 | |
openstackgerrit | Merged openstack/sahara: Updated from global requirements https://review.openstack.org/327388 | 07:08 |
*** pcaruana has joined #openstack-sahara | 07:09 | |
*** esikachev has joined #openstack-sahara | 07:27 | |
*** pino|work has joined #openstack-sahara | 07:41 | |
*** hoonetorg has quit IRC | 07:47 | |
*** witlessb has joined #openstack-sahara | 07:49 | |
*** nkrinner has joined #openstack-sahara | 07:56 | |
*** tesseract has joined #openstack-sahara | 07:56 | |
*** hoonetorg has joined #openstack-sahara | 07:58 | |
*** openstackgerrit has quit IRC | 08:03 | |
*** openstackgerrit has joined #openstack-sahara | 08:03 | |
*** permalac has joined #openstack-sahara | 08:21 | |
*** nkrinner has quit IRC | 08:22 | |
*** nkrinner has joined #openstack-sahara | 08:27 | |
*** _degorenko|afk is now known as degorenko | 08:32 | |
*** stanchan has joined #openstack-sahara | 08:56 | |
*** Guest8385 has quit IRC | 08:58 | |
*** sverma has quit IRC | 09:03 | |
*** Guest8385 has joined #openstack-sahara | 09:11 | |
*** sverma has joined #openstack-sahara | 09:20 | |
*** dmk0202 has joined #openstack-sahara | 09:28 | |
*** tosky has joined #openstack-sahara | 09:30 | |
tosky | uhm, the change for getting tempest tests from sahara-tests was merged, but it's not working | 09:31 |
tosky | I will ask other people on -qa later | 09:31 |
openstackgerrit | Merged openstack/sahara-dashboard: Imported Translations from Zanata https://review.openstack.org/327478 | 09:43 |
tosky | uhm, or it simply worked but I used the wrong regexp | 09:50 |
*** vgridnev has joined #openstack-sahara | 09:51 | |
*** sgotliv_ has joined #openstack-sahara | 09:55 | |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: fix grenade from mitaka upgrade https://review.openstack.org/327570 | 10:15 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: fix grenade from mitaka upgrade https://review.openstack.org/327570 | 10:16 |
*** stanchan has quit IRC | 10:17 | |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: fix grenade from mitaka upgrade https://review.openstack.org/327570 | 10:17 |
*** pgadiya has quit IRC | 10:27 | |
*** sverma has quit IRC | 10:30 | |
*** Guest8385 has quit IRC | 10:32 | |
openstackgerrit | Michael Ionkin proposed openstack/sahara-image-elements: testcommit https://review.openstack.org/327023 | 10:37 |
openstackgerrit | Michael Ionkin proposed openstack/sahara-image-elements: testcommit https://review.openstack.org/327023 | 10:40 |
*** Guest8385 has joined #openstack-sahara | 10:44 | |
openstackgerrit | Michael Ionkin proposed openstack/sahara-image-elements: testcommit https://review.openstack.org/327584 | 10:44 |
*** sverma has joined #openstack-sahara | 10:45 | |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: workaround to fix ambari start on centos7 https://review.openstack.org/315024 | 11:10 |
*** vgridnev_ has joined #openstack-sahara | 11:42 | |
*** vgridnev has quit IRC | 11:44 | |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara-specs: initial kerberos integration https://review.openstack.org/327616 | 11:45 |
openstackgerrit | Michael Ionkin proposed openstack/sahara-image-elements: testcommit https://review.openstack.org/327617 | 11:53 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: fix grenade from mitaka upgrade https://review.openstack.org/327570 | 12:05 |
*** agireud has quit IRC | 12:08 | |
*** agireud has joined #openstack-sahara | 12:09 | |
*** zioproto has joined #openstack-sahara | 12:24 | |
zioproto | Hello there ! I am running Hadoop on openstack, and I am using the hadoop-openstack.jar to use swift storage. Everything works in my test so far, but I am stuck with a corner case config problem regarding a swift container that belongs to another tenant and I can access in read only. | 12:26 |
zioproto | it is better to go ahead and ask for some help here in the channel or there is a mailing list where I should send an email with the problem description ? or there is a bug tracker ? but I guess it is more like a config issue and not a bug | 12:27 |
zioproto | in short, with the swift command line client I can use the option --os-storage-url but I dont know how to set this option when I configure swift in the core-site.xml in Hadoop | 12:27 |
tosky | but are you manually configuring it? Without Sahara? | 12:28 |
*** Guest8385 has quit IRC | 12:29 | |
*** abehl has joined #openstack-sahara | 12:30 | |
*** _mattf` has quit IRC | 12:40 | |
*** _mattf has joined #openstack-sahara | 12:40 | |
*** _crobertsrh is now known as crobertsrh | 12:42 | |
zioproto | tosky: mmm yes | 12:44 |
zioproto | tosky: I actually used some external provisioning tool with Openstack HEAT developed by a colleague of mine | 12:45 |
*** vgridnev_ has quit IRC | 12:45 | |
*** vgridnev has joined #openstack-sahara | 12:45 | |
zioproto | tosky: basically I ssh to the master node and I play around with the core-site.xml file. The provisioning was done with this tool where you can set how many slaves node you want and few other options | 12:45 |
vgridnev | zioproto, there is xml that we are using to configure swift in sahara https://github.com/openstack/sahara/blob/master/sahara/swift/resources/conf-template.xml | 12:47 |
vgridnev | btw, if you are not using sahara to provision hadoop on openstack, how it affects sahara? | 12:48 |
zioproto | vgridnev: is the parameter fs.swift.service.sahara.auth.url the same parameter as the --os-storage-url of the swift client ? | 12:48 |
vgridnev | auth url is url to keystone, actually | 12:49 |
vgridnev | this data will be needed for to perform auth in keystone then | 12:49 |
zioproto | oh well even if you install hadoop manually, you can always overwrite the hadoop-openstack.jar from the Hadoop distribution, and hack the core-site.xml to configure the openstack swift access right ? We plan to integrate sahara in our public cloud. But now we are still learning hadoop. Is is kind of a long process :) | 12:49 |
vgridnev | you will probably want to change tenant_id in order to get access to container in other tenant | 12:50 |
zioproto | vgridnev: ok, so everything is working for me. I can run map reduce reading and writing from swift. The only problem I dont know how to tweak the core-site.xml to read data from a container where I have read access, but the container belongs to another tenant. This is a use case where the cloud operator creates a container with a Scientific Dataset (for example the 1000genomes dataset) and many | 12:51 |
zioproto | other tenants have readonly access to this container to run Hadoop jobs on it. | 12:51 |
zioproto | vgridnev: if I change the tenant_id I am not able to authenticate anymore with keystone because my user is not in that tenant | 12:52 |
vgridnev | oh, ok, if you just starting learning hadoop; actually I just initially thought that there is some issue in sahara : ) | 12:52 |
zioproto | My fear is that this feature is not implemented. The --os-storage-url for cross-project swift container sharing | 12:54 |
zioproto | which one is the official repository for the hadoop swift fs driver ? | 12:55 |
*** links has quit IRC | 12:57 | |
zioproto | is this this one the latest ? https://github.com/openstack/sahara-extra/tree/master/hadoop-swiftfs | 12:57 |
*** esikachev has quit IRC | 12:58 | |
*** esikachev has joined #openstack-sahara | 13:00 | |
zioproto | so, if I have a problem with the hadoop-swiftfs implementation, is this a project that comes from the sahara community, or I should report the issue to the Hadoop developers community ? | 13:05 |
*** egafford has quit IRC | 13:08 | |
*** simon-AS559 has joined #openstack-sahara | 13:09 | |
*** tmckay has joined #openstack-sahara | 13:11 | |
*** tellesnobrega is now known as tellesnobrega_af | 13:11 | |
*** links has joined #openstack-sahara | 13:17 | |
vgridnev | zioproto, there are two implementations actually, the link you provided is sahara's repo, and also there is a hadoop-openstack that is developed by hadoop folks | 13:18 |
vgridnev | the current trunk seems to be there: https://github.com/apache/hadoop/tree/fa440a39b7883183b9cf43c056908ca7bf68e6a1/hadoop-tools/hadoop-openstack | 13:19 |
*** links has quit IRC | 13:23 | |
*** nkrinner has quit IRC | 13:29 | |
openstackgerrit | Michael Ionkin proposed openstack/sahara-image-elements: testcommit https://review.openstack.org/327617 | 13:31 |
*** nkrinner has joined #openstack-sahara | 13:33 | |
*** esikachev has quit IRC | 13:37 | |
*** esikachev has joined #openstack-sahara | 13:42 | |
*** itisha has joined #openstack-sahara | 13:44 | |
*** esikachev has quit IRC | 13:53 | |
vgridnev | zioproto, have you saw my answer? | 13:54 |
*** esikachev has joined #openstack-sahara | 14:01 | |
*** rodrigods has quit IRC | 14:06 | |
*** rodrigods has joined #openstack-sahara | 14:07 | |
*** abehl has quit IRC | 14:09 | |
zioproto | vgridnev: yes, I am going through the code. thank you :) | 14:10 |
*** agireud has quit IRC | 14:19 | |
*** agireud has joined #openstack-sahara | 14:20 | |
*** sverma has quit IRC | 14:21 | |
*** abehl has joined #openstack-sahara | 14:22 | |
*** abehl has quit IRC | 14:22 | |
*** anshul has joined #openstack-sahara | 14:22 | |
*** anshul is now known as Guest76774 | 14:23 | |
*** egafford has joined #openstack-sahara | 14:41 | |
*** pcaruana has quit IRC | 14:41 | |
*** Poornima has quit IRC | 14:42 | |
*** egafford has left #openstack-sahara | 14:50 | |
*** zioproto has quit IRC | 14:50 | |
*** egafford has joined #openstack-sahara | 14:52 | |
*** nkrinner has quit IRC | 15:03 | |
*** esikachev has quit IRC | 15:26 | |
*** tellesnobrega_af is now known as tellesnobrega | 15:26 | |
*** abalutoiu has quit IRC | 15:26 | |
*** tesseract has quit IRC | 15:30 | |
*** rcernin has quit IRC | 15:32 | |
openstackgerrit | Merged openstack/sahara-dashboard: Start using reno for release notes https://review.openstack.org/327080 | 15:33 |
*** vgridnev has quit IRC | 15:36 | |
*** agireud has quit IRC | 15:40 | |
*** dmk0202 has quit IRC | 15:41 | |
*** agireud has joined #openstack-sahara | 15:42 | |
*** esikachev has joined #openstack-sahara | 15:47 | |
*** tellesnobrega is now known as tellesnobrega_af | 15:47 | |
*** esikachev has quit IRC | 16:00 | |
*** Guest76774 has quit IRC | 16:02 | |
*** degorenko is now known as _degorenko|afk | 16:18 | |
*** vgridnev has joined #openstack-sahara | 16:31 | |
*** vgridnev has quit IRC | 16:31 | |
*** tellesnobrega_af is now known as tellesnobrega | 16:31 | |
*** tellesnobrega is now known as tellesnobrega_af | 16:55 | |
*** tellesnobrega_af is now known as tellesnobrega | 17:00 | |
*** tellesnobrega is now known as tellesnobrega_af | 17:15 | |
openstackgerrit | Merged openstack/python-saharaclient: Migrate functional tests to openstack-client https://review.openstack.org/326512 | 17:16 |
*** simon-AS559 has quit IRC | 17:19 | |
*** permalac has quit IRC | 17:31 | |
openstackgerrit | Merged openstack/sahara-dashboard: Updated from global requirements https://review.openstack.org/327797 | 17:34 |
*** vgridnev has joined #openstack-sahara | 17:50 | |
elmiko | vgridnev, egafford, i'll be at the meeting but gonna be a few minutes late | 17:52 |
egafford | elmiko: Ack! | 17:53 |
*** simon-AS559 has joined #openstack-sahara | 17:54 | |
*** esikachev has joined #openstack-sahara | 17:58 | |
*** itisha has quit IRC | 18:02 | |
*** itisha has joined #openstack-sahara | 18:03 | |
*** simon-AS5591 has joined #openstack-sahara | 18:07 | |
*** simon-AS559 has quit IRC | 18:09 | |
*** abalutoiu has joined #openstack-sahara | 18:10 | |
*** stanchan has joined #openstack-sahara | 18:12 | |
*** abalutoiu has quit IRC | 18:24 | |
*** abalutoiu has joined #openstack-sahara | 18:25 | |
*** stanchan has quit IRC | 18:39 | |
*** esikachev has quit IRC | 18:55 | |
egafford | elmiko: How'd you get back into Launchpad? | 19:00 |
elmiko | seems it has been fixed | 19:00 |
elmiko | i was chatting in openstack-infra | 19:00 |
elmiko | they pinged me when it started working again | 19:00 |
egafford | Nice. | 19:00 |
elmiko | biab, i need to get some foodz | 19:01 |
*** simon-AS5591 has quit IRC | 19:02 | |
*** simon-AS559 has joined #openstack-sahara | 19:06 | |
*** simon-AS559 has quit IRC | 19:11 | |
*** simon-AS559 has joined #openstack-sahara | 19:11 | |
*** ukaynar has joined #openstack-sahara | 19:31 | |
*** pino|work has quit IRC | 19:32 | |
*** esikachev has joined #openstack-sahara | 19:38 | |
*** sgotliv_ has quit IRC | 19:48 | |
*** esikachev has quit IRC | 20:13 | |
*** rcernin has joined #openstack-sahara | 20:35 | |
*** esikachev has joined #openstack-sahara | 20:51 | |
*** crobertsrh is now known as _crobertsrh | 21:03 | |
*** ukaynar has quit IRC | 21:11 | |
*** vgridnev has quit IRC | 21:11 | |
*** rcernin has quit IRC | 21:15 | |
*** simon-AS559 has quit IRC | 21:38 | |
*** tmckay has quit IRC | 21:41 | |
*** ukaynar has joined #openstack-sahara | 21:52 | |
*** esikachev has quit IRC | 21:56 | |
*** jamielennox is now known as jamielennox|away | 22:09 | |
*** abalutoiu has quit IRC | 22:35 | |
*** ukaynar has quit IRC | 22:56 | |
*** egafford has quit IRC | 23:03 | |
*** witlessb has quit IRC | 23:05 | |
*** ukaynar has joined #openstack-sahara | 23:23 | |
*** jamielennox|away is now known as jamielennox | 23:37 | |
*** tosky has quit IRC | 23:43 | |
*** chlong has quit IRC | 23:45 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!