| openstackgerrit | Anand Shanmugam proposed openstack/sahara: Fixed typo of precendence to precedence https://review.openstack.org/284394 | 00:59 |
|---|---|---|
| *** links has joined #openstack-sahara | 02:47 | |
| *** crobertsrh has joined #openstack-sahara | 03:15 | |
| *** links has quit IRC | 03:34 | |
| *** chlong_ has quit IRC | 03:47 | |
| *** chlong_ has joined #openstack-sahara | 03:49 | |
| *** links has joined #openstack-sahara | 04:29 | |
| *** sgotliv has joined #openstack-sahara | 05:23 | |
| *** Poornima has joined #openstack-sahara | 05:30 | |
| *** nkrinner has joined #openstack-sahara | 05:58 | |
| openstackgerrit | Jaxon Wang proposed openstack/sahara-specs: Add new spec for NFS-as-a-data-source blueprint https://review.openstack.org/210839 | 06:28 |
| *** Poornima has quit IRC | 06:37 | |
| *** Poornima has joined #openstack-sahara | 06:39 | |
| *** dave-mccowan has quit IRC | 06:45 | |
| openstackgerrit | Georgy Dyuldin proposed openstack/sahara-dashboard: Add test 'cluster create-delete with fake plugin' https://review.openstack.org/272558 | 07:48 |
| *** vgridnev has joined #openstack-sahara | 07:50 | |
| *** Poornima has quit IRC | 07:51 | |
| *** Poornima has joined #openstack-sahara | 07:52 | |
| openstackgerrit | Georgy Dyuldin proposed openstack/sahara-dashboard: Add test 'cluster create-delete with fake plugin' https://review.openstack.org/272558 | 08:02 |
| *** esikachev_afk is now known as esikachev | 08:14 | |
| *** edisonxiang has joined #openstack-sahara | 08:28 | |
| edisonxiang | Hello guys, i have a question about the sahara-dashboard. | 08:29 |
| edisonxiang | sahara_dashboard\enabled\_1810_data_processing_panel_group.py | 08:29 |
| edisonxiang | sahara_dashboard\enabled\_1820_data_processing_clusters_panel.py | 08:30 |
| edisonxiang | Does the above numbers(1810,1820) have some special meanings? | 08:32 |
| edisonxiang | Thanks in advance. | 08:32 |
| * esikachev is now away: Away from keyboard | 08:32 | |
| *** esikachev is now known as esikachev_afk | 08:32 | |
| *** witlessb has joined #openstack-sahara | 09:01 | |
| vgridnev | edisonxiang, hi | 09:09 |
| vgridnev | no, actually | 09:09 |
| vgridnev | but we use _18 as a prefix for our enabled files to avoid conflicts with other dashboard plugins | 09:10 |
| edisonxiang | <vgridnev>:Oh. | 09:11 |
| vgridnev | edisonxiang, are there some problems with that? | 09:12 |
| edisonxiang | <vgridnev>:i find 1610,1620 and 1910,1920 in the horizon/openstack_dashboard/enabled folder | 09:12 |
| openstackgerrit | Nikita Konovalov proposed openstack/sahara: HA for NameNode and ResourceManager in HDP 2.2 https://review.openstack.org/197551 | 09:12 |
| edisonxiang | <vgridnev>: i think you are right | 09:12 |
| edisonxiang | i want to add a new dashboard project into horizon | 09:13 |
| edisonxiang | i think sahara is a very good example. | 09:13 |
| edisonxiang | <vgridnev>:thank you. | 09:14 |
| vgridnev | edisonxiang, also you can ask some help in openstack-horizon channel, if you need some help with plugin system, for example | 09:15 |
| edisonxiang | <vgridnev> yeah.:-) | 09:16 |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara-tests: Add ability export results to file https://review.openstack.org/284611 | 09:30 |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara-tests: Adding ability use default templates https://review.openstack.org/280225 | 09:37 |
| *** esikachev has joined #openstack-sahara | 09:45 | |
| openstackgerrit | Nikita Konovalov proposed openstack/sahara: HA for NameNode and ResourceManager in HDP 2.2 https://review.openstack.org/197551 | 09:53 |
| *** sabiya has joined #openstack-sahara | 09:56 | |
| *** sabiya has quit IRC | 09:57 | |
| *** esikachev has quit IRC | 09:58 | |
| *** esikachev has joined #openstack-sahara | 10:00 | |
| *** Akanksha08 has joined #openstack-sahara | 10:07 | |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara-tests: Add ability export results to file https://review.openstack.org/284611 | 10:17 |
| *** tosky has joined #openstack-sahara | 10:27 | |
| *** tosky has quit IRC | 10:29 | |
| *** _degorenko|afk is now known as degorenko | 10:30 | |
| *** tosky has joined #openstack-sahara | 10:31 | |
| openstackgerrit | lu huichun proposed openstack/sahara: Add release note for suspend EDP job https://review.openstack.org/284636 | 10:38 |
| *** pcaruana has joined #openstack-sahara | 10:42 | |
| *** Akanksha08 has quit IRC | 11:03 | |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara-tests: Fix scenario tests for correct output to swift https://review.openstack.org/276624 | 11:32 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: split cloudera health checks https://review.openstack.org/284653 | 11:36 |
| *** akuznetsov has joined #openstack-sahara | 12:07 | |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara-tests: Add Hive jobs for CDH and Ambari job https://review.openstack.org/280701 | 12:22 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: split cloudera health checks https://review.openstack.org/284653 | 12:27 |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara-tests: Add ability export results to file https://review.openstack.org/284611 | 12:31 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: ambari health check implementation https://review.openstack.org/280203 | 12:35 |
| *** raildo-afk is now known as raildo | 12:37 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: ambari health check implementation https://review.openstack.org/280203 | 12:38 |
| openstackgerrit | Andrey Pavlov proposed openstack/sahara: Making health verification periodics distributed https://review.openstack.org/284688 | 12:42 |
| *** AndreyPavlov has joined #openstack-sahara | 12:44 | |
| openstackgerrit | Nikita Konovalov proposed openstack/sahara-dashboard: Use oslo timeutils for durations https://review.openstack.org/284697 | 12:48 |
| *** pcaruana has quit IRC | 12:55 | |
| *** dave-mccowan has joined #openstack-sahara | 12:56 | |
| *** akuznetsov has quit IRC | 12:56 | |
| *** vgridnev has quit IRC | 13:07 | |
| *** pcaruana has joined #openstack-sahara | 13:09 | |
| *** vgridnev has joined #openstack-sahara | 13:12 | |
| openstackgerrit | Nikita Konovalov proposed openstack/sahara-dashboard: Job duration column added https://review.openstack.org/273981 | 13:14 |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara-ci-config: Migrate to heat-engine and neutron https://review.openstack.org/284716 | 13:22 |
| *** links has quit IRC | 13:26 | |
| *** Akanksha08 has joined #openstack-sahara | 13:39 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: enable ambari plugin by default https://review.openstack.org/284719 | 13:48 |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara-tests: Add ability export results to file https://review.openstack.org/284611 | 13:49 |
| *** tmckay has joined #openstack-sahara | 13:50 | |
| vgridnev | tmckay, hi! I just saw your -1 in here: https://review.openstack.org/#/c/193081/ . Actually, I agree, that exception message can be better. But since we are moving to feature freeze soon, and I think that we can file bug to improve exception message and fix this bug in rc1. Also, I have some ideas to enable ambari by default, but I think that there is a strict requirement that plugin should support scaling at least. | 13:54 |
| vgridnev | Thoughts? | 13:55 |
| tmckay | vgridnev, okay, sounds fine to me | 13:55 |
| *** weiting has joined #openstack-sahara | 13:55 | |
| *** Poornima has quit IRC | 13:55 | |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara-tests: Fix scenario tests for correct output to swift https://review.openstack.org/276624 | 13:55 |
| elmiko | don't forget, meeting in 5 minutes in #openstack-meeting-3 | 13:56 |
| vgridnev | elmiko, yeah, sure | 13:56 |
| openstackgerrit | Nikita Konovalov proposed openstack/sahara-dashboard: Job duration column added https://review.openstack.org/273981 | 14:00 |
| openstackgerrit | Nikita Konovalov proposed openstack/sahara-dashboard: Use oslo timeutils for durations https://review.openstack.org/284697 | 14:00 |
| *** vgridnev has quit IRC | 14:04 | |
| *** vgridnev has joined #openstack-sahara | 14:04 | |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara-ci-config: Migrate to heat-engine and neutron https://review.openstack.org/284716 | 14:07 |
| *** links has joined #openstack-sahara | 14:07 | |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara-tests: Add ability export results to file https://review.openstack.org/284611 | 14:19 |
| elmiko | tmckay: i don't have strong feelings either way about it | 15:00 |
| tmckay | yeah, I was trying to come up with a way to eliminate the credential problem | 15:01 |
| elmiko | i mean, i can see some might complain about having to add another service to their stack | 15:01 |
| tmckay | one option is just to drop swift support altogether, since we have manila and external hdfs | 15:01 |
| elmiko | imo, the credential issue needs to be solved on a larger scale | 15:01 |
| tmckay | but then I thought, hey, manila could write to swift, why not? There is an app out there called swift commander (posted at summit, open source, from a user) that does a good job of making swift look like an actual filesystem | 15:02 |
| elmiko | overcloud applications are going to want to interact with the cloud services. we will always have a need for some sort of credentialled access from there. | 15:02 |
| tmckay | elmiko, true | 15:02 |
| elmiko | oh man, so you have to install manilla, then an app on top of manilla to make this work? | 15:02 |
| elmiko | i think it sounds cool as an option, but should we push it as the main path for swift inclusion? i'm not sure | 15:02 |
| crobertsrh | Yeah, not sure it would be well-received. | 15:03 |
| tosky | tmckay: what is the difference between Swift and Manila for the credentials? When you write the results to a Manila share, how is authentication handled? | 15:04 |
| tosky | I thought the problem was the same | 15:04 |
| tmckay | elmiko, well, it would just be a manila driver. I am cloud-gazing here, haven't really looked into it | 15:04 |
| tmckay | tosky, so manila does acl by ip | 15:04 |
| elmiko | tmckay: for sure, and don't take my criticism as a slam against it. i'm trying to understand the whole issue more thoroughly =) | 15:05 |
| tmckay | tosky, today, hadoop doesn't need anything at all to write to a manila nfs share as a local filesystem | 15:05 |
| tmckay | if a local filesystem was mapped to swift by manila, the authentication could be set up on the openstack side | 15:05 |
| tmckay | elmiko, none taken :) it was a snack-inspired concept. Cookies, and manila ... | 15:06 |
| tosky | because the manila share it's a local filesystem from its point of view, uhm, you moved the problem somewhere else | 15:06 |
| tosky | i see | 15:06 |
| tmckay | tosky, the whole issue is shoe-horning hadoop into an authentication system it wasn't designed for | 15:06 |
| tmckay | my other idea is to ask the swift guys for "expire on demand" temporary URLs | 15:06 |
| tosky | I think we already had this discussion: what does hadoop support? | 15:06 |
| tmckay | I mentioned that quite a long time ago but we never pursued it | 15:06 |
| tmckay | tosky, not sure. maybe there is an auth system for hadoop we could work with. imho, we should find a solution where we don't have to mess with jars carried by sahara (or maintained by us in hadoop) | 15:08 |
| tosky | fine, but then I would start from checking what hadoop support | 15:08 |
| tmckay | and elmiko has a point, we need an openstack-wide solution for credentials/auth from apps layered on openstack and running in vms | 15:08 |
| *** weiting has quit IRC | 15:08 | |
| tmckay | tosky, ack. I just started thinking about this after running jobs with rickflare :) | 15:09 |
| *** vgridnev has quit IRC | 15:09 | |
| tmckay | ok, commute time | 15:11 |
| *** links has quit IRC | 15:12 | |
| *** nkrinner has quit IRC | 15:16 | |
| *** hid-kanetoshi has joined #openstack-sahara | 15:16 | |
| *** vgridnev has joined #openstack-sahara | 15:18 | |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara-tests: Add ability export results to file https://review.openstack.org/284611 | 15:20 |
| *** tmckay has quit IRC | 15:22 | |
| *** Haomeng|2 has joined #openstack-sahara | 15:24 | |
| *** vgridnev has quit IRC | 15:25 | |
| *** vgridnev has joined #openstack-sahara | 15:26 | |
| *** Haomeng has quit IRC | 15:26 | |
| *** hid-kanetoshi has quit IRC | 15:27 | |
| crobertsrh | Can we get another +2 on https://review.openstack.org/#/c/283710/ I think they want to get moving on translation. | 15:30 |
| elmiko | crobertsrh: i upgrade my +1 to a +2 | 15:35 |
| crobertsrh | gracias | 15:35 |
| elmiko | ah, and vgridnev added +2/+W | 15:35 |
| crobertsrh | Heh I even gave it another +W....seriously getting merged now | 15:36 |
| vgridnev | simultaneous approves | 15:36 |
| elmiko | hehe | 15:36 |
| vgridnev | elmiko, like in apiv2 | 15:36 |
| elmiko | haha, yea! | 15:37 |
| openstackgerrit | Merged openstack/sahara-dashboard: Ensure to compile translation catalogs https://review.openstack.org/283710 | 15:37 |
| elmiko | it's like "merge with force" | 15:37 |
| pino|work | --use-the-force-luke (really existing in cdrdao or cdrecord or one of these) | 15:38 |
| elmiko | wow, that's awesome | 15:38 |
| openstackgerrit | Merged openstack/sahara: Fixed typo of precendence to precedence https://review.openstack.org/284394 | 15:53 |
| *** vgridnev has quit IRC | 15:55 | |
| openstackgerrit | Merged openstack/sahara: add initial v2 api https://review.openstack.org/273316 | 16:02 |
| *** esikachev has quit IRC | 16:10 | |
| elmiko | \o/ | 16:11 |
| tosky | \o/ | 16:11 |
| tosky | now, tests | 16:11 |
| * tosky hides | 16:11 | |
| *** AndreyPavlov has quit IRC | 16:14 | |
| elmiko | tosky: nice... ;) | 16:15 |
| *** tmckay has joined #openstack-sahara | 16:15 | |
| *** AndreyPavlov has joined #openstack-sahara | 16:28 | |
| openstackgerrit | Merged openstack/sahara: Added scaling support for HDP 2.2 / 2.3 https://review.openstack.org/193081 | 16:37 |
| *** apavlov has joined #openstack-sahara | 16:38 | |
| *** sgotliv has quit IRC | 16:39 | |
| *** AndreyPavlov has quit IRC | 16:39 | |
| *** vgridnev has joined #openstack-sahara | 16:41 | |
| *** Akanksha08_ has joined #openstack-sahara | 16:47 | |
| openstackgerrit | Merged openstack/sahara: Fix E005 bashate error https://review.openstack.org/283705 | 16:48 |
| openstackgerrit | Akanksha Agrawal proposed openstack/sahara-specs: Spec about improving anti-affinity behavior in sahara https://review.openstack.org/269202 | 17:11 |
| tmckay | vgridnev, ping | 17:13 |
| vgridnev | tmckay, pong | 17:14 |
| tmckay | vgridnev, hey there. If someone calls "get_heath_checks()" on cdh version 5.3.0, where is it going to fail, or return an empty list? I'm missing it. | 17:15 |
| tmckay | in the old version, default was a [] | 17:15 |
| tmckay | but now it dispatches from abstract version handler | 17:15 |
| tmckay | what am I missing? | 17:15 |
| vgridnev | tmckay, It will return a list of health checks, but none of them will be runned, because of is_available method | 17:16 |
| tmckay | ah, I see. okay | 17:16 |
| tmckay | vgridnev, thanks | 17:17 |
| vgridnev | https://github.com/openstack/sahara/blob/master/sahara/service/health/health_check_base.py#L101 | 17:17 |
| *** edisonxiang has quit IRC | 17:20 | |
| *** edisonxiang has joined #openstack-sahara | 17:20 | |
| openstackgerrit | Luigi Toscano proposed openstack/sahara-tests: Use ostestr instead of the custom pretty_tox.sh https://review.openstack.org/284831 | 17:30 |
| *** tellesnobrega_af is now known as tellesnobrega | 17:37 | |
| *** vgridnev has quit IRC | 17:50 | |
| *** tosky has quit IRC | 17:56 | |
| *** degorenko is now known as _degorenko|afk | 18:04 | |
| *** vgridnev has joined #openstack-sahara | 18:07 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: split cloudera health checks https://review.openstack.org/284653 | 18:11 |
| *** vgridnev has quit IRC | 18:12 | |
| *** vgridnev has joined #openstack-sahara | 18:39 | |
| *** Haomeng has joined #openstack-sahara | 18:50 | |
| *** Haomeng|2 has quit IRC | 18:52 | |
| *** Akanksha08_ has quit IRC | 18:53 | |
| *** Akanksha08_ has joined #openstack-sahara | 19:05 | |
| openstackgerrit | Chad Roberts proposed openstack/sahara: Updating dashboard user guide post-reorg https://review.openstack.org/284886 | 19:15 |
| *** vgridnev has quit IRC | 19:15 | |
| *** Akanksha08_ has quit IRC | 19:16 | |
| *** vgridnev has joined #openstack-sahara | 19:17 | |
| openstackgerrit | Chad Roberts proposed openstack/sahara: Updating dashboard user guide post-reorg https://review.openstack.org/284886 | 19:20 |
| *** vgridnev has quit IRC | 19:41 | |
| *** vgridnev has joined #openstack-sahara | 19:47 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: split cloudera health checks https://review.openstack.org/284653 | 19:49 |
| *** krotscheck is now known as krotscheck_dcm | 19:50 | |
| *** vgridnev has quit IRC | 19:55 | |
| *** vgridnev has joined #openstack-sahara | 19:58 | |
| *** vgridnev has quit IRC | 20:00 | |
| *** vgridnev has joined #openstack-sahara | 20:07 | |
| *** vgridnev has quit IRC | 20:10 | |
| *** vgridnev has joined #openstack-sahara | 20:11 | |
| *** esikachev has joined #openstack-sahara | 20:16 | |
| openstackgerrit | Merged openstack/sahara-dashboard: Add missing duplicated action buttons https://review.openstack.org/282657 | 20:20 |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara-tests: Add ability export results to file https://review.openstack.org/284611 | 20:36 |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara-tests: Add ability export results to file https://review.openstack.org/284611 | 20:36 |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara-tests: Disable ssl_verify as default https://review.openstack.org/280762 | 20:39 |
| *** _degorenko|afk has quit IRC | 20:42 | |
| *** apavlov has quit IRC | 20:42 | |
| *** _degorenko|afk has joined #openstack-sahara | 20:43 | |
| openstackgerrit | Michael McCune proposed openstack/sahara: remove hdp from the default plugin list https://review.openstack.org/284922 | 20:45 |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara-tests: Add Hive jobs for CDH and Ambari job https://review.openstack.org/280701 | 20:52 |
| *** vgridnev has quit IRC | 20:53 | |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara-tests: Adding ability use default templates https://review.openstack.org/280225 | 20:55 |
| *** raildo is now known as raildo-afk | 21:04 | |
| rickflare | hey folks | 21:23 |
| rickflare | man the last two day have been horrible | 21:23 |
| elmiko | =( | 21:25 |
| rickflare | ive been so swamped with stuff I really dont want to do | 21:32 |
| *** esikachev has quit IRC | 21:32 | |
| rickflare | how are you | 21:33 |
| elmiko | pretty busy | 21:33 |
| elmiko | but otherwise well =) | 21:33 |
| rickflare | good | 21:34 |
| crobertsrh | Howdy | 21:35 |
| *** sgotliv has joined #openstack-sahara | 21:41 | |
| *** crobertsrh is now known as _crobertsrh | 21:49 | |
| tmckay | sgotliv, hey there :) | 21:50 |
| sgotliv | tmckay, hey | 21:51 |
| openstackgerrit | Luigi Toscano proposed openstack/sahara: Use ostestr instead of the custom pretty_tox.sh https://review.openstack.org/284951 | 21:55 |
| rickflare | im getting pumped for the summit | 22:03 |
| rickflare | I am going to try my horton works cluster again tonight | 22:03 |
| *** tellesnobrega is now known as tellesnobrega_af | 22:05 | |
| tmckay | rickflare, good luck with that. You could try the ambari plugin, too -- newer version of the hdp stuff. you just have to enable the plugin in sahara.conf | 22:06 |
| tmckay | I gotta run .. see you all tomorrow | 22:06 |
| *** tmckay has left #openstack-sahara | 22:06 | |
| *** tellesnobrega_af is now known as tellesnobrega | 22:25 | |
| *** witlessb has quit IRC | 22:40 | |
| *** sgotliv has quit IRC | 23:42 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!