| openstackgerrit | Takashi Kajinami proposed openstack/puppet-sahara master: setup.cfg: Replace dashes with underscores https://review.opendev.org/c/openstack/puppet-sahara/+/790627 | 00:51 |
|---|---|---|
| openstackgerrit | Merged openstack/puppet-sahara master: setup.cfg: Replace dashes with underscores https://review.opendev.org/c/openstack/puppet-sahara/+/790627 | 01:07 |
| *** Bhujay has joined #openstack-sahara | 03:12 | |
| Bhujay | Hi ALL, couple of years back I had a pilot roll out of sahara in my org which worked to some extent to deploy HDP cluster. Few days back our team discovered that the cluster creation fails since HDP/CDH have changed their policy to access their repos freely . Just wanted to check quickly if the latest versions of sahara have taken care of such issues ? it will be great help to know from you before you we give effort and venture to upgrade the | 04:29 |
| Bhujay | whole stack ? | 04:29 |
| Bhujay | By issues I mean - is it capable to deploy key components of hadoop and spark without depending on any commercial repos | 04:31 |
| *** tosky has joined #openstack-sahara | 07:18 | |
| openstackgerrit | zhongshengping proposed openstack/puppet-sahara master: Prepare Xena M1 https://review.opendev.org/c/openstack/puppet-sahara/+/793315 | 07:53 |
| *** hoonetorg has quit IRC | 11:05 | |
| *** hoonetorg has joined #openstack-sahara | 11:58 | |
| openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_sahara master: Fix linters https://review.opendev.org/c/openstack/openstack-ansible-os_sahara/+/792241 | 13:13 |
| jeremyfreudberg | Hi Bhujay I remember you well | 13:57 |
| jeremyfreudberg | Unfortunately the situation is not good with CDH/HDP | 13:57 |
| jeremyfreudberg | HDP and CDH 6.x (and 5.x) are all nearly end-of-life | 13:58 |
| jeremyfreudberg | There is new CDP product offering from Cloudera, but they have much more control over the deploy (including integration with Kubernetes) so Sahara is not really a good fit | 13:59 |
| jeremyfreudberg | You can try the Sahara vanilla plugin (or spark plugin), but they are both very basic and especially the spark plugin does not really deploy according to best practices | 14:00 |
| jeremyfreudberg | If you are a paying customer for CDH/HDP, then maybe you can work on adding support for authentication for access to repos, but we don't have that feature now in Sahara | 14:00 |
| jeremyfreudberg | I am not on IRC much, you can email me at <my nickname> AT gmail | 14:01 |
| Bhujay | thanks jeremyfreudberg | 14:08 |
| jeremyfreudberg | I was trying to talk to some folks about how to setup custom repos to work with Ambari but the conversations are stalled | 14:10 |
| tosky | jeremyfreudberg: uh, as you around: we may have to ask Sergey Lukjanov to release the twin channel on the other network that can't be named | 14:16 |
| tosky | as it's one of the few that's it's not owned by opendev people | 14:16 |
| openstackgerrit | Merged openstack/puppet-sahara master: Get rid of the $pyvers variable https://review.opendev.org/c/openstack/puppet-sahara/+/792584 | 14:16 |
| jeremyfreudberg | tosky: Yes, I thought infra was trying to contact him | 14:16 |
| tosky | oh, ok, I may have missed that | 14:16 |
| tosky | jeremyfreudberg: do you think it's better to double check with infra? | 14:17 |
| jeremyfreudberg | tosky: on friday last week fungi was going to email him | 14:18 |
| jeremyfreudberg | i don't know what the result was | 14:18 |
| tosky | jeremyfreudberg: ack, thanks | 14:18 |
| jeremyfreudberg | tosky: i'll be afk soon and then for several days, if something related to irc needs action from the sahara team, i trust you to handle it | 14:21 |
| Bhujay | there is so much demand for Bigdata / ML/AI and that way Sahara should have been the most exciting project. Only thing it should match features like Azure Data Lake and AWS Sagemaker. I sincerely hope the community come forward to make that happen | 14:23 |
| *** Bhujay has quit IRC | 14:25 | |
| *** Bhujay has joined #openstack-sahara | 14:32 | |
| tosky | hoping that we will have a channel :) | 14:45 |
| *** Bhujay has quit IRC | 16:40 | |
| *** tosky has quit IRC | 23:12 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!