| openstackgerrit | kaka proposed openstack/sahara master: fix a typo https://review.openstack.org/573075 | 03:00 |
|---|---|---|
| *** Bhujay has joined #openstack-sahara | 03:28 | |
| *** links has joined #openstack-sahara | 04:28 | |
| *** pgadiya has joined #openstack-sahara | 05:08 | |
| *** pgadiya has quit IRC | 05:08 | |
| *** e0ne has joined #openstack-sahara | 05:23 | |
| *** e0ne has quit IRC | 05:25 | |
| *** Bhujay has quit IRC | 05:28 | |
| *** e0ne has joined #openstack-sahara | 06:31 | |
| *** pcaruana has joined #openstack-sahara | 06:35 | |
| *** e0ne has quit IRC | 06:41 | |
| openstackgerrit | kaka proposed openstack/sahara master: Updated oozie version https://review.openstack.org/573104 | 06:55 |
| *** e0ne has joined #openstack-sahara | 07:10 | |
| *** e0ne has quit IRC | 07:11 | |
| *** tosky has joined #openstack-sahara | 07:26 | |
| zigo | I'm still stuck with sahara-wsgi-api spitting a 500 error: http://paste.openstack.org/show/722857/ | 08:29 |
| zigo | What can I do to investigate? | 08:29 |
| zigo | Stairing at the code didn't help, I don't get what's happening. | 08:31 |
| tosky | I can't help - I will defer to the other developers which will connect later | 08:32 |
| zigo | tosky: Who should I ask? | 08:33 |
| zigo | This seems to be flask framework related. | 08:33 |
| tosky | sadly the people who implemented wsgi support are not around; I know that it works with apache (that's how it's configured by devstack) | 08:33 |
| zigo | Looks like it can't find the content-length or something. | 08:33 |
| zigo | tosky: The same happens with eventlet. | 08:33 |
| zigo | It could be Py3 related, not sure. | 08:33 |
| tosky | maybe, but not sure we want to support eventlet with py3 | 08:34 |
| zigo | (Debian packages are all switched to Py3) | 08:34 |
| zigo | tosky: It doesn't work over SSL, which is why I switched to uwsgi, but then I get the same error. | 08:34 |
| zigo | flask.request.content_length doesn't exist when the size is checked. | 08:35 |
| zigo | So, it looks like flask request handling is broken for me. | 08:36 |
| *** Bhujay has joined #openstack-sahara | 08:39 | |
| *** Bhujay has quit IRC | 09:06 | |
| openstackgerrit | kaka proposed openstack/sahara master: Updated oozie version https://review.openstack.org/573104 | 09:28 |
| *** links has quit IRC | 09:48 | |
| *** e0ne has joined #openstack-sahara | 09:56 | |
| *** links has joined #openstack-sahara | 10:05 | |
| zigo | tosky: Here's my patch, your thoughts? https://salsa.debian.org/openstack-team/services/sahara/blob/debian/queens/debian/patches/fix-flask.request.content_length-is-none-in-sahara-api.patch | 10:10 |
| *** links has quit IRC | 10:39 | |
| openstackgerrit | Thomas Goirand proposed openstack/sahara master: Fix flask.request.content_length is None https://review.openstack.org/573179 | 10:51 |
| *** links has joined #openstack-sahara | 10:56 | |
| openstackgerrit | Telles Mota Vidal Nóbrega proposed openstack/sahara master: Boot from volume https://review.openstack.org/385053 | 11:23 |
| openstackgerrit | Luigi Toscano proposed openstack/sahara master: fix tox python3 overrides https://review.openstack.org/572978 | 11:32 |
| tellesnobrega | tosky, apparently cdh problem is a missing mysql connector | 11:59 |
| tellesnobrega | not sure yet | 12:00 |
| tosky | tellesnobrega: uhm, full log needed :) | 12:13 |
| *** dave-mccowan has joined #openstack-sahara | 12:14 | |
| *** dave-mcc_ has joined #openstack-sahara | 12:15 | |
| tellesnobrega | tosky, http://paste.openstack.org/show/722876/ | 12:16 |
| tellesnobrega | and I found this https://community.cloudera.com/t5/Cloudera-Manager-Installation/Cloudera-Manager-Installation-Path-B-Step-5-sudo-service/td-p/7816 | 12:17 |
| tellesnobrega | but not sure the solution is correct | 12:18 |
| *** dave-mccowan has quit IRC | 12:18 | |
| tosky | tellesnobrega: did you see this? https://community.cloudera.com/t5/Cloudera-Manager-Installation/ERROR-main-com-cloudera-server-cmf-Main-Server-failed/m-p/42654 | 12:20 |
| tosky | well, there are many instances of that error on community.cloudera.com | 12:21 |
| tosky | what do you see in /etc/cloudera-scm-server/db.properties ? | 12:21 |
| tellesnobrega | there is plenty | 12:22 |
| tellesnobrega | mysql | 12:22 |
| tellesnobrega | should it be something else? | 12:22 |
| tellesnobrega | hmm, apparently we use postgres with cloudera | 12:23 |
| tosky | yep | 12:23 |
| tellesnobrega | let me change that | 12:24 |
| tosky | tellesnobrega: this is what I have on a local deployment, and please note the Auto-generated by comment: http://paste.openstack.org/show/722877/ | 12:24 |
| tellesnobrega | awesome | 12:25 |
| tellesnobrega | thanks | 12:25 |
| tosky | I'm trying to understand how calls that script | 12:27 |
| tellesnobrega | thanks | 12:29 |
| tellesnobrega | error changed | 12:29 |
| tellesnobrega | now it is only connection refused | 12:29 |
| tosky | so the db is not initialized or it is initialized but you don't have the correct credentials | 12:30 |
| tellesnobrega | yes | 12:30 |
| tosky | the question is: which component calls initialize_embedded_db.sh ? | 12:30 |
| tosky | it's called by /etc/init.d/cloudera-scm-server-db start | 12:32 |
| tellesnobrega | apparently it is running | 12:32 |
| tosky | which, if I'm not mistaken, should be started during the initialization process | 12:32 |
| tellesnobrega | yes, but I didn't start a cluster just started a instance with cloudera on it | 12:33 |
| tellesnobrega | and now it is running | 12:33 |
| tosky | oh | 12:33 |
| tosky | ok, so yeah, you need to start it before cloudera-scm-server | 12:33 |
| tellesnobrega | thanks | 12:33 |
| tellesnobrega | you would think it would be smart enough to start on its own | 12:34 |
| tellesnobrega | but guess not | 12:34 |
| tosky | they split it into two separate services, probably there is some reason | 12:34 |
| tosky | like running the db and the manager on different systems | 12:35 |
| tellesnobrega | probably | 12:35 |
| tellesnobrega | installing cdh now | 12:39 |
| tellesnobrega | tosky, on other front, I think I figure the issue with db sync problem | 12:40 |
| tosky | the default value for null? | 12:42 |
| tellesnobrega | yes | 12:42 |
| tellesnobrega | it was set on the models but not on the migration | 12:42 |
| tellesnobrega | actually, not default value for null | 12:42 |
| tellesnobrega | if it can be nullable or not | 12:42 |
| tellesnobrega | default value is false | 12:42 |
| tosky | I noticed that "True, False" as last parameters, but I thought it was the default value | 12:42 |
| tosky | not the field allowing null or not | 12:43 |
| tellesnobrega | tosky, had a minor pep8 problem | 12:50 |
| openstackgerrit | Telles Mota Vidal Nóbrega proposed openstack/sahara master: Boot from volume https://review.openstack.org/385053 | 12:50 |
| tellesnobrega | not boot from volume is fine on the sahara side | 12:50 |
| tosky | with documentation? | 12:51 |
| tosky | oh, remember also the Task: footer in the commit message, or it won't be closed automatically | 12:52 |
| *** rcernin has quit IRC | 12:56 | |
| tellesnobrega | will update | 12:59 |
| tellesnobrega | not docs yet | 12:59 |
| tellesnobrega | do you have a suggested place to put it? | 13:01 |
| tellesnobrega | I'm thinking user/quickstart | 13:02 |
| tosky | in the place where we document how to create a cluster | 13:02 |
| tellesnobrega | I guess that is the one then | 13:02 |
| *** jeremyfreudberg has joined #openstack-sahara | 13:21 | |
| tellesnobrega | jeremyfreudberg, cdh install is working | 13:29 |
| tellesnobrega | now installing services | 13:29 |
| jeremyfreudberg | tellesnobrega: you mean the manual part? | 13:30 |
| tellesnobrega | yes | 13:30 |
| tellesnobrega | but it just failed | 13:30 |
| jeremyfreudberg | tellesnobrega: the error is? | 13:31 |
| tellesnobrega | Can't open /run/cloudera-scm-agent/process/ccdeploy_spark-conf_etcsparkconf.cloudera.spark_on_yarn_3570090449422232286/spark-conf/hive-env.sh: No such file or directory. | 13:31 |
| tellesnobrega | /usr/lib/cmf/service/client/deploy-cc.sh: line 193: /run/cloudera-scm-agent/process/ccdeploy_spark-conf_etcsparkconf.cloudera.spark_on_yarn_3570090449422232286/scripts/control.sh: Permission denied | 13:32 |
| tellesnobrega | I would assume that it is trying to create the folder | 13:32 |
| tellesnobrega | but the user has no permissions here | 13:32 |
| tellesnobrega | I can change that | 13:32 |
| jeremyfreudberg | i can't say that i've encountered anything like it before | 13:34 |
| jeremyfreudberg | and i do see someone with the same problem -- but answered: https://community.cloudera.com/t5/Cloudera-Manager-Installation/Permission-Denied-error-5-13-installation/m-p/61641 | 13:34 |
| tellesnobrega | did you run with root? | 13:34 |
| *** openstackgerrit has quit IRC | 13:34 | |
| jeremyfreudberg | can't remember | 13:34 |
| jeremyfreudberg | tellesnobrega: just saw Cloudera folks came out with this https://www.cloudera.com/downloads/quickstart_vms/5-13.html.html | 13:38 |
| tellesnobrega | can we use that and run sahara stuff on it to get configs? | 13:38 |
| jeremyfreudberg | tellesnobrega: jup, i think trying to grab the configs from there is worth a try | 13:39 |
| tellesnobrega | will try iy | 13:39 |
| tellesnobrega | it | 13:39 |
| *** dave-mcc_ has quit IRC | 13:41 | |
| tellesnobrega | and by that I mean | 13:41 |
| tellesnobrega | please can any of you try it | 13:41 |
| tellesnobrega | It won't download here until hell freezes over | 13:41 |
| *** dave-mccowan has joined #openstack-sahara | 13:43 | |
| jeremyfreudberg | yup, downloading now | 13:43 |
| *** dave-mccowan has quit IRC | 13:46 | |
| *** dave-mccowan has joined #openstack-sahara | 13:48 | |
| jeremyfreudberg | ugh, it just got 5.1G/5.4G then died | 13:48 |
| tellesnobrega | it would take about 8h here | 13:50 |
| tellesnobrega | and probably die as well | 13:50 |
| tellesnobrega | jeremyfreudberg, do you remember installing oracle or just used installed java | 13:50 |
| *** dave-mcc_ has joined #openstack-sahara | 13:50 | |
| *** zchkun has joined #openstack-sahara | 13:50 | |
| jeremyfreudberg | tellesnobrega: definitely not oracle | 13:50 |
| *** dave-mccowan has quit IRC | 13:53 | |
| *** Bhujay has joined #openstack-sahara | 13:58 | |
| tosky | tellesnobrega, jeremyfreudberg : iirc only oracle java is supported by CDH | 14:00 |
| jeremyfreudberg | tosky: then i meant, the installed java | 14:00 |
| tosky | https://www.cloudera.com/documentation/enterprise/release-notes/topics/rn_consolidated_pcm.html#pcm_jdk | 14:00 |
| tellesnobrega | yes, but we don't need it by default I guess | 14:00 |
| *** links has quit IRC | 14:23 | |
| *** openstackgerrit has joined #openstack-sahara | 14:44 | |
| openstackgerrit | Chen proposed openstack/python-saharaclient master: Remove PyPI downloads https://review.openstack.org/573271 | 14:44 |
| *** zchkun has quit IRC | 14:51 | |
| -openstackstatus- NOTICE: Zuul update for Ansible 2.5 in progress. Scheduler crashed as unexpected side effect of pip upgrade. Will be back and running shortly. | 15:31 | |
| *** jeremyfreudberg has quit IRC | 15:33 | |
| -openstackstatus- NOTICE: The zuul upgrade to ansible 2.5 is complete and zuul is running again. Changes uploaded or approved between 15:25 and 15:45 will need to be rechecked. Please report any problems in #openstack-infra | 16:11 | |
| *** jeremyfreudberg has joined #openstack-sahara | 16:40 | |
| jeremyfreudberg | tellesnobrega: looks like the cdh config grabbing worked | 16:40 |
| tellesnobrega | awesome | 16:45 |
| tellesnobrega | jeremyfreudberg, can you send them to me? | 16:45 |
| jeremyfreudberg | actually, oops, it's not totally ready | 16:45 |
| jeremyfreudberg | there were a few services missed | 16:45 |
| tellesnobrega | no problem | 16:45 |
| tellesnobrega | like what? | 16:45 |
| tellesnobrega | I see that we don't have cloudera navigator, did we have that before? | 16:45 |
| tellesnobrega | I see that on my install | 16:45 |
| jeremyfreudberg | i missed the configs (json files) for flume, kafka, sentry | 16:46 |
| jeremyfreudberg | but i think i can fix that, just have to tweak some of the cloudera quickstart settings | 16:46 |
| tellesnobrega | cool | 16:46 |
| jeremyfreudberg | tellesnobrega: just navigator, or navigator keytrustee? | 16:46 |
| *** tellesnobrega has left #openstack-sahara | 16:46 | |
| *** tellesnobrega has joined #openstack-sahara | 16:47 | |
| jeremyfreudberg | tellesnobrega: just navigator, or navigator keytrustee? | 16:47 |
| tellesnobrega | keytrustee is out for sure | 16:47 |
| tellesnobrega | but navigator is only available on enterprise version or 60 days trial | 16:47 |
| jeremyfreudberg | i'm not sure if we ever had it | 16:47 |
| tellesnobrega | at least that is what I saw on my local env | 16:48 |
| jeremyfreudberg | i think missing navigator is fine | 16:48 |
| jeremyfreudberg | we actually never had it | 16:48 |
| tellesnobrega | cool | 16:48 |
| jeremyfreudberg | i'll let you know how it goes with the config stuff on my end | 16:48 |
| tellesnobrega | thanks | 16:48 |
| jeremyfreudberg | unfortunately i am already running out of time for today | 16:48 |
| jeremyfreudberg | but soon | 16:48 |
| tellesnobrega | if you can get the configs, I can work out the rest of the patch | 16:49 |
| tellesnobrega | I'm trying on my end too | 16:49 |
| jeremyfreudberg | awesome | 16:49 |
| *** jeremyfreudberg has quit IRC | 16:53 | |
| *** e0ne has quit IRC | 16:55 | |
| *** Bhujay has quit IRC | 17:27 | |
| *** openstackgerrit has quit IRC | 17:34 | |
| *** e0ne has joined #openstack-sahara | 17:57 | |
| *** openstackgerrit has joined #openstack-sahara | 18:12 | |
| openstackgerrit | Merged openstack/sahara master: fix tox python3 overrides https://review.openstack.org/572978 | 18:12 |
| *** e0ne has quit IRC | 18:43 | |
| *** e0ne has joined #openstack-sahara | 18:45 | |
| openstackgerrit | Telles Mota Vidal Nóbrega proposed openstack/python-saharaclient master: Adding boot from volume https://review.openstack.org/572536 | 18:58 |
| *** tmckay has joined #openstack-sahara | 20:15 | |
| *** e0ne has quit IRC | 20:32 | |
| *** e0ne has joined #openstack-sahara | 20:33 | |
| *** pcaruana has quit IRC | 20:39 | |
| *** e0ne has quit IRC | 20:44 | |
| *** e0ne has joined #openstack-sahara | 20:45 | |
| *** e0ne has quit IRC | 20:49 | |
| *** tmckay has left #openstack-sahara | 21:08 | |
| *** rcernin has joined #openstack-sahara | 22:24 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!