| *** jparrill has joined #ara | 06:47 | |
| -openstackstatus- NOTICE: Jobs in gate are failing with POST_FAILURE. Infra roots are investigating | 07:40 | |
| *** ChanServ changes topic to "Jobs in gate are failing with POST_FAILURE. Infra roots are investigating" | 07:40 | |
| *** karimb has joined #ara | 08:13 | |
| *** karimb has quit IRC | 08:17 | |
| -openstackstatus- NOTICE: logs.openstack.org has corrupted disks, it's being repaired. Please avoid rechecking until this is fixed | 08:20 | |
| *** ChanServ changes topic to "logs.openstack.org has corrupted disks, it's being repaired. Please avoid rechecking until this is fixed" | 08:20 | |
| *** karimb has joined #ara | 08:23 | |
| *** dmsimard|afk is now known as dmsimard | 12:41 | |
| dmsimard | _dev: hey, I've been knocked out and sick past 2 days, I'll look at it sometime today thanks for following up | 12:59 |
|---|---|---|
| *** jparrill has quit IRC | 13:52 | |
| *** tready has joined #ara | 15:12 | |
| tready | hey all - quick question about startup/ini. I've got a working server, but it seems that it's not creating the socket file on startup? | 15:14 |
| tready | here's my ini: https://pastebin.com/bg9BxS5M | 15:14 |
| tready | & here's my init script: https://pastebin.com/pPPSMvB0 | 15:14 |
| tready | the socket file is not currently in /tmp, & starting ara from the terminal, I get: bind(): No such file or directory [core/socket.c line 230] | 15:16 |
| tready | I'd thought the process would create the file, but apparently not....? | 15:16 |
| dmsimard | tready: hm, I'm not super familiar with uwsgi :( | 15:20 |
| dmsimard | tready: I guess you're not interested in using apache/mod_wsgi? | 15:20 |
| tready | ok. apparently it was the damned quotes. heh. | 15:21 |
| tready | nah, we've got an existing nginx install that I'm using | 15:21 |
| tready | long as you're here, I told you that I'd write up the nginx instructions - is that just a PR once done? | 15:21 |
| dmsimard | tready: oh yeah, I'd definitely love nginx+uwsgi docs | 15:21 |
| tready | I ask, b/c the "contributing" instructions seem way more involved | 15:22 |
| dmsimard | tready: Yeah, we don't use the github workflow, there's a few hoops to jump through to get started but after that it's easy -- I see you're already acquainted with the docs, yeah, that's how | 15:22 |
| tready | but I figured maybe just for documentation, the guidelines may not be as.... detailed. heh | 15:22 |
| dmsimard | tready: docs are in the source of the project so it's like code contribution :) | 15:23 |
| dmsimard | tready: I'd be happy to walk you through the process if you need a hand, otherwise I can commit on your behalf or something | 15:23 |
| *** tbielawa has joined #ara | 15:23 | |
| tready | ok, I'll get back to you once I get them written up. | 15:23 |
| tready | my instance is running again, btw :) | 15:23 |
| dmsimard | tready: awesome | 15:25 |
| tready | another, un-related question: we're recording a run that goes every 2hrs. it has 102 tasks, 16 hosts, & we now have 137 records of it | 15:27 |
| tready | digging into the reports lately produces just a spinning wheel | 15:27 |
| tready | is this just b/c the sqlite is struggling? | 15:27 |
| tready | also: is it possible to setup ara to run w/a postgresql back end? | 15:28 |
| dmsimard | tready: it looks like getting it to run with pgsql will need to wait until the next release (0.12.4) which will contain https://review.openstack.org/#/c/450948/ | 15:28 |
| dmsimard | but mysql is known to work out of the box | 15:29 |
| dmsimard | tready: how many playbooks are in each page right now ? | 15:29 |
| tready | 10 | 15:29 |
| tready | (reports, if that's what you're referring to) | 15:29 |
| dmsimard | The tables are loaded asynchronously sequentially from top to bottom | 15:29 |
| dmsimard | so i.e, as you load the reports page, you the first report will load first in the background but the one at the bottom might take a bit to display as the ones before it are loading | 15:30 |
| dmsimard | The only (known) reason why there'd be an endless spinning wheel is if the playbook has incomplete data (i.e, was interrupted or is in progress) | 15:31 |
| tready | ok. It doesn't seem to make a difference which record I try to access right now, unfortunately | 15:31 |
| tready | & these records are all marked success/complete | 15:31 |
| dmsimard | hm, spinning wheels everywhere ? | 15:32 |
| tready | unfortunately | 15:32 |
| tready | even clicking the 1st record, 1st action | 15:32 |
| dmsimard | so it might mean that the frontend is not able to do the AJAX calls to get the data that's meant to be in the tables | 15:32 |
| tready | hmmm... well it did work at one point | 15:33 |
| dmsimard | tready: if you open the developer tools/inspect thing of your browser, go to the network tab and reload the page -- are you seeing 404's or 500's ? | 15:33 |
| tready | nope, just 200's all the way down | 15:34 |
| dmsimard | tready: oh wait, you're running nginx you said ? | 15:34 |
| tready | correct | 15:34 |
| dmsimard | tready: there's an unreleased bugfix for that https://review.openstack.org/#/c/450965/ | 15:35 |
| tready | oh ho-hooooo!! | 15:35 |
| dmsimard | tready: I wanted to cut 0.12.4 this week but got sick and knocked out, there'll be a release candidate early next week as I fight with one last bug I want to fix | 15:36 |
| dmsimard | tready: in the meantime, you could run your application off of source/master branch | 15:36 |
| tready | ok | 15:36 |
| tready | I'll try the patch to see if it fixes the issue & let you know | 15:37 |
| dmsimard | tready: draft changelog for 0.12.4 is http://paste.openstack.org/raw/605086/ | 15:37 |
| _dev | dmsimard: Just got into the office and saw your message. No rush, hope you feel better. | 16:12 |
| *** karimb has quit IRC | 16:30 | |
| *** karimb has joined #ara | 16:32 | |
| *** karimb has quit IRC | 16:36 | |
| *** karimb has joined #ara | 16:45 | |
| tready | dmsimard - applied diff file, unfortunately, same symptoms persist | 18:11 |
| dmsimard | tready: endless spinning wheel ? | 18:11 |
| tready | correct | 18:11 |
| dmsimard | tready: not sure what else it could be, if you inspect the modal, do you see the link here with a trailing slash ? i.e, http://i.imgur.com/fk9S2dS.png | 18:17 |
| dmsimard | modal = little popup thing | 18:19 |
| tready | what's the tree for that? I'm not seeing it | 18:23 |
| tready | ok, I found it, I think | 18:24 |
| tready | forgot about the "inspect" part. heh | 18:24 |
| tready | I've got something a bit different. I guess b/c it isn't loading anything | 18:29 |
| tready | http://i.imgur.com/H0XugGp.png | 18:29 |
| dmsimard | tready: nah it's just a different popup, that looks right though | 18:29 |
| dmsimard | tready: this is pure nginx/uwsgi ? you said there was nothing ususual in nginx logs or developer console ? | 18:30 |
| tready | nothing I saw in dev console. lemme check the logs | 18:30 |
| tready | no, nothing in error log | 18:32 |
| dmsimard | tready: what about uwsgi logs ? | 18:32 |
| dmsimard | nginx I guess would just be http logs, not application logs | 18:32 |
| dmsimard | nginx is just reverse proxy right ? | 18:32 |
| tready | correct | 18:33 |
| tready | where does ara log to? syslog? | 18:33 |
| dmsimard | tready: ara's logs are probably not going to tell you if there's been an error, they're probably logged to uwsgi in foreground -- but by default it's to ~/.ara/ara.log iirc | 18:34 |
| dmsimard | tready: check /var/log/uwsgi or journalctl -u uwsgi or something | 18:34 |
| tready | hmmm | 18:45 |
| tready | I haven't got ~/.ara/ara.log, nor /var/log/uwsgi | 18:45 |
| tready | I'm going to try to enable uwsgi logging - default is stdout/err, apparently | 18:48 |
| dmsimard | tready: just to throw uwsgi/nginx out of the equation | 18:48 |
| dmsimard | tready: can you fire the embedded server just to see if you can reproduce it there ? Command is "ara-manage runserver" | 18:49 |
| *** tbielawa is now known as tbielawa|lunch | 18:51 | |
| tready | can't connect to it. got "unable to connect" | 18:52 |
| tready | (in Firefox). Chrome says "refused to connect" ERR_CONNECTION_REFUSED | 18:52 |
| dmsimard | tready: are you running that off of another machine ? you might need to make it listen on all interface, ex: "ara-manage runserver -h 0.0.0.0" | 18:52 |
| tready | ah. that worked. | 18:53 |
| tready | ok, so that loaded up the details modal w/o issue | 18:54 |
| dmsimard | tready: ok, just making sure, let's go back to uwsgi to try and figure it out | 18:54 |
| tready | nothing much helpful in the uwsgi log, either, unfortunately. I get the following line when invoking the modal: | 19:04 |
| tready | [pid: 115987|app: 0|req: 24/58] 10.8.0.204 () {50 vars in 1142 bytes} [Fri Mar 31 15:03:27 2017] GET /file/1c709066-89f3-425a-9946-b9776da0f7a0/ => generated 31302 bytes in 38 msecs (HTTP/1.1 200) 2 headers in 82 bytes (2 switches on core 0) | 19:04 |
| _dev | tbh, we use gunicorn with nginx talking to it | 19:05 |
| _dev | on OpenBSD, but still might work if you want to give something else a shot | 19:05 |
| tready | I just don't get why it worked initially, but then quit working | 19:07 |
| dmsimard | tready: really odd, not sure what to say - I'd need a procedure (ideally a script?) to reproduce the issue on my end to try and understand what's going on | 19:16 |
| tready | ok. I'll let you know when I have a chance to get back to it. Thanks for helping as much as you did. Appreciate it. | 19:17 |
| dmsimard | tready: all good, I'm still interested in those nginx+uwsgi docs eh -- let me know :) | 19:18 |
| tready | when/if I get it working! | 19:19 |
| dmsimard | _dev: testing now, very cool :) | 19:28 |
| dmsimard | See those annoying messages everywhere ? http://paste.openstack.org/show/605100/ That's what I want to get rid of before cutting new release, not as straightforward as it seems | 19:30 |
| *** tready has quit IRC | 19:33 | |
| *** karimb has quit IRC | 19:36 | |
| *** tbielawa|lunch is now known as tbielawa | 19:52 | |
| _dev | It looks like thats coming from alembic? | 19:54 |
| dmsimard | yeah, it is | 19:54 |
| _dev | are you running migrate everytime we invoke ara? | 19:54 |
| dmsimard | Yes and no, it runs once automatically (by default) when the application bootstraps | 19:55 |
| _dev | ah, | 19:55 |
| _dev | well, it looks like its logging at INFO: https://github.com/openstack/ara/blob/e50b6bb2a32d0c4cd7bfd0ebe1cbd14197bd06ee/ara/db/alembic.ini#L33 | 19:55 |
| _dev | do we need to keep it to info? | 19:55 |
| _dev | can we set it to WARNING maybe? | 19:56 |
| dmsimard | It's not just the INFO thing, it's the logger handler, I'd rather have it log to ara.log -- it doesn't seem like I'm able to get it to log *only* to the file, either nowhere or both file and stdout | 19:56 |
| dmsimard | so I'm poking around | 19:56 |
| -openstackstatus- NOTICE: lists.openstack.org will be offline from 20:00 to 23:00 UTC for planned upgrade maintenance | 19:56 | |
| _dev | okay, wish i could be of more help :\ | 20:04 |
| *** tbielawa has quit IRC | 20:05 | |
| *** tbielawa has joined #ara | 20:11 | |
| openstackgerrit | David Moreau Simard proposed openstack/ara master: Hide foreground INFO alembic.runtime.migration stdout logging https://review.openstack.org/452317 | 20:21 |
| dmsimard | _dev: I added a comment to your patch btw, other than that it's good to go | 20:24 |
| dmsimard | I could merge it before the weekend \o/ | 20:24 |
| _dev | just saw them, ill update and push | 20:25 |
| _dev | thanks | 20:25 |
| *** tbielawa has quit IRC | 20:34 | |
| openstackgerrit | Devon Mizelle proposed openstack/ara master: adding postgresql text type "isms" https://review.openstack.org/450948 | 20:34 |
| _dev | okay, pushed! | 20:35 |
| openstackgerrit | Merged openstack/ara master: adding postgresql text type "isms" https://review.openstack.org/450948 | 21:10 |
| -openstackstatus- NOTICE: The upgrade maintenance for lists.openstack.org has been completed and it is back online. | 21:48 | |
| *** dougbtv_ has joined #ara | 22:04 | |
| *** dougbtv has quit IRC | 22:07 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
