Tuesday, 2017-03-14

*** karimb has joined #ara00:14
*** karimb has quit IRC00:22
*** JakeDEvans has joined #ara03:43
JakeDEvanswould you guys want/accept a pull request for a docker-compose.yml or DockerFile, and if so, how would it be formatted03:44
JakeDEvansI setup https://hub.docker.com/r/jacobdevans/ara/03:44
JakeDEvansyou can find me on twitter, @jakedevans03:47
*** JakeDEvans has quit IRC03:47
*** Maximus86 has joined #ara08:21
*** karimb has joined #ara08:36
Maximus86Anyone, please.. where can I file a bug report?09:00
karimbMaximus86 not clear as per the docs :)09:59
karimbMaximus86 it doesnt seem github issues are used, nor launchpad bugs10:00
Maximus86yeah I also tried to find stuff10:00
Maximus86no luck10:00
Maximus86"stuff" = a place to track and file bugs10:00
karimbdmsimard worth enabling the issues tab on github ?10:01
Maximus86anyway10:59
Maximus86the revision of the db was not updated since 0.11.010:59
Maximus86so maybe logical that the db upgrades did not run?11:00
Maximus86though I don't see any upgrade file for 0.12.3?11:00
dmsimardMaximus86: hey, you're right, how to file issues is not documented :(12:52
dmsimardkarimb: OpenStack projects don't use github issues, that's why it's toggled off12:53
dmsimardkarimb: It's either launchpad, or in the process of being moved towards storyboard12:53
dmsimardMaximus86: sorry for not getting back to you yesterday, had my head deep into other work things12:53
Maximus86np :)13:02
Maximus86Still have some logs13:03
Maximus86can post them here, but if you can enable some form of public bug tracking, it might be better to post the info there?13:03
dmsimardMaximus86: we do have public tracking on https://storyboard.openstack.org/#!/project/843 -- however it's not as straightforward as I would like from contributors not used to the OpenStack workflows13:13
dmsimardSometimes people end up posting issues on https://github.com/dmsimard/ara (original upstream) and I don't scold them for it but eventually I'll have to do something about it13:14
dmsimardfeel free to open an issue there for now, it's my fault for not coming up with proper docs and stuff :)13:14
dmsimardif necessary I'll move the issue myself13:14
karimbdmsimard yeah my guess was launchpad as github is just used for mirroring13:15
Maximus86aha awesome13:15
dmsimardkarimb: ara skipped launchpad entirely though, I wasn't interested in using launchpad if it was to migrate to storyboard a few months down the road13:15
dmsimardplus I helped the storyboard devs with some feedback as an actual end user :)13:16
Maximus86dmsimard: would you prefer me filingh the issue on storyboard?13:16
dmsimardleifmadsen: did you see that: https://hub.docker.com/r/jacobdevans/ara/13:16
dmsimardleifmadsen: came out of nowhere last night :)13:16
dmsimardMaximus86: do you happen to already have an unbutu launchpad account ?13:28
dmsimardMaximus86: storyboard currently uses launchpad as login backend13:28
Maximus86I do, but I just filed an issue on GH13:28
Maximus86https://github.com/dmsimard/ara/issues/11713:28
Maximus86let me know if you need any more info13:29
dmsimardok, that works, I'll have a read soon, thanks13:29
-openstackstatus- NOTICE: Gerrit is going to be restarted due to performance problems13:36
*** ChanServ changes topic to "Gerrit is going to be restarted due to performance problems"13:36
leifmadsendmsimard: I didn't! looking! I ended up trying a new approach -- curious to see what he did13:41
leifmadsendmsimard: I hate when there is no Dockerfile associated :(13:42
dmsimardleifmadsen: yeah I didn't look (yet) but it looks like there's definitely interest in running ara in docker, that's the third person in a couple days pitching something13:42
-openstackstatus- NOTICE: Gerrit has been successfully restarted13:42
*** ChanServ changes topic to "Gerrit has been successfully restarted"13:42
leifmadsendmsimard: nice! I basically wanted to access the ara command from my jenkins master to generate the html output, but I couldn't figure out a clean way of building the container so that I could access the commands13:44
leifmadsenI've tried a couple approaches now, but I wonder if people doing ARA in containers aren't in the same scenario as me13:44
dmsimardleifmadsen: hm, I've seen something before around python-openstackclient being packaged in a container13:45
dmsimardneed to remember who it was13:46
dmsimardthe use case is probably similar13:46
leifmadsenoh true13:47
leifmadsenI would imagine the same approach would work... let me google13:47
dmsimardleifmadsen: in the end iirc it was mostly a lean container with osc and then a bash alias that'd wrap around it (say docker run -it openstackclient $1 -> osc server list)13:48
dmsimardor something like that13:48
leifmadsengotcha13:48
leifmadsenyea the issue was the deps and the binary accessing it13:49
*** ChanServ changes topic to "ARA - Ansible Run Analysis: Making playbook runs easier to visualize, understand and troubleshoot | Git: https://github.com/openstack/ara - Docs: https://ara.readthedocs.io/en/latest/ - Latest version: 0.12.0: https://github.com/openstack/ara/releases/tag/0.12.0 | This channel is logged: http://eavesdrop.openstack.org/irclogs/%23ara/"13:49
-openstackstatus- NOTICE: Gerrit has been successfully restarted13:49
dmsimardleifmadsen: https://github.com/gbraad/dockerfile-openstack-client ?13:49
* leifmadsen looks13:49
dmsimardcan't vouch for it, never tried it, but the approach seemed to make sense13:50
leifmadsenyea, will check out some approaches, thanks!13:52
leifmadsenhrmmmmmmmmmmmmm13:52
leifmadsenah so they install via curl... interesting...13:53
dmsimardthey do what where ?13:53
leifmadsenthe container is build via a sh script which does a curl to pull down a yml used by ansible to install the client in the container...13:53
leifmadsennot sure I agree with this approach lol13:53
leifmadsenhttps://github.com/gbraad/dockerfile-openstack-client/blob/master/centos/run_container.sh13:54
leifmadsenso really the trick here, is that they install the client via a package (RPM) and not via python itself... which is why I did a "hmmmmmmm"13:54
dmsimardSo basically they bypass Dockerfile completely lol13:55
dmsimardUse ansible-container while you're at it13:55
leifmadsenyea....13:55
dmsimardHm. Actually I did talk to you about an ara role yesterday13:56
leifmadsenwell I'm still trying to wrap my head around how to make it so the ara binaries have access to the right deps13:56
dmsimardAnsible-container could just use that o_O13:56
leifmadsenyea, I mean the "how" it gets installed could be debated, but I'm trying to think about how to satisfy the deps from requirements.txt while running from another container13:56
dmsimardleifmadsen: I don't follow. The deps aren't installed in the container ?13:56
leifmadsenI think a lot of these approaches with teh openstackclients are being run on machines hosting the container13:56
leifmadsenthey are, but then you have to expose things via volumes so that things can be read13:57
leifmadsensince you're in another container running the app...13:57
leifmadsenat least this seems to be what is happening... says things like it can't load ara.shell etc13:57
leifmadseneven though I see the file13:57
dmsimardAh so using containerized ara from another container ?13:57
leifmadsenI think I need to go and bother Doug to de-derp me, because I think I've just gotten my brain in a situation where it is stuck13:57
leifmadsendmsimard: yea that was the idea anyways... providing the binary to jenkins_master container via docker-compose and linking13:58
*** tbielawa has joined #ara13:59
dmsimardI haven't done that before. I mean, I've done linking for network stuff (say, mysql, httpd, etc) but not for using a binary from another container13:59
leifmadsenyea, same14:03
leifmadsen:)14:03
dmsimardleifmadsen: the dockerfile for that dockerhub thing is here https://github.com/JakeDEvans/docker-ara14:16
leifmadsengotcha, so yea I kind of assumed he was going to be running the web interface...14:18
leifmadsenI wonder if he tried running ara from another container....14:18
*** spiette has joined #ara14:18
*** ChanServ sets mode: +o dmsimard14:20
*** dmsimard changes topic to "ARA - Ansible Run Analysis: Making playbook runs easier to visualize, understand and troubleshoot | Git: https://github.com/openstack/ara - Docs: https://ara.readthedocs.io/en/latest/ - Latest version: 0.12.3: https://dmsimard.com/2017/03/12/an-even-better-ansible-reporting-interface-with-ara-0-12 | This channel is logged: http://eavesdrop.openstack.org/irclogs/%23ara/"14:20
dmsimardIn case you missed it, I posted about the 0.12 release this week: https://dmsimard.com/2017/03/12/an-even-better-ansible-reporting-interface-with-ara-0-1214:20
dmsimardMaximus86: looking at your thing now14:21
leifmadsen\o/14:23
dmsimardleifmadsen: I missed some boolean things yesterday T_T14:31
leifmadsendoh!14:31
dmsimardMaximus86: are you around ?14:33
Maximus86dmsimard: I am14:34
openstackgerritDavid Moreau Simard proposed openstack/ara master: Properly use boolean Ansible types in configuration parameters (take two)  https://review.openstack.org/44551814:36
dmsimardMaximus86: so I meant to ask you for a debug config but I realized toggling it on was broken  (hence this patch just now ^)14:37
dmsimardMaximus86: could you manually edit the config.py file (i.e, /usr/lib/python2.7/site-packages/ara/config.py)14:37
dmsimardand change this line to "True" (no quotes) https://github.com/openstack/ara/blob/master/ara/config.py#L9814:37
dmsimardrestart apache, go to your vhost/debug/config14:38
dmsimardand pastebin that (feel free to truncate any sensitive info)14:38
Maximus86dmsimard: Is it normal lines 96-101 were removed in https://review.openstack.org/445518 ?14:42
Maximus86ah k nevermind14:43
dmsimardMaximus86: yeah, they've moved up in an if/else logic to support ansible 2.3 differences14:43
Maximus86yeah just saw that14:43
dmsimardI'm re-working that particular file to make it cleaner14:44
dmsimardit's grown organically and it's a bit messy right now14:44
Maximus86I was confused because the file you linked on github was different from the file in the review link14:44
Maximus86hence the lines did not match14:44
Maximus86anyway, enabled it now14:44
dmsimardMaximus86: so if you go to http://ara/debug/config, you should see a table with all the config items14:46
Maximus86dmsimard: http://pastebin.com/ruqtAe0C14:48
dmsimardMaximus86: ok, what about if you run "ara-manage db history", can you pastebin that ?14:55
*** tbielawa has quit IRC14:55
*** tbielawa has joined #ara14:55
Maximus86dmsimard: http://pastebin.com/r3rP1ain15:00
dmsimardMaximus86: that's good too.. huh15:02
* dmsimard scratches head15:02
Maximus86I could create a mysqldump15:03
Maximus86but need to know then what kind of stuff is actually written in the dbv15:03
Maximus86*db15:03
Maximus86let me have alook15:03
Maximus86at least you can import that and recreate my issue15:03
Maximus86but it's as easy as: install centos 7 with all deps, install older version of ara, run ansible at least once, and then upgrade15:04
Maximus86I do have some failed runs too15:04
dmsimardMaximus86: I'll figure it out15:05
Maximus86dmsimard: does ara actually store a copy of playbook or role related files in the db?15:07
Maximus86or does it rely on the files not changing on disk?15:07
Maximus86to display their contents?15:07
dmsimardMaximus86: yup, they're compressed and unique (i.e, running the same playbooks 100 times will not save 100 files)15:07
dmsimardara saves files as ansible sees them -- it doesn't seek out by itself15:08
Maximus86dmsimard: nice, I saw some hashing but did not have a look in the code to see what was going onn but this means that if I want to send you a sql dump, all my playbook files are unredacted in the db15:08
dmsimardif you do select * from the file content table, you should only see gibberish which is really just zipped text15:08
Maximus86I see15:09
dmsimardMaximus86: right - I didn't look at anything though, promise15:09
Maximus86dmsimard: no issue for me, no passwords or any really sensitive info in there either, but might be an issue since the dump contains code I wrote at work15:10
Maximus86dmsimard: can you firstr try to reproduce on your end?15:14
dmsimardMaximus86: yeah15:14
dmsimardof course15:14
Maximus86dmsimard: sorry, if you are unable to reproduce I'll figure something out15:15
*** IRCFrEAK has joined #ara15:16
*** IRCFrEAK has left #ara15:16
*** IRCFrEAK has joined #ara15:16
*** IRCFrEAK has left #ara15:16
*** IRCFrEAK has joined #ara15:16
*** IRCFrEAK has quit IRC15:16
*** lamer14895042822 has joined #ara15:20
*** lamer14895042822 has quit IRC15:23
*** tbielawa is now known as tbielawa|brbXorg15:46
*** tbielawa has joined #ara15:50
Maximus86dmsimard: something even more fishy happened16:18
Maximus86dmsimard: "ERROR! Unexpected Exception: cannot import name 'app' "16:18
Maximus86while trying to run ansible...16:19
Maximus86uncommenting the ara values in ansible.cfg, ansible works again as expected16:19
Maximus86where can I look for meaningful info?16:19
Maximus86at least more meaningful than the error I am getting atm16:19
Maximus86(this is on ubuntu 16.04, ansible 2.2.1, ara 0.12.3)16:20
Maximus86first ansible run I do after the upgrade16:20
dmsimardMaximus86: and ara 0.11 works just fine you said, right ?16:21
Maximus86yes16:22
dmsimardcan you stick on 0.11 for now while I figure this out ?16:22
Maximus86yes of course16:22
Maximus86it's non critical anyway16:22
dmsimarddon't want to leave you in a broken state16:22
Maximus86dmsimard: just downgraded to v0.11.0 via pip uninstall and pip install ara==0.11.016:25
Maximus86dmsimard: I can run ansible without errors now, after uncommenting the are stuff in ansible.cfg16:25
Maximus86(using just the callback plugins on that ubuntu box, with a local sqlite)16:25
dmsimardwhat ansible.cfg config was causing issues ?16:26
Maximus86I had ara config in callbacks, actions and modules16:26
Maximus86I just blanket commented them, did not bother to test which single one was causing issues16:27
Maximus86I'll test and report back :)16:27
dmsimardokay16:27
dmsimardfinding bugs is unfortunate but also cool so we can fix them16:27
Maximus86/usr/local/lib/python2.7/dist-packages/ara/plugins/callbacks16:28
Maximus86that's the one16:28
dmsimardso callback_plugins was causing an error ?16:29
Maximus86did an upgrade, tried to run ansible -> fail, commented that line , ran ansible-> succes16:29
Maximus86yes16:29
dmsimardyeah well that's what tells ansible to use ara :/16:29
Maximus86hence why I'm in this IRC room and not ansible :P16:30
Maximus86jk16:30
dmsimardyou're finding all these problems I've never ran in, I should hire you as QA or something16:30
Maximus86lol I am known to break stuff (involuntarily)16:31
Maximus86I like the project. as long as I find bugs, and action is taken on them, it's not that unfortunate, it hopefully prevents others frustration16:31
Maximus86so I am happy to test and file bugs16:31
Maximus86also for future versions16:31
dmsimardansible 2.1.5 and 2.2.2 are bound to be released soon as well as the first release candidate for 2.316:32
dmsimardtesting will happen :p16:32
Maximus86ansible has becoma s a pillar of my daily work, so I shy away from RC or betas, but I'll certainly upgrade to the latest available16:34
*** themurph has joined #ara17:11
*** Maximus86 has left #ara18:10
openstackgerritDavid Moreau Simard proposed openstack/ara master: Cleanup ARA configuration module  https://review.openstack.org/44551818:42
openstackgerritDavid Moreau Simard proposed openstack/ara master: Cleanup ARA configuration module  https://review.openstack.org/44551818:43
dmsimardandymccr: fyi that improves how configuration in >=2.3 is handled versus <2.3 (tested successfully locally, I'll also run it in gate, 2.3rc1 is due to be out soon)18:46
*** tbielawa is now known as tbielawa|lunch19:30
*** tbielawa|lunch is now known as tbielawa19:58
*** tbielawa is now known as tbielawa|lunch19:59
*** tbielawa|lunch is now known as tbielawa20:02
*** tbielawa is now known as tbielawa|lunch20:03
*** tbielawa|lunch has quit IRC20:25
*** Maximus86 has joined #ara23:07
Maximus86dmsimard: I updated the ticket with a schemq dump23:24
Maximus86and did a quick test by wiping and recreating the db23:24
Maximus86no error so far23:25
Maximus86at least no datatables error23:25
Maximus86I do get the same errors in the apache error log as before23:25
Maximus86this might have to do with my wsgi/apache config23:25
Maximus86I'll do some tests Thursday or Friday and report back23:26
*** Maximus86 has left #ara23:26
*** karimb has quit IRC23:30

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!