ara-slack | zach.swanson: https://github.com/rundeck/rundeck/issues/4258 | 01:36 |
---|---|---|
ara-slack | dmsimard: @zach.swanson thanks for sharing -- I've never used Rundeck but I can take a look :smile: | 01:37 |
ara-slack | zach.swanson: It's an ... interesting tool | 01:37 |
ara-slack | zach.swanson: I haven't used it recently. Looked at it maybe a year ago. Has some real quirks to the UI and workflow (I hear they've done a big refresh) and its like a swiss-army knife kind of thing. But if you're looking to do 'self service' automation tasks its pretty nice | 01:38 |
dmsimard | brb reading marketing https://www.rundeck.com/ansible | 01:40 |
ara-slack | zach.swanson: I think that video there is the old UI. It really didn't work well with ansible (which was done via a plugin) but you could at least use it | 01:42 |
dmsimard | I'm just interested in where Ansible is running and how it is installed :p | 01:45 |
dmsimard | There's two things that are important 1) we need to install ara somewhere, ideally in the same python interpreter as ansible itself 2) set the callback plugins variable to the ara callback 3) profit (not really, it's free software) | 01:46 |
ara-slack | zach.swanson: the actual rundeck plugin for ansible is here - https://github.com/Batix/rundeck-ansible-plugin | 01:47 |
dmsimard | oh, sweet | 01:47 |
ara-slack | zach.swanson: If I remember correctly ansible runs locally with rundeck... but maybe that was just me being dumb when I was first playing with it | 01:47 |
ara-slack | zach.swanson: because that doesn't sound very enterprise-y of them | 01:47 |
dmsimard | JAVA ? | 01:48 |
dmsimard | you cannot be serious | 01:48 |
ara-slack | zach.swanson: haha yah | 01:48 |
ara-slack | zach.swanson: good luck have fun | 01:48 |
ara-slack | zach.swanson: :wink: | 01:48 |
dmsimard | hang on, it can't be THAT complicated | 01:48 |
dmsimard | I'm not going to write a version of ARA in Java :p | 01:50 |
dmsimard | Oh, but they can probably use the new API in 1.0 though | 01:50 |
ara-slack | zach.swanson: yah that'd be cool | 01:52 |
ara-slack | zach.swanson: I have people on my team that need more of a "point and click" way to run things so that I'm not the only one doing it | 01:52 |
ara-slack | dmsimard: Maybe you can give AWX a try, it's not that bad | 01:55 |
dmsimard | I guess I'm biased | 01:55 |
dmsimard | ¯\_(ツ)_/¯ | 01:55 |
ara-slack | zach.swanson: yah I should try it again, I had a bad experience trying to install it last year and the damn thing was building or something for like 2 hours (admittedly I was trying to do this in a small VM) and I gave up | 01:56 |
ara-slack | zach.swanson: I'm consistently lazy at least | 01:56 |
dmsimard | I'm going to write docs for setting up ara with it, it's ~3 steps | 01:56 |
dmsimard | there's something about an ANSIBLE_CONFIG file here https://github.com/Batix/rundeck-ansible-plugin/blob/d9fcad02681c6bbc634aa1d18701fbcea4296c08/src/main/java/com/batix/rundeck/core/AnsibleRunner.java#L462-L468 | 02:05 |
dmsimard | but that's just wrapping around the ansible CLI ... | 02:05 |
ara-slack | zach.swanson: its weird for sure | 02:05 |
ara-slack | zach.swanson: it also has to "import" the hosts from your inventory | 02:06 |
ara-slack | zach.swanson: Rundeck has a way of doing things and someone tried to force the ansible model into that | 02:06 |
dmsimard | so there's probably a way to set the callback_plugins configuration around here https://github.com/Batix/rundeck-ansible-plugin/blob/d9fcad02681c6bbc634aa1d18701fbcea4296c08/docker/project.properties | 02:06 |
dmsimard | oh, huh? https://github.com/Batix/rundeck-ansible-plugin/blob/d9fcad02681c6bbc634aa1d18701fbcea4296c08/Dockerfile#L8 | 02:07 |
dmsimard | https://github.com/Batix/rundeck-ansible-plugin/blob/d9fcad02681c6bbc634aa1d18701fbcea4296c08/Dockerfile#L22 | 02:07 |
dmsimard | ouch, ansible==2.3.2.0 | 02:08 |
ara-slack | zach.swanson: hah, despite the repo being updated within a week | 02:09 |
ara-slack | zach.swanson: oh wait were you looking at an older version? the one I'm seeing on master just says it installs the latest from pip | 02:10 |
dmsimard | that's bad, though -- 2.3 has been EOL for a year https://docs.ansible.com/ansible/latest/reference_appendices/release_and_maintenance.html#release-status | 02:10 |
dmsimard | oh ? | 02:11 |
dmsimard | T_T | 02:11 |
ara-slack | zach.swanson: I dunno, now I'm confused | 02:11 |
dmsimard | Must have been from the github search link | 02:11 |
ara-slack | zach.swanson: yah maybe | 02:11 |
dmsimard | didn't realize it was pinned to an old commit | 02:11 |
ara-slack | zach.swanson: https://github.com/Batix/rundeck-ansible-plugin/blob/master/Dockerfile | 02:11 |
ara-slack | zach.swanson: looks fine in there | 02:11 |
dmsimard | oh yeah | 02:11 |
ara-slack | zach.swanson: RUN apk --no-cache add sudo bash ca-certificates curl openssl python2 ansible openjdk8-jre && \ | 02:11 |
dmsimard | ++ | 02:11 |
dmsimard | ok | 02:12 |
dmsimard | I can work with that | 02:12 |
dmsimard | oh that's the latest *APK* of ansible | 02:35 |
dmsimard | there's APKs for ansible ? | 02:35 |
dmsimard | APKs, Java | 02:35 |
dmsimard | Discovering things today | 02:35 |
dmsimard | \o/ | 02:35 |
openstackgerrit | Merged openstack/ara-plugins master: Add helper command to determine plugins location https://review.openstack.org/625303 | 02:35 |
openstackgerrit | Merged openstack/ara-plugins master: Improve README to include docs for enabling ara-plugins https://review.openstack.org/625304 | 02:38 |
openstackgerrit | Merged openstack/ara-plugins master: Tweak how files and hosts are created to ensure idempotency https://review.openstack.org/625962 | 02:38 |
*** herald85 has joined #ara | 08:22 | |
*** jungleslow has quit IRC | 09:32 | |
*** jungleslow has joined #ara | 09:34 | |
*** ssbarnea has joined #ara | 10:14 | |
openstackgerrit | Florian Apolloner proposed openstack/ara-server master: Added endpoint exposing ara and python version. https://review.openstack.org/626868 | 10:38 |
openstackgerrit | Florian Apolloner proposed openstack/ara-server master: Added endpoint exposing ara and python version. https://review.openstack.org/626868 | 10:39 |
*** jungleslow has quit IRC | 14:25 | |
openstackgerrit | David Moreau Simard proposed openstack/ara-server master: Fix ansible-integration test after playbook.files tweak https://review.openstack.org/626916 | 14:55 |
dmsimard | apollo13: on a second thought, I wonder if including the python version is really relevant | 15:00 |
apollo13 | a health check endpoint would probably be better than info either way :þ | 15:01 |
dmsimard | good idea, do you have anything in mind as far as healthcheck goes ? | 15:01 |
apollo13 | not really, we'd probably want to have one which just returns 200 ok if the server is running at all | 15:02 |
dmsimard | I guess it needs to at least exercise a read to the database | 15:02 |
apollo13 | and then maybe with an option one that reads from the db | 15:02 |
apollo13 | or just that yeah | 15:02 |
dmsimard | does django have a method for that perhaps ? | 15:03 |
apollo13 | nope | 15:03 |
dmsimard | there's https://github.com/KristianOellegaard/django-health-check that does a bit more than what we were looking for | 15:05 |
dmsimard | it even checks available disk and memory | 15:05 |
apollo13 | yeah, more than needed, also health checks should be as fast as possible imo :D | 15:09 |
apollo13 | bbl, time to go home | 15:09 |
dmsimard | apollo13: happy holidays just in case o/ | 15:11 |
Xaroth | healthcheck for what purpose, if I may ask? | 15:12 |
dmsimard | Xaroth: a healthcheck API endpoint for monitoring to tell if the thing is alive or not | 15:13 |
openstackgerrit | David Moreau Simard proposed openstack/ara-server master: Remove requirement on django-environ https://review.openstack.org/626919 | 15:13 |
ara-slack | dmsimard: @zach.swanson replied to that issue last night btw https://github.com/rundeck/rundeck/issues/4258#issuecomment-449226103 | 15:14 |
ara-slack | dmsimard: Gave them a few pointers but I just don't have the time to do the work tbh | 15:14 |
*** gvincent has quit IRC | 15:14 | |
*** gvincent has joined #ara | 15:15 | |
openstackgerrit | Merged openstack/ara-server master: Added endpoint exposing ara and python version. https://review.openstack.org/626868 | 15:19 |
openstackgerrit | David Moreau Simard proposed openstack/ara-server master: Update and improve README https://review.openstack.org/626928 | 15:20 |
openstackgerrit | Merged openstack/ara-server master: Fix ansible-integration test after playbook.files tweak https://review.openstack.org/626916 | 15:23 |
openstackgerrit | David Moreau Simard proposed openstack/ara-server master: Add basic installation documentation https://review.openstack.org/626933 | 15:26 |
openstackgerrit | David Moreau Simard proposed openstack/ara-server master: Update and improve README https://review.openstack.org/626928 | 15:28 |
herald85 | So here's an idea for my next steps with ara: Using jenkins with a jenkinsslave running in openshift that runs ansible playbooks which log into ara. Not a massive amount of jobs at the moment, especially not concurrent. I read conflicting stuff about using mysql as ara backend? | 15:49 |
dmsimard | herald85: I think 1.0 would be perfect for that use case | 15:51 |
dmsimard | with the callback sending data to a central API | 15:51 |
openstackgerrit | David Moreau Simard proposed openstack/ara-server master: Add documentation on how to configure ara-server https://review.openstack.org/626938 | 15:52 |
herald85 | would it be a huge change between setting up with DB now vs 1.0 API way of working? | 15:52 |
herald85 | I can be patient :) | 15:52 |
dmsimard | herald85: I'm hoping for a beta after the holidays | 15:52 |
dmsimard | Using the new callback with the new API isn't complicated: https://github.com/openstack/ara-plugins/blob/master/ara/plugins/callback/ara_default.py#L39-L92 | 15:53 |
dmsimard | See https://github.com/openstack/ara-plugins#documentation | 15:53 |
dmsimard | oops, a RST syntax mishap | 15:54 |
herald85 | cool. reading ansible output in jenkins is a huge pita | 15:55 |
openstackgerrit | David Moreau Simard proposed openstack/ara-plugins master: Fix RST codeblock syntax in README https://review.openstack.org/626939 | 15:56 |
dmsimard | herald85: the tl;dr is that you'll need to install the ara-plugins package, set the callback_plugins configuration to point to the right place "(python -m ara.plugins)/callback", set your API client to http and set the API server to use the remote API server | 15:57 |
dmsimard | that API server can be anywhere and on any database backend | 15:57 |
dmsimard | the API server is the ara-server package -- I'm working on docs but it's not complicated either | 15:58 |
herald85 | how will it store data by default? | 15:59 |
dmsimard | sqlite by default | 15:59 |
dmsimard | in ~/.ara/server/ansible.sqlite (default in 0.x is ~/.ara/ansible.sqlite) | 16:00 |
dmsimard | sqlite works fine but doesn't scale well with concurrent writes | 16:00 |
dmsimard | The web interface in 1.0 needs work though | 16:01 |
apollo13 | Xaroth: health checks for a load balancer in front of it etc… | 16:04 |
herald85 | and the api server can be queried over http? | 16:05 |
apollo13 | dmsimard: thanks, same to you, but I guess we will hear of each other anyways :) | 16:05 |
apollo13 | herald85: yes | 16:05 |
apollo13 | herald85: actually that is the only way to access it | 16:05 |
openstackgerrit | David Moreau Simard proposed openstack/ara-server master: Add docs on how to use the API clients with ara-server https://review.openstack.org/626944 | 16:05 |
apollo13 | (unless you are in offline mode, in which case it transparently spawns a server for you just to keep the code paths the same) | 16:06 |
dmsimard | ^ herald85 right, there is an "offline" client which doesn't require you to stand up the API server | 16:06 |
dmsimard | herald85: there's some basic docs that are WIP here http://logs.openstack.org/50/623350/9/check/build-openstack-sphinx-docs/470089e/html/using_api_clients.html | 16:07 |
herald85 | thats a weird url :) | 16:08 |
herald85 | ok looks like i can easily get failed playbook runs for example in splunk. nice | 16:09 |
openstackgerrit | David Moreau Simard proposed openstack/ara-server master: Add docs on how to use the API clients with ara-server https://review.openstack.org/626944 | 16:11 |
dmsimard | herald85: that's a draft build of the docs provided by CI | 16:11 |
openstackgerrit | Merged openstack/ara-plugins master: Fix RST codeblock syntax in README https://review.openstack.org/626939 | 16:12 |
dmsimard | even the docs are integration tested :D | 16:12 |
herald85 | English linter over the docs | 16:12 |
openstackgerrit | Merged openstack/ara-server master: Update and improve README https://review.openstack.org/626928 | 16:12 |
openstackgerrit | Merged openstack/ara-server master: Add basic installation documentation https://review.openstack.org/626933 | 16:13 |
openstackgerrit | Merged openstack/ara-server master: Remove requirement on django-environ https://review.openstack.org/626919 | 16:13 |
dmsimard | herald85: and yes, one of the goals of this new API is to make it easy to take data from ARA and send it to everything | 16:13 |
dmsimard | there's already an openstack project that is taking data from ara and shipping it to influxdb for graphing task and playbook duration in grafana | 16:13 |
dmsimard | that's in 0.x though and it's more difficult than it should be | 16:13 |
dmsimard | sending groked, indexed and organized data to influxdb, graphite, logstash, splunk, etc.. or getting monitoring like prometheus, nagios, sensu, etc to poke at the API for alerting | 16:14 |
dmsimard | I don't want ara to be able to do all the things that these different software do but I want to make it easy to integrate with them :p | 16:15 |
dmsimard | apollo13: I'm kind of sad about SECRET_KEY not being set by default but I understand why | 16:17 |
dmsimard | It increases the amount of steps required to get going by 25% (there's four steps in the quickstart) | 16:19 |
herald85 | when 1.0 beta releases I'll definitely try it out and give good feedback | 16:20 |
dmsimard | herald85: much appreciated ! | 16:20 |
apollo13 | dmsimard: yeah, but sadly that is the single one step that is here to ensure security imo | 16:27 |
dmsimard | apollo13: considering there's no authentication or permissions, maybe we should be more upfront about being insecure by default | 16:28 |
apollo13 | dmsimard: there is no authentication yet :þ | 16:28 |
dmsimard | Not going to block 1.0 for that, though | 16:28 |
dmsimard | Maybe it can land in 1.1 or something | 16:28 |
apollo13 | ic | 16:29 |
dmsimard | Letting web servers handle security is a good compromise to release the damn thing | 16:29 |
apollo13 | we should ensure that we have a way to at least pass basic auth to the client though | 16:31 |
openstackgerrit | David Moreau Simard proposed openstack/ara-server master: Add docs on how to use the API clients with ara-server https://review.openstack.org/626944 | 16:31 |
dmsimard | apollo13: I don't think I've ever worked with basic-auth enabled in a client.. how does that work in practice ? It doesn't need to re-authenticate every time, does it ? It keeps a cookie ? | 16:32 |
apollo13 | I'd expect it to provide authentication on every request | 16:32 |
apollo13 | in the long run sessions might be a good idea, but initially… | 16:32 |
dmsimard | ouch, that's an extra roundtrip for every call | 16:32 |
apollo13 | why? | 16:32 |
apollo13 | (read: no) | 16:32 |
apollo13 | if you __know__ (which you will generally) that your server requires auth you can just send the basic auth header along | 16:33 |
apollo13 | ie if I configure my client to talk to http://user:password@some_loc I'd epxect it to send that along all the time | 16:33 |
dmsimard | hmmm, I guess | 16:34 |
*** herald85 has quit IRC | 16:34 | |
openstackgerrit | Merged openstack/ara-server master: Add documentation on how to configure ara-server https://review.openstack.org/626938 | 16:34 |
apollo13 | at least as long as we say "use your webserver for auth" :D | 16:35 |
dmsimard | It's a good compromise I think | 16:35 |
dmsimard | Let me add it to the todo | 16:35 |
openstackgerrit | Merged openstack/ara-server master: Add docs on how to use the API clients with ara-server https://review.openstack.org/626944 | 16:54 |
dmsimard | apollo13: 1.0.0a1 tagged in git repos and updated dev builds are on pypi | 17:17 |
apollo13 | well you are in a rush :D | 17:17 |
apollo13 | (congrats ;)) | 17:17 |
dmsimard | Well, it's just a good milestone because we can tell that ara-server/ara-plugins/ara-clients work with each other at this point | 17:18 |
dmsimard | the fact that it works at all is worthy of mention :D | 17:19 |
*** tristanC has quit IRC | 19:17 | |
*** tristanC has joined #ara | 19:17 | |
*** etienne has quit IRC | 21:14 | |
*** etienne has joined #ara | 21:15 | |
ara-slack | nj.chandu: Hello folks, is there a way to cleanup the reports before executing a new job on the same jenkins machine (or after archiving the report). | 22:29 |
-openstackstatus- NOTICE: the gerrit service on review.openstack.org is being restarted to pick up new configuration changes, and will return momentarily | 22:55 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!