Monday, 2016-06-13

*** markvoelker has quit IRC00:01
*** chandanc_ has joined #openstack-ansible00:53
*** chandanc has joined #openstack-ansible00:54
*** thorst has joined #openstack-ansible01:01
*** fishcried has joined #openstack-ansible01:04
*** thorst has quit IRC01:04
*** thorst has joined #openstack-ansible01:05
*** thorst has quit IRC01:13
*** cfarquhar has quit IRC01:24
*** thorst has joined #openstack-ansible01:26
*** chandanc has quit IRC01:26
*** chandanc_ has quit IRC01:26
*** thorst has quit IRC01:26
*** thorst has joined #openstack-ansible01:27
*** cfarquhar has joined #openstack-ansible01:29
*** cfarquhar has quit IRC01:29
*** cfarquhar has joined #openstack-ansible01:29
*** thorst has quit IRC01:31
*** fishcried1 has joined #openstack-ansible01:45
*** jamesdenton has joined #openstack-ansible01:46
*** fishcried has quit IRC01:47
*** fishcried1 is now known as fishcried01:47
*** markvoelker has joined #openstack-ansible01:58
*** markvoelker has quit IRC02:02
*** jamesdenton has quit IRC02:15
*** sacharya has joined #openstack-ansible02:27
*** thorst has joined #openstack-ansible02:30
*** thorst has quit IRC02:30
*** thorst has joined #openstack-ansible02:30
*** thorst has quit IRC02:36
*** chandanc has joined #openstack-ansible02:36
*** chandanc_ has joined #openstack-ansible02:36
*** chandanc__ has joined #openstack-ansible03:19
*** chandanc_ has quit IRC03:22
*** chandanc has quit IRC03:22
*** chandanc has joined #openstack-ansible03:22
*** Guest10310 has quit IRC03:28
*** thorst has joined #openstack-ansible03:34
*** thorst has quit IRC03:41
*** fishcried1 has joined #openstack-ansible03:50
*** fishcried has quit IRC03:51
*** fishcried1 has quit IRC03:52
*** markvoelker has joined #openstack-ansible03:59
*** markvoelker has quit IRC04:03
*** sacharya has quit IRC04:10
*** bbmbx__ has joined #openstack-ansible04:24
*** bbmbx has quit IRC04:27
*** thorst has joined #openstack-ansible04:39
*** thorst has quit IRC04:46
*** fishcried has joined #openstack-ansible05:25
*** saneax_AFK is now known as saneax05:32
*** saneax is now known as saneax_AFK05:32
*** thorst has joined #openstack-ansible05:43
*** McMurlock has joined #openstack-ansible05:48
*** saneax_AFK is now known as saneax05:48
*** thorst has quit IRC05:51
*** M00nr41n has quit IRC05:56
*** markvoelker has joined #openstack-ansible05:59
*** fishcried has quit IRC06:02
*** markvoelker has quit IRC06:04
*** thorst has joined #openstack-ansible06:50
*** thorst has quit IRC06:56
*** george_goh has quit IRC06:57
*** george_goh has joined #openstack-ansible06:58
*** javeriak has joined #openstack-ansible07:00
*** agireud has quit IRC07:04
*** agireud has joined #openstack-ansible07:07
*** javeriak has quit IRC07:07
*** elopez has joined #openstack-ansible07:15
*** elopez is now known as Guest9033707:16
*** zerda2 has joined #openstack-ansible07:26
*** bsv has joined #openstack-ansible07:29
*** mikelk has joined #openstack-ansible07:38
*** mikelk has quit IRC07:41
*** Oku_OS-away is now known as Oku_OS07:45
*** mikelk has joined #openstack-ansible07:47
*** chandanc__ has quit IRC07:48
*** chandanc has quit IRC07:49
*** thorst has joined #openstack-ansible07:53
*** M00nr41n has joined #openstack-ansible07:55
*** permalac has joined #openstack-ansible08:00
*** markvoelker has joined #openstack-ansible08:00
*** thorst has quit IRC08:01
*** markvoelker has quit IRC08:05
*** electrofelix has joined #openstack-ansible08:06
*** javeriak has joined #openstack-ansible08:08
*** chandanc__ has joined #openstack-ansible08:12
*** chandanc has joined #openstack-ansible08:15
*** javeriak has quit IRC08:21
*** zerda2 has quit IRC08:27
*** thng has joined #openstack-ansible08:27
thngHi all08:27
thngAnyone can tell me where can I set globally proxy settings ? I did it in users_variables.yml but it does not work for pip_install role while trying to get "Modern PIP"08:28
*** javeriak has joined #openstack-ansible08:29
*** javeriak has quit IRC08:30
*** javeriak has joined #openstack-ansible08:30
pjm6Good morning08:43
pjm6thng, are you using haproxy?=08:43
thngnope08:44
thngI try to use aio08:44
thngand my server is behind a proxy08:45
pjm6you use this guide08:46
pjm6http://docs.openstack.org/developer/openstack-ansible/install-guide/app-no-internet-connectivity.html#practice-b-proxy-access-to-internet-resources ?08:46
*** tiagogomes has joined #openstack-ansible08:47
thngpjm6: Yes, I set all proxy settings already in /etc/openstack_deploy/user_variables.yml. But it still does not have any effect08:48
pjm6thng, did you try enter in the container and try to access the internet?08:49
pjm6that configuration was in the beginning ? Before you run setup-hosts08:49
pjm6(forget about setup-hosts, you're using AIO)08:50
thngI think I did an error in user_variables.yml. I set up variables HTTP_PROXY etc. but I didnot see to uncomment global_environment_variables:08:54
thngI will do a test08:54
*** admin0 has joined #openstack-ansible08:57
pjm6that could be a reason for it not being working08:58
pjm6automagically, are you therE?=08:58
*** thorst has joined #openstack-ansible09:00
thngI still doesnot work... I got now http_proxy etc. in /etc/environment09:02
thngTASK: [pip_install | Get Modern PIP] ******************************************  <172.29.236.100> ESTABLISH CONNECTION FOR USER: root <172.29.236.100> REMOTE_MODULE get_url validate_certs=yes force=yes dest=/opt/get-pip.py url=https://bootstrap.pypa.io/get-pip.py <172.29.236.100> EXEC ssh -C -v -o ControlMaster=auto -o ControlPersist=60s -o ControlPath="/root/.ansible/cp/ansible-ssh-%h-%p-%r" -o StrictHostKeyChecking=no -o Kb09:02
thng3rd time already09:03
*** javeriak has quit IRC09:03
*** javeriak has joined #openstack-ansible09:03
pjm6weird >S09:04
thngResult from run 1 is: {u'msg': u'Failed to validate the SSL certificate for bootstrap.pypa.io:443. Make sure your managed systems have a valid CA certificate installed. If the website serving the url uses SNI you need python >= 2.7.9 on your managed machine. You can use validate_certs=False if you do not need to confirm the server\\s identity but this is unsafe and not recommended Paths checked for this platform: /etc/ssl/cer09:05
thngI got this error while enabling -vvv in ansible :09:05
*** thorst has quit IRC09:06
pjm6well it seems that you've problems with certificates09:07
pjm6if you do lxc-ls do you see any container?09:07
thngNo, lxc-ls isnot already installed yet at this state. I found the problem (i hope)09:12
thngI must disable and validate_certs in all roles09:12
thngwhile using proxy09:12
thngpip_install works now.09:13
pjm6yes, for some reason the CA isn't being readed correctly09:16
thnghoho I have to modify some roles manually :D09:19
pjm6if you just disable HTTPS09:20
pjm6don't solve your probleM?09:20
thnghttps of which ?09:21
pjm6apt repositories09:21
pjm6i'm trying to find that config file09:21
thngit is not easier because this option is set by default to yes in lxc_hosts, galera_server and pip_install at the first sign in /etc/ansible/roles09:23
*** pcaruana has joined #openstack-ansible09:27
pjm6yeah, it seems that are not a easy way to do it :s09:28
*** M00nr41n has quit IRC09:28
thng:) anyway, thanks for your help :D09:31
thngit is dling lxc_cache.... donnt know if there is any prob else :D09:32
*** pjm6_ has joined #openstack-ansible09:34
*** pjm6 has quit IRC09:38
*** gparaskevas has joined #openstack-ansible09:38
*** zerda2 has joined #openstack-ansible09:42
ionihey guys09:49
ioniif i want to install additional packages on compute hosts, how should I do that?09:49
ionii need to add a new role in /etc/ansible right09:51
*** Bofu2U has quit IRC09:51
*** thorst has joined #openstack-ansible10:04
*** pjm6_ is now known as pjm610:10
*** thorst has quit IRC10:11
*** javeriak has quit IRC10:13
evrardjpgood morning everyone10:15
*** javeriak has joined #openstack-ansible10:26
*** karimb has joined #openstack-ansible10:29
*** zerda2 has quit IRC10:34
*** mikelk has quit IRC10:41
pjm6good morning evrardjp10:46
pjm6evrardjp, it was you that have done some work in horizon?10:46
evrardjpdepends10:55
evrardjpI know the role a little10:55
evrardjp:D10:55
evrardjppjm6: why?10:58
pjm6I was talking about the project xd10:58
pjm6because i'm trying to do testing in a dashboard that I created and the lack of docs (or my methods of search are bad) are not the best10:58
*** chandanc__ has quit IRC10:59
*** chandanc has quit IRC10:59
*** admin0 has quit IRC11:01
*** mikelk has joined #openstack-ansible11:04
*** thorst has joined #openstack-ansible11:08
*** thorst has quit IRC11:15
evrardjpstevelle: when you're there: do you remember the step where the timeout appeared for before your "recheck timeout ovh" on this commit? https://review.openstack.org/#/c/328274/11:15
evrardjpIt currently have failed for tempest reasons, I'll recheck.11:15
evrardjpGuys bad news, I think the gate is broken11:23
evrardjpor more, completely BORKED11:23
evrardjp(for the integrated builds)11:24
pjm6because i'm trying to do testing in a dashboard that I created and the lack of docs (or my methods of search are bad) are not the best11:24
pjm6ups sorry11:24
pjm6btw: evrardjp i could do it =)11:24
pjm6i'm using openstack_dashboard.test.helpers11:25
pjm6the TestCase ( to simulate a normal user) and test.BaseAdminViewTests (admin users)11:25
evrardjpit's been a while and it probably has changed now pjm6 :D11:25
pjm6evrardjp, true :) but anything might help, anyway using that I could figure out =)11:25
pjm6there is a docs about how doing tests?11:25
evrardjpfor django panel/dashboard?11:26
pjm6yes11:26
pjm6the docs I saw say don't have much examples, and i'm doing by seeing examples from tests of openstack_dashboard11:26
evrardjpI don;t know where the docs are for that11:26
evrardjpdid you check latest dev horizon docs?11:26
pjm6http://docs.openstack.org/developer/horizon/topics/testing.html11:27
pjm6http://docs.openstack.org/developer/horizon/ref/test.html11:27
pjm6this ones11:27
pjm6maybe lack me knowledge of django :)11:28
pjm6for instance, I didn't know about self.client.get and self.client.post11:28
pjm6(maybe its used in django by default in tests)11:28
evrardjpI'm definitely not the right person for that11:30
evrardjpall I was using was standard unittest/mox testing with basic python scripts11:31
evrardjpthat were used to populate my dashboard11:31
*** Guest__ has joined #openstack-ansible11:32
evrardjpI'd be happy to have feedback about the latest practices 'though11:33
*** thorst has joined #openstack-ansible11:33
*** psilvad has joined #openstack-ansible11:38
pjm6evrardjp, i'm searching about how to do and what pratices xD11:39
pjm6but when I know something more, i could share yes :)11:39
evrardjpmaybe you should contact horizon guys on irc?11:40
pjm6yes, already ask there, but no one replied yet11:41
pjm6btw: the mox is the mock?11:41
evrardjpyup11:42
*** retreved has joined #openstack-ansible11:43
pjm6that is used when we want to "abstract" an event?11:43
pjm6for instance, i have a API that i communicate with an external server11:43
pjm6the mock could be used to simulate that?11:44
evrardjpthere is no magic behind it11:45
evrardjpso you'd have to write a mock API11:46
*** elo has quit IRC11:46
evrardjpIIRC, swagger and apiary were good for writing APIs, because it allowed to generate these11:47
evrardjpbut it's been REALLY a while that I did this11:47
evrardjpand I didn't do that for long, so I am a noob on these11:47
pjm6but the general idea is to reproduce/simulate events right?11:48
evrardjpso basically here if you didn't start with that, you'd have to create fake local results for your api, to explain what your code should expect, and then you assert the results11:48
evrardjpI don't know if I'm clear11:48
evrardjpI'm definitely not the right person :p11:49
evrardjpI think google will help you better than me :p11:50
evrardjpI am a noob on that level :p11:50
pjm6yes yes evrardjp , been great help =) it was what i'm thinking11:51
pjm6i didn't have sure11:51
*** admin0 has joined #openstack-ansible11:51
evrardjppjm6: it's better to talk here11:56
evrardjpso you can set the affinity for your containers11:56
evrardjphttp://docs.openstack.org/developer/openstack-ansible/install-guide/configure-initial.html#affinity11:56
evrardjpthis way you'll run multiple containers on a host11:56
*** weshay has joined #openstack-ansible11:56
evrardjprun 3 containers on your node, and this way you'll test the redundancy11:56
evrardjpofc it's better to have 3 physical nodes instead of 3 containers on the same node11:57
evrardjpbut it gives you an idea of how it works11:57
*** evrardjp has left #openstack-ansible11:57
*** evrardjp has joined #openstack-ansible11:57
pjm6yeah, and can do that in current config?12:01
*** markvoelker has joined #openstack-ansible12:01
pjm6it will cause no problems with sync?12:01
mhaydenhappy monday12:02
pjm6hi mhayden12:02
pjm6i have to run, come back later. thanks evrardjp :)12:03
evrardjpnp, yw pjm6!12:04
evrardjphappy mondayversay mhayden!12:04
evrardjpI got my yubikeys! woot12:05
*** markvoelker has quit IRC12:06
*** elo has joined #openstack-ansible12:08
odyssey4methng to turn off cert validation (because you have a naughty proxy), check http://docs.openstack.org/developer/openstack-ansible/install-guide/app-no-internet-connectivity.html#considerations-when-proxying-tls-traffic12:09
odyssey4meioni there are many ways to install additional packages on your compute hosts - you can make your own playbook to do it and target the appropriate group12:10
*** thorst has quit IRC12:11
odyssey4meo/ all12:11
odyssey4meevrardjp yeah, I saw that something's gone broken on the weekend due to some upstream changes, I think12:11
odyssey4mehave you found out anything interesting in your log reviews?12:12
*** thorst has joined #openstack-ansible12:15
*** markvoelker has joined #openstack-ansible12:25
*** woodard has joined #openstack-ansible12:26
*** woodard has quit IRC12:26
thngodyssey4me: thanks. I also got it. Now, I have just gotten this error :12:26
thng+ ansible neutron_agent -m shell -a 'DEBIAN_FRONTEND=noninteractive apt-get install iptables-persistent' -t /openstack/log/ansible_cmd_logs//add_neutron_agent_checksum_rule ++ exit_fail 262 012:26
*** woodard has joined #openstack-ansible12:27
thngI havent figured out what it is12:27
thngjust came back from lunch :D12:27
*** elo has quit IRC12:30
*** Guest90337 has quit IRC12:31
thngAh it cannot download iptables-persistent from ubuntu repo because network is unreacheable.... weird.12:31
*** Qiming_ has joined #openstack-ansible12:31
odyssey4methng it would seem that you re-ran run-playbooks a few times, so the containers have lost connectivity12:31
odyssey4methng I'd suggest using the lxc-container-destroy (or some name like that) to destroy the containers, then you can re-run run-playbooks again12:32
*** klamath has joined #openstack-ansible12:34
*** klamath has quit IRC12:34
*** klamath has joined #openstack-ansible12:35
thngI re-ran several times run-playbooks but only when It couldnot download pip_install and at that moment, no container is installed.... I thought that it did not affect anything.... After, when the validation cert is disabled, I didnt rerun anymore12:35
thngI will destroy container as you told and rerun run-playbook as you adviced12:35
*** Qiming_ has quit IRC12:35
odyssey4methng if the containers have been created, run-playbooks restarts the lxc bridge, which breaks container connectivity12:35
odyssey4meso you can either restart all the containers, or just destroy and recreate them12:36
*** javeriak has quit IRC12:36
*** woodard_ has joined #openstack-ansible12:38
*** woodard has quit IRC12:38
thngodyssey4me : do I need to stop all services, uninstall core service and pip configuration file as in the rebuilding AIO section ?12:41
odyssey4methng no, that shouldn't be necessary - your install didn't get very far12:41
thngoki. I did it and reruning playbook12:44
*** jamesdenton has joined #openstack-ansible12:45
odyssey4methng which branch are you running?12:45
thngmitaka12:50
mrhillsmang'morning12:54
thnghi12:54
mhaydenodyssey4me: i'd like to find a proper home for this thing -> https://review.openstack.org/#/c/328469/12:58
mhaydenautomagically and i were doing some head scratching last week on where it belongs12:58
*** karimb has quit IRC12:59
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins: Provide an empty default for image properties  https://review.openstack.org/32899013:00
odyssey4mehughsaunders does https://review.openstack.org/328990 make sense?13:00
hughsaundersodyssey4me: looks reasonable13:01
hughsaundersodyssey4me: so the default default is None... Would be better if the default key was required whenever required=false.13:03
odyssey4meyeah, that certainly is a good review guideline13:03
evrardjpodyssey4me: sorry I am back only now13:05
evrardjpyes it's I guess one of the two recent glance changes13:05
evrardjpI marked it in a commit13:05
odyssey4meevrardjp the issue should be solved by https://review.openstack.org/32899013:06
evrardjpI don't see that issue coming on my recently updated aio13:06
evrardjpok good13:07
evrardjpit makes sense13:07
evrardjpthanks for checking that for me13:07
evrardjp:D13:07
*** messy has joined #openstack-ansible13:07
thngodyssey4me: I got the same error after destroying container13:07
odyssey4methng attach into a container and check whether it has connectivity13:08
*** Zucan has joined #openstack-ansible13:08
odyssey4methng check that it can speak to DNS and resolve DNS13:08
odyssey4meyou're more than likely in a situation where you have duplicated IP addresses, or some other network connectivity problem13:09
thngoki I will try it13:09
odyssey4mehughsaunders evrardjp lol, it looks like jmccrory had already pushed a patch up to solve the same problem: https://review.openstack.org/32867113:12
odyssey4mewhich do you think is the better approach?13:12
odyssey4meI think I might prefer jmccrory's mechanism better.13:13
thngodysset4me : I think becasue there is no proxy settings in container. I have just attached to utility_container and done a apt-get install13:14
thngit didnot work13:14
odyssey4methng did you configure the proxy settings in user_variables? https://github.com/openstack/openstack-ansible/blob/master/etc/openstack_deploy/user_variables.yml#L137-L14613:15
odyssey4methng can you pastebin your user_variables for inspection?13:15
thngyes I did it13:16
thng## PROXY proxy_env_url: http://80.78.6.10:8080 no_proxy_env: "localhost,127.0.0.1,{% for host in groups['all_containers'] %}{{ hostvars[host]['container_address'] }}{% if not loop.last %},{% endif %}{% endfor %}" global_environment_variables:   HTTP_PROXY: "{{ proxy_env_url }}"   HTTPS_PROXY: "{{ proxy_env_url }}"   NO_PROXY: "{{ no_proxy_env }}"   http_proxy: "{{ proxy_env_url }}"   https_proxy: "{{ proxy_env_url }}"   no_pr13:16
odyssey4mejmccrory automagically cloudnull d34dh0r53 stevelle mattt hughsaunders andymccr mhayden can we get another review on https://review.openstack.org/328671 please?13:16
evrardjpodyssey4me: I think this is the best approach13:18
evrardjpbut to be honest, it's almost the same13:18
* mhayden looks13:18
evrardjpodyssey4me: do you abandon your change?13:19
odyssey4methng can you please pastebin it instead of just pasting it here13:19
odyssey4meevrardjp yes, I think jmccrory's is better13:19
evrardjpwhen we are at speaking about plugins13:20
evrardjpwhat do you think of using ARA callbacks?13:20
evrardjphttps://github.com/openstack/ara13:20
mhaydenodyssey4me: hah, checked commas a hundred times in that diff13:21
mhayden:P13:21
*** oneswig has joined #openstack-ansible13:21
*** tiagogomes has quit IRC13:21
mhaydensomething in the openstack ci gate image is preventing cron jobs from being provisioned13:22
odyssey4meevrardjp that looks like something good to submit tooling for in openstack-ansible-ops13:22
evrardjpodyssey4me: because that's what will be the successor of human log callback13:22
evrardjpit is13:22
evrardjpbut it could also be interesting for our gate stats13:23
odyssey4meevrardjp we can't really use it for the gate13:23
odyssey4meit requires a running database to view, so it has no value in the gate13:23
evrardjpnothing prevents using an external DB :D13:23
evrardjpbut ok13:23
odyssey4meit looks like dmsimard has done a good job there :)13:23
evrardjpalso it could be useful to just replace what we have13:24
evrardjpyou know him/her?13:24
evrardjpapparently its him13:24
odyssey4meI know dmsimard about as well as anyone else who lurks here. :) While he doesn't really work on OSA specifically, he does lurk and sometimes highlights issues coming up in Ansible or related to Ansible things. :)13:25
thngodyssey4me: http://pastebin.com/Vvpeqd2n13:25
evrardjpodyssey4me: ok13:26
*** Guest__ is now known as Bofu2U13:26
odyssey4methng can you attach into a container and check that /etc/environment has the appropriate content?13:27
thngYes I did, I will show you : http://pastebin.com/qg4sZ9ud13:30
openstackgerritMerged openstack/openstack-ansible-plugins: Optionally include image properties  https://review.openstack.org/32867113:30
odyssey4methng ok, so with that in place from inside a container can you curl a web address?13:31
thngyes13:33
odyssey4methng ok, and can you apt-get update?13:33
thngnope13:34
thnglike apt-get install13:34
odyssey4methng ok, have you configured the hosts to work through the proxy?13:34
thngI will try to add apt.conf for proxy to see13:34
thngyes13:34
*** Ashana has joined #openstack-ansible13:35
odyssey4methng ok, for newton we've implemented an automatic configuration of the containers in the same way as the host13:35
thngit works now if I add apt.conf13:35
dmsimardoh hai13:36
odyssey4mebut for mitaka you'll have to give it the extra apt config13:36
thngwhere can I do it ?13:36
dmsimardodyssey4me, evrardjp: let me know if you happen to have any questions about ara :)13:36
evrardjp:D13:36
evrardjptbh, I wanted to do something similar recently for a personal project of mine13:36
odyssey4methng you can have the correct files on your deployment host, then add them into this dict: https://github.com/openstack/openstack-ansible-lxc_hosts/blob/stable/mitaka/defaults/main.yml#L82-L8713:37
automagicallyMorning all13:37
*** permalac has quit IRC13:37
evrardjpdmsimard: without the web interface13:37
odyssey4methng that way all containers will contain the configs you want13:37
dmsimardevrardjp: oh, then do please contribute if you'd like :)13:37
evrardjpdmsimard: I'll be happy to talk with you about the callbacks, and what we can extend13:37
evrardjpcool13:37
dmsimardWe worked on the ARA gate jobs last week, ARA *just* joined the OpenStack umbrella13:38
dmsimardHere's our own integration tests output http://logs.openstack.org/65/327965/1/gate/gate-ara-integration-ubuntu-trusty/cefee0b/logs/build/13:38
evrardjpit maybe out of scope, so I'll discuss that later with you, but anyway I see good reasons to consume at least parts of it13:38
odyssey4medmsimard boo :( http://logs.openstack.org/65/327965/1/gate/gate-ara-integration-ubuntu-trusty/cefee0b/logs/build/playbook/index.html13:38
dmsimardhuh, what ? That worked before o_O13:39
dmsimardIt looks like some stuff got deleted13:39
evrardjp:D13:39
evrardjpit looks like it!13:39
evrardjpelse it's a nice html page13:39
thngodyssey4me : ok thanks. I will try to do it :)13:39
*** galstrom_zzz is now known as galstrom13:39
evrardjp:D13:39
odyssey4medmsimard ah, everything may have been targzipped - it happens after a few days13:39
dmsimardodyssey4me: interesting, so html stuff becomes html.gz ?13:40
dmsimarddidn't know that.13:40
odyssey4medmsimard all logs on the openstack-ci log servers get gzipped after a few days13:40
*** tiagogomes has joined #openstack-ansible13:41
dmsimardgood to know, I thought it was expected of jobs to gzip their own stuff13:41
odyssey4mehere's an example: http://logs.openstack.org/73/324173/7/gate/gate-openstack-ansible-dsvm-commit/c8d1dd9/13:41
odyssey4meyou can see there that anything in the logs dir is gzipped, but any subdirectories are not13:42
odyssey4meI do think that may be a bug though -they actually should be recursively compressing all files.13:42
*** schwicht has joined #openstack-ansible13:49
*** michaelgugino has joined #openstack-ansible13:49
*** flaviodsr has joined #openstack-ansible13:50
*** fedruantine has quit IRC13:50
dmsimardodyssey4me, evrardjp: here, this one isn't zipped http://logs.openstack.org/08/329008/1/check/gate-ara-integration-ubuntu-trusty/8fde562/logs/build/13:54
evrardjpgood13:55
evrardjp:D13:55
odyssey4medmsimard yeah, that's neat - far better than that horrible profiler callback13:55
evrardjpodyssey4me: that's why I talked to you about ARA !13:55
dmsimardthere's definitely a lot of UI/UX work needed to improve usability13:56
evrardjp:D13:56
dmsimardI'm exploring options but I'm definitely not a frontend guy13:56
evrardjpdmsimard: for my usage, it was drilling down to the variables13:56
evrardjpwhich is what this is doing13:56
*** tiagogomes has quit IRC13:56
odyssey4memy only wish is a more intelligent log output that automatically sees newlines and pretty-prints them properly13:56
dmsimardevrardjp: yeah but it requires too many clicks and stuff :)13:56
evrardjpodyssey4me: when you have the db and structure, I guess it's not that hard :D13:57
dmsimardodyssey4me: I think it was you or cloudnull but someone pulled my human_log plugin which does a better job at pretty printing stuff13:57
dmsimardit's not perfect but it's better13:57
dmsimardfor example: https://ci.centos.org/view/rdo/view/weirdo/job/weirdo-mitaka-periodic-packstack-scenario001/89/consoleFull13:58
odyssey4medmsimard yeah, I recall seeing that - as I recall we're in a bit of a stuck situation because we don't understand the licensing issues relating to callbacks and such13:58
dmsimardthe problem is that it doesn't suppress the verbose output, it prints the verbose output AND the pretty printed output so it's super confusing13:58
odyssey4mesee the comments in https://review.openstack.org/#/c/321331/13:58
odyssey4medmsimard yeah, what I was hoping for is something that only outputs stderror if there is content in it and the task has failed13:59
*** bsv has quit IRC13:59
dmsimardWe had some discussions around licensing in ARA recently with Ansible Inc, and Red Hat legal13:59
odyssey4medmsimard I was also thinking that stdout should also only be pretty printed if the task fails13:59
odyssey4medmsimard so the general idea is that you don't do verbose logging, and the human readable log will output the right things if/when you need them... not for everything14:00
dmsimardThis is definitely a recurring topic, I'll try and get them to put some clear guidelines out14:00
odyssey4medmsimard thanks, that would be most helpful - we need a clear set of guidelines about what Ansible bits can be included in OpenStack projects14:00
odyssey4mewhatever is put together needs to be clear and cover each of the plugin types - libraries, callbacks, etc14:01
odyssey4mewe need to know definitively whether the license is compatible to include in an OpenStack project14:01
*** TxGirlGeek has joined #openstack-ansible14:03
*** adrian_otto has joined #openstack-ansible14:05
odyssey4mealextricity25 happy to see you putting your review capacity to good use :)14:05
alextricity25hehe14:08
*** tiagogomes has joined #openstack-ansible14:08
dmsimardodyssey4me: fwiw you're including a GPL project in your requirements.txt of openstack-ansible :)14:09
dmsimardnitpicking on a callback sounds odd to me in that context14:10
*** gregfaust has joined #openstack-ansible14:10
odyssey4medmsimard as I understand it there's a difference between adding a package requirements versus subclassing an object14:11
dmsimardI see.14:11
odyssey4meas I understand it using a package does not result in license contamination, but subclassing does14:11
odyssey4mewhen we last looked into this, the feedback we got was that Ansible libraries are fine because they stand alone... but Ansible callbacks have license contamination due to the subclassing14:12
*** Mudpuppy has joined #openstack-ansible14:13
dmsimardI can't quite share the info I have since it's not the same context and IANAL and all that, I poked the beehive to try and see if we can come up with some clear guidelines14:13
dmsimardThe gist of the issue is that the definition of "code linking" is mostly up to interpretation in GPLv314:13
dmsimardThe Zuulv3 callbacks are GPL'd but then again it's not a "big tent" project14:14
odyssey4medmsimard yeah, I hate licensing... I personally think that patenting (the root cause for the need of licensing) in software is stupid. I wish that licensing would die in a fire.14:14
dmsimardARA callbacks are Apache v2 (hence why the topic came up internally) and they'll stay that way for the time being14:15
odyssey4meok, so that's where we need clarity14:15
dmsimardhowever, that particular callback originates from a GPL open sourced plugin anyway (author GPL'd it and I improved on top of what he did)14:16
dmsimardso I doubt we'd be able to change the licensing on that particular one14:16
evrardjpsorry I was busy, I didn't see the rest of the conversation14:16
evrardjpyes indeed, you can write filters etc without caring about the license, because you're not importing ansible code14:17
evrardjpwhich isn't the case for callbacks14:17
evrardjpat least that's what I understood14:17
odyssey4meI know that we can easily consume a callback regardless of the licensing. So if your callback was hosted somewhere we could just pull it in from there. The things we need clarification on is whether we really can have an Apache2 license for a callback (or whatever plugin/library) and whether we can hold something with a different license in our repo. As far as I know the second question is already answered by14:17
odyssey4me https://wiki.openstack.org/wiki/LegalIssuesFAQ#Licensing_of_library_dependencies14:17
openstackgerritIan Cordasco proposed openstack/openstack-ansible: Use correct keystone auth parameters  https://review.openstack.org/32843014:18
openstackgerritIan Cordasco proposed openstack/openstack-ansible: Use correct keystone auth parameters  https://review.openstack.org/32843214:18
evrardjpthe problem, ppl use GPL, and they don't know how to use this14:18
evrardjpLGPL should have been used14:19
evrardjpor another license :p14:19
evrardjpanyway14:19
evrardjpI'm not a lawyer14:19
evrardjp:p14:19
*** TxGirlGeek has quit IRC14:20
*** TxGirlGeek has joined #openstack-ansible14:20
*** permalac has joined #openstack-ansible14:21
*** TheIntern has joined #openstack-ansible14:22
odyssey4medmsimard thanks for poking the hornets nest :)14:22
dmsimardhornets ? bah. bees. honey bees. hard workers :)14:22
openstackgerritMerged openstack/openstack-ansible-os_aodh: Convert default from MongoDB to MySQL storage  https://review.openstack.org/32851014:22
*** TxGirlGeek has quit IRC14:25
*** TxGirlGeek has joined #openstack-ansible14:27
*** spotz_zzz is now known as spotz14:27
*** TxGirlGeek has quit IRC14:29
*** TxGirlGeek has joined #openstack-ansible14:30
*** fedruantine has joined #openstack-ansible14:31
*** sigmavirus24_awa is now known as sigmavirus2414:32
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts: Implement base container for overlayfs-backed containers  https://review.openstack.org/32902914:38
odyssey4mealextricity25 stevelle I expect that the os-aodh-install playbook may require some db tasks to go with https://review.openstack.org/328510 ?14:39
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts: Implement base container for overlayfs-backed containers  https://review.openstack.org/32902914:41
*** galstrom is now known as galstrom_zzz14:42
*** jthorne has joined #openstack-ansible14:45
*** sacharya has joined #openstack-ansible14:47
evrardjpodyssey4me: overlayfs <314:51
odyssey4meevrardjp yeah, I did some testing with it over the weekend and it's pretty awesome14:54
evrardjpyup14:54
odyssey4meusing overlayfs for the AIO should cut the build time by 10-15 mins14:54
evrardjpI got issues on the past with locks 'though14:54
*** gparaskevas has quit IRC14:54
evrardjpbut I think it's kinda perfect for our use case14:55
odyssey4mewe can try it out for the AIO for a while and see how it goes, but if we find it works well then I think we should consider making it the only way we deploy containers14:55
odyssey4meit'll totally change how we deploy packages, do upgrades, etc14:55
*** phalmos has joined #openstack-ansible14:56
alextricity25odyssey4me: You're right. Originally we planned on the deployer already having the DB and DB users setup in MongoDB, but now that we are using MySQL it would be good to make that part of the playbooks14:57
odyssey4mealextricity25 can you whip up a patch for that quickly, seeing as I expect that with that patch merged it might cause a gate blocker14:58
*** permalac has quit IRC14:58
*** Ashana has quit IRC14:58
alextricity25odyssey4me: sure thing!14:58
*** KLevenstein has joined #openstack-ansible14:58
*** galstrom_zzz is now known as galstrom14:58
odyssey4meevrardjp I think that perhaps we could also use lvm snapshots to improve any deployments using lvm-backed containers15:00
odyssey4mebut I'll test that out another time - I just want to push some patches in which enable overlayfs for now15:00
evrardjpwe are using flat files to store that15:01
evrardjpit's not that great15:01
evrardjpfor using lvm snapshot backend feature IIRC15:01
evrardjpbut yes, the most important point is to create this container, at a stopped state, to use it for differentials15:02
*** kstev has joined #openstack-ansible15:02
evrardjpit increase the storage needed to start (one more container) but it also decreases afterwards (just the diff)15:02
evrardjpbut bringing this needs careful maintaing later: how do we updates the basic container?15:03
*** michaelgugino has quit IRC15:03
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_container_create: Implement overlayfs-backed containers  https://review.openstack.org/32904515:04
evrardjpmy point would be, shouldn't we use the template of the other containers, instead of having a new one?15:04
openstackgerritMajor Hayden proposed openstack/openstack-ansible: Destroy repo containers before upgrade  https://review.openstack.org/32848515:05
evrardjpnot "template", cache or something15:05
odyssey4meevrardjp I did some tests yesterday. The base container can be changed, and the changes are reflected in the implemented containers, but I actually think that it would be better for us to move towards considering the containers more disposable.15:05
odyssey4meSo basically for major upgrades we should be deleting all containers and building them off a fresh base container.15:06
*** zerda2 has joined #openstack-ansible15:06
*** michaelgugino has joined #openstack-ansible15:07
evrardjpodyssey4me: In all cases, they should be diposed of on a regular basis15:07
evrardjpelse the overhead becomes too big15:07
odyssey4meyeah, with overlayfs I actually think it's quite practical for us to destroy all containers even in patch upgrades15:07
evrardjpI'm just thinking of a way to quickly benefit from os changes (ssh security update for example) without a need of rebuilding15:08
*** thng has quit IRC15:08
odyssey4meas long as the container IP's don't change (as this impacts external LB configuration) I think that moving towards full container disposability is a great way to get rid of some of the issue we're seeing in upgrades15:09
evrardjpI fully agree15:09
evrardjpbut I still don't get why we don't do that on the container that is using as base for the other containers15:10
evrardjpthe cache container if I recall the name correctly15:11
odyssey4meevrardjp well, that's what I'm thinking - if we're disposing of containers regularly then there's no reason why we can't implement a fresh base container perhaps even for each tag, we then destroy and rebuild the containers using that base in serial (to maintain uptime)15:11
openstackgerritMajor Hayden proposed openstack/openstack-ansible: Fix keystone DB Access variable  https://review.openstack.org/32766015:12
*** permalac has joined #openstack-ansible15:13
evrardjpI think we agree, but we are not speaking about the same things15:13
odyssey4meevrardjp if we do that then we're always in a place where all containers are always up to date, without even trying15:14
evrardjpI agree15:15
evrardjpIt's good to do it that way15:15
evrardjplet me read the lxc_hosts again to be sure my idea isn't stupid15:15
odyssey4meevrardjp I did try something else though - I implemented a trusty base container on xenial, then created an overlayfs-backed container based on a snapshot of the base... then I chrooted into the base container and upgraded it to Xenial15:15
*** weezS has joined #openstack-ansible15:16
odyssey4meafter a reboot of the overlayfs-backed container it actually showed that it was now a xenial container15:16
odyssey4meI was surprised that it worked so well.15:16
evrardjpyou mean you're surpised the ubuntu upgrade works ?15:16
evrardjpor you're suprised overlayfs works?15:16
evrardjpbecause I'm super confident in the latter :p15:16
odyssey4meevrardjp FYI the container 'cache' (ie the rootfs that all containers use as the base) is refreshed every single time the lxc_hosts role is executed15:17
evrardjpalso because it's been a long time I'm using it too15:17
evrardjpodyssey4me: YUP15:17
evrardjpthat's why!15:17
evrardjpI mean15:17
evrardjpthat's why I would rather have it there15:17
odyssey4meevrardjp nah, I was just surprised that even though I'd installed some packages in the container from trusty everything still worked15:18
odyssey4meobviously my packages needed an upgrade15:18
evrardjpevery single time you run, you have the latest cache, which makes it easy for security updates15:18
evrardjpthat was my whole point15:18
evrardjpodyssey4me: it's FS :D15:18
evrardjpit has bitten me a few times 'though15:19
odyssey4meevrardjp yeah, so we can't really do it in the cache - it'd have to be done by updating the base container on which all the containers are based15:19
evrardjpthat's what I don't get15:19
evrardjpoh you mean the clean cache container ?15:20
evrardjpbut it doesn't matter15:20
odyssey4meevrardjp the base container is supposed to be immutable, so I think a better process is to build fresh base containers regularly and the roll rebuilds of all the containers based on the new fresh base15:20
alextricity25odyssey4me: The aodh-dbsync script runs the initial database bits15:21
odyssey4meI did some some stuff which we'd have to change if we want to work this way - we'd have to try to limit the unnecessary changes we make in the container itself. For example, we shouldn't be running 'apt-get update' in the container - we should do it in the base instead.15:21
alextricity25odyssey4me: I don't think there is anything else to do apart from that. Did you have something else in mind?15:22
evrardjpI guess we have a problem of vocabulary here15:22
evrardjpbase is the container you are creating again in your last commit, while cache is the one you consider clean downloaded and stopped15:22
evrardjpright?15:23
odyssey4mealextricity25 hmm, I think you're missing the point - essentially we need the tasks as are present in https://github.com/openstack/openstack-ansible/blob/master/playbooks/os-cinder-install.yml#L146-L173 to also be in https://github.com/openstack/openstack-ansible/blob/master/playbooks/os-aodh-install.yml15:23
odyssey4mealextricity25 the issue is that there is no aodh db or db user in mysql right now15:23
alextricity25Ah. That's right15:24
alextricity25Thanks odyssey4me15:24
evrardjpalextricity25: also please change the doc that goes with it if it's an IRR (not the case here)15:24
evrardjpbut this way you don't forget :p15:24
*** jmckind has joined #openstack-ansible15:24
odyssey4meevrardjp the container cache is just a zipped tarball of the rootfs, the base container is the one created as a basis for the snapshot15:24
evrardjpodyssey4me: you agree with my terminology ?15:24
evrardjpok15:24
evrardjpThat's the issue15:24
evrardjplet's rollback to explanation15:24
evrardjpWHAT IF15:25
evrardjpwe download a container (the container cache), this container having overlayfs as backing store. Then we do stuff, but don't zip the tarball15:25
evrardjpwe keep the container as it is, and you've got your "base" template15:26
*** weshay is now known as weshay_lunch_brb15:26
*** Drago has joined #openstack-ansible15:27
evrardjpif you want to transfer to multiple nodes, you can still compress-send/decompress-receive on nodes15:27
mhaydendarrenc: you around?15:27
*** Drago has quit IRC15:27
*** Drago has joined #openstack-ansible15:27
odyssey4meyeah, I looked into that - the trouble with implementing a folder which is used as the backing for overlayfs for the containers is that lxc has no control mechanisms for it - so you may completely break that folder... the way I'm doing it now there are protections in place implemented by LXC15:27
evrardjpoh15:28
evrardjpthat's where I am lacking the docs15:28
odyssey4mebut yeah, I did think of that - but it's a complete break of the process we have right now, and I'd rather we didn't break the process until we're certain that we want to move over to this method as *the* method for all production environments15:28
evrardjpit's not really a change, we just don't notify the Destroy base container :D15:29
odyssey4mesomething that we could do as a neat extension of this idea is to actually prep different base containers for each service15:29
*** johnmilton has joined #openstack-ansible15:30
evrardjpyou mean an upper overlay or a different base ?15:30
evrardjpI mean, using a different lowerdir, or have a higher lowerdir15:30
odyssey4meevrardjp yeah, it can be that simple but I didn't want to use LXC_NAME as the base container - I wanted something that's a bit more explicitly named15:31
evrardjpOMG terminology will be difficult15:31
evrardjpodyssey4me: understood then15:31
odyssey4meevrardjp well, it seems that LXC can't use more than one layer at this stage15:31
evrardjpwhat?15:31
evrardjpthat sucks15:31
odyssey4menot that I could see - but I didn't try very hard15:31
evrardjpfplay15:32
evrardjplet me get info on this15:32
odyssey4mebut it'd be quite nice to have the repo server hold a set of base images which could be used for all container builds15:32
evrardjpwe are reinventing docker registry !15:33
evrardjp:p15:33
*** al_loew has joined #openstack-ansible15:33
odyssey4meso we could layer base + nova software = nova-base15:34
evrardjpexcept docker used AuFS which was supposed to be doomed15:34
evrardjpI hate aufs15:34
evrardjp:p15:34
odyssey4methen the deploy is to deploy a nova-base, then simply to configure things on it (no software install takes place)15:34
evrardjpodyssey4me: yeah, I'll get info on this, because I never runned with multiple bases for lxc15:34
evrardjpI had that for other things though15:34
*** johnmilton has quit IRC15:35
*** TxGirlGeek has quit IRC15:35
*** javeriak has joined #openstack-ansible15:35
*** agireud has quit IRC15:36
odyssey4mewell, deploy nova-base - then create containers based on that as a snapshot, then configure the software in the containers (but no need to install any software)15:36
odyssey4merumour has it that iscsi may work from inside a container in xenial15:36
evrardjpThis is like a completely different process15:36
*** mikelk has quit IRC15:37
odyssey4meyeah, but we wouldn't have to change all that much15:37
odyssey4methe tasks in the roles can stay as-is... we'd just have to change the playbooks15:37
odyssey4methe tasks in the role to install the software would just need to be properly idempotent so that the software installs just end up being noops because the software's already there15:38
evrardjpanyway, I don't think it's a good idea to allow the change of the backingstore without a proper recent kernel15:38
evrardjpmaybe we should have a check for that15:38
*** agireud has joined #openstack-ansible15:38
evrardjpor at least a note15:38
odyssey4meyeah, I was thinking about implementing that - but I made sure that it was noted in the release notes.15:38
*** fedruantine has quit IRC15:38
evrardjpbecause 3. is definitely not as good as recent ones on overlayfs15:39
evrardjpok15:39
evrardjplet me review then15:39
evrardjp:D15:39
odyssey4meI want to use this for the AIO, even on trusty, so I didn't want to put a check in place that hard failed.15:39
evrardjpgood we aren't moving that much files around15:39
evrardjp(just create/copy and delete)15:40
*** admin0 has quit IRC15:41
evrardjpquick question, where do you plan to define the FS?15:42
evrardjpbecause here, we just create the thing in a dir, so I guess the mount is lacking15:43
*** javeriak_ has joined #openstack-ansible15:43
*** tiagogomes has quit IRC15:44
*** javeriak has quit IRC15:44
*** weshay_lunch_brb is now known as weshay15:45
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_container_create: Implement overlayfs-backed containers  https://review.openstack.org/32904515:47
*** johnmilton has joined #openstack-ansible15:47
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Implement overlayfs as the backing store for the AIO  https://review.openstack.org/32906615:47
michaelguginoodyssey4me: if you could look at https://review.openstack.org/#/c/324045/ I would appreciate it.  Tempest check is failing in the CI environment complaining about availability zone, but I cannot replicate the failure locally15:47
*** tiagogomes has joined #openstack-ansible15:48
evrardjpodyssey4me: it's 3.18 btw IIRC15:48
evrardjphaha: https://en.wikipedia.org/wiki/OverlayFS15:48
odyssey4meevrardjp ok, please note that in the review so that I change the comments - I was just going off the info provided in the footnotes of https://www.hastexo.com/blogs/florian/2016/02/21/containers-just-because-everyone-else/15:49
odyssey4meevrardjp what do you mean the mount is lacking? the container create implements the overlayfs mount all on its own15:49
evrardjpI like this title15:49
automagicallymhayden Can you give this a quick review at some point today? https://review.openstack.org/#/c/327331/15:49
odyssey4meevrardjp you'll see the container has a config line like: lxc.rootfs = overlayfs:/var/lib/lxc/cache/rootfs:/var/lib/lxc/container1/delta015:50
automagicallyI appreciate all your other reviews15:50
evrardjpodyssey4me: haha that's what I did home exactly for the same purpose at home. Love this post already!15:50
evrardjpor close15:50
evrardjpodyssey4me: didn't see the line in the commit15:50
evrardjpwill re-review15:51
evrardjpthanks for the explanation15:51
*** TxGirlGeek has joined #openstack-ansible15:52
odyssey4meevrardjp no, it's not in the commit - it's just how lxc configures it when you do the lxc-clone based on a snapshot and implement overlayfs as the backing store15:52
odyssey4meit's really, really simple - lxc does all the heavy lifting15:52
evrardjpoh yes, true it does that15:54
evrardjpmy bad15:54
evrardjplike I said, I'm mostly using that on host directly... I had that setup long ago and then I forgot :p15:54
evrardjpit just works so transparently...15:55
*** sacharya_ has joined #openstack-ansible15:55
odyssey4mewell, if we can get that series of patches merged I think it'll be quite interesting15:55
evrardjpgood to have a technology refresh once in a while :D15:55
*** TheIntern has quit IRC15:56
*** TheIntern has joined #openstack-ansible15:56
openstackgerritMajor Hayden proposed openstack/openstack-ansible-security: Docs: Specify supported distributions  https://review.openstack.org/32907215:57
openstackgerritMerged openstack/openstack-ansible: Use default metadata_backlog value from Neutron  https://review.openstack.org/32850315:57
*** sacharya has quit IRC15:58
evrardjpmhayden: do you need this to merge at some point? https://review.openstack.org/#/c/310067/215:59
mhaydenautomagically: lookin'16:05
mhaydenautomagically: i'll trade you for a gander at https://review.openstack.org/32907216:05
*** tiagogomes has quit IRC16:06
mhaydenevrardjp: i do, but i think that rolls into my bigger problem of "i need to figure out logging"16:06
evrardjpara ? :D16:06
mhaydenpossibly16:06
evrardjp:p16:06
mhaydeni'm eager to get something that is easy to import into a siem... perhaps CSV for that16:07
mhaydenwell a SIEM or a vulnerability management platform16:07
evrardjpmakes sense16:07
evrardjpbut you'll need to link the inventory16:07
evrardjpfor that to makes sense16:07
evrardjpit is a whole new world I guess16:07
evrardjpdmsimard: is csv export possible with ARA?16:07
evrardjpelse mhayden building docs for security role gives a serious load of warnings16:09
evrardjpdocuments not included in any toctree16:09
mhaydenyeah, that's on my list of to-do's... sphinx complains about that16:09
mhaydeni have a special way of including everything16:09
evrardjpok you're already ware of it16:09
mhaydenwhich throws off sphinx16:09
dmsimardevrardjp: I've never really tried poking around csv stuff, technically the ARA cli is built on top of cliff (same python framework as python-openstackclient) so if you do "-f csv" to any command it *should* work16:10
dmsimardevrardjp: otherwise, you could probably export the database (sqlite or mysql) as csv and do things with it16:10
dmsimardevrardjp: what's your use case around wanting csv ?16:11
evrardjpnot mine, for mhayden16:11
evrardjphe is looking about improving his ansible playbooks run reporting16:11
*** electrofelix has quit IRC16:11
*** TxGirlGeek has quit IRC16:12
evrardjpnot pushing anything, just trying to make ppl work together if possible16:12
mhaydendmsimard: long story short, i'm looking to generate some logs from the security role that could tell a deployer, or a deployer's security team, about which stig configurations were applied to an openstack environment16:13
mhaydento hand over to an auditor and/or corp security team16:13
evrardjpand the tasks with the stig configurations are marked with tags in ansible, right?16:13
evrardjp(for ease of understanding for everyone)16:13
odyssey4mehughsaunders you may find https://review.openstack.org/#/q/status:open+topic:overlayfs-implementation interesting :)16:16
evrardjpI think he has left for today16:17
dmsimardmhayden, evrardjp: hm, we don't give tags any special treatment in ara right now, it's probably a good idea to leverage tags somehow.16:17
flaviodsrodyssey4me I have checked and the sahara role is already using the multi-distro framework btw16:19
mhaydendmsimard: yeah, i'm thinking about registering a variable that i could use to make a log at the end16:19
*** woodard_ has quit IRC16:20
evrardjpdmsimard: I think tags should appear if possible, somehow :D16:20
*** woodard has joined #openstack-ansible16:20
dmsimardevrardjp: yes, it's a good idea I'm taking notes16:20
evrardjpI'll read ARA's code, I hope soon, but it's not gonna be until at least 2 week-ends :/16:21
*** woodard has quit IRC16:21
*** tiagogomes has joined #openstack-ansible16:21
*** woodard has joined #openstack-ansible16:21
mhaydenautomagically: reviewed the vagrant file stuff16:21
mhaydeni guess i should check out this vagrant thing16:21
mhaydenthen again, virtualbox makes me cry tears16:22
dmsimardevrardjp: I like to think it's a fairly simple application16:22
evrardjphow does playbook nesting work? if the playbook was an include of another one, would it be the invokee that will log the tasks/data?16:22
evrardjpjust curious16:23
*** michaelgugino has quit IRC16:24
dmsimardRight now we're working on making role and includes more obvious (and filter-able in general) and file-based task filtering. I used to have a playbook for a project that included other playbooks but I got rid of that.16:25
dmsimardAs far as ARA is concerned, it'd probably record that as being just one playbook16:25
dmsimardBut it's an interesting thought, I'll try and test it16:25
evrardjpthat's what I would have thought16:25
dmsimardIt'd be one playbook but multiple plays16:25
dmsimardJust like they'd be in the same file16:26
dmsimardand you'd see the include tasks.16:26
evrardjpyes, that's what I thought too16:26
evrardjpit is what ansible is doing and reporting anyway16:26
dmsimardevrardjp: http://logs.openstack.org/08/329008/1/check/gate-ara-integration-ubuntu-trusty/8fde562/logs/build/playbook/63127a1a-acf7-48ec-93a4-6186eb706113/index.html16:26
dmsimardThis is an example of playbook with different plays16:26
dmsimardIf you drill down on the details of each play, you see the tasks related to it16:26
dmsimardYou can see the beginning of the work we started around file-based filtering here http://logs.openstack.org/08/329008/1/check/gate-ara-integration-ubuntu-trusty/8fde562/logs/build/playbook/63127a1a-acf7-48ec-93a4-6186eb706113/file/index.html16:27
dmsimardWe're storing the content of the files now too, so eventually we'll have a UI for that, maybe even diffing files across runs (i.e, to try and tell what changed between two runs to see what failed)16:28
evrardjpyes, I understand, that's what I expected16:28
*** TxGirlGeek has joined #openstack-ansible16:28
*** fedruantine has joined #openstack-ansible16:28
evrardjpdmsimard: ahah that's the feature I wanted to implement for my home project16:28
evrardjpgood :D16:28
*** alikins has joined #openstack-ansible16:29
*** johnmilton has quit IRC16:30
*** metral_zzz is now known as metral16:32
*** tiagogomes has quit IRC16:36
*** mummer has joined #openstack-ansible16:37
openstackgerritNolan Brubaker proposed openstack/openstack-ansible: Address low-hanging TODO items  https://review.openstack.org/32909816:38
*** pcaruana has quit IRC16:38
openstackgerritNolan Brubaker proposed openstack/openstack-ansible: Address low-hanging TODO items  https://review.openstack.org/32909816:39
mhaydendo your items hang low, can you swing them to and fro16:41
*** al_loew has quit IRC16:43
mhaydenautomagically: your vagrant stuff looks good -- hopefully the middle ground makes sense16:46
*** michaelgugino has joined #openstack-ansible16:46
*** M00nr41n has joined #openstack-ansible16:47
*** zerda2 has quit IRC16:49
*** tiagogomes has joined #openstack-ansible16:50
*** bbmbx__ has quit IRC16:51
*** bbmbx__ has joined #openstack-ansible16:51
*** Drago has quit IRC16:52
*** woodard_ has joined #openstack-ansible17:00
*** woodard has quit IRC17:03
*** kstev has quit IRC17:05
*** sacharya has joined #openstack-ansible17:13
*** sacharya_ has quit IRC17:13
*** Zucan has quit IRC17:15
*** sacharya_ has joined #openstack-ansible17:16
*** Drago has joined #openstack-ansible17:17
*** sacharya has quit IRC17:19
*** Drago has quit IRC17:19
*** Drago has joined #openstack-ansible17:19
*** scarlisle has joined #openstack-ansible17:20
*** TheIntern has quit IRC17:32
*** gregfaust has quit IRC17:32
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_sahara: Use master git branches  https://review.openstack.org/32912317:34
michaelguginoI think I figured out what's going on with my Nova patch for 16.0417:35
michaelguginoLooks like the handler is only firing once for the openstack host, and not the localhost (where the compute service lives)17:36
jmccrorypalendae: have you looked into adding tests around osa-plugins?17:36
michaelguginowhich makes about zero sense... must be a bug in ansible, that's the only thing I can guess17:38
michaelguginoalthough, I'm not seeing the problem locally.17:39
*** pcaruana has joined #openstack-ansible17:39
michaelguginohmm, looks like it's trying to setup UCA repo and failing...17:41
michaelguginowell, that's interesting.  It was automatically rebasing my patch in gerrit :/17:44
openstackgerritMichael Gugino proposed openstack/openstack-ansible-os_nova: Implement Xenial Support  https://review.openstack.org/32404517:46
*** TheIntern has joined #openstack-ansible17:47
palendaejmccrory, I haven't looked at it yet17:49
openstackgerritMerged openstack/openstack-ansible-memcached_server: Cleanup/standardize usage of tags  https://review.openstack.org/32830917:49
palendaejmccrory, I'd think the first step would be adding in relevant tox info and then setting up imports17:49
*** fedruantine has quit IRC17:51
*** weezS has quit IRC17:52
evrardjpodyssey4me: I replied to your concern for https://review.openstack.org/#/c/328274/317:54
evrardjpjmccrory: I think osa-plugins could have a proper rewrite17:54
*** Drago has quit IRC17:55
evrardjpproper testing, but also proper CRUD operations for anything we are doing (for example modules)17:55
evrardjpproper for anything we are doing, and proper CRUD idempotency for modules*17:55
evrardjpdarn it I can't write!17:56
*** raddaoui has joined #openstack-ansible17:56
*** weezS has joined #openstack-ansible17:57
*** albertcard has joined #openstack-ansible17:57
*** kstev has joined #openstack-ansible17:58
*** jthorne has quit IRC17:59
*** TxGirlGeek has quit IRC17:59
jmccroryevrardjp: hoping to eventually be able to just remove some of the libraries for ansible 2 modules as well, glance -> os_image for example17:59
*** jthorne has joined #openstack-ansible17:59
mhaydenso there are three hotels here in SAT that will give special rates (around $100/night) for the mid-cycle18:00
mhaydenand one provides a free shuttle to/from Rackspace's HQ18:00
palendaeyeah, conributing to and using the upstream ones would be great18:00
palendaemhayden, lemme guess, Aloft?18:00
mhaydensi18:00
mhaydenthere's also the Valencia and one other18:00
*** saneax is now known as saneax_AFK18:01
mhaydeni'm wondering if we could cobble together some funds from the locals to do a cookout18:01
mhaydeni don't mind offering up my place for that18:01
evrardjptrue18:03
*** jthorne has quit IRC18:04
evrardjpjmccrory: and with 2.1 a few modules were improved, I should read them to see the extend of the improvements18:04
*** cloader89 has joined #openstack-ansible18:06
*** jthorne has joined #openstack-ansible18:06
*** Zucan has joined #openstack-ansible18:07
*** TxGirlGeek has joined #openstack-ansible18:17
openstackgerritMiguel Alex Cantu (alextricity25) proposed openstack/openstack-ansible: Configuring AODH DB now that it uses MySQL.  https://review.openstack.org/32913618:17
*** Drago has joined #openstack-ansible18:19
*** sdake_ has joined #openstack-ansible18:23
openstackgerritMiguel Alex Cantu (alextricity25) proposed openstack/openstack-ansible-os_aodh: AODH dbsync script needs pymongo  https://review.openstack.org/32913718:23
openstackgerritMiguel Alex Cantu (alextricity25) proposed openstack/openstack-ansible: Configuring AODH DB now that it uses MySQL.  https://review.openstack.org/32913618:24
openstackgerritMajor Hayden proposed openstack/openstack-ansible-security: Fix documentation warnings from sphinx  https://review.openstack.org/32913918:29
*** TxGirlGeek has quit IRC18:31
*** TxGirlGeek has joined #openstack-ansible18:32
*** berendt has joined #openstack-ansible18:33
stevellethanks alextricity25 for those18:33
openstackgerritMajor Hayden proposed openstack/openstack-ansible-security: Fix documentation warnings from sphinx  https://review.openstack.org/32913918:36
*** TxGirlGeek has quit IRC18:42
*** fedruantine has joined #openstack-ansible18:43
*** TxGirlGeek has joined #openstack-ansible18:43
*** Zucan has quit IRC18:49
openstackgerritMajor Hayden proposed openstack/openstack-ansible-security: Fix documentation warnings from sphinx  https://review.openstack.org/32913918:50
stevellealextricity25: I'm not seeing that failure.18:51
alextricity25stevelle: Really...hmmm..are you using virtualenvs?18:51
stevellealextricity25: yes18:51
stevellehttps://gist.github.com/stevelle/43e5873807f9432b397bdfe5132f3a4b18:52
alextricity25This is what I'm seeing:18:52
alextricity25http://paste.openstack.org/show/515798/18:52
alextricity25Oh wow that formatting18:53
stevellealextricity25: that's a full OSA, and that isn't using mysql b/c of group vars, right?18:54
openstackgerritMajor Hayden proposed openstack/openstack-ansible-security: Add key fields to audit rules  https://review.openstack.org/32828818:54
alextricity25Hmm...let me check something18:55
alextricity25stevelle: you're right18:57
stevellejmccrory gets the credit18:57
stevellesee his comment on /329136/118:58
alextricity25stevelle: nice. hey...are we getting rid of the aodh_db_port variable all together18:59
alextricity25?18:59
alextricity25https://review.openstack.org/#/c/328510/7/defaults/main.yml19:00
stevellealextricity25: I am inclined toward it, tough call whether to retain and fix the default or not19:00
alextricity25that works for me :)19:00
mhaydenjmccrory: thanks for the quick look -- this review should be identical https://review.openstack.org/32828819:00
alextricity25urgggg...but that should probably be configurable, no? What if the deployer wants AODH to use a different db?19:01
alextricity25on a different port19:01
jmccrorymhayden: cool, got it19:02
mhaydenthanks!19:03
mhaydenevrardjp: i went through the security role docs and fixed the warnings -> https://review.openstack.org/32913919:03
evrardjpoh thank you !19:03
evrardjpI'm sorry but it's Belgium playing today @Euro, I can't review19:05
evrardjplater :D19:05
stevellealextricity25: aodh_db_address: "mongodb:27017"19:05
stevelleez user_var19:05
alextricity25try!19:05
alextricity25true*19:05
stevellealextricity25: work remaining is to write the upgrade step to run the migration, I'll submit a release note today19:08
stevellethat after we get the playbook / group_vars fixed19:08
alextricity25stevelle: Great! Thanks! I'll update my commit to make the group_var changes.19:08
alextricity25I'm doing that now19:09
*** javeriak has joined #openstack-ansible19:12
*** javeriak_ has quit IRC19:15
alextricity25stevelle: Should aodh_db_address here be "aodh_galera_address"?19:20
alextricity25https://review.openstack.org/#/c/328510/7/defaults/main.yml19:20
alextricity25should I set it like so in defaults/main.yml: aodh_db_address: {{ aodh_galera_address }}19:21
stevelleerrr, um, that won't work as typed :)19:25
openstackgerritMajor Hayden proposed openstack/openstack-ansible-security: Docs: Specify supported distributions  https://review.openstack.org/32907219:25
alextricity25aodh_db_address: "{{ aodh_galera_address }}"?19:26
stevellealextricity25: remove them from group_vars, they shouldn't be needed19:28
stevellethe galera vars should declared locally in the playbook, like other roles19:28
*** bsv has joined #openstack-ansible19:28
openstackgerritAmy Marrich (spotz) proposed openstack/openstack-ansible-security: Docs: Specify supported distributions  https://review.openstack.org/32907219:30
alextricity25stevelle: Okay I see. At this point it will connect to galera the exact same way all other services do19:32
alextricity25stevelle: Maybe we should get rid of "aodh_db_type" all together19:33
stevellealextricity25: from group vars, yes19:33
openstackgerritChristopher Hultin proposed openstack/openstack-ansible-os_magnum: Specifying Keystone Authentication Version  https://review.openstack.org/32916219:34
openstackgerritMajor Hayden proposed openstack/openstack-ansible: [WIP] Update lists of skipped security role tasks  https://review.openstack.org/32773219:37
chris_hultinmhayden: Yep, just another small little 'gotcha' we're running into with Magnum.19:38
alextricity25stevelle: Were you testing against a local mysql DB or galera?19:44
*** woodard_ has quit IRC19:44
stevellelocal19:44
palendaemhayden, automagically Have we seen other patches need this many rechecked? https://review.openstack.org/#/c/325380/19:44
*** javeriak has quit IRC19:44
alextricity25Ahhhh okay19:44
stevelleit was containered though19:44
*** woodard has joined #openstack-ansible19:45
alextricity25Should we have to connect to galera by default you think?19:45
mhaydenpalendae: i have seen a few take that many19:45
stevellealextricity25: that's why the role has mysql+pymysql default now19:45
mhaydenhowever, something is slow in gate-land because even odyssey4me's overlayfs patch is taking a while19:45
*** woodard has quit IRC19:45
stevelleonly reason any of that was in group vars before was because mongo19:46
*** woodard has joined #openstack-ansible19:46
palendaemhayden, Recently? Just wanna make sure that change didn't introduce additional time, even if that's unlikely19:46
alextricity25stevelle: I'm getting this strange error when I run aodh-dbsync19:46
mhaydenpalendae: i'd be surprised if it did, but anyhting is possible19:46
alextricity25ERROR aodh NoMatches: No 'aodh.storage' driver found, looking for ''19:46
alextricity25THat's when I try to connect to galera19:46
palendaemhayden, Ok. Just to be safe I'm gonna run some local tests for speed of head of master vs that19:46
palendaeInventory should generally be a tiny fraction of runtime, but seeing as it hasn't verified even once, I'm skeptical19:47
stevellealextricity25: strange19:49
*** fedruantine has quit IRC19:53
palendaemhayden, In terms of test execution time that patch only added 1 second locally, so I don't think that's it20:00
*** woodard_ has joined #openstack-ansible20:05
*** sdake_ is now known as sdake20:06
*** woodard has quit IRC20:09
*** McMurlock has quit IRC20:09
*** woodard_ has quit IRC20:14
*** woodard has joined #openstack-ansible20:14
*** woodard has quit IRC20:15
*** woodard has joined #openstack-ansible20:15
mhaydenjust sent an email to the list about the mid-cycle dates20:21
mhaydenthere is an etherpad on there20:21
mhaydenwaiting on the hotel discount contract now, but i need to know dates20:21
michaelguginomhayden: what is the email list?20:21
mhaydenopenstack-dev20:22
openstackgerritMiguel Alex Cantu (alextricity25) proposed openstack/openstack-ansible: Configuring AODH DB now that it uses MySQL.  https://review.openstack.org/32913620:22
michaelguginowhat is the mailing list for this project?20:22
mhaydenmichaelgugino: http://lists.openstack.org/pipermail/openstack-dev/2016-June/097218.html20:22
mhaydenmichaelgugino: you can email openstack-dev with the [openstack-ansible] tag in the subject line20:22
michaelguginogotcha20:22
michaelguginothanks20:22
mhaydende nada!20:22
*** jwitko has joined #openstack-ansible20:23
*** TxGirlGeek has quit IRC20:24
*** M00nr41n has quit IRC20:25
*** TxGirlGeek has joined #openstack-ansible20:30
openstackgerritMajor Hayden proposed openstack/openstack-ansible-security: Ensure aide-common package is installed  https://review.openstack.org/32917720:33
openstackgerritMajor Hayden proposed openstack/openstack-ansible: [WIP] Update lists of skipped security role tasks  https://review.openstack.org/32773220:33
*** TxGirlGeek has quit IRC20:44
openstackgerritCameron Loader proposed openstack/openstack-ansible-os_keystone: Updated the keystone WSGI application locations in Mitaka  https://review.openstack.org/32918220:44
*** TxGirlGeek has joined #openstack-ansible20:52
*** cfarquhar has quit IRC20:53
*** psilvad has quit IRC20:54
*** bbmbx__ has quit IRC20:55
*** thorst has quit IRC20:56
*** TxGirlGeek has quit IRC20:57
*** Mudpuppy has quit IRC20:59
*** TxGirlGeek has joined #openstack-ansible21:00
*** thorst has joined #openstack-ansible21:03
*** TheIntern has quit IRC21:04
*** adrian_otto has quit IRC21:07
*** thorst has quit IRC21:07
openstackgerritCameron Loader proposed openstack/openstack-ansible-os_keystone: Update the keystone WSGI application locations  https://review.openstack.org/32918221:15
*** jamesdenton has quit IRC21:24
*** woodard_ has joined #openstack-ansible21:26
*** woodard__ has joined #openstack-ansible21:28
*** woodard has quit IRC21:29
*** woodard_ has quit IRC21:31
*** schwicht has quit IRC21:32
*** TxGirlGeek has quit IRC21:32
*** woodard__ has quit IRC21:32
*** thorst has joined #openstack-ansible21:35
*** thorst_ has joined #openstack-ansible21:39
*** thorst has quit IRC21:39
*** cfarquhar has joined #openstack-ansible21:40
*** cfarquhar has quit IRC21:40
*** cfarquhar has joined #openstack-ansible21:40
*** michaelgugino has quit IRC21:41
*** adrian_otto has joined #openstack-ansible21:42
*** thorst_ has quit IRC21:43
*** galstrom is now known as galstrom_zzz21:44
*** admin0 has joined #openstack-ansible21:45
mrdaMorning21:46
*** schwicht has joined #openstack-ansible21:47
bsvmrda: evenings :)21:49
spotzhey mrda21:49
*** weezS has quit IRC21:49
*** bsv has quit IRC21:53
mrdao/21:54
*** messy has quit IRC21:55
*** jamesdenton has joined #openstack-ansible21:57
openstackgerritNolan Brubaker proposed openstack/openstack-ansible: [POC] Remove most I/O inventory tests  https://review.openstack.org/32920121:57
*** jmckind has quit IRC21:57
palendaestevelle, sigmavirus24, automagically, izaakk, raddaoui ^ curious about thoughts on that approach. The patch seems kind of messy with mocks being peppered everywhere, but that's partially a result of how we're testing everything from the top level righ tnow21:58
*** cloader89 has quit IRC21:59
*** schwicht has quit IRC22:09
jmccrorychris_hultin: there's quite a bit of config_overrides in the magnum playbook. is it planned to go back and add those directly to the magnum.conf template at some point?22:14
*** KLevenstein has quit IRC22:16
*** galstrom_zzz is now known as galstrom22:17
palendaealextricity25, Are your patches meant to fix this kind of test failure? http://logs.openstack.org/98/329098/2/check/gate-openstack-ansible-dsvm-commit/683c7f4/console.html#_2016-06-13_21_00_26_21022:18
*** galstrom is now known as galstrom_zzz22:19
*** spotz is now known as spotz_zzz22:19
*** saneax_AFK is now known as saneax22:21
*** TxGirlGeek has joined #openstack-ansible22:22
*** schwicht has joined #openstack-ansible22:28
*** retreved has quit IRC22:29
*** schwicht has quit IRC22:32
*** TxGirlGeek has quit IRC22:37
*** saneax is now known as saneax_AFK22:40
*** jamesdenton has quit IRC22:46
*** admin0 has quit IRC22:46
*** jamesdenton has joined #openstack-ansible22:50
*** kstev has quit IRC22:52
*** jamesdenton has quit IRC22:54
*** schwicht has joined #openstack-ansible22:54
*** woodard has joined #openstack-ansible22:59
*** adrian_otto has quit IRC22:59
*** adrian_otto has joined #openstack-ansible22:59
*** schwicht has quit IRC23:01
*** saneax_AFK is now known as saneax23:06
stevellepalendae: yes23:07
*** schwicht has joined #openstack-ansible23:08
*** jthorne has quit IRC23:23
*** phalmos has quit IRC23:27
*** alikins has quit IRC23:34
*** Nepoc has quit IRC23:40
*** mummer has quit IRC23:54
*** weshay has quit IRC23:54

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!