Tuesday, 2018-02-06

*** guhcampos_ has joined #openstack-ansible00:02
*** gucampos__ has joined #openstack-ansible00:02
*** guhcampos has joined #openstack-ansible00:02
*** tux_ has quit IRC00:04
*** acormier has joined #openstack-ansible00:08
*** tux_ has joined #openstack-ansible00:12
*** tux_ has quit IRC00:19
*** acormier has quit IRC00:24
*** weezS has joined #openstack-ansible00:28
*** vnogin has joined #openstack-ansible00:36
*** chyka has quit IRC00:37
*** vnogin has quit IRC00:38
*** weezS has quit IRC00:39
*** dave-mccowan has joined #openstack-ansible00:42
*** tux_ has joined #openstack-ansible00:54
*** tux_ has quit IRC00:59
*** rama_y_ has joined #openstack-ansible01:00
*** chyka has joined #openstack-ansible01:01
*** rama_y has quit IRC01:03
*** acormier has joined #openstack-ansible01:04
*** acormier has quit IRC01:04
*** acormier has joined #openstack-ansible01:04
*** chyka has quit IRC01:06
*** rama_y has joined #openstack-ansible01:11
*** rama_y_ has quit IRC01:11
*** rama_y has quit IRC01:17
*** acormier has quit IRC01:28
*** woodard has joined #openstack-ansible01:42
*** woodard has quit IRC01:45
*** woodard has joined #openstack-ansible01:46
*** chyka has joined #openstack-ansible01:50
*** chyka has quit IRC01:55
*** gfa has quit IRC02:04
*** gfa has joined #openstack-ansible02:07
*** acormier has joined #openstack-ansible02:09
*** esberglu has quit IRC02:14
openstackgerritJames E. Blair proposed openstack/openstack-ansible-os_ceilometer master: Zuul: Remove project name  https://review.openstack.org/54109302:20
*** askb has quit IRC02:21
*** markvoelker has joined #openstack-ansible02:22
*** askb has joined #openstack-ansible02:24
*** markvoelker has quit IRC02:24
*** acormier has quit IRC02:26
*** acormier has joined #openstack-ansible02:27
*** askb has quit IRC02:29
*** askb has joined #openstack-ansible02:29
*** askb has quit IRC02:31
*** markvoelker has joined #openstack-ansible02:31
*** askb has joined #openstack-ansible02:31
*** tux_ has joined #openstack-ansible02:31
*** askb has quit IRC02:31
*** askb has joined #openstack-ansible02:32
*** tux_ has quit IRC02:35
*** askb has quit IRC02:36
*** askb has joined #openstack-ansible02:45
*** dave-mccowan has quit IRC02:48
*** askb has quit IRC02:49
*** guhcampos has quit IRC02:51
*** guhcampos_ has quit IRC02:51
*** gucampos__ has quit IRC02:51
*** askb_ has joined #openstack-ansible02:52
*** rama_y has joined #openstack-ansible02:52
*** mattt has quit IRC02:55
*** adrianreza has joined #openstack-ansible02:55
*** markvoelker has quit IRC02:56
*** markvoelker has joined #openstack-ansible02:59
*** askb_ has quit IRC03:01
*** tux_ has joined #openstack-ansible03:01
*** dave-mccowan has joined #openstack-ansible03:10
*** rama_y has quit IRC03:10
*** markvoelker has quit IRC03:11
*** markvoelker has joined #openstack-ansible03:14
*** acormier_ has joined #openstack-ansible03:23
*** markvoelker has quit IRC03:25
*** acormier has quit IRC03:27
idlemindi'd like to disable any / all banners from ansible-hardening. i see their is a boolean for graphical logins (gdm) but i don't see a boolean for sshd (rhel7). i see security_login_banner_text ... should I just override the default in my user_variables.yml and set it to an empty string ("")? also, in rhel7 when i ssh into a host i get the banner displayed twice, didn't know if that's normal. the reason for the banner03:27
idlemindbeing disabled is because it doesn't do anything but satisfy a policy wonk (stig) if anything it tells a target it actually found something someone cares about. but that's just me.03:27
*** markvoelker has joined #openstack-ansible03:30
*** dave-mccowan has quit IRC03:33
*** acormier_ has quit IRC03:37
*** chyka has joined #openstack-ansible03:39
*** markvoelker has quit IRC03:42
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Add nspawn container driver  https://review.openstack.org/47701703:43
*** chyka has quit IRC03:44
cloudnullidlemind: mhayden may have some thoughts on that03:44
cloudnullthere may be a switch that can do what you need, though I'm not seeing one.03:44
cloudnullyou could disable all of the hardening role?03:44
*** askb_ has joined #openstack-ansible03:49
*** askb_ has quit IRC03:55
*** askb_ has joined #openstack-ansible03:56
openstackgerritJames E. Blair proposed openstack/openstack-ansible-os_nova master: Zuul: Remove project name  https://review.openstack.org/54111704:01
*** askb_ has quit IRC04:06
*** askb has joined #openstack-ansible04:06
*** askb has quit IRC04:07
*** askb has joined #openstack-ansible04:07
*** askb has quit IRC04:09
*** askb has joined #openstack-ansible04:09
*** askb has quit IRC04:12
*** askb has joined #openstack-ansible04:13
tux_@mgariepy - I found galera not talking to repo because iptables has no rule to allow port 8181, when i did following which works04:13
tux_iptables -I INPUT 1 -p tcp --dport 8181  -j ACCEPT04:13
tux_not sure this is a bug or something i missed04:13
openstackgerritJames E. Blair proposed openstack/openstack-ansible-os_almanach master: Zuul: Remove project name  https://review.openstack.org/54112104:21
tux_Now i got this error04:31
-tux_- TASK [Create DB for service] ********************************************************************************************************************************04:32
-tux_- Monday 05 February 2018 07:54:19 -0500 (0:00:00.048) 0:00:07.296 *******04:32
-tux_- fatal: [aio1_keystone_container-df9bce44 -> 172.29.239.105]: FAILED! => {"changed": false, "failed": true, "msg": "unable to connect to database, check login_user and login_password are correct or /root/.my.cnf has the credentials. Exception message: (2003, 'Can\\'t connect to MySQL server on \\'172.29.236.100\\' (113 \"No route to host\")')"}04:32
tux_To fix this i have added iptables rules04:32
tux_iptables -I INPUT 1 -p tcp --dport 3306  -j ACCEPT04:32
tux_Do you have any idea what is going on here?04:33
tux_Oh! wait is this my CentOS default iptables which is blocking openstack-ansible services?04:45
*** rama_y has joined #openstack-ansible04:46
tux_i have stopped firewalld :)04:49
*** dariko has joined #openstack-ansible04:52
*** sunilvp73 has joined #openstack-ansible04:57
tux_I got new error, damn! i am not lucky :(04:58
tux_http://paste.openstack.org/show/662629/04:58
tux_Anyone know how to fix it?04:58
sunilvp73when I run openstack-ansible setup-openstack.yml05:01
sunilvp73I am getting this error05:01
sunilvp73{"failed": true, "item": "infra2", "module_stderr": "Shared connection to 10.7.8.4 closed.\r\n", "module_stdout": "Traceback (most recent call last):\r\n  File05:01
sunilvp73can someone help05:01
tux_is that your ip 10.7.8.4 ?05:04
sunilvp73that is the IP address of the Infra Host05:04
*** poopcat has quit IRC05:05
sunilvp73My internal and external LB address is the same05:05
sunilvp73does it cause problems05:05
tux_I am new to openstack-ansible so i would say wait for someone who is more expert.05:06
*** dariko has quit IRC05:14
*** askb has quit IRC05:18
*** askb has joined #openstack-ansible05:18
*** jwitko_ has quit IRC05:19
*** chyka has joined #openstack-ansible05:22
*** eumel8 has joined #openstack-ansible05:25
*** armaan has quit IRC05:25
*** gkadam has joined #openstack-ansible05:25
*** armaan has joined #openstack-ansible05:28
*** sunilvp73 has quit IRC05:29
*** dariko has joined #openstack-ansible05:29
*** sdake_ is now known as sdake05:30
*** dariko has quit IRC05:36
*** acormier has joined #openstack-ansible05:38
*** acormier has quit IRC05:42
openstackgerritJames E. Blair proposed openstack/openstack-ansible-os_watcher master: Zuul: Remove project name  https://review.openstack.org/54113405:42
*** tux_ has quit IRC05:56
*** dariko has joined #openstack-ansible05:58
*** hw_wutianwei has quit IRC05:59
*** hw_wutianwei has joined #openstack-ansible05:59
*** askb has quit IRC06:09
*** hybridpollo has quit IRC06:09
*** askb has joined #openstack-ansible06:10
*** chyka has quit IRC06:15
gokhangood morning everyone, I got errors on rabbitmq cluster so ı destroyed rabbitmq containers and run openstack-ansible setup-hosts.yml --limit rabbitmq_all. but I am getting errors on TASK [lxc_container_create : Gather variables for each operating system]. How can I solve this problem ?06:17
gokhanthis is error log: https://pastebin.com/q33RkGAw06:17
gokhanmy environment is pike 16.0.406:17
openstackgerritJames E. Blair proposed openstack/openstack-ansible-rsyslog_client master: Zuul: Remove project name  https://review.openstack.org/54113906:22
*** rama_y has quit IRC06:33
*** woodard has quit IRC06:40
*** threestrands has quit IRC06:40
*** woodard has joined #openstack-ansible06:40
*** yolanda has joined #openstack-ansible06:43
*** woodard has quit IRC06:45
*** ianychoi_ has quit IRC06:47
*** ianychoi_ has joined #openstack-ansible06:48
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_keystone master: Test keystone with a memcached cluster  https://review.openstack.org/54000106:58
evrardjpgokhan: when recreate containers, you should probably do lxc-containers-create with limit localhost,rabbitmq_all07:06
*** olivierbourdon38 has quit IRC07:06
evrardjpthen you should gather facts for the newly created containers07:06
evrardjpif you're doing setup-hosts you'll have lots of things to run, but it should work if you add localhost in the limit.07:07
evrardjpsunilvp73 you have to do special configuration if you want internal and external lb the same.07:08
evrardjpkeep them separate it's better.07:08
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_keystone master: Test keystone with a memcached cluster  https://review.openstack.org/54000107:11
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Update all SHAs for master  https://review.openstack.org/53913107:12
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Update all SHAs for master  https://review.openstack.org/53913107:12
gokhanevrardjp, I solved this situation wit running 'ansible _infrastructure_hosts -m setup'. this helped. but I am getting problems rabbitmq cluster. my all rabbitmq containers are in alarm state and there are lots of timeouts. so I destroyed them and then recreated. but when running rabbitmq-install.yml again get errors on second rabbitmq container. this is logs http://paste.openstack.org/show/662825/. also task is continuing07:13
CobHeadHi guys - when I want to add a new node to my already operating cluster, I try to run openstack-ansible setup-infrastructure --limit <node-hostname-as-in-the-openstack-config> but the infrastructure playbook finishes instantly and doesn't really do much (where are all the containers e.g?)07:18
CobHeadWhen I turn on verbose, I get this "Conditional check failed" on resolvconf07:21
*** olivierbourdon38 has joined #openstack-ansible07:42
evrardjp[m]add localhost in your limit07:43
evrardjp[m]or just don't use limit.07:43
evrardjp[m]better not to use limit in your case.07:44
*** woodard has joined #openstack-ansible07:44
*** SmearedBeard has quit IRC07:46
*** mbuil has joined #openstack-ansible07:47
*** woodard has quit IRC07:48
*** vnogin has joined #openstack-ansible07:51
*** weezS has joined #openstack-ansible07:51
*** weezS has quit IRC07:55
*** vnogin has quit IRC07:55
CobHeadevrardjp[m], then OSA will overwrite the config changes I've made to the cluster, no?07:56
CobHeadI see --limit is only presented as an opportunity in the Pike documentation, not on Ocata, which is what I run.07:56
*** SmearedBeard has joined #openstack-ansible07:57
ThomasShi07:58
evrardjpCobHead: all the changes should be in the deploy code (user variables etc) not done in a live environment08:01
evrardjpand if you re-run, it should be idempotent.08:01
evrardjpCobHead: limit is evil for many cases.08:01
evrardjphello ThomasS08:01
*** hamza21 has joined #openstack-ansible08:02
openstackgerritJames E. Blair proposed openstack/openstack-ansible-os_aodh master: Zuul: Remove project name  https://review.openstack.org/54117208:03
*** vnogin has joined #openstack-ansible08:06
CobHeadevrardjp: How do I set certain variables only for certain nodes, though? Let's say I have 4 nodes, each of them in separate zones, which will run their own AZ on Cinder, Nova and Neutron - how do I set desired variables for certain nodes in e.g. cinder.conf?08:06
evrardjphttps://evrard.me/group-and-host-variables-overriding-in-openstack-ansible.html08:07
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Build everything on metal  https://review.openstack.org/50422408:10
evrardjpCobHead: everything should be in the docs though, for your use case.08:12
evrardjpwe have hosts overrides since Juno08:12
*** pcaruana has joined #openstack-ansible08:14
openstackgerritMerged openstack/ansible-hardening master: Zuul: Remove project name  https://review.openstack.org/54098708:18
*** askb has quit IRC08:19
*** askb_ has joined #openstack-ansible08:20
openstackgerritJames E. Blair proposed openstack/openstack-ansible-galera_client master: Zuul: Remove project name  https://review.openstack.org/54117708:23
*** ianychoi_ has quit IRC08:27
*** ianychoi_ has joined #openstack-ansible08:28
*** askb_ has quit IRC08:31
*** abelur_ has joined #openstack-ansible08:32
*** pbandark1 has joined #openstack-ansible08:33
openstackgerritMerged openstack/openstack-ansible-rsyslog_client master: Zuul: Remove project name  https://review.openstack.org/54113908:35
*** pbandark has quit IRC08:35
*** pbandark1 is now known as pbandark08:35
openstackgerritMerged openstack/openstack-ansible-repo_build stable/ocata: Correct location of venv build logs  https://review.openstack.org/53736808:35
openstackgerritMerged openstack/openstack-ansible-repo_build stable/newton: Correct location of venv build logs  https://review.openstack.org/53736908:35
*** armaan has quit IRC08:37
*** armaan has joined #openstack-ansible08:37
*** sxc731 has joined #openstack-ansible08:42
openstackgerritMerged openstack/openstack-ansible-os_almanach master: Zuul: Remove project name  https://review.openstack.org/54112108:42
*** rodolof has joined #openstack-ansible08:47
*** woodard has joined #openstack-ansible08:48
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_gnocchi master: Change default gnocchi ceph pool name to metrics  https://review.openstack.org/51231308:52
openstackgerritMerged openstack/openstack-ansible-os_watcher master: Zuul: Remove project name  https://review.openstack.org/54113408:53
*** woodard has quit IRC08:53
*** abelur_ has quit IRC08:55
*** abelur_ has joined #openstack-ansible08:55
*** rodolof has quit IRC08:58
*** rpittau has joined #openstack-ansible09:01
openstackgerritMerged openstack/openstack-ansible-os_nova stable/pike: Improve console install and restart services appropriately  https://review.openstack.org/54032809:03
*** threestrands has joined #openstack-ansible09:06
Taseerevrardjp: do you have infuence in congress ? can you help in asking them about the congress API verification ? no one responds to me in the channel09:07
openstackgerritMerged openstack/openstack-ansible-galera_client master: Zuul: Remove project name  https://review.openstack.org/54117709:21
*** threestrands has quit IRC09:21
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_ironic master: Handle Pike deprecations for Ironic  https://review.openstack.org/52549409:41
evrardjpTaseer: I do not09:44
evrardjpI'd hope that you'd have, because you're a user of it.09:45
evrardjpCobHead: does that help you ?09:45
TaseerI have tried asking a number of times. But no response09:50
*** tescra has joined #openstack-ansible09:51
*** woodard has joined #openstack-ansible09:52
tescrahad a question does the cinder-volume runs in a container on the infrastructure hosts for production environment ? also is it mandatory to edit/etc/openstack_deploy/env.d/cinder.yml09:52
*** SmearedBeard has quit IRC09:55
tescraam following appendix B09:57
*** woodard has quit IRC09:57
evrardjptescra: you do whatever you want.09:57
evrardjpIf you want it on containers, follow that part09:58
evrardjpif you're running ceph, you can run in containers. If not, run on metal. But you can run cinder-volume on metal with ceph if you like it too.09:58
openstackgerritJames E. Blair proposed openstack/openstack-ansible-lxc_hosts master: Zuul: Remove project name  https://review.openstack.org/54121910:04
*** SmearedBeard has joined #openstack-ansible10:05
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Remove impossible tests  https://review.openstack.org/54122010:05
tescraV thanks10:07
tescraevrardjp10:07
tescrathanks10:07
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Reinstate ubuntu ceph gating  https://review.openstack.org/54122210:09
evrardjptescra: you're welcome, not sure if that helped or not :p10:09
evrardjphwoarang: do you need the opensuse deploy periodics in osa, due to the fact you have your own too? They always fail due to timeouts for now -- I thought to remove them until we think we are ready to beat the timer10:15
hwoarangevrardjp: we dont have any periodics beside the OSA ones10:15
hwoarangunless you mean the opnfv ones10:15
hwoarangevrardjp: centos is failing due to timeouts too right? afaik they both suffer from the same issue10:16
evrardjpYeah I thought opnfv had a periodic testing of opensuse deploy using osa10:16
hwoarangyeah we have a cut-down & modified OSA for opnfv10:16
openstackgerritTaseer Ahmed proposed openstack/openstack-ansible-os_congress master: Introduce os_congress role in gerrit  https://review.openstack.org/52249110:16
evrardjphwoarang: yes, I just patched something to remove centos, but opensuse is closer to success and you have maybe external gating10:16
hwoarangevrardjp: we test CentOS in the same opnfv jobs with oepnsuse10:17
evrardjpoh I see, both are tested by your use case. Interesting.10:17
hwoarangyep10:17
hwoarangbut ok drop the periodic10:17
hwoarangbecause the issue is the same on both10:17
evrardjpI had this: https://review.openstack.org/#/c/541220/10:17
evrardjpbut now I was thinking of extending to the deploys too. I am worried to forget to test them manually.10:18
hwoarangyou mean the regular check jobs?10:19
evrardjpno the check jobs stay.10:19
hwoarangok i think that's good enough10:19
evrardjpwell I'd like to keep the test jobs OR the periodic jobs.10:19
evrardjpI think it's better to keep test jobs10:19
hwoarangi'd vote for the test jobs10:19
evrardjpok.10:19
hwoarangif that's ok of course10:20
evrardjpYeah so let's leave them be for now as test jobs.10:20
evrardjpyeah I think if we are working on improvements, and we are confident they would pass gates in a timely fashion, then we make these check jobs part of gate, and include them in periodics.10:20
evrardjpbut right now, I am not checking those periodics, and they all timeout.10:21
evrardjpok I will update this commit to also remove the deploy periodics, to keep only the checks for now.10:21
hwoarangok10:23
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Remove impossible tests  https://review.openstack.org/54122010:25
-openstackstatus- NOTICE: Our Zuul infrastructure is currently experiencing some problems and processing jobs very slowly, we're investigating. Please do not approve or recheck changes for now.10:28
openstackgerritMaxime Guyot proposed openstack/openstack-ansible master: [WIP] Ceph RadosGW integration  https://review.openstack.org/51785610:31
*** DanyC has joined #openstack-ansible10:33
evrardjphwoarang: odyssey4me spotz mgariepy cloudnull mhayden andymccr please see the message from infra: no rechecks/+w please.10:36
*** sxc731 has quit IRC10:38
evrardjphaha the onmetal job I am including succeeded in gates, where the standard deploy just timedout.10:42
evrardjpthe future is near.10:42
evrardjphwoarang: wants opensuse to gate that way? :p10:43
hwoarang:)10:46
hwoarangevrardjp: just ubuntu passed or... ?10:47
evrardjpfor all_metal I am only testing ubuntu for now yes10:47
evrardjpBut I think it would be wise to test centos and suse.10:48
evrardjpbecause they are more likely to pass gates :D10:48
evrardjpbut I guess it can be decided later.10:48
hwoarangok10:49
hwoarangnot sure why all_metal performs faster on gates though10:49
evrardjpall_metal doesn't have containers, so we are skipping playbooks.10:49
evrardjpskipping lxc hosts and lxc containers create help on the IO, and on the timings.10:50
*** chyka has joined #openstack-ansible10:52
*** hamza21 has quit IRC10:54
hwoarangah yes10:54
*** chyka has quit IRC10:56
*** pradiprwt has joined #openstack-ansible10:59
*** peri has joined #openstack-ansible11:01
pradiprwtHi Guys, I am installing OSA multinode in centOS, while installation i faced some issue regarding communication between hosts after disabling "Firewall" the installation got successfully completed. Can anyone please tell me what are the firewall rules needs to be apply before installation in centOS 711:03
pradiprwtI am using Ocata release11:03
*** sxc731 has joined #openstack-ansible11:12
openstackgerritJames E. Blair proposed openstack/openstack-ansible-os_gnocchi master: Zuul: Remove project name  https://review.openstack.org/54124311:25
*** gkadam is now known as gkadam-brb11:27
*** stuartgr has joined #openstack-ansible11:30
*** woodard has joined #openstack-ansible11:45
*** gkadam-brb is now known as gkadam11:49
*** woodard has quit IRC11:49
odyssey4meo/11:50
*** sxc731 has quit IRC11:52
*** acormier has joined #openstack-ansible12:03
*** acormier has quit IRC12:04
odyssey4meevrardjp would you prefer me to add a patch on top of https://review.openstack.org/#/c/540789/ or just modify that patch in order to update the repo_build and os_nova roles to include the recent fixes?12:06
pradiprwtHi ivveh, I have few very basic questions regarding OSA installation in centOS12:11
*** olivierbourdon38 has quit IRC12:11
pradiprwtcan you please help me12:12
evrardjpodyssey4me: yeah, this way it's done for next release12:42
evrardjpinstead of waiting for the bump etc.12:42
evrardjpoh it's not merged12:42
evrardjpnot sure it would change much... Infra is in a bad state rn12:43
evrardjpI'd say I'd prefer it to pass to respect our usual contract12:43
evrardjpwell no, it doesn't matter, it's on our side12:44
evrardjpso we are good I think, up to you.12:44
evrardjp(speaking too fast is not good!)12:44
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/newton: Update os_nova and repo_build role SHA's  https://review.openstack.org/54125912:45
openstackgerritJames E. Blair proposed openstack/openstack-ansible-rsyslog_client stable/ocata: Zuul: Remove project name  https://review.openstack.org/54126012:45
*** woodard has joined #openstack-ansible12:46
jamespagetinwood: hey - any progress on a new 2.0.x release of pylxd? odyssey4me was asking12:47
tinwoodhey jamespage, just working on it now.12:48
jamespagethanks tinwood mucho appreciated :-)12:48
odyssey4meah, thanks muchly tinwood  - appreciate you taking the time12:48
tinwoododyssey4me, no problem; when I tracked the other error, I thought we'd need to do this as well to keep the LTS happy. :)12:48
odyssey4metinwood yeah, although it looks like the error was fixed in packaging rather than source - it'd be much better to have it fixed in source :)12:49
tinwoododyssey4me, indeed. I'm also now a core pylxd maintainer; do ping me for missing things, etc.12:50
odyssey4meah, very good to know - thanks tinwood ... I expect that you might get some pings from jrosser as I think they've been doing quite a bit of work with LXD12:51
evrardjpwow that's cool .12:51
*** woodard has quit IRC12:51
tinwoododyssey4me, jrosser, good to know12:53
*** takamatsu has joined #openstack-ansible12:54
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/pike: Update os_nova role SHA  https://review.openstack.org/54126313:03
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/newton: Update os_nova and repo_build role SHA's  https://review.openstack.org/54125913:04
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/pike: Update os_nova role SHA  https://review.openstack.org/54126313:05
evrardjpodyssey4me: thanks13:05
evrardjpthat could have waited for next release, it's every two weeks, but I am ok with that too13:06
odyssey4mewell, given that we're actually breaking the service on every playbook run - I figure that we should get the fix in asap13:07
evrardjpyeah that's a valid point.13:07
evrardjp:D13:07
evrardjpbut it's not new!13:07
odyssey4mewe've still got an upgrade job fail in https://review.openstack.org/540329, so I think those patches to pike to use u-c will likely also need porting back to ocata?13:07
*** jbadiapa has joined #openstack-ansible13:09
*** nsingh has joined #openstack-ansible13:10
evrardjpodyssey4me: I don't think they should, because the rest was constrained, wasn't it?13:13
evrardjplet me check.13:13
evrardjp(I don't really mean constrained, but at least not tested the same way)13:13
odyssey4meevrardjp those upgrade jobs were introduced in ocata and left almost untouched, so any issue in master is likely still an issue for the ocata branch13:14
*** jbadiapa has quit IRC13:14
evrardjpthe issue is a problem with tempest13:14
evrardjpon the link you gave me13:14
evrardjplet me quickly check13:14
evrardjpI was backporting only the necessary bits, not everything13:15
evrardjpfor example, not backporting the ansible venvs things.13:15
odyssey4meah ok, appreciate your expert view - given that you've been in the thick of things for these tests13:15
nsinghi am trying to find some reference to write my own plugin to deploy masakari services using ansible. So can anyone guid me about the path where plugins are written to deploy openstack services using ansible. any help.13:17
evrardjpHost 'ubuntu-xenial-inap-mtl01-0002373133' is not mapped to any cell13:17
evrardjpnsingh: there are multiple frameworks to deploy openstack using ansible13:17
evrardjpopenstack-ansible is one, kolla-ansible is another.13:18
evrardjpthen there are other ones too, like triple-O, ardana, etc.13:18
evrardjpin the openstack-ansible case, you'd have to build your own role13:18
odyssey4meevrardjp ok, let me fire up a test instance and execute it to see what's going on there13:19
evrardjpI planned to do that too.13:19
evrardjpI just wanted to make sure the sha is good13:19
evrardjpit looks okay, but I am worried to see how tempest gets installed in O13:20
*** acormier has joined #openstack-ansible13:20
odyssey4meevrardjp don't worry about it - I'll figure it out and sort it13:21
nsinghevrardjp: you are talking about the roles defined in this https://github.com/openstack/openstack-ansible/blob/master/ansible-role-requirements.yml13:21
nsingham i right?13:21
evrardjpodyssey4me: thanks13:22
evrardjpnsingh: yes. These are roles used to deploy components13:22
evrardjpYou can take one for inspiration, and modify it to your needs.13:23
evrardjpnot sure what you're trying to achieve though. Do you deploy openstack using openstack-ansible?13:23
odyssey4mensingh I'd suggest using a relatively simple service as a model to work from - perhaps something like glance13:23
nsinghok thank you for your help. :)13:23
*** acormier has quit IRC13:25
nsinghevrardjp: no i didnot deploy openstack using ansible.13:26
*** rodolof has joined #openstack-ansible13:26
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_magnum master: Update the Tempest plugin to point towards the new plugin  https://review.openstack.org/54126913:26
nsinghevrardjp: i want to develop a plugin to deploy masakari(https://github.com/openstack/masakari) using ansible plugin.13:27
nsinghevrardjp: just i need a reference to start with it.13:28
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_aodh master: Update the Tempest plugin to point towards the new plugin  https://review.openstack.org/54127013:29
*** dave-mccowan has joined #openstack-ansible13:29
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Build everything on metal  https://review.openstack.org/50422413:31
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_trove master: Update the Tempest plugin to point towards the new plugin  https://review.openstack.org/54127213:32
evrardjpnsingh: it's not that simple13:32
evrardjpthere is no single plugin of a few lines that deploy things for all the openstack deployments that exist in the world13:32
evrardjpnsingh: in which environment do you have to deploy it?13:33
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_magnum master: Update the Tempest plugin to point towards the new plugin  https://review.openstack.org/54126913:33
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_trove master: Update the Tempest plugin to point towards the new plugin  https://review.openstack.org/54127213:34
*** dave-mcc_ has joined #openstack-ansible13:34
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_aodh master: Update the Tempest plugin to point towards the new plugin  https://review.openstack.org/54127013:35
*** dave-mccowan has quit IRC13:35
nsinghevrardjp: i have ubantu 16.04 and 12 gb ram.13:35
gokhanhi folks, I have problems on rabbitmq cluster. It get warnings and errors. now cluster status is in alarm state. I destroyed rabbitmq containers and recreated again getting same errors. what is your thoughts about that. This is error logs. http://paste.openstack.org/show/663350/13:36
gokhanthis is cluster_status log: http://paste.openstack.org/show/663350/13:36
gokhanit generaly gives timeout error on sahara and magnum13:37
*** acormier has joined #openstack-ansible13:37
evrardjpnsingh: I don't know what your company wants...13:40
evrardjpbut it looks like openstack-ansible could be a good fit.13:40
*** acormier_ has joined #openstack-ansible13:41
*** woodard has joined #openstack-ansible13:42
*** acormier has quit IRC13:42
*** woodard has quit IRC13:43
nsinghevrardjp: sorry for your enconvinience. i just want to develop plugin for a new component to deploy that component using ansible.13:43
*** woodard has joined #openstack-ansible13:43
openstackgerritJames E. Blair proposed openstack/openstack-ansible-os_aodh stable/ocata: Zuul: Remove project name  https://review.openstack.org/54127413:46
*** acormier_ has quit IRC13:46
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_ceilometer master: Drop MongoDB installation and api-paste file configuration  https://review.openstack.org/54127513:46
odyssey4memnaser nice to see the telemetry stack get some lovin' :)13:47
odyssey4mewe appreciate the assistance!13:47
mnaserodyssey4me: i think those should be enough to make things passing but in an ideal world panko role would be a thing and ceilometer can be fully tested :>13:47
odyssey4memnaser yep, not sure if anyone has volunteered to get a panko role going... I thought I saw some chat about it some time ago, but haven't seen any code13:48
mnaserodyssey4me: saw a bug but yeah, looks like nothing is done13:48
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_ceilometer master: Drop MongoDB installation and api-paste file configuration  https://review.openstack.org/54127513:49
mnaserand this should unblock the gates.. i think13:49
odyssey4memnaser I'd be happy to do a seed repo with the basic structure needed, but it would require someone with understanding of the stack to finish it. Doing the basic new role pattern is pretty straightforward.13:50
odyssey4meJust getting the bits put down is easy, making it work with functional testing is where the real understanding of the stack comes in.13:50
*** udesale has joined #openstack-ansible13:51
mnaserodyssey4me: dealt with this enough times in puppet world, i dont mind picking this up but the structure+new project in infra is what i'm shying away from13:51
odyssey4memnaser new project in infra is trivial for us - and evrardjp would handle that for you, as could I13:52
odyssey4methe structure - in most cases we just grab an existing role and modify it13:52
*** eumel8 has quit IRC13:52
mnaserodyssey4me: let me hack on something in the next little while and i'll see how/where i go from there13:53
*** esberglu has joined #openstack-ansible13:53
odyssey4methat'd be super, thanks mnaser - if you're feeling a little lost or feel like you're missing something, please don't hesitate to ask in channel for help or clarification13:53
mnaserwill do13:54
mgariepymorning everyone13:55
odyssey4meif you do feel like you're stuck, I'd be happy to work on a staged plan with you in an etherpad to help focus the work items - typically a new role's basic bits can be done in a few days, then we pull that in to the openstack git org and work on getting tests implemented appropriately, before moving on to improving the tests so that they actually do useful things13:55
gokhanhi mnaser odyssey4me there is also need a coordinator on telemetry projects(gnocchi and ceilometer) for HA.  https://docs.openstack.org/ha-guide/controller-ha-telemetry.html. This documents advice 3 option https://docs.openstack.org/ha-guide/controller-ha-telemetry.html13:56
gokhanfor this I wrote a redis role13:56
evrardjpnsingh: there is no inconvenience, I am just trying to help you by understanding better :)13:56
gokhanand I tested it it works successfully13:57
evrardjpI am informing you where you are heading too :)13:57
mnasergokhan: the redis role would be very useful13:57
mnaserbut does it so replication or anything like that?13:57
nsinghevrardjp: :)13:57
gokhanodyssey4me, mnaser https://github.com/gokhan27/openstack-ansible-os_redis13:57
gokhanodyssey4me, mnaser yes redis + redis sentinel13:58
odyssey4megokhan not sure that os_redis makes sense as a name, given it's not an openstack service but an infra service? but hey, that's your call :)13:59
odyssey4megokhan I'm curious though, what made you develop a fresh role instead of using an existing role made by someone else?13:59
mnaserafaik there isn't one that does ha oob14:00
gokhanodyssey4me, ı integrated it to openstack ansible14:00
odyssey4megokhan at first glance, looks like good work that!14:04
odyssey4meany chance that you happen to be working on a panko role already?14:04
gokhanodyssey4me, yes I also need your assistance about redis role. there are some missings14:05
evrardjpnsingh: like what odyssey4me said, you can use the os_glance repo as a source of inspiration, and you adapt it to your needs. the tests/test.yml is the entrypoint14:05
gokhanodyssey4me, I wrote a panko role also14:05
gokhanodyssey4me, but I didn't test it clearly yet14:05
gokhanodyssey4me, https://github.com/b3lab/openstack-ansible-os_panko/tree/stable/pike14:06
odyssey4megokhan ORLY? perhaps we should pull it in to the openstack namespace soon so that we can collaborate on getting it completed?14:06
gokhanodyssey4me, yep it would be good. sorry I have to go now. I will be back tomorrow. can we talk about this tomorrow ?14:07
odyssey4mesure thing14:08
odyssey4memnaser it looks like gokhan has done a basic structural start there :)14:08
*** tux_ has joined #openstack-ansible14:08
nsinghevrardjp: ok14:10
openstackgerritTaseer Ahmed proposed openstack/openstack-ansible-os_congress master: Introduce os_congress role in gerrit  https://review.openstack.org/52249114:12
idlemindcloudnull ya i figured mhayden would be the expert for it ... i tried the empty string ("") for security_login_banner_text and it seems to have had the desired effect14:13
idlemind... from openstack-glance regarding show_multiple_locations = false (default) ... idlemind show_multiple_locations will not go away for queens, there are some complications making it difficult to remove that setting and use rbac only ... we plan to come up with a solution during the Rocky planning sessions at the PTG in Dublin at the end of february14:14
idlemindmaybe default it to true until the rbac fix is in?14:15
mbuilI found a bug in neutron role but I need an ansible expert to help me solve it. We have this task --> https://github.com/openstack/openstack-ansible/blob/master/playbooks/os-neutron-install.yml#L22 which ends up here --> https://github.com/openstack/openstack-ansible/blob/master/playbooks/common-tasks/dynamic-grouping.yml with group_when = "neutron_plugin_type == 'ml2.ovs.dvr'", however, that expression is not evaluated because neutron_plugin_type14:15
mbuil = ml2.ovs and still the task is executed14:15
idlemindor at least true if horizon_images_upload_mode == 'direct'14:15
odyssey4meidlemind that may make sense to wire up using group_vars - given that I don't know the details of the problem and the best practise for resolving it, I'd feel more comfortable if logan- was on board with that approach14:19
idlemindcool i'm writing up a bug i'll include that and the discussion can work from there i'll try to get all the relavent details in it14:20
idlemindit seems like a fairly major issue, by taking the defaults you end up w/a horizon that cannot upload images to glance14:20
idlemindtook me a few days to get the necessary pieces tacked together14:20
mhaydenidlemind: let me know if you need help on an ansible-hardening bug/patch14:22
idlemindmhayden will do14:22
odyssey4meidlemind awesome, thank you for digging into it :)14:22
idlemindhoping to get approval to soon (tm) to sign the contributor agreement so i can do more than just investigate and file bugs and what not14:23
*** chyka has joined #openstack-ansible14:23
evrardjpdear cloudnull, DimGR, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, mhayden, scarlisle, luckyinva, ntt, javeriak, spotz, vdo, jmccrory, alextricity25, jasondotstar, admin0, michaelgugino, ametts, bgmccollum, darrenc, JRobinson__, asettle,14:25
evrardjpcolinmcnamara, thorst, adreznec, eil397, qwang,nishpatwa_, cathrichardson, drifterza, hwoarang, cshen, ullbeking14:25
evrardjpthe osa bug triage will start in 1h35’. Please have a look at the bug list before starting: https://etherpad.openstack.org/p/osa-bugtriage14:25
evrardjpThank you14:25
hwoarangevrardjp: i will not be able to attend today14:26
evrardjphwoarang: thanks for the info!14:26
evrardjplet's see who'll have state: present then :)14:27
*** chyka has quit IRC14:28
idlemindevrardjp lol ansible jokes you make me giggle14:33
evrardjp:)14:34
*** tux_ has quit IRC14:37
*** rodolof has quit IRC14:39
*** dim_ has quit IRC14:44
*** gkadam has quit IRC14:44
idlemind(image upload bug notes) https://bugs.launchpad.net/openstack-ansible/+bug/174768414:55
openstackLaunchpad bug 1747684 in openstack-ansible "Default Values Do Not Allow Image Uploads to Glance from Horizon" [Undecided,New]14:55
*** tux_ has joined #openstack-ansible14:55
*** derekjhyang has quit IRC14:55
*** derekjhyang has joined #openstack-ansible14:56
*** acormier has joined #openstack-ansible14:59
tux_Folks, any thought here? http://paste.openstack.org/show/662629/15:00
*** eumel8 has joined #openstack-ansible15:06
openstackgerritJames E. Blair proposed openstack/openstack-ansible-os_trove stable/ocata: Zuul: Remove project name  https://review.openstack.org/54130115:06
mgariepytux_, either your repo-server having issues with the caching or the mirror not responding.15:07
evrardjpmbuil: did you get an answer?15:08
mgariepymaybe we should add neutron_agent container as well as rabbitmq to the lxc_container_allow_restarts=false list.15:10
mgariepyon upgrades15:10
tux_@magariepy - can you give me clue where i should look ?15:10
evrardjpmgariepy: neutron_agent is now on baremetal15:11
evrardjpbut we have no conversion tool, cloudnull has promised it though.15:11
mgariepyok cool15:11
*** mnaser has quit IRC15:11
mgariepybut still.15:11
*** rodolof has joined #openstack-ansible15:11
mbuilevrardjp: yes, hwoarang is helping me. I think we found the source problem15:11
*** mnaser has joined #openstack-ansible15:12
cloudnullmornings15:12
spotzhey15:14
evrardjpok great15:14
evrardjpmorning cloudnull spotz15:14
evrardjphow are things spotz ?15:15
spotzevrardjp: Busy:(15:15
evrardjpprevents boredom15:16
evrardjp:D15:16
mgariepyfun : http://paste.openstack.org/show/663489/15:23
odyssey4meandymccr ping you around? I'd like to reach into your forgotten memories regarding newton->ocata upgrades and cells_v215:24
andymccrodyssey4me: sure - got a meeting in 5, but should be good after that15:24
odyssey4meokie dokey15:25
openstackgerritManuel Buil proposed openstack/openstack-ansible master: l3_agent should only appear in computes when dvr  https://review.openstack.org/54131015:25
openstackgerritManuel Buil proposed openstack/openstack-ansible master: l3_agent should only appear in computes when dvr  https://review.openstack.org/54131015:27
idlemindtux_ are you using centos or ubuntu underneath (i think centos from the yum statement right?)15:29
idlemindtux_ if you rerun openstack-ansible os-glance-install.yml (from playbooks dir) do you get the same error time and again?15:31
idlemindif that's the case you could start by attaching to the glance container and trying a yum update just to see if it has good connectivity (dns/etc) and from there you could check the repo server as well15:35
*** santacloud has joined #openstack-ansible15:35
*** armaan has quit IRC15:40
*** armaan has joined #openstack-ansible15:41
*** pedja has quit IRC15:42
*** pedja has joined #openstack-ansible15:42
*** pcaruana has quit IRC15:51
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Add defaults for lxc container_tech  https://review.openstack.org/54131515:52
cloudnullmgariepy: that's a good idea.15:53
cloudnullhaving the neutron_agents in that list makes a lot of sense IMO.15:53
cloudnullas folks upgrade to queens they'll have those containers given that they already exist in inventory so if we can add more guards to prevent them from restarting I think it's a good idea.15:54
mgariepyrabbitmq15:55
mgariepyalso, since it's a ""live"" upgrade rolling restart of all container  would be better haha15:55
mgariepyi'm not sure i'll have time to create patch for this tho.15:56
mgariepyi need to babysit ansible today for the pike upgrade haha15:56
odyssey4memgariepy that's already done for galera_server, so perhaps it'll be easy enough to almost copy and paste15:56
mgariepyodyssey4me, yep15:57
odyssey4mehttps://github.com/openstack/openstack-ansible/blob/stable/pike/scripts/run-upgrade.sh#L186-L18915:57
mgariepyi would integrate that in minor upgrade as well i think.15:57
mgariepymy ocata upgrade went way better than my pike one so far :)15:58
odyssey4methat's already done, or should be: https://github.com/openstack/openstack-ansible/blob/stable/pike/playbooks/rabbitmq-install.yml#L16-L35 for the container config changes, then https://github.com/openstack/openstack-ansible/blob/stable/pike/playbooks/rabbitmq-install.yml#L50-L6515:58
odyssey4methe same is done for galera, so perhaps that run_upgrade script stuff is no longer required - someone would have to test and verify15:59
mgariepyit's the lxc-container-create that restarted my containers on pike upgrades.15:59
odyssey4meah, dammit - it'd be far better if we could finally move to JIT container creation to control that better16:00
mgariepyit's not that bad, just some small issues here and there ;) a lot of stuff happens everywhere.16:01
evrardjpyeah maybe., we don't test container uptime in upgrades. We should16:01
evrardjpBug triage cloudnull, DimGR, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, mhayden, scarlisle, luckyinva, ntt, javeriak, spotz, vdo, jmccrory, alextricity25, jasondotstar, admin0, michaelgugino, ametts, bgmccollum, darrenc, JRobinson__,16:01
evrardjpasettle, colinmcnamara, thorst, adreznec, eil397, qwang,nishpatwa_, cathrichardson, drifterza, hwoarang, cshen, ullbeking16:01
evrardjpHere is our bug list for today https://etherpad.openstack.org/p/osa-bugtriage16:01
evrardjp#startmeeting openstack_ansible_meeting16:01
openstackMeeting started Tue Feb  6 16:01:49 2018 UTC and is due to finish in 60 minutes.  The chair is evrardjp. Information about MeetBot at http://wiki.debian.org/MeetBot.16:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:01
*** openstack changes topic to " (Meeting topic: openstack_ansible_meeting)"16:01
openstackThe meeting name has been set to 'openstack_ansible_meeting'16:01
evrardjp#topic rollcall16:02
*** openstack changes topic to "rollcall (Meeting topic: openstack_ansible_meeting)"16:02
prometheanfireo/16:02
evrardjpnobody else?16:02
mgariepyi'm half-here.16:03
odyssey4meo/16:03
evrardjplet's start, 3.5 people :)16:03
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/174762916:03
openstackLaunchpad bug 1747629 in openstack-ansible "A worker was found in dead state" [Undecided,New]16:03
evrardjp#topic bugs16:03
*** openstack changes topic to "bugs (Meeting topic: openstack_ansible_meeting)"16:03
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/174762916:03
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Ensure neutron agents & rabbitmq do not restart when upgrading  https://review.openstack.org/54132016:04
odyssey4memgariepy https://media.giphy.com/media/xT9IgN8YKRhByRBzMI/giphy.gif ;)16:04
cloudnullmgariepy: ^16:04
cloudnullevrardjp: i'm here this morning :)16:04
evrardjpwoot16:04
cloudnull4.5 people :)16:04
evrardjpok so the first one is interesting16:04
cloudnullmore like 3.7516:04
cloudnull:P16:04
spotzsorta here, ping if needed16:04
*** Guy has quit IRC16:04
*** v1k0d3n has quit IRC16:04
evrardjpit doesn't seem to reproduce in my machine, but reliably happens in the gates. It seems we have dead workers after a certain time in the translations jobs16:05
odyssey4mehmm, that worker dead state issue is something I've seen when the host runs out of memory16:05
*** v1k0d3n has joined #openstack-ansible16:05
odyssey4meansible basically just croaks16:05
evrardjpodyssey4me: indeed, I've seen that too16:05
evrardjpso maybe there is something to reduce memory consumption for that job16:05
mgariepycloudnull, reviewed ;)16:06
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron master: add ml2 config for networking bgpvpn  https://review.openstack.org/52259816:06
evrardjpis there anyone that wants to confirm this, work on it?16:07
*** armaan has quit IRC16:07
evrardjpif not I'll move to the next bug16:07
evrardjpok next16:08
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/174762816:08
openstackLaunchpad bug 1747628 in openstack-ansible "Upgrades to Queens are broken due to new container scaffolding" [Undecided,In progress] - Assigned to Kevin Carter (kevin-carter)16:08
*** armaan has joined #openstack-ansible16:08
evrardjpcloudnull: could you have a look?16:08
evrardjpgreat!16:08
evrardjpthanks16:08
evrardjpmust be something real quick to fix16:08
evrardjplet's move on16:08
cloudnullevrardjp: already done.16:08
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/174735016:08
prometheanfirelol16:08
openstackLaunchpad bug 1747350 in openstack-ansible "openstack-ansible failed on ubuntu 16.04 aio " [Undecided,New]16:08
cloudnullhttps://review.openstack.org/#/c/541315/16:08
evrardjpcloudnull: yeah I've seen, thanks.16:08
cloudnullevrardjp: ^16:08
odyssey4methat failure is not a failure16:09
odyssey4meit's a try/rescue block16:09
evrardjpit looks invalid16:10
evrardjpindeed16:10
odyssey4meI've commented16:10
cloudnull++ odyssey4me with https://review.openstack.org/#/q/Ic54a7524c09a170e20830c5f8d2c2a0658159ed016:10
odyssey4meThat, and there is still the set of rabbitmq try/rescue blocks that causes confusion.16:10
andymccrinvalid!16:10
cloudnullhopefully it'll be clearer when the playbooks fail or succeed16:10
cloudnullthat is until ansible 2.5 is released and the try/except ux is better16:11
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/174731316:12
openstackLaunchpad bug 1747313 in openstack-ansible "openstack-ansible failed to build AIO" [Undecided,New]16:12
odyssey4meJa, added that comment to the bug. I'm not a fan of that set of patches - I would far rather have us rework that try/rescue block into something that doesn't require a task failure.16:12
cloudnullcool16:12
odyssey4meBut meh, I don't really have the time to spend on it.16:12
evrardjpwe've all commented on that bug. nice!16:12
evrardjpodyssey4me: that's what we should probably do indeed. Because the rescue is meant as a rescue :)16:12
evrardjplast resort stuff, not expected failures.16:13
evrardjpanyway16:13
evrardjpnext one is selinux16:13
evrardjphttps://bugs.launchpad.net/openstack-ansible/+bug/174731316:13
openstackLaunchpad bug 1747313 in openstack-ansible "openstack-ansible failed to build AIO" [Undecided,New]16:13
odyssey4methis looks kinda like a dup of the last one, except for the selinux thing16:13
odyssey4meI thought that we had selinux things in the ansible bootstrap though16:13
odyssey4mein this one the failure is again not actually a failure16:13
evrardjplet's check real quick16:14
odyssey4meah, except for the "Check for unlabeled device files" task16:14
evrardjpwait16:14
evrardjpopenstack-ansible-security16:14
evrardjpthat's old.16:14
odyssey4meoh, good catch there16:15
*** redondo-mk has quit IRC16:15
odyssey4meit's tagged with the beta, but doesn't look beta related16:15
*** redondo-mk has joined #openstack-ansible16:15
*** wlmbasson has quit IRC16:15
evrardjpno it's not.16:15
evrardjpthat's not possible.16:15
evrardjpwill comment on the bug16:15
evrardjpmarked it as incomplete16:16
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/174614216:16
openstackLaunchpad bug 1746142 in openstack-ansible "Nova uid/gid sync, default/standards" [Undecided,New]16:16
odyssey4meThe reason it's not defaulted is exactly for the reason he describes... it will break an upgrade16:17
evrardjphere it's a question of: is that a whishlist, or a real bug? (think about people using shared storage)16:17
cloudnullwishlist16:17
odyssey4meboth the cinder and nova roles implement very broad access rights to the storage folders so that the uid/gid should not matter16:18
odyssey4methat's as far as I recall, at least16:18
odyssey4meso if we implement a default, we have to implement a migration tool too so that upgrades work16:18
andymccryeah wishlist16:18
odyssey4meso yeah, that's a feature request - and a hard one to do16:18
andymccrimo just dont set the uid/gid why would you need to? unless you are doing a new deploy16:18
odyssey4meandymccr on a shared storage system (like NFS), if each compute has a different nova uid, then stuff doesn't work right... but we work around that using very brooad access settings which is quite horrible, really16:19
*** RandomTech has joined #openstack-ansible16:20
odyssey4mewe've long talked about having a global uid/gid map - even back in juno I remember chatting about it16:20
evrardjpI think we all agree, and we can continue16:20
evrardjpif someone wants consistant uid he can do it beforehand16:20
odyssey4mebut the upgrade issue is always where it got stuck16:20
evrardjpnext16:21
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/174567516:21
openstackLaunchpad bug 1745675 in openstack-ansible "aide database file is missing" [Undecided,New]16:21
evrardjpmhayden: ?16:21
evrardjpcould you have a look at it?16:21
evrardjpwho is okay with the fact I assign that to mhayden ?16:22
*** kstev has joined #openstack-ansible16:22
evrardjp:D16:22
odyssey4mewell, anyone could pick it up I guess - but mhayden would probably be interested :)16:22
evrardjpyeah16:23
odyssey4melooks like that process needs a little bit of TLC to make it more reliable16:23
evrardjpI leave it as new for now. Just assigned mhayden for the incentive16:23
evrardjplet's move on16:23
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/174536116:23
openstackLaunchpad bug 1745361 in openstack-ansible "Failed to create subvolume /var/lib/machines/ when run 'openstack-ansible setup-hosts.yml' multiple times" [Undecided,New]16:23
evrardjpgokhan: was definitely unlucky on this one16:24
*** DanyC has quit IRC16:24
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Ensure neutron agents & rabbitmq do not restart when upgrading  https://review.openstack.org/54132016:24
andymccrhmm16:24
odyssey4meDefer to cloudnull for that one.16:25
*** DanyC has joined #openstack-ansible16:25
odyssey4meThere may already be a fix available - I remember seeing something about quotas and such.16:25
evrardjpyeah maybe16:25
evrardjpcloudnull: ?16:25
*** weezS has joined #openstack-ansible16:25
evrardjpcould you handle this one?16:25
cloudnullyup, https://review.openstack.org/#/c/527592/16:26
evrardjptriage it and take decisions?16:26
cloudnullI need to update it seems as reno is unhappy16:26
evrardjpgreat16:26
evrardjpyeah I've quickly reviewed to link both the bug and the review.16:26
evrardjplet's continue16:27
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/174528716:27
openstackLaunchpad bug 1745287 in openstack-ansible "ceph-mon : collect admin and bootstrap keys fails on CentOS7" [Undecided,New]16:27
andymccrcloudnull knocking it out the park!16:27
odyssey4mecloudnull need a closes-bug in that commit msg too then16:27
cloudnullodyssey4me: ++ will add16:27
mhaydenevrardjp: sorry -- got caught in something... feel free to assign16:28
andymccrhmm that is weird16:28
odyssey4melooks like it failed to collect the data it needs from the mons16:28
*** vnogin has quit IRC16:28
odyssey4meconnectivity, or perhaps ssh key issue?16:28
evrardjpit looks like a problem with quorum?16:28
evrardjpbut on top of that unable to find a keyring on /etc/ceph/ceph.client.admin.keyring16:29
odyssey4meor yes, perhaps actually a ceph cluster issue16:29
*** weezS has quit IRC16:29
odyssey4mesounds to me like the cluster setup wasn't complete16:29
*** DanyC has quit IRC16:29
andymccrwell its a ceph-mon role from ceph-ansible task that is failing16:29
evrardjpandymccr: does that look right to you?  "addr": "172.29.236.177:6789/0",16:29
evrardjpthat doesn't like nice16:30
andymccrim sure its the mon service16:30
andymccrnot sure what the /0 is16:30
*** weezS has joined #openstack-ansible16:30
evrardjpor "addr": "0.0.0.0:0/1",16:30
jamespageodyssey4me: pylxd 2.0.6 is now on pypi16:31
odyssey4mejamespage brilliant, thank you very much!16:31
andymccrthe /0 is fine16:31
andymccr    "extra_probe_peers": [16:32
andymccr        "172.29.236.32:6789/0",16:32
andymccr        "172.29.236.33:6789/0"16:32
andymccrfor e.g. on my test aio right now i have ^16:32
andymccrand that succeeded fine16:32
evrardjpthe configuration doesn't look that bad on the given tar file16:32
evrardjpjamespage: \o/16:32
jamespagetinwood: ^^ take the praise (not my work)16:33
evrardjptinwood: \o/ too!16:33
tinwoodthanks16:33
evrardjpandymccr: what's your take?16:33
evrardjpon the bug16:33
andymccrhttp://tracker.ceph.com/issues/21427 id follow that16:33
andymccrit is failing on a specific task - ceph-create-keys i think if we could get more info16:33
andymccrlike what does a manual run output. etc16:33
andymccrits hard to say if its something setup in our deploys or a ceph-ansible bug or a ceph bug overall16:34
*** weezS has quit IRC16:34
evrardjpcould you comment on the bug to ask the additional info, please?16:35
evrardjpI'll mark it as incomplete16:35
evrardjpok let's move on16:35
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/174528116:35
openstackLaunchpad bug 1745281 in openstack-ansible "galera_server : Create galera users fails on CentOS7" [Undecided,New]16:35
*** pedja has quit IRC16:36
evrardjpthis proves how centos is broken :/16:36
evrardjpor on how the deployer's environment is broken16:36
evrardjp:D16:36
*** pedja has joined #openstack-ansible16:36
andymccrwill do16:36
*** pedja has quit IRC16:37
andymccrit also shows ppl kinda like centos :P16:37
evrardjpI will tackle this one I guess, except if mgariepy has the time to do it between two things?16:37
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Clean-up old systemd prep and allow machinctl to grow  https://review.openstack.org/52759216:38
idlemind+1 centos, i haven't seen this one yet but i only have a single galera container atm (fail on me i know right)16:38
evrardjpgood point idlemind , I have to try with a cluster.16:39
evrardjplet's move on16:39
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/174527016:40
openstackLaunchpad bug 1745270 in openstack-ansible "unable to connect to epmd (port 4369) on CentOS7" [Undecided,New]16:40
evrardjpnow I am thinking this whole series is a networking issue :p16:40
evrardjplet's move on16:41
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/174521516:41
openstackLaunchpad bug 1745215 in openstack-ansible "Every openstack client is built in the repo build" [Undecided,New]16:41
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/newton: Update os_nova and repo_build role SHA's  https://review.openstack.org/54125916:42
cloudnullevrardjp: seems like not a bug, given the mentioned refactor ?16:43
odyssey4meyeah, feature release16:43
odyssey4meit's a bit painful, but not a bug - it's due to heat and that's life16:43
*** hamzy has quit IRC16:43
odyssey4meif you don't use heat, remove it from your config and life will be awesome again :)16:44
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests master: Add a status line for SELinux status  https://review.openstack.org/54137116:44
odyssey4meI mean, we could propose patches to the heat client repo, which would be nice - if someone has the time and inclination, awesome16:45
evrardjpyeah. In the meantime it's wishlist I'd say, and confirmed.16:45
odyssey4meyep16:45
*** brad[] has quit IRC16:45
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/174521216:45
openstackLaunchpad bug 1745212 in openstack-ansible "default_bind_mount_logs changes on N>O upgrade" [Undecided,New]16:45
evrardjpwe can mark this fix released I guess?16:46
odyssey4melooks like it16:46
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/174445816:46
openstackLaunchpad bug 1744458 in openstack-ansible "Failed to build cradox on CentOS7 " [Undecided,New]16:46
odyssey4meunless it's not actually solved? mgariepy - I see the reviews were marked 'related', not 'closes'16:47
*** pedja has joined #openstack-ansible16:47
odyssey4meI think this was solved recently16:47
odyssey4mehttps://review.openstack.org/#/c/530570/16:47
evrardjpYes I think it looks solved16:48
evrardjpfix released16:48
evrardjpwoot16:48
mgariepyhrm , sorry was the time i was half - not here haha :)16:48
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/174303216:48
openstackLaunchpad bug 1743032 in openstack-ansible "Galera cluster maintenance in OpenStack-Ansible" [Undecided,New] - Assigned to Kevin Carter (kevin-carter)16:48
*** chyka has joined #openstack-ansible16:49
evrardjpcloudnull: do you have time to check at this one, or should we unassign it?16:49
nurdie_https://docs.openstack.org/openstack-ansible-ceph_client/latest  <-- is that just a guide on what to include when making our own ceph-install play? So, for instance, this could replace the ceph-install play that gets called from /opt/openstack-ansible/playbooks/setup-infrastructure.yml?16:49
nurdie_for integration with an existing ceph cluster16:50
evrardjpnurdie_: let's talk after the bug triage, in 10 minutes.16:50
nurdie_evrardjp, thanks!16:50
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova stable/newton: Revert "Switch the LXD compute driver test to non-voting"  https://review.openstack.org/54137216:50
cloudnullevrardjp:  I can look into that today16:51
evrardjpthat's great!16:51
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova stable/newton: Revert "Switch the LXD compute driver test to non-voting"  https://review.openstack.org/54137216:51
evrardjpnext16:51
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/173947216:51
openstackLaunchpad bug 1739472 in openstack-ansible "mariadb-client excluded in ocata centos7 deploy" [Undecided,New] - Assigned to Markos Chandras (hwoarang)16:51
evrardjphwoarang: said he cannot attend the meeting today, so let's postpone the discussion of this, unless someone has anything to say?16:52
evrardjpok let's move on then16:52
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/173782716:52
openstackLaunchpad bug 1737827 in openstack-ansible "(ceph-client): setting 'nova_ceph_client' results in deployment where volumes can't be attached to VMs" [Undecided,New]16:52
odyssey4methat's an old bug IIRC16:53
odyssey4mewhat I mean is, I've seen that discussed in channel before - I think admin0 made some noise about it16:53
andymccrahh igot feedback on that16:53
*** dcdamien has quit IRC16:53
evrardjpodyssey4me: yeah, I am sure I got that biting me too in the past... but things might have changed now :)16:54
evrardjpandymccr: ?16:54
andymccrlemme look at the comments16:54
andymccri'll take that one16:54
evrardjpok16:54
evrardjpassigning it to you16:54
evrardjpthanks16:54
evrardjpnext16:55
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/172926316:55
openstackLaunchpad bug 1729263 in openstack-ansible "Swift (master) transient tempest failures under centos " [Undecided,New]16:55
evrardjplet's skip that one16:55
evrardjp#link https://bugs.launchpad.net/openstack-ansible/+bug/172155416:55
openstackLaunchpad bug 1721554 in openstack-ansible "os_ceilometer fails without swift installed" [Medium,New]16:55
evrardjpI have the impression there was a patch for this one16:56
*** chyka_ has joined #openstack-ansible16:56
evrardjpmnaser: are you there?16:57
mnasero/16:57
* mnaser reads that bug16:57
*** chyka has quit IRC16:57
*** dcdamien has joined #openstack-ansible16:57
*** rama_y has joined #openstack-ansible16:58
evrardjpthanks mnaser !16:58
mnaserokay it looks like this is something that should be skipped if not using swift16:58
evrardjpIf you are working on removing mongo there are maybe other things on that topic that can cause issues, and things to be aware of...16:58
evrardjpthanks for having a look!16:58
evrardjpif you need any help, don't hesitate mnaser !16:59
evrardjpok we are out of time17:00
evrardjpthanks everyone for your help on making the world of openstack-ansible better17:00
evrardjp#endmeeting17:00
*** openstack changes topic to "Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: https://goo.gl/tTmdgs"17:00
openstackMeeting ended Tue Feb  6 17:00:22 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)17:00
openstackMinutes:        http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2018/openstack_ansible_meeting.2018-02-06-16.01.html17:00
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2018/openstack_ansible_meeting.2018-02-06-16.01.txt17:00
openstackLog:            http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2018/openstack_ansible_meeting.2018-02-06-16.01.log.html17:00
evrardjpnurdie_: you may ask your questions now :)17:01
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_ceilometer master: Skip creation of Swift user if Ceilometer support is disabled  https://review.openstack.org/54137417:01
mnaservoila ^17:01
evrardjpI am leaving though.17:01
evrardjpwoot that was quick mnaser17:01
*** SerenaFeng has joined #openstack-ansible17:02
mnaserit was a simple fix, just gotta make sure it was skipping something when swift was disabled17:02
evrardjpyeah I saw17:03
evrardjpI saw that was the default too, and it makes sense17:03
evrardjpthanks a lot17:03
evrardjpyou did great!17:03
mnaser:)17:03
andymccrok i updated that bug!17:04
evrardjprouter firmware upgrade, I think it's time to end my day!17:04
evrardjpthanks andymccr17:05
andymccrodyssey4me: free now to talk ocata cells shenanigans if youre still free!17:05
evrardjpwow17:05
*** derekjhyang has quit IRC17:05
evrardjpyou guys are great!17:06
evrardjpcloudnull: wowow no new bugs!17:06
evrardjp;p17:06
cloudnulltalking about https://bugs.launchpad.net/openstack-ansible/+bug/1747713 ?17:06
openstackLaunchpad bug 1747713 in openstack-ansible "chattr fails sometimes in ansible 2.4" [Undecided,New]17:06
evrardjpand good catch :)17:06
evrardjpyeah17:06
cloudnullI was deploying a new aio to work on the galera issue I'm assigned, and that happened.17:06
cloudnullidk why17:07
nurdie_ https://docs.openstack.org/openstack-ansible-ceph_client/latest  <-- is that just a guide on what to include when making our own ceph-install play? So, for instance, this could replace the ceph-install play that gets called from /opt/openstack-ansible/playbooks/setup-infrastructure.yml?17:07
andymccrpebkac cloudnull17:07
cloudnulllikelu17:07
evrardjpthat's new right?17:07
cloudnull**likely17:07
evrardjpmmm17:07
cloudnullits the first I've seen of it17:07
evrardjpI am building a centos rn, will tell you if I have the same17:07
evrardjpbut I am not on head of master though17:08
andymccrnurdie_: it has a sample playbook at the bottom, the others are more a list of the current default vars and other commented out vars you could set17:08
cloudnullbased on the error "    "details": "Error while setting attributes: Usage: /usr/bin/chattr [-RVf] [-+=aAcCdDeijsStTu] [-v version] files..." it looks like ansible is passing in the wrong flags while executing that command ?17:08
nurdie_andymccr, I'm confused on when this should be run. Should it be run during the OSA rollout, post OSA? From setup-hosts.yml? etc17:09
mgariepycloudnull, re-reviewed https://review.openstack.org/#/c/54132017:10
nurdie_andymccr, is it easiest to setup a farce storage backend when doing a new OSA deployment, and then configuring Ceph afterwards? We have a ceph cluster that does not need configuring17:11
odyssey4meandymccr alright, we're seeing our ocata os_nova upgrade jobs failing... so that's from newton (no cells) upgrading to ocata (with cells v2)... all the tasks run right, but for some reason I'm getting this: https://pastebin.com/C9ji6vdS17:11
odyssey4meif you have no idea, I'll get into the openstack-nova channel and chat there17:12
evrardjpcloudnull: let me check the task and all17:12
andymccrnurdie_: ahh i see. it gets run as part of the nova/glance/cinder - if you have a ceph deploy. so you shouldnt need to manually run that as aplaybook17:12
*** ricardoas has quit IRC17:12
andymccrnurdie_: e.g. for nova: https://github.com/openstack/openstack-ansible-os_nova/blob/master/tasks/main.yml#L112-L12317:13
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Ensure neutron agents & rabbitmq do not restart when upgrading  https://review.openstack.org/54132017:13
andymccrodyssey4me: looking now17:13
evrardjpcloudnull: happening only on nspawn, or also on lxc?17:13
cloudnullmgariepy: re-re-updated :)17:13
cloudnullevrardjp: both17:13
evrardjpmmm fun.17:13
cloudnullbut only on ubuntu17:13
andymccrodyssey4me: i thought we fixed this - hmm. lemme dig a bit. that rings a bell. there was a very specific order you need for upgrades and a diff order for greenfields17:14
evrardjpbut that's the task, right? https://github.com/openstack/openstack-ansible-galera_server/blob/baa97f1df2035e2db969152f64b28b791e25d3d9/tasks/galera_post_install.yml#L182-L18817:14
cloudnullthat's the one.17:14
odyssey4meandymccr it last worked in December last year, and we've had no patches since then but it no longer works as it did before17:15
odyssey4meandymccr see https://review.openstack.org/#/q/branch:stable/ocata+project:openstack/openstack-ansible-os_nova :)17:15
andymccrodyssey4me: yeah ok i was pretty sure it did work.17:15
odyssey4methere have been a bunch of upstream patches, but I haven't really dug into the contents of each one17:15
*** efaf has joined #openstack-ansible17:15
cloudnullevrardjp: this is the command it's trying to run17:16
andymccrodyssey4me: out of interest, if we set the sha for nova back to some version from december or last known working, does it still work? i would assume so17:16
cloudnull['/usr/bin/chattr', '=7375', '/etc/services.8673.2018-02-06@17:15:04~']17:16
odyssey4meperhaps we should just chat with the nova folk, rather than you digging into another issue - I was just wondering if there was something special you remember gave more info or something17:16
*** peri has quit IRC17:16
odyssey4meandymccr hmm, I guess I could try triage that way too to see if we identify what broke things17:17
odyssey4megood idea - lemme do that17:17
andymccrso we had this bug before, and i fixed it here: https://github.com/openstack/openstack-ansible-os_nova/commit/5223270ede7cd4d9e0aa7ab851acab2a6e369f7e17:19
nurdie_andymccr, that isn't part of OSA. I'm getting kind of lost now17:19
andymccrobviously thats not working, but i definitely do remember that exact bug17:19
evrardjpsorry cloudnull17:19
cloudnull?17:20
evrardjpwas afk for a few seconds, missed the conversation17:20
*** SerenaFeng has quit IRC17:20
evrardjpcloudnull: so that's an ansible module change17:20
evrardjplet me check the lineinfile17:21
odyssey4meandymccr good pointer, tyvm, will look at whether those things are doing whatever they should be doing17:21
*** nurdie_ is now known as nurdie17:21
andymccrnurdie_: im not sure i understand which part you mean :) deploying ceph is done via the ceph-ansible project which osa imports. The ceph_client role you mentioned is an OSA role that we use to setup the ceph client on the openstack components (so nova, cinder, glance)17:22
*** guhcampos has joined #openstack-ansible17:22
*** gucampos__ has joined #openstack-ansible17:22
*** guhcampos_ has joined #openstack-ansible17:22
andymccrbut that role is called within the cinder/ceph/glance roles - so you shouldnt need to do anything to call it manually.17:22
andymccrodyssey4me: yeah it could be that fix wasnt that great. it was mine after all :D17:22
evrardjpcloudnull: the last changes don't seem to be altering that chattr behavior17:23
cloudnullyea - https://github.com/ansible/ansible/blame/v2.4.3.0-1/lib/ansible/module_utils/basic.py#L1311-L1328 seems to be about a year old.17:23
nurdieandymccr, correct. I have a Ceph cluster that is already deployed via ceph-deploy. I am having a difficult time seeing which options/variables should be set to run OSA, and have it integrate with an already configured Ceph cluster. So far, every single method I have tried has tried to configure my Ceph cluster for me, instead of just integrating with it17:24
cloudnullevrardjp: however running `/usr/bin/chattr =7375 /somefile` does not work17:24
andymccrnurdie: ahh i see17:24
cloudnullwhich is what is being rendered.17:24
*** tux_ has quit IRC17:24
evrardjpyeah, wondering why it tries to do it17:24
cloudnullits very curious17:25
cloudnulli have a new system coming up on a different ubuntu image. see if i can reproduce it on a fresh box17:25
*** udesale has quit IRC17:25
cloudnullthe aio i have has been kicked around for quite a while17:25
*** geekinutah_ has joined #openstack-ansible17:26
evrardjpI know module_utils are quite changing, but I don't think it should impact this17:26
cloudnullactually... upgrading to ansible 2.4.3, fixed17:26
andymccrnurdie: http://paste.openstack.org/show/663680/ - that should pretty much be it - NB you need access via SSH to the mon hosts, and you will also need precreate openstack users/pools (ceph-ansible usually does that so if you used ceph-deploy you'll need to have those created)17:26
cloudnullwas running 2.4.2, tried 2.4.3 and it's fixed17:26
nurdieandymccr, many thanks. I will play with that17:27
*** geekinutah_ has quit IRC17:27
evrardjpmmm17:28
evrardjpcloudnull: worth a bump :)17:28
cloudnullI will try 2.4.2 again maybe this was not a bug at all and my ansible was just foobar17:28
evrardjpI thought we were on 2.4.3. though17:28
nurdieandymccr, to be clear, those should be set in the openstack_user_config.yml?17:28
evrardjpcloudnull:17:28
evrardjpwoops lag...17:29
evrardjpcloudnull: https://github.com/ansible/ansible/blob/v2.4.3.0-1/lib/ansible/modules/files/lineinfile.py#L213-L22317:29
andymccrnurdie: more like /etc/openstack_deploy/user_variables.yml17:29
andymccrnurdie: or you could add a new file like /etc/openstack_deploy/user_ceph_variables.yml if you wanted17:29
nurdieandymccr, ahhh ok. fanks!!! :317:29
*** geekinutah has joined #openstack-ansible17:29
andymccrnurdie: give it a go. it should work fine - but yeah the gotcha's are going to be that you need ssh access to the mon hosts (thats how it copies over the ceph.conf), and the pools/users created for glance/nova/cinder etc.17:30
geekinutahhey folks, is this channel just for dev or are general question okay here?17:30
cloudnullgeekinutah: all of the above ;)17:31
*** DanyC has joined #openstack-ansible17:31
cloudnullwelcome17:31
geekinutahthanks :-)17:31
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Update ansible to the latest stable  https://review.openstack.org/54138117:33
nurdieandymccr, pools and users are created! thanks i'm going to give a couple of runs17:33
geekinutahbeen playing with openstack-ansible and am having a problem where ansible_host is null on all the containers17:33
cloudnullevrardjp: so, now that I've upgraded and now downgraded the issue is gone.17:33
*** Guest52 has joined #openstack-ansible17:33
cloudnullso i got that going for me17:33
cloudnullwhich is nice17:33
cloudnull:)17:33
cloudnulli think andymccr was right, PEBCAK...17:34
andymccrcloudnull: from experience, thats usually where the problem lies for me :D17:34
cloudnulleither way I added the ansible version bump17:34
andymccreither that or leave the issue alone for a week, come back and it'll just fix itself17:34
cloudnullahhahaa17:34
geekinutahresults in all kinds of things failing in the process17:35
geekinutahparticularly /etc/hosts files which look completely wrong, any ideas on what route I go to troubleshoot?17:35
evrardjpcloudnull: https://paste.ubuntu.com/26531047/17:35
cloudnullgeekinutah: have you setup the openstack_user_config.yml in /etc/openstack_deploy ?17:36
evrardjpthe only thing I expect is a pebkac indeed :p17:36
evrardjpthere are the only changes between the two...17:36
geekinutahcloudnull: yup, want a paste?17:36
cloudnullevrardjp: i can use either ansible version now. IDK why module utils was messed up but a reinstalled fixed it all. so YIPIE !17:37
cloudnullgeekinutah: sure.17:37
cloudnullalso what playbooks are you running ?17:38
evrardjpprobably an alpha version17:38
cloudnulland is this an AIO or prod ?17:38
cloudnullevrardjp: it could have been17:38
*** jbadiapa has joined #openstack-ansible17:38
evrardjp:D17:38
cloudnullI'll never know now :)17:38
* cloudnull closes issue17:38
geekinutahopenstack_user_config.yml ---> https://paste.ubuntu.com/26531061/   user_variables.yml ---> https://paste.ubuntu.com/26531064/17:39
geekinutahcloudnull: I am running setup_all17:39
geekinutahso everything...17:39
geekinutahjust cleared the environment, so I can paste some of the failures soon, right now running through hardening17:40
cloudnullok.17:41
cloudnullwhen/if it fails ping out with the stacktrace if you can17:41
cloudnullalso which release is it ?17:41
geekinutahcloudnull: release is 16.0.617:43
cloudnullok.17:44
cloudnullanyone around want to give this a love tap https://review.openstack.org/#/c/541320/17:45
*** jbadiapa has quit IRC17:45
cloudnullalso https://review.openstack.org/#/c/540956/ could use another review17:49
*** SmearedBeard has quit IRC17:50
*** tux_ has joined #openstack-ansible17:55
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Add nspawn container driver  https://review.openstack.org/47701717:56
*** NostawRm has quit IRC17:57
*** NostawRm has joined #openstack-ansible17:57
*** guhcampos_ has quit IRC17:58
*** gucampos__ has quit IRC17:58
*** guhcampos has quit IRC17:58
*** tux_ has quit IRC18:01
*** guhcampos has joined #openstack-ansible18:03
*** tux_ has joined #openstack-ansible18:04
*** pedja has quit IRC18:07
*** pedja has joined #openstack-ansible18:07
openstackgerritMajor Hayden proposed openstack/openstack-ansible stable/pike: Remove jinja from failed_when  https://review.openstack.org/54139118:11
openstackgerritMajor Hayden proposed openstack/openstack-ansible stable/ocata: Remove jinja from failed_when  https://review.openstack.org/54139218:12
*** hamzy has joined #openstack-ansible18:13
*** hamzy_ has joined #openstack-ansible18:15
*** hamzy has quit IRC18:17
*** brad[] has joined #openstack-ansible18:21
*** rama_y has quit IRC18:23
openstackgerritMajor Hayden proposed openstack/openstack-ansible stable/pike: Remove jinja2 delimiters in when  https://review.openstack.org/54139418:23
xdfilrally_role_project_group: utility_all18:25
xdfilso rally gets installed in the utility container?18:26
xdfilthat seems od18:26
xdfilodd*18:26
xdfilI want stuff like this: https://www.mirantis.com/blog/rally-as-an-openstack-performance-dashboard/18:26
xdfilam I out of my depth on this?18:26
*** brad[] has quit IRC18:34
*** olivierbourdon38 has joined #openstack-ansible18:36
*** hamza21 has joined #openstack-ansible18:40
openstackgerritMajor Hayden proposed openstack/ansible-hardening master: Move aide db when needed  https://review.openstack.org/54139818:40
tux_Folks basic question, how does container talk to internet servers?18:43
tux_I am inside aio1-repo-container-6faedf2a  and trying to ping 8.8.8.8 its not working :(18:44
tux_Does it use iptables NAT or haproxy to get access of public repo18:45
jrosserlxcbr0 on the host should sort that out for you18:45
jrossersee if the container hosts can ping out first18:45
tux_my all container pinging each other but not pinging public server so look like something missing like NAT etc..18:46
*** brad[] has joined #openstack-ansible18:46
tux_Yesterday i shutdown firewalld service may be it wipe out my all NATing rules ?18:47
cloudnulltux_: run, ifdown lxcbr0; ifup lxcbr018:48
cloudnullthen run lxc-veth-check18:49
cloudnullthat should reset the state of the generic lxcbr0 interface and make sure it's wired into your containers.18:49
jrossertheres a helpful diagram here https://docs.openstack.org/project-deploy-guide/openstack-ansible/ocata/app-networking.html18:49
tux_ok18:49
tux_@cloudnull - i did as you said but no luck :(18:50
cloudnullhas anyone running master bumped into this issue https://bugs.launchpad.net/openstack-devel/+bug/168269218:51
openstackLaunchpad bug 1682692 in OpenStack Development Infrastructure "nova fails with error: 'module' object has no attribute 'VIR_MIGRATE_POSTCOPY' after using libvirt 2.5.0 from UCA" [Undecided,New]18:51
tux_from container i can ping lxcbr0 (10.255.255.1)18:51
cloudnulli'm seeing it today18:51
cloudnullnew aio running the head of master ^18:51
cloudnulltux_: there should be a masqerade rule on the host.18:52
*** niraj_singh has joined #openstack-ansible18:52
cloudnullcan you confirm that's in place ?18:52
tux_that is what i am saying, yesterday i removed all iptables rules and look like i don't have any NAT / masqerade rules18:52
cloudnullsomething like `MASQUERADE  all  --  *      *       10.0.4.0/24         !10.0.4.0/24`18:53
cloudnullthat ifup/down should have put it back18:53
cloudnullthere's another command `lxc-system-manage`18:53
cloudnullyou can recreate all of the things18:53
tux_i did ifup/ifdown and it didn't put iptables rules back  (iptables -L -t nat) still empty18:54
tux_Should i try ( lxc-system-manage iptables-recreate ) ?18:55
*** nsingh has quit IRC18:55
cloudnullyea18:55
cloudnullgive it a shot18:55
tux_sweet!!! :)18:55
tux_it works!! thank you so much!18:56
* cloudnull happy dance :)18:56
odyssey4mecloudnull that issue should only come up in two conditions - one is all our settings related to the libvirt python module build are gone, which is unlikely... or the compute host and repo container do not have the same libvirt versions18:57
openstackgerritMerged openstack/openstack-ansible-repo_build stable/newton: Zuul: Remove project name  https://review.openstack.org/53892818:58
odyssey4mecloudnull it is plausible that between your repo build and the compute deploy UCA published a new package ;)18:59
cloudnullodyssey4me: the second is it, host: 3.6.0-1ubuntu6~cloud0 container: 1.3.1-1ubuntu10.1518:59
odyssey4meoh, that's bad - somehow the container didn't get the UCA setup18:59
odyssey4methat's done in https://github.com/openstack/openstack-ansible/blob/master/playbooks/openstack-hosts-setup.yml now, so maybe the restructiring recently has missed that19:00
cloudnullyup, it's missing the /etc/apt/sources.list.d/uca.list file19:00
odyssey4meoh actually, not ther e- it seems it's somewhere else19:01
*** arijr has joined #openstack-ansible19:01
odyssey4meevrardjp moved the UCA stuff to the openstack_hosts role, and the containers get it done in a play somewhere19:01
*** poopcat has joined #openstack-ansible19:01
cloudnullI blew my containers away this morning so maybe there's some new play I need to run to pull that in19:02
odyssey4mecloudnull ah: https://github.com/openstack/openstack-ansible/blob/master/playbooks/containers-lxc-create.yml#L4219:02
cloudnullhum...19:02
cloudnullthat should have been caught19:03
* cloudnull goes splunking19:03
idlemindrandom observation, in the vlan and flat network definitions we use br-vlan for both. when i try to use it i get an error which amounts to neutron needing a separate physical interface for both. neutron is on the compute host (neutron-linuxbridge-agent). shouldn't the documentation and architecture be updated to show something like a br-flat as a port on br-vlan and setup the flat network to use br-flat? #19:08
idlemindlayersuponlayersofbridges19:08
geekinutahcloudnull: got my first failure: https://paste.ubuntu.com/26531470/19:08
*** mbuil has quit IRC19:09
cloudnullidlemind: I wish we could. the flat networking option in neutron needs an actual interface (not a bridge)19:09
idlemindcloudnull really like a raw ethernet port?19:09
*** stuartgr has quit IRC19:09
cloudnullwhich is why the example hangs the veth off a bridge and plumbs neutron to one end of it19:10
cloudnullwhen neutron uses a flat network it creates a bridge and you can't bridge a bridge :)19:10
idlemindso you can't put a bridge in a bridge19:11
cloudnullyou could create a vlan tagged interface for it, hang a veth, etc.19:11
idlemindin a bridge19:11
idlemind:)19:11
geekinutahthe failure actually comes from this line https://github.com/openstack/openstack-ansible-haproxy_server/blob/0eb657614ed82eda0c7e45773aa631c2d8073542/templates/service.j2#L10519:11
cloudnullbut not bridge a bridge using bridges of bridges.19:11
cloudnull:{19:11
cloudnull:P19:11
geekinutahansible_host is null, so if I replace that with another var, like ansible_default_ipv4.address, it will pass this point19:11
idlemindhmm cloudnull good point on that my network architecture uses a lot of bridges. my br-vxlan, vlan, mgmt, storage are actually bridges created from vlan interfaces on an underlying bridge w/stp on (#awful compared to bonding except fail-over w/o vpc aware switches upstream)19:12
cloudnullgeekinutah: can you look at the the openstack-inventory.json file and see if the "ansible_host" is set there?19:13
cloudnullit should be.19:13
cloudnullbut i'd like to confirm in your deployment19:13
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests stable/newton: Update git_branch for nova/ironic  https://review.openstack.org/54140619:13
idlemindso i might be able to wiggle something that way, keep my vlan i use for br-vlan (qinq) and just tag another vlan for the flat one and point it to the otherwise unused vlan interface off my base bridge19:13
geekinutahcloudnull: ansible_host is set for all the hosts. For containers it is always null.19:14
cloudnullidlemind: ah yes. we've had to do something similar. in our normal deployments we do eth(s) > bonding > vlan tagged interfaces > bridges19:14
idlemindyup i just use a bridge instead of a bond becuz no nexus 7k's in the home lab19:14
cloudnullhowever we've had to do eth > bridge > vlan tagged intefaces from bridge > bridges19:14
cloudnullwhich worked but looked funky19:15
idlemindppl are going to think we're crazy if we keep saying bridge19:15
cloudnullhahaha19:15
idlemindor that we're playing cards19:15
cloudnullfrom now on I will refer to bridge as Pinochle.19:16
cloudnull:P19:16
idlemindlol19:16
idlemindso segway, any thoughts on https://bugs.launchpad.net/openstack-ansible/+bug/1747684 ... it could be chunked into at least 2 changes. in particular i think horizon_ssl_no_verify should be True since self-signed certs are the default19:16
openstackLaunchpad bug 1747684 in openstack-ansible "Default Values Do Not Allow Image Uploads to Glance from Horizon" [Undecided,New]19:16
idlemindthe other stuff for glance and cors could be a separate change19:17
cloudnulloh mhayden19:19
mhaydenoh cloudnull19:19
cloudnulllooks like http://yum.mariadb.org/10.1/centos/7 was renamed to http://yum.mariadb.org/10.1/centos7-amd64/19:19
mhaydenwell that's cute19:19
tux_Here you are!! cloudnull19:19
cloudnullmhayden: which by definition means this is your fault.19:19
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova stable/newton: Change stable/newton branch to newton-eol  https://review.openstack.org/54140719:19
mhaydencloudnull: haha okay, i'll go look19:19
cloudnull:)19:19
mhaydencloudnull: is there a bug open?19:20
cloudnulltux_: ^ ?19:20
cloudnullnone that i'm aware of yet19:21
mhaydenhttps://bugs.launchpad.net/openstack-ansible/+bug/174774019:21
openstackLaunchpad bug 1747740 in openstack-ansible "CentOS yum repository for galera has moved" [Critical,Confirmed] - Assigned to Major Hayden (rackerhacker)19:21
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ironic stable/newton: Change stable/newton branch to newton-eol  https://review.openstack.org/54140819:21
tux_not yet! i just discovered while running build19:21
mhaydengood catch19:21
*** jafeha has quit IRC19:21
odyssey4memhayden probably best to add a reno telling everyone what override to set for the versions of OSA which don't use the right URL19:22
*** arijr has quit IRC19:22
mhaydenodyssey4me: i assume we're talking about galera_repo_url ?19:23
odyssey4memhayden whichever one needs overriding on older OSA versions ;)19:23
* odyssey4me can't keep up any more :p19:24
mhaydenwell, if someone has it set to a custom value right now, then this change won't affect them most likely19:24
mhaydenunless i am missing your point entirely19:25
idlemindadd it to the bug / change / review so ppl using non-master branches or behind master branches know what override statement they can just plop in when they arrive at the bug / change / review via google?19:26
mhaydenoh, i see what you mean19:27
mhaydenwe could always use logan's mirror ;) http://mirror.lstn.net/mariadb/yum/10.1/centos7-amd64/19:28
* mhayden winks19:28
*** DanyC has quit IRC19:29
geekinutahcloudnull: any thoughts on the ansible_host being null?19:31
cloudnullgeekinutah: sorry, it sounds like the inventory was generated in error.19:32
openstackgerritAntony Messerli proposed openstack/openstack-ansible-ops master: Stop any running VMs when re-deploying  https://review.openstack.org/54141619:32
cloudnullgiven that this is a new deployment19:33
cloudnulland not all that far in, I'd run `openstack-ansible lxc-container-destroy.yml` then delete the json file and rerun the playbook.19:33
geekinutahyeah, I've done that :-/19:34
odyssey4memhayden the point is anyone trying to deploy something old - it'll break... their choices are to upgrade to the latest OSA, or to override... they need to know :)19:34
cloudnullgeekinutah: including deleting the json file ?19:34
geekinutahit consistently comes back as being null, so I was thinking I had misconfigured something...19:34
geekinutahyeah, deleted the json19:34
cloudnullif so then there's something off in the openstack_user_config.yml19:34
cloudnullmind sharing that paste again19:34
cloudnull?19:34
geekinutahhttps://paste.ubuntu.com/26531061/19:35
openstackgerritMajor Hayden proposed openstack/openstack-ansible-galera_server master: Update MariaDB CentOS yum mirror URL  https://review.openstack.org/54141719:39
openstackgerritMajor Hayden proposed openstack/openstack-ansible-galera_client master: Update MariaDB CentOS yum mirror URL  https://review.openstack.org/54141919:42
openstackgerritMajor Hayden proposed openstack/openstack-ansible-galera_server master: Update MariaDB CentOS yum mirror URL  https://review.openstack.org/54141719:43
geekinutahI might just have to step through the inventory generator after lunch... I'm sure it's something dumb like typo or indentation, but I am not finding it :-(19:46
cloudnullgeekinutah: http://paste.openstack.org/show/663881/19:47
tux_Folks, my aio1-galera-container-6add7d91 container IPs disappeared, what could be the reason for that?19:47
cloudnullit was a yaml spacing issue19:47
geekinutahoh nice! Thx! I'll give it a try19:48
cloudnullyea, sorry about that,  i should have noticed that before.19:48
cloudnullyou'll have to delte the json file again19:48
cloudnullbut it generates correctly now19:48
geekinutahno problem, just thanks for the help19:49
geekinutahI owe you an IRC beer19:49
* cloudnull will work for beer19:52
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Build everything on metal  https://review.openstack.org/50422419:54
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests stable/ocata: Collect logs to a subfolder properly  https://review.openstack.org/54142620:00
*** jafeha has joined #openstack-ansible20:00
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests stable/newton: Collect logs to a subfolder properly  https://review.openstack.org/54142820:00
*** guhcampos has quit IRC20:00
odyssey4meevrardjp after a long chat with the nova crew, they're also scratching their heads and wanting more logs - unfortunately our CI isn't giving logs... so I'll be working on making sure out upgrade tests are giving us logs for ocata20:01
odyssey4mehence the patches I've just done for newton/ocata20:02
mnasermariadb fix is to be backported? :>20:03
odyssey4memnaser of course, once it has its votes and merges20:04
mnasernot a great day for the gate today20:04
odyssey4meit's always nice when yum/apt repositories change keys or URLs20:05
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_magnum master: Update the Tempest plugin to point towards the new plugin  https://review.openstack.org/54126920:07
mgariepyupgrade to pike is over now :)20:09
mgariepywasn't too bad. but not as smooth as the ocata one.20:10
mhaydenwoot20:10
odyssey4memgariepy got any bug fixes ti push up?20:10
mhaydengot any bugs?20:10
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_trove master: Update the Tempest plugin to point towards the new plugin  https://review.openstack.org/54127220:10
odyssey4memnaser is killing it :)20:11
mgariepyhaproxy check service (neutron-server and placement api)  made them offline20:11
evrardjpmnaser: there are sometimes patches that are open for repos, like for example the lint fix in os_magnum. If you could re-use or close that would be good :)20:11
evrardjpmnaser: is on a row!20:11
mnaserevrardjp: oh dang, i didnt notice20:11
evrardjp:D20:11
evrardjpwooot!20:11
mnaseri'll co-author it20:11
mnaserit has to be merged together though to unbreak gate20:11
evrardjpoh no it's fine, it's to avoid things20:11
mgariepyceph is upgrade (from uca is also not that great)20:11
mgariepyceph upgrade (from uca is also not that great)20:12
evrardjpI mean sometimes you can just reuse what was there, that is probably partial fixes or things to do20:12
evrardjpjust trying to help20:12
evrardjpodyssey4me: did you backport those patches already? I will have a look in that case20:12
odyssey4meevrardjp which patches?20:13
*** SmearedBeard has joined #openstack-ansible20:14
mgariepybeside that, uca repo is defined once per upgrade in /etc/apt/sources.list.d/ubuntu_cloud_archive_canonical_com_ubuntu.list20:14
mgariepyi'll patch that up tomorrow.20:14
odyssey4meevrardjp got some fixes: https://review.openstack.org/541406 & https://review.openstack.org/541407 & https://review.openstack.org/541408 & https://review.openstack.org/541426 & https://review.openstack.org/54142820:14
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_magnum master: Update the Tempest plugin to point towards the new plugin  https://review.openstack.org/54126920:14
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_trove master: Update the Tempest plugin to point towards the new plugin  https://review.openstack.org/54127220:15
mnasersorry for the spams20:16
mnaserbut added co-authored-by so one commit can fix the gate20:16
evrardjp:)20:16
evrardjpthanks mnaser !20:16
mgariepyah and pci nova config is outdated.20:18
mgariepymhayden,  >> http://selinuxgame.org/20:19
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_aodh master: Update the Tempest plugin to point towards the new plugin  https://review.openstack.org/54127020:20
mhaydenmgariepy: i have that on my to-do list20:21
mgariepyselinux games or the pci stuff ?20:21
mgariepyi'll try to upload a patch for pci tomorrow, i have a pretty good idea of what I need. just need to write it.20:22
evrardjpwhat's the issue with uca?20:23
mhaydenthe selinux games20:23
mgariepyi have repo for newton, ocata, and pike after the upgrade.20:25
mhaydenthat's good redundancy20:25
mgariepythe repo is added but the older one is not removed.20:25
mhaydenalways good to have extras20:25
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Zuul: Remove project name  https://review.openstack.org/54121920:25
mgariepyyeah20:25
mgariepyuntil they stop responding. lol20:25
mgariepyand the pike repo is messing with ceph repo. (they have the same priority which is causing issues)20:26
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_ceilometer master: Drop MongoDB installation and API file configurations  https://review.openstack.org/54127520:29
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_ceilometer master: Skip creation of Swift user if Ceilometer support is disabled  https://review.openstack.org/54137420:29
*** jamesdenton has joined #openstack-ansible20:29
evrardjpcores: stable/pike implementation of memcached changes for backwards compatibility https://review.openstack.org/#/c/540931/20:29
evrardjpugly but ...20:30
mhaydenthat's some fancy footwork20:30
mhayden:)20:30
evrardjp(to be reviewed with: https://review.openstack.org/#/c/540964/ )20:30
mgariepyhttps://bugs.launchpad.net/openstack-ansible/+bug/174775420:31
openstackLaunchpad bug 1747754 in openstack-ansible "container /var/backup mounted twice on upgrade to pike" [Undecided,New]20:31
*** hw_wutianwei1 has joined #openstack-ansible20:32
mnaserevrardjp: you were right about aodh, 13 hours ago :>20:32
evrardjphaha20:32
evrardjpgood20:32
evrardjpI trust you :)20:32
evrardjpoh you even putted the link, great!20:34
*** hw_wutianwei has quit IRC20:34
*** hw_wutianwei1 is now known as hw_wutianwei20:34
*** foutatoro has joined #openstack-ansible20:37
mgariepyUCA issue >>  https://bugs.launchpad.net/openstack-ansible/+bug/174775520:37
openstackLaunchpad bug 1747755 in openstack-ansible "UCA repo included multiple times" [Undecided,New]20:37
lbragstadis it possible install apache + uwsgi with the os_keystone role?20:38
mgariepylbragstad, I guess that what this test is doing : openstack-ansible-uw_apache-ubuntu-xenial20:39
foutatorohi all, L deploed OSAD 15.1.14 but I get this error when lanching instance http://paste.openstack.org/show/663954/20:40
lbragstadhuh - ok, i figured as much, but i was following along tasks/main.yml and didn't really see how the keystone_apache.yml plays get invoked20:40
foutatorodid somebody get this error before ?20:41
*** arijr has joined #openstack-ansible20:41
*** Guest52 has quit IRC20:42
mgariepylbragstad, https://github.com/openstack/openstack-ansible-os_keystone/blob/master/defaults/main.yml#L18120:42
lbragstadah20:42
*** Smeared_Beard has joined #openstack-ansible20:43
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova master: If debug is enabled, provide verbose output for host discovery  https://review.openstack.org/54144320:44
*** SmearedBeard has quit IRC20:44
mgariepylbragstad, https://github.com/openstack/openstack-ansible-os_keystone/blob/master/tasks/main.yml#L111-L11320:44
mgariepythere you go :)20:44
lbragstadpsh - if it were any closer it would have bit me20:45
lbragstadthanks mgariepy :)20:45
mgariepywelcome20:45
mgariepylate enough for me. talk to you tomorrow, have a nice evening everyone20:45
RandomTechhave a nice evening20:48
* odyssey4me watches the patch approvals suddenly burt into life20:49
*** chyka_ has quit IRC20:49
odyssey4me*burst20:49
*** olivierbourdon38 has quit IRC20:50
* odyssey4me opens evrardjp's https://review.openstack.org/540931 - sees the jinja, closes it20:52
odyssey4metoo much for my tired brain right now :p20:52
* odyssey4me sends it over to jmccrory to review instead20:52
*** RandomTech has quit IRC20:53
jmccrorymmmm jinja20:54
odyssey4meok, so I reviewed it anyway - the second patch intrigued me... only removing stuff, not adding a thing... it made me wonder how keystone would know what to use for memcache20:58
openstackgerritMerged openstack/openstack-ansible-rsyslog_client stable/ocata: Zuul: Remove project name  https://review.openstack.org/54126020:59
*** takamatsu has quit IRC21:01
odyssey4meafk for a bit - dinner time!21:04
openstackgerritMohammed Naser proposed openstack/openstack-ansible-haproxy_server master: Remove hard-coded host group value  https://review.openstack.org/52987621:04
*** hamza21 has quit IRC21:06
*** santacloud has quit IRC21:13
foutatoroany suggestion ,21:15
openstackgerritMajor Hayden proposed openstack/openstack-ansible master: [WIP] Python 3 fix and flake8 cleanup  https://review.openstack.org/54144521:16
mhaydenfoutatoro: have you tried starting (or restarting) lvmetad?21:16
mhaydeni haven't seen that issue before21:16
foutatoromhayden: I still get this message "WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!"21:20
foutatoroeven after restarting the service lvm2-lvmetad21:20
*** guhcampos has joined #openstack-ansible21:21
mhaydenfoutatoro: what's in your /etc/lvm/lvm.conf ? is use_lvmetad set in there?21:27
foutatoromhayden: you can find it here http://paste.openstack.org/show/664026/21:29
mhaydenso you do have lvmetad disabled (see the use_lvmetad variable)21:30
mhaydenbut something is trying to run it21:30
mhaydenthe cinder role's template sets use_lvmetad to 021:31
mhaydenby default21:31
*** weezS has joined #openstack-ansible21:31
mhaydenperhaps something else on the system tried to start lvmetad?21:31
*** weezS has quit IRC21:32
mhaydenor you could turn use_lvmetad on (set it to 1), but i don't know what happens when you do that ;)21:32
*** threestrands has joined #openstack-ansible21:32
*** threestrands has quit IRC21:32
*** threestrands has joined #openstack-ansible21:32
*** jbadiapa has joined #openstack-ansible21:36
foutatoromhayden: If I set use_lvmetad to 1 I no longer get the warning when typing "lvs" command21:36
foutatorobut the "cinder-volumes" is not listed21:36
mhaydeni'm not sure if that's a good outcome, but if it works for you, that's good! :)21:36
foutatoroI don't think this as a good outcome because the LVM volume group "cinder-volumes" should be listed21:38
*** weezS has joined #openstack-ansible21:39
*** jbadiapa has quit IRC21:40
*** dave-mcc_ has quit IRC21:41
*** jafeha__ has joined #openstack-ansible21:42
*** jafeha has quit IRC21:44
*** Smeared_Beard has quit IRC21:52
*** eumel8 has quit IRC21:57
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests stable/ocata: Update role test log collection  https://review.openstack.org/54145722:07
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova stable/pike: tests: test-nova-upgrades.sh: Remove the exit trap  https://review.openstack.org/54146222:11
*** efaf has quit IRC22:11
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova stable/ocata: tests: test-nova-upgrades.sh: Remove the exit trap  https://review.openstack.org/54146322:11
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_cinder stable/ocata: tests: test-cinder-upgrades.sh: Remove the exit trap  https://review.openstack.org/54146522:12
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_swift stable/pike: tests: test-swift-upgrades.sh: Remove the exit trap  https://review.openstack.org/54146622:12
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_swift stable/ocata: tests: test-swift-upgrades.sh: Remove the exit trap  https://review.openstack.org/54146722:12
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone stable/pike: tests: test-keystone-upgrades.sh: Remove the exit trap  https://review.openstack.org/54146822:13
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone stable/ocata: tests: test-keystone-upgrades.sh: Remove the exit trap  https://review.openstack.org/54146922:13
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance stable/pike: tests: test-glance-upgrades.sh: Remove the exit trap  https://review.openstack.org/54147022:13
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance stable/ocata: tests: test-glance-upgrades.sh: Remove the exit trap  https://review.openstack.org/54147122:13
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/ocata: tests: test-neutron-upgrades.sh: Remove the exit trap  https://review.openstack.org/54147222:13
*** weezS has quit IRC22:14
*** openstackgerrit has quit IRC22:16
odyssey4memhayden are you wanting to pull this back into pike too? https://review.openstack.org/#/c/539688/22:19
mhaydenyeah, but it will require some tinkering :/22:19
-cloudnull- If you're doing a deployment with CentOS 7 on any of our releases you will likely need to set the repo URL path in the user variables file (http://paste.openstack.org/show/664071) until we can get the following patches merged and backported https://review.openstack.org/#/q/topic:bug/1747740+(status:open+OR+status:merged)22:20
odyssey4mewhoa, has logan given the ok to use his mirror?22:21
odyssey4mewe'll be driving a ton of traffic there22:21
odyssey4melogan- ^22:21
cloudnullthat's a good question.22:21
odyssey4mewhy not continue to make use of the mariadb mirrors, or perhaps the rackspace mirrors?22:21
mhaydeni'm up for any mirrors22:22
mhaydenhis were on the public mariadb site22:22
odyssey4memariadb should be better, as I think they're geolocated?22:22
mhaydenyum.mariadb.org comes out of OVH22:22
mhaydenone of two ovh dv's22:22
mhaydendc's22:22
odyssey4meoh22:22
mhaydendigitalocean has mirrors, too22:22
mhaydenbut we could use the rackspace ones22:23
odyssey4methey're obviously inviting it22:23
odyssey4mehttps://downloads.mariadb.org/mariadb/repositories/#mirror=evowise-ny&distro=CentOS&distro_release=centos7-amd64--centos7&version=10.122:26
odyssey4meit's probably more responsible of us to stick with the website recommendations, surely?22:27
*** chyka has joined #openstack-ansible22:35
*** tux_ has quit IRC22:37
*** tux_ has joined #openstack-ansible22:38
*** tux_ has quit IRC22:42
*** openstackgerrit has joined #openstack-ansible22:53
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Add nspawn container driver  https://review.openstack.org/47701722:53
*** pbandark has quit IRC22:54
*** dariko has quit IRC23:10
*** Trident has quit IRC23:18
*** tux_ has joined #openstack-ansible23:22
*** tux_ has quit IRC23:27
*** armaan has quit IRC23:27
*** acormier has quit IRC23:28
*** acormier has joined #openstack-ansible23:29
*** brad[] has quit IRC23:29
*** acormier has quit IRC23:30
*** acormier has joined #openstack-ansible23:30
*** kstev has quit IRC23:32
*** acormier has quit IRC23:35
*** guhcampos_ has joined #openstack-ansible23:40
*** rodolof has quit IRC23:53

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!