Thursday, 2018-12-27

*** hwoarang has quit IRC02:21
*** hwoarang has joined #openstack-ansible02:22
*** hwoarang has quit IRC03:22
openstackgerritlijunjie proposed openstack/openstack-ansible-os_keystone master: Fix the misspelling of "configuration"  https://review.openstack.org/62744203:22
*** hwoarang has joined #openstack-ansible03:23
*** vnogin has joined #openstack-ansible03:37
*** vnogin has quit IRC03:41
*** udesale has joined #openstack-ansible04:20
*** shyamb has joined #openstack-ansible05:48
*** hamzaachi has joined #openstack-ansible06:08
*** hamzaachi has quit IRC06:20
*** d3n14l has joined #openstack-ansible06:46
d3n14l@jamesdenton are you there for a question?06:46
d3n14lWe just updated keystone from queens to rocky - it was just keystone, but suddenly we lost all  floating-ip assignments…06:48
*** d3n14l has quit IRC07:06
*** d3n14l has joined #openstack-ansible07:12
*** hwoarang has quit IRC07:33
*** hwoarang has joined #openstack-ansible07:34
*** d3n14l has quit IRC07:49
*** shyamb has quit IRC08:01
*** d3n14l has joined #openstack-ansible08:21
d3n14l@jamesdenton human error. never mind.08:22
*** d3n14l has left #openstack-ansible08:22
*** gkadam has joined #openstack-ansible08:40
*** thuydang has joined #openstack-ansible08:49
*** rjgibson has quit IRC09:02
*** rjgibson has joined #openstack-ansible09:02
*** thuydang has quit IRC09:09
*** shyamb has joined #openstack-ansible09:09
*** rgogunskiy has joined #openstack-ansible09:27
*** luksky has joined #openstack-ansible09:52
*** fatdragon has joined #openstack-ansible10:01
*** fatdragon has quit IRC10:11
*** rgogunskiy has quit IRC10:18
*** shyamb has quit IRC10:33
*** ppetit has joined #openstack-ansible10:47
*** fatdragon has joined #openstack-ansible10:54
*** fatdragon has quit IRC11:00
*** shyamb has joined #openstack-ansible11:05
*** jonher has quit IRC11:22
*** gkadam_ has joined #openstack-ansible11:42
*** gkadam has quit IRC11:44
*** gkadam_ has quit IRC11:48
*** gkadam has joined #openstack-ansible11:59
*** ppetit has quit IRC12:10
*** ppetit has joined #openstack-ansible12:11
*** ppetit has quit IRC12:11
*** ppetit has joined #openstack-ansible12:12
*** ppetit has quit IRC12:12
*** ppetit has joined #openstack-ansible12:13
*** ppetit has quit IRC12:13
*** ppetit has joined #openstack-ansible12:13
*** ppetit has quit IRC12:14
*** ppetit has joined #openstack-ansible12:14
*** ppetit has quit IRC12:14
*** ppetit has joined #openstack-ansible12:15
*** ppetit has quit IRC12:15
*** ppetit has joined #openstack-ansible12:16
*** ppetit has quit IRC12:16
*** udesale has quit IRC12:23
*** hamzaachi has joined #openstack-ansible12:38
*** gkadam_ has joined #openstack-ansible12:43
*** gkadam has quit IRC12:45
*** shyamb has quit IRC12:52
*** aedc has joined #openstack-ansible12:55
*** vnogin has joined #openstack-ansible12:59
*** deployer2 has joined #openstack-ansible13:04
*** lbragstad has joined #openstack-ansible14:04
*** vnogin has quit IRC14:13
*** vnogin has joined #openstack-ansible14:20
*** chandankumar is now known as chkumar|off14:20
*** vnogin has quit IRC14:31
*** tosky has joined #openstack-ansible14:35
*** lbragstad has quit IRC14:57
*** lbragstad has joined #openstack-ansible14:59
*** fatdragon has joined #openstack-ansible15:12
*** fatdragon has quit IRC15:17
*** gkadam_ has quit IRC16:14
*** macza has joined #openstack-ansible16:22
*** fatdragon has joined #openstack-ansible16:31
*** fatdragon has quit IRC16:42
*** fatdragon has joined #openstack-ansible16:56
*** jamesdenton has quit IRC17:30
*** spatel has joined #openstack-ansible17:35
*** spatel has quit IRC17:38
*** tosky has quit IRC18:49
*** l-j has joined #openstack-ansible19:02
redkriegHello, I'm having an issue installing swift.  I had some issues with swift not being built on the repo server until I added my storage server to storage_hosts, now that that's settled, it's not able to copy the swift config, http://paste.openstack.org/show/738691/19:28
redkriegthere is no index attribute in /etc/ansible/roles/os_swift/tasks/swift_post_install.yml so I'm not sure where that error comes from19:29
noonedeadpunkMy guess would be, that it missing some info for creating your config, and the error occurs during junja processing19:37
noonedeadpunk*jinja19:37
cloudnullredkrieg did you run the repo-install playbook after you setup the service ?19:39
cloudnullthe 404 for the venv download is because the swift python components have not been buitl.19:39
cloudnull**built19:40
redkriegyeah, turned out that was happening because I didn't have anything in storage_hosts19:40
redkriegI had renamed it to swift_hosts instead of adding a second group19:40
cloudnulloh. that would do it too :)19:40
guilhermesphey cloudnull have you ever seen in centos deployments the /var/lock/neutron disappearing after a reboot in the infra/neutron-agents node?19:41
redkriegnoonedeadpunk: funny thing, I thought something similar but I couldn't find anywhere that it used .index in that yml file19:41
cloudnullguilhermesp nope, but then again i dont run centos :)19:41
noonedeadpunkredkrieg: I think, it might be https://github.com/openstack/openstack-ansible-os_swift/blob/master/templates/swift.conf.j2#L1219:42
guilhermespah ok. I'm struggling to figure out the reason19:42
cloudnullat home my cloud is made with suse 42 and ubuntu 18.19:42
redkriegguilhermesp: is /var/lock mounted as tmpfs for you?  I know /run/lock is for me19:42
* cloudnull checking19:42
noonedeadpunkbut might be somewhere else in swift.conf.j2, swift-dispersion.conf.j2 or swift-memcache.conf.j219:43
guilhermesplet me check redkrieg19:43
redkriegthanks, that gives me a good place to start hunting19:43
*** sawblade6 has quit IRC19:43
cloudnullhttps://pasted.tech/pastes/bc92099eda8be513327d819ff6deed33cc4fb81319:44
cloudnull^ its temfs for me too19:44
cloudnullhttps://pasted.tech/pastes/381c4d84e79e7d2e9296deb2439e50c442975344 guilhermesp do you have this file ?19:45
cloudnull# /etc/tmpfiles.d/openstack-neutron-linuxbridge-agent.conf19:45
guilhermespchecking cloudnull19:45
guilhermespyes I have for most of all services running on neutron-agents, just missing the /var/lock/neutron19:46
guilhermespand I'm using ovs19:46
guilhermespthis might be a bug for centos deployments. That's why I'm struggling to know the reason and submit a PR :)19:46
guilhermespand yes cloudnull I have this file for openvswitch19:48
guilhermesphttps://pasted.tech/pastes/612817db0f63ed4cc7ac923f663a65208323f96c19:48
cloudnullso you should have something like openstack-neutron-ovs-agent.conf ?19:48
cloudnullok19:49
guilhermespwhen I run the playbook it created the folder but after a reboot: goooodbye19:49
guilhermesphttps://github.com/openstack/openstack-ansible-os_neutron/blob/ef07cd02c5f469f7e5899109b132a93069463100/tasks/neutron_pre_install.yml#L8419:49
cloudnullthe playbook creates the files/folders and then drops the tmpfiles.d config which is supposed to ensure those temp files are recreated at boot19:50
cloudnullmaybe there's something else we need to for cent?19:51
guilhermespthen theoretically I'd need to have a neutron.conf here https://pasted.tech/pastes/b530c62d87d9b9b1ab644b33eb3458a5bdf9d1a619:52
*** dave-mccowan has joined #openstack-ansible19:56
*** dave-mccowan has quit IRC19:57
cloudnullalmost all of those files should have the needed entries.19:58
cloudnullcan you check `systemctl status systemd-tmpfiles-setup.service` ?19:59
guilhermespa sec19:59
guilhermesphttps://pasted.tech/pastes/3103137a17e737c4cd77592c0cde8943f982399e.raw20:00
guilhermespall of the neutron service has the run and lock files in place as they are listed in /etc/tempfiles.d except neutron.conf, exactly what is missing in run and lock20:01
guilhermespcreating these files in /etc/tempfiles.d is in the role side?20:01
cloudnullthose tmpfiles.d are created in the systemd service role.20:03
cloudnullI think20:03
cloudnullwhich is used as an "include_role"20:04
cloudnullso are the missing lock directories in the contianer or on the network nodes?20:04
guilhermespyou might be referring to this https://github.com/openstack/openstack-ansible-os_neutron/commit/34da3d0eaa5475c2b1876c208785a19ba6d2718620:04
guilhermesponly in the neutron-agent node on metal, as I'm using rocky20:05
cloudnullyes that :_20:05
cloudnull:)20:05
cloudnullso that config list looks correct then, the tempfiles.d conf files are all created based on the loaded agents.20:05
guilhermespjust checked that in my compute nodes, the lock neutron dir doesn't disappear after boot. They only have these files in temp.d https://pasted.tech/pastes/0997d147193e9ceb2fe4144653d2cb9c832bb53120:08
cloudnulltry running `/usr/bin/systemd-tmpfiles --create --remove --boot --exclude-prefix=/dev`20:09
cloudnulldoes it produce an error?20:09
* guilhermesp checking20:09
guilhermesphum no errors20:10
*** chkumar|off has quit IRC20:10
cloudnullif you delete the directory, /var/lock/neutron-openvswitch-agent and rerun that command does it get recreated?20:12
guilhermesplet me try20:12
guilhermespyep it does20:13
openstackgerritKevin Carter (cloudnull) proposed openstack/ansible-role-systemd_networkd master: Move link options to a link file  https://review.openstack.org/61248920:13
cloudnullso the config is working, which is good20:13
cloudnullhowever now we need to figure out why its not reloading ...20:14
cloudnulls/reloading/recreating on boot/20:14
guilhermespand why is not creating /var/lock/neutron. which makes neutron-openvswitch complain in the logs20:14
guilhermespactually they're being recreated, but just /var/lock/neutron is missing. I'm not sure if a neutron temp file should exists but if so, should be placed when the role is executing20:19
cloudnullwhich unit is complaining about that dir ?20:20
guilhermespneutron-openvswitch-agent. Let me grab part of the logs20:20
cloudnullasking because I dont have that lock dir20:21
guilhermesphttps://pasted.tech/pastes/b9468e80e035eeadc2ebfb81435552fba5fccb1420:21
cloudnullbutis is used ...20:22
openstackgerritMerged openstack/openstack-ansible-pip_install master: fix the url in doc  https://review.openstack.org/62737120:22
cloudnullhttps://pasted.tech/pastes/0b817d7c5d76b5c51c6a68055b4449c11ac5a48720:22
cloudnulllooks like that lock path is set in config20:22
cloudnullso this is something we should have a tempfile config for20:22
cloudnullor we need to move the lock dir20:22
guilhermespso I should have in my neutron.conf a line defining this lock path20:23
cloudnullyes20:23
* guilhermesp checking again20:23
openstackgerritMerged openstack/openstack-ansible-os_neutron master: fix url in doc  https://review.openstack.org/62736020:24
openstackgerritMerged openstack/openstack-ansible-specs master: 1. modify the http link to https link 2. fix 'a' to 'an'  https://review.openstack.org/61983320:24
guilhermespyep it is defined https://pasted.tech/pastes/156a80de0375853ed4750a145ef7905ec4c3922e20:24
cloudnullyup same as me20:24
guilhermespunder [oslo_concurrency]20:25
openstackgerritMerged openstack/openstack-ansible-lxc_container_create master: fix the spelling mistake world  https://review.openstack.org/61983620:25
cloudnullI suspect the service is supposed to create it on start, if its missing.20:25
* cloudnull going to check another node 20:25
openstackgerritMerged openstack/openstack-ansible-os_designate master: modify the misspelling world  https://review.openstack.org/61984420:27
openstackgerritMerged openstack/openstack-ansible-os_searchlight master: fix url in doc  https://review.openstack.org/62736120:27
cloudnullguilhermesp mind checking your os_neutron role20:27
cloudnullwhat checkout are you on ?20:27
guilhermespone sec20:28
openstackgerritMerged openstack/openstack-ansible master: Imported Translations from Zanata  https://review.openstack.org/62716020:28
cloudnullI see this in the config https://github.com/openstack/openstack-ansible-os_neutron/blob/stable/rocky/tasks/main.yml#L11120:28
guilhermesphttps://pasted.tech/pastes/ee32a290bbe68567d3c66fa8590e393959a90558 and the tag for osa is 18.1.120:29
cloudnullOK.20:29
cloudnullI found the issue... https://github.com/openstack/ansible-role-systemd_service/blob/master/templates/systemd-tmpfiles.j2#L3-L520:29
guilhermespw00t20:30
guilhermespbut this seems to be fine I think. The variable is defined in tasks/main.ym and then passed to the systemd_service role template20:35
*** hamzaachi has quit IRC20:43
cloudnullhttps://pasted.tech/pastes/cf46315c58aee564164c3fd059fca66d66edfd41.raw20:44
cloudnullif you can test that diff it'd be appreciated.20:44
cloudnullI have to run to make dinner20:44
cloudnullback later20:44
guilhermespfor sure20:44
guilhermesptake your time and thanks cloudnull :)20:44
cloudnullif it works feel free to PR it, I dont have my laptop here, so i dont have my keys for gerrit20:44
cloudnullthough I can make new ones if needed.20:44
guilhermespnice I'll do that20:45
*** l-j has quit IRC21:09
*** l-j has joined #openstack-ansible21:09
*** dave-mccowan has joined #openstack-ansible21:31
*** sawblade6 has joined #openstack-ansible21:36
*** sawblade6 has quit IRC21:38
*** sawblade6 has joined #openstack-ansible21:38
guilhermespcloudnull: it is creating the file https://pasted.tech/pastes/f1a78446f14f272970cc9a040dbe90a83b5beec0 but i think still missing the /var/run21:41
guilhermespbecause when I restarted the node, it is still not creating the lock folder. I did a test here adding the entry manually to the tmpfile.d to create the run folder. Let's see what happens on boot21:43
guilhermespyeah, after editing the file it is creating on boot https://pasted.tech/pastes/9e5ae285148fc8fcf65bba14c6277e1d63e5e84a21:50
guilhermespand neutron-openvswitch-agent logs no longer complains21:50
*** dave-mccowan has quit IRC22:09
*** jamesdenton has joined #openstack-ansible23:03
*** luksky has quit IRC23:21
*** lbragstad has quit IRC23:27
openstackgerritKevin Carter (cloudnull) proposed openstack/ansible-role-systemd_networkd master: Move link options to a link file  https://review.openstack.org/61248923:30
*** thuydang has joined #openstack-ansible23:31
*** thuydang has quit IRC23:33
*** thuydang has joined #openstack-ansible23:33
*** thuydang has quit IRC23:33
*** thuydang has joined #openstack-ansible23:33
*** thuydang has quit IRC23:34
*** thuydang has joined #openstack-ansible23:34
redkrieghas anyone seen an issue where the ceph_client task can't complete "Gather variables for each operating system" with the message "No file was found when using with_first_found. Use the 'skip: true' option to allow this task to be skipped if no files are found"23:59
openstackgerritKevin Carter (cloudnull) proposed openstack/ansible-role-systemd_service master: Fix global lock path usage  https://review.openstack.org/62757723:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!