*** hwoarang has quit IRC | 02:21 | |
*** hwoarang has joined #openstack-ansible | 02:22 | |
*** hwoarang has quit IRC | 03:22 | |
openstackgerrit | lijunjie proposed openstack/openstack-ansible-os_keystone master: Fix the misspelling of "configuration" https://review.openstack.org/627442 | 03:22 |
---|---|---|
*** hwoarang has joined #openstack-ansible | 03:23 | |
*** vnogin has joined #openstack-ansible | 03:37 | |
*** vnogin has quit IRC | 03:41 | |
*** udesale has joined #openstack-ansible | 04:20 | |
*** shyamb has joined #openstack-ansible | 05:48 | |
*** hamzaachi has joined #openstack-ansible | 06:08 | |
*** hamzaachi has quit IRC | 06:20 | |
*** d3n14l has joined #openstack-ansible | 06:46 | |
d3n14l | @jamesdenton are you there for a question? | 06:46 |
d3n14l | We just updated keystone from queens to rocky - it was just keystone, but suddenly we lost all floating-ip assignments… | 06:48 |
*** d3n14l has quit IRC | 07:06 | |
*** d3n14l has joined #openstack-ansible | 07:12 | |
*** hwoarang has quit IRC | 07:33 | |
*** hwoarang has joined #openstack-ansible | 07:34 | |
*** d3n14l has quit IRC | 07:49 | |
*** shyamb has quit IRC | 08:01 | |
*** d3n14l has joined #openstack-ansible | 08:21 | |
d3n14l | @jamesdenton human error. never mind. | 08:22 |
*** d3n14l has left #openstack-ansible | 08:22 | |
*** gkadam has joined #openstack-ansible | 08:40 | |
*** thuydang has joined #openstack-ansible | 08:49 | |
*** rjgibson has quit IRC | 09:02 | |
*** rjgibson has joined #openstack-ansible | 09:02 | |
*** thuydang has quit IRC | 09:09 | |
*** shyamb has joined #openstack-ansible | 09:09 | |
*** rgogunskiy has joined #openstack-ansible | 09:27 | |
*** luksky has joined #openstack-ansible | 09:52 | |
*** fatdragon has joined #openstack-ansible | 10:01 | |
*** fatdragon has quit IRC | 10:11 | |
*** rgogunskiy has quit IRC | 10:18 | |
*** shyamb has quit IRC | 10:33 | |
*** ppetit has joined #openstack-ansible | 10:47 | |
*** fatdragon has joined #openstack-ansible | 10:54 | |
*** fatdragon has quit IRC | 11:00 | |
*** shyamb has joined #openstack-ansible | 11:05 | |
*** jonher has quit IRC | 11:22 | |
*** gkadam_ has joined #openstack-ansible | 11:42 | |
*** gkadam has quit IRC | 11:44 | |
*** gkadam_ has quit IRC | 11:48 | |
*** gkadam has joined #openstack-ansible | 11:59 | |
*** ppetit has quit IRC | 12:10 | |
*** ppetit has joined #openstack-ansible | 12:11 | |
*** ppetit has quit IRC | 12:11 | |
*** ppetit has joined #openstack-ansible | 12:12 | |
*** ppetit has quit IRC | 12:12 | |
*** ppetit has joined #openstack-ansible | 12:13 | |
*** ppetit has quit IRC | 12:13 | |
*** ppetit has joined #openstack-ansible | 12:13 | |
*** ppetit has quit IRC | 12:14 | |
*** ppetit has joined #openstack-ansible | 12:14 | |
*** ppetit has quit IRC | 12:14 | |
*** ppetit has joined #openstack-ansible | 12:15 | |
*** ppetit has quit IRC | 12:15 | |
*** ppetit has joined #openstack-ansible | 12:16 | |
*** ppetit has quit IRC | 12:16 | |
*** udesale has quit IRC | 12:23 | |
*** hamzaachi has joined #openstack-ansible | 12:38 | |
*** gkadam_ has joined #openstack-ansible | 12:43 | |
*** gkadam has quit IRC | 12:45 | |
*** shyamb has quit IRC | 12:52 | |
*** aedc has joined #openstack-ansible | 12:55 | |
*** vnogin has joined #openstack-ansible | 12:59 | |
*** deployer2 has joined #openstack-ansible | 13:04 | |
*** lbragstad has joined #openstack-ansible | 14:04 | |
*** vnogin has quit IRC | 14:13 | |
*** vnogin has joined #openstack-ansible | 14:20 | |
*** chandankumar is now known as chkumar|off | 14:20 | |
*** vnogin has quit IRC | 14:31 | |
*** tosky has joined #openstack-ansible | 14:35 | |
*** lbragstad has quit IRC | 14:57 | |
*** lbragstad has joined #openstack-ansible | 14:59 | |
*** fatdragon has joined #openstack-ansible | 15:12 | |
*** fatdragon has quit IRC | 15:17 | |
*** gkadam_ has quit IRC | 16:14 | |
*** macza has joined #openstack-ansible | 16:22 | |
*** fatdragon has joined #openstack-ansible | 16:31 | |
*** fatdragon has quit IRC | 16:42 | |
*** fatdragon has joined #openstack-ansible | 16:56 | |
*** jamesdenton has quit IRC | 17:30 | |
*** spatel has joined #openstack-ansible | 17:35 | |
*** spatel has quit IRC | 17:38 | |
*** tosky has quit IRC | 18:49 | |
*** l-j has joined #openstack-ansible | 19:02 | |
redkrieg | Hello, I'm having an issue installing swift. I had some issues with swift not being built on the repo server until I added my storage server to storage_hosts, now that that's settled, it's not able to copy the swift config, http://paste.openstack.org/show/738691/ | 19:28 |
redkrieg | there is no index attribute in /etc/ansible/roles/os_swift/tasks/swift_post_install.yml so I'm not sure where that error comes from | 19:29 |
noonedeadpunk | My guess would be, that it missing some info for creating your config, and the error occurs during junja processing | 19:37 |
noonedeadpunk | *jinja | 19:37 |
cloudnull | redkrieg did you run the repo-install playbook after you setup the service ? | 19:39 |
cloudnull | the 404 for the venv download is because the swift python components have not been buitl. | 19:39 |
cloudnull | **built | 19:40 |
redkrieg | yeah, turned out that was happening because I didn't have anything in storage_hosts | 19:40 |
redkrieg | I had renamed it to swift_hosts instead of adding a second group | 19:40 |
cloudnull | oh. that would do it too :) | 19:40 |
guilhermesp | hey cloudnull have you ever seen in centos deployments the /var/lock/neutron disappearing after a reboot in the infra/neutron-agents node? | 19:41 |
redkrieg | noonedeadpunk: funny thing, I thought something similar but I couldn't find anywhere that it used .index in that yml file | 19:41 |
cloudnull | guilhermesp nope, but then again i dont run centos :) | 19:41 |
noonedeadpunk | redkrieg: I think, it might be https://github.com/openstack/openstack-ansible-os_swift/blob/master/templates/swift.conf.j2#L12 | 19:42 |
guilhermesp | ah ok. I'm struggling to figure out the reason | 19:42 |
cloudnull | at home my cloud is made with suse 42 and ubuntu 18. | 19:42 |
redkrieg | guilhermesp: is /var/lock mounted as tmpfs for you? I know /run/lock is for me | 19:42 |
* cloudnull checking | 19:42 | |
noonedeadpunk | but might be somewhere else in swift.conf.j2, swift-dispersion.conf.j2 or swift-memcache.conf.j2 | 19:43 |
guilhermesp | let me check redkrieg | 19:43 |
redkrieg | thanks, that gives me a good place to start hunting | 19:43 |
*** sawblade6 has quit IRC | 19:43 | |
cloudnull | https://pasted.tech/pastes/bc92099eda8be513327d819ff6deed33cc4fb813 | 19:44 |
cloudnull | ^ its temfs for me too | 19:44 |
cloudnull | https://pasted.tech/pastes/381c4d84e79e7d2e9296deb2439e50c442975344 guilhermesp do you have this file ? | 19:45 |
cloudnull | # /etc/tmpfiles.d/openstack-neutron-linuxbridge-agent.conf | 19:45 |
guilhermesp | checking cloudnull | 19:45 |
guilhermesp | yes I have for most of all services running on neutron-agents, just missing the /var/lock/neutron | 19:46 |
guilhermesp | and I'm using ovs | 19:46 |
guilhermesp | this might be a bug for centos deployments. That's why I'm struggling to know the reason and submit a PR :) | 19:46 |
guilhermesp | and yes cloudnull I have this file for openvswitch | 19:48 |
guilhermesp | https://pasted.tech/pastes/612817db0f63ed4cc7ac923f663a65208323f96c | 19:48 |
cloudnull | so you should have something like openstack-neutron-ovs-agent.conf ? | 19:48 |
cloudnull | ok | 19:49 |
guilhermesp | when I run the playbook it created the folder but after a reboot: goooodbye | 19:49 |
guilhermesp | https://github.com/openstack/openstack-ansible-os_neutron/blob/ef07cd02c5f469f7e5899109b132a93069463100/tasks/neutron_pre_install.yml#L84 | 19:49 |
cloudnull | the playbook creates the files/folders and then drops the tmpfiles.d config which is supposed to ensure those temp files are recreated at boot | 19:50 |
cloudnull | maybe there's something else we need to for cent? | 19:51 |
guilhermesp | then theoretically I'd need to have a neutron.conf here https://pasted.tech/pastes/b530c62d87d9b9b1ab644b33eb3458a5bdf9d1a6 | 19:52 |
*** dave-mccowan has joined #openstack-ansible | 19:56 | |
*** dave-mccowan has quit IRC | 19:57 | |
cloudnull | almost all of those files should have the needed entries. | 19:58 |
cloudnull | can you check `systemctl status systemd-tmpfiles-setup.service` ? | 19:59 |
guilhermesp | a sec | 19:59 |
guilhermesp | https://pasted.tech/pastes/3103137a17e737c4cd77592c0cde8943f982399e.raw | 20:00 |
guilhermesp | all of the neutron service has the run and lock files in place as they are listed in /etc/tempfiles.d except neutron.conf, exactly what is missing in run and lock | 20:01 |
guilhermesp | creating these files in /etc/tempfiles.d is in the role side? | 20:01 |
cloudnull | those tmpfiles.d are created in the systemd service role. | 20:03 |
cloudnull | I think | 20:03 |
cloudnull | which is used as an "include_role" | 20:04 |
cloudnull | so are the missing lock directories in the contianer or on the network nodes? | 20:04 |
guilhermesp | you might be referring to this https://github.com/openstack/openstack-ansible-os_neutron/commit/34da3d0eaa5475c2b1876c208785a19ba6d27186 | 20:04 |
guilhermesp | only in the neutron-agent node on metal, as I'm using rocky | 20:05 |
cloudnull | yes that :_ | 20:05 |
cloudnull | :) | 20:05 |
cloudnull | so that config list looks correct then, the tempfiles.d conf files are all created based on the loaded agents. | 20:05 |
guilhermesp | just checked that in my compute nodes, the lock neutron dir doesn't disappear after boot. They only have these files in temp.d https://pasted.tech/pastes/0997d147193e9ceb2fe4144653d2cb9c832bb531 | 20:08 |
cloudnull | try running `/usr/bin/systemd-tmpfiles --create --remove --boot --exclude-prefix=/dev` | 20:09 |
cloudnull | does it produce an error? | 20:09 |
* guilhermesp checking | 20:09 | |
guilhermesp | hum no errors | 20:10 |
*** chkumar|off has quit IRC | 20:10 | |
cloudnull | if you delete the directory, /var/lock/neutron-openvswitch-agent and rerun that command does it get recreated? | 20:12 |
guilhermesp | let me try | 20:12 |
guilhermesp | yep it does | 20:13 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/ansible-role-systemd_networkd master: Move link options to a link file https://review.openstack.org/612489 | 20:13 |
cloudnull | so the config is working, which is good | 20:13 |
cloudnull | however now we need to figure out why its not reloading ... | 20:14 |
cloudnull | s/reloading/recreating on boot/ | 20:14 |
guilhermesp | and why is not creating /var/lock/neutron. which makes neutron-openvswitch complain in the logs | 20:14 |
guilhermesp | actually they're being recreated, but just /var/lock/neutron is missing. I'm not sure if a neutron temp file should exists but if so, should be placed when the role is executing | 20:19 |
cloudnull | which unit is complaining about that dir ? | 20:20 |
guilhermesp | neutron-openvswitch-agent. Let me grab part of the logs | 20:20 |
cloudnull | asking because I dont have that lock dir | 20:21 |
guilhermesp | https://pasted.tech/pastes/b9468e80e035eeadc2ebfb81435552fba5fccb14 | 20:21 |
cloudnull | butis is used ... | 20:22 |
openstackgerrit | Merged openstack/openstack-ansible-pip_install master: fix the url in doc https://review.openstack.org/627371 | 20:22 |
cloudnull | https://pasted.tech/pastes/0b817d7c5d76b5c51c6a68055b4449c11ac5a487 | 20:22 |
cloudnull | looks like that lock path is set in config | 20:22 |
cloudnull | so this is something we should have a tempfile config for | 20:22 |
cloudnull | or we need to move the lock dir | 20:22 |
guilhermesp | so I should have in my neutron.conf a line defining this lock path | 20:23 |
cloudnull | yes | 20:23 |
* guilhermesp checking again | 20:23 | |
openstackgerrit | Merged openstack/openstack-ansible-os_neutron master: fix url in doc https://review.openstack.org/627360 | 20:24 |
openstackgerrit | Merged openstack/openstack-ansible-specs master: 1. modify the http link to https link 2. fix 'a' to 'an' https://review.openstack.org/619833 | 20:24 |
guilhermesp | yep it is defined https://pasted.tech/pastes/156a80de0375853ed4750a145ef7905ec4c3922e | 20:24 |
cloudnull | yup same as me | 20:24 |
guilhermesp | under [oslo_concurrency] | 20:25 |
openstackgerrit | Merged openstack/openstack-ansible-lxc_container_create master: fix the spelling mistake world https://review.openstack.org/619836 | 20:25 |
cloudnull | I suspect the service is supposed to create it on start, if its missing. | 20:25 |
* cloudnull going to check another node | 20:25 | |
openstackgerrit | Merged openstack/openstack-ansible-os_designate master: modify the misspelling world https://review.openstack.org/619844 | 20:27 |
openstackgerrit | Merged openstack/openstack-ansible-os_searchlight master: fix url in doc https://review.openstack.org/627361 | 20:27 |
cloudnull | guilhermesp mind checking your os_neutron role | 20:27 |
cloudnull | what checkout are you on ? | 20:27 |
guilhermesp | one sec | 20:28 |
openstackgerrit | Merged openstack/openstack-ansible master: Imported Translations from Zanata https://review.openstack.org/627160 | 20:28 |
cloudnull | I see this in the config https://github.com/openstack/openstack-ansible-os_neutron/blob/stable/rocky/tasks/main.yml#L111 | 20:28 |
guilhermesp | https://pasted.tech/pastes/ee32a290bbe68567d3c66fa8590e393959a90558 and the tag for osa is 18.1.1 | 20:29 |
cloudnull | OK. | 20:29 |
cloudnull | I found the issue... https://github.com/openstack/ansible-role-systemd_service/blob/master/templates/systemd-tmpfiles.j2#L3-L5 | 20:29 |
guilhermesp | w00t | 20:30 |
guilhermesp | but this seems to be fine I think. The variable is defined in tasks/main.ym and then passed to the systemd_service role template | 20:35 |
*** hamzaachi has quit IRC | 20:43 | |
cloudnull | https://pasted.tech/pastes/cf46315c58aee564164c3fd059fca66d66edfd41.raw | 20:44 |
cloudnull | if you can test that diff it'd be appreciated. | 20:44 |
cloudnull | I have to run to make dinner | 20:44 |
cloudnull | back later | 20:44 |
guilhermesp | for sure | 20:44 |
guilhermesp | take your time and thanks cloudnull :) | 20:44 |
cloudnull | if it works feel free to PR it, I dont have my laptop here, so i dont have my keys for gerrit | 20:44 |
cloudnull | though I can make new ones if needed. | 20:44 |
guilhermesp | nice I'll do that | 20:45 |
*** l-j has quit IRC | 21:09 | |
*** l-j has joined #openstack-ansible | 21:09 | |
*** dave-mccowan has joined #openstack-ansible | 21:31 | |
*** sawblade6 has joined #openstack-ansible | 21:36 | |
*** sawblade6 has quit IRC | 21:38 | |
*** sawblade6 has joined #openstack-ansible | 21:38 | |
guilhermesp | cloudnull: it is creating the file https://pasted.tech/pastes/f1a78446f14f272970cc9a040dbe90a83b5beec0 but i think still missing the /var/run | 21:41 |
guilhermesp | because when I restarted the node, it is still not creating the lock folder. I did a test here adding the entry manually to the tmpfile.d to create the run folder. Let's see what happens on boot | 21:43 |
guilhermesp | yeah, after editing the file it is creating on boot https://pasted.tech/pastes/9e5ae285148fc8fcf65bba14c6277e1d63e5e84a | 21:50 |
guilhermesp | and neutron-openvswitch-agent logs no longer complains | 21:50 |
*** dave-mccowan has quit IRC | 22:09 | |
*** jamesdenton has joined #openstack-ansible | 23:03 | |
*** luksky has quit IRC | 23:21 | |
*** lbragstad has quit IRC | 23:27 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/ansible-role-systemd_networkd master: Move link options to a link file https://review.openstack.org/612489 | 23:30 |
*** thuydang has joined #openstack-ansible | 23:31 | |
*** thuydang has quit IRC | 23:33 | |
*** thuydang has joined #openstack-ansible | 23:33 | |
*** thuydang has quit IRC | 23:33 | |
*** thuydang has joined #openstack-ansible | 23:33 | |
*** thuydang has quit IRC | 23:34 | |
*** thuydang has joined #openstack-ansible | 23:34 | |
redkrieg | has anyone seen an issue where the ceph_client task can't complete "Gather variables for each operating system" with the message "No file was found when using with_first_found. Use the 'skip: true' option to allow this task to be skipped if no files are found" | 23:59 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/ansible-role-systemd_service master: Fix global lock path usage https://review.openstack.org/627577 | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!