| *** tosky has quit IRC | 00:01 | |
| *** macza_ has quit IRC | 00:07 | |
| *** macza has joined #openstack-ansible | 00:07 | |
| *** spsurya has quit IRC | 00:26 | |
| *** bgmccollum has quit IRC | 00:29 | |
| *** ztr has quit IRC | 00:39 | |
| *** DanyC has quit IRC | 00:43 | |
| *** TxGirlGeek has joined #openstack-ansible | 00:47 | |
| *** macza has quit IRC | 00:51 | |
| *** TxGirlGeek has quit IRC | 01:03 | |
| *** nurdie has joined #openstack-ansible | 01:15 | |
| *** nurdie has quit IRC | 01:19 | |
| broken_one | jrosser mnaser jenglisch https://review.openstack.org/#/c/630374/ -- works on our end | 01:35 |
|---|---|---|
| broken_one | found some new issues. /var/lock/neutron and /var/lock/nova are not being recreated when a system is rebooted ... this is on CentOS 7 | 01:36 |
| *** hwoarang has quit IRC | 02:33 | |
| *** hwoarang has joined #openstack-ansible | 02:34 | |
| *** partlycloudy has quit IRC | 02:54 | |
| jamesdenton | evenin' folks | 03:07 |
| *** hwoarang has quit IRC | 03:15 | |
| *** hwoarang has joined #openstack-ansible | 03:16 | |
| *** hwoarang has quit IRC | 03:34 | |
| *** hwoarang has joined #openstack-ansible | 03:35 | |
| *** udesale has joined #openstack-ansible | 04:06 | |
| cloudnull | o/ all | 04:13 |
| openstackgerrit | James Denton proposed openstack/openstack-ansible-os_neutron master: [WIP] Deploy Vector Packet Processing (VPP) Platform for Neutron https://review.openstack.org/631644 | 04:17 |
| jamesdenton | hello hello | 04:17 |
| chandankumar | cloudnull: \o/ | 04:20 |
| cloudnull | hows it on this fine evening | 04:21 |
| chandankumar | cloudnull: http://paste.openstack.org/show/743143/ | 04:21 |
| chandankumar | cloudnull: i cloned os_tempest and runned ./run_tests.sh functional and hitting this error to reproduce one of the gate failure | 04:21 |
| chandankumar | on centos 7 | 04:21 |
| jamesdenton | it is what it is. spent too much time troubleshooting what ended up being a permissions issue. | 04:21 |
| chandankumar | cloudnull: I assume something wrong is happening here http://git.openstack.org/cgit/openstack/openstack-ansible-tests/tree/test-prepare-host.yml#n221 | 04:22 |
| cloudnull | jamesdenton i know your pain :) | 04:22 |
| cloudnull | chandankumar maybe we need to add another fact gather? | 04:24 |
| cloudnull | or gather all facts instead of a subset ? | 04:25 |
| cloudnull | http://git.openstack.org/cgit/openstack/openstack-ansible-tests/tree/test-prepare-host.yml#n202 | 04:25 |
| chandankumar | cloudnull: checking | 04:27 |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-tests master: Gather all facts while preparing hosts https://review.openstack.org/632609 | 04:31 |
| chandankumar | cloudnull: ^^ you mean this? | 04:31 |
| chandankumar | cloudnull: setting all still gives the same | 04:39 |
| chandankumar | problem | 04:39 |
| chandankumar | oh I made a mistake | 04:41 |
| *** shyamb has joined #openstack-ansible | 05:00 | |
| *** shyamb has quit IRC | 05:09 | |
| cloudnull | chandankumar did you get it going? | 05:10 |
| chandankumar | cloudnull: nope | 05:10 |
| chandankumar | cloudnull: on doing setup: {} | 05:11 |
| chandankumar | it is not working | 05:11 |
| *** nurdie has joined #openstack-ansible | 05:12 | |
| cloudnull | can you paste the generated facts? | 05:12 |
| cloudnull | maybe the interface is not up? | 05:12 |
| *** shyamb has joined #openstack-ansible | 05:19 | |
| *** dave-mccowan has quit IRC | 05:22 | |
| chandankumar | cloudnull: http://paste.openstack.org/show/743146/ a big paste | 05:25 |
| chandankumar | cloudnull: or we get something specific? | 05:26 |
| cloudnull | chandankumar interesting, there are no bridge devices ? | 05:27 |
| cloudnull | no ansible_br_XXX | 05:27 |
| chandankumar | cloudnull: yes no any devices | 05:28 |
| * cloudnull looking around | 05:30 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Update conditionals and namespaced options https://review.openstack.org/632613 | 05:30 |
| chandankumar | cloudnull: is there any bridge related config issue? | 05:31 |
| cloudnull | its like the bridges havent been created. | 05:32 |
| *** udesale has quit IRC | 05:32 | |
| cloudnull | based on those facts | 05:32 |
| cloudnull | do you have the log run output? | 05:32 |
| cloudnull | did the previous tasks succeed? | 05:32 |
| chandankumar | cloudnull: yes | 05:33 |
| chandankumar | i am pasting the playbook run log | 05:35 |
| *** udesale has joined #openstack-ansible | 05:36 | |
| chandankumar | cloudnull: http://paste.openstack.org/show/743147/ | 05:36 |
| cloudnull | and this is on centos? | 05:37 |
| chandankumar | cloudnull: yes it is on centos CentOS Linux release 7.6.1810 (Core) | 05:38 |
| chandankumar | I am running it in a openstack vm on rdo cloud | 05:39 |
| chandankumar | cloudnull: did I switch to normal vm? | 05:39 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Update conditionals and namespaced options https://review.openstack.org/632613 | 05:40 |
| cjloader | cloudnull: need any reviews? | 05:43 |
| cloudnull | chandankumar that should work just fine. | 05:44 |
| cloudnull | im not sure whats going on there. | 05:44 |
| cloudnull | however i can spin a test vm myself and hack on a bin | 05:44 |
| cloudnull | **bit | 05:44 |
| chandankumar | cloudnull: thanks! | 05:45 |
| cloudnull | seems the networks are not being created or started. | 05:45 |
| cloudnull | are you just running the os_tempest role tests from master? | 05:45 |
| chandankumar | cloudnull: yes | 05:45 |
| cloudnull | or a specific review? | 05:45 |
| chandankumar | git clone <os_tempest>; cd <os_tempest> and ./run_test.sh functional | 05:45 |
| cloudnull | ok | 05:45 |
| chandankumar | or I am doing something wrong here? | 05:45 |
| * cloudnull running it now on my home cloud. | 05:46 | |
| cloudnull | I dont think so | 05:46 |
| cloudnull | that's how i would run a test job | 05:46 |
| cloudnull | for a given role | 05:46 |
| chandankumar | ok | 05:46 |
| cloudnull | cjloader nothing i specifically need however reviews across master would be appreciated . | 05:47 |
| cjloader | cloudnull: I may seem non relevant but what exactly is 'kolide' | 05:47 |
| cjloader | excuse my ignorance | 05:47 |
| cjloader | I see youre adding 'kolide' to variables | 05:48 |
| cloudnull | kolide is a UI for osquery | 05:50 |
| cjloader | ah okay that makes ALOT of sense now | 05:50 |
| cjloader | cloudnull: I thought '--isolated' was frowned upon | 05:54 |
| cjloader | why exactly is openstacksdk being isolatedly installed | 05:56 |
| cjloader | could you not symlink it? | 05:56 |
| cjloader | and aviod isolated | 05:57 |
| cjloader | avoid* | 05:57 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Update conditionals and namespaced options https://review.openstack.org/632613 | 05:58 |
| cloudnull | openstacksdk is needed for the ansible modules to work in the skydive role, when deploying against a newton environment we dont have version 12.5 or greater in the repo server. | 05:59 |
| cloudnull | to ensure it works regardless, its using isolated. | 06:00 |
| cjloader | makes sense | 06:00 |
| cjloader | I'm just trying to learn from the best :) | 06:00 |
| *** nurdie has quit IRC | 06:05 | |
| *** nurdie has joined #openstack-ansible | 06:05 | |
| cloudnull | chandankumar I have that test node going. | 06:07 |
| cloudnull | im going to bed but i will check in on it in the morning | 06:07 |
| cloudnull | good night all | 06:07 |
| chandankumar | cloudnull: see ya :-) | 06:07 |
| *** spsurya has joined #openstack-ansible | 06:08 | |
| cjloader | i'm going to bed as well | 06:09 |
| cjloader | (same time zone as cloudnull) | 06:09 |
| *** hwoarang has quit IRC | 06:09 | |
| *** nurdie has quit IRC | 06:09 | |
| cjloader | night all, feel free to add me as a reviewer to items | 06:10 |
| *** hwoarang has joined #openstack-ansible | 06:15 | |
| *** shyamb has quit IRC | 06:19 | |
| *** udesale has quit IRC | 06:28 | |
| *** udesale has joined #openstack-ansible | 06:29 | |
| *** udesale has quit IRC | 06:30 | |
| *** udesale has joined #openstack-ansible | 06:31 | |
| *** udesale has quit IRC | 06:33 | |
| *** shyamb has joined #openstack-ansible | 06:50 | |
| *** DanyC has joined #openstack-ansible | 07:28 | |
| *** rgogunskiy has joined #openstack-ansible | 07:28 | |
| *** DanyC has quit IRC | 07:29 | |
| *** DanyC has joined #openstack-ansible | 07:29 | |
| *** udesale has joined #openstack-ansible | 07:30 | |
| *** hwoarang has quit IRC | 07:39 | |
| *** hwoarang has joined #openstack-ansible | 07:39 | |
| *** DanyC has quit IRC | 07:44 | |
| *** kopecmartin|off is now known as kopecmartin | 07:47 | |
| *** ostackz has left #openstack-ansible | 07:50 | |
| *** shyamb has quit IRC | 07:53 | |
| *** gkadam has joined #openstack-ansible | 08:22 | |
| openstackgerrit | lijunjie proposed openstack/openstack-ansible-ops master: Fix the misspelling of "container" https://review.openstack.org/632642 | 08:27 |
| openstackgerrit | lijunjie proposed openstack/openstack-ansible-ops master: Fix the misspelling of "container" https://review.openstack.org/632643 | 08:27 |
| chandankumar | odyssey4me: hello | 08:28 |
| *** shardy has joined #openstack-ansible | 08:28 | |
| openstackgerrit | lijunjie proposed openstack/openstack-ansible-nspawn_container_create master: Fix the misspelling of "container" https://review.openstack.org/632644 | 08:29 |
| chandankumar | odyssey4me: http://paste.openstack.org/show/743153/ How I make sure here that requests is always installed there | 08:29 |
| chandankumar | ? | 08:29 |
| *** markvoelker has joined #openstack-ansible | 08:47 | |
| *** tosky has joined #openstack-ansible | 08:50 | |
| *** markvoelker has quit IRC | 08:53 | |
| *** shyamb has joined #openstack-ansible | 09:03 | |
| *** rgogunskiy_ has joined #openstack-ansible | 09:15 | |
| *** rgogunskiy has quit IRC | 09:17 | |
| *** rgogunksiy__ has joined #openstack-ansible | 09:17 | |
| *** priteau has joined #openstack-ansible | 09:17 | |
| *** rgogunskiy_ has quit IRC | 09:20 | |
| *** DanyC has joined #openstack-ansible | 09:23 | |
| *** shyamb has quit IRC | 09:36 | |
| *** shyamb has joined #openstack-ansible | 09:37 | |
| *** asettle has joined #openstack-ansible | 09:49 | |
| *** markvoelker has joined #openstack-ansible | 09:49 | |
| odyssey4me | jenglisch_ the environment nurdie is working in is pike, when the neutron agents were still in a container by default | 09:58 |
| odyssey4me | jamesdenton jrosser yes, playbooks/defaults/repo_packages/*.yml is what's used for the git checkouts, and they will use the SHA, not the tracking branch - thr tracking branch is used by the release tooling | 10:00 |
| jrosser | odyssey4me: yes i think i got confused between ansible-role-requirements pulling master roles on master branch vs. repo_packages/* always using sha regardless | 10:02 |
| odyssey4me | chandankumar hmm, that's odd - why does the creation of the virtualenv suddenly require requests? | 10:03 |
| chandankumar | odyssey4me: no idea | 10:05 |
| chandankumar | odyssey4me: I am seeing weired issues | 10:05 |
| chandankumar | odyssey4me: right now this http://paste.openstack.org/show/743159/ | 10:06 |
| chandankumar | there is some problem with base repo i think | 10:06 |
| odyssey4me | chandankumar the yum repo, you mean? | 10:11 |
| chandankumar | odyssey4me: yes | 10:12 |
| chandankumar | odyssey4me: on running ./run_test.sh where the role got cloned? | 10:13 |
| odyssey4me | chandankumar I don't understand. What's the question? | 10:14 |
| chandankumar | odyssey4me: on running ./run_tests.sh functional, it clones openstack-ansible-test and and required ansible roles for that os_tempest, my questions is where the addtional roles are getting cloned? | 10:15 |
| odyssey4me | where, as in what code does it - or where as-in what is the directory they're cloned into? | 10:16 |
| *** shyamb has quit IRC | 10:16 | |
| *** AndreasF has joined #openstack-ansible | 10:16 | |
| chandankumar | odyssey4me: what is the directory they are cloned into | 10:16 |
| odyssey4me | chandankumar roles tests put everything into ~/.ansible | 10:17 |
| chandankumar | got it | 10:17 |
| jrosser | odyssey4me: just looking at the upgrade patch, is the comment in here resolved? https://review.openstack.org/#/c/624773/1/scripts/run-upgrade.sh | 10:17 |
| *** AndreasF has quit IRC | 10:18 | |
| *** AndreasF has joined #openstack-ansible | 10:19 | |
| *** shyamb has joined #openstack-ansible | 10:19 | |
| odyssey4me | jrosser as resolved as it is in the current implementation - in the current implementation we pass 'lxc_container_allow_restarts=false', and we still do in the new one | 10:19 |
| odyssey4me | I'm still not happy with that, but don't have the time to develop something better just yet - so I left it as-is | 10:20 |
| jrosser | the comment implies that they are currently all restarted together? or do i misunderstand that | 10:20 |
| odyssey4me | the only thing I changed in the new implementation was to use setup-hosts instead of lxc-containers-create... setup-hosts covers more and will work for nspawn and lxc | 10:20 |
| odyssey4me | jrosser yes, they are all restarted together - except that we pass the var that tells it not to restart them at all | 10:21 |
| odyssey4me | if we didn't pass 'lxc_container_allow_restarts=false' then all containers would reboot at the same time | 10:21 |
| jrosser | where is that done? | 10:22 |
| odyssey4me | oh sorry, I see that even in the current implementation, we run setup-hosts without that flag for all hosts except rabbit and galera | 10:22 |
| *** markvoelker has quit IRC | 10:22 | |
| odyssey4me | https://review.openstack.org/#/c/624773/7/scripts/run-upgrade.sh@172 | 10:22 |
| odyssey4me | I really don't like that - but thankfully the container config doesn't change much, so we don't actually have the restarts happen, usually | 10:23 |
| odyssey4me | I think queens->rocky would. | 10:23 |
| odyssey4me | (because of the lxc2->lxc3 changes) | 10:23 |
| odyssey4me | I'd like to work something out that can implement serialised restarts. | 10:24 |
| odyssey4me | We'd hopefully do all our configs in a fan-out method, then do serialised restarts at the end. | 10:24 |
| jrosser | should we add that flag to the non rabbit/galera setup-hosts as well? | 10:25 |
| odyssey4me | well, no - because as you may notice, the rabbitmq containers never get restarted | 10:27 |
| odyssey4me | and that would then happen to all other containers | 10:27 |
| odyssey4me | ideally I'd like to see a fix go in to sort all that out | 10:27 |
| odyssey4me | but for this patch, I wanted to keep like functionality - just cut out the tech debt | 10:27 |
| jrosser | ok cool, i only have one nit in the documentation but apart from that it looks fine | 10:28 |
| *** czunker has joined #openstack-ansible | 10:31 | |
| *** shyamb has quit IRC | 10:32 | |
| *** hwoarang has quit IRC | 10:36 | |
| *** hwoarang has joined #openstack-ansible | 10:36 | |
| *** pcaruana has joined #openstack-ansible | 10:37 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Clean-up and simplify the major upgrade https://review.openstack.org/624773 | 10:45 |
| odyssey4me | jrosser I hope that's better | 10:45 |
| odyssey4me | it's a bit of a lame section, but I also don't have the time to determine whether being in a different directory also works | 10:45 |
| *** udesale has quit IRC | 10:57 | |
| *** kaiokmo has quit IRC | 11:08 | |
| *** shyamb has joined #openstack-ansible | 11:10 | |
| *** markvoelker has joined #openstack-ansible | 11:20 | |
| *** aedc has quit IRC | 11:20 | |
| chandankumar | odyssey4me: I tried on a fresh vm, deployment in progress | 11:33 |
| chandankumar | odyssey4me: openstack_hosts : Add requirement packages (repositories gpg keys packages, toolkits... task only fail if we re run the run_tests.sh functional | 11:33 |
| chandankumar | is there a way to skip it? | 11:33 |
| odyssey4me | chandankumar no, every task that runs is required - if it's failing, the reason for failing must be identified and resolved | 11:34 |
| *** markvoelker has quit IRC | 11:52 | |
| *** ansmith has joined #openstack-ansible | 11:55 | |
| *** sum12 has quit IRC | 11:59 | |
| jamesdenton | thanks for the clarification, odyssey4me | 12:00 |
| *** nurdie has joined #openstack-ansible | 12:24 | |
| *** sep has quit IRC | 12:32 | |
| *** sep has joined #openstack-ansible | 12:33 | |
| *** shyam89 has joined #openstack-ansible | 12:41 | |
| *** shyamb has quit IRC | 12:45 | |
| *** markvoelker has joined #openstack-ansible | 12:49 | |
| *** priteau has quit IRC | 12:55 | |
| *** aedc has joined #openstack-ansible | 12:56 | |
| *** shyamb has joined #openstack-ansible | 13:00 | |
| *** shyam89 has quit IRC | 13:02 | |
| *** kaiokmo has joined #openstack-ansible | 13:08 | |
| *** shyamb has quit IRC | 13:20 | |
| *** markvoelker has quit IRC | 13:22 | |
| *** markvoelker has joined #openstack-ansible | 13:23 | |
| *** nurdie has quit IRC | 13:29 | |
| *** markvoelker has quit IRC | 13:30 | |
| *** nurdie has joined #openstack-ansible | 13:30 | |
| chandankumar | cloudnull: regarding ansible-br-mgmt issue, when I updated the vm , it vanishes | 13:31 |
| chandankumar | odyssey4me: one stupid question, while running ./run-tests.sh functional, it failed at particular step, is it possible to re-run the stuff from there | 13:32 |
| chandankumar | odyssey4me: If i run run-tests.sh multiple times it is creating multiple network interfaces | 13:33 |
| odyssey4me | chandankumar cloudnull I have recently also had trouble with ansible facts not including the networking info unless all facts are gathered | 13:33 |
| odyssey4me | I don't know what's changed, but it's not nice. | 13:33 |
| *** nurdie has quit IRC | 13:34 | |
| odyssey4me | chandankumar unfortunately not - it's a horrible test implementation which is very monolithic... I tend to hack at parts of the system to skip them when working with it | 13:34 |
| odyssey4me | we're working on switching it to a better method, but it takes time | 13:34 |
| chandankumar | odyssey4me: in a fresh vm, currently I am facing the no module name requests issue | 13:35 |
| odyssey4me | chandankumar which role is that, I can fire up a vagrant vm to test the same | 13:36 |
| chandankumar | odyssey4me: os_neutron | 13:36 |
| chandankumar | odyssey4me: yesterday it was on os_nova | 13:36 |
| *** dave-mccowan has joined #openstack-ansible | 13:43 | |
| *** strattao has joined #openstack-ansible | 13:47 | |
| *** nurdie has joined #openstack-ansible | 13:49 | |
| *** nurdie has quit IRC | 13:55 | |
| AndreasF | Is it possible to install mistral using openstack-ansible? Background: I installed tacker using openstack-ansible - but tacker needs IMHO mistral installed in the VIM (here OpenStack). | 13:56 |
| odyssey4me | AndreasF to my knowledge, no-one has prepared and contributed a role for that yet | 13:57 |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_tempest master: Added dependencies of os_tempest role https://review.openstack.org/632726 | 13:59 |
| odyssey4me | chandankumar congrats on https://review.openstack.org/628415 :) | 14:04 |
| broken_one | o/ | 14:04 |
| odyssey4me | cloudnull when you're in, there was a small change to https://review.openstack.org/624773 - if you could re-review that'd be grand | 14:05 |
| chandankumar | odyssey4me: thanks, thanks for you, cloudnull evrardjp jrosser mnaser it all happened because of you guys :-) | 14:06 |
| chandankumar | odyssey4me: but we still have blocker on os_tempest till we fix our gate | 14:06 |
| odyssey4me | chandankumar yep, now that virtualbox/vagrant have updated - kicking that off now | 14:09 |
| *** digidiensten has joined #openstack-ansible | 14:21 | |
| odyssey4me | chandankumar using vagrant with the os_neutron role seems to be working for me - it just passed the task you're failing on | 14:22 |
| chandankumar | odyssey4me: so may be my environment hiccups then | 14:22 |
| odyssey4me | chandankumar I did: vagrant up centos7 --no-provision | 14:22 |
| chandankumar | odyssey4me: I am trying it all on a openstack vm with 8gb and 16 vcpus | 14:23 |
| chandankumar | on centos | 14:23 |
| odyssey4me | chandankumar then did 'vagrant ssh centos7' to get in to the vm, 'sudo -i' to get root, then 'cd /vagrant; ./run_tests.sh functional' | 14:23 |
| chandankumar | ok let me go with vagrant then | 14:23 |
| odyssey4me | I'm using my lowly macbook. :p | 14:24 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: [TEST] Remove lock on repo for source installs https://review.openstack.org/632526 | 14:33 |
| cloudnull | mornings | 14:34 |
| cloudnull | anyone want to give https://review.openstack.org/#/c/632505/ a nudge? | 14:34 |
| *** sum12 has joined #openstack-ansible | 14:38 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Update conditionals and namespaced options https://review.openstack.org/632613 | 14:40 |
| digidiensten | I try to deploy openstack rock via openstack-ansible, and I'm following https://docs.openstack.org/project-deploy-guide/openstack-ansible/rocky/run-playbooks.html but when I run openstack-ansible setup-infrastructure.yml I get the error: https://gist.github.com/mpiscaer/0ccc586e94ffd5e9fb552750967725c7 | 14:41 |
| *** digidiensten is now known as masterpe | 14:41 | |
| masterpe | This is a error with ceph, but what do I wrong? | 14:42 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Update conditionals and namespaced options https://review.openstack.org/632613 | 14:44 |
| masterpe | In the user_variables_ceph_cinder.yml I had the set variable "ceph_release_num: 13". | 14:58 |
| masterpe | in https://github.com/ceph/ceph-ansible/blob/master/group_vars/all.yml.sample I saw: | 14:59 |
| masterpe | ceph_release_num: | 14:59 |
| masterpe | mimic: 13 | 14:59 |
| masterpe | Is that beter? | 14:59 |
| *** rgogunksiy__ has quit IRC | 15:00 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Update conditionals and namespaced options https://review.openstack.org/632613 | 15:02 |
| broken_one | hello everyone..having an issue with OSA | 15:04 |
| broken_one | i dont see anything creating the /run/neutron/ or /run/nova/ | 15:04 |
| broken_one | nothing in /etc/tmpfiles.d or in the normal OS systemd tmpfiles.d either | 15:05 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Fix journal remote playbook https://review.openstack.org/632505 | 15:05 |
| broken_one | using OSA rocky and CentOS 7 if that helps | 15:05 |
| jrosser | cloudnull: would those /run directories ^^^ be something the systemd units should create? | 15:06 |
| odyssey4me | masterpe I don't know, but I can tell you that rocky uses stable-3.1 - so make sure you're using the right branch of ceph-ansible for reference | 15:08 |
| cloudnull | it should be, there are tempd files for nova / neutron. I remember guilhermesp having a similar thing ? | 15:08 |
| jrosser | is the centos systemd version still quite old? | 15:08 |
| cloudnull | broken_one which release ? | 15:08 |
| broken_one | jrosser cloudnull what is very odd is that in /etc/neutron/neutron.conf there is the refernce in [oslo_concurrency] | 15:09 |
| broken_one | lock_path | 15:09 |
| broken_one | OSA 18.1.2 and CentOS 7.6 | 15:09 |
| cloudnull | broken_one do you have this commit in the systemd_service role ? | 15:09 |
| cloudnull | https://github.com/openstack/ansible-role-systemd_service/commit/86ad639f4171b0c01bba030ebc3fd96ec020aa45 | 15:09 |
| broken_one | oh btw, the commit for the neutron-l3-agent path issue does solve the problems i faced | 15:10 |
| cloudnull | ^ ++ I'd like to see that merged/cherry-picked into the stable branches | 15:10 |
| odyssey4me | broken_one could you add a +1 with a comment in the patch review? | 15:10 |
| broken_one | of course i will | 15:11 |
| broken_one | let me look at the roles on the deploy host | 15:11 |
| broken_one | one moment | 15:11 |
| broken_one | cloudnull: those commits are not on my deployer | 15:13 |
| broken_one | we will add and redeploy if you need more +1's | 15:13 |
| cloudnull | broken_one if you fetch and checkout the commit (or the master branch) it should resolve that global lock path issue | 15:13 |
| cloudnull | Those changes should get pulled into the stable osa branch when SHA updates are done. | 15:14 |
| odyssey4me | cloudnull that should already be in the stable branch: https://review.openstack.org/627589 | 15:15 |
| cloudnull | if they're not already in the branch | 15:15 |
| cloudnull | what odyssey4me said :) | 15:16 |
| odyssey4me | oh, the role in pinned to the commit before that - so yeah, it needs a role SHA update | 15:16 |
| odyssey4me | yep, it missed the last update by 5 days | 15:17 |
| cloudnull | :'( | 15:17 |
| odyssey4me | I'll do a patch quickly | 15:18 |
| cloudnull | thanks odyssey4me! | 15:18 |
| cloudnull | chandankumar so we're good on the os_tempest issues? | 15:19 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/rocky: Update systemd_service role for lock path fix https://review.openstack.org/632751 | 15:20 |
| odyssey4me | cloudnull there's that and https://review.openstack.org/632485 which add fixes for rocky | 15:21 |
| *** czunker has quit IRC | 15:21 | |
| cloudnull | +2 | 15:21 |
| cloudnull | should we do the same for the other branches? | 15:21 |
| *** ostackz has joined #openstack-ansible | 15:22 | |
| broken_one | ok +1'd the PATH commit | 15:22 |
| odyssey4me | the systemd_service thing? I think that's rocky onwards? | 15:22 |
| cloudnull | ok | 15:22 |
| *** udesale has joined #openstack-ansible | 15:22 | |
| odyssey4me | thanks broken_one - on that basis, I've +2'd and added workflow, so it'll merge soon and we can port it back | 15:23 |
| broken_one | sweet | 15:24 |
| broken_one | thanks | 15:24 |
| odyssey4me | cloudnull on that basis, should https://review.openstack.org/#/c/630370/ port back to rocky too then? | 15:24 |
| ostackz | odyssey4me, cloudnull hi I'm trying to add compute node to rocky, it fails with lacking lbazar role https://pastebin.com/raw/kpXDeS3E Can you suggest how to solve this? Im on 18.1.2 + couple cherry-pick patches | 15:25 |
| cloudnull | oh yea, that was something we needed for the l3 issues | 15:25 |
| cloudnull | odyssey4me ++ that should be pulled back into rocky if we can | 15:25 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/ansible-role-systemd_service stable/rocky: Add an option to configure a service environment https://review.openstack.org/632754 | 15:26 |
| cloudnull | ostackz you could just clone that role down ? | 15:26 |
| cloudnull | if you rebootstrap the environment that role should be cloned, if its marked as needed | 15:27 |
| odyssey4me | ostackz either clean up the cherry-picks to not include that playbook, or pull that role down | 15:27 |
| cloudnull | however the fastest path to success is to clone. | 15:27 |
| cloudnull | what odyssey4me said, | 15:27 |
| cloudnull | `git clone https://github.com/openstack/openstack-ansible-os_blazar /etc/ansible/roles/os_blazar` | 15:27 |
| odyssey4me | ostackz yeah, as cloudnull suggested - if you've picked the whole blazar thing back, then bootstrap-ansible should pull the role down for you | 15:28 |
| ostackz | odyssey4me, cloudnull ok I did that git clone, it helped for blazar, now it stucks on "role 'ceph-facts' was not found" will try to do same thing. Wondering where those roles gone. If I do bootstrap, then I guess I need to reapply cherry-picks as well? | 15:33 |
| odyssey4me | ostackz is this a rocky env? | 15:34 |
| ostackz | just to understand where am I, some time later I will need to upgrade to 18.1.3 - I need to be sure I will be able to do that ;) | 15:34 |
| ostackz | odyssey4me yes, 18.1.2 | 15:34 |
| odyssey4me | be careful with cherry-picking things from master verbatim, there are a lot of different versions of things and adjustments to them to make them work | 15:34 |
| chandankumar | cloudnull: I have not yet reached to tests failure | 15:35 |
| chandankumar | cloudnull: ansible brgmgmt issye gone | 15:35 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Update conditionals and namespaced options https://review.openstack.org/632613 | 15:38 |
| cloudnull | chandankumar nice ! | 15:40 |
| cloudnull | so it was just a system upgrade ? | 15:40 |
| odyssey4me | ostackz can you list the reviews you're cherry-picking? | 15:40 |
| * cloudnull reading back in the IRC loss | 15:40 | |
| cloudnull | **logs | 15:40 |
| odyssey4me | cloudnull could you review https://review.openstack.org/632485 please to help solve issues people reported for horizon/policy issues | 15:41 |
| cloudnull | done | 15:41 |
| chandankumar | odyssey4me: yes | 15:42 |
| chandankumar | cloudnull: yes | 15:42 |
| chandankumar | cloudnull: https://review.openstack.org/#/c/632609/ this would be nice to have | 15:43 |
| cloudnull | done | 15:43 |
| cloudnull | who else needs a +2? Got my workflow macro warmed up and ready! | 15:44 |
| cloudnull | :D | 15:44 |
| jrosser | cloudnull: https://review.openstack.org/#/c/632118/ | 15:44 |
| *** TxGirlGeek has joined #openstack-ansible | 15:46 | |
| openstackgerrit | Merged openstack/ansible-role-systemd_service master: Add options to set DynamicUser and StateDirectory https://review.openstack.org/630664 | 15:46 |
| openstackgerrit | Merged openstack/ansible-role-systemd_service master: Update home-page https://review.openstack.org/630437 | 15:46 |
| ostackz | odyssey4me I have marked these I have applied after clean 18.1.2 https://pastebin.com/raw/QUpf3YvK | 15:50 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Fix the misspelling of "container" https://review.openstack.org/632642 | 15:53 |
| ostackz | odyssey4me Is it ok to do scripts/bootstrap-ansible.sh again if I have those patches? As I unserstand that would wipe out patched things again? | 15:55 |
| derks | I am running OpenStack AIO for PIKE (16.0.24) ... we need this version for specific reasons. It appears to no longer run 'scripts/bootstrap-ansible.sh' | 15:55 |
| derks | the failure is due to github.com/ceph/ansible-ceph-* (defaults, common, etc) are now 404 | 15:56 |
| derks | Is anyone aware why or where the ceph repos moved to? | 15:56 |
| odyssey4me | ostackz ok, once https://review.openstack.org/632485 merges, that resolves the policy issue | 15:57 |
| *** strattao has quit IRC | 15:59 | |
| odyssey4me | derks they were recently removed from github | 16:00 |
| derks | odyssey4me I see that. Is there any plan to update Openstack AIO PIKE to fix that then? or any suggestions? | 16:01 |
| odyssey4me | derks you'll need to pull https://github.com/openstack/openstack-ansible/commit/03adca70dcc2c8befe597e2f2dd12bbeb7d88720 in to make it bootstrap again | 16:01 |
| derks | awesome | 16:02 |
| odyssey4me | derks what's the reason you're pinning to an OSA tag? | 16:02 |
| derks | I think we talked about this previously. Working on a project that doesn't support Keystone v3 API yet | 16:02 |
| derks | and Pike is the last version that includes v2 | 16:03 |
| odyssey4me | derks oh, actually I see that 16.0.24 is the latest tag - if you checkout stable/pike you'll get the proposed 16.0.25 changes, including the above-mentioned patch | 16:03 |
| odyssey4me | derks oh ok, so you're not pinning to an OSA tag - you're just stuck with pike | 16:03 |
| openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts stable/rocky: Use libeatmydata during LXC cache prep https://review.openstack.org/632118 | 16:05 |
| odyssey4me | derks you should probably delete the old roles from /etc/ansible/roles FYI, or just use https://github.com/openstack/openstack-ansible/commit/dcd6f2b031e3680f9381dad005a97c5eee91731d to do it | 16:05 |
| derks | odyssey4me both ... we're stuck to pike (for now), and locking to 16.0.24 to prevent untested/unknown changes | 16:05 |
| derks | in this case that bites us | 16:05 |
| odyssey4me | ostackz so does https://review.openstack.org/632505 work for you to fix the remote journaling? | 16:07 |
| odyssey4me | if so, please +1 and coment in review | 16:07 |
| ostackz | oddysey4me yes | 16:08 |
| *** udesale has quit IRC | 16:10 | |
| openstackgerrit | Merged openstack/ansible-role-systemd_service stable/rocky: Add an option to configure a service environment https://review.openstack.org/632754 | 16:10 |
| ostackz | oddysey4me sorry Im not registered in review.openstack.org currently, but can do that if my +1 is what is missing for this change to move on | 16:14 |
| odyssey4me | ostackz no worries, I've added a note about your feedback | 16:15 |
| *** ThiagoCMC has joined #openstack-ansible | 16:17 | |
| ostackz | cloudnull could you advice url to clone for "ERROR! the role 'ceph-facts' was not found in /opt/openstack-ansible/playbooks/roles" just cannot find it in github.com | 16:18 |
| ThiagoCMC | Hey guys, I'm facing a hard time to find a complete documentation about OSA with Ceph... | 16:18 |
| ThiagoCMC | This one: https://docs.openstack.org/openstack-ansible/rocky/user/ceph/full-deploy.html - doesn't looks complete.. Like, where is the OSD devices? | 16:19 |
| odyssey4me | ostackz ceph-facts should be in /etc/ansible/roles/ceph-ansible | 16:19 |
| ostackz | oddysey4me thanks, got that! | 16:20 |
| odyssey4me | ThiagoCMC the docs are all in ceph-ansible | 16:21 |
| ThiagoCMC | Ceph-ansible itself, like, their own docs? | 16:22 |
| odyssey4me | ThiagoCMC yep | 16:22 |
| ThiagoCMC | Another question, when installing OSA with Ceph, can I use Ceph from Ubuntu Cloud Archives: ceph-13.2.1 ? | 16:23 |
| odyssey4me | we have a minimal integration layer to help with providing mon containers and integrating with openstack bits | 16:23 |
| odyssey4me | ThiagoCMC you can if you like, there's a var to set where ceph is sourced from, and uca is one of those I think | 16:23 |
| *** gyee has joined #openstack-ansible | 16:23 | |
| ThiagoCMC | Cool, that's what I'm interested actually! The integration layer from OSA | 16:24 |
| ThiagoCMC | ok | 16:24 |
| ThiagoCMC | What about the Ceph Manager (ceph-mgr), where is it going to be deployed when with OSA+Ceph? | 16:25 |
| jenglisch_ | in the mon lxc's | 16:25 |
| ThiagoCMC | Thanks! | 16:25 |
| jenglisch_ | it's all in the playbooks/ceph-install.yml | 16:26 |
| ThiagoCMC | Nice! | 16:26 |
| ThiagoCMC | I'll take a look! | 16:26 |
| jenglisch_ | read those few lines + docs about ceph-ansible | 16:26 |
| ThiagoCMC | For sure! Working on it... ^_^ | 16:27 |
| odyssey4me | ostackz how is it that you're getting the need for ceph-facts, that's only needed for ceph-ansible in OSA master, not rocky | 16:28 |
| odyssey4me | ostackz it seems to me that the list of cherry-picks in https://pastebin.com/raw/QUpf3YvK is incomplete | 16:29 |
| openstackgerrit | Merged openstack/openstack-ansible-tests master: Gather all facts while preparing hosts https://review.openstack.org/632609 | 16:32 |
| openstackgerrit | Merged openstack/openstack-ansible master: Clean-up and simplify the major upgrade https://review.openstack.org/624773 | 16:36 |
| *** macza has joined #openstack-ansible | 16:41 | |
| openstackgerrit | James Denton proposed openstack/openstack-ansible-os_neutron master: [WIP] Deploy Vector Packet Processing (VPP) Platform for Neutron https://review.openstack.org/631644 | 16:54 |
| *** nurdie has joined #openstack-ansible | 16:55 | |
| openstackgerrit | James Denton proposed openstack/openstack-ansible-os_neutron master: [WIP] Deploy Vector Packet Processing (VPP) Platform for Neutron https://review.openstack.org/631644 | 16:56 |
| *** ThiagoCMC has quit IRC | 16:58 | |
| *** ztr has joined #openstack-ansible | 17:04 | |
| *** gkadam has quit IRC | 17:29 | |
| *** TxGirlGeek has quit IRC | 17:35 | |
| *** TxGirlGeek has joined #openstack-ansible | 17:36 | |
| *** DanyC has quit IRC | 17:50 | |
| *** DanyC has joined #openstack-ansible | 17:51 | |
| *** ThiagoCMC has joined #openstack-ansible | 17:52 | |
| *** strattao has joined #openstack-ansible | 17:54 | |
| *** DanyC has quit IRC | 17:55 | |
| *** ThiagoCMC has quit IRC | 17:58 | |
| *** kopecmartin is now known as kopecmartin|off | 18:01 | |
| *** shardy has quit IRC | 18:21 | |
| *** CeeMac has quit IRC | 18:22 | |
| *** strattao has quit IRC | 18:24 | |
| *** strattao has joined #openstack-ansible | 18:28 | |
| *** ThiagoCMC has joined #openstack-ansible | 18:29 | |
| *** TxGirlGeek has quit IRC | 18:29 | |
| nurdie | https://git.openstack.org/cgit/openstack/designate/tag/?h=5.0.2 <-- I think that's the last version of designate for Pike? In OSA 16.0.23 (maybe .24 too?), requirements.txt requires designate-7.1.0.dev70, which breaks repo-build | 18:30 |
| nurdie | Sorry, I mean requirements_absolute_requirements.txt | 18:30 |
| odyssey4me | nurdie that doesn't break it at all - requirements_absolute_requirements.txt is created during repo build, based on the packages it built | 18:32 |
| odyssey4me | nurdie what repo build uses is https://github.com/openstack/openstack-ansible/blob/stable/rocky/playbooks/defaults/repo_packages/openstack_services.yml#L68 | 18:33 |
| odyssey4me | nurdie also, I can see 7.x tags in the designate repo | 18:35 |
| *** TxGirlGeek has joined #openstack-ansible | 18:35 | |
| odyssey4me | nurdie so, the question is - what exactly is the failure you're hitting, and what do the logs in /var/log/repo in the repo container say about it? | 18:36 |
| odyssey4me | I'm going afk now, but if you show some log output in a paste service I can take a look in the morning | 18:37 |
| nurdie | odyssey4me: My 16.0.23 environment keeps trying to install that 7.x, which requires keystoneauth1>=3.4.0, but that doesn't get pulled in. I just manually downlaoded it to my repo container to see if that fixes | 18:38 |
| nurdie | Thanks! | 18:38 |
| *** asettle has quit IRC | 18:45 | |
| *** mugsie has quit IRC | 18:55 | |
| *** Darcidride has joined #openstack-ansible | 18:56 | |
| *** ztr has quit IRC | 18:57 | |
| *** mugsie has joined #openstack-ansible | 18:57 | |
| *** DanyC has joined #openstack-ansible | 19:08 | |
| *** electrofelix has quit IRC | 19:11 | |
| openstackgerrit | Andy Smith proposed openstack/openstack-ansible master: Add documentation for hybrid messaging configuration https://review.openstack.org/610079 | 19:11 |
| openstackgerrit | Merged openstack/openstack-ansible stable/rocky: Update roles for policy-in-code fixes https://review.openstack.org/632485 | 19:15 |
| *** aedc has quit IRC | 19:17 | |
| *** TxGirlGeek has quit IRC | 19:29 | |
| nurdie | odyssey4me: https://pastebin.com/RM03zCeE -- line 2164 | 19:42 |
| nurdie | Happens on both OSA 16.0.23 and 16.0.24 | 19:43 |
| *** TxGirlGeek has joined #openstack-ansible | 19:46 | |
| *** spsurya has quit IRC | 19:55 | |
| jrosser | nurdie: that feels like an inventory error, first thing i might investigate is a typo/indentation error in openstack_user_config | 20:06 |
| *** DanyC has quit IRC | 20:09 | |
| jrosser | nurdie: are you putting pike onto centos7.6? | 20:10 |
| *** aedc has joined #openstack-ansible | 20:11 | |
| nurdie | jrosser: yessir | 20:13 |
| nurdie | I just looked over my config. Looks fine | 20:13 |
| nurdie | I commented out designate for now. Gonna rerun and see what happens. I can go back and stand designate up manually later | 20:13 |
| *** DanyC has joined #openstack-ansible | 20:14 | |
| jrosser | i see a few patches for centos7.5->7.6 related things backported to pike | 20:16 |
| nurdie | If it's backported, it should be in 16.0.24, no? | 20:16 |
| jrosser | however, note that the last commit to that branch https://review.openstack.org/#/c/632460/ only gates on xenial, so there could be all sorts of surprises lurking there | 20:16 |
| nurdie | lol oh fun | 20:17 |
| nurdie | Thanks! We're not going to Queens for another month or so. Then, 1 or 2 months to Rocky | 20:18 |
| *** ThiagoCMC has quit IRC | 20:31 | |
| *** DanyC has quit IRC | 20:32 | |
| *** aedc has quit IRC | 20:36 | |
| *** DanyC has joined #openstack-ansible | 20:47 | |
| *** strattao has quit IRC | 20:48 | |
| *** DanyC has quit IRC | 20:51 | |
| *** DanyC has joined #openstack-ansible | 20:55 | |
| *** hamzaachi has joined #openstack-ansible | 21:05 | |
| *** hamzaachi has quit IRC | 21:06 | |
| *** noonedeadpunk has quit IRC | 21:07 | |
| *** errr has quit IRC | 21:23 | |
| derks | odyssey4me using stable/pike I've gotten further but have hit a way when running setup-openstack.yml: https://gist.github.com/derks/520cf2e68b2203fdbdc1560968882b51 | 21:27 |
| derks | still something with ceph | 21:27 |
| derks | hit a wall* | 21:27 |
| *** tinwood has quit IRC | 21:29 | |
| *** tinwood has joined #openstack-ansible | 21:30 | |
| prometheanfire | what would be the best way to get more debug info for this stall? | 21:32 |
| prometheanfire | http://logs.openstack.org/02/608102/9/check/openstack-ansible-functional-gentoo-17-0-systemd/ffc79cf/job-output.txt.gz#_2019-01-22_17_30_42_859063 | 21:32 |
| *** errr has joined #openstack-ansible | 21:48 | |
| jrosser | derks: you may be affected by upstream changes to the ceph-ansible repos, see this https://review.openstack.org/#/c/632142/ | 21:52 |
| *** tinwood has quit IRC | 21:52 | |
| *** ztr_ has joined #openstack-ansible | 21:52 | |
| *** tinwood has joined #openstack-ansible | 21:54 | |
| derks | jrosser yeah that's what original bit me... got passed that now, but I guess the new ceph-ansible breaks pike regardless | 21:57 |
| jrosser | derks: oh well thats actually the openstack-ansible ceph_client role it cant find - so thats a different issue | 22:00 |
| derks | yeah | 22:00 |
| derks | ok | 22:00 |
| jrosser | it says it is looking in /etc/ansible/roles, which is where i think the role should be | 22:01 |
| derks | not sure how to move past this... I'm locked into pike so this is a pita | 22:01 |
| jrosser | i can only suggest checking if the role is cloned into the expected location | 22:02 |
| derks | /etc/ansible/roles/ceph_client ? | 22:03 |
| jrosser | yes, i believe that is where it should be (it's there on my rocky deploy fwiw) | 22:03 |
| derks | it's not there... now it is here /etc/ansible/roles/ceph-ansible/roles/ceph-client/ | 22:03 |
| jrosser | ceph*_*client though - note the underscore | 22:04 |
| derks | likely that openstack aio for pike will be fixed? | 22:04 |
| jrosser | it should be pulled in from this https://github.com/openstack/openstack-ansible/blob/stable/pike/ansible-role-requirements.yml#L21-L24 | 22:05 |
| jrosser | it's late here i got to run, but if you are missing that role then that should be enough info to dig into why | 22:06 |
| jrosser | bootstrap-ansible should have put all that in place | 22:06 |
| openstackgerrit | Merged openstack/openstack-ansible-ops master: Update conditionals and namespaced options https://review.openstack.org/632613 | 22:09 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Update delegated setup hosts to support IP delegation https://review.openstack.org/632201 | 22:15 |
| *** jbadiapa has quit IRC | 22:15 | |
| *** dave-mccowan has quit IRC | 22:25 | |
| *** Darcidride has quit IRC | 22:27 | |
| *** nurdie has quit IRC | 22:28 | |
| *** nurdie has joined #openstack-ansible | 22:29 | |
| *** nurdie has quit IRC | 22:34 | |
| openstackgerrit | Merged openstack/openstack-ansible-ops master: Fix the misspelling of "container" https://review.openstack.org/632642 | 22:34 |
| *** tinwood has quit IRC | 22:34 | |
| *** tinwood has joined #openstack-ansible | 22:41 | |
| *** DanyC has quit IRC | 22:50 | |
| *** ztr_ has quit IRC | 23:40 | |
| *** tosky has quit IRC | 23:43 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!