| *** spatel has quit IRC | 00:16 | |
| *** nicolasbock has quit IRC | 00:17 | |
| *** spatel has joined #openstack-ansible | 00:54 | |
| *** sep has quit IRC | 01:05 | |
| *** sep has joined #openstack-ansible | 01:05 | |
| *** ianychoi_ has joined #openstack-ansible | 01:27 | |
| *** ianychoi has quit IRC | 01:30 | |
| *** altlogbot_0 has quit IRC | 01:30 | |
| *** altlogbot_2 has joined #openstack-ansible | 01:31 | |
| *** jamesdenton has quit IRC | 01:32 | |
| *** Pilou has quit IRC | 01:36 | |
| *** KeithMnemonic has quit IRC | 02:26 | |
| spatel | I have filed bug to fix octavia 3 node controller networking issue, this is totally misleading documentation which cause my 2 weeks of pain :( | 03:09 |
|---|---|---|
| spatel | https://bugs.launchpad.net/openstack-ansible/+bug/1835855 | 03:09 |
| openstack | Launchpad bug 1835855 in openstack-ansible "octavia lb-mgmt network is broken on production 3 node deployment" [Undecided,New] | 03:09 |
| *** BjoernT has joined #openstack-ansible | 03:17 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/ansible-config_template master: Add option to use a remote source https://review.opendev.org/669758 | 03:17 |
| *** shyamb has joined #openstack-ansible | 03:40 | |
| *** cshen has joined #openstack-ansible | 04:08 | |
| *** udesale has joined #openstack-ansible | 04:10 | |
| *** shyamb has quit IRC | 04:20 | |
| *** raukadah is now known as chandankumar | 04:35 | |
| *** pcaruana has joined #openstack-ansible | 04:35 | |
| *** spatel has quit IRC | 04:37 | |
| *** pcaruana has quit IRC | 04:38 | |
| *** gyee has quit IRC | 04:59 | |
| *** ivve has joined #openstack-ansible | 05:19 | |
| *** BjoernT has quit IRC | 05:26 | |
| *** luksky11 has joined #openstack-ansible | 05:30 | |
| *** shyamb has joined #openstack-ansible | 05:36 | |
| *** shyam89 has joined #openstack-ansible | 05:41 | |
| *** shyamb has quit IRC | 05:41 | |
| *** udesale has quit IRC | 05:48 | |
| *** miloa has joined #openstack-ansible | 06:04 | |
| *** udesale has joined #openstack-ansible | 06:06 | |
| evrardjp | good morning | 06:06 |
| evrardjp | I am back from holidays, what did I miss? | 06:06 |
| evrardjp | I will check the releases and bump this week | 06:07 |
| evrardjp | (catching up with other things first) | 06:07 |
| evrardjp | but please tell me if there is something important I missed :) | 06:07 |
| *** udesale has quit IRC | 06:09 | |
| *** udesale has joined #openstack-ansible | 06:10 | |
| jrosser | evrardjp: i found why the master bump was brok | 06:12 |
| jrosser | python-qinlingclient made 'openstack complete' crash, they've released a new version but i think it's still failing becasue of the version of requirements we pick up | 06:13 |
| jrosser | not really sure where that is controlled tbh | 06:13 |
| janno | Sehe ich es richtig, dass es mit journal fürs Logging kein zentrales Log mehr gibt? | 06:24 |
| janno | damn, sorry | 06:24 |
| janno | Do I see it correctly that there is no longer a central log with journal for logging? | 06:24 |
| jrosser | janno: the journals should be set up to forward over http to log1 | 06:40 |
| *** udesale has quit IRC | 06:40 | |
| evrardjp | janno: there are things in openstack-ansible-ops too, to help with central logging | 06:40 |
| * jrosser working on elk7.x right now | 06:41 | |
| evrardjp | jrosser: well I guess it all depends on requirements sha and its u-c | 06:41 |
| evrardjp | I will have a look when I will have caught up in my day job | 06:41 |
| jrosser | evrardjp: yeah, I couldn’t see how that worked | 06:41 |
| janno | evrardjp: where is this supposed to be configured? /etc/systemd/journald.conf? | 06:42 |
| jrosser | Seemed to be injected by zuul env var, which feels odd because if you are broken by a pypi package like we are, then you seem totally stuck until that SHA is updated | 06:42 |
| *** spatel has joined #openstack-ansible | 06:48 | |
| *** shyam89 has quit IRC | 06:52 | |
| evrardjp | jrosser: oh at some point we might have done that for role tests, but it shouldn't apply in the integrated. I will double check | 06:53 |
| *** spatel has quit IRC | 06:53 | |
| *** rpittau|afk is now known as rpittau | 06:58 | |
| *** shyamb has joined #openstack-ansible | 07:02 | |
| *** pcaruana has joined #openstack-ansible | 07:03 | |
| janno | It's necessary that there is a host called log1? | 07:20 |
| miloa | morning | 07:24 |
| *** udesale has joined #openstack-ansible | 07:24 | |
| *** tosky has joined #openstack-ansible | 07:28 | |
| *** shyamb has quit IRC | 07:40 | |
| *** shyamb has joined #openstack-ansible | 07:44 | |
| *** starborn has joined #openstack-ansible | 07:49 | |
| *** shyamb has quit IRC | 07:50 | |
| *** gkadam has joined #openstack-ansible | 07:55 | |
| *** gkadam has quit IRC | 07:55 | |
| *** Namrata has joined #openstack-ansible | 08:04 | |
| jrosser | evrardjp: this is where it picks up the requirements pin from https://opendev.org/openstack/openstack-ansible/src/branch/master/scripts/bootstrap-ansible.sh#L120 | 08:09 |
| Namrata | Hi folks, I am trying to run major upgrade from Rocky to Steinthe run-upgrade.sh fails at http://paste.openstack.org/show/754194/. I manually changed the version to master and then it fails at http://paste.openstack.org/show/754202/so running the scripts manually http://paste.openstack.org/show/754203/ . it again fails at `openstack-ansible setup-i | 08:12 |
| Namrata | nfrastructure.yml -e 'galera_upgrade=true' -e 'rabbitmq_upgrade=true'` http://paste.openstack.org/show/754204/ | 08:12 |
| *** Namrata has quit IRC | 08:21 | |
| *** shyamb has joined #openstack-ansible | 08:23 | |
| *** Blinkiz has joined #openstack-ansible | 08:30 | |
| Blinkiz | Hello. "git clone -b 19.0.0.0rc3 https://ope..." and then "scripts/bootstrap-ansible.sh" will fail on download of qdrouterd packages from git. http://paste.openstack.org/show/754205/ | 08:33 |
| *** Namrata has joined #openstack-ansible | 08:37 | |
| Blinkiz | Hmm. Maybe there is something wrong with access to opendev.org. I get random errors now when downloading. So ignore my message :-) | 08:43 |
| *** hamzaachi has joined #openstack-ansible | 09:14 | |
| *** ArchiFleKs has joined #openstack-ansible | 09:19 | |
| *** shyamb has quit IRC | 09:40 | |
| *** vnogin has joined #openstack-ansible | 09:42 | |
| *** pcaruana has quit IRC | 09:48 | |
| *** shyamb has joined #openstack-ansible | 09:52 | |
| *** nicolasbock has joined #openstack-ansible | 10:11 | |
| *** Guest1634 has quit IRC | 10:22 | |
| *** Pilou has joined #openstack-ansible | 10:23 | |
| *** udesale has quit IRC | 10:34 | |
| openstackgerrit | kourosh vivan proposed openstack/openstack-ansible-os_octavia master: Fix python path when deploy host is not localhost https://review.opendev.org/669838 | 10:35 |
| *** shyamb has quit IRC | 10:35 | |
| *** Namrata has quit IRC | 10:37 | |
| *** luksky11 has quit IRC | 10:40 | |
| *** jamesdenton has joined #openstack-ansible | 10:50 | |
| *** shyamb has joined #openstack-ansible | 10:52 | |
| *** nicolasbock has quit IRC | 11:06 | |
| *** luksky11 has joined #openstack-ansible | 11:16 | |
| *** gokhani has quit IRC | 11:16 | |
| *** altlogbot_2 has quit IRC | 11:19 | |
| *** irclogbot_3 has quit IRC | 11:19 | |
| *** altlogbot_1 has joined #openstack-ansible | 11:19 | |
| *** zbr is now known as zbr|lunch | 11:22 | |
| *** altlogbot_1 has quit IRC | 11:25 | |
| openstackgerrit | Georgina Shippey proposed openstack/openstack-ansible-ops master: Duplicate of elk_metrics_6x to elk_metrics_7x https://review.opendev.org/669851 | 11:27 |
| openstackgerrit | Georgina Shippey proposed openstack/openstack-ansible-ops master: Config updates for elk 7.x https://review.opendev.org/669852 | 11:27 |
| *** ansmith has quit IRC | 11:31 | |
| *** niceplace_ has joined #openstack-ansible | 11:52 | |
| *** electrofelix has joined #openstack-ansible | 11:54 | |
| *** kinrui has joined #openstack-ansible | 11:54 | |
| *** udesale has joined #openstack-ansible | 11:55 | |
| *** fyx has quit IRC | 11:55 | |
| *** gundalow has quit IRC | 11:55 | |
| *** cyberpear has quit IRC | 11:55 | |
| *** niceplace has quit IRC | 11:55 | |
| *** jtanner has quit IRC | 11:55 | |
| *** guilhermesp has quit IRC | 11:55 | |
| *** janno has quit IRC | 11:55 | |
| *** jrosser has quit IRC | 11:55 | |
| *** fungi has quit IRC | 11:55 | |
| *** odyssey4me has quit IRC | 11:56 | |
| *** asettle-PTO has quit IRC | 11:56 | |
| *** Namrata has joined #openstack-ansible | 11:57 | |
| *** altlogbot_1 has joined #openstack-ansible | 11:58 | |
| *** zbr|lunch is now known as zbr | 11:59 | |
| *** altlogbot_1 has quit IRC | 11:59 | |
| *** shyamb has quit IRC | 11:59 | |
| *** irclogbot_1 has joined #openstack-ansible | 11:59 | |
| *** fyx has joined #openstack-ansible | 12:01 | |
| *** gundalow has joined #openstack-ansible | 12:01 | |
| *** cyberpear has joined #openstack-ansible | 12:01 | |
| *** janno has joined #openstack-ansible | 12:01 | |
| *** jtanner has joined #openstack-ansible | 12:01 | |
| *** guilhermesp has joined #openstack-ansible | 12:01 | |
| *** jrosser has joined #openstack-ansible | 12:01 | |
| *** altlogbot_0 has joined #openstack-ansible | 12:01 | |
| *** weshay_PTO is now known as weshay | 12:01 | |
| *** irclogbot_1 has quit IRC | 12:05 | |
| *** altlogbot_0 has quit IRC | 12:05 | |
| *** altlogbot_0 has joined #openstack-ansible | 12:07 | |
| *** pcaruana has joined #openstack-ansible | 12:10 | |
| *** altlogbot_0 has quit IRC | 12:11 | |
| *** kinrui is now known as fungi | 12:21 | |
| *** vnogin has quit IRC | 12:25 | |
| *** shyamb has joined #openstack-ansible | 12:26 | |
| *** vnogin has joined #openstack-ansible | 12:33 | |
| evrardjp | mnaser: https://review.opendev.org/#/c/669861/ | 12:35 |
| *** Blinkiz has quit IRC | 12:36 | |
| mnaser | thanks evrardjp ! | 12:39 |
| evrardjp | can I have someone push that one through? https://review.opendev.org/#/c/660071/ | 12:49 |
| evrardjp | mnaser: yw. Still catching up from my holidays. 600 openstack emails to action | 12:49 |
| evrardjp | down to 350. | 12:50 |
| evrardjp | \o/ | 12:50 |
| *** ansmith has joined #openstack-ansible | 12:50 | |
| mgariepy | evrardjp, done. | 12:51 |
| *** altlogbot_3 has joined #openstack-ansible | 12:53 | |
| *** altlogbot_3 has quit IRC | 12:57 | |
| *** vnogin has quit IRC | 13:19 | |
| *** goldyfruit has joined #openstack-ansible | 13:19 | |
| openstackgerrit | kourosh vivan proposed openstack/openstack-ansible-os_octavia master: iptables save fix for centos 7 https://review.opendev.org/669870 | 13:23 |
| *** shyamb has quit IRC | 13:23 | |
| evrardjp | mgariepy: thanks! | 13:26 |
| evrardjp | jrosser: do you have a view of where we are for the "convert the db to a file we can sync" across roles? Did noonedeadpunk share a link or something? | 13:27 |
| evrardjp | it would be nice to have that done in all roles before starting said sync :) | 13:27 |
| jrosser | hmm no i dont have that | 13:27 |
| *** vnogin has joined #openstack-ansible | 13:31 | |
| *** BjoernT has joined #openstack-ansible | 13:34 | |
| jamesdenton | If anyone around is running >= Stein, I'd be curious to know the size of the /var/log/haproxy/haproxy.log file on your node. | 13:37 |
| *** goldenfri has quit IRC | 13:43 | |
| jrosser | jamesdenton: woah it's 1.7G | 13:47 |
| *** BjoernT has quit IRC | 13:52 | |
| *** goldenfri has joined #openstack-ansible | 13:54 | |
| jamesdenton | Mine was over 100G yesterday | 13:55 |
| jamesdenton | has grown ~20 MB in the last 20 min. | 13:56 |
| *** cshen has quit IRC | 13:56 | |
| *** BjoernT has joined #openstack-ansible | 13:57 | |
| *** spatel has joined #openstack-ansible | 14:14 | |
| *** spatel has left #openstack-ansible | 14:22 | |
| *** spatel has joined #openstack-ansible | 14:22 | |
| jrosser | looks like theres something a bit wierd with the logrotate on this? | 14:29 |
| *** BjoernT_ has joined #openstack-ansible | 14:30 | |
| *** BjoernT has quit IRC | 14:32 | |
| jamesdenton | probably, just haven't had much time to dig into it. | 14:40 |
| redkrieg | Hi all, I'm trying to remove swift and deploy glance on ceph, but my old swift container keeps getting recreated and is failing to configure. I've commented out everything swift related and used lxc-containers-destroy.yml but I think its presence in the inventory is causing it to be created and configured again. How do I go about completely removing it? | 14:41 |
| redkrieg | /etc/openstack_deploy/openstack_hostnames_ips.yml says not to manually edit it. | 14:41 |
| spatel | jrosser: Did you see this.. https://bugs.launchpad.net/openstack-ansible/+bug/1835855 | 14:45 |
| openstack | Launchpad bug 1835855 in openstack-ansible "octavia lb-mgmt network is broken on production 3 node deployment" [Undecided,New] | 14:45 |
| spatel | Look like may need to fix OSA document to implement Octavia because its very vague and not clear... | 14:46 |
| openstackgerrit | Merged openstack/openstack-ansible-os_congress master: Add integrated coverage https://review.opendev.org/660071 | 14:47 |
| *** starborn has quit IRC | 14:48 | |
| jrosser | spatel: i read you bug - i'm not sure i understand why br-lbaas needs an ip? | 14:49 |
| jrosser | redkrieg: you need to use the scripts/inventory-manage.py tool to remove your swift containers from the inventory, after you've deleted tham | 14:49 |
| openstackgerrit | Merged openstack/openstack-ansible-os_glance master: service_setup: refactor service setup to a single file https://review.opendev.org/665372 | 14:50 |
| redkrieg | jrosser: that's what I was missing. thanks! | 14:51 |
| spatel | jrosser: i finally found what was wrong.. i would really like to get website updated so people like me save 2 weeks worth of time to chase issue like this. | 14:51 |
| spatel | br-lbaas need ip address but it doesn't need to map with any bond0.XX | 14:52 |
| spatel | it need special veth peer to br-vlan.XX | 14:52 |
| spatel | which isn't in that document. | 14:52 |
| jamesdenton | br-lbaas does not need an IP AFAIK | 14:52 |
| *** ivve has quit IRC | 14:53 | |
| jamesdenton | the octavia container will connect to br-lbaas (along with br-mgmt), and the container interface needs an IP | 14:53 |
| jrosser | spatel: doesnt it depend how you set it up? you've used vlan type so neutron will handle the de-encapsulation | 14:53 |
| jrosser | and if you used a flat type then you can pass bond0.XX if you make it yourself? | 14:53 |
| *** jehane has left #openstack-ansible | 14:54 | |
| spatel | I asked that question multiple time do i need flat or raw (type) but no one reply :( | 14:54 |
| jrosser | you can do either | 14:54 |
| spatel | why can flat will fix that issue.. i still have doubt | 14:54 |
| spatel | Issue is when you map br-lbaas with bond0.XX in that case netns (namespace) won't get ARP reply back | 14:55 |
| spatel | that is what i mentioned in bug | 14:55 |
| spatel | flat has nothing to do with this issue.. | 14:55 |
| *** altlogbot_2 has joined #openstack-ansible | 14:55 | |
| spatel | This is what i did finally, remove bond0.27 from br-lbaas and created veth using this doc - https://github.com/rcbops/rpc-octavia/blob/master/INSTALLATION.md | 14:56 |
| *** altlogbot_2 has quit IRC | 14:57 | |
| spatel | jrosser: now i have last time if you have time.. my rsyslog client not getting push out :( | 14:58 |
| spatel | that is blocking me to move to production :( | 14:58 |
| spatel | without logging i can't push | 14:58 |
| jrosser | spatel: do you have something more specific? | 15:02 |
| spatel | I am searching bug which i filed | 15:02 |
| spatel | let me find bug | 15:02 |
| openstackgerrit | Merged openstack/openstack-ansible-os_keystone master: service_setup: refactor service setup to a single file https://review.opendev.org/665167 | 15:03 |
| spatel | https://bugs.launchpad.net/openstack-ansible/+bug/1835632 | 15:03 |
| openstack | Launchpad bug 1835632 in openstack-ansible "rsyslog_client deployment broken after rocky release " [Undecided,New] | 15:03 |
| spatel | jrosser: ^^ | 15:03 |
| spatel | i found it | 15:03 |
| openstackgerrit | Merged openstack/openstack-ansible-os_cinder master: service_setup: refactor service setup to a single file https://review.opendev.org/665607 | 15:06 |
| jrosser | spatel: did you check that it actually ran the rsyslog_client role as part of that command? i am thinking that the --tags will make it skip pretty much everything | 15:08 |
| spatel | i did it run rsyslog_client but didn't do anything | 15:09 |
| spatel | question is which playbook i should run to make changes in rsyslog_client ot install rsyslog_client? | 15:09 |
| spatel | i ran full setup-openstack.yml but didn't do much, i have seen it deply 50-default.conf file in some container but not all | 15:10 |
| spatel | do you think i should run setup-hosts.yml | 15:11 |
| *** altlogbot_2 has joined #openstack-ansible | 15:11 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_cinder master: Install openSUSE distro packages selectively https://review.opendev.org/668056 | 15:14 |
| jrosser | spatel: with the use of --tags that you had, i think that the rsyslog_client steps may have been skipped | 15:15 |
| jrosser | spatel: as you can see here each playbook for each component calls the rsyslog_client role https://opendev.org/openstack/openstack-ansible/src/branch/master/playbooks/common-playbooks/glance.yml#L72-L77 | 15:16 |
| *** altlogbot_2 has quit IRC | 15:17 | |
| spatel | you are suggesting not to use --tags with setup-openstack.yml playbook? | 15:17 |
| *** Namrata has quit IRC | 15:17 | |
| jrosser | jrosser> spatel: did you check that it actually ran the rsyslog_client role as part of that command? i am thinking that the --tags will make it skip pretty much everything | 15:17 |
| jrosser | ^ yes | 15:17 |
| spatel | let me run on specific container and give you full output. hold on | 15:18 |
| jrosser | as i've just shown you each playbook calls rsyslog client itself | 15:18 |
| jrosser | so limit yourself to one component like keystone or glance | 15:18 |
| spatel | openstack-ansible setup-openstack.yml --limit ostack-infra-2-1_barbican_container-7684c7d5 | 15:20 |
| spatel | running now | 15:20 |
| *** vnogin has quit IRC | 15:20 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova master: service_setup: refactor service setup to a single file https://review.opendev.org/665648 | 15:22 |
| spatel | jrosser: here you go full report - http://paste.openstack.org/show/754224/ | 15:25 |
| spatel | line number 291 it ran rsyslog playbook | 15:25 |
| spatel | In container i can see only 1 file 50-default.conf | 15:26 |
| -spatel- [root@ostack-infra-2-1-barbican-container-7684c7d5 ~]# cat /etc/rsyslog.d/ | 15:26 | |
| -spatel- 50-default.conf listen.conf | 15:26 | |
| *** chandankumar is now known as raukadah | 15:32 | |
| *** miloa has quit IRC | 15:33 | |
| *** hamzy has quit IRC | 15:33 | |
| jrosser | spatel: and at 342 it did nothing | 15:33 |
| spatel | hmmm | 15:33 |
| jrosser | so that tells you that this condition was false https://github.com/openstack/openstack-ansible-rsyslog_client/blob/fa8a61f9b2d80d584ec8213668c2668c37093ece/tasks/rsyslog_client_post_install.yml#L86 | 15:33 |
| openstackgerrit | Georgina Shippey proposed openstack/openstack-ansible-ops master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/657225 | 15:34 |
| spatel | jrosser: but why that condition is not true? | 15:34 |
| *** Namrata has joined #openstack-ansible | 15:35 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: Add mistral into the playbook list https://review.opendev.org/669894 | 15:38 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_mistral master: Use the dynamic aio scenario https://review.opendev.org/658448 | 15:39 |
| *** altlogbot_3 has joined #openstack-ansible | 15:41 | |
| *** cshen has joined #openstack-ansible | 15:44 | |
| *** altlogbot_3 has quit IRC | 15:47 | |
| *** hamzy has joined #openstack-ansible | 16:02 | |
| *** CeeMac has quit IRC | 16:06 | |
| *** altlogbot_3 has joined #openstack-ansible | 16:07 | |
| *** ivve has joined #openstack-ansible | 16:08 | |
| *** vnogin has joined #openstack-ansible | 16:09 | |
| *** BjoernT_ has quit IRC | 16:09 | |
| *** altlogbot_3 has quit IRC | 16:13 | |
| *** BjoernT_ has joined #openstack-ansible | 16:13 | |
| mnaser | sorry. | 16:15 |
| mnaser | #startmeeting openstack_ansible_meeting | 16:15 |
| openstack | Meeting started Tue Jul 9 16:15:52 2019 UTC and is due to finish in 60 minutes. The chair is mnaser. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:15 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:15 |
| *** openstack changes topic to " (Meeting topic: openstack_ansible_meeting)" | 16:15 | |
| openstack | The meeting name has been set to 'openstack_ansible_meeting' | 16:15 |
| mnaser | sorry, i got caught up in something | 16:15 |
| mnaser | so i think we need to get around the release | 16:16 |
| mnaser | ifeel like everything is probably okay enough right now | 16:16 |
| guilhermesp | o/ | 16:16 |
| guilhermesp | what is the status of the release? I think noonedeadpunk was working on that while ago? | 16:17 |
| jrosser | o/ | 16:18 |
| mnaser | noonedeadpunk: is out on vacation :) | 16:18 |
| guilhermesp | oh good for him :) | 16:18 |
| mnaser | but i think evrardjp is around. i think jrosser covered a bunch of stuff | 16:18 |
| jrosser | i did i pile of digging on the master branch sha bump | 16:19 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/ansible-config_template master: Add option to use a remote source https://review.opendev.org/669758 | 16:19 |
| *** altlogbot_0 has joined #openstack-ansible | 16:19 | |
| jrosser | and seems we pull in a pinned version of requirements, and that (is/was) what was breaking us on master | 16:19 |
| *** vnogin has quit IRC | 16:20 | |
| *** hamzaachi has quit IRC | 16:20 | |
| mnaser | jrosser: we should probably use master in master but i was thinking for stable/stein | 16:20 |
| * jrosser rechecks https://review.opendev.org/#/c/668328/1 | 16:22 | |
| jrosser | the infra mirrors were a bit fubar so lets see if thats better now | 16:22 |
| *** altlogbot_0 has quit IRC | 16:23 | |
| jrosser | theres another thing i wanted to bring up - the lack of haproxy in our metal jobs leaves us exposed to error | 16:23 |
| *** hamzaachi has joined #openstack-ansible | 16:23 | |
| *** irclogbot_0 has joined #openstack-ansible | 16:23 | |
| jrosser | having the ssl & self signed cert there with haproxy catches all sorts of endpoint misconfiguration stuff, and we merged a patch with that wrong recently | 16:24 |
| *** vnogin has joined #openstack-ansible | 16:24 | |
| mnaser | jrosser: yeah.. that is something we can fix though | 16:25 |
| mnaser | by pretty much listening on the right interface | 16:25 |
| mnaser | instead of 0.0.0.0 | 16:25 |
| jrosser | indeed - theres a port conflict iirc? | 16:25 |
| mnaser | thats how we do it at least | 16:25 |
| mnaser | yeah, pretty much haproxy will listen on vip:x and services listen on mgmt:x | 16:26 |
| mnaser | that eliminates that issue | 16:26 |
| guilhermesp | yeah I think there was some work in the past with this. Or I did a workaround locally in a deployment but didn't have time to patch this in osa | 16:27 |
| guilhermesp | that's is also a blocker for deployer who wants to not deploy on lxc | 16:27 |
| *** irclogbot_0 has quit IRC | 16:27 | |
| jrosser | if theres a simple fix then thats would be good, we need the tests to fail when the endpoints are setup badly | 16:28 |
| jrosser | other things - still not much more progress on ansible 2.8 , it's still stuck with tempest failing object storage tests | 16:30 |
| mnaser | right | 16:33 |
| mnaser | so ill watch 668328 (and if others can too please) | 16:33 |
| mnaser | and once that merges we push an rc and hopefully thats the end of it | 16:33 |
| mnaser | :( | 16:33 |
| * guilhermesp watching too | 16:33 | |
| jrosser | also new elk stuff on the go to | 16:34 |
| jrosser | we pushed a first cut of elk_metrics_7x today if anyone wants to get stuck in with that | 16:34 |
| *** cshen has quit IRC | 16:35 | |
| *** goldyfruit has quit IRC | 16:35 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-ops master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/657225 | 16:36 |
| *** rpittau is now known as rpittau|afk | 16:37 | |
| *** luksky11 has quit IRC | 16:39 | |
| evrardjp | hey | 16:39 |
| evrardjp | sorry catching up | 16:39 |
| *** spatel has quit IRC | 16:41 | |
| evrardjp | well I think we don't need haproxy for aio | 16:41 |
| evrardjp | metal | 16:41 |
| evrardjp | but I agree there is a coverage gap | 16:41 |
| evrardjp | but that was supposed to be covered by lxc deploys | 16:41 |
| evrardjp | for the releases I am just back from holidays, I will check the status tomorrow | 16:42 |
| guilhermesp | evrardjp: you mean we don't need to test haproxy on metal or we dont need to have haproxy on metal deployments? | 16:42 |
| evrardjp | the latter, assuming a well architected cloud, which also mean the former | 16:43 |
| evrardjp | but I agree, it could be nice to have haproxy coverage too | 16:43 |
| evrardjp | I just think this could be done using a different test that covers other things | 16:44 |
| evrardjp | (multinode) | 16:44 |
| evrardjp | my idea (long ago!) was to have the user stories of our documentation, gated. | 16:45 |
| jrosser | right now we don't run any lxc jobs for role tests | 16:45 |
| evrardjp | so aio/multinode would be tested | 16:45 |
| evrardjp | jrosser: none at all? | 16:46 |
| evrardjp | like we don't have our specific scenarios anymore for galera and others? | 16:46 |
| jrosser | https://review.opendev.org/#/c/669615/ | 16:46 |
| evrardjp | I think we need to convert the old scenarios to the new world asap | 16:46 |
| *** cshen has joined #openstack-ansible | 16:47 | |
| evrardjp | how did the first one work? I am curious | 16:48 |
| jrosser | i'm still thinking we should have haproxy generally, because a mix of https & http is what everyone is doing in a real deploy, from AIO up | 16:48 |
| jrosser | i expect it connected to the wrong endpoint, which was http, and therefore it worked | 16:48 |
| jrosser | but in real life that would have been https and fails | 16:48 |
| evrardjp | I see | 16:48 |
| evrardjp | I don't have the cycles to add haproxy to the metal job | 16:49 |
| evrardjp | but I guess it's a question of whether we should do that or not | 16:49 |
| evrardjp | (in case not, what other job will we create to cover this use case?) | 16:49 |
| *** cshen has quit IRC | 16:51 | |
| *** spatel has joined #openstack-ansible | 16:58 | |
| *** altlogbot_2 has joined #openstack-ansible | 16:59 | |
| *** udesale has quit IRC | 17:00 | |
| *** vnogin has quit IRC | 17:01 | |
| *** altlogbot_2 has quit IRC | 17:05 | |
| *** irclogbot_0 has joined #openstack-ansible | 17:09 | |
| mnaser | uh haproxy makes a lot of sense in aio metal tbh | 17:10 |
| mnaser | you dont want ssl happening inside services | 17:10 |
| evrardjp | haproxy makes sense in metal cases, I agree, but AIO... meh? | 17:11 |
| evrardjp | but I won't say no to those patches :) | 17:12 |
| evrardjp | I just don't have the bw | 17:12 |
| *** irclogbot_0 has quit IRC | 17:13 | |
| jrosser | It’s makes sense in AIO metal because that’s what we base a ton of our tests on | 17:14 |
| mnaser | yeah, i think they are necessary imho, but i've been pretty overwhelmed personally. | 17:14 |
| mnaser | i am hoping some welcome hhelp soon | 17:14 |
| mnaser | #endmeeting | 17:14 |
| *** openstack changes topic to "Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: http://bit.ly/2xA1eZC" | 17:14 | |
| openstack | Meeting ended Tue Jul 9 17:14:53 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 17:14 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-07-09-16.15.html | 17:14 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-07-09-16.15.txt | 17:14 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-07-09-16.15.log.html | 17:14 |
| jrosser | mnaser: if you already know what needs doing with the listening ports i may be able to give this a look | 17:15 |
| mnaser | guilhermesp: has a bunch of the stuff that we use, it's pretty much just listening to ansible_default_ipv4.address instead of 0.0.0.0 | 17:15 |
| mnaser | the issue however when i tried bringing that up once was i was told that because of our fancy network stuff, that's not necessary the 'local ip' | 17:15 |
| mnaser | so there needs to be some introspection to determine the *real* management_ip | 17:15 |
| mnaser | which we actually do in the os_neutron role afaik | 17:16 |
| mnaser | jrosser: https://github.com/openstack/openstack-ansible/blob/master/playbooks/common-playbooks/neutron.yml#L29-L32 | 17:17 |
| mnaser | something similar to that i guess | 17:17 |
| spatel | jrosser: i am still struggling with "rsyslog_client_all_log_files" condition | 17:20 |
| spatel | jrosser: check this out - https://bugs.launchpad.net/openstack-ansible/+bug/1648490 | 17:23 |
| openstack | Launchpad bug 1648490 in openstack-ansible "rsyslog_client: configuration file doesn't get written" [Undecided,Fix released] - Assigned to Logan V (loganv) | 17:23 |
| mnaser | spatel: contributions and fixes welcome :) | 17:25 |
| mnaser | logan-: btw check out this work that cloudnull has been doing, it might be good in thinking how we wanna approach the whole smart sources -- https://review.opendev.org/#/c/669758/4 | 17:25 |
| jrosser | spatel: I’ve shown you where the co diction makes the task skipped, the best thing to do now is start adding debug to the ansible | 17:26 |
| jrosser | spatel: I’m not doing any rsyslog myself so don’t have an immediate thing to compare with | 17:26 |
| spatel | i have very short time so thinking i can write own rsyslog module and push out to all container to get logs rolling out. | 17:27 |
| spatel | I have already spent enough time to debug octavia and lost 2 weeks :( | 17:28 |
| spatel | i think i can live with some hack for now and later test more stuff when i have time. my customer waiting to launch and can't keep them on hold because of this syslog bug | 17:29 |
| evrardjp | mnaser: jrosser alternatively, we could just decide that for gates we override the interface <software> listens to | 17:29 |
| evrardjp | I am off now | 17:29 |
| evrardjp | ttyl | 17:29 |
| logan- | mnaser: yep that could be useful indeed. thanks. have not made progress on that over the last week due to holidays but hoping to work on it this week :) | 17:30 |
| mnaser | logan-: yeah no worries, just thought that'd come in handy! | 17:31 |
| *** gyee has joined #openstack-ansible | 17:39 | |
| jrosser | This unbreaks the ops repo tests https://review.opendev.org/#/c/657225/ | 17:45 |
| *** hamzy has quit IRC | 17:47 | |
| *** hamzy has joined #openstack-ansible | 17:52 | |
| *** poopcat has joined #openstack-ansible | 18:04 | |
| *** electrofelix has quit IRC | 18:08 | |
| *** luksky11 has joined #openstack-ansible | 18:09 | |
| *** BjoernT_ has quit IRC | 18:09 | |
| spatel | jrosser: i think i found issue related rsyslog, if /var/log/<project>/ missing then rsyslog remote client won't get deploy | 18:14 |
| jrosser | Right, because it’s searching for log files | 18:14 |
| spatel | in short barbican didn't created /var/log/barbican/barbican.log file ( i am debugging why it didn't created logs file) | 18:14 |
| jrosser | Because it probably all goes to the systemd journal | 18:15 |
| spatel | hmm | 18:15 |
| spatel | any clean way to turn it off ? | 18:15 |
| jrosser | You’ll find that most of the useful stuff you need is in the journals | 18:16 |
| jrosser | Across all the services | 18:16 |
| spatel | i can see all logs going in journal systemctl status barbican.service -l | 18:17 |
| spatel | wish in OSA we can pick which logging method we need instead of having both in place | 18:19 |
| jrosser | contributions welcome, as usual :) | 18:22 |
| spatel | i have to now :) | 18:24 |
| jamesdenton | spatel if it helps, you can filter on service name like this: "journalctl -u cinder-api -f" == "tail -f /var/log/cinder/cinder-api.log" | 18:27 |
| spatel | jamesdenton: i want rsyslog to pump my logs to my ELK | 18:28 |
| spatel | journalctl is great but new tool and very few people use at moment ( atleast in my company ) | 18:29 |
| jamesdenton | gotcha | 18:31 |
| mnaser | jrosser: what do you think if we started using systemd-journald for all of our service logging | 18:32 |
| mnaser | i feel like it would simplify a lot | 18:32 |
| jrosser | It us right though that the logging is abut random across OSA | 18:32 |
| jrosser | mnaser: that would be great | 18:32 |
| jrosser | Like bits of heat have no logging whatsoever right now | 18:33 |
| jrosser | So this generally needs a tidy up | 18:33 |
| mnaser | ya i feel like this would be a good thing | 18:33 |
| mnaser | eliminate /openstack/log or whatever | 18:33 |
| mnaser | eliminate /var/log/<service> | 18:33 |
| mnaser | setup journal logging for all services so you can just check their units | 18:33 |
| mnaser | plus there is some really neat things you can do | 18:33 |
| mnaser | https://docs.openstack.org/oslo.log/3.28.1/journal.html | 18:34 |
| jrosser | It shouldnt be difficult to leverage the elk work to deploy just the beats and push to an existing elasticsearch | 18:34 |
| mnaser | https://docs.openstack.org/oslo.log/3.28.1/journal.html#extra-metadata | 18:34 |
| mnaser | the metadata is so neat | 18:34 |
| mnaser | because it includes all these useful things like request id, projet id, etc | 18:34 |
| mnaser | and you can filter on it too | 18:34 |
| mnaser | i.e. in a metal aio journalctl REQUEST_ID=req-b1903300-77a8-401d-984c-8e7d17e4a15f | 18:34 |
| mnaser | yeah, and if elk picks up that extra metadata, it's super easy to capture that metadata and make filtering easier | 18:35 |
| mnaser | + no more annoying silly multiline regex patterns | 18:35 |
| *** irclogbot_1 has joined #openstack-ansible | 18:35 | |
| jrosser | Imho is we can get > 1 set of eyes on this progress can be >> 1 | 18:36 |
| spatel | i thought osa already using system-journal | 18:36 |
| jrosser | It was like that with the initial elk work | 18:36 |
| spatel | journal keep log in binary data so not sure how to pump them in ELK.. there must be some way to do never thought of it | 18:37 |
| spatel | journalbeat does that | 18:38 |
| jonher | fluentbit can do it i think | 18:38 |
| jonher | https://fluentbit.io/documentation/0.12/input/systemd.html | 18:38 |
| jonher | journalbeat was experimental last i checked it | 18:39 |
| *** irclogbot_1 has quit IRC | 18:39 | |
| jrosser | Journalbeat is now part of the elk stack proper | 18:40 |
| jrosser | again | 18:41 |
| jonher | coolio | 18:41 |
| jrosser | jonher: you know we have elk tooling in openstack-ansible-ops? | 18:43 |
| jonher | i haven't | 18:43 |
| jonher | seen * | 18:43 |
| jrosser | https://github.com/openstack/openstack-ansible-ops/tree/master/elk_metrics_6x | 18:45 |
| *** BjoernT has joined #openstack-ansible | 18:45 | |
| jonher | cool :) | 18:47 |
| *** hamzy has quit IRC | 18:49 | |
| *** hamzy has joined #openstack-ansible | 18:49 | |
| *** Namrata has quit IRC | 18:56 | |
| redkrieg | I've just changed over to using ceph as my backing for glance/cinder and managed to get everything up and running but I notice that I now have a /var/lib/machines setup on my compute that was not there before. the compute (kvm) does not host any service containers. any idea why this would've been created when switching to ceph? | 19:05 |
| *** weifan has joined #openstack-ansible | 19:16 | |
| jrosser | redkrieg: probably again the inventory-manage tool is the best place to start to see whats in which group with the -G flag | 19:18 |
| *** hamzaachi has quit IRC | 19:18 | |
| *** goldyfruit has joined #openstack-ansible | 19:25 | |
| *** andrea15 has quit IRC | 19:43 | |
| *** Bico_Fino has quit IRC | 19:49 | |
| spatel | jrosser: can you check this line - https://github.com/openstack/openstack-ansible-os_magnum/blob/master/tasks/magnum_pre_install.yml#L46 | 19:49 |
| spatel | Why are we using -h option here? | 19:50 |
| spatel | don't you think it should be -d ? | 19:50 |
| spatel | i am debugging why none of service created /var/log/service directory even code is saying create... | 19:51 |
| jrosser | it's testing for the log dir being a symlink | 19:53 |
| spatel | but if there is no directory at all then that code should create one right? | 19:53 |
| spatel | if i am reading correct | 19:54 |
| jrosser | if it is a link the task on line 44 deals with the permissions of the link destination | 19:54 |
| jrosser | otherwise line 56 creates the dir | 19:54 |
| spatel | i have confirmed that /var/log has no symlink or directory exist | 19:55 |
| spatel | let me test that code again with debug | 19:55 |
| jrosser | i have /var/log/magnum in my magnum containers | 19:56 |
| spatel | hmm.. | 19:56 |
| spatel | i must be missed something somewhere | 19:57 |
| jrosser | theres no log file in there though | 19:57 |
| spatel | let me check again | 19:57 |
| spatel | yes you need to add log_file = /var/log/magnum/magnum.log file in magnum.conf file | 19:57 |
| spatel | i have found none of service has that log_file line anymore ( i believe this is because of systemd-journal ) | 19:58 |
| jrosser | well like was discussed earlier converging things toward systemd journal is probably the right thing to be doing | 19:59 |
| jrosser | you can add config overrides for any of this to change the log settings | 20:00 |
| spatel | yup! i am trying to add some if then else to get both version available if we need. | 20:00 |
| spatel | so i can turn off/on rsyslog or systemd-journal if i need | 20:00 |
| spatel | stopping system-journal should be enough on all container right ? | 20:03 |
| spatel | also systemd-socket | 20:03 |
| spatel | i don't want stuff get duplicate and start filling disk | 20:04 |
| *** ivve has quit IRC | 20:06 | |
| spatel | jrosser: did you notice magnum-conductor eating up lots of CPU | 20:08 |
| spatel | even its fresh deployment | 20:08 |
| spatel | i wonder i may need to reduce number of threads | 20:09 |
| jrosser | depends what huge means, maybe 15% of one cpu for me | 20:09 |
| spatel | in top i am seeing 11% for magum-conductor | 20:10 |
| spatel | without any workload with fresh installed box | 20:10 |
| spatel | http://paste.openstack.org/show/754236/ <-- here is the TOP output | 20:11 |
| spatel | not sure if its normal behavior or something crazy going on | 20:12 |
| jrosser | perhaps something to take up with the magnum folks | 20:12 |
| spatel | yup.. i will poke them | 20:12 |
| *** hamzaachi has joined #openstack-ansible | 20:21 | |
| *** irclogbot_2 has joined #openstack-ansible | 20:24 | |
| spatel | jrosser: if i want to submit patch how do i submit? sorry asking stupid question because i have never done that before.. do i just commit them in github role or there are different process? | 20:24 |
| jonher | spatel: https://docs.openstack.org/tripleo-docs/latest/contributor/contributions.html | 20:25 |
| jonher | https://wiki.openstack.org/wiki/How_To_Contribute * | 20:26 |
| jonher | that was for tripleo but it takes you to ^ | 20:26 |
| jrosser | this is useful too https://docs.openstack.org/infra/manual/developers.html | 20:27 |
| jonher | but what you probably want is https://docs.openstack.org/contributors/common/git.html and https://docs.openstack.org/contributors/common/setup-gerrit.html | 20:27 |
| *** irclogbot_2 has quit IRC | 20:27 | |
| jonher | yeah that link from jrosser seems to be a better "one-pager" | 20:27 |
| spatel | Thank you folks, bookmarking them | 20:28 |
| spatel | so every patch of commit will go through ci-cd pipeline, and who is owner of those servers? rackspace? | 20:30 |
| spatel | for OSAD | 20:30 |
| openstackgerrit | Merged openstack/openstack-ansible-ops master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/657225 | 20:32 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-ops master: Config updates for elk 7.x https://review.opendev.org/669852 | 20:32 |
| *** hamzy has quit IRC | 20:37 | |
| jonher | spatel: ci-cd is distributed https://docs.openstack.org/infra/system-config/contribute-cloud.html https://opendev.org/openstack/project-config/src/branch/master/nodepool | 20:39 |
| spatel | jrosser: but that is for openstack project related right? | 20:41 |
| spatel | what about openstack-ansible related cimmits? | 20:41 |
| jrosser | it's all the same | 20:41 |
| spatel | commit* | 20:41 |
| jrosser | openstack-ansible is an official project of openstack | 20:41 |
| spatel | oh! | 20:41 |
| jonher | https://governance.openstack.org/tc/reference/projects/ | 20:42 |
| spatel | i thought openstack-ansible run and managed by Rackspace folks.. | 20:42 |
| jrosser | see here https://www.openstack.org/software/project-navigator/deployment-tools | 20:42 |
| spatel | now it make sense :) | 20:42 |
| *** BjoernT_ has joined #openstack-ansible | 20:43 | |
| *** BjoernT has quit IRC | 20:44 | |
| spatel | lets say if i submit patch in OSA and it will go through review and then commit will run ci-cd job to deploy and test code with AIO deployment on those servers right? | 20:44 |
| spatel | that is how code get verify, am i missing anything ? | 20:45 |
| jrosser | click the link in the irc topic.... http://bit.ly/2xA1eZC | 20:45 |
| jrosser | thats all the patches that people have created against the OSA repos (ish) | 20:45 |
| spatel | ah! | 20:46 |
| jrosser | you can serch in there by contributor, or repo, or commit-id and so on | 20:47 |
| jrosser | as an example here is the activity for the OSA octavia role https://review.opendev.org/#/q/project:openstack/openstack-ansible-os_octavia | 20:47 |
| *** ansmith has quit IRC | 20:48 | |
| spatel | I can see in Zuul where you can see if you patch failed or success.. | 20:48 |
| jrosser | so like here https://review.opendev.org/#/c/669870/ | 20:49 |
| jrosser | then you can click the individual tests, and navigate through the logs | 20:49 |
| jrosser | and there are two sets of ARA data linked in there | 20:49 |
| jrosser | like this http://logs.openstack.org/70/669870/1/check/openstack-ansible-deploy-aio_metal_octavia-centos-7/b5f0e95/logs/ara-report/ | 20:49 |
| jrosser | so you submit your patch, and use the log collection / ara and so on to figure out what broke, then re-submit until the tests pass | 20:50 |
| spatel | damn.. this is awesome! i didn't know lots of science going on behind single commit :) | 20:51 |
| jrosser | you can watch progress in real time here http://zuul.openstack.org/status | 20:52 |
| jrosser | even watch the console of the individual jobs | 20:52 |
| spatel | hmm! is Juul is nothing but alternative of Jenkins right? | 20:55 |
| spatel | and better version of jenkins i believe | 20:56 |
| openstackgerrit | Merged openstack/openstack-ansible stable/stein: Bump SHAs for stable/stein https://review.opendev.org/668328 | 20:57 |
| jrosser | mnaser: ^^^ release release release! | 20:59 |
| openstackgerrit | Antony Messerli proposed openstack/openstack-ansible-ops master: Correct opendev.org urls https://review.opendev.org/669947 | 21:03 |
| redkrieg | will that be 19.0.0? | 21:10 |
| spatel | I am running 19.0.0.0rc3 ( if this new release has goodness i would get that rollout) | 21:12 |
| *** irclogbot_1 has joined #openstack-ansible | 21:14 | |
| *** pcaruana has quit IRC | 21:19 | |
| *** irclogbot_1 has quit IRC | 21:19 | |
| *** goldyfruit has quit IRC | 21:20 | |
| *** weifan has quit IRC | 21:21 | |
| *** weifan has joined #openstack-ansible | 21:21 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-ops master: Config updates for elk 7.x https://review.opendev.org/669852 | 21:24 |
| *** weifan has quit IRC | 21:26 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_tempest master: Update distro package names for openSUSE Leap 15.1 https://review.opendev.org/667302 | 21:28 |
| *** irclogbot_2 has joined #openstack-ansible | 21:38 | |
| mnaser | jrosser: woot woot woot woot | 21:38 |
| mnaser | evrardjp: think you can push out a final rc? :'( | 21:40 |
| openstackgerrit | Merged openstack/openstack-ansible-os_cinder master: Fixed typo in cinder_glance_api_servers endpoint https://review.opendev.org/669613 | 21:43 |
| *** irclogbot_2 has quit IRC | 21:43 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-ops master: Duplicate of elk_metrics_6x to elk_metrics_7x https://review.opendev.org/669851 | 21:44 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-ops master: Config updates for elk 7.x https://review.opendev.org/669852 | 21:44 |
| *** BjoernT_ has quit IRC | 21:52 | |
| *** irclogbot_2 has joined #openstack-ansible | 21:54 | |
| *** altlogbot_3 has joined #openstack-ansible | 21:54 | |
| *** altlogbot_3 has quit IRC | 21:55 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-ops master: Config updates for elk 7.x https://review.opendev.org/669852 | 21:58 |
| *** irclogbot_2 has quit IRC | 21:59 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova master: Install netcat on compute hosts https://review.opendev.org/666759 | 22:00 |
| *** weifan has joined #openstack-ansible | 22:10 | |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-os_nova stable/stein: Install netcat on compute hosts https://review.opendev.org/669953 | 22:10 |
| *** luksky11 has quit IRC | 22:12 | |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-os_nova stable/rocky: Install netcat on compute hosts https://review.opendev.org/669954 | 22:12 |
| *** tosky has quit IRC | 22:18 | |
| *** weifan has quit IRC | 22:19 | |
| *** spatel has quit IRC | 22:22 | |
| *** goldyfruit has joined #openstack-ansible | 22:28 | |
| *** hamzaachi has quit IRC | 22:37 | |
| *** altlogbot_1 has joined #openstack-ansible | 22:44 | |
| *** weifan has joined #openstack-ansible | 22:45 | |
| *** altlogbot_1 has quit IRC | 22:49 | |
| *** ansmith has joined #openstack-ansible | 22:53 | |
| *** goldyfruit has quit IRC | 23:14 | |
| *** weifan has quit IRC | 23:17 | |
| *** weifan has joined #openstack-ansible | 23:22 | |
| *** hamzy has joined #openstack-ansible | 23:59 | |
| *** kplant has quit IRC | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!