| *** fabiog1901 has quit IRC | 00:17 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: WIP - Use haproxy for metal deployments https://review.opendev.org/733408 | 00:19 |
|---|---|---|
| *** spatel has quit IRC | 00:43 | |
| noonedeadpunk | Any extra vote on this? https://review.opendev.org/#/c/733354/1 | 00:52 |
| *** gyee has quit IRC | 01:26 | |
| *** cshen has joined #openstack-ansible | 01:41 | |
| *** cshen has quit IRC | 01:47 | |
| *** also_stingrayza has joined #openstack-ansible | 01:49 | |
| *** stingrayza has quit IRC | 01:52 | |
| *** cshen has joined #openstack-ansible | 03:42 | |
| *** cshen has quit IRC | 03:47 | |
| *** rh-jelabarre has quit IRC | 03:52 | |
| openstackgerrit | Merged openstack/openstack-ansible-repo_server stable/ussuri: add missing quote to lsyncd.lua template https://review.opendev.org/733418 | 03:53 |
| openstackgerrit | Merged openstack/openstack-ansible-os_ceilometer stable/train: Make user provided content deployable https://review.opendev.org/733354 | 04:10 |
| *** evrardjp has quit IRC | 04:33 | |
| *** evrardjp has joined #openstack-ansible | 04:33 | |
| *** cshen has joined #openstack-ansible | 05:01 | |
| *** cshen has quit IRC | 05:05 | |
| *** cshen has joined #openstack-ansible | 05:07 | |
| *** Muran has quit IRC | 05:27 | |
| *** Muran has joined #openstack-ansible | 05:28 | |
| *** Muran has quit IRC | 05:32 | |
| *** udesale has joined #openstack-ansible | 05:36 | |
| AJaeger | So, https://review.opendev.org/733391 passes for ansible-hardening to unblock the syncing. Please review. | 05:46 |
| openstackgerrit | Merged openstack/openstack-ansible-rsyslog_server master: Updated from OpenStack Ansible Tests https://review.opendev.org/733375 | 06:01 |
| openstackgerrit | Merged openstack/ansible-config_template master: Updated from OpenStack Ansible Tests https://review.opendev.org/733376 | 06:01 |
| openstackgerrit | Merged openstack/ansible-role-python_venv_build master: Updated from OpenStack Ansible Tests https://review.opendev.org/733377 | 06:02 |
| openstackgerrit | Merged openstack/ansible-role-systemd_mount master: Updated from OpenStack Ansible Tests https://review.opendev.org/733378 | 06:02 |
| openstackgerrit | Merged openstack/openstack-ansible-os_tempest master: Updated from OpenStack Ansible Tests https://review.opendev.org/733367 | 06:02 |
| openstackgerrit | Merged openstack/ansible-role-systemd_service master: Updated from OpenStack Ansible Tests https://review.opendev.org/733380 | 06:04 |
| openstackgerrit | Merged openstack/ansible-role-systemd_networkd master: Updated from OpenStack Ansible Tests https://review.opendev.org/733379 | 06:05 |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia master: Updated from OpenStack Ansible Tests https://review.opendev.org/733359 | 06:06 |
| openstackgerrit | Merged openstack/openstack-ansible-rsyslog_client master: Updated from OpenStack Ansible Tests https://review.opendev.org/733374 | 06:06 |
| openstackgerrit | Merged openstack/openstack-ansible-rabbitmq_server master: Updated from OpenStack Ansible Tests https://review.opendev.org/733372 | 06:06 |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova master: Updated from OpenStack Ansible Tests https://review.opendev.org/733358 | 06:07 |
| openstackgerrit | Merged openstack/openstack-ansible-plugins master: Updated from OpenStack Ansible Tests https://review.opendev.org/733371 | 06:07 |
| openstackgerrit | Merged openstack/openstack-ansible-ops master: Updated from OpenStack Ansible Tests https://review.opendev.org/733333 | 06:07 |
| openstackgerrit | Merged openstack/openstack-ansible-os_swift master: Updated from OpenStack Ansible Tests https://review.opendev.org/733365 | 06:07 |
| openstackgerrit | Merged openstack/openstack-ansible-os_tacker master: Updated from OpenStack Ansible Tests https://review.opendev.org/733366 | 06:07 |
| openstackgerrit | Merged openstack/openstack-ansible-os_gnocchi master: Updated from OpenStack Ansible Tests https://review.opendev.org/733345 | 06:08 |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron master: Updated from OpenStack Ansible Tests https://review.opendev.org/733356 | 06:08 |
| openstackgerrit | Merged openstack/openstack-ansible-os_murano master: Updated from OpenStack Ansible Tests https://review.opendev.org/733355 | 06:09 |
| openstackgerrit | Merged openstack/openstack-ansible-os_ironic master: Updated from OpenStack Ansible Tests https://review.opendev.org/733348 | 06:09 |
| openstackgerrit | Merged openstack/openstack-ansible-os_blazar master: Updated from OpenStack Ansible Tests https://review.opendev.org/733336 | 06:09 |
| openstackgerrit | Merged openstack/openstack-ansible-os_zun master: Updated from OpenStack Ansible Tests https://review.opendev.org/733370 | 06:10 |
| openstackgerrit | Merged openstack/openstack-ansible-os_masakari master: Updated from OpenStack Ansible Tests https://review.opendev.org/733351 | 06:10 |
| openstackgerrit | Merged openstack/openstack-ansible-os_rally master: Updated from OpenStack Ansible Tests https://review.opendev.org/733363 | 06:10 |
| openstackgerrit | Merged openstack/openstack-ansible-repo_server master: Updated from OpenStack Ansible Tests https://review.opendev.org/733373 | 06:11 |
| openstackgerrit | Merged openstack/openstack-ansible-os_congress master: Updated from OpenStack Ansible Tests https://review.opendev.org/733341 | 06:11 |
| openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts master: Updated from OpenStack Ansible Tests https://review.opendev.org/733330 | 06:11 |
| openstackgerrit | Merged openstack/openstack-ansible-os_aodh master: Updated from OpenStack Ansible Tests https://review.opendev.org/733334 | 06:11 |
| openstackgerrit | Merged openstack/openstack-ansible-os_heat master: Updated from OpenStack Ansible Tests https://review.opendev.org/733346 | 06:12 |
| openstackgerrit | Merged openstack/openstack-ansible-os_mistral master: Updated from OpenStack Ansible Tests https://review.opendev.org/733353 | 06:12 |
| openstackgerrit | Merged openstack/openstack-ansible-os_designate master: Updated from OpenStack Ansible Tests https://review.opendev.org/733342 | 06:12 |
| openstackgerrit | Merged openstack/openstack-ansible-nspawn_hosts master: Updated from OpenStack Ansible Tests https://review.opendev.org/733329 | 06:12 |
| openstackgerrit | Merged openstack/openstack-ansible-os_sahara master: Updated from OpenStack Ansible Tests https://review.opendev.org/733364 | 06:13 |
| openstackgerrit | Merged openstack/openstack-ansible-nspawn_container_create master: Updated from OpenStack Ansible Tests https://review.opendev.org/733328 | 06:13 |
| openstackgerrit | Merged openstack/openstack-ansible-os_cloudkitty master: Updated from OpenStack Ansible Tests https://review.opendev.org/733340 | 06:13 |
| openstackgerrit | Merged openstack/openstack-ansible-os_placement master: Updated from OpenStack Ansible Tests https://review.opendev.org/733362 | 06:13 |
| openstackgerrit | Merged openstack/openstack-ansible-os_barbican master: Updated from OpenStack Ansible Tests https://review.opendev.org/733335 | 06:13 |
| openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts master: Updated from OpenStack Ansible Tests https://review.opendev.org/733326 | 06:13 |
| openstackgerrit | Merged openstack/openstack-ansible-lxc_container_create master: Updated from OpenStack Ansible Tests https://review.opendev.org/733325 | 06:14 |
| openstackgerrit | Merged openstack/openstack-ansible-os_trove master: Updated from OpenStack Ansible Tests https://review.opendev.org/733368 | 06:14 |
| openstackgerrit | Merged openstack/openstack-ansible-haproxy_server master: Updated from OpenStack Ansible Tests https://review.opendev.org/733324 | 06:14 |
| openstackgerrit | Merged openstack/openstack-ansible-galera_client master: Updated from OpenStack Ansible Tests https://review.opendev.org/733321 | 06:14 |
| openstackgerrit | Merged openstack/openstack-ansible-os_keystone master: Updated from OpenStack Ansible Tests https://review.opendev.org/733350 | 06:14 |
| openstackgerrit | Merged openstack/openstack-ansible-os_ceilometer master: Updated from OpenStack Ansible Tests https://review.opendev.org/733338 | 06:14 |
| *** miloa has joined #openstack-ansible | 06:14 | |
| openstackgerrit | Merged openstack/openstack-ansible-memcached_server master: Updated from OpenStack Ansible Tests https://review.opendev.org/733327 | 06:14 |
| openstackgerrit | Merged openstack/openstack-ansible-os_cinder master: Updated from OpenStack Ansible Tests https://review.opendev.org/733339 | 06:15 |
| openstackgerrit | Merged openstack/openstack-ansible-openstack_openrc master: Updated from OpenStack Ansible Tests https://review.opendev.org/733332 | 06:16 |
| openstackgerrit | Merged openstack/openstack-ansible-apt_package_pinning master: Updated from OpenStack Ansible Tests https://review.opendev.org/733320 | 06:16 |
| openstackgerrit | Merged openstack/openstack-ansible-os_glance master: Updated from OpenStack Ansible Tests https://review.opendev.org/733344 | 06:17 |
| openstackgerrit | Merged openstack/openstack-ansible-os_horizon master: Updated from OpenStack Ansible Tests https://review.opendev.org/733347 | 06:17 |
| openstackgerrit | Merged openstack/openstack-ansible-galera_server master: Updated from OpenStack Ansible Tests https://review.opendev.org/733323 | 06:18 |
| openstackgerrit | Merged openstack/openstack-ansible-os_panko master: Updated from OpenStack Ansible Tests https://review.opendev.org/733360 | 06:19 |
| *** redrobot has quit IRC | 06:39 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_keystone master: DNM - test using the utility host for db setup tasks https://review.opendev.org/733443 | 06:41 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: WIP - Use haproxy for metal deployments https://review.opendev.org/733408 | 06:42 |
| jrosser | noonedeadpunk: i wasn't quite sure how we left the details of using utility for db setup so this https://review.opendev.org/#/c/733443/ is somewhere that comments can go | 06:45 |
| jrosser | it should also get validated with 733408 | 06:45 |
| *** gshippey has quit IRC | 06:51 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_tempest stable/stein: Pin telemetry-tempest-plugin to 0.4.0 for python2 compatibility. https://review.opendev.org/733449 | 06:53 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_ceilometer stable/stein: Make user provided content deployable https://review.opendev.org/733387 | 06:53 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-repo_server master: Bind services to mgmt network addresses https://review.opendev.org/733385 | 06:55 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-repo_server master: Restart rsyncd if the configuration file is changed https://review.opendev.org/733451 | 07:00 |
| *** cshen has quit IRC | 07:19 | |
| *** dpaclt has joined #openstack-ansible | 07:21 | |
| openstackgerrit | Andreas Jaeger proposed openstack/ansible-hardening master: Updated from OpenStack Ansible Tests https://review.opendev.org/671840 | 07:23 |
| openstackgerrit | Andreas Jaeger proposed openstack/ansible-hardening master: Use newer openstackdocstheme and reno versions https://review.opendev.org/733203 | 07:23 |
| AJaeger | now all rebased nicely ^ | 07:23 |
| dpaclt | Hi All When creating cluster getting create in Progress at kube_cluster_deploy OS::Heat::SoftwareDeployment and finaly getting timed out error. | 07:25 |
| *** tosky has joined #openstack-ansible | 07:46 | |
| *** jawad_axd has joined #openstack-ansible | 07:48 | |
| *** rpittau|afk is now known as rpittau | 07:50 | |
| *** cshen has joined #openstack-ansible | 07:52 | |
| *** cshen has quit IRC | 07:56 | |
| *** cshen has joined #openstack-ansible | 07:58 | |
| *** cshen has quit IRC | 08:03 | |
| janno | regarding my issue from yesterday: migrating the volumes from host rbd:volumes@volumes_hdd to cluster ceph@volumes_hdd and deleting the stale service did the trick | 08:06 |
| *** cshen has joined #openstack-ansible | 08:08 | |
| *** yolanda has joined #openstack-ansible | 08:12 | |
| *** cshen has quit IRC | 08:12 | |
| jrosser | janno: do you think there is anything more we can do to make this less difficult? maybe check that the cinder backends are all up before trying the migration? | 08:20 |
| *** itandops has joined #openstack-ansible | 08:21 | |
| janno | jrosser: yeah, maybe checking if all backends are up before starting the migration would be helpful | 08:22 |
| jrosser | i wonder if it robust enough just to check for "down" in the output of cinder service-list | 08:24 |
| openstackgerrit | Merged openstack/openstack-ansible-specs master: Updated from OpenStack Ansible Tests https://review.opendev.org/677372 | 08:25 |
| jrosser | guarantees someone has 'down' in their hostname for cinder-volume i guess :) | 08:25 |
| *** itandops has quit IRC | 08:28 | |
| *** cshen has joined #openstack-ansible | 08:28 | |
| *** itandops_ has joined #openstack-ansible | 08:31 | |
| *** itandops_ has quit IRC | 08:31 | |
| janno | what would be the best way to check this? having a command returning true or false if not all services are ok? | 08:31 |
| *** itandops has joined #openstack-ansible | 08:32 | |
| *** also_stingrayza is now known as stingrayza | 08:32 | |
| openstackgerrit | Merged openstack/openstack-ansible-ceph_client master: Updated from OpenStack Ansible Tests https://review.opendev.org/730201 | 08:33 |
| *** cshen has quit IRC | 08:33 | |
| janno | /openstack/venvs/cinder-19.1.1/bin/cinder-manage service list | awk '{print $5}' | egrep -v "State|:-)" | 08:41 |
| janno | if there is anything not in state ":-)" egrep will return 0 otherwise 1 | 08:42 |
| janno | I am not sure if disabled services have to be considered separately. | 08:44 |
| *** cshen has joined #openstack-ansible | 08:48 | |
| janno | alternative: /openstack/venvs/cinder-19.1.1/bin/cinder-manage service list | awk '{if(NR>1)print}' | egrep -v ":-)" | 08:49 |
| jrosser | hmm wanst your paste "up vs down" https://pastebin.com/HdsS8478 | 08:51 |
| janno | Forget the last one. I meant this: /openstack/venvs/cinder-19.1.1/bin/cinder-manage service list | awk '{if(NR>1)print $5}' | egrep -v ":-)" | 08:52 |
| *** cshen has quit IRC | 08:53 | |
| *** cshen has joined #openstack-ansible | 08:55 | |
| *** itandops has quit IRC | 08:57 | |
| *** itandops has joined #openstack-ansible | 08:57 | |
| *** cshen has quit IRC | 09:00 | |
| noonedeadpunk | jrosser: you're an early bird | 09:00 |
| janno | it depends which tool you use. the paste was from "cinder service-list". there you have up and down | 09:00 |
| janno | if you use cinder-manage, it is ":-)" vs "XXX" | 09:01 |
| jrosser | noonedeadpunk: yeah, awake too early today :( | 09:01 |
| jrosser | mariadb 10.4 patch seems a bit unwilling to merge | 09:02 |
| noonedeadpunk | yeah, saw that. Btw it deployed yestarday ok on prod env.. | 09:06 |
| noonedeadpunk | seems that check I've done is still a bit unreliable... | 09:07 |
| jrosser | i looked at the failing check and the IP it wants was missing from the list | 09:08 |
| jrosser | maybe it's not waiting long enough for all to join the cluster? | 09:08 |
| *** cshen has joined #openstack-ansible | 09:08 | |
| noonedeadpunk | Yeah, I think that's the case... Like I added extra task here https://review.opendev.org/#/c/717830/36/tests/test-galera-server-functional.yml and was suggesting it should work. | 09:09 |
| noonedeadpunk | was trying other status from wsrep_% but they didnt seem to resolve issue as well | 09:10 |
| noonedeadpunk | just thinking about adding sleep 10 or smth like this lol | 09:11 |
| *** cshen has quit IRC | 09:13 | |
| janno | I think the output of cinder-manage would be easier to parse than the one from cinder service-list | 09:15 |
| janno | besides this cinder-manage is available in the cinder container, cinder is not | 09:17 |
| janno | nevermind, it is | 09:18 |
| jrosser | janno: this is probably something that we'd delegate to the utility host | 09:24 |
| janno | ok | 09:25 |
| janno | so "cinder service-list" would be the way to go? | 09:27 |
| jrosser | janno: i think you are right, it should go on the cinder host just here https://github.com/openstack/openstack-ansible-os_cinder/blob/master/tasks/cinder_db_sync.yml#L22 | 09:33 |
| jrosser | right before the migrations | 09:33 |
| jrosser | everything is already setup to run that on the right host | 09:34 |
| *** udesale has quit IRC | 09:39 | |
| *** udesale has joined #openstack-ansible | 09:49 | |
| *** andrea10 has joined #openstack-ansible | 09:56 | |
| *** andrea15 has quit IRC | 09:56 | |
| *** rpittau is now known as rpittau|bbl | 10:02 | |
| janno | Shall I try to write a task for this? | 10:08 |
| *** cshen has joined #openstack-ansible | 10:13 | |
| *** cshen has quit IRC | 10:18 | |
| *** cshen has joined #openstack-ansible | 10:18 | |
| *** cshen has quit IRC | 10:22 | |
| jamesdenton | mornin | 10:23 |
| *** fghaas has joined #openstack-ansible | 10:23 | |
| jamesdenton | noonedeadpunk have time for a quick vote on https://review.opendev.org/#/c/733169/? | 10:23 |
| *** fghaas has left #openstack-ansible | 10:24 | |
| openstackgerrit | James Denton proposed openstack/openstack-ansible master: Add integrated test for Ubuntu Bionic using ML2/OVN driver https://review.opendev.org/733017 | 10:46 |
| *** stingrayza has quit IRC | 10:51 | |
| *** cshen has joined #openstack-ansible | 11:03 | |
| *** mgariepy has quit IRC | 11:06 | |
| *** cshen has quit IRC | 11:07 | |
| *** udesale_ has joined #openstack-ansible | 11:08 | |
| AJaeger | noonedeadpunk, jamesdenton, could either of you review https://review.opendev.org/733391 and https://review.opendev.org/733203 for ansible-hardening, please? | 11:10 |
| *** udesale has quit IRC | 11:11 | |
| noonedeadpunk | done | 11:12 |
| AJaeger | thanks, noonedeadpunk | 11:18 |
| dpaclt | Hello..Installed Magnum using OSA and When creating cluster only master node got VM is and created and stuck at kube_masters OS::Heat::ResourceGroup .. any suggestions | 11:22 |
| jrosser | dpaclt: you'll need to look through the heat agent logs in the magnum master and minion nodes | 11:31 |
| jrosser | this is a whole big subject in itself "how to make magnum work" unfortunately | 11:32 |
| jrosser | janno: sure - if you can write a task that would be great | 11:32 |
| *** donnyd_ has quit IRC | 11:33 | |
| *** donnyd_ has joined #openstack-ansible | 11:33 | |
| *** donnyd_ has quit IRC | 11:34 | |
| *** rpittau|bbl is now known as rpittau | 11:35 | |
| *** donnyd_ has joined #openstack-ansible | 11:35 | |
| *** donnyd_ has quit IRC | 11:35 | |
| *** donnyd_ has joined #openstack-ansible | 11:36 | |
| *** donnyd_ has quit IRC | 11:36 | |
| dpaclt | jrosser yeah got it .. i can only see http://paste.openstack.org/show/794364/ in heat-container-agent | 11:37 |
| *** rh-jelabarre has joined #openstack-ansible | 11:37 | |
| *** TobbeCN has joined #openstack-ansible | 11:37 | |
| *** donnyd_ has joined #openstack-ansible | 11:42 | |
| *** donnyd_ is now known as donnyd | 11:44 | |
| *** stingrayza has joined #openstack-ansible | 11:48 | |
| *** zbr has left #openstack-ansible | 11:52 | |
| *** cshen has joined #openstack-ansible | 12:03 | |
| openstackgerrit | Merged openstack/ansible-hardening master: Enable syncing of docs https://review.opendev.org/733391 | 12:06 |
| openstackgerrit | Merged openstack/ansible-hardening master: Updated from OpenStack Ansible Tests https://review.opendev.org/671840 | 12:06 |
| openstackgerrit | Merged openstack/ansible-hardening master: Use newer openstackdocstheme and reno versions https://review.opendev.org/733203 | 12:06 |
| *** gshippey has joined #openstack-ansible | 12:06 | |
| AJaeger | \o/ | 12:06 |
| *** TobbeCN has quit IRC | 12:07 | |
| openstackgerrit | Andreas Jaeger proposed openstack/ansible-hardening stable/ussuri: Enable syncing of docs https://review.opendev.org/733571 | 12:07 |
| *** cshen has quit IRC | 12:07 | |
| *** mgariepy has joined #openstack-ansible | 12:08 | |
| openstackgerrit | Andreas Jaeger proposed openstack/ansible-hardening stable/train: Enable syncing of docs https://review.opendev.org/733572 | 12:09 |
| *** cshen has joined #openstack-ansible | 12:22 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron master: Update OVN metadata agent binary name https://review.opendev.org/733169 | 12:23 |
| *** aedc has quit IRC | 12:23 | |
| *** arxcruz has quit IRC | 12:28 | |
| *** arxcruz has joined #openstack-ansible | 12:29 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_keystone master: DNM - test using the utility host for db setup tasks https://review.opendev.org/733443 | 12:30 |
| *** aedc has joined #openstack-ansible | 12:31 | |
| *** ianychoi_ has joined #openstack-ansible | 12:32 | |
| *** waxfire6 has joined #openstack-ansible | 12:33 | |
| *** owalsh_ has joined #openstack-ansible | 12:36 | |
| *** tobberydberg has quit IRC | 12:36 | |
| *** arxcruz has quit IRC | 12:36 | |
| *** owalsh has quit IRC | 12:36 | |
| *** ioni has quit IRC | 12:36 | |
| *** udesale_ has quit IRC | 12:36 | |
| *** kukacz_ has quit IRC | 12:36 | |
| *** zigo has quit IRC | 12:36 | |
| *** waxfire has quit IRC | 12:36 | |
| *** ianychoi has quit IRC | 12:36 | |
| *** yolanda has quit IRC | 12:36 | |
| *** waxfire6 is now known as waxfire | 12:37 | |
| *** arxcruz has joined #openstack-ansible | 12:37 | |
| *** tobberydberg has joined #openstack-ansible | 12:38 | |
| *** yolanda has joined #openstack-ansible | 12:38 | |
| *** ioni has joined #openstack-ansible | 12:41 | |
| *** fghaas has joined #openstack-ansible | 12:43 | |
| *** zigo_ has joined #openstack-ansible | 12:44 | |
| jrosser | i think we are good to go on the collections stuff (leaving tempest for the time being) | 12:48 |
| jrosser | https://review.opendev.org/#/q/topic:osa-collections+(status:open+OR+status:merged) | 12:48 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_masakari stable/train: Drop monitoring of nova-compute process https://review.opendev.org/733601 | 12:52 |
| *** spatel has joined #openstack-ansible | 12:57 | |
| *** sshnaidm is now known as sshnaidm|mtg | 12:59 | |
| *** spatel has quit IRC | 13:00 | |
| *** spatel has joined #openstack-ansible | 13:02 | |
| spatel | morning folks | 13:02 |
| spatel | noonedeadpunk: and mgariepy - i made good progress last time with centOS8 | 13:03 |
| spatel | installed LXC3.0 and not getting stuck to download image | 13:03 |
| spatel | question is are we going to use centOS 7 image or CentOS 8 image for containers? | 13:03 |
| *** Guest10631 has joined #openstack-ansible | 13:04 | |
| *** Guest10631 is now known as redrobot | 13:05 | |
| spatel | currently its pulling centos-7-x86_64-docker.tar.xz image but i didn't find centos-8 image | 13:09 |
| mgariepy | spatel, we would use centos8 ones. | 13:11 |
| mgariepy | https://review.opendev.org/#/c/728108/10/vars/redhat-8.yml | 13:12 |
| spatel | cool.. | 13:12 |
| spatel | Did you guys using ZFS for /var/lib/machine ? | 13:12 |
| spatel | I am using btrfs with all hack way.. which i don't like but i want to keep going to for POC anyway... | 13:13 |
| jrosser | spatel: if you see on that patch there is a "topic", if you click that you can see all the centos-8 related patches here https://review.opendev.org/#/q/topic:osa/el8+(status:open+OR+status:merged) | 13:13 |
| spatel | How do i guys can be sync with your centos8 git repo? | 13:14 |
| spatel | currently i am making change on my local git repo for required changes | 13:14 |
| jrosser | you have to download the patches from gerrit and apply them locally | 13:19 |
| jrosser | top left of each patch use "download" and it will give you a command to paste into your terminal to apply the patch | 13:19 |
| jrosser | thats got to be done for each patch manually | 13:20 |
| *** rpittau is now known as rpittau|brb | 13:24 | |
| mgariepy | as far as hacking to get the btrfs via a random kernel we can't really do that in the gates and i wouldn't want that anyway in production either | 13:26 |
| spatel | mgariepy: totally with you... | 13:33 |
| spatel | question is on my way testing if i want to report thing where i should do that? | 13:34 |
| spatel | or submit patch.. | 13:34 |
| spatel | centos8 doesn't use legacy network-scripts :( what you guys did there? | 13:35 |
| spatel | i install network-scripts for that support | 13:35 |
| jrosser | spatel: for submitting patches see this https://docs.opendev.org/opendev/infra-manual/latest/developers.html | 13:35 |
| jrosser | and this https://docs.opendev.org/opendev/infra-manual/latest/gettingstarted.html#getting-started | 13:36 |
| jrosser | spatel: networking on centos8 is an unhappy place, so for now it is a big mess https://review.opendev.org/#/c/689629/46/tests/roles/bootstrap-host/tasks/prepare_networking.yml | 13:37 |
| jrosser | the thing to spend time on is getting the all-in-one to build, as thats whats tested in the CI | 13:38 |
| jrosser | you should be applying the patches we already have and trying to get it further than those, if you can | 13:38 |
| spatel | jrosser: stupid question do i need to apply each patch individually ? from here https://review.opendev.org/#/q/topic:osa/el8+(status:open+OR+status:merged) | 13:39 |
| jrosser | yes they are all to different repos | 13:39 |
| jrosser | there will be patches to openstack-ansible, then various ones to the roles in /etc/ansible/roles after you have run bootstrap-ansible.sh | 13:39 |
| jrosser | then decide if you are going to work on containerised or bare metal deployment of AIO | 13:40 |
| *** fresta has quit IRC | 13:40 | |
| jrosser | metal will bypass the lxc issues and get you further toward galera, rabbit and the openstack services | 13:40 |
| *** mjwales has joined #openstack-ansible | 13:41 | |
| spatel | jrosser: i think i would like to have LXC because i am running all my cluster with lxc and would like to keep that similar :) | 13:41 |
| jrosser | of course | 13:41 |
| mjwales | Hi, I'm struggling to get my head around the upgrade patch from Xenial to Bionic. Is there a documented way of removing compute and control nodes (both running Ceph) from the cluster so they can be reinstalled with Bionic then added back into the cluster? | 13:42 |
| spatel | jrosser: so you guys pull out master branch (which is 21.x.x.x) and on top of that you guys applying patches right? just making sure | 13:42 |
| jrosser | i am not suggesting you do a metal deploy for production, of you want to contribute patches then those patches need to pass all the tests, lxc, metal, and so on | 13:43 |
| jrosser | master is master, 21.x is ussuri | 13:43 |
| jrosser | for binging up new operating system support it is sometimes easier to do the metal deployment first | 13:43 |
| spatel | jrosser: yes.. because it will cut down one extra layers of virtualization and complex networking | 13:44 |
| jrosser | right | 13:44 |
| spatel | let me try both in my free time. i really want to get CentOS 8 out ASAP :) | 13:45 |
| spatel | i have some deployment coming in future and would like to use latest OS> | 13:45 |
| *** KeithMnemonic has joined #openstack-ansible | 13:46 | |
| openstackgerrit | James Denton proposed openstack/openstack-ansible-ops master: Implements support for OVS+DVR in an MNAIO https://review.opendev.org/715002 | 13:50 |
| AJaeger | so, the docstheme update is fine IMHO - if anybody has time to review the nearly identical changes accross all osa repos, it would be great: https://review.opendev.org/#/q/topic:reno-openstackdocstheme+is:open+(projects:openstack/openstack-ansible+OR+projects:openstack/ansible-) - thanks! | 13:53 |
| *** dpaclt has quit IRC | 13:54 | |
| *** mjwales has quit IRC | 13:54 | |
| *** nsmeds has joined #openstack-ansible | 13:56 | |
| nsmeds | Hey everyone :) If anyone's around, was hoping to get some clarification on "Verify OpenStack-Ansible Cloud" steps of the deployment process. | 13:58 |
| nsmeds | OSA created and configured a number of LXC containers, `infra1_neutron_server_container-638ce5a4` being one of them. Inside of which there are multiple `neutron-server` processes running. | 13:59 |
| nsmeds | Yet from the utility container, when we run `openstack network agent list` we're presented with a list of the physical servers (on which thosoe containers run). Everything reports healthy - but would we not expect to see the neutron containers in this list instead? | 14:00 |
| jamesdenton | so the neutron server is different from the neutron agent(s) | 14:00 |
| jamesdenton | the neutron-server is the api service | 14:00 |
| jamesdenton | the agents are deployed on metal, meaning outside the container | 14:01 |
| *** rpittau|brb is now known as rpittau | 14:01 | |
| nsmeds | Ok - which is exactly what we're seeing. Thanks for clarification. | 14:01 |
| *** sauloasilva has joined #openstack-ansible | 14:05 | |
| sauloasilva | Hi , I am new at channel and I figured out probably a bug at onpenstack-ansible install master brancj on centos7 . How should I report it ? | 14:06 |
| gshippey | https://bugs.launchpad.net/openstack-ansible/+filebug | 14:07 |
| sauloasilva | thanks | 14:07 |
| gshippey | https://bugs.launchpad.net/openstack-ansible you can search through our reported bugs here | 14:08 |
| *** mjwales has joined #openstack-ansible | 14:10 | |
| *** fresta has joined #openstack-ansible | 14:11 | |
| mjwales | be great if someone could offer some guidance on the upgrade path from Xenial to Bionic | 14:12 |
| mgariepy | mjwales, do you have both ceph deamons and openstack service on your hosts ? | 14:13 |
| mjwales | Yes. Control nodes run the manager and monitor along with storage. Compute and storage only | 14:13 |
| mgariepy | there are some notes : https://etherpad.opendev.org/p/osa-rocky-bionic-upgrade | 14:14 |
| mjwales | mgariepy: there seems to be differing advice on whether it is best to do an in-place upgrade or complete reinstall of the OS | 14:14 |
| gshippey | keystone after their break are talking about CI, one of the items on there agenda is potentially dropping OSA for upgrade testing, if anyone wants to join me to see if there is anything we can do you're most welcome https://zoom.us/j/91266780961?pwd=RFVVdHJRRmJtTmYwcDc5RWF0NzRVZz09 @noonedeadpunk | 14:15 |
| mjwales | mgariepy: also came across https://review.opendev.org/#/c/710803/4/doc/source/admin/upgrades/distribution-upgrades.rst | 14:16 |
| * noonedeadpunk joined | 14:16 | |
| mgariepy | mjwales, depends on what you want to do. but you will be deleting all the containers. | 14:17 |
| noonedeadpunk | gshippey: did they use osa for upgrade testing?:) | 14:17 |
| gshippey | according to their etherpad it sounds like it - im not sure what they actually do / how they use it https://etherpad.opendev.org/p/victoria-ptg-keystone | 14:19 |
| mgariepy | the way i do it for the controllers is move all the network stuff away from the node i reinstall, reconfigure the differents services (haproxy, keepalived, galera, rabbit, memcached and then openstack services) | 14:20 |
| mgariepy | you can be gentle and disable the node in haproxy. | 14:20 |
| mjwales | mgariepy: is this documented clearly anywhere? We run an cluster but are 100% not experts so worried we are going to go wrong | 14:21 |
| mgariepy | these are notes about the Trusty > xenail upgrade : https://etherpad.opendev.org/p/osa-newton-xenial-upgrade | 14:21 |
| mgariepy | mjwales, not much more documented than the bits here and there | 14:22 |
| mjwales | mgariepy: that's what we are worried about. It seems like if you do OpenStack every day you can probably muddle through and get it done | 14:23 |
| mgariepy | do you have a testbed that is configured the same way ? | 14:23 |
| mgariepy | mjwales, it's a bit complicated because you do have some choice you make to configure it. like the colocation on ceph and compute etc.. | 14:24 |
| mjwales | Unfortunately not :( it's on the list of nice to haves but we haven't got round to it | 14:24 |
| mgariepy | also if you run ephemeral storage you might need to do some stuff around it .. | 14:24 |
| mjwales | We don't have any ephemeral storage it's all in Ceph so hopefully that makes it easier | 14:25 |
| mgariepy | mjwales, yep it will be easier :D | 14:25 |
| *** sauloasilva has quit IRC | 14:25 | |
| mgariepy | maybe you can try to do a similar the setup in openstack and upgrade that ? | 14:26 |
| openstackgerrit | Merged openstack/openstack-ansible-repo_server master: Bind services to mgmt network addresses https://review.opendev.org/733385 | 14:27 |
| mjwales | To hash it out it almost seems that the following could work: 1. Put all the endpoints for infra3 in maintenance mode 2. Remove infra3 from mysql, rabbit, ceph 3. Reinstall OS 4. Rerun the playbooks | 14:27 |
| mgariepy | don't forget the network bits. | 14:29 |
| mjwales | We are in a slight hole given that our scheduled window for this work to start is in less than a week | 14:29 |
| mgariepy | how many network/router do you have ? | 14:29 |
| mjwales | Roughly 400 | 14:30 |
| mgariepy | do you run them in ha mode ? | 14:30 |
| mjwales | Yeah, over 3 infra nodes | 14:30 |
| mgariepy | if you are using the dns from the dnsmasq on those (ex: not secify a dns server for your networks/subnet) you might want to move the dhcp port to another server. | 14:32 |
| mgariepy | otherwise it will take a 2 extra second to resolv the dns for some of your vms. | 14:33 |
| mjwales | All networks created within OpenStack have DNS servers defined. So does that mean we can down the node without worrying about networking and the remaining two infra nodes will pick up the slack? | 14:34 |
| mgariepy | if the resolved is not on the tenant network only the dhcp part is used. | 14:35 |
| mgariepy | mjwales, that's what i was saying about it being complicated, it's not possible to document 100% of the usecase because there are a lot of place you can configure things like you want. | 14:36 |
| mjwales | It is a challenge. It seems like the process is quite robust as long as we are careful with rabbit, mysql, ceph and maintaining the same IP addresses. We can take an infra node out then rerun all the playbooks to restore it | 14:38 |
| mjwales | An issue we faced a little while back on a minor upgrade was the time required to run the playbooks. It took best part of a day to run the setup-hosts.yml and looked like this was caused by Ansible enumerating all the network interfaces on the hosts. Is this normal? | 14:39 |
| mgariepy | you can secify the number of forks also. | 14:43 |
| *** mjwales41 has joined #openstack-ansible | 14:43 | |
| *** mjwales41 has left #openstack-ansible | 14:44 | |
| *** mjwales81 has joined #openstack-ansible | 14:45 | |
| *** gyee has joined #openstack-ansible | 14:46 | |
| *** mjwales has quit IRC | 14:47 | |
| mjwales81 | mgariepy: we tried that but it didn't seem to have any impact as Ansible ran the collect facts in a single thread | 14:47 |
| mjwales81 | we thought it might just be down to the number of networks and routers we have deployed | 14:48 |
| mjwales81 | it would be good to know how long other deployments take on similar sized clusters | 14:48 |
| openstackgerrit | Merged openstack/openstack-ansible-os_magnum master: Updated from OpenStack Ansible Tests https://review.opendev.org/727316 | 14:49 |
| *** cshen has quit IRC | 14:49 | |
| *** jawad_axd has quit IRC | 14:52 | |
| *** jawad_axd has joined #openstack-ansible | 14:54 | |
| *** fghaas has left #openstack-ansible | 15:04 | |
| mgariepy | jamesdenton, for ovn aio do you have some config to do on the server directly ? | 15:10 |
| jamesdenton | what do you mean? | 15:16 |
| jamesdenton | there's a few overrides, but nothing more than that | 15:17 |
| *** cshen has joined #openstack-ansible | 15:18 | |
| mgariepy | so you need to create some network interface ? | 15:18 |
| mgariepy | or the aio bootstrap is correctly setting the stuff ? | 15:19 |
| jamesdenton | there's a patch for that, actually. https://review.opendev.org/#/c/733017/ | 15:19 |
| jamesdenton | if you export SCENARIO='aio_metal_ovn', then it will just use eth12 (a veth) and plumb it all up | 15:20 |
| jamesdenton | and the floating (public) network is accessible from the IP on br-vlan. | 15:20 |
| mgariepy | aio_lxc_ovn ? | 15:20 |
| jamesdenton | not yet | 15:20 |
| mgariepy | ok i'll take a look. | 15:21 |
| jamesdenton | well, lemme rephrase. i haven't tested. the keyword is ovn, so you can try it | 15:21 |
| mgariepy | yep, :) that's what i'm running now i will see. | 15:21 |
| jamesdenton | cool. lemme know! | 15:22 |
| *** cshen has quit IRC | 15:23 | |
| openstackgerrit | Merged openstack/openstack-ansible-galera_server master: Bump MariaDB version to 10.4 https://review.opendev.org/717830 | 15:24 |
| *** mjwales81 has quit IRC | 15:24 | |
| *** mgariepy has quit IRC | 15:34 | |
| *** idlemind has joined #openstack-ansible | 15:34 | |
| *** cshen has joined #openstack-ansible | 15:45 | |
| spatel | jrosser: hey this patch failed here so do i ignore it - https://review.opendev.org/#/c/709461/ | 15:45 |
| *** idlemind has quit IRC | 15:57 | |
| *** ebbex has joined #openstack-ansible | 16:14 | |
| *** mgariepy has joined #openstack-ansible | 16:14 | |
| CeeMac | evening | 16:29 |
| *** rpittau is now known as rpittau|afk | 16:31 | |
| jamesdenton | howdy | 16:34 |
| CeeMac | how goes? | 16:36 |
| jamesdenton | it goes! | 16:50 |
| jamesdenton | busy with stuff i don't like doing. but other than that, its good | 16:50 |
| *** sshnaidm|mtg is now known as sshnaidm|afk | 16:59 | |
| jrosser | spatel: i think you may not need that - this is all work in progress and some of the patches are speculative | 17:01 |
| CeeMac | jamesdenton: sounds familiar! | 17:02 |
| spatel | jrosser: thanks i will put that patch.. | 17:16 |
| spatel | jrosser: also what is openstack/openstack-ansible-tests branch do i need those patch also ? | 17:17 |
| jrosser | spatel: no you don't need that to deploy an AIO from openstack-ansible | 17:18 |
| spatel | that is what i thought.. cool | 17:18 |
| jrosser | it is used in the CI tests of some of the roles like neutron where tox is used as a test running for functional/unit tests | 17:18 |
| *** cshen has quit IRC | 17:21 | |
| spatel | sounds good | 17:22 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_keystone master: DNM - test using the utility host for db setup tasks https://review.opendev.org/733443 | 17:38 |
| jrosser | grrr at galera | 17:39 |
| *** cshen has joined #openstack-ansible | 17:50 | |
| *** cshen has quit IRC | 17:54 | |
| *** jawad_axd has quit IRC | 17:57 | |
| *** aedc_ has joined #openstack-ansible | 18:08 | |
| *** aedc has quit IRC | 18:11 | |
| *** cshen has joined #openstack-ansible | 18:24 | |
| *** cshen has quit IRC | 18:28 | |
| spatel | Did you guys noticed why "Retrieve base images" getting stuck there for very long time - https://github.com/openstack/openstack-ansible-lxc_hosts/blob/master/tasks/lxc_cache_preparation_systemd_new.yml#L42 | 18:31 |
| spatel | If i run from command-line.. just hanging there | 18:34 |
| -spatel- # machinectl --verify=no import-tar /tmp/CentOS-8-Container-8.1.1911-20200113.3.x86_64.tar.xz centos-8-amd64 | 18:34 | |
| -spatel- Enqueued transfer job 1. Press C-c to continue download in background. | 18:34 | |
| mgariepy | uep we did notice it | 18:44 |
| mgariepy | yep** spatel | 18:44 |
| spatel | because its just hanging and not moving forward | 18:45 |
| spatel | how do i move forward or should i disable this task in next run? | 18:46 |
| mgariepy | we know. machinectl is kinda buggy on this | 18:46 |
| mgariepy | we did discuss removing this since it's just for the image managerment.. | 18:46 |
| spatel | mgariepy: lots of people bitching about this... they are saying use raw image | 18:46 |
| spatel | mgariepy: any workaround at this point to move forward? | 18:48 |
| mgariepy | no i don't have a workaround for it. | 18:50 |
| spatel | no worry.. i will see what we can do... | 18:51 |
| mgariepy | jamesdenton, it seems to be working in lxc :D | 18:53 |
| jamesdenton | great! | 18:53 |
| mgariepy | at least some commands give me output haha | 18:53 |
| mgariepy | not errors.. lol | 18:53 |
| jamesdenton | ovn-nbctl show and ovn-sbctl show will be the main ones, and i believe the AIO should be plumbed completely, so it *ought* to work out of the box | 18:55 |
| jamesdenton | esp if you ran the tempest playbook | 18:55 |
| mgariepy | i didn't run tempest yet. | 18:59 |
| *** cshen has joined #openstack-ansible | 19:03 | |
| mgariepy | ovn-nbctl was empty because i didn't had any network | 19:03 |
| jamesdenton | ahh right | 19:04 |
| janno | I think I have a working task for checking if all cinder services are up. Do you have a tip on how I can best test this? | 19:07 |
| *** gshippey has quit IRC | 19:15 | |
| jrosser | noonedeadpunk: what do you think of this? Is it py2 on the target and no pymysql for py2.7 to run the module? https://f2812ca26965a251a9f1-8c8e1caf92c572d2c7c7d35e44c895e7.ssl.cf2.rackcdn.com/733408/5/check/openstack-ansible-deploy-aio_metal-ubuntu-bionic/3fd4cc2/logs/ara-report/result/e4608a8a-e35a-46c8-b112-f379916edf4e/ | 19:20 |
| jrosser | it's what breaks this https://review.opendev.org/#/c/733408/ | 19:21 |
| noonedeadpunk | btw, is "?" really meant here to be ? https://review.opendev.org/#/c/733408/5/tests/roles/bootstrap-host/tasks/prepare_networking.yml | 19:23 |
| noonedeadpunk | (just dunno what it means that way) | 19:23 |
| jrosser | https://stackoverflow.com/questions/33987316/what-is-a-complex-mapping-key-in-yaml | 19:25 |
| noonedeadpunk | TIL | 19:27 |
| noonedeadpunk | regarding error it looks like you said. But I don't see anything ground braking in that change at the moment | 19:27 |
| jrosser | i tested the whole stack of patches locally and it worked | 19:28 |
| jrosser | keystone, placement, cinder | 19:28 |
| noonedeadpunk | so what is changed - 10.4 got merged... | 19:30 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Bump SHAs for master https://review.opendev.org/732017 | 19:31 |
| noonedeadpunk | oh | 19:34 |
| noonedeadpunk | are we delegating now to utility container? | 19:34 |
| noonedeadpunk | so it probably miss mysql module.... | 19:35 |
| noonedeadpunk | oh, we're delegating to localhost | 19:36 |
| noonedeadpunk | in terms of zuul... I think localhost is some container where zuul executor runs? | 19:36 |
| noonedeadpunk | So we can't delegate to localhost I guess? | 19:37 |
| jrosser | it's still running, need to look in the logs in zuul.openstack.org | 19:37 |
| jrosser | localhost is fine becasue it's the embedded ansible i think | 19:37 |
| noonedeadpunk | so we might have issue here? https://review.opendev.org/#/c/733443/3/defaults/main.yml | 19:38 |
| noonedeadpunk | actually I can really mess up things | 19:39 |
| noonedeadpunk | in terms of our inventory vs zuul inventory... | 19:39 |
| jrosser | on a metal job service setup host would be localhost | 19:40 |
| jrosser | i guess i just dont really understand why it's broken all the jobs for a change which is almost a "no change" | 19:41 |
| *** cshen has quit IRC | 19:45 | |
| noonedeadpunk | except in case everything is broken now.... | 19:48 |
| jrosser | noonedeadpunk: oh maybe I know - we have to use the utility venv python interpreter? | 20:01 |
| jrosser | that’s how the other service setup tasks work I think..... | 20:01 |
| *** aedc_ has quit IRC | 20:30 | |
| *** cshen has joined #openstack-ansible | 20:40 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_keystone master: DNM - test using the utility host for db setup tasks https://review.opendev.org/733443 | 20:44 |
| *** cshen has quit IRC | 20:44 | |
| *** gyee has quit IRC | 20:55 | |
| *** gyee has joined #openstack-ansible | 20:57 | |
| *** spatel has quit IRC | 21:16 | |
| *** cshen has joined #openstack-ansible | 21:50 | |
| *** cshen has quit IRC | 21:55 | |
| *** pcaruana has quit IRC | 22:09 | |
| *** pcaruana has joined #openstack-ansible | 22:19 | |
| *** noonedeadpunk has quit IRC | 22:19 | |
| *** noonedeadpunk has joined #openstack-ansible | 22:29 | |
| *** soren has quit IRC | 22:35 | |
| *** gixx has quit IRC | 22:35 | |
| *** CeeMac has quit IRC | 22:35 | |
| *** samueldmq has quit IRC | 22:35 | |
| *** guilhermesp has quit IRC | 22:36 | |
| *** nicolasbock has quit IRC | 22:36 | |
| *** alanmeadows has quit IRC | 22:36 | |
| *** rpittau|afk has quit IRC | 22:36 | |
| *** cyberpear has quit IRC | 22:36 | |
| *** mnaser has quit IRC | 22:36 | |
| *** donnyd has quit IRC | 22:36 | |
| *** NobodyCam has quit IRC | 22:36 | |
| *** gregwork has quit IRC | 22:36 | |
| *** viks____ has quit IRC | 22:37 | |
| *** Open10K8S has quit IRC | 22:37 | |
| *** mubix has quit IRC | 22:37 | |
| *** jonmasters has quit IRC | 22:37 | |
| *** gundalow has quit IRC | 22:37 | |
| *** mwhahaha has quit IRC | 22:37 | |
| *** NobodyCam has joined #openstack-ansible | 22:37 | |
| *** jrosser has quit IRC | 22:37 | |
| *** fyx has quit IRC | 22:37 | |
| *** johnsom has quit IRC | 22:37 | |
| *** vblando has quit IRC | 22:37 | |
| *** sri_ has quit IRC | 22:37 | |
| *** CeeMac has joined #openstack-ansible | 22:37 | |
| *** alanmeadows has joined #openstack-ansible | 22:38 | |
| *** mubix has joined #openstack-ansible | 22:38 | |
| *** jonmasters has joined #openstack-ansible | 22:38 | |
| *** soren has joined #openstack-ansible | 22:38 | |
| *** gregwork has joined #openstack-ansible | 22:38 | |
| *** sri_ has joined #openstack-ansible | 22:39 | |
| *** Open10K8S has joined #openstack-ansible | 22:39 | |
| *** vblando has joined #openstack-ansible | 22:39 | |
| *** gixx has joined #openstack-ansible | 22:40 | |
| *** gundalow has joined #openstack-ansible | 22:40 | |
| *** guilhermesp has joined #openstack-ansible | 22:40 | |
| *** jrosser has joined #openstack-ansible | 22:41 | |
| *** mnaser has joined #openstack-ansible | 22:41 | |
| *** donnyd has joined #openstack-ansible | 22:41 | |
| *** mwhahaha has joined #openstack-ansible | 22:41 | |
| *** nicolasbock has joined #openstack-ansible | 22:42 | |
| *** yolanda has quit IRC | 22:43 | |
| *** johnsom has joined #openstack-ansible | 22:43 | |
| *** cyberpear has joined #openstack-ansible | 22:52 | |
| *** samueldmq has joined #openstack-ansible | 23:02 | |
| *** guilhermesp has quit IRC | 23:02 | |
| *** guilhermesp has joined #openstack-ansible | 23:02 | |
| *** rpittau|afk has joined #openstack-ansible | 23:04 | |
| *** fyx has joined #openstack-ansible | 23:12 | |
| *** tosky has quit IRC | 23:35 | |
| *** rh-jelabarre has quit IRC | 23:44 | |
| *** gyee has quit IRC | 23:46 | |
| *** cshen has joined #openstack-ansible | 23:51 | |
| *** cshen has quit IRC | 23:56 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!