Wednesday, 2018-06-06

*** dankolbrs has quit IRC00:11
*** dankolbrs has joined #openstack-ansible00:11
*** nurdie has quit IRC00:28
*** portante_ has joined #openstack-ansible00:28
*** lhinds|out has joined #openstack-ansible00:29
spotzcloudnull: If you're still about put a comment on https://review.openstack.org/#/c/572196/00:30
*** portante has quit IRC00:32
*** portante_ is now known as portante00:32
*** lhinds has quit IRC00:32
*** tux_ has joined #openstack-ansible00:34
openstackgerritMerged openstack/openstack-ansible-tests master: Vagrantfile: Add workaround for Virtualbox bug on guest audio config  https://review.openstack.org/57238400:35
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-apt_package_pinning master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57259400:38
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-ceph_client master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57259500:38
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-galera_client master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57259600:38
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-galera_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57259700:38
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-haproxy_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57259900:38
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-lxc_container_create master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57260000:38
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-lxc_hosts master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57260100:38
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-memcached_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57260200:39
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-nspawn_container_create master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57260300:39
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-nspawn_hosts master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57260400:39
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-openstack_hosts master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57260500:39
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-openstack_openrc master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57260600:39
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_almanach master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57260700:39
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-rabbitmq_server master: Update the version of erlang to support rabbitmq  https://review.openstack.org/57219600:40
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_aodh master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57260800:40
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_barbican master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57260900:40
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_blazar master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57261000:40
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_ceilometer master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57261100:40
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_cinder master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57261200:40
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_cloudkitty master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57261300:40
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_congress master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57261400:40
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_designate master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57261500:41
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_glance master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57261600:41
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_gnocchi master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57261700:41
cloudnullspotz jmccrory mnaser https://review.openstack.org/#/c/572196 - updated I think that captures whats needed to ensure we're able to test upgrades.00:41
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_heat master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57261800:41
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_horizon master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57261900:41
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_ironic master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57262000:41
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_keystone master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57262100:42
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_magnum master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57262200:42
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_masakari master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57262300:42
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_monasca master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57262400:42
*** portante_ has joined #openstack-ansible00:42
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_neutron master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57262500:43
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_nova master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57262600:43
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_octavia master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57262700:43
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_panko master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57262800:43
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_rally master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57262900:43
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_sahara master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57263000:43
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_searchlight master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57263200:43
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_swift master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57263300:44
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_tacker master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57263400:44
*** lhinds|out has quit IRC00:44
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_tempest master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57263500:44
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_trove master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57263600:44
*** portante has quit IRC00:44
*** portante_ is now known as portante00:44
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_watcher master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57263700:44
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_zaqar master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57263800:44
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-pip_install master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57263900:45
*** gregoryo has joined #openstack-ansible00:45
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-plugins master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57264000:45
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-rabbitmq_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57264100:45
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-repo_build master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57264200:45
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-repo_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57264300:45
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-rsyslog_client master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57264400:45
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-rsyslog_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57264500:45
openstackgerritOpenStack Proposal Bot proposed openstack/ansible-config_template master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57264600:46
openstackgerritOpenStack Proposal Bot proposed openstack/ansible-hardening master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57264700:46
openstackgerritOpenStack Proposal Bot proposed openstack/ansible-role-python_venv_build master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57264800:46
openstackgerritOpenStack Proposal Bot proposed openstack/ansible-role-systemd_mount master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57264900:46
openstackgerritOpenStack Proposal Bot proposed openstack/ansible-role-systemd_networkd master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57265000:46
openstackgerritOpenStack Proposal Bot proposed openstack/ansible-role-systemd_service master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57265100:47
openstackgerritMerged openstack/openstack-ansible-repo_build stable/pike: Create distutils cfg before install and build  https://review.openstack.org/57255500:47
*** lhinds has joined #openstack-ansible00:47
spotzcloudnull: And the debian is not to be the same version as apt?00:48
openstackgerritMerged openstack/openstack-ansible-repo_build stable/ocata: Create distutils cfg before install and build  https://review.openstack.org/57255700:48
spotzIt's the only thing that looked off to be so just verifying00:48
cloudnullyes the version here https://review.openstack.org/#/c/572196/6/tests/rabbitmq_server-upgrade-overrides.yml should only be used for the previous release which would install 19 and upgrade to 2000:49
*** chyka has joined #openstack-ansible00:50
*** chyka has quit IRC00:55
openstackgerritMerged openstack/openstack-ansible-repo_build stable/queens: Create distutils cfg before install and build  https://review.openstack.org/57255400:59
*** jeferobles has joined #openstack-ansible01:00
spotzgotcha01:04
openstackgerritMerged openstack/openstack-ansible-os_tempest stable/ocata: Pin cmd2 to the last python2 version of the library  https://review.openstack.org/57203801:06
tux_cloudnull: hey i have question, if i create my br-mgmt on same existing LAN in that case does my LAN DHCP will create any issue with br-mgmt IP range?01:12
tux_We already have mgmt LAN in our network and thinking i can use same IP range for Openstack br-mgmt IP range01:13
*** jbadiapa has joined #openstack-ansible01:30
*** threestrands_ has joined #openstack-ansible01:33
*** threestrands has quit IRC01:36
openstackgerritMerged openstack/openstack-ansible-repo_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57264301:42
openstackgerritMerged openstack/openstack-ansible-plugins master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57264001:43
openstackgerritMerged openstack/ansible-role-systemd_service master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57265101:43
openstackgerritMerged openstack/openstack-ansible-os_rally master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57262901:43
openstackgerritMerged openstack/openstack-ansible-os_panko master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57262801:44
openstackgerritMerged openstack/openstack-ansible-os_swift master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57263301:44
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57263501:45
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57264101:45
openstackgerritMerged openstack/openstack-ansible-os_trove master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57263601:46
*** gyee has quit IRC01:46
openstackgerritMerged openstack/openstack-ansible-os_sahara master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57263001:46
openstackgerritMerged openstack/openstack-ansible-repo_build master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57264201:46
openstackgerritMerged openstack/openstack-ansible-pip_install master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57263901:46
openstackgerritMerged openstack/openstack-ansible-os_zaqar master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57263801:46
openstackgerritMerged openstack/openstack-ansible-os_magnum master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57262201:47
openstackgerritMerged openstack/openstack-ansible-os_searchlight master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57263201:47
openstackgerritMerged openstack/openstack-ansible-os_watcher master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57263701:47
openstackgerritMerged openstack/openstack-ansible-rsyslog_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57264501:47
openstackgerritMerged openstack/openstack-ansible-os_horizon master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57261901:47
openstackgerritMerged openstack/openstack-ansible-os_glance master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57261601:48
openstackgerritMerged openstack/openstack-ansible-os_neutron master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57262501:48
openstackgerritMerged openstack/openstack-ansible-os_nova master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57262601:50
openstackgerritMerged openstack/openstack-ansible-ceph_client master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57259501:50
openstackgerritMerged openstack/openstack-ansible-rsyslog_client master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57264401:50
openstackgerritMerged openstack/openstack-ansible-os_ironic master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57262001:51
openstackgerritMerged openstack/openstack-ansible-os_tacker master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57263401:51
openstackgerritMerged openstack/openstack-ansible-nspawn_container_create master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57260301:52
openstackgerritMerged openstack/openstack-ansible-galera_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57259701:52
openstackgerritMerged openstack/openstack-ansible-os_monasca master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57262401:52
openstackgerritMerged openstack/openstack-ansible-os_keystone master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57262101:52
openstackgerritMerged openstack/openstack-ansible-os_aodh master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57260801:52
openstackgerritMerged openstack/openstack-ansible-os_masakari master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57262301:52
openstackgerritMerged openstack/openstack-ansible-galera_client master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57259601:53
openstackgerritMerged openstack/openstack-ansible-os_congress master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57261401:53
openstackgerritMerged openstack/openstack-ansible-os_blazar master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57261001:53
openstackgerritMerged openstack/openstack-ansible-lxc_container_create master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57260001:53
openstackgerritMerged openstack/openstack-ansible-os_cinder master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57261201:53
openstackgerritMerged openstack/openstack-ansible-os_cloudkitty master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57261301:53
openstackgerritMerged openstack/openstack-ansible-os_almanach master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57260701:54
openstackgerritMerged openstack/openstack-ansible-os_designate master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57261501:54
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57260101:54
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57260501:54
openstackgerritMerged openstack/openstack-ansible-os_ceilometer master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57261101:55
openstackgerritMerged openstack/openstack-ansible-os_octavia master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57262701:55
openstackgerritMerged openstack/openstack-ansible-memcached_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57260201:55
spotzLast call for reviews for the night01:55
openstackgerritMerged openstack/openstack-ansible-apt_package_pinning master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57259401:56
openstackgerritMerged openstack/openstack-ansible-haproxy_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57259901:56
*** yolanda_ has joined #openstack-ansible01:56
openstackgerritMerged openstack/openstack-ansible-openstack_openrc master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57260601:56
openstackgerritMerged openstack/openstack-ansible-os_heat master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57261801:57
openstackgerritMerged openstack/openstack-ansible-nspawn_hosts master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57260401:57
openstackgerritMerged openstack/openstack-ansible-os_gnocchi master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57261701:57
openstackgerritMerged openstack/openstack-ansible-os_barbican master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57260901:57
*** yolanda_ has quit IRC01:57
*** yolanda_ has joined #openstack-ansible01:58
*** yolanda has quit IRC01:59
*** asdf1234asdf[m] has joined #openstack-ansible02:20
*** cjloader has joined #openstack-ansible02:21
*** cjloader has quit IRC02:26
*** jeferobles has quit IRC02:33
*** jeferobles has joined #openstack-ansible02:46
*** dxiri has quit IRC02:51
*** nurdie has joined #openstack-ansible03:07
*** tux_ has quit IRC03:16
*** skyscraper has quit IRC03:30
*** sm806 has quit IRC03:30
*** sm806 has joined #openstack-ansible03:31
*** skyscraper has joined #openstack-ansible03:32
*** udesale has joined #openstack-ansible03:44
*** masuberu has quit IRC04:04
*** poopcat has quit IRC04:06
*** jbadiapa has quit IRC04:12
*** Bhujay has joined #openstack-ansible04:14
*** cjloader has joined #openstack-ansible04:21
*** cjloader has quit IRC04:26
*** radeks has joined #openstack-ansible04:36
*** radeks_ has joined #openstack-ansible04:39
*** radeks has quit IRC04:42
evrardjpgood morning04:48
*** radeks_ has quit IRC04:50
*** udesale has quit IRC04:56
*** udesale has joined #openstack-ansible04:57
*** udesale has quit IRC04:57
*** armaan has quit IRC04:58
*** udesale has joined #openstack-ansible04:58
*** armaan has joined #openstack-ansible04:58
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_nova master: Updated spice-html5 git repository URL  https://review.openstack.org/57241305:01
evrardjplet's just make a m2 working, and see how it goes.05:01
*** radeks_ has joined #openstack-ansible05:06
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: [WIP] Remove rabbitmq setup tasks replaced by oslo.messaging  https://review.openstack.org/57253105:08
*** cjloader has joined #openstack-ansible05:21
*** Bhujay has quit IRC05:21
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-plugins master: Updated spice-html5 git repository URL  https://review.openstack.org/57267105:23
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-repo_build master: Updated spice-html5 git repository URL  https://review.openstack.org/57267205:25
*** cjloader has quit IRC05:25
*** xar- has quit IRC05:27
*** chhagarw has joined #openstack-ansible05:27
*** sar has quit IRC05:28
*** xar- has joined #openstack-ansible05:28
*** Bhujay has joined #openstack-ansible05:28
*** chris_hultin has quit IRC05:30
*** chris_hultin|AWA has joined #openstack-ansible05:30
*** chris_hultin|AWA is now known as chris_hultin05:30
*** DanyC has joined #openstack-ansible05:42
*** DanyC has quit IRC05:46
*** hassenius has joined #openstack-ansible05:49
*** mma has joined #openstack-ansible05:50
*** mma has quit IRC05:53
*** hassenius has quit IRC05:53
*** mma has joined #openstack-ansible05:54
*** Bhujay has quit IRC05:56
*** mma has quit IRC05:58
*** masber has joined #openstack-ansible06:04
*** sar has joined #openstack-ansible06:15
*** lvdombrkr has joined #openstack-ansible06:16
*** sm806 has quit IRC06:23
*** skyscraper has quit IRC06:23
*** sm806 has joined #openstack-ansible06:24
*** skyscraper has joined #openstack-ansible06:24
*** cshen has joined #openstack-ansible06:27
*** lemouchon has joined #openstack-ansible06:31
*** pcaruana has joined #openstack-ansible06:44
*** cshen has quit IRC06:48
*** cshen has joined #openstack-ansible06:51
*** cshen has quit IRC06:57
*** jbadiapa has joined #openstack-ansible07:09
*** hassenius has joined #openstack-ansible07:10
*** nurdie has quit IRC07:13
*** hassenius has quit IRC07:14
*** nurdie has joined #openstack-ansible07:14
*** ThiagoCMC has quit IRC07:14
*** armaan has quit IRC07:15
*** jbadiapa has quit IRC07:17
*** jbadiapa has joined #openstack-ansible07:17
*** gkadam has joined #openstack-ansible07:18
*** cshen has joined #openstack-ansible07:18
*** openstackgerrit has quit IRC07:19
evrardjpso who deals with the mess of the wiring of oslo?07:21
*** mma has joined #openstack-ansible07:23
*** jeferobles has quit IRC07:25
*** cshen has quit IRC07:26
*** masber has quit IRC07:27
*** mma has quit IRC07:27
*** tosky has joined #openstack-ansible07:28
*** mma has joined #openstack-ansible07:28
*** lvdombrkr89 has joined #openstack-ansible07:32
*** mma has quit IRC07:32
*** armaan has joined #openstack-ansible07:33
*** masber has joined #openstack-ansible07:35
*** lvdombrkr has quit IRC07:35
evrardjpok I will handle it :(07:38
*** DanyC has joined #openstack-ansible07:38
*** masuberu has joined #openstack-ansible07:39
*** masber has quit IRC07:43
*** hassenius has joined #openstack-ansible07:49
*** hasseniu_ has joined #openstack-ansible07:49
*** hassenius has quit IRC07:53
*** hasseniu_ has quit IRC07:56
*** hasseniu_ has joined #openstack-ansible07:57
*** threestrands_ has quit IRC08:03
*** shardy has joined #openstack-ansible08:05
*** hasseniu_ has quit IRC08:05
*** hassenius has joined #openstack-ansible08:06
*** armaan has quit IRC08:06
*** hassenius has quit IRC08:09
*** hassenius has joined #openstack-ansible08:09
*** hasseniu_ has joined #openstack-ansible08:09
odyssey4meo/08:12
odyssey4meevrardjp I think there's already a WIP patch up08:12
odyssey4mehttps://review.openstack.org/57253108:12
evrardjpyeah08:12
evrardjpit doesn't work08:12
evrardjpI am cleaning everything08:12
evrardjpI am done waiting08:12
odyssey4mewell yes, last night's chatter seems to indicate that there're a bunch of other issues that also crept in08:13
*** armaan has joined #openstack-ansible08:13
*** radek__ has joined #openstack-ansible08:13
*** hassenius has quit IRC08:13
odyssey4mebut hey, I dunno - just wanted to make sure you're aware of the patch08:13
*** armaan has quit IRC08:17
evrardjpI prefer simplifying08:17
evrardjpit is far too complex in terms of group vars08:18
evrardjpand we have other issues indeed08:18
evrardjpthis is a serious mess08:28
*** oneswig has joined #openstack-ansible08:30
evrardjpI think I won't do it. Table flip.08:31
evrardjp:p08:31
*** armaan has joined #openstack-ansible08:32
*** pvradu has joined #openstack-ansible08:46
*** gregoryo has quit IRC08:46
*** electrofelix has joined #openstack-ansible08:49
*** openstackgerrit has joined #openstack-ansible08:49
openstackgerritMerged openstack/openstack-ansible-galera_server master: Bump minor version of mariadb  https://review.openstack.org/57236508:49
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Replace rabbitmq references with oslo messaging  https://review.openstack.org/57270308:50
*** oneswig has quit IRC08:51
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Replace rabbitmq references with oslo messaging  https://review.openstack.org/57270308:53
*** oneswig has joined #openstack-ansible08:57
*** sar has quit IRC08:59
*** sar has joined #openstack-ansible08:59
*** nurdie has quit IRC09:02
*** evin has joined #openstack-ansible09:04
*** sar has quit IRC09:05
odyssey4meevrardjp I wanted to fast follow that series of patches with moving the MQ tasks into the roles, but I find myself wondering whether we shouldn't just do that instead of trying to fix up the group vars09:09
openstackgerritMerged openstack/openstack-ansible-plugins master: Updated spice-html5 git repository URL  https://review.openstack.org/57267109:10
evrardjpodyssey4me: yes you can09:16
evrardjpbut you'll still bork the upgrades.09:17
evrardjpputting them in one place, stating where they are used is useful, until we use ansible-viz from aspiers09:17
hwoarangevrardjp: are you going to backport the spice-html5 url fixes to pike too?09:18
* hwoarang is behind his irc backlog09:18
evrardjpalready done09:19
evrardjpcheck lost-console09:19
evrardjptopic09:19
hwoarangawesome thanks09:19
evrardjpodyssey4me: I am all okay with the improvements, but right now we need somethign working.09:22
evrardjpTomorrow is the deadline for m209:22
evrardjpwe don't have anything yet.09:22
evrardjpWe can't freeze09:22
evrardjpTHis morning I had the choice to revert all back, or continue fixing.09:22
odyssey4meevrardjp yep, that's why I'm holding back - besides the fact that I have my day job to do too09:22
evrardjpGuess what... you're not alone... :p09:23
odyssey4meI can pick it up later if we're still stuck, probably around 6pm my time. Until then I need to focus elsewhere.09:24
openstackgerritMerged openstack/openstack-ansible-os_cinder master: Update to use oslo.messaging service for RPC and Notify  https://review.openstack.org/56057409:24
evrardjpcool ^ merged.09:24
evrardjpa large issue is fixed.09:25
*** gkadam has quit IRC09:25
evrardjpok I have to do something else too. good luck on fixing the gates. If you want, I have something that cleans up the vars: https://review.openstack.org/#/c/572703/ that makes things easier to track and fix.09:27
*** radeks_ has quit IRC09:32
openstackgerritMerged openstack/openstack-ansible-repo_build master: Updated spice-html5 git repository URL  https://review.openstack.org/57267209:33
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-repo_build stable/queens: Updated spice-html5 git repository URL  https://review.openstack.org/57271209:36
*** armaan has quit IRC09:37
*** armaan has joined #openstack-ansible09:37
*** armaan has quit IRC09:43
*** armaan has joined #openstack-ansible09:43
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-repo_build stable/pike: Updated spice-html5 git repository URL  https://review.openstack.org/57271509:46
andymccrocata and done!09:50
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-repo_build stable/ocata: Updated spice-html5 git repository URL  https://review.openstack.org/57271709:51
hwoarangpheww09:51
*** armaan has quit IRC09:52
*** armaan has joined #openstack-ansible09:52
openstackgerritMerged openstack/openstack-ansible-os_nova master: Updated spice-html5 git repository URL  https://review.openstack.org/57241309:53
andymccrstupid github gitlab thing!09:58
andymccrshould make the default plugin test for github and if that fails try gitlab09:59
*** armaan has quit IRC10:07
*** armaan has joined #openstack-ansible10:07
odyssey4melol, I find myself wondering why we bother using git for those any more given that the packages are maintained better these days10:13
odyssey4meback in the old days they weren't10:13
hwoarangthis is soooo annoying10:14
hwoarangthey could just leave the github repos for a month to give people time to migrate10:14
odyssey4meyeah, deleting the repo and org is silly10:16
odyssey4methey could've just frozen it and put a README entry in to say that active development has moved10:16
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-plugins stable/queens: Updated spice-html5 git repository URL  https://review.openstack.org/57272210:18
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-plugins stable/pike: Updated spice-html5 git repository URL  https://review.openstack.org/57272310:19
hwoarangi guess too much hype to move to gitlab10:19
odyssey4mehwoarang andymccr it'd probably be prudent to add a release note to indicate that this is a known issue and to provide a workaround for older releases10:20
hwoarangdo we need a release not if we are backporting all the way back to oacata?10:21
odyssey4mewell, yes - this is something that can be worked around with overrides for older releases, and people need to be notified that there's an known problem for anything older than the current proposed release10:22
odyssey4mesimilar to the resolv.conf issue we head a month or two ago10:22
hwoarangi see. i can do that but it's more like a  'friday afternoon' task right now.10:32
*** mmalchuk has joined #openstack-ansible10:34
mmalchukhello everyone10:35
*** jamesdenton has quit IRC10:35
mmalchukspotz could you please +workflow again https://review.openstack.org/#/c/572036/ and https://review.openstack.org/#/c/572037/10:35
mmalchukboth failed on gates10:36
odyssey4memmalchuk just recheck them10:36
odyssey4meadd 'recheck' as a comment10:36
mmalchukrecheck didn't retrigger verify on gates10:37
odyssey4me'reverify' is no longer a thing IIRC10:37
hwoarangwhat do you make of that http://logs.openstack.org/17/572417/1/check/openstack-ansible-functional-centos-7/c19bf9b/job-output.txt.gz#_2018-06-06_10_17_08_34777210:37
mmalchukyep. so -w and then +w only helps10:37
odyssey4meit's 'recheck' now, the key word 'reverify' has not been a thing for over a year10:37
* hwoarang is wondering if upstream gitlab repo is rate limiting connections10:38
odyssey4memmalchuk the issue on those patches is that the verificaiton failed... so changing workflow will do nothing10:38
odyssey4meit needs to check again10:38
mmalchukok, lets see. i will recheck now10:38
olivierbourdon38hello everyone, sorry to ask this kind of question here but did any of you experimented some github cloning/updating issues lately :-(  (SSL connect error)10:39
olivierbourdon38tried several of my machines (across different public providers) wihout any success on any. It was working ~1h ago10:40
openstackgerritMerged openstack/ansible-role-systemd_mount master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57264910:42
openstackgerritMerged openstack/ansible-role-systemd_networkd master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57265010:43
openstackgerritMerged openstack/ansible-hardening master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57264710:44
openstackgerritMerged openstack/ansible-role-python_venv_build master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57264810:46
openstackgerritMerged openstack/ansible-config_template master: Updated from OpenStack Ansible Tests  https://review.openstack.org/57264610:47
olivierbourdon38nevermind, seems to have been transient (blue screen of unavailability)10:50
*** chyka has joined #openstack-ansible10:50
evrardjpif there are ppl willing to help on gates: https://review.openstack.org/#/c/572703/210:51
evrardjpolivierbourdon38: time to self host? :p10:51
openstackgerritMerged openstack/openstack-ansible-plugins stable/queens: Updated spice-html5 git repository URL  https://review.openstack.org/57272210:53
*** oneswig has quit IRC10:55
*** chyka has quit IRC10:55
*** erolg has joined #openstack-ansible11:00
*** yolanda_ has quit IRC11:00
*** yolanda_ has joined #openstack-ansible11:00
*** lvdombrkr89 has quit IRC11:03
openstackgerritMerged openstack/openstack-ansible-repo_build stable/ocata: Updated spice-html5 git repository URL  https://review.openstack.org/57271711:06
openstackgerritMerged openstack/openstack-ansible-repo_build stable/queens: Updated spice-html5 git repository URL  https://review.openstack.org/57271211:11
openstackgerritMaksim Malchuk proposed openstack/openstack-ansible-os_tempest stable/pike: Pin cmd2 to the last python2 version of the library  https://review.openstack.org/57203711:26
*** armaan has quit IRC11:27
*** armaan has joined #openstack-ansible11:28
*** lvdombrkr has joined #openstack-ansible11:39
hwoarangwe seem to suffer from a centos specific prob + new spice-html5 repo https://review.openstack.org/#/c/572415/11:41
hwoarangmnaser: ^11:41
*** lvdombrkr89 has joined #openstack-ansible11:41
mnaserhwoarang: will check once I get to the office11:42
*** lvdombrkr has quit IRC11:44
*** jamesdenton has joined #openstack-ansible11:46
*** gkadam has joined #openstack-ansible11:49
*** chhagarw has quit IRC11:58
*** mmalchuk_ has joined #openstack-ansible12:05
*** hachi has joined #openstack-ansible12:06
*** mmalchuk has quit IRC12:06
openstackgerritMerged openstack/openstack-ansible-pip_install stable/queens: Disable the pip version check  https://review.openstack.org/56352112:08
*** nurdie has joined #openstack-ansible12:09
mnaserhwoarang: so yeah, centos seems to be non determinstically failing12:09
mnaseri guess https://review.openstack.org/#/c/572413/ merged because centos is nv :(12:09
*** nurdie has quit IRC12:14
hwoarangmaybe we can make all nova branches -nv ?12:18
mnaseri mean12:21
mnaseri'd like centos to stay voting..12:21
mnaseri have a patch reverting the non voting status because i fixed the issue that got it to non voting in the first place12:21
mnaseri have no idea why it would 404 though12:21
mnaserhttp://logs.openstack.org/15/572415/1/check/openstack-ansible-functional-centos-7/d490616/logs/ara-report/result/f15ca8cc-a046-408c-bb06-6c9a45afab71/12:21
hwoarangok but this issue prevents backports on os_nova :/12:22
hwoarangso either we need to understand and fix it or disable it and move on :/12:22
hwoarangor something else which i can't think right now12:23
mnaserhwoarang: yes i agree with you12:23
mnaseri'm just trying to see if i can quickly think this through in some 30 minutes12:23
*** ansmith has quit IRC12:23
hwoarangok no problem lets see12:23
mnaserso for some reason git clone requests give a 404 under centos12:24
mnaserto that repo12:24
*** lvdombrkr89 has quit IRC12:24
*** lvdombrkr has joined #openstack-ansible12:25
mnaserok12:26
mnaserin my own centos machine12:26
mnaserhttps://www.irccloud.com/pastebin/I5UYG8qG/12:26
mnasersigh ignore that12:26
mnaserrunning /bin/git clone --origin origin https://gitlab.freedesktop.org/spice/spice-html5 /usr/share/spice-html512:26
mnaser gives me the same error12:26
mnaserok12:27
mnaseradding a trailing .git fixes it..12:27
mnaser`/bin/git clone --origin origin https://gitlab.freedesktop.org/spice/spice-html5.git /usr/share/spice-html5` works12:27
mnaserlet me update things then12:27
hwoarangthat is so strange ;p12:27
mnaserhttps://stackoverflow.com/a/4930533712:28
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server master: Update the version of erlang to support rabbitmq  https://review.openstack.org/57219612:28
mnaseri guess different git versions12:28
*** armaan has quit IRC12:28
*** armaan has joined #openstack-ansible12:28
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_nova stable/pike: Updated spice-html5 git repository URL  https://review.openstack.org/57241512:29
hwoaranghmm the uril (without the .git suffix) was merged in other repos12:29
mnaserhwoarang: in every repo that either didnt have centos jobs12:29
hwoarangbut i can't be sure what was happening with centos there or whether this was actually tested by anything12:29
mnaseror they were nv12:29
mnaseraka master and ocata12:29
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_nova stable/queens: Updated spice-html5 git repository URL  https://review.openstack.org/57241712:29
hwoarangit was also merged in the integration repo (all branches) and repo_build (all branches)12:29
hwoarangstrange12:30
mnaseri guess it clones in some weird different way12:30
mnaserthis whole thing is strange12:30
hwoarangtrue12:30
hwoarangthank you for the investigation. lets see12:30
mnaserhwoarang: it did fail in integrated repo12:32
mnaserbut centos is non voting12:32
mnaserso no one did anything12:32
mnaser:(12:32
mnaserhttps://review.openstack.org/#/c/572408/12:32
hwoarangyeah non-voting...12:33
hwoarangeasy to miss12:33
mnaserhttps://review.openstack.org/#/c/572405/12:34
mnaserlooks like the master change didn't land but had the right repo12:34
mnaserbut the backports didnt have the right repo :<12:34
mnaserso ill have to do stable only fixes12:35
openstackgerritMerged openstack/openstack-ansible-plugins stable/pike: Updated spice-html5 git repository URL  https://review.openstack.org/57272312:37
openstackgerritMohammed Naser proposed openstack/openstack-ansible stable/queens: Fix Git URL for SPICE to work with CentOS  https://review.openstack.org/57275712:37
openstackgerritMohammed Naser proposed openstack/openstack-ansible stable/pike: Fix Git URL for SPICE to work with CentOS  https://review.openstack.org/57275812:38
*** shardy has quit IRC12:39
*** shardy has joined #openstack-ansible12:43
*** armaan has quit IRC12:45
*** armaan has joined #openstack-ansible12:45
*** chhagarw has joined #openstack-ansible12:50
evrardjpso13:00
evrardjpwhat's the state?13:00
evrardjpI see I got more timeouts on https://review.openstack.org/#/c/572703/213:00
mnaserevrardjp: atm spice stuff is dealt with13:01
evrardjpyup13:01
evrardjpbut the integrated didn't get the patch, right?13:01
mnaserhttps://review.openstack.org/#/c/572703/213:01
mnaserit would have to get it through yours13:01
evrardjpI hesitated reviewing -1 on the .git ... argh I should have.13:02
evrardjpworked for me13:03
* mnaser can only help so much in ubuntu when he has to deal with unbreaking centos :(13:03
evrardjpyeah your patch still didn't pass13:03
evrardjp:(13:03
evrardjpit's been what.. 1 month now?13:03
evrardjp:'(13:03
evrardjpdoes using packages help in terms of timeouts?13:04
evrardjpI had the impression it was worse13:04
mnaserbesides selinux which takes 5 minutes to install, the rest kinda flies by13:04
evrardjpmaybe we should try switching to software collection's python and dnf?13:04
mnaserpuppet world which deploys from pkgs13:04
evrardjpyes but puppet computes a complete state, right?13:05
mnasercentos 7 deploy + tempest run is 1h13:05
evrardjpand install all the packages at the same time?13:05
mnaseri think it might13:06
* mnaser is starting to feel overwhelmed by all this13:06
evrardjpI think it's fine,but you're losing the orchestration power13:07
evrardjp(if you were to do the same)13:07
*** Bhujay has joined #openstack-ansible13:09
mnaseri would honestly propose we stop adding new code/features until we fix the CI.13:11
mnasermake sure we fix all jobs across all repos13:11
evrardjpmnaser: well we have no choice, milestone 2 is just here.13:13
evrardjpthat's what this is about13:13
mnaserwhen is the m-2 release dead line?13:13
evrardjptoday13:13
mnasersigh, bummer13:13
evrardjpwell thursday morning.13:13
evrardjpwhich is kinda the same13:13
evrardjp:p13:13
mnaserwe'll at least unblock if your patch lands13:13
mnaserwhat are the 'basekit' jobs13:14
evrardjprunning with less services13:14
evrardjpstill containers13:14
evrardjpso designate/horizon are not in13:14
mnaserso does that mean its the same as aio_lxc with less coverage?13:15
evrardjpthat's what we did for making centos pass in terms of time13:15
evrardjpyes13:15
evrardjpwhen basekit was introduced we had this idea of having multiple smaller scenarios13:15
mnaseri tihnk that's the way to go13:16
evrardjpand keep the traditional one as an easy way for deployers to test osa in a one liner13:16
evrardjpto see what OSA can do13:16
evrardjpso we needed to keep that one13:16
evrardjpI still believe it's better to keep it, but maybe we can exercise it only in periodics.13:16
evrardjpthe idea was to extend coverage13:16
evrardjpthat's why I have included the bare metal one13:17
evrardjpit's lighter, doesn't need haproxy, doesn't need containers13:17
evrardjpand we can have multiple things stacked on top based on that13:17
mnaserwe need to figure out how to make our ci more stable13:17
evrardjpso computekit could be one13:17
evrardjpso the stability is just a new thing since spectre/meltdown13:18
evrardjpfor me, it was always stable until that happened.13:18
evrardjpthe problem is double13:18
evrardjp1) ram usage is sky high13:18
evrardjp2) the cpu is "slower" (allow me the ellipsis there)13:19
mnaseri just think that sometimes as a team, we take preferences on the things we deploy on13:19
evrardjpthe problem in 1) is getting worse and worse with the increase of scope on some deploys, and some variables.13:19
mnaser"if centos is broken then i'll just set to non-voting"13:19
evrardjpthat's not the ideal situation13:20
mnaseri think we should have a collective responsibility across all deploy targets13:20
*** lemouchon has quit IRC13:20
evrardjpI agree13:20
evrardjpbut we never got centos stable13:20
evrardjpit's been more than a year that I saw centos flakiness all over the place13:20
hwoarangthe prob is that only a handful of people know suse and centos so if these are not around things are blocked until they return13:20
hwoarang"handful of core people"13:21
mnaserhwoarang: you're right, but even if i say suse gate issues, i'll try to google it or figure something out13:21
evrardjpwell if people trust that it would work, people would start fixing it if we couldn't do otherwise13:21
*** ansmith has joined #openstack-ansible13:21
mnaseri think as a very last resort we set something to non voting.. instead we reached a state of *many* non voting jobs all over the place13:21
mnaseryou're right about that13:21
evrardjpI do not like moving things to -nv13:22
mnaserbut imho the only way to fix things is to tell people: if you don't fix this, your patch is not landing13:22
evrardjpbut for something like the upgrade job of nova, that's a good example of where agility shines13:22
hwoarangwell this is not normally the case :/13:22
mnaserso you're either going to enjoy typing 'recheck' or investigate a bit of time to help clear it up13:22
hwoarangci breaks not because of our patches but often because of unrelated issues13:22
hwoarangupstream repos, external repos, foobar etc13:22
evrardjpwell that's something we should fix13:22
mnaserhwoarang: yeah, and so if we don't collectively accept to fix those issues, even if its not the os we target13:22
mnaserthen we'll end up in the current state we're in13:23
mnaserlike todays issue with the git stuff for spice13:23
mnaserthat was nothing centos specific, it was just a weird git thing13:23
*** epalper has joined #openstack-ansible13:23
mnaseri ran it locally in a centos machine, saw the same problem, read online, learned about the .git, voila13:23
hwoarangso is that because i suggested to make centos -nv? it's already -nv on master so it was not a new thing13:23
hwoarangok13:23
mnaserhwoarang: sorry if this seems like it's aimed at you, that's not what i meant to go at13:24
mnaserthe state of where we're at just makes me as a centos deployer feel a bit as an outsider (and im sure suse feels the same too)13:24
hwoaranguntil we have full control of the repos, it's very hard to prevent distro jobs go non-voting13:24
hwoarangwe can simply mirror more stuff in the openstack infra13:25
mnaser++ absolutely13:25
hwoarangsuse and centos are prob outsiders because ubuntu is prob having more stable infra in openstack13:25
hwoarangwith mirroring of pretty much everything13:25
*** throwsb1 has joined #openstack-ansible13:26
mnaseryou are right on that, but we can work to make it stable, in puppet openstack world, centos is actaully the more stable one, so it is possible to have both13:26
hwoarangsee, centos often fails to fetch the percona packages from upstream. we can mirror that in infra... but needs someone to own this task :(13:26
mnaserbut yeah, the thing is: i can't imagine us ever going non voting for xenial because of an issue13:26
mnaserhwoarang: i'll try to talk to infra about getting that done13:26
hwoarangcopr repo fails quite often as well13:27
hwoarangso we need a bit of infra work for centos13:27
evrardjp+113:27
evrardjpI think copr is the worst contender13:27
mnaserif i have to host a mirror at vexxhost to make this go through quicker till we get it in infra, i don't mind doing that13:27
hwoarangbut i have to do that for suse too so my hands are already full :(13:27
mnaseroh absolutely, yeah13:28
mnaseri think there is very few centos deployers :(13:28
mnaserim not sure how we can mirror copr stuff13:28
evrardjpwhat was disabled in nova .git is the upgrades in that patch.13:28
evrardjpwhich makes sense, because if it wasn't nothing could ever get in, except if we start by the lower branch13:29
evrardjpwhich is not what we do13:29
evrardjpwe've backported too fast, once again, into lower branches, IMO.13:29
mnaserunless we can make nspawn the native choice and drop all of the extra lxc stuff13:29
evrardjpmnaser: that's not a problem, use the metal one13:29
mnaserthen we don't have to worry about any extra lxc packages13:29
evrardjpit's not better.13:30
mnaserevrardjp: true13:30
evrardjpyou still have copr issues13:30
evrardjpyou still have other issues of slowness13:30
mnaserhow come13:30
mnaseri thought we pulled lxc only from copr13:30
evrardjpwell let me double check if we don't set that to hosts anyway13:30
*** nicolasbock has joined #openstack-ansible13:30
evrardjpbut we never ran with only metal jobs13:31
hwoarangmaybe we can convince rdo to have lxc there :)13:31
mnaserhwoarang: haha lets start with uwsgi13:31
mnaser:p13:31
evrardjpcopr should not be an issue on metal13:32
evrardjpso it's only the rest.13:32
evrardjp(slowness)13:32
evrardjpbut I think that13:32
*** udesale has quit IRC13:32
evrardjpif we remove swift from the metal scenario13:32
evrardjpand we do different kind of jobs13:32
evrardjpit can help on the centos story13:32
mnaseri'm sorry for coming off a little rant-y, it's just a bit of the frustration of not feeling like we're moving forward13:32
evrardjpas swift is heavy ram user.13:32
evrardjpmnaser: oh but you're right, we are not moving forward on that point.13:33
mnaserwe can borrow a lot from puppet integration jobs, seriously, the jobs there never ever timeout13:33
evrardjpNo problem being ranty.13:33
mnaserwe have nailed it down to a solid hour that almost never fails, 30-40 minutes in ubuntu13:33
mnasertook a really long time, but yeah13:33
mnaserright now is probably not the time to see how we can improve things, lets start by fixing them and keep a close eye on the patch that evrardjp proposed13:33
evrardjpI have seen so many things in the past, I've helped a lot, and I got always backfired. At some point I just said that I didn't care about fixing the world for everyone.13:33
mnasermaybe add discuss ci solutions to agenda of next meeting13:34
evrardjpI don't have enough hours in my day to do all of this.13:34
mnasersame.. while this is an important part of what i do, it's not all :>13:34
odyssey4mewe go through a crisis like this every cycle13:34
hwoaranglol13:34
mnasermid...cycle..crisis?13:34
odyssey4mehahaha13:35
mnasertime to go buy shiny toys13:35
mnaser:P13:35
mnaserget me some of that kubernetes iot edge computing open infrastructure tooling to run our ci13:35
odyssey4methe fact is that the current deploy mechanism needs a revamp, perpetuating the current model while adding more and more code won't work - that's why we're trying to jam all these things in this cycle13:35
mnaserthat's cloud native too13:35
evrardjpwith nspawn13:35
evrardjp:p13:35
evrardjpand whatever runtime new13:36
evrardjpsr-criov13:36
*** jwitko_ has joined #openstack-ansible13:36
evrardjphahaha13:36
mnaserodyssey4me: thats a good point13:36
odyssey4mewe've been struggling to keep things good for greenfield and brownfield and evolve to improve13:36
mnaseri think something that would help us a lot is13:36
mnaserrunning integrated repo jobs on roles.13:36
odyssey4mewe're making progress, but these initiatives are all part of that change and need to happen13:36
mnaserwe would have never had this ci break if we were doing that13:36
mnaserin puppet world (sorry i keep bringing it up)13:36
evrardjpmnaser: I said that long ago :)13:36
evrardjpnobody is keen to it.13:37
odyssey4mesimplifying the way the source builds work is key, distro-based builds is key13:37
evrardjpI did the experimental job for it.13:37
evrardjpas a middle ground13:37
odyssey4meand until those are done, doing integrated repo builds on every role will slow us down to a crawl13:37
evrardjpbut we can make that a standard job, voting13:37
mnaserwe have multiple scenarios with multiple services.  we run only the scenarios that affect that specific role13:37
mnaserodyssey4me: that is true, i see your point13:37
odyssey4mewe've discussed that at the last PTG, and some suggestions were made13:37
mnaserrole development would be significantly impacted in terms of slow down13:37
evrardjpmnaser: it's just all part of a plan.13:37
evrardjpIt's slowly moving13:38
*** jwitko_ has quit IRC13:38
ansmithevrardjp, odyssey4me, mnaser: in looking at https://review.openstack.org/#/c/572703/ what might be difference between aio_lxc and aio_metal13:38
odyssey4meI'd like to get that going, but haven't the time right now... and it hinges on moving the source-based builds into the role anyway.13:38
mnaserodyssey4me: if you find out where to get some of that time, i'd like some too13:38
mnaser:P13:38
ansmithaio_lxc still shows rabbit auth errors while aio_metal looks good (both with ssl)13:39
*** jwitko_ has joined #openstack-ansible13:39
odyssey4meso, for now we're trying to press through these - and I'll personally change my attention after m3 to test improvement because that's where we need to start forucing on finding and fixing bugs13:39
hwoarangtrue story13:39
evrardjpthat was the plan for m313:40
evrardjpimproved testing13:40
evrardjpm1 and m2 were features.13:40
mnaserwell i guess it all circle back to us all agreeing to the same thing :)13:40
evrardjpyeah just don't worry13:40
evrardjplet's make things, it just needs time.13:40
odyssey4mewe're all busy, so reviews are perhaps getting approved a little too easily because our heads are not fully focused... perhaps we should learn that lesson now and get ourselves a little unbroken, then use that experimental job more diligently13:41
mnaser++13:41
mnaserthe two take aways is: big changes need discussion, ALWAYS make sure master for a backport has merged before +W (and i'm probably guilty of this too)13:41
evrardjpansmith: if you check previous run, it ran fine.13:42
evrardjpit just timed out13:42
evrardjpreally think twice before +w when someone -1 :p13:43
evrardjphaha13:43
evrardjpanyway13:43
evrardjpbionic, suse 15 are already pending too, so we'll get more distros thoroughly tested in m3.13:44
evrardjpWe need to make sure everything is fine, at all times.13:44
evrardjpthat's a lot of shared ownership13:44
ansmithevrardjp: looking at the rabbit logs for aio_lxc, there are auth errors, not seeing the auth failures in the aio_metal jub13:44
evrardjpoh13:45
evrardjpwill double check that then13:45
ansmithwas wondering if it was still an issue with still having the ssl query param in the transport_url but that should apply to both jobs13:45
*** hasseniu_ has quit IRC13:48
*** hassenius has joined #openstack-ansible13:49
evrardjpI think that patch simplified the vars, so now it's all about the roles that can be incorrect, or a variable that wasn't properly set13:56
evrardjpif you could have a look that would be nice13:56
*** dave-mccowan has joined #openstack-ansible13:58
*** rodolof has joined #openstack-ansible14:04
*** evin has quit IRC14:04
*** dave-mcc_ has joined #openstack-ansible14:06
*** dave-mccowan has quit IRC14:08
*** MikeW has joined #openstack-ansible14:09
MikeWWhat's the easiest way to add new containers to the inventory file? I'm having a brain issue I updated my openstack_user_config and ran openstack-hosts-setup to no avail14:10
evrardjpMikeW: extra containers for something new?14:11
evrardjpor something existing with more containers/more hosts?14:11
*** esberglu has joined #openstack-ansible14:14
MikeWevrardjp Yeah :)14:19
MikeWSomething new sorry14:19
MikeWJust read the top one14:19
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-rabbitmq_server master: Update rabbitmq to the latest stable release  https://review.openstack.org/57220714:25
*** mma has joined #openstack-ansible14:29
*** armaan has quit IRC14:30
*** armaan has joined #openstack-ansible14:32
*** mma has quit IRC14:33
*** mmalchuk_ has quit IRC14:36
*** sar has joined #openstack-ansible14:37
evrardjpMikeW: you can build your own env.d14:38
evrardjpit's documented14:38
evrardjpin our docs :)14:38
evrardjpelse, you can probably hack around using a static inventory14:38
MikeWOh yeah I know that I'm just trying to get this trove conatiners built, but they're not building for me14:38
evrardjpyou're on master/queens?14:39
evrardjpoh trove is not a new thing14:39
evrardjptrove should be in there14:39
MikeWSorry new for my env not a custom container my mistake :014:39
evrardjpyou didn't tell me which branch btw14:41
*** cjloader has joined #openstack-ansible14:42
*** lvdombrkr has quit IRC14:42
*** radek__ has quit IRC14:43
*** nurdie has joined #openstack-ansible14:43
mnasershucks14:46
mnaserceph failed14:46
*** shardy has quit IRC14:47
*** shardy has joined #openstack-ansible14:47
mnaserok does anyone know whats the deal with the no space left on device14:48
mnaserwe have 80g on the vms14:48
mnaserhow are we running out14:48
*** Bhujay has quit IRC14:53
spotzmnaser: I remember getting that back when we recommended 50 and I had more14:55
mnaseri'm just curious how that job runs out of disk and how we can fix it rather than throwing a recheck14:56
*** dave-mcc_ has quit IRC14:56
hwoarangiirc odyssey4me looked into that14:56
hwoarangsome cloud providers give two disks instead of one14:57
hwoarangthe 1st one is not that big and things do not fit there14:57
hwoarangbut i think we got past these issues :/14:57
*** rodolof has quit IRC14:58
mgariepyMikeW, did you test the internal CA stuff from the other day ?14:58
evrardjpmnaser: if you solve that, you're a winner, I buy you a chicken dinner!14:58
*** rodolof has joined #openstack-ansible14:59
evrardjpbecause I throw an extra thing on the dstat (the freespace plugin), but it doesn't show all FS. And I didn't get the chance to fork the plugin to make that work14:59
evrardjpbut to what I've seen, there was enough storage at the end of the build, so there is something taking space.14:59
evrardjpwonder if we have sparse swap files or things like that.15:00
mgariepythe virtual env does use the system CA bundle, (I use it for ldap cert in keystone container on my install and it works correctly AFAIK)15:00
evrardjphwoarang: that was one of the things that helped, but there are other issues15:00
ansmithevrardjp: I believe the auth errors in rabbit logs are for the notify transport, we are using same name but different passwords in the url, we should probably have separate user names for rpc/notify now they are separate15:02
ansmithI can update your patch15:02
*** rodolof has quit IRC15:03
*** rodolof has joined #openstack-ansible15:03
mnaserok it looks like this rax machine has 40g in xvda and 80gb in xvde15:05
mnaseri'm still not sure how we're eating up 40g though15:05
mnaserthats still a lot15:05
odyssey4memnaser rax provides a two disk setup - the others usually one, but in rax we use both disks15:05
odyssey4methat's not the issue at all15:05
odyssey4methe issue is only in containers, and only in the repo build15:06
mnaserodyssey4me: oh okay i see15:06
* mnaser thinks15:06
odyssey4mecloudnull has been trying to figure it out, because it only happens when using btrfs15:06
mnaseroh15:06
odyssey4methere's a long string of patches that have gone in15:06
mnaserbtrfs = an actual volume size right?15:06
mnaseri guess it's just the surprises of "oh, the ceph deploy job uses btrfs"15:06
odyssey4mehere's the most recent one: https://review.openstack.org/57230715:06
hwoarangi dont think it's related to ceph at all15:07
mnaserdo we see out of disk failures on any job other than cephs?15:07
odyssey4meno, nothing to do with ceph - it's the backing store for the containers15:07
*** dave-mccowan has joined #openstack-ansible15:07
hwoarangyes we see them randomly across aio jobs15:07
odyssey4memnaser yes, it randomly happens on any of the jobs deploying with containers15:07
cloudnullits an odd issue given that it only seems to happen in the gate.15:07
odyssey4mecloudnull except that I got one outside the gate the other day15:08
odyssey4meon a node with a single large enough disk15:08
cloudnulls/gate/rax gear/g15:08
odyssey4mewell, that could be a thing15:08
mnasertrying to formulate something in logstash15:08
mnaserto confirm our theory15:08
cloudnullthe latest change will ensure we're not duplicating the metadata which has been a source of fustration because it duplicates it by default.15:09
mnaserit looks like it happens *more* often with the ceph job15:10
mnaserbut happens with others too15:10
mnaserhttp://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22IOError%3A%20%5BErrno%2028%5D%20No%20space%20left%20on%20device%5C%2215:10
mnaseradd build_name field and select last 7 days15:10
mnasernode provider has been all rax, except for an nspawn related failure (but that might be btrfs related?)15:11
MikeWmgariepy Yeah we did15:18
MikeWmgariepy We ended up writing a playbook to go into each environment and update the certificate chain for certifi and httlib215:18
mgariepyMikeW, you add the cert in the virutal env ?15:18
MikeWmgariepy We opted not to add the cert to the virtual env, because we're going to pivot and use a public ca cert in the future15:19
mgariepyso you add the cert to the ca bundle of all the containers then ?15:19
MikeWmgariepy Yeah15:19
mgariepyok15:20
MikeWmgariepy It's not clean, and there's so many different things using their own chain that we decided we were making dumb technical debt... does that make any sense?15:20
MikeWAll in the name of saving like $40015:20
openstackgerritMohammed Naser proposed openstack/openstack-ansible master: Replace rabbitmq references with oslo messaging  https://review.openstack.org/57270315:20
mnaserevrardjp: made an update to your change because it failed because of out of disk anyways15:21
mnaserand added this .. https://review.openstack.org/#/c/572703/2..3/scripts/scripts-library.sh15:21
*** radek__ has joined #openstack-ansible15:23
*** pcaruana has quit IRC15:23
*** Leo_m has joined #openstack-ansible15:25
throwsb1Hey, I am deploying elk to a new environment and getting failure with missing index var in the journalbeat template.  I did compare with an install I did a day or so earlier and do the additional code.15:26
*** pvradu has quit IRC15:27
throwsb1I can just comment out the added code, but wanted to check if there is something else I am missing.15:27
evrardjpmnaser: I tried that in the past, but let's see if your more lucky15:28
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Set format options when prepairing filesystems  https://review.openstack.org/57230715:32
*** jbadiapa has quit IRC15:33
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible master: playbooks: default: Remove double backslash in repo URL  https://review.openstack.org/57281215:36
*** jeferobles has joined #openstack-ansible15:38
*** dxiri has joined #openstack-ansible15:39
*** epalper has quit IRC15:39
*** dxiri has quit IRC15:40
*** epalper has joined #openstack-ansible15:40
*** dxiri has joined #openstack-ansible15:40
openstackgerritMerged openstack/openstack-ansible-repo_build stable/pike: Updated spice-html5 git repository URL  https://review.openstack.org/57271515:49
*** chyka has joined #openstack-ansible15:49
openstackgerritAndy Smith proposed openstack/openstack-ansible-os_designate master: Update to use oslo.messaging services for RPC and Notify  https://review.openstack.org/57281615:50
*** radek__ has quit IRC15:58
*** epalper has quit IRC16:02
*** shardy has quit IRC16:03
*** shardy has joined #openstack-ansible16:04
*** jeferobles has quit IRC16:11
hwoarangcloudnull: why did you remove W+1 from https://review.openstack.org/#/c/572417/ ?16:15
*** gkadam has quit IRC16:15
hwoarangi guess either you or mnaser can actually give it a W+1 it should be ok :)16:15
cloudnull+16:15
mnaserso16:16
mnasera job failed because out of disk16:16
mnaserbut guess what we got16:16
mnaserhttp://logs.openstack.org/03/572703/3/check/openstack-ansible-deploy-aio_lxc-ubuntu-xenial/8fe7abf/logs/host/df.txt16:16
mnaser:)16:16
mnaserso we never ran out of disk space16:16
mnaser(we knew this, but at least this is confirmed now)16:17
spotzmnaser wow /dev/xvdd       516K  516K     0 100% /mnt/config16:17
mnaserthats configdrive16:17
hwoarangthat;s actually expected16:17
hwoarang(re config drive)16:17
spotzbleh TINY!!!!16:17
mnaserso this is an lxc job on xenial and 'ran out of disk' .. hmm16:17
odyssey4meyes, the issue is that the container ran out of disk16:18
mnasercontainers have disk quotas?16:18
mnaserTIL16:18
odyssey4methat's why all the patches have related to cgroups, file system limits, quotas, etc16:18
odyssey4mecloudnull has pretty much tried everything to eliminate the quota16:18
mnaseri still have a lot to learn ;x16:18
odyssey4methey only have quotas if you're using btrfs16:19
mnaserwe don't use btrfs in openstack-ansible-deploy-aio_lxc-ubuntu-xenial .. or do we?16:19
cloudnullmnaser http://logs.openstack.org/03/572703/3/check/openstack-ansible-deploy-aio_lxc-ubuntu-xenial/8fe7abf/logs/openstack/instance-info/btrfs_machines_df_16-02-16.log16:19
odyssey4meso we could actually just not use btrfs any more for now16:19
mnaseroh16:20
mnaserTIL about instance-info..16:20
cloudnullthe current hypothesis is that the metadata is filing up16:20
odyssey4methis is what activates it: https://github.com/openstack/openstack-ansible/blob/master/tests/roles/bootstrap-host/templates/user_variables.aio.yml.j2#L164-L16616:20
odyssey4meusing machinectl is the default for queens and master, which is where we see these issues16:20
cloudnullif you look at the various machines  files we can see that the metadata section is growing and I believe its filling when building the venvs because of all the little files it produces.16:21
odyssey4mecloudnull have you checked whether the machinectl template isn't perhaps the cause here?16:21
cloudnullnow metadat will grow dynamically however if the growth is too fast and we duplicate the metadata (default) it could fill16:22
mnasercloudnull: what command generates the brfs_lxc_usage16:22
mnaserit would maybe be beneficial to add it to the list of things i added like ps/df/etc16:22
cloudnullto see the quotas ?16:22
mnaserwhich getes generated at the end of the job rather than periodically16:22
mnasers/getes/gets/16:22
mnaserthat way we can clearly see if metadata is really full or not16:23
mnaserso what command creates http://logs.openstack.org/03/572703/3/check/openstack-ansible-deploy-aio_lxc-ubuntu-xenial/8fe7abf/logs/openstack/instance-info/btrfs_machines_df_16-02-16.log i guess16:23
cloudnullhttps://github.com/openstack/openstack-ansible/blob/master/scripts/scripts-library.sh#L336-L34616:23
mnaserok thats already logged at the end of the job16:24
cloudnullit should be logged periodically as the job runs16:26
mnaseri dont think it seems to run in gate_job_exit_tasks so ill add it there which run in post16:26
mnaserso it will run even if the job fails16:26
cloudnull++16:26
cloudnullodyssey4me I thought about that a bit.16:26
cloudnullI could make the machinectl template use additional options as it creates the subvolumes16:27
cloudnullthough that all should be taken care of with the global config16:27
cloudnullI think the easiest solution to this issue would be to change the build path.16:27
cloudnullwe build in tmp which is functional, but may be bad form in some environments given the fact a lot people set tmp to be non-executable16:28
*** jra has quit IRC16:29
openstackgerritMohammed Naser proposed openstack/openstack-ansible master: Replace rabbitmq references with oslo messaging  https://review.openstack.org/57270316:29
*** jra has joined #openstack-ansible16:29
mnaserrefactored to use the instance-info stuff cloudnull uses and run on exit to know the final result16:29
mnaserand added a few more useful things16:29
mnaserthat will be able to confirm our theories16:30
openstackgerritAntony Messerli proposed openstack/openstack-ansible-openstack_hosts stable/queens: Remove the old ocata uca sources.list  https://review.openstack.org/57282816:36
*** armaan has quit IRC16:38
*** armaan has joined #openstack-ansible16:38
*** smatzek has joined #openstack-ansible16:39
*** armaan has quit IRC16:43
*** smatzek has quit IRC16:52
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-repo_build master: Change build path from tmp to opt and disable COW  https://review.openstack.org/57283816:56
cloudnullodyssey4me ^ ]16:56
cloudnullmnaser, maybe that will help the situation ?16:57
*** mstrohl has joined #openstack-ansible16:58
odyssey4mecloudnull seems fine, just a little spelling error17:01
odyssey4meof course we can't verify whether that'll break anything until the rabbit issues are sortedout17:01
cloudnullyup17:02
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-repo_build master: Change build path from tmp to opt and disable COW  https://review.openstack.org/57283817:02
odyssey4mecloudnull missed one of the /tmp refs17:06
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-repo_build master: Change build path from tmp to opt and disable COW  https://review.openstack.org/57283817:07
cloudnullone more time around :)17:07
odyssey4melgtm17:10
*** jra has quit IRC17:11
*** mastrohl has joined #openstack-ansible17:11
*** jra has joined #openstack-ansible17:11
*** shardy has quit IRC17:13
*** rodolof has quit IRC17:13
*** rodolof has joined #openstack-ansible17:13
*** mstrohl has quit IRC17:16
*** mstrohl has joined #openstack-ansible17:16
*** MikeW has quit IRC17:17
*** mastrohl has quit IRC17:19
*** mastrohl has joined #openstack-ansible17:19
*** mstrohl has quit IRC17:21
*** erolg has quit IRC17:26
*** gyee has joined #openstack-ansible17:30
mnaserI’m just grabbing food and will be back17:34
*** chhagarw has quit IRC17:37
*** jra has quit IRC17:41
*** jra has joined #openstack-ansible17:41
* mnaser back17:42
mnaseris there a common knowledge for the failure of percona rpms because they show as 'unsigned' ?17:42
mnaser>Package percona-release-0.1-4.noarchwVFay_.rpm is not signed17:42
*** rodolof has quit IRC17:47
*** dave-mccowan has quit IRC17:52
*** prestonr83 has joined #openstack-ansible17:53
prestonr83Hello, I am staging an upgrade from Newton to Ocata and noticed when deploying 15.1.21 that l3 and metadata agents are now also being installed on compute hosts as well as within neutron agents containers on the controllers. Is this an intended change? Is there any info on why the change?17:55
*** rodolof has joined #openstack-ansible17:55
openstackgerritAndy Smith proposed openstack/openstack-ansible-os_designate master: Update to use oslo.messaging services for RPC and Notify  https://review.openstack.org/57281617:56
openstackgerritMerged openstack/openstack-ansible-os_ceilometer master: vars: Do not pull devel packages on distro installations  https://review.openstack.org/57204317:58
openstackgerritMohammed Naser proposed openstack/openstack-ansible-galera_server master: Stop installing percona-release and setup using yum_repository  https://review.openstack.org/57285518:01
mnaserthat's the percona issue fixed ^18:01
mnaserinside aio_metal it was failing because the security roles obviously ran there18:01
mnasercloudnull: if you got a few seconds of time, the nspawn jobs are fialing because of: No package matching 'ubuntu-cloud-keyring' is available .. i cant imagine it being too difficult to figure out whats wrong there18:02
mnaserim not sure why it cant find it :X18:02
openstackgerritMerged openstack/openstack-ansible stable/pike: Fix Git URL for SPICE to work with CentOS  https://review.openstack.org/57275818:05
openstackgerritMerged openstack/openstack-ansible stable/queens: Fix Git URL for SPICE to work with CentOS  https://review.openstack.org/57275718:05
*** radeks has joined #openstack-ansible18:06
*** DanyC has quit IRC18:07
mnasersweet. opensuse is running tempest right now, centos is nv but we cant see the progress18:08
*** poopcat has joined #openstack-ansible18:08
*** electrofelix has quit IRC18:10
mnasersuccesssssss yay18:10
mnasereverything is passing, just pending centos but that's non-voting.. can i get some reviews on https://review.openstack.org/#/c/572703/ to unbreak our gates please?18:15
spotzmnaser: done18:18
mnaserspotz: thanks, and thanks to evrardjp and ansmith in flushing this out18:19
* spotz claps and hi-5s18:20
*** DanyC has joined #openstack-ansible18:20
*** DanyC has quit IRC18:25
*** mma has joined #openstack-ansible18:30
*** mma has quit IRC18:35
*** dave-mccowan has joined #openstack-ansible18:39
*** radeks has quit IRC18:57
*** cjloader_ has joined #openstack-ansible18:58
*** cjloader has quit IRC18:58
cloudnullanyone want to give https://review.openstack.org/#/c/572838/ a nudge forward18:59
*** cjloader_ has quit IRC19:00
*** cjloader has joined #openstack-ansible19:00
*** erolg has joined #openstack-ansible19:07
*** dave-mccowan has quit IRC19:10
*** dave-mccowan has joined #openstack-ansible19:11
*** jra has quit IRC19:11
*** cjloader has quit IRC19:11
*** jra has joined #openstack-ansible19:12
*** cjloader has joined #openstack-ansible19:14
jamesdentonAny known issues with the repo-build playbook in queens (17.0.4) before i go down a rabbit hole?19:14
*** cjloader has quit IRC19:14
*** cjloader has joined #openstack-ansible19:15
mnaserjamesdenton: what error are you seeing19:15
*** radeks has joined #openstack-ansible19:17
jamesdentonRunning an AIO install. http://paste.openstack.org/show/722825/19:18
mgariepyhttps://github.com/openstack/openstack-ansible/commit/e80beff0be975f6f0fdd287b0177a479bc715c8519:20
mgariepyjamesdenton,19:20
mgariepy^^19:20
jamesdentonThank you. I'll take a look!19:24
mgariepyjamesdenton, you can check if the inventory-manager run correctly: /opt/openstack-ansible/scripts/inventory-manage.py -l19:27
*** weezS has joined #openstack-ansible19:28
cloudnullmnaser it needs a package update19:32
cloudnullRE: nspawn19:33
cloudnullits something odd when the cache gets added in19:33
cloudnullmnaser ive added and removed the package updates here https://review.openstack.org/#/c/568331/19:34
cloudnullsome conversations on if its needed or not19:34
cloudnulla few tasks before the proxy cache is added in but the cache seems to not be getting updated.19:35
cloudnullits strange, I've thought about running an update in the cache prep, though i don't really know whats best19:35
prometheanfirecloudnull: you get the email too?19:36
cloudnullabout the hard drives? yes, i got it yesterday19:37
openstackgerritMohammed Naser proposed openstack/openstack-ansible-tests stable/pike: Fix missing openstack_hosts_centos_mirror_url  https://review.openstack.org/57293219:38
*** rodolof has quit IRC19:38
mnaserplease return my hard drives pleas19:38
mnaserthanks19:38
mnaser:P19:39
*** rodolof has joined #openstack-ansible19:39
prometheanfiremnaser: but I needs them19:39
*** mastrohl has quit IRC19:39
mnaser:p19:39
mnaserhttps://review.openstack.org/#/c/572932/ fun nugget to speed up stable/pike and prevent timeouts19:40
prometheanfirenot needed for queens?19:40
prometheanfireah, tests19:40
mnaserprometheanfire: already was fixed in all the other branches, backport wasn't done right19:41
prometheanfireah19:41
mnaserso we were deploying from the intarwebs in pike19:41
prometheanfirepike is dead, long live the queen19:42
mnaseri agree but backports :<19:42
* mnaser is mostly doing it so less painful backports19:42
openstackgerritIlya Popov proposed openstack/openstack-ansible master: IP addresses in exaples were changed  https://review.openstack.org/57293519:43
openstackgerritMerged openstack/openstack-ansible-repo_build master: Change build path from tmp to opt and disable COW  https://review.openstack.org/57283819:45
cloudnull^ hopefully this helps our full fs issue19:45
prometheanfirecloudnull: mnaser can't cancel if I don't have an account I think19:46
cloudnullI had to  call19:46
* mnaser doesn't know what we're talking about19:46
prometheanfirecloudnull: k19:47
prometheanfiremnaser: :P19:47
cloudnullwallmart had a sale for 20 10TB drives for $600 yesterday19:47
cloudnullprometheanfire and I bought them19:47
cloudnullthey cancled the order.19:47
prometheanfirecloudnull: what number?19:47
cloudnullI call Walmart support19:48
prometheanfirek19:48
jamesdentonIs that what we're doing? Are we moving the Cloud to 20 10TB hard drives?19:49
cloudnullI would have19:49
cloudnullhad they honored my order :)19:49
openstackgerritMohammed Naser proposed openstack/openstack-ansible-galera_server master: Fix SSL support  https://review.openstack.org/57293919:49
cloudnullprometheanfire: 800-966-654619:49
openstackgerritMohammed Naser proposed openstack/openstack-ansible-galera_server master: Start gating Bionic for Galera  https://review.openstack.org/57294019:50
prometheanfirety19:50
*** dave-mcc_ has joined #openstack-ansible19:51
openstackgerritMohammed Naser proposed openstack/openstack-ansible-galera_server master: Add upgrade jobs to all supported operating systems  https://review.openstack.org/57294119:52
*** dave-mccowan has quit IRC19:53
openstackgerritMohammed Naser proposed openstack/openstack-ansible-galera_server master: Fix SSL support  https://review.openstack.org/57293919:55
openstackgerritMohammed Naser proposed openstack/openstack-ansible-galera_server master: Start gating Bionic for Galera  https://review.openstack.org/57294019:55
openstackgerritMohammed Naser proposed openstack/openstack-ansible-galera_server master: Add upgrade jobs to all supported operating systems  https://review.openstack.org/57294119:55
jamesdentonmgariepy I moved from tagged to stable/queens and that did the trick. thanks for the help19:59
openstackgerritMohammed Naser proposed openstack/openstack-ansible-galera_server master: Add gating for all supported OS for SSL  https://review.openstack.org/57294420:00
openstackgerritMohammed Naser proposed openstack/openstack-ansible-tests master: Add upgrade jobs for CentOS 7  https://review.openstack.org/57294520:02
openstackgerritMohammed Naser proposed openstack/openstack-ansible-galera_server master: Add upgrade jobs to all supported operating systems  https://review.openstack.org/57294120:04
openstackgerritMohammed Naser proposed openstack/openstack-ansible-galera_server master: Add gating for all supported OS for SSL  https://review.openstack.org/57294420:04
*** throwsb1 has quit IRC20:06
openstackgerritMohammed Naser proposed openstack/openstack-ansible-tests stable/pike: Fix missing openstack_hosts_centos_mirror_url  https://review.openstack.org/57293220:12
openstackgerritMohammed Naser proposed openstack/openstack-ansible-galera_server master: Remove verbose output from SSL job  https://review.openstack.org/57299420:15
*** dave-mcc_ has quit IRC20:15
*** radeks has quit IRC20:16
jrossercloudnull: half way there http://paste.openstack.org/show/722832/20:21
jrosserhorizon no longer crash/burn and the profile notifications are showing up in kibana20:21
cloudnulloh really ?20:22
*** jwitko__ has joined #openstack-ansible20:22
jrossermissing bit is the profiler panel in horizon stays empty20:22
jrosserno obvious errors there so it looks like its not quite hooked up to read from elasticsearch yet20:23
*** jwitko__ has quit IRC20:23
*** jwitko__ has joined #openstack-ansible20:24
jrossercloudnull: theres two completely independant bits of config, OPENSTACK_PROFILER and oslo cfg.CONF20:25
jrosserthe former drives the ui bits and the latter the underlying osprofiler lib20:25
openstackgerritMerged openstack/openstack-ansible master: Replace rabbitmq references with oslo messaging  https://review.openstack.org/57270320:26
*** jwitko_ has quit IRC20:26
cloudnulljrosser odd that you have to add the oslo config section into horizon to make that work ?20:30
openstackgerritMohammed Naser proposed openstack/openstack-ansible-galera_server master: Start gating Bionic for Galera  https://review.openstack.org/57294020:31
openstackgerritMohammed Naser proposed openstack/openstack-ansible-galera_server master: Add upgrade jobs to all supported operating systems  https://review.openstack.org/57294120:31
openstackgerritMohammed Naser proposed openstack/openstack-ansible-galera_server master: Fix SSL support  https://review.openstack.org/57293920:31
openstackgerritMohammed Naser proposed openstack/openstack-ansible-galera_server master: Add gating for all supported OS for SSL  https://review.openstack.org/57294420:31
*** jwitko__ has quit IRC20:31
*** ansmith has quit IRC20:31
jrossercloudnull: i think it's possibly that horizon may not use oslo.config at all20:32
jrosseras it's all a bunch of python config files20:32
*** radeks has joined #openstack-ansible20:32
*** dxiri has quit IRC20:32
jrosseri've not found a route in inject that config, so adding that in the local_settings.py effectively fakes having a .conf file20:33
openstackgerritMohammed Naser proposed openstack/openstack-ansible-galera_server master: Add upgrade jobs to all supported operating systems  https://review.openstack.org/57294120:37
openstackgerritMohammed Naser proposed openstack/openstack-ansible-galera_server master: Fix SSL support  https://review.openstack.org/57293920:37
openstackgerritMohammed Naser proposed openstack/openstack-ansible-galera_server master: Add gating for all supported OS for SSL  https://review.openstack.org/57294420:37
mnasersorry for zee spam20:39
mnaseri think i'm done20:39
*** chyka has quit IRC20:42
*** chyka has joined #openstack-ansible20:42
*** esberglu_ has joined #openstack-ansible20:42
*** esberglu has quit IRC20:44
*** jmnk has quit IRC20:46
*** dxiri has joined #openstack-ansible20:47
*** jwitko_ has joined #openstack-ansible20:55
*** esberglu_ has quit IRC20:56
*** weezS has quit IRC20:59
*** jmnk has joined #openstack-ansible21:01
*** radeks has quit IRC21:04
*** sar has quit IRC21:10
*** nicolasbock has quit IRC21:14
*** ansmith has joined #openstack-ansible21:22
openstackgerritAndy Smith proposed openstack/openstack-ansible master: Setup separate users for service RPC and Notify messaging  https://review.openstack.org/57301421:26
*** weezS has joined #openstack-ansible21:36
*** TxGirlGeek has joined #openstack-ansible21:41
*** DanyC has joined #openstack-ansible21:42
*** hassenius has quit IRC21:43
*** DanyC has quit IRC21:43
*** DanyC has joined #openstack-ansible21:43
*** DanyC has quit IRC21:44
*** DanyC has joined #openstack-ansible21:46
*** DanyC_ has joined #openstack-ansible21:47
cloudnullSpam away mnaser! ;)21:48
openstackgerritMerged openstack/openstack-ansible-os_nova stable/queens: Updated spice-html5 git repository URL  https://review.openstack.org/57241721:50
evrardjpok so if everything is fine tomorrow morning I will freeze and release m2.21:50
*** DanyC has quit IRC21:51
evrardjpI'm out for the rest of the day21:51
evrardjpttyl everyone!21:51
*** joe_w has quit IRC21:51
*** joe_w has joined #openstack-ansible21:52
*** joe_w has quit IRC21:53
*** cjloader_ has joined #openstack-ansible21:56
*** cjloader has quit IRC21:56
*** nurdie has quit IRC21:57
*** nurdie has joined #openstack-ansible21:58
*** Leo_m has quit IRC22:00
*** cjloader_ has quit IRC22:00
*** nurdie has quit IRC22:02
*** joe_w has joined #openstack-ansible22:09
*** joe_w has quit IRC22:09
*** weezS has quit IRC22:11
*** rodolof has quit IRC22:17
*** hassenius has joined #openstack-ansible22:18
*** hassenius has quit IRC22:23
openstackgerritMohammed Naser proposed openstack/openstack-ansible-galera_server master: Fix SSL support  https://review.openstack.org/57293922:26
*** joe_w has joined #openstack-ansible22:27
*** joe_w has quit IRC22:27
*** mgariepy has quit IRC22:29
*** mgariepy has joined #openstack-ansible22:30
openstackgerritMohammed Naser proposed openstack/openstack-ansible-tests stable/pike: Fix missing openstack_hosts_centos_mirror_url  https://review.openstack.org/57293222:30
openstackgerritMohammed Naser proposed openstack/openstack-ansible-tests stable/pike: Fix missing openstack_hosts_centos_mirror_url  https://review.openstack.org/57293222:31
openstackgerritMohammed Naser proposed openstack/openstack-ansible-tests stable/pike: Fix missing openstack_hosts_centos_mirror_url  https://review.openstack.org/57293222:31
mnaserhttps://review.openstack.org/#/q/topic:osa-gate-fix22:31
mnasergate should be much healthier with those22:31
mnaserill continue to track gate fixes under that topic as i catch more22:32
*** pmannidi has joined #openstack-ansible22:39
*** erolg has quit IRC22:39
*** joe_w has joined #openstack-ansible22:44
*** joe_w has quit IRC22:44
*** threestrands has joined #openstack-ansible22:51
*** nurdie has joined #openstack-ansible23:00
*** nurdie has quit IRC23:04
*** DanyC_ has quit IRC23:30
*** chyka has quit IRC23:31
*** tosky has quit IRC23:31
*** cjloader has joined #openstack-ansible23:31
*** cjloader has quit IRC23:37
*** TxGirlGeek has quit IRC23:48

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!