| ANKITA | even in containers i have to install nfs-commn to mount it manually | 00:00 |
|---|---|---|
| *** masber has joined #openstack-ansible | 00:21 | |
| *** weezS has quit IRC | 00:25 | |
| *** weezS_ has quit IRC | 00:25 | |
| *** dave-mccowan has joined #openstack-ansible | 00:31 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova master: tests: test-nova-upgrades.sh: Drop Ansible verbosity https://review.openstack.org/537379 | 00:32 |
| *** pmannidi has quit IRC | 00:37 | |
| *** pmannidi has joined #openstack-ansible | 00:40 | |
| *** weezS has joined #openstack-ansible | 00:42 | |
| *** lbragstad has quit IRC | 00:43 | |
| *** dave-mccowan has quit IRC | 00:53 | |
| *** weezS has quit IRC | 00:57 | |
| *** armaan has quit IRC | 01:00 | |
| *** acormier_ has quit IRC | 01:08 | |
| *** acormier has joined #openstack-ansible | 01:09 | |
| *** chyka_ has joined #openstack-ansible | 01:13 | |
| *** acormier has quit IRC | 01:13 | |
| *** acormier has joined #openstack-ansible | 01:14 | |
| *** acormier has quit IRC | 01:14 | |
| *** acormier has joined #openstack-ansible | 01:15 | |
| *** chyka has quit IRC | 01:16 | |
| *** dave-mccowan has joined #openstack-ansible | 01:18 | |
| *** ANKITA has quit IRC | 01:22 | |
| *** dave-mccowan has quit IRC | 01:29 | |
| *** woodard_ has joined #openstack-ansible | 01:39 | |
| *** woodard has quit IRC | 01:39 | |
| *** chyka_ has quit IRC | 01:49 | |
| *** chyka has joined #openstack-ansible | 01:50 | |
| *** chyka has quit IRC | 01:55 | |
| *** armaan has joined #openstack-ansible | 01:55 | |
| *** esberglu has quit IRC | 02:04 | |
| *** esberglu has joined #openstack-ansible | 02:04 | |
| *** jafeha has joined #openstack-ansible | 02:08 | |
| *** esberglu has quit IRC | 02:09 | |
| *** jafeha__ has quit IRC | 02:10 | |
| *** weezS has joined #openstack-ansible | 02:14 | |
| *** vishwanathj has joined #openstack-ansible | 02:20 | |
| *** esberglu has joined #openstack-ansible | 02:31 | |
| *** esberglu has quit IRC | 02:39 | |
| *** esberglu has joined #openstack-ansible | 02:40 | |
| *** ANKITA has joined #openstack-ansible | 02:41 | |
| *** weezS has quit IRC | 02:41 | |
| *** esberglu has quit IRC | 02:44 | |
| *** lbragstad has joined #openstack-ansible | 03:01 | |
| *** dave-mccowan has joined #openstack-ansible | 03:10 | |
| *** gkadam has joined #openstack-ansible | 03:39 | |
| *** acormier has quit IRC | 03:50 | |
| *** esberglu has joined #openstack-ansible | 03:51 | |
| *** esberglu has quit IRC | 03:56 | |
| *** jafeha__ has joined #openstack-ansible | 04:03 | |
| *** jafeha has quit IRC | 04:04 | |
| *** chyka has joined #openstack-ansible | 04:06 | |
| *** chyka has quit IRC | 04:10 | |
| *** udesale has joined #openstack-ansible | 04:13 | |
| *** lbragstad has quit IRC | 04:26 | |
| cloudnull | evenings | 04:38 |
| *** esberglu has joined #openstack-ansible | 04:48 | |
| *** esberglu has quit IRC | 04:52 | |
| idlemind | o7 | 04:54 |
| prometheanfire | o7 cmdr | 04:55 |
| *** dave-mccowan has quit IRC | 05:02 | |
| *** poopcat has quit IRC | 05:02 | |
| ANKITA | GE cloudnull thanks for the help; guidance & support odyssey4me; evrardjp and all members frm d community despite of my limited knowledge; have finally completed the deployment | 05:07 |
| ANKITA | have a g8 day | 05:07 |
| ANKITA | TONS OF GRATITUDE | 05:09 |
| ANKITA | FOUND https://docs.openstack.org/openstack-ansible/pike/contributor/inventory-and-vars.html TO BE HELPFUL | 05:14 |
| *** dariko has joined #openstack-ansible | 05:16 | |
| *** gkadam has quit IRC | 05:43 | |
| *** gkadam has joined #openstack-ansible | 05:44 | |
| *** gokhan has joined #openstack-ansible | 06:01 | |
| *** dariko has quit IRC | 06:01 | |
| *** hybridpollo has quit IRC | 06:19 | |
| *** sxc731 has joined #openstack-ansible | 06:40 | |
| ANKITA | path for /openstack/log/ansible-logging/ansible.log | 06:42 |
| *** jafeha__ is now known as jafeha | 06:45 | |
| jafeha | good morning everybody | 06:45 |
| *** sar has quit IRC | 06:51 | |
| *** acormier has joined #openstack-ansible | 06:51 | |
| *** chyka has joined #openstack-ansible | 06:55 | |
| *** acormier has quit IRC | 06:55 | |
| *** chyka has quit IRC | 06:59 | |
| *** sxc731 has quit IRC | 07:00 | |
| *** Sha000000 has joined #openstack-ansible | 07:05 | |
| Taseer | evrardjp: Good morning ! any reservations => https://review.openstack.org/#/c/503971/ | 07:09 |
| Taseer | > | 07:10 |
| *** threestrands has quit IRC | 07:10 | |
| *** sar has joined #openstack-ansible | 07:19 | |
| openstackgerrit | Maxime Guyot proposed openstack/openstack-ansible master: Ceph RadosGW integration https://review.openstack.org/517856 | 07:32 |
| *** gkadam has quit IRC | 07:34 | |
| *** gkadam has joined #openstack-ansible | 07:34 | |
| *** SmearedBeard has joined #openstack-ansible | 07:35 | |
| *** pcaruana has joined #openstack-ansible | 07:35 | |
| openstackgerrit | Gökhan proposed openstack/openstack-ansible-os_ceilometer master: Deprecate os_endpoint_type option Option "os_endpoint_type" from groups "service_credentials" and "keystone_authtoken" is deprecated[1]. Use option "interface" from groups "service_credentials" and "keystone_authtoken". https://review.openstack.org/521857 | 07:42 |
| *** alex___ has joined #openstack-ansible | 07:43 | |
| *** alex___ is now known as fusmu | 07:43 | |
| *** Sha000000 has quit IRC | 07:47 | |
| *** mbuil has joined #openstack-ansible | 07:54 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: [Docs] Promote scale the environment https://review.openstack.org/545592 | 07:58 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: [Docs] Promote Backup and Restore https://review.openstack.org/545593 | 07:58 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: [Docs] Flatten out maintenance task https://review.openstack.org/545597 | 07:58 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: [Docs] Move upgrade guides into ops https://review.openstack.org/545664 | 08:02 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: [Docs] Move upgrade guides into ops https://review.openstack.org/545664 | 08:03 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: [Docs] Migrate CLI reference to reference guide https://review.openstack.org/545790 | 08:03 |
| *** epalper has joined #openstack-ansible | 08:04 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: [Docs] Simplify advanced config https://review.openstack.org/545795 | 08:09 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: [Docs] Merge advanced configuration into reference https://review.openstack.org/545805 | 08:10 |
| openstackgerrit | Merged openstack/openstack-ansible master: [Docs] Promote scale the environment https://review.openstack.org/545592 | 08:20 |
| openstackgerrit | Merged openstack/openstack-ansible master: [Docs] Promote Backup and Restore https://review.openstack.org/545593 | 08:24 |
| openstackgerrit | Merged openstack/openstack-ansible master: [Docs] Flatten out maintenance task https://review.openstack.org/545597 | 08:24 |
| openstackgerrit | Merged openstack/openstack-ansible master: [Docs] Move upgrade guides into ops https://review.openstack.org/545664 | 08:24 |
| openstackgerrit | Merged openstack/openstack-ansible master: [Docs] Migrate CLI reference to reference guide https://review.openstack.org/545790 | 08:26 |
| *** sxc731 has joined #openstack-ansible | 08:26 | |
| openstackgerrit | Merged openstack/openstack-ansible master: [Docs] Simplify advanced config https://review.openstack.org/545795 | 08:32 |
| *** fusmu has quit IRC | 08:32 | |
| *** fusmu_ has joined #openstack-ansible | 08:32 | |
| openstackgerrit | Merged openstack/openstack-ansible master: [Docs] Merge advanced configuration into reference https://review.openstack.org/545805 | 08:35 |
| openstackgerrit | Gökhan proposed openstack/openstack-ansible-os_ceilometer master: Deprecate os_endpoint_type option Option "os_endpoint_type" from groups "service_credentials" and "keystone_authtoken" is deprecated[1]. Use option "interface" from groups "service_credentials" and "keystone_authtoken". https://review.openstack.org/521857 | 08:36 |
| gunix | odyssey4me: cloudnull: i left that centos to do osa aio over night and it freezed on isntalling yum packages. i found a quick solution. i deleted the centos7 vm and i am installing in ubuntu. | 08:36 |
| openstackgerrit | Gökhan proposed openstack/openstack-ansible-os_ceilometer master: Deprecate os_endpoint_type option Option "os_endpoint_type" from groups "service_credentials" and "keystone_authtoken" is deprecated[1]. Use option "interface" from groups "service_credentials" and "keystone_authtoken". https://review.openstack.org/521857 | 08:38 |
| *** chyka has joined #openstack-ansible | 08:44 | |
| *** gokhan has quit IRC | 08:45 | |
| *** chyka has quit IRC | 08:49 | |
| kklimonda | how can I apply a patch for neutron/use a custom neutron package? | 08:49 |
| Miouge | kklimonda: you can specify a custom repo & branch with neutron_git_repo and neutron_git_install_branch see https://docs.openstack.org/openstack-ansible-os_neutron/latest/ | 08:51 |
| kklimonda | thanks | 08:51 |
| Miouge | kklimonda: I think that it is used only if “neutron_developer_mode: true”, so probably not suitable for a production setup. | 08:53 |
| *** armaan has quit IRC | 09:00 | |
| *** armaan has joined #openstack-ansible | 09:01 | |
| *** shardy has joined #openstack-ansible | 09:09 | |
| *** pmannidi has quit IRC | 09:16 | |
| *** Sha000000 has joined #openstack-ansible | 09:19 | |
| kklimonda | bummer | 09:30 |
| *** indistylo has joined #openstack-ansible | 09:32 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova master: Remove systemd conditionals https://review.openstack.org/544987 | 09:39 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova master: Stop running non-voting jobs in gate https://review.openstack.org/543486 | 09:40 |
| *** aruns has joined #openstack-ansible | 09:40 | |
| *** aruns has quit IRC | 09:40 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova master: Change include: to include_tasks: https://review.openstack.org/544986 | 09:41 |
| *** aruns has joined #openstack-ansible | 09:41 | |
| *** indistylo has quit IRC | 09:42 | |
| *** aruns has quit IRC | 09:45 | |
| *** indistylo has joined #openstack-ansible | 09:46 | |
| *** ankita_ has joined #openstack-ansible | 09:49 | |
| *** ankita_ has quit IRC | 09:49 | |
| openstackgerrit | Taseer Ahmed proposed openstack/openstack-ansible master: Integrate Congress with OSA. https://review.openstack.org/503971 | 09:50 |
| *** Sha000000 has quit IRC | 09:53 | |
| *** aruns has joined #openstack-ansible | 09:58 | |
| *** indistylo has quit IRC | 10:00 | |
| odyssey4me | ANKITA hooray!\ | 10:15 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova stable/queens: Add SELinux contexts for nova log directory https://review.openstack.org/546103 | 10:20 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova stable/queens: tests: test-nova-upgrades.sh: Drop Ansible verbosity https://review.openstack.org/546104 | 10:21 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova stable/pike: tests: test-nova-upgrades.sh: Drop Ansible verbosity https://review.openstack.org/546105 | 10:21 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_build master: [WIP] Make the git clone and wheel build optional https://review.openstack.org/537015 | 10:30 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_build master: Ensure virtualenv is not broken for CentOS/SuSE too https://review.openstack.org/545991 | 10:34 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_build master: [WIP] Make the git clone and wheel build optional https://review.openstack.org/537015 | 10:34 |
| ThomasS | hi | 10:38 |
| odyssey4me | evrardjp hwoarang I'd like to get https://review.openstack.org/545849 merged asap to prevent any confusion. If you could take a peek that'd be great. | 10:40 |
| odyssey4me | also https://review.openstack.org/545697 needs one more review | 10:41 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: Stop running non-voting jobs in gate https://review.openstack.org/546109 | 10:42 |
| *** jamespage has quit IRC | 10:43 | |
| hwoarang | ok | 10:43 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: Add SELinux contexts for neutron log directory https://review.openstack.org/545884 | 10:44 |
| *** jamespage has joined #openstack-ansible | 10:46 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/pike: Ensure that constraints are used for AIO bootstrap https://review.openstack.org/545894 | 10:47 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/ocata: Ensure that constraints are used for AIO bootstrap https://review.openstack.org/545895 | 10:47 |
| odyssey4me | thanks evrardjp hwoarang - one more bug fix which needs to get back into queens: https://review.openstack.org/545991 | 10:53 |
| odyssey4me | I just rebased it a moment ago which is why it's still running tests. | 10:54 |
| *** fusmu_ has quit IRC | 10:59 | |
| hwoarang | hmm i thought i voted on it | 10:59 |
| *** gkadam has quit IRC | 11:06 | |
| *** gkadam has joined #openstack-ansible | 11:07 | |
| odyssey4me | hwoarang this is a follow-on from another patch which you may have voted on | 11:08 |
| *** pbandark has joined #openstack-ansible | 11:09 | |
| *** gkadam has quit IRC | 11:12 | |
| *** gkadam has joined #openstack-ansible | 11:12 | |
| *** foutatoro has joined #openstack-ansible | 11:14 | |
| *** gkadam has quit IRC | 11:18 | |
| *** aruns__ has joined #openstack-ansible | 11:19 | |
| *** aruns has quit IRC | 11:22 | |
| *** armaan has quit IRC | 11:23 | |
| *** gkadam has joined #openstack-ansible | 11:30 | |
| hwoarang | odyssey4me: hmm some of the jobs still fail on the upgrade test | 11:40 |
| hwoarang | but sometimes they also pass | 11:40 |
| hwoarang | veeeeeery strange | 11:40 |
| odyssey4me | some depend on others having the right things done - eg: nova need neutron/glance/keystone to be right before it works right | 11:41 |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia stable/queens: Updated from OpenStack Ansible Tests https://review.openstack.org/544932 | 11:41 |
| odyssey4me | but yeah, there are still some jobs failing, and I unfortunately don't have time right now to look into it - evrardjp knows the reasons for those failures and has patched many of them up, so maybe looking into those patches would give the right clues | 11:42 |
| *** armaan has joined #openstack-ansible | 11:42 | |
| odyssey4me | hwoarang for https://review.openstack.org/545991 I wasn't sure if ansible_plg_mgr was the best way to do the platform differentiation - suggestions are welcome | 11:43 |
| *** udesale has quit IRC | 11:43 | |
| *** stuartgr has joined #openstack-ansible | 11:43 | |
| hwoarang | yeah should be fine | 11:51 |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova master: Stop running non-voting jobs in gate https://review.openstack.org/543486 | 12:04 |
| *** rpittau has quit IRC | 12:05 | |
| *** acormier has joined #openstack-ansible | 12:06 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova stable/queens: Stop running non-voting jobs in gate https://review.openstack.org/546128 | 12:06 |
| *** gkadam has quit IRC | 12:06 | |
| *** acormier has quit IRC | 12:06 | |
| *** acormier has joined #openstack-ansible | 12:07 | |
| openstackgerrit | Periyasamy Palanisamy proposed openstack/openstack-ansible master: Make Opendaylight as the BGP speaker using Quagga https://review.openstack.org/523907 | 12:16 |
| openstackgerrit | Periyasamy Palanisamy proposed openstack/openstack-ansible master: Make Opendaylight as the BGP speaker using Quagga https://review.openstack.org/523907 | 12:20 |
| *** gkadam has joined #openstack-ansible | 12:22 | |
| *** chyka has joined #openstack-ansible | 12:25 | |
| *** chyka has quit IRC | 12:30 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_tempest master: Use realpath filter instead of the stat/dir dance https://review.openstack.org/545829 | 12:31 |
| *** sxc731 has quit IRC | 12:32 | |
| *** foutatoro has quit IRC | 12:36 | |
| openstackgerrit | Merged openstack/openstack-ansible master: Replace host_need_pip with standard override mechanism https://review.openstack.org/545697 | 12:37 |
| *** acormier has quit IRC | 12:37 | |
| *** acormier has joined #openstack-ansible | 12:37 | |
| *** acormier has quit IRC | 12:42 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_magnum stable/pike: Zuul: Remove project name https://review.openstack.org/538642 | 12:42 |
| *** indistylo has joined #openstack-ansible | 12:49 | |
| *** aruns__ has quit IRC | 12:51 | |
| *** sm806 has joined #openstack-ansible | 12:54 | |
| JohnnyOSA | Hello all. Have a question about my OSA deploy configuration (see: http://paste.openstack.org/show/678432/) | 12:59 |
| JohnnyOSA | I have a flat provider network I plan on using for both a floating IP range to for an IP for the external lb vip address using ens3 (untagged). | 13:00 |
| JohnnyOSA | (..."and for" rather than "to for"...) | 13:01 |
| JohnnyOSA | ens3 is captured by br-vlan to map the floating ip network range with neutron, and the haproxy_keepalived_external_interface is set to br-vlan | 13:02 |
| JohnnyOSA | The default gateway in the interfaces file is the management network's gateway, 172.29.236.1, which is routable to the internet. | 13:04 |
| *** sm806_ has joined #openstack-ansible | 13:05 | |
| JohnnyOSA | Most everything seems to work ok, except for Horizon. Without a few extra "ip route" and "ip rule" commands which are seen in the paste above under the br-vlan device, the external lb VIP is accessible only from the same subnet that the external VIP is on (10.9.198.0/24). | 13:06 |
| *** sm806 has quit IRC | 13:06 | |
| *** sm806_ has quit IRC | 13:06 | |
| JohnnyOSA | This appears to be due to a source-routing issue where an incoming http/s request to the external LB VIP leaves the haproxy server out the default gateway (172.29.236.1) rather than the same interface that the external VIP is on, and that traffic then appears to get dropped. | 13:08 |
| JohnnyOSA | (before it reaches the requesting computer). | 13:09 |
| JohnnyOSA | If I add a few lines to the configuration for br-vlan, such as ip route and ip rule see in the paste, to ensure that traffic coming into the br-vlan interface leaves also leaves the br-vlan interface on an appropriate gateway rather than a different interfaces gateway, I can get to Horizon just fine from other external subnets. | 13:11 |
| *** sm806 has joined #openstack-ansible | 13:11 | |
| JohnnyOSA | However, the issue now is that Horizon throws 504 page response timeouts on certain Horizon pages, such as the network topology page and the keypair page | 13:12 |
| *** sm806 has quit IRC | 13:15 | |
| JohnnyOSA | Is there a better approach than what I'm doing here? Has anyone else run into what seems like a source-routing issue like this? | 13:15 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_nova master: Updated from global requirements https://review.openstack.org/535067 | 13:16 |
| *** sm806 has joined #openstack-ansible | 13:16 | |
| *** chyka has joined #openstack-ansible | 13:17 | |
| JohnnyOSA | (will be on road shortly -- be back soon) | 13:17 |
| mhayden | buenos dias | 13:20 |
| *** chyka has quit IRC | 13:22 | |
| *** acormier has joined #openstack-ansible | 13:22 | |
| mhayden | evrardjp: i can go change some of these to "import_tasks" but i had some peculiar results when i did that in ansible-hardening https://review.openstack.org/544986 | 13:26 |
| evrardjp | mhayden: could you link to the ansible-hardening attempt? That's the nova change. | 13:27 |
| *** acormier has quit IRC | 13:27 | |
| mhayden | the ansible-hardening one was the one we reverted ;) | 13:27 |
| evrardjp | link? | 13:28 |
| evrardjp | let me find that | 13:28 |
| * mhayden searches | 13:28 | |
| mhayden | https://review.openstack.org/#/c/534327/ | 13:28 |
| mhayden | bah, CI jobs are missing | 13:29 |
| evrardjp | mhayden: I am confused | 13:29 |
| evrardjp | I thought the revert was to support more than ansible 2.4 | 13:29 |
| mhayden | the revert removed the patch entirely | 13:30 |
| mhayden | and restored the warnings | 13:30 |
| mhayden | and ansible < 2.4 support | 13:30 |
| evrardjp | ok so I was right on that part. | 13:31 |
| mhayden | generally you want to use import_tasks where you once used "static: yes" | 13:31 |
| evrardjp | yes. | 13:31 |
| mhayden | include_tasks is where you would have used static: no | 13:31 |
| evrardjp | that's true | 13:31 |
| evrardjp | and? | 13:31 |
| mhayden | so on the nova patch, you suggested using import_tasks more often | 13:31 |
| evrardjp | anything that should be serialized is import_task | 13:31 |
| mhayden | which is okay, but that might break | 13:31 |
| evrardjp | well | 13:31 |
| evrardjp | my question is why | 13:32 |
| *** sm806 has quit IRC | 13:32 | |
| mhayden | i have the same question :P | 13:32 |
| mhayden | it seems to break things in odd ways | 13:32 |
| *** sm806 has joined #openstack-ansible | 13:32 | |
| sm806 | In my compute node i see this error been printed in /var/log/neutron/neutron-openvswitch-agent.log --> "Bridge br-vlan for physical network vlan does not exist. Agent terminated!" | 13:32 |
| sm806 | I have not configured anible to use ovs. So i am hoping my openstack setup would use only linux bridges. I see this issue with vlan network only. vxlan and flat network seems to be working fine. | 13:33 |
| sm806 | Logs, "brctl show" and "ovs-vsctl show" --> https://paste.ubuntu.com/p/FqGHf9J3T6/ | 13:33 |
| evrardjp | I thought the jinja in the filenames was now allowed with import. | 13:33 |
| mhayden | sm806: do you have a bridge called "br-vlan"? | 13:33 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tempest stable/queens: Use realpath filter instead of the stat/dir dance https://review.openstack.org/546147 | 13:33 |
| evrardjp | anyway | 13:33 |
| mhayden | evrardjp: well, i could flip them all to "import" and then change the ones that need to be changed | 13:33 |
| evrardjp | do what you want :) | 13:33 |
| * mhayden has the powerrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr | 13:34 | |
| sm806 | mhayden : yes its is created as linuxbridge. Looks like it is looking for a ovs bridge !!! | 13:34 |
| mhayden | sm806: that is a bit unusual | 13:34 |
| evrardjp | mhayden: you already had it. | 13:34 |
| evrardjp | it's called +w . | 13:34 |
| mhayden | sm806: so you want to use linuxbridge exclusively? no OVS at all? | 13:34 |
| sm806 | mhayden : yes i want try our linuxbridge only for now. | 13:35 |
| mhayden | sm806: here's my global_overrides from /etc/openstack_deploy/openstack_user_config.yml https://paste.fedoraproject.org/paste/DUIl-nqUTCnQoyhFUlnzBA/raw | 13:36 |
| mhayden | i am using linuxbridge only | 13:36 |
| mhayden | sm806: i believe the "group_binds" is what controls that | 13:36 |
| mhayden | but it's been a while since i've dug into that | 13:37 |
| openstackgerrit | Merged openstack/openstack-ansible stable/pike: Update all SHAs for 16.0.9 https://review.openstack.org/545410 | 13:38 |
| *** woodard_ has quit IRC | 13:38 | |
| *** woodard has joined #openstack-ansible | 13:39 | |
| mhayden | evrardjp: also, on the CentOS + AIO basekit, i figured it might be a nice way to get CentOS into a voting gate | 13:39 |
| mhayden | since it reduces the services it deploys | 13:39 |
| sm806 | mhayden : https://paste.fedoraproject.org/paste/W1r-7KKAYQ9CcvgggvVklA this is my openstack_user_config.yml | 13:39 |
| * mhayden ganders | 13:39 | |
| mhayden | sm806: okay, that looks fine | 13:40 |
| mhayden | how about user_variables.yml? | 13:41 |
| mhayden | feel free to mask/hide anything sensitive in there ;) | 13:41 |
| sm806 | mhayden: this is my user_variahles.yml https://paste.fedoraproject.org/paste/tTzpI6RWf70lT55-eo13Lw | 13:44 |
| sm806 | mhayden: most of the options are commented :) | 13:44 |
| mhayden | taking a look | 13:45 |
| mhayden | hmm, i don't see any neutron ml2 stuff set there, so you should get linuxbridge by default | 13:45 |
| mhayden | sm806: which branch are you dploying? | 13:45 |
| sm806 | i am using pike. | 13:46 |
| sm806 | mhayden : i tried to enable ovs in my setup few days back. Ran to some issues and i reverted back to linuxbridge. | 13:48 |
| *** esberglu has joined #openstack-ansible | 13:48 | |
| sm806 | mhayden : reverted to my previous openstack_user_config.yml anduser_variables.yml version. | 13:49 |
| sm806 | reinstalled ubuntu in my infra and compute nodes and re-executed the anisible playbooks | 13:49 |
| *** chyka has joined #openstack-ansible | 13:50 | |
| sm806 | before re-executing the playbooks, i cleaned up following files and dirs -- cd /etc/openstack_deploy; rm -rf ansible_facts; rm backup_openstack_inventory.tar; rm openstack_hostnames_ips.yml; rm openstack_inventory.json | 13:52 |
| openstackgerrit | Merged openstack/openstack-ansible-os_tempest master: Updated from OpenStack Ansible Tests https://review.openstack.org/544663 | 13:55 |
| *** chyka has quit IRC | 13:55 | |
| *** Smeared_Beard has joined #openstack-ansible | 13:56 | |
| mhayden | sm806: ah, did you go out and manually stop those ovs services? | 13:56 |
| mhayden | the ansible playbooks won't go and shut them off if they were started previously | 13:56 |
| mhayden | you'll need to manually stop/disable them | 13:56 |
| *** electrofelix has quit IRC | 13:57 | |
| *** SmearedBeard has quit IRC | 13:57 | |
| *** Sha000000 has joined #openstack-ansible | 13:58 | |
| *** dave-mccowan has joined #openstack-ansible | 13:59 | |
| sm806 | mhayden: I reinstalled ubuntu on the infra and compute hosts.So expected ansible script wont install them if ovs is not enabled in config files. | 14:00 |
| sm806 | i see ovs is running in the host. I will stop them and try creating a vlan network | 14:01 |
| sm806 | mhayden : looks like neutron ovs agent plugin is still trying to contact ovs service. | 14:04 |
| sm806 | https://paste.fedoraproject.org/paste/oIM~DT2fMQHOYNnxtGznmQ | 14:05 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: Set SELinux to permissive mode for tests https://review.openstack.org/546153 | 14:05 |
| sm806 | i stoped ovs service using "/etc/init.d/openvswitch-switch stop" | 14:05 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible master: Set SELinux to permissive mode for tests https://review.openstack.org/546155 | 14:08 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible master: Use aio_basekit scenario for CentOS 7 https://review.openstack.org/545455 | 14:10 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible master: Use package_state=present for CentOS 7 testing https://review.openstack.org/541017 | 14:11 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible master: CentOS 7 integrated gate optimization https://review.openstack.org/545455 | 14:13 |
| mhayden | sm806: i'm not entirely sure what to do there | 14:14 |
| mhayden | you may want to look under /etc/neutron to ensure there's not an ovs-related configuration file there | 14:14 |
| *** aruns__ has joined #openstack-ansible | 14:15 | |
| *** indistylo has quit IRC | 14:17 | |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible master: CentOS 7 integrated gate optimization https://review.openstack.org/545455 | 14:25 |
| evrardjp | dear cloudnull, DimGR, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, mhayden, scarlisle, luckyinva, ntt, javeriak, spotz, vdo, jmccrory, alextricity25, jasondotstar, admin0, michaelgugino, ametts, bgmccollum, darrenc, JRobinson__, asettle, | 14:25 |
| evrardjp | colinmcnamara, thorst, adreznec, eil397, qwang,nishpatwa_, cathrichardson, drifterza, hwoarang, cshen, ullbeking | 14:25 |
| evrardjp | the osa bug triage will start in 1h30'. Please have a look at the bug list before starting: https://etherpad.openstack.org/p/osa-bugtriage | 14:25 |
| *** lbragstad has joined #openstack-ansible | 14:29 | |
| JohnnyOSA | Re: my query above on flat routing. I'm making an assumption that the ip route/rule additions to the interfaces file caused the Horizon 504 timeouts on select pages since those errors happened as soon as I introduced rules/route cmds. I'll verify that by removing and seeing if the 504 Horizon errors disappear. If not, I'll start looking for another root cause. | 14:29 |
| *** jwitko_ has joined #openstack-ansible | 14:29 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova master: Remove systemd conditionals https://review.openstack.org/544987 | 14:30 |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova stable/pike: tests: test-nova-upgrades.sh: Drop Ansible verbosity https://review.openstack.org/546105 | 14:30 |
| *** sar has quit IRC | 14:34 | |
| *** gillesMo has joined #openstack-ansible | 14:36 | |
| gillesMo | Hello, After an upgrade from Ocata to Pike, My Ceph cluster has been upgraded from jewel to luminous. But... There's no ceph-mgr started, the cluster is not healthy, and I cant' see any pool... I can't see if there is something to add in openstack_user_config.yml to add ceph mgr demons | 14:39 |
| *** Sha000000 has quit IRC | 14:43 | |
| evrardjp | git-harry: could you file a bug in OSA for your galera issue? | 14:52 |
| *** acormier has joined #openstack-ansible | 14:52 | |
| evrardjp | this way we can track it at both ways | 14:52 |
| evrardjp | also I'd add it to the triage of today | 14:52 |
| *** udesale has joined #openstack-ansible | 14:56 | |
| *** indistylo has joined #openstack-ansible | 14:56 | |
| *** aruns__ has quit IRC | 14:58 | |
| evrardjp | git-harry: wrong wording on my side, maybe that's clearer: https://review.openstack.org/#/c/545844/1 | 15:01 |
| *** gokhan has joined #openstack-ansible | 15:02 | |
| *** kstev has joined #openstack-ansible | 15:26 | |
| *** armaan has quit IRC | 15:30 | |
| *** indistylo has quit IRC | 15:46 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova master: Updated from global requirements https://review.openstack.org/535067 | 15:47 |
| *** sxc731 has joined #openstack-ansible | 15:53 | |
| gillesMo | Anyone using Ceph Luminous deployed with openstack-ansible (>pike) ? | 15:54 |
| evrardjp | gillesMo: yeah there are ppl like logan- andymccr | 15:57 |
| shananigans | Very happy to see the ssh retries being updated as its a pain on every build. Upping the hosts MaxStartups and MaxSessions seems to help a lot in the ssh connection issues as well. | 15:58 |
| gillesMo | evrardjp: thanks | 15:58 |
| andymccr | i know logan is using it in prod, but if you have mgr services that is not good - the mgr services should run on the mon hosts | 15:58 |
| evrardjp | shananigans: oh so you have the issue too ? | 15:58 |
| evrardjp | shananigans: do you know if https://review.openstack.org/#/c/545844/1 could fix your issue? | 15:58 |
| shananigans | I see ssh issues all the time. On every new environment I usually up the retries, timeout and set the maxsessions and maxstartups. | 15:59 |
| evrardjp | the MaxSessions and MaxStartups are your host things, so we shouldn't change that | 15:59 |
| evrardjp | but the sessions/forks are something we could do | 15:59 |
| evrardjp | shananigans: could you review this, and give us your opinion? https://review.openstack.org/#/c/545844/1 | 16:00 |
| gillesMo | andymccr: I see that when I lauvnh ceph-install.yml, it tries to configure and launch it in the ceph mon container. But it fails because it tries to copy a non-existant keyring in /var/lib/ceph/mgr/ceph-*/keyring | 16:00 |
| shananigans | It is the source of the issue being worked around by the retries from my experience. | 16:00 |
| evrardjp | mm interesting. Forks isn't the cause? | 16:00 |
| gillesMo | andymccr: when you say mon hosts, you really mean bare metal ? | 16:01 |
| evrardjp | shananigans: We have a bug triage right now, but your input is extremely valuable. | 16:01 |
| shananigans | The higher the forks, the more ssh connections to all of the lxc containers on the host. Back when originally looking into this, it looks like the host was dropping connections once it hit the session/startup limits. | 16:01 |
| andymccr | gillesMo: no more wherever you have specified your mon service to exist, that could be metal, but i think the default is containers for that | 16:01 |
| evrardjp | that's until I wrote a more efficient connection plugin | 16:01 |
| shananigans | sorry. | 16:01 |
| evrardjp | shananigans: exactly | 16:01 |
| evrardjp | so limiting the amount of forks is generally good | 16:02 |
| evrardjp | no need for retries. | 16:02 |
| andymccr | gillesMo: the group-vars are set to make the mgr_group_name = mon_group_name (i.e. the mgr service will get installed on the same hosts as the mon service) | 16:02 |
| gillesMo | andymccr: yes, that's what I see. But ceph-mgr can't start because of an empty keyring... | 16:03 |
| andymccr | gillesMo: hmm | 16:03 |
| andymccr | gillesMo: so the service is there but it just wont start properly? | 16:03 |
| gillesMo | Yes | 16:03 |
| evrardjp | shananigans: https://docs.openstack.org/openstack-ansible/latest/admin/maintenance-tasks.html#ansible-forks | 16:03 |
| evrardjp | Bug triage cloudnull, DimGR, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, mhayden, scarlisle, luckyinva, ntt, javeriak, spotz, vdo, jmccrory, alextricity25, jasondotstar, admin0, michaelgugino, ametts, bgmccollum, darrenc, JRobinson__, | 16:04 |
| evrardjp | asettle, colinmcnamara, thorst, adreznec, eil397, qwang,nishpatwa_, cathrichardson, drifterza, hwoarang, cshen, ullbeking | 16:04 |
| evrardjp | Here is our bug list for today https://etherpad.openstack.org/p/osa-bugtriage | 16:04 |
| evrardjp | #startmeeting openstack_ansible_meeting | 16:04 |
| openstack | Meeting started Tue Feb 20 16:04:15 2018 UTC and is due to finish in 60 minutes. The chair is evrardjp. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:04 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:04 |
| *** openstack changes topic to " (Meeting topic: openstack_ansible_meeting)" | 16:04 | |
| d34dh0r53 | o/ | 16:04 |
| openstack | The meeting name has been set to 'openstack_ansible_meeting' | 16:04 |
| hwoarang | ο/ | 16:04 |
| evrardjp | good, we are already 3. | 16:04 |
| jmccrory | o/ | 16:05 |
| evrardjp | 4! | 16:05 |
| evrardjp | omg! | 16:05 |
| andymccr | o/ | 16:05 |
| hwoarang | lol | 16:05 |
| hwoarang | quick before we disappear | 16:05 |
| andymccr | haha | 16:05 |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova master: Change include: to include_tasks: https://review.openstack.org/544986 | 16:06 |
| evrardjp | ok let's move on to the agenda then! | 16:06 |
| evrardjp | #topic focus of the week | 16:07 |
| *** openstack changes topic to "focus of the week (Meeting topic: openstack_ansible_meeting)" | 16:07 | |
| evrardjp | this week is! | 16:07 |
| evrardjp | drumroll.... | 16:07 |
| evrardjp | Wrapping up Newton, stabilization of queens branch by fixing bugs | 16:07 |
| evrardjp | so basically newton is close of EOL | 16:07 |
| evrardjp | I will send a message to ML soon to do a last warning sign :) | 16:07 |
| *** indistylo has joined #openstack-ansible | 16:08 | |
| evrardjp | for the rest, I think it would be nice to fix the upgrades to queens and improve stability of queens in general. | 16:08 |
| evrardjp | ok let's move on to bug triage | 16:08 |
| evrardjp | #topic bugtriage | 16:08 |
| *** openstack changes topic to "bugtriage (Meeting topic: openstack_ansible_meeting)" | 16:08 | |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1750241 | 16:08 |
| openstack | Launchpad bug 1750241 in openstack-ansible "creating OS::Neutron::FloatingIP with OS::Neutron::LBaaS::LoadBalancer" [Undecided,New] | 16:08 |
| evrardjp | I don't understand this. Is that our thing? | 16:09 |
| * hwoarang has no clue | 16:09 | |
| evrardjp | It looks like it's usage | 16:10 |
| evrardjp | any idea? | 16:11 |
| evrardjp | should I say invalid? | 16:11 |
| evrardjp | incomplete? | 16:11 |
| andymccr | hmm | 16:11 |
| andymccr | thats a heat template | 16:11 |
| evrardjp | yeah | 16:11 |
| evrardjp | it looks like a depends on something | 16:11 |
| evrardjp | which we don't do, and probably shouldn't | 16:11 |
| andymccr | im not sure what the issue is at all | 16:11 |
| evrardjp | ahah welcome to the club | 16:12 |
| andymccr | incomplete? | 16:12 |
| evrardjp | yeah incomplete | 16:12 |
| evrardjp | I asked a question there | 16:12 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1750236 | 16:13 |
| openstack | Launchpad bug 1750236 in openstack-ansible "os::aodh::alarm via heat stable/pike ubuntu & centos http 503" [Undecided,New] | 16:13 |
| andymccr | ok so since its the same reporter | 16:13 |
| evrardjp | omg. | 16:13 |
| andymccr | im guessing the issue is that using heat with OSA right now is causing issues? | 16:13 |
| andymccr | but tl;dr aodh is broken there id guess :D | 16:13 |
| evrardjp | with gnocchi and autoscaling. | 16:13 |
| evrardjp | so I guess unless someone has the time to confirm, we should move to another bug | 16:14 |
| evrardjp | ok for everyone? | 16:14 |
| evrardjp | I assume yes. | 16:15 |
| evrardjp | next | 16:15 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1750233 | 16:15 |
| openstack | Launchpad bug 1750233 in openstack-ansible "corrupted dynamic_inventory.py backup file" [Undecided,New] | 16:15 |
| evrardjp | ok this one is VERY nice. | 16:15 |
| odyssey4me | I suspect those heat issues relate to bad config - endpoints for example. | 16:16 |
| evrardjp | I want to work on it, but I am still lacking cycles, so I'd like to classify this, so we know what we can do. | 16:16 |
| odyssey4me | I don't know heat very well, but it does require access to valid endpoints, and theire showing gateway errors and internal server errors. | 16:16 |
| odyssey4me | heh, yeah - our inventory is designed for single-use only | 16:17 |
| evrardjp | odyssey4me: can you comment on the bug, to ask for more detailed information maybe? Or should I do it? | 16:17 |
| odyssey4me | multiple accessors at the same time *will* break it | 16:17 |
| evrardjp | odyssey4me: yeah, that inventory thing show how many issues we will hit if we do things in parallel. | 16:17 |
| spotz | heat does require valid endpoints | 16:17 |
| odyssey4me | we should probably implement some sort of lock file or whatever | 16:17 |
| odyssey4me | or not allow it to change itself ;) | 16:18 |
| evrardjp | or moved to static inventory, or safe system | 16:18 |
| evrardjp | yeah | 16:18 |
| evrardjp | so | 16:18 |
| evrardjp | I think this is a feature addition, which is kinda whishlist | 16:18 |
| evrardjp | although, this is a SEVERE bug in usability | 16:18 |
| andymccr | hmm | 16:19 |
| andymccr | can i ask what the usecase is there? | 16:21 |
| andymccr | i guess its still broken but hmm | 16:21 |
| evrardjp | you can ask :D | 16:21 |
| mattt | the usecase of multiple simultaneous ansible runs? | 16:21 |
| *** pcaruana has quit IRC | 16:21 | |
| andymccr | mattt: ok so the aim is to run separate things at the same time? e.g. deploy nova and something else in the inventory at the same time? | 16:21 |
| andymccr | that kinda makes sense | 16:22 |
| andymccr | (this is why we need a distributed inventory!) :D | 16:22 |
| mattt | andymccr: :) yeah not entirely sure, maybe shananigans can chime in if he's free | 16:23 |
| evrardjp | nah we don't need distributed inventory, we need it to be multithread safe. | 16:23 |
| evrardjp | don't go for too complex :) | 16:23 |
| odyssey4me | andymccr it could also be multiple people doing multiple things at the same time, but with the same inventory | 16:23 |
| andymccr | we could avoid doing the tar in the script and instead create a backups dir that gets tarred up once per day as part of a cron? | 16:23 |
| odyssey4me | for example - jenkins is executing the upgrade, meanwhile I'm doing some maintenance | 16:23 |
| openstackgerrit | German Eichberger proposed openstack/openstack-ansible-os_octavia master: Fixes Lint errors and improve tests https://review.openstack.org/544117 | 16:24 |
| andymccr | that way we only tar once and each run will create its own backup inventory | 16:24 |
| andymccr | so that should avoid corruption | 16:24 |
| odyssey4me | if we're worried just about the tarball, we could just timestamp it and maintain a history of x versions | 16:24 |
| andymccr | i think we do - but the tarball is a tar of those to save space | 16:24 |
| evrardjp | yeah that's what we do indeed. | 16:24 |
| andymccr | so we create timestamped backup confs that we then tar up, and we untar add the new one and tar up again on each run | 16:24 |
| andymccr | at least thats my idea | 16:25 |
| odyssey4me | but the issue is actually that the inventory itself is a static file, and that file can't really be safely modified at the same time by multiple executions of the script... but in this case that's happening | 16:25 |
| evrardjp | that's correct | 16:25 |
| *** acormier has quit IRC | 16:25 | |
| andymccr | so if we just dont tar as part of the inventory script | 16:25 |
| evrardjp | well | 16:25 |
| evrardjp | we just append I think | 16:25 |
| andymccr | hmm | 16:25 |
| *** acormier has joined #openstack-ansible | 16:25 | |
| andymccr | ok so the issue is the inventory script itself | 16:25 |
| andymccr | thats a problem then | 16:25 |
| evrardjp | I think this should be moved out of the inventory | 16:25 |
| evrardjp | yeah that's definitely inventory script failure there | 16:25 |
| odyssey4me | wow, simpler would just be to have the 'openstac-ansible' wrapper do the tarballing and take it out of the inventory script | 16:25 |
| andymccr | yeah ^ that'd work | 16:26 |
| andymccr | but i think it sounds like its still broken | 16:26 |
| andymccr | hmm | 16:26 |
| evrardjp | well let's just triage this first | 16:26 |
| evrardjp | instead of thinking of solutions | 16:27 |
| evrardjp | is that a new feature we want to provide, or do we think it's a bug? | 16:27 |
| andymccr | you could classify as either | 16:27 |
| andymccr | we didnt design it to be run multiple times as jesse said | 16:27 |
| evrardjp | IMO it's a new feature we provide, but it proves a big bug we have pending on our noses. | 16:27 |
| andymccr | yeh | 16:27 |
| evrardjp | so I'd like to classify this as something medium or high. | 16:28 |
| odyssey4me | I'd say this is high. | 16:28 |
| odyssey4me | Confirmed. | 16:29 |
| odyssey4me | The bug problem itself can be worked around with a band-aid, but the feature request for multi-user inventory should be registered separately. | 16:29 |
| evrardjp | ok I validate this then. | 16:29 |
| evrardjp | I agree. | 16:29 |
| odyssey4me | That feature request is not actually asked for here though, so don't comment that. | 16:29 |
| odyssey4me | We're deriving a feature request based on the bug. | 16:30 |
| shananigans | matt, andymcrr: Sorry, was in a meeting. We were seeing bug 1750233 in a larger environment where multiple admins are running various plays to get information from the servers. | 16:30 |
| openstack | bug 1750233 in openstack-ansible "corrupted dynamic_inventory.py backup file" [High,Confirmed] https://launchpad.net/bugs/1750233 | 16:30 |
| evrardjp | well it's the first line of the bug. | 16:30 |
| evrardjp | ok let's move on then, now that we have triaged the bug | 16:30 |
| mattt | shananigans: yeah, in my mind i could imagine a deployment running ansible routinely to obtain information about the deployment, and hitting this race conditino | 16:30 |
| evrardjp | next | 16:31 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1749990 | 16:31 |
| openstack | Launchpad bug 1749990 in openstack-ansible "Fails to update the a-r-r file properly when stable branch is used" [Undecided,New] | 16:31 |
| evrardjp | I think this can be marked as confirmed and low. | 16:32 |
| evrardjp | ok for everyone ? | 16:32 |
| evrardjp | let's move on, we have many bugs open today. | 16:32 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1749680 | 16:32 |
| openstack | Launchpad bug 1749680 in openstack-ansible "Ensure apt operations have retries" [Undecided,New] | 16:32 |
| hwoarang | ok | 16:32 |
| hwoarang | dont know what to say about that. by the same argument, every network operation should have a retry option | 16:33 |
| evrardjp | probably yes. | 16:33 |
| evrardjp | ansible is notoriously unreliable. | 16:33 |
| *** sxc731 has quit IRC | 16:33 | |
| evrardjp | wow. | 16:34 |
| evrardjp | that's not what I meant without proper context. | 16:34 |
| evrardjp | I think that it's possible that you have a process issue if a network disruption happens. | 16:34 |
| hwoarang | and this bug shouldn cover just apt | 16:35 |
| hwoarang | every network op is subject to this problem | 16:35 |
| hwoarang | overall i am not sure i agree this is a real bug | 16:35 |
| evrardjp | Retrying is fair on modules that don't implement retries, or for modules whose operations are dependant on somethink that's prone to connectivity issues. | 16:35 |
| andymccr | yeah | 16:35 |
| evrardjp | hwoarang: that's fair too | 16:36 |
| andymccr | you could argue that if apt module needs retries all the time it should be hardcoded in ansible. | 16:36 |
| *** udesale has quit IRC | 16:36 | |
| hwoarang | every module is subject to connectivity issues since it talks to remote hosts | 16:36 |
| andymccr | but if we are doing it everywhere but in a few places it seems sensible to have consistency as well | 16:36 |
| evrardjp | yup | 16:36 |
| evrardjp | hwoarang: I mean without counting the connection plugin in itself | 16:36 |
| odyssey4me | it's not a bug, its a wishlist item | 16:37 |
| hwoarang | yeah | 16:37 |
| evrardjp | I think the linting bring consistency | 16:37 |
| odyssey4me | it happens to cause failures, so it matters to us | 16:37 |
| evrardjp | it's a wishlist indeed. | 16:37 |
| odyssey4me | a lint test would help us enforce such a thing, yes | 16:37 |
| evrardjp | well, I understand both positions -- invalid for the fact it's not really a bug because we shouldn't do it -- and whishlist for consistency | 16:38 |
| odyssey4me | basically, if we did this, deployments would be more reliable in their results | 16:38 |
| evrardjp | I'd prefer to classify this as whishlist and we can think about improving ansible in the future. | 16:38 |
| evrardjp | just so you know -- ansible-devel also has lots of flaky tests when installing packages. | 16:39 |
| andymccr | yeah im all for consistency tbh so i wouldnt be against adding it in as a feature | 16:39 |
| evrardjp | so there might be improvements coming upstream in the future too, not that it's currently planned. | 16:39 |
| evrardjp | let's mark it as wishlist | 16:39 |
| evrardjp | next | 16:40 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1749255 | 16:40 |
| openstack | Launchpad bug 1749255 in openstack-ansible "haproxy healthcheck for API placement is broken" [Undecided,New] | 16:40 |
| andymccr | i swear this thing breaks once a cycle | 16:40 |
| evrardjp | haha yeah it broke recently in queens. | 16:40 |
| andymccr | sigh | 16:41 |
| odyssey4me | yeah, every cycle and sometimes in the cycle they change an interface | 16:41 |
| evrardjp | I fixed it I think, so this should be fixed released. | 16:41 |
| andymccr | ok cool | 16:41 |
| andymccr | next! | 16:41 |
| odyssey4me | the return code, or the path | 16:41 |
| evrardjp | I fixed it before the bug was posted I think :p | 16:41 |
| evrardjp | rc | 16:41 |
| evrardjp | next | 16:41 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1749083 | 16:41 |
| openstack | Launchpad bug 1749083 in openstack-ansible "Nova, Glance, Cinder, ... downtime during O to P upgrade" [Undecided,New] | 16:41 |
| evrardjp | oh yeah. I am on it. | 16:42 |
| evrardjp | when not busy on other things. | 16:42 |
| evrardjp | Confirmed and high, ok for everyone? | 16:42 |
| evrardjp | it's not breaking gates, it's counting that's wrong | 16:42 |
| odyssey4me | yeah | 16:43 |
| evrardjp | ok moving on | 16:43 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1748951 | 16:43 |
| openstack | Launchpad bug 1748951 in openstack-ansible "Use default sysctl_file in openstack_hosts" [Undecided,New] | 16:43 |
| evrardjp | wishlist? | 16:43 |
| mattt | definitely wishlist | 16:43 |
| evrardjp | he is overriding the file, so overriding our defaults. I think he should be using the module :) | 16:43 |
| evrardjp | that would make things work in an idempotent way | 16:44 |
| evrardjp | ok commented. | 16:45 |
| evrardjp | next | 16:45 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1747684 | 16:45 |
| openstack | Launchpad bug 1747684 in openstack-ansible "Default Values Do Not Allow Image Uploads to Glance from Horizon" [Undecided,New] | 16:45 |
| evrardjp | maybe we should ship with different defaults? | 16:46 |
| evrardjp | the changes in horizon in Pike state the default is to use external endpoints | 16:46 |
| evrardjp | so it would make sense to work on this | 16:47 |
| mattt | i'll need 30 mins to process that bug, so no comment | 16:47 |
| evrardjp | and provide better defaults. | 16:47 |
| mattt | :) | 16:47 |
| odyssey4me | evrardjp if we use the public endpoint by default, due to the self-signed cert it will be broken out the box | 16:47 |
| odyssey4me | so to change that we have to ensure that we also configure the cert CA | 16:48 |
| odyssey4me | ultimately, yes, we should use the public endpoint by default | 16:48 |
| jwitko_ | Hey All, is it possible to specify the index of the product of an intersected group of hosts? For example, if i do "hosts: group1:&group2[0]", this intersects group1 with the index0 host from group2 | 16:48 |
| evrardjp | unless the default should be to use HTTP. | 16:48 |
| odyssey4me | because the endpoints shown to the user should be public, not internal | 16:48 |
| logan- | i think the self signed cert might be breaking it anyway | 16:48 |
| odyssey4me | we could do that, but then we'll not catch bugs where the wrong endpoint is being used | 16:48 |
| logan- | because iirc horizon fixed the "bug" for direct uploads and it now directs the client to use public glance endpoints regardless of what endpoints horizon uses | 16:49 |
| odyssey4me | so yes - the intent is good, but some plumbing needs to be done | 16:49 |
| evrardjp | is there no insecure flags that can be set? | 16:49 |
| odyssey4me | haha, well that's always fun | 16:49 |
| odyssey4me | there probably is - not sure, but that's not doing anyone any favors either | 16:50 |
| evrardjp | I think it's the same conversation over and over again | 16:50 |
| evrardjp | does someone deserve to run openstack if he hasn't valid certs? | 16:50 |
| evrardjp | hahaha | 16:50 |
| evrardjp | what do we do? | 16:51 |
| evrardjp | and who could work on this? | 16:51 |
| logan- | in the case where self signed certs are used, legacy mode will work fine. maybe we should make sure our developer and AIO example configs reflect that | 16:51 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova stable/queens: Change include: to include_tasks: https://review.openstack.org/546231 | 16:51 |
| evrardjp | FYI: https://review.openstack.org/#/c/525491/ | 16:51 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova stable/queens: Remove systemd conditionals https://review.openstack.org/546232 | 16:51 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible master: Enable profile_tasks callback for AIO bootstrap https://review.openstack.org/546233 | 16:53 |
| evrardjp | so what's the situation , what do we decide? | 16:53 |
| evrardjp | That looks like confirmed -- not so sure how we're gonna classify this | 16:53 |
| logan- | mediumish? the defaults need improvement but with configuration (easiest way is to set upload_mode legacy) this can be easily worked around | 16:54 |
| evrardjp | ok | 16:55 |
| *** chyka has joined #openstack-ansible | 16:55 | |
| evrardjp | next | 16:56 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1747629 | 16:56 |
| openstack | Launchpad bug 1747629 in openstack-ansible "A worker was found in dead state" [Undecided,New] | 16:56 |
| evrardjp | I think it's valid to cleanup the translations build, in order to make it pass. | 16:57 |
| evrardjp | Confirmed and high. | 16:57 |
| evrardjp | ok for everyone? | 16:57 |
| odyssey4me | yeah, perhaps better to move to using the non-container build for it to save up some resource usage | 16:58 |
| odyssey4me | and look through all the services to see if we've ensured that they're all properly constrained | 16:58 |
| mattt | what exactly does the translations job do? | 16:58 |
| odyssey4me | ie there should not be a default number of workers/threads/processes for each service - but instead a smaller set as per the AIO config | 16:58 |
| odyssey4me | mattt it installs every service that has a horizon plugin, and is used by the translations team to validate whether the language conversations are working right | 16:59 |
| evrardjp | ok let's do a last one for today | 17:00 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1745281 | 17:00 |
| openstack | Launchpad bug 1745281 in openstack-ansible "galera_server : Create galera users fails on CentOS7" [Undecided,New] - Assigned to Jean-Philippe Evrard (jean-philippe-evrard) | 17:00 |
| evrardjp | what | 17:00 |
| *** weezS has joined #openstack-ansible | 17:00 | |
| evrardjp | why is this assigned to me? | 17:00 |
| mattt | yeah i've seen that bug | 17:00 |
| mattt | that thing is valid | 17:00 |
| evrardjp | yeah | 17:01 |
| evrardjp | mhayden: told me the case was important | 17:01 |
| odyssey4me | evrardjp heh, it shows you assigned yourself :p | 17:01 |
| evrardjp | odyssey4me: yeah during the galera issue period | 17:01 |
| evrardjp | but that's something different | 17:01 |
| evrardjp | I'll assign that to mhayden | 17:01 |
| evrardjp | anyone against? | 17:01 |
| evrardjp | :D | 17:01 |
| odyssey4me | yup, something is hinky there - I remember mnaser also wondering what the heck was going on | 17:02 |
| evrardjp | yeah | 17:02 |
| evrardjp | it was in galera_client at that time | 17:02 |
| odyssey4me | if mhayden or mgagne can pick that up it'd be nice | 17:02 |
| mattt | evrardjp: no objections, i already asked him to look at it :P | 17:02 |
| evrardjp | but now the link is for galera_server | 17:02 |
| evrardjp | it looks like the package name case doesn't matter after all | 17:02 |
| evrardjp | mattt: hahah great. | 17:02 |
| evrardjp | let's wrap up for today. | 17:03 |
| evrardjp | thanks everyone! | 17:03 |
| mattt | thanks! | 17:03 |
| evrardjp | #endmeeting | 17:03 |
| weezS | morning | 17:03 |
| *** openstack changes topic to "Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: https://goo.gl/tTmdgs" | 17:03 | |
| openstack | Meeting ended Tue Feb 20 17:03:38 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 17:03 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2018/openstack_ansible_meeting.2018-02-20-16.04.html | 17:03 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2018/openstack_ansible_meeting.2018-02-20-16.04.txt | 17:03 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2018/openstack_ansible_meeting.2018-02-20-16.04.log.html | 17:03 |
| odyssey4me | looks like zuul may have just croaked | 17:04 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-lxc_hosts master: Install common packages into container cache https://review.openstack.org/546239 | 17:04 |
| evrardjp | odyssey4me: zuul was kinda super flaky since saturday | 17:05 |
| odyssey4me | apparently they changed zuul web yesterday, so clear browser cache if it's not working right for you | 17:06 |
| odyssey4me | any takers to review https://review.openstack.org/545991 ? it fixes centos/suse | 17:08 |
| cloudnull | odyssey4me: done | 17:11 |
| odyssey4me | thx | 17:12 |
| spotz | odyssey4me: done | 17:14 |
| *** dariko has joined #openstack-ansible | 17:14 | |
| *** indistylo has quit IRC | 17:15 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_build master: [WIP] Make the git clone and wheel build optional https://review.openstack.org/537015 | 17:16 |
| openstackgerrit | weezer su proposed openstack/openstack-ansible-ops master: Add force: true to avoid dirty git repo https://review.openstack.org/545457 | 17:19 |
| *** sxc731 has joined #openstack-ansible | 17:23 | |
| *** epalper has quit IRC | 17:24 | |
| *** sm806 has quit IRC | 17:24 | |
| *** weezS has quit IRC | 17:25 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_build master: [WIP] Make the git clone and wheel build optional https://review.openstack.org/537015 | 17:27 |
| openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts master: Remove host_need_pip https://review.openstack.org/545698 | 17:28 |
| *** pcaruana has joined #openstack-ansible | 17:36 | |
| hwoarang | odyssey4me: https://review.openstack.org/#/c/545886/ only queens? | 17:37 |
| hwoarang | not a backport? | 17:37 |
| evrardjp | fair point | 17:38 |
| odyssey4me | hwoarang it is: https://review.openstack.org/#/q/I9daa4352aa818db03f682eb0d1a65eefff9bb6f6 | 17:38 |
| odyssey4me | but it was adjusted, so not a clean pick | 17:38 |
| evrardjp | it's missing the indication | 17:38 |
| evrardjp | ok | 17:38 |
| hwoarang | ah ok | 17:38 |
| odyssey4me | it wouldn't clean pick as the branch names are different | 17:38 |
| hwoarang | i should have clicked the id instead | 17:38 |
| evrardjp | well | 17:39 |
| evrardjp | we generally write manual cherry-pick | 17:39 |
| evrardjp | at least I do it :D | 17:39 |
| odyssey4me | the change id is enough of a reference | 17:39 |
| hwoarang | yeah cherry-pick just makes it obvious it's a backport :D | 17:40 |
| hwoarang | for lazy people like me :) | 17:40 |
| evrardjp | I remembered the first patch, so it's different :D | 17:40 |
| odyssey4me | well, fair enough, meh - it's not released, so it's hardly worth a discussion | 17:40 |
| evrardjp | I think it's good | 17:41 |
| evrardjp | but for once, someone found you doing a mistake (which isn't really one), it's hard to not remember that to you odyssey4me :p | 17:41 |
| * odyssey4me makes mistakes all the time :p | 17:41 | |
| evrardjp | else you'd be closer to robot than human | 17:41 |
| * hwoarang opened a can of worms | 17:41 | |
| evrardjp | hahaha | 17:42 |
| evrardjp | you both make me laugh. | 17:42 |
| odyssey4me | in other news, if you haven't discovered https://howchoo.com/g/ytkwotvkztq/using-the-iterm-2-and-tmux-integration yet, then you haven't lived | 17:43 |
| evrardjp | I think I will stop working for today. | 17:43 |
| evrardjp | that's not new | 17:43 |
| * odyssey4me is working on his latest megapatch: https://review.openstack.org/#/c/537015/ | 17:43 | |
| evrardjp | odyssey4me: we discussed this together on top of it! | 17:44 |
| evrardjp | woot mega patches | 17:44 |
| odyssey4me | yes, I know it's not new - it's my regular love affair with it :) | 17:44 |
| evrardjp | I am working on a series of patches myself. | 17:44 |
| evrardjp | it's smaller but if you merge them together, what a bunch! | 17:44 |
| openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible-plugins master: Make connection plugin compatible with Ansible 2.5 https://review.openstack.org/543576 | 17:44 |
| evrardjp | and jmccrory is in da place! woot :) | 17:44 |
| odyssey4me | the funny thing about that patch is - once I put one more patch into the integrated build, I'll be deleting somewhere around 800 lines from repo_build ;) | 17:45 |
| openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible master: [TEST] Update Ansible to 2.5.0b2 https://review.openstack.org/501814 | 17:45 |
| odyssey4me | so I add some, so that we can lose some of what was added, but most of the rest of it | 17:45 |
| evrardjp | odyssey4me: that will be nice! | 17:46 |
| odyssey4me | step 1 - get repo-build to be more understandable, step 2 - reduce dependencies on it, step 3 - make the builds happen in the roles instead, step 4 - switch models so that repo_build no longer needs to exist at all | 17:50 |
| odyssey4me | I might just managed to get step 1 done by the PTG at this rate. :) | 17:50 |
| evrardjp | that's good, because we can speak about making roles more generic at the ptg, so linked to step 3... Knowing is half the battle, right? | 17:54 |
| evrardjp | :D | 17:54 |
| jmccrory | odyssey4me wow had no idea iterm2 could do that, awesome | 17:56 |
| evrardjp | jmccrory: it's flaky though :p | 17:59 |
| openstackgerrit | Merged openstack/openstack-ansible-repo_build master: Ensure virtualenv is not broken for CentOS/SuSE too https://review.openstack.org/545991 | 17:59 |
| evrardjp | I had so many issues with the -CC in the past I stoped trying. | 17:59 |
| evrardjp | new sessions are fine, it's when restoring from (deep) sleep | 18:00 |
| evrardjp | but I might be doing it wrong | 18:00 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_build stable/queens: Ensure virtualenv is not broken for CentOS/SuSE too https://review.openstack.org/546259 | 18:02 |
| *** openstackgerrit has quit IRC | 18:03 | |
| jmccrory | evrardjp hmm i'll have to see how my sessions look tomorrow then, seems to be working alright for now at least | 18:04 |
| *** dariko has quit IRC | 18:06 | |
| *** gillesMo has quit IRC | 18:07 | |
| *** openstackgerrit has joined #openstack-ansible | 18:11 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_tacker stable/queens: Update installation mechanism https://review.openstack.org/545886 | 18:11 |
| *** pcaruana has quit IRC | 18:16 | |
| *** dariko has joined #openstack-ansible | 18:18 | |
| odyssey4me | evrardjp it's not been flaky at all for me | 18:21 |
| odyssey4me | but the nice thing is that you can tmux the normal way on a fkaly session, then switch to using -CC when you're on a good one | 18:21 |
| odyssey4me | your window layout stays | 18:21 |
| *** sxc731 has quit IRC | 18:22 | |
| odyssey4me | jmccrory :) ^ | 18:22 |
| odyssey4me | has anyone else seen this dbu error popping up in tests lately? http://logs.openstack.org/15/537015/15/check/openstack-ansible-functional_selective-ubuntu-xenial/09b4064/logs/ara/result/3f774412-746a-4f27-8547-1b3612264bc6/ | 18:23 |
| evrardjp | maybe since the changes that involved dbus? | 18:23 |
| evrardjp | I am off for today | 18:23 |
| evrardjp | I can check tomorrow if you file a bug | 18:24 |
| odyssey4me | evrardjp I suspect that it might just be the role not running something the way it's expected, but it's not a consistent failure... was wondering if it's been seen elsewhere. | 18:25 |
| *** sxc731 has joined #openstack-ansible | 18:29 | |
| *** weezS has joined #openstack-ansible | 18:30 | |
| odyssey4me | jmccrory cloudnull I wonder if this makes any sense to you... I don't know the depths of systemd/lxc/veths/etc well enough... | 18:34 |
| odyssey4me | I've seen this pop up in some tests: http://logs.openstack.org/15/537015/15/check/openstack-ansible-functional_selective-ubuntu-xenial/09b4064/logs/ara/result/3f774412-746a-4f27-8547-1b3612264bc6/ | 18:35 |
| odyssey4me | it's a module failure, which makes it look like the connection between the host and container got lost. | 18:35 |
| odyssey4me | that happens to be happening at around this time: http://logs.openstack.org/15/537015/15/check/openstack-ansible-functional_selective-ubuntu-xenial/09b4064/logs/host/syslog.txt.gz#_Feb_20_17_52_00 | 18:36 |
| cloudnull | odyssey4me: yup thats thing | 18:36 |
| odyssey4me | and just before it in http://logs.openstack.org/15/537015/15/check/openstack-ansible-functional_selective-ubuntu-xenial/09b4064/logs/host/syslog.txt.gz#_Feb_20_17_51_57 it looks like there's some sort of mac error showing up | 18:36 |
| openstackgerrit | Periyasamy Palanisamy proposed openstack/openstack-ansible master: Make Opendaylight as the BGP speaker using Quagga https://review.openstack.org/523907 | 18:36 |
| cloudnull | its trying to read from /var/lib/dbus | 18:36 |
| odyssey4me | which led me to https://github.com/systemd/systemd/issues/3374 | 18:36 |
| cloudnull | I've been trying to alleviate some of that within the containers with https://review.openstack.org/#/c/523218/ | 18:37 |
| cloudnull | but have not had a lot of time to circle back on it | 18:37 |
| odyssey4me | ah yes, it's been a while since I've seen that coming up... maybe time to get to it? | 18:37 |
| cloudnull | also we should have a less of those iussues with the recent machine-id changes | 18:38 |
| odyssey4me | it's a bit unfortunate that it's not made queens though :( | 18:38 |
| cloudnull | maybe this weekend while flying :) | 18:38 |
| cloudnull | odyssey4me: once we can stabalize that set of prs we can easily cherry-pick them back | 18:40 |
| cloudnull | i just need to fix up suse a | 18:40 |
| cloudnull | *and it should be happy | 18:41 |
| odyssey4me | sure, but the longer it takes to stabilize, the harder it is to remember the right bits to pick back | 18:41 |
| odyssey4me | in other news - thank you dmsimard for ARA... finding the failed task using the web interface is so simple... find->'failed'-> profit! | 18:42 |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia stable/queens: Stop running non-voting jobs in gate https://review.openstack.org/545334 | 18:42 |
| *** shardy has quit IRC | 18:43 | |
| *** dariko has quit IRC | 18:44 | |
| cloudnull | ++ | 18:44 |
| *** hamzy has quit IRC | 18:44 | |
| *** hamzy has joined #openstack-ansible | 18:48 | |
| * dmsimard ara sense tingling | 18:50 | |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: Set SELinux to permissive mode for tests https://review.openstack.org/546153 | 18:53 |
| *** weezS has quit IRC | 18:54 | |
| dmsimard | mhayden: how dare you | 18:55 |
| mhayden | :| | 18:55 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: Use ARA instead of profile_tasks callback https://review.openstack.org/546270 | 18:56 |
| mhayden | dmsimard: does that please you? ^^ | 18:56 |
| dmsimard | that's pretty cool yeah | 18:56 |
| dmsimard | you're forgiven | 18:57 |
| *** sxc731 has quit IRC | 18:57 | |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible master: Use ARA instead of profile_tasks callback https://review.openstack.org/546271 | 18:57 |
| mhayden | dmsimard: twice as nice? ^^ | 18:57 |
| *** hamza21 has joined #openstack-ansible | 18:57 | |
| mhayden | odyssey4me: ^^ | 18:57 |
| dmsimard | mhayden: profile_tasks is kinda cool anyway though | 18:57 |
| mhayden | true | 18:58 |
| mhayden | but odyssey4me told me i am a bad person for expanding its usage ;) | 18:58 |
| dmsimard | I get asked a lot about how to enable ARA in OSA, someone is allegedly writing a blog post about it | 18:58 |
| *** sar has joined #openstack-ansible | 18:59 | |
| mhayden | yay | 18:59 |
| dmsimard | mhayden: btw are you using the RDO openstack-selinux package ? | 19:00 |
| odyssey4me | there's a cheat sheet in our gating script ;) | 19:00 |
| dmsimard | odyssey4me: yeah but apparently it's a bit awkward to do outside the context of CI, I dunno | 19:00 |
| mhayden | dmsimard: i actually just removed openstack-selinux/container-selinux since their policies didn't match with our deployment | 19:00 |
| dmsimard | mhayden: probably because they're meant to work with the RPM packaging | 19:00 |
| mhayden | and they took forever to install due to the old way CentOS 7 ocmpiles selinux policies | 19:00 |
| mhayden | Fedoras is much faster | 19:01 |
| dmsimard | mhayden: if you want to look at the source, it's here: https://github.com/redhat-openstack/openstack-selinux | 19:01 |
| odyssey4me | mhayden you may wish to add the explanation from https://review.openstack.org/#/c/546270/1 into https://review.openstack.org/#/c/546271/ so that it's clearer why | 19:01 |
| mhayden | ain't nobody got time for that | 19:01 |
| * mhayden cackles | 19:02 | |
| odyssey4me | dmsimard hmm, perhaps a nice docs entry would be useful then :) | 19:02 |
| odyssey4me | if the blog post is not yet up by the PTG, then perhaps we'll take the time to document it :) | 19:02 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible master: Use ARA instead of profile_tasks callback https://review.openstack.org/546271 | 19:02 |
| mhayden | fixed, odyssey4me | 19:02 |
| *** dariko has joined #openstack-ansible | 19:03 | |
| odyssey4me | I see what you did there | 19:03 |
| dmsimard | odyssey4me: I'll ping you when it's out :) | 19:03 |
| *** poopcat has joined #openstack-ansible | 19:07 | |
| mhayden | odyssey4me: do we have a docs page i could link to? | 19:07 |
| mhayden | or are you insinuating i should cobble one together | 19:07 |
| * mhayden squints | 19:07 | |
| odyssey4me | mhayden once dmsimard has a blog post, there will be one :) | 19:07 |
| odyssey4me | or we (you) could do one first ;) | 19:08 |
| * mhayden adds "Depends-On: dmsimard-blog-post" | 19:08 | |
| odyssey4me | lol | 19:08 |
| * odyssey4me likes | 19:08 | |
| odyssey4me | mhayden as it's not urgent, we can let that lie and see if someone volunteers... or maybe we'll do it at the PTG | 19:08 |
| odyssey4me | or maybe I'll do it this w/end :p | 19:09 |
| dmsimard | well, someone did tell me they were going to write something soon so I'll wait a bit and let you know if I don't hear back | 19:10 |
| *** armaan has joined #openstack-ansible | 19:11 | |
| *** weezS has joined #openstack-ansible | 19:16 | |
| *** weezS has quit IRC | 19:19 | |
| *** hamzy has quit IRC | 19:19 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_build master: [WIP] Make the git clone and wheel build optional https://review.openstack.org/537015 | 19:20 |
| *** stuartgr has quit IRC | 19:23 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_build master: [WIP] Make the git clone and wheel build optional https://review.openstack.org/537015 | 19:24 |
| mhayden | holy moley, i got a CentOS 7 deployment done in exactly 120 minutes with the aio_basekit from andymccr | 19:24 |
| andymccr | YES! | 19:24 |
| mhayden | with success even | 19:24 |
| mhayden | - [ Run Time = 7245 seconds || 120 minutes ] ------------------------- | 19:24 |
| mhayden | - [ Status: Success ] ------------------------------------------------ | 19:24 |
| andymccr | \o/ | 19:24 |
| mhayden | AND THERE WAS MUCH REJOICING | 19:24 |
| mhayden | distro package installs are still painful :| | 19:25 |
| mnaser | any cores around to +W this patch which already has +W but zuul doing zuul things - https://review.openstack.org/#/c/543467/ (to avoid rechecking) | 19:25 |
| mnaser | if we get another +W it'll get into gate | 19:25 |
| mhayden | mnaser: looks like it's workflowed | 19:25 |
| *** hamzy has joined #openstack-ansible | 19:25 | |
| mhayden | mnaser: i put extra workflow on it to show zuul who's the boss | 19:26 |
| mnaser | mhayden: yeah but it's stuck and not in gate (probably lost with one of the zuul restarts) | 19:26 |
| mnaser | and it's in gate now, thank you mhayden :) | 19:26 |
| mhayden | hooray! | 19:26 |
| mhayden | galera package installs are painful | 19:26 |
| mnaser | we should just use mongodb tbh its web scale | 19:26 |
| mhayden | trolololol | 19:27 |
| mhayden | we could shave 5 minutes if i could avoid pulling in python-monascaclient | 19:27 |
| mnaser | actually though i always wondered it would be nice to experiment with that database that was presented in boston keynote | 19:27 |
| mhayden | cockroachdb? | 19:27 |
| mnaser | it talks mysql but uses some distributed storage | 19:27 |
| mnaser | yes | 19:27 |
| mhayden | if heat would switch to install_requires, that'd be nice | 19:28 |
| * mhayden likes how gnocchi does that | 19:29 | |
| odyssey4me | mhayden a report from a timeout: http://logs.openstack.org/49/545849/1/check/openstack-ansible-deploy-ceph-centos-7/d2c484e/logs/ara/ :) | 19:30 |
| mhayden | ah okay | 19:30 |
| odyssey4me | given that the ARA report is done in the post section of the zuul execution, it now collects all the things | 19:31 |
| odyssey4me | evrardjp methinks we should add mnaser as core for the telemetry roles... | 19:32 |
| mnaser | i don't mind keeping an eye on telemetry stack reviews | 19:33 |
| odyssey4me | that would be marvellous | 19:33 |
| odyssey4me | with your work, perhaps we could add some telemetry tests into the periodics so that they're actively tested again | 19:33 |
| mnaser | odyssey4me: i think the one step before that is os_panko but i can't remember who mentioned that they already started it | 19:33 |
| odyssey4me | ah yes, gokhan perhaps? | 19:34 |
| odyssey4me | cloudnull did you push up a patch to import those extra roles? perhaps we should do a batch | 19:34 |
| mnaser | don't remember who exactly :( but yeah, that would be nice to add to the stack | 19:34 |
| cloudnull | i have not. | 19:35 |
| cloudnull | i suck | 19:35 |
| odyssey4me | cloudnull I can put something together now. | 19:36 |
| odyssey4me | cloudnull doing it live! | 19:38 |
| evrardjp[m] | me also thinks odyssey4me | 19:38 |
| odyssey4me | evrardjp want me to do it now? | 19:39 |
| evrardjp[m] | if he is okay yeah. i can do it too, i have to add mbuil to neutron too. | 19:41 |
| odyssey4me | I can do that for you now if you'd like. Seems sensible to me. | 19:41 |
| odyssey4me | mnaser also, confirmed that gokhan has the panko role: http://eavesdrop.openstack.org/irclogs/%23openstack-ansible/%23openstack-ansible.2018-02-06.log.html#t2018-02-06T14:06:23 | 19:41 |
| evrardjp[m] | i was busy with all governance stuff today | 19:42 |
| odyssey4me | gokhan we need to revisit that conversation - happy to pull the role in if you'r happy to go ahead? we might want a few tweaks (like flattening the git history) | 19:42 |
| odyssey4me | it doesn't matter if it's broken - it's easy enough to get fixed once we have people working on it as a group. | 19:43 |
| evrardjp[m] | i still have a etherpad ;) | 19:44 |
| mnaser | yeah once it's in, we can fix the issues with proper gate checks | 19:45 |
| mnaser | and i'm okay with it | 19:45 |
| odyssey4me | awesome, thanks mnaser - I'll verify that the gerrit ACL's are properly set as I'm doing a housekeeping patch anyway to pull cloudnull's nspawn roles in | 19:45 |
| mnaser | odyssey4me: ok cool, i'm going to setup a gerrit dashboard for this then, aodh+ceilometer+gnocchi+panko ? | 19:47 |
| odyssey4me | mnaser yep, and maybe horizon for the related plugins there? | 19:47 |
| * odyssey4me has a long gerrit query: project:"^(openstack|openstack-infra)/(monitorstack|openstack-ansible|ansible-|devstack-gate).*" | 19:48 | |
| mnaser | odyssey4me: sure, i can do horizon reviews if you want (i have the pleasure of working with it often, ha) or leave them | 19:48 |
| mnaser | odyssey4me: i use multiple dashboards for different projects/components | 19:48 |
| mnaser | ex: puppet/project config/etc | 19:49 |
| odyssey4me | makes sense | 19:52 |
| odyssey4me | I basically have a very large 'to review' queue, then a focused one which removes -1 reviews and zuul failures, then another one which shows those owned by me, then another which has my starred reviews, then the merged ones (for context and proactive backporting). | 19:53 |
| odyssey4me | each is a tab in the browser | 19:53 |
| odyssey4me | maybe we should do a review practise sharing session at the PTG :) | 19:53 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_gnocchi stable/pike: Zuul: Remove project name https://review.openstack.org/542103 | 19:56 |
| *** dave-mccowan has quit IRC | 19:57 | |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_gnocchi stable/queens: Zuul: Remove project name https://review.openstack.org/545321 | 19:58 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_gnocchi master: Change default gnocchi ceph pool name to metrics https://review.openstack.org/512313 | 19:58 |
| odyssey4me | mhayden you've had some contributors help out with some things - would you want a core group outside of the standard OSA core group? | 19:59 |
| odyssey4me | for ansible-hardening I mean | 19:59 |
| mhayden | at the moment, i dunno | 19:59 |
| mhayden | it could be helpful in the long term | 19:59 |
| odyssey4me | ok, I'll leave it then | 19:59 |
| odyssey4me | the option is always there, it's just a project-config patch away | 20:00 |
| mnaser | andymccr: do you have sometime to do the fixups needed here or would you like me to pick it up? https://review.openstack.org/#/c/492580/ | 20:01 |
| odyssey4me | mnaser I'm quite certain that andymccr would be happy for you to take over that patch. | 20:03 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_aodh master: Standardize services list and package installation https://review.openstack.org/492580 | 20:04 |
| odyssey4me | he was doing a sweep at one point to try and normalise some of the less well looked after roles, and that was part of it | 20:04 |
| mnaser | cool :) | 20:05 |
| *** sxc731 has joined #openstack-ansible | 20:06 | |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_ceilometer stable/pike: [pike only] Stop using 'latest' for pymongo installation https://review.openstack.org/546293 | 20:07 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_ceilometer stable/pike: Zuul: Remove project name https://review.openstack.org/542601 | 20:08 |
| mnaser | would anyone historically know the reason behind this? https://review.openstack.org/#/q/topic:move-out-telem -- is this not necessary anymore because we're maintaining them now? | 20:10 |
| odyssey4me | mnaser yep - basically there was one guy trying to maintain them, and he's gone now | 20:15 |
| odyssey4me | but he was trying to move them out from the integrated build to reduce the effects on our ongoing gating | 20:15 |
| odyssey4me | but if we now have people picking those up, we can abandon those | 20:15 |
| mnaser | yeah i think we can abandon them because it looks like the author hasn't pushed up anything for the last 7 months | 20:17 |
| *** mbuil has quit IRC | 20:28 | |
| odyssey4me | mnaser You're now a core reviewer for os_aodh, os_ceilometer... os_gnocchi will be on the way once we have a dedicated core group for the repo done | 20:28 |
| odyssey4me | Sad to see stevelle and alextricity25 go though. | 20:28 |
| * odyssey4me pours one out for them. | 20:28 | |
| mnaser | odyssey4me: thanks and :( | 20:30 |
| odyssey4me | welcome, and thank you | 20:30 |
| odyssey4me | you are free to add more cores to the repo core list, just please add the openstack-ansible-core group there as a back-stop to help out with any issues | 20:31 |
| odyssey4me | we added some core reviewer guidelines stuff to the docs here, for bedtime reading ;) https://docs.openstack.org/openstack-ansible/latest/contributor/core-reviewers.html#general-responsibilities | 20:31 |
| odyssey4me | please do feel very free to propose changes to those | 20:32 |
| *** poopcat has quit IRC | 20:32 | |
| *** poopcat has joined #openstack-ansible | 20:33 | |
| *** dave-mccowan has joined #openstack-ansible | 20:37 | |
| *** pcaruana has joined #openstack-ansible | 20:40 | |
| *** oneswig has joined #openstack-ansible | 20:55 | |
| *** dave-mccowan has quit IRC | 20:56 | |
| *** hamza21 has quit IRC | 21:02 | |
| *** flaviosr_ has quit IRC | 21:12 | |
| openstackgerrit | Merged openstack/openstack-ansible stable/pike: Fix cinder_service_region undefined https://review.openstack.org/543467 | 21:19 |
| *** armaan has quit IRC | 21:21 | |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-galera_client master: Allow Galera package downloads over HTTP https://review.openstack.org/546308 | 21:21 |
| *** armaan has joined #openstack-ansible | 21:21 | |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-galera_server master: Allow Galera package downloads over HTTP https://review.openstack.org/546309 | 21:22 |
| mhayden | that was a fun find ^^ | 21:22 |
| mhayden | i knew yum was slow, but it wasn't THAT slow | 21:22 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible master: CentOS 7 integrated gate optimization https://review.openstack.org/545455 | 21:23 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible master: Add base kit scenario https://review.openstack.org/543534 | 21:23 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible master: CentOS 7 integrated gate optimization https://review.openstack.org/545455 | 21:24 |
| *** flaviosr_ has joined #openstack-ansible | 21:25 | |
| openstackgerrit | git-harry proposed openstack/openstack-ansible-galera_server master: Fix cache update after initial apt_repository fail https://review.openstack.org/546312 | 21:28 |
| mhayden | cloudnull: i'm looking into trimming heat's requirements.txt on the repo server... | 21:29 |
| mhayden | we do a selective wheel build but then heat drags in clients that we don't need | 21:29 |
| mhayden | it would be heat-specific code, which feels dirty :/ | 21:29 |
| *** tux_ has joined #openstack-ansible | 21:30 | |
| *** mbuil has joined #openstack-ansible | 21:31 | |
| tux_ | Hello Folks! | 21:33 |
| mhayden | howdy tux_ | 21:33 |
| tux_ | Hey Major :) let me tell you i love your blog | 21:34 |
| mhayden | hah thanks! | 21:34 |
| * mhayden needs to update it more often ;) | 21:34 | |
| tux_ | Anyway! i am planning to build openstack in production using OSA and collecting some info, | 21:34 |
| tux_ | I have 3 controller node but what about HA Proxy node? do i need separate node? | 21:35 |
| tux_ | How do you guys deal with HA proxy node in production? | 21:35 |
| *** pcaruana has quit IRC | 21:37 | |
| andymccr | majors blog is the best! :) | 21:38 |
| tux_ | silence is painful ;) | 21:39 |
| tux_ | Can i use HA proxy in all 3 controller node or anything else i need to do? | 21:42 |
| shananigans | You can set up all three infra nodes with an external and internal floating ip using keepalived in the OSA configs. https://docs.openstack.org/openstack-ansible-haproxy_server/latest/configure-haproxy.html | 21:47 |
| shananigans | If you check out the link the 'haproxy_hosts' will determine where haproxy gets installed and the keepalived settings is were you configure your floating ips tied to specific interfaces. | 21:48 |
| mhayden | tux_: sorry, got dragged away | 21:50 |
| mhayden | i have four nodes running OSA -- each one is a hypervisor, but they run openstack services, too | 21:50 |
| mhayden | hyperconverged! | 21:50 |
| mhayden | i picked two of my four to run haproxy | 21:50 |
| *** mbuil has quit IRC | 21:51 | |
| tux_ | so that is do-able? i can pick 01 and 02 and setup HA proxy on them. | 21:51 |
| tux_ | Does it required hand edit config or OSA does itself? | 21:51 |
| tux_ | Does it required hand edit config or OSA does itself? ( I meant can i pick 2 controller node) | 21:55 |
| openstackgerrit | Merged openstack/openstack-ansible stable/queens: Ensure that constraints are used for AIO bootstrap https://review.openstack.org/545891 | 21:57 |
| *** armaan has quit IRC | 22:00 | |
| shananigans | It is doable and I think the haproxy_server ansible role handles all of the changes based on the OSA configs. | 22:00 |
| *** sar has quit IRC | 22:02 | |
| *** oneswig has quit IRC | 22:05 | |
| *** sxc731 has quit IRC | 22:05 | |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-repo_build master: [WIP] Remove unneeded clients from heat https://review.openstack.org/546319 | 22:08 |
| *** dariko has quit IRC | 22:09 | |
| *** dariko has joined #openstack-ansible | 22:10 | |
| tux_ | @shananigans - Thanks! | 22:10 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible master: [WIP] Test repo build w/trimmed heat requirements https://review.openstack.org/546331 | 22:10 |
| mhayden | cloudnull: i'm a bad person https://review.openstack.org/#/c/546319/ | 22:11 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-repo_build master: [WIP] Remove unneeded clients from heat https://review.openstack.org/546319 | 22:11 |
| *** pbandark has quit IRC | 22:12 | |
| mnaser | any cores who would like to push https://review.openstack.org/#/c/546293/ ? | 22:19 |
| *** threestrands has joined #openstack-ansible | 22:23 | |
| *** dariko has quit IRC | 22:23 | |
| *** kstev has quit IRC | 22:24 | |
| openstackgerrit | German Eichberger proposed openstack/openstack-ansible-os_octavia master: Fixes Lint errors and improve tests https://review.openstack.org/544117 | 22:26 |
| *** jwitko__ has joined #openstack-ansible | 22:29 | |
| *** jwitko_ has quit IRC | 22:33 | |
| *** tux_ has quit IRC | 22:33 | |
| *** jwitko__ has quit IRC | 22:36 | |
| *** jwitko_ has joined #openstack-ansible | 23:00 | |
| *** Smeared_Beard has quit IRC | 23:02 | |
| *** pmannidi has joined #openstack-ansible | 23:03 | |
| *** openstackgerrit has quit IRC | 23:04 | |
| *** NostawRm has quit IRC | 23:15 | |
| *** NostawRm has joined #openstack-ansible | 23:19 | |
| *** acormier has quit IRC | 23:35 | |
| *** taseer1 has joined #openstack-ansible | 23:38 | |
| *** Taseer has quit IRC | 23:40 | |
| *** Tahvok has quit IRC | 23:46 | |
| *** Tahvok has joined #openstack-ansible | 23:47 | |
| *** tux_ has joined #openstack-ansible | 23:49 | |
| *** taseer2 has joined #openstack-ansible | 23:51 | |
| *** tux_ has quit IRC | 23:54 | |
| *** taseer1 has quit IRC | 23:54 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!