| *** TxGirlGeek has quit IRC | 00:05 | |
| *** omegapoint has joined #openstack-ansible | 00:08 | |
| JohnnyOSA | Anyone using Grafana for gnocchi data plotting? I'm trying (https://grafana.com/plugins/gnocchixyz-gnocchi-datasource), but keep getting Keystone failure 502 bad gateway with setting up the plugin. Trying to figure it out. Any pointers appreciated. | 00:08 |
|---|---|---|
| *** omegapoint has quit IRC | 00:12 | |
| *** omegapoint has joined #openstack-ansible | 00:14 | |
| *** omegapoint has quit IRC | 00:19 | |
| *** omegapoint has joined #openstack-ansible | 00:24 | |
| *** gokhan is now known as Guest5320 | 00:29 | |
| *** chyka has quit IRC | 00:30 | |
| *** lbragstad has quit IRC | 00:32 | |
| *** agrebennikov has quit IRC | 00:44 | |
| *** hw_wutianwei_ has joined #openstack-ansible | 00:57 | |
| JohnnyOSA | For a 16.0.7 OSA deploy, the external HAproxy LB VIP uses https and self-signed certs by default. When I try to authenticate to keystone externally using the public (external) LB VIP, I receive an SSL certificate verify failed error (http://paste.openstack.org/show/683548/). | 00:58 |
| *** jwitko_ has quit IRC | 00:58 | |
| JohnnyOSA | Any easy way to keep the self-signed cert and fix it so this error doesn't occur? (I think it's behind the Grafana-gnocchi plugin error as well). | 00:59 |
| -openstackstatus- NOTICE: Zuul was restarted to workaround a memory issue. If your jobs are not running they may need to be rechecked | 01:01 | |
| *** woodard has quit IRC | 01:13 | |
| *** woodard has joined #openstack-ansible | 01:14 | |
| admin0 | JohnnyOSA, care to share your config on how you set it up .. i can try to replicate it | 01:15 |
| * admin0 is looking for a/any working dashboard on top of OSA | 01:15 | |
| *** woodard has quit IRC | 01:16 | |
| *** woodard has joined #openstack-ansible | 01:17 | |
| *** markvoelker has quit IRC | 01:19 | |
| *** markvoelker has joined #openstack-ansible | 01:20 | |
| openstackgerrit | Merged openstack/openstack-ansible-repo_build stable/queens: Change logging for source downloads and wheel build https://review.openstack.org/546008 | 01:23 |
| *** markvoelker has quit IRC | 01:25 | |
| openstackgerrit | Merged openstack/openstack-ansible-galera_server master: Restore support for percona packages when using ppc64le https://review.openstack.org/547101 | 01:25 |
| JohnnyOSA | Hi admin0, sure. When you say how I set it up -- you mean the OSA config files for the deploy? | 01:26 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_container_create master: Unify container network interfaces with networkd https://review.openstack.org/523218 | 01:27 |
| admin0 | not the osa but how you tried on " Grafana for gnocchi data plotting" | 01:28 |
| admin0 | i guess you pointed it to keystone and its not working due to ssl stuff ? | 01:28 |
| admin0 | i would first make sure if that 502 is legit from haproxy ( maybe the api behind the port is not working ) or the 502 from grafana due to ssl | 01:30 |
| *** chyka has joined #openstack-ansible | 01:30 | |
| *** admin0 has quit IRC | 01:31 | |
| JohnnyOSA | Yeah, that's what it seems like. There is a ticket on the gnocchi plugin site saying essentially that a self-signed cert would be a problem for the plugin (https://github.com/gnocchixyz/grafana-gnocchi-datasource/issues/44) | 01:31 |
| JohnnyOSA | I've just installing the openstack client cli on an external server, setting up an openrc file with the env vars set to externalURL rather than internalURL and trying an openstack command like | 01:33 |
| JohnnyOSA | "openstack server list". Without the --insecure flag on the command I receive SSL verify error which I'm guessing is also what the gnocci Grafana plugin is seeing by default. | 01:34 |
| JohnnyOSA | If I add the --insecure flag, then I get an error of "EndpointNotFound: externalURL endpoint for compute service in RegionOne region not found" | 01:35 |
| *** chyka has quit IRC | 01:35 | |
| JohnnyOSA | That seems odd, because from inside the OS environment, if I list the endpoints, it clearly shows the a public nova endpoint. | 01:35 |
| JohnnyOSA | I have to hit the road, but later tonight I'll dig into the HAproxy logs and see if I can learn anything else. | 01:36 |
| JohnnyOSA | I'll check in once I'm off the road to see if you have any other thoughts... Thanks! | 01:37 |
| *** omegapoint has quit IRC | 01:44 | |
| *** taseer1 has joined #openstack-ansible | 01:54 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova stable/ocata: Restore PowerVM repo setup https://review.openstack.org/547438 | 01:56 |
| *** Taseer has quit IRC | 01:57 | |
| *** taseer2 has joined #openstack-ansible | 02:05 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_tempest stable/queens: Use realpath filter instead of the stat/dir dance https://review.openstack.org/546147 | 02:07 |
| *** taseer1 has quit IRC | 02:08 | |
| *** markvoelker has joined #openstack-ansible | 02:21 | |
| *** armaan has quit IRC | 02:44 | |
| *** pramod has joined #openstack-ansible | 02:54 | |
| *** markvoelker has quit IRC | 02:55 | |
| openstackgerrit | Merged openstack/openstack-ansible stable/pike: Ensure that constraints are used for AIO bootstrap https://review.openstack.org/545894 | 03:01 |
| openstackgerrit | Merged openstack/openstack-ansible stable/ocata: Ensure that constraints are used for AIO bootstrap https://review.openstack.org/545895 | 03:01 |
| *** errr has quit IRC | 03:10 | |
| *** masuberu has quit IRC | 03:11 | |
| *** kenperkins has quit IRC | 03:12 | |
| *** masuberu has joined #openstack-ansible | 03:33 | |
| *** masuberu has quit IRC | 03:38 | |
| *** armaan has joined #openstack-ansible | 03:41 | |
| *** markvoelker has joined #openstack-ansible | 03:52 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_container_create master: Unify container network interfaces with networkd https://review.openstack.org/523218 | 04:09 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_container_create master: Unify container network interfaces with networkd https://review.openstack.org/523218 | 04:11 |
| *** masuberu has joined #openstack-ansible | 04:13 | |
| *** lbragstad has joined #openstack-ansible | 04:15 | |
| *** masber has joined #openstack-ansible | 04:15 | |
| *** masuberu has quit IRC | 04:18 | |
| *** markvoelker has quit IRC | 04:26 | |
| *** pramod has quit IRC | 05:04 | |
| *** lbragstad has quit IRC | 05:05 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_container_create master: Unify container network interfaces with networkd https://review.openstack.org/523218 | 05:06 |
| *** markvoelker has joined #openstack-ansible | 05:23 | |
| *** markvoelker has quit IRC | 05:57 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_container_create master: Unify container network interfaces with networkd https://review.openstack.org/523218 | 06:04 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_container_create master: Unify container network interfaces with networkd https://review.openstack.org/523218 | 06:18 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_container_create master: Unify container network interfaces with networkd https://review.openstack.org/523218 | 06:24 |
| *** markvoelker has joined #openstack-ansible | 06:54 | |
| *** arbrandes has joined #openstack-ansible | 07:01 | |
| *** clone99 has joined #openstack-ansible | 07:03 | |
| *** arbrandes1 has quit IRC | 07:03 | |
| *** armaan has quit IRC | 07:03 | |
| *** armaan has joined #openstack-ansible | 07:04 | |
| *** SimAloo has quit IRC | 07:04 | |
| *** armaan has quit IRC | 07:05 | |
| *** dariko has joined #openstack-ansible | 07:05 | |
| *** armaan has joined #openstack-ansible | 07:05 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_container_create master: Unify container network interfaces with networkd https://review.openstack.org/523218 | 07:27 |
| *** markvoelker has quit IRC | 07:27 | |
| *** indistylo has joined #openstack-ansible | 07:33 | |
| *** masber has quit IRC | 07:39 | |
| *** armaan has quit IRC | 07:44 | |
| *** clone99 has quit IRC | 07:45 | |
| *** indistylo has quit IRC | 07:45 | |
| *** armaan has joined #openstack-ansible | 07:54 | |
| *** armaan has quit IRC | 07:55 | |
| *** armaan has joined #openstack-ansible | 07:56 | |
| *** armaan has quit IRC | 08:21 | |
| *** armaan has joined #openstack-ansible | 08:21 | |
| *** markvoelker has joined #openstack-ansible | 08:24 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_container_create master: Unify container network interfaces with networkd https://review.openstack.org/523218 | 08:28 |
| *** armaan has quit IRC | 08:28 | |
| *** armaan has joined #openstack-ansible | 08:29 | |
| *** woodard has quit IRC | 08:30 | |
| *** indistylo has joined #openstack-ansible | 08:57 | |
| *** markvoelker has quit IRC | 08:58 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: neutron_needs_openvswitch should be jinja, not a string https://review.openstack.org/547731 | 09:13 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/queens: vars: Install qpress only when galera_xtrabackup_compression is true https://review.openstack.org/547737 | 09:21 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/queens: tasks: Fix use_percona_upstream variable usage https://review.openstack.org/547738 | 09:21 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/queens: tasks: Replace deprecated 'include' statements https://review.openstack.org/547739 | 09:21 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/queens: Restore support for percona packages when using ppc64le https://review.openstack.org/547740 | 09:21 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: neutron_needs_openvswitch should be jinja, not a string https://review.openstack.org/547731 | 09:24 |
| *** chyka has joined #openstack-ansible | 09:30 | |
| *** chyka has quit IRC | 09:34 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: Temporarily remove the upgrade test to unblock patch merging https://review.openstack.org/547741 | 09:34 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: neutron_needs_openvswitch should be jinja, not a string https://review.openstack.org/547731 | 09:35 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: Updated from OpenStack Ansible Tests https://review.openstack.org/544930 | 09:35 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: Add SELinux contexts for neutron log directory https://review.openstack.org/545884 | 09:36 |
| *** armaan has quit IRC | 09:43 | |
| *** armaan has joined #openstack-ansible | 09:43 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: Restore upgrade test as non-voting https://review.openstack.org/547743 | 09:49 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: Restore upgrade test as non-voting https://review.openstack.org/547743 | 09:50 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: Temporarily make upgrade test non-voting to unblock patch merging https://review.openstack.org/547741 | 09:54 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: neutron_needs_openvswitch should be jinja, not a string https://review.openstack.org/547731 | 09:54 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: Updated from OpenStack Ansible Tests https://review.openstack.org/544930 | 09:54 |
| *** markvoelker has joined #openstack-ansible | 09:54 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: Add SELinux contexts for neutron log directory https://review.openstack.org/545884 | 09:55 |
| *** armaan has quit IRC | 10:00 | |
| *** armaan has joined #openstack-ansible | 10:00 | |
| *** sm806 has quit IRC | 10:09 | |
| *** armaan has quit IRC | 10:11 | |
| *** armaan has joined #openstack-ansible | 10:12 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: Temporarily set functional tests to non-voting to unblock patch merging https://review.openstack.org/547741 | 10:25 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: neutron_needs_openvswitch should be jinja, not a string https://review.openstack.org/547731 | 10:26 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: Updated from OpenStack Ansible Tests https://review.openstack.org/544930 | 10:27 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: neutron_needs_openvswitch should be jinja, not a string https://review.openstack.org/547731 | 10:27 |
| *** markvoelker has quit IRC | 10:28 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: Temporarily set functional tests to non-voting to unblock patch merging https://review.openstack.org/547741 | 10:29 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: Updated from OpenStack Ansible Tests https://review.openstack.org/544930 | 10:29 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: neutron_needs_openvswitch should be jinja, not a string https://review.openstack.org/547731 | 10:29 |
| *** pbandark has joined #openstack-ansible | 10:30 | |
| odyssey4me | evrardjp and cores, we can't merge anything right now into the integrated build (and some other repositories) in master, because OVS is installing and failing - that's fixed by https://review.openstack.org/547650, but that can't merge because the upgrade test is failing. That's failing because the queens branch hasn't been fixed yet to do the right things... and the queens branch is quite broken and needs a few patches to get working | 10:33 |
| odyssey4me | again. | 10:33 |
| odyssey4me | That's why I've made all neutron queens functional tests non-voting temporarily and chained up the patches to hopefully get everything fixed up. | 10:34 |
| *** armaan has quit IRC | 10:43 | |
| *** armaan has joined #openstack-ansible | 10:43 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: Add SELinux contexts for neutron log directory https://review.openstack.org/545884 | 10:51 |
| evrardjp | hey odyssey4me | 11:12 |
| evrardjp | is there anyhing I should do | 11:13 |
| *** chyka has joined #openstack-ansible | 11:19 | |
| *** chyka has quit IRC | 11:24 | |
| *** markvoelker has joined #openstack-ansible | 11:25 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron stable/queens: Temporarily set functional tests to non-voting to unblock patch merging https://review.openstack.org/547741 | 11:32 |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron stable/queens: Updated from OpenStack Ansible Tests https://review.openstack.org/544930 | 11:34 |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron stable/queens: neutron_needs_openvswitch should be jinja, not a string https://review.openstack.org/547731 | 11:34 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: Revert "Temporarily set functional tests to non-voting to unblock patch merging" https://review.openstack.org/547748 | 11:35 |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron stable/queens: Add SELinux contexts for neutron log directory https://review.openstack.org/545884 | 11:47 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: Stop running non-voting jobs in gate https://review.openstack.org/546109 | 11:50 |
| *** markvoelker has quit IRC | 11:58 | |
| *** masber has joined #openstack-ansible | 12:37 | |
| evrardjp | odyssey4me: thanks | 12:38 |
| *** markvoelker has joined #openstack-ansible | 12:56 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: Revert "Temporarily set functional tests to non-voting to unblock patch merging" https://review.openstack.org/547748 | 13:20 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: Partially revert "Temporarily set functional tests to non-voting to unblock patch merging" https://review.openstack.org/547748 | 13:23 |
| odyssey4me | evrardjp ^ Doing a partial revert - leaving the upgrade job non-voting for now to work on that in isolation, but at least having the functional jobs voting again. | 13:24 |
| odyssey4me | I'm building a test node to look at what's going on there now. | 13:24 |
| evrardjp[m] | my laptop is out of battery, i can only work later today :( | 13:29 |
| evrardjp[m] | forgot my charger | 13:29 |
| odyssey4me | evrardjp[m] oh dear | 13:29 |
| *** markvoelker has quit IRC | 13:29 | |
| odyssey4me | no worries, I'm on it | 13:29 |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron master: neutron_needs_openvswitch should be jinja, not a string https://review.openstack.org/547650 | 13:33 |
| *** lbragstad has joined #openstack-ansible | 13:35 | |
| *** masber has quit IRC | 13:48 | |
| openstackgerrit | Merged openstack/openstack-ansible master: [Docs] Centralize Inventory documentation https://review.openstack.org/547149 | 13:49 |
| openstackgerrit | Merged openstack/openstack-ansible master: [Docs] Move limited connectivity to user guide https://review.openstack.org/547150 | 13:49 |
| openstackgerrit | Merged openstack/openstack-ansible master: [Docs] Migrate security into user guide https://review.openstack.org/547151 | 13:52 |
| *** armaan has quit IRC | 13:52 | |
| *** armaan has joined #openstack-ansible | 13:53 | |
| *** lbragsta_ has joined #openstack-ansible | 14:03 | |
| *** lbragsta_ has quit IRC | 14:03 | |
| *** mardim_ has joined #openstack-ansible | 14:04 | |
| *** jillr_ has joined #openstack-ansible | 14:07 | |
| *** dariko1 has joined #openstack-ansible | 14:07 | |
| *** lbragstad has quit IRC | 14:07 | |
| *** astellwa1 has joined #openstack-ansible | 14:09 | |
| *** astellwag has quit IRC | 14:10 | |
| *** tobberydberg has quit IRC | 14:10 | |
| *** mardim has quit IRC | 14:10 | |
| *** jillr has quit IRC | 14:10 | |
| *** dariko has quit IRC | 14:10 | |
| *** tobberydberg has joined #openstack-ansible | 14:10 | |
| *** bhujay has joined #openstack-ansible | 14:10 | |
| *** armaan has quit IRC | 14:12 | |
| *** lbragstad has joined #openstack-ansible | 14:14 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Switch to using the imported nspawn roles https://review.openstack.org/547554 | 14:17 |
| openstackgerrit | Merged openstack/openstack-ansible-nspawn_hosts master: Updated from OpenStack Ansible Tests https://review.openstack.org/547134 | 14:19 |
| *** taseer3 has joined #openstack-ansible | 14:22 | |
| *** taseer2 has quit IRC | 14:22 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: Partially revert "Temporarily set functional tests to non-voting to unblock patch merging" https://review.openstack.org/547748 | 14:22 |
| *** bhujay has quit IRC | 14:22 | |
| *** tobberydberg has quit IRC | 14:22 | |
| *** tobberydberg has joined #openstack-ansible | 14:23 | |
| *** bhujay has joined #openstack-ansible | 14:23 | |
| *** woodard has joined #openstack-ansible | 14:24 | |
| *** woodard has quit IRC | 14:24 | |
| *** woodard has joined #openstack-ansible | 14:25 | |
| *** markvoelker has joined #openstack-ansible | 14:26 | |
| *** lbragstad has quit IRC | 14:28 | |
| *** markvoelker has quit IRC | 14:29 | |
| *** markvoelker has joined #openstack-ansible | 14:29 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: [TEST]ing a theory https://review.openstack.org/547755 | 14:31 |
| *** bhujay has quit IRC | 14:37 | |
| *** bhujay has joined #openstack-ansible | 14:42 | |
| *** indistylo has quit IRC | 14:43 | |
| *** armaan has joined #openstack-ansible | 14:45 | |
| *** markvoelker has quit IRC | 14:47 | |
| *** indistylo has joined #openstack-ansible | 14:49 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-pip_install stable/queens: Remove the implementation of constraints in pip.conf https://review.openstack.org/547756 | 14:50 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: Set upgrade tests to voting again https://review.openstack.org/547757 | 14:56 |
| *** admin0 has joined #openstack-ansible | 15:00 | |
| admin0 | hi all .. is putting firewall_v2 in variables not enough ? i got neutron not working saying " Error loading class by alias: NoMatches: No 'neutron.service_plugins' driver found, looking for 'firewall_v2' | 15:00 |
| admin0 | " | 15:00 |
| openstackgerrit | Merged openstack/openstack-ansible-repo_build stable/queens: Ensure virtualenv is not broken for CentOS/SuSE too https://review.openstack.org/546259 | 15:08 |
| *** lbragstad has joined #openstack-ansible | 15:09 | |
| ashak | is there asimple way right now to bypass the ovs problem? | 15:20 |
| JohnnyOSA | Morning all. Wondering if this is a bug or I'm missing something simple. External OS CLI commands to public endpoints return "endpoint not found" even though the debug info for that command shows the public endpoints are being returned to it. (http://paste.openstack.org/show/684364/) | 15:22 |
| admin0 | ashak, whats the ovs problem ? | 15:22 |
| admin0 | endpoint is admin only isn't it JohnnyOSA | 15:26 |
| odyssey4me | ashak if you're speaking of the issue where OVS is trying to install in gates, and failing - then a patch for Queens and Master merged a few hours ago, so just recheck | 15:26 |
| admin0 | you do openstack service list from external | 15:26 |
| JohnnyOSA | admin0: morning... "openstack service list" from external provides the same error (all OS CLI cmds do). Also, yes, I tried with non-admin user as well. Same result/error. | 15:29 |
| admin0 | does it work from the util container ? | 15:29 |
| JohnnyOSA | Yes -- everything works from within util container as expected. Just not outside. | 15:29 |
| admin0 | ok .. i have one cluster which we first used internally and later customers ( so cannot break it now ) .. there everything works from util container but anything that has to do with glance gives 503 error | 15:30 |
| odyssey4me | JohnnyOSA you've specified the endpoint type wrong | 15:30 |
| admin0 | maybe related | 15:30 |
| admin0 | but if someone wants logs of this, i can provide on this image thing | 15:30 |
| odyssey4me | s/externalURL/publicURL/' | 15:30 |
| JohnnyOSA | Ahh... Let me give that a try. | 15:31 |
| odyssey4me | it's the "public" endpoint, not the "external" endpoint ;) | 15:32 |
| admin0 | odyssey4me, i setup a cluster first, and then setup the logs container .. is there a way for me to run only the logs part so that the configs point to the logs and run it, without doing the whole setup-openstack playbook cycle | 15:32 |
| admin0 | a way to target rsyslog ip update | 15:33 |
| odyssey4me | openstack-ansible setup-everything.yml --tags rsyslog | 15:33 |
| admin0 | thanks odyssey4me | 15:33 |
| admin0 | exactly the thing i was lookign for | 15:33 |
| odyssey4me | that's what the tags are for ;) | 15:34 |
| odyssey4me | happy to help | 15:34 |
| odyssey4me | not sure about the fwaas/vpnaas stuff - you might have to verify against upstream docs to see if something changed and we now have a bug | 15:34 |
| *** bhujay has quit IRC | 15:35 | |
| *** bhujay has joined #openstack-ansible | 15:35 | |
| JohnnyOSA | Odyssey4me: that fixed it. My newbiness is shining though. I see I missed it in the docs now, thanks! | 15:36 |
| JohnnyOSA | though=through | 15:36 |
| odyssey4me | JohnnyOSA it's confusing terminology, for sure - I guess it has some legacy aspects to it | 15:36 |
| odyssey4me | there are public, internal and admin endpoints... they'll be phasing the admin ones out at some point as they serve no purpose any more | 15:37 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: [Docs] Guide users more https://review.openstack.org/547219 | 15:38 |
| JohnnyOSA | Ok, good to know. And also shows I really should be fact checking everything I change without making assumptions, but time availability is often the problem there :) | 15:38 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: [Docs] Add explicit warnings on common mistake https://review.openstack.org/547353 | 15:38 |
| odyssey4me | JohnnyOSA oh sure, but that's why there are people here to help catch those things :) | 15:40 |
| JohnnyOSA | awesome! | 15:41 |
| *** bhujay has quit IRC | 15:41 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-pip_install master: Remove the implementation of constraints in pip.conf https://review.openstack.org/547762 | 15:46 |
| *** indistylo has quit IRC | 15:53 | |
| *** markvoelker has joined #openstack-ansible | 15:57 | |
| *** markvoelker has quit IRC | 15:58 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_build master: [WIP] Make the git clone and wheel build optional https://review.openstack.org/537015 | 16:06 |
| odyssey4me | evrardjp cloudnull I think implementing constraints in pip.conf right now is a mistake. We make too many assumptions and always provide them on the pip install CLI, so for now I'd rather do https://review.openstack.org/547762 - solving all the upgrade test issues we're seeing all over the place. | 16:08 |
| evrardjp[m] | odyssey4me: will review this, but what you said makes sense. | 16:09 |
| *** armaan has quit IRC | 16:10 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_container_create master: Unify container network interfaces with networkd https://review.openstack.org/523218 | 16:10 |
| odyssey4me | evrardjp once that's merged, I'll port it back to queens - that will resolve the queens upgrade brokenness across all roles | 16:10 |
| *** armaan has joined #openstack-ansible | 16:10 | |
| evrardjp[m] | odyssey4me: it's also more explicit when reviewing/reading code. | 16:11 |
| evrardjp[m] | i saw a few patches on the neutron bits , did that solve the db thing too? | 16:12 |
| odyssey4me | evrardjp the db thing is actually due to this problem | 16:12 |
| odyssey4me | when we prep the upgrade environment, we set down pip.conf with constraints for pike - then we don't re-setup pip.conf for queens, so the install doesn't actually install the right software | 16:13 |
| *** bhujay has joined #openstack-ansible | 16:13 | |
| evrardjp[m] | ok. | 16:13 |
| evrardjp[m] | i see... yeah that sounds bad. | 16:14 |
| odyssey4me | cloudnull replied to your suggestion | 16:15 |
| evrardjp[m] | cloudnull: yup agreed with odyssey4me 's comment. | 16:17 |
| cloudnull | I think the only reason to have the no-index option re-added would be to ensure that if a deployer ran `pip install ...` they don't pull from doesn't pull up pypi. | 16:18 |
| evrardjp[m] | darn that's hard to review things with a phone. | 16:18 |
| cloudnull | ** don't pull from pypi... | 16:18 |
| * cloudnull can't type | 16:18 | |
| odyssey4me | cloudnull yep, that's the only reason I can see it being useful too | 16:18 |
| cloudnull | if that's not a concern, then +2 | 16:18 |
| *** lvdombrkr89 has quit IRC | 16:19 | |
| odyssey4me | If that is a concern, then I'll have to re-implement the lock down feature in rocky (I removed it recently, because it was a no-op). | 16:20 |
| cloudnull | the added constraints took the place of the "no-index" + find-links options. | 16:20 |
| odyssey4me | OK, let me do that - even if we remove it later - at least it keeps the same function. | 16:20 |
| cloudnull | I know our deployers use `pip install ...` all the time to test things | 16:20 |
| cloudnull | even if it's wrong | 16:20 |
| odyssey4me | Once we re-implement constraints after the remodelling of how things are built, then I can re-remove the lock down. | 16:20 |
| cloudnull | that said, | 16:21 |
| *** lbragstad has quit IRC | 16:21 | |
| cloudnull | if you want to leave it out in master to cater to the ongoing work ++ | 16:21 |
| cloudnull | and if it's something backportable we do a roll-up I'd be good with that | 16:21 |
| odyssey4me | well, for master I think we might just want to set 'pip_default_index: no-index' rather than have another var for it | 16:22 |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron stable/queens: Partially revert "Temporarily set functional tests to non-voting to unblock patch merging" https://review.openstack.org/547748 | 16:24 |
| odyssey4me | cloudnull actually, now that I think about it | 16:24 |
| odyssey4me | if we do repo-build, then there are wheels served by pypiserver - pypiserver will only serve its own versions of the things it holds, and the index returned from pip when looking for installs will never look upstream in that case | 16:25 |
| admin0 | cloudnull, firewall_v2 gave me this error post install , Error loading class by alias: NoMatches: No 'neutron.service_plugins' driver found, looking for 'firewall_v2' .. so had to disable it | 16:26 |
| odyssey4me | so there's no need to set 'no-index' any more, as lon gas the repo-build is building wheels | 16:26 |
| cloudnull | well that's convenient :) | 16:26 |
| odyssey4me | yep, it basically does the lock down automatically | 16:26 |
| cloudnull | yea, fair enough. | 16:27 |
| cloudnull | but isn't our pypi server also proxy'ing traffic back ? | 16:27 |
| * cloudnull maybe remembering things wrong | 16:28 | |
| cloudnull | if not, then I have no more objections :) | 16:28 |
| odyssey4me | nginx uses pypiserver for the index - if the index returns from there, it uses it... we've disabled pypiserver going to pypi for the index if it doesn't have it | 16:28 |
| odyssey4me | that's what this is: https://github.com/openstack/openstack-ansible-repo_server/blob/master/defaults/main.yml#L95 | 16:29 |
| cloudnull | ah ha! | 16:29 |
| cloudnull | well look at that | 16:30 |
| odyssey4me | disable redirect to real PyPI index for packages not found in the local index | 16:30 |
| cloudnull | ok, LGTM ! | 16:30 |
| odyssey4me | when we switch to not building the packages by default, we'll have to do something then - but that we can do at the same time as re-implementing constraints in the pip.conf file | 16:31 |
| cloudnull | += | 16:31 |
| odyssey4me | Given this conversation, I think I might also now port back the pip_lock_down removal. | 16:32 |
| odyssey4me | evrardjp[m] happy with all that? | 16:35 |
| odyssey4me | I've noted this all in the review to help us remember. :) | 16:35 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_container_create master: Unify container network interfaces with networkd https://review.openstack.org/523218 | 16:35 |
| cloudnull | odyssey4me: ++ I think it's worth a cherry-pick | 16:35 |
| odyssey4me | cloudnull did you see that https://review.openstack.org/547158 didn't pass? | 16:36 |
| cloudnull | no, I've been fixated on that other pr. | 16:36 |
| cloudnull | while thats gating let me go give that one another bash | 16:36 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-pip_install stable/queens: Remove pip_lock_to_internal_repo variable https://review.openstack.org/547766 | 16:40 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Remove pip_lock_to_internal_repo variable https://review.openstack.org/547767 | 16:42 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Replace host_need_pip with standard override mechanism https://review.openstack.org/547768 | 16:44 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-openstack_hosts stable/queens: Remove host_need_pip https://review.openstack.org/547769 | 16:44 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-openstack_hosts stable/queens: Remove host_need_pip https://review.openstack.org/547769 | 16:45 |
| *** SerenaFeng has joined #openstack-ansible | 16:47 | |
| admin0 | setting up logs is giving me an error: logs attached: https://gist.github.com/a1git/2d1a5e2767dab7c46a49cdb71f0230e6 | 16:48 |
| admin0 | running one now without the rsyslog part | 16:49 |
| admin0 | but limit=logs | 16:49 |
| *** armaan has quit IRC | 16:49 | |
| *** armaan has joined #openstack-ansible | 16:49 | |
| *** SerenaFeng has quit IRC | 16:52 | |
| odyssey4me | admin0 why limit to 'logs' ? | 16:52 |
| evrardjp[m] | odyssey4me: will have a look tonight. it seems reasonable, we definitely want to be more stable before the release, and unexpected versions are not good :) | 16:58 |
| odyssey4me | ja | 16:58 |
| odyssey4me | if we can get that pip_install patched merged, then the backport merged, then I can recheck all the failing queens role patches and see what else comes up | 16:59 |
| admin0 | odyssey4me, without the limit also gave me the same error .. so this was to capture the logs and makeit smaller | 16:59 |
| odyssey4me | the one thing that does bug me about the PTG happening at this time (during our RC period) is that we are sorely tempted to spend time on the release, rather than looking at the next release | 17:00 |
| odyssey4me | maybe we should use monday/tuesday as hack days to stabilise the queens release - between cross-project sessions | 17:00 |
| odyssey4me | admin0 odd | 17:01 |
| admin0 | i am rerunning from start | 17:01 |
| admin0 | i might have missed something | 17:01 |
| odyssey4me | admin0 I think there might be a new task that's not taged appropriately | 17:02 |
| odyssey4me | using the tag is causing another task it depends on to not run | 17:02 |
| admin0 | odyssey4me, i think so: https://gist.github.com/a1git/47fa274d89fe8570a9d3efecd2a9cd4c | 17:04 |
| admin0 | c1 2 3 = controllers, logs = logs | 17:05 |
| odyssey4me | It must have been mhayden's fault. | 17:05 |
| odyssey4me | actually, I think it's mine. :/ | 17:06 |
| odyssey4me | patch to test incoming | 17:07 |
| admin0 | if there are commands to run to fix it, it would be nice :) | 17:07 |
| admin0 | this is direct prod .. i hate to patch and cherry pick | 17:07 |
| admin0 | but will do :D | 17:07 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts master: Implement always tag for required fact https://review.openstack.org/547771 | 17:09 |
| odyssey4me | that should do it | 17:10 |
| odyssey4me | the only other option is not to use --tags... so it's your choice ;) | 17:10 |
| openstackgerrit | Merged openstack/openstack-ansible master: Increase Ansible SSH connection retries https://review.openstack.org/545844 | 17:16 |
| *** bhujay has quit IRC | 17:18 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_build master: [WIP] Make the git clone and wheel build optional https://review.openstack.org/537015 | 17:21 |
| openstackgerrit | Merged openstack/openstack-ansible master: Remove the "max_fail_percentage" option https://review.openstack.org/547218 | 17:21 |
| odyssey4me | cloudnull wanna port that one back as far as it'll go? | 17:22 |
| admin0 | cherry picked .. continueing | 17:23 |
| admin0 | when this is done, this platform(osa+ovs) will be used for a nfv SaaS/PaaS solution .. that i can document :) | 17:24 |
| odyssey4me | admin0 sounds good - thanks for helping us find more bugs ;) | 17:24 |
| odyssey4me | and for documenting things that work for you | 17:25 |
| admin0 | running openstack-ansible setup-everything.yml --tags rsyslog | 17:26 |
| admin0 | now .. being optimistic | 17:26 |
| admin0 | odyssey4me, will this patch be included in 16.0.9 ? | 17:26 |
| admin0 | so that during upgrade, i will be on the sane branch again :D | 17:26 |
| *** kstev has joined #openstack-ansible | 17:26 | |
| cloudnull | odyssey4me: which on e? | 17:27 |
| odyssey4me | admin0 once it merges, I'll propose the backports - it'll likely be in the release after next, not the current proposed | 17:27 |
| odyssey4me | cloudnull https://review.openstack.org/547218 | 17:27 |
| admin0 | same error ! | 17:27 |
| cloudnull | sure | 17:27 |
| odyssey4me | admin0 ORLY? | 17:28 |
| *** kstev has quit IRC | 17:28 | |
| admin0 | hmm | 17:28 |
| admin0 | git fetch/cherry-pick on /opt does not change files on /etc where the role lives right ? | 17:29 |
| admin0 | maybe my fault | 17:29 |
| odyssey4me | admin0 lol, no - the cherry-pick has to be in the role itself | 17:29 |
| admin0 | :D | 17:29 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible stable/queens: Remove the "max_fail_percentage" option https://review.openstack.org/547772 | 17:29 |
| odyssey4me | and you would have to be using roles pulled down via git for it to work | 17:29 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible stable/pike: Remove the "max_fail_percentage" option https://review.openstack.org/547773 | 17:30 |
| *** armaan has quit IRC | 17:30 | |
| *** armaan has joined #openstack-ansible | 17:30 | |
| openstackgerrit | Merged openstack/openstack-ansible master: Go back to assuming volume size in GB https://review.openstack.org/545849 | 17:31 |
| openstackgerrit | Merged openstack/openstack-ansible master: [Docs] Guide users more https://review.openstack.org/547219 | 17:31 |
| openstackgerrit | Merged openstack/openstack-ansible master: [Docs] Add explicit warnings on common mistake https://review.openstack.org/547353 | 17:31 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible stable/ocata: Remove the "max_fail_percentage" option https://review.openstack.org/547774 | 17:34 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible stable/newton: Remove the "max_fail_percentage" option https://review.openstack.org/547775 | 17:36 |
| cloudnull | odyssey4me: done | 17:36 |
| odyssey4me | cloudnull you missed some in https://review.openstack.org/547773, and probably the older ones too | 17:37 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible stable/pike: Remove the "max_fail_percentage" option https://review.openstack.org/547773 | 17:37 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible stable/queens: Remove the "max_fail_percentage" option https://review.openstack.org/547772 | 17:38 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible stable/ocata: Remove the "max_fail_percentage" option https://review.openstack.org/547774 | 17:38 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible stable/newton: Remove the "max_fail_percentage" option https://review.openstack.org/547775 | 17:38 |
| cloudnull | now done :) | 17:38 |
| odyssey4me | I think you broke https://review.openstack.org/#/c/547772/ ? | 17:38 |
| cloudnull | the cherry-picks missed things | 17:38 |
| cloudnull | oh... my sed changed the links to files. | 17:39 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible stable/queens: Remove the "max_fail_percentage" option https://review.openstack.org/547772 | 17:40 |
| cloudnull | one more time.. | 17:40 |
| cloudnull | OK, gotta run all. see you in dublin! | 17:40 |
| odyssey4me | cheerio sir - see you there on monday! | 17:45 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Isolate the Ansible bootstrap https://review.openstack.org/547526 | 17:54 |
| admin0 | odyssey4me, its running .. past the point i was stuck before | 18:03 |
| admin0 | if there could be ELK ( on the logs container ) and some sort of monitoring/alerting ( graphana,graphite) out of the box , it would have been complete :D | 18:10 |
| *** armaan has quit IRC | 18:12 | |
| *** armaan has joined #openstack-ansible | 18:14 | |
| odyssey4me | admin0 we expect to be bringing that in this cycle, assuming that d34dh0r53 actually pushes up a patch to do it :p | 18:17 |
| odyssey4me | there is https://github.com/openstack/openstack-ansible-ops/tree/master/elk_metrics which is a bit of a rough take, and there's also https://github.com/openstack/openstack-ansible-ops/tree/master/cluster_metrics which is not ELK, but provides a ton of useful metrics for analysis | 18:18 |
| odyssey4me | the plan is https://github.com/openstack/openstack-ansible-specs/blob/master/specs/queens/elk-stack.rst | 18:19 |
| *** pbandark has quit IRC | 18:19 | |
| admin0 | i tried cluster-metrics before .. got some issues on telegraf | 18:21 |
| admin0 | i can give it a try again here | 18:21 |
| admin0 | patch verified and working OK :) | 18:21 |
| admin0 | i have logs :) | 18:22 |
| admin0 | grep -r ERROR *| less \o/ . finally | 18:25 |
| odyssey4me | awesome, thanks - if you can vote and comment as such on the patch, that'd be awesome | 18:29 |
| admin0 | done | 18:38 |
| *** jwitko has quit IRC | 19:28 | |
| openstackgerrit | Merged openstack/openstack-ansible master: Add base kit scenario https://review.openstack.org/543534 | 19:38 |
| openstackgerrit | git-harry proposed openstack/openstack-ansible stable/queens: Increase Ansible SSH connection retries https://review.openstack.org/547780 | 19:49 |
| admin0 | glance image upload is stuck at saving for a long time .... what is the best/fastest way to toggle DEBUG=true/false in variables to the cluster, so that i can have more debug in the logs | 19:51 |
| openstackgerrit | git-harry proposed openstack/openstack-ansible stable/pike: Increase Ansible SSH connection retries https://review.openstack.org/547781 | 19:52 |
| openstackgerrit | git-harry proposed openstack/openstack-ansible stable/ocata: Increase Ansible SSH connection retries https://review.openstack.org/547782 | 19:53 |
| openstackgerrit | git-harry proposed openstack/openstack-ansible stable/newton: Increase Ansible SSH connection retries https://review.openstack.org/547783 | 19:54 |
| openstackgerrit | git-harry proposed openstack/openstack-ansible-tests master: Add ansible-lint rule for apt_repository https://review.openstack.org/547497 | 20:29 |
| *** oanson has quit IRC | 20:44 | |
| *** oanson has joined #openstack-ansible | 20:47 | |
| *** ansmith has joined #openstack-ansible | 20:53 | |
| *** ansmith has quit IRC | 21:03 | |
| *** dariko has joined #openstack-ansible | 21:39 | |
| *** dariko1 has quit IRC | 21:39 | |
| *** dariko has quit IRC | 21:55 | |
| *** admin0 has quit IRC | 21:59 | |
| *** dariko has joined #openstack-ansible | 22:00 | |
| *** dariko has quit IRC | 22:18 | |
| *** dariko1 has joined #openstack-ansible | 22:18 | |
| *** markvoelker has joined #openstack-ansible | 22:40 | |
| *** markvoelker has quit IRC | 22:45 | |
| *** markvoelker has joined #openstack-ansible | 22:46 | |
| *** markvoelker has quit IRC | 22:51 | |
| *** markvoelker has joined #openstack-ansible | 22:54 | |
| *** dariko1 has quit IRC | 23:46 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!