| *** jafeha has quit IRC | 00:04 | |
| openstackgerrit | Antony Messerli proposed openstack/openstack-ansible-ops master: Update Newton release to newton-eol in leap-upgrades https://review.openstack.org/576667 | 00:11 |
|---|---|---|
| *** nurdie has quit IRC | 00:18 | |
| *** nurdie has joined #openstack-ansible | 00:19 | |
| ThiagoCMC | All mysqld are dead, all seqno = -1, what to do? | 00:20 |
| ThiagoCMC | No backups, BTW... | 00:20 |
| *** nurdie has quit IRC | 00:23 | |
| *** dxiri has quit IRC | 00:23 | |
| mnaser | ThiagoCMC: there's a doc somewhere in osa docs | 00:29 |
| *** cshen has joined #openstack-ansible | 00:32 | |
| *** nurdie has joined #openstack-ansible | 00:35 | |
| *** cshen has quit IRC | 00:37 | |
| guilhermesp | ThiagoCMC: I think that can help: https://docs.openstack.org/openstack-ansible/latest/admin/maintenance-tasks/galera.html | 00:37 |
| *** jafeha has joined #openstack-ansible | 00:37 | |
| *** fatdragon has quit IRC | 01:02 | |
| *** gyee has quit IRC | 01:02 | |
| *** chyka has joined #openstack-ansible | 01:07 | |
| *** chyka has quit IRC | 01:11 | |
| *** tux_ has joined #openstack-ansible | 01:19 | |
| *** nurdie has quit IRC | 01:21 | |
| *** exodusftw has joined #openstack-ansible | 01:21 | |
| *** nurdie has joined #openstack-ansible | 01:21 | |
| *** nurdie has quit IRC | 01:25 | |
| *** JamesZhu has quit IRC | 01:34 | |
| *** JamesZhu has joined #openstack-ansible | 01:35 | |
| *** cjloader_ has joined #openstack-ansible | 01:41 | |
| *** cjloader has quit IRC | 01:41 | |
| *** cjloader_ has quit IRC | 01:45 | |
| *** lhinds has quit IRC | 01:59 | |
| *** cjloader has joined #openstack-ansible | 02:09 | |
| *** cjloader has quit IRC | 02:14 | |
| *** dxiri has joined #openstack-ansible | 02:14 | |
| *** lhinds has joined #openstack-ansible | 02:15 | |
| *** JamesZhu has quit IRC | 02:24 | |
| *** ianychoi_ has quit IRC | 02:27 | |
| *** cjloader has joined #openstack-ansible | 02:27 | |
| *** ianychoi has joined #openstack-ansible | 02:30 | |
| *** cjloader has quit IRC | 02:31 | |
| *** cshen has joined #openstack-ansible | 02:35 | |
| *** cshen has quit IRC | 02:40 | |
| *** Leo_m has quit IRC | 02:49 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add diagrams covering the deployment of ELK https://review.openstack.org/576646 | 02:59 |
| cloudnull | evenings | 03:02 |
| *** ThiagoCMC has quit IRC | 03:17 | |
| openstackgerrit | Merged openstack/openstack-ansible-ops master: Add diagrams covering the deployment of ELK https://review.openstack.org/576646 | 03:18 |
| openstackgerrit | Merged openstack/openstack-ansible-rsyslog_client master: Add release notes link to README https://review.openstack.org/576395 | 03:26 |
| openstackgerrit | Merged openstack/openstack-ansible-os_tacker master: add doc & release notes link to README https://review.openstack.org/576372 | 03:27 |
| openstackgerrit | Merged openstack/openstack-ansible-os_tempest master: add release notes link in readme https://review.openstack.org/576381 | 03:27 |
| openstackgerrit | Merged openstack/openstack-ansible-os_watcher master: add doc、releasenotes and home link in readme.rst https://review.openstack.org/576376 | 03:27 |
| openstackgerrit | Merged openstack/openstack-ansible-os_panko master: add doc、releasenotes and home link in readme.rst https://review.openstack.org/576378 | 03:28 |
| openstackgerrit | Merged openstack/openstack-ansible-apt_package_pinning master: Add release notes link to README https://review.openstack.org/576097 | 03:29 |
| openstackgerrit | Merged openstack/openstack-ansible-pip_install master: Add release notes link to README https://review.openstack.org/576396 | 03:29 |
| openstackgerrit | Merged openstack/openstack-ansible-os_rally master: Add release notes link to README https://review.openstack.org/576399 | 03:29 |
| openstackgerrit | Merged openstack/openstack-ansible-os_trove master: Add Documentation 、release notes and home link to README https://review.openstack.org/576369 | 03:30 |
| openstackgerrit | Merged openstack/openstack-ansible-rsyslog_server master: Add release notes link to README https://review.openstack.org/576404 | 03:30 |
| openstackgerrit | Merged openstack/openstack-ansible-os_searchlight master: add doc、releasenotes and home link in readme.rst https://review.openstack.org/576379 | 03:30 |
| openstackgerrit | Merged openstack/openstack-ansible-os_cloudkitty master: Update README.rst information https://review.openstack.org/576303 | 03:30 |
| openstackgerrit | Merged openstack/openstack-ansible-rabbitmq_server master: add release note link in readme https://review.openstack.org/576385 | 03:31 |
| openstackgerrit | Merged openstack/openstack-ansible-os_almanach master: Update README.rst information https://review.openstack.org/576333 | 03:31 |
| openstackgerrit | Merged openstack/openstack-ansible-os_aodh master: add doc、releasenotes and home link in readme.rst https://review.openstack.org/576386 | 03:31 |
| *** cjloader_ has joined #openstack-ansible | 03:32 | |
| *** dariko33 has joined #openstack-ansible | 03:33 | |
| *** cjloader_ has quit IRC | 03:35 | |
| tux_ | what would be the best option for production "nova_cpu_allocation_ratio: 2.0" ? | 03:36 |
| *** cjloader has joined #openstack-ansible | 03:36 | |
| *** cjloader has quit IRC | 03:37 | |
| *** cjloader has joined #openstack-ansible | 03:37 | |
| *** udesale has joined #openstack-ansible | 03:40 | |
| *** wlmbasson has quit IRC | 03:41 | |
| *** mnaser has quit IRC | 03:42 | |
| *** Guest45438 has quit IRC | 03:42 | |
| *** fatdragon has joined #openstack-ansible | 03:43 | |
| *** fyx has quit IRC | 03:44 | |
| cloudnull | tux_ the OpenStack default is 16:1 | 03:44 |
| cloudnull | its really all depends on what you want as your end user experience . | 03:45 |
| tux_ | what would be idle for production where we have 40 core hypervisor | 03:45 |
| *** wlmbasson has joined #openstack-ansible | 03:45 | |
| *** mnaser has joined #openstack-ansible | 03:45 | |
| *** Guest45438 has joined #openstack-ansible | 03:45 | |
| cloudnull | higher performance or higher density . | 03:45 |
| tux_ | Our application is CPU hungry so i want to run them smoothly | 03:46 |
| *** fyx has joined #openstack-ansible | 03:46 | |
| cloudnull | Then I'd probably do ~4:1 or so. | 03:46 |
| cloudnull | unless all instances will be running all jobs all the time | 03:47 |
| cloudnull | then maybe 1:1 | 03:47 |
| tux_ | 1:1 means 1vcp will map to physical core right (hyperthred core) | 03:47 |
| *** neith has quit IRC | 03:47 | |
| *** liangqi has quit IRC | 03:48 | |
| cloudnull | yup, no over-commit | 03:48 |
| tux_ | i think 4:1 would be idle | 03:48 |
| *** xdfil has quit IRC | 03:48 | |
| *** hw_wutianwei_ has quit IRC | 03:49 | |
| *** fatdragon has quit IRC | 03:49 | |
| *** jamespage has quit IRC | 03:49 | |
| *** spsurya has quit IRC | 03:49 | |
| *** Talion has quit IRC | 03:49 | |
| *** jamespo has quit IRC | 03:49 | |
| *** portdirect has quit IRC | 03:50 | |
| *** johnsom has quit IRC | 03:50 | |
| *** ullbeking has quit IRC | 03:50 | |
| *** alanmeadows has quit IRC | 03:50 | |
| *** paulfantom has quit IRC | 03:50 | |
| *** mubix has quit IRC | 03:50 | |
| *** hogepodge has quit IRC | 03:50 | |
| *** wlmbasson has quit IRC | 03:50 | |
| *** berendt_ has quit IRC | 03:51 | |
| *** ildikov has quit IRC | 03:51 | |
| *** Guest45438 has quit IRC | 03:51 | |
| *** mnaser has quit IRC | 03:51 | |
| *** fyx has quit IRC | 03:51 | |
| *** harryhuang_ has quit IRC | 03:51 | |
| *** fdegir has quit IRC | 03:51 | |
| *** adrianreza has quit IRC | 03:51 | |
| *** boxrick has quit IRC | 03:51 | |
| *** Guest19794 has quit IRC | 03:51 | |
| *** mrhillsman has quit IRC | 03:51 | |
| *** geekinutah has quit IRC | 03:51 | |
| *** xgerman_ has quit IRC | 03:52 | |
| *** AndyWojo has quit IRC | 03:52 | |
| *** serverascode has quit IRC | 03:52 | |
| openstackgerrit | Merged openstack/openstack-ansible-repo_build master: redhat: Add the EPEL repository for moreutils packages https://review.openstack.org/576305 | 03:53 |
| openstackgerrit | Merged openstack/openstack-ansible-os_cloudkitty master: Use coordination to prevent duplicate pricing https://review.openstack.org/576121 | 03:55 |
| *** cjloader has quit IRC | 03:58 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_designate master: Use correct package for CentOS rndc https://review.openstack.org/576579 | 04:02 |
| tux_ | Do you guys keep auto-generated password or your favorite one? user_secrets.yml | 04:02 |
| tux_ | there are lots of password so thinking to keep auto-gen | 04:03 |
| *** cshen has joined #openstack-ansible | 04:04 | |
| *** radeks_ has joined #openstack-ansible | 04:04 | |
| openstackgerrit | Nguyen Hai proposed openstack/openstack-ansible master: Trivial: Update pypi url to new url https://review.openstack.org/563385 | 04:04 |
| *** cshen has quit IRC | 04:08 | |
| *** poopcat has quit IRC | 04:12 | |
| *** armaan has quit IRC | 04:16 | |
| *** armaan has joined #openstack-ansible | 04:17 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia master: Update to use oslo.messaging services for RPC and Notify https://review.openstack.org/574829 | 04:23 |
| *** poopcat has joined #openstack-ansible | 04:29 | |
| *** openstack has joined #openstack-ansible | 04:32 | |
| *** ChanServ sets mode: +o openstack | 04:32 | |
| openstackgerrit | Merged openstack/openstack-ansible master: Add extra process documentation https://review.openstack.org/570922 | 04:33 |
| *** dxiri has quit IRC | 04:35 | |
| *** Bhujay has joined #openstack-ansible | 04:36 | |
| *** dxiri_ has quit IRC | 04:36 | |
| tux_ | openstack-ansible ssh timeout issue, where should i bump timeout ? | 04:41 |
| *** tux_ has quit IRC | 04:43 | |
| *** markvoelker has quit IRC | 04:45 | |
| *** nicolasbock has joined #openstack-ansible | 04:56 | |
| *** masber has quit IRC | 04:59 | |
| *** nurdie has joined #openstack-ansible | 05:05 | |
| *** poopcat has quit IRC | 05:12 | |
| *** geekinutah has joined #openstack-ansible | 05:21 | |
| *** AndyWojo has joined #openstack-ansible | 05:22 | |
| *** xdfil has joined #openstack-ansible | 05:23 | |
| *** liangqi has joined #openstack-ansible | 05:23 | |
| *** paulfantom has joined #openstack-ansible | 05:23 | |
| *** Talion has joined #openstack-ansible | 05:23 | |
| *** tux_ has joined #openstack-ansible | 05:23 | |
| *** vurtz has quit IRC | 05:23 | |
| *** ildikov has joined #openstack-ansible | 05:23 | |
| *** tux_ has quit IRC | 05:24 | |
| *** Guest45438 has joined #openstack-ansible | 05:24 | |
| *** wlmbasson has joined #openstack-ansible | 05:24 | |
| *** ullbeking has joined #openstack-ansible | 05:26 | |
| *** serverascode has joined #openstack-ansible | 05:28 | |
| *** neith has joined #openstack-ansible | 05:29 | |
| *** jamespage has joined #openstack-ansible | 05:29 | |
| *** jamespo has joined #openstack-ansible | 05:29 | |
| openstackgerrit | baiwenteng proposed openstack/openstack-ansible-tests master: add release notes to README.rst https://review.openstack.org/576726 | 05:30 |
| *** mubix has joined #openstack-ansible | 05:30 | |
| *** alanmeadows has joined #openstack-ansible | 05:31 | |
| *** udesale_ has joined #openstack-ansible | 05:33 | |
| *** fdegir has joined #openstack-ansible | 05:35 | |
| *** harryhuang_ has joined #openstack-ansible | 05:36 | |
| *** berendt_ has joined #openstack-ansible | 05:36 | |
| *** johnsom has joined #openstack-ansible | 05:36 | |
| *** udesale has quit IRC | 05:36 | |
| *** adrianreza has joined #openstack-ansible | 05:37 | |
| *** radek__ has joined #openstack-ansible | 05:40 | |
| *** mnaser has joined #openstack-ansible | 05:42 | |
| *** fyx has joined #openstack-ansible | 05:43 | |
| *** fatdragon has joined #openstack-ansible | 05:45 | |
| *** spsurya has joined #openstack-ansible | 05:47 | |
| *** fatdragon has quit IRC | 05:50 | |
| *** mnaser has quit IRC | 05:51 | |
| *** wlmbasson has quit IRC | 05:51 | |
| *** fyx has quit IRC | 05:51 | |
| *** mnaser has joined #openstack-ansible | 05:51 | |
| *** boxrick has joined #openstack-ansible | 05:52 | |
| *** Guest45438 has quit IRC | 05:55 | |
| openstackgerrit | baiwenteng proposed openstack/openstack-ansible-ops master: add release notes to README.rst https://review.openstack.org/576736 | 05:55 |
| *** mnaser has quit IRC | 05:56 | |
| *** jamespo has quit IRC | 05:57 | |
| *** paulfantom has quit IRC | 05:57 | |
| *** liangqi has quit IRC | 05:57 | |
| *** AndyWojo has quit IRC | 05:57 | |
| *** berendt_ has quit IRC | 05:57 | |
| *** jamespage has quit IRC | 05:57 | |
| *** Talion has quit IRC | 05:57 | |
| *** xdfil has quit IRC | 05:57 | |
| *** spsurya has quit IRC | 05:57 | |
| *** neith has quit IRC | 05:57 | |
| *** ildikov has quit IRC | 05:57 | |
| *** geekinutah has quit IRC | 05:57 | |
| *** harryhuang_ has quit IRC | 05:57 | |
| *** johnsom has quit IRC | 05:57 | |
| *** alanmeadows has quit IRC | 05:57 | |
| *** ullbeking has quit IRC | 05:58 | |
| *** adrianreza has quit IRC | 05:58 | |
| *** fdegir has quit IRC | 05:58 | |
| *** mubix has quit IRC | 05:58 | |
| *** serverascode has quit IRC | 05:58 | |
| *** boxrick has quit IRC | 05:58 | |
| *** lvdombrkr has joined #openstack-ansible | 06:04 | |
| *** mnaser has joined #openstack-ansible | 06:10 | |
| *** lvdombrkr has quit IRC | 06:11 | |
| *** lvdombrkr has joined #openstack-ansible | 06:11 | |
| *** Guest45438 has joined #openstack-ansible | 06:12 | |
| *** fyx has joined #openstack-ansible | 06:16 | |
| *** DanyC has joined #openstack-ansible | 06:17 | |
| *** wlmbasson has joined #openstack-ansible | 06:17 | |
| *** alanmeadows has joined #openstack-ansible | 06:19 | |
| *** AndyWojo has joined #openstack-ansible | 06:19 | |
| *** boxrick has joined #openstack-ansible | 06:20 | |
| *** mrhillsman has joined #openstack-ansible | 06:20 | |
| *** mubix has joined #openstack-ansible | 06:20 | |
| *** xgerman_ has joined #openstack-ansible | 06:20 | |
| *** harryhuang_ has joined #openstack-ansible | 06:21 | |
| *** neith has joined #openstack-ansible | 06:21 | |
| *** paulfantom has joined #openstack-ansible | 06:21 | |
| *** jamespage has joined #openstack-ansible | 06:21 | |
| *** portdirect has joined #openstack-ansible | 06:21 | |
| *** jamespage has quit IRC | 06:21 | |
| *** jamespage has joined #openstack-ansible | 06:21 | |
| *** serverascode has joined #openstack-ansible | 06:21 | |
| *** adrianreza has joined #openstack-ansible | 06:21 | |
| *** jamespage has quit IRC | 06:21 | |
| *** jamespage has joined #openstack-ansible | 06:21 | |
| *** portdirect has quit IRC | 06:21 | |
| *** portdirect has joined #openstack-ansible | 06:21 | |
| *** serverascode has quit IRC | 06:22 | |
| *** serverascode has joined #openstack-ansible | 06:22 | |
| *** jamespage has quit IRC | 06:22 | |
| *** jamespage has joined #openstack-ansible | 06:22 | |
| *** adrianreza has quit IRC | 06:22 | |
| *** adrianreza has joined #openstack-ansible | 06:22 | |
| *** berendt_ has joined #openstack-ansible | 06:22 | |
| *** cshen has joined #openstack-ansible | 06:22 | |
| *** johnsom has joined #openstack-ansible | 06:22 | |
| *** xdfil has joined #openstack-ansible | 06:23 | |
| *** Talion has joined #openstack-ansible | 06:23 | |
| *** fdegir has joined #openstack-ansible | 06:23 | |
| *** d34dh0r53 has quit IRC | 06:24 | |
| *** d34dh0r53 has joined #openstack-ansible | 06:24 | |
| *** liangqi has joined #openstack-ansible | 06:25 | |
| *** jamespo has joined #openstack-ansible | 06:25 | |
| *** geekinutah has joined #openstack-ansible | 06:25 | |
| *** serverascode has quit IRC | 06:26 | |
| *** spsurya has joined #openstack-ansible | 06:26 | |
| *** ullbeking has joined #openstack-ansible | 06:26 | |
| *** ildikov has joined #openstack-ansible | 06:26 | |
| *** nurdie has quit IRC | 06:26 | |
| *** serverascode has joined #openstack-ansible | 06:26 | |
| *** serverascode has quit IRC | 06:29 | |
| *** serverascode has joined #openstack-ansible | 06:30 | |
| openstackgerrit | Nguyen Hai proposed openstack/openstack-ansible master: Trivial: Update pypi url to new url https://review.openstack.org/563385 | 06:33 |
| openstackgerrit | Nguyen Hai proposed openstack/openstack-ansible master: Trivial: Update pypi url to new url https://review.openstack.org/563385 | 06:33 |
| *** sxc731 has joined #openstack-ansible | 06:37 | |
| *** DanyC has quit IRC | 06:37 | |
| *** prasen has joined #openstack-ansible | 06:45 | |
| *** markvoelker has joined #openstack-ansible | 06:46 | |
| *** lvdombrkr89 has joined #openstack-ansible | 06:50 | |
| *** lvdombrkr has quit IRC | 06:53 | |
| *** hw_wutianwei_ has joined #openstack-ansible | 06:56 | |
| *** Guest19794 has joined #openstack-ansible | 06:59 | |
| *** hogepodge has joined #openstack-ansible | 07:00 | |
| *** epalper has joined #openstack-ansible | 07:00 | |
| *** sxc731 has quit IRC | 07:02 | |
| openstackgerrit | Merged openstack/openstack-ansible master: Fix the incorrect cirros default password https://review.openstack.org/567172 | 07:03 |
| *** udesale__ has joined #openstack-ansible | 07:06 | |
| *** rodolof has joined #openstack-ansible | 07:06 | |
| *** udesale_ has quit IRC | 07:09 | |
| evrardjp | mnaser: could you check my comment on https://review.openstack.org/#/c/576613/2 , please? ty | 07:17 |
| *** markvoelker has quit IRC | 07:21 | |
| evrardjp | it would be nice if I could have votes on https://review.openstack.org/#/c/575505/13 | 07:21 |
| evrardjp | andymccr: odyssey4me ? ^ | 07:22 |
| evrardjp | we can later improve the role | 07:22 |
| *** hachi has quit IRC | 07:26 | |
| *** tosky has joined #openstack-ansible | 07:30 | |
| *** poul has joined #openstack-ansible | 07:31 | |
| *** vakuznet has quit IRC | 07:31 | |
| *** vakuznet has joined #openstack-ansible | 07:32 | |
| *** DanyC has joined #openstack-ansible | 07:40 | |
| fdegir | mnaser: I've seen you've been doing quite some Centos fixes lately | 07:41 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_neutron master: [WIP] Third party extensions for neutron https://review.openstack.org/576773 | 07:41 |
| fdegir | mnaser: can we assume that you are maintaining OSA on Centos and come to you if we have trouble with it? | 07:42 |
| *** lvdombrkr89 has quit IRC | 07:43 | |
| *** fatdragon has joined #openstack-ansible | 07:47 | |
| *** fatdragon has quit IRC | 07:52 | |
| *** gkadam has joined #openstack-ansible | 07:56 | |
| *** nicolasbock has quit IRC | 07:58 | |
| openstackgerrit | fupingxie proposed openstack/openstack-ansible-os_designate master: Trivial: Fix the pep8 warning https://review.openstack.org/576777 | 07:59 |
| *** chyka has joined #openstack-ansible | 07:59 | |
| *** hassenius has joined #openstack-ansible | 08:00 | |
| *** hasseniu_ has joined #openstack-ansible | 08:01 | |
| *** armaan has quit IRC | 08:03 | |
| openstackgerrit | fupingxie proposed openstack/openstack-ansible-os_horizon master: Trivial: Fix the pep8 warning https://review.openstack.org/576779 | 08:03 |
| *** chyka has quit IRC | 08:04 | |
| *** hassenius has quit IRC | 08:05 | |
| *** rpittau is now known as rpittau_ | 08:05 | |
| *** rpittau_ is now known as elfosardo | 08:05 | |
| *** elfosardo is now known as rpittau | 08:05 | |
| *** rmart04 has joined #openstack-ansible | 08:07 | |
| openstackgerrit | fupingxie proposed openstack/openstack-ansible-galera_server master: Trivial: Fix the pep8 warning https://review.openstack.org/576780 | 08:08 |
| *** rodolof has quit IRC | 08:09 | |
| *** rpittau is now known as rpittau__ | 08:09 | |
| *** rpittau__ is now known as rpittau | 08:09 | |
| *** rpittau has quit IRC | 08:10 | |
| *** rodolof has joined #openstack-ansible | 08:10 | |
| *** rpittau has joined #openstack-ansible | 08:10 | |
| openstackgerrit | fupingxie proposed openstack/openstack-ansible-os_swift master: Trivial: Fix the pep8 warning https://review.openstack.org/576781 | 08:11 |
| *** pcaruana has joined #openstack-ansible | 08:11 | |
| Tahvok | mnaser: what logs do you need? I'm creating a new osa environment now, so you need the run logs? | 08:15 |
| Tahvok | mnaser: I'm talking about this bug: https://bugs.launchpad.net/openstack-ansible/+bug/1776606 | 08:16 |
| openstack | Launchpad bug 1776606 in openstack-ansible "qemu-kvm missing on new compute hosts" [Undecided,Incomplete] | 08:16 |
| openstackgerrit | fupingxie proposed openstack/openstack-ansible-repo_build master: Trivial: Fix the pep8 warning https://review.openstack.org/576783 | 08:17 |
| *** armaan has joined #openstack-ansible | 08:18 | |
| *** markvoelker has joined #openstack-ansible | 08:18 | |
| openstackgerrit | fupingxie proposed openstack/openstack-ansible-rabbitmq_server master: Trivial: Fix the pep8 warning https://review.openstack.org/576785 | 08:21 |
| openstackgerrit | fupingxie proposed openstack/openstack-ansible-pip_install master: Trivial: Fix the pep8 warning https://review.openstack.org/576786 | 08:24 |
| openstackgerrit | fupingxie proposed openstack/openstack-ansible-os_tempest master: Trivial: Fix the pep8 warning https://review.openstack.org/576789 | 08:27 |
| openstackgerrit | fupingxie proposed openstack/openstack-ansible-haproxy_server master: Trivial: Fix the pep8 warning https://review.openstack.org/576790 | 08:30 |
| *** hachi has joined #openstack-ansible | 08:32 | |
| *** armaan has quit IRC | 08:35 | |
| *** armaan has joined #openstack-ansible | 08:35 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_rally master: Use isolated https://review.openstack.org/576791 | 08:39 |
| *** rmart04_ has joined #openstack-ansible | 08:40 | |
| *** nicolasbock has joined #openstack-ansible | 08:41 | |
| nicolasbock | Good morning | 08:42 |
| nicolasbock | I am trying to understand why https://review.openstack.org/#/c/574893/ keeps failing some tests | 08:42 |
| nicolasbock | In http://logs.openstack.org/93/574893/4/check/openstack-ansible-deploy-aio_lxc-ubuntu-xenial/893f07a/logs/ara-report/ I see that this particular test failed because | 08:43 |
| nicolasbock | No matching distribution found for pbr<=3.1.1 (from -c /var/www/repo/os-releases/18.0.0.0b3/ubuntu-16.04-x86_64/requirements_constraints.txt (line 103)) | 08:43 |
| *** rmart04 has quit IRC | 08:43 | |
| *** rmart04_ is now known as rmart04 | 08:43 | |
| nicolasbock | Is that a mirror issue, i.e. are we not mirroring appropriate versions of pbr? | 08:43 |
| *** DanyC has quit IRC | 08:45 | |
| openstackgerrit | Taseer Ahmed proposed openstack/openstack-ansible-os_blazar master: This patch ensures that the functional tests for Blazar pass. https://review.openstack.org/571388 | 08:45 |
| *** shardy has joined #openstack-ansible | 08:45 | |
| *** DanyC has joined #openstack-ansible | 08:45 | |
| *** spsurya has quit IRC | 08:46 | |
| *** armaan has quit IRC | 08:46 | |
| *** armaan has joined #openstack-ansible | 08:47 | |
| *** radek__ has quit IRC | 08:49 | |
| *** Bhujay has quit IRC | 08:50 | |
| *** Bhujay has joined #openstack-ansible | 08:51 | |
| *** Bhujay has quit IRC | 08:52 | |
| *** markvoelker has quit IRC | 08:52 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_rally master: Use isolated https://review.openstack.org/576791 | 08:57 |
| evrardjp | andymccr: this should be clarifying the context: https://review.openstack.org/#/c/576791/ | 08:57 |
| evrardjp | nicolasbock: mmm | 08:58 |
| evrardjp | let me check | 08:58 |
| evrardjp | but the gist is: | 08:58 |
| evrardjp | 1) I think we need to change repo server | 08:58 |
| evrardjp | 2) I think we need to make sure there is no conflicting requirements | 08:59 |
| nicolasbock | Ok evrardjp | 08:59 |
| *** cshen has quit IRC | 08:59 | |
| evrardjp | nicolasbock: but that doesn't seem related AT ALL to your patch | 08:59 |
| nicolasbock | I know, which is the sad part :) | 08:59 |
| evrardjp | where do you see that failure? | 09:00 |
| nicolasbock | It just seems that we need to recheck a million times just to get it passed | 09:00 |
| evrardjp | Because for ubuntu that's not the failure | 09:00 |
| nicolasbock | http://logs.openstack.org/93/574893/4/check/openstack-ansible-deploy-aio_lxc-ubuntu-xenial/893f07a/ | 09:00 |
| nicolasbock | Oh? | 09:00 |
| evrardjp | Failed to establish authenticated ssh connection to cirros@172.29.249.120 | 09:00 |
| nicolasbock | I was looking at the awesome ara report you showed me :) | 09:00 |
| evrardjp | http://logs.openstack.org/93/574893/4/check/openstack-ansible-deploy-aio_lxc-ubuntu-xenial/893f07a/logs/ara-report/result/84dc3398-14ad-4699-86ca-fff8c5ee8b1e/ | 09:01 |
| evrardjp | tempest.lib.exceptions.TimeoutException: Request timed out | 09:01 |
| evrardjp | Details: (VolumesBackupsAdminTest:_run_cleanups) Failed to delete backup e9867d8b-494e-44a1-9289-1f131f4b7cca within the required time (600 s). | 09:01 |
| evrardjp | I extended timeouts from 300 to 600s | 09:01 |
| evrardjp | I don't want to extend further | 09:01 |
| evrardjp | I am betting we are on ovh | 09:01 |
| evrardjp | ding ding ding | 09:01 |
| evrardjp | winner! | 09:01 |
| nicolasbock | Ok, so the earlier failure is a red herring? | 09:02 |
| nicolasbock | Why is OVH known to be a little on the slow side? | 09:02 |
| evrardjp | nicolasbock: could you point to a specific line in that log? | 09:02 |
| evrardjp | nicolasbock: yeah, so... Basically they have a kernel issue for a certain time, which makes kvm instances in nested virt crash randomly under IO | 09:03 |
| evrardjp | so we disabled kvm for OVH, and use qemu directly | 09:03 |
| nicolasbock | Ok | 09:03 |
| evrardjp | (in gates) | 09:03 |
| evrardjp | https://github.com/openstack/openstack-ansible/blob/091a0841afa3e9bfbd64965038e0e1c27d99e84e/tests/roles/bootstrap-host/tasks/prepare_aio_config.yml#L80-L82 | 09:04 |
| evrardjp | octavia has the same issue, so we did the same thing | 09:04 |
| nicolasbock | But is qemu slower? | 09:05 |
| evrardjp | we are far more reliable since then | 09:05 |
| evrardjp | oh yeah | 09:05 |
| *** cshen has joined #openstack-ansible | 09:05 | |
| evrardjp | full emulation of everything, that's a LOT slower | 09:05 |
| nicolasbock | Ok, I see, that makes sense | 09:05 |
| nicolasbock | And to raise the timeout just for OVH? | 09:05 |
| evrardjp | that's not a bad idea | 09:05 |
| evrardjp | I am not sure how much we can raise it though, as there will be timeouts on the jobs :) | 09:06 |
| nicolasbock | Ah ok | 09:06 |
| evrardjp | and jobs cannot be made conditional based on providers | 09:06 |
| evrardjp | but we can try it's not a bad idea | 09:06 |
| nicolasbock | You mean that OVH imposes a timeout on Zuul jobs? | 09:06 |
| evrardjp | nope | 09:06 |
| evrardjp | infra does | 09:06 |
| nicolasbock | ok | 09:06 |
| evrardjp | and even, for developer experience, we are already high in terms of length. | 09:07 |
| nicolasbock | I see, so the job would have to finish within that timeout regardless of internal timeouts | 09:07 |
| evrardjp | yeah. | 09:07 |
| nicolasbock | Yes, true | 09:07 |
| nicolasbock | I think you can argue though that the developer experience is worse if they have to 'recheck' several times ;) | 09:07 |
| evrardjp | 100% agreed. | 09:08 |
| evrardjp | I think that's bad experience we have there, but we can't say no to ovh nodes. | 09:08 |
| evrardjp | there is no fail fast either, as the jobs are independently tested | 09:09 |
| nicolasbock | Is the kernel bug on the hypervisor or the VM image? | 09:09 |
| evrardjp | hypervisor | 09:09 |
| nicolasbock | Ok, so we can't do anything about that | 09:10 |
| evrardjp | we should speak with johnsom about that, maybe there is something we can do about it with the help of infra. That could probably be helpful for both projects | 09:10 |
| *** cshen has quit IRC | 09:10 | |
| nicolasbock | True | 09:10 |
| nicolasbock | But isn't OVH seeing issues with this for other customers? | 09:10 |
| evrardjp | johnsom: we are talking about the ovh kernel issues again, and maybe we should think of a longer term approach now -- maybe help infra fix that kernel thing. | 09:11 |
| evrardjp | nicolasbock: I don't think so | 09:11 |
| evrardjp | it's a separate thing | 09:11 |
| evrardjp | nicolasbock: or we can rely on probabilities | 09:12 |
| nicolasbock | What do you mean it's separate evrardjp ? Did I misunderstand the issue? | 09:12 |
| nicolasbock | If the kernel running on OVH's hypervisor node has a bug | 09:12 |
| nicolasbock | Then I would expect other customers to run into the same issue we see | 09:13 |
| evrardjp | yeah but those nodes are handled differently for their customers and infra. | 09:13 |
| evrardjp | maybe not the same hardware nodes either | 09:13 |
| nicolasbock | You mean they have a segregated pool of servers just for OpenStack? | 09:14 |
| evrardjp | that started to show up after spectre/meldown too. | 09:14 |
| nicolasbock | Of course :) | 09:14 |
| evrardjp | nicolasbock: just for the openstack infra sharing yes | 09:14 |
| evrardjp | if I am not mistaken | 09:14 |
| nicolasbock | Are you familiar with the kernel issue we had in the ECP? | 09:14 |
| nicolasbock | The symptoms were not related to crashes, but definitely due to spectre/meltdown changes. | 09:15 |
| *** lvdombrkr has joined #openstack-ansible | 09:15 | |
| evrardjp | I am not | 09:16 |
| evrardjp | but I am not surprised | 09:16 |
| evrardjp | spectre/meltdown quite reduced our ability to gate fast in all providers, and I am pretty sure it's not the end of this. | 09:16 |
| evrardjp | if you want to do overrides for ovh, I am fine with that | 09:16 |
| evrardjp | https://github.com/openstack/openstack-ansible-os_tempest/blob/master/tasks/tempest_post_install.yml#L54 | 09:17 |
| evrardjp | so in the previous link I gave you, to determine special overrides for ovh, you could add something with tempest_tempest_conf_overrides | 09:17 |
| evrardjp | and update the _timeout things, probably 1.5x what it is right now is helpful. | 09:18 |
| *** lvdombrkr89 has joined #openstack-ansible | 09:18 | |
| evrardjp | I think that we need to make sure it's x3, but that would probably get us to timeouts. | 09:18 |
| evrardjp | so starting with x1.5 on ovh sounds reasonable :) | 09:19 |
| evrardjp | we can iterate | 09:19 |
| evrardjp | I have to go | 09:19 |
| evrardjp | ttyl | 09:19 |
| nicolasbock | Ok, sounds good. Thanks! | 09:19 |
| *** lvdombrkr has quit IRC | 09:21 | |
| *** rodolof has quit IRC | 09:31 | |
| *** rodolof has joined #openstack-ansible | 09:31 | |
| *** electrofelix has joined #openstack-ansible | 09:34 | |
| *** koukou has joined #openstack-ansible | 09:37 | |
| koukou | Hello, in my deployment my network nodes are my compute nodes. neutron.conf set his dhcp agent per network number to network nodes number. Network have too much port because of this > project's port quota exceded. | 09:45 |
| koukou | Does anyone have a problem with me propose a change to put a maximum number of agent per network option ? | 09:45 |
| *** fatdragon has joined #openstack-ansible | 09:48 | |
| *** sxc731 has joined #openstack-ansible | 09:51 | |
| *** armaan has quit IRC | 09:52 | |
| *** radek__ has joined #openstack-ansible | 09:53 | |
| *** armaan has joined #openstack-ansible | 09:53 | |
| *** fatdragon has quit IRC | 09:54 | |
| *** shardy has quit IRC | 10:06 | |
| *** shardy has joined #openstack-ansible | 10:06 | |
| *** radeks_ has quit IRC | 10:10 | |
| *** cristicalin has joined #openstack-ansible | 10:18 | |
| *** hachi has quit IRC | 10:25 | |
| *** armaan has quit IRC | 10:25 | |
| *** armaan has joined #openstack-ansible | 10:25 | |
| *** zwen has joined #openstack-ansible | 10:34 | |
| *** cristicalin has quit IRC | 10:37 | |
| *** armaan has quit IRC | 10:46 | |
| *** armaan has joined #openstack-ansible | 10:47 | |
| *** markvoelker has joined #openstack-ansible | 10:48 | |
| *** cristicalin has joined #openstack-ansible | 10:48 | |
| *** cristicalin has quit IRC | 10:53 | |
| *** vurtz has joined #openstack-ansible | 10:57 | |
| *** sxc731 has quit IRC | 10:57 | |
| *** shardy is now known as shardy_afk | 11:13 | |
| *** cristicalin has joined #openstack-ansible | 11:19 | |
| *** udesale__ has quit IRC | 11:20 | |
| evrardjp | koukou: a few questions there | 11:21 |
| evrardjp | why would you want to run network nodes == compute nodes... You generally don't need much more than a few network nodes. | 11:22 |
| *** markvoelker has quit IRC | 11:22 | |
| evrardjp | second I am not sure what you're trying to achieve | 11:22 |
| evrardjp | quotas can be defined by project, and overriden. | 11:23 |
| evrardjp | as a cloud admin, you can set up your tenants' quotas | 11:23 |
| evrardjp | tenants = projects | 11:23 |
| *** cristicalin has quit IRC | 11:25 | |
| *** ansmith has quit IRC | 11:25 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: Unpin ceph-ansible and add ceph-ansible library path https://review.openstack.org/550749 | 11:25 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: Unpin ceph-ansible and add ceph-ansible library path https://review.openstack.org/550749 | 11:26 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_rally master: Use isolated https://review.openstack.org/576791 | 11:29 |
| *** hachi has joined #openstack-ansible | 11:33 | |
| *** chyka has joined #openstack-ansible | 11:35 | |
| *** tux_ has joined #openstack-ansible | 11:36 | |
| mnaser | fdegir: sure, please raise any OSA issues on CentOS | 11:36 |
| fdegir | mnaser: thanks. I hope you won't regret this :) | 11:38 |
| mnaser | fdegir: aha :) no worries. We should make sure you never have to reach out :) | 11:38 |
| fdegir | mnaser: that's even better. I'll buy you beers (lots of them) once we re-enable centos jobs on opnfv xci | 11:40 |
| *** chyka has quit IRC | 11:40 | |
| mnaser | fdegir: yeah it’s broken right now but I’m working on it. We should be close to seeing them green again | 11:41 |
| Tahvok | Is there some configuration to set sysctl variables inside the lxc containers? | 11:41 |
| *** spsurya has joined #openstack-ansible | 11:43 | |
| mnaser | Tahvok: yes there is. Check details in openstack_hosts | 11:44 |
| mnaser | Defaults | 11:44 |
| Taseer | evrardjp: all of my jobs get stuck while installing keystone pip packages. are you seeing this else where ? | 11:44 |
| Tahvok | mnaser: this unfortunately set only the hosts, not the containers | 11:45 |
| mnaser | Tahvok: ah not sure in that case | 11:46 |
| Tahvok | I wanted to set net.ipv4.conf.default.rp_filter to 0 on all containers, as our virts do not work without it.. | 11:46 |
| *** armaan_ has joined #openstack-ansible | 11:47 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: Unpin ceph-ansible and add ceph-ansible library path https://review.openstack.org/550749 | 11:47 |
| evrardjp | Taseer: no | 11:47 |
| *** armaan has quit IRC | 11:47 | |
| Taseer | evrardjp: http://zuul.openstack.org/stream.html?uuid=cef1ebe473334001a2a78884157d191f&logfile=console.log, been like this for more then an hour | 11:48 |
| evrardjp | Tahvok: there are sysctl that can't be applied on "containers" | 11:48 |
| Tahvok | And couldn't find a way to set it.. I guess I'll have to do it manually.. The only question, is whether I should create a new task for lxc_container_create and submit a review? | 11:48 |
| evrardjp | Tahvok: the openstack_hosts apply everywhere, and allow sysctls to be set | 11:49 |
| Tahvok | For some reason it did not set anything to our containers... | 11:49 |
| evrardjp | if there are groups that need some specific sysctls, apply that in user space :) | 11:49 |
| evrardjp | Tahvok: because that can't be applied in containers maybe? | 11:50 |
| Tahvok | net.ipv4.conf.default.rp_filter sure can be applied | 11:50 |
| evrardjp | try manually: set it in your cli, reboot your container, see if that's still there | 11:50 |
| *** fatdragon has joined #openstack-ansible | 11:50 | |
| Tahvok | I can apply it manually | 11:50 |
| evrardjp | reboot afterwards :) | 11:50 |
| Tahvok | Let me try | 11:50 |
| evrardjp | some are inherited from the hosts and can't be set in the container | 11:50 |
| *** cristicalin has joined #openstack-ansible | 11:51 | |
| Tahvok | Put it in sysctl.conf, and rebooting now | 11:51 |
| evrardjp | Taseer: are you sure all your variables are well set? | 11:51 |
| evrardjp | ensuring you're not using a repo that's slow | 11:52 |
| evrardjp | Tahvok: I wrote a service to load the sysctl in containers | 11:52 |
| evrardjp | check if that runs | 11:52 |
| Tahvok | What service? | 11:52 |
| evrardjp | probably named sysctl something | 11:52 |
| evrardjp | I can't remember that's old | 11:52 |
| Tahvok | The service should run on the host? | 11:53 |
| MasterofJOKers | sysctl-container.service <- that one? | 11:53 |
| MasterofJOKers | "Apply Kernel Variables in Container" | 11:53 |
| evrardjp | https://github.com/openstack/openstack-ansible-lxc_container_create/blob/master/templates/sysctl-container.init.j2 | 11:54 |
| evrardjp | yeah | 11:54 |
| evrardjp | thanks MasterofJOKers | 11:54 |
| Tahvok | The service is active on my second host | 11:54 |
| Tahvok | But none of the sysctl parameters applied | 11:54 |
| *** fatdragon has quit IRC | 11:55 | |
| Tahvok | The first host is undergoing a reboot :) | 11:55 |
| evrardjp | so I guess that's due to inheritenc | 11:55 |
| evrardjp | e | 11:55 |
| *** cristicalin has quit IRC | 11:56 | |
| evrardjp | oh yeah I remember why this shouldn't be set in openstack_hosts, is that it was not needed (IIRC) for nspawn | 11:56 |
| *** vakuznet has quit IRC | 11:57 | |
| Tahvok | I'm on Ocata.. So no nspawn problems for me (yet) | 11:58 |
| MasterofJOKers | hm ... the manpage says, sysctl -p only reads /etc/sysctl.conf, not /etc/sysctl.d/*.conf | 11:58 |
| Tahvok | Nop.. I got confused, the service I found is systemd-sysctl.service | 11:58 |
| Tahvok | Which is not the correct one | 11:59 |
| Tahvok | I don't have the sysctl-container service | 11:59 |
| Tahvok | Ok, looks like there is no code for it in Ocata.. evrardjp when did you create it? | 12:00 |
| evrardjp | yeah Pike sounds plausible | 12:00 |
| Tahvok | Yep, it's found in Pike | 12:01 |
| evrardjp | let me check that | 12:01 |
| Tahvok | Any chance to bring it for Ocata? | 12:01 |
| evrardjp | https://github.com/openstack/openstack-ansible-lxc_container_create/commit/bb76ea23f5682242df66648c5afe0c34c7c49988 | 12:01 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-lxc_container_create stable/ocata: Ensure that sysctl can be applied on containers https://review.openstack.org/576830 | 12:02 |
| evrardjp | Tahvok: ^ I suggested it for you, but you have to do a proper review with the context, as I just blindly clicked. | 12:02 |
| evrardjp | It's probably introducing a series of regressions too : p | 12:03 |
| *** tux_ has quit IRC | 12:03 | |
| Tahvok | Do you want me to run it on my env as a test? | 12:03 |
| evrardjp | that would be nice | 12:03 |
| evrardjp | and then you review it | 12:03 |
| evrardjp | : ) | 12:03 |
| Tahvok | Ok, let me do it | 12:04 |
| evrardjp | and then we make it happen! | 12:04 |
| evrardjp | cool, thanks Tahvok | 12:04 |
| MasterofJOKers | but if systemd-sysctl is running, why is that other service even needed? systemd-sysctl even reads the values from /etc/sysctl.d/*.conf | 12:05 |
| Tahvok | MasterofJOKers: https://www.freedesktop.org/software/systemd/man/systemd-sysctl.service.html | 12:06 |
| Tahvok | It only configures the parameters on the host | 12:06 |
| Tahvok | The service evrardjp wrote, applies this parameters on the containers | 12:06 |
| *** rmart04 has quit IRC | 12:07 | |
| evrardjp | MasterofJOKers: unless this has changed, this indeed didn't apply on containers. | 12:08 |
| MasterofJOKers | but ... who sets rp_filter then? it's in /etc/sysctl.d/10-network-security.conf | 12:08 |
| MasterofJOKers | http://paste.openstack.org/show/723921/ | 12:08 |
| evrardjp | isn't that one on bare metal? | 12:08 |
| evrardjp | that looks like a container indeed | 12:08 |
| MasterofJOKers | if I set it in /etc/sysctl.conf, then sysctl-container also sets it | 12:09 |
| MasterofJOKers | my point is, the sysctl-container service doesn't apply stuff from /etc/sysctl.d/*.conf which is the place I would manually put stuff | 12:10 |
| evrardjp | /sbin/sysctl -p | 12:10 |
| evrardjp | that's all what it does | 12:10 |
| MasterofJOKers | jap. manpage says, it only uses /etc/sysctl.conf | 12:10 |
| evrardjp | I never used sysctl.d/*.conf : ) | 12:10 |
| *** cristicalin has joined #openstack-ansible | 12:10 | |
| evrardjp | I expect using what ansible is setting | 12:10 |
| MasterofJOKers | /sbin/sysctl --system <- that's the real deal | 12:11 |
| evrardjp | https://docs.ansible.com/ansible/2.5/modules/sysctl_module.html#sysctl-module by default is sysctl.conf | 12:11 |
| evrardjp | MasterofJOKers: happy to see a patch : ) | 12:12 |
| MasterofJOKers | ah. I was under the impression, that the ansible-hardening stuff has also put its settings tehre | 12:12 |
| Tahvok | rp_filter is part of the default here: https://github.com/openstack/openstack-ansible-openstack_hosts/blob/master/defaults/main.yml#L93 | 12:12 |
| Tahvok | MasterofJOKers: there is actually some doc that says that rp_filter should be set to 1 (althought we need it 0 in our case). But I have not found any code that sets it | 12:13 |
| Tahvok | You can grep /etc/ansible/roles dir to look it up | 12:13 |
| MasterofJOKers | right, didn't do that. just found a couple of files that aren't on my local system and assumed. | 12:14 |
| evrardjp | so... if that's an openstack thing, we should probably put it in openstack_hosts | 12:15 |
| evrardjp | the problem is that this sysctl thing should 1) only apply on lxc containers IIRC, 2) ansible-hardening is independant of that, 3) ansible doesn't have a converged view | 12:16 |
| evrardjp | odyssey4me: review requested https://review.openstack.org/#/c/576791/3 | 12:16 |
| MasterofJOKers | it's not an ansible-hardening thing. my bad. files is from procps: /etc/sysctl.d/10-network-security.conf | 12:17 |
| Tahvok | evrardjp: so, the service is running | 12:17 |
| Tahvok | However, I do not have any configuration under sysctl.conf.. | 12:18 |
| Tahvok | So.. What should set the configuration? | 12:18 |
| Taseer | evrardjp: yes, I did not go near the variables for the latest change | 12:18 |
| *** markvoelker has joined #openstack-ansible | 12:19 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: Move database creation into role (nova) https://review.openstack.org/571793 | 12:19 |
| MasterofJOKers | but openstack_hosts doesn't apply stuff to the container's /etc/sysctl.conf, only to the host's ... at least in pike ... so yeah | 12:22 |
| *** markvoelker has quit IRC | 12:22 | |
| *** markvoelker has joined #openstack-ansible | 12:22 | |
| evrardjp | MasterofJOKers: yeah I think those openstack_hosts to be global to containers are in Q only | 12:22 |
| *** vurtz has quit IRC | 12:24 | |
| Tahvok | So another patch would be needed to complete the review? As having the service alone is not helpfull. | 12:26 |
| andymccr | https://review.openstack.org/#/c/576091/ if there is any availability for reviews :D | 12:26 |
| *** shardy_afk is now known as shardy | 12:26 | |
| Tahvok | Btw, inside the containers there is also another service called systemd-sysctl.service | 12:27 |
| Tahvok | Shouldn't this one apply the container sysctl configs? | 12:27 |
| MasterofJOKers | Tahvok, you could set variables manually (e.g. with your own playbook running after setup-hosts.yml) and they would be applied on container reboot | 12:27 |
| evrardjp | andymccr: could you review this plz: https://review.openstack.org/#/c/576624/ | 12:27 |
| evrardjp | I will review yours | 12:27 |
| andymccr | trades! | 12:27 |
| andymccr | sure | 12:27 |
| evrardjp | simple | 12:28 |
| andymccr | im a big fan of dir for testing | 12:28 |
| andymccr | i got really weird outcomes when using anything else /w ceph | 12:28 |
| mnaser | i figured that if we're setting 'dir' as the default for user deploys | 12:28 |
| mnaser | we should be gating that by default... | 12:28 |
| *** cristicalin has quit IRC | 12:29 | |
| *** kman has joined #openstack-ansible | 12:29 | |
| andymccr | its more straight forward too. i think the other backends work quite well if you arent doing anything like ceph osds in containers or other stuff :) | 12:29 |
| mnaser | andymccr: https://review.openstack.org/#/c/576613/ and https://review.openstack.org/#/c/576612/ ? :D | 12:29 |
| mnaser | https://review.openstack.org/#/c/576298/ trivial too | 12:29 |
| andymccr | taking a look | 12:29 |
| evrardjp | andymccr: I will be a pain :( | 12:30 |
| andymccr | evrardjp: dont do that | 12:30 |
| *** dxiri has joined #openstack-ansible | 12:33 | |
| evrardjp | I know | 12:35 |
| evrardjp | I try | 12:35 |
| evrardjp | but think about the fact that I am preparing you for Belgium-England | 12:35 |
| andymccr | any good ideas for testing diff mode? | 12:36 |
| asettle | andymccr: you're acting like England might beat Belgium | 12:36 |
| evrardjp | asettle: that's possible though. | 12:36 |
| evrardjp | in andymccr 's dreams. | 12:37 |
| evrardjp | hahaha | 12:37 |
| andymccr | Senegal won for Africa, and thats all that matters | 12:37 |
| evrardjp | : ) | 12:37 |
| asettle | Dude you're not *from* Senegal. | 12:37 |
| asettle | That's another country babe | 12:37 |
| asettle | You're from *South* Africa. | 12:37 |
| openstackgerrit | Johannes Kulik proposed openstack/openstack-ansible-lxc_container_create master: Apply all sysctl settings in sysctl-container.service https://review.openstack.org/576838 | 12:37 |
| asettle | Who are not in the world cup. | 12:37 |
| mnaser | i know how we can bring asettle back to osa world now | 12:38 |
| asettle | mnaser: hahahahahah I lurk like a creeper. | 12:38 |
| evrardjp | hahahaha | 12:38 |
| mnaser | we just have to run the world cup 24x7 | 12:38 |
| *** kman has quit IRC | 12:38 | |
| asettle | I have to admit, it's pretty addictive. | 12:38 |
| evrardjp | mnaser: Putin would be happy to have that role | 12:38 |
| mnaser | asettle: OSA is addictive, right? :-) | 12:38 |
| mnaser | haha | 12:38 |
| asettle | The guy next to me in the office has BBC ivew up on one monitor. The downstairs kitchen has a giant projector up. | 12:38 |
| evrardjp | mnaser: hahaha | 12:38 |
| asettle | mnaser: sure ;) | 12:38 |
| mnaser | i haven't gotten around watching a game yet because EBUSY | 12:38 |
| asettle | Actually, I went to get up a test server the other day and found my old OSA instance up <3 | 12:39 |
| asettle | So faithful | 12:39 |
| asettle | (it'd been up for a year so I don't wanna know how much that thing was costing) | 12:39 |
| mnaser | :') | 12:39 |
| evrardjp | andymccr: the only thing I can think of, is to run a new scenario, tox.ini running a different shell script, running this scenarios and parsing output | 12:39 |
| mnaser | evrardjp, andymccr: id make your life even easier | 12:39 |
| evrardjp | you merge? | 12:39 |
| mnaser | you know how we have idempotence tests | 12:39 |
| evrardjp | yeah | 12:39 |
| mnaser | we run one more time with --check at the edd | 12:40 |
| mnaser | end | 12:40 |
| evrardjp | and one more time with --check and --diff? that seems long at the end : ) | 12:40 |
| andymccr | this bug only happens if you run --diff by itself | 12:40 |
| andymccr | --check --diff works ok | 12:40 |
| evrardjp | yeah I meant running the matrix | 12:40 |
| andymccr | im not sure why anybody would want to run --diff without --check | 12:40 |
| andymccr | but it causes a bug :D | 12:41 |
| mnaser | pretty colors and diffs | 12:41 |
| evrardjp | logging for auditing? | 12:41 |
| andymccr | yeah that could work | 12:41 |
| andymccr | check is a bit of a difficult onebecause it wont work for a lot of roles | 12:41 |
| evrardjp | yeah so running one more time with diff | 12:41 |
| mnaser | i'd just extend the job to run with `--diff` | 12:41 |
| andymccr | yeah | 12:42 |
| evrardjp | yeah but it's just for this role | 12:42 |
| mnaser | that's my opinion | 12:42 |
| evrardjp | I don't think we should do taht everywhere | 12:42 |
| andymccr | --diff and no --diff would generate the same "outcome" so yeah perhaps just changing the base run to use --diff would work for this role | 12:42 |
| evrardjp | nobody cares | 12:42 |
| mnaser | nor did i sugegst that :) | 12:42 |
| mnaser | suggest | 12:42 |
| mnaser | i'm saying add --diff to the functional jobs for ansible-config_template (because diffs are actually relevant to this module) | 12:42 |
| evrardjp | andymccr: yeah so always running --diff ? | 12:42 |
| mnaser | in tox.ini | 12:42 |
| evrardjp | yeah that would be fine | 12:43 |
| evrardjp | also adding a parameter here: https://github.com/openstack/openstack-ansible-plugins/blob/master/tox.ini#L107 | 12:43 |
| mgariepy | good morning everyone | 12:44 |
| mnaser | o/ mgariepy | 12:44 |
| evrardjp | good morning | 12:44 |
| *** juhak has quit IRC | 12:44 | |
| evrardjp | I have to take my flight, so ttyl everyone. I am on leave for a few days, so I leave you the keys to the house! | 12:44 |
| evrardjp | tty on Tuesday | 12:44 |
| mgariepy | have a safe trip evrardjp | 12:45 |
| *** juhak has joined #openstack-ansible | 12:45 | |
| mnaser | ALRIGHT Y'ALL | 12:46 |
| mnaser | EVERYONE GETS +2's | 12:46 |
| mnaser | ALL CI IS NON VOTING | 12:46 |
| mnaser | w00t | 12:46 |
| mgariepy | haha | 12:46 |
| andymccr | haha love it | 12:46 |
| evrardjp | mnaser: been there.... | 12:46 |
| evrardjp | :) | 12:47 |
| *** Guest45438 is now known as v1k0d3n | 12:48 | |
| *** v1k0d3n is now known as Guest93 | 12:49 | |
| *** Guest93 has quit IRC | 12:49 | |
| *** Guest93 has joined #openstack-ansible | 12:49 | |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_cinder master: Drop usage of scsi-target-utils for Cinder LVM https://review.openstack.org/576842 | 12:50 |
| *** ansmith has joined #openstack-ansible | 12:58 | |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_cinder master: Replace scsi-target-utils by targetcli https://review.openstack.org/576842 | 12:58 |
| *** Guest93 is now known as v1k0d3n | 13:03 | |
| openstackgerrit | Andy McCrae proposed openstack/ansible-config_template master: Fix ordering for --diff mode setup https://review.openstack.org/576091 | 13:04 |
| *** dxiri has quit IRC | 13:05 | |
| *** cjloader has joined #openstack-ansible | 13:13 | |
| *** tux_ has joined #openstack-ansible | 13:18 | |
| koukou | evardjp: soon i'll switch from lxb to ovs-dvr and i want all my compute/network node used in north/south traffic. | 13:21 |
| openstackgerrit | German Eichberger proposed openstack/openstack-ansible-os_octavia master: [WIP] Adds the issuer to the CAs https://review.openstack.org/576234 | 13:25 |
| openstackgerrit | Merged openstack/openstack-ansible-tests master: Add RDO mirror https://review.openstack.org/576612 | 13:28 |
| *** tux__ has joined #openstack-ansible | 13:31 | |
| *** tux_ has quit IRC | 13:34 | |
| *** armaan_ has quit IRC | 13:34 | |
| *** armaan has joined #openstack-ansible | 13:35 | |
| *** jwitko has joined #openstack-ansible | 13:37 | |
| *** jwitko has quit IRC | 13:37 | |
| *** jwitko has joined #openstack-ansible | 13:38 | |
| *** cjloader has quit IRC | 13:38 | |
| *** Bhujay has joined #openstack-ansible | 13:44 | |
| *** tux__ has quit IRC | 13:47 | |
| *** udesale has joined #openstack-ansible | 13:47 | |
| *** dxiri has joined #openstack-ansible | 13:47 | |
| *** fatdragon has joined #openstack-ansible | 13:51 | |
| *** dxiri has quit IRC | 13:52 | |
| *** sgrasley has quit IRC | 13:54 | |
| *** udesale_ has joined #openstack-ansible | 13:55 | |
| *** udesale has quit IRC | 13:56 | |
| *** fatdragon has quit IRC | 13:56 | |
| *** armaan has quit IRC | 13:57 | |
| *** armaan has joined #openstack-ansible | 13:57 | |
| openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts master: Switch to latest RDO repositories https://review.openstack.org/576613 | 14:08 |
| *** tux_ has joined #openstack-ansible | 14:10 | |
| *** throwsb1 has joined #openstack-ansible | 14:11 | |
| *** tux__ has joined #openstack-ansible | 14:13 | |
| *** tux_ has quit IRC | 14:17 | |
| *** armaan has quit IRC | 14:26 | |
| *** armaan has joined #openstack-ansible | 14:26 | |
| *** fatdragon has joined #openstack-ansible | 14:29 | |
| *** cjloader has joined #openstack-ansible | 14:29 | |
| *** epalper has quit IRC | 14:34 | |
| *** fatdragon has quit IRC | 14:34 | |
| *** epalper has joined #openstack-ansible | 14:35 | |
| *** tux__ has quit IRC | 14:38 | |
| *** dxiri has joined #openstack-ansible | 14:38 | |
| *** cjloader has quit IRC | 14:39 | |
| *** cjloader_ has joined #openstack-ansible | 14:39 | |
| *** koukou has quit IRC | 14:41 | |
| *** tux_ has joined #openstack-ansible | 14:42 | |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_cinder master: Replace scsi-target-utils by targetcli https://review.openstack.org/576842 | 14:44 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_cinder master: Switch volume type creation to use OpenStack client https://review.openstack.org/576883 | 14:44 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-tests master: Run all tests without containers https://review.openstack.org/575961 | 14:44 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-tests master: Add retry install packages linter https://review.openstack.org/575727 | 14:44 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-tests master: Add repo_build pip cache https://review.openstack.org/576884 | 14:44 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible master: Add LXC and PIP mirrors https://review.openstack.org/576885 | 14:44 |
| *** tux__ has joined #openstack-ansible | 14:44 | |
| *** Bhujay has quit IRC | 14:46 | |
| *** alefra has joined #openstack-ansible | 14:46 | |
| *** epalper has quit IRC | 14:46 | |
| *** tux_ has quit IRC | 14:47 | |
| *** sgrasley has joined #openstack-ansible | 14:49 | |
| cloudnull | mornings | 14:50 |
| *** throwsb1 has quit IRC | 14:50 | |
| *** throwsb1 has joined #openstack-ansible | 14:51 | |
| mnaser | hiya cloudnull | 14:52 |
| cloudnull | o/ | 14:52 |
| *** cjloader_ has quit IRC | 14:54 | |
| *** fatdragon has joined #openstack-ansible | 14:56 | |
| mnaser | cloudnull: if you have some spare cycles to look at the nspawn role jobs and fix them, it would be so appreciated | 14:57 |
| cloudnull | ++ will take a look today | 14:57 |
| mnaser | thank you, i have a few changes, looks like the nspawn_create jobs are failing.. looks like it's trying to ping and address that's not responding, probably an easy fix for someone who knows whats going on :P | 14:58 |
| *** fatdragon has quit IRC | 15:00 | |
| *** tux__ has quit IRC | 15:01 | |
| *** cshen has joined #openstack-ansible | 15:03 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add an 'always' tag to cluster layout task include https://review.openstack.org/576473 | 15:03 |
| *** cjloader has joined #openstack-ansible | 15:06 | |
| openstackgerrit | Merged openstack/openstack-ansible-ops master: Add explicit enable=true when a check is enabled https://review.openstack.org/575890 | 15:07 |
| openstackgerrit | Merged openstack/openstack-ansible-ops master: Correct elasticsearch host roles for small clusters https://review.openstack.org/576474 | 15:07 |
| *** cshen has quit IRC | 15:08 | |
| *** Sodh has joined #openstack-ansible | 15:09 | |
| openstackgerrit | Merged openstack/openstack-ansible-ops master: Add a test for the host layout selection https://review.openstack.org/576493 | 15:11 |
| openstackgerrit | Merged openstack/openstack-ansible-ops master: Adds support for leaping from Mitaka https://review.openstack.org/575527 | 15:12 |
| openstackgerrit | Merged openstack/openstack-ansible-ops master: Update Newton release to newton-eol in leap-upgrades https://review.openstack.org/576667 | 15:12 |
| *** admin0 has quit IRC | 15:13 | |
| *** admin0 has joined #openstack-ansible | 15:14 | |
| openstackgerrit | Merged openstack/openstack-ansible-ops master: add release notes to README.rst https://review.openstack.org/576736 | 15:14 |
| jrosser | cloudnull: cheers for fixing up the tags patch | 15:17 |
| cloudnull | thanks for submitting it :) | 15:17 |
| jrosser | i wondered if there was a follow up to https://review.openstack.org/#/c/576474/ to move all of the cluster role logic to one place | 15:18 |
| jrosser | there is some of it hidden in the templates currently | 15:18 |
| openstackgerrit | Merged openstack/openstack-ansible-ops master: Add an 'always' tag to cluster layout task include https://review.openstack.org/576473 | 15:21 |
| openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-os_horizon master: Add required packages to build mysql-python https://review.openstack.org/576891 | 15:23 |
| openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-os_horizon master: Add openstack_auth to translations update https://review.openstack.org/576584 | 15:23 |
| mnaser | andymccr thought it was a one liner.. little did he know he had more to do :P | 15:23 |
| andymccr | mnaser: haha | 15:23 |
| andymccr | nothing beats a good yak shave! | 15:23 |
| cloudnull | jrosser we certainly could pull more of the template logic out and put it into that task file. | 15:25 |
| andymccr | mnaser: ahh nice you put in a fix for that cinder stuff - did you test that out? | 15:26 |
| jrosser | cloudnull: yes, that would then let showElasticCluster give you all the info. currently some of the choices made in the templates are not visible | 15:26 |
| *** armaan has quit IRC | 15:26 | |
| mnaser | andymccr: i didn't test it locally tbh, i need to work on setting up a dev env at some point lol | 15:26 |
| andymccr | haha all good :) | 15:26 |
| andymccr | gates should show anyway | 15:27 |
| andymccr | just wondered if it would definitely work or if its more of a hope | 15:27 |
| *** armaan has joined #openstack-ansible | 15:27 | |
| cloudnull | https://twitter.com/cloudnull/status/1009456498215354369 - for the curious - the elk stack is working wonderfully. We have so much more insight into things right now :D | 15:27 |
| mnaser | cloudnull: i really want to deploy that | 15:27 |
| mnaser | i'll have time at some point | 15:28 |
| cloudnull | said nobody ever :) | 15:28 |
| mnaser | andymccr: it worked | 15:28 |
| mnaser | i just saw the job go green in the check/gate | 15:28 |
| jrosser | cloudnull: after i fixed the 3 node layout i just reran the elasticsearch playbook and it magically migrated 1/3rd of the shards :) | 15:29 |
| cloudnull | :D | 15:29 |
| jrosser | took it about an hour | 15:29 |
| * mnaser curious how big of clouds y'all running this on | 15:29 | |
| cloudnull | yea. thats a bummer, however the fact that its working is great | 15:29 |
| cloudnull | mnaser I have it running on a 25 compute node cloud | 15:30 |
| mnaser | wonder how much data that generates | 15:30 |
| mnaser | probably not accurate | 15:30 |
| mnaser | given it depends on how much vm churn happening | 15:30 |
| cloudnull | though we did just deploy it to a 300 compute node cloud | 15:30 |
| *** gkadam has quit IRC | 15:30 | |
| cloudnull | So i should have an idea of how well its all working at that scale soon | 15:31 |
| mnaser | is that cloud relatively stable in number of churn of vms going up and down? | 15:31 |
| cloudnull | no. its fairly eratic | 15:31 |
| cloudnull | **erratic | 15:31 |
| jrosser | packetbeat seems to generate >> of the ingest data | 15:31 |
| *** hamzy has quit IRC | 15:31 | |
| jrosser | i figure thats going swamp whatever extra is created from the cloud being busy | 15:32 |
| jrosser | but that could all change greatly if the APM bit gets hooked up | 15:33 |
| cloudnull | https://i.snag.gy/OSGfhN.jpg - this is my test bed at the moment | 15:33 |
| cloudnull | I find packetbeat to be the largest producer. | 15:33 |
| jrosser | i have a 21 compute node test cloud which is quite happily running 3x 4C8T elk nodes | 15:33 |
| cloudnull | we have a change up for connbeat, i've got it deployed but not wired up | 15:34 |
| cloudnull | maybe that will be of better use, maybe not. | 15:34 |
| jrosser | but its obvious those 4C8T boxes are a little light on cpu | 15:34 |
| cloudnull | yea my nodes are light on resources as well. | 15:34 |
| cloudnull | they're a bunch of older r710's | 15:35 |
| *** armaan has quit IRC | 15:35 | |
| *** lvdombrkr89 has quit IRC | 15:38 | |
| *** hamzy has joined #openstack-ansible | 15:38 | |
| *** chyka has joined #openstack-ansible | 15:41 | |
| jrosser | cloudnull: "Courier fetch: 20 of 56 shards failed." <- have you seen anything like that? | 15:48 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_octavia master: Switch to using project-templates + add OpenSUSE support. https://review.openstack.org/576635 | 15:48 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_octavia master: Upgrade disk for amphora to 20GB https://review.openstack.org/576896 | 15:48 |
| *** fatdragon has joined #openstack-ansible | 15:49 | |
| johnsom | Yes, OVH is still having KVM problems as is limestone now. | 15:58 |
| johnsom | My suspicion is the cloud archive patches are not playing nice with the xenial kernel, but I haven't been able to prove that yet. | 15:59 |
| *** sgrasley_ has joined #openstack-ansible | 15:59 | |
| logan- | johnsom: i'm able to reproduce it in my local gates now on limestone's ci cloud. in the process of rebooting some hvs to updated kernels right now to see if anything changes. | 15:59 |
| *** sgrasley has quit IRC | 15:59 | |
| *** sgrasley_ is now known as sgrasley | 16:00 | |
| johnsom | logan- That is great news! | 16:00 |
| guilhermesp | hey there! Making the most of the opportunity about elk... I was talking lately with cloudnull and d34dh0r53 about the idea of migrating the grafana's opentack log dashboards to kibana. I'm already working on it. Specially because these dashboards has been very usefull in my previous old kibana installations. | 16:02 |
| logan- | johnsom: fwiw, they are currently on 4.4.0-116.140, they'll be rebooting into 4.4.0-128.154 | 16:02 |
| *** Sodh has quit IRC | 16:03 | |
| guilhermesp | the use case is for those who doesn't want to install an extra component like grafana a make the most of elk installation | 16:03 |
| johnsom | logan- There is a kernel bug open here if you have more information for the kvm folks: https://bugzilla.kernel.org/show_bug.cgi?id=192521 | 16:03 |
| openstack | bugzilla.kernel.org bug 192521 in kvm "KVM: entry failed, hardware error 0x0" [High,New] - Assigned to virtualization_kvm | 16:03 |
| guilhermesp | unfortunatly i needed to do a pause on this task this week becasue I've been sick sincelast saturday. but I will come back with baby steps asap | 16:04 |
| openstackgerrit | Merged openstack/openstack-ansible master: Move database creation into role (horizon) https://review.openstack.org/571757 | 16:04 |
| cloudnull | jrosser, I've seen failed fetches before though its always been a transient issue. | 16:05 |
| jrosser | yeah, i've seen it a bunch of times | 16:05 |
| cloudnull | or an issue while curator is running | 16:05 |
| jrosser | when it does it the data in that screenshot you posted just looks bogus | 16:05 |
| guilhermesp | here's an exemple: https://ibb.co/ccAGxy | 16:05 |
| guilhermesp | these dashboard came from rpc repo | 16:06 |
| jrosser | cloudnull: i've mostly been concentrating on getting the various beats sorted and squashing any log 'error' entries | 16:07 |
| cloudnull | cool! | 16:07 |
| cloudnull | anything I can help with ? | 16:07 |
| *** poul has quit IRC | 16:07 | |
| jrosser | however it looks like there is a pass across all the resulting kibana dashboards needed, becasue a good bunch of the don't seem to make much sense | 16:07 |
| openstackgerrit | Merged openstack/openstack-ansible master: Move database creation into role (keystone) https://review.openstack.org/571776 | 16:08 |
| jrosser | almost as if the data is there but maybe some missing/wrong fields make the dashboards strange | 16:08 |
| jrosser | like when adding the actual hostname rather than 127.0.0.1 to beat.host suddenly made a load of them work | 16:08 |
| jrosser | i just have a feeling there is more like that lurking | 16:08 |
| cloudnull | very well could be | 16:09 |
| d34dh0r53 | looking good guilhermesp, hope you feel better | 16:10 |
| jrosser | cloudnull: look here https://github.com/elastic/apm-agent-python/blob/master/elasticapm/contrib/paste.py | 16:11 |
| guilhermesp | thanks d34dh0r53 ! | 16:11 |
| cloudnull | jrosser that's nice! | 16:12 |
| cloudnull | that should plug right into the paste pipeline | 16:12 |
| cloudnull | which would give us a config_template way to add it to all of the openstack services | 16:12 |
| jrosser | cloudnull: yeah, i did try but it's all a bit alien to me | 16:14 |
| jrosser | that looks like the definition of a composite, rather than a filter | 16:15 |
| jrosser | so its really really close | 16:15 |
| * jrosser goes to eat | 16:15 | |
| andymccr | mnaser: cinder stuff worked for me - nice one! | 16:19 |
| *** gyee has joined #openstack-ansible | 16:21 | |
| gyee | evrardjp: ping | 16:22 |
| mnaser | andymccr: ah sweet. ill have to squash the two commits i think | 16:28 |
| mnaser | scsi-target-utils is missing is a gate fix and so is volume type | 16:28 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_cinder master: Fix volume type creation, switch to targetcli https://review.openstack.org/576883 | 16:30 |
| *** sgrasley has quit IRC | 16:46 | |
| *** FrankZhang has joined #openstack-ansible | 16:46 | |
| *** armaan has joined #openstack-ansible | 16:49 | |
| *** armaan has quit IRC | 16:51 | |
| *** udesale_ has quit IRC | 16:55 | |
| *** alefra has quit IRC | 16:56 | |
| *** armaan has joined #openstack-ansible | 16:57 | |
| *** ThiagoCMC has joined #openstack-ansible | 16:59 | |
| ThiagoCMC | guilhermesp, thanks! I was reading that page... But it isn't helping... =/ | 17:01 |
| ThiagoCMC | I'm trying to avoid this: "Restore from backup if all of the nodes in a Galera cluster fail (do not shutdown gracefully)." :-( | 17:01 |
| *** sgrasley has joined #openstack-ansible | 17:10 | |
| *** spsurya has quit IRC | 17:23 | |
| cloudnull | ThiagoCMC are you still not able to get the cluster back online? | 17:24 |
| *** vurtz has joined #openstack-ansible | 17:26 | |
| *** poul has joined #openstack-ansible | 17:39 | |
| *** cshen has joined #openstack-ansible | 17:39 | |
| *** poul_ has joined #openstack-ansible | 17:39 | |
| *** poul has quit IRC | 17:39 | |
| *** poul has joined #openstack-ansible | 17:42 | |
| *** shardy has quit IRC | 17:42 | |
| *** poul_ has quit IRC | 17:44 | |
| *** cshen has quit IRC | 17:44 | |
| *** DanyC has quit IRC | 17:51 | |
| *** poul has quit IRC | 17:53 | |
| *** electrofelix has quit IRC | 17:59 | |
| *** dxiri has quit IRC | 17:59 | |
| *** radek__ has quit IRC | 18:05 | |
| *** cshen has joined #openstack-ansible | 18:06 | |
| *** poopcat has joined #openstack-ansible | 18:07 | |
| *** cshen has quit IRC | 18:10 | |
| *** sgrasley has quit IRC | 18:13 | |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_cinder master: Fix volume type creation, switch to targetcli for CentOS https://review.openstack.org/576883 | 18:15 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_cinder master: Switch non-voting jobs to use Zuul stanza https://review.openstack.org/575297 | 18:19 |
| jrosser | mnaser: i just took a pass across the osprofiler reviews, theres a bunch failed due to centos7 aria2 which i think is now fixed, and another bunch all due to the same nova db task failing | 18:26 |
| jrosser | do we know what that 2nd failure is? | 18:26 |
| mnaser | jrosser: yup, centos aria2 fix merged here https://review.openstack.org/#/c/574382/ | 18:26 |
| mnaser | hmm nova db task failing | 18:26 |
| mnaser | let me see that one | 18:26 |
| jrosser | heres one https://review.openstack.org/#/c/573509/ | 18:27 |
| mnaser | awesome thanks | 18:27 |
| * mnaser look | 18:27 | |
| mnaser | jrosser: yes i believe this was the fix here - https://review.openstack.org/#/c/574834/ | 18:28 |
| jrosser | and there is another recurring fail to do with mysql-python install https://review.openstack.org/#/c/573517/ | 18:29 |
| *** hamza21 has joined #openstack-ansible | 18:31 | |
| mnaser | jrosser: im not sure about that one | 18:32 |
| mnaser | but oh boy | 18:33 |
| jrosser | it is odd isnt it | 18:33 |
| jrosser | but it pops up in more than one of the patches i checked | 18:33 |
| jrosser | so it seems like another systematic fail of some sort | 18:33 |
| *** yolanda_ has joined #openstack-ansible | 18:35 | |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_nova master: Ensure the database for cell0 is created https://review.openstack.org/576932 | 18:35 |
| mnaser | if anyone is around, big oops ^ | 18:35 |
| *** ianychoi has quit IRC | 18:36 | |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_nova master: Run "nova-status upgrade check" during install and upgrade https://review.openstack.org/575125 | 18:37 |
| openstackgerrit | Merged openstack/openstack-ansible-os_molteniron master: Add packages required for osprofiler https://review.openstack.org/573510 | 18:38 |
| *** yolanda__ has joined #openstack-ansible | 18:39 | |
| *** yolanda has quit IRC | 18:39 | |
| openstackgerrit | Merged openstack/ansible-config_template master: Fix ordering for --diff mode setup https://review.openstack.org/576091 | 18:39 |
| *** yolanda_ has quit IRC | 18:40 | |
| openstackgerrit | German Eichberger proposed openstack/openstack-ansible-os_octavia master: [WIP] Adds the issuer to the CAs https://review.openstack.org/576234 | 18:47 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_cinder master: Fix volume type creation, switch to targetcli for CentOS https://review.openstack.org/576883 | 18:49 |
| *** yolanda_ has joined #openstack-ansible | 19:08 | |
| *** rodolof has quit IRC | 19:08 | |
| *** rodolof has joined #openstack-ansible | 19:09 | |
| *** yolanda_ has quit IRC | 19:09 | |
| *** yolanda_ has joined #openstack-ansible | 19:10 | |
| *** poul has joined #openstack-ansible | 19:11 | |
| *** yolanda__ has quit IRC | 19:12 | |
| *** poul has quit IRC | 19:16 | |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_nova master: Restore openstack-ansible-upgrade-ubuntu-xenial https://review.openstack.org/575153 | 19:16 |
| *** yolanda_ has quit IRC | 19:17 | |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_nova master: Run "nova-status upgrade check" during install and upgrade https://review.openstack.org/575125 | 19:17 |
| *** yolanda has joined #openstack-ansible | 19:19 | |
| *** poul has joined #openstack-ansible | 19:23 | |
| *** poul has quit IRC | 19:23 | |
| *** tux_ has joined #openstack-ansible | 19:25 | |
| *** poul has joined #openstack-ansible | 19:29 | |
| tux_ | Need help folks | 19:30 |
| tux_ | running setup-hosts.yml and seeing following errors | 19:30 |
| tux_ | http://paste.openstack.org/show/723954/ | 19:30 |
| tux_ | why its saying " already uses address 172.28.1.217" | 19:31 |
| tux_ | first-time it failed with some other error and then i re-kick again and now seeing this error | 19:31 |
| *** cshen has joined #openstack-ansible | 19:33 | |
| *** poul has quit IRC | 19:33 | |
| openstackgerrit | Merged openstack/openstack-ansible-repo_build master: Switch to using project-templates https://review.openstack.org/576314 | 19:34 |
| *** Deknos has joined #openstack-ansible | 19:38 | |
| tux_ | cloudnull: & jamesdenton: any thought? http://paste.openstack.org/show/723954/ | 19:40 |
| *** Deknos has left #openstack-ansible | 19:40 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add kafka output plugin to logstash https://review.openstack.org/576949 | 19:41 |
| openstackgerrit | Merged openstack/openstack-ansible-repo_build master: Add Ubuntu Bionic 18.04 support https://review.openstack.org/576316 | 19:42 |
| *** tux_ has quit IRC | 19:42 | |
| *** jwitko_ has joined #openstack-ansible | 19:43 | |
| *** jwitko has quit IRC | 19:44 | |
| *** armaan has quit IRC | 19:46 | |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-openstack_hosts master: Stop setting package priorities https://review.openstack.org/576954 | 19:50 |
| *** rodolof has quit IRC | 19:50 | |
| ansmith | mnaser: hello, currently working through https://review.openstack.org/#/c/575505/ introduction of qdrouterd role. It was passing functional-centos-7 yesterday but is now failing on a dependency | 19:54 |
| ansmith | mnaser: iiuc, it looks like due to rdo-deps exclusion | 19:54 |
| ansmith | mnaser: any help to work around would be appreciated | 19:55 |
| *** sgrasley has joined #openstack-ansible | 19:57 | |
| *** tux_ has joined #openstack-ansible | 19:58 | |
| tux_ | if i delete inventory file and re-run setup-hosts.yml in that case does it create issue? i did that | 20:01 |
| tux_ | do you think already used IP address because i delete inventory file? | 20:01 |
| *** cmart has quit IRC | 20:03 | |
| openstackgerrit | German Eichberger proposed openstack/openstack-ansible-os_octavia master: [WIP] Adds the issuer to the CAs https://review.openstack.org/576234 | 20:08 |
| *** jwitko__ has joined #openstack-ansible | 20:12 | |
| jrosser | tux_: have you ensured that any IP you have assigned manually are covered here https://github.com/openstack/openstack-ansible/blob/feef46a4b4af249fd3d2a48d1fad9f248d9b82e8/etc/openstack_deploy/openstack_user_config.yml.prod.example#L7-L11 | 20:15 |
| *** cshen has quit IRC | 20:15 | |
| *** tux_ has quit IRC | 20:17 | |
| *** jwitko_ has quit IRC | 20:17 | |
| *** throwsb1 has quit IRC | 20:22 | |
| *** poul has joined #openstack-ansible | 20:22 | |
| *** poul has quit IRC | 20:27 | |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-openstack_hosts master: Stop setting package priorities https://review.openstack.org/576954 | 20:29 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-openstack_hosts master: Stop installing sshpass with openstack_hosts https://review.openstack.org/576971 | 20:29 |
| mnaser | ansmith: checking | 20:29 |
| mnaser | ansmith: https://review.openstack.org/576954 should fix | 20:30 |
| mnaser | ansmith: if you wanna add a depends-on it would also help validate that | 20:30 |
| ansmith | mnaser: great to hear, thanks for checking and I will add the depends-on | 20:31 |
| mnaser | so sad i broke da world, i'm planning ci changes that make sure we don't break the world from now on | 20:31 |
| *** sgrasley has quit IRC | 20:33 | |
| *** FrankZhang_ has joined #openstack-ansible | 20:33 | |
| *** tux_ has joined #openstack-ansible | 20:35 | |
| *** FrankZhang has quit IRC | 20:35 | |
| jrosser | mnaser: i'm done for today, but i gathered up a list of repeated failures here if it is any use http://paste.openstack.org/show/723961/ | 20:35 |
| tux_ | jrosser: i did make sure but question is if i delete inventory and re-run setup-hosts.yml does that re-arrange IP again? | 20:36 |
| mnaser | jrosser: tempest is fixed in https://review.openstack.org/576954, pip/opensuse .. that's a weird one, i'll check, cinder is fixed but broken by my other change and nginx missing should be fixed but ill verify | 20:38 |
| *** FrankZhang_ has quit IRC | 20:38 | |
| *** hasseniu_ has quit IRC | 20:38 | |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_cinder master: Add packages required for osprofiler https://review.openstack.org/573500 | 20:39 |
| openstackgerrit | Nguyen Hai proposed openstack/openstack-ansible master: Trivial: Update pypi url to new url https://review.openstack.org/563385 | 20:39 |
| *** poul has joined #openstack-ansible | 20:39 | |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_magnum master: Add packages required for osprofiler https://review.openstack.org/573509 | 20:39 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_magnum master: Switch non-voting jobs to use Zuul stanza https://review.openstack.org/575281 | 20:40 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_magnum master: Deprecate auth_uri option https://review.openstack.org/558380 | 20:41 |
| *** pcaruana has quit IRC | 20:41 | |
| *** ansmith has quit IRC | 20:42 | |
| *** jwitko__ has quit IRC | 20:43 | |
| *** jwitko has joined #openstack-ansible | 20:44 | |
| *** poul has quit IRC | 20:44 | |
| *** jwitko has quit IRC | 20:46 | |
| *** jwitko has joined #openstack-ansible | 20:47 | |
| *** jwitko_ has joined #openstack-ansible | 20:47 | |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_nova master: Setup service users and endpoints before database setup https://review.openstack.org/576976 | 20:49 |
| *** jwitko is now known as Guest38389 | 20:49 | |
| *** jwitko_ is now known as jwitko | 20:49 | |
| *** poul has joined #openstack-ansible | 20:49 | |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_nova master: Restore openstack-ansible-upgrade-ubuntu-xenial https://review.openstack.org/575153 | 20:49 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_nova master: Run "nova-status upgrade check" during install and upgrade https://review.openstack.org/575125 | 20:50 |
| *** Guest38389 has quit IRC | 20:51 | |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_cinder master: Fix volume type creation, switch to targetcli for CentOS https://review.openstack.org/576883 | 20:51 |
| *** cmart has joined #openstack-ansible | 20:51 | |
| *** poul has quit IRC | 20:53 | |
| openstackgerrit | German Eichberger proposed openstack/openstack-ansible-os_octavia master: [WIP] Adds the issuer to the CAs https://review.openstack.org/576234 | 20:57 |
| *** DanyC has joined #openstack-ansible | 20:59 | |
| openstackgerrit | Heba Naser proposed openstack/ansible-config_template master: Switch to using project-templates https://review.openstack.org/576981 | 21:01 |
| *** poul has joined #openstack-ansible | 21:07 | |
| *** poul has quit IRC | 21:11 | |
| openstackgerrit | Heba Naser proposed openstack/ansible-role-python_venv_build master: Switch to using project-templates https://review.openstack.org/576984 | 21:12 |
| ThiagoCMC | cloudnull, nop, my Galera is dead... :-( | 21:14 |
| *** FrankZhang has joined #openstack-ansible | 21:14 | |
| ThiagoCMC | Also, there is no rush! This is my own cloud in my house. But, I would LOVE to bring it back! | 21:15 |
| openstackgerrit | Heba Naser proposed openstack/ansible-role-systemd_mount master: Switch to using project-templates https://review.openstack.org/576986 | 21:18 |
| *** cjloader has quit IRC | 21:23 | |
| *** poul has joined #openstack-ansible | 21:24 | |
| tux_ | ThiagoCMC: you need to bootstrap one of galera node | 21:27 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-galera_server master: Stop installing python-crypto for Galera server https://review.openstack.org/576989 | 21:27 |
| *** jwitko has quit IRC | 21:28 | |
| tux_ | i had same issue and after doing bootstrap one of node other node picked up master and all green | 21:28 |
| *** poul has quit IRC | 21:29 | |
| ThiagoCMC | tux_, right... I'm reading many docs about Galera, from OpenStack and from Galera docs but, I'm not sure about how to do it yet. I'll read more! | 21:29 |
| tux_ | in /var/lib/mysql/ there is a .dat file you need to edit that and set value to 1 and run new_cluster_galaera something like that | 21:30 |
| tux_ | ThiagoCMC: google will get you there | 21:30 |
| openstackgerrit | Heba Naser proposed openstack/ansible-role-systemd_networkd master: Switch to using project-templates https://review.openstack.org/576991 | 21:31 |
| *** yolanda has quit IRC | 21:35 | |
| *** ansmith has joined #openstack-ansible | 21:35 | |
| openstackgerrit | Heba Naser proposed openstack/ansible-role-systemd_networkd master: Switch to using project-templates https://review.openstack.org/576991 | 21:38 |
| *** yolanda has joined #openstack-ansible | 21:40 | |
| openstackgerrit | Heba Naser proposed openstack/ansible-role-python_venv_build master: Switch to using project-templates https://review.openstack.org/576984 | 21:41 |
| *** poul has joined #openstack-ansible | 21:42 | |
| openstackgerrit | Heba Naser proposed openstack/ansible-role-systemd_service master: Switch to using project-templates https://review.openstack.org/576992 | 21:43 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-tests master: Add repo_build pip cache https://review.openstack.org/576884 | 21:45 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-tests master: Run all tests without containers https://review.openstack.org/575961 | 21:45 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-tests master: Add retry install packages linter https://review.openstack.org/575727 | 21:45 |
| *** poul has quit IRC | 21:46 | |
| *** hamza21 has quit IRC | 21:46 | |
| *** nicolasbock has quit IRC | 21:52 | |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-openstack_hosts master: Stop setting package priorities https://review.openstack.org/576954 | 21:53 |
| *** cmart has quit IRC | 21:53 | |
| *** poul has joined #openstack-ansible | 21:59 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add the virtualenv package when installing currator https://review.openstack.org/576998 | 22:02 |
| *** poul has quit IRC | 22:03 | |
| *** cmart has joined #openstack-ansible | 22:04 | |
| *** poul has joined #openstack-ansible | 22:09 | |
| *** dariko33 has quit IRC | 22:10 | |
| *** cshen has joined #openstack-ansible | 22:11 | |
| *** poul has quit IRC | 22:13 | |
| *** cshen has quit IRC | 22:16 | |
| *** tux_ has quit IRC | 22:18 | |
| *** cjloader has joined #openstack-ansible | 22:23 | |
| *** poul has joined #openstack-ansible | 22:26 | |
| *** tux_ has joined #openstack-ansible | 22:28 | |
| *** sgrasley has joined #openstack-ansible | 22:29 | |
| *** poul has quit IRC | 22:30 | |
| *** cjloader has quit IRC | 22:31 | |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-galera_server master: Remove python-crypto and use in-repo GPG keys https://review.openstack.org/576989 | 22:33 |
| mnaser | what's the best way to run role tests from scratch on a local machine | 22:38 |
| *** cmart has quit IRC | 22:39 | |
| *** hassenius has joined #openstack-ansible | 22:39 | |
| *** poul has joined #openstack-ansible | 22:43 | |
| *** hassenius has quit IRC | 22:44 | |
| *** poul has quit IRC | 22:48 | |
| *** tux_ has quit IRC | 22:48 | |
| *** tux_ has joined #openstack-ansible | 22:50 | |
| *** jbadiapa has quit IRC | 22:55 | |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-galera_server master: Remove python-crypto and use in-repo GPG keys https://review.openstack.org/576989 | 22:56 |
| *** pmannidi has joined #openstack-ansible | 23:00 | |
| *** poul has joined #openstack-ansible | 23:01 | |
| *** poul has quit IRC | 23:05 | |
| *** tux_ has quit IRC | 23:07 | |
| *** tux_ has joined #openstack-ansible | 23:13 | |
| *** poul has joined #openstack-ansible | 23:18 | |
| *** vurtz has quit IRC | 23:20 | |
| *** poul has quit IRC | 23:23 | |
| *** cjloader has joined #openstack-ansible | 23:28 | |
| *** chyka has quit IRC | 23:32 | |
| *** cjloader has quit IRC | 23:33 | |
| *** poul has joined #openstack-ansible | 23:36 | |
| *** poul has quit IRC | 23:40 | |
| *** tosky has quit IRC | 23:42 | |
| *** dxiri has joined #openstack-ansible | 23:53 | |
| *** DanyC has quit IRC | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
