Monday, 2016-02-01

*** alejandrito has quit IRC00:05
*** vdo has quit IRC00:26
*** vdo has joined #openstack-ansible00:26
*** vdo has joined #openstack-ansible00:26
*** elo has joined #openstack-ansible00:38
*** markvoelker has joined #openstack-ansible00:46
*** markvoelker has quit IRC00:50
*** Mudpuppy has quit IRC01:15
*** Mudpuppy has joined #openstack-ansible01:46
*** markvoelker has joined #openstack-ansible01:47
openstackgerritLogan V proposed openstack/openstack-ansible: Explicitly use root as SSH user in haproxy play  https://review.openstack.org/27448101:49
*** Mudpuppy has quit IRC01:51
*** markvoelker has quit IRC01:52
openstackgerritLogan V proposed openstack/openstack-ansible: Clean up references to haproxy_hosts in plays  https://review.openstack.org/27448401:55
*** kejlly_ has quit IRC02:19
*** baker has joined #openstack-ansible02:39
*** baker has quit IRC02:49
*** Mudpuppy has joined #openstack-ansible02:58
*** markvoelker has joined #openstack-ansible03:47
*** weezS has joined #openstack-ansible03:51
*** markvoelker has quit IRC03:52
*** baker has joined #openstack-ansible04:06
*** baker has quit IRC04:11
*** skamithi has joined #openstack-ansible04:11
*** skamithi has left #openstack-ansible04:11
*** keedya has quit IRC04:19
openstackgerritLogan V proposed openstack/openstack-ansible: Install psmisc with haproxy  https://review.openstack.org/27449804:38
*** cemmason has joined #openstack-ansible04:48
*** baker has joined #openstack-ansible04:52
*** cemmason has quit IRC05:11
*** baker has quit IRC05:16
*** javeriak has joined #openstack-ansible05:28
*** javeriak has quit IRC05:29
*** javeriak has joined #openstack-ansible05:29
*** ntpttr has joined #openstack-ansible05:33
*** javeriak has quit IRC05:35
*** javeriak has joined #openstack-ansible05:35
*** ntpttr has quit IRC05:36
*** darrenc_ has joined #openstack-ansible05:43
*** neillc_ has joined #openstack-ansible05:43
*** Tridde_ has joined #openstack-ansible05:44
*** matt6434 has joined #openstack-ansible05:44
*** gus_ has joined #openstack-ansible05:45
*** e-vad_ has joined #openstack-ansible05:45
*** jmccrory_ has joined #openstack-ansible05:48
*** markvoelker has joined #openstack-ansible05:48
*** kysse_ has quit IRC05:49
*** mgagne has quit IRC05:49
*** agireud has quit IRC05:49
*** arbrandes has quit IRC05:49
*** jmccrory has quit IRC05:49
*** errr_ has quit IRC05:49
*** e-vad has quit IRC05:49
*** logan- has quit IRC05:49
*** Tridde has quit IRC05:49
*** mattoliverau has quit IRC05:49
*** gus has quit IRC05:49
*** jamielennox has quit IRC05:49
*** darrenc has quit IRC05:49
*** neillc has quit IRC05:49
*** palendae has quit IRC05:49
*** d34dh0r53 has quit IRC05:49
*** bogeyon1- has quit IRC05:49
*** dolphm has quit IRC05:49
*** eglute has quit IRC05:49
*** cloudnull has quit IRC05:49
*** sigmavirus24_awa has quit IRC05:49
*** jwagner has quit IRC05:49
*** b3rnard0 has quit IRC05:49
*** jmccrory_ is now known as jmccrory05:49
*** mgagne_ has joined #openstack-ansible05:49
*** dolphm has joined #openstack-ansible05:50
*** palendae has joined #openstack-ansible05:50
*** logan- has joined #openstack-ansible05:50
*** agireud has joined #openstack-ansible05:51
*** d34dh0r53 has joined #openstack-ansible05:52
*** kysse has joined #openstack-ansible05:52
*** markvoelker has quit IRC05:53
*** sigmavirus24_awa has joined #openstack-ansible05:54
*** eglute has joined #openstack-ansible05:55
*** javeriak has quit IRC05:55
*** jwagner has joined #openstack-ansible05:56
*** arbrandes has joined #openstack-ansible05:56
*** errr_ has joined #openstack-ansible05:57
*** javeriak has joined #openstack-ansible06:02
*** bogeyon18 has joined #openstack-ansible06:03
*** weezS has quit IRC06:04
*** Mudpuppy has quit IRC06:06
*** jamielennox|away has joined #openstack-ansible06:07
*** phiche has joined #openstack-ansible06:07
*** jamielennox|away is now known as jamielennox06:07
*** b3rnard0 has joined #openstack-ansible06:07
*** phiche has quit IRC06:09
*** phiche has joined #openstack-ansible06:10
*** phiche1 has joined #openstack-ansible06:10
*** phiche has quit IRC06:14
*** phiche1 has quit IRC06:33
*** Mudpuppy has joined #openstack-ansible06:37
*** cloudnul- has joined #openstack-ansible06:38
*** Mudpuppy has quit IRC06:42
*** phiche has joined #openstack-ansible06:43
*** cloudnul- is now known as cloudnull06:51
*** markvoelker has joined #openstack-ansible07:49
*** markvoelker has quit IRC07:54
*** mikelk has joined #openstack-ansible08:08
odyssey4memattt hughsaunders can I ask for some reviews of https://review.openstack.org/271399 this morning please08:32
*** gparaskevas has joined #openstack-ansible08:39
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Update RabbitMQ to v3.5.7-1  https://review.openstack.org/27455709:05
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-rabbitmq_server: Update RabbitMQ to v3.6.0-1  https://review.openstack.org/26638809:11
odyssey4memattt https://review.openstack.org/27440609:12
odyssey4meand https://review.openstack.org/274449 for mattt and hughsaunders09:12
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: [WIP] Consolidate lint tests into common tox environment  https://review.openstack.org/27272309:18
openstackgerritMerged openstack/openstack-ansible-pip_install: Fix pip url variable name  https://review.openstack.org/27440609:19
*** electrofelix has joined #openstack-ansible09:44
Bofu2Umornin09:46
*** markvoelker has joined #openstack-ansible09:50
*** egonzalez90 has joined #openstack-ansible09:50
*** egonzalez90 is now known as egonzalez09:52
*** javeriak_ has joined #openstack-ansible09:54
*** markvoelker has quit IRC09:54
*** javeriak has quit IRC09:56
*** javeriak_ has quit IRC10:00
odyssey4meo/ Bofu2U10:02
*** openstackgerrit has quit IRC10:02
*** openstackgerrit_ has joined #openstack-ansible10:03
*** openstackgerrit_ has quit IRC10:03
Bofu2Uhow are ya odyssey4me10:03
odyssey4menot too bad Bofu2U - how're you doing? How's your testing going?10:09
Bofu2Ucluster is up and running as of yesterday *thumbs up*10:09
odyssey4meBofu2U awesome, are you running Kilo or Liberty?10:09
Bofu2ULiberty10:09
Bofu2U3 controllers, 8 compute, 1 cinder10:09
odyssey4meBofu2U excellent :)10:10
Bofu2Uonce I removed the tunnels it turned to being blazing fast10:10
Bofu2U(vlans only)10:10
Bofu2Ucloudnull helped me way more than he should have :P10:10
Bofu2Unow just trying to find out if I'm missing where to make a load balancer that is multi-port on the same IP or if I'm thinking about this wrong10:11
odyssey4meBofu2U you wish to allow instances to have multiple IP's, specifically not assigned by OpenStack?10:12
Bofu2Uno no - I'm creating a load balancer within Horizon10:12
Bofu2Ubut I need it to handle, for example, ports 80, 443, and 222210:12
Bofu2UBut I can't seem to find where to handle that on the same IP unless it's using a VIP, maybe?10:12
odyssey4meAh, the LBaaS feature in Liberty is LBaaS v1 which doesn't allow that. Only LBaaS v2 does.10:12
Bofu2Udamn.10:13
Bofu2Unow I need to figure out how to upgrade it then :P10:13
odyssey4meLBaaS v2 isn't supported in Horizon in Liberty. (Horizon code in Liberty doesn't exist)10:13
odyssey4meit's not yet there in Mitaka either10:13
Bofu2Udamn. So is it that I don't have LBaaS v2 in general, or just within horizon?10:13
Bofu2UI only need to make this LB once, after all.10:13
odyssey4meTo make LBaaSv2 work in Liberty requires a considerable change in the way we deploy it. mhayden is busy looking into that10:14
Bofu2Uahh ok10:15
Bofu2Udamn, that sucks.10:15
Bofu2UI guess I'll just use a floating IP until then10:16
odyssey4mefor v1 I believe that each port needs its own floating IP10:16
Bofu2Uyeah10:16
Bofu2Uand I have 3 ports10:16
Bofu2Uman that sucks.10:16
odyssey4meyeah, that's why LBaaS wasn't enabled by default10:17
Bofu2Uyeah10:17
odyssey4mev1 was not acknowledge as ready for production10:17
odyssey4mev2 is the first the LBaaS team indicates is ready for production10:17
Bofu2UI guess I'll be that guy that creates an instance that is just haproxy and floating IP that10:17
Bofu2Uand then point the ports to the VIPs for each internal LB10:17
*** phiche1 has joined #openstack-ansible10:23
*** phiche has quit IRC10:25
*** marekd has quit IRC10:34
*** grumpycatt has quit IRC10:34
*** egonzalez has quit IRC10:36
*** Mudpuppy has joined #openstack-ansible10:39
*** marekd has joined #openstack-ansible10:42
*** grumpycatt has joined #openstack-ansible10:42
*** Mudpuppy has quit IRC10:43
*** swati_ has joined #openstack-ansible10:50
swati_Hi...I checked aodh in openstack-ansible10:50
swati_it is installed via venv....i have a doubt, if anything installed using venv should it be mentioend as venv enabled?10:51
matttswati_: all openstack services should be installed by default into a venv10:53
matttswati_: what is the doubt you have?10:53
odyssey4meswati_ welcome back :)10:54
odyssey4meswati_ by default we have the venv install enabled, but it can be disabled - for the designate role you'll want to implement the same pattern10:55
odyssey4meswati_ you'll also notice this recent merge, which is important: https://github.com/openstack/openstack-ansible/commit/2d766bc0e06deae00318814d5edbbadd50db607f10:55
*** mgoddard_ has joined #openstack-ansible10:59
*** mgoddard has quit IRC11:02
swati_Hello Jesse, I am using http://docs.openstack.org/developer/designate/getting-started.html to install designate using virtualenv in a container11:06
swati_whereas aodh has been using venv download url11:06
swati_so I erased all venv from my designate code11:06
odyssey4meswati you should follow our pattern for the method of install, but learn from their pattern to understand the configuration bits and the architecture needed11:08
odyssey4meswati_ ^11:08
*** swati_ has quit IRC11:11
*** matt6434 is now known as mattoliverau11:14
odyssey4memattt would you mind taking a peek at https://review.openstack.org/272723 ?11:19
matttodyssey4me: sure11:19
matttodyssey4me: https://review.openstack.org/#/c/27438711:21
matttany idea why that is failing?  thought juno may be busted but i just built an AIO without issue11:21
odyssey4memattt I have no idea, but I'm not sure it's worth doing anything there unless someone specifically presses for it.11:22
odyssey4meThere are no new Juno deployments by anyone AFAIK.11:23
*** grumpycatt has quit IRC11:28
*** grumpycatt has joined #openstack-ansible11:31
matttodyssey4me: ok so we can that review then?11:32
odyssey4memattt I think we can just leave it alone. If someonw has time and cares enough to figure it out, they can.11:35
matttok cool11:35
*** swati_ has joined #openstack-ansible11:41
swati_Hi Jesse, I checked in glance also, this venv part is mentioned https://github.com/openstack/openstack-ansible/commit/09411841e1a25575fd9012805ba3d34bf595a71f11:42
swati_is it mandatory for venv to be included in all components? coz initially also it was working without it?11:42
*** grumpycatt has quit IRC11:45
odyssey4meswati_ yes, all the roles have it - you can do your initial build without them as it will liekly simplify things just to get to a working base11:46
*** markvoelker has joined #openstack-ansible11:50
*** openstackgerrit_ has joined #openstack-ansible11:54
*** openstackgerrit_ is now known as openstackgerrit11:55
*** markvoelker has quit IRC11:55
*** grumpycatt has joined #openstack-ansible11:55
swati_ok I will add that11:55
swati_Also, I am working on the designate specification and  While the Designate services seem to up and running now in its container, I am stuck up with one last issue for the designate endpoint "EndpointNotFound". Whenever I run any designate related command after sourcing the openrc, I get this error.11:56
swati_Also, I have verified these details- (1) All designate endpoints showing (2) Designate services are running on 9001 port (3) keystone url verified for v2 and v3 (4) checked firewall enabled----false11:57
swati_?11:58
*** openstackgerrit has quit IRC11:59
*** openstackgerrit has joined #openstack-ansible12:08
odyssey4meswati_ so if you execute 'openstack endpoint list' does it show the designate endpoints?12:10
*** phiche1 has quit IRC12:16
swati_yes it shows https://10.16.34.6:900112:21
swati_I also tried with https://10.16.34.6:9001/v112:22
swati_and with https://10.16.34.6:9001/v2 as well12:22
odyssey4meswati_ and if you try to access those URL's from your utility container, does it work?12:23
odyssey4mehmm, also - have you configured for HTTPS (ie do you have certs, etc)12:23
swati_sorry...endpoints are listed with http://10.16.34.6:900112:24
swati_not https12:24
odyssey4meok, and if you curl that URL from the utility container, is it accessible?12:24
*** retreved_ has quit IRC12:30
*** phiche has joined #openstack-ansible12:38
openstackgerritMerged openstack/openstack-ansible: Remove cached facts in teardown.sh  https://review.openstack.org/27412412:38
openstackgerritMerged openstack/openstack-ansible: Clean up references to haproxy_hosts in plays  https://review.openstack.org/27448412:49
*** markvoelker has joined #openstack-ansible12:51
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Explicitly use root as SSH user in haproxy play  https://review.openstack.org/27448112:54
odyssey4memattt I rebased ^ after the previous patch merged.12:54
*** swati_ has quit IRC12:55
*** markvoelker has quit IRC12:56
*** woodard has joined #openstack-ansible12:58
*** woodard has quit IRC12:59
*** woodard has joined #openstack-ansible13:00
*** admin0 has joined #openstack-ansible13:04
*** xek__ is now known as xek13:12
*** markvoelker has joined #openstack-ansible13:14
logan-thanks for getting those haproxy merged :D with those patches it works for me in a 3 container setup now13:19
mhaydenmorning13:23
mhaydenodyssey4me / Bofu2U: the LBaaSv2 hacking is going somewhat well so far13:23
*** javeriak has joined #openstack-ansible13:23
*** javeriak has quit IRC13:23
*** javeriak has joined #openstack-ansible13:24
Bofu2Uoh nice13:28
Bofu2Uif you need someone to give it a shot let me know :P13:28
Bofu2UI found a workaround thus far but it's not a clean one heh13:28
mhaydena workaround for v1?13:28
*** javeriak has quit IRC13:28
Bofu2Ufor my use case for it, yeah13:28
mhaydenoh nice13:29
Bofu2Uhaproxy on an instance => port to LBaaS VIPs13:29
mhaydenonce i have something working for v2, i'll surely send something to the openstack-dev ML for people to poke at it13:29
Bofu2Uetc.13:29
Bofu2Uaka horrid workaround.13:29
openstackgerritMerged openstack/openstack-ansible: Install psmisc with haproxy  https://review.openstack.org/27449813:41
*** admin0 has quit IRC13:43
*** automagically has joined #openstack-ansible13:46
*** retreved has joined #openstack-ansible13:52
*** retreved has quit IRC13:52
*** retreved has joined #openstack-ansible13:53
*** dweaver has quit IRC14:03
*** dweaver has joined #openstack-ansible14:04
*** dweaver has quit IRC14:16
*** dweaver has joined #openstack-ansible14:17
*** fawadkhaliq has joined #openstack-ansible14:17
*** fawadkhaliq has quit IRC14:18
*** Bjoern has joined #openstack-ansible14:18
*** fawadkhaliq has joined #openstack-ansible14:20
*** grumpycatt has quit IRC14:21
*** dweaver has quit IRC14:30
*** pabelanger has quit IRC14:30
*** pabelanger has joined #openstack-ansible14:30
*** mgoddard__ has joined #openstack-ansible14:30
*** dweaver has joined #openstack-ansible14:30
*** mgoddard_ has quit IRC14:33
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-plugins: Fixes keystone library incompatibility with the Keystone v3 client  https://review.openstack.org/27468614:33
*** dweaver has quit IRC14:43
*** dweaver has joined #openstack-ansible14:43
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Update Defcore test list function  https://review.openstack.org/27013814:44
openstackgerritMajor Hayden proposed openstack/openstack-ansible-specs: Spec: LBaaSv2/Octavia  https://review.openstack.org/27374914:45
mhaydenBofu2U: feel free to weigh in on that spec ^^14:45
openstackgerritMerged openstack/openstack-ansible: Update AIO Quickstart  https://review.openstack.org/27444914:46
openstackgerritMerged openstack/openstack-ansible: Doc: Update Contributor Guidelines  https://review.openstack.org/27139914:46
*** dweaver has quit IRC14:56
*** dweaver has joined #openstack-ansible14:56
*** MCoLo has quit IRC14:57
*** spotz_zzz is now known as spotz15:04
*** skamithi has joined #openstack-ansible15:06
*** skamithi has left #openstack-ansible15:06
*** michaelgugino has joined #openstack-ansible15:08
*** sigmavirus24_awa is now known as sigmavirus2415:09
*** Mudpuppy has joined #openstack-ansible15:09
*** dweaver has quit IRC15:09
*** Mudpuppy has quit IRC15:09
*** dweaver has joined #openstack-ansible15:10
*** Mudpuppy has joined #openstack-ansible15:10
spotzmudpuppy how was the fog?15:16
MudpuppyFog is just a cloud that crashed15:16
*** alejandrito has joined #openstack-ansible15:17
cloudnullmorning15:18
automagicallyMorning15:21
michaelguginoI'm looking for feedback on rpm/apt changes:  https://review.openstack.org/#/c/274290/15:22
*** dweaver has quit IRC15:22
openstackgerritNolan Brubaker proposed openstack/openstack-ansible: [WIP] Add support for upgrading from Kilo to Liberty  https://review.openstack.org/27218215:23
*** dweaver has joined #openstack-ansible15:23
*** weezS has joined #openstack-ansible15:23
*** KLevenstein has joined #openstack-ansible15:34
spotzmorning15:34
*** b3rnard0 has quit IRC15:37
*** b3rnard0 has joined #openstack-ansible15:37
mattthowdy spotz15:37
spotzmichaelgugino put some thoughts in a comment for you15:37
michaelguginothanks15:37
spotzhey mattt15:37
spotzyou're welcome15:37
cloudnullodyssey4me: what not appropriate ?15:38
*** b3rnard0 has quit IRC15:40
michaelguginospotz: you and me are kind of on the same fence.  I added some additional rationale in the review.15:41
*** b3rnard0- has joined #openstack-ansible15:41
spotzmichaelgugino apt/yum are the most common. I know gentoo was on the list as well and last I used it it utilized emerge15:42
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible: Added conditional templating  https://review.openstack.org/27329315:42
michaelguginoI'm not qualified to add something for gentoo, but rather if the method is agreeable, then utilizing the same set of steps should be trivial.15:43
michaelguginoCurrently, I have put all steps in order, 1,1,2,2,3,3 for rpm/apt, respectively.  I feel it might be a little cleaner 1,2,3 1,2,315:44
michaelguginosince there don't appear to be any common steps between the two.15:44
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-rsyslog_client: Added conditional templating  https://review.openstack.org/27329215:44
cloudnullodyssey4me: when I asked reviewing a backport I worked on you said -+- "IMO you can, as you're verifying that it's the same thing you put in and you think it's suitable for the branch in question" -+- is that no longer the case?15:46
spotzmichaelgugino Yeah 1,2,3 so that each distro is isolated would be neater15:48
*** phiche1 has joined #openstack-ansible15:48
*** phiche has quit IRC15:48
odyssey4mecloudnull it was my patch, you backported it - ie I'm the author, but you're the change owner... you can't +2 your own change, but you can +2 a change owned by someone else which you originally authored15:50
odyssey4meclear as mud?15:50
*** jthorne has joined #openstack-ansible15:50
cloudnullokiedokie :)15:50
*** phiche has joined #openstack-ansible15:52
*** phiche1 has quit IRC15:52
*** galstrom_zzz is now known as galstrom15:53
*** phiche1 has joined #openstack-ansible15:55
*** phiche has quit IRC15:56
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-rsyslog_client: Added conditional templating  https://review.openstack.org/27329215:56
*** mgoddard__ has quit IRC15:58
*** fawadkhaliq has quit IRC16:03
*** cemmason has joined #openstack-ansible16:06
*** ccesario has joined #openstack-ansible16:07
*** Bjoern has quit IRC16:07
*** izaakk has joined #openstack-ansible16:08
*** mgoddard has joined #openstack-ansible16:10
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Revise all lint tests and add consolidated 'linters' tox environment  https://review.openstack.org/27272316:12
*** alextricity25_ is now known as alextricity2516:16
*** cemmason has quit IRC16:18
*** ntpttr has joined #openstack-ansible16:21
*** gparaskevas has quit IRC16:21
odyssey4mespotz if you can keep me honest I'd appreciate it: https://review.openstack.org/27272316:25
spotzLooking odyssey4me16:26
openstackgerritMichael Gugino proposed openstack/openstack-ansible-rsyslog_server: [WIP] Multi-distro support for rsyslog-server role  https://review.openstack.org/27429016:27
spotzYou're honest odyssey4me:)16:29
*** javeriak has joined #openstack-ansible16:31
*** javeriak has quit IRC16:35
*** ravla has joined #openstack-ansible16:36
*** grumpycatt has joined #openstack-ansible16:36
odyssey4methanks spotz16:39
odyssey4memattt can you take a quick look at https://review.openstack.org/27446016:39
spotzMy pleasure16:39
*** sigmavirus24 is now known as sigmavirus24_awa16:39
*** javeriak_ has joined #openstack-ansible16:39
*** sigmavirus24_awa is now known as sigmavirus2416:41
odyssey4memattt hughsaunders andymccr d34dh0r53 stevelle can we please get some reviews on https://review.openstack.org/272764 asap, this is essential to get votes/comments on - please refrain from workflow for now16:46
openstackgerritMatt Thompson proposed openstack/openstack-ansible-plugins: Update LICENSE file  https://review.openstack.org/27478016:47
*** baker has joined #openstack-ansible16:50
palendaegit-harry: Your restart patch at https://review.openstack.org/#/c/273149 worked for me on this AIO, but then I got an error with missing `cryptography` dependencies =\16:52
hughsaundersgit-harry: just had a build timeout because maas failed to register all the alarms within 20 mins :(16:52
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Revise all lint tests and add consolidated 'linters' tox environment  https://review.openstack.org/27272316:53
odyssey4memattt spotz palendae thanks for the previous reviews - I made a slight change to use a speci tox var instead of specifying the tmp dir myself16:53
*** mikelk has quit IRC16:54
*** phiche1 has quit IRC16:54
palendaeodyssey4me: 👍16:54
openstackgerritMatt Thompson proposed openstack/openstack-ansible: Correct path to callback plugins in gate script  https://review.openstack.org/27446016:55
git-harrypalendae: that sounds right, you need to apply this patch as well https://review.openstack.org/#/c/273943/16:55
mattt^^^ jmccrory hey there, i modified review 274460 as there should be no need to carry the MIT stuff in LICENSE.txt any more ... i've created https://review.openstack.org/274780 to account for this in the new repo16:56
palendaegit-harry: Ah, ok. Thanks16:56
palendaeReviews on https://review.openstack.org/#/c/273771 would be appreciated. I get michaelgugino's question about ansigenome being GPLv3, but that patch is using it as a callable binary, much in the same way we use ansible (which is itself GPLv3)16:57
*** mgoddard_ has joined #openstack-ansible17:00
*** mgoddard has quit IRC17:03
palendaegit-harry: Should probably backport that patch to liberty once it's merged17:06
git-harrypalendae: yup, both will need backporting17:07
*** phiche has joined #openstack-ansible17:10
*** javeriak_ has quit IRC17:11
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Add release note about restricted .my.cnf distribution  https://review.openstack.org/27154717:14
palendaegit-harry: Confirmed that applying that venv patch allowed swift playbooks to finish17:17
odyssey4mestevelle updated :) https://review.openstack.org/27154717:23
git-harrygit-harry: that's good, code wise I'm not sure if there's much more to do. At least based on aio testing.17:25
git-harrypalendae: ^17:25
palendaegit-harry: Cool17:25
*** raddaoui has joined #openstack-ansible17:27
*** retreved has quit IRC17:28
openstackgerritMerged openstack/openstack-ansible: Explicitly use root as SSH user in haproxy play  https://review.openstack.org/27448117:28
openstackgerritMerged openstack/openstack-ansible-plugins: Update LICENSE file  https://review.openstack.org/27478017:28
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Update Defcore test list function  https://review.openstack.org/27013817:29
automagicallyAny cores around who would like to get this backport merged, I’d appreciate it: https://review.openstack.org/#/c/273130/17:30
odyssey4mehughsaunders ^17:31
*** mgagne_ has quit IRC17:32
*** mgagne_ has joined #openstack-ansible17:32
*** daneyon_ has joined #openstack-ansible17:32
*** mgagne_ is now known as mgagne17:34
*** daneyon has quit IRC17:35
automagicallyThx gents17:36
odyssey4me:)17:36
jmccrorymattt: ok cool, thanks17:40
*** javeriak has joined #openstack-ansible17:41
*** ntpttr has left #openstack-ansible17:41
logan-my repo-build on liberty keeps pulling in pip 8. I see the pin was removed here https://github.com/openstack/openstack-ansible/commit/30f8db0fd70378c8e942e02b4f812af962424af3#diff-0e5f1153826db0ba1b2a81777fbcc888L3 ..is it possible that repo-build does not look at the package version spec in pip_install role?17:51
odyssey4melogan- the pip_install role contains the same restrictions: https://github.com/openstack/openstack-ansible/blob/liberty/playbooks/roles/pip_install/defaults/main.yml#L27-L2817:53
logan-actually the repo-build output shows it correctly as "pip>7,<8" under pip_install17:53
logan-yep I see that, however it does not seem like the repo-build honors it17:54
odyssey4melogan- yeah, so are you ending up with a pip wheel of >=8, or is pip on the host/container >=8 ?17:54
logan-situation I have right now is galera fails on pip_install because it can't find pip 7 on the repo, and it can't fall back to internet17:55
logan-I noticed on my AIO containers it always uses the fallback (since pip 7 is not on the repo)17:55
odyssey4melogan- ah, good find17:55
*** javeriak_ has joined #openstack-ansible17:55
odyssey4mein that case I wonder if we're missing something - the py_pkgs lookup should honour that17:56
logan-it does seem to pass it as part of role_packages17:56
logan-http://paste.gentoolinux.info/urozaxutob.apache17:56
*** javeriak has quit IRC17:57
logan-seems like the break is further in the build17:57
*** mgoddard_ has quit IRC17:57
michaelguginoodyssey4me: your feedback on https://review.openstack.org/274290 would be appreciated17:59
logan-i think the pin in requirements.txt is overriding the role requirement18:04
*** mgoddard has joined #openstack-ansible18:04
*** weezS has quit IRC18:04
*** retreved has joined #openstack-ansible18:12
*** retreved has quit IRC18:13
javeriak_guys any idea if tempest picks up the conf from another location for runtime? im getting different results everytime18:13
*** retreved has joined #openstack-ansible18:13
*** raddaoui has quit IRC18:15
odyssey4memichaelgugino done :)18:22
odyssey4mejaveriak_ if you're running tempest manually from a relatively old tag, or for juno/kilo - then you need to add the --serial option, otherwise you end up with differing amounts of tests being run18:23
javeriak_odyssey4me i'm running from kilo 11.2.6?18:24
javeriak_how does it change the skipped tests everytime? shouldn't it be picking that up from the config I set18:24
odyssey4mejaveriak_ we did this not too long ago to make it work the way we want by default: https://github.com/openstack/openstack-ansible/commit/850221910e780f6d0b3d790b377992ca6b32945618:24
javeriak_odyssey4me oh is it a concurrency issue?18:26
odyssey4mejaveriak_ yeah, it seems that tempest does differing amounts of tests if you do too many concurrent tests18:26
odyssey4meso we force it to run the tests in serial18:26
odyssey4methat's the only way we could get the same number of tests being run, always18:26
javeriak_okay thanks odyssey4me, looks like thats what its doing for me too18:27
michaelguginothanks odyssey4me.  I'll look into trying these suggestions.18:28
odyssey4memichaelgugino they're just my suggestions based on my thinking - not necessarily the only way of doing things18:30
odyssey4meI'm happy to see more opinions in the review before any revision.18:31
michaelguginoI'm not an ansible expert, so I'm very open to better ways of doing things.18:31
*** KLevenstein has quit IRC18:32
odyssey4memichaelgugino part of the point was to figure out different options which made sense to different people18:33
odyssey4meso this is good - it forms a platform for discussion on thu18:33
odyssey4mealright, time for me to move on - I might be on again later, but might not - night all18:34
michaelguginocya18:36
*** javeriak has joined #openstack-ansible18:38
*** javeriak_ has quit IRC18:42
openstackgerritMerged openstack/openstack-ansible: Implement multi-domain LDAP configuration for Keystone  https://review.openstack.org/27313018:45
*** mgoddard has quit IRC18:51
*** Bjoern has joined #openstack-ansible19:00
openstackgerritLogan V proposed openstack/openstack-ansible: Set Openstack LXC apparmor profile on haproxy containers  https://review.openstack.org/27485719:11
openstackgerritLogan V proposed openstack/openstack-ansible: Use root user when configuring Galera LXC profile  https://review.openstack.org/27485819:11
*** oneswig has joined #openstack-ansible19:17
*** grumpycatt has quit IRC19:21
*** marekd has quit IRC19:21
*** oneswig has quit IRC19:24
*** oneswig has joined #openstack-ansible19:26
*** jthorne has quit IRC19:29
*** grumpycatt has joined #openstack-ansible19:32
*** marekd has joined #openstack-ansible19:32
*** metral is now known as metral_zzz19:32
*** raddaoui has joined #openstack-ansible19:35
*** oneswig has quit IRC19:41
*** skamithi has joined #openstack-ansible19:42
*** oneswig has joined #openstack-ansible19:42
*** KLevenstein has joined #openstack-ansible19:45
*** skamithi has left #openstack-ansible19:49
*** metral_zzz is now known as metral19:50
*** metral is now known as metral_zzz19:50
*** weezS has joined #openstack-ansible19:54
*** jthorne has joined #openstack-ansible19:56
*** b3rnard0- is now known as b3rnard019:57
*** michaelgugino has quit IRC19:58
*** metral_zzz is now known as metral20:00
openstackgerritMiguel Alex Cantu (alextricity25) proposed openstack/openstack-ansible: Allow apache file overrides  https://review.openstack.org/26774920:01
alextricity25Well, that's definitely not what I wanted20:02
alextricity25time to rebase20:02
openstackgerritMiguel Alex Cantu (alextricity25) proposed openstack/openstack-ansible: Allow apache file overrides  https://review.openstack.org/26774920:03
*** oneswig has quit IRC20:04
*** galstrom is now known as galstrom_zzz20:14
bgmccollumwhen galera tips over, it looks like cinder scheduler / volume don't try to reconnect, or they backoff their retries to an extreme amount...have to manually bounce to get them back in.20:23
alextricity25sounds like a cinder bug20:24
bgmccollumalso, shouldn't the database continue to operate if 1 of the 3 nodes is down? im seeing everything halt until that single offline node is brought back into the cluster20:25
*** oneswig has joined #openstack-ansible20:25
bgmccollumalextricity25 thats what im thinking... :/20:26
*** grumpycatt has quit IRC20:34
*** grumpycatt has joined #openstack-ansible20:35
*** electrofelix has quit IRC20:37
*** javeriak has quit IRC20:41
*** skamithi has joined #openstack-ansible20:45
*** ntpttr has joined #openstack-ansible20:47
ntpttrHey everyone, I've set up three infra nodes for my osad deployment, and in two of them the containers are starting all right but in the third I'm getting "failed to start container" for all of its containers20:47
ntpttrI thought I configured the hosts all identically, what can I do to troubleshoot the failure?20:48
retrevedi saw a similar issue last week.  for me, i  had a newer kernel than the others and app-armor was stopping lxc20:49
sigmavirus24bgmccollum: is the database back off for cinder scheduler/cinder volume not configurable via the oslo.db section?20:51
bgmccollumsigmavirus24 dunno...just noticed that behavior recently. looking...20:51
sigmavirus24bgmccollum: pretty sure those are things you can tweak for the service20:52
sigmavirus24Idk if cinder supports sighup's for reloading conf though20:53
bgmccollumsigmavirus24 doesn't look like anything is defined in OSA kilo20:53
bgmccollumactually, is kilo even using oslo.db ? the conf section is just [database]20:54
ntpttrretreved: thanks, looks like all of my kernels are the same version though20:54
sigmavirus24bgmccollum: potentially, I'm going to look at kilo cinder20:55
sigmavirus24bgmccollum: looks like that section *is* generated by oslo.db21:00
sigmavirus24bgmccollum: so looks like there's two db backends for cinder (oslo.db and cinder.db.api)21:03
sigmavirus24bgmccollum: no clue what's going on here21:04
bgmccollumbgmccollum: im trying to reproduce...i think it has to do with my other issue, where 1 galera node out of 3 drop, and the cluster things its lost quorum...21:05
bgmccollumsigmavirus24 ^21:05
sigmavirus24bgmccollum: that sounds likely too21:06
sigmavirus24but having to bounce cinder to reconnect sounds like a different issue21:07
* sigmavirus24 assumed you'd know about quorum21:07
*** oneswig has quit IRC21:08
sigmavirus24bgmccollum: as I read cinder's code in kilo, you can set https://github.com/openstack/oslo.db/blob/stable/kilo/oslo_db/options.py#L77..L92 for the database section and they should just work too21:09
bgmccollumsigmavirus24 i though that if at least majority of members were up, things would continue to function. so with only 1 of 3 nodes down, that cluster would still be operations...no?21:10
odyssey4mebgmccollum does haproxy think the node is still up perhaps?21:10
bgmccollumodyssey4me im trying to re-break it :/21:10
odyssey4meas far as I remember, the haproxy timeout may be too high21:10
odyssey4mewe could probably do with tuning it to ensure that the default openstack service client timeout, haproxy timeout and galera timeout are similar or exactly the same21:11
odyssey4mebut hey, that's just another guess21:11
bgmccollumsigmavirus24 -- cinder trace when galera tips over...after this, it never retries -- http://paste.openstack.org/show/485670/21:12
bgmccollumodyssey4me ill check when i get it to happen again21:12
sigmavirus24bgmccollum: according to a comment on http://serverfault.com/questions/705255/mariadb-galera-cluster-falls-out-of-sync-easily that error tends to be because of a lost quorum21:15
sigmavirus24bgmccollum: have you looked at the mysql/galera logs?21:16
bgmccollumsigmavirus24 whats weird is that there only 1 of 3 nodes was down...21:16
sigmavirus24bgmccollum: interesting21:17
sigmavirus24there's also oslo.db settings for retrying a transaction fwiw21:17
sigmavirus24This could also be an unhandled exception by cinder in stable/kilo21:17
bgmccollumexit21:19
bgmccollum:/21:19
*** darrenc_ is now known as darrenc21:19
*** elopez has joined #openstack-ansible21:21
sigmavirus24bgmccollum: http://serverfault.com/questions/705255/mariadb-galera-cluster-falls-out-of-sync-easily21:25
sigmavirus24gah wrong link21:25
sigmavirus24https://groups.google.com/forum/#!topic/codership-team/jmhLd_Hr98Y21:25
bgmccollumreading thx21:25
*** ntpttr has left #openstack-ansible21:25
sigmavirus24I really feel like this is a quorum related thing but I agree that this *should not* be a problem21:26
bgmccollum2 of 3 nodes up should still reach quorum right? or am i misunderstanding quorum is this context?21:28
palendaeThat's my understanding21:29
palendaeAnd the whole reason we have an odd number of nodes21:29
bgmccollumand after quorum is lost (for whatever unknown reason at this point)...cinder scheduler / volume basically stop trying to re-connect to DB...which require a bounce21:30
sigmavirus24bgmccollum: is there anything in the galera/maria logs though?21:33
bgmccollumsigmavirus24 digging21:34
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_server: Remove unused python_packages and reports directories  https://review.openstack.org/27490221:36
stevellebgmccollum: I have been wondering for a while if we needed to weight the galera nodes to ensure quarum21:47
*** eil397 has joined #openstack-ansible21:49
*** oneswig has joined #openstack-ansible21:50
bgmccollumstevelle -- this? -- http://galeracluster.com/documentation-webpages/weightedquorum.html21:53
stevellebgmccollum: the same21:54
*** oneswig has quit IRC21:54
stevelleI believe we had a change to number our galera nodes at one point. assigning a weight of 2^node_number should do it21:55
openstackgerritMiguel Alex Cantu (alextricity25) proposed openstack/openstack-ansible: Changed ceilometer configs to use keystonev3  https://review.openstack.org/27490521:55
alextricity25 darn that trailing whitspace21:55
alextricity25just when i thought I could have a bug fix with only one patchset21:56
alextricity25(x) Achievement Unlocked: Fixed Bug with only one patch set21:57
prometheanfirelol21:57
openstackgerritMiguel Alex Cantu (alextricity25) proposed openstack/openstack-ansible: Changed ceilometer configs to use keystonev3  https://review.openstack.org/27490521:58
bgmccollumreading about galera quorum...the only way i can see what im seeing happen is...1 node gracefully leaves the cluster (OOM?)...then a network split-brain happens, leaving the 2 remaining nodes in non-primary.22:01
stevelleyeah, a bit of an edge case if things work as documented22:02
stevellestill possible and who knows if docs are right22:02
bgmccollumgonna need some more nodes :P22:05
*** SamYaple has joined #openstack-ansible22:23
SamYaplecloudnull: odyssey4me interesting conversation happening in #openstack-nova atm22:23
SamYapleapparently in liberty they added a new nova_api database as a requirement22:24
SamYaplepatch i found from a few days ago now starts to use that database and broke things22:24
SamYaplehttps://bugs.launchpad.net/kolla/+bug/154057922:24
openstackLaunchpad bug 1540579 in kolla "nova-api -- No sql_connection parameter is established" [Undecided,New]22:24
SamYapleI think you guys might be missing the api_db as well22:24
*** admin0 has joined #openstack-ansible22:28
admin0this is my container address: 10.10.0.0/22   .. my used_ips is - 10.10.0.1,10.10.1.100  .. so I expect the new container address will be from 10.10.1.101+ .. but all my containers are getting 10.0.3.x range and ssh fails22:29
admin0what am I doing wrong ?22:29
*** Mudpuppy_ has joined #openstack-ansible22:29
admin010.0 is not defined anywhere22:30
*** alejandrito has quit IRC22:30
bgmccollumadmin0 i think thats is the lxc NAT...is it assigned to eth0 in the containers?22:30
admin0yep22:31
cloudnullhahaha SamYaple I was just having a rage fest about that when i was AFK.22:31
admin0so this is the correct behaviour ?22:31
SamYaplecloudnull: yea i say it last week but didnt track it down until now22:31
bgmccollumadmin0 yes, its what allows your containers to reach the internet to install packages etc...22:32
cloudnullanything interesting come from that ?22:32
SamYaplecloudnull: they did the api_db in KILO!22:32
SamYaplenot liberty22:32
SamYaplebut this is the first patch to use it22:32
SamYaplecloudnull: https://wiki.openstack.org/wiki/ReleaseNotes/Kilo#OpenStack_Compute_.28Nova.2922:32
SamYaplecells v2 section22:33
SamYaple"but nothing is using this database yet so it is not necessary to set it up." lol22:33
*** KLevenstein has quit IRC22:33
*** Mudpuppy has quit IRC22:33
cloudnulli just saw this https://github.com/openstack/nova/blob/df0fca62cf5324f5b6eae0fed1f88c6c9ed61c71/releasenotes/notes/request-spec-api-db-b9cc6e0624d563c5.yaml22:34
*** Mudpuppy_ has quit IRC22:34
SamYapleyup thats the commit i found22:34
palendaeSweet, so we need to add migrations for that?22:34
cloudnullyup22:34
palendaeGood to know22:34
SamYaplenew db and migrations! woo22:34
palendaeWill add that to my list of at least liberty things to worry about22:35
cloudnullfrustrating22:35
SamYapleso much for one db per service. that was just too clean22:35
cloudnulland so much for "only the conductor talks to the db"22:35
SamYaplelol yup22:35
cloudnull:(22:35
palendae👍 nova22:35
SamYapleolny the conductor talks to the nova database though22:35
SamYaplenova api talks to the api database ;)22:35
palendaeSo *technically* true. :p22:36
cloudnulli see what you did there ...22:36
SamYaplethe best kind of true22:36
* cloudnull takes ball and goes home22:36
cloudnullits "truthy"22:37
cloudnullor rather trueish ?22:37
SamYaplemy favorite flavor!22:37
*** raddaoui has quit IRC22:37
cloudnullBaskin-Robbins to the rescue22:38
cooljwhat was the reasoning for requiring a new api db?22:38
cloudnullyes22:38
bgmccollumhey guys...did you know the baskin robbins logo has a hidden 13 in it?!?22:38
SamYaplecoolj: yes indeed22:38
cloudnull^reason22:38
bgmccollumcrazy...right?22:38
spotzice cream!!!22:38
bgmccollumand the fedex logo has a hidden arrow in it?!?!?...crazy town i tell ya22:38
SamYapleand the.... oh i probably shoudlnt say that one22:38
SamYaplejust... get a vhs copy of little mermaid22:39
SamYaplethank me later22:39
cloudnullLOL22:39
bgmccollumdont go there22:39
palendaecoolj: Looks like the reasoning might be laid out at https://review.openstack.org/#/c/258628/, but I've only skimmed the commit message22:40
cooljpalendae: thx, reading22:42
palendaeWait, SamYaple, cloudnull: Wait, is this patch in liberty now too?22:43
palendaeLooks like it says master22:43
*** b3rnard0 is now known as b3rnard0_away22:43
palendae"With this change the api db will be more frequently needed."22:44
palendaelol22:44
palendaeThat's a nice way of saying "required"22:44
SamYaplepalendae: it wasnt' used in liberty at all22:44
SamYaplebut some tables were added22:44
palendaeSamYaple: Ok, so it's used for *Mitaka*22:44
SamYapleyes22:44
SamYapleas of 4 days ago in master22:44
palendaeOk, still good to know22:44
palendaeWell, Mitaka's not out yet22:44
SamYaplesure22:44
palendaeBleeding edge, woo22:44
SamYaplebut if this was all done right we would have added the db in kolla and osa back in Kilo22:45
SamYapleand then this change wouldn't break anything in anybodies project22:45
palendaeI'd be more concerned if they turned it on in liberty now22:45
bgmccollumHakuna Mitaka22:45
palendaeYeah, they should have been creating the DB when they....created the DB22:45
SamYaplelol22:45
SamYaplebgmccollum22:45
palendaeAh well22:45
bgmccollumSamYaple Sups22:45
SamYapleyou should have run into this by now, right bgmccollum ? with the labs and the gates no/22:46
admin0bgmccollum:  setup-hosts run fine .. without issues .. containers have eth0 address . now when I switch next to setup-infra , it fails immeidately22:46
bgmccollumSamYaple Sounds like an OSA problem, not an RPC problem22:46
SamYapleoh wait you do the shabumps nvm22:46
admin0self.ipv6 = ':' in self.host TypeError: argument of type 'NoneType' is not iterable22:46
SamYapleso you _will_ run into it if you shabump nova22:46
palendaeYeah22:47
bgmccollumRephrased...sounds like an eventual RPC problem22:47
bgmccollum;)22:47
palendaebgmccollum: Yep22:47
palendaeActually it sounds like everyone just needs to keep up to date with the head of the various projects22:50
palendaeWhich are current development and not guaranteed to not break22:50
SamYaplein this case those this was a change in Kilo that had basically no mention or use after that palendae22:52
SamYaplepushing it under everyones radar22:52
palendaeWould it really be any different if the DB just appeared now, with the same commit?22:52
SamYaplei dont think they can do that (the TC doesnt allow a change like that)22:52
SamYaplethey would need a cycle for it to happen22:52
SamYaplewhich they gave us22:52
palendaeAlright, well, I don't see it as earth shattering I guess. It's a new feature for an in-progress release. Sucks, but fixable22:54
SamYapleyea no game changing22:55
palendaeThe ideal thing would be to make the DB back in Kilo, I agree22:55
*** admin0 has quit IRC22:57
*** pegmanm has joined #openstack-ansible23:03
*** skamithi has quit IRC23:03
*** Bjoern has quit IRC23:18
openstackgerritKevin Carter proposed openstack/openstack-ansible: Add support for the nova_api db  https://review.openstack.org/27493223:18
*** sigmavirus24 is now known as sigmavirus24_awa23:22
*** spotz is now known as spotz_zzz23:22
*** baker has quit IRC23:27
*** automagically has quit IRC23:29
*** raddaoui has joined #openstack-ansible23:33
*** jamielennox is now known as jamielennox|away23:36
*** oneswig has joined #openstack-ansible23:39
*** markvoelker has quit IRC23:41
*** oneswig has quit IRC23:43
*** jthorne has quit IRC23:44

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!