Friday, 2017-02-03

*** arif-ali has quit IRC00:06
openstackgerritAndrey Grebennikov proposed openstack/openstack-ansible-galera_server master: Added Galera SSL support  https://review.openstack.org/42599700:07
*** rob0t_ has joined #openstack-ansible00:08
*** hfu has joined #openstack-ansible00:12
*** rob0t_ has quit IRC00:12
*** esberglu has joined #openstack-ansible00:16
*** esberglu has quit IRC00:17
*** esberglu has joined #openstack-ansible00:17
MasterOfBugsHi All00:18
MasterOfBugsI want to deploy 3 controller and 50+ compute with OVS on an openstack-ansible environment00:19
*** adrian_otto has joined #openstack-ansible00:19
MasterOfBugsIs there a documentation which explains me that in detail?00:19
MasterOfBugsme -*00:19
*** rob0t_ has joined #openstack-ansible00:20
*** jperry has quit IRC00:20
*** arif-ali has joined #openstack-ansible00:20
*** esberglu has quit IRC00:22
*** agrebennikov__ has quit IRC00:24
*** rob0t_ has quit IRC00:24
*** LinStatSDR has quit IRC00:36
*** chyka has quit IRC00:36
*** weezS has joined #openstack-ansible00:41
*** weezS has quit IRC00:41
openstackgerritMiguel Alex Cantu (alextricity25) proposed openstack/openstack-ansible stable/mitaka: Bump requirements SHA  https://review.openstack.org/42851100:43
openstackgerritTom Jose Kalapura proposed openstack/openstack-ansible stable/newton: Use https to retrieve upper-constraints  https://review.openstack.org/42851300:45
*** LinStatSDR has joined #openstack-ansible00:47
*** acormier has joined #openstack-ansible00:49
*** hw_wutianwei has joined #openstack-ansible00:51
*** acormier has quit IRC00:54
*** pjh03 has joined #openstack-ansible00:59
*** retreved has quit IRC00:59
*** retreved has joined #openstack-ansible00:59
*** weezS has joined #openstack-ansible01:03
*** pjh03 has quit IRC01:03
*** jamesdenton has joined #openstack-ansible01:07
*** jamesdenton has quit IRC01:09
*** pjh03 has joined #openstack-ansible01:12
cloudnullevenings01:15
logan-hello01:15
cloudnullhows it logan-01:16
logan-great. messing with M->N finally01:17
logan-you?01:17
*** pjh03 has quit IRC01:17
logan-kind of amazing how slow this is http://cdn.pasteraw.com/ryb4m96x0cshk5mithblq31572sb9pv01:17
cloudnullwow 17 sec01:18
cloudnullinternal routing?01:18
cloudnulldoing well, just playing catch-up -- the forever battle01:18
LinStatSDRno sdn :(01:18
cloudnullLinStatSDR: ?01:18
LinStatSDRsoftware defined networking01:19
LinStatSDRlike contrail01:19
cloudnullah, yea. no contrail01:20
cloudnullwe have nuage and plumgrid01:20
logan-yeah local boxes low latency etc etc. was trying to think of a way to make it loop thru hostvars faster01:20
*** thorst_ has quit IRC01:20
*** crushil has joined #openstack-ansible01:20
LinStatSDRmm01:20
cloudnulland calico01:20
LinStatSDRyeah i use calico01:20
LinStatSDRi feel01:21
*** thorst_ has joined #openstack-ansible01:21
cloudnulllogan-: hum...01:21
logan-even targeting that debug at localhost is 17sce01:21
logan-sec*01:21
logan-i guess it is some ansible thing01:21
cloudnullmaybe its the inventory processing ?01:21
LinStatSDR17s i would look into kinda long01:21
LinStatSDRi came in late, what exactly is taking 17s?01:22
cloudnullcurious if a static inventory with a limited set of hosts would be faster?01:22
LinStatSDRhmmm lots of ips in there01:22
logan-looping thru an 81 host group in hostvars LinStatSDR: http://cdn.pasteraw.com/ryb4m96x0cshk5mithblq31572sb9pv01:22
LinStatSDRyeah i see tha tnow01:23
LinStatSDRall internal tho01:23
logan-it isn't even connecting to them, seems to be laggy inventory01:24
LinStatSDRinteresting01:24
* LinStatSDR shrugs01:24
cloudnullalso curious if a jinja loop using {% for i in ... %}{% endfor %} is faster ?01:24
logan-nope tested that too, 17 seconds also01:24
cloudnullhum.01:24
LinStatSDRif you keep getting the same times01:24
cloudnullansible 2.2.x ?01:25
*** weezS has quit IRC01:25
*** thorst_ has quit IRC01:25
*** evilt0ne has quit IRC01:25
logan-newton 2.1.4.001:25
*** cmart has quit IRC01:27
logan-i'll try latest just for kicks01:28
*** retreved has quit IRC01:28
logan-maybe this will resolve itself for ocata :)01:28
*** sdake has joined #openstack-ansible01:28
cloudnulllogan-: http://cdn.pasteraw.com/fcal8gmytl08ewkygbodf1znsxr52jo01:30
cloudnull13 sec01:30
cloudnullso not much better01:30
cloudnulland thats on ansible 2.301:30
logan-same here on 2.2.1.001:30
logan-13.48701:30
logan-:(01:30
*** portdirect is now known as portdirect_away01:30
*** rob0t_ has joined #openstack-ansible01:36
cloudnullso it looks like it's slow to process the inventory in the loop01:37
cloudnullinventory load time seems good.01:38
cloudnullthough the jinja loop seems like it's slow01:38
logan-mitaka 1.9.6 is at 5.379s so it was still pretty slow but not quite as bad on 1.901:39
logan-yeah it seems to be when you loop hostvars via jinja you hit this01:40
*** chris_hultin|AWA is now known as chris_hultin01:41
*** LinStatSDR has quit IRC01:42
*** evilt0ne has joined #openstack-ansible01:43
*** evilt0ne has quit IRC01:43
*** evilt0ne has joined #openstack-ansible01:43
*** chris_hultin is now known as chris_hultin|AWA01:43
*** kberger has quit IRC01:44
cloudnullhttps://groups.google.com/forum/#!topic/ansible-devel/UU0Tpw-qlhY01:45
cloudnullseems like its a known which is "managable" according to the last pst01:46
logan-hmm that PR they merged is included as of 2.2.1.0 so maybe thats the 17s->13s we're seeing01:49
*** acormier has joined #openstack-ansible01:49
*** acormier has quit IRC01:50
*** acormier has joined #openstack-ansible01:50
*** thorst_ has joined #openstack-ansible02:00
*** thorst_ has quit IRC02:00
*** adrian_otto has quit IRC02:06
*** rob0t_ has quit IRC02:07
*** gouthamr has joined #openstack-ansible02:09
*** cathrich_ has joined #openstack-ansible02:13
*** cathrichardson has quit IRC02:13
*** rob0t_ has joined #openstack-ansible02:14
boxrick1Is there currently a good branch which is safe to build from ?02:17
*** Mahe has quit IRC02:23
*** Mahe has joined #openstack-ansible02:25
*** thorst_ has joined #openstack-ansible02:32
*** thorst_ has quit IRC02:32
*** woodard has quit IRC02:39
*** woodard has joined #openstack-ansible02:40
cloudnulllogan-: that may be02:41
cloudnullsorry was getting dinner02:41
cloudnullboxrick1: the last deployment I did was from 14.0.602:42
boxrick1How long ago ?02:42
cloudnullwhich was from the stable/newton branch02:42
cloudnulltwo weeks02:42
cloudnullI've done several labs since then on the head of stable newton02:42
cloudnullare you running into things ?02:43
boxrick1Yea, was having this problem with "master" about 5 hours ago: https://gist.github.com/boxrick/b40cb2c6589876d4f2e19c655332763302:46
boxrick1Someone said there were fixes being pushed at the time though02:46
boxrick1Doesn't matter too much this exact second. Just cleaning up some of these roles to replace Cobbler to push upstream and just making sure things still work with my stuff.02:47
cloudnullmcarden: ^ you were seeing something with the run playbooks script ?02:47
*** MasterOfBugs has quit IRC02:47
cloudnullboxrick1: is this for a multi-node deploy or are you running this on a cluster ?02:47
boxrick1Yea, this is a multinode deploy.02:47
mcardenI was having a problem, but it wasn't that problem and also the patch to fix the problem I was having, has merged.02:48
boxrick1Ill give 14.0.6 another go02:49
boxrick1And see where I get02:49
*** pmannidi has quit IRC02:57
*** pmannidi has joined #openstack-ansible02:58
*** whiteveil has joined #openstack-ansible02:59
*** whiteveil has quit IRC03:02
*** crushil has quit IRC03:05
*** cmart has joined #openstack-ansible03:14
mhaydenandymccr: so it seems that CentOS is 2-3x slower in the gate on tasks across the board03:23
cloudnull:'(03:24
mhaydensome of them are ansible heavy03:24
mhaydenbut some are just easy stuff, like git clones03:24
mhaydeni wonder if there's a config difference in the gate for centos03:24
cloudnullcould be the image ?03:24
mhaydeni'm wondering if so03:24
mhaydenbecause my deployment on centos seemed to be the same speed as ubuntu03:25
mhaydeni would have noticed if it wasn't!03:25
*** crushil has joined #openstack-ansible03:25
mhaydencloudnull: https://gist.github.com/major/7933b918723bff2216190a38bf2c957203:29
mhaydenrepo build was almost 2x03:29
cloudnullare those the gate timings?03:30
cloudnullah, well this kinda makes sense. i think (for repo-build that is)03:30
mhaydenyes03:30
cloudnullthe image we used is from the upstream gate.03:31
cloudnullwhich caches just about everything for devstack03:31
cloudnullI suspect they dont do the same level of caching for centos03:31
cloudnullour gat ejobs tries to get and use the cached bits to make things faster if present03:31
mhaydenquick script i hacked together https://gist.github.com/major/b090eaa865b5e86ec9676610acb6b47f03:32
mhaydenhmm, i wonder what would happen if we disabled fastestmirror03:32
mhaydenbut yeah, this appears to be happening with anything that depends heavily on the network03:33
mhaydencreate neutron ha task is 41 sec vs 52 sec03:33
mhaydenfairly close03:33
mhaydencompressing static files in horizon is within 15-20 sec03:34
mhaydenperhaps i'll cobble a patch to disable fastestmirror just in case03:38
mhaydeni disable it on quite a few centos machines03:38
cloudnullthere are a mess of packages that gets installed03:38
cloudnullso that could be it03:38
mhaydensometimes the fastestmirror check hangs for a long time03:40
*** sdake has quit IRC03:41
*** crushil has quit IRC03:41
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: corrected infra wheel mirror URL  https://review.openstack.org/42855803:42
cloudnull^ found a bug :)03:42
openstackgerritMajor Hayden proposed openstack/openstack-ansible-openstack_hosts master: Disable yum fastestmirror plugin  https://review.openstack.org/42856003:43
openstackgerritMajor Hayden proposed openstack/openstack-ansible-lxc_hosts master: Copy over fastestmirror configuration  https://review.openstack.org/42856103:46
mhaydenwe can try those out03:46
mhaydenmgariepy: i linked to those patches in 40769003:49
mhaydencloudnull: but centos should be using the pip mirror from openstack, right?03:52
cloudnullyes it looks like the current mirror selector should cover it03:53
mhaydenwell, my .pip directory in my repo server doesn't specify a mirror03:56
mhaydenerr, i guess it wouldn't on a non-gate run03:56
cloudnullyea it should only be run when detected to be running w/in nodepool03:57
*** thorst_ has joined #openstack-ansible03:58
*** thorst_ has quit IRC03:58
mhaydeni'll go run one in a 8gb vm and see04:00
*** hfu has quit IRC04:00
*** hfu has joined #openstack-ansible04:02
mhaydenimma go sleepytime while that runs04:03
mhaydennight folks04:03
*** crushil has joined #openstack-ansible04:07
*** sdake has joined #openstack-ansible04:07
*** acormier has quit IRC04:10
cloudnullcheers mhayden04:10
*** sdake_ has joined #openstack-ansible04:11
boxrick1cloudnull using 14.0.6 gives this: ERROR! Unexpected Exception: The 'packaging>=16.8' distribution was not found and is required by setuptools04:11
boxrick1Which I think was fixed in a more recent build?04:11
cloudnullah. that was fixed in the branch04:12
cloudnullsorry.04:12
cloudnullstable/newton04:12
cloudnullI forgot about that issue04:12
*** sdake has quit IRC04:12
*** udesale has joined #openstack-ansible04:13
openstackgerritRick Box proposed openstack/openstack-ansible-ops master: Adds in Apache2 role - Ubuntu 16.04  https://review.openstack.org/42856604:13
*** esberglu has joined #openstack-ansible04:17
*** gouthamr has quit IRC04:17
openstackgerritRick Box proposed openstack/openstack-ansible-ops master: Adds in DHCPD role - Ubuntu 16.04  https://review.openstack.org/42856904:18
*** thorst_ has joined #openstack-ansible04:21
*** thorst_ has quit IRC04:21
*** esberglu has quit IRC04:21
openstackgerritRick Box proposed openstack/openstack-ansible-ops master: Adds in TFTP Configure role - Ubuntu 16.04  https://review.openstack.org/42857004:22
*** jcannava has quit IRC04:23
*** jcannava has joined #openstack-ansible04:25
boxrick1Hopefully if these end up looking OK we can start thinking about Cobbler going away.04:26
cloudnull+1 they look pretty good.04:26
cloudnulltomorrow i'm going to give it all a go.04:26
*** furlongm has quit IRC04:27
boxrick1I have all the glue which brings it together, but lets make sure this looks all good first then ill push that next.04:29
boxrick1Right, its rather late here time to sleep. I shall speak to you later.04:31
*** furlongm has joined #openstack-ansible04:32
*** admin0_ has joined #openstack-ansible04:32
*** crushil has quit IRC04:33
*** crushil has joined #openstack-ansible04:33
*** acormier has joined #openstack-ansible04:34
*** crushil has quit IRC04:39
cloudnulltake care boxrick1, ttyt04:39
*** crushil has joined #openstack-ansible04:41
*** lucas_ has joined #openstack-ansible04:49
*** drifterza has joined #openstack-ansible04:52
*** lucas_ has quit IRC04:52
*** acormier has quit IRC04:52
*** lucas_ has joined #openstack-ansible04:53
*** haasn has quit IRC05:00
*** lucas_ has quit IRC05:01
*** haasn has joined #openstack-ansible05:05
*** shausy has joined #openstack-ansible05:09
*** adrian_otto has joined #openstack-ansible05:15
*** crushil has quit IRC05:16
*** crushil has joined #openstack-ansible05:16
*** lucas_ has joined #openstack-ansible05:17
*** lucas_ has quit IRC05:22
*** cmart has quit IRC05:23
*** shausy has quit IRC05:25
*** shausy has joined #openstack-ansible05:26
*** Jolrael has quit IRC05:53
*** Jolrael has joined #openstack-ansible05:57
*** phalmos has quit IRC05:58
*** Jack_Iv has joined #openstack-ansible05:58
*** MasterOfBugs has joined #openstack-ansible06:01
*** pramodrj07 has joined #openstack-ansible06:04
*** MasterOfBugs has quit IRC06:05
*** admin0_ has quit IRC06:10
*** kiriakos has joined #openstack-ansible06:12
*** crushil has quit IRC06:13
*** thorst_ has joined #openstack-ansible06:22
*** thorst_ has quit IRC06:27
*** Andrew_jedi has joined #openstack-ansible06:46
*** kiriakos has quit IRC06:47
*** unlaudable has joined #openstack-ansible06:47
*** sdake_ has quit IRC06:52
*** Oku_OS-away is now known as Oku_OS07:07
openstackgerritOmer Anson proposed openstack/openstack-ansible-os_neutron master: Implement Dragonflow deployment  https://review.openstack.org/39152407:07
*** jrobinson has quit IRC07:13
evrardjp[m]Good morning everyone07:15
*** adrian_otto has quit IRC07:20
*** adrian_otto has joined #openstack-ansible07:26
*** adrian_otto has quit IRC07:33
*** Andrew_jedi has quit IRC07:40
*** Jack_Iv has quit IRC07:44
*** Jack_Iv has joined #openstack-ansible07:45
*** esberglu has joined #openstack-ansible07:50
*** esberglu has quit IRC07:54
*** woodard has quit IRC08:00
*** admin0_ has joined #openstack-ansible08:11
*** pramodrj07 has quit IRC08:18
*** Jack_Iv has quit IRC08:21
*** thorst_ has joined #openstack-ansible08:23
*** thorst_ has quit IRC08:28
*** Andrew_jedi has joined #openstack-ansible08:31
*** fxpester has joined #openstack-ansible08:55
andymccrmgariepy: ive moved the nova CentOS gate to non-voting again, unfortunately its timing out about 50% of the time so merging things became impossible - we need to figure out the centos time discrepancy and then re-enable it as voting.08:59
*** rob0t_ has quit IRC08:59
* andymccr burns a goat at the altar of the gate-lords09:00
evrardjphaha09:04
*** kiriakos has joined #openstack-ansible09:04
kiriakosHi again there, on Yesterday's try I had an issue where machines could not access the default gateway of their internal subnet. They could ping the .2 IP though Which I suppose is the dnsmaq service? Subnet was like 10.30.1.0/24 Clients on 10.30.1.7&8 DG 10.30.1.1 (assigned by default by Openstack & not pingable), DHCP on 10.30.1.2 (pingable)09:05
*** admin0_ has quit IRC09:06
*** evilkry has quit IRC09:07
*** admin0_ has joined #openstack-ansible09:08
kiriakosSo far I understand that sort of traffic should becompletely handled by the neutron agent in the compute node but when pinging 10.30.1.1. tcpdump showed that ARPs were sent by .8 to discover .1's mac but no response was recorded at all.09:10
kiriakosThe Arpscame from the neutron linuxbridge interface09:13
*** sawblade6 has quit IRC09:14
*** sawblade6 has joined #openstack-ansible09:23
*** karimb has joined #openstack-ansible09:27
*** udesale__ has joined #openstack-ansible09:28
*** udesale has quit IRC09:30
*** skuda has joined #openstack-ansible09:34
*** udesale__ has quit IRC09:46
*** udesale has joined #openstack-ansible09:46
*** udesale has quit IRC09:46
*** hfu has quit IRC09:47
*** udesale has joined #openstack-ansible09:52
hachiHello,09:56
hachiI am trying to do ceph OSA integration on stable/newton. for ceph i am using this repo:09:56
hachihttps://github.com/ceph/ceph-ansible/tree/v2.1.509:56
hachiMy problem is that the ceph-common role checks the existing of keyring before it gets created!, this the error :09:57
hachihttp://paste.openstack.org/show/597516/09:58
hachiI am not sure whether this error is due to misconfiguration on my intergartion or in ceph-ansible itself, here is how my user_ceph.yml user variables looks:09:59
*** evilt0ne has quit IRC09:59
hachihttp://paste.openstack.org/show/597517/09:59
hachiany idea ?10:00
*** thorst_ has joined #openstack-ansible10:24
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/mitaka: Add dummy tox config to workaround bad CI config  https://review.openstack.org/42867710:24
andymccrhachi: i dont think any ceph experts are online atm! So you might get more assistance later on - in master we have an integrated ceph build - you may be able to gather some ideas from there, and some info about the required config: https://github.com/openstack/openstack-ansible/commit/06ede41645550b1260f0c457aeca7ab7feffe91810:26
odyssey4meandymccr I'm finding more and more of those rogue jobs on the mitaka branch10:26
odyssey4mejmccrory ^10:26
odyssey4metrying to figure it out10:27
hachiandymccr thank you for your response, i will review the link you mentioned and come back later on.10:29
*** thorst_ has quit IRC10:29
andymccrodyssey4me: thanks! yeah i noticed the neutron one, meant to put in a patch to just dummy it for now10:29
openstackgerritMerged openstack/openstack-ansible-security master: Configure pam_faildelay on Ubuntu  https://review.openstack.org/42689210:29
odyssey4meandymccr like this one? https://review.openstack.org/#/c/428677/10:29
andymccrhachi: sorry about that :) but that should help because that gate on master is working and passing!10:29
andymccrodyssey4me: yeah exactly! maybe thats the simplest way10:29
odyssey4mesure, we can implement patches like those for now while we work out the CI stuff, if we ever do10:30
*** udesale__ has joined #openstack-ansible10:30
andymccrodyssey4me: yeah part of me thinks so few patches go in its not worth risking messing up master/the work involved in untangled that spaghetti web10:31
odyssey4meyeah, agreed10:31
odyssey4meandymccr this one is an easy fix though: https://review.openstack.org/42867510:32
hachiandymccr Ok then :), i think it would be good if i can test the intergation on the master then on the stable/newton branch10:32
*** udesale__ has quit IRC10:33
openstackgerritMerged openstack/openstack-ansible-galera_server master: Update galera running check for CentOS  https://review.openstack.org/42693410:33
andymccrhachi: yeah id recommend using stable/newton now, but it should help to get it going on stable/newton :)10:33
*** udesale has quit IRC10:33
hachiOk i will review and apply directly on stable/newton10:34
odyssey4mehachi you oculd try that, although then you'd have to maintain your fork10:36
odyssey4meI think andymccr meant that all the settings needed are there and you can learn from them.10:36
andymccryeah ^ that :)10:37
odyssey4meandymccr are there any patches that need reviews for the RC?10:38
andymccrodyssey4me: not atm, basically the one is merging now (centos7 moved to non-voting)10:39
andymccrthen i just need to update the rc patch for the os_nova sha and then it'll need a reeview10:39
andymccr*review10:39
andymccrtested it manually and it works so hopefully that'll be all good :)10:39
odyssey4meyeah, I see mhayden put in https://review.openstack.org/428560 and https://review.openstack.org/428561 to try and speed up the infra job10:40
odyssey4meI think that's an important thing to do regardless - a deployment should only use the mirror it has configured, not some random mirror from elsewhere.10:41
hachiodyssey4me so by maintaining the fork you mean cloning the appropriate ceph roles that works with stable/newton instead of master OSA, right ? :)10:41
odyssey4mehachi if you use the patch from master you would have to cherry-pick it to your fork of the github repo10:41
andymccrodyssey4me: ahh i see. thanks mhayden :D lets give it a go10:41
odyssey4mefrom then on in order to get updates for newton you'd have to maintain that10:42
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Disable yum fastestmirror plugin  https://review.openstack.org/42856010:44
*** hw_wutianwei has quit IRC10:44
hachi odyssey4me Ah got it now. for now i will just work on getting the deployment right on a testing environment, based on that i will try to adjust it for somthing easy to maintain on production10:46
odyssey4mehmm, I think I have the bug in the CI config andymccr10:47
openstackgerritPedro Magalhães (pjm6) proposed openstack/openstack-ansible-os_cinder stable/newton: [DOCS] Adding configuration for use Dell EQLX in cinder  https://review.openstack.org/42868710:47
odyssey4meI can put in a test patch to validate10:47
odyssey4meI think the first inclusion is getting a broader inclusion from https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L328710:48
odyssey4meso lemme try and remove the liberty/mitaka branches from there to see what happens10:48
openstackgerritPedro Magalhães (pjm6) proposed openstack/openstack-ansible-os_cinder master: [DOCS] Adding missing config parameter of Dell EQLX in cinder  https://review.openstack.org/42868810:50
pjm6good morning all10:51
*** stuartgr has joined #openstack-ansible10:55
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Copy over fastestmirror configuration  https://review.openstack.org/42856110:55
pjm6I'm using cinder with dell eqlx volume driver10:57
pjm6for some reason, when I create an instance booted with volume, sometimes works and sometimes not10:58
pjm6here is the logs of a success and failure operation10:58
pjm6succcess: pastebin.com/WgV9SJ6P10:58
pjm6failure: pastebim.com/sEZcwUpw10:59
pjm6it seems that for some reason, he cannot found image from glance10:59
pjm6odyssey4me: could you take a look when you have time?11:00
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_designate master: Enable current Designate services  https://review.openstack.org/42781011:00
odyssey4meandymccr I think we should get this in before we release os_designate: https://review.openstack.org/42690411:00
odyssey4mepjm6 what glance store is configured?11:01
odyssey4meare you using ceph, swift, or file?11:01
pjm6odyssey4me: is file11:01
openstackgerritMerged openstack/openstack-ansible-os_cinder master: [DOCS] Adding missing config parameter of Dell EQLX in cinder  https://review.openstack.org/42868811:01
odyssey4medo you have more than one infra server?11:01
pjm6and i'm not using NFS11:01
pjm6yes11:01
odyssey4mewell, that's the problem right there11:01
pjm6hmmm, there is only in one server11:01
pjm6and as I don't have NFS11:01
pjm6he fails?11:01
odyssey4methe LB will send the request to one of three glance stores11:01
odyssey4meonly one will have the image, as there is no shared or replicated store11:01
odyssey4meso one of three requests will fail11:02
odyssey4meso best to implement a shared store, or a replicated store11:02
odyssey4meit doesn't have to be NFS - it can just be the folder mounted via any means11:03
pjm6hmm I see11:03
pjm6i will see you do a replicated store11:03
odyssey4meI have often thought about putting a little hack in similar to the repo server11:03
pjm6(for now i'm doing tests with storage, so I suposse that will be more easy to do)11:03
pjm6odyssey4me: for having one place with all files, right?11:04
odyssey4meyep11:04
odyssey4meso basically setup a LUN on your Dell storage, then mount that LUN from each of your glance containers11:04
odyssey4meyou'll have to move the existing data over11:04
odyssey4mebut that's your simplest option right now11:05
drifterzaswift/ceph for me is best for glance11:05
drifterzaHey Jesse, could you give this another pass ? https://review.openstack.org/#/c/397313/11:08
pjm6odyssey4me: that should do manually of I could use OSA to do that?11:08
pjm6drifterza: I don't have ceph :\11:08
*** yolanda has quit IRC11:08
drifterzaoh so you're not going to do object storage at all ?11:08
pjm6drifterza: no, for now the aim is just to use Block Storage11:09
openstackgerritMerged openstack/openstack-ansible-os_cinder stable/newton: [DOCS] Adding configuration for use Dell EQLX in cinder  https://review.openstack.org/42868711:09
openstackgerritMerged openstack/openstack-ansible-os_nova master: Add nova-placement-api service and cell_v2 setup  https://review.openstack.org/41845711:09
odyssey4mepjm6 can you backport https://review.openstack.org/428688 to newton quickly please11:09
pjm6suer11:09
pjm6sure11:09
drifterzayeah well then the only options is NFS or sharing the same lun11:09
odyssey4mepjm6 you'd need to do it manually11:09
openstackgerritPedro Magalhães (pjm6) proposed openstack/openstack-ansible-os_cinder stable/newton: [DOCS] Adding missing config parameter of Dell EQLX in cinder  https://review.openstack.org/42869511:10
evrardjpplacement-api service merged \o/11:10
odyssey4mepjm6 technically I think the store is bind-mounted to the hosts anyway, so you can pre-setup the mount on the host11:10
*** yolanda has joined #openstack-ansible11:10
pjm6btw: but sharing the same lun using iSCSI will not have concurrency problems?11:10
odyssey4meandymccr figure out the bug in the CI jobs :) https://review.openstack.org/42869111:11
odyssey4mepjm6 you will have to ensure that the lun can be mounted by multiple hosts11:11
drifterzapjm6: it only hurts when you have concurrent writes to the same files on the lun11:11
drifterzabut glance is read-only no ?11:11
odyssey4meglance itself will not write to the same file from multiple sources11:11
pjm6thanks odyssey4me, drifterza11:11
andymccrodyssey4me: nice!11:11
pjm6oh its only in the same file?11:11
odyssey4meglance writes snapshots and when you upload images11:12
pjm6I was thinking that was not regarding any  file11:12
*** hfu has joined #openstack-ansible11:13
pjm6btw: do you know where the images are stored by default?11:13
openstackgerritAndy McCrae proposed openstack/openstack-ansible master: Fix SHA's for rc1 + SHA bump  https://review.openstack.org/42821211:13
drifterzausually /var/lib/glance/images11:13
pjm6thanks drifterza, thats its =)11:14
drifterzaor in the venv11:14
drifterzaah cool11:14
drifterza;)11:14
*** hfu has quit IRC11:16
odyssey4meandymccr I think we should also make sure this one goes in for the release: https://review.openstack.org/42781011:16
*** sdake has joined #openstack-ansible11:18
andymccrodyssey4me: its getting close to time - im not sure we can wait that long, it can just go in rc2 surely?11:20
odyssey4meyeah, it can11:24
odyssey4measettle or spotz another vote for https://review.openstack.org/428695 would be good11:25
boxrick1Is OSA still in an odd state of flux? Seeing errors like this on stable/newton https://gist.github.com/boxrick/b3ce22bd4bb577fb051257b465e1f15511:25
evrardjpboxrick1: this error looks like your ansible deploy node couldn't get an url11:26
evrardjpcan your deploy node connect to http://10.29.236.200:8181/venvs/14.0.7/ubuntu/keystone-14.0.7-x86_64.checksum ?11:27
*** Jack_Iv has joined #openstack-ansible11:27
odyssey4meandymccr we're still missing the patch that overrides the URL for the config_template URL for the policy files11:27
boxrick1Seems not evrardjp11:27
andymccrodyssey4me: yeah i know - ive only had time to fix the nova stuff - that will also have to wait for rc211:27
asettleodyssey4me: kk11:28
odyssey4meta asettle11:28
evrardjpboxrick1: well if you can't curl http://10.29.236.200:8181/venvs/14.0.7/ubuntu/keystone-14.0.7-x86_64.checksum from your deploy node, that's your issue :p11:28
evrardjpthe reason is a different thing11:28
boxrick1Ok cheers :)11:28
evrardjpis the file present in your repo, can you deploy node connect to this network, etc...11:29
evrardjpI don't know your config, so hard to guess :p11:29
*** hfu has joined #openstack-ansible11:30
boxrick1Ill figure this one out, was more just wondering how things were generally so I wasn't chasing my own tail.11:30
openstackgerritMerged openstack/openstack-ansible-os_cinder stable/newton: [DOCS] Adding missing config parameter of Dell EQLX in cinder  https://review.openstack.org/42869511:30
*** sdake_ has joined #openstack-ansible11:43
openstackgerritMerged openstack/openstack-ansible-os_designate master: Configure pools.yaml inside Designate role  https://review.openstack.org/42690411:43
openstackgerritMerged openstack/openstack-ansible master: Implementation Neutron SR-IOV  https://review.openstack.org/41590911:45
openstackgerritAndy McCrae proposed openstack/openstack-ansible-tests master: Remove work-around for reserved_host_disk_mb bug  https://review.openstack.org/42870511:46
*** sdake has quit IRC11:46
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova master: Implementation Neutron SR-IOV  https://review.openstack.org/41590711:46
odyssey4mewow, these CentOS jobs do rather take their time11:52
*** hfu has quit IRC11:53
pjm6odyssey4me: when the creation of a instance fails (nova service) and there's not error logs in any of the compute nodes and storage node11:54
pjm6and not even in the nova scheduler11:54
pjm6where's the next step I could use?11:54
*** pmannidi has quit IRC11:54
pjm6well i think i found it nova conductor11:56
*** Hosam has joined #openstack-ansible11:56
*** crushil has joined #openstack-ansible11:56
*** Hosam_ has joined #openstack-ansible11:57
odyssey4meargh, it would seem that we allowed a breaking change to merge into stable/newton: https://review.openstack.org/#/q/I817ff372c2d58e999a89496fce3d25dc617216f011:58
odyssey4mealso, palendae we may have an inventory bug? http://lists.openstack.org/pipermail/openstack-operators/2017-February/012573.html11:58
odyssey4mepjm6 yep, nova has many moving parts11:59
pjm6yeah odyssey4me, and the error is so generic :\11:59
pjm6it says11:59
pjm6No valid host was found. Tehre are not enough hosts avaiable11:59
pjm6but i have a compute node that only has 1 vm11:59
pjm6and 1 vcpu used from 4 :|12:00
*** Hosam has quit IRC12:01
*** rob0t_ has joined #openstack-ansible12:02
pjm6there exist a VCPU limit?12:04
pjm6in this case, i can exceed the vcpus used12:05
*** jwitko has quit IRC12:06
*** rob0t_ has quit IRC12:07
*** jwitko has joined #openstack-ansible12:08
odyssey4meyou'd have to debug the scheduler to see why12:09
odyssey4methe limits are typically cpu, ram or disk12:09
odyssey4meother reasons could be that it's wanting a specific hardware profile and not finding it12:10
pjm6I think that could be problem with vcpu ratio12:10
pjm6the other compute node I saw that have insufficient ram :\12:10
odyssey4meyou can mess with the ratio's - they're set in nova.conf12:11
pjm6yeah i was seeing this config12:11
pjm6http://docs.openstack.org/developer/openstack-ansible-os_nova/12:11
pjm6and to update i only need to run setup-nova.conf --tags nova-config ?12:11
odyssey4meyeah, that should do the trick12:13
pjm6thanks odyssey4me12:14
pjm6reading the compute scheduler make senses why is not creating12:14
pjm6the default cpu_allocation_ratio is 2.0 in OSA12:15
pjm6i have 4vcpu in the compute node that have available ram12:15
pjm6so the limit is 8 VMs12:15
*** rob0t_ has joined #openstack-ansible12:17
*** esberglu has joined #openstack-ansible12:18
*** rob0t_ has quit IRC12:21
*** Jack_Iv_ has joined #openstack-ansible12:22
*** esberglu has quit IRC12:22
*** Jack_Iv has quit IRC12:23
*** rob0t_ has joined #openstack-ansible12:23
*** DanyC has joined #openstack-ansible12:27
*** sdake has joined #openstack-ansible12:27
*** rob0t_ has quit IRC12:28
*** mcrafty has quit IRC12:29
*** mcrafty has joined #openstack-ansible12:29
*** sdake_ has quit IRC12:30
*** Jack_Iv_ has quit IRC12:33
*** Jack_Iv has joined #openstack-ansible12:35
Andrew_jediFolks, have you tried deploying OpenStack on OpenStack VMs. Were you able to get internet connectivity on the instances?12:35
*** thorst_ has joined #openstack-ansible12:37
*** Jack_Iv_ has joined #openstack-ansible12:40
*** schwicht has joined #openstack-ansible12:41
*** Jack_Iv has quit IRC12:42
*** Jack_Iv_ has quit IRC12:44
*** Jack_Iv has joined #openstack-ansible12:49
*** drifterza has quit IRC12:49
*** Jack_Iv has quit IRC12:49
*** Jack_Iv has joined #openstack-ansible12:49
*** rob0t_ has joined #openstack-ansible12:52
evrardjpAndrew_jedi: I guess it depends on the VM and the network12:55
andymccrodyssey4me: hughsaunders any other cores around: would appreciate a +2w https://review.openstack.org/#/c/428212/12:55
evrardjpfor example, in a default OpenStack network, you are not allowed to have multiple mac addresses behind a port, which makes things harder12:56
evrardjpso it's hard to say without knowing a little more12:56
evrardjpandymccr: ok12:56
*** rob0t_ has quit IRC12:57
odyssey4meandymccr done12:57
evrardjpandymccr: don't want to bring the latest? It has some release notes issue fixing for keystone, not that it really matters12:58
odyssey4meevrardjp that'll come in the next rc12:59
evrardjpnaturally :p12:59
spotzI got beat to the DOC one, but got to +2 and workflow one of cloudniull's I was waiting on jenkins for:)12:59
*** kiriakos_ has joined #openstack-ansible12:59
*** kiriakos has quit IRC12:59
logan-wonder why ceph failed tempest on the sha bump one :/12:59
*** askb has quit IRC12:59
andymccrevrardjp: yeah the gate will take 3+ hours if i make a change (assuming it will not time out) - id rather not make changes unless they are critical, anything missing can go in rc213:00
odyssey4meoanson evrardjp I see that https://review.openstack.org/391524 is failing the tests, any idea whether we'll get resolution for that soon?13:00
oansonodyssey4me, I am working on it - currently I am trying to get AIO pass tempest13:00
andymccrim mostly just glad we got the placement stuff in and were able to sha bump on ceilometer.13:01
oansonAs a quick fix, I can add the failing tests to the skip-list13:01
odyssey4meoanson ok, great - I just wanted to make sure that we're still on top of it13:01
odyssey4meoanson if you'd like dragonflow included in the ocata release, then I'd advise that13:01
oansonYes. The deployment issue if my first priority, currently.13:01
odyssey4methat'll buy time to figure out the fixes and implement them one at a time, with backports13:02
oansonYes.13:02
oansonSome of these issues are real dragonflow issues.13:02
evrardjpI think we all agree13:02
evrardjpoanson: yes, because it used to pass, and at one point (hack week in dragonflow before feature freeze?) it stopped working13:03
odyssey4meok, so in my mind if it deploys and all the services are running, that's good enough for the feature to land in an experimental status13:03
odyssey4meeverything that comes after that is a bug fix13:03
oansonI'll definitely get it done by the beginning of next week. I'll try today, but I can't promise13:03
evrardjpodyssey4me: we have to remember that we depend on upstream, so if the deploy itself works, we could consider it as "ok to integrate"13:03
odyssey4meevrardjp yep, that's what I mean13:03
evrardjpok13:04
*** rob0t_ has joined #openstack-ansible13:04
odyssey4meoanson it'll be up to andymccr if we can allow it to be ported back to ocata if it doesn't make the branch cut which will be happening this week or next13:04
evrardjpalso the docs change can be done later, and logan- and I had about the same way to configure it13:04
evrardjpso the review of the docs gonna be easy13:04
odyssey4meconsidering this is an opt-in feature, I would support a backport personally13:05
evrardjpintegration in OSA main directly shouldn't be that hard13:05
logan-ping me if you need a hand wiring up stuff to the AIO oanson. i will be around most of the day13:05
oansonThanks. I'll do my best.13:07
mgariepymorning everyone !13:08
*** rob0t_ has quit IRC13:09
openstackgerritMarc Gariépy proposed openstack/openstack-ansible master: [WIP] Add CentOS support for AIO setup  https://review.openstack.org/40769013:11
mgariepyandymccr, sad for nova.13:11
mgariepydid your goat thing fixed the issue ? haha13:12
*** rob0t_ has joined #openstack-ansible13:12
andymccrmgariepy:  yeah :( it was just becomming impossible to get anything merged in when it needs 2 x successful gates and 50% chance on either!13:12
mgariepyyeah I understand.13:12
andymccrive asked mhayden to take a look at the gate times for CentOS to see if we can do something. also the infrastructure is quite random, sometimes its fast (45 mins or so) and passes no problem, others its timing out.13:13
mgariepywhile it's 45 minutes for centos it's mostly only 30 for ubunut..13:13
andymccrhoping to use ara to debug that a bit13:16
*** rob0t_ has quit IRC13:16
mgariepyon centos I started to see a lot of warning in ansible.13:17
mgariepyle ssh connection gets closed and it needs to re-open it.13:17
mgariepyevery time it happens it take like a second.13:18
odyssey4memgariepy not sure if this will help, but perhaps we should try and get the lxc compilation to be packaged13:18
mgariepylxc-compile is not that long.13:18
odyssey4melast I discussed it with cloudnull he said the packages available did not have the same CLI options13:18
mgariepythe version compiled is like 1.x13:18
odyssey4mehmm, bad ssh connections - that's weird13:19
mgariepyalso the ceilometer restart failing takes 5 minutes.13:19
odyssey4meargh13:19
mgariepyceilomter-collector13:19
mgariepyboth ubuntu and centos.13:19
mgariepyfor the ocata release, i've looked up as far as I could, and it was like that back december also.13:20
*** Jack_Iv has quit IRC13:20
*** rob0t_ has joined #openstack-ansible13:22
odyssey4memgariepy yeah, I remember discussion about it13:24
odyssey4meI think even for the newton release we struggled with it13:25
mgariepynewton is ok today.13:25
*** jheroux has joined #openstack-ansible13:26
*** rob0t_ has quit IRC13:26
mgariepyevery tasks on centos takes longer lol13:27
mgariepyhttp://logs.openstack.org/74/426774/1/check/gate-openstack-ansible-os_nova-ansible-func-centos-7-nv/9a3d80a/logs/ara/playbook/127f5ae2-c39a-4aa1-a89a-da620cfa75aa/index.html#plays13:27
mgariepyhttp://logs.openstack.org/74/426774/1/check/gate-openstack-ansible-os_nova-ansible-func-ubuntu-xenial/4de7d45/logs/ara/playbook/9e85d19a-bca4-442f-87cb-0b04b1c1dbcf/index.html13:27
mgariepyexceot destroy container haha13:28
mgariepyfor obvious reason.13:28
openstackgerritMerged openstack/openstack-ansible-os_nova master: Implementation Neutron SR-IOV  https://review.openstack.org/41590713:29
mgariepyis there a reason why both tests don't run on the same hardware ?13:29
mgariepythe flavor is the same but the cpu aren't.13:29
*** markvoelker_ has joined #openstack-ansible13:29
Andrew_jedievrardjp: I have a 4 node setup. Controller, Compute, Network and Cinder nodes in OpenStack VMs. All VMs have two NICs, ens3 and ens4. I am using vxlan for configuring all the OSA bridges and all the  bridge traffic is passing through "ens3" except for br-vlan. The br-vlan is configured on Network and Compute node. vxlan and Flat network are used. On the Network node i have used allowed...13:30
Andrew_jedi...address pair to allow "0.0.0.0/24".13:30
andymccrmgariepy: i think it depends which cloud provider you get - so its kinda a "luck" thing sometimes :/13:30
mgariepy2017-02-03 13:30:28.890698 |  [WARNING]: sftp transfer mechanism failed on [172.29.236.100]. Use13:30
mgariepy2017-02-03 13:30:28.890780 | ANSIBLE_DEBUG=1 to see detailed information13:30
mgariepythat's the issue I have on centos.13:31
*** crushil has quit IRC13:32
*** markvoelker has quit IRC13:32
Andrew_jedievrardjp: Instance MTU is 1350, here is the network configuration http://paste.openstack.org/show/597559/13:32
mgariepydo you have a aio running on ubuntu ?13:32
mgariepywhat is brctl show like ?13:32
*** woodard has joined #openstack-ansible13:33
*** hfu has joined #openstack-ansible13:33
*** hfu has quit IRC13:33
*** rob0t_ has joined #openstack-ansible13:34
*** woodard has quit IRC13:34
odyssey4meall cores, please see http://lists.openstack.org/pipermail/openstack-dev/2017-February/111585.html13:34
*** woodard has joined #openstack-ansible13:34
mgariepyomg, didn't expect that :D13:35
Andrew_jedievrardjp: Some more info about namespaces and neutron http://paste.openstack.org/show/597560/13:38
*** rob0t_ has quit IRC13:39
asettlemgariepy: I think that means that odyssey4me likes you :p13:39
asettle+1 from me dude :)13:40
mgariepyhehe13:40
*** rob0t_ has joined #openstack-ansible13:42
*** wdirons has quit IRC13:43
evrardjpyeah +1 ofc13:43
andymccrhmm that ceilometer collector thing is interesting - its not happening like that in role gate.13:43
andymccrit seems to get a shutdown that takes ages and then it starts up again13:43
mgariepyyeah on the ceilometer tests it's ok,13:44
mgariepydifference is that all ceilometer runs in the same container on that check13:44
andymccrmgariepy: ahh - true. well reading their docs we should be running ceilometer on the hosts themselves. i think this role needs a bit of a refresher13:45
andymccr*compute-hosts13:45
andymccrthe polling agent at least13:45
*** Jolrael has quit IRC13:46
mgariepymaybe it's an order thing.13:46
*** rob0t_ has quit IRC13:47
*** Jolrael has joined #openstack-ansible13:47
andymccri think we do need a way to set an order for restarts, this may be an example of that.13:48
*** Hosam_ has quit IRC13:49
odyssey4meandymccr yeah, that's going to become more and more important for services that have multiple daemons13:50
odyssey4meit's definitely a requirement for doing rolling upgrades in nova13:50
logan-https://github.com/ceph/ceph-ansible/commit/40a2df5bbf13685c83ddc0b784b97e8a76414006 ceph-ansible just started doing some handler serialization this week, the delegation stuff there might work as a stopgap until ansible can get serialization as a task level parameter13:52
*** crushil has joined #openstack-ansible13:53
logan-but I guess that's not gonna happen looking at https://github.com/ansible/ansible/issues/1217013:53
fxpesterhi all, my dib started to act strange, it is not taking variables in work anymore13:54
*** esberglu has joined #openstack-ansible13:54
fxpesterI run `export DIB_YUM_REPO_CONF=redhat.repo && /usr/bin/disk-image-create`but it says `no repo file passed`13:55
fxpesterand I run dib with -t raw, yet it is generating qcow2 for me13:55
fxpesterand I pass image name rhel_ironic, but output images named image.*13:56
fxpesterhow can it be ?:D13:56
*** rob0t_ has joined #openstack-ansible13:56
*** kberger has joined #openstack-ansible13:56
*** esberglu has quit IRC13:59
*** crushil has quit IRC14:00
*** rob0t_ has quit IRC14:01
*** nbante has joined #openstack-ansible14:02
*** rob0t_ has joined #openstack-ansible14:06
*** wdirons has joined #openstack-ansible14:07
*** cathrichardson has joined #openstack-ansible14:08
*** drifterza has joined #openstack-ansible14:09
fxpesterI feel like is it a bug in element `rhel `14:09
*** rob0t_ has quit IRC14:10
*** jwitko has quit IRC14:10
*** cathrich_ has quit IRC14:11
fxpesteror not14:11
*** crushil has joined #openstack-ansible14:12
fxpester`/usr/bin/disk-image-create --install-type package --ramdisk-element dracut-ramdisk -x -x -t -o rhel6_ironic -p lvm2 -c rhel baremetal dhcp-all-interfaces rhel-common`14:12
*** rob0t_ has joined #openstack-ansible14:12
cloudnullmornings14:12
fxpester2017-02-03 09:11:34.806 ERROR diskimage_builder.element_dependencies [-] Element 'rhel6_ironic' not found in '/usr/bin/../share/diskimage-builder/elements'14:12
cloudnullfxpester: you running this w/ openstack-ansible ?14:13
cloudnullmaybe see if there were changes in DIB in #openstack-dib ?14:13
fxpesterepic fail, whole time the wrong channel)14:13
cloudnullit happens :)14:13
*** jwitko has joined #openstack-ansible14:13
*** gouthamr has joined #openstack-ansible14:14
*** jperry has joined #openstack-ansible14:14
*** strattao_ has joined #openstack-ansible14:15
*** rob0t_ has quit IRC14:17
odyssey4mecloudnull jamesdenton BjoernT logan- nice to see the SRIOV work merged now14:18
odyssey4meit'd be super-great to somehow get an external-CI test for it14:18
*** McMurlock1 has joined #openstack-ansible14:19
odyssey4meI wonder if adreznec / kylek3h_away could make that happen ;)14:20
*** drifterza has quit IRC14:20
logan-would be good to add to the ptg agenda to discuss during that osic ci item. iirc that is going to be bare metal14:20
*** Jack_Iv has joined #openstack-ansible14:21
odyssey4melogan- ah, good point - it might be possible for that team to extend their CI tests beyond just upgrades14:21
odyssey4meluzC ^14:21
*** rob0t_ has joined #openstack-ansible14:22
*** TxGirlGeek has joined #openstack-ansible14:22
*** bauruine has joined #openstack-ansible14:24
*** Jack_Iv has quit IRC14:25
*** rob0t_ has quit IRC14:27
openstackgerritMerged openstack/openstack-ansible master: corrected infra wheel mirror URL  https://review.openstack.org/42855814:28
odyssey4meI would recommend that we hold back any integrated build rechecks/+w's until https://review.openstack.org/428212 merges14:28
odyssey4meotherwise andymccr is going to have a very, very late night14:28
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/newton: corrected infra wheel mirror URL  https://review.openstack.org/42876014:29
odyssey4mejmccrory ping me when you're around to chat about the mitaka tests14:29
*** esberglu has joined #openstack-ansible14:31
*** esberglu has quit IRC14:31
*** esberglu has joined #openstack-ansible14:32
openstackgerritAndy McCrae proposed openstack/openstack-ansible master: Fix SHA's for rc1 + SHA bump  https://review.openstack.org/42821214:32
*** rob0t_ has joined #openstack-ansible14:32
*** esberglu_ has joined #openstack-ansible14:33
mgariepygathering fact with a 300 router deployed is quite long.. on neutron-agent..14:35
*** jperry has quit IRC14:36
*** esbergl__ has joined #openstack-ansible14:37
*** rob0t_ has quit IRC14:37
*** esberglu has quit IRC14:37
*** esberglu has joined #openstack-ansible14:38
*** esberglu_ has quit IRC14:38
*** shausy has quit IRC14:39
odyssey4memgariepy haha, yeah14:39
odyssey4meif we don't need the facts, maybe more filtering is needed14:39
cloudnullmgariepy: yea I've seen that be miserable in the OSIC.14:40
mgariepyhaha14:40
cloudnullthough I've not tackled how to solve it14:40
odyssey4mewe can filter the fact gathering - the question is whether the facts are needed for the role execution14:41
*** esbergl__ has quit IRC14:41
*** esberglu_ has joined #openstack-ansible14:41
mgariepycan we filter like get eth? info but not tap and other stuff like that ?14:42
odyssey4memgariepy filter may not improve speed, but gather_subset may: http://docs.ansible.com/ansible/setup_module.html14:43
odyssey4meI think the filter gathers them, then filters the return14:43
odyssey4mewhereas gather_subset filters the request for facts14:43
evrardjpI didn't follow your conversation but if facts suck, just use another fact system or make your own facts :p14:44
odyssey4mecurrently we do reduce the subset: https://github.com/openstack/openstack-ansible/blob/master/scripts/openstack-ansible.rc#L3214:44
*** esberglu has quit IRC14:44
adreznecevrardjp: are you saying we should gather alternative facts?14:44
odyssey4mebut maybe it could be reduced more14:44
odyssey4mehahaha adreznec14:44
odyssey4meadreznec any possibility for the IBM CI tests to report back as an external CI?14:45
odyssey4me(and perhaps to have an SRIOV scenario)?14:45
*** lucas_ has joined #openstack-ansible14:45
adreznecHmm yeah, that's something we've been meaning to switch over from the PowerVM side14:46
adreznecHave gotten a bit constrained on CI resources since we're running double CI for Nova now (out-of-tree and in-tree)14:46
adreznecNone of our CI hardware has SRIOV in it today though14:46
odyssey4meadreznec any feedback is good, even if it comes after merge14:47
*** rob0t_ has joined #openstack-ansible14:48
adreznecodyssey4me: I'll have to sync up with some of the other Power CI maintainers internally, see if any of them have SRIOV capable hardware14:48
odyssey4methanks adreznec14:49
odyssey4mejust powervm feedback would be nice though :)14:49
adreznecodyssey4me: But yeah, we'll definitely look at getting the powervm driver feedback publish externally14:49
adreznecI'll hit up the guys who were working on that and hopefully have things to report in Atlanta14:50
openstackgerritMerged openstack/openstack-ansible-os_horizon stable/mitaka: Use same branch for upper constraints when testing  https://review.openstack.org/42829714:50
openstackgerritMerged openstack/openstack-ansible-rsyslog_server master: Add Vagrantfile to allow for easier testing  https://review.openstack.org/42833214:50
Mr_Smurfcloudnull: OPENSTACK_KEYSTONE_URL is apperently used as default region when multiple regions are configured (bug 1660344)14:51
openstackbug 1660344 in openstack-ansible "OPENSTACK_KEYSTONE_URL missing when horizon_available_regions is defined." [Undecided,New] https://launchpad.net/bugs/166034414:51
cloudnullMr_Smurf: hum, is that newton ?14:53
Mr_Smurfcloudnull: yes14:54
Mr_Smurfcloudnull: I added a comment in the bug with some more logs14:54
cloudnullI've a multi-region mitaka cloud up and i dont think i've had an issue with that but I remember there being some changes in newton for horizon and maybe this is one of them14:54
*** rob0t_ has quit IRC14:56
Mr_Smurfcloudnull: if you look at the code on line 101 https://github.com/openstack/django_openstack_auth/blob/stable/newton/openstack_auth/forms.py#L10114:59
Mr_Smurfcloudnull: you can see that it fetches OPENSTACK_KEYSTONE_URL before fetching the list of AVALIABLE_REGIONS15:00
openstackgerritRick Box proposed openstack/openstack-ansible-ops master: Adds in network config - removes hardcoded values  https://review.openstack.org/42877015:00
*** chris_hultin|AWA is now known as chris_hultin15:01
*** whiteveil has joined #openstack-ansible15:01
mhaydenandymccr: i'm off today, but i dug into some of the centos stuff last night15:01
*** weezS has joined #openstack-ansible15:01
mhaydenfastestmirror could be part of it, but cloudnull noted that we might not be using the best yum mirrors for the gate jobs15:01
*** pjh03 has joined #openstack-ansible15:01
odyssey4memhayden we're using whatever infra gives us15:02
odyssey4mewhich should be their mirrors15:02
*** klamath has joined #openstack-ansible15:02
mhaydenwhat's odd is that the tasks that don't use the network are fairly close in comparison w/ubuntu15:02
odyssey4mealthough I suppose we're adding  RDO and EPEL, so perhaps we need to also adapt the vars to ensure we use infra repositories for those15:02
mhaydenbut anything that uses the network (like pip / yum) is quite slow15:02
cloudnullodyssey4me: mhayden: there's not a tun of dev that happens on cent so I suspect that there's less caching within the cent image making some of the installation times slower15:02
mhaydenpossibly15:03
mgariepyrdo and epel is already installed.15:03
mhaydenbut we don't install that much from RDO/EPEL15:03
*** whiteveil has quit IRC15:03
*** rob0t_ has joined #openstack-ansible15:03
mhaydenthe bulk comes from standard centos/updates mirrors15:03
odyssey4mewell, that means that we should work with infra to improve that15:03
odyssey4meI'm sure the puppet and kolla communities would enjoy the fruits of that labour15:04
*** klamath has quit IRC15:04
*** klamath has joined #openstack-ansible15:04
mhaydenhopefully it's not too labourous15:05
mhaydenlabouring isn't my favourite15:05
mhaydenbut it can be a colourful activity15:05
* mhayden waits for it15:05
*** pjh03 has quit IRC15:06
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_horizon master: ensure OPENSTACK_KEYSTONE_URL is always configured  https://review.openstack.org/42877215:06
cloudnullMr_Smurf:15:06
cloudnull^15:06
Mr_Smurfcloudnull: I'm just checking one thing15:08
mgariepymhayden, Setting nodepool variablestakes 6 sec on centos while it takes only 2 on ubuntu.15:08
*** rob0t_ has quit IRC15:08
Mr_Smurfcloudnull: It could still be a bug in horizon...15:08
mhaydenthat's peculiar15:08
mgariepycentos-7-osic-cloud1-disk-7100150 vs ubuntu-xenial-osic-cloud1-s3700-7100115:09
*** smatzek has joined #openstack-ansible15:09
*** chris_hultin is now known as chris_hultin|AWA15:10
*** pcaruana has quit IRC15:11
logan-from what ive seen the osic disk vs ssd flavors run almost the same gate times fwiw15:11
*** acormier has joined #openstack-ansible15:11
mhaydeneven nova gates are 34m for ubuntu and > 65m for centos15:12
mhaydenthat's unusual15:12
Mr_Smurfcloudnull: it looks like a bug in horizon.. L101 should probably be getattr(settings, "OPENSTACK_KEYSTONE_URL", "Default Region")15:14
Mr_Smurfcloudnull: but the most simple solution for now is just to force it to be set anyway15:14
*** ssmith has joined #openstack-ansible15:15
*** pjh03 has joined #openstack-ansible15:15
Mr_Smurfcloudnull: well "Defalut Region" is still not a valid keystone URL so I dont know.. ;)15:17
*** pcaruana has joined #openstack-ansible15:17
*** ssmith_ has joined #openstack-ansible15:18
*** pjh03 has quit IRC15:19
*** rob0t_ has joined #openstack-ansible15:19
*** adrian_otto has joined #openstack-ansible15:20
*** ssmith has quit IRC15:21
*** marst has quit IRC15:21
*** strattao_ has quit IRC15:23
*** adrian_otto has quit IRC15:25
*** woodard has quit IRC15:25
*** rob0t_ has quit IRC15:26
luzCodyssey4me hello, yes, OSIC CI is on 22 baremetal nodes. I'm not very familiar with SRIOV, but let's talk about it on ptg and let me include dankolbrs and kvcobb on the loop15:27
*** strattao_ has joined #openstack-ansible15:28
*** whiteveil has joined #openstack-ansible15:28
*** chris_hultin|AWA is now known as chris_hultin15:29
*** strattao_ has quit IRC15:29
*** strattao_ has joined #openstack-ansible15:30
*** marc_ab has joined #openstack-ansible15:30
*** unlaudable has quit IRC15:33
luzCodyssey4me or before ptg :)15:33
*** rob0t_ has joined #openstack-ansible15:37
*** cmart has joined #openstack-ansible15:39
openstackgerritRick Box proposed openstack/openstack-ansible-ops master: Adds in proxy role - Ubuntu 16.04  https://review.openstack.org/42878215:39
*** marst has joined #openstack-ansible15:41
*** rob0t_ has quit IRC15:42
*** admin0_ has quit IRC15:43
*** DanyC has quit IRC15:43
*** unlaudable has joined #openstack-ansible15:48
openstackgerritMerged openstack/openstack-ansible stable/mitaka: Bump requirements SHA  https://review.openstack.org/42851115:48
*** rob0t_ has joined #openstack-ansible15:52
*** unlaudable has quit IRC15:54
*** whiteveil has quit IRC15:55
*** rob0t_ has quit IRC15:57
*** ssmith__ has joined #openstack-ansible15:58
*** unlaudable has joined #openstack-ansible15:58
*** whiteveil has joined #openstack-ansible16:02
*** ssmith_ has quit IRC16:02
openstackgerritLogan V proposed openstack/openstack-ansible master: Fix haproxy playbook group target  https://review.openstack.org/42878716:04
*** crushil has quit IRC16:06
*** rob0t_ has joined #openstack-ansible16:06
*** crushil has joined #openstack-ansible16:06
*** unlaudable has quit IRC16:07
*** sdake_ has joined #openstack-ansible16:08
*** fxpester has quit IRC16:08
*** sdake has quit IRC16:08
*** sdake has joined #openstack-ansible16:09
*** Andrew_jedi has quit IRC16:10
*** galstrom_zzz is now known as galstrom16:11
*** rob0t_ has quit IRC16:11
*** sdake has quit IRC16:12
*** sdake_ has quit IRC16:12
openstackgerritFrank Zhang proposed openstack/openstack-ansible-os_horizon master: Add retries for horizon venv download  https://review.openstack.org/42879416:14
*** pjh03 has joined #openstack-ansible16:16
jwitkohey guys16:17
jwitkois there a way to restart specific LXC containers without rebooting the host?16:17
jwitkoI've tried restarting them in the past but they don't seem to come up the exact way that openstack-ansible brings them up, not sure what I'm doing wrong16:17
*** dankolbrs has quit IRC16:17
*** pjh03 has quit IRC16:18
*** pjh03 has joined #openstack-ansible16:18
logan-lxc-attach -n <container> -- reboot or lxc-stop -n <container>; lxc-start -n <container> should work16:18
palendaejwitko: Can use ansible's ad hoc commands and groups to target them. https://thoughtstreams.io/palendae/openstack-ansible-tips-and-tricks/9015/16:18
*** Oku_OS is now known as Oku_OS-away16:18
jwitkothank you both!16:18
palendaeIf you're on Newton+ you can target the lxc_hosts group (though there's a bug in that group I'm working on)16:19
jwitkounfortunately this old ass cluster is on Kilo16:19
jwitkotrying to get it into shape for an upgrade16:19
*** dankolbrs has joined #openstack-ansible16:19
*** rob0t_ has joined #openstack-ansible16:19
*** unlaudable has joined #openstack-ansible16:19
palendaeAh16:20
palendaeYeah; you could probably pare the "hosts:is_metal" group down a bit by adding ":!nova_compute"16:20
palendaeAnd run your lxc command16:20
palendaeBash command loop in an ad hoc command is doable16:21
palendaeNot pretty, but doable16:21
jwitkothanks, appreciate it16:21
jwitkothis is just for a single container, wanted to make sure i was rebooting it correctly16:21
palendaeCool16:21
jwitkoi have a new compute node which is dropping connections to rabbitmq containers instantly16:21
palendaeYeah, logan's commands in an ad-hoc command (lxc-stop/start) should work16:21
jwitkothe only errors coming from rabbitmq are seen here http://cdn.pasteraw.com/izh0zi9bb4g291vr1wb2ug9tcojnnii16:22
*** Andrew_jedi has joined #openstack-ansible16:22
oansonHi. I found one issue with the dragonflow tests (os_neutron role) - the IP addresses in {{ neutron_local_ip }} is 127.0.0.1. Is there a way to get the container's management IP?16:23
oanson(For a file deployed inside the container?)16:24
*** unlaudable has quit IRC16:24
odyssey4meoanson that's supposed to be overridden by the playbook IIRC16:25
oansonIn the deployement created by tox, I'm looking at the file, and the final address is 127.0.0.116:25
*** unlaudable has joined #openstack-ansible16:26
*** rob0t_ has quit IRC16:26
oansonThe template takes it from {{ neutron_local_ip }}.16:26
jwitkopalendae, one more quick question:  is there a way to rebuild the inventory JSON file ?16:27
*** agrebennikov__ has joined #openstack-ansible16:27
andymccroanson: taking a look quick16:27
palendaejwitko: In kilo, execute playbooks/inventory/dynamic_inventory.py16:27
jwitkothanks16:28
oansonandymccr, thanks16:28
palendaeWell, in any series actually16:28
palendaeAnsible will call that file every time it runs16:28
palendaeBut you can do that generate stuff "out of band"16:28
*** adrian_otto has joined #openstack-ansible16:28
andymccroanson: is that set on localhost or one of the containers?16:29
logan-neutron-overrides-ovs.yml:neutron_local_ip: "{{ ansible_host }}"16:29
logan-i suspect we'll need something like that in the dragonflow test overrides16:29
logan-neutron-overrides-dragonflow.yml16:29
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_cinder master: re-added cinder_nfs_client for legacy support  https://review.openstack.org/42880216:29
jwitkopalendae, so its a little more complicated than that unfortunately.  So I have a running cluster but someone deleted the JSON file16:29
cloudnullandymccr: odyssey4me: ^16:30
jwitkoSo running dynamic inventory is generating a new one with new IP allocations and newly generated container names16:30
jwitkothis of course is no good16:30
palendaejwitko: Yikes16:30
jwitkois there any way to generate the JSON off an existing infrastructure?16:30
palendaeNot that I know of :(16:30
cloudnulljwitko: do you have the openstack_inventory.tar ?16:30
logan-jwitko: do you have /etc/openstack_deploy/backup_openstack_inventory.tar16:30
palendaeOh, right16:30
palendae^^16:30
cloudnullif so then there should be a running archive of all json files using the date stamp before the inventory was deleted.16:31
oansonlogan-, I'll try that. Thanks16:31
logan-no prob16:31
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_cinder master: re-added cinder_nfs_client for legacy support  https://review.openstack.org/42880216:32
palendaecloudnull: Is ^ in reference to http://lists.openstack.org/pipermail/openstack-operators/2017-February/012573.html ?16:32
jwitkocloudnull, logan-, palendae, thank you :)  that file exists and it just saved me a massive amount of time16:33
palendaejwitko: Phew!16:33
jwitkoyou guys are the best16:33
andymccrcloudnull: one comment (on patchset one)16:34
palendaejwitko: In terms of *both* those files missing, you'd have to generate a new JSON file and update the IPs manually16:34
jwitkoand the container names!16:34
jwitkobut this is awesome, thank you again16:34
*** ssmith__ has quit IRC16:34
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_nova master: [WIP] Combine package install tasks  https://review.openstack.org/42880616:34
*** rob0t_ has joined #openstack-ansible16:35
odyssey4meandymccr cloudnull personally, I think we could just push https://review.openstack.org/428802 to newton and leave master as-is?16:36
odyssey4methen the bug andymccr is mentioning should be sorted out in a separate patch perhaps16:36
palendaeIs that patch for the ML question?16:36
andymccrpalendae: partly16:36
odyssey4mebut yeah - actually maybe a newton/ocata deprecation would be good16:36
logan-nice change mhayden16:36
andymccrpalendae: its mostly to fix an issue that wa sintroduced by the multiple nfs support16:37
mhaydenlogan-: will be nice if it works :P16:37
logan-applying that security role pattern more places is cool16:37
andymccrbut also to address the fact we ltierally just changed how it works without any migration path16:37
palendaeandymccr: Ah; trying to determine if i need to do any spelunking on inventory for ti16:37
andymccrpalendae: i don't thinkso - i think what he's doing should be ok, although the main issue is there is no support for multiple backends. so once he moves to 14.0.8 (and this is fixed) it'll work better16:37
palendaeandymccr: Gotcha, thanks16:38
andymccractually odyssey4me i agree on the basis that the current method is massively broken16:38
andymccrif the current method worked nicely i would say put it in master and backport16:38
odyssey4meandymccr I'm confused.16:39
*** rob0t_ has quit IRC16:39
odyssey4meAre you saying it should be a master patch that fixes the lack of deprecation, and the lack of a working system in one go?16:40
odyssey4meOr are you saying there should be seperate patches for each issue?16:40
andymccrodyssey4me: we should push the patch to newton - and then add a second patch to master (to fix the shares issue), that gets backported16:40
odyssey4meah yes, makes sense16:40
*** unlaudable has quit IRC16:41
odyssey4meis it just me, or is gerrit slow as molasses16:41
cloudnullodyssey4me: andymccr: so what should I do ?16:41
cloudnullodyssey4me: its being slow16:41
openstackgerritFrank Zhang proposed openstack/openstack-ansible-os_horizon master: Add retries for horizon venv download  https://review.openstack.org/42879416:42
*** rob0t_ has joined #openstack-ansible16:42
andymccrcloudnull: well what are your thoughts? i mean we could leave it in master too - give people an extra cycle to change, but imo the old way is broken in anycase.16:42
mhaydenlogan-: i assumed in the nova role that the distro pkg install must be done before the pip install, but i could be wrong16:42
*** chyka has joined #openstack-ansible16:42
mhaydeni figured some pip modules might depend on certain pkgs16:42
*** weezS has quit IRC16:43
*** DanyC has joined #openstack-ansible16:44
cloudnulland i've been getting lp failures too.16:45
*** DanyC has quit IRC16:46
*** rob0t_ has quit IRC16:47
*** whiteveil has quit IRC16:50
*** DanyC has joined #openstack-ansible16:51
*** adrian_otto has quit IRC16:51
*** ddaskal has joined #openstack-ansible16:51
*** rob0t_ has joined #openstack-ansible16:52
*** whiteveil has joined #openstack-ansible16:52
*** ddaskal has quit IRC16:53
*** weezS has joined #openstack-ansible16:54
*** ssmith__ has joined #openstack-ansible16:54
*** DanyC has quit IRC16:55
openstackgerritMarc Gariépy proposed openstack/openstack-ansible master: [WIP] Add CentOS support for AIO setup  https://review.openstack.org/40769016:55
*** ssmith_ has joined #openstack-ansible16:56
*** McMurlock1 has quit IRC16:56
*** rob0t_ has quit IRC16:57
mhaydenmgariepy: congratulations -- it looks like you're on your way to core! :P16:58
*** ssmith__ has quit IRC16:59
mhaydenlogan-: "async mode is not supported with the package module"17:01
mhayden:|17:01
logan-:(17:01
mgariepymhayden, thanks :)17:01
logan-theres still some optimization to be had even if you can't async it I guess.17:02
*** rob0t_ has joined #openstack-ansible17:02
logan-just by consolidating the install tasks17:02
*** adrian_otto has joined #openstack-ansible17:02
mhaydentrue17:02
mhaydenlogan-: life finds a way17:03
*** lucas_ has quit IRC17:03
*** yolanda has quit IRC17:03
logan-lol17:04
*** whiteveil has quit IRC17:04
mgariepymhayden, running AIO setup on 2 vm here centos and ubuntu to see the difference in time.17:05
mhaydencool17:05
*** yolanda has joined #openstack-ansible17:06
mgariepywow.17:06
mgariepyubuntu is faster..17:07
*** rob0t_ has quit IRC17:07
*** Jack_Iv has joined #openstack-ansible17:08
*** Jack_Iv has quit IRC17:08
*** marc_ab has quit IRC17:09
mgariepylet's wait for the end to see..17:10
*** Jack_Iv has joined #openstack-ansible17:11
*** Jack_Iv has quit IRC17:11
mgariepymhayden, have you seen :  [WARNING]: sftp transfer mechanism failed on [172.29.236.100]. Use ANSIBLE_DEBUG=1 to see detailed information on centos?17:11
*** Jack_Iv has joined #openstack-ansible17:11
mhaydenwhoa17:11
mhaydeni haven't17:11
mhaydeni also wondered if we ought to disable GSSAPI support17:12
mhaydenthat has given me more speed in the past17:12
*** rob0t_ has joined #openstack-ansible17:12
*** Jack_Iv has quit IRC17:12
odyssey4mewell, for the AIO bootstrap we give the ssh role this config: https://github.com/openstack/openstack-ansible/blob/master/tests/bootstrap-aio.yml#L51-L8917:12
*** Jack_Iv has joined #openstack-ansible17:12
odyssey4meI don't know whether you guys are looking at AIO deploy speeds or role deploy speeds17:13
odyssey4meand I don't know whether the role tests use the ssh role to reconfigure the host in the same way17:13
odyssey4meit's entirely plausible that we've been using system defaults for both platforms, and they're very different. Perhaps normalising them in the role tests will help.17:14
mgariepyGSSAPIAuthentication was set to Yes.17:14
*** Jack_Iv has quit IRC17:14
*** Jack_Iv has joined #openstack-ansible17:14
cloudnullin the gate i think we normalize it17:15
odyssey4mecloudnull for the integrated gate, yes - but for the role tests?17:15
cloudnullno i dont think so17:15
odyssey4meyeah, I don't think the role tests do it17:15
odyssey4meperhaps they should17:15
openstackgerritMiguel Alex Cantu (alextricity25) proposed openstack/openstack-ansible master: Move scenario variables under vars  https://review.openstack.org/42882017:16
*** Jack_Iv_ has joined #openstack-ansible17:16
*** Jack_Iv_ has quit IRC17:17
*** rob0t_ has quit IRC17:17
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_nova master: [WIP] Combine package install tasks  https://review.openstack.org/42880617:17
*** Jack_Iv has quit IRC17:20
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_cinder master: NFS backend option "shares" should not be templated  https://review.openstack.org/42882317:20
odyssey4memhayden is the async attempt even necessary?17:21
odyssey4meif you give the package module a list it installs them all at once, rather than through a loop17:22
*** rob0t_ has joined #openstack-ansible17:22
mhaydenodyssey4me: no idea -- mainly testing now to see if it's worth keeping the pattern going17:23
mhaydenthe "action:" stuff makes me cringe17:23
mhaydenbut i figured it was worth a try17:24
odyssey4meyeah, I'm hating it17:24
odyssey4meI'd rather then revert to using the apt module if that's the package manager, and the yum module on a yum platform17:24
odyssey4meie two tasks17:24
mhaydenthat would be possible, too17:24
mhaydenlet's see if this helps at all, especially for centos, and then i'll prettify this thing into a reusable pattern17:25
odyssey4mebut the question still stands - if you use the map to build the list, does the task do a with_items loop or does it push it all in one go17:25
*** marc_ab has joined #openstack-ansible17:26
mhaydenit does it in one go -- already tested that in a sample playbook17:26
mhaydenthe actual package install task is a single step17:26
mhaydenthat sum() takes care of that17:26
odyssey4meok awesome, but the async task doesn't work with it?17:27
odyssey4meand you're hoping that the async task can improve run time17:27
mhaydenasync doesn't work with the package module17:27
*** rob0t_ has quit IRC17:27
mhaydenbut it does work with dnf/yum/apt17:27
odyssey4meah17:27
mhaydenit seems like something isn't getting passed through into the pkg module :|17:27
odyssey4mein that case I would say let's have two tasks - one for each pkg manager17:27
mhaydenthat seems like an easy fix, but it might not be if i examine the code ;)17:27
mhaydenodyssey4me: agreed17:28
mgariepyshould we copy sshd config into containers ?17:29
odyssey4memgariepy well, we do adjust the config already in the lxc_hosts role17:30
mgariepycentos: GSSAPIAuthentication yes by default17:30
mgariepyon the host. not in the container17:30
odyssey4mealso note that we don't actually ssh to the containers17:30
odyssey4mewe ssh to the host, then lxc-attach into the container17:30
odyssey4meour special ssh connection plugin does that for us17:30
*** weezS has quit IRC17:31
openstackgerritMerged openstack/openstack-ansible master: Fix SHA's for rc1 + SHA bump  https://review.openstack.org/42821217:32
andymccrthe goat sacrifices have been accepted17:32
logan-finally17:32
*** Jack_Iv has joined #openstack-ansible17:32
logan-lol17:32
andymccralthough we have memory issues etc - which is probably caused by additional nova services now - so aside from long running gate we're gonna need to find a way to reduce memory footprint17:33
*** rob0t_ has joined #openstack-ansible17:34
*** Jack_Iv has quit IRC17:34
odyssey4meandymccr it's likely those new services have worker configs which we haven't implemented17:35
andymccrodyssey4me: its just 1 service, i think the nginx config could be tuned though perhaps17:35
andymccrbut yeah you're right that could help17:35
odyssey4methe upstream defaults are quite onerous17:36
odyssey4mewe need to set the aio to push it way down17:36
odyssey4mewe do that all here: https://github.com/openstack/openstack-ansible/blob/master/tests/roles/bootstrap-host/templates/user_variables.aio.yml.j2#L3217:36
odyssey4meand here https://github.com/openstack/openstack-ansible-tests/blob/master/test-vars.yml#L42817:37
*** rob0t_ has quit IRC17:39
*** galstrom is now known as galstrom_zzz17:39
andymccrok so stable/ocata is gonna get branched soon17:42
andymccrat that point we're gonna have to start deving on master but backporting all fixes/patches to stable/ocata17:42
andymccrand we'll have to fix up testing too17:42
andymccrso if all cores/contributors could just keep an eye out for that and backport as appropriate. I'll try do a regular run through but would appreciate any help - that'll happen once the release goes in for RC117:43
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_nova master: [WIP] Combine package install tasks  https://review.openstack.org/42880617:45
andymccrand on that note - i'm out :) enjoy your weekends everybody and thanks for all the help and effort - got there in the end.17:48
cloudnullcheers andymccr17:48
odyssey4mecheers andymccr - I'm out too17:48
odyssey4mehave a great w/end y'all!17:49
*** adrian_otto1 has joined #openstack-ansible17:49
mhaydenenjoy!17:49
*** rob0t_ has joined #openstack-ansible17:49
*** adrian_otto has quit IRC17:50
*** Jack_Iv has joined #openstack-ansible17:52
spotzseeya andymccr and odyssey4me17:53
*** galstrom_zzz has quit IRC17:56
*** d34dh0r53 has quit IRC17:56
*** coolj has quit IRC17:56
*** nwonknu has quit IRC17:56
*** coolj has joined #openstack-ansible17:56
*** agarner has quit IRC17:56
*** jwagner has quit IRC17:56
*** SamYaple has quit IRC17:56
*** NostawRm has quit IRC17:56
*** topol has quit IRC17:56
*** nategraf has quit IRC17:56
*** d34dh0r53 has joined #openstack-ansible17:56
*** NostawRm has joined #openstack-ansible17:56
*** galstrom_zzz has joined #openstack-ansible17:56
*** rob0t_ has quit IRC17:56
*** jowisz_ has quit IRC17:56
*** z- has quit IRC17:56
*** dmsimard has quit IRC17:56
*** SamYaple has joined #openstack-ansible17:56
*** topol_ has joined #openstack-ansible17:56
*** jwagner has joined #openstack-ansible17:56
*** jowisz has joined #openstack-ansible17:56
*** nategraf has joined #openstack-ansible17:56
*** dmsimard has joined #openstack-ansible17:56
*** aleph1 has joined #openstack-ansible17:59
*** kiriakos_ has quit IRC18:00
*** nwonknu has joined #openstack-ansible18:02
*** Andrew_jedi has quit IRC18:05
oansonandymccr, it's set in a container (openstack1) (Sorry, I missed your message in real time)18:05
*** rob0t_ has joined #openstack-ansible18:06
*** Jack_Iv has quit IRC18:08
*** woodard has joined #openstack-ansible18:10
*** rob0t_ has quit IRC18:10
*** pjh03 has quit IRC18:13
*** McMurlock1 has joined #openstack-ansible18:15
openstackgerritRick Box proposed openstack/openstack-ansible-ops master: Adds in Playbook and inventory for Ubuntu 16.04 roles  https://review.openstack.org/42884418:16
boxrick1cloudnull: I have a whole bunch of commits relating to the promised roles. Would you mind having a look when you have a moment?18:18
*** mheremans has quit IRC18:18
*** rob0t_ has joined #openstack-ansible18:19
cloudnull++ will have a look asap18:21
*** mheremans has joined #openstack-ansible18:22
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_nova master: [WIP] Combine package install tasks  https://review.openstack.org/42880618:23
*** lucas_ has joined #openstack-ansible18:23
*** admin0_ has joined #openstack-ansible18:25
*** whiteveil has joined #openstack-ansible18:26
*** rob0t_ has quit IRC18:26
*** rob0t_ has joined #openstack-ansible18:36
*** rob0t_ has quit IRC18:41
openstackgerritMarc Gariépy proposed openstack/openstack-ansible master: [WIP] Add CentOS support for AIO setup  https://review.openstack.org/40769018:42
*** rob0t_ has joined #openstack-ansible18:44
*** chris_hultin is now known as chris_hultin|AWA18:44
*** weezS has joined #openstack-ansible18:46
openstackgerritMarc Gariépy proposed openstack/openstack-ansible master: [WIP] Add CentOS support for AIO setup  https://review.openstack.org/40769018:47
*** rob0t_ has quit IRC18:49
*** Hosam has joined #openstack-ansible18:49
*** Andrew_jedi has joined #openstack-ansible18:51
openstackgerritMarc Gariépy proposed openstack/openstack-ansible master: [WIP] Add CentOS support for AIO setup  https://review.openstack.org/40769018:51
*** rob0t_ has joined #openstack-ansible18:52
andymccrahh oanson: add this line to the neutron-overrides-dragonflow.yml: https://github.com/openstack/openstack-ansible-os_neutron/blob/master/tests/neutron-overrides-ovs.yml#L1818:54
andymccrthat should fix that one18:54
mgariepyhmmm let's see the result. https://review.openstack.org/#/c/407690/23/tests/bootstrap-aio.yml18:54
oansonandymccr, tried that. Came out as 'localhost;18:54
oanson'localhost'*18:54
andymccrhmm18:54
*** marc_ab has quit IRC18:54
oansonAlso tried inventory_hostname. also localhost. Now trying hostvars[inventory_hostname]['ansible_host'] as per https://github.com/ansible/ansible/issues/1613918:55
andymccrhmm tahts odd i'll take a look later and see if i can figure that out then18:55
oansonThanks18:55
*** sdake has joined #openstack-ansible18:56
*** TxGirlGeek has quit IRC18:57
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible master: Update reno for stable/ocata  https://review.openstack.org/42886218:57
*** rob0t_ has quit IRC18:57
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-apt_package_pinning master: Update reno for stable/ocata  https://review.openstack.org/42886518:57
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-pip_install master: Update reno for stable/ocata  https://review.openstack.org/42886818:57
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-galera_client master: Update reno for stable/ocata  https://review.openstack.org/42887118:57
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-galera_server master: Update reno for stable/ocata  https://review.openstack.org/42887418:57
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-ceph_client master: Update reno for stable/ocata  https://review.openstack.org/42887718:57
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-haproxy_server master: Update reno for stable/ocata  https://review.openstack.org/42888018:57
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-lxc_container_create master: Update reno for stable/ocata  https://review.openstack.org/42888318:57
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-lxc_hosts master: Update reno for stable/ocata  https://review.openstack.org/42888618:57
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-memcached_server master: Update reno for stable/ocata  https://review.openstack.org/42888918:57
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-security master: Update reno for stable/ocata  https://review.openstack.org/42889218:57
*** poopcat has joined #openstack-ansible18:57
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-openstack_hosts master: Update reno for stable/ocata  https://review.openstack.org/42889518:57
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_keystone master: Update reno for stable/ocata  https://review.openstack.org/42889818:57
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-openstack_openrc master: Update reno for stable/ocata  https://review.openstack.org/42890118:57
*** klamath has quit IRC18:58
*** TxGirlGeek has joined #openstack-ansible18:58
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_aodh master: Update reno for stable/ocata  https://review.openstack.org/42890418:58
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_barbican master: Update reno for stable/ocata  https://review.openstack.org/42890718:58
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_ceilometer master: Update reno for stable/ocata  https://review.openstack.org/42891018:58
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_cinder master: Update reno for stable/ocata  https://review.openstack.org/42891318:58
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_glance master: Update reno for stable/ocata  https://review.openstack.org/42891618:58
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_gnocchi master: Update reno for stable/ocata  https://review.openstack.org/42891918:58
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_heat master: Update reno for stable/ocata  https://review.openstack.org/42892218:58
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_horizon master: Update reno for stable/ocata  https://review.openstack.org/42892518:58
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_ironic master: Update reno for stable/ocata  https://review.openstack.org/42892818:58
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_magnum master: Update reno for stable/ocata  https://review.openstack.org/42893118:58
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_trove master: Update reno for stable/ocata  https://review.openstack.org/42893418:58
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_neutron master: Update reno for stable/ocata  https://review.openstack.org/42893718:58
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_nova master: Update reno for stable/ocata  https://review.openstack.org/42894018:58
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_rally master: Update reno for stable/ocata  https://review.openstack.org/42894318:58
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_sahara master: Update reno for stable/ocata  https://review.openstack.org/42894618:58
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_swift master: Update reno for stable/ocata  https://review.openstack.org/42894918:58
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_tempest master: Update reno for stable/ocata  https://review.openstack.org/42895218:58
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-plugins master: Update reno for stable/ocata  https://review.openstack.org/42895518:58
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-rabbitmq_server master: Update reno for stable/ocata  https://review.openstack.org/42895818:58
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-repo_build master: Update reno for stable/ocata  https://review.openstack.org/42896118:59
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-repo_server master: Update reno for stable/ocata  https://review.openstack.org/42896418:59
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-rsyslog_client master: Update reno for stable/ocata  https://review.openstack.org/42896718:59
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-rsyslog_server master: Update reno for stable/ocata  https://review.openstack.org/42897018:59
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_designate master: Update reno for stable/ocata  https://review.openstack.org/42897318:59
*** stuartgr has left #openstack-ansible19:01
*** rob0t_ has joined #openstack-ansible19:02
oansonMy next test will be container_networks.management_address..address19:02
*** dalees has quit IRC19:02
openstackgerritGerman Eichberger proposed openstack/openstack-ansible master: Additions to install OpenStack Octavia  https://review.openstack.org/42206219:04
*** TxGirlGeek has quit IRC19:06
openstackgerritGerman Eichberger proposed openstack/openstack-ansible-os_neutron master: [WIP] Adds Octavia to Neutron  https://review.openstack.org/42897919:06
*** rob0t_ has quit IRC19:06
*** TxGirlGeek has joined #openstack-ansible19:07
openstackgerritGerman Eichberger proposed openstack/openstack-ansible-os_octavia master: [WIP] Octavia role hacking  https://review.openstack.org/41721019:08
*** whiteveil has quit IRC19:09
*** rob0t_ has joined #openstack-ansible19:12
*** lucas_ has quit IRC19:12
*** lucas_ has joined #openstack-ansible19:12
*** cmart has quit IRC19:14
*** lucas_ has quit IRC19:14
*** lucas_ has joined #openstack-ansible19:15
*** crushil has quit IRC19:15
*** rob0t_ has quit IRC19:17
*** whiteveil has joined #openstack-ansible19:19
*** TxGirlGeek has quit IRC19:20
*** admin0_ has quit IRC19:21
*** TxGirlGeek has joined #openstack-ansible19:21
*** rob0t_ has joined #openstack-ansible19:22
*** nbante has quit IRC19:23
*** rob0t_ has quit IRC19:27
*** admin0_ has joined #openstack-ansible19:27
*** lucas_ has quit IRC19:27
*** lucas_ has joined #openstack-ansible19:27
*** jwitko has quit IRC19:27
*** admin0_ has quit IRC19:29
*** cmart has joined #openstack-ansible19:31
*** admin0_ has joined #openstack-ansible19:31
*** cmart has quit IRC19:35
*** rob0t_ has joined #openstack-ansible19:39
*** Jack_Iv has joined #openstack-ansible19:39
*** rob0t_ has quit IRC19:43
mgariepymhayden, my last build is looking good on centos ;)19:45
mgariepycinder is done after 44 minutes, was like 67 minutes last time.19:46
*** skuda has quit IRC19:53
*** rob0t_ has joined #openstack-ansible19:55
*** adrian_otto1 has quit IRC19:55
*** lucas_ has quit IRC19:55
*** McMurlock1 has quit IRC19:56
*** adrian_otto has joined #openstack-ansible19:57
*** rob0t_ has quit IRC19:59
*** zao has quit IRC20:04
*** lucas_ has joined #openstack-ansible20:04
*** rob0t_ has joined #openstack-ansible20:07
openstackgerritLogan V proposed openstack/openstack-ansible master: [WIP] Containerize HAProxy  https://review.openstack.org/42901920:07
*** lucas_ has quit IRC20:08
cloudnulllogan-: nice!20:08
logan-yes.. but will it blend.. :)20:08
*** woodard has quit IRC20:09
*** woodard has joined #openstack-ansible20:10
palendaeWill it proxy20:11
*** rob0t_ has quit IRC20:11
openstackgerritMarc Gariépy proposed openstack/openstack-ansible master: [WIP] Add CentOS support for AIO setup  https://review.openstack.org/40769020:15
*** zao has joined #openstack-ansible20:16
cloudnulllogan-: I'm a firm believe it will all blend20:21
cloudnullhttp://www.willitblend.com/20:21
*** rob0t_ has joined #openstack-ansible20:22
openstackgerritOmer Anson proposed openstack/openstack-ansible-os_neutron master: Implement Dragonflow deployment  https://review.openstack.org/39152420:22
*** pramodrj07 has joined #openstack-ansible20:24
*** pramodrj07 has quit IRC20:24
*** MasterOfBugs has joined #openstack-ansible20:25
cloudnullthis is one of my favorites https://www.youtube.com/watch?v=DORyTWjqg7U&list=PL5B2372870FCE5A72&index=920:25
*** jheroux has quit IRC20:26
*** lucas_ has joined #openstack-ansible20:26
*** rob0t_ has quit IRC20:26
*** rob0t_ has joined #openstack-ansible20:32
*** lucas_ has quit IRC20:33
logan-haha20:33
*** chris_hultin|AWA is now known as chris_hultin20:34
*** lucas_ has joined #openstack-ansible20:34
mgariepyany reason for this ? https://github.com/openstack/openstack-ansible-openstack_openrc/blob/master/templates/openrc.j2#L220:36
*** rob0t_ has quit IRC20:36
*** lucas_ has quit IRC20:39
*** adrian_otto has quit IRC20:40
openstackgerritTim Simmons proposed openstack/openstack-ansible-os_designate master: Enable current Designate services  https://review.openstack.org/42781020:42
*** rob0t_ has joined #openstack-ansible20:42
*** karimb has quit IRC20:42
*** karimb has joined #openstack-ansible20:43
*** lucas_ has joined #openstack-ansible20:44
*** rob0t_ has quit IRC20:47
*** skuda has joined #openstack-ansible20:47
*** karimb has quit IRC20:48
*** rob0t_ has joined #openstack-ansible20:52
mgariepyhave a nice weekend everyone20:55
*** lucas_ has quit IRC20:56
*** gouthamr has quit IRC20:59
*** rob0t_ has quit IRC21:01
csmartmgariepy: thanks, you too!21:03
*** gouthamr has joined #openstack-ansible21:05
*** sdake has quit IRC21:06
*** lucas_ has joined #openstack-ansible21:11
*** Jack_Iv has quit IRC21:12
*** Jack_Iv has joined #openstack-ansible21:13
*** pjh03 has joined #openstack-ansible21:14
*** Jack_Iv_ has joined #openstack-ansible21:16
*** askb has joined #openstack-ansible21:18
*** pjh03 has quit IRC21:18
*** Jack_Iv has quit IRC21:19
*** askb has quit IRC21:22
*** admin0_ has quit IRC21:23
*** smatzek has quit IRC21:23
*** admin0_ has joined #openstack-ansible21:23
*** admin0_ has quit IRC21:24
*** crushil has joined #openstack-ansible21:26
*** skuda has quit IRC21:26
*** Jack_Iv_ has quit IRC21:32
*** Jack_Iv has joined #openstack-ansible21:32
*** Jeffrey4l has quit IRC21:35
*** crushil has quit IRC21:35
*** Jeffrey4l has joined #openstack-ansible21:35
*** whiteveil has quit IRC21:45
*** chris_hultin is now known as chris_hultin|AWA21:47
*** whiteveil has joined #openstack-ansible21:48
*** topol_ is now known as topol21:54
*** lucas_ has quit IRC21:54
agrebennikov__qq to whoever is still there...21:56
agrebennikov__glance api v1 has been deprecated in newton21:56
agrebennikov__while defaults everywhere until master say glance_enable_v1_api=true21:56
agrebennikov__do I need to fix it?21:56
*** adrian_otto has joined #openstack-ansible21:57
*** gouthamr has quit IRC21:57
agrebennikov__cloudnull or evrardjp21:57
agrebennikov__please21:57
*** Jack_Iv_ has joined #openstack-ansible21:58
*** Jack_Iv has quit IRC22:01
*** whiteveil has quit IRC22:05
agrebennikov__or odyssey4me maybe...22:07
*** karimb has joined #openstack-ansible22:14
*** Andrew_jedi has quit IRC22:15
*** skuda has joined #openstack-ansible22:16
*** karimb has quit IRC22:17
*** Andrew_jedi has joined #openstack-ansible22:17
*** whiteveil has joined #openstack-ansible22:21
*** smatzek has joined #openstack-ansible22:24
*** thorst_ has quit IRC22:25
*** Jack_Iv_ has quit IRC22:27
*** smatzek has quit IRC22:29
*** strattao_ has left #openstack-ansible22:31
cloudnullagrebennikov__: I believe that the glance api v1 is still in newton and will be removed in ocata?22:32
*** ssmith_ has quit IRC22:32
*** klamath has joined #openstack-ansible22:32
cloudnullare you seeing that option causing issues ?22:33
*** sdake has joined #openstack-ansible22:33
*** calebb has quit IRC22:34
*** whiteveil has quit IRC22:37
*** Adri2000 has quit IRC22:37
*** klamath has quit IRC22:41
*** Adri2000 has joined #openstack-ansible22:43
*** gouthamr has joined #openstack-ansible22:45
agrebennikov__cloudnull, kind of... at least on one of the newton envs we are deploying glance --os-image-api-version 1 image-list fails22:46
*** weezS has quit IRC22:47
agrebennikov__and it fails because of the broken communication between glance-registry and glance-api somehow22:47
*** calebb has joined #openstack-ansible22:47
agrebennikov__because of this reason rally fails on some scenarios22:47
agrebennikov__if you don't specifically mention you want v222:48
*** karimb has joined #openstack-ansible22:52
*** chris_hultin|AWA is now known as chris_hultin23:02
*** chris_hultin is now known as chris_hultin|AWA23:03
*** acormier has quit IRC23:05
*** adrian_otto has quit IRC23:05
*** esberglu_ has quit IRC23:06
*** nadeem has joined #openstack-ansible23:06
*** Adri2000 has quit IRC23:07
*** sdake has quit IRC23:11
*** Adri2000 has joined #openstack-ansible23:14
*** acormier has joined #openstack-ansible23:17
*** pmannidi has joined #openstack-ansible23:20
stevelleagrebennikov__: glance v1 can continue to be enabled in newton and ocata23:21
stevelleit is being given an extended deprecation period23:21
agrebennikov__stevelle, this is fine, but it just doesn't work seems so :D23:22
agrebennikov__I'll definitely dig deeper23:22
stevelleagrebennikov__: glance still has bugs open in master (pike) for the api -> registry version issues23:22
agrebennikov__awsome :/23:23
agrebennikov__so why keeping v1 in stable branch if it doesn't work correctly then?23:23
stevelleagrebennikov__: also, heat still working on their conversion23:23
*** acormier has quit IRC23:23
stevelleagrebennikov__: https://review.openstack.org/#/c/416766/23:24
agrebennikov__wowww.....23:25
agrebennikov__this is super cool :D23:25
agrebennikov__really lol23:25
*** pmannidi has quit IRC23:26
stevelleagrebennikov__: v1 does work, you have to configure stuff correctly23:26
stevelleit shouldn't be that hard though23:26
agrebennikov__agree. but in this case in our stable it should have deep logic of configuring all these 4 things by default23:27
agrebennikov__because by default all 4 are true23:27
*** TxGirlGeek has quit IRC23:28
*** pmannidi has joined #openstack-ansible23:29
*** adrian_otto has joined #openstack-ansible23:30
agrebennikov__:q23:33
agrebennikov__Жй23:33
*** skuda has quit IRC23:35
*** karimb has quit IRC23:45
stevelleagrebennikov__: you lose me23:49
stevellein our table, deep logic, all 4 things.  XD23:50
agrebennikov__it is stevelle, but guess what happens if you go with default?23:52
agrebennikov__all them become true23:52
agrebennikov__and lead to the broken env23:53
stevelledevstack only tests one permutation by default and glance apparently has insufficient functional testing for permutations.23:54
*** rollniak has joined #openstack-ansible23:55
agrebennikov__any advise?23:56
agrebennikov__maybe I just disable v1 in defaults then? ;)23:57
agrebennikov__nah, probably we can't.... since cinder sets up v1 if there is no ceph :/23:58
* agrebennikov__ confused23:58
stevelleI thought cinder was supposed to support v223:59
stevelleheat would have problems with v2 though23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!