Tuesday, 2017-02-28

*** meteorfox has quit IRC00:00
*** mudpuppy has quit IRC00:00
*** palendae has quit IRC00:00
*** mancdaz has quit IRC00:00
*** rackertom has quit IRC00:00
*** qwang has quit IRC00:00
*** spotz has quit IRC00:00
*** bgmccollum has quit IRC00:00
*** meteorfox has joined #openstack-ansible00:00
*** aetaric has quit IRC00:01
*** pwnall1337 has quit IRC00:01
*** dstanek has quit IRC00:01
*** Adri2000 has quit IRC00:01
*** errr has quit IRC00:02
*** xar- has quit IRC00:02
*** NachoDuck has quit IRC00:02
*** berendt has quit IRC00:02
*** mubix has quit IRC00:02
*** chris_hultin|AWA has quit IRC00:02
*** mhayden has quit IRC00:02
*** toan has quit IRC00:02
*** odyssey4me has quit IRC00:02
*** jmccrory has quit IRC00:02
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_keystone master: Conditionally run appropriate db_sync commands  https://review.openstack.org/43213400:03
*** qwang has joined #openstack-ansible00:03
*** Guest68651 has joined #openstack-ansible00:03
*** berendt has joined #openstack-ansible00:06
*** NachoDuck has joined #openstack-ansible00:06
*** xar- has joined #openstack-ansible00:07
*** mancdaz has joined #openstack-ansible00:07
*** bgmccollum has joined #openstack-ansible00:07
*** pwnall1337 has joined #openstack-ansible00:07
*** chris_hultin|AWA has joined #openstack-ansible00:07
*** toan has joined #openstack-ansible00:07
*** mubix has joined #openstack-ansible00:08
*** chris_hultin|AWA is now known as chris_hultin00:08
*** galstrom is now known as galstrom_zzz00:09
*** dstanek has joined #openstack-ansible00:09
*** jmccrory has joined #openstack-ansible00:09
*** spotz has joined #openstack-ansible00:09
*** mudpuppy has joined #openstack-ansible00:10
*** mhayden has joined #openstack-ansible00:10
*** odyssey4me has joined #openstack-ansible00:11
*** jamesdenton has joined #openstack-ansible00:11
*** chris_hultin has quit IRC00:12
*** DanyC has joined #openstack-ansible00:13
*** Guest68651 has quit IRC00:14
*** errr has joined #openstack-ansible00:15
*** darrenc has quit IRC00:16
*** jamielennox|away is now known as jamielennox00:16
*** darrenc has joined #openstack-ansible00:17
*** palendae_ has joined #openstack-ansible00:17
*** palendae_ is now known as Guest8571800:17
*** DanyC has quit IRC00:17
*** chris_hultin|AWA has joined #openstack-ansible00:18
*** chris_hultin|AWA is now known as chris_hultin00:18
*** TxGirlGeek has quit IRC00:20
*** mmalik4_ has quit IRC00:28
*** jrobinson is now known as jrobinson-afk00:33
*** dstanek has quit IRC00:34
*** dstanek has joined #openstack-ansible00:34
*** jamesdenton has quit IRC00:37
*** pwnall1337 is now known as zz_pwnall133700:42
*** weezS has joined #openstack-ansible00:44
*** Adri2000 has joined #openstack-ansible00:46
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_keystone master: Conditionally run appropriate db_sync commands  https://review.openstack.org/43213400:47
*** jrobinson-afk is now known as jrobinson00:49
Andrew_jedifolks, how can i reduce the number of workers in keystone container ?00:49
*** svayrette has joined #openstack-ansible00:49
lbragstadAndrew_jedi i think this would be your starting point - https://github.com/openstack/openstack-ansible-os_keystone/blob/master/defaults/main.yml#L18700:51
lbragstadAndrew_jedi if you're talking about adjusting the threads and process counts here - https://github.com/openstack/openstack-ansible-os_keystone/blob/master/templates/keystone-httpd.conf.j2#L600:52
*** manheim has joined #openstack-ansible00:53
Andrew_jedilbragstad: keystone is eating up all the memory of my controller , 97 keystone process at the moment eating up around 6 gb00:53
*** manheim has quit IRC00:53
*** manheim has joined #openstack-ansible00:53
lbragstadwhoa00:54
*** svayrette has quit IRC00:54
Andrew_jedi# ps -ef | grep keystone | wc -l     9700:54
lbragstadAndrew_jedi is it getting hammered with requests?00:54
Andrew_jedilbragstad: i am running magnum, sahara, designate etc etc, so i guess yes00:55
lbragstadhmm00:55
lbragstadI wonder whats causing it to eat up that much memory00:55
Andrew_jedilbragstad: btw do you know the location of the file, which has this configuration, in case if i want to make change manually ?00:57
lbragstadAndrew_jedi yeah it should be in /etc/apache2/sites-enabled00:57
lbragstadAndrew_jedi if you're on the keystone containers, it should be the only enabled site for apache00:58
Andrew_jedicool, found it00:58
Andrew_jedilbragstad: this is strange, " keystone-service user=keystone group=keystone processes=48"00:59
Andrew_jediit is set to 4800:59
*** bgmccollum has quit IRC01:00
*** bgmccollum has joined #openstack-ansible01:00
lbragstadAndrew_jedi what about thread count?01:01
lbragstadoh01:01
*** SerenaFeng has joined #openstack-ansible01:02
lbragstadAndrew_jedi you probably have two vhosts running01:02
Andrew_jedi keystone-service user=keystone group=keystone processes=48 threads=101:02
lbragstadone for admin and one for public01:02
lbragstadso 48 processes for each01:02
Andrew_jedilbragstad: can i change that01:02
Andrew_jediohhhhh01:02
Andrew_jediyes, i do have two virtualhost01:03
lbragstadif you wanted to change that you'd probably have to redeploy somehow - since openstack-ansible's os-keystone role will go through and configure auth endpoints according to those values01:03
Andrew_jedilbragstad: ps -ef | grep keystone | wc -l  4101:04
Andrew_jedi:)01:04
lbragstadAndrew_jedi did you set it to 20 processes apiece?01:05
Andrew_jedilbragstad: Is that bad ? :(01:05
lbragstadno - just doing the math01:05
Andrew_jedihaha, yep, i changed to 2001:05
lbragstadcool - well hopefully that helps01:06
lbragstadfor the record, i'm about as good at tuning apache as i am at basket weaving01:06
Andrew_jediwow, from 6.72 gb to 1.2 gb01:06
lbragstadso I would defer whatever suggests i gave you to another expert in the channel :)01:06
lbragstadsuggestions*01:07
lbragstadAndrew_jedi the restart of the apache service might have had an effect on that too01:07
Andrew_jedilbragstad: when you expert, i wonder that people working on openstack(operators, devops) can be expert on one thing ?01:09
Andrew_jedis/you/you say01:09
lbragstadI guess what I meant by that would be that there are a lot of other people in this channel that have a lot more experience tuning apache than I do - so they might be able to explain what's going on a little better or what to possibly look for01:10
lbragstadin general - i find a lot of people in this channel have a lot of deep background across a *lot* of openstack services (since there are a lot of operators here)01:11
lbragstadwhere-as I am primarily limited to keystone01:11
*** DanyC has joined #openstack-ansible01:14
*** pramodrj07 has quit IRC01:14
*** MasterOfBugs has quit IRC01:14
*** DanyC has quit IRC01:18
Andrew_jedilbragstad: With your help i was able to free up to 10gb ,,, feeling much better now :)01:18
Andrew_jedilbragstad: Thanks a lot :)01:18
lbragstadAndrew_jedi no problem :)01:19
*** weezS has quit IRC01:21
*** thorst has joined #openstack-ansible01:26
*** Andrew_jedi has quit IRC01:29
*** sdake_ has joined #openstack-ansible01:30
*** jrobinson has quit IRC01:32
*** sdake has quit IRC01:33
*** sdake_ has quit IRC01:40
matttcloudnull: awww, someone beat me to it :P01:40
*** cuongnv has joined #openstack-ansible01:43
alextricity25Does anybody know how I can apply an open patch to a patch set in another repo?01:48
alextricity25One of my changes to the ceilometer role depends first on changes to the integrated repo, but the changes in the integrated repo depend on the role changes01:49
*** adrian_otto has quit IRC01:51
*** rackertom has joined #openstack-ansible02:00
*** chris_hultin has quit IRC02:04
*** manheim has quit IRC02:04
*** chris_hultin|AWA has joined #openstack-ansible02:06
*** chris_hultin|AWA is now known as chris_hultin02:06
*** Mahe has quit IRC02:08
*** Mahe has joined #openstack-ansible02:13
*** DanyC has joined #openstack-ansible02:14
*** BjoernT has quit IRC02:15
*** DanyC has quit IRC02:19
cloudnullmattt: whats that ?02:21
*** manheim has joined #openstack-ansible02:28
dmsimardcloudnull, odyssey4me: I think I've addressed the width/padding issues, can you have a look at your convenience to see if it's better for you ? http://46.231.133.111/reports/index.html (make sure to clear your cache)02:35
cloudnulllooks great!02:39
cloudnullscaling around to different res seems like its all good now.02:39
dmsimardYeah, you retain full width until around ~1440px before it starts folding02:41
*** jrobinson has joined #openstack-ansible02:41
*** FrankZhang has quit IRC02:42
cloudnullit looks very good02:42
dmsimardnow I have another special request and I think I will be able to land this after02:43
*** jrobinson has quit IRC02:43
*** thorst has quit IRC02:44
*** thorst has joined #openstack-ansible02:44
*** jrobinson has joined #openstack-ansible02:44
openstackgerritRavi Kumar Boyapati proposed openstack/openstack-ansible master: Place gnocchi database bind mount dirs to be in group_vars  https://review.openstack.org/43832002:45
*** thorst has quit IRC02:49
openstackgerritRavi Kumar Boyapati proposed openstack/openstack-ansible master: update galera cluster database bind mount dirs  https://review.openstack.org/43822902:50
*** manheim has quit IRC02:53
*** FrankZhang has joined #openstack-ansible03:01
*** FrankZhang has quit IRC03:01
*** zz_pwnall1337 has quit IRC03:04
*** zz_pwnall1337 has joined #openstack-ansible03:06
*** DanyC has joined #openstack-ansible03:15
*** DanyC has quit IRC03:20
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Remove the system_crontab_coordination role  https://review.openstack.org/43869803:24
logan-very nice dmsimard03:25
dmsimard\o/03:26
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Inherit /etc/crontab from host  https://review.openstack.org/43878403:26
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Remove the system_crontab_coordination role  https://review.openstack.org/43869803:27
*** ngupta has joined #openstack-ansible03:31
*** ngupta has quit IRC03:31
*** ngupta has joined #openstack-ansible03:31
*** jgriffiths has quit IRC03:33
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ceph_client master: Tag clean up  https://review.openstack.org/43872303:35
*** FrankZhang has joined #openstack-ansible03:38
*** thorst has joined #openstack-ansible03:45
openstackgerritMerged openstack/openstack-ansible-rsyslog_client master: rsyslog client tasks overwriting rsyslog server config  https://review.openstack.org/43820503:49
*** thorst has quit IRC03:50
*** lucasxu has joined #openstack-ansible03:53
*** gouthamr has quit IRC03:54
*** FrankZhang has quit IRC03:56
*** svayrette has joined #openstack-ansible03:56
*** Jack_Iv has joined #openstack-ansible03:59
*** SerenaFeng has quit IRC04:00
*** svayrette has quit IRC04:01
*** FrankZhang has joined #openstack-ansible04:01
*** Jack_Iv has quit IRC04:04
*** DanyC has joined #openstack-ansible04:16
xdfilat PTG i beleive i heard some complaints about templates. I was looking at how OSA creates nova.conf, for example, and just realized its created with a template04:16
xdfilnot sure if you considered ansible "ini_file" module04:17
xdfilthis is an example of what I was doing to generate configs with it http://paste.openstack.org/show/hSlTa7HApTqui2fPj4cf/04:17
xdfilusing ini_file gives you the flexibility to change a config file later without knowing about the previous config04:19
xdfiland it is more satisfying to watch the playbook run too :)04:19
xdfili think cloudnull is who I heard say it04:20
*** DanyC has quit IRC04:21
*** crushil has quit IRC04:22
*** ngupta has quit IRC04:35
*** jasondotstar has quit IRC04:35
*** Fenuks has joined #openstack-ansible04:40
*** weezS has joined #openstack-ansible04:45
*** jasondotstar has joined #openstack-ansible04:48
*** Jeffrey4l__ has quit IRC04:49
*** weezS has quit IRC04:50
*** weezS has joined #openstack-ansible04:51
*** Jeffrey4l__ has joined #openstack-ansible04:52
*** crushil has joined #openstack-ansible04:54
*** lucasxu has quit IRC04:54
*** sdake has joined #openstack-ansible05:03
*** FrankZhang has quit IRC05:03
*** rickflare has joined #openstack-ansible05:06
*** zz_pwnall1337 is now known as pwnall133705:07
*** sdake_ has joined #openstack-ansible05:07
*** sdake has quit IRC05:08
pwnall1337had a question for anyone who might know.  I'm attempting to use the OSA multi node AIO on ubuntu 14.04 LTS with a rackspace on metal server.   On branch stable/newton  the cobbler setup tries to pull 14.04.4 LTS which is does not exist. it's now .5  I fixed that and then during the openstack deploy all the OSA playbooks failed for requiring 16.04 LTS.05:10
pwnall1337let me know if it looks like my irc message got cut off.05:11
*** DanyC has joined #openstack-ansible05:17
*** chhavi has joined #openstack-ansible05:18
*** udesale has joined #openstack-ansible05:19
*** DanyC has quit IRC05:21
*** udesale__ has joined #openstack-ansible05:33
*** udesale has quit IRC05:35
*** SerenaFeng has joined #openstack-ansible05:38
*** sdake_ has quit IRC05:47
*** sdake has joined #openstack-ansible05:47
*** pwnall1337 is now known as zz_pwnall133705:55
*** Jack_Iv has joined #openstack-ansible05:58
*** hybridpollo has quit IRC06:09
*** sdake_ has joined #openstack-ansible06:10
*** Jeffrey4l__ is now known as Jeffrey4l06:10
*** sdake has quit IRC06:13
*** sacharya has quit IRC06:13
*** sacharya has joined #openstack-ansible06:14
*** DanyC has joined #openstack-ansible06:18
*** sacharya has quit IRC06:19
*** SerenaFeng has quit IRC06:22
*** DanyC has quit IRC06:22
*** chhavi has quit IRC06:27
*** DanyC has joined #openstack-ansible06:28
*** chhavi has joined #openstack-ansible06:29
*** KarlKloppenborg has joined #openstack-ansible06:29
*** DanyC has quit IRC06:33
*** udesale__ has quit IRC06:35
*** svayrette has joined #openstack-ansible06:44
*** SerenaFeng has joined #openstack-ansible06:45
*** weezS has quit IRC06:46
*** thorst has joined #openstack-ansible06:46
*** weezS has joined #openstack-ansible06:47
*** weezS has quit IRC06:47
*** svayrette has quit IRC06:48
*** thorst has quit IRC06:51
*** rgogunskiy has joined #openstack-ansible06:54
*** fxpester has joined #openstack-ansible07:00
*** fxpester has quit IRC07:00
*** svayrette has joined #openstack-ansible07:05
*** phalmos has quit IRC07:08
*** Oku_OS-away is now known as Oku_OS07:08
*** svayrette has quit IRC07:10
*** sacharya has joined #openstack-ansible07:15
*** jrobinson has quit IRC07:21
*** dalees has quit IRC07:32
*** crushil has quit IRC07:36
*** manheim has joined #openstack-ansible07:42
*** dalees has joined #openstack-ansible07:44
*** manheim has quit IRC07:46
*** askb has quit IRC07:56
*** sdake_ is now known as sdake07:56
*** zz_pwnall1337 has quit IRC07:58
*** zz_pwnall1337 has joined #openstack-ansible07:59
*** Jack_Iv has quit IRC08:05
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/newton: Bump BIRD and etcd role pins  https://review.openstack.org/43868808:12
*** pcaruana has joined #openstack-ansible08:17
*** Jack_Iv has joined #openstack-ansible08:18
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-rsyslog_client stable/ocata: rsyslog client tasks overwriting rsyslog server config  https://review.openstack.org/43884508:24
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-rsyslog_client stable/newton: rsyslog client tasks overwriting rsyslog server config  https://review.openstack.org/43884608:24
*** vnogin has joined #openstack-ansible08:30
openstackgerritDavid Rabel proposed openstack/openstack-ansible-security stable/newton: Add conf file entry for chrony  https://review.openstack.org/43885208:43
*** karimb has joined #openstack-ansible08:48
*** KarlKloppenborg has quit IRC08:51
*** DanyC has joined #openstack-ansible08:57
*** DanyC has quit IRC09:00
openstackgerritDavid Rabel proposed openstack/openstack-ansible-security master: Prepare vagrant centos/7 box for role testing  https://review.openstack.org/43868609:00
*** Jeffrey4l has quit IRC09:00
*** DanyC has joined #openstack-ansible09:00
*** Jeffrey4l has joined #openstack-ansible09:00
*** manheim_ has joined #openstack-ansible09:01
*** manheim_ has quit IRC09:02
*** manheim_ has joined #openstack-ansible09:02
*** vcn[m] has quit IRC09:09
*** evrardjp[m] has quit IRC09:09
*** csmart has quit IRC09:09
openstackgerritMerged openstack/openstack-ansible master: Place gnocchi database bind mount dirs to be in group_vars  https://review.openstack.org/43832009:10
openstackgerritMerged openstack/openstack-ansible master: update galera cluster database bind mount dirs  https://review.openstack.org/43822909:11
*** sdake has quit IRC09:13
*** udesale has joined #openstack-ansible09:17
*** chhavi has quit IRC09:19
*** SerenaFeng has quit IRC09:19
*** fandi has joined #openstack-ansible09:20
*** SerenaFeng has joined #openstack-ansible09:25
*** manheim__ has joined #openstack-ansible09:36
*** adogrant has joined #openstack-ansible09:37
*** Jack_Iv has quit IRC09:37
*** h5t4_ has joined #openstack-ansible09:38
*** Jack_Iv has joined #openstack-ansible09:38
*** manheim_ has quit IRC09:39
*** electrofelix has joined #openstack-ansible09:43
*** Jack_Iv has quit IRC09:51
*** manheim__ has quit IRC09:51
*** Jack_Iv has joined #openstack-ansible09:52
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_swift master: Rework swift_rings.py to use the RingBuilder class  https://review.openstack.org/43213209:57
*** Andrew_jedi has joined #openstack-ansible10:00
*** cuongnv has quit IRC10:02
*** sdake has joined #openstack-ansible10:05
*** pmannidi has quit IRC10:07
*** SerenaFeng has quit IRC10:08
*** svayrette has joined #openstack-ansible10:10
*** manheim_ has joined #openstack-ansible10:12
*** fandi has quit IRC10:13
*** svayrette has quit IRC10:15
*** aetaric has joined #openstack-ansible10:19
*** SerenaFeng has joined #openstack-ansible10:22
*** Jack_Iv has quit IRC10:23
*** Jack_Iv has joined #openstack-ansible10:23
*** SerenaFeng has quit IRC10:24
*** Jack_Iv has quit IRC10:26
*** Jack_Iv has joined #openstack-ansible10:26
*** evrardjp[m] has joined #openstack-ansible10:27
*** sacharya has quit IRC10:29
odyssey4meandymccr happy to go ahead with this? https://review.openstack.org/43870810:31
andymccrodyssey4me: yeah although im wondering if we shouldn't get the replacement periodical setup first10:31
andymccror at least that was my understanding of how we were going to do this10:31
odyssey4meandymccr sure, that's probably wise - I'll try and put some times into the upgrade periodic today which sets the scene for that10:32
odyssey4methat said, removing those from the AIO puts them into the same place as Ironic, Magnum, etc which isn't too terrible10:33
andymccrodyssey4me: yeah thats true10:33
andymccras long as its happening im happy to get it removed10:33
*** SerenaFeng has joined #openstack-ansible10:33
*** manheim_ has quit IRC10:34
*** dfflanders has quit IRC10:37
*** manheim_ has joined #openstack-ansible10:38
*** sdake has quit IRC10:42
*** udesale has quit IRC10:43
*** Jack_Iv has quit IRC10:47
*** Jack_Iv has joined #openstack-ansible10:48
*** thorst has joined #openstack-ansible10:48
*** Jack_Iv has quit IRC10:52
*** esberglu has joined #openstack-ansible10:53
*** thorst has quit IRC10:53
*** SerenaFeng has quit IRC10:55
*** SerenaFeng has joined #openstack-ansible10:56
*** esberglu has quit IRC10:57
*** chhavi has joined #openstack-ansible11:03
*** chhavi has quit IRC11:10
*** chhavi has joined #openstack-ansible11:10
openstackgerritAndy McCrae proposed openstack/openstack-ansible-rsyslog_client master: Test for rsyslog_all group before conditional  https://review.openstack.org/43892711:26
andymccr^ reviews por favor, currently master builds on roles are broken without the rsyslog_all group (e.g. swift or any other sthat import rsyslog_client)11:26
odyssey4megerrit is rather flaky this morning11:29
*** stuartgr has joined #openstack-ansible11:29
*** SerenaFeng has quit IRC11:32
*** SerenaFeng has joined #openstack-ansible11:32
nea1I just rebooted my node (now twice) and rabbitmq isn't coming up - http://termbin.com/cble anyone seen something like this?11:39
*** Amit82 has joined #openstack-ansible11:39
Amit82Hi All11:40
Amit82I am now trying to install Openstack using OSA Newton 14.0.811:40
Amit82I am trying example test configuration as per Newton deployment guide11:40
openstackgerritMerged openstack/openstack-ansible master: Remove ceilometer from the gate  https://review.openstack.org/43870811:40
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/ocata: Remove ceilometer from the gate  https://review.openstack.org/43893011:41
Amit82while running playbook "openstack-ansible setup-hosts.yml", it is giving the error pasted here: http://paste.openstack.org/show/600751/11:41
Amit82do I need to install python manually on compute node?11:42
odyssey4meAmit82 yes, the deployment guide states clearly that it's a requirement on all hosts11:42
odyssey4meAmit82 yesterday logan- also replied to you to inform you that there is a bug fixed that will install it for you once 14.1.0 releases11:43
Amit82I may be wrong but this link doesn't state this. https://docs.openstack.org/project-deploy-guide/openstack-ansible/newton/targethosts-prepare.html11:43
odyssey4meso you can either use stable/newton instead of the tag, or install python yourself11:43
odyssey4meAmit82 weird, I see you're right - I could have sworn we had it as a requirement11:45
odyssey4meanyway, either install python2 or update your branch to the head of stable/newton11:45
Amit82I have installed python2.7 using apt-get install python2.7 but still the same error11:47
Amit82probably because it is looking for python11:47
*** vcn[m] has joined #openstack-ansible11:48
odyssey4meAmit82 if you execute with -vvv can you pastebin theoutput?11:48
*** csmart has joined #openstack-ansible11:50
openstackgerritAndy McCrae proposed openstack/openstack-ansible stable/ocata: Final SHA bump before 15.0.0 release  https://review.openstack.org/43893411:50
Amit82odyssey4me: http://paste.openstack.org/show/600752/11:50
odyssey4meAmit82 can you git checkout to the head of stable/newton and retry?11:51
odyssey4meAmit82 execute: git fetch; git checkout origin/stable/newton11:52
Amit82odysse4me: but this branch will keep on changing, right?11:52
Amit82I want something stable to start working on Openstack11:53
odyssey4meAmit82 ok, to make this work all your hosts need to have python installed11:53
odyssey4mein 14.1.0 we will have something that does that automatically, but you are not at 14.1.011:53
*** chhavi has quit IRC11:53
*** chhavi has joined #openstack-ansible11:54
Amit82odyssey4me: See my compute is showing this: http://paste.openstack.org/show/600754/11:54
odyssey4methe error is pretty clear - it cannot find the python binary on the target host11:54
odyssey4meis /usr/bin/python there?11:55
Amit82it is not showing python in /usr/bin/11:55
odyssey4meAmit82 so that's the problem right there11:57
Amit82odyssey4me: thanks, I actually installed python2.7 explicitly11:59
*** smatzek has joined #openstack-ansible12:04
*** johnthetubaguy has quit IRC12:04
*** smatzek_ has joined #openstack-ansible12:05
*** smatzek has quit IRC12:05
*** lwiecek has joined #openstack-ansible12:07
*** chhavi has quit IRC12:07
lwiecekHello. I am trying to install keystone using a ready openstack-keystone-ansible-role and the keystone gets installed, however playbook fails at step: Ensure service tenant, which is adding service tenant. After investigation, I need to do following steps manually to make it work: 1. Install correct version of pysaml2 in virtualenv (I install 3.0.2, the role installs the newest. 2. I have to make 4 spaces that are missing i12:07
*** chhavi has joined #openstack-ansible12:07
lwiecek(in first line after <VirtualHost *:5000>) 3. Logs show that wsgi-module is not loaded properly. It seems that it /var/www/cgi-bin/keystone/main is executed by wrong python. I can manually fix it by entering virtualenv, sourcing keystone admin credentials and running it manually (python /var/www/cgi-bin/keystone/main). I used Ansible 2.2.1.0 (requirements specifies minimum 2.0 version). How can I fix this?12:07
odyssey4melwiecek can you point to where you got this role?12:09
lwiecekhttps://github.com/openstack-ansible/ansible-role-keystone.git12:09
odyssey4melwiecek that's from a project which is old and quite dead12:10
odyssey4methe author is not maintaining it12:10
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_nova master: Adjust conf for deprecation warnings  https://review.openstack.org/43800812:10
evrardjpnot us :)12:10
lwiecekoops I am sorry, not this one :)12:10
lwiecekhttps://github.com/openstack/openstack-ansible-os_keystone12:10
lwiecekthis one12:10
odyssey4mewe have a keystone role here: https://github.com/openstack/openstack-ansible-os_keystone12:10
odyssey4meok, and what playbook are you using to install it?12:11
lwiecekI use this one: https://github.com/openstack/openstack-ansible-os_keystone/blob/master/examples/playbook.yml12:12
Amit82Now any idea about this failures: http://paste.openstack.org/show/600756/. setup-hosts.yml is going on but I think it will ultimately.12:13
Amit82does 14.0.8 works on any Ubuntu Server 16.04?12:14
*** johnthetubaguy has joined #openstack-ansible12:14
odyssey4meAmit82 yes, Ubuntu Xenial is supported for Newton12:17
odyssey4mein fact, it is best to use Xenial if you can12:17
*** Amit82_ has joined #openstack-ansible12:18
lwiecek@odyssey4me I use the playbook after doing some additional manual "pre" tasks like install mariadb, setsebool -P httpd_can_network_connect_db on, creating root with grant option and privileges and setenforce 0. (centos machine)12:18
odyssey4melwiecek hmm, it's likely that the example needs updating as the role has gone through some changes12:18
odyssey4melwiecek this is the one we use and test well: https://github.com/openstack/openstack-ansible/blob/master/playbooks/os-keystone-install.yml12:18
*** Amit82 has quit IRC12:19
odyssey4meandymccr I wonder if we shouldn't have a job that tests the example on a host without containers or something12:19
odyssey4meotherwise the examples are meaningless and should be removed12:19
*** SerenaFeng has quit IRC12:20
lwiecekok thank You for answer, I will try it now12:20
andymccrodyssey4me: its a decent idea12:20
Amit82_Now any idea about this failures: http://paste.openstack.org/show/600756/. setup-hosts.yml is going on but I think it will ultimately.12:21
Amit82_fail ultimately12:21
odyssey4meAmit82_ it seems like your lxc hosts don't have access to the internet?12:21
odyssey4melxc_hosts needs to download the base container12:21
*** Fenuks has quit IRC12:22
*** xar- has quit IRC12:22
*** xar- has joined #openstack-ansible12:23
andymccrevrardjp: can i get a review on https://review.openstack.org/#/c/438927/ - its blocking some master role gates12:24
*** retreved has joined #openstack-ansible12:24
Amit82_odyssey4me: this is my /etc/network/interfaces on infra node: http://paste.openstack.org/show/600759/. eth1 is the NW IP providing internet access to infra node12:25
Amit82_Am I missing anything in this configuration12:26
Amit82_?12:26
odyssey4meAmit82_ as long as the host is able to reach the internet - test using ping or wget or curl to an internet URL12:27
Amit82_These are my routes at infra: http://paste.openstack.org/show/600761/12:27
Amit82_yes, infra and compute both are able to access the internet12:27
odyssey4methen use verbose execution of the playbook to see what's going on and what the error is12:27
odyssey4me-vvv12:27
Amit82_ok12:28
Amit82_can I interrupt playbooks in between12:28
Amit82_using ctrl+c12:28
Amit82_and re-run them12:28
Amit82_?12:28
*** woodard has joined #openstack-ansible12:34
Amit82_odyssey4me: Inspite of the error as mentioned in http://paste.openstack.org/show/600756/, here are the end results: http://paste.openstack.org/show/600763/12:37
Amit82_Is it a success12:37
Amit82_?12:37
*** kong has quit IRC12:39
*** woodard has quit IRC12:39
*** csmart has quit IRC12:39
*** csmart has joined #openstack-ansible12:40
*** Amit82_ has quit IRC12:42
*** thorst has joined #openstack-ansible12:47
openstackgerritMerged openstack/openstack-ansible-rsyslog_client master: Test for rsyslog_all group before conditional  https://review.openstack.org/43892712:51
*** manheim_ has quit IRC12:53
*** afranc has quit IRC12:56
*** KarlKloppenborg has joined #openstack-ansible12:57
mgariepymorning everyone12:58
*** manheim_ has joined #openstack-ansible12:59
*** Hosam has joined #openstack-ansible12:59
*** jmckind has joined #openstack-ansible13:00
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-rsyslog_client stable/ocata: rsyslog client tasks overwriting rsyslog server config  https://review.openstack.org/43884513:01
*** afranc has joined #openstack-ansible13:01
*** manheim_ has quit IRC13:01
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-rsyslog_client stable/newton: rsyslog client tasks overwriting rsyslog server config  https://review.openstack.org/43884613:03
-openstackstatus- NOTICE: restarting gerrit to address performance problems13:04
*** ChanServ changes topic to "restarting gerrit to address performance problems"13:04
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_nova master: Adjust conf for deprecation warnings  https://review.openstack.org/43800813:04
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_nova master: Adjust conf for deprecation warnings  https://review.openstack.org/43800813:06
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/newton: Remove ceilometer from the gate  https://review.openstack.org/43896013:07
andymccrmhayden: ^ i've tried to fix that rst to include a : but the gate complains about it still, so i think its best to just leave the : out. (mostly im tired of messing about with that reno so yeah!)13:09
odyssey4meandymccr I think you can use a :, but only if the list item is - |13:09
odyssey4mebut yeah, better to avoid using : as reno interpets it as a section13:10
andymccrodyssey4me: i'll remember for next time :) but after 6 patchsets, or so, on reno i filed that one in the "don't care/too hard" basket.13:10
*** Hosam_ has joined #openstack-ansible13:10
andymccri think people can figure out its a list :P since it'll list!13:10
andymccri do appreciate mhayden's pursuit of perfection!13:11
*** aetaric has quit IRC13:11
*** git-harry has quit IRC13:11
*** kylek3h has joined #openstack-ansible13:12
*** Hosam has quit IRC13:14
*** git-harry has joined #openstack-ansible13:16
*** manheim_ has joined #openstack-ansible13:18
*** aetaric has joined #openstack-ansible13:21
*** Hosam_ has quit IRC13:26
*** klamath has joined #openstack-ansible13:26
*** klamath has quit IRC13:26
*** klamath has joined #openstack-ansible13:26
mhaydenandymccr: ah we probably need a pipe (|) in there13:30
andymccrmhayden: feel free to do your magic :D13:30
andymccrmhayden: you don't want to be lying awake tonight - unable to sleep - thinking about that missing : that could've made it obvious it was a list ;)13:31
*** Hosam has joined #openstack-ansible13:33
-openstackstatus- NOTICE: ok gerrit is back to normal13:33
*** ChanServ changes topic to "ok gerrit is back to normal"13:33
mgariepyhaha13:34
asettle*head desk*13:35
*** Hosam has quit IRC13:38
*** ChanServ changes topic to "Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: https://goo.gl/tTmdgs"13:38
-openstackstatus- NOTICE: gerrit is back to normal and I don't know how to use the openstackstaus bot13:40
mgariepylogan-, mattt or anyone else :) can you please tell me why we need to install libvirt-bin via the ceph client role ? https://github.com/openstack/openstack-ansible-ceph_client/blob/master/vars/main.yml#L4213:41
matttmgariepy: i think it runs some libvirt command13:42
matttmgariepy: https://github.com/openstack/openstack-ansible-ceph_client/blob/master/tasks/ceph_auth_extra_compute.yml#L7513:42
mgariepyhmm. ok, i'll patch that up for centos then.13:42
Andrew_jedimgariepy: I think it is needed for rbd block devices13:43
Andrew_jedimgariepy: I guess, libvirt communicates with qemu which then communicate with librd and then librbd talks to OSDs and Mons13:44
Andrew_jediohh, the client role, sorry nevermind13:45
alextricity25andymccr: Could you give me a little background as to why the telemetry services were removed from gate? Where there certain gate failures that happened? I'm asking mainly to see what we can do to make it better.13:45
*** svayrette has joined #openstack-ansible13:46
*** Andrew_jedi has quit IRC13:46
andymccralextricity25: its a timing thing - they'll be moved to a periodical test13:46
mgariepyAndrew_jedi, no worry.13:46
alextricity25andymccr: cool. Where can I view the periodic jobs?13:46
andymccralextricity25: they are not up yet - odyssey4me is working on the upgrade test and setting the groundwork for that13:47
alextricity25andymccr: Alright. I'll circle back with you guys later, then. Thanks! :)13:47
andymccralextricity25: no problem - i'll try remember to give you a ping once thats all up and running13:47
alextricity25Thank you!13:47
*** lwiecek has quit IRC13:48
mgariepymattt, wouldn't it be safe to assume libvirt will be installed by the nova role first ? https://github.com/openstack/openstack-ansible/blob/master/playbooks/os-nova-install.yml#L141-L15113:49
odyssey4mealextricity25 yep, the plan is to shift the longer running and more complex scenario tests into periodic jobs13:50
evrardjpmgariepy: well we move to a different order with recent cloudnull's patch13:50
evrardjpso I guess we can think differently now13:50
odyssey4meI'm hoping to have the first one (upgrade) implemented this week, then we can add more scenario's13:50
*** gouthamr has joined #openstack-ansible13:50
alextricity25odyssey4me: that's a good plan. Let me know if I can help in anyway.13:51
mgariepyevrardjp, https://review.openstack.org/#/c/438671/4/playbooks/os-nova-install.yml still runs after ?13:53
*** esberglu has joined #openstack-ansible13:54
*** Oku_OS has quit IRC13:56
matttmgariepy: yeah not entirely sure about that one13:58
matttmgariepy: nova should always get installed first, and then ceph_client (discounting any changes cloudnull is making)13:58
evrardjpmgariepy: well I didn't really have a look :/14:02
mgariepycloudnull, what are you planning to do with the ceph_client ? can I safely remove libvirt-bin package from the ceph_client role ?14:02
*** openstackgerrit has quit IRC14:03
evrardjpI just had to barge in, just in case you didn't know14:03
*** openstackgerrit has joined #openstack-ansible14:05
openstackgerritMarc Gariépy proposed openstack/openstack-ansible-ceph_client master: Remove libvirt-bin package from ceph_client role  https://review.openstack.org/43896914:05
matttmgariepy: did you test https://review.openstack.org/#/c/438969/1/vars/main.yml ?14:05
mgariepyit would be nice to be able to tests a patch against the integrated role on jenkins :)14:05
matttoh yeah, forget we have a ceph job now :-/14:06
mgariepywe don't have anything to test it automatically tho.14:06
matttbleh14:06
mgariepywould be nice to push a fake patch that depends-on another patch and to have both patch tested together ;)14:07
matttcan you test that manually then?  i'm worried that reviewers will just come along and +2 that and it causes some problems down the line14:07
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_octavia master: Initial Octavia role work  https://review.openstack.org/41721014:07
mgariepyyep i'll test it.14:08
mattti looked at the original review to see if there was any indication, but couldn't see it14:08
mgariepyI guess it was because it runs some libvirt commands but i14:09
*** Oku_OS has joined #openstack-ansible14:09
mgariepydon't think it would break things right now.14:09
*** aetaric has quit IRC14:11
*** DimGR has joined #openstack-ansible14:12
*** Jack_Iv has joined #openstack-ansible14:17
*** crushil has joined #openstack-ansible14:18
*** manheim_ has quit IRC14:19
*** The_Intern has joined #openstack-ansible14:21
*** evrardjp[m] has quit IRC14:21
*** fxpester has joined #openstack-ansible14:22
*** sdake has joined #openstack-ansible14:23
*** manheim_ has joined #openstack-ansible14:23
*** aetaric has joined #openstack-ansible14:24
*** evrardjp[m] has joined #openstack-ansible14:25
*** jamesdenton has joined #openstack-ansible14:25
*** sacharya has joined #openstack-ansible14:26
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Use an explicit version of urrlib3  https://review.openstack.org/43897714:26
*** cloudtrainme has joined #openstack-ansible14:30
*** sacharya has quit IRC14:30
*** smatzek_ has quit IRC14:31
*** cloudtrainme has quit IRC14:32
openstackgerritMiguel Alex Cantu (alextricity25) proposed openstack/openstack-ansible-os_ceilometer master: [WIP] Remove Ceilometer API Service  https://review.openstack.org/43723214:34
*** BjoernT has joined #openstack-ansible14:36
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_swift master: Rework swift_rings.py to use the RingBuilder class  https://review.openstack.org/43213214:36
*** whiteveil has joined #openstack-ansible14:38
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Support user shell commands during cache prep  https://review.openstack.org/43863414:41
*** Matias has quit IRC14:42
*** git-harry has quit IRC14:42
*** Matias has joined #openstack-ansible14:44
openstackgerritMerged openstack/openstack-ansible-rsyslog_client stable/newton: Ensure rsyslog restarts after configuration file changes  https://review.openstack.org/43863514:44
*** whiteveil_ has joined #openstack-ansible14:44
*** whiteveil has quit IRC14:45
*** whiteveil_ is now known as whiteveil14:45
openstackgerritMerged openstack/openstack-ansible-rsyslog_client stable/ocata: Ensure rsyslog restarts after configuration file changes  https://review.openstack.org/43863714:45
*** ngupta has joined #openstack-ansible14:45
*** ngupta has quit IRC14:45
*** ngupta has joined #openstack-ansible14:46
*** thorst is now known as thorst_afk14:46
openstackgerritLogan V proposed openstack/openstack-ansible-lxc_hosts stable/ocata: Support user shell commands during cache prep  https://review.openstack.org/43898314:49
openstackgerritLogan V proposed openstack/openstack-ansible-lxc_hosts stable/newton: Support user shell commands during cache prep  https://review.openstack.org/43898414:49
*** zz_pwnall1337 is now known as pwnall133714:50
openstackgerritMerged openstack/openstack-ansible-rsyslog_client stable/ocata: rsyslog client tasks overwriting rsyslog server config  https://review.openstack.org/43884514:53
openstackgerritMerged openstack/openstack-ansible-os_gnocchi stable/newton: Fix gnocchi endpoint variable names  https://review.openstack.org/43866114:53
*** whiteveil has quit IRC14:54
openstackgerritMerged openstack/openstack-ansible-rsyslog_client stable/newton: rsyslog client tasks overwriting rsyslog server config  https://review.openstack.org/43884614:54
Guest85718logan-: Have you been able to test https://review.openstack.org/427855 / https://review.openstack.org/427885 yet?14:54
*** Guest85718 is now known as palendae14:55
logan-working on it this morning14:55
palendaeCool, thanks!14:55
openstackgerritMarc Gariépy proposed openstack/openstack-ansible master: Install rdo package  https://review.openstack.org/43899014:56
*** cjloader_ has joined #openstack-ansible14:57
*** smatzek_ has joined #openstack-ansible14:57
mgariepyevrardjp, odyssey4me andymccr :   https://review.openstack.org/43899014:57
*** fxpester has quit IRC14:57
*** fxpester has joined #openstack-ansible14:57
evrardjpahah good catch14:57
evrardjpsorry I missed it :/14:58
mgariepynot your fault. it's not easy to maintain everything is over 50 repos14:58
*** FrankZhang has joined #openstack-ansible14:58
*** weezS has joined #openstack-ansible15:00
*** Jack_Iv has quit IRC15:01
evrardjpit was worse before :D15:01
*** Jack_Iv has joined #openstack-ansible15:01
openstackgerritMerged openstack/openstack-ansible-os_horizon stable/ocata: ensure OPENSTACK_KEYSTONE_URL is always configured  https://review.openstack.org/43798315:02
*** git-harry has joined #openstack-ansible15:03
*** TxGirlGeek has joined #openstack-ansible15:06
nea1mattt: nope it is still failing15:07
xdfilanyone see my ansible "ini_file" module example? http://paste.openstack.org/show/hSlTa7HApTqui2fPj4cf/15:07
openstackgerritMerged openstack/openstack-ansible-os_gnocchi stable/ocata: Fix gnocchi endpoint variable names  https://review.openstack.org/43866215:08
xdfilyou guys ever consider that module in the past?15:08
logan-xdfil: thanks to cloudnull we have config_template which offers the same flexibility without requiring every single option being enumerated in the task. https://docs.openstack.org/developer/openstack-ansible/draft-operations-guide/advanced-config.html15:09
xdfilI thought it was the best way to have multiple playbooks touch the same config file15:09
*** Andrew_jedi has joined #openstack-ansible15:09
logan-failed to link the anchor https://docs.openstack.org/developer/openstack-ansible/draft-operations-guide/advanced-config.html#example-task-using-the-config-template-module15:10
Andrew_jediFolks, somebody just asked me whether it is possible to run OSA in pull mode,  https://linux.die.net/man/1/ansible-pull, i don't know the answer so i thought i should ask here15:10
openstackgerritMajor Hayden proposed openstack/openstack-ansible-security stable/newton: Add conf file entry for chrony  https://review.openstack.org/43885215:11
openstackgerritMerged openstack/openstack-ansible-os_keystone master: Conditionally run appropriate db_sync commands  https://review.openstack.org/43213415:12
*** rgogunskiy has quit IRC15:13
evrardjpdear cloudnull, mattt, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, Sam-I-Am, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, mhayden, scarlisle, luckyinva, ntt, javeriak, automagically,15:13
evrardjpspotz, vdo, jmccrory, alextricity25, jasondotstar, KLevenstein, admin0, michaelgugino, ametts, v1k0d3n, severion, bgmccollum, darrenc, JRobinson__, asettle, colinmcnamara, thorst, adreznec, eil397, qwang, nishpatwa_, cathrichardson, drifterza :15:13
evrardjpthe osa bug triage will start in 45’. Please have a look at the bug list before starting: https://etherpad.openstack.org/p/osa-bugtriage15:13
evrardjpwell I will have to remove automagically from this list :/15:13
alextricity25yay15:13
logan-gonna be a marathon this week15:13
alextricity25too soon :(15:13
*** lucasxu has joined #openstack-ansible15:15
*** whiteveil has joined #openstack-ansible15:15
*** cjloader_ has quit IRC15:16
*** cjloader_ has joined #openstack-ansible15:16
asettleOh no :(15:16
asettlesad evrardjp15:16
openstackgerritMerged openstack/openstack-ansible-lxc_hosts stable/ocata: Support user shell commands during cache prep  https://review.openstack.org/43898315:16
*** DanyC has quit IRC15:19
nea1oh, sry mattt, its a new error http://termbin.com/xny415:19
openstackgerritLogan V proposed openstack/openstack-ansible-lxc_hosts stable/newton: Support user shell commands during cache prep  https://review.openstack.org/43898415:20
Andrew_jedicloudnull: Hello :), I was wondering whether it is possible to run OSA in pull mode,  https://linux.die.net/man/1/ansible-pull15:20
matttnea1: the error you were hitting was because of setuptools i believe, at least on the branch i was working on it was resolved by downgrading setuptools15:20
*** cjloader_ has quit IRC15:21
nea1mattt: I did a yum reinstall python2-setuptools15:21
nea1lets see what that brings15:21
openstackgerritMerged openstack/openstack-ansible stable/ocata: Final SHA bump before 15.0.0 release  https://review.openstack.org/43893415:22
*** galstrom_zzz is now known as galstrom15:23
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-pip_install master: Install urllib3  https://review.openstack.org/43901715:24
*** marst has joined #openstack-ansible15:25
odyssey4mejmccrory dolphm lbragstad are the db sync return codes available in Ocata?15:25
lbragstadodyssey4me i don't believe so15:26
odyssey4meI was thinking of porting https://review.openstack.org/432134 back to ocata if it is15:26
evrardjp "#is it shipped yet"15:26
lbragstadodyssey4me but let me double check15:26
dolphmlbragstad: i think they landed just after branching for pike15:26
*** sacharya has joined #openstack-ansible15:27
lbragstadyep15:27
lbragstadhttps://review.openstack.org/#/c/416383/15:27
*** sacharya has quit IRC15:27
*** sacharya has joined #openstack-ansible15:28
odyssey4meokie dokey - no backport then15:29
odyssey4mealthough we're now using it for pike, and it works as designed15:30
odyssey4mehappy days!15:30
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-pip_install master: Use an explicit version of urrlib3  https://review.openstack.org/43901715:30
nea1failed again :/15:30
lbragstadodyssey4me good to hear!15:30
evrardjpwell IMO that's not a feature, that's a bug15:33
evrardjp:D15:33
*** aetaric has quit IRC15:36
openstackgerritMerged openstack/openstack-ansible-pip_install master: Use an explicit version of urrlib3  https://review.openstack.org/43901715:37
*** adrian_otto has joined #openstack-ansible15:42
xdfillogan-: Thanks config_template!15:42
*** aetaric has joined #openstack-ansible15:43
xdfiland cloudnull for making it15:43
evrardjphaha it has many lovers, not only cloudnull :)15:44
andymccrcloudnull: evrardjp: mhayden: mgariepy: odyssey4me: palendae: logan-: jmccrory: is anybody waiting on any patches that they view as critical or need to be merged into stable/ocata?15:46
palendaeandymccr: Only one I can think of is https://review.openstack.org/#/c/427855/, maybe. Logan's planning on testing today, but has to use the newton branch15:47
evrardjpandymccr: I'm gonna bring a few patches in the next hours to fix the urllib3 mess15:48
odyssey4meevrardjp yep, but those can probably wait until a hotfix release15:48
evrardjpI think it deserves to be included, but we've been living with that for a while15:48
odyssey4mepalendae yep, I'm waiting for logan's confirmation15:48
*** fxpester has quit IRC15:48
*** ngupta has quit IRC15:48
andymccrevrardjp: palendae: roger - will wait on those. At this point it's not too dramatic since we "could" release now and hotfix later, but if there are pending patches happy to wait15:49
palendaeandymccr: I'm not sure about the impact of that one...it's basically been the behavior since Newton launched. And it "fixes itself" once brought down15:49
*** ngupta has joined #openstack-ansible15:49
palendaeSo I'd say it's not release critical, maybe a known issue15:49
andymccrpalendae: yeah makes sense. i'll go with a "if it's in it's in!" but i'll wait a bit for it. thanks for raising15:50
mhaydenandymccr: not that i'm aware of15:50
andymccrsweet :)15:51
andymccri think we're in good shape15:51
*** Andrew_jedi has quit IRC15:54
andymccrmattoliverau: i jumped the gun, but https://review.openstack.org/#/c/432132/ is now ready and passing, if you have some time to write testing would be great15:55
mgariepyandymccr, i don't have patches that need merging now but the centos installation is somewhat broken due to the rdo package + apt-cacher-ng stuff.15:55
openstackgerritMerged openstack/openstack-ansible-lxc_hosts stable/newton: Support user shell commands during cache prep  https://review.openstack.org/43898415:56
*** retreved has quit IRC15:56
andymccrmgariepy: what is the fix?15:57
andymccror rather can i help with the fix?15:58
mgariepyi'm not sure what the fix is i haven't got the right config.15:58
mgariepymaybe we can document to set the cacher to off on centos...15:58
*** sdake has quit IRC15:58
*** h5t4_ has quit IRC16:00
evrardjphey guys, guess what.16:00
evrardjpBug triage cloudnull, mattt, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, Sam-I-Am, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, mhayden, scarlisle, luckyinva, ntt, javeriak, automagically,16:01
evrardjpspotz, vdo, jmccrory, alextricity25, jasondotstar, KLevenstein, admin0, michaelgugino, ametts, v1k0d3n, severion, bgmccollum, darrenc, JRobinson__, asettle, colinmcnamara, thorst, adreznec, eil397, qwang, nishpatwa_, cathrichardson, drifterza16:01
evrardjpHere is our bug list for today https://etherpad.openstack.org/p/osa-bugtriage16:01
evrardjp#startmeeting openstack_ansible_meeting16:01
openstackMeeting started Tue Feb 28 16:01:03 2017 UTC and is due to finish in 60 minutes.  The chair is evrardjp. Information about MeetBot at http://wiki.debian.org/MeetBot.16:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:01
asettleHooray16:01
openstackThe meeting name has been set to 'openstack_ansible_meeting'16:01
spotzo/16:01
evrardjpLarge list today16:01
andymccrmgariepy: perhaps that works as a stop gap for now.16:01
evrardjpSo, sorry for not having send an email last week to tell the meeting was cancelled16:01
evrardjpduring PTG16:01
andymccr^i am also sorry for that.16:01
evrardjpanyway, let's move on.16:02
andymccrahha yes quickly move on :P16:02
alextricity25lol16:02
evrardjp:D16:02
evrardjpfirst one of the day!16:02
evrardjphttps://bugs.launchpad.net/openstack-ansible/+bug/166796016:02
openstackLaunchpad bug 1667960 in openstack-ansible "Rebuilding keystone[0] container breaks credential keys" [Undecided,New]16:02
evrardjpI saw a commit in a similar topic, done by logan-16:03
evrardjpI think other ppl voted on it, and I think we can mark this as confirmed16:03
andymccrok16:03
andymccryeah that sounds legit16:03
evrardjpI still think there is other ways to solve this, and we are more and more lacking of a proper facility to do file distribution with ansible16:03
evrardjpbut let's forget this for now, and focus on the bug16:04
evrardjpIMO the criticality is high (at minimum)16:04
evrardjpif we break credential keys, it's serious16:04
logan-agreed on criticality and confirmedness16:04
andymccryeah16:04
andymccragreed16:04
andymccrat least high16:04
logan-because by the time you find out it is broken, the keys are unrecoverable16:04
andymccryeah16:04
evrardjpcritical then?16:04
andymccryeah lets say that16:04
evrardjpok16:04
logan-yep16:04
andymccrthat is pretty nasty16:04
evrardjpwho works on it16:05
evrardjplogan-: you have time to work on this one too?16:05
logan-i have some ideas on how we might be able to solve it. will work on a patch this week for it16:05
evrardjpI think whatever the method, the important is getting it merged right now (harry principle)16:05
openstackgerritMerged openstack/openstack-ansible stable/newton: Bump BIRD and etcd role pins  https://review.openstack.org/43868816:05
evrardjplogan-: great!16:05
openstackgerritMerged openstack/openstack-ansible master: Use an explicit version of urrlib3  https://review.openstack.org/43897716:06
evrardjplet's move on the next one.16:06
evrardjphttps://bugs.launchpad.net/openstack-ansible/+bug/166781416:06
openstackLaunchpad bug 1667814 in openstack-ansible "inventory-manage.py --file option can cause the output to overwrite the default inventory file" [Undecided,New] - Assigned to Joel Griffiths (5s-ubuntu)16:06
andymccrwell id rather it was a good fix than an anything goes fix :P but yeah it would be good to get it fixed asap16:06
*** whiteveil_ has joined #openstack-ansible16:06
evrardjpI was not even aware of this feature16:07
*** whiteveil has quit IRC16:07
*** whiteveil_ is now known as whiteveil16:07
evrardjppalendae: can we assume it's worked on by Joel Griffiths?16:07
andymccrhmm16:07
*** aetaric has quit IRC16:07
evrardjpif True; status -> In Progress?16:07
*** tailDASHeF has joined #openstack-ansible16:08
andymccrahh this one is diff16:08
*** sdake has joined #openstack-ansible16:08
evrardjpthat's a bad bug16:08
andymccryeah16:08
evrardjpcan someone confirm it?16:09
andymccrhavnt tested it16:09
andymccrevrardjp: lets move on - im sure palendae will be back in a bit and can help us look at that one!16:09
evrardjpImportance would be medium because it breaks stuff (high) but with a low probability to happen.16:09
palendaeevrardjp: I'll double check it this afternoon, but last I talked to Joel it sounded plausible16:10
andymccrahh see! easy :P16:10
evrardjp:D16:10
*** cjloader_ has joined #openstack-ansible16:10
evrardjppalendae: you can move it to In Progress if Joel is working on it :)16:10
evrardjpin the meantime confirmed medium16:10
palendaeevrardjp: Alrighty16:10
evrardjpnext16:11
evrardjphttps://bugs.launchpad.net/openstack-ansible/+bug/166779616:11
openstackLaunchpad bug 1667796 in openstack-ansible "lookup url function proxy issue with venv checksum" [Undecided,New]16:11
*** weezS has quit IRC16:11
evrardjplet's wait for news16:11
evrardjptechnically ansible should respect env vars for that16:11
evrardjpIIRC16:12
*** jmckind has quit IRC16:12
andymccrevrardjp: agreed - more info would be good16:12
*** tailDASHeF has quit IRC16:12
evrardjpI'll mark it as incomplete16:12
*** jwitko has joined #openstack-ansible16:12
*** aetaric has joined #openstack-ansible16:12
evrardjpnext16:12
evrardjphttps://bugs.launchpad.net/openstack-ansible/+bug/166774716:12
openstackLaunchpad bug 1667747 in openstack-ansible "Swap creation fails on CentOS AIO" [Undecided,New]16:12
evrardjpI'm fine with the fix.16:13
evrardjp:D16:13
andymccragreed16:13
evrardjpconfirmed low, low hanging fruit16:13
evrardjpany beginner in openstack-ansible wanting to patch this?16:13
evrardjpok let's move on16:14
evrardjpnext:16:14
evrardjphttps://bugs.launchpad.net/openstack-ansible/+bug/166733716:14
openstackLaunchpad bug 1667337 in openstack-ansible "Error running os-nova-install with nova-config tag in 15.0.0" [Undecided,New]16:14
andymccrhmm16:15
evrardjpprobably due to filtering of the tag16:15
evrardjpworth having a look16:15
evrardjpI think cloudnull had a patch for tags in nova IIRC16:15
andymccrjamesdenton: does that only fail with the "--tags", or would it fail normally too?16:15
jamesdentonhi16:16
asettleA wild operator appears16:16
andymccrthe irc ping thing is beautiful :D16:17
jamesdentonso i had no issue with os-nova-install as part of the deploy, only with --tags nova-config16:17
asettleandymccr: truly is16:17
andymccrjamesdenton: ok cool thanks!16:17
*** Oku_OS is now known as Oku_OS-away16:17
evrardjpyeah, the pip install part is not part of config, it's only part of install16:17
jamesdentoni'll hang around for the other bugs, too :P16:17
andymccrjamesdenton: repeat offender!16:17
palendaeStop breaking it16:18
palendae;)16:18
jamesdenton:P16:18
evrardjpthe question is why ansible just doesn't "only run this tag"16:18
evrardjpjamesdenton: meanwhile you can maybe use --skip-tags=nova-install16:18
evrardjpor just run the whole thing16:19
evrardjplet's say confirmed and low for the triage, ok for everyone?16:19
jamesdentoni could - and will - if i need to do it again16:19
jamesdentonthanks for the suggestion16:19
evrardjpI think we could refine this16:19
andymccryeah that tags thing is weird16:19
andymccrbut yeah the triage seems ok16:20
*** Jack_Iv has quit IRC16:20
evrardjpok16:20
evrardjpnext16:20
evrardjphttps://bugs.launchpad.net/openstack-ansible/+bug/166719316:20
openstackLaunchpad bug 1667193 in openstack-ansible "During N->O upgrade, conditional check bombs when inventory hostname not in nova service name" [Undecided,New]16:20
evrardjpstill jamesdenton16:20
*** ngupta has quit IRC16:20
evrardjp:D16:20
*** Jack_Iv has joined #openstack-ansible16:20
jamesdentonahh yes16:20
*** ngupta has joined #openstack-ansible16:20
jamesdentonIn this case, the hostname of the compute node != to the name defined in inventory16:21
andymccroh i see16:21
evrardjpwhat's the difference?16:21
andymccrbasically16:21
logan-it is using ansible_hostname there, not inventory_hostname16:21
evrardjp_ vs - ?16:21
logan-do you have stale facts maybe?16:21
jamesdentonno, in this case the inventory hostname was very basic (ie. compute01) vs i812847.NewtonTest.com16:22
evrardjpansible hostname should be fine, it should be the hostname of the compute node16:22
jamesdentonand the latter is how the services register themselves to Nova16:22
jamesdenton*shrug*16:22
logan-unless you are overriding your nova hostname in nova.conf, ansible_hostname should match the default hostname that nova uses to register its service16:23
evrardjp^ agreed16:23
jamesdentonyeah, definitely not overriding.16:23
evrardjpjamesdenton: check the 127.0.1.1 line in your /etc/hosts16:24
evrardjpcould you report it in the bug?16:24
jamesdentonyes one sec16:24
evrardjpand hostname file16:24
evrardjpI don't see a bug there in the code, but there could be a bug in our hosts file management16:25
evrardjp(I still think we should use dns)16:25
evrardjprabbit!16:25
*** Matias has quit IRC16:25
jamesdentoni will update the bug in a bit - 127.0.0.1 line is just localhost16:26
evrardjpand 1.1 ?16:26
evrardjpBasically dump the file somewhere :)16:27
evrardjpif you can16:27
evrardjpsame for hostname16:27
evrardjpin the meantime, I'll have to continue the triage16:27
evrardjpwe have many bugs today16:27
evrardjpnext16:27
evrardjphttps://bugs.launchpad.net/openstack-ansible/+bug/166713016:27
openstackLaunchpad bug 1667130 in openstack-ansible "During N->O upgrade, nova-api-os-compute service won't start" [Undecided,New]16:27
*** Matias has joined #openstack-ansible16:27
evrardjpI guess it's all the same issue16:27
evrardjpif you can't properly list and match, that's gonna be a problem, right?16:28
jamesdentonevrardjp i will get you the info after this16:29
jamesdentonthat bug there is related to systemd16:30
evrardjpandymccr: could you have a look at this one?16:30
evrardjpso nova_compute_wait should run after a flush handlers16:30
andymccrhmm16:31
evrardjpso I guess the flush handlers should have been doing a systemctl reload16:31
andymccri'll look16:31
*** cloudtrainme has joined #openstack-ansible16:31
evrardjpthanks16:31
andymccrwe dont seem to do a systemctl reload so maybe we need that instead?16:31
evrardjpfun with placement api moves ! :)16:31
evrardjpoh I thought we had that in handlers16:31
evrardjpyes we do16:32
andymccrmost likely cells16:32
andymccrahh daemon reload16:32
evrardjpyes16:32
andymccryeah16:32
andymccrok16:32
jamesdentonyeah andymccr, daemon reload!!!16:32
evrardjpmaybe the module notified doesn't have it16:32
evrardjpin that case, we need to daemon reload16:32
evrardjpjamesdenton: if you have the full playbook run it could help, this way we see which one changed, and therefore which notified handler needs a daemon reload16:33
evrardjpor we can just daemon_reload everywhere :D16:33
andymccryeah im wondering when it failed to restart16:33
andymccrhmm16:33
andymccrok well we can move on16:34
jamesdentonevrardjp i may have to get that to you later as well - i can try to run thru this upgrade in another environment. Sorry I don't have that info anymore. Let me know how i can make the bug reports more informational moving forward16:34
evrardjpprobably we can change command: /bin/true to systemd module, and force it changed_when :D but that's not really better IMO16:34
evrardjpjamesdenton: thanks!16:34
*** pcaruana has quit IRC16:34
evrardjpsometimes it's also helpful to have vars, but here I don't think it's gonna be needed :D16:35
evrardjpFYI :p16:35
evrardjpok next16:35
andymccri just wonder why nova crashed if we do a daemon reload on restarts...16:35
evrardjphttps://bugs.launchpad.net/openstack-ansible/+bug/166712716:35
openstackLaunchpad bug 1667127 in openstack-ansible "Error running nova-install.yml during N->O upgrade due to table permissions" [Undecided,New]16:35
andymccrbut anyway16:35
jamesdentonhey, me again16:35
evrardjpandymccr: yes, let's gather more info.16:35
evrardjphaha :D16:35
andymccri hate cells :P16:35
evrardjpjamesdenton: you are the bug reporter of the week, congratulations!16:35
jamesdentonearly adopter award16:36
evrardjpwell you got the nova fun :D16:36
andymccrhmm16:36
evrardjpjust a little after andymccr :D16:36
andymccrthe cell0 db should need access from nova_api user not nova user afaik16:36
evrardjpI can't confirm or deny :/16:37
jamesdentonOperationalError: (pymysql.err.OperationalError) (1044, u"Access denied for user 'nova'@'%' to database 'nova_cell0'")16:37
evrardjpis there someone else that can help here?16:37
evrardjpwe don't want to overburden andymccr with nova, right ?16:38
andymccrhmm16:38
andymccrhow is our gate passing is my question :/16:38
evrardjpjamesdenton: is that a greenfield?16:38
jamesdentonN->O upgrade16:38
evrardjpooh16:38
evrardjpoh yes, I didn't see that in the title.16:38
evrardjpyou live on the edge!16:39
jamesdentonyeah, i enjoy the pain16:39
evrardjpI'd be happy to mark that has a high importance, but I can't confirm it16:40
andymccrits high for upgrades at least16:40
evrardjpandymccr: let's mark it as confirmed and high? Could we have some eyes in the community there?16:40
evrardjpthat was meant to be 2 sentences16:41
*** Jeffrey4l has quit IRC16:41
*** csmart has quit IRC16:42
evrardjpok I'll leave it as is, hoping it gets more attention next week16:42
evrardjpnext one is16:42
evrardjp(sorry for that)16:42
*** Jeffrey4l has joined #openstack-ansible16:42
evrardjpso next one is16:42
evrardjphttps://bugs.launchpad.net/openstack-ansible/+bug/166710316:42
openstackLaunchpad bug 1667103 in openstack-ansible "Error upgrading MariaDB during N->O upgrade" [Undecided,New]16:42
evrardjpcan we voluntold mancdaz for this one?16:43
andymccryeah just mark it critical and assign it to mancdaz16:43
spotz+1:)16:43
mancdazevrardjp andymccr I don't think you understand how this works16:43
*** The_Intern has quit IRC16:43
*** h5t4 has joined #openstack-ansible16:43
evrardjpyes we do, yes we do!16:43
evrardjp(same voice as in pulp fiction "yes you did")16:44
andymccrthat bug sounds sensible16:44
*** weezS has joined #openstack-ansible16:44
evrardjpyes :/16:44
evrardjpI still think it's worth confirming and high16:44
evrardjpthat's newton16:44
*** Jack_Iv_ has joined #openstack-ansible16:44
evrardjpand breaking stuff16:44
jamesdentonN->O16:44
mancdazit looks familiar16:44
evrardjpfrom N16:44
evrardjpjamesdenton: yes but upgrade of galera should be well known16:45
evrardjp:D16:45
evrardjpI guess systemd again :D16:45
evrardjpandymccr: confirmed high ?16:45
andymccrseems like we're doing a wsrep-new-cluster when we shouldnt16:45
andymccryeah16:45
evrardjpgalera needs love for its systemd units.16:46
evrardjpI'm not assigning mancdaz, but we would be pleased :D16:46
evrardjpnext16:46
evrardjphttps://bugs.launchpad.net/openstack-ansible/+bug/166706016:46
openstackLaunchpad bug 1667060 in openstack-ansible "Ceilometer should batch by number of notification agents" [Undecided,New]16:47
evrardjpstevelle: do you plan to have a commit after that, or do we keep it as wishlist for now?16:47
evrardjpI'm not sure about the risk impact analysis on this one16:47
*** Jack_Iv has quit IRC16:48
*** The_Intern has joined #openstack-ansible16:48
stevelleevrardjp: based on upstream changes, medium is fine.16:48
stevelleif someone wants to run ceilometer at anything beyond 1 node it's high16:49
evrardjpso you mean we are breaking things?16:49
stevelleyou *can* get incorrect metrics if it's set wrong16:49
evrardjpok16:50
stevellenot /will/16:50
evrardjpok, it breaks the user experience if wrongly deployed, so I understand your classification16:50
evrardjpI'd be enclined to say medium16:50
stevelleagree16:50
evrardjpLet's put that into confirmed medium16:50
evrardjpanyone can pick bugs, right :D16:51
andymccrtrue true16:51
*** csmart has joined #openstack-ansible16:51
evrardjp(just a friendly reminder :D)16:51
evrardjpok next16:51
evrardjphttps://bugs.launchpad.net/openstack-ansible/+bug/166676516:52
openstackLaunchpad bug 1666765 in openstack-ansible "RPC settings not set for neutron agents" [Undecided,New] - Assigned to Bjoern Teipel (bjoern-teipel)16:52
evrardjpthere are fixes in it16:52
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts stable/newton: Add Trusty backports repo if it is not enabled  https://review.openstack.org/43905316:52
evrardjpstill the status is new16:52
evrardjpI'll retag16:52
*** agrebennikov has joined #openstack-ansible16:53
evrardjpnext one16:53
evrardjphttps://bugs.launchpad.net/openstack-ansible/+bug/166662516:53
openstackLaunchpad bug 1666625 in openstack-ansible "Ceilometer still sending samples to messaging queue" [Undecided,New]16:53
evrardjpstevelle: could you give your opinion?16:54
evrardjpit sounds legit16:54
evrardjpalextricity25: are you working on it?16:54
alextricity25not at the moment, no.16:55
alextricity25I'm working on deprecating the ceilometer api ATM16:55
evrardjpok16:55
evrardjpwell I can't say for prios, but it sounds a good thing to fix :p16:55
alextricity25actually....This one was resolved by removing the ceilometer-collector16:55
stevelleyeah, that was resolved at PTG16:55
evrardjpso we fixed that during the PTG?16:56
evrardjpDo you have a commit I can refer to?16:56
stevellelooking16:56
evrardjpthanks16:56
alextricity25evrardjp: https://review.openstack.org/#/c/436222/16:57
stevelle I396b154d106c0afba44d57792ae6dad39b33a6f516:57
alextricity25evrardjp: So really this bug was fixed by another bug fix16:57
*** rmelero has joined #openstack-ansible16:57
evrardjpyou are talking about the same16:57
evrardjpok16:57
evrardjpgood16:57
evrardjpI'll mark this as fix released.16:58
alextricity25I just forgot to reference that. Sorry16:58
evrardjpno that's fine :)16:58
stevellefix committed*16:58
andymccrboom fixing bugs16:58
evrardjpin which world are we living!16:58
evrardjpAnyway, we don't ahve time for the next bugs, so let's call it a day, and postpone to next week16:59
andymccrsi si16:59
evrardjpThe imperatress?16:59
evrardjpIf that translate16:59
evrardjp+s16:59
andymccrjamesdenton: i'll be spinning up some aio stable/newton to test those upgrades16:59
andymccrhopefuly get some done tomorrow/thursday16:59
evrardjpandymccr: thanks!16:59
jamesdentonthanks andymccr. I don't know how soon i can get it done16:59
evrardjpCollaboration \o/17:00
evrardjpLet's close the meeting for today17:00
evrardjpThanks everyone17:00
stevelle\o17:00
evrardjp#endmeeting17:00
openstackMeeting ended Tue Feb 28 17:00:32 2017 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)17:00
openstackMinutes:        http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2017/openstack_ansible_meeting.2017-02-28-16.01.html17:00
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2017/openstack_ansible_meeting.2017-02-28-16.01.txt17:00
openstackLog:            http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2017/openstack_ansible_meeting.2017-02-28-16.01.log.html17:00
mgariepyandymccr, should I make a releasenote about the pkg cache issue on centos ?17:01
andymccrmgariepy: so there is no way for us to remove it only on centos? or we have tried and it broke things?17:01
mgariepyI have tried but i'm not sure how to fix the config.17:02
logan-i think you missed one evrardjp https://bugs.launchpad.net/openstack-ansible/+bug/166508417:02
openstackLaunchpad bug 1665084 in openstack-ansible "M->N upgrade causes container reboot due to bind mounts" [Undecided,New]17:02
evrardjpOh :/17:03
evrardjpsorry17:03
*** sdake_ has joined #openstack-ansible17:03
mgariepythis one affect minor upgrade also.17:03
evrardjpoh no I didn't miss it, we just didn't got the chance to do it in this hour17:03
logan-oh gotcha17:03
evrardjpwe only have one hour17:03
*** crushil has quit IRC17:05
mgariepyandymccr, we can only have a release note for it for the time being unless you have time to debug apt-cacher-ng  ?17:06
*** sdake has quit IRC17:07
*** mmalik4 has joined #openstack-ansible17:07
andymccrmgariepy: ok lets go with that for now then!17:08
*** ngupta has quit IRC17:09
*** ngupta has joined #openstack-ansible17:09
xdfilI read sometime ago that nova was going to incorporate instance HA natively. Is it a thing yet?17:11
*** vcn[m] has quit IRC17:11
*** csmart has quit IRC17:11
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ceph_client master: Tag clean up  https://review.openstack.org/43872317:14
*** evrardjp[m] has quit IRC17:16
mhaydenFYI i updated the gate parser script to now calculate CUMULATIVE task time -> http://paste.openstack.org/raw/600811/17:16
mhaydenhttps://github.com/major/osa-gate-parser17:16
mhaydenso if the same task runs multiple times in different roles, those will be added together17:16
xdfilrealistic estimates, nice stuff17:17
mhaydenyeah, it highlights repetitive tasks that end up hurting us17:17
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts stable/newton: Add Trusty backports repo if it is not enabled  https://review.openstack.org/43905317:17
odyssey4mecloudnull oops - tiny edit ^17:17
*** manheim_ has quit IRC17:19
cloudnull+217:20
*** ngupta has quit IRC17:20
*** ngupta has joined #openstack-ansible17:20
dmsimardmgariepy: o/ everything properly opens in "popup" windows now: http://46.231.133.111/reports/index.html17:20
*** Amit82 has joined #openstack-ansible17:20
dmsimardincluding line highlights when clicking on actions17:20
Amit82Hi All,17:20
Amit82I just installed OS using OSA Newton release17:21
*** jwitko has quit IRC17:21
dmsimardodyssey4me: by the way, an ARA user reported to me that you have tasks that log private keys :p17:21
Amit82while launching instance, I am facing this error: http://paste.openstack.org/show/600814/17:22
Amit82Any pointers?17:22
*** h5t4 has quit IRC17:22
xdfilAmit82: check disk space on the hypervisors17:23
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts stable/newton: Add Trusty backports repo if it is not enabled  https://review.openstack.org/43905317:23
*** manheim_ has joined #openstack-ansible17:23
xdfil15rc1 doesn't make nova placement credentials seems like17:24
*** h5t4 has joined #openstack-ansible17:24
xdfili have a mysql password but no service password17:24
*** sdake_ is now known as sdake17:24
Amit82nova-compute.log in /var/log/nova are like this: http://paste.openstack.org/show/600816/17:24
Amit82xdfil: you mean to check disk space on compute node?17:25
xdfilAmit82: yeah its the most common reason i see that error17:26
DimGRHello . I am trying to  understand how to set up a haproxy stanza for osa cloud .  I am here : https://docs.openstack.org/developer/openstack-ansible/mitaka/install-guide/configure-haproxy.html    my question is , can I use public Its instead of 172... ?17:26
*** thorst_afk is now known as thorst17:27
xdfilAmit82: second most common is because a neutron agent is not running on the compute host17:27
*** rmelero has quit IRC17:27
DimGRIts = ips17:27
mgariepydmsimard, nice :D17:27
Amit82xdfil: huge disk space is there on compute node17:28
*** karimb has quit IRC17:28
Amit82xdfil: how to check if neutron agent is running on compute or not17:28
Amit82?17:28
xdfilAmit82: i see that now. not really sure17:29
mhaydeninstalling the RDO repo RPM chews up almost 6 minutes in the OSA CentOS 7 gate17:29
mhaydendo we install anything from that particular repo during the pip_install role itself?17:29
xdfilI don't think neutron agent is your problem. But "systemctl status neutro" then tab a few times17:30
*** manheim_ has quit IRC17:31
openstackgerritGerman Eichberger proposed openstack/openstack-ansible-os_octavia master: [WIP] Octavia role hacking  https://review.openstack.org/41721017:32
*** aludwar1 has joined #openstack-ansible17:32
xgerman^^ mhayden updated docs and also forgot a line over the reviews in defaut/main.yml17:32
*** aludwar has quit IRC17:33
xgermanalso alextricity25  I am wondering if you can spare a review17:33
Amit82xdfil: This is what systemctl status neutron... says: http://paste.openstack.org/show/600819/17:35
alextricity25I know nothing about Octavia, so it's going to take me a little bit to catch up haha17:35
alextricity25I will try to take a look17:35
xgermanthanks a dozen!!17:35
xdfilAmit82: ahh check the neutron logs then17:36
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Inherit /etc/crontab from host  https://review.openstack.org/43878417:36
xdfilor maybe just try to start it hehe17:37
openstackgerritMiguel Alex Cantu (alextricity25) proposed openstack/openstack-ansible-os_ceilometer master: [WIP] Remove Ceilometer API Service  https://review.openstack.org/43723217:37
*** evrardjp[m] has joined #openstack-ansible17:40
*** chhavi has quit IRC17:44
*** sdake_ has joined #openstack-ansible17:49
*** sdake has quit IRC17:50
openstackgerritMajor Hayden proposed openstack/openstack-ansible-pip_install master: Optimize pip_install  https://review.openstack.org/43907817:52
*** jmckind has joined #openstack-ansible17:53
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/ocata: Use an explicit version of urrlib3  https://review.openstack.org/43907917:54
*** crushil has joined #openstack-ansible17:54
xdfilwow this error again "'dict object' has no attribute 'ipv4'"17:56
*** aludwar1 has quit IRC17:56
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/newton: Use an explicit version of urrlib3  https://review.openstack.org/43908017:57
*** aludwar has joined #openstack-ansible17:57
xdfilis there a difference between the default ipv4 address and the ipv4 address of the default interface?17:57
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-openstack_hosts master: Remove urllib3 dependency  https://review.openstack.org/43908417:58
*** sdake_ has quit IRC18:02
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-pip_install stable/ocata: Use an explicit version of urrlib3  https://review.openstack.org/43908618:02
*** whiteveil has quit IRC18:02
*** The_Intern has quit IRC18:04
*** ngupta has quit IRC18:04
*** ngupta has joined #openstack-ansible18:05
*** sdake has joined #openstack-ansible18:05
*** cloudtrainme has quit IRC18:06
*** adogrant has quit IRC18:08
*** ngupta has quit IRC18:14
*** ngupta has joined #openstack-ansible18:14
*** The_Intern has joined #openstack-ansible18:19
*** sdake has quit IRC18:21
*** sdake has joined #openstack-ansible18:23
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-pip_install stable/newton: Use an explicit version of urrlib3  https://review.openstack.org/43909218:23
*** agrebennikov_ has joined #openstack-ansible18:27
*** agrebennikov has quit IRC18:28
*** agrebennikov__ has joined #openstack-ansible18:28
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Install rdo package  https://review.openstack.org/43899018:29
*** agrebennikov_ has quit IRC18:32
*** agrebennikov_ has joined #openstack-ansible18:33
*** lucasxu has quit IRC18:34
*** karimb has joined #openstack-ansible18:35
*** agrebennikov__ has quit IRC18:35
*** karimb has quit IRC18:35
mhaydeni think i figured out why the RDO install is slow -> http://paste.openstack.org/raw/600827/18:35
mhayden4 redirects before the actual download :|18:36
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-galera_server master: Fix fact set using ternary filter  https://review.openstack.org/43909818:36
xdfilwow haha18:37
alextricity25xgerman: Is it possible to run an Octavia with the code that's in place right now? If I pull in the integrated repo patch, and the os_ocatavia patch, will it work?18:37
xgermanyou also need the neutron patch18:38
xdfilmaybe it would be better to add the repos with a template18:38
alextricity25xgerman: Ah! I'll pull that one in too. Thanks.18:38
xgermanyeah, let me know — I just installed yesterday and things were a bit uneven18:39
alextricity25I'll let you know :)18:39
xgermanthanks18:39
xdfilmhayden: is the playbook running wget and then yum to install that repo package?18:39
*** tailDASHeF has joined #openstack-ansible18:40
mhaydenxdfil: just yum18:40
xdfilmaybe yum can handle the redirects better18:40
xdfiloh18:40
mhaydeni wonder if we should install it into the cached container...18:42
mhaydenbut then again, people may provide something that overrides it18:42
evrardjpplease remind me to NOT TELL ideas to odyssey4me18:43
odyssey4memhayden so, apparently the unarchive module can fetch directly from a url18:43
evrardjpI am now assigned to deduplicate tasks.18:43
odyssey4meie those tasks where we have 'fetch arhive', then 'unarchive' can be squashed into a single task18:44
evrardjpand unarchive in place18:44
evrardjpthe problem is we don't have checksumming18:44
*** FrankZhang has quit IRC18:45
*** Amit82 has quit IRC18:45
xdfilmhayden: I'm leaning towards a "custom" repo file since the repo.rpms all have strings attached18:45
xdfillooking at rdo-release.repo it just points to centos SIG anyway18:46
xdfiloh those pesky gpg keys18:47
mhaydenpip_install is rerun against all containers as each role runs -- i'm still scratching my head on how to do that better18:49
mhaydenputting in the cache would be ideal, but that's complicated18:49
odyssey4memhayden take them out as a meta dep and only execute them in lxc-container-create and openstack_hosts? ;)18:50
mhaydenrunning it during lxc-container-create won't help much18:50
mhaydenodyssey4me: but then we run into the "20 containers downloading the same RPM" issue18:50
odyssey4meah yes18:50
odyssey4methe other evil is to make the container creation happen in the service plays18:50
mhaydenunless we download it to the host during openstack_hosts and copy it to the container somehow18:51
odyssey4mebut then you have the lxc-container create role executing many, many times18:51
mhaydenvery true18:51
odyssey4meI guess putting it into the cache would work best, but you won't be able to remove the meta-dep because existing environments need those updates to happen18:52
mhaydentrue18:52
mhaydenOLD MAN YELLS AT CLOUD18:52
odyssey4methat's why I was thinking - remove the meta-dep, run it in the openstack_hosts and lxc-container-create play (this keeps the packages and config maintained)18:52
odyssey4methen at least those only get run when you're doing a minor/major upgrade - instead of all the time18:53
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-tests master: Use file lookup to store contents of key files  https://review.openstack.org/43910518:53
odyssey4methe package downloading a million times is not so bad, and if it's in the container cache then it's only going to check for an update when it runs in the lxc-container-create role18:53
mhaydenmakes sense18:54
DimGRHello . I am trying to  understand how to set up a haproxy stanza for osa cloud .  I am here : https://docs.openstack.org/developer/openstack-ansible/mitaka/install-guide/configure-haproxy.html    my question is , can I use public ips instead of 172... ?18:54
mhaydenodyssey4me: i'll propose some patches18:54
evrardjpman why do ppl love lookups now18:55
evrardjpI was alone18:55
*** manheim_ has joined #openstack-ansible18:55
mhaydenbetter than lookdowns18:55
* evrardjp plays drums 18:55
odyssey4meDimGR the example in https://docs.openstack.org/project-deploy-guide/openstack-ansible/ocata/app-config-prod.html may be helpful18:55
jmccroryevrardjp : they're amazing!18:55
evrardjpwait for my next patch!18:55
odyssey4mejmccrory more!18:55
DimGRThanks will take a look18:55
odyssey4mejmccrory I'll show you one that will make you cry big crocodile tears18:56
odyssey4mehttps://review.openstack.org/43309718:56
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-haproxy_server master: Avoid using get_url remotely  https://review.openstack.org/43910718:56
*** manheim_ has quit IRC18:56
evrardjp^18:56
evrardjpjmccrory: not critics of the patch from odyssey4me allowed.18:56
xdfilya know, I don't see the harm in simply installing all repos via centos-release packages and then deleting the /etc/yum.repos.d/~ceph.repo file18:56
evrardjps/not/no18:57
xdfilit would have the desired effect ultimately18:57
mhaydeni learned my lesson from criticizing odyssey4me's patches18:57
evrardjphahah18:57
alextricity25Anybody have a copy of the OSA group picture we took at the PTG? andymccr?18:58
xdfilyum won't flip out if you try to remove/update those packages and the repo file is missing18:58
evrardjpit's published online alextricity2518:58
evrardjpmhayden: I said that because I was at origin of this dirty hack18:58
*** poopcat has joined #openstack-ansible18:59
odyssey4meoh dear jmccrory - something broke: http://logs.openstack.org/55/427855/12/gate/gate-openstack-ansible-openstack-ansible-aio-ubuntu-xenial/1b8511b/console.html#_2017-02-28_18_50_27_55932119:02
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Only insert container hosts into lxc_hosts  https://review.openstack.org/42785519:02
jmccroryohh is the keystone git repo bumped past https://review.openstack.org/#/c/432376/ ?19:03
odyssey4mejmccrory aha, that's probably worth checking19:03
*** whiteveil has joined #openstack-ansible19:04
openstackgerritMarc Gariépy proposed openstack/openstack-ansible-ceph_client master: Add var for libvirt-bin package  https://review.openstack.org/43896919:05
mgariepymattt, it breaks on cinder install for AIO since it's also nova_compute ;)19:05
*** lucasxu has joined #openstack-ansible19:06
*** poopcat has quit IRC19:07
matttmgariepy: but doesn't nova get dropped first, meaning libvirt-bin is installed first?19:07
*** lucasxu has quit IRC19:08
mgariepynop cinder install first then nova, but the ceph_client role want to run the libvirt thing when configuring cinder.19:08
mgariepymattt, https://github.com/openstack/openstack-ansible/blob/master/playbooks/setup-openstack.yml#L1919:09
xdfilI find this teams use of the word "drop" unprofessional and ambiguous :)19:09
odyssey4mejmccrory are you going to push up a sha bump patch for keystone, or shall I?19:10
*** stuartgr has quit IRC19:10
jmccroryyou can, i'm about to leave for early lunch19:10
odyssey4meokie dokey19:10
openstackgerritMajor Hayden proposed openstack/openstack-ansible master: Move pip_install deployment  https://review.openstack.org/43911319:11
mhaydenodyssey4me: ^^19:11
matttmhayden: ahhh!19:12
mhaydenmattt: ooooh?19:12
matttmgariepy: rather :)19:13
mhaydenmgariepy: aaaah!19:13
*** vcn[m] has joined #openstack-ansible19:13
*** csmart has joined #openstack-ansible19:13
matttmgariepy: yeah that makes sense19:13
*** The_Intern has quit IRC19:13
*** The_Intern has joined #openstack-ansible19:13
*** Andrew_jedi has joined #openstack-ansible19:14
openstackgerritGerman Eichberger proposed openstack/openstack-ansible master: Additions to install OpenStack Octavia  https://review.openstack.org/42206219:18
*** The_Intern has quit IRC19:18
evrardjpmhayden: FYI I love wha you're doing by moving the pip_install role19:19
evrardjphowever, we don't need that everywhere19:19
*** poopcat has joined #openstack-ansible19:19
mhaydenORLY?19:19
*** sdake has quit IRC19:19
evrardjppip_install the world is a step to world domination, but not necessary.19:19
mhaydenwe don't need the role?19:19
evrardjpnot everywhere19:19
evrardjpwell, I'd prefer to have it run everywhere.19:20
evrardjpLet's do it.19:20
mhaydeni plan to back out the meta-deps after this19:20
evrardjpyes I completely understood you19:20
evrardjpand it's gonna be faster19:20
mhaydenoh okay19:20
evrardjpI think I talked about that in the PTG IIRC.19:20
mhaydenit won't hurt to have pip_install on some non-pippy hosts19:20
evrardjpso I was 100%19:21
mhaydenevrardjp: the plane flight back shook the memories of the PTG out of me19:21
evrardjpI'd love it because now we can manage repos there19:21
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Update keystone SHA to support db_sync check  https://review.openstack.org/43912319:21
evrardjpso it's even easier to artifact19:21
openstackgerritGerman Eichberger proposed openstack/openstack-ansible master: Additions to install OpenStack Octavia  https://review.openstack.org/42206219:23
openstackgerritGerman Eichberger proposed openstack/openstack-ansible-os_neutron master: [WIP] Adds Octavia to Neutron  https://review.openstack.org/42897919:25
evrardjpwell it's not 100% because I planned to use openstack_hosts and lxc-container-create to cater for the non lxc hosts19:25
evrardjpbut that's details.19:25
mgariepycan I have some review ? https://review.openstack.org/#/c/438969/19:26
evrardjpso where should I sigh?19:26
evrardjpsign*19:26
evrardjpmgariepy: I'll vote on yours!19:26
odyssey4mejmccrory https://review.openstack.org/439123 <----- that should unbreak the gate you broke19:27
*** sdake has joined #openstack-ansible19:27
odyssey4memhayden evrardjp ^19:28
mhaydenodyssey4me: got it19:29
evrardjpgot it19:29
mgariepyoops wait a sec.19:29
mhaydenalso, it takes 2+ minutes to start nova-placement-api -- sounds unusual19:30
mhaydeni see that on ubuntu and centos19:30
mhaydenis that expected?19:30
evrardjpI think there are issues now19:30
evrardjpsee bug triage19:30
mhaydenah okay19:30
evrardjpI think andymccr would happy to get some help on it19:31
mgariepyevrardjp, ok, you can +W ;)19:32
odyssey4memgariepy as can you19:32
odyssey4meif there are two +2's, you can +w19:32
mgariepyhmm i though i was bad habbit19:32
mgariepybut nice.19:32
*** electrofelix has quit IRC19:32
evrardjpit's a bad habit!19:32
evrardjpwas I the last one?19:33
mgariepythe other day i saw a patch merge with only 1 +219:33
evrardjpthat's definitely a no, unless broken gates19:33
mgariepytechnically 2, but the second one was jenkins ..19:33
evrardjpgenerally urgent fixes could require that -- we leave that to andy :p19:33
alextricity25Anybody know why keystone-manage credential_migrate could be returning a rc of 1?19:38
alextricity25<3 this command. Still returns NOTHING even though the --debug flag is given19:40
evrardjp:D19:41
*** jmckind_ has joined #openstack-ansible19:41
*** jmckind has quit IRC19:41
alextricity25xgerman: did you even have trouble with the keystone-manage credential_migrate command during your ocatavia testing?19:41
alextricity25s/even/ever19:41
xgermannope19:42
alextricity25This must be something different then19:42
alextricity25bah19:42
xgermanneutron gave me trouble when I reran  it19:42
*** lucasxu has joined #openstack-ansible19:45
*** Jack_Iv_ has quit IRC19:47
*** Jack_Iv has joined #openstack-ansible19:48
*** mmalik4 has quit IRC19:48
odyssey4mealextricity25 the integrated gate in master is busted, thanks to jmccrory :p19:48
odyssey4mesee https://review.openstack.org/43912319:48
odyssey4methe roles will work fine as they build straight from trunk19:48
odyssey4mealextricity25 oh hang on, you're talking about something else19:49
mhaydenodyssey4me: i'm still shopping at my local walmart19:49
odyssey4meIIRC lbragstad was the credential migrate expert :)19:49
alextricity25ah bah...lesson learned. I was looking at the keystone patch sets to see if something changed there.19:49
mhaydenpaging Dr. Lbragstad19:50
alextricity25odyssey4me: Ah...yeah. My build is breaking on keystone-manage credential_migrate19:50
alextricity25not db_sync19:50
openstackgerritMajor Hayden proposed openstack/openstack-ansible master: Move pip_install deployment  https://review.openstack.org/43911319:52
*** Jack_Iv has quit IRC19:52
*** cloudtrainme has joined #openstack-ansible19:54
*** hybridpollo has joined #openstack-ansible19:55
*** hybridpollo has quit IRC19:58
*** manheim_ has joined #openstack-ansible19:58
*** hybridpollo has joined #openstack-ansible19:58
openstackgerritMiguel Alex Cantu (alextricity25) proposed openstack/openstack-ansible-os_ceilometer master: Remove Ceilometer API Service  https://review.openstack.org/43723220:01
*** FrankZhang has joined #openstack-ansible20:02
lbragstadmhayden doctor?20:03
lbragstadodyssey4me doctor20:03
lbragstadcloudnull doctor20:03
*** poopcat has quit IRC20:05
*** Jack_Iv has joined #openstack-ansible20:05
*** sdake has quit IRC20:07
*** h5t4 has quit IRC20:07
*** sdake has joined #openstack-ansible20:07
*** poopcat has joined #openstack-ansible20:08
*** DimGR has quit IRC20:11
*** sdake has quit IRC20:13
*** mrhillsman has quit IRC20:13
*** agrebennikov_ has quit IRC20:13
*** sdake has joined #openstack-ansible20:14
*** mmalik4 has joined #openstack-ansible20:16
*** poopcat has quit IRC20:16
*** adrian_otto has quit IRC20:16
*** whiteveil has quit IRC20:18
*** Andrew_jedi has quit IRC20:20
*** mrhillsman has joined #openstack-ansible20:20
*** manheim_ has quit IRC20:23
*** vnogin has quit IRC20:24
*** poopcat has joined #openstack-ansible20:29
*** weezS_ has joined #openstack-ansible20:29
*** weezS has quit IRC20:30
*** weezS_ is now known as weezS20:30
*** askb has joined #openstack-ansible20:30
*** DimGR has joined #openstack-ansible20:35
openstackgerritMerged openstack/openstack-ansible-ceph_client master: Add var for libvirt-bin package  https://review.openstack.org/43896920:35
*** rabel_b1 has joined #openstack-ansible20:37
*** vnogin has joined #openstack-ansible20:40
*** whiteveil has joined #openstack-ansible20:41
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Only insert container hosts into lxc_hosts  https://review.openstack.org/42785520:43
*** DimGR has quit IRC20:44
*** chris_hultin is now known as chris_hultin|AWA20:45
cloudnulllbragstad: doctor20:46
*** sdake_ has joined #openstack-ansible20:46
bgmccollumcloudnull: docker20:47
cloudnullbgmccollum: doctor20:47
spotzMarx brothers?20:47
palendaebgmccollum: Uncalled for20:48
bgmccollumnot sure if cloudnull noticed20:48
cloudnulli did not.20:49
cloudnulli was having a good time20:49
palendaeNow you did it20:49
cloudnulluntil now20:49
palendaeRuined it20:49
cloudnullbah!20:49
cloudnull:)20:49
spotzNo cookies for bgmccollum20:49
bgmccollumtroll fed20:49
*** chris_hultin|AWA is now known as chris_hultin20:49
openstackgerritMerged openstack/openstack-ansible-galera_server master: Fix fact set using ternary filter  https://review.openstack.org/43909820:50
*** sdake has quit IRC20:50
mrdaMorning OSA20:51
mhaydenohai mrda20:51
mrdao/20:51
spotzhola mrda20:53
*** mpotdar_ has joined #openstack-ansible20:54
mrdao/20:55
*** mpotdar_ has quit IRC20:55
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/ocata: Update galera running check for CentOS  https://review.openstack.org/43914920:55
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/ocata: Fix fact set using ternary filter  https://review.openstack.org/43915020:55
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/ocata: Update galera running check for CentOS  https://review.openstack.org/43914920:57
*** kong has joined #openstack-ansible20:58
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/ocata: Install packages in one step  https://review.openstack.org/43713820:58
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/ocata: Fix fact set using ternary filter  https://review.openstack.org/43915020:59
openstackgerritMajor Hayden proposed openstack/openstack-ansible master: Move pip_install deployment  https://review.openstack.org/43911321:00
odyssey4memgagne jmccrory hopefully https://review.openstack.org/439149 & https://review.openstack.org/439150 will bring the galera_server back on track for ocata21:00
odyssey4mesorry mgagne, I meant mgariepy21:00
*** TxGirlGeek has quit IRC21:00
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/newton: Update galera running check for CentOS  https://review.openstack.org/43915321:00
mgagneodyssey4me: still happy to see work on galera role =)21:00
*** ngupta has quit IRC21:01
*** TxGirlGeek has joined #openstack-ansible21:01
*** ngupta has joined #openstack-ansible21:01
mhaydenodyssey4me: i think i got the pip_install patch fixed21:03
mhaydenfound it in the utility container too21:03
*** ngupta has quit IRC21:03
openstackgerritDavid Rabel proposed openstack/openstack-ansible-security stable/newton: Fix auditd restart handler  https://review.openstack.org/43090021:03
*** ngupta has joined #openstack-ansible21:03
odyssey4memhayden ah yes, of course21:03
odyssey4memhayden I'd be interested in hearing thoughts from cloudnull and logan- about that change21:05
cloudnullwhich one ?21:05
cloudnull430900 ?21:05
odyssey4mehttps://review.openstack.org/43911321:06
*** FrankZhang has quit IRC21:07
cloudnullif it saves time and has the same outcome +2 from me21:07
*** FrankZhang has joined #openstack-ansible21:07
*** TxGirlGeek has quit IRC21:09
xdfilpip install was driving me nuts last night on 14.0.721:09
*** TxGirlGeek has joined #openstack-ansible21:09
mhaydencloudnull: it should save time if we remove the meta-deps for pip_install on the IRRs21:09
xdfilless pip install, i like21:10
*** TxGirlGeek has quit IRC21:11
*** cloudtrainme has quit IRC21:12
*** adrian_otto has joined #openstack-ansible21:13
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_nova master: [WIP] Reverse placement api task order  https://review.openstack.org/43915721:13
*** cloudtrainme has joined #openstack-ansible21:14
odyssey4mealextricity25 one minor tweak as far as I can see in https://review.openstack.org/#/c/437232/621:14
*** TxGirlGeek has joined #openstack-ansible21:18
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_nova master: [WIP] Reverse placement api task order  https://review.openstack.org/43915721:18
spotzooh mhayden....21:19
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/newton: Install packages in one step  https://review.openstack.org/43915821:19
mhaydenOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOORLY?21:19
mhaydenodyssey4me: oh that patch is gorgeous21:19
mhaydensuch galera much optimized21:19
mhaydenalextricity25 shouldn't let me have coffee in the afternoon hours21:20
odyssey4memhayden yeah, I know ... it works out21:20
mhaydenkylek3h: BTW, i'd love a screenshot of the ps aufx output from a power machine with 192 nova workers21:20
mhayden:)21:20
spotzmhayden: odyssey4me It is nice and succinct21:21
xdfilI miss power21:21
spotzI miss Ground Town:(21:21
kylek3hI have some with 176 vcpu...will that do?  :-)21:21
*** cjloade__ has joined #openstack-ansible21:21
*** TxGirlGeek has quit IRC21:22
mhaydenkylek3h: of course!21:23
mhaydenyou should just send it to the openstack operators list and say "is this normal?" :)21:23
odyssey4meI miss scotch.21:23
odyssey4meOh wait...21:23
*** dfflanders has joined #openstack-ansible21:24
*** crushil has quit IRC21:24
*** cjloader_ has quit IRC21:24
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/newton: Fix fact set using ternary filter  https://review.openstack.org/43916221:25
xdfilI was having a little trouble understanding why the IBM folks were discussing workers, at that layer of deployment wouldnt the same playbooks/variables apply as they do on x86?21:25
*** cjloade__ has quit IRC21:26
xdfilor does nova on power replace ini files with a DB2 database?21:26
*** whiteveil has quit IRC21:27
kylek3hthe reason we needed to cap the number or workers is that the containers see CPU x SMT8 ... or the systems we're using 22 CPU x 8 = 17621:27
odyssey4mexdfil our default of half the number of CPU's is rather a lot on a power box21:27
*** smatzek_ has quit IRC21:28
xdfilkylek3h: i understand the need to cap the workers, but I find myself in the same situation on x8621:28
xdfili feel like the worker capping should be on both arch21:29
*** cloudtrainme has quit IRC21:29
odyssey4mexdfil it is21:30
kylek3hit shouldn't be unique to power21:30
odyssey4mexdfil it's only been fully implemented in master21:30
palendae9eeb222a-ae92-4e0e-834c-4fa5ba29c5b521:30
palendaeWhoops21:30
palendaehttps://developer.rackspace.com/blog/osa-inventory-happenings/21:30
odyssey4mesome patches are still waiting for final votes in ocata21:30
xdfilI was unsure if there were seperate playbooks being written for the power stuff21:30
odyssey4meand ideally someone should port them back to newton too, I think21:30
*** TxGirlGeek has joined #openstack-ansible21:31
odyssey4menope - OSA works on power and x86, and both mixed thanks to the folks at IBM21:31
odyssey4meit would probably work on arm too if you had the kit21:31
xdfilnewton is old nobody uses it anymore21:31
xdfilI've been setting caps in user_vars21:32
odyssey4mexdfil as you should for your env21:32
xdfilit just seems like if your env /needs/ more workers, then your at the level of knowledge that you know how to make the change21:33
cloudnullmhayden: odyssey4me: +2 on the pip things runs fine21:34
xdfilwhereas the default should be conservitive21:34
*** agrebennikov_ has joined #openstack-ansible21:34
*** TxGirlGeek has quit IRC21:34
*** Jeffrey4l has quit IRC21:35
xdfilbut this is more of an OS thing than an OSA thing. we are compensating for default behavior from the other services21:35
*** TxGirlGeek has joined #openstack-ansible21:35
*** FrankZhang has quit IRC21:37
*** mpotdar has joined #openstack-ansible21:38
*** crushil has joined #openstack-ansible21:38
*** FrankZhang has joined #openstack-ansible21:39
xdfilkylek3h: you an IBMer?21:39
kylek3hxdfil: That's true.  We  are.21:39
kylek3hyes21:39
*** chris_hultin is now known as chris_hultin|AWA21:39
*** jrobinson has joined #openstack-ansible21:39
xdfilMy first exposure to OpenStack was PowerVC21:39
*** TxGirlGeek has quit IRC21:40
xdfilMy last job was heavy on AIX21:40
kylek3hMe too.  I led the nova compute driver team for a few releases of PowerVC.21:40
*** thorst has quit IRC21:41
odyssey4mein another life I broke powervc apart to see how openstack was implemented underneath, with the intent of integrating with it21:42
xdfilcool, I was really enthusiastic about it. The prospect of not having to map things in the VIOS was nice. We never did anything with it though21:42
*** thorst has joined #openstack-ansible21:42
*** whiteveil has joined #openstack-ansible21:44
*** gouthamr has quit IRC21:44
*** sdake_ has quit IRC21:45
*** whiteveil has quit IRC21:45
*** whiteveil has joined #openstack-ansible21:45
*** thorst has quit IRC21:46
*** whiteveil has quit IRC21:46
*** lucasxu has quit IRC21:46
*** mpotdar has quit IRC21:47
*** Jeffrey4l has joined #openstack-ansible21:48
*** mpotdar has joined #openstack-ansible21:48
*** lucasxu has joined #openstack-ansible21:49
*** woodard has joined #openstack-ansible21:50
xdfilodyssey4me: I was thinking of doing the same with Cisco Modeling Lab (CML). I was installing it a couple months ago its basicaly an AIO21:51
odyssey4mexdfil I learned that there be dragons, and sometimes it's best to leave those things alone. :p21:52
xdfilI want to see if i can get those Cisco images to run on a generic deploy21:52
*** mpotdar has quit IRC21:53
odyssey4memhayden it appears to me that by far the most skipped tasks are due to improper playbook target scoping21:53
*** jmckind_ has quit IRC21:54
palendaeAnyone seen an AIO fail to find the bootstrap-host's OS vars files? Using stable/newton and 14.0421:54
alextricity25odyssey4me: Just making sure your paying attention! ;) gropus!21:54
alextricity25lol21:54
odyssey4mewhen you execute the os-nova-install playbook a lot of the tasks are skipped on a per host basis21:54
openstackgerritMiguel Alex Cantu (alextricity25) proposed openstack/openstack-ansible-os_ceilometer master: Remove Ceilometer API Service  https://review.openstack.org/43723221:54
palendaehttp://paste.openstack.org/show/600853/21:55
*** ngupta has quit IRC21:55
odyssey4meI expect that if we setup more dynamic groups for each profile it will make execution much faster21:55
*** woodard has quit IRC21:55
*** ngupta has joined #openstack-ansible21:55
odyssey4mepalendae is your deploy host one of the supported platforms?21:55
palendaeodyssey4me: Each nova profile?21:55
palendaeodyssey4me: It's an AIO on rax public cloud21:55
palendaeUbuntu 14.0421:56
odyssey4mepalendae did it gather facts when executing?21:56
*** Jack_Iv has quit IRC21:56
*** Jack_Iv has joined #openstack-ansible21:56
odyssey4mealextricity25 :)21:56
palendaeHrm, no21:57
palendaeWas using bootstrap-aio.sh21:57
odyssey4mepalendae I figure that perhaps at least splitting playbook execution between the control plane and the sprawl will be beneficial in large environments21:57
odyssey4mepalendae that's weird - it should have, always does for me21:57
palendaeodyssey4me: Yeah, not run into this before...I got it on master, but I wanna test some things in newton. Happening for 14.0.0 and 14.0.1 tags tooo...21:58
palendaeI wonder if I'm missing facter or something21:58
odyssey4mepalendae hmm, odd - I've been building trusty/newton envs all day21:59
palendaePlaybook's value is set to `True`21:59
palendaeI wonder if it's the image I'm using21:59
* palendae squints22:01
palendaeok: [localhost] => (item=/etc/ansible/roles/sshd/vars/Ubuntu_14.yml)22:01
*** Jack_Iv has quit IRC22:01
palendaeThough that's sshd22:01
*** TxGirlGeek has joined #openstack-ansible22:02
*** cloudtrainme has joined #openstack-ansible22:06
*** DimGR has joined #openstack-ansible22:07
*** svayrette has quit IRC22:07
palendaeHuh. Using the image's UUID instead of name in my instance creation playbook seems to have gotten it past that.22:11
openstackgerritGerman Eichberger proposed openstack/openstack-ansible-os_octavia master: [WIP] Octavia role hacking  https://review.openstack.org/41721022:18
*** tailDASHeF has quit IRC22:18
xgermanthat should appease the linter22:18
*** ngupta has quit IRC22:25
*** ngupta has joined #openstack-ansible22:25
*** TxGirlGeek has quit IRC22:26
*** phalmos has joined #openstack-ansible22:27
odyssey4mexgerman if you're looking for reviews, your tests should pass and there should be no WIP marker on the patch22:28
*** gouthamr has joined #openstack-ansible22:29
*** chris_hultin|AWA is now known as chris_hultin22:36
*** phalmos_ has joined #openstack-ansible22:42
*** phalmos has quit IRC22:46
*** galstrom is now known as galstrom_zzz22:46
*** crushil has quit IRC22:48
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts master: Use block-rescue for cache create  https://review.openstack.org/43919922:48
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts master: Use block-rescue for cache create  https://review.openstack.org/43919922:49
*** adrian_otto has quit IRC22:50
openstackgerritMerged openstack/openstack-ansible-haproxy_server master: Avoid using get_url remotely  https://review.openstack.org/43910722:50
*** chris_hultin is now known as chris_hultin|AWA22:50
*** ngupta_ has joined #openstack-ansible22:56
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts master: Allow the use of the different cache variant  https://review.openstack.org/43920122:59
*** ngupta has quit IRC23:00
*** esberglu has quit IRC23:00
palendaeodyssey4me: Yeah, changing from using an image name to an image UUID, both for 14.04 PVHM allowed me to continue23:00
* palendae shrugs23:00
*** ngupta_ has quit IRC23:01
palendaeNo clue why that'd inhibit gathering facts23:01
*** esberglu has joined #openstack-ansible23:02
*** phalmos has joined #openstack-ansible23:03
*** phalmos_ has quit IRC23:06
*** esberglu has quit IRC23:07
*** jamesdenton has quit IRC23:08
*** hybridpollo has quit IRC23:08
*** hybridpollo has joined #openstack-ansible23:08
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts master: Allow the use of a different default cache variant  https://review.openstack.org/43920123:09
odyssey4mepalendae that's quite odd23:11
odyssey4memaybe a different image?23:12
palendaeYeah23:12
palendaeQuite possible23:12
*** lucasxu has quit IRC23:15
*** BjoernT has quit IRC23:18
*** crushil has joined #openstack-ansible23:20
*** pmannidi has joined #openstack-ansible23:22
cloudnullany cores around that might want to give this a nudge https://review.openstack.org/#/c/438723/23:30
*** phalmos_ has joined #openstack-ansible23:30
*** phalmos has quit IRC23:31
odyssey4mecloudnull it depends on another patch that hasn't merged and needs change, so it's a bit pointless right now :p23:31
*** klamath has quit IRC23:31
cloudnullah it depends on it, but is not a child of it23:31
cloudnullso reviewing would get it stag\ged to merge as soon as the other is.23:32
cloudnullstaged23:32
*** vnogin has quit IRC23:37
odyssey4mecloudnull that role is miserable, but that makes it just a teeny bit better23:38
odyssey4meone nit and a question23:39
cloudnull++ that role is miserable.23:39
cloudnulli'm hoping to making it less so, a little at time.23:39
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Move ceph client role to playbooks for faster run time  https://review.openstack.org/43867123:41
spotzWaiting for odyssey4me's nit cloudnull23:42
*** marst has quit IRC23:42
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ceph_client master: Tag clean up  https://review.openstack.org/43872323:45
*** sacharya has quit IRC23:47
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-pip_install stable/ocata: Optimize pip_install  https://review.openstack.org/43924223:48
cloudnullgo for newton ?23:48
cloudnull:)23:48
odyssey4meyep, going to give it a go23:49
*** cloudtrainme has quit IRC23:50
*** DimGR has quit IRC23:51
*** hybridpollo has quit IRC23:51
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-pip_install stable/newton: Optimize pip_install  https://review.openstack.org/43924423:52
*** crushil has quit IRC23:53
xgermanI will remove WIP with the next spin23:54
xgermanotherwise I need to add some space somewhere…23:54
openstackgerritMerged openstack/openstack-ansible master: Update keystone SHA to support db_sync check  https://review.openstack.org/43912323:58
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Install rdo package  https://review.openstack.org/43899023:59
*** hybridpollo has joined #openstack-ansible23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!