Thursday, 2016-01-28

« Wednesday, 2016-01-27 Index Friday, 2016-01-29 »
*** Goneri has joined #tripleo00:03
*** mbound has quit IRC00:34
*** dmacpher has joined #tripleo00:38
*** mbound has joined #tripleo00:42
*** mbound has quit IRC00:44
openstackgerritOpenStack Proposal Bot proposed openstack/diskimage-builder: Updated from global requirements  https://review.openstack.org/27329701:26
*** ccrouch has quit IRC01:36
*** mbound has joined #tripleo01:45
*** shakamunyi has joined #tripleo01:48
*** tiswanso has joined #tripleo01:50
*** mbound has quit IRC01:50
*** shakamunyi has quit IRC02:10
*** shakamunyi has joined #tripleo02:10
*** sthillma has quit IRC02:13
openstackgerritIan Wienand proposed openstack/diskimage-builder: Cleanup unmount_dir function  https://review.openstack.org/27331102:19
*** penick has quit IRC02:20
*** shivrao has quit IRC02:21
*** shivrao has joined #tripleo02:22
*** shivrao has quit IRC02:26
*** sthillma has joined #tripleo02:37
*** Hunner has quit IRC02:39
*** Hunner has joined #tripleo02:39
*** Hunner has joined #tripleo02:39
*** sthillma has quit IRC02:41
*** trozet has joined #tripleo02:43
openstackgerritMerged openstack/instack-undercloud: Clean out os-refresh-config on every run  https://review.openstack.org/27080902:44
*** rhallisey has quit IRC02:48
*** marcusvrn_ has joined #tripleo02:50
*** tzumainn has quit IRC03:01
*** yamahata has quit IRC03:16
*** Marga_ has quit IRC03:38
openstackgerritIan Wienand proposed openstack/diskimage-builder: Cleanup unmount_dir function  https://review.openstack.org/27331103:48
*** coolsvap|away is now known as coolsvap03:54
*** yamahata has joined #tripleo04:17
*** tiswanso has quit IRC04:31
*** lazy_prince has joined #tripleo04:42
*** shivrao has joined #tripleo04:45
*** coolsvap is now known as coolsvap|away04:51
*** rlandy has quit IRC04:57
*** Marga_ has joined #tripleo04:58
*** coolsvap|away is now known as coolsvap04:59
*** tserong has quit IRC05:00
*** Marga_ has quit IRC05:02
*** tserong has joined #tripleo05:05
*** jaosorior has joined #tripleo05:21
*** dmacpher has quit IRC05:33
*** teju has joined #tripleo05:44
*** akuznetsov has joined #tripleo06:00
*** masco has joined #tripleo06:02
*** akuznetsov has quit IRC06:06
*** akuznetsov has joined #tripleo06:07
openstackgerritgreghaynes proposed openstack/diskimage-builder: Resolve sylinks when unmounting  https://review.openstack.org/27326006:08
*** Marga_ has joined #tripleo06:17
*** Marga_ has quit IRC06:17
*** Marga_ has joined #tripleo06:18
*** oshvartz has joined #tripleo06:37
openstackgerritDerek Higgins proposed openstack/tripleo-common: Don't execute the output from wait_for  https://review.openstack.org/27335906:47
*** akuznetsov has quit IRC06:55
*** devvesa has joined #tripleo06:58
*** dshulyak has joined #tripleo07:01
*** jaosorior has quit IRC07:03
openstackgerritafazekas proposed openstack/tripleo-incubator: Enable host-passthrough  https://review.openstack.org/27336407:13
openstackgerritafazekas proposed openstack/tripleo-incubator: Enable host-passthrough on the virt hosts  https://review.openstack.org/27336407:15
*** 14WAAUC5I has joined #tripleo07:26
*** olap has joined #tripleo07:31
*** jaosorior has joined #tripleo07:38
openstackgerritMerged openstack/diskimage-builder: Cleanup unmount_dir function  https://review.openstack.org/27331107:39
*** hjensas has quit IRC07:43
*** jprovazn has joined #tripleo07:55
*** jhenner has quit IRC07:56
*** jhenner has joined #tripleo07:56
*** coolsvap is now known as coolsvap|away08:00
openstackgerritMatthew Thode proposed openstack/diskimage-builder: add support for gentoo to a bunch of elements  https://review.openstack.org/27059708:02
*** fgimenez has joined #tripleo08:03
*** fgimenez has quit IRC08:03
*** fgimenez has joined #tripleo08:03
*** xinwu has joined #tripleo08:07
*** aufi has joined #tripleo08:12
*** barra204 has joined #tripleo08:16
*** marcusvrn_ has quit IRC08:17
*** devvesa_ has joined #tripleo08:18
*** athomas_ has joined #tripleo08:18
*** devvesa has quit IRC08:19
*** shakamunyi has quit IRC08:19
*** athomas has quit IRC08:19
openstackgerritSteve Kowalik proposed openstack/diskimage-builder: Don't use wc -l for the umount check  https://review.openstack.org/27338608:25
*** olap has quit IRC08:27
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Nothing to see here  https://review.openstack.org/11101108:32
*** liverpooler has joined #tripleo08:33
*** gfidente has joined #tripleo08:35
devvesa_hi shardy: this patch has failed again :(08:43
devvesa_https://review.openstack.org/#/c/260413/08:43
openstackgerritDougal Matthews proposed openstack/python-tripleoclient: Set NeutronMetadataProxySharedSecret  https://review.openstack.org/26813108:45
openstackgerritDougal Matthews proposed openstack/python-tripleoclient: Generate a unique DeployIdentifier on updates  https://review.openstack.org/26812608:45
*** mbound has joined #tripleo08:54
*** paramite has joined #tripleo08:55
*** hjensas has joined #tripleo09:00
*** hjensas has quit IRC09:00
*** hjensas has joined #tripleo09:00
*** shardy has joined #tripleo09:00
*** shivrao has quit IRC09:00
*** jhenner has quit IRC09:01
*** lucas-dinner is now known as lucasagomes09:04
*** panda_ has quit IRC09:11
*** panda_ has joined #tripleo09:11
*** olap has joined #tripleo09:15
*** jistr has joined #tripleo09:16
*** jhenner has joined #tripleo09:18
*** jaosorior has quit IRC09:21
*** jaosorior has joined #tripleo09:22
*** nico_auv has joined #tripleo09:22
*** jaosorior has quit IRC09:34
*** akrivoka has joined #tripleo09:35
*** jaosorior has joined #tripleo09:35
*** derekh has joined #tripleo09:38
derekhshardy: I spent some time this morning trying to track down some of our intermittent CI failures09:39
shardyderekh: great, any progress?09:39
derekhshardy: So, on the undercloud heat-engine is now spawning 4 workers, using over a Gig in total09:40
derekhshardy: https://review.openstack.org/#/c/259172/2/heat/cmd/engine.py09:40
derekhshardy: looks like this has been introduced with out move of current-tripleo09:41
mariosshardy: derekh: morning gents. any idea why stable/liberty ha job hits "ERROR: <html><body><h1>503 Service Unavailable" during the pingtest? I saw this https://review.openstack.org/#/c/272479/  yesterday but i don't think it is relevant (at least in the pingtest it is just used for the output there)09:41
shardyderekh: Yeah, that was because when defaulting to one worker, you experience spurious RPC timeouts when you throw 100 nested stack at one process09:41
shardyhttps://bugzilla.redhat.com/show_bug.cgi?id=129094909:41
openstackbugzilla.redhat.com bug 1290949 in openstack-heat "rhel-osp-director: re-ran the deployment command: "Stack failed with status: resources.Controller: MessagingTimeout: resources[0]: Timed out waiting for a reply to message ID 863d0fbc6ce24cd288074d901d1a6e64 ERROR: openstack Heat Stack update failed."" [Unspecified,Post] - Assigned to sbaker09:42
*** xinwu has quit IRC09:42
shardywe might be able to get away with two workers, but 1 has been proven to not be enough09:42
derekhshardy: ya, that was going to be my next question, do you think we can bump it down to two09:43
*** jistr is now known as jistr|biab09:43
shardyderekh: basically there's a balance between the number of nested stacks you have (which in TripleO is a lot) and the number of workers you need to process them (because we round-robin them via RPC, even on a single host with a single worker)09:43
derekhthat was the undercloud, lots of ram being used but not hitting any limits09:43
shardyderekh: we can try - may be worth chatting w/stevebaker, as he decided on 4 as the default09:43
shardyI assume that was based on some evidence, but I'm not sure what09:43
derekhwe are hitting ram limits on the overclound though09:44
shardyah09:44
shardyOn the overcloud, for CI, we can probably just use 1 worker09:44
shardythe stack we're creating is very small for pingtest09:44
derekhshardy: ack stevebaker ^^ see above, any idea is 2 is enough09:44
openstackgerritafazekas proposed openstack/tripleo-incubator: Using host-passthrough cpu mode with virtual hosts  https://review.openstack.org/27336409:44
derekhshardy: various things are being killed by the OOM killer on the overcloud09:44
gfidentederekh, shardy fwiw, two worked fine for me on regular 2 cores hw09:45
derekhshardy: then being restarted by systemd09:45
shardyderekh: really, we need to increase the ram - is that at all possible or are we at the limit?09:45
derekhso the ping test may or maynot work depending on the timing09:45
shardyderekh: if not, then I'd say try 2 workers on the undercloud, and 1 or 2 on the overcloud09:45
gfidenteshardy, regarding the scaling bug, the depends_on did not help09:46
derekhshardy: I can up the ram on the overcloud, will soon know if we hit limits, requires TE host rebuild though09:46
gfidenteshardy, and trying to deploy/update a stack from endpoint_map only does not reproduce09:46
shardyderekh: FYI I have started investgating where all the memory is going, hopefully we can reduce the memory-hog-ness of heat soon09:46
shardyI suspect we've got more circular references as memory is not being freed09:46
gfidenteshardy, so I added what I had in a BZ but I am out of ideas09:46
shardyderekh: I think it's fine to reduce the workers on the overcloud09:47
derekhshardy: cool, it wasn't the biggest ram user on the overcloud09:47
shardyit's the undercloud I'm worried about, as we may swap OOM for message timeouts09:47
*** mcornea has joined #tripleo09:48
derekhgfidente: how much RAM had you with the 2 cores and was it the newer heat ?09:48
shardyderekh: for the overcloud, we can just pass a HeatWorkers:1 parameter in parameter_defaults for CI09:48
shardyderekh: want me to push a patch with that to test?09:49
*** apetrich has quit IRC09:49
derekhshardy: ack, go for it09:49
shardykk09:49
gfidentederekh, I had 8g but was consuming <509:49
afazekasderekh: is it possible to change the memory size of the VMs on the running system (at least +1G to each), and reducing the nr envs to /node to 3 from 4 ?09:49
derekhafazekas: yup, its possible, thats what well have to do if configureing workers doesn't work, or maybe we should do it anyways09:50
*** paramite is now known as paramite|afk09:51
derekhmarios: which job did you see that error on ?09:51
openstackgerritGiulio Fidente proposed openstack-infra/tripleo-ci: Reduce the number of CephStorage nodes to 1  https://review.openstack.org/27342209:52
gfidentederekh, ^^ is what I wrote in the commit message there anywhere true?09:52
mariosderekh: http://logs.openstack.org/13/260413/9/check-tripleo/gate-tripleo-ci-f22-ha/d5fff90/console.html#_2016-01-27_18_55_34_64609:53
derekhgfidente: it will reduce the memory requirements of the Test Env Hosts, a good idea if we're not loosing anything in the actually test, is there any advantage to leaveing it as 2 ?09:54
gfidentederekh, I don't think so09:54
gfidenteas long as we use the code to deploy one09:55
shardyhttps://github.com/openstack-infra/tripleo-ci/blob/master/toci_instack.sh#L24609:55
shardymarios, derekh: do I need more coffee, that TRIPLEO_SH_ARGS doesn't do anything does it?09:55
shardyhttps://github.com/openstack/tripleo-common/blob/master/scripts/tripleo.sh#L10609:56
gfidenteissues with lists formatting and stuff could go uncatches but we haven't had many that I can tell09:56
shardywe need to set OVERCLOUD_DEPLOY_ARGS?09:56
gfidente*uncatched09:56
derekhgfidente: see the comment I left about NODECOUNT09:56
shardyI can't see where we evaluate $@ but I'm fairly uncaffineated atm09:56
openstackgerritGiulio Fidente proposed openstack-infra/tripleo-ci: Reduce the number of CephStorage nodes to 1  https://review.openstack.org/27342209:57
derekhshardy: looking09:57
mariosshardy: grep not giving me any assignment/usage under  tripleo-ci/*09:57
shardymarios: Ok - you added it in the pingtest patch bc240928 so I assumed it was used09:58
shardyI'll rewire it :)09:58
mariosshardy: well, bnemec landed that (I was doing the rebases at the time)09:58
mariosshardy: i mean, i am not disputing it landed with the pingtest, but i have no recollection of that09:59
mariosshardy: /me looks closer09:59
shardyAh, cool git blame gave you the blame, no worries ;)09:59
afazekasderekh, Fri Jan 22 17:33:37 http://fpaste.org/315666/53975086/   (date @number to convert it to human)  , this was the interval when we vas above 45 allocated env09:59
shardytoci_gate_test.sh uses OVERCLOUD_DEPLOY_ARGS so I think that's all good09:59
afazekasderekh, other times the env usage is below 45 usually far bellow09:59
shardyAh, we're using it to add --use-containers10:00
shardynot for general additional args10:00
shardysorry for the noise10:00
openstackgerritGiulio Fidente proposed openstack-infra/tripleo-ci: Add netisov4 parsing to enable network isolated configuration  https://review.openstack.org/27342410:01
gfidentederekh, and ^^ ? was there a reason why we never tried it?10:01
derekhshardy: hmm, could we just use DEPLOY_ARG instead maybe10:01
shardyderekh: I don't think we can use OVERCLOUD_DEPLOY_ARGS, but we could just set USE_CONTAINERS directly10:02
derekhgfidente: is that a new job your adding ?10:03
mariosshardy: i think this is what you meant steve (line 238) https://review.openstack.org/#/c/262028/6/toci_instack.sh10:03
gfidentederekh, actually no I hoped to to add it to an existing job10:04
shardymarios: Yeah, sorry I missed that it was just modifying the line not added the ARGS part10:04
gfidentederekh, maybe to both ha and ceph10:04
*** paramite|afk is now known as paramite10:04
*** apetrich has joined #tripleo10:05
mariosshardy: np. i am trying to understand why overcloud heat was down for the pingtest (I wonder if your discussion with derekh and overcloud ram is relevant here?). i am pretty sure the pingtest itself is ok (it has/is running already right) so was mostly concerned if i'd missed something10:05
mariosshardy: i mean with the args you pointed to so checked it out10:05
derekhmarios: on master at least it looks like we are hitting RAM limits on the overcloud controller, things are getting killed10:07
mariosderekh: well fwiw it has happened twice in a row last two times on that review10:08
mariosderekh: i don't want to just recheck and hammer ci for nothing...10:08
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Override HeatWorkers parameter for deployed overcloud  https://review.openstack.org/27343110:08
shardymarios: from what derekh is saying, it got killed due to insufficient memory10:08
shardy^^ may help10:08
* derekh is hitting his limit for simultaneous conversations10:09
shardylol10:09
* shardy also10:09
derekhafazekas: soo, the only times we got close to the limit was on friday10:09
mariosshardy: yeah i thought that may be the case when you guys were discussion ram limits on the overcloud10:09
mariosdiscussing10:09
shardywe can probably do the same thing for a bunch of other services if needed10:10
openstackgerritMerged openstack/diskimage-builder: Remove argparse from requirements  https://review.openstack.org/27035610:10
derekhafazekas: interestingly at one stage on friday things were being queued on the ZUUL side, so maybe our limit on the number of workers isn't high enough to use all of the envs10:10
shardyderekh: is there something in the CI logs showing oc memory usage, or have you been checking manually?10:11
shardy(other than the OOM killer ;)10:11
derekhshardy: I added a call to top the other day and afazekas has a patch to add stats, one sec10:11
derekhshardy: I havn't actually looked at whats being output yet, but its there https://review.openstack.org/#/c/270139/10:12
derekhshardy: and the patch from afazekas https://review.openstack.org/#/c/271218/  /me will take a look at it today10:13
afazekasderekh: you can see the full log on the vm ~/gearlog  # some line is broken due to missing error handling (lockenv  was not in the output)10:14
derekhgfidente: I'll take a look at that patch in a bit, I think by itself it does nothing, need to confirm10:14
gfidentederekh, yeah it does nothing we need to add the names to the jenkins jobs right?10:14
gfidentewas just curios if there was a reason why we never enabled it in the upstream hw10:15
derekhgfidente: yup exactly, no reason, nobody ever did it and I havn't been following along on the network stuff to know it needed to be done10:15
afazekasderekh: Friday was special so far, on the other times <<45 was enough10:16
derekhgfidente: we could just add it under ha) and ceph)10:16
openstackgerritMerged openstack/diskimage-builder: Add inetutils-ping to test-deps  https://review.openstack.org/26939010:17
gfidentederekh, ack but we need to get the jobs stable first?10:18
*** rcernin has joined #tripleo10:18
derekhafazekas: yup, I know we got loads of free resources when not during peak (most of the time), I'm still reluctant to reduce the number of envs, at least ontil we've explored other options, we also have new jobs the people want to add and other projects tat we want to add our tests to (if we ever have tripleo stable enough)10:20
derekhgfidente: yup10:21
afazekashttp://fpaste.org/315673/76492145/10:21
*** rebrego has joined #tripleo10:22
*** regebro has quit IRC10:22
*** rebrego is now known as regebro10:22
* afazekas something is wrong , I create new one10:23
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Nothing to see here  https://review.openstack.org/11101110:24
*** electrofelix has joined #tripleo10:27
derekhshardy: my top command didn't work10:34
derekh'unknown': unknown terminal type.10:34
derekhshardy: I thought running it in batch mode would make it work ;-(10:34
derekhmarios: I don't see any OOM killing anything on the job you pasted10:35
derekhmarios: this one was it ? http://logs.openstack.org/13/260413/9/check-tripleo/gate-tripleo-ci-f22-ha/d5fff90/10:35
* derekh got a meeting now, bbiab10:35
mariosderekh: yeah. ok thanks. well heat is 503 anyway like at http://logs.openstack.org/13/260413/9/check-tripleo/gate-tripleo-ci-f22-ha/d5fff90/console.html#_2016-01-27_18_55_34_64610:38
*** xinwu has joined #tripleo10:40
*** xinwu has quit IRC10:40
afazekasderekh: 6.96% of the valid samples greater than >45 used env;  17.86%  >30; 35% >1510:43
*** fgimenez has quit IRC10:48
*** fgimenez has joined #tripleo10:48
*** fgimenez has joined #tripleo10:48
openstackgerritGiulio Fidente proposed openstack-infra/tripleo-ci: Deploy using network isolation the HA and Ceph jobs  https://review.openstack.org/27342410:50
*** yamahata has quit IRC10:50
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Run top in batch mode  https://review.openstack.org/27345210:52
* afazekas I used string compare instead of numbers in the first attempt, I could save more samples from the log, the logger is half line script, which needs be 2 line to handle the missing report10:56
*** jistr|biab is now known as jistr10:57
afazekasderekh: would you like to have some more sophisticated process accounting in the jobs (all nodes)?10:59
openstackgerritSteven Hardy proposed openstack/tripleo-docs: Fix NODE_MEM/UNDERCLOUD_NODE_MEM error  https://review.openstack.org/27345911:03
*** paramite is now known as paramite|afk11:07
*** tosky has joined #tripleo11:12
afazekasderekh, https://review.openstack.org/#/c/273364/ this expected to allow you the full host cpu power, however it really expected to help for scientific calculations, and for nested guest11:15
*** mgould has joined #tripleo11:15
*** paramite|afk is now known as paramite11:24
*** marcusvrn_ has joined #tripleo11:26
afazekas` more sophisticated`: like overriding clone, fork, execve(2) *exit*(2)  weak symbols and logging the usage, unless systemtap can work and do the same thing11:27
shardygfidente: I just tried to reproduce your ceph scaling issue, it works for me:11:31
shardyhttp://paste.openstack.org/show/485252/11:31
shardyI did openstack overcloud deploy --ceph-storage-scale 111:31
shardythen after completion I did it again with --ceph-storage-scale 211:31
shardyIt all works11:31
shardynot using network isolation or any other environments tho11:32
shardyThis was on an Undecloud running latest heat w/4 workers, 6G ram and 1G swap11:32
shardyit ran into swap a little bit, but not much11:32
*** teju has quit IRC11:49
*** jdob has joined #tripleo11:49
*** paramite is now known as paramite|afk11:51
*** athomas_ has quit IRC11:53
*** rhallisey has joined #tripleo11:54
*** dprince has joined #tripleo11:59
afazekasderekh, shardy: is the testenv hosts has this ? https://www.kernel.org/doc/Documentation/cpu-freq/intel-pstate.txt12:06
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Nothing to see here  https://review.openstack.org/11101112:08
*** paramite|afk is now known as paramite12:13
*** paramite is now known as paramite|afk12:22
*** paramite|afk is now known as paramite12:25
*** apetrich has quit IRC12:45
*** weshay_xchat has joined #tripleo12:46
*** mgould has quit IRC12:54
*** fgimenez has quit IRC12:55
*** leanderthal has joined #tripleo12:56
*** fgimenez has joined #tripleo12:57
*** fgimenez has joined #tripleo12:57
*** dmacpher has joined #tripleo13:15
*** jayg|g0n3 is now known as jayg13:18
openstackgerritOpenStack Proposal Bot proposed openstack/diskimage-builder: Updated from global requirements  https://review.openstack.org/27329713:19
*** trown|outttypeww is now known as trown13:22
*** tzumainn has joined #tripleo13:26
*** leanderthal has quit IRC13:29
*** jprovazn has quit IRC13:30
*** rbrady has quit IRC13:31
*** rbrady has joined #tripleo13:31
gfidenteshardy, :( dah13:33
gfidentethe only difference I can think of is that I was using network-isolation, let me try without13:33
*** trozet has quit IRC13:46
*** masco has quit IRC13:48
*** apetrich has joined #tripleo13:53
*** pradk has quit IRC13:58
*** egafford has joined #tripleo14:00
*** paramite is now known as paramite|afk14:00
gfidenteafazekas, do you know pretty much how much space would suffice for cinder/lvm to pass tempest without running out of space?14:03
gfidenteI wanted to increase the default loopback device we create as it looks like it's small for tempest14:04
afazekasgfidente: it is depends on the number of threads14:08
afazekasgfidente, ceph or lvm ?14:08
gfidentelvm14:08
afazekasthe loop back file can be sparse, also you can disable the secure delete14:09
afazekasin this case it will not allocate the full file14:09
afazekasTempest on 1 thread expected to use 3..5G , It is just a guess14:09
afazekason multple thread the worse case scenario should less then 3 * number of test classes with volume creation14:10
gfidenteafazekas, I think using seek= https://github.com/openstack/puppet-cinder/blob/4d3e0665c64d86ed4f66a97a9909a2c2892d54eb/manifests/setup_test_volume.pp#L3114:11
gfidenteis making it 'sparse' right?14:11
afazekasy14:11
gfidentebut I think we do the actual secure delete because we don't change that by default14:12
gfidenteso it will consume space after the tests :P14:12
gfidentemight be we could make this into a parameters14:12
*** julim has quit IRC14:13
afazekasIf you try it on a slow disk (without I/O cheat) the delete is slow as usual ..14:15
gfidenteyeah14:15
*** paramite|afk is now known as paramite14:15
afazekasyou can check how big volume devstack is using , tempest is running on these jobs on 4 thread.14:16
ayoungshardy, so...very successful day yesterday.  With dprince14:18
ayoung's most recent changes Keystone ran in HTTPD14:18
ayoungthe population of the Keystone DB was not done, I updated the review with the key issue, which seems to be the URL that is used is a 127.0.0.114:19
afazekasgfidente, 24G was configured, long time ago we run out from 8G the hosts had a lot of space ..14:19
*** lblanchard has joined #tripleo14:21
shardyayoung: nice, good news! :)14:22
ayoungshardy, trying to figure out where that URL comes from14:23
ayoungI assume Puppet14:23
ayoungshardy, BTW your blog post has been super valuable14:23
*** rlandy has joined #tripleo14:23
ayounghttp://hardysteven.blogspot.com/2015/04/debugging-tripleo-heat-templates.html14:23
gfidenteafazekas, looks like 10 now https://github.com/openstack-dev/devstack/blob/master/stackrc#L64914:23
shardyayoung: Ah, cool, I've not updated the blog in a while, I should find time to add some more stuff14:25
ayoungshardy, what would be awesome is "here is how you hack on tripleo"  based on that14:27
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Increase default Cinder LVM backing file to 10G  https://review.openstack.org/27356814:27
ayoungthe whole openstack overcloud deploy --template /home/stack/tripleo-heat-templates/  and how you would see changes in the other component projects14:27
shardyayoung: I think the keystone db connection url is derived via puppet hieradata, which is assigned via this:14:28
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/puppet/controller.yaml#L95914:28
ayoungshardy, not the DB14:28
ayoungthe URL that is used to talk to Keystone itself14:28
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Increase default Cinder LVM backing file to 10G  https://review.openstack.org/27356814:28
shardyayoung: Ah, there's the keystone_*_uri a few lines below that14:29
ayoungshardy, I get calls like http://127.0.0.1:35357/v3/users  showing up in the log14:29
ayoungok looking14:29
afazekasgfidente: It was 24 according to the log, usually devstack gate overrides the default value14:29
shardywhich is derived from our internal EndpointMap, which is basically a template that provides a lookup of all the per-service endpoints14:29
*** tiswanso has joined #tripleo14:29
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/puppet/controller.yaml#L96814:29
gfidenteafazekas, but does tempest run with 4 threads by default?14:30
afazekasgfidente, my local.conf usually has 16G14:30
gfidentemaybe 10 is enough for the default tempest config?14:30
ayoungkeystone_auth_uri: {get_param: [EndpointMap, KeystoneInternal, uri] }14:30
ayoungso  KeystoneInternal  is probably set to 127.0.0114:30
afazekasgfidente: by default it depends on the number of cpus on the executer , it nrcpu/2 AFAIK (maybe nrcpu)14:30
afazekasgfidente, nrcpu14:31
shardyayoung: possibly, you can check by logging into the controller node14:32
afazekasgfidente: anyway you can specify the executors, it can be much larger  if the target system big enough14:32
shardythen looking inside /etc/puppet/hieradata/*14:32
shardyif the hieradata keys have 127.0.0.1, that's your issue14:32
shardyif it has the correct host IP, I guess the requests may be coming from something else14:32
*** jprovazn has joined #tripleo14:32
ayoungshardy, I'm there14:33
shardyThe endpoints are supposed to use the VIPs not localhost tho, so I'm not sure why they'd be setting localhost14:33
gfidentereboot14:33
afazekasgfidente: Usually not tempest the bottle neck , even tough it is not the most efficient load tester I ever saw14:34
ayoung# grep 127  /etc/puppet/hieradata/*14:34
ayoung/etc/puppet/hieradata/controller.yaml:  '127 snmp':14:34
ayoungNope14:34
ayoungshardy, and a look through those files show a lot of proper IP addresses: /etc/puppet/hieradata/controller.yaml:keystone::endpoint::internal_url: http://192.0.2.11:500014:35
*** ccrouch has joined #tripleo14:35
ayoungshardy, so, I get this error when I run  heat deployment-show 3ec8faeb-f098-4c1b-b17a-07ad3e7445f614:35
ayoungheat resource-list --nested-depth 5 overcloud | grep FAILED14:36
ayoungovercloud-ControllerNodesPostDeployment-3hpsgck25dnb-ControllerOvercloudServicesDeployment_Step4-biw27i3id4vk14:37
*** ccrouch1 has joined #tripleo14:37
shardyayoung: to clarify, you run a heat command on the undercloud and see an error in the undercloud keystone log?14:38
ayoungOK...I'm, on a single system install, 3 VMs: instack, 2 controllers.  I ran triple.sh on instack and it failed.  Then I ran the above commands14:39
ayoungso...yes?14:39
*** ccrouch has quit IRC14:40
*** pradk has joined #tripleo14:40
trownfor pre-installing ceph packages in the overcloud-full image, would `yum install -y ceph` be enough, or are there other packages needed?14:42
trownhttp://fpaste.org/315777/53992219/ is what I get with `yum install ceph`14:44
ayoungshardy, I assume -ControllerOvercloudServicesDeployment_Step4  is a heat template, right?14:45
*** pradk has quit IRC14:47
openstackgerritDan Prince proposed openstack/instack-undercloud: Set default Glance backend to Swift  https://review.openstack.org/24849214:48
*** pradk has joined #tripleo14:50
dprinceshardy: I'm going to address your feedback here now14:52
dprinceshardy: https://review.openstack.org/#/c/245314/814:52
dprinceshardy: what you ask for can actually come before or after my patch14:52
dprinceshardy: it is only sort of related, Agree it would be useful to move the UpdatesDeployment into -post though14:52
*** sthillma has joined #tripleo14:54
*** mcornea has quit IRC14:55
*** sthillma_ has joined #tripleo14:56
*** ifarkas has joined #tripleo14:57
*** sthillma has quit IRC14:59
*** sthillma_ is now known as sthillma14:59
*** fgimenez has quit IRC15:00
*** fgimenez has joined #tripleo15:05
*** fgimenez has joined #tripleo15:05
shardyayoung: It's a heat deployment resource:15:05
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/puppet/controller-post.yaml#L8215:05
shardyit applies a puppet manifest to all controller nodes15:05
ayoungshardy, how do I map from what I saw in heat to that file?15:06
ayoungI don't see a heat list-templates command15:06
shardyayoung: I normally grep tripleo-heat-templates for the name of the resource15:06
ayoungshardy, I think we need an RFE there.  We need to be able to swim back upstream to debug15:07
shardyYou can see that -ControllerOvercloudServicesDeployment_Step4 is applying this manifest with a step value of "3"15:07
ayoungwhere is the manifest?15:07
shardyayoung: Yeah, it's already on my todo list15:07
ayoungcool15:07
shardyayoung: there is heat template-show, but that only gives you the top-level template, not all the nested ones15:07
ayoungyou need to know the name15:07
ayoungthe resource does not show the template, does it?15:08
shardyayoung: A SoftwareDeployment resource references a config, which references a manifest:15:08
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/puppet/controller-post.yaml#L8815:08
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/puppet/controller-post.yaml#L2815:08
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/puppet/controller-config.yaml#L2515:09
ayoungtype: OS::TripleO::ControllerConfig  that is the puppet manifest?15:09
shardyayoung: that's a reference to another heat template, so we can switch between pacemaker and non-pacemaker versions15:09
shardyultimately it references t-h-t/puppet/manifests/overcloud_controller.pp15:09
shardyOr overcloud_controller_pacemaker.pp in the HA/pacemaker case15:10
ayoungshardy, I see both environments/enable-tls.yaml:25:    KeystoneInternal: {protocol: 'http', port: '5000', host: 'IP_ADDRESS'}15:12
ayoungnetwork/endpoints/endpoint_map.yaml:66:      KeystoneInternal: {protocol: 'http', port: '5000', host: 'IP_ADDRESS'}15:12
*** pblaho has quit IRC15:14
*** julim has joined #tripleo15:20
ayoungshardy, I wonder if the 127 worked in the past because of the way Keystone was listening to the network would pick up both the public IP address and the localhost, and now HTTPD is explicitly listening to  the public only15:21
*** paramite is now known as paramite|afk15:21
*** paramite|afk is now known as paramite15:23
*** mcornea has joined #tripleo15:23
ayoungEmilienM, dprince with the change to Keystone running in HTTPD, provisioning is failing at the "talk to keystone stage"  because everything is getting URLS based on 127.0.0.1.  I'm on the controller right now, and the public IP addres works,  just not localhost15:26
ayoungEmilienM, dprince shardy, was helping me look at it, and I think it has to do with how KeystoneInternal is build from the controller-config.yaml15:26
ayoungIt looks like this network/endpoints/endpoint_map.yaml:66:      KeystoneInternal: {protocol: 'http', port: '5000', host: 'IP_ADDRESS'}15:28
prometheanfirederekh: https://review.gerrithub.io/#/c/261404/15:30
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Add TimeZone parameter for all node types  https://review.openstack.org/27362315:30
derekhprometheanfire: thanks, will try it this afternoon, sorry my head was elsewhere15:31
prometheanfirederekh: k15:31
prometheanfirenow to wait on https://review.openstack.org/#/c/272884/15:31
*** trozet has joined #tripleo15:32
*** trozet has quit IRC15:34
*** trozet has joined #tripleo15:34
*** egafford has quit IRC15:34
*** masco has joined #tripleo15:39
*** Goneri has quit IRC15:41
*** hjensas has quit IRC15:45
*** lazy_prince has quit IRC15:45
shardydprince: ack, thanks, the main reason for my comment is I wasn't sure if we'd want to move *ArtifactsDeploy or UpdateDeployment15:47
shardyeither will be fine wrt enabling deploying a repo file15:47
dprinceshardy: I'm inclined to move UpdateDeployment into -post15:47
shardyI still wonder if we'd want *ArtifactsDeploy in the per-node template tho, vs *post, which may be disabled e.g in the split stack case?15:47
shardyI can imaging artefact deployment being useful regardless of whether you choose to deploy via puppet15:48
shardyimagine.15:48
dprinceshardy: hmmm, my take is if you only use t-h-t for provisioning there are no artifacts15:48
shardyayoung: I thought we determined it wasn't related to EndpointMap, because the hieradata is fine15:48
shardyayoung: can you just allow httpd to listen on localhost?15:48
shardyI'm pretty sure thats how it used to work15:49
shardyit seems a bit weird (to me at least) to have a service running but not accessible on localhost15:49
*** paramite is now known as paramite|afk15:49
*** paramite|afk is now known as paramite15:50
shardydprince: I guess so, I can imagine times where you'd want to e.g deploy an agent for some other config tool or something15:50
shardybut no concrete use case so it can stay in -post :)15:50
ayoungshardy, WELL, Nova is still in eventlet, and it does not respond to localhost either15:52
ayoungshardy, true, the data stored in hiera files on the server look correct15:54
*** paramite has quit IRC15:55
ayoungshardy, its this stuff  http://paste.fedoraproject.org/315520/93501814/15:55
ayoungshardy, I'm guessing it failed before this, though.15:56
ayoungNotice: /Stage[main]/Keystone::Roles::Admin/Keystone_user_role[admin@admin]: Dependency Keystone_user[admin] has failures: true15:57
*** aufi has quit IRC16:00
shardyayoung: it's puppet connecting to keystone to create users, roles, endpoints etc16:00
shardyit assumes keystone is accessible via localhost, and doesn't use the endpoints provided for the config from heat/hiera16:01
*** morazi has quit IRC16:01
shardynova listens on 0.0.0.0 by default doesn't it?16:01
* shardy spins up overcloud to check how we configure it16:01
bnemecshardy: No, it can't.  That would conflict with the haproxy listener.16:08
* bnemec knows because this is also broken with undercloud ssl right now16:08
shardybnemec: ah, yeah I see it now I've deployed an overcloud16:08
*** yamahata has joined #tripleo16:08
shardyI'm trying to see where the keystone puppet stuff is getting localhost from in ayoung's paste16:09
shardywhen the hieradata related to keystone endpoints isn't pointing at localhost16:09
shardyayoung: what's the link to your patch under test again?16:09
*** liverpooler has quit IRC16:10
shardyhttps://review.openstack.org/#/c/213175/ I think16:11
shardyayoung: Ah!16:11
shardyyou're unsetting keystone::*bind_host16:11
shardyI wonder if puppet is using that to derive the endpoint internally16:12
shardyEmilienM is probably the best person to comment16:13
EmilienMlooking16:13
*** jcoufal has joined #tripleo16:13
derekhprometheanfire: I've tested your packaging patch, eveything seems to work, added a +2, but its merged, could do with some core reviews on your DIB patch to get an idea if its likely to change or not16:20
derekhprometheanfire: I'll get a look at it soon, and also see if I can to a patch to tripleo-ci to test the 2 patches together16:21
*** xinwu has joined #tripleo16:25
*** leanderthal has joined #tripleo16:25
*** trozet has quit IRC16:26
*** egafford has joined #tripleo16:27
*** akrivoka has quit IRC16:31
*** akrivoka has joined #tripleo16:31
*** oshvartz has quit IRC16:31
*** masco has quit IRC16:32
openstackgerritayoung proposed openstack/tripleo-heat-templates: puppet: run keystone in wsgi  https://review.openstack.org/21317516:34
ayoungEmilienM, like that?16:34
ayounghttps://review.openstack.org/#/c/213175/21/puppet/controller.yaml16:34
EmilienMayoung: yeah it should be good now16:35
*** Goneri has joined #tripleo16:36
*** jcoufal has quit IRC16:38
*** trozet has joined #tripleo16:39
slaglemarios: looking at all the logs from http://logs.openstack.org/13/260413/9/check-tripleo/gate-tripleo-ci-f22-ha/d5fff90/, i don't see any out of memory errors16:41
*** devvesa_ has quit IRC16:42
*** sbalukoff has quit IRC16:47
derekhshardy: see my comment on the single heat worker patch,16:48
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: Fix unit tests failing against Puppet 4.3.x  https://review.openstack.org/27364716:48
*** mcornea has quit IRC16:49
*** alop has joined #tripleo16:49
*** tiswanso has quit IRC16:50
*** tiswanso has joined #tripleo16:50
derekhdprince: btw, the tripleo.org generation script was stalled this morning when I came in, had to kill a git process to free it up again16:53
derekhdprince: github was down overnight, some of our ci jobs failed as a result, I'm guess the same github problem caused it16:54
shardyderekh: Ah, thanks, yeah I'm missing a ">"16:55
dprincederekh: ouch, and just as I was thinking my tripleo.org .sh script was invincable :)16:55
dprincederekh: thanks for re-kicking it16:56
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Override HeatWorkers parameter for deployed overcloud  https://review.openstack.org/27343116:56
derekhdprince: np, its invincable again now16:56
derekhshardy: ahh, yes that should work too ;-)16:56
*** xinwu has quit IRC16:58
*** sbalukoff has joined #tripleo16:59
ayoungEmilienM, I think I only added back in the private, but needed to add in the admin as well.  testing that now, and will update the patch if it works17:04
slaglederekh: i don't think that -e is going to get passed to the deploy command will it?17:04
slaglederekh: probably need to add that to $OVERCLOUD_DEPLOY_ARGS17:05
derekhslagle: yup17:05
derekhslagle: i.e. your correct17:05
* derekh double checks17:06
*** dprince has quit IRC17:06
derekhyup, needs to be in $OVERCLOUD_DEPLOY_ARGS17:08
*** sthillma has quit IRC17:08
derekhshardy: ^ , want me to move it if you got your head in something else ?17:10
*** panda_ has quit IRC17:11
*** panda_ has joined #tripleo17:11
shardyderekh: gah, yes of course it does17:14
shardyfeel free to hack on it, sorry I should've realized that17:14
openstackgerritayoung proposed openstack/tripleo-heat-templates: puppet: run keystone in wsgi  https://review.openstack.org/21317517:16
ayoungshardy, ... I think I had success...17:16
* ayoung going to check...17:16
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Override HeatWorkers parameter for deployed overcloud  https://review.openstack.org/27343117:18
*** fgimenez has quit IRC17:19
*** jaosorior has quit IRC17:21
*** jaosorior has joined #tripleo17:22
*** olap has quit IRC17:25
openstackgerritMatthew Thode proposed openstack/diskimage-builder: add support for gentoo to a bunch of elements  https://review.openstack.org/27059717:25
ayoungEmilienM, thanks...it worked.  Needed admin as well as public.  Patch updated, and I'm going to go beat on the Tripleo deploy to make sure everything worked17:26
derekhshardy: will do, /me should have noticed too17:27
*** xinwu has joined #tripleo17:30
*** athomas has joined #tripleo17:32
*** sbalukoff has quit IRC17:33
*** ifarkas has quit IRC17:33
openstackgerritBen Nemec proposed openstack/instack-undercloud: Add ability to auto-generate self-signed certificates  https://review.openstack.org/27323317:36
*** xinwu has quit IRC17:37
*** 14WAAUC5I has quit IRC17:37
*** jistr has quit IRC17:38
*** leanderthal is now known as leanderthal|afk17:42
*** sbalukoff has joined #tripleo17:44
*** bvandenh has quit IRC17:46
*** xinwu has joined #tripleo17:47
openstackgerritgreghaynes proposed openstack/diskimage-builder: Revert "Use pip 7 for ironic"  https://review.openstack.org/27368817:49
*** mcornea has joined #tripleo17:55
*** dshulyak has quit IRC18:02
*** mbound has quit IRC18:02
*** derekh has quit IRC18:03
*** lucasagomes is now known as lucas-away18:03
*** julim has quit IRC18:04
*** penick has joined #tripleo18:04
*** julim has joined #tripleo18:06
*** trozet has quit IRC18:08
*** trozet has joined #tripleo18:08
*** dprince has joined #tripleo18:11
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Allow the deployer to pick a predefined IP for VIPs  https://review.openstack.org/24575018:13
*** pradk has quit IRC18:20
*** akrivoka has quit IRC18:23
*** xinwu has quit IRC18:24
*** olap has joined #tripleo18:24
openstackgerritBen Nemec proposed openstack/tripleo-common: TEST: Try fedora user image for ping test  https://review.openstack.org/27369918:25
*** mcornea has quit IRC18:28
*** trown is now known as trown|lunch18:29
*** olap_ has joined #tripleo18:30
*** olap has quit IRC18:32
*** pradk has joined #tripleo18:34
*** jaosorior has quit IRC18:35
openstackgerritBen Nemec proposed openstack/tripleo-common: Output some debug info when pingtest fails  https://review.openstack.org/27370118:35
*** jaosorior has joined #tripleo18:35
*** ccrouch1 has quit IRC18:36
*** rhallisey has quit IRC18:38
*** shivrao has joined #tripleo18:41
*** olap_ has quit IRC18:42
openstackgerritSteven Hardy proposed openstack/os-cloud-config: Switch keystone certs to parameter_defaults  https://review.openstack.org/27371018:47
*** xinwu has joined #tripleo18:53
*** ccrouch has joined #tripleo18:55
jaosoriorshardy: the commit above looks about right. But, haven't we already switched to using fernet tokens instead of PKI tokens?18:56
jaosoriorthought those parameters aren't even needed anymore18:57
bnemecHey all, I put together a few logstash queries for some of our common failures: https://etherpad.openstack.org/p/tripleo-ci-logstash-queries18:57
bnemecFeel free to add more.18:57
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Update yaml-validate.py to accept files or directories  https://review.openstack.org/26928119:06
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add simple parameter test to yaml-validate.py  https://review.openstack.org/26928219:06
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Remove unused parameters  https://review.openstack.org/26928319:06
*** trown|lunch is now known as trown19:09
*** lblanchard has quit IRC19:10
*** sthillma has joined #tripleo19:11
*** lblanchard has joined #tripleo19:14
*** nico_auv has quit IRC19:14
*** tosky has quit IRC19:17
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Set overcloud deploy timeout  https://review.openstack.org/27371619:18
*** leanderthal|afk is now known as leanderthal19:21
stevebakershardy: hey, only 2 engines will result in rpc timeouts, but I don't know about 319:21
stevebakershardy: I'd prefer 4, and reduce the memory usage19:22
*** yamahata has quit IRC19:23
*** olap has joined #tripleo19:36
*** electrofelix has quit IRC19:50
*** yamahata has joined #tripleo19:51
*** ayoung has quit IRC19:56
*** bnemec has quit IRC20:18
*** leanderthal has quit IRC20:19
*** ayoung has joined #tripleo20:22
*** dsneddon is now known as dsneddon_lunch20:23
*** Marga_ has quit IRC20:24
*** bnemec has joined #tripleo20:25
EmilienMdprince: https://review.openstack.org/26507620:26
EmilienMis that what we expect by composable roles at the end?20:26
EmilienMthat's the first time I see usage of an openstack module in puppet-tripleo (which is not too bad for me)20:28
*** tiswanso has quit IRC20:29
*** tiswanso has joined #tripleo20:30
*** leanderthal has joined #tripleo20:31
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Enable undercloud ssl on nonha job  https://review.openstack.org/27374320:34
*** rwsu has quit IRC20:40
*** tiswanso has quit IRC20:41
*** jaosorior has quit IRC20:41
dprinceEmilienM: yeah, I think we are headed this way20:43
EmilienMwfm20:43
EmilienMjust wanted to know20:43
*** tiswanso has joined #tripleo20:52
shardystevebaker: ack, thanks for confirming20:57
shardystevebaker: I've not figured out where yet, but we definitely seem to be retaining memory after some operations20:58
shardyI don't have a reproducer, but I graphed a days testing on tripleo, and there's a leak somewhere20:58
stevebakershardy: hmm, ok20:58
shardyit's not huge, but the usage creeps up over time20:59
shardyand obviously the idle usage is pretty high too atm20:59
openstackgerritBen Nemec proposed openstack/tripleo-heat-templates: Rename validate tox env to linters  https://review.openstack.org/27375121:00
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Add swap to overcloud nodes  https://review.openstack.org/27375221:00
*** mbound has joined #tripleo21:00
openstackgerritDan Radez proposed openstack/tripleo-heat-templates: [WIP] Enable deployment of Ceph Storage (OSD) on the Compute Nodes  https://review.openstack.org/27375421:02
*** rcernin has quit IRC21:02
*** dmsimard_ has joined #tripleo21:02
*** dprince has quit IRC21:10
*** panda_ has quit IRC21:11
*** panda_ has joined #tripleo21:12
prometheanfireSpamapS: about the pyo/pyc stuff, ya I think only root would be able to recache it21:13
prometheanfirethe main reason for removal was to shrink the final image, iirc the two python removal lines shrink it by about 40-50M21:13
SpamapSprometheanfire: the only way that makes sense is if you generate them all again at first boot.21:18
openstackgerritMatthew Thode proposed openstack/diskimage-builder: add support for gentoo to a bunch of elements  https://review.openstack.org/27059721:18
prometheanfireSpamapS: point21:18
prometheanfireSpamapS: I did remove it21:18
prometheanfireSpamapS: ^21:19
prometheanfireI'll leave it alone for now though, no new element unless it bothers me enough down the line21:19
*** jayg is now known as jayg|g0n321:19
SpamapSprometheanfire: I mean, 40-50 MB is nice to get back, but not worth the slowdown one would experience importing python modules. :)21:20
* prometheanfire shrugs21:20
prometheanfirenot an issue now :P21:20
SpamapSprometheanfire: ok, but also.. splitting it out.. ?21:20
prometheanfiremaking another element to do image shrinking operations21:20
prometheanfirestuff that might be extreme21:20
*** ayoung has quit IRC21:24
*** dsneddon_lunch is now known as dsneddon21:24
*** rcernin has joined #tripleo21:27
*** jprovazn has quit IRC21:32
*** athomas has quit IRC21:33
openstackgerritMerged openstack/diskimage-builder: Updated from global requirements  https://review.openstack.org/27329721:36
*** shardy has quit IRC21:38
openstackgerritMatthew Thode proposed openstack/diskimage-builder: add new cloud-init element  https://review.openstack.org/27376421:38
*** jcoufal has joined #tripleo21:39
openstackgerritMatthew Thode proposed openstack/diskimage-builder: add gentoo support to growroot  https://review.openstack.org/27376921:45
*** ayoung has joined #tripleo21:47
*** ron___ has quit IRC21:49
openstackgerritMatthew Thode proposed openstack/diskimage-builder: add gentoo support to growroot  https://review.openstack.org/27376921:51
openstackgerritMatthew Thode proposed openstack/diskimage-builder: add support for openrc to dib-init-system  https://review.openstack.org/27377221:53
EmilienMslagle: https://bugs.launchpad.net/tripleo/+bug/1537720 is fixed for you now? I remember you had an issue21:54
openstackLaunchpad bug 1537720 in tripleo "mysql failing to start in stable/liberty CI" [Critical,Fix released] - Assigned to John Trowbridge (trown)21:54
slagleEmilienM: indeed it is21:54
EmilienMso why the bug is in "Fix released"?21:54
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Add swap to overcloud nodes  https://review.openstack.org/27375221:54
EmilienMI was just wondering if I should investigate21:54
slagleEmilienM: b/c it's fixed21:55
slaglemaybe someone did a release?21:55
openstackgerritMatthew Thode proposed openstack/diskimage-builder: add support for openrc to dib-init-system  https://review.openstack.org/27377221:55
EmilienMslagle: ok, let me know if you still see the bug21:55
*** trown is now known as trown|outttypeww21:56
openstackgerritMerged openstack/diskimage-builder: Add systemd/fedora support to growroot  https://review.openstack.org/27186221:59
*** athomas has joined #tripleo22:00
*** athomas has quit IRC22:01
*** athomas has joined #tripleo22:01
openstackgerritMatthew Thode proposed openstack/diskimage-builder: adds support for gentoo to source-repositories by adding a pkg-map  https://review.openstack.org/27377622:01
*** Marga_ has joined #tripleo22:05
*** rwsu has joined #tripleo22:05
openstackgerritMatthew Thode proposed openstack/diskimage-builder: package-installs doesn't work in python3/gentoo  https://review.openstack.org/27378222:07
*** tiswanso has quit IRC22:09
*** lblanchard has quit IRC22:12
*** Goneri has quit IRC22:13
openstackgerritMatthew Thode proposed openstack/diskimage-builder: add support for gentoo to simple-init  https://review.openstack.org/27379022:15
*** penick has quit IRC22:16
*** gfidente has quit IRC22:17
*** penick has joined #tripleo22:20
*** ayoung has quit IRC22:21
*** egafford has quit IRC22:23
openstackgerritMatthew Thode proposed openstack/diskimage-builder: fix gentoo hardened support  https://review.openstack.org/27379522:25
prometheanfireso, who wants to review :D22:31
*** athomas has quit IRC22:33
*** jcoufal has quit IRC22:33
*** cwolferh has quit IRC22:34
*** leanderthal has quit IRC22:37
*** leanderthal has joined #tripleo22:45
*** yamahata has quit IRC22:49
*** julim has quit IRC22:50
*** julim has joined #tripleo22:52
*** alop has quit IRC22:52
*** leanderthal has quit IRC22:57
*** rwsu has quit IRC23:05
*** rwsu has joined #tripleo23:06
*** weshay_xchat has quit IRC23:07
*** julim has quit IRC23:11
*** mbound has quit IRC23:15
*** chlong has quit IRC23:32
*** ayoung has joined #tripleo23:33
*** cwolferh has joined #tripleo23:35
*** ayoung has quit IRC23:50
*** dmacpher has quit IRC23:51
openstackgerritMerged openstack/diskimage-builder: Revert "Use pip 7 for ironic"  https://review.openstack.org/27138023:54
« Wednesday, 2016-01-27 Index Friday, 2016-01-29 »

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!