Monday, 2014-03-31

*** e0ne has joined #heat00:01
*** e0ne_ has joined #heat00:03
*** e0ne has quit IRC00:03
*** e0ne_ has quit IRC00:08
*** matsuhashi has joined #heat00:23
*** duncanjw has joined #heat00:32
*** duncanjw has quit IRC00:37
stevebakerSpamapS: that is a fix from a recent migration regression, so it is at least improving the situation00:40
*** pablosan is now known as zz_pablosan00:43
SpamapSstevebaker: improving the situation is great. But without a regression test, it is likely to .. well.. regress00:43
SpamapSstevebaker: and testing that is really easy00:44
*** alexpilotti has quit IRC00:46
stevebakerSpamapS: yes, it should be easy to test. We should establish a pattern for testing these template format migrations which doesn't require full fake db migration setup <-- sdake00:47
*** DandyPandy has quit IRC00:50
openstackgerritA change was merged to openstack/heat: Fix incorrect error msg in validate_template()  https://review.openstack.org/8367700:56
*** DandyPandy has joined #heat00:57
*** e0ne has joined #heat01:01
*** funzo_ has joined #heat01:04
*** spzala has joined #heat01:05
*** andersonvom_ has joined #heat01:08
*** Slower_ has joined #heat01:09
*** blomquis` has joined #heat01:12
*** ruhe2 has joined #heat01:13
*** cody-somerville has quit IRC01:13
*** andersonvom has quit IRC01:13
*** dims has quit IRC01:13
*** dmakogon_ has quit IRC01:13
*** Darnoth has quit IRC01:13
*** pasquier-s has quit IRC01:13
*** ruhe has quit IRC01:13
*** DinaBelova has quit IRC01:13
*** Daviey has quit IRC01:13
*** e0ne has quit IRC01:13
*** killer_prince has quit IRC01:13
*** che-arne has quit IRC01:13
*** blomquisg_gone has quit IRC01:13
*** funzo has quit IRC01:13
*** dteselkin has quit IRC01:13
*** Slower has quit IRC01:13
*** ruhe2 is now known as ruhe01:13
*** DinaBelova has joined #heat01:14
*** dteselkin has joined #heat01:14
*** Daviey has joined #heat01:16
*** dmakogon_ has joined #heat01:20
*** cody-somerville has joined #heat01:20
*** pasquier-s has joined #heat01:21
*** killer_prince has joined #heat01:21
*** dims has joined #heat01:21
*** che-arne has joined #heat01:21
*** matsuhashi has quit IRC01:24
*** matsuhashi has joined #heat01:26
*** nosnos has joined #heat01:31
*** arbylee has joined #heat01:46
*** arbylee has quit IRC01:52
*** sdake has quit IRC01:54
*** Daviey has quit IRC02:00
*** e0ne has joined #heat02:01
*** andersonvom_ has quit IRC02:02
*** e0ne has quit IRC02:06
*** spzala has quit IRC02:13
*** Michalik- has joined #heat02:20
*** ramishra has joined #heat02:21
*** IlyaE has quit IRC02:30
*** zz_pablosan is now known as pablosan02:33
*** pablosan has quit IRC02:36
*** sdake has joined #heat02:45
*** liang has joined #heat02:50
*** Michalik- is now known as Michalik03:00
*** e0ne has joined #heat03:01
*** e0ne has quit IRC03:03
*** andersonvom has joined #heat03:17
*** matsuhashi has quit IRC03:19
*** andersonvom has quit IRC03:28
openstackgerritA change was merged to openstack/heat: Ensure that the NoCloud data source is loaded, part 2  https://review.openstack.org/7870403:29
openstackgerritA change was merged to openstack/heat: Add IP address to error message of failed stack  https://review.openstack.org/7723103:29
openstackgerritSteve Baker proposed a change to openstack/heat: Credentials for native heat os-collect-config polling  https://review.openstack.org/8404603:29
openstackgerritSteve Baker proposed a change to openstack/heat: Allow for stack users in _authorize_stack_user  https://review.openstack.org/8404703:29
openstackgerritA change was merged to openstack/heat: Add events for automation statuses to Cloud Server  https://review.openstack.org/8036103:32
stevebakerSpamapS: when you're about I'd like to talk about the unit tests for my native heat occ collector03:33
*** nosnos has quit IRC03:34
*** andersonvom has joined #heat03:44
*** matsuhashi has joined #heat03:57
*** e0ne has joined #heat04:01
*** nosnos has joined #heat04:02
*** e0ne has quit IRC04:06
*** ramishra_ has joined #heat04:16
*** ramishra has quit IRC04:17
*** nati_ueno has joined #heat04:23
*** nati_ueno has quit IRC04:23
*** IlyaE has joined #heat04:27
*** lazy_prince has joined #heat04:39
*** matsuhashi has quit IRC04:39
*** sdake has quit IRC04:39
*** pasquier-s has quit IRC04:39
*** killer_prince has quit IRC04:39
*** lazy_prince is now known as killer_prince04:39
*** gokrokve has joined #heat04:41
*** matsuhashi has joined #heat04:43
*** sdake has joined #heat04:46
*** pasquier-s has joined #heat04:46
*** andersonvom has quit IRC04:49
*** gokrokve has quit IRC04:52
*** gokrokve has joined #heat04:52
*** sdake has quit IRC04:54
*** akuznetsov has joined #heat04:55
*** e0ne has joined #heat05:01
*** e0ne has quit IRC05:04
*** alexheneveld has quit IRC05:07
skraynevmorning!05:09
*** gokrokve_ has joined #heat05:10
*** gokrokve has quit IRC05:13
*** gokrokve_ has quit IRC05:15
*** gokrokve has joined #heat05:16
*** killer_prince has quit IRC05:19
*** gokrokve has quit IRC05:20
*** kevinbenton has left #heat05:25
*** e0ne has joined #heat05:32
*** killer_prince has joined #heat05:34
*** e0ne has quit IRC05:36
mattoliverauMorning skraynev05:46
*** gokrokve has joined #heat05:46
skraynevmattoliverau: hi ;)05:47
*** gokrokve_ has joined #heat05:49
*** chandan_kumar has joined #heat05:50
*** gokrokve has quit IRC05:51
*** nosnos_ has joined #heat05:53
*** nosnos has quit IRC05:53
*** matsuhashi has quit IRC05:54
*** matsuhashi has joined #heat05:55
*** gokrokve_ has quit IRC05:59
*** e0ne has joined #heat06:01
*** e0ne has quit IRC06:02
*** duncanjw has joined #heat06:08
*** pradipta has joined #heat06:09
*** bvandenh has joined #heat06:10
openstackgerritJenkins proposed a change to openstack/heat: Imported Translations from Transifex  https://review.openstack.org/8395706:11
*** tspatzier has joined #heat06:13
openstackgerritSergey Kraynev proposed a change to openstack/heat: Using default value during update  https://review.openstack.org/8370906:15
openstackgerritSergey Kraynev proposed a change to openstack/heat: Fix incorrect logic during updating in unittest  https://review.openstack.org/8370806:15
*** IlyaE has quit IRC06:16
skraynevliang: ping06:17
openstackgerritJun Jie Nan proposed a change to openstack/heat: Adjust user_data_format for server with deployment  https://review.openstack.org/8299206:17
*** mkollaro has joined #heat06:18
*** alexheneveld has joined #heat06:21
SpamapSstevebaker: sorry, been a very family-focused Sunday. ;) We'll talk tomorrow.06:25
openstackgerritMatthew Oliver proposed a change to openstack/heat: Standalone heat can't specify a region  https://review.openstack.org/8366906:27
*** duncanjw has quit IRC06:29
*** duncanjw has joined #heat06:30
*** duncanjw has quit IRC06:30
*** duncanjw has joined #heat06:30
liangskraynev, pong06:31
*** alexheneveld has quit IRC06:31
*** duncanjw has quit IRC06:33
skraynevliang: I wanted ask you here about my fix for unittests, but I did it through gerrit06:34
skraynevliang: please look my comment for https://review.openstack.org/#/c/83708/06:34
liangskraynev,  looking ;)06:35
*** IlyaE has joined #heat06:36
liangskraynev, so the next patch will use the default value for image_update_policy property when the new template doesn't specify one?06:37
skraynevliang: right06:38
liangskraynev, which effectively makes the old image_update_policy property not being used anymore.06:38
skraynevliang: not fully, when I did this change I thought same06:39
liangskraynev, Ok. perhaps you would like to associate that patch with https://bugs.launchpad.net/heat/+bug/1298850 ?06:40
uvirtbotLaunchpad bug 1298850 in heat "Use default value during update" [Medium,In progress]06:40
skraynevliang: old property will be used in case if image_update_policy was not changes at all. (like in this test)06:41
skraynevliang: sure, I will mark as Related-Bug. ok?06:41
liangskraynev, yes, to us. But to the end users, they will think only new property is used.06:43
liangskraynev, yeah, Related-Bug: #129885006:43
liangskraynev, thanks!!06:43
skraynevliang: thank you =)06:44
liangskraynev, you are welcome ;)06:44
*** alexheneveld has joined #heat06:45
skraynevliang: ;)06:45
*** rpothier has joined #heat06:48
*** rpothier_ has quit IRC06:50
mattoliverauNight all, time to go make dinner, for those of you who are on the other side of the world, enjoy your Monday :)06:50
*** alexheneveld has quit IRC06:51
*** IlyaE has quit IRC06:52
therveGood morning06:53
*** alexheneveld has joined #heat06:55
*** gokrokve has joined #heat06:56
*** alexheneveld has quit IRC07:00
*** gokrokve has quit IRC07:01
*** chandan_kumar has quit IRC07:06
*** cmyster has joined #heat07:06
*** matsuhashi has quit IRC07:08
*** matsuhashi has joined #heat07:08
*** TonyBurn has joined #heat07:09
*** nosnos_ has quit IRC07:09
*** nosnos has joined #heat07:10
*** stannie has joined #heat07:11
*** tomek_adamczewsk has joined #heat07:14
*** pas-ha has joined #heat07:16
pas-hamorning, heaters :)07:16
*** ifarkas has joined #heat07:18
cmystermorning07:20
cmysterI misread it as haters...07:20
cmystercoffee++07:20
tspatziercmyster: LOL07:20
*** matsuhashi has quit IRC07:22
openstackgerritThierry Carrez proposed a change to openstack/heat: Open Juno development  https://review.openstack.org/8407707:22
*** yogesh has joined #heat07:26
*** mkollaro has quit IRC07:27
*** jstrachan has joined #heat07:28
*** matsuhashi has joined #heat07:28
*** sergmelikyan has joined #heat07:31
*** tomek_adamczewsk has quit IRC07:36
*** ramishra_ has quit IRC07:38
*** tomek_adamczewsk has joined #heat07:38
*** jistr has joined #heat07:40
*** julienvey has joined #heat07:42
*** jprovazn has joined #heat07:44
*** matsuhashi has quit IRC07:46
*** matsuhashi has joined #heat07:47
*** tomek_adamczewsk has quit IRC07:49
*** yogesh has quit IRC07:55
*** mkerrin has joined #heat07:59
*** akuznetsov has quit IRC07:59
*** akuznetsov has joined #heat07:59
*** shardy has joined #heat08:02
*** pas-ha has quit IRC08:02
shardymorning all08:02
*** akuznetsov has quit IRC08:06
shardyhuh?  I'm I seeing things or has our stable/grizzly branch been deleted?08:08
shardy*Am* I08:09
*** derekh has joined #heat08:09
* shardy needs moar coffee08:09
skraynevshardy: really s/moar/more ;)08:09
cmysterno, actually moar08:10
cmysterMOAR even08:10
cmysterhi BTW08:10
skraynevOh. you right MOAR.08:11
*** ramishra has joined #heat08:12
cmysteryou just need moar coffee skraynev, all will look better after that08:12
shardyhttps://github.com/openstack/heat/releases/tag/grizzly-eol08:12
shardyI guess that explains it08:12
shardyI didn't expect the branch to actually disappear08:13
cmysterHmmm08:13
*** pas-ha has joined #heat08:14
skraynevcmyster: possibly problem was, that I have not known this word.  (and use dictionary to get meaning)08:14
liangshardy, so does that mean grizzly wouldn't be maintained anymore?08:15
cmysterand lack of coffee ;)08:15
cmysterliang: depends, no new features for sure, maybe only critical bug fixes for paying supported customers but I am not 100%08:16
shardyliang: It would appear so, yes08:16
skraynevcmyster: lol. it's possible always08:17
*** e0ne has joined #heat08:17
shardyliang: https://wiki.openstack.org/wiki/Releases08:18
liangcmyster, shardy, thanks ;)08:18
shardyThat looks like it's pending an update, but I guess grizzly goes eol now, and havana becomes security-supported08:18
shardycmyster: upstream, there can be no further updates at all, because the stable/grizzly branch has just been removed08:19
shardywhat distributors do with their grizzly packages is a different thing :)08:19
cmystershardy: ya I know that, but thanks for clarifying08:22
*** ramishra has quit IRC08:22
*** ramishra has joined #heat08:24
*** akuznetsov has joined #heat08:32
*** Daviey has joined #heat08:35
*** liang has quit IRC08:40
*** tomek_adamczewsk has joined #heat08:40
*** yogesh has joined #heat08:43
*** yogesh has quit IRC08:44
*** RockKuo_TW_PC has joined #heat08:48
*** liang has joined #heat08:51
cmystershardy: I am looking for a way to programmatically return a list of keypair names. do we have something like that in heat or should I just use nova ?08:52
*** RockKuo_TW has quit IRC08:52
shardycmyster: We have a Constraint plugin which will check a keypair name against the list from nova, but AFAIK we don't have anything which will allow you to directly manipulate the list08:54
*** julienvey has quit IRC08:54
cmysternot manipulate, just thinking about how to create a stack with keypair and the use the returned outputs08:54
cmysterhmmm08:54
*** bvandenh has quit IRC08:55
cmystercan I just use the returned data (rsa key) as the keypair to use or do I need to state the name of the key ?08:55
cmysterif so I'll need to call nova and I rather avoid it for now08:56
shardycmyster: OS::Nova::KeyPair allows you to do either08:56
shardySo you either pass the name of an existing key into the template (which is passed into OS::Nova::Server)08:57
*** alexheneveld has joined #heat08:57
cmysterwell, that stack I alreay created. the question is, if I 'remember' the output of that resource, can I use the rsa code to launch another resource, say a nova::server08:57
shardyor you create a KeyPair resource, which creates the key for you, optionally from an exisitng key string08:57
cmysterya ok then08:57
*** gokrokve has joined #heat08:57
shardyCan't you just output the name of the keypair from stack1 and pass it into stack2?08:58
cmysterno?08:58
cmysterno08:58
cmysterall I have is outputs08:58
cmysterand for the key its the string08:58
cmysterthe data itself not the name that is08:58
shardywell you could output either08:59
cmysterright, thanks08:59
shardy{get_resource: my_keypair}09:00
cmysterhmmm09:00
cmystereven if on a differnt stack ?09:00
shardycmyster: yes, although it would be best to make the second stack nested so you can delete them together09:01
shardythe get_resource returns the nova keypair ID09:01
cmysternot sure I want to, I am playing with a set of 'independent' stacks that can talk with one another09:01
*** bvandenh has joined #heat09:02
shardywell they're not really independent if one depends on a keypair in the other09:02
*** gokrokve has quit IRC09:02
shardymaybe create the keypair outside and pass it as a parameter to all stacks instead09:02
cmysterthats what I am working on, henceforth the original question09:03
shardySure, I'm just explaining what is possible, up to you to decide what's best ;)09:03
shardyobviously creating the keypair via a heat resource only makes sense if the stacks are related and share the same lifecycle09:04
cmysterwill let you know in a jiffy, just need to clear that pesky 'u' from those utf8 strings else nothing is equal :)09:04
cmysterin this test they will. I'm creating, testing and destroying09:05
*** e0ne_ has joined #heat09:08
*** e0ne has quit IRC09:12
cmysterthere is already an open bug about failing to felete stacks right ?09:36
cmysterwow, failing to delete even09:36
*** julienvey has joined #heat09:47
*** tomek_adamczewsk has quit IRC09:52
*** tomek_adamczewsk has joined #heat09:53
*** gokrokve has joined #heat09:58
*** gokrokve has quit IRC10:03
*** liang has quit IRC10:15
*** alexpilotti has joined #heat10:22
*** alexpilotti has quit IRC10:26
*** liang has joined #heat10:39
*** liang has quit IRC10:49
*** e0ne_ has quit IRC10:54
*** alexpilotti has joined #heat10:57
*** gokrokve has joined #heat10:59
*** tomek_adamczewsk has quit IRC11:01
*** gokrokve has quit IRC11:03
*** liang has joined #heat11:07
*** tomek_adamczewsk has joined #heat11:08
*** liang has quit IRC11:12
*** tomek_adamczewsk has quit IRC11:14
*** tomek_adamczewsk has joined #heat11:16
*** rpothier has quit IRC11:26
*** matsuhashi has quit IRC11:26
*** nosnos has quit IRC11:27
lifelessderekh: last thought - you might ask here if anyone knows about heat stack-list hangs etc :)11:30
*** alexheneveld has quit IRC11:31
derekhok, so heat-list on our seed (deployed a few months ago) is hanging, has anybody seen this before and pointers as to why it might be happening ?11:32
*** e0ne has joined #heat11:34
shardyderekh: The only reason I can think of is the heat-api can't connect to the heat-engin via RPC, or the heat-engine is not running11:36
derekhshardy: ok, heat-engine is running , trying to verify RPC11:37
shardyderekh: e.g there was that reconnect issue recently, where I had to periodically restart qpidd to get the API reconnected to the engine11:38
shardyI think that's fixed in master and havana now though via an oslo patch11:39
derekhshardy: ok, I think lifeless tried that but will double check11:39
cmysterback11:40
shardyderekh: failing that pls enable debug in the heat.conf and we can take a look at the logs11:40
derekhshardy: ok, rabbitmq restart didn't work enabling debug11:41
openstackgerritPavlo Shchelokovskyy proposed a change to openstack/heat: Add handle_update to VolumeAttachment  https://review.openstack.org/7268111:42
*** jprovazn has quit IRC11:42
cmysterderekh: does horizon show you a list of stacks ?11:42
cmysternot exactly the same thing, but interesting to know11:43
derekhcmyster: we don't have horizon11:43
cmysterok11:43
*** e0ne has quit IRC11:44
*** e0ne has joined #heat11:44
*** saju_m has joined #heat11:51
derekhshardy: dubug log produced by heat-api when I do a stack list http://paste.openstack.org/show/74655/ no corrisponding logs on heat engine, so looks like its not getting hit at all11:54
derekhthe heat-engine logs don't produce anything after11:55
derekh2014-03-31 11:42:17.857 1936 INFO heat.openstack.common.rpc.common [-] Connected to AMQP server on 127.0.0.1:567211:55
derekh2014-03-31 11:42:17.857 1936 DEBUG heat.openstack.common.rpc.service [-] Creating Consumer connection for Service engine start /opt/stack/venvs/heat/local/lib/python2.7/site-packages/heat/openstack/common/rpc/service.py:5011:55
*** spzala has joined #heat11:57
shardyderekh: hmm, interesting, could heat.conf be misconfigured?11:58
shardye.g rabbit_host/qpid_hostname?11:58
shardyor is it only stack-list which hangs?11:58
*** gokrokve has joined #heat12:00
*** saju_m has quit IRC12:00
derekhrabbit_host = 127.0.0.1  # looks ok12:00
derekh"heat stack-show garbage" also hangs12:00
derekhgotta pop away for a bit will be back12:02
*** spzala has quit IRC12:04
*** gokrokve has quit IRC12:05
*** saju_m has joined #heat12:06
shardyderekh: I don't really have an answer for you unfortunately - if you restart heat-engine, rabbit and heat-api, and the config is correct, then it should work12:08
*** saju_m has quit IRC12:08
*** ramishra_ has joined #heat12:10
*** ramishra has quit IRC12:13
*** blomquisg has joined #heat12:15
*** sergmelikyan has quit IRC12:17
*** jpeeler has joined #heat12:19
openstackgerritChmouel Boudjnah proposed a change to openstack/heat: Skip tests when loading tests  https://review.openstack.org/8411712:25
*** rpothier has joined #heat12:25
thervepas-ha, Please don't do recheck no bug12:25
pas-hatried to search for the bug on launchpad but found nothing.. currently looks like some specific volume tests are failing in many check jobs12:26
pas-habut I can't produce a meaningful bug report on that :(12:27
pas-hayour ideas?12:28
shardypas-ha: If you can't find a bug matching, raise a new one and recheck against that12:28
thervepas-ha, https://bugs.launchpad.net/bugs/1300161 I think12:28
uvirtbotLaunchpad bug 1300161 in cinder "Error import taskflow Failure" [Undecided,New]12:28
shardyIf everyone did recheck no bug when they found a new bug, we'd never fix any bugs ;)12:28
therveI'm surprised nobody else complained to be honest12:28
pas-hatherve: thanks for the link, wasn't able to find it by myself :(12:29
thervepas-ha, Don't give up! :)12:30
therveYou can always ask here too12:30
shardypas-ha: Are you aware of http://status.openstack.org/rechecks/?12:30
shardyThat's my start point when looking for recheck bugs, followed by google normally12:30
pas-hanope, that one is new for me, thanks for pointing12:30
* pas-ha remembers to use google instead of launchpad for searching launchpad bugs12:31
shardypas-ha: You can search direct in launchpad too, but personally I get better results via google with part of the error logged and some additional keywords like "tempest" and "bug"12:32
pas-hayes, I've already found that out too - the launchpad' search on its own content is quite inferior to google's12:33
openstackgerritBartosz Górski proposed a change to openstack/heat: Multi-region support with context concept  https://review.openstack.org/5331312:33
thervepas-ha, Another trick is that creating a bug uses a better search12:38
therveBut yeah "test" site:launchpad.net works pretty well12:38
*** dims has quit IRC12:38
*** sgordon has joined #heat12:43
*** sgordon has quit IRC12:43
*** sgordon has joined #heat12:43
*** jdob has joined #heat12:44
derekhshardy: ok, thanks for looking, I'll keep poking at it, will let you knwo if I find anything12:46
*** radez_g0n3 is now known as radez12:48
*** akuznetsov has quit IRC12:52
*** dims has joined #heat12:52
openstackgerritThomas Spatzier proposed a change to openstack/heat: Move some template validation to Template class  https://review.openstack.org/8398412:53
openstackgerritThomas Spatzier proposed a change to openstack/heat: Check top-level sections when parsing a template  https://review.openstack.org/8375812:53
*** dmakogon_ is now known as denis_makogon12:55
*** sballe has joined #heat12:57
*** gokrokve has joined #heat13:01
*** TonyBurn has quit IRC13:01
*** TonyBurn has joined #heat13:01
*** akuznetsov has joined #heat13:03
*** e0ne has quit IRC13:03
*** e0ne has joined #heat13:04
openstackgerritChmouel Boudjnah proposed a change to openstack/heat: Skip tests when loading plugins  https://review.openstack.org/8411713:06
*** gokrokve has quit IRC13:06
*** jdob has quit IRC13:06
*** jdob has joined #heat13:06
pas-haso, how this should be done practically for the new bug on the gate? "recheck bug XXXX" and the gate will ignore the failure with said symptoms, or we can only wait for the bug to be fixed?13:08
shardypas-ha: Normally the gate bugs are transient so recheck may work, nothing is ignored, it's just a workaround for bugs which aren't repeatable 100% of the time13:10
*** spzala has joined #heat13:10
pas-habut in this last case cinder has to be fixed / brought in line with taskflow, right?13:11
therveYeah, the otherway around now :)13:11
therveCurrently it's useless to recheck until the bug is fixed13:11
pas-hanow got it, thanks :)13:12
pas-hapity we have only 1 patch left and stuck due to this gate bug to able to unfreeze..13:12
*** pradipta is now known as pradipta_away13:13
*** duncanjw has joined #heat13:21
*** pafuent has joined #heat13:21
*** ramishra_ has quit IRC13:28
*** ramishra_ has joined #heat13:30
*** aweiteka has joined #heat13:31
derekhshardy: found the problem, rabbitmq blocks connections from doing anything if free disk space falls below a certain amount13:32
shardyderekh: aha, glad you found the issue :)13:32
derekhshardy: thanks for the ideas13:32
*** alexheneveld has joined #heat13:32
*** jdob_ has joined #heat13:35
*** funzo_ is now known as funzo13:36
sdagueanyone up for helping me understand how incredibly I fubarred the ha template for the tempest test? - https://review.openstack.org/#/c/83924/13:40
shardysdague: I can try :)13:40
*** bgorski has joined #heat13:40
sdagueit's complaining about not defining ImageId13:41
sdaguehttp://logs.openstack.org/24/83924/2/check/check-tempest-dsvm-neutron-heat-slow/021be46/console.html#_2014-03-31_12_55_53_94913:41
shardysdague: are you aware that we'd like to move towards deprecating and removing HARestarter?13:42
shardyThere are design issues with it so we've discussed replacing it (or possibly fixing it I guess)13:42
sdagueyes, however, it's in the code now13:42
skraynevsdague: did you use autoscaling scenario test as exmaple?13:42
sdagueskraynev: I tried to, but apparently did it badly13:42
shardysdague: Ok, cool just wanted to make sure you knew :)13:42
sdake_morning13:43
skraynevsdague: AFAIK, we have not any scenario test which work (because autoscaling is skipped now)13:43
shardysdague: The LaunchConfiguration is missing ImageId13:44
skraynevall these tests needed F20 image, which is not in devstack13:44
thervesdague, LaunchConfig can be removed AFAIU13:45
shardytherve: +113:45
sdagueskraynev: it is during the heat slow tests13:45
therveAccessKeys as well I guess?13:45
shardylikewise the User/AccessKey13:45
*** jmckind has joined #heat13:45
skraynevOops. So I suppose, that therve and shardy are right13:45
shardyskraynev: there is no requirement to use F20 unless you want cfntools13:46
sdagueso if I remove launch config, how do I get cfn-push-stats to run on the guest?13:46
sdaguebecause my understanding was that was how HARestarter made it's decision13:46
*** samstav has joined #heat13:47
shardysdague: You leave the user/accesskey and create the cfn-credentials file in the myserver user_data13:47
shardythe LaunchConfig is not doing anything atm13:47
shardyLaunchConfig is only used with groups of instances, e.g AutoScalingGroup13:47
sdagueok13:47
shardysdague: also, if you wish, you can trigger the HARestarter by just hitting the URL it exposes13:48
*** samstav has quit IRC13:48
shardyyou don't *have* to setup an alarm if you're just testing that one resource13:48
* shardy grabs an example13:48
sdagueok, so my thinking about this test was that we'd start the guest with heat13:48
sdaguemake sure it was up13:48
sdaguekill it with nova13:48
sdaguethen make sure heat restarts it13:48
sdagueif there is a simpler way to provide health ping back from the guest, I'm all for it13:49
shardysdague: You certainly could do it that way, you just need to move the cfn-credentials file creation into the user_data and that should work13:49
shardyhttp://paste.fedoraproject.org/90221/1396273813:50
*** zigo has quit IRC13:50
shardyOr, you could start the stack, check the instance is ACTIVE, then hit AlarmUrl from the test13:51
shardysdague: 5mins, I'll do a working version of your current template13:52
*** samstav has joined #heat13:52
sdaguewell, if I hit the alarm url from the test, it wouldn't test that HARestart was correctly detecting that the resource went way13:52
sdagueaway13:52
sdagueshardy: cool, thank you13:52
shardyHARestarter isn't detecting anything, it just responds to something hitting that URL13:53
shardywhich in most cases is an alarm, but you can trigger it manually13:53
*** zaneb has joined #heat13:57
sdagueok, so for a scenario test we should bake the alarm part into this. I could see us doing HARestarter hitting that url directly as an API test, especially if there was a super cheap resource to test13:58
*** zigo has joined #heat13:58
sdaguelike a flavor existing or a user, if we have access to those13:59
*** zns has joined #heat14:00
*** ramishra has joined #heat14:01
*** gokrokve has joined #heat14:01
*** ramishra_ has quit IRC14:02
*** maishsk has joined #heat14:04
maishskgood afternoon14:04
maishskanyone up and about ?14:04
sdake_7am here14:06
sdake_barely awake14:06
maishskHi14:06
*** gokrokve has quit IRC14:06
*** rwsu has joined #heat14:06
maishskI was wondering - HEAT has the option of performing operations during the creation of a stack14:07
sdake_define "performing operations"14:08
maishskis there any option to perform operations when a stack is removed - (just for example - remove DNS records or remove puppet certficates)14:08
*** ramishra_ has joined #heat14:08
sdake_we call that quiescing, and we plan to tackle that in Juno14:08
sdake_we need it for stack update and autoscaling use cases14:08
sdake_tripleo and tusker cats need it14:08
sdake_so its going to happen one way or another :)14:08
*** ramishra has quit IRC14:09
*** cfriesen has joined #heat14:09
maishskis there a blueprint currently available?14:09
*** bnemec has joined #heat14:09
*** lipinski has joined #heat14:10
sdake_i am not sure on blueprints14:10
sdake_usually with a blueprint someone proposes HOW not WHAT14:11
sdake_we haven't figured out HOW yet :)14:11
sdake_but we got when figured out :)14:12
maishskthat is funny... :)14:12
*** jordanP has joined #heat14:12
maishskany discussion topics that I look at / chime in?14:12
*** cmyster has quit IRC14:13
jordanPhi guys, I've juste filled a bug report " Possible confusion between auth_uri and auth_port" (https://bugs.launchpad.net/heat/+bug/1300246 )14:13
uvirtbotLaunchpad bug 1300246 in heat "Possible confusion between auth_uri and auth_port" [Undecided,New]14:13
jordanPcan someone confirm my saying :)14:13
jordanPplz14:13
*** sjmc7 has joined #heat14:19
*** jcru has joined #heat14:23
*** david-lyle has joined #heat14:25
*** Darnoth has joined #heat14:26
*** sballe has quit IRC14:29
*** duncanjw has quit IRC14:31
*** ramishra_ has quit IRC14:36
*** sergmelikyan has joined #heat14:37
*** jdob_ has quit IRC14:38
openstackgerritBartosz Górski proposed a change to openstack/heat: Ensure parameter timeout_mins available in update  https://review.openstack.org/7621114:40
*** jdob has quit IRC14:41
*** TonyBurn has quit IRC14:43
*** alexheneveld has quit IRC14:45
*** ramishra has joined #heat14:45
*** rcleere has joined #heat14:48
*** mkerrin has quit IRC14:53
*** vijendar has joined #heat14:54
*** alexheneveld has joined #heat14:55
*** alexheneveld_ has joined #heat14:56
*** maishsk has left #heat14:58
*** IlyaE has joined #heat14:58
*** alexheneveld has quit IRC14:59
*** alexheneveld_ is now known as alexheneveld14:59
openstackgerritA change was merged to openstack/heat: Properly delete OS::Nova::FloatingIPAssociation  https://review.openstack.org/8402114:59
*** pas-ha has quit IRC15:02
*** gokrokve has joined #heat15:02
*** ramishra_ has joined #heat15:04
*** ramishra has quit IRC15:05
*** gokrokve has quit IRC15:06
*** tspatzier has quit IRC15:06
openstackgerritThomas Herve proposed a change to openstack/heat: Pass and use the environment in validate_template  https://review.openstack.org/8344215:07
*** alexpilotti has quit IRC15:07
*** blamar has quit IRC15:07
*** mkerrin has joined #heat15:11
*** ramishra_ has quit IRC15:11
*** ramishra has joined #heat15:12
therveshardy, So do you think #1300246 is valid? It seems we should be using auth_host/port instead of auth_uri15:15
*** ramishra has quit IRC15:16
*** gokrokve has joined #heat15:17
*** gokrokve_ has joined #heat15:20
*** gokrokve has quit IRC15:21
*** ramishra has joined #heat15:21
shardytherve: I'm not sure tbh, AFAICS heat doesn't use auth_uri at all except for ec2tokens, where probably using the public endpoint is the right thing15:26
therveshardy, It's used by our KeystoneClientV3 it seems15:27
therveself.v3_endpoint = cfg.CONF.keystone_authtoken.auth_uri.replace( 'v2.0', 'v3')15:27
openstackgerritBartosz Górski proposed a change to openstack/heat: Fix timeout for stack actions  https://review.openstack.org/7790215:28
shardytherve: Hmm, maybe we need to change that, but my original expectation was that we'd want to make requests to the public keystone API, as they're on behalf of a user15:29
*** kgriffs|afk is now known as kgriffs15:29
shardyMy understanding was that the admin details in auth_host etc were only for getting a new token, e.g in keystoneclient's auth_token15:29
therveThat's one way to see it15:30
therveshardy, Some deployment(s) don't have access to publicURL from the infra itself15:31
shardySaying "Other Openstack projects deals fine with this" is kinda innacurate, because all other projects only use keystone for token validation15:31
*** alexpilotti has joined #heat15:31
shardytherve: But aren't there limitations on what you can do via the keystone admin endpoint?15:31
shardyI thought there were15:31
therveGood questions15:31
*** mkerrin has quit IRC15:31
jordanPshardy, I filled the bug report. I know that 'Other Openstack projects deals fine with this' is inaccurate, sorry15:32
shardyjordanP: Hi, no worries, just trying to figure out what the best solution is15:32
jordanPokay15:32
jordanPin my env, publicURL (auth_uri) is behind a SSL but internal URL is not. PublicURL is not accesible from the heat node itself15:33
shardyjordanP: so, to clarify, you can access the public endpoint of every service except keystone?15:33
therveArguably, we'd use adminURL when using service admin creds15:33
jordanPshardy, I'va submitted a patch to use internalURL in engine/clients.py15:34
jordanPit was merged a few month ago15:34
jordanPI meant, to be able to configure on which endpoint type to connect15:34
jordanPit works well with all projects, but keystone, as keystone is "special"15:34
*** TonyBurn has joined #heat15:35
shardytherve: that argument could be correct, I'm just a little worried about the implications of routing all user-initiated requests to the admin endpoint15:35
therveshardy, Agreed, we'd need to check what happens then15:36
*** alexpilotti has quit IRC15:36
jordanPdo you route requests "as is" or you initiate new request to keystone ?15:36
*** ramishra has quit IRC15:36
thervejordanP, Both15:37
shardyjordanP: we initiate new requests, either directly using the credentials in the request, or using heat administrative credentials, depending on how you have configured heat15:37
shardybut, for example, are extensions like OS-TRUST available via the admin endpoint?15:38
*** mkerrin has joined #heat15:38
jordanPat the moment, the work arround for my env is to configure auth_uri to point to admin/private endpoint, but I shouldn't be so I think, as far as I understand the diff between auth_uri and auth_host15:38
jordanPshardy, I believe that's why there's a difference between auth_host and auth_uri, in other OS I have to configure both15:39
jordanPbut heat only uses auth_uri15:39
jordanP*other OS projects15:39
thervejordanP, The point is that adminURL ought to be functionally different. We (heat) don't know the differences15:40
openstackgerritA change was merged to openstack/heat: version migration fails if version is an integer  https://review.openstack.org/8386915:40
shardyjordanP: I think maybe the issues stem from our using auth_uri as a basis for the endpoint passed to keystoneclient15:41
shardyjordanP: that was a workaround for the fact that everyone still had hard-coded v2.0 endpoints15:41
jordanPI agree but I am not sure15:41
shardyperhaps we can look at removing that as AIUI keystoneclient now has version discovery15:42
shardythen we can let the client work out what endpoint to use via the catalog15:42
shardywhich is the "right way" to do it, but until now didn't work for v3 keystone15:42
shardyjordanP: do you have versioned keystone endpoints in the catalog?15:44
jordanPI have to look how other project does it. But I feel that heat should no try to contact keystone using auth_uri15:44
jordanPshardy, yes I have. But ATM i tries to make heat work with keystone v2...15:45
therveWell that doesn't really tell us anything. Heat has some unique requirements15:45
jordanPso i am using the plugin in contrib/15:45
jordanPtherve, true.15:45
shardyjordanP: That would have been valuable information to disclose when reporting the issue15:46
shardyjordanP: the non-contrib heat_keystoneclient is v3 only15:46
jordanPthe pb is the same, v2 and v3 tries to contact keystone trough auth_uri which is unreachable from my heat node15:47
jordanPI can make auth_uri to point to my internal endpoint, which should fixe the issue15:48
jordanPbut I still think it's wrong and it's not what the keystone middleware expects, IMO15:49
*** ramishra has joined #heat15:49
shardyjordanP: Ok, so can you provide an example of another project which creates a keystoneclient Client, and passes in an auth_url derived from the admin endpoint details?15:50
jordanPyep !15:51
jordanPthat's what I should do now :)15:51
shardyjordanP: I'm just trying to decouple the "uses keystoneclient directly" requirement from "has auth_token int the API pipeline" use-case which all projects have15:51
thervejordanP, It seems auth_uri is only used by the middleware to do a redirect in case of error15:52
jordanPshardy, I don"t understand your last point, but I must say I am not familiar with all these mechanisms15:53
shardyjordanP: The configuration section in question is primarily for the API paste filter, provided by keystoneclient, the auth_token middleware15:53
shardyarguably we shouldn't be (ab)using the API configuration in heat-engine15:54
jordanPtherve, auth_uri seems to be used to connect to keystone directly, I mean there's point to be somewhere the URL to talk to keystone, and to Heat, it's auth_uri15:54
shardyperhaps the simplest fix is to provide a heat-specific auth_uri which defaults to the keystonclient one if not set15:54
*** tomek_adamczewsk has quit IRC15:54
thervejordanP, I'm differentiating how heat uses auth_uri and how the keystone middleware uses it15:55
jordanPah ok15:55
thervejordanP, You said "it's not what the keystone middleware expects"15:55
therveBut it doesn't really uses it for anything useful15:55
jordanPindeed the middleware only uses auth_uri when talking with the client, to set an httpheader named WWW-something15:56
therveIt does a redirect in case of 401 AFAIU15:57
*** andrew_plunk has joined #heat15:58
*** e0ne_ has joined #heat16:01
*** tango has joined #heat16:01
*** ramishra has quit IRC16:04
*** e0ne has quit IRC16:04
*** IlyaE has quit IRC16:09
*** e0ne has joined #heat16:12
*** sdake has joined #heat16:14
*** sdake has quit IRC16:14
*** sdake has joined #heat16:14
*** e0ne_ has quit IRC16:15
*** jordanP has quit IRC16:21
*** pvaneck has joined #heat16:22
openstackgerritA change was merged to openstack/python-heatclient: Resolve files in resource types  https://review.openstack.org/8052816:24
*** che-arne has quit IRC16:27
*** IlyaE has joined #heat16:30
*** e0ne has quit IRC16:39
*** pafuent has left #heat16:42
*** duncanjw has joined #heat16:45
*** RockKuo_TW_PC has quit IRC16:46
*** pafuent has joined #heat16:47
*** harlowja_away is now known as harlowja16:48
shardysdake: Sorry for the delay - I think this example basically does what you want:16:49
shardyoops sdague ^^16:49
shardyhttp://paste.fedoraproject.org/90310/2845191316:49
shardytab-completion fail ;)16:49
sdagueshardy: awesome, I'll give it a shot in a few. Thanks much.16:50
*** jdob has joined #heat16:50
shardysdague: np!16:50
*** RockKuo_iPad has joined #heat16:53
*** RockKuo_iPad has quit IRC16:57
*** andersonvom has joined #heat16:59
*** TravT has joined #heat17:03
*** derekh has quit IRC17:04
*** TravT has quit IRC17:07
*** TravT has joined #heat17:07
*** alexpilotti has joined #heat17:07
*** asalkeld has joined #heat17:07
*** rwsu has quit IRC17:11
*** jistr has quit IRC17:14
*** gokrokve has joined #heat17:15
SpamapSstevebaker: I'm around for a while, so whenever you want to chat.17:16
*** pablosan has joined #heat17:16
*** gokrokve_ has quit IRC17:18
*** cmyster has joined #heat17:21
cmysterevening17:24
*** bvandenh has quit IRC17:24
*** tspatzier has joined #heat17:25
*** arbylee has joined #heat17:30
*** gokrokve has quit IRC17:31
*** gokrokve has joined #heat17:32
*** gokrokve_ has joined #heat17:34
*** gokrokve has quit IRC17:36
*** bvandenh has joined #heat17:36
*** gokrokve has joined #heat17:37
*** gokrokve_ has quit IRC17:38
*** e0ne has joined #heat17:41
openstackgerritThomas Spatzier proposed a change to openstack/heat: Move some template validation to Template class  https://review.openstack.org/8398417:42
openstackgerritThomas Spatzier proposed a change to openstack/heat: Check top-level sections when parsing a template  https://review.openstack.org/8375817:42
*** arbylee has quit IRC17:45
*** arbylee has joined #heat17:45
*** rustlebee is now known as russellb17:47
*** gokrokve has quit IRC17:49
*** gokrokve has joined #heat17:49
*** packet has joined #heat17:50
*** gokrokve has quit IRC17:53
*** cmyster has quit IRC17:54
*** tspatzier has quit IRC17:54
*** TonyBurn has quit IRC17:56
*** yogesh has joined #heat17:56
*** cmyster has joined #heat17:56
openstackgerritBartosz Górski proposed a change to openstack/heat: Fix timeout for stack actions  https://review.openstack.org/7790217:56
*** denis_makogon has quit IRC17:59
*** dmakogon_ has joined #heat17:59
*** IlyaE has quit IRC18:07
*** jmckind has quit IRC18:08
*** IlyaE has joined #heat18:08
openstackgerritBartosz Górski proposed a change to openstack/heat: Fix timeout for stack actions  https://review.openstack.org/7790218:11
openstackgerritCyril Roelandt proposed a change to openstack/python-heatclient: Python 3: fix test_template_utils.py  https://review.openstack.org/8419818:15
*** tspatzier has joined #heat18:16
*** IlyaE has quit IRC18:17
*** kevinbenton has joined #heat18:17
*** IlyaE has joined #heat18:27
*** lipinski has quit IRC18:28
*** gokrokve has joined #heat18:29
*** gokrokve has quit IRC18:34
*** gokrokve has joined #heat18:37
*** gokrokve_ has joined #heat18:38
*** lipinski has joined #heat18:40
openstackgerritJason Dunsmore proposed a change to openstack/heat: Add show_deleted parameter to stack-list API  https://review.openstack.org/8031218:40
*** gokrokve has quit IRC18:41
*** gokrokve_ has quit IRC18:43
*** duncanjw has quit IRC18:46
*** gokrokve has joined #heat18:51
*** jcru has quit IRC18:55
yogeshhello, i need help on a basic template question18:57
yogeshcan i create the resources conditionally?18:57
yogeshbasically if a supplied parameter has value 1 then create single compute resource and if 2 then create 2 of them18:57
*** jcru has joined #heat18:58
*** jstrachan has quit IRC19:00
*** david-lyle has quit IRC19:00
sdake_yogesh for that case you can using a scaling group and set the minimum scaling group size to the parameter of the # of nodes19:01
yogeshsdake_: thanks, lemme try it out19:04
yogeshis there a way to have something like a "case" or "if else" in the template...i guess no, but just to ensure19:05
sdake_there are no conditionals, hot is declarative not imperative19:05
*** e0ne has quit IRC19:05
yogeshok...19:06
yogeshlemme check out on scaling gorups19:06
yogeshgroups*19:06
yogeshthanks much19:06
*** e0ne has joined #heat19:06
sjmc7there is a CFN conditional construct19:06
sjmc7no plans to add something similar?19:06
sdake_sjmc7 there is no analog in heat for the cfn conditional construction19:06
sdake_sjmc7 hard to predict - I'd not be keen for it but some others in the core team are interested in such a construct19:07
yogeshit surely would be helpful...19:07
sdake_I see conditionals as a slippery slope which must be avoided :)19:07
sjmc7:)19:07
sjmc7can't fight progress? :)19:08
yogeshadds to flexibility19:08
sdake_i could see how that could lead to a "ok now we want python as the HOT dsl"19:08
*** e0ne has quit IRC19:08
sdake_I understand its useful, but its not declarative :)19:08
sjmc7i think while it's in CFN there'll continue to be arguments for it in heat but i can see why you're wary19:08
*** tspatzier has quit IRC19:09
sdake_hot is tidy and simple to learn - the intrinsics are easy to understand19:10
sdake_this is what makes hot very appealing19:10
sdake_adding a bunch of language features makes it less attractive from the "how long does it take to learn" POV19:10
*** john-n-seattle has quit IRC19:11
sdake_conditionals imo belong in a higher level component (workflow perhaps?)19:12
*** john-n-s- has quit IRC19:13
yogesh+119:13
yogeshthey sure do19:13
*** john-n-seattle has joined #heat19:16
*** andrew_plunk has quit IRC19:16
*** john-n-s- has joined #heat19:18
*** Ajaeger1 has joined #heat19:22
Ajaeger1Hi, the translation jobs currently are broken since we have broken po files. Could you review and approve this, please? https://review.openstack.org/#/c/83960/19:22
*** bgorski has quit IRC19:27
stevebakerAjaeger1: done19:28
Ajaeger1Thanks!19:30
asalkeldjasond, you got a moment?19:32
jasondasalkeld: sure19:34
*** sballe has joined #heat19:34
openstackgerritAndreas Jaeger proposed a change to openstack/heat: Check that all po/pot files are valid  https://review.openstack.org/8422619:40
*** gokrokve has quit IRC19:40
Ajaeger1This patch ^ gates heat against introducing the breakage from 83960 again.19:40
*** gokrokve has joined #heat19:40
*** gokrokve_ has joined #heat19:42
*** e0ne has joined #heat19:44
*** gokrokve has quit IRC19:45
openstackgerritAndreas Jaeger proposed a change to openstack/heat: Check that all po/pot files are valid  https://review.openstack.org/8422619:45
*** david-lyle has joined #heat19:47
*** radez is now known as radez_g0n319:49
*** Ajaeger1 has quit IRC19:59
stevebakerSpamapS: so I have a working collector which depends on heatclient and keystoneclient, but I'm having trouble integrating that with test_collect since that assumes that all collectors can be mocked out by passing in an alternate requests_impl20:00
*** pablosan is now known as zz_pablosan20:01
*** zns_ has joined #heat20:06
*** Tross has left #heat20:08
*** zns has quit IRC20:09
*** Tross has joined #heat20:09
*** Tross has left #heat20:09
*** akuznetsov has quit IRC20:13
lifelessuhm20:15
lifelesswhat does heat stack-delete testenv20:15
lifelessERROR: Failed to stop stack (testenv) on other engine (9bb3ee47-79af-44c7-8d6b-49110c9fea5f)20:15
lifelessmean when I only have one engine running20:15
lifeless ps fax | grep heat-engine20:16
lifeless 4097 pts/2    S+     0:00      \_ grep --color=auto heat-engine20:16
lifeless32302 ?        Ss     0:32 /opt/stack/venvs/heat/bin/python /opt/stack/venvs/heat/bin/heat-engine20:16
lifelessroot@undercloud-notcompute-jws3awlsb2kh:/opt/stack/tripleo-image-elements/elements/tripleo-cd#20:16
lifelessstevebaker:  ^20:16
stevebakerlifeless: what does heat stack-list show for the state of that stack>20:17
stevebaker?20:17
lifeless| b7ff4cb2-0e1c-46a4-8808-542cfe7d3a2d | testenv        | CREATE_IN_PROGRESS | 2014-03-31T19:26:35Z |20:18
lifelessI have restarted heat-engine since that timestamp20:18
lifelessstevebaker: ^20:21
stevebakerlifeless: I think you will need to capture the heat-engine log during the stack-delete call to diagnose this.20:21
*** rwsu has joined #heat20:22
lifelessstevebaker: http://paste.openstack.org/show/74695/http://paste.openstack.org/show/74695/20:22
lifelesshttp://paste.openstack.org/show/74695/20:22
*** sballe has quit IRC20:24
*** zz_pablosan is now known as pablosan20:24
zaneblifeless: it's _supposed_ to send a ping to your old (dead) heat-engine, and go ahead and delete anyway if (when) it times out20:25
lifelesszaneb: so, I can't get tripleo-ci back up again until I can get past this20:25
lifelesszaneb: is there a knob to permit sysadmins to fix things?20:25
zaneblifeless: delete the entry in the lock table in the DB?20:26
zanebjasond: about? ^20:26
jasondzaneb: what's up?20:27
zanebjasond: see lifeless's question above20:27
lifelesswow that table grows cruft20:27
lifelessrows dating back to early feb20:28
lifelesstruncate table ftw20:28
zaneblifeless: do you restart Heat in the middle of operations a lot?20:28
lifelesszaneb: of course20:28
lifelesszaneb: deployment of engines cannot in any sane world be interlocked with users using heat20:28
shardywhat happens when you restart the nova scheduler, or compute service in the middle of spawning vm's, out of interest?20:29
shardyI'm interested what their recovery strategy is for such a scenario, if it's common20:30
jasondlifeless: how many times did you encounter that?20:30
lifelessshardy: compute service - vms deploying but not deployed *to that node* go to error. Workaround is to disable the compute engine via the api, wait a short while, then deploy, then reenable20:30
stevebakerI thought there would be some sort of timeout on locks for dead engines, but I can't see anything obvious20:30
shardylifeless: interesting, thanks20:30
openstackgerritA change was merged to openstack/heat: Open Juno development  https://review.openstack.org/8407720:31
lifelessshardy: ideally nova would just deal, but since there is a reasonable thing that doesn't involve waiting forever, its ok.20:31
lifelessshardy: the scheduler is more of an issue, in principle you run two and just kill them serially. in practice... well, not sure yet. ask me when the HA control plane is well established in tripleo.20:32
jasondstevebaker: they're always confirmed to be alive20:32
stevebakerok, the call to elif engine_alive looks suspect, since that method only returns None or False20:32
stevebakerservice.py line 70720:32
stevebakeroh, ignore me20:33
zanebstevebaker: look here: https://github.com/openstack/heat/blob/master/heat/engine/stack_lock.py#L7520:33
sdakestevebaker I've been all over that part of the code - imo multiengine is in solid shape except it suffers from spit brain20:33
stevebakerbrain spit20:34
sdakemy brain has split multiple times!20:34
zanebstevebaker: actually, I'm wrong because it is calling try_acquire(), not acquire20:37
zanebbut the code looks equivalent20:38
*** andrew_plunk has joined #heat20:39
zaneblifeless: it appears that the other heat-engine is alive enough to respond to pings, but not enough to stop doing whatever it's doing20:40
lifelesszaneb: its dead jim20:40
lifelesszaneb: see my ps listing above20:40
zanebhmm20:41
zaneblifeless: if you retry the delete a second time will it work?20:41
lifelessunless ps is *entirely* lying to me20:41
lifelesszaneb: it did not20:41
lifelesszaneb: I tried a few times20:41
lifelesszaneb: then asked here20:41
lifelesszaneb: then truncated the lock table once pointed at that20:42
stevebakeror its not doing anything and it is wedged IN_PROGRESS for some other reason20:42
sdakedid the update involve a floating ip20:42
lifelessstevebaker: no, process was entirely gone20:42
lifelesssdake: no20:42
sdakelifeless split brain a possibility?20:43
lifelesssdake: one server20:43
sdakehow doe smultiengine play int oit?20:43
zanebso somehow we're getting True returned from here: https://github.com/openstack/heat/blob/master/heat/engine/stack_lock.py#L4320:43
sdakeI guess I missed the probelm report :)20:43
lifelesssdake: ps fax full | grep heat-engine output is above20:43
lifelesssdake: I restarted the engnie20:43
sdakethe dreaded restart20:44
zanebsdake: the engine was restarted in the middle of a create operation, now the stack cannot be deleted20:44
lifelesswell I deleted it now, thanks to deleting the stack lock row20:45
sdakezaneb stacklock only listens on the topic of the engine_id20:45
stevebakerI do that frequently, and it works for me20:46
sdakewould make sense a restart would respond with a listen request to the restarted server20:46
sdakethe engine_id does not change between runs20:46
zanebsdake: yes it does20:46
lifelessit doesn't?20:46
lifelesshow is the id persisted ?20:47
sdakemoment let me double check the code20:47
*** sgordon has quit IRC20:47
stevebakergenerate_engine_id20:47
jasondsdake: yes, every engine process has a unique id20:47
sdakeyup every engine is unique20:48
sdakemy bad20:48
jasondif it's restarted, it will have a new uuid20:48
sdakeone possibility is somehow the exchanges got confused20:48
sdakeeg, amqp problem20:48
stevebakermaybe "listening" should assert a matching engine id before returning True20:49
andersonvomhey folks, is it possible to use functions (e.g. str_replace) in parameters?20:49
lifelessit was, it broke20:49
andersonvomlifeless: as in "it needs to be fixed" or "we don't really want that anymore"?20:50
*** e0ne has quit IRC20:50
*** e0ne has joined #heat20:51
stevebakerandersonvom: it used to work by accident, then it stopped working as a side-effect of other changes. It could be enabled again once we make the concious decision to make it part of the HOT spec20:51
zanebextremely curious what y'all are using that for20:52
* zaneb had not heard of this20:52
jasondlifeless: if you see this happen again, please see which engine or engines are subscribed to the amqp queue named for the engine ID referenced in the StopActionFailed message.  so in the error case above, it would've been a queue named "9bb3ee47-79af-44c7-8d6b-49110c9fea5f"20:52
andersonvomstevebaker, lifeless: thanks! =)20:53
lifelessjasond: how can a dead engine be subscribed?20:54
lifelessandersonvom: I believe it was considered ok to add back, but needs a) work and b) tests.20:55
lifelesszaneb: we used it to centralise calculated values - basically as variables20:55
jasondlifeless: it wouldn't be, but maybe another engine was subscribed to the dead engine's queue.  not sure how that would happen, but i can't think of another explanation for what you saw20:55
*** e0ne has quit IRC20:55
*** jdob has quit IRC20:56
andersonvomlifeless: fair enough! =P20:56
*** pablosan is now known as zz_pablosan20:57
*** harlowja is now known as harlowja_away21:00
openstackgerritChmouel Boudjnah proposed a change to openstack/heat: Skip tests when loading plugins  https://review.openstack.org/8411721:01
lifelessjasond: well, I can check. what output do you want?21:01
jasondlifeless: are there any consumers for queue "9bb3ee47-79af-44c7-8d6b-49110c9fea5f"?21:03
stevebakerhttp://tarballs.openstack.org/heat/heat-2014.1.rc1.tar.gz21:03
stevebakerjuno is open21:03
stevebakerkeep an eye out for fixes which would justify an rc221:04
*** sgordon has joined #heat21:05
SpamapSstevebaker: I see.21:06
stevebakerSpamapS: I could:21:06
stevebaker1. do the keystone and heat calls with raw requests21:06
SpamapSI like that for one simple reason: less dependencies to install. :)21:07
SpamapSbut21:07
SpamapSI have a better idea21:07
stevebaker2. refactor test_collect to use a factory method from test_* instead of assuming it needs a requests_impl21:07
SpamapSwhy don't we use one-off or signed urls?21:07
SpamapS(in juno.. I get that we don't have that option right now ;)21:07
SpamapSI've always been a bit confused why we don't just pass in a secret UUID that the agent would then use to establish secure comms.21:08
shardySpamapS: because all requests are authenticated via keystone21:08
shardySpamapS: essentially we are doing that via a random uuid password21:09
stevebakerbut with real keystone users21:09
shardyIf oauth support ever lands in keystoneclient, we could add the option to use oauth signed urls21:09
SpamapSshardy: right, so I'm saying that for an in-instance agent, not having to be able to reach keystone is a win.21:10
SpamapSoauth would be cool yeah21:10
shardySpamapS: but then we have to worry about a whole load of stuff that keystone currently handles for us21:11
SpamapSshardy: this is super super super narrow focus21:11
SpamapSbut anyway, keystoneclient and heatclient vs. building your own requests..21:12
SpamapSI did raw requests for ec2 and cfn because "F boto".21:12
SpamapSBut keystoneclient and heatclient are somewhat sane compared to boto :)21:12
stevebakeryeah, but its impractical to swap out their requests usage21:13
*** pafuent has left #heat21:13
shardySpamapS: I agree that keystone currently lacks some features we'd like to improve the in-instance user use-case, but short-circuiting keystone and doing it all ourselves is not the answer, IMO21:14
shardySpamapS: anyway, I proposed a summit session so we can discuss the roadmap for this stuff :)21:15
SpamapSshardy: it isn't doing it all ourselves, it is doing it in heat-engine to simplify in-instance tools.21:15
SpamapSmuch like the current cfn signals work21:15
SpamapSwhich I think is "tha bomb"21:15
SpamapSexcept the XML part ;)21:15
shardyAnd maintaining another special variety of auth middleware, and dealing with how to revoke the secrets if they are leaked and end up known outside the stack, doing our own RBAC to limit the API surface accessible etc etc21:17
stevebakerSpamapS: focus! ;)21:17
SpamapSI'd hope that it would just be oauth or something.21:17
SpamapSNot special.21:17
SpamapSAlso for all I care we can shove them in swift and hand out tempurls :)21:17
SpamapSstevebaker: I think it would be fine to refactor the tests a bit to be able to pass an arbitrary "client impl"21:18
shardySpamapS: Yeah, https://blueprints.launchpad.net/heat/+spec/oauth-credentials-resource21:18
shardyThe client support has been blocked for $many cycles afaict21:18
SpamapSstevebaker: so instead of "requests" it is just "the thing that works like the collector expects a client to work"21:18
*** harlowja_away is now known as harlowja21:19
sdake_\o/ rc1 released ;)21:19
SpamapSwell done21:19
SpamapSstevebaker: ^521:19
stevebakerSpamapS: 5^21:19
sdake_too bad its not friday, i'd make a ^ joke21:20
stevebakerSpamapS: ok, I'll hack the tests21:20
SpamapSanyway, any scheme that requires instances to reach keystone will create extra problems for operators who run with tenant isolated networks.21:20
SpamapSThey'll already be struggling to get heat-api traffic out21:20
*** e0ne has joined #heat21:21
*** zz_pablosan is now known as pablosan21:22
SpamapSFeels like neutron-metadata-agent will need to become a little bit smarter... otherwise networks with no gateway will have no way to even be routed to keystone and heat.21:22
*** e0ne has quit IRC21:23
*** alexheneveld has quit IRC21:24
*** e0ne has joined #heat21:24
*** zns_ has quit IRC21:25
*** e0ne has quit IRC21:26
*** sgordon has quit IRC21:27
andersonvomstevebaker: when will feature freeze be lifted?21:30
stevebakerandersonvom: now21:30
SpamapS+A the world!!21:33
*** arosen1 has joined #heat21:34
*** pablosan is now known as zz_pablosan21:34
*** alexheneveld has joined #heat21:36
*** Slower_ has quit IRC21:38
*** rpothier has quit IRC21:39
*** Slower has joined #heat21:39
*** vijendar has quit IRC21:41
*** aweiteka has quit IRC21:46
andersonvomstevebaker: oooh, that was quick! :P21:48
*** duncanjw has joined #heat21:48
andersonvomstevebaker: can we lift this -2 then? https://review.openstack.org/#/c/58641/ :D21:50
*** andrew_plunk has quit IRC21:50
stevebakerandersonvom: any abandoned changes will need to be un-abandoned before -2s can be raised21:51
andersonvomwhoops21:53
andersonvomstevebaker: done21:53
stevebakerandersonvom: done21:54
*** tnurlygayanov_ has quit IRC21:55
*** tnurlygayanov has joined #heat21:56
*** dims has quit IRC21:57
*** e0ne has joined #heat21:59
andersonvomstevebaker: danke schon! =)22:02
*** packet has quit IRC22:02
stevebakerandersonvom: alstublieft22:03
*** zz_pablosan is now known as pablosan22:04
*** zns has joined #heat22:10
*** dims has joined #heat22:13
*** e0ne has quit IRC22:13
arosen1does anyone have a heat template that does anything with docker off hand?22:14
*** rcleere has quit IRC22:20
*** lipinski has quit IRC22:21
*** lipinski has joined #heat22:21
*** lipinski has quit IRC22:26
*** jcru has quit IRC22:27
*** yogesh has quit IRC22:28
openstackgerritAnderson Mesquita proposed a change to openstack/heat: Check resources are in expected states  https://review.openstack.org/5864122:36
andersonvomsweet, no merge conflicts! =)22:36
arosen1I'm trying to use docker with heat. I set the following value in /etc/heat/heat.conf    plugin_dirs=/opt/stack/heat/contrib/docker/docker/resources/ though when I load my docker template h-eng is returning:22:40
arosen122:40
arosen1ERROR: Unknown resource Type : OS::Heat::Docker22:41
arosen1Anyone know off hand where I might be going wrong?22:41
stevebakerarosen1: it may have been renamed recently22:41
stevebakerarosen1: DockerInc::Docker::Container22:42
arosen1stevebaker:  so OS::Heat::Docker --> OS::Heat::DockerInc::Docker::Container22:42
stevebakerarosen1: no, OS::Heat::Docker -> DockerInc::Docker::Container22:43
*** asalkeld has quit IRC22:44
arosen1stevebaker:  thanks22:45
*** tango has quit IRC22:49
*** sjmc7 has quit IRC22:52
*** alexpilotti has quit IRC23:11
arosen1I'm playing around with heat and docker. When I try to run this wordpress_mysql.yml file http://codepad.org/Dwp7adAZ i get the following error. It looks like it's trying to launch docker on the node running heat-engine? This should'nt be something that someone is trying to do though right?23:12
*** duncanjw has quit IRC23:18
*** TravT has quit IRC23:21
*** david-lyle has quit IRC23:30
*** zns has quit IRC23:32
stevebakerarosen1: You need to specify the docker_endpoint property http://docs.openstack.org/developer/heat/template_guide/contrib.html#DockerInc::Docker::Container23:32
stevebakerarosen1: that resource is not at all integrated with keystone23:32
*** kgriffs is now known as kgriffs|afk23:32
arosen1stevebaker:  thanks. Another quick question.  I'm using this heat template which is supposed to boot a vm then install docker on top of it then launch a cirros image in it: http://codepad.org/nhujso7623:36
arosen1though  it seems to be failing on the user_data: section. I'm guessing that, #include https://get.docker.io  doesn't install docker for you? I found that here: http://blog.docker.io/category/openstack/23:37
stevebakerarosen1: try adding user_data_format=RAW23:37
stevebakerarosen1: so that #include will be given directly to cloud-init23:38
arosen1stevebaker:  for the docker endpoint property you're talking about does that endpoint just tie you down to one server?23:38
stevebakerarosen1: yes, until there is a container API which has some form of scheduler you will have to manually decide where every container gets created. Heat will not become a scheduler23:40
*** pvaneck has quit IRC23:40
arosen1stevebaker:  like this: http://codepad.org/N2HMS27R ?23:43
stevebakerarosen1: yes23:44
stevebakerarosen1: and I'd be interested to know if that works ;)23:44
arosen1stevebaker:  sure i'll keep you posted. I'm trying to integrate support for heat+docker with neutron though i'm just trying to figure out how things work today.23:45
*** rpothier has joined #heat23:46
stevebakerarosen1: ah, cool23:46
arosen1stevebaker:  no go: http://codepad.org/UeO4c7kP23:49
arosen1I don't see anything about docker in the cloud-init-log23:49
stevebakerarosen1: ok, next attempt. try user_data: {get_file: https://get.docker.io/}23:50
stevebakerarosen1: this will require a recent python-heatclient23:50
arosen1stevebaker:  and delete user_data_format: RAW?23:50
*** arbylee has quit IRC23:51
stevebakerarosen1: you can leave that23:51
arosen1stevebaker:  the python-heatclient needs to be recent on my desktop or in the guest?23:51
stevebakerarosen1: on your desktop. It actually resolves the url on your local machine23:52
arosen1stevebaker:  i'm running from devstack from today so i should have pretty new stuff.23:53
stevebakerthat should be fine23:53
arosen1It doesn't like this line:       user_data: {get_file: https://get.docker.io/}23:53
*** david-lyle has joined #heat23:53
arosen1  in "<unicode string>", line 13, column 29 found unexpected ':'23:54
arosen1get_file no : maybe23:54
*** andersonvom has quit IRC23:56
stevebakerarosen1: try user_data: {get_file: 'https://get.docker.io/'}23:57
*** RockKuo_iPad has joined #heat23:57
*** david-lyle has quit IRC23:58
*** RockKuo_iPad has quit IRC23:58
arosen1stevebaker:  http://codepad.org/7IXzW6AN23:59
*** gokrokve_ has quit IRC23:59
arosen1seems like it did something23:59
*** gokrokve has joined #heat23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!