Monday, 2014-05-05

*** yogeshmehra has quit IRC00:01
*** piyush has quit IRC00:02
*** daneyon_ has joined #heat00:06
*** zns has joined #heat00:06
*** daneyon has quit IRC00:08
*** shakamunyi has joined #heat00:23
*** piyush has joined #heat00:25
*** piyush1 has quit IRC00:26
*** zhiyan_ is now known as zhiyan00:26
*** faramir has quit IRC00:28
*** packet has joined #heat00:35
*** zns has quit IRC00:37
*** yogeshmehra has joined #heat00:38
*** sdake has quit IRC00:38
*** achampion has quit IRC00:41
*** piyush has quit IRC00:42
*** achampion has joined #heat00:46
*** shakamunyi has quit IRC00:48
openstackgerritSteve Baker proposed a change to openstack/heat: Fetch all db resources in one query  https://review.openstack.org/9000200:51
openstackgerritSteve Baker proposed a change to openstack/heat: Refactor DB resource fetching from Resource to Stack  https://review.openstack.org/9000000:51
openstackgerritSteve Baker proposed a change to openstack/heat: resource_get_all_by_stack returns a dict  https://review.openstack.org/9000100:51
openstackgerritSteve Baker proposed a change to openstack/heat: Eager-load Stack.raw_template for Stack.load  https://review.openstack.org/9062300:51
openstackgerritSteve Baker proposed a change to openstack/heat: Fetch RawTemplate from Stack, not a query  https://review.openstack.org/9062200:51
openstackgerritSteve Baker proposed a change to openstack/heat: Do not query database for every metadata_get  https://review.openstack.org/8973700:51
openstackgerritSteve Baker proposed a change to openstack/heat: Use resource methods for metadata get/set  https://review.openstack.org/8973600:51
openstackgerritSteve Baker proposed a change to openstack/heat: Do not initialise stack_user password  https://review.openstack.org/8999900:51
openstackgerritSteve Baker proposed a change to openstack/heat: Give resource fakes a string ID  https://review.openstack.org/9203200:51
openstackgerritSteve Baker proposed a change to openstack/heat: Make Server metadata a passive store again  https://review.openstack.org/9203300:51
*** yogeshmehra has quit IRC00:56
*** shakamunyi has joined #heat01:13
*** IlyaE has quit IRC01:19
*** Michalik- has quit IRC01:19
*** onorua has joined #heat01:25
*** lazy_prince is now known as killer_prince01:27
*** sdake has joined #heat01:28
*** sdake has quit IRC01:28
*** sdake has joined #heat01:28
*** IlyaE has joined #heat01:30
*** blomquisg has quit IRC01:46
*** onorua has quit IRC01:55
*** fandi has joined #heat02:11
*** renlt has joined #heat02:15
*** tiantian has joined #heat02:24
*** onorua has joined #heat02:29
*** mestery has quit IRC02:43
*** packet has quit IRC02:49
*** shakamunyi has quit IRC02:57
openstackgerritEthan Lynn proposed a change to openstack/heat-templates: Description mismatch in F20 hot  https://review.openstack.org/9200003:05
*** blamar has quit IRC03:08
asalkeldstevebaker, have you had any  problems updating a patch series (with then new gerrit?)03:11
asalkeldI have a series and am tring to update the middle one03:12
asalkeldand it refuses, 'cos one of the commits has no changes :(03:12
stevebakerasalkeld: yeah, I had that. I ended up making a whitespace change. I'm assuming its because the series spanned the upgrade, rather than an issue with the new version03:15
asalkeldI see03:15
asalkeldok, thanks03:15
asalkeldwoot, thanks - that worked03:17
*** dims has joined #heat03:21
*** dims has quit IRC03:33
*** killer_prince is now known as lazy_prince04:07
*** asalkeld has quit IRC04:08
*** zpatten has quit IRC04:17
*** zpatten has joined #heat04:21
*** asalkeld has joined #heat04:25
*** achampion has quit IRC04:26
*** achampion has joined #heat04:28
openstackgerritA change was merged to openstack/heat-templates: Description mismatch in F20 hot  https://review.openstack.org/9200004:32
*** daneyon_ has quit IRC04:37
*** daneyon has joined #heat04:37
*** daneyon has quit IRC04:39
*** daneyon has joined #heat04:40
*** SushillKM has joined #heat04:43
*** achampion has quit IRC04:43
*** achampion has joined #heat04:45
*** achampion has quit IRC04:55
*** achampion has joined #heat04:56
*** daneyon has quit IRC04:57
*** lazy_prince has quit IRC04:58
*** IlyaE has quit IRC05:04
*** onorua has quit IRC05:08
*** nkhare has joined #heat05:11
*** chandan_kumar has joined #heat05:26
*** sergmelikyan has joined #heat05:28
*** sab has joined #heat05:34
*** onorua has joined #heat05:35
*** IlyaE has joined #heat05:39
*** saju_m has joined #heat05:40
*** Qiming has joined #heat05:42
*** saju_m has quit IRC05:47
*** IlyaE has quit IRC05:53
*** yogeshmehra has joined #heat05:57
*** SnowDust has joined #heat05:59
*** saju_m has joined #heat06:05
openstackgerritOpenStack Proposal Bot proposed a change to openstack/heat: Imported Translations from Transifex  https://review.openstack.org/8975006:09
*** SushillKM has left #heat06:10
*** cmyster has joined #heat06:10
*** cmyster has joined #heat06:10
*** shivamshukla has joined #heat06:10
cmystermorning06:12
*** IlyaE has joined #heat06:13
*** tiantian has quit IRC06:14
openstackgerritAngus Salkeld proposed a change to openstack/heat: Pass the parent's registry into child stacks  https://review.openstack.org/8622806:23
asalkeldstevebaker, ^ finally got time to look at this06:23
asalkeldused the parent_resource06:23
*** yogeshmehra has quit IRC06:24
*** akuznets_ has quit IRC06:24
*** jprovazn has joined #heat06:25
openstackgerritA change was merged to openstack/heat: Fix status reason in events for deployment signals  https://review.openstack.org/8466506:25
*** akuznetsov has joined #heat06:26
*** rpothier_ has joined #heat06:30
*** julienvey has joined #heat06:31
*** yogeshmehra has joined #heat06:32
*** rpothier has quit IRC06:33
*** sergmelikyan has quit IRC06:40
*** akuznets_ has joined #heat06:48
*** akuznetsov has quit IRC06:48
*** tspatzier has joined #heat06:50
*** tspatzier has quit IRC06:56
*** tspatzier has joined #heat06:59
*** fandi has quit IRC07:05
therveGood morning!07:12
saju_mtherve, Good morning07:15
*** julienvey has quit IRC07:17
*** julienvey has joined #heat07:18
*** fandi has joined #heat07:22
*** jamie_h has joined #heat07:24
*** jamie_h has quit IRC07:25
*** RockKuo_Office has joined #heat07:26
*** sorantis has joined #heat07:27
*** zenoway has joined #heat07:29
*** IlyaE has quit IRC07:35
*** IlyaE has joined #heat07:35
*** sorantis has quit IRC07:36
*** saju_m has quit IRC07:36
*** e0ne has joined #heat07:37
*** IlyaE has quit IRC07:38
*** yogeshmehra has quit IRC07:42
*** IlyaE has joined #heat07:43
*** pas-ha has joined #heat07:47
pas-hamorning all07:47
cmystermorning07:47
*** e0ne has quit IRC07:47
*** openstackgerrit has quit IRC07:53
*** jistr has joined #heat07:57
*** tspatzier has quit IRC07:59
*** tspatzier has joined #heat08:04
*** julienve_ has joined #heat08:05
*** julienvey has quit IRC08:08
*** tiantian has joined #heat08:08
*** IlyaE has quit IRC08:13
*** zenoway has quit IRC08:24
*** che-arne has joined #heat08:24
*** tomek_adamczewsk has joined #heat08:25
*** saju_m has joined #heat08:31
*** tspatzier has quit IRC08:37
*** sorantis has joined #heat08:41
*** tspatzier has joined #heat08:47
sorantismorning08:49
*** cdent has joined #heat08:57
*** cdent has quit IRC08:59
*** Qiming has quit IRC09:23
*** mkollaro has joined #heat09:33
*** ifarkas has joined #heat09:40
*** Michalik- has joined #heat09:43
sorantisstevebaker: hi, have you read my commens https://review.openstack.org/#/c/90029/16 ?09:48
sorantis*comment*09:48
*** tomek_adamczewsk has quit IRC10:07
*** tomek_adamczewsk has joined #heat10:09
*** julienve_ has quit IRC10:13
*** cmyster has quit IRC10:13
*** Qiming has joined #heat10:19
*** fandi has quit IRC10:20
*** SnowDust has quit IRC10:22
*** asalkeld has quit IRC10:22
*** jprovazn has quit IRC10:25
*** sorantis has quit IRC10:25
*** fandi has joined #heat10:32
*** SnowDust has joined #heat10:36
*** sorantis has joined #heat10:39
*** renlt has quit IRC10:43
*** blomquisg has joined #heat11:01
*** RockKuo_Office has quit IRC11:04
*** nkhare has quit IRC11:09
*** bvandenh has joined #heat11:09
*** jprovazn has joined #heat11:10
*** akuznets_ has quit IRC11:13
*** jprovazn is now known as jprovazn_afk11:14
*** akuznetsov has joined #heat11:15
*** bvandenh has quit IRC11:26
*** rpothier_ has quit IRC11:35
*** dims has joined #heat11:39
*** mestery has joined #heat11:39
*** fandi has quit IRC11:43
*** SushillKM has joined #heat11:48
*** mestery has quit IRC11:55
*** mestery has joined #heat11:56
*** SnowDust has quit IRC11:56
*** sdague has left #heat12:00
*** sgordon_ has joined #heat12:00
*** mestery has quit IRC12:01
*** lipinski has joined #heat12:06
*** andersonvom has joined #heat12:16
*** e0ne has joined #heat12:18
*** jdob has joined #heat12:18
*** Michalik- has quit IRC12:20
*** aweiteka has joined #heat12:22
*** rpothier has joined #heat12:28
*** nkhare has joined #heat12:33
*** bvandenh has joined #heat12:35
*** sballe has joined #heat12:36
*** e0ne has quit IRC12:46
*** sab has quit IRC12:48
*** blues-man has joined #heat12:48
*** achampion has quit IRC12:48
*** erecio has joined #heat12:51
*** Michalik- has joined #heat12:53
*** faramir has joined #heat12:59
*** nkhare has quit IRC13:03
*** sorantis_ has joined #heat13:04
*** e0ne has joined #heat13:04
*** sorantis has quit IRC13:06
*** sorantis_ is now known as sorantis13:06
*** Qiming has quit IRC13:12
*** baffle has joined #heat13:19
*** onorua has quit IRC13:22
*** Michalik- has quit IRC13:22
*** m_22 has joined #heat13:23
*** radez_g0n3 is now known as radez13:24
*** jasond` has joined #heat13:35
*** saju_m has quit IRC13:35
*** openstackgerrit has joined #heat13:36
*** blamar has joined #heat13:37
*** SushillKM has quit IRC13:37
*** SushillKM has joined #heat13:37
*** m_22 has quit IRC13:39
*** tiantian has quit IRC13:40
openstackgerritAnderson Mesquita proposed a change to openstack/heat: Ignore template validation when checking stacks  https://review.openstack.org/8990513:43
openstackgerritAnderson Mesquita proposed a change to openstack/heat: Implement check for Instance resource  https://review.openstack.org/8990613:43
openstackgerritAnderson Mesquita proposed a change to openstack/heat: Check resources are in expected states  https://review.openstack.org/8990813:43
*** spzala has joined #heat13:44
baffleShould [ec2authtoken] auth_uri in heat.conf be set to "https://keystone/v3" or "https://keystone/v3/credentials" ?13:46
*** blomquisg has quit IRC13:46
*** mwheckmann has joined #heat13:48
*** faramir has quit IRC13:48
*** SushillKM has quit IRC13:50
*** openstackgerrit has quit IRC13:51
*** vijendar has joined #heat13:52
*** onorua has joined #heat13:52
*** achampion has joined #heat13:52
*** blomquisg has joined #heat13:57
*** jprovazn_afk is now known as jprovazn14:00
*** nkhare has joined #heat14:01
*** aweiteka has quit IRC14:07
*** sjmc7 has joined #heat14:11
*** zns has joined #heat14:12
*** rwsu has joined #heat14:18
*** gokrokve has joined #heat14:19
*** aweiteka has joined #heat14:21
*** m_22 has joined #heat14:23
*** Qiming has joined #heat14:23
*** onorua has quit IRC14:24
*** e0ne has quit IRC14:25
*** nkhare has quit IRC14:25
*** e0ne has joined #heat14:26
*** bvandenh has quit IRC14:27
*** samstav has joined #heat14:29
*** samstav has quit IRC14:30
*** packet has joined #heat14:30
*** metral_zzz is now known as metral14:32
*** piyush has joined #heat14:32
*** pablosan has joined #heat14:34
*** samstav has joined #heat14:34
*** david-lyle has joined #heat14:38
*** TravT has joined #heat14:40
*** daneyon has joined #heat14:45
*** daneyon has quit IRC14:45
*** daneyon has joined #heat14:46
*** kgriffs|afk is now known as kgriffs14:49
*** bigdread has joined #heat14:49
*** bigdread has left #heat14:50
*** julienvey has joined #heat14:50
*** denis_makogon has quit IRC14:50
*** dmakogon_ has joined #heat14:51
*** erecio has quit IRC14:53
*** erecio has joined #heat14:54
*** julienvey has quit IRC14:54
*** zz_gondoi is now known as gondoi14:59
*** IlyaE has joined #heat15:01
*** TravT has quit IRC15:05
*** TravT has joined #heat15:05
thervezaneb, Hey, around? I have some questions about update_allowed_keys15:05
*** TravT has quit IRC15:05
*** TravT has joined #heat15:06
*** sorantis has quit IRC15:06
zanebtherve: o/15:06
thervezaneb, So I wonder a little bit about the purpose. For example, why isn't Metadata updatable for all resources?15:07
zanebI agree it probably should be15:08
therveSo that attribute is somewhat useless I think15:09
*** sabeen has joined #heat15:09
therveI'm seeing the issue when updating DeletionPolicy15:09
*** sabeen has quit IRC15:09
therveIt seems I would need to explicitely support it in Volumes15:10
*** sabeen has joined #heat15:10
therveActually no because Retain is supported by all resources15:11
zanebI would love it if we can get rid of it15:12
zanebbecause it's causing me a headache right now too :)15:12
therveI guess the question is how much backward compatibility we need15:14
therveWe could almost remove the tmpl_diff argument of handle_update :/15:14
zanebyeah15:15
zanebit's a real shame we can't do that without backwards-compatibility issues15:16
thervehandle_update215:16
therve(kidding)15:16
zaneblol15:16
zanebbut I think it's safe to just start ignoring update_allowed_keys15:17
therveSo 1) Ignore update_allowed_keys 2) Handle metadata in Resource 3) Handle deletion policy in Resource15:18
therve?15:18
zaneb4) Profit!15:19
zanebmetadata should probably be updated by calling metadata_update()15:20
zanebdeletion policy should already be handled by Resource afaik. There's no reason for subclasses to even look at it15:21
therveWell it should but it's not :)15:23
therveAlthough I guess if you remove update_allowed_keys maybe it works15:23
zanebyes, I imagine that's the only thing stopping it15:24
*** zhiyan is now known as zhiyan_15:25
*** randallburt has joined #heat15:26
andersonvomhey fellows, is there a way to access the actual resource inside a contraint?  I'd like to create a constraint that would validate the presence of two properties at the same time (i.e. either both or none exist, but not just one)15:29
therveYou need to write custom validation code for doing that AFAIK15:31
*** aweiteka has quit IRC15:31
zanebyes, it's tricky because the Schema objects are more or less standalone15:32
zanebif you can find a way to pull it off that would be awesome, though :) That pattern shows up quite a lot15:32
andersonvomhummm =\15:34
andersonvomdo you know by heart a place where this is currently being done?15:34
therveSomewhere in nova server15:35
therveThere is a custom exception Conflict something15:35
andersonvomtherve: thanks, I'll take a look15:35
*** daneyon has quit IRC15:38
*** daneyon has joined #heat15:38
pas-haandersonvom: https://review.openstack.org/#/c/82853/13/heat/engine/resources/neutron/neutron.py _validate_depr_property_required - smth like this?15:40
pas-haand yes, seems that kind of logic is usually sticked in resource's custom validate()15:41
*** radez is now known as radez_g0n315:41
*** tomek_adamczewsk has quit IRC15:41
*** openstackgerrit has joined #heat15:43
*** aweiteka has joined #heat15:44
*** radez_g0n3 is now known as radez15:44
andersonvompas-ha: yeah, precisely.15:49
andersonvomdoes it make sense to pass not only (value, context) but (value, resource, context) to the constraints?15:50
andersonvomzaneb or therve: ^^15:50
*** shivamshukla_ has joined #heat15:50
*** IlyaE has quit IRC15:50
therveandersonvom, No15:53
zanebandersonvom: IMO it would make more sense to have the properties.Properties class do the verification15:53
zanebsince it has all the properties data available15:54
pas-hazaneb: what if we improve properties schema and add a "conflicts" field accepting a list of other mutually exclusive properties?15:56
*** spzala has quit IRC15:56
*** IlyaE has joined #heat15:56
pas-hathere are several cases where we have required but mutually exclusive properties (like size and backupid of volume), but we can not state them as required as of now15:57
zanebpas-ha: +1, that's actually what I was thinking too15:58
pas-hadoes it deserve a bug or a blueprint?15:58
zanebsure, could be a blueprint. just make sure you co-ordinate with andersonvom16:00
*** rpothier_ has joined #heat16:00
*** rpothier has quit IRC16:03
*** shivamshukla_ has quit IRC16:05
*** lipinski has quit IRC16:08
*** andrew_plunk has joined #heat16:15
*** chandan_kumar has quit IRC16:19
pas-hazaneb: https://blueprints.launchpad.net/heat/+spec/mutually-exclusive-properties16:19
zanebpas-ha: nice work, thank you :)16:20
*** sorantis has joined #heat16:23
tspatzierhas anyone recently tried to use diskimage-builder to build a fedora-20 image for software config? I am getting an error with 11-selinux-fixfiles today, but it worked last week.16:24
*** alexpilotti has joined #heat16:30
*** jistr has quit IRC16:31
*** SushillKM has joined #heat16:38
*** SushillKM has left #heat16:39
SpamapStspatzier: whats the error?16:40
tspatzierHi SpamapS, one sec16:41
*** rbuilta has joined #heat16:41
* SpamapS grabs coffee from kitchen16:41
*** SushillKM has joined #heat16:41
*** SushillKM has left #heat16:42
*** m_22 has quit IRC16:42
tspatzierSpamapS: I pasted the last few lines here http://paste.openstack.org/show/78985/16:45
*** spzala has joined #heat16:46
*** rbuilta has quit IRC16:48
openstackgerritThomas Herve proposed a change to openstack/heat: Implement snapshots for servers and images  https://review.openstack.org/8728016:48
openstackgerritThomas Herve proposed a change to openstack/heat: Add snapshot restore HTTP API  https://review.openstack.org/9212516:48
openstackgerritThomas Herve proposed a change to openstack/heat: Implement stack restore  https://review.openstack.org/9212416:48
openstackgerritThomas Herve proposed a change to openstack/heat: Implement snapshot listing  https://review.openstack.org/9212616:48
openstackgerritThomas Herve proposed a change to openstack/heat: Add APIs to create and manipulate snapshots  https://review.openstack.org/8727916:48
SpamapStspatzier: Not something I've seen. Consider reporting it as a bug in diskimage-builder ..16:48
SpamapStspatzier: also the Fedora focused people in #tripleo may have more insight as well.16:49
tspatzierSpamapS: thanks. I will check in #tripleo if there is someone who knows anything and probably also file a bug. Seems related to a fix for an selinux issue which I have seen recently, that prevented login with a key pair16:50
*** dims has quit IRC16:54
*** mestery has joined #heat16:55
*** e0ne has quit IRC16:58
*** e0ne has joined #heat16:58
*** SushillKM has joined #heat16:59
*** IlyaE has quit IRC16:59
*** mestery has quit IRC17:00
*** SushillKM has left #heat17:00
*** IlyaE has joined #heat17:01
*** dims has joined #heat17:04
*** gokrokve has quit IRC17:11
*** ifarkas has quit IRC17:12
*** beekneemech is now known as bnemec17:15
*** harlowja_away is now known as harlowja17:16
*** shivamshukla_ has joined #heat17:18
*** andersonvom has quit IRC17:19
*** andersonvom has joined #heat17:19
*** erecio has quit IRC17:19
*** erecio has joined #heat17:20
*** openstackgerrit has quit IRC17:20
*** jrist has quit IRC17:20
*** mestery has joined #heat17:21
*** blamar_ has joined #heat17:22
*** jrist has joined #heat17:22
*** vijendar1 has joined #heat17:22
*** blues-man has quit IRC17:22
*** m_22 has joined #heat17:23
*** blamar has quit IRC17:23
*** blamar_ is now known as blamar17:23
*** mestery has quit IRC17:24
*** openstackgerrit has joined #heat17:25
*** vijendar has quit IRC17:25
*** piyush has quit IRC17:27
randallburtandersonvom:  ping. do you have an example template demonstrating https://review.openstack.org/#/c/92134? Perhaps a test using the constraint in a template would be beneficial?17:29
*** lindsayk has joined #heat17:30
*** e0ne has quit IRC17:31
*** sabeen has quit IRC17:36
*** sabeen has joined #heat17:37
*** tspatzier has quit IRC17:37
jasond`does anybody know what angus was referring to WRT show-deleted being deprecated in his comment here https://review.openstack.org/#/c/84520/ ?17:46
*** gokrokve has joined #heat17:48
*** m_22 has left #heat17:51
randallburtjasond`:  not really. responded to that review17:52
jasond`randallburt: thanks17:53
randallburtnp17:53
*** e0ne has joined #heat17:59
*** gondoi is now known as zz_gondoi18:05
*** zz_gondoi is now known as gondoi18:06
*** ifarkas has joined #heat18:08
*** piyush has joined #heat18:11
*** IlyaE has quit IRC18:12
*** piyush1 has joined #heat18:12
*** IlyaE has joined #heat18:14
*** yogeshmehra has joined #heat18:14
*** sabeen has quit IRC18:15
*** bvandenh has joined #heat18:15
*** piyush has quit IRC18:15
*** sabeen has joined #heat18:15
*** yogeshmehra has quit IRC18:16
*** yogeshme_ has joined #heat18:16
*** yogeshme_ has quit IRC18:20
*** yogeshmehra has joined #heat18:20
*** tomek_adamczewsk has joined #heat18:23
skraynevshardy, are still here?18:23
*** shivamshukla_ has quit IRC18:23
*** onorua has joined #heat18:23
*** packet has quit IRC18:27
*** saurabhs has joined #heat18:28
*** dims has quit IRC18:29
*** radez is now known as radez_g0n318:31
*** IlyaE has quit IRC18:32
*** alexpilotti has quit IRC18:38
*** IlyaE has joined #heat18:41
*** radez_g0n3 is now known as radez18:46
*** metral has quit IRC18:48
*** Michalik- has joined #heat18:48
*** sorantis has quit IRC18:49
*** TravT has quit IRC18:51
*** randallburt has quit IRC18:51
*** IlyaE has quit IRC18:52
*** IlyaE has joined #heat18:55
*** TravT has joined #heat18:59
*** e0ne has quit IRC19:02
*** e0ne has joined #heat19:03
*** bvandenh has quit IRC19:05
*** sorantis has joined #heat19:08
*** yogeshmehra has quit IRC19:14
*** radez is now known as radez_g0n319:22
*** randallburt has joined #heat19:23
*** alexpilotti has joined #heat19:24
saurabhsstevebaker: in a heat template how do I specify that I want to spin up n number of instances of a particular resource? is it possible?19:26
stevebakersaurabhs: with one of our group resources http://docs.openstack.org/developer/heat/template_guide/openstack.html#OS::Heat::ResourceGroup http://docs.openstack.org/developer/heat/template_guide/openstack.html#OS::Heat::AutoScalingGroup19:28
lifelesssaurabhs: if its in tripleo you may still need Merge::Map and a scale variable though19:33
*** arbylee has joined #heat19:34
*** tomek_adamczewsk has quit IRC19:35
*** IlyaE has quit IRC19:35
*** lipinski has joined #heat19:37
saurabhsstevebaker lifeless: thanks. that looks straight forward. I have one more doubt about writing heat template for trove. so trove control plane has api, taskmanager and condutor, these are three seperate resources, but they have some parameters common so for specifying metadata for such resources is there a way to specify a common metadata and then a instance/resource specific metadata on the top of it. if its possible it will be helpful to19:37
*** ifarkas has quit IRC19:39
*** mkollaro has quit IRC19:39
lifelesssaurabhs: buffer overflow :)19:41
*** Qiming has quit IRC19:41
*** dims has joined #heat19:42
*** mkollaro has joined #heat19:43
saurabhsso trove control plane has multiple resources api, taskmanager and condutor, these are three seperate resources in a single heat template19:44
saurabhsbut they have some parameters common like nova URLs or IP of the rabbitmq and mysql19:44
saurabhsbut then they also have some specific parameters to them like Taskmanage needs nova admin account creds, but API needs quota parameters19:45
*** pablosan has quit IRC19:45
saurabhsnow in a heat template how I can club the metadata so that I have a common metadata that goes to all these three resources but then add some more parameters to that common list19:45
saurabhsfor specific resources19:46
saurabhslifeless: is this making sense to you or I am going completely off track19:49
saurabhsI guess i am looking for some way of extending metadata (trove-common) for specific resource and adding few more parameters to that list19:50
*** piyush1 has left #heat19:52
*** piyush has joined #heat19:53
openstackgerritJason Dunsmore proposed a change to openstack/heat: Stop periodic watcher tasks before deleting stack  https://review.openstack.org/9165619:57
*** gondoi is now known as zz_gondoi19:57
*** samstav_ has joined #heat19:59
lifelesssaurabhs: sorry, am on a call, but have a look at the tripleo templates to see how we do it - one parameter, just Ref: it in many places19:59
*** samstav has quit IRC20:01
*** julienvey has joined #heat20:03
*** julienvey has quit IRC20:03
*** julienvey has joined #heat20:03
andersonvomrandallburt: you can see the constraint being used here: https://review.openstack.org/#/c/79355/14/contrib/barbican/barbican/resources/secret.py (I added a comment on the original patch as well pointing here)20:03
randallburtandersonvom:  thanks!20:04
*** metral has joined #heat20:05
*** samstav_ has quit IRC20:05
*** samstav has joined #heat20:06
*** sorantis has quit IRC20:08
*** metral has quit IRC20:08
*** metral has joined #heat20:09
*** zz_gondoi is now known as gondoi20:12
*** metral has quit IRC20:13
*** metral has joined #heat20:13
*** kgriffs is now known as kgriffs|afk20:13
openstackgerritA change was merged to openstack/heat: Add database model to store snapshots  https://review.openstack.org/8727720:15
*** funzo has quit IRC20:17
*** funzo has joined #heat20:17
*** funzo is now known as Guest9726420:18
*** Guest97264 has quit IRC20:21
*** achampion has quit IRC20:27
*** dims has quit IRC20:35
*** dims has joined #heat20:37
*** samstav has quit IRC20:39
*** gokrokve has quit IRC20:46
*** che-arne has quit IRC20:47
*** samstav has joined #heat20:47
stevebakersaurabhs: I'm back20:48
*** kgriffs|afk is now known as kgriffs20:50
stevebakersaurabhs: tripleo-heat-templates would have some reasonable examples. You could share config data either with params, or by defining an OS::Heat::StructuredConfig resource which contains the common config and deploy that to the needed servers (one deployment resource per server, defined inside the resource group if necessary)20:51
*** IlyaE has joined #heat20:58
*** asalkeld has joined #heat21:00
*** aweiteka has quit IRC21:03
*** sdague has joined #heat21:09
openstackgerritA change was merged to openstack/heat: Don't dynamically create provider types in the global env  https://review.openstack.org/8969521:10
*** e0ne has quit IRC21:17
*** e0ne has joined #heat21:17
*** tspatzier has joined #heat21:18
*** tspatzier has quit IRC21:21
*** dims has quit IRC21:25
*** blomquisg has quit IRC21:25
*** zns has quit IRC21:26
*** jprovazn has quit IRC21:27
*** julienvey has quit IRC21:28
*** gokrokve has joined #heat21:29
*** rpothier_ has quit IRC21:31
*** gokrokve has quit IRC21:33
*** gokrokve has joined #heat21:39
*** blomquisg has joined #heat21:40
*** gokrokve_ has joined #heat21:44
*** gokrokve has quit IRC21:44
*** lipinski has quit IRC21:44
*** lipinski has joined #heat21:44
*** jasond` has quit IRC21:45
*** gokrokve has joined #heat21:45
*** piyush has quit IRC21:48
*** gokrokve_ has quit IRC21:48
*** gokrokve has quit IRC21:49
*** e0ne has quit IRC21:49
*** e0ne has joined #heat21:49
*** e0ne has quit IRC21:51
openstackgerritSteve Baker proposed a change to openstack/heat: SoftwareDeployments tolerate string zero status code  https://review.openstack.org/9182821:52
*** zns has joined #heat21:53
*** vijendar1 has quit IRC21:55
*** sgordon_ has quit IRC21:55
*** IlyaE has quit IRC21:56
*** spzala has quit IRC21:59
*** onorua has quit IRC22:03
*** lindsayk1 has joined #heat22:06
openstackgerritA change was merged to openstack/heat: Add ISO 8601 date constraint  https://review.openstack.org/9213422:07
SpamapSERROR: The personality property may not contain greater than -1 entries.22:07
SpamapSbest error ever22:08
zanebit would be hard to top that22:08
SpamapSespecially since I don't have personality set on any of the servers in my template22:09
*** lindsayk has quit IRC22:09
*** IlyaE has joined #heat22:09
*** gokrokve has joined #heat22:10
zanebSpamapS: maybe that's your problem22:11
zanebyou need to assign at least -1 personalities22:11
*** piyush has joined #heat22:11
zanebor at least one negative personality22:11
* SpamapS closes eyes and imagines really hard what a template with -1 personalities looks like .. 22:12
* SpamapS is bewildered when an image of Richard Stallman appears22:12
*** ryansb has quit IRC22:12
*** piyush1 has joined #heat22:14
*** lindsayk1 has quit IRC22:14
*** lindsayk has joined #heat22:15
*** piyush has quit IRC22:15
*** dims has joined #heat22:17
*** piyush1 has quit IRC22:18
*** e0ne has joined #heat22:20
*** gondoi is now known as zz_gondoi22:20
*** e0ne has quit IRC22:21
*** e0ne has joined #heat22:22
*** e0ne has quit IRC22:26
SpamapSzaneb: ah, I've found a bug22:27
SpamapSzaneb: -1 means _no_ quota.22:27
SpamapSzaneb: but we treat it as the limit.22:27
zanebtricky22:27
SpamapSI have all -1's for quotas in my nova so I can use the fake driver and create an astronomically big heat template to find where heat and nova break together.22:28
stevebakerwe've already had some fixes for -1 quotas22:29
stevebakerSpamapS: oh, it hasn't landed yet https://review.openstack.org/#/c/89389/22:30
SpamapSah good to know22:30
*** dims has quit IRC22:34
randallburtthe OO purist in me wanted to −2 that patch sooo bad...22:37
*** sabeen has quit IRC22:39
SpamapSrandallburt: Ideally it would just be a function. But OWWW MY HEAD WE CANT USE NASTY OLD FUNCTIONS.22:39
SpamapSthat would.. you know.. be too easy to test. ;)22:40
randallburtSpamapS:  indeed. :D22:40
randallburtfwiw, I'd be more than happy to see that one as a plain old function22:41
randallburtthere's nothing contextual it needs from the object22:41
SpamapSrandallburt: right, in fact, it would be right at home in nova_utils22:42
randallburtan excellent idea22:42
randallburtjasond:  do you still have heartburn over https://review.openstack.org/#/c/89389/ or is it just me at the moment?22:44
*** zns has quit IRC22:45
SpamapSgah22:45
SpamapSresource-list gets _REALLY_ slow with 137 resources22:45
SpamapSreal0m9.034s22:46
SpamapSuser0m0.200s22:46
SpamapSsys0m0.024s22:46
stevebakerSpamapS: can you try with my patch series?22:47
stevebakerSpamapS: https://review.openstack.org/#/q/status:open+project:openstack/heat+branch:master+topic:bug/1306743,n,z22:47
SpamapSstevebaker: even resource-list would be affected?22:47
SpamapSstevebaker: thought you were hitting .metadata()22:47
andrew_plunkthe template parsing of resource-list is what makes it slow I bet22:47
SpamapSyep22:47
randallburtSpamapS:  part of that series addresses loading resources as well22:47
SpamapSeverything is a query22:47
stevebakersure, anything that does Stack.load will see huge improvements with the rest of the patch series22:48
stevebakerthere are a bunch of changes early in that series which still need reviews22:48
SpamapS7s to do a server's metadata-show (with latest master)22:49
SpamapSlet me try your patchset22:49
SpamapSstevebaker: any schema changes or RPC changes?22:49
stevebakerSpamapS: no, just sqlalchemy eager fetch, and changes to internal API to make that practical22:49
SpamapSstevebaker: woot, from 7s to 1.4s22:51
stevebakernice22:51
SpamapS1.4 is still going to be a bit painful22:51
SpamapSbut I bet it gets us past 30 servers22:51
stevebakerI'm sure there is still room for optimization22:52
andrew_plunkstevebaker, I wonder how the eager fetch will work on a system with a large number of tenants22:52
SpamapSstevebaker: looks like there are some indexes needed actually22:53
stevebakerandrew_plunk: I don't think its related to tenant count22:53
SpamapShttp://paste.ubuntu.com/7401520/22:53
SpamapS1.5ms ... but there were quite a few of them in a row22:54
*** david-lyle has quit IRC22:55
andrew_plunkstevebaker: lazy loading seems to be the default for most orm's. When a lot of users are on a system, and data from their stacks are loaded into memory eagerly, I wonder if there would be problems22:55
andrew_plunkI guess it all depends on when those model objects are cleared from memory22:55
stevebakerandrew_plunk: all the data gets loaded during the request one way or another, so its better to load it in 2 queries rather than hundreds22:56
SpamapSahh ok there's an index but the optimizer decided to just scan the table because it only has 75 rows22:56
SpamapSbetter not to load it22:57
SpamapSwe should not need to load the stack when a user just wants metadata for one resource.22:57
SpamapSone of what could be tens of thousands.22:57
stevebakerandrew_plunk: its the round-trip to the db which is the latency killer22:57
stevebakerSpamapS: correct22:58
SpamapSthe round trips are bad because they waste network time, but a big query with lots of data is equally bad. They both require heat-engine's full attention.22:58
andrew_plunkThat makes sense stevebaker. As long as data that would have not normally been loaded is not being pulled in then there should not be a problem with that approach.22:58
SpamapSI actually think we should strive to never re-load the whole stack with all of its resource data22:59
stevebakerandrew_plunk: agreed, from my analysis raw template, resources and resource data are worth eager fetching when querying a stack23:00
SpamapSAs things change, they can be recalculated and saved with their area of concern.23:00
SpamapSand with the distributed convergence model we'll be driving ... reloading the whole stack would be counter to the whole point.23:00
SpamapSstevebaker: right, long term though, let's never fetch a stack. :)23:00
andrew_plunkSpamapS: if we never re-load the data, then are you saying we should hold that data in memory forever?23:00
stevebakerSpamapS: we should work towards not having to do a Stack.load for read-only operations too23:01
SpamapSandrew_plunk: no we should never hold that data.23:01
SpamapSfor any purpose23:01
SpamapSthat object is poison.23:01
stevebakerSpamapS: +123:01
SpamapSThe idea is that we parse the template, and save the "needs" to the database.23:02
SpamapSthe engine then sees unfulfilled needs, and starts fulfilling them by firing off distributed jobs.23:02
SpamapSbut at no point does it read the whole thing in, and _THEN_ work on it.23:02
SpamapSlifeless and I hope to direct a fairly large team on this effort. :)23:03
SpamapS(and hopefully some of you will join as well. :)23:03
andrew_plunkdefinitely sounds interesting SpamapS23:03
greghaynesThe needs are states you want to end up at though right, not the tasks to perform?23:03
SpamapSstevebaker: so your patch set is _definitely_ going to help.23:03
SpamapSgreghaynes: right23:04
SpamapSgreghaynes: which also frees us from a stack-wide lock23:04
greghaynesSmells like query planner :)23:04
stevebakerSpamapS: good23:04
* SpamapS fires up 40 os-collect-config's23:04
stevebakerbtw, setting heat logging to INFO and turning on sql logging is _most_ informative23:04
mattoliveraumorning23:04
andrew_plunkgood evening everyone. Thanks for catching me up on the database db changes stevebaker and SpamapS23:05
*** andrew_plunk has quit IRC23:05
stevebakerandersonvom: \o23:05
andersonvomstevebaker: hey23:06
stevebakerandersonvom: whoops, um, hey!23:06
andersonvomI'm guessing you meant andrew ? :P23:07
stevebakerandersonvom: yes, sorry23:07
andersonvomhehe not a problem.23:07
andersonvomfastest patch ever approved today, btw! (iso8601) o/23:08
*** mkollaro has quit IRC23:10
*** IlyaE has quit IRC23:12
SpamapStakes about 10 seconds to do 'stack-create' with my 137 resource template23:13
SpamapSas in "reading the yaml, turning that into objects, flushing them to db, returning "CREATE IN PROGRESS" over RPC23:14
zanebSpamapS: only the stack gets flushed to the DB before we return23:15
zanebunless stevebaker has changed something23:15
SpamapSzaneb: I hadn't thought through exactly what just took 10 seconds23:16
zaneb(i.e. resources don't get stored until they are actually created)23:16
SpamapSI'm also not entirely sure my heat has cyaml23:16
stevebakerI've only been optimizing read paths23:16
*** IlyaE has joined #heat23:16
SpamapSwhich makes a ridiculously big difference23:16
zanebah, right23:16
SpamapSat this point, nova and neutron (using the fake driver btw) are slammed23:16
stevebakerSpamapS: with recent python-heatclient its json by the time heat gets it23:17
SpamapS20799 nova      20   0   89520  68136   3544 S 59.2  3.3   6:56.87 nova-api                                     4692 neutron   20   0   53808  36840   3712 R 27.3  1.8  65:03.36 neutron-server23:17
SpamapSstevebaker: that's great! :)23:17
SpamapS/home/clint/.cache/tripleo/tripleo-incubator/openstack-tools/lib/python2.7/site-packages/_yaml.so23:18
SpamapSyay23:18
*** arbylee has quit IRC23:18
SpamapSWe slam the crap out of nova-api23:19
SpamapSat the beginning we have 40 polls going all the time23:19
SpamapSso it gets faster than faster as we complete servers23:20
*** e0ne has joined #heat23:20
*** e0ne has quit IRC23:23
SpamapShrm, getting 403's now when trying to fetch metadata23:25
stevebakerkilled your keystone?23:25
SpamapSno23:25
stevebakerSpamapS: consider backing out only this change from the series https://review.openstack.org/#/c/92033/23:27
SpamapSstevebaker: something feels stuck. Many of the _config_ resources are stuck in CREATE_IN_PROGRESS .. but those should just basically create the reosurce in heat and then move on, right? There's no polling or waiting for signal right?23:27
stevebakeryeah, config resources should just create23:27
SpamapSkeystone may be crying then23:27
SpamapSI have users for all of the deployments23:28
SpamapSah, 403 was something else23:28
openstackgerritA change was merged to openstack/heat: Add a Nova Flavor resource.  https://review.openstack.org/9002923:29
SpamapSstevebaker: interestingly, os-collect-config is about 500ms faster than heatclient for showing metadata.23:29
lifeless:)23:30
*** kgriffs is now known as kgriffs|afk23:31
SpamapSok so with a 40 os-collect-config's running, we peg heat-engine.. but no queuepool errors yet23:33
SpamapSthey do eventually complete23:34
SpamapSstevebaker: I'll review your patchset tonight.. it looks like it may at least give us some breathing room.23:36
lifelessSpamapS: what was the 403 ?23:37
SpamapSa 40 server stack seems to handle 40 os-collect-config's polling in < 30s .. so we can at least make that work.23:37
SpamapSlifeless: pbkac23:37
* SpamapS has to go fetch 'littl'uns now23:38
openstackgerritA change was merged to openstack/heat: Fix validate failed with an image_name in uuid format  https://review.openstack.org/9029523:38
openstackgerritDmitry Borodaenko proposed a change to openstack/heat: Ignore nova limits set to '-1'  https://review.openstack.org/8938923:38
stevebakerSpamapS: occ vs heatclient, is occ going via the ec2 API. not fetching a token would be way faster23:39
*** tomek_adamczewsk has joined #heat23:42
*** tomek_adamczews1 has joined #heat23:45
*** gokrokve has quit IRC23:45
*** IlyaE has quit IRC23:45
*** tomek_adamczewsk has quit IRC23:46
*** radez_g0n3 is now known as radez23:52
openstackgerritA change was merged to openstack/heat: SoftwareDeployments tolerate string zero status code  https://review.openstack.org/9182823:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!