| *** kitch_ has joined #heat | 00:03 | |
| *** kitch_ has quit IRC | 00:03 | |
| asalkeld | bug 1455276 is getting hit often (for me) in the gate | 00:11 |
|---|---|---|
| openstack | bug 1455276 in heat "TemplateResourceUpdateFailedTest.test_update_on_failed_create is failing with ActionInProgress" [High,Triaged] https://launchpad.net/bugs/1455276 | 00:11 |
| *** dims has quit IRC | 00:15 | |
| *** dims has joined #heat | 00:23 | |
| *** Drago has quit IRC | 00:27 | |
| openstackgerrit | Merged openstack/heat: Updated from global requirements https://review.openstack.org/181910 | 00:43 |
| openstackgerrit | Merged openstack/heat: Replace self.properties.get on self.properties[] https://review.openstack.org/179030 | 00:49 |
| *** alexheneveld has quit IRC | 00:58 | |
| *** harlowja has quit IRC | 00:58 | |
| *** pm90_ has quit IRC | 01:02 | |
| *** sdake has quit IRC | 01:03 | |
| *** sdake has joined #heat | 01:05 | |
| *** achanda has quit IRC | 01:07 | |
| openstackgerrit | Merged openstack/python-heatclient: Add OS_TEST_PATH to testr https://review.openstack.org/180216 | 01:19 |
| *** erkules_ has joined #heat | 01:21 | |
| *** alanf-mc has quit IRC | 01:23 | |
| *** erkules has quit IRC | 01:23 | |
| *** Qiming has joined #heat | 01:30 | |
| *** Yanyanhu has joined #heat | 01:38 | |
| *** multi_io has quit IRC | 01:39 | |
| *** multi_io has joined #heat | 01:41 | |
| *** Qiming_ has joined #heat | 01:49 | |
| *** sdake_ has joined #heat | 01:51 | |
| *** Qiming has quit IRC | 01:53 | |
| *** zzxwill has joined #heat | 01:54 | |
| *** sdake has quit IRC | 01:55 | |
| *** hdd has quit IRC | 01:58 | |
| openstackgerrit | Angus Salkeld proposed openstack/heat: Update the stack state as late as possible https://review.openstack.org/183374 | 02:04 |
| *** signed8bit has quit IRC | 02:10 | |
| openstackgerrit | Rabi Mishra proposed openstack/heat: Fix property validation for TemplateResource during update https://review.openstack.org/182763 | 02:14 |
| ramishra | morning all | 02:14 |
| Qiming_ | huangtianhua, about https://review.openstack.org/#/c/180096/, I still believe there needs some improvement to the messages and maybe also the test cases, though it has already been approved | 02:20 |
| *** alexheneveld has joined #heat | 02:21 | |
| elynn | morning | 02:22 |
| huangtianhua | Qiming_: looking | 02:22 |
| *** alexheneveld has quit IRC | 02:32 | |
| *** huangtianhua has quit IRC | 02:37 | |
| *** huangtianhua has joined #heat | 02:37 | |
| *** Tross has joined #heat | 02:43 | |
| openstackgerrit | Ethan Lynn proposed openstack/heat: Add CIDR format validation https://review.openstack.org/182209 | 02:44 |
| *** vijayagurug has quit IRC | 02:46 | |
| *** dims has quit IRC | 03:12 | |
| *** hdd has joined #heat | 03:18 | |
| *** achanda has joined #heat | 03:21 | |
| *** achanda has quit IRC | 03:27 | |
| *** EricGonczer_ has joined #heat | 03:29 | |
| *** sdake has joined #heat | 03:33 | |
| *** hdd has quit IRC | 03:33 | |
| *** EricGonczer_ has quit IRC | 03:34 | |
| *** alexpilotti has quit IRC | 03:35 | |
| *** sdake_ has quit IRC | 03:36 | |
| *** sdake_ has joined #heat | 03:38 | |
| *** sdake has quit IRC | 03:41 | |
| *** tobe4333 has joined #heat | 03:48 | |
| *** coolsvap|afk is now known as coolsvap | 04:12 | |
| *** jaime49 has joined #heat | 04:19 | |
| *** tobe4333 has quit IRC | 04:20 | |
| *** achanda has joined #heat | 04:22 | |
| *** Marga_ has quit IRC | 04:24 | |
| *** rakesh_hs has joined #heat | 04:27 | |
| *** nkhare has joined #heat | 04:31 | |
| *** huangtianhua has quit IRC | 04:34 | |
| *** huangtianhua has joined #heat | 04:35 | |
| *** sdake_ has quit IRC | 04:35 | |
| *** daneyon has joined #heat | 04:36 | |
| *** jaime49 has quit IRC | 04:40 | |
| *** pm90_ has joined #heat | 04:43 | |
| ramishra | asalkeld: Hi | 04:43 |
| *** pm90__ has joined #heat | 04:47 | |
| *** pm90_ has quit IRC | 04:47 | |
| *** noa-koffman has joined #heat | 04:50 | |
| openstackgerrit | huangtianhua proposed openstack/heat: Improve cinder volume validation and tests related https://review.openstack.org/183392 | 04:55 |
| *** Marga_ has joined #heat | 05:00 | |
| *** mwheckmann has joined #heat | 05:07 | |
| *** mwheckmann has quit IRC | 05:12 | |
| *** tspatzier has joined #heat | 05:21 | |
| *** tspatzier has quit IRC | 05:24 | |
| *** gokrokve has joined #heat | 05:31 | |
| *** rakesh_hs has quit IRC | 05:36 | |
| *** inc0 has joined #heat | 05:44 | |
| asalkeld | ramishra: hi | 05:47 |
| *** sdake has joined #heat | 05:52 | |
| *** sdake has quit IRC | 05:53 | |
| *** sdake has joined #heat | 05:54 | |
| *** gokrokve has quit IRC | 05:56 | |
| *** gokrokve_ has joined #heat | 05:56 | |
| *** jtomasek has joined #heat | 05:57 | |
| inc0 | good morning | 05:57 |
| inc0 | guys, do we want to schedule heated-beer for Vancouver?:) | 05:58 |
| *** pm90__ has quit IRC | 05:58 | |
| *** sdake has quit IRC | 05:58 | |
| *** gokrokve_ has quit IRC | 06:01 | |
| *** nihilifer has joined #heat | 06:03 | |
| *** pal has joined #heat | 06:08 | |
| *** Marga_ has quit IRC | 06:12 | |
| ramishra | asalkeld: would you be able to review https://review.openstack.org/#/c/182763/ when you've time? | 06:12 |
| *** sdake has joined #heat | 06:16 | |
| asalkeld | sure | 06:21 |
| *** jprovazn has joined #heat | 06:21 | |
| *** daneyon has quit IRC | 06:21 | |
| ramishra | thanks | 06:22 |
| openstackgerrit | Merged openstack/heat: Improve cinder volume validation and tests related https://review.openstack.org/183392 | 06:23 |
| *** achanda has quit IRC | 06:23 | |
| *** daneyon has joined #heat | 06:23 | |
| asalkeld | ramishra: lgtm | 06:24 |
| ramishra | asalkeld: thanks | 06:24 |
| *** Murali has joined #heat | 06:29 | |
| *** vijayagurug has joined #heat | 06:38 | |
| *** Marga_ has joined #heat | 06:43 | |
| *** tspatzier has joined #heat | 06:43 | |
| openstackgerrit | Sergey Kraynev proposed openstack/heat: Add functional test for neutron port https://review.openstack.org/178189 | 06:45 |
| openstackgerrit | Sergey Kraynev proposed openstack/heat: Add scenario test for AWS loadbalancer https://review.openstack.org/153192 | 06:45 |
| *** Marga_ has quit IRC | 06:48 | |
| *** erkules_ is now known as erkules | 06:53 | |
| *** erkules has joined #heat | 06:53 | |
| *** ishant has joined #heat | 06:59 | |
| openstackgerrit | huangtianhua proposed openstack/heat: Should raise error if hook is invalid https://review.openstack.org/183409 | 07:00 |
| *** daneyon has quit IRC | 07:03 | |
| openstackgerrit | huangtianhua proposed openstack/heat: Correct volume restore behavior https://review.openstack.org/182152 | 07:05 |
| *** sdake_ has joined #heat | 07:05 | |
| *** sdake has quit IRC | 07:08 | |
| *** ifarkas has joined #heat | 07:13 | |
| openstackgerrit | Merged openstack/heat: Reference the parent stack, not parent resource in Stack https://review.openstack.org/183214 | 07:18 |
| *** jcoufal has joined #heat | 07:27 | |
| *** chlong has quit IRC | 07:32 | |
| *** inc0 has quit IRC | 07:32 | |
| *** jistr has joined #heat | 07:33 | |
| *** asalkeld has quit IRC | 07:38 | |
| *** Marga_ has joined #heat | 07:44 | |
| *** tobe4333 has joined #heat | 07:44 | |
| *** Marga_ has quit IRC | 07:49 | |
| *** zzxwill has quit IRC | 07:50 | |
| openstackgerrit | Merged openstack/heat: Encrypt Heat template hidden parameters https://review.openstack.org/97900 | 07:51 |
| *** tobe4333 has quit IRC | 08:07 | |
| *** derekh has joined #heat | 08:13 | |
| *** blues-man has joined #heat | 08:30 | |
| openstackgerrit | huangtianhua proposed openstack/heat: Add and apply cinder backup constraint https://review.openstack.org/183433 | 08:30 |
| *** smccully has quit IRC | 08:38 | |
| *** vijayagurug has quit IRC | 08:43 | |
| *** inc0 has joined #heat | 08:44 | |
| *** Marga_ has joined #heat | 08:44 | |
| *** Marga_ has quit IRC | 08:50 | |
| *** smccully has joined #heat | 08:52 | |
| *** Trozz has joined #heat | 08:53 | |
| *** BManojlovic has joined #heat | 08:54 | |
| *** higgins has quit IRC | 08:58 | |
| *** higgins has joined #heat | 09:10 | |
| *** vijayagurug has joined #heat | 09:14 | |
| *** bdossant has joined #heat | 09:30 | |
| *** inc0 has quit IRC | 09:35 | |
| *** xuhaiwei has quit IRC | 09:36 | |
| *** tochi has quit IRC | 09:37 | |
| *** shardy has joined #heat | 09:39 | |
| *** dims has joined #heat | 09:45 | |
| *** Tross has quit IRC | 09:45 | |
| *** Tross has joined #heat | 09:45 | |
| *** Marga_ has joined #heat | 09:45 | |
| *** Yanyanhu has quit IRC | 09:46 | |
| *** alexpilotti has joined #heat | 09:47 | |
| *** pas-ha has joined #heat | 09:47 | |
| pas-ha | morning all | 09:48 |
| *** Marga_ has quit IRC | 09:50 | |
| *** e0ne has joined #heat | 09:55 | |
| *** e0ne is now known as e0ne_ | 09:56 | |
| *** e0ne_ is now known as e0ne | 10:01 | |
| *** Qiming_ has quit IRC | 10:02 | |
| *** jprovazn has quit IRC | 10:16 | |
| openstackgerrit | Rabi Mishra proposed openstack/heat: Add validation for parameter_groups https://review.openstack.org/183466 | 10:18 |
| openstackgerrit | Merged openstack/heat: Resource plug-in for keystone service https://review.openstack.org/178584 | 10:19 |
| openstackgerrit | Merged openstack/heat: Resource plug-in for keystone endpoint https://review.openstack.org/178585 | 10:19 |
| openstackgerrit | Merged openstack/heat: heat_keystone README update for service and endpoint https://review.openstack.org/178586 | 10:19 |
| *** tobe4333 has joined #heat | 10:27 | |
| *** e0ne is now known as e0ne_ | 10:31 | |
| *** e0ne_ is now known as e0ne | 10:33 | |
| *** Tross has quit IRC | 10:35 | |
| *** Tross has joined #heat | 10:35 | |
| *** ishant has quit IRC | 10:41 | |
| skraynev | anybody know should we merge this https://review.openstack.org/#/c/179291/ ? | 10:44 |
| *** Marga_ has joined #heat | 10:45 | |
| *** Marga__ has joined #heat | 10:47 | |
| *** Marga_ has quit IRC | 10:47 | |
| *** Marga__ has quit IRC | 10:48 | |
| *** Marga_ has joined #heat | 10:48 | |
| *** jprovazn has joined #heat | 10:50 | |
| *** Marga_ has quit IRC | 10:53 | |
| shardy | skraynev: honestly I'm not sure - I don't understand why it's changing so much to apply a tag?! | 10:58 |
| *** pal has quit IRC | 10:59 | |
| shardy | I guess it's resolving a merge of the kilo milestone-proposed branch, but I don't really understand why that affects master, given that everything in kilo proposed was backported from master? | 11:00 |
| openstackgerrit | Thomas Herve proposed openstack/heat: Implement barbican-backed store mechanism https://review.openstack.org/180959 | 11:03 |
| shardy | skraynev: I've pinged ttx to ask about it in #openstack-dev | 11:03 |
| *** Qiming has joined #heat | 11:04 | |
| *** Marga_ has joined #heat | 11:05 | |
| *** tobe4333 has quit IRC | 11:07 | |
| *** Qiming_ has joined #heat | 11:23 | |
| *** e0ne is now known as e0ne_ | 11:26 | |
| *** Qiming has quit IRC | 11:27 | |
| *** blues-man has quit IRC | 11:31 | |
| *** pas-ha has quit IRC | 11:35 | |
| skraynev | skraynev: I have no ideas too :) I just met it during review and was surprised, why it's still here. | 11:35 |
| skraynev | shardy: ^ . also thx for the request to ttx | 11:36 |
| therve | It's a bit weird, it seems to source branch has conflicts | 11:39 |
| *** alexpilotti has quit IRC | 11:42 | |
| therve | Ah, maybe got something | 11:43 |
| therve | http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2015-05-05.log | 11:43 |
| therve | "gerrit displays them oddly. checkout that merge commit and diff it against the branch tip" | 11:43 |
| *** prazumovsky has joined #heat | 11:45 | |
| *** e0ne_ is now known as e0ne | 11:48 | |
| *** saju_m has joined #heat | 11:50 | |
| shardy | therve: it's still weird, I don't really know how we can review something that appears to change thousands of lines of stuff, but probably shouldn't do anything | 11:51 |
| shardy | therve: thanks for the link though, sheds some light on it at least :) | 11:51 |
| *** ifarkas has quit IRC | 11:52 | |
| *** EricGonczer_ has joined #heat | 11:55 | |
| *** Marga_ has quit IRC | 11:56 | |
| *** ifarkas has joined #heat | 11:58 | |
| *** Marga_ has joined #heat | 12:07 | |
| *** blomquisg has joined #heat | 12:10 | |
| *** links has joined #heat | 12:13 | |
| *** Yanyanhu has joined #heat | 12:13 | |
| *** Yanyan has joined #heat | 12:17 | |
| *** Yanyanhu has quit IRC | 12:20 | |
| *** e0ne is now known as e0ne_ | 12:22 | |
| *** coolsvap is now known as coolsvap|afk | 12:23 | |
| *** Yanyan has quit IRC | 12:26 | |
| *** e0ne_ is now known as e0ne | 12:26 | |
| *** Marga_ has quit IRC | 12:30 | |
| *** nkhare has quit IRC | 12:33 | |
| *** jtomasek has quit IRC | 12:38 | |
| *** EricGonczer_ has quit IRC | 12:44 | |
| *** derekh_ has joined #heat | 12:49 | |
| *** blues-man has joined #heat | 12:51 | |
| *** blues-man has quit IRC | 12:52 | |
| *** blues-man has joined #heat | 12:52 | |
| *** vijayagurug has left #heat | 12:52 | |
| *** derekh has quit IRC | 12:52 | |
| *** e0ne is now known as e0ne_ | 12:54 | |
| *** rpothier has joined #heat | 12:54 | |
| *** blomquisg1 has joined #heat | 12:55 | |
| *** e0ne_ is now known as e0ne | 12:56 | |
| *** blomquisg has quit IRC | 12:56 | |
| *** links has quit IRC | 12:57 | |
| *** sdake has joined #heat | 12:59 | |
| *** sdake_ has quit IRC | 13:02 | |
| *** sdake_ has joined #heat | 13:03 | |
| *** pas-ha has joined #heat | 13:05 | |
| *** sdake_ has quit IRC | 13:07 | |
| *** sdake has quit IRC | 13:07 | |
| openstackgerrit | Oleksii Chuprykov proposed openstack/heat-specs: Add batching to ResGroup https://review.openstack.org/183506 | 13:08 |
| *** sdake has joined #heat | 13:11 | |
| openstackgerrit | Oleksii Chuprykov proposed openstack/heat-specs: Add batching to ResGroup https://review.openstack.org/183506 | 13:13 |
| *** dyasny has joined #heat | 13:22 | |
| *** sdake has quit IRC | 13:23 | |
| *** crose has joined #heat | 13:29 | |
| *** sdake has joined #heat | 13:34 | |
| *** pas-ha has quit IRC | 13:34 | |
| *** pas-ha has joined #heat | 13:35 | |
| openstackgerrit | Oleksii Chuprykov proposed openstack/heat-specs: Add batching to ResGroup https://review.openstack.org/183506 | 13:41 |
| *** pas-ha has quit IRC | 13:41 | |
| *** pshchelo has joined #heat | 13:42 | |
| *** sdake has quit IRC | 13:42 | |
| *** pshchelo has left #heat | 13:45 | |
| *** BManojlovic has quit IRC | 13:51 | |
| *** blomquisg1 has quit IRC | 13:51 | |
| *** pas-ha has joined #heat | 13:52 | |
| *** jasond` has joined #heat | 13:54 | |
| *** pas-ha has quit IRC | 13:55 | |
| openstackgerrit | Oleksii Chuprykov proposed openstack/heat-specs: Add batching to ResGroup https://review.openstack.org/183506 | 13:56 |
| *** jprovazn is now known as jprovazn_bbl | 13:56 | |
| *** pas-ha has joined #heat | 13:56 | |
| *** pas-ha_ has joined #heat | 13:59 | |
| *** pas-ha_ has quit IRC | 13:59 | |
| *** mwheckmann has joined #heat | 14:00 | |
| *** blomquisg1 has joined #heat | 14:05 | |
| *** andersonvom has joined #heat | 14:06 | |
| *** sdake has joined #heat | 14:08 | |
| *** signed8bit has joined #heat | 14:11 | |
| *** nihilifer has quit IRC | 14:11 | |
| *** Qiming__ has joined #heat | 14:12 | |
| *** Murali_ has joined #heat | 14:14 | |
| *** BManojlovic has joined #heat | 14:15 | |
| *** Qiming_ has quit IRC | 14:15 | |
| zaneb | skraynev: answered your question on https://review.openstack.org/#/c/183215/ - let me know if that doesn't clear it up | 14:16 |
| *** dims is now known as dimsum__ | 14:16 | |
| *** sdake has quit IRC | 14:16 | |
| *** Murali has quit IRC | 14:16 | |
| *** Murali_ is now known as Murali | 14:16 | |
| *** prazumovsky has quit IRC | 14:20 | |
| skraynev | zaneb: thx. looking... | 14:20 |
| openstackgerrit | Oleksii Chuprykov proposed openstack/heat-specs: Add batching to ResGroup https://review.openstack.org/183506 | 14:20 |
| *** jcoufal has quit IRC | 14:21 | |
| *** saju_m has quit IRC | 14:26 | |
| *** sdake has joined #heat | 14:28 | |
| *** achanda has joined #heat | 14:36 | |
| *** sabeen1 has joined #heat | 14:43 | |
| *** achanda has quit IRC | 14:43 | |
| *** mragupat has joined #heat | 14:45 | |
| *** mragupat has quit IRC | 14:46 | |
| openstackgerrit | Oleksii Chuprykov proposed openstack/heat-specs: Add batching to ResGroup https://review.openstack.org/183506 | 14:47 |
| *** vijendar has joined #heat | 14:49 | |
| *** alexpilotti has joined #heat | 14:50 | |
| *** hdd has joined #heat | 14:51 | |
| *** bdossant has quit IRC | 14:55 | |
| *** nihilifer has joined #heat | 14:57 | |
| *** mikal has joined #heat | 14:57 | |
| *** radez_g0n3 is now known as radez | 15:02 | |
| *** sdake_ has joined #heat | 15:03 | |
| *** sabeen2 has joined #heat | 15:07 | |
| *** sdake has quit IRC | 15:08 | |
| *** gus has quit IRC | 15:08 | |
| *** gus has joined #heat | 15:09 | |
| *** sabeen1 has quit IRC | 15:10 | |
| *** mwheckmann has quit IRC | 15:10 | |
| *** mwheckmann has joined #heat | 15:14 | |
| *** jistr is now known as jistr|mtgh | 15:15 | |
| *** jistr|mtgh is now known as jistr|mtg | 15:15 | |
| *** Qiming_ has joined #heat | 15:17 | |
| *** mwheckmann has quit IRC | 15:19 | |
| *** mwheckmann has joined #heat | 15:19 | |
| *** Qiming__ has quit IRC | 15:20 | |
| jasond` | skraynev: hello | 15:23 |
| *** BManojlovic has quit IRC | 15:23 | |
| *** dyasny has quit IRC | 15:24 | |
| *** dyasny has joined #heat | 15:24 | |
| *** Tango has joined #heat | 15:25 | |
| *** jistr|mtg is now known as jistr | 15:28 | |
| *** radez is now known as radez_g0n3 | 15:29 | |
| *** pm90_ has joined #heat | 15:33 | |
| *** Murali has quit IRC | 15:33 | |
| skraynev | zaneb: thx for clarification. it was enough | 15:41 |
| skraynev | jasond`: yeah | 15:42 |
| skraynev | I am here | 15:43 |
| jasond` | skraynev: hey, how's it going with the stack tags filtering in python-heatclient? | 15:43 |
| *** Drago has joined #heat | 15:45 | |
| *** Drago has quit IRC | 15:45 | |
| *** Drago has joined #heat | 15:46 | |
| zaneb | skraynev: cool, thanks | 15:47 |
| skraynev | jasond`: ummm. probably I forgot something. could you refresh my memories? | 15:49 |
| zaneb | ryansb: did some back-of-the-envelope calculations... looks to me like the files dict could be maybe ~0.5MB | 15:49 |
| *** Qiming_ has quit IRC | 15:49 | |
| zaneb | (* no actual envelopes were harmed, for once) | 15:50 |
| ryansb | heh | 15:50 |
| ryansb | you mean presuming we only had one copy, right? | 15:50 |
| zaneb | yeah, each one would be about that much | 15:50 |
| jasond` | skraynev: sure "Apr 17 09:18:58 <skraynev> jasond: I have not seen patch to python-heatclient with commands for tags" "Apr 17 09:19:36 <skraynev> jasond: do you plan to upload it ? I'd like to try it ;)" | 15:51 |
| ryansb | sounds approximately correct | 15:51 |
| zaneb | so if we assume 50 stacks with maybe 4 copies each... that puts us into an awkward range | 15:51 |
| zaneb | where we can make maybe a 20% (tops) saving, which is worth it | 15:52 |
| zaneb | but really in terms of scaling to a lot more nested stacks... we're still hosed :( | 15:52 |
| ryansb | so 100MB, according to my envelope (total size) and 20MB (saved size) | 15:52 |
| *** jrist has quit IRC | 15:52 | |
| skraynev | jasond`: lol. I meant, another: try = check, test it, when it be on review ;) | 15:52 |
| skraynev | jasond`: sorry for the confused phrase from me. | 15:53 |
| ryansb | and the actual 20MB savings would be reduced by mem. fragmentation | 15:53 |
| ryansb | :( | 15:53 |
| zaneb | ryansb: no, I mean if we're using 550MB and we can reduce ~100MB of files down to 0.5MB, then we've still saved less than 20% | 15:53 |
| jasond` | skraynev: oh, ha ha. i'm glad i asked about it. no problem. i will start working on that then | 15:54 |
| zaneb | shardy: merge.py is starting to look like not such a bad idea :D | 15:55 |
| ryansb | zaneb: ah, gotcha | 15:56 |
| skraynev | jasond`: heh. thx for the question it was in time! and my apologize. I really did not want to confuse you. | 15:56 |
| openstackgerrit | Rabi Mishra proposed openstack/heat: Add validation for parameter_groups https://review.openstack.org/183466 | 15:56 |
| jasond` | skraynev: it's no problem. thanks for clearing that up | 15:57 |
| skraynev | jasond`: no problem, I glad that you asked about this staff. | 15:57 |
| *** ifarkas has quit IRC | 15:58 | |
| *** shakamunyi has quit IRC | 16:00 | |
| *** barra204 has quit IRC | 16:00 | |
| *** sdake_ has quit IRC | 16:00 | |
| *** Marga_ has joined #heat | 16:00 | |
| shardy | zaneb: Hah, so to clarify, we've gone from one giant stack breaks heat to lots of little stacks break heat? ;D | 16:00 |
| zaneb | indeed | 16:01 |
| *** harlowja has joined #heat | 16:01 | |
| zaneb | shardy: part of the problem is, everything we do to make Heat more scalable increases memory use, which is a known tradeoff, but the undercloud can only have one node | 16:02 |
| ryansb | zaneb: your ref cycle patch breaks tuskar, btw | 16:02 |
| shardy | zaneb: I don't think it's necessarily true that the undercloud can only have one node | 16:02 |
| shardy | I think we need to support deploying $reasonable number of overcloud nodes with one seed/undercloud node | 16:03 |
| *** harlowja has quit IRC | 16:03 | |
| shardy | if you have a really huge deployment, you're going to want to scale out the undercloud for performance and availability reasons IMO | 16:03 |
| shardy | The question is the definition of $reasonable I guess | 16:03 |
| zaneb | yeah, but we don't support that yet | 16:04 |
| ryansb | AIUI the idea is that once your oc is deployed you can have your uc go down sometimes and be fine | 16:04 |
| ryansb | so HA uc isn't a huge priority | 16:04 |
| ryansb | also $reasonable for a 3-node OC should probably be equal to 1 | 16:04 |
| zaneb | lol, yes | 16:05 |
| ryansb | "Oh, you want a 3 node oc? Here, deploy a seed VM that will bootstrap 9 nodes for your HA undercloud" | 16:05 |
| ryansb | no thanks | 16:05 |
| shardy | ryansb: Yeah, agreed, $reasonable must be at least a few hundred nodes IMO | 16:05 |
| zaneb | ryansb: are you set up to test the reference loop removal patches and see if that makes any difference? | 16:05 |
| zaneb | ryansb: in reality, more like 1 node, 24GB RAM ;) | 16:06 |
| ryansb | zaneb: yeah, I'm set up | 16:06 |
| ryansb | but it breaks tuskar | 16:06 |
| zaneb | the patch breaks tuskar? | 16:06 |
| shardy | everything breaks tuskar | 16:06 |
| ryansb | so with your ref loop patch, the stack create for tuskar fails because the stack ref disappears | 16:06 |
| zaneb | doh! | 16:07 |
| zaneb | we should stop that patch from merging upstream then | 16:07 |
| ryansb | I'm adding a "if there's no stack ref, go ahead and grab from the DB" | 16:07 |
| ryansb | yeah, well I just found it | 16:07 |
| ryansb | was testing my own patches earlier | 16:07 |
| zaneb | nah, grabbing from the db is the wrong solution. we should make sure we're retaining a ref to the stack all the time | 16:09 |
| skraynev | zaneb: only last patch should be stopped, I hope | 16:09 |
| zaneb | skraynev: correct | 16:09 |
| zaneb | I just set Workflow -1 | 16:09 |
| zaneb | hopefully that might stop it | 16:09 |
| ryansb | oh, you got it before I refreshed | 16:10 |
| ryansb | the first patch (that's already merged) seems fine | 16:10 |
| ryansb | just rolled back and tested | 16:10 |
| zaneb | ryansb: can you send me the stack trace from where it failed? | 16:10 |
| ryansb | zaneb: can you -1 the rest of that series while I do some digging? | 16:10 |
| zaneb | I wonder why are functional tests didn't catch this :/ | 16:11 |
| ryansb | not a clue | 16:11 |
| ryansb | it's probably something like "the tests were holding a ref themselves, so it didn't happen" | 16:11 |
| zaneb | the rest of the series should be harmless | 16:11 |
| ryansb | wait, functests should've still caught that | 16:11 |
| ryansb | hrm. | 16:11 |
| zaneb | with the possible exception of the one that's merged already | 16:12 |
| zaneb | yeah, functional tests test from the outside | 16:12 |
| ryansb | I tested the merged one independently and it seems fine | 16:12 |
| ryansb | maybe we should just add tuskar as a submodule for functests | 16:12 |
| ryansb | it seems to break everything pretty thoroughly | 16:12 |
| zaneb | I was half-expecting them to fail in the gate, but when they didn't I assumed I had caught everything with the unit tests | 16:13 |
| zaneb | (which found only one problem) | 16:13 |
| *** jrist has joined #heat | 16:13 | |
| *** jrist has quit IRC | 16:13 | |
| *** jrist has joined #heat | 16:13 | |
| ryansb | zaneb: here's your trace, btw | 16:13 |
| ryansb | http://fpaste.org/222364/14317064/ | 16:14 |
| zaneb | thanks | 16:14 |
| zaneb | what the... | 16:15 |
| zaneb | so it logs CREATE: ResourceGroup "Controller" Stack "overcloud" [61a1b847-8d09-448a-b1a9-a2bde05ef012] | 16:15 |
| *** e0ne is now known as e0ne_ | 16:15 | |
| zaneb | clearly it the Stack exists at that point | 16:15 |
| *** nihilifer has quit IRC | 16:15 | |
| zaneb | oh, it might be in stack_resource | 16:16 |
| zaneb | ryansb: is there another stack trace in the logs by any chance? | 16:19 |
| ryansb | lemme look | 16:20 |
| *** e0ne_ is now known as e0ne | 16:20 | |
| zaneb | this one is the local one raised by the parent stack upon receipt of an error over RPC | 16:20 |
| zaneb | I suspect that the child one gets turned into a validation error, so the stack doesn't get printed :( | 16:20 |
| zaneb | s/stack/traceback/ | 16:20 |
| zaneb | too many overloaded meanings of 'stack' | 16:21 |
| ryansb | http://fpaste.org/222366/14317068/ | 16:21 |
| *** blues-man has left #heat | 16:21 | |
| ryansb | there's another | 16:21 |
| ryansb | heh, no joke | 16:21 |
| ryansb | "we use heat stacks to provision our stack, then sometimes read the stacks from errors | 16:21 |
| ryansb | " | 16:21 |
| zaneb | second one looks like the same thing but on update instead of create | 16:22 |
| ryansb | here's another http://fpaste.org/222367/31706979/ | 16:23 |
| ryansb | k, that's the earliest one | 16:23 |
| zaneb | still in the parent | 16:23 |
| ryansb | yeah, that | 16:25 |
| *** derekh_ has quit IRC | 16:25 | |
| *** sikor_sxe has quit IRC | 16:25 | |
| *** tspatzier has quit IRC | 16:26 | |
| *** tspatzier has joined #heat | 16:26 | |
| ryansb | 1 sec, rerunning with a blank logfile | 16:26 |
| *** tspatzier has quit IRC | 16:26 | |
| *** pm90__ has joined #heat | 16:28 | |
| *** pm90_ has quit IRC | 16:28 | |
| zaneb | ryansb: this should give us the debug we need - http://paste.fedoraproject.org/222368/70741414 | 16:30 |
| *** Marga_ has quit IRC | 16:35 | |
| ryansb | http://fpaste.org/222372/07750143/ | 16:35 |
| ryansb | msg is angry about the str | 16:36 |
| ryansb | gonna fix that first | 16:36 |
| *** nihilifer has joined #heat | 16:36 | |
| *** e0ne has quit IRC | 16:37 | |
| zaneb | bah | 16:37 |
| zaneb | I thought that was actually the exception object, but it isn't | 16:38 |
| ryansb | unicode: the natural enemy of all python programmers | 16:38 |
| *** pm90__ has quit IRC | 16:39 | |
| zaneb | we don't even need to print that then | 16:39 |
| *** pm90_ has joined #heat | 16:39 | |
| zaneb | problem is apparently in StackResource.validate_nested_stack | 16:39 |
| ryansb | http://fpaste.org/222374/14317079/ | 16:39 |
| zaneb | which seems... inexplicable | 16:40 |
| ryansb | ¯\_ツ_/¯ | 16:40 |
| ryansb | https://dionscher.files.wordpress.com/2015/04/multithreaded-programming.jpeg | 16:40 |
| zaneb | ah, the root stack nonsense | 16:40 |
| zaneb | boy that is awful | 16:40 |
| zaneb | that could be it | 16:40 |
| openstackgerrit | Merged openstack/heat: Retain references to stacks in all unit tests https://review.openstack.org/183215 | 16:41 |
| openstackgerrit | Merged openstack/heat: Pass stack to thread in resource_signal https://review.openstack.org/183216 | 16:41 |
| * zaneb goes to investigate root stacks | 16:41 | |
| *** spzala has joined #heat | 16:41 | |
| *** EricGonczer_ has joined #heat | 16:45 | |
| zaneb | IT BURRRRNS | 16:50 |
| *** alanf-mc has joined #heat | 16:51 | |
| zaneb | so the innocent looking property root_stack... | 16:52 |
| shardy | lol, that stuff is really evil | 16:52 |
| zaneb | loads the seemingly innocent-looking property parent_resource (3 times)... | 16:52 |
| zaneb | despite the comment that "this should only be used by "Fn::ResourceFacade" | 16:52 |
| zaneb | and not only recursively loads all the parent stacks back to the root... | 16:53 |
| zaneb | but *also* their resources, which we don't need and which are already equipped with lazy-loading | 16:53 |
| *** inc0 has joined #heat | 16:53 | |
| zaneb | ^#&*&#% !*&(# | 16:54 |
| *** radez_g0n3 is now known as radez | 16:55 | |
| *** radez is now known as radez_g0n3 | 16:56 | |
| *** radez_g0n3 is now known as radez | 16:56 | |
| zaneb | ryansb: we could save a truckload of memory by just fixing this | 16:57 |
| *** radez is now known as radez_g0n3 | 16:57 | |
| *** thedodd has joined #heat | 17:00 | |
| *** alexheneveld has joined #heat | 17:02 | |
| *** dimsum__ has quit IRC | 17:04 | |
| *** Marga_ has joined #heat | 17:04 | |
| *** dimsum__ has joined #heat | 17:05 | |
| ryansb | o.O | 17:06 |
| *** thedodd has quit IRC | 17:07 | |
| zaneb | ryansb: even with a fix for this though... there must be so many more copies of the files loaded than I imagined | 17:11 |
| zaneb | so that's sort-of good news | 17:11 |
| zaneb | our upside may be higher than we calculated earlier | 17:12 |
| *** jistr has quit IRC | 17:12 | |
| *** pas-ha has quit IRC | 17:15 | |
| *** e0ne has joined #heat | 17:15 | |
| *** EricGonc_ has joined #heat | 17:18 | |
| ryansb | hrm. bbiab, heading to get some lunch | 17:20 |
| ryansb | lmk if you need me to test any patches | 17:20 |
| zaneb | k, thanks | 17:20 |
| zaneb | I might do the same | 17:21 |
| *** EricGonczer_ has quit IRC | 17:21 | |
| *** nihilifer has quit IRC | 17:21 | |
| ryansb | wfm | 17:22 |
| *** inc0 has quit IRC | 17:22 | |
| zaneb | oh geez | 17:23 |
| zaneb | so next we are calling total_resources() which literally loads every resource for every stack in the entire tree | 17:23 |
| openstackgerrit | Rob Pothier proposed openstack/heat: Add BayModel and Bay to Magnum client plugin https://review.openstack.org/179771 | 17:24 |
| *** achanda has joined #heat | 17:27 | |
| *** daneyon has joined #heat | 17:31 | |
| zaneb | I raised https://bugs.launchpad.net/heat/+bug/1455589 | 17:32 |
| openstack | Launchpad bug 1455589 in heat "Memory use is quadratic in the number of stacks" [Critical,New] | 17:32 |
| *** daneyon_ has joined #heat | 17:33 | |
| mwheckmann | If the objecj nodes are calculating csums, then what if due to some corruption object nodes don't have the same ETag for an object in metadata? I guess I should use the source to really understand the behviour.. | 17:33 |
| *** tlashchova has quit IRC | 17:34 | |
| mwheckmann | i.e. if replication factor of 3x spread across 3 nodes and not all nodes agree on the Etag value | 17:34 |
| *** nihilifer has joined #heat | 17:35 | |
| *** daneyon has quit IRC | 17:36 | |
| openstackgerrit | Merged openstack/heat: Add CIDR format validation https://review.openstack.org/182209 | 17:40 |
| zaneb | mwheckmann: you sure you're in the right channel? | 17:55 |
| *** jprovazn_bbl has quit IRC | 17:56 | |
| mwheckmann | zaneb: nope :) Just noticed that my client was in the wrong one. Wanted to jump in on a conversation in #openstack-swift | 17:57 |
| mwheckmann | seems I failed miserably :) Explains why I got no answers. Thanks for pointing that out! | 17:58 |
| zaneb | that's what I thought :) | 17:58 |
| *** daneyon has joined #heat | 18:11 | |
| *** daneyon_ has quit IRC | 18:11 | |
| *** saju_m has joined #heat | 18:11 | |
| *** Murali has joined #heat | 18:15 | |
| *** saju_m has quit IRC | 18:18 | |
| *** andersonvom has quit IRC | 18:21 | |
| *** openstackgerrit has quit IRC | 18:22 | |
| *** openstackgerrit has joined #heat | 18:23 | |
| *** tspatzier has joined #heat | 18:23 | |
| *** Marga_ has quit IRC | 18:26 | |
| *** saju_m has joined #heat | 18:30 | |
| *** shakamunyi has joined #heat | 18:37 | |
| *** barra204 has joined #heat | 18:37 | |
| *** Murali has quit IRC | 18:40 | |
| *** saju_m has quit IRC | 18:43 | |
| *** nihilifer has quit IRC | 18:53 | |
| *** MasterPiece has joined #heat | 18:55 | |
| *** Marga_ has joined #heat | 18:57 | |
| *** Marga__ has joined #heat | 19:01 | |
| *** Marga_ has quit IRC | 19:01 | |
| *** nihilifer has joined #heat | 19:05 | |
| *** Marga__ has quit IRC | 19:05 | |
| zaneb | ryansb: it occurs to me that you probably cherry-picked that patch and you don't have 2032548c4e501ebf90604bf60a69fdf9f64b981d in your tree. would I be right? | 19:07 |
| ryansb | hrm | 19:08 |
| ryansb | you would be right, because I cherry-picked "zaneRefPatch~4" instead of ~5 | 19:09 |
| zaneb | doh | 19:10 |
| ryansb | worst game of go fish ever "Do you have any hashes beginning with 20325 in your tree?" | 19:10 |
| zaneb | so that explains why you're getting errors anyway | 19:10 |
| zaneb | lol | 19:10 |
| ryansb | I'll slap that in, thanks for the catch | 19:10 |
| zaneb | presumably you have d29bb1927489d5590f17d2f3ef2904b6f5edd0d4, which you'll also need | 19:10 |
| ryansb | yeah, I have that | 19:11 |
| ryansb | I have 3/4 of your patches, and about to add #4 | 19:11 |
| *** Marga_ has joined #heat | 19:12 | |
| zaneb | cool | 19:12 |
| ryansb | not sure how you divined that I was missing that patch, but good on you | 19:13 |
| zaneb | well, I looked at the code and it was awful, but I couldn't figure out how it could be losing the reference | 19:14 |
| zaneb | and then I realised that was the exact bug I had fixed when I was developing it :) | 19:14 |
| *** Marga__ has joined #heat | 19:14 | |
| *** Marga_ has quit IRC | 19:14 | |
| zaneb | that explains why the tests didn't catch it, anyway | 19:14 |
| *** andersonvom has joined #heat | 19:17 | |
| *** pm90_ has quit IRC | 19:18 | |
| *** pm90_ has joined #heat | 19:19 | |
| *** andersonvom has quit IRC | 19:22 | |
| *** pm90_ has quit IRC | 19:23 | |
| *** blomquisg1 has quit IRC | 19:26 | |
| *** daneyon has quit IRC | 19:27 | |
| *** alanf-mc has quit IRC | 19:32 | |
| *** alanf-mc has joined #heat | 19:34 | |
| *** alexheneveld has quit IRC | 19:43 | |
| ryansb | hah, yeah | 19:45 |
| *** barra204 has quit IRC | 19:48 | |
| *** shakamunyi has quit IRC | 19:48 | |
| openstackgerrit | Jason Dunsmore proposed openstack/python-heatclient: Add stack tag filtering options to stack-list https://review.openstack.org/183679 | 19:50 |
| openstackgerrit | Jason Dunsmore proposed openstack/python-heatclient: Add --tags option to stack-create and stack-update https://review.openstack.org/183680 | 19:50 |
| zaneb | ryansb: working? | 19:52 |
| ryansb | had to redo discovery | 19:52 |
| ryansb | it'll be a bit | 19:52 |
| zaneb | kk | 19:53 |
| *** crose has quit IRC | 20:03 | |
| ryansb | zaneb: it's past where it broke earlier, and mem usage is down tremendously | 20:04 |
| *** tlashchova has joined #heat | 20:05 | |
| *** Marga__ has quit IRC | 20:08 | |
| *** Marga__ has joined #heat | 20:11 | |
| *** Drago has quit IRC | 20:15 | |
| *** alexpilotti has quit IRC | 20:17 | |
| *** andersonvom has joined #heat | 20:17 | |
| *** achanda has quit IRC | 20:18 | |
| openstackgerrit | Vijendar Komalla proposed openstack/heat: Change user_data_format default value in Rackspace server https://review.openstack.org/183690 | 20:22 |
| ryansb | zaneb: failed, but I don't think it's your patch | 20:22 |
| *** andersonvom has quit IRC | 20:22 | |
| openstackgerrit | Vijendar Komalla proposed openstack/heat: Change user_data_format default value in Rackspace server https://review.openstack.org/183690 | 20:23 |
| *** daneyon has joined #heat | 20:25 | |
| *** achanda has joined #heat | 20:37 | |
| *** Marga__ has quit IRC | 20:39 | |
| *** Marga_ has joined #heat | 20:40 | |
| *** vijendar has quit IRC | 20:41 | |
| *** vijendar has joined #heat | 20:43 | |
| *** multi_io has quit IRC | 20:48 | |
| *** Drago has joined #heat | 20:51 | |
| *** Drago has quit IRC | 20:51 | |
| *** Drago has joined #heat | 20:52 | |
| *** multi_io has joined #heat | 20:53 | |
| *** alexheneveld has joined #heat | 21:06 | |
| *** htruta has quit IRC | 21:15 | |
| zaneb | ryansb: think it's safe to reapprove? | 21:17 |
| ryansb | zaneb: I haven't had it work yet | 21:18 |
| *** andersonvom has joined #heat | 21:18 | |
| ryansb | but this system is drifty, so I'm trying to track down whether the failure is related to your patch | 21:18 |
| ryansb | I should be able to confirm in a bit | 21:18 |
| ryansb | I'll +1 when it works | 21:18 |
| *** vijendar has quit IRC | 21:19 | |
| ryansb | should be sometime soon. Though I said that an hour ago too | 21:19 |
| zaneb | ryansb: ok thanks | 21:20 |
| zaneb | I'd really like to get this stuff merged into midstream today if I can | 21:20 |
| zaneb | so that folks have something to work with next week | 21:20 |
| ryansb | np. If the state of heat before it ruined everything is indicative, that patch may save our bacon | 21:20 |
| ryansb | yeah, I gotcha | 21:21 |
| zaneb | mem usage is looking good? numbers? | 21:21 |
| ryansb | fortunately my wife is in grad school, so I don't have anywhere to be ;) | 21:21 |
| ryansb | 133M | 21:21 |
| ryansb | as opposed to 540 | 21:21 |
| zaneb | oh, that's much better | 21:21 |
| ryansb | yeah | 21:22 |
| zaneb | little bit of caching, we can get that right down ;) | 21:22 |
| ryansb | heh, yeah | 21:22 |
| ryansb | of course, then it ruined my whole virt setup | 21:22 |
| ryansb | so it may have just loaded some stuff then crashed | 21:23 |
| *** andersonvom has quit IRC | 21:23 | |
| zaneb | lol, ok | 21:28 |
| *** alexheneveld has quit IRC | 21:32 | |
| *** tspatzier has quit IRC | 21:42 | |
| *** alanf-mc_ has joined #heat | 21:42 | |
| *** alanf-mc has quit IRC | 21:45 | |
| *** Marga_ has quit IRC | 21:47 | |
| *** Marga_ has joined #heat | 21:48 | |
| *** Marga_ has quit IRC | 21:50 | |
| *** Marga_ has joined #heat | 21:52 | |
| *** sabeen2 has quit IRC | 21:53 | |
| *** Marga_ has quit IRC | 21:55 | |
| ryansb | still waiting for my images to redeploy :/ | 21:56 |
| *** EricGonc_ has quit IRC | 21:59 | |
| zaneb | ugh. tripleo. :( | 22:06 |
| *** jasond` has quit IRC | 22:11 | |
| *** hdd has quit IRC | 22:11 | |
| *** hdd has joined #heat | 22:14 | |
| *** Marga_ has joined #heat | 22:14 | |
| *** rpothier has quit IRC | 22:16 | |
| ryansb | zaneb: working now, looks like | 22:18 |
| ryansb | and sitting at 133M of ram | 22:18 |
| zaneb | ryansb: w00t!!! thank you! | 22:18 |
| ryansb | no problemo | 22:19 |
| zaneb | we still have work to do to fix bug 1455589, but I think this should get us unblocked again | 22:20 |
| openstack | bug 1455589 in heat "Memory use is quadratic in the number of stacks" [Critical,New] https://launchpad.net/bugs/1455589 | 22:20 |
| zaneb | maybe I'll downgrade that to 'high' | 22:21 |
| openstackgerrit | Zane Bitter proposed openstack/heat: Get rid of circular references in Resource and Function https://review.openstack.org/183217 | 22:26 |
| openstackgerrit | Zane Bitter proposed openstack/heat: Don't swallow AssertionErrors https://review.openstack.org/183722 | 22:26 |
| *** andersonvom has joined #heat | 22:34 | |
| *** andersonvom has quit IRC | 22:39 | |
| *** spzala has quit IRC | 22:40 | |
| *** sabeen1 has joined #heat | 22:43 | |
| multi_io | do any of you people generate their heat templates, rather than writing them manually? | 22:47 |
| multi_io | yaml and the heat functions are pretty verbose and limited. | 22:48 |
| multi_io | *seem to be | 22:48 |
| *** jamielennox|away is now known as jamielennox | 22:48 | |
| *** hdd has quit IRC | 22:53 | |
| *** jimmybee has joined #heat | 22:54 | |
| *** dannycastle has joined #heat | 22:55 | |
| zaneb | multi_io: yes, lots of people do that | 22:56 |
| *** dannycastle has quit IRC | 22:57 | |
| *** signed8bit is now known as signed8bit_ZZZzz | 22:58 | |
| *** jimmybee has quit IRC | 22:58 | |
| multi_io | zaneb: any specific tools you use? | 22:59 |
| *** crystal0079 has joined #heat | 23:01 | |
| *** crystal0079 has left #heat | 23:01 | |
| *** achanda_ has joined #heat | 23:01 | |
| *** e0ne has quit IRC | 23:04 | |
| *** MasterPiece has quit IRC | 23:05 | |
| *** achanda has quit IRC | 23:05 | |
| *** dims_ has joined #heat | 23:05 | |
| *** achanda_ has quit IRC | 23:06 | |
| *** dimsum__ has quit IRC | 23:07 | |
| zaneb | multi_io: I don't do it personally, but the TripleO project used to just use python. other folks are using jinja2 templating. | 23:08 |
| *** Marga_ has quit IRC | 23:11 | |
| multi_io | zaneb: ok thanks | 23:11 |
| *** Marga_ has joined #heat | 23:18 | |
| openstackgerrit | Merged openstack/heat: Get rid of circular references in Resource and Function https://review.openstack.org/183217 | 23:27 |
| zaneb | w00t! | 23:30 |
| *** Marga_ has quit IRC | 23:31 | |
| *** andersonvom has joined #heat | 23:35 | |
| *** hdd has joined #heat | 23:38 | |
| *** andersonvom has quit IRC | 23:39 | |
| *** sabeen1 has quit IRC | 23:40 | |
| *** Marga_ has joined #heat | 23:40 | |
| ryansb | zaneb: \o/ | 23:49 |
| ryansb | I'll toss it into midstream in a bit, after create it's stable at 258M | 23:50 |
| ryansb | going to test w/ some updates no | 23:50 |
| ryansb | *now | 23:50 |
| *** Marga_ has quit IRC | 23:57 | |
| *** vahidh has joined #heat | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
