Thursday, 2013-12-19

*** sgordon has quit IRC00:00
*** SnowDust has quit IRC00:02
*** AndrewMichalik has quit IRC00:06
*** brint has quit IRC00:09
*** sabeen1 has quit IRC00:10
*** IlyaE has joined #heat00:12
*** pablosan has quit IRC00:24
*** agileclipse has quit IRC00:25
*** zaneb has quit IRC00:30
*** gokrokve has joined #heat00:36
*** dims_ is now known as dims00:37
*** gokrokve has quit IRC00:40
*** gokrokve has joined #heat00:41
*** pvaneck has quit IRC00:41
*** brint has joined #heat00:41
*** gokrokve_ has joined #heat00:42
*** gokrokve has quit IRC00:46
*** brint_ has joined #heat00:57
sdake2SpamapS - yes a piece of data that I'm averse to unified agents ;-)00:58
russellbstevebaker: added some info to https://bugs.launchpad.net/heat/+bug/126143300:58
uvirtbotLaunchpad bug 1261433 in heat "heat-tempest-xx already has an action (DELETE) in progress" [High,Triaged]00:58
russellbstevebaker: happened 39 times in the last 3 days00:58
stevebakerrussellb: OK, thanks. jasond is looking into the followup fix00:59
russellband just put in an elastic-recheck query for it01:00
russellbthanks for being on top of it :)01:00
stevebakerno problem01:01
*** brint has quit IRC01:03
*** brint_ is now known as brint01:03
*** swygue has joined #heat01:07
*** rpothier_ has joined #heat01:08
*** agileclipse has joined #heat01:13
*** IlyaE has quit IRC01:15
*** agileclipse has quit IRC01:15
*** fandikurnia01 has quit IRC01:17
*** rwsu has quit IRC01:18
*** rwsu has joined #heat01:20
openstackgerritRichard Lee proposed a change to openstack/heat: Add filter and pagination to stack_get_all  https://review.openstack.org/6303901:20
openstackgerritAnderson Mesquita proposed a change to openstack/heat: Unscoped List Stacks  https://review.openstack.org/6304101:25
*** brint has quit IRC01:26
*** brint has joined #heat01:26
*** arbylee has quit IRC01:35
*** arbylee has joined #heat01:36
*** nosnos has joined #heat01:38
*** andersonvom has quit IRC01:38
*** andersonvom has joined #heat01:38
*** arbylee has quit IRC01:40
*** faramir1 has joined #heat01:41
*** andersonvom has quit IRC01:42
*** harlowja has quit IRC01:51
openstackgerritA change was merged to openstack/heat: Convert [Cinder]VolumeAttachment to new Schema format  https://review.openstack.org/6178301:58
*** andersonvom has joined #heat02:03
*** harlowja has joined #heat02:03
*** slong has quit IRC02:07
*** slong has joined #heat02:10
*** rongze has joined #heat02:12
*** arbylee has joined #heat02:28
*** nosnos_ has joined #heat02:30
openstackgerrithuangtianhua proposed a change to openstack/heat: Fix copy/paste errors in API docstrings  https://review.openstack.org/6253602:32
*** nosnos has quit IRC02:33
*** erkules_ has joined #heat02:40
SpamapSsdake2: I think if you have that much experience with them failing then you have quite a bit of context that many of us do not. :)02:40
*** erkules has quit IRC02:40
*** yogesh has quit IRC02:43
sdake2security is a big concern02:46
sdake2imagine a monolithic agent deployed on hundreds of thousands of openstack vms where an exploit is found in some way02:47
sdake2that would be very very verrry bad for openstack02:47
SpamapSsdake2: thats why the agent has to be dumb and preferrably _NOT_ root.02:47
sdake2i get that cves are a fact of life, but restarting something like nova is different then restarting hundreds of thousands of vms02:47
sdake2well ideally the agent wouldn't run as root, but some services need enhanced capabilities02:48
*** nati_ueno has quit IRC02:48
sdake2agree agent has to be dumb02:49
sdake2dead simple02:49
sdake2do one thing do it well02:49
SpamapSThis agent is specifically meant to not run as root.02:49
sdake2don't import alot of third party dependencies as that could increase the attack surface02:49
SpamapSAnd to not do anything except the narrow things that each project needs it to.02:49
sdake2yes, although i think it is a bit preferrable that they run in separate process boundaries for security concerns02:50
sdake2so that has been one reason a unified agent has failed02:50
SpamapSLike Trove needs to run SQL commands, maybe upload to swift. Savanna just wants to execute hadoop commands.02:50
sdake2(security wasn't job #1)02:50
sdake2dependency management is important02:50
sdake2the more dependencies, the less likely someone is to import the agent into the vm02:50
sdake2that has derailed a different unified agent02:51
SpamapSThats where I see the salt idea as better than write our own. Salt is just a framework that has a lot of system management plugins. You can run it without any of those.02:51
sdake2salt introduces a new attack surface02:51
sdake2especially the "glue" partt of things02:51
SpamapSso does our own comms library02:51
sdake2so just listing out what has failed, not debating alternatives at this point :)02:52
sdake2people try to turn unified agents into sea salt makers02:52
sdake2i've seen it happen on several occaisons02:52
sdake2its natural for developers to want to grow the agent to do more things02:53
sdake2once that happens, the ocean boiling begins02:53
sdake2as you can see from our long drawn out requirements thread02:53
sdake2server dependencies have been a particular problem in the past, because they have to be securified, ha-ified, documented, etc02:53
SpamapSYeah I've been trying to steer it into "do not invent anything" and "do not pile anything else on this"02:53
sdake2you can steer, but it seems like the thread has gotten out of hand02:54
sdake2reference sea salt making02:54
lifelessSpamapS: what did you think of my troll^Widea?02:56
sdake2agents turn into a huge political gang bang02:56
sdake2i've seen that happen on multiple occasions02:56
sdake2everyone thinks they run the show02:56
sdake2when in fact nobody is actually running anything ;-)02:57
sdake2i could go on02:57
sdake2if yo uwant me to bore you more ;-)02:57
sdake2memory footprint, always a favorite topic of everyone02:58
SpamapSlifeless: well Dmitry seems to be the one most interested in putting actual time in, and he is not interested in the salt idea, so I steered him toward your idea and he's doing that now.02:58
sdake2python is really not a suitable choice for an agent, because of its memory footprint and the fact that it shaves memory off the top of the system *always802:58
lifelessSpamapS: ok cool02:58
sdake2c agent = language war02:59
SpamapSsdake2: that is one reason we've focused on fork/execcing the actual thing. os-collect-config is pretty small.02:59
sdake2so assuming you have a 512mb vm, and you have a 20mb agent, how much memory does it cost, if you have 1 million vms02:59
SpamapSsdake2: that is why they wrote a C++ agent.03:00
SpamapSwhich is an easier language to sell than C03:00
SpamapSmiddle ground03:00
sdake2c++ doesn't fix that problem, see my most recent post comparing c++ to c re memory consumption03:00
sdake2c++ has same footprint as python memory wise03:00
SpamapSThat was a really unfair comparison.03:00
sdake2seemed fair enough to me ;-)03:01
SpamapSruntime != actual running footprint.03:01
lifelessclearly we should use forth03:01
SpamapSlifeless: go .. just say it. We're doing it in go.03:01
SpamapSI bet go's memory footprint ends up identical to python03:01
sdake2we saw what happened with go + juju ;-)03:01
sdake2c is a nonstarter for an agent in openstack imnsho03:02
sdake2c++ is also a nonstarter for similar reasons03:02
SpamapSyou know.. reading salt minion..03:02
SpamapSit is pretty self contained03:02
lifelesswhat you need is zeromq to have a process starting interface03:03
lifeless:P03:03
sdake2dbus ;-)03:03
lifelessmore seriously03:03
lifelessmemory footprint isn't an issue03:03
lifeless /active/ memory footprint is03:03
*** liang has joined #heat03:03
sdake2agree active03:03
sdake2eg, res in top03:03
lifelessthe problem with Python, go, and many other languages03:03
lifelessis that they have a mark and sweep gc03:04
lifelesswhich makes memory == active memory on the order of seconds to minutes03:04
lifelessyou can either drive foot print down to drive active down03:04
lifelessor change languages to ones with only refcounting / manual memory management03:04
lifelessif you're in such constrained circumstances03:04
sdake2there are so many competing requirements for a unified agent03:05
sdake2and tbh, I don't really see the projects that need such agent have enough use cases to deal with to make something reasonable03:05
sdake2focusing on just the specific problems they want solved makes alot of sense03:06
sdake2yet, I have seen that fail - google matahari for an example03:06
*** vkozhukalov has joined #heat03:06
sdake2pretty much the only cats that ever managed to figure it out where the snmp guys in the 70s03:07
sdake2since then, snakeeyes03:07
sdake2cim is a complete and utter failure03:07
sdake2microsoft has unified agents, not sure how they managed to make it happen03:08
sdake2but they were one company with alot of top/down hierarchial control03:08
sdake2I hate to say it can't be done, because anything that can be thought up can be done03:08
sdake2but I wont be the one doing it ;-)03:08
sdake2i do like the idea of injecting agents via oslo.bootstrap or some other process03:09
sdake2this solves the distribution problem03:09
*** swygue has quit IRC03:11
sdake2i would say I have seen every strategy, tactic, plan, project management, organizatoinal management approach to a unified agent03:12
sdake2and every one of them has failed for one reason or another03:12
sdake2my general thought is if *those* army of people couldn't figure it out..03:12
sdake2well you know the rest03:12
sdake2ok done ranting ;-)03:12
sdake2but then again, many people didn't think heat could be done03:14
sdake2and here we are ;-)03:14
sdake2so its entirely possible I am the wrong person to ask for input since I am corrupted by experience03:14
sdake2maybe a naive mind is just what a unified agent needs to get rolling03:21
*** jergerber has joined #heat03:27
*** arbylee has quit IRC03:28
*** jergerber has quit IRC03:30
*** nati_ueno has joined #heat03:35
*** jergerber has joined #heat03:37
*** swygue has joined #heat03:44
*** yogesh has joined #heat03:54
*** Alienyyg has quit IRC03:55
*** yogesh has quit IRC03:58
*** nati_ueno has quit IRC04:01
SpamapSlifeless: people want something "better than HTTP polling" .. which is why the zeromq/oslo.messaging conversation happens.04:01
SpamapSsdake2: btw04:03
SpamapSroot      1199  0.1  0.6  20520 13316 ?        Ss   Dec18   0:29 /usr/bin/python /usr/local/bin/os-collect-config04:03
asalkeld Web Socket transport?04:04
grncdrseriously what's wrong with HTTP polling?04:04
SpamapSgrncdr: useless chatter04:04
asalkeldhttps://github.com/FlaPer87/marconi-websocket04:05
asalkeldmarconi are thinking about web socket04:05
grncdrhm, I should probably read this thread that sdake has been ranting about all day...04:05
SpamapSbut, don't fucking use it in production. Not yet! ;)04:05
SpamapSossum04:05
asalkeld:) he is just prototyping it04:06
SpamapSgrncdr: to tell you the truth, I think it is the right way to go04:06
grncdrwhat is?04:06
SpamapSBut there is that issue that both sides have to be expecting that it might get chopped off in the middle because web requests aren't supposed to take a long time.04:06
SpamapSgrncdr: websocket04:07
SpamapSSomebody suggested that it is only popular because it works in browsers without modification but I think it is also just a ubiquitous and thus likely to work perversion of HTTP.04:07
grncdrI agree with somebody ;)04:08
grncdrbut I have no context for or expertise with wtf you guys are talking about :)04:08
*** blomquisg has quit IRC04:08
*** guohliu has joined #heat04:11
SpamapSgrncdr: If you are going to put an agent on every DBaaS node you spin up and every Hadoop aaS node you spin up.. useless chatter becomes a measurable factor in cost calculation.04:13
grncdrhm, so I'll try not to put my foot in my mouth too much, while still responding... ;)04:15
SpamapSgrncdr: it relates to Heat in that we'd also like to have a way for things to contact Heat from private networks. I'm less convinced that one code base will do more than the private network traversal though.04:16
grncdrso, regarding HTTP polling vs. websockets vs. some other protocol over TCP sockets04:17
grncdrHTTP polling works everywhere and has easy semantics, and is not _necessarily_ much chattier than websockets if you use long-polling04:18
grncdrif long-polling is *still* too chatty, then drop HTTP altogether04:19
SpamapSright that is how I feel too04:20
SpamapSand if we just did that to the ec2 metadata service...04:20
grncdrI don't know, I'm not super passionate about it, but it doesn't seem reasonable to use websockets outside of browsers when there's a plethora of well-implemented and much lighter-weight text-based protocols out there04:21
SpamapSI'm starting to think that is the "it is already done" answer and we would just need to enable POST and help the long polling work better.04:21
SpamapSgrncdr: Consider a deployment where users want to deploy a hadoop cluster in a private network, one where only one machine even has a default gateway.04:22
grncdrSpamapS: you may have to dumb it down/explain why that matters…04:23
SpamapSgrncdr: Right now, in order to make the EC2 metadata service work for those networks, we let neutron sit on that network and listen to 169.254.169.254 port 80. It then looks up the source IP, finds the instance id, and fetches the metadata from nova.04:23
SpamapSgrncdr: HTTP makes that exceedingly straight forward.04:24
*** AndrewMichalik has joined #heat04:25
grncdrhm, so I feel like there should be a generic way to (selectively) expose OpenStack HTTP services inside a private network04:26
grncdrlike, there should be a neutron resource that does just that (minus the IP lookup part I guess)04:27
grncdrI guess you could do it by configuring the router… but honestly I'm talking out my ass here ;)04:27
*** ccs has quit IRC04:28
*** gokrokve_ has quit IRC04:28
openstackgerritA change was merged to openstack/heat: Convert AWS network resources to new Schema format  https://review.openstack.org/6181804:29
SpamapSgrncdr: thats the thing, even just IP is difficult at this level.04:29
*** Tross has joined #heat04:30
SpamapSgrncdr: because the idea is that these nodes have precious data that you don't want to leak out. They are then contacted and filtered by a head node that pokes the data out in limited fashion.04:30
*** ccs has joined #heat04:32
*** gokrokve has joined #heat04:36
*** AndrewMichalik has quit IRC04:37
*** rcleere has joined #heat04:41
*** AndrewMichalik has joined #heat04:44
*** rongze has quit IRC04:44
*** _skraynev has joined #heat04:44
*** nati_ueno has joined #heat04:46
*** Tross has quit IRC04:52
*** ccs has quit IRC04:52
*** akuznetsov has joined #heat04:54
_skraynevMorning04:59
lifelessSpamapS: so don't poll :)05:01
stevebakerSpamapS: how about allowing either the neutron proxy or nova metadata server to have other endpoints that it proxies to?05:01
lifelessso the way the nova metadata server works05:01
lifelesswith neutron05:02
stevebakerthen we can implement longpoll05:02
lifelessis that there is an agent that lives into the user network namespace and proxies out to the API endpoint05:02
_skraynevstevebaker: hello, will you be here 30 min yet? I want discuss with you tempest, but from mobile it is dificult?05:02
sdake2grncdr i wasn't ranting all day, it was more like a 1 hour get it off my chest session ;-)05:02
*** chandankumar has joined #heat05:02
stevebaker_skraynev: I will be here ... but ... wine05:03
_skraynevstevebaker: it is ok)05:04
stevebakerI'll probably make sense, mostly05:04
stevebakerlifeless: so the agent could proxy to other endpoints too?05:04
*** rcleere has quit IRC05:06
*** nosnos_ has quit IRC05:06
lifelessstevebaker: in principle yes, but really I'd be inclined to push it all through the one metadata API05:06
lifelessstevebaker: if that API needs to be richer, surely we just fix it there.05:07
*** nosnos has joined #heat05:07
*** urulama has joined #heat05:07
stevebakerlifeless: it would be nice if heat didn't have to push changes to nova metadata when something changed, that is where I'm coming from05:08
*** rushiagr has joined #heat05:08
*** _skraynev has quit IRC05:08
*** _skraynev has joined #heat05:08
*** Seal has joined #heat05:10
*** rushiagr2 has joined #heat05:12
*** rushiagr has quit IRC05:16
*** Tross has joined #heat05:16
*** AndrewMichalik has quit IRC05:17
*** rongze has joined #heat05:18
*** _skraynev has quit IRC05:19
*** faramir1 has quit IRC05:21
*** rongze has quit IRC05:23
*** sdake2 has quit IRC05:28
*** radix_ has quit IRC05:30
asalkeldwoot, lifeless your data reproduces the bug05:31
asalkeldERROR 1005 (HY000) at line 47: Can't create table 'test_migrations_utils.stack' (errno: 150)05:31
*** rushiagr2 is now known as rushiagr05:40
*** harlowja is now known as harlowja_away05:40
*** erkules_ is now known as erkules05:45
skraynevstevebaker: So now I am ready) As far as I remember you talk that tempest test will became available after release F20. Currently I want know : what plans do you have now?05:45
*** Seal has quit IRC05:46
*** harlowja_away is now known as harlowja05:59
*** jergerber has quit IRC06:02
*** nati_ueno has quit IRC06:05
openstackgerritJenkins proposed a change to openstack/heat: Imported Translations from Transifex  https://review.openstack.org/6255106:06
*** yogesh has joined #heat06:09
*** Seal has joined #heat06:10
*** yogesh_ has joined #heat06:16
*** yogesh has quit IRC06:16
*** rongze has joined #heat06:20
*** yogesh_ has quit IRC06:23
*** nkhare has joined #heat06:24
*** Seal has quit IRC06:25
*** rongze has quit IRC06:25
*** yogesh has joined #heat06:27
*** rongze has joined #heat06:27
*** rongze has quit IRC06:28
*** Seal has joined #heat06:30
lifelessasalkeld: great06:33
asalkeldlifeless, checkout my comments in the bug06:33
lifelessstevebaker: so - neutron doesn't push data to nova, but nova exposes neutron data in metadata06:33
asalkeldhttps://bugs.launchpad.net/heat/+bug/126160506:34
uvirtbotLaunchpad bug 1261605 in heat "migration 30 -> 31 (031_stack_lock)  fails" [Critical,In progress]06:34
lifelessstevebaker: so I don't quite follow your concern06:34
*** rushiagr has quit IRC06:36
*** Seal has quit IRC06:37
*** nati_ueno has joined #heat06:37
*** rongze has joined #heat06:37
*** yogesh has quit IRC06:44
*** yogesh_ has joined #heat06:44
*** rushiagr has joined #heat06:44
*** yogesh_ has quit IRC06:46
*** Seal has joined #heat06:47
lifelessasalkeld: we didn't set latin106:47
asalkeldok06:47
*** SushilKM has joined #heat06:47
lifelessSpamapS: ^06:47
asalkeldlifeless, I have deleted all copies of your sqldump, I can just use a trivial dump and change the tables to latin106:49
asalkeld(so no worries of the actual contents)06:49
asalkeldalso that tenant_idx and stack_status_idx makes no difference06:49
asalkeld(you extra index)06:50
lifelesscool06:50
lifelessSpamapS: do you know about those extra indices?06:50
*** amritanshu_RnD has joined #heat06:52
*** vkozhukalov has quit IRC06:52
stevebakerasalkeld: i think there are about 4 different places utf8 can/should be set for mysql, and they all need to be to get utf8 end-to-end06:52
asalkeldstevebaker, well we need to decide if this is a valid bug06:53
*** akuznetsov has quit IRC06:59
*** yogesh has joined #heat07:01
*** SushilKM has quit IRC07:02
lifelessasalkeld: we didn't do anything to deliberately get that07:02
lifelessasalkeld: so permitting it to happen is a bug07:02
stevebakerlifeless: maybe os-db-create needs to do a:07:03
stevebakercreate database heat default character set utf8;07:03
asalkeldI am making a test, to check for non-utf807:03
lifelessmaybe07:03
*** Seal has quit IRC07:03
lifeless  CONSTRAINT `stack_ibfk_2` FOREIGN KEY (`user_creds_id`) REFERENCES `user_creds` (`id`)07:03
lifeless) ENGINE=InnoDB DEFAULT CHARSET=utf8 |07:03
lifelessfor show create table stack in a recent overcloud07:04
lifelessI want to say that something in the heat space has changed07:04
lifelessin the last month or so07:04
stevebakerlifeless: sqlalchemy 015_grizzly specifies utf8 on the tables, so I don't _think_ anything has changed recently07:05
SpamapSlifeless: extra indices? no?07:05
asalkeldsome sql people:07:06
asalkeldselect TABLE_COLLATION from information_schema.TABLES where TABLE_COLLATION!='utf8_general_ci';07:06
lifelessSpamapS: heat db on the underclou07:06
lifelessSpamapS: has two indices that new heat db's don't have07:06
SpamapSregarding the utf8 problem on indexes: it is ridiculous to have utf8 UUID's. Anyway, I'm still not ready to champion that bug just yet.07:06
asalkeldI want to say "if there is no "utf8" in the table_collation field07:07
SpamapSlifeless: let me look at that07:07
lifelessSpamapS: and has CHARSET latin107:07
lifelessSpamapS: on the stack table07:07
lifelessSpamapS: this is what make migration 31 barf07:07
SpamapSlifeless: the charset latin1 may have been some default leaking from our de-tuned mysql07:07
lifelessSpamapS: overcloud heat doesn't have the latin107:07
lifelessSpamapS: it also doesn't have the extra indices07:08
SpamapSlifeless: right. Hard to say why the table would be latin1.07:08
lifelessSpamapS: I know, right?07:08
stevebakerSpamapS, lifeless, is it because you're calling create database explicitly instead of letting sqlalchemy migrate fu do it?07:08
SpamapSlifeless: undercloud / is full again :(07:09
SpamapSlifeless: I'm guessing those extra indexes are my fault. :)07:15
SpamapSlifeless: ~/.mysql_history has them being added.07:15
SpamapSlifeless: I vaguely remember tinkering with them.07:16
SpamapSand indeed, server and db are defaulted to latin1 instead of utf8 as they should be07:16
*** hub_cap has joined #heat07:17
SpamapSlifeless: ok so I think we probably need to assert our mysql configuration to set character_set_server to utf8.07:21
stevebakerbut I wonder why the utf8 on the migrate table create wasn't applied?07:21
*** yogesh has quit IRC07:21
*** rushiagr has quit IRC07:22
*** rushiagr has joined #heat07:22
*** faramir1 has joined #heat07:22
SpamapSstevebaker: do we actually assert utf8 anywhere?07:28
*** ccs has joined #heat07:29
asalkeldSpamapS I don't think so07:30
SpamapSok, so what is happening then is that our clients _do_ set utf8 but our servers do not...07:31
SpamapSthis leads to a client which sets "nothing" getting "latin1"07:31
SpamapSand, most likely, the client that was in use when the database was being dickered with (probably by me) was one such client07:32
SpamapSthis gets really ugly if you already have utf-8 characters in the database, but AFAICT, we shouldn't07:32
SpamapSthere's no real bug then in Heat.07:33
*** tomek_adamczewsk has joined #heat07:36
*** ccs has quit IRC07:36
stevebakerI shall mark that Essentiall/Invalid then :)07:39
*** ccs has joined #heat07:39
*** Seal has joined #heat07:39
*** SushilKM has joined #heat07:39
stevebakerI mean Critical/Invalid07:40
*** liang has quit IRC07:48
*** rongze has quit IRC07:49
*** rongze has joined #heat07:49
SpamapSstevebaker: this is why Drizzle removed charsets and just made everything utf8.07:50
*** gokrokve has quit IRC07:50
*** nati_ueno has quit IRC07:54
*** tomek_adamczewsk has quit IRC07:55
*** rushiagr is now known as rushiagr_away07:55
*** tomek_adamczewsk has joined #heat07:56
asalkeldo well at least I setup a new pgp key :O07:56
*** che-arne has quit IRC07:56
*** yogesh has joined #heat07:57
openstackgerritMitsuru Kanabuchi proposed a change to openstack/heat: Implements resource type NetworkGateway  https://review.openstack.org/6228707:59
sgran  /win 3108:01
sgranarg08:01
*** SushilKM__ has joined #heat08:03
*** SushilKM has quit IRC08:04
*** harlowja is now known as harlowja_away08:04
*** TonyBurn has joined #heat08:11
*** rushiagr_away is now known as rushiagr08:12
*** tomek_adamczewsk has quit IRC08:14
*** tomek_adamczewsk has joined #heat08:16
*** akuznetsov has joined #heat08:22
*** vkozhukalov has joined #heat08:29
*** tomek_adamczewsk has quit IRC08:35
*** pshchelo has joined #heat08:35
*** tomek_adamczewsk has joined #heat08:36
shardymorning08:40
therveHi shardy08:41
therveSo I missed the meeting (again), but the new times are just, like 4 to 6h later?08:41
therveWhy not a bigger difference?08:42
therveI guess to keep NZ happy? :)08:42
openstackgerritSimon Pasquier proposed a change to openstack/heat: Simplify update_with_template() method  https://review.openstack.org/6283208:52
*** Tross has quit IRC08:52
*** ifarkas has joined #heat09:01
*** tomek_adamczewsk has quit IRC09:02
*** tomek_adamczewsk has joined #heat09:02
shardytherve: Hmm, I didn't think we decided the new time, we were going to post a ML thread with a doodle poll IIRC09:03
shardytherve: Then alternate like ceilometer does, keeping the current time every other week09:03
lifelessstevebaker: so I think invalid is missing the point :)09:03
lifelessstevebaker: if we can get it wrong others will09:04
lifelessstevebaker: there should be a cross-check in there somewhere to prevent that being unnoticed09:04
therveshardy, Yeah there is a doodle, the times are 0-2 UTC09:05
*** tomek_adamczewsk has quit IRC09:05
*** tomek_adamczewsk has joined #heat09:05
therveAt least for me that would make it a no-go09:05
shardytherve: ouch09:05
shardytherve: Yeah, pretty sure I'll be sleeping then too09:06
therveI'd be okay if the current one was perfect, but it's also slightly inconvenient :/09:06
shardyYeah, nearly all my meetings end up eating up my free evenings during the week09:07
shardyNo way to make it convenient for everyone tho..09:07
SpamapSlifeless: this is one of those meta-bugs in MySQL.. _everyone_ screws this up.09:07
shardytherve: Did you see the minutes, where we discussed the instance-users proposals?09:08
shardytherve: consensus seems to be to proceed with option (2) where we still create users associated with the credentials, but put them in a separate heat-specific domain09:10
*** tomek_adamczewsk has quit IRC09:11
therveshardy, Yeah I read it. Looking at stevebaker's section right now too09:16
lifelessSpamapS: sure, but can we be one of the projects that *notices* this?09:16
SpamapSlifeless: I tend to agree with you that the bug should be kept open. The bug is actually that the error is misleading and unhelpful. I want to make it clear though, it is not easy to predict when this will fail.09:19
SpamapSlifeless: have had it bite me in production more times than I can count.09:19
SpamapSand by it I mean "charset WTF"09:19
openstackgerritStephen Sugden proposed a change to openstack/heat: Add PortCheck resource  https://review.openstack.org/6207809:19
*** ccs has quit IRC09:20
shardytherve: I'm not sure about stevebaker's proposal, I see the advantages, but I don't like the fact that we can't do any policy enforcement, because the keypair isn't backed by a real user09:20
shardytherve: i.e whose token will the engine return when it validates the signature?09:21
therveYeah I'm just curious :)09:21
shardyI also don't like the fact that it makes Heat the authentication service09:21
therveBut I agree, 2) looks like the most promising, I like it09:21
shardybut I would support it being added as an optional mode, in addition to domain users09:21
*** ccs has joined #heat09:21
lifelessSpamapS: can we check the schema once on attaching or something ?09:22
lifelessSpamapS: care to reopen it then?09:22
shardyI don't see why we couldn't do both, in a way which is easily selectable via the heat.conf09:22
shardythen heat standalone folks could use (5) and everyone else could use the (arguably more robust) (2)09:22
SpamapSlifeless: what we can do is check it in db_sync09:23
shardyWe need an answer to the whose-token-is-it question first tho09:23
therveshardy, Do we still need trusts with the second option?09:25
*** akuznetsov has quit IRC09:26
SpamapSlifeless: re-opened09:28
shardytherve: No, not unless you want the user inside the instance to impersonate the stack owning user09:29
shardytherve: which in many/most cases probably isn't required09:29
therveWe have a trick anyway for that already, no?09:29
shardytherve: although it could make things simpler if we did, as it would avoid having to map user ids to resources, or do a lookup09:30
therveRight09:30
therve_load_user_creds09:30
shardytherve: Yeah, it's either do a policy check of userid-> resource, or do impersonation and allow the user to access any resource in the stack09:30
shardycomes down to whether we want a user per stack or a user per resource09:30
shardyThe other issue is we'd need a way to defeat the tenant scoping if we don't use impersonation, which is maybe not desirable09:31
shardywe could have some resource DB lookup which filters on the unique stack_user_id or something I guess09:32
*** Tross has joined #heat09:32
shardyeither way with or without trusts, I don't think it will be super complex09:33
shardyfirst step is to port heat_keystoneclient to v3 only, which I've already started09:33
shardyanother keystone bug I need to fix first..09:33
*** ccs has quit IRC09:36
*** giulivo has joined #heat09:41
*** urulama has quit IRC09:56
openstackgerritChmouel Boudjnah proposed a change to openstack/python-heatclient: Show better error when json fail to parse template  https://review.openstack.org/6231109:59
*** SergeyLukjanov has joined #heat10:03
openstackgerritLiang Chen proposed a change to openstack/heat: Enable parallel while deleting neutron resources  https://review.openstack.org/6258010:05
*** nkhare is now known as nkhare_afk10:06
*** faramir1 has quit IRC10:10
*** rongze has quit IRC10:11
*** liang has joined #heat10:12
*** derekh has joined #heat10:15
*** rongze has joined #heat10:23
*** yogesh has quit IRC10:24
*** pshchelo has quit IRC10:25
*** pshchelo has joined #heat10:27
*** rushiagr is now known as rushiagr_away10:30
*** akuznetsov has joined #heat10:32
openstackgerrithuangtianhua proposed a change to openstack/heat: "Size" should be required para on Volume resource  https://review.openstack.org/6308310:41
*** rushiagr_away is now known as rushiagr10:47
*** urulama has joined #heat10:50
*** aignatov has joined #heat10:51
*** tomek_adamczewsk has joined #heat10:53
*** SushilKM__ has quit IRC10:59
*** nosnos has quit IRC11:00
*** Seal has quit IRC11:01
*** tomek_adamczewsk has quit IRC11:07
*** blues-man has joined #heat11:10
pshchelohi all, I have a question - in my recent patch that was approved and merged, the last patch-set actually did not fix the error that commit message announced, and I hugely apologize for that :( how should I proceed?11:12
*** rongze has quit IRC11:13
shardypshchelo: Post another patch which fixes the problem ;)11:13
blues-manhello folks11:14
shardypshchelo: If you wish, you can post a patch reverting the one we committed first11:14
shardypshchelo: which patch?11:14
pshchelohttps://review.openstack.org/#/c/61816/311:14
pshchelowhile I was fighting the json, the original intent got lost..11:15
pshchelojust noticed it when rebasing now on my other patches that are in progress11:16
shardypshchelo: Please just post a followup patch explaining the issue and fixing the problem11:17
shardypshchelo: reference that commit or review URL in the commit message so we can connect the two patches11:17
pshcheloshardy: ref it in commit message?11:18
pshchelook, got you11:18
*** guohliu has quit IRC11:18
shardyIn the detailed part of the commit message, say patch merged under review <url> introduces <problem explanation>, this fixes <problem>11:19
openstackgerritPavlo Shchelokovskyy proposed a change to openstack/heat: Fix misused assertTrue in unit tests  https://review.openstack.org/6308911:26
pshcheloshardy: done11:27
*** alexheneveld has joined #heat11:27
*** aignatov has quit IRC11:28
*** rpothier has joined #heat11:32
*** rpothier_ has quit IRC11:34
*** SushilKM__ has joined #heat11:34
*** yogesh has joined #heat11:35
*** nkhare_afk is now known as nkhare11:35
*** yogesh has quit IRC11:39
*** rushiagr has quit IRC11:40
*** bgorski has joined #heat11:45
*** aignatov has joined #heat11:47
*** bgorski has quit IRC11:49
*** rushiagr has joined #heat11:50
*** rushiagr has quit IRC11:55
*** rushiagr has joined #heat11:55
*** nkhare is now known as nkhare_afk11:56
*** swygue has quit IRC11:59
*** bgorski has joined #heat12:02
*** rongze has joined #heat12:04
*** rpothier_ has joined #heat12:15
*** aignatov has quit IRC12:16
*** rpothier has quit IRC12:18
*** aignatov has joined #heat12:20
*** rongze_ has joined #heat12:24
*** giulivo has quit IRC12:24
*** rongze has quit IRC12:28
*** rpothier_ has quit IRC12:29
*** agileclipse has joined #heat12:37
*** nkhare_afk has quit IRC12:40
*** pshchelo has quit IRC12:40
*** urulama has quit IRC12:46
*** giulivo has joined #heat12:47
openstackgerritA change was merged to openstack/heat: Add nested resource references to resource group  https://review.openstack.org/6161412:50
*** SushilKM__ has quit IRC12:51
*** blues-man has quit IRC12:51
*** akuznetsov has quit IRC12:53
*** rushiagr has quit IRC13:09
*** pshchelo has joined #heat13:09
openstackgerritPavlo Shchelokovskyy proposed a change to openstack/heat: Fix asserttion of types  https://review.openstack.org/6143613:14
*** pshchelo has quit IRC13:19
*** pafuent has joined #heat13:22
*** pafuent has left #heat13:23
sdakemorning13:28
shardyHi sdake13:28
sdakehey shardy13:28
sdakecloud borat has become less offensive, and less funny as a result :(13:31
*** rpothier has joined #heat13:36
*** blomquisg has joined #heat13:36
*** SushilKM__ has joined #heat13:36
*** Seal has joined #heat13:36
*** andersonvom has quit IRC13:39
*** Seal has quit IRC13:41
*** chandankumar_ has joined #heat13:44
*** chandankumar_ has quit IRC13:44
*** aweiteka has joined #heat13:45
openstackgerritJun Jie Nan proposed a change to openstack/heat: Avoid using python build-in class property and exit  https://review.openstack.org/6281413:45
*** akuznetsov has joined #heat13:47
*** tomek_adamczewsk has joined #heat13:51
*** urulama has joined #heat13:55
*** urulama_ has joined #heat13:56
*** akuznetsov has quit IRC13:58
*** derekh has quit IRC14:00
*** urulama has quit IRC14:00
*** chandankumar has quit IRC14:06
openstackgerritJun Jie Nan proposed a change to openstack/heat: Removed unused variables  https://review.openstack.org/6282714:09
openstackgerritLiang Chen proposed a change to openstack/heat: Enable parallel while deleting neutron resources  https://review.openstack.org/6258014:10
*** blues-man has joined #heat14:12
openstackgerritA change was merged to openstack/heat: Use property name constants in Ceilometer alarm  https://review.openstack.org/6241314:13
*** rushiagr has joined #heat14:14
*** sergmelikyan has quit IRC14:27
sdakeshardy did we cancel the heat meeting on the 1st?14:28
*** andersonvom has joined #heat14:28
sdakeI was half-attending the irc meeting yesterday and don't recall the outcome14:28
shardysdake: Yes, cancelled for the next two meetings14:28
*** rushiagr has quit IRC14:29
*** rushiagr has joined #heat14:29
* sdake shakes fists at zimbra14:29
skraynevshardy: oh. Is there no meeting 25 Dec and 1 Jun ?14:30
sdakesome young enterprising individual should put that on the heatmeetings page ;-)14:30
shardyskraynev: No, due to Christmas and New Years holidays14:30
skraynevshardy: Well, what about 5 Jun?14:31
sdakewhat happens jun 5th?14:31
skraynevshardy: different countries different holidays)))14:32
pasquier-sskraynev, you mean January, right?14:32
shardyskraynev: I'm well aware of that, but a sufficient number of the core team will be absent, so we decided to cancel the meetings14:32
skraynevsdake: I have asked about meeting in 5 Jan)14:32
therveWell Jan 5th is a sunday, so it should be a problem14:32
skraynevpasquier-s: yes14:33
therveshould not14:33
skraynevlol) I have looked to other mount in calendar. sorry)14:34
shardyandersonvom: hi14:35
sdakeskraynev our next meeting is jan 8 201414:35
openstackgerritPavlo Shchelokovskyy proposed a change to openstack/heat: Fix comparison with singletons  https://review.openstack.org/6285214:35
sdakeI edited the wiki based upon shardy's comments14:35
skraynevsdake: I got it. thank you.14:35
*** jasond` has joined #heat14:37
skraynevlong period for the resting and celebration NY with family))14:37
*** jcru has joined #heat14:40
*** liang has quit IRC14:40
*** pfreund has joined #heat14:42
*** openstack has joined #heat14:49
*** sabeen has joined #heat14:49
*** amritanshu_RnD has quit IRC14:50
andersonvomshardy: morning!14:51
shardyHey andersonvom, just wanted to quickly chat about the policy additions14:52
shardyI dug out my patch adding policy enforcement to the native API, and it's nearly there14:52
*** gokrokve has joined #heat14:52
andersonvomshardy: sure. I just saw your comments. if I can help in any way, I have bandwidth to do it14:52
shardySo if you're happy, I can finish adding the tests this afternoon, and post it for you to use as a basis for the management-api additions?14:52
andersonvomshardy: sounds good!14:53
shardyandersonvom: Yeah, after I wrote the comment I realized what I had was nearly there sat on a branch, as always adding tests is taking a while.. :)14:53
andersonvomshardy: I feel ya ;)14:53
*** arbylee has joined #heat14:54
shardyandersonvom: Ok, cool, I should have something for you in the next few hours14:54
andersonvom\o/14:54
*** tims has joined #heat14:54
*** vijendar has joined #heat14:55
openstackgerritPavlo Shchelokovskyy proposed a change to openstack/heat: Fix comparison with singletons  https://review.openstack.org/6285214:57
openstackgerritPavlo Shchelokovskyy proposed a change to openstack/heat: Fix comparison with singletons  https://review.openstack.org/6285214:57
*** pshchelo has joined #heat14:59
tomek_adamczewskHi, wanted to ask about https://wiki.openstack.org/wiki/Heat/Environments15:08
*** blamar has joined #heat15:08
tomek_adamczewskexample shows that you can modify resource content through environment, but current source code (if I understand it correctly) doesn't support these sections in environment model15:09
tomek_adamczewskis it something that is expected to work, or just an outdated document/example?15:09
tomek_adamczewsk*) expected to work one day15:10
*** jergerber has joined #heat15:11
*** topol has joined #heat15:12
*** mestery_ has joined #heat15:12
*** AndrewMichalik has joined #heat15:15
*** mestery has quit IRC15:16
*** blamar has quit IRC15:16
*** blamar has joined #heat15:17
*** jasond` has quit IRC15:17
*** IlyaE has joined #heat15:21
*** mestery has joined #heat15:22
*** mestery_ has quit IRC15:25
*** rcleere has joined #heat15:27
*** nkhare has joined #heat15:30
*** rcleere has quit IRC15:39
*** sjmc has joined #heat15:40
*** vkozhukalov has quit IRC15:40
*** rongze has joined #heat15:42
*** rongze_ has quit IRC15:45
*** jasond` has joined #heat15:46
*** john-n-seattle1 has joined #heat15:47
openstackgerritA change was merged to openstack/heat: Convert Neutron resources to new Schema format  https://review.openstack.org/6182315:55
*** SergeyLukjanov has quit IRC15:56
*** swygue has joined #heat15:56
*** ccs has joined #heat16:02
*** rcleere has joined #heat16:04
*** SushilKM__ has quit IRC16:05
*** rongze has quit IRC16:15
*** rongze has joined #heat16:16
*** tomek_adamczewsk has quit IRC16:18
*** swygue has quit IRC16:18
*** SushilKM__ has joined #heat16:18
*** Seal has joined #heat16:18
*** sdake_ has joined #heat16:22
*** sdake_ has quit IRC16:22
*** sdake_ has joined #heat16:22
*** rongze has quit IRC16:22
sdake_wow target got hacked16:22
sdake_40 million credit cards compromised16:22
*** rongze has joined #heat16:22
*** urulama_ has quit IRC16:22
sdake_that is going to cost a boatload of money to fix16:22
*** dims has quit IRC16:26
openstackgerritRichard Lee proposed a change to openstack/heat: Add way to group exceptions in DependencyTaskGroup  https://review.openstack.org/6247916:27
openstackgerritRichard Lee proposed a change to openstack/heat: Refactor Instance#_check_active  https://review.openstack.org/6247816:27
*** swygue has joined #heat16:27
*** aignatov has quit IRC16:28
*** dims has joined #heat16:30
*** SergeyLukjanov has joined #heat16:38
*** rushiagr is now known as rushiagr_away16:39
*** sjm__ has joined #heat16:42
SpamapSsdake_: they seem pretty inept. Wife ordered a couch that was supposed to be shipped from Ohio to California, and was instead shipped to Wisconsin.16:45
*** pshchelo has quit IRC16:45
SpamapSsdake_: and then it sat in their distribution warehouse for 3 weeks and nobody knew where it was.16:45
*** dims_ has joined #heat16:46
*** arbylee has quit IRC16:46
SpamapSgrncdr: your PortCheck resource has me concerned.16:47
*** jasond`` has joined #heat16:47
openstackgerritPablo Andres Fuente proposed a change to openstack/heat: Deleting a stack with a deleted nested stack fails  https://review.openstack.org/6275216:47
*** aignatov has joined #heat16:51
*** dims has quit IRC16:52
*** jasond` has quit IRC16:52
*** sjmc has quit IRC16:52
*** SushilKM__ has quit IRC16:56
*** Seal has quit IRC16:57
*** AndrewMichalik has quit IRC17:00
openstackgerritA change was merged to openstack/heat: Convert numeric values in instance metadata to strings  https://review.openstack.org/6188317:02
*** SushilKM__ has joined #heat17:02
*** Seal has joined #heat17:02
*** arbylee has joined #heat17:03
*** SergeyLukjanov is now known as _SergeyLukjanov17:03
*** _SergeyLukjanov has quit IRC17:04
*** pablosan has joined #heat17:05
*** SergeyLukjanov has joined #heat17:07
*** sjm__ has quit IRC17:07
openstackgerritDennyZhang proposed a change to openstack/heat: add assertion to heat-keystone-setup script  https://review.openstack.org/6190517:07
*** Seal has quit IRC17:08
*** rushiagr_away is now known as rushiagr17:15
*** aignatov has quit IRC17:17
*** pfreund has quit IRC17:18
openstackgerritPablo Andres Fuente proposed a change to openstack/heat: Deleting a stack with a deleted nested stack fails  https://review.openstack.org/6275217:21
*** blues-man has quit IRC17:21
*** SushilKM__ has left #heat17:39
*** rongze has quit IRC17:39
*** rongze has joined #heat17:40
*** rongze has quit IRC17:44
*** vkozhukalov has joined #heat17:46
*** nkhare has quit IRC17:47
*** dims_ is now known as dims17:50
*** AndrewMichalik has joined #heat17:51
openstackgerritAnderson Mesquita proposed a change to openstack/heat: Check resources are in expected states  https://review.openstack.org/5864117:55
*** che-arne has joined #heat17:57
*** TonyBurn has quit IRC17:58
*** aignatov has joined #heat18:03
*** harlowja_away is now known as harlowja18:04
openstackgerritJason Dunsmore proposed a change to openstack/heat: Allow an in-progress stack to be deleted  https://review.openstack.org/6300218:06
grncdrSpamapS: you around?18:07
grncdrugh, also does anybody know how to put links into gerrit comments?18:09
grncdrthey have commit hashes in them which gerrit seems determined to interfere with18:09
jasond``grncdr: maybe put it on it's own line with space before it?18:10
grncdrhah nope that just does even more broken things :(18:12
grncdrwtf gerrit authors18:12
openstackgerritSteven Hardy proposed a change to openstack/heat: Add policy enforcement to ReST API  https://review.openstack.org/6318518:13
shardyandersonvom: ^^18:13
shardyandersonvom: Not quite finished, still need a little bit more work on the tests18:13
shardybut I'm going afk for a couple of hours so there's a WIP for you to review18:13
andersonvomshardy: sweet. I'll take a look at it right after lunch. thanks!18:14
shardyandersonvom: Cool, I'll be back later after some food also18:15
clarkbgrncdr: its actually our comment link config doing that18:15
SpamapSgrncdr: I am now18:15
clarkbgrncdr: are these links to openstack project commits? you can just dump the hash in there18:15
grncdrclarkb: I want to link to specific lines18:15
clarkbthough we should probably go back to simply linking change ids and not commits18:15
SpamapSclarkb: I think this is just for the sake of discussion.18:16
grncdrso I'm doing https://github.com/openstack/heat/blob/<hash>/heat/engine/somefile.py#L12318:16
grncdrSpamapS: since you're here, I'll post the review comment without the hashes (which should stop the auto-linking)18:17
grncdre.g. just pointed at master18:17
clarkbgrncdr: you know a simple solution is probably ot wrap the regex in \b18:17
grncdrclarkb: who has permissions to do that?18:17
* grncdr hopes it's you ;)18:18
clarkbgrncdr: anyone. the gerrit config is hosted in gerrit. I am poking at it now though18:18
SpamapSgrncdr: did you just want to chat here about it?18:19
grncdrSpamapS: yeah, I did take the time to write this though so I'm going to post it first ;)18:19
*** akuznetsov has joined #heat18:19
SpamapSgrncdr: This is for posterity.. so please.. be honest: http://4.bp.blogspot.com/-C9FfVjS-l_8/UXoMAjav1WI/AAAAAAAAB1w/EtbFBZyK10Y/s1600/CountRugen.jpg18:20
*** alexheneveld has quit IRC18:21
grncdr:P18:21
clarkbgrncdr: https://review.openstack.org/6318718:21
*** urulama has joined #heat18:23
*** pvaneck has joined #heat18:23
openstackgerritA change was merged to openstack/heat: Simplify update_with_template() method  https://review.openstack.org/6283218:24
grncdrwoo published finally18:24
grncdralso seriously wtf does everybody invent their own half-assed text markup? </rant>18:25
grncdr(not OpenStack/Heat, but gerrit)18:26
*** urulama has quit IRC18:27
grncdrSpamapS: the gist of my comment regarding exceptions is "heat already does this and it works"18:27
*** IlyaE has quit IRC18:28
*** radix_ has joined #heat18:29
SpamapSgrncdr: Ah right, I forgot that we treat these things like plugins and thus we expect the authors to do crazy things like raise their own exceptions. :)18:29
SpamapSgrncdr: On the "should we do this".. I think for a small scale this is fantastic and so probably "Yes we should do it". But I think we may want to document the dangers of enabling it.. you basically turn heat-engine into a DDoS machine. We might not be expecting heat-engine to do that the same way we expect tenant vms to.18:30
*** IlyaE has joined #heat18:31
grncdrSpamapS: fwiw I agree with you on both points. In my particular use case we're not running heat-api publically, we have an application in front of it that is responsible for generating the templates and instantiating them via the heat-api18:32
grncdrthe DDoS aspect is worth considering though… is there currently a mechanism for whitelisting resource types that heat can instantiate?18:33
SpamapSgrncdr: FWIW I like the idea a lot.18:33
grncdrfor that matter, is there a mechanism for telling heat "also load resources from this other module?" (I never looked for that...)18:34
*** yogesh has joined #heat18:34
SpamapS#plugin_dirs=/usr/lib64/heat,/usr/lib/heat18:34
*** ifarkas has quit IRC18:34
*** gokrokve has quit IRC18:36
*** PhilK has quit IRC18:36
SpamapSgrncdr: this is where I wonder if there isn't real monitoring as a service in development. because that is really what you want anyway.18:36
*** PhilK has joined #heat18:37
*** rcleere has quit IRC18:37
*** bgorski has quit IRC18:37
*** fsargent has joined #heat18:38
grncdrwell, I specifically want it to interact with heat18:38
grncdrthough I suppose that part would be easy18:38
*** rongze has joined #heat18:40
*** rushiagr has quit IRC18:41
*** gokrokve has joined #heat18:41
*** dmueller_ has joined #heat18:42
SpamapSgrncdr: right if it was monitoring as a service you just feed monitoring as a service the waitcondition handle.18:42
SpamapSgrncdr: you could basically create a little "under the covers" nested stack with a waitcondition and a monitoring as a service thing.18:43
SpamapSgrncdr: I think for now we should just merge your thing but open a bug to replace its underbelly with something more scalable.18:43
grncdrmakes sense to me18:44
*** IlyaE has quit IRC18:45
*** yogesh has quit IRC18:45
*** rongze has quit IRC18:45
*** yogesh has joined #heat18:47
*** aignatov has quit IRC18:47
*** dmueller__ has joined #heat18:48
*** dmueller_ has quit IRC18:49
openstackgerritStephen Sugden proposed a change to openstack/heat: Add PortCheck resource  https://review.openstack.org/6207818:50
SpamapSgrncdr: responded in-line and added a few more comments18:51
*** dmueller__ has quit IRC18:53
grncdrregarding the delete_stack_after… reset_dummy_db will do the same?18:56
grncdrfrom reading the code that's really not clear...18:58
SpamapSgrncdr: well reset should clear everything out. Let me verify that.18:58
*** yogesh has quit IRC18:58
grncdrit deletes the database, but stack_delete_after calls stack.delete()18:58
*** yogesh has joined #heat18:58
grncdrI'm not sure whether there are other resources left hanging around by creating a stack that wouldn't be in the database...18:59
grncdractually, I think I was just confusing myself, since I'm used to be a client of heat and not working on heat itself18:59
SpamapSgrncdr: this is also just in a "delete what you create so tests are isolated" thing. It isn't an integration test after all.19:00
*** yogesh has quit IRC19:01
grncdryeah, it's that my brain wasn't used to thinking of "the db" as "heat engine state"19:01
grncdrbecause in my app tests "the db" is "app state" and "heat engine state" has to be cleaned up via the heat api19:02
grncdranyways, brain fart deconstructed, I'll get rid of the suspenders19:02
openstackgerritStephen Sugden proposed a change to openstack/heat: Add PortCheck resource  https://review.openstack.org/6207819:03
*** yogesh_ has joined #heat19:04
*** aignatov has joined #heat19:07
*** AndrewMichalik has quit IRC19:09
*** che-arne has quit IRC19:10
*** radez_g0n3 is now known as radez19:13
stevebakermorning19:14
*** yogesh_ has quit IRC19:15
*** yogesh has joined #heat19:17
andersonvommorning!19:17
stevebakerI'm going to go ahead and assume that randellburt won't -1 bgorski's nomination19:19
*** akuznetsov has quit IRC19:20
jasond``stevebaker: he +1ed it19:22
jasond``stevebaker: http://dunsmor.com/shots/2013-12-19-132315_562x632.png19:23
stevebakerah, zaneb hasn't19:23
shardystevebaker: zaneb is on PTO today I think19:25
*** AndrewMichalik has joined #heat19:25
*** lsmola_ has quit IRC19:25
openstackgerritSteven Hardy proposed a change to openstack/heat: Add policy enforcement to ReST API  https://review.openstack.org/6318519:25
stevebakertoo late, I've added bgorski to core19:29
*** andersonvom1 has joined #heat19:31
*** andersonvom is now known as Guest6605319:31
*** andersonvom1 is now known as andersonvom19:31
*** Guest66053 has quit IRC19:32
andersonvomshardy: just looked at your patch and I think I see where you're going now. I'm wondering how do you see the tenant_safe flag being used, though19:32
*** AndrewMichalik has quit IRC19:42
*** swygue has quit IRC19:42
*** scroiset_ has joined #heat19:42
*** scroiset has quit IRC19:42
SpamapShm19:43
SpamapSupdates don't wait for waitconditions19:44
SpamapSwondering if they should19:44
SpamapSor if we should have some way to make a waitcondition an update wait condition.19:44
stevebakerisn't a waitcondition IN_PROGRESS while waiting?19:52
SpamapSstevebaker: nothing sets it back to that during update19:55
*** sdake has quit IRC19:55
SpamapSstevebaker: I'm thinking that we just need an UpdateWaitCondition that works exactly like WaitCondition but, on update, clears the signals and waits for them again.19:55
*** sdake has joined #heat19:56
*** sdake has quit IRC19:56
*** sdake has joined #heat19:56
*** swygue has joined #heat19:56
stevebakerSpamapS: that is what SoftwareDeployment signalling will do (not that I've tried it)19:57
SpamapSstevebaker: yay, ok so I will defer trying to do mine and just hack a 1 second timeout wobble into our updates which will force replacement of the wait conditions.19:57
SpamapSlifeless: ^^ HOT to the rescue :)19:58
stevebakerthere might need to be some way of saying to reapply the deployment even if nothing has changed19:59
SpamapShm that won't work20:00
SpamapSsorry not your thing stevebaker20:00
SpamapSthe wobble20:00
SpamapSI need the WaitConditionHandle to be replaced, not the waitcondition20:01
*** pablosan has quit IRC20:06
*** fsargent has left #heat20:07
*** pablosan has joined #heat20:08
*** ccs has quit IRC20:08
*** swygue has quit IRC20:19
*** swygue has joined #heat20:22
*** urulama has joined #heat20:24
*** ccs has joined #heat20:25
openstackgerritAnderson Mesquita proposed a change to openstack/heat: Check resources are in expected states  https://review.openstack.org/5864120:26
*** ccs has quit IRC20:26
*** ccs has joined #heat20:26
stevebakerjasond``: any progress on https://bugs.launchpad.net/heat/+bug/1261433 ?20:27
uvirtbotLaunchpad bug 1261433 in heat "heat-tempest-xx already has an action (DELETE) in progress" [High,Triaged]20:27
*** IlyaE has joined #heat20:28
*** urulama has quit IRC20:29
arbyleein regards to the etc/heat/policy.json, does anyone know the context around the role "heat_stack_user"? What does that role represent and why is it not allowed to do any cloudformation/cloudwatch actions?20:29
arbyleeI'm trying to understand this upcoming change: https://review.openstack.org/#/c/63185/2/etc/heat/policy.json20:30
arbylee^ shardy if you're around20:31
stevebakerarbylee: that role is just for instance users, they are only allowed to fetch information about their own resources20:33
openstackgerritStephen Sugden proposed a change to openstack/heat: Add PortCheck resource  https://review.openstack.org/6207820:33
grncdr^ fixed my 80 character line :\20:33
jasond``stevebaker: i think this will fix it https://review.openstack.org/#/c/63002/20:34
jasond``I'm going to add that bug to the commit message on the next update20:35
arbyleestevebaker: thanks20:36
stevebakerjasond``: OK, have you also looked into stopping heat-api logging user exceptions with ERROR?20:39
jasond``stevebaker: i'll start working on that now20:41
*** rcleere has joined #heat20:43
*** Tross has quit IRC20:43
stevebakerjasond``: OK, thanks. That would probably be the quickest fix. We're racking up quite a few rechecks20:44
jasond``stevebaker: well, the quickest fix is https://review.openstack.org/#/c/62938/20:46
stevebakerjasond``: that is not a fix, that is hiding the bug ;)20:47
*** alexheneveld has joined #heat20:47
jasond``stevebaker: so the test should keep trying to delete the same stack twice?20:47
*** aignatov has quit IRC20:48
stevebakerjasond``: sure, it should work. A test should automatically clean up its resources, and it is desirable to also explicitly test doing a delete20:48
stevebakerin the short term we could add that error to tempest/etc/whitelist.yaml20:49
jasond``okay.  so the double delete should be done in a separate test, right?20:49
jasond``ie. test_stack_double_delete20:51
*** alexheneveld has quit IRC20:51
stevebakerwe could eventually have a test which exercises multi-engine, attempting actions while in_progress doing other actions20:51
*** vkozhukalov has quit IRC20:51
jasond``sounds good20:52
*** Seal has joined #heat20:56
*** jdob has joined #heat20:57
openstackgerritA change was merged to openstack/python-heatclient: Sync base and exceptions from oslo  https://review.openstack.org/6199120:58
openstackgerritA change was merged to openstack/python-heatclient: Reuse BaseManager and Resource from oslo  https://review.openstack.org/6234820:58
openstackgerritA change was merged to openstack/heat: Fix copy/paste errors in API docstrings  https://review.openstack.org/6253620:58
*** Seal has quit IRC21:01
*** sabeen has quit IRC21:05
*** radez is now known as radez_g0n321:08
openstackgerritSteve Baker proposed a change to openstack/heat: A cloud-config resource based on SoftwareConfig  https://review.openstack.org/6321421:09
openstackgerritSteve Baker proposed a change to openstack/heat: A multipart cloud-init resource based on SoftwareConfig  https://review.openstack.org/6321521:09
openstackgerritSteve Baker proposed a change to openstack/heat: OS::Nova::Server support for software config  https://review.openstack.org/5888021:09
openstackgerritSteve Baker proposed a change to openstack/heat: REST API for software config/deployment  https://review.openstack.org/5887821:09
openstackgerritSteve Baker proposed a change to openstack/heat: Resource types for software config/deployment  https://review.openstack.org/5887921:09
openstackgerritSteve Baker proposed a change to openstack/heat: Database model for software config/deployment  https://review.openstack.org/5887621:09
openstackgerritSteve Baker proposed a change to openstack/heat: RPC service for software config/deployment  https://review.openstack.org/5887721:09
jasond``shardy: still here?21:14
asalkeldmorning21:17
*** gokrokve has quit IRC21:17
*** topol has quit IRC21:17
*** gokrokve has joined #heat21:18
jasond``asalkeld: good morning21:19
*** Tross has joined #heat21:21
*** gokrokve has quit IRC21:21
*** blomquisg has quit IRC21:23
*** swygue has quit IRC21:28
jasond``stevebaker: https://review.openstack.org/#/c/62080/3 fixes the API error logging issue21:30
andersonvommorning21:31
asalkeldooo, we really need that jasond21:32
*** swygue has joined #heat21:34
*** cody-somerville has joined #heat21:37
*** cody-somerville has quit IRC21:37
*** cody-somerville has joined #heat21:37
*** gokrokve has joined #heat21:38
SpamapSweird21:41
SpamapSstack validation requires nova to be running21:41
*** jasond has quit IRC21:42
*** jasond has joined #heat21:42
SpamapSstevebaker: so for the event-list ordering.. I wonder if we should actually bring back the autoincrement ID, but just never expose it to the user.21:43
SpamapSthe random order is really awful21:43
stevebakerwhy was the int id removed? I don't recall21:44
*** slong has quit IRC21:44
SpamapSstevebaker: leaks data21:44
SpamapSstevebaker: same reason nova ids are uuids.21:45
asalkeldbrb: dropping kids off21:46
*** SergeyLukjanov has quit IRC21:46
*** jdob has quit IRC21:46
stevebakeranother option, add a milliseconds column and sort by created_at, millis21:48
SpamapSstevebaker: indeed, and that will support a more distributed scale-out-per-resource story better.. assuming we have time synced ;)21:49
stevebakermysql starts supporting sub-second datetime from version 5.6.421:50
shardysubsecond timestamps are truncated on mysql, ref bug #124638321:50
uvirtbotLaunchpad bug 1246383 in keystone "Trusts expires_at field is rounded down, doesn't match docs" [Low,New] https://launchpad.net/bugs/124638321:50
SpamapSstevebaker: but letting the database handle ordering instead of the clock will produce better results.21:50
shardyha, snap21:50
lifelessyeah but21:50
lifelessin nova the id is an int21:50
lifelessthe uuid is a string21:50
lifelessthe id doesn't get exported over the API21:51
SpamapSlifeless: right, we just don't tell the user what the id is.21:51
SpamapSI'm suggesting we do the same in the events table.21:51
lifelessheat seems to have forgotten the basic rule of id is INT21:51
lifelessand instead gone nutty :)21:51
*** alexheneveld has joined #heat21:55
sdake_rht gangbusters in aftermarket21:56
sdake_street must have liked our performance21:56
*** aweiteka has quit IRC21:56
stevebakercan we get some reviews on this potential gate race fix? https://review.openstack.org/#/c/62080/21:57
SpamapSwoooot22:02
*** giulivo has quit IRC22:02
SpamapShttp://paste.openstack.org/show/5555322:02
SpamapS^^ update retrying a failed create22:03
*** tomek_adamczewsk has joined #heat22:03
*** slong has joined #heat22:04
asalkeldstevebaker, interested in removing your -2 from: https://review.openstack.org/#/c/59685/22:10
SpamapSyou guys missed an extra not-needed upcall to setUp22:10
SpamapSI'll do a follow-up patch22:10
chmouelhello, how much ram should i need on my vm to test the cfn/fedora image?22:11
asalkeldchmouel, m1.small22:12
SpamapSwhats an m1?22:12
asalkeldflavor22:12
asalkeld| 2  | m1.small  | 2048      | 20   | 0         |      | 1     | 1.0         | True      |22:13
* SpamapS is trolling22:13
asalkeldm1.tiny can work if you don't have cfn-init in there22:13
*** tomek_adamczewsk has quit IRC22:13
asalkeldcfn-init does a yum makecache that blows the disk22:14
stevebakerasalkeld: removed, I'll review if I get the chance22:14
*** Tross has quit IRC22:14
asalkeldsure (it's just discouraging others from reviewing)22:15
openstackgerritClint "SpamapS" Byrum proposed a change to openstack/heat: Remove unnecessary setUp call  https://review.openstack.org/6322522:16
*** arbylee has quit IRC22:17
*** rcleere has quit IRC22:20
*** urulama has joined #heat22:25
SpamapSasalkeld: did we find a way around the upgrade problem?22:25
asalkeld(other that changing the charset?)22:25
asalkeldthan22:26
*** rpothier has quit IRC22:26
asalkeldI can re-test my old patch, one moment22:26
chmouelasalkeld:nice thank you, seem to work if i increase my vm size from 1gb to 3gb :)22:27
*** swygue has quit IRC22:28
asalkeldchmouel, cool22:28
asalkeldSpamapS, that old patch of mine does not fix the issue22:29
asalkeldjust re-tested22:29
chmoueltrying to fix this bug https://bugs.launchpad.net/heat/+bug/1261883 but i need some proper events first :)22:29
uvirtbotLaunchpad bug 1261883 in heat "event-list is in random order" [High,Triaged]22:29
*** gokrokve has quit IRC22:29
*** gokrokve has joined #heat22:30
*** urulama has quit IRC22:30
asalkeldchmouel, you could just start an empty stack22:30
*** swygue has joined #heat22:30
asalkeldyou really don't need a server22:30
asalkeldwhy not a stack with only a LaunchConfig22:31
asalkeldor a whole bunch of them22:31
chmouelhumm yeah, i was trying to get as much real life as possible22:31
chmoueland i need to get experience on heat22:31
asalkeldthat will generate events22:31
chmouelso that's a good excuxe :)22:31
asalkeldok, cool22:31
SpamapSalso its good to have events that are separated by a few seconds22:32
SpamapSchmouel: how are you proposing to fix it?22:32
chmouelSpamapS: something like this? http://pastie.org/pastes/8559490/text?key=kyye29jqy9q06b0tzudhdw22:32
SpamapSchmouel: we were just discussing adding back in an incrementing ID.22:33
*** arbylee has joined #heat22:33
*** pablosan has quit IRC22:33
SpamapSchmouel: that will not produce an accurate order22:34
*** gokrokve has quit IRC22:34
SpamapSchmouel: it will just limit the random ordering to events in the same single second22:34
chmouelSpamapS: ah :(22:34
chmoueli guess as you said the incrementing ID would make things work then22:34
asalkeldnote: i have a patch series to send the events via the notification system22:35
SpamapSasalkeld: send them where?22:35
asalkeldso first send them via notify()22:35
asalkeldI'll post a wip (easier than discribing)22:36
SpamapSohh22:37
SpamapSno I think I understand22:37
openstackgerritAngus Salkeld proposed a change to openstack/heat: WIP: Send events via the notification system  https://review.openstack.org/6323022:37
SpamapSasalkeld: ok, so in oslo I see log, rpc, and noop22:37
chmouelasalkeld: nice22:37
SpamapSasalkeld: nothing user facing unfortunately. :(22:37
asalkeldcfg.CONF.set_default(name='notification_driver',22:37
asalkeld29                     default=['heat.engine.event'])22:37
asalkeldso SpamapS all this goes to ceilometer22:38
asalkeldand ceilometer is moving to an "event" style api22:38
*** nati_ueno has joined #heat22:38
SpamapSasalkeld: Aha!22:39
asalkeldso we could at some point change "heat event-list" to actually call the ceilometer api22:39
asalkeldand all this is soon to end up in horizon22:39
*** vijendar has quit IRC22:39
*** jasond`` has quit IRC22:39
SpamapSasalkeld: sounds good because then every set of notifications that we want to show to users and let users store is in ceilometer.22:39
asalkeldso you can see your "events/notifications"22:40
asalkeldyip22:40
SpamapSasalkeld: however, right now, I don't need ceilometer for Heat. Will this be an alternate backend or are we going to tie Heat to ceilometer in a more aggressive way?22:40
SpamapSbecause I do actually need ordered events now22:40
asalkeldso SpamapS atm that patch will not change anything22:41
chmouelSpamapS: is storing events can be optional?22:41
SpamapSnote that I've taken to piping to sort -t\| -k622:41
asalkeldchmouel, exactly22:41
asalkeldby default store the events as normal22:41
SpamapSwhich is what chmouel's suggested fix would do22:41
*** swygue has quit IRC22:41
asalkeldbut also send to ceiloometer22:41
asalkeldin the future when ceilometer and horizon is ready22:42
SpamapSasalkeld: ahh, ok cool. I think this is an alternative-backend-driver type of solution, so less "but also ceilometer" and more "store and retrieve in sql, or store and retrieve from ceilometer or sql"22:42
asalkeldwe can just remove that default event store notification handler22:42
SpamapSI'd just let it alone.22:43
SpamapSstandalone people will thank you :)22:43
asalkeldyeah, my patch just gives you more options22:43
SpamapShave it work like keystone token drivers22:43
SpamapSasalkeld: there is the question of how ceilometer knows what to do with your notifications, but I presume you're involved with making that "awesome" :)22:44
asalkeldwell it just stores22:44
asalkeldper resource/project/user22:45
asalkeldso you can see all your notifications22:45
asalkeldso you could say: what are all the notifications for my stack22:45
SpamapSasalkeld: and there is something that makes them "heat+stackid" so that heat event-list can grab just those.22:45
SpamapS?22:45
SpamapSasalkeld: sounds like ceilometer is going to be logging as a service22:46
SpamapSthough I know these are less verbose than logs22:46
asalkeldSpamapS, well I am not driving that22:46
SpamapSit would actually make sense22:46
asalkeldbut if that is the way, then I'll use it22:46
SpamapSlike a log != an event.. but having the ability to shove verbose logs in during an event is useful.22:47
asalkeldit's notification-aas22:47
SpamapSasalkeld: anyway, neat-o22:47
asalkeldcool22:47
*** gokrokve has joined #heat22:49
SpamapSchmouel: sorry we got off on a tangent. Did you need help building a template for testing?22:52
chmouelSpamapS: oh no worries, i am fighting with my nova on my vm but all good new stuff to learn22:52
chmouelSpamapS: thanks22:52
chmouelSpamapS: and i thing it's getting late for me so will see that tomorrow22:53
SpamapSchmouel: cool. I really want this bug fixed so let me know if there is anything I can do to help.22:53
chmouelSpamapS: cool let me give a try tomo morning (EU time) and if i can't i may unassigned myself to someone who know the code better22:54
*** gokrokve has quit IRC22:54
SpamapSchmouel: ok, nothing like a good old fashioned bug fix to learn. :)22:56
chmouelSpamapS: i can probably help on the swift sides do you know if there is some features requests there?22:57
chmouelSpamapS: i am thinking to add tempurl key for a start since that may be useful for a heat use case22:57
SpamapSchmouel: No I haven't heard much about that but we do have swift resources so reviewing them / filling out their docs / features would be useful.22:58
SpamapSchmouel: I am positive tempurls would be very useful22:58
chmouelSpamapS: ok great, thanks again and that would be the time for me to logoff22:58
stevebakerits a shame ceph doesn't support tempurls23:08
SpamapShttp://tracker.ceph.com/issues/345423:09
*** yogesh has quit IRC23:10
*** harlowja is now known as harlowja_away23:12
stevebakergood to see23:15
*** arbylee has quit IRC23:18
*** andersonvom has quit IRC23:21
*** rpothier has joined #heat23:29
openstackgerritAngus Salkeld proposed a change to openstack/heat: Add a db check for CHARSET=utf8  https://review.openstack.org/6324123:34
*** nati_uen_ has joined #heat23:34
*** nati_uen_ has quit IRC23:34
*** nati_uen_ has joined #heat23:35
*** nkhare has joined #heat23:35
*** Tross has joined #heat23:36
*** nati_ueno has quit IRC23:37
*** ccs has quit IRC23:42
stevebakerasalkeld: I get this quite frequently but have not yet found how to reproduce it http://paste.openstack.org/show/55566/23:42
asalkeldthat's with the current code?23:43
asalkeld(not my patch)23:43
stevebakeryep23:43
*** rongze has joined #heat23:43
asalkeldmmm, that's not good23:44
asalkeldstevebaker, not sure what to make of that :(23:46
stevebakerme neither23:47
stevebakerI'll raise a bug23:47
*** rongze has quit IRC23:48
*** slong has quit IRC23:49
stevebakerhang on, does devstack create a new encrypt secret on every run?23:50
asalkeldmaybe?23:51
stevebakerthat will be it. unstack.sh has stopped killing heat-engine so the old heat-engine gets load-balanced until I notice and kill it23:53
*** harlowja_away is now known as harlowja23:57
*** gokrokve has joined #heat23:59
*** ccs has joined #heat23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!