Wednesday, 2014-09-17

cindyosandywalsh: which timestamp in the raw event do you use for the required timestamp field? I see timestamp, context_timestamp, launched_at, created_at.00:19
sandywalshcindyo: "timestamp"00:19
cindyotoo obvious :)00:19
cindyothnks00:19
sandywalshlaunched_at and created_at and deleted_at have specific meanings within NOva00:19
sandywalsh*nova00:19
sandywalshand _context_* stuff leaked into notifications a long time ago and were never removed :/00:20
cindyoI’m just getting back to events.  I have the topics added to kafka in mini-mon, and now am working on a test driver that feeds events (wrapped in an evelope with tenant id, region which is what we need) to the raw-events topic.  Bypassing api for now00:21
cindyousing notigen to generate :)00:21
sandywalshheh, nice!00:21
sandywalshwe've been tied up with stackforge stuff, but back in the saddle again now00:21
cindyogood news! :)00:22
sandywalshI'm moving the oahu stuff into winchester00:22
sandywalshso, we should be rocking some monasca integration soon I hope00:22
cindyoyes, please, I’m used to that interface00:22
sandywalshby interface do you mean the Config object vs. the yaml stuff?00:22
cindyoI’ll be ready (don’t know about you) next week to start looking at winchester.  Is that doable for getting oahu in?00:22
sandywalshI think so ... so long as stackforge doesn't cause any issues00:23
cindyoby interface, i mean constructing the pipeline, and creating the nice callback00:23
sandywalshperhaps you, I, roland and dragon should have a little pow-wow tomorrow to sync up?00:23
sandywalshgotcha. yeah, I kinda like the explicit definitions myself too00:24
cindyothat would be good00:24
cindyoI haven’t really looked at winchester yet to be honest.  I heard it has a richer config.  So I’ll use it as you recommend of course!00:25
sandywalshthey're largely the same, but configuration is better with winchester and I suspect the db driver is more performant00:28
sandywalshI'll send an email about tomorrow00:29
cindyosounds great, looks like we are all free except for a short meeting at 11:00 MDT00:30
cindyoanytime except 11:0000:30
sandywalshk, thanks00:30
cindyooh, and 3-4, rolland has a meeting00:31
*** openstackgerrit has quit IRC00:31
*** openstackgerrit has joined #openstack-monasca00:32
*** cindyo has quit IRC01:18
*** cindyo has joined #openstack-monasca02:56
*** cindyo has quit IRC03:43
*** craigbr has joined #openstack-monasca04:05
*** garyh has quit IRC04:10
*** craigbr has quit IRC04:19
*** craigbr has joined #openstack-monasca04:23
*** craigbr has quit IRC04:25
*** craigbr has joined #openstack-monasca04:32
*** craigbr has quit IRC04:58
*** sandywalsh has quit IRC12:37
*** sandywalsh has joined #openstack-monasca12:45
*** craigbr has joined #openstack-monasca13:04
*** craigbr has quit IRC13:17
*** craigbr has joined #openstack-monasca13:29
*** craigbr has quit IRC13:56
*** craigbr has joined #openstack-monasca13:58
*** craigbr has quit IRC14:02
*** craigbr has joined #openstack-monasca14:04
*** sandywalsh has quit IRC14:09
*** rbak has joined #openstack-monasca14:11
*** garyh has joined #openstack-monasca14:16
*** bklei has joined #openstack-monasca14:19
*** sandywalsh has joined #openstack-monasca14:38
*** cindyo has joined #openstack-monasca14:41
*** Guest55683 has joined #openstack-monasca14:53
*** sandywalsh has quit IRC15:02
*** dschroeder has joined #openstack-monasca15:04
*** craigbr has quit IRC15:10
*** craigbr has joined #openstack-monasca15:14
*** tongli has joined #openstack-monasca15:14
openstackgerritDeklan Dieterly proposed a change to stackforge/monasca-persister: Initial Python Persister  https://review.openstack.org/12200915:17
*** sandywalsh has joined #openstack-monasca15:20
*** craigbr has quit IRC15:52
*** sandywalsh has quit IRC17:00
*** tongli has quit IRC17:00
*** bklei has quit IRC17:00
*** sandywalsh has joined #openstack-monasca17:00
*** tongli has joined #openstack-monasca17:00
*** bklei has joined #openstack-monasca17:00
*** jodah has joined #openstack-monasca17:30
*** craigbr has joined #openstack-monasca17:31
cindyosandywalsh: I’m using notigen, and I think one (or more) of the event types does not have ‘tenant_id’. Would that be correct?17:50
sandywalshcindyo: that's possible ... lemme check something17:51
cindyolooking for [‘payload’][‘tenant_id’].  Should it always be there??17:51
*** Guest55683 is now known as Dragon17:52
sandywalshcindyo: how about _context_tenant ... is that always there?17:52
*** Dragon is now known as Guest6578017:52
cindyoI could check, i only saw the error after processing several events17:52
sandywalshcindyo: payload.tenant_id could be hit or miss ... depends on who fabricated the payload17:52
sandywalshthe payload is the Wild West17:52
sandywalshthings above payload are a little more consistent17:53
*** Guest65780 is now known as mdragon17:53
cindyohmm, maybe i should always test for tenant-id17:53
sandywalshI'd use_context_tenant17:53
mdragonyah, payloads can be pretty variable.17:53
sandywalsh_context_tenant17:54
cindyothanks, i’ll try that17:54
cindyosandywalsh: would there be a field that consistenly gives something like region?  I was using payload availability_zone17:56
mdragoncindyo: Alas, most openstack cells/installations are ignorant of region17:58
sandywalshyep, what he said :)17:59
sandywalshit might be good to get that in the winchest or yagi config in some fashion mdragon17:59
sandywalshbrb17:59
cindyoalas :)18:00
mdragonsandywalsh: we actually do in yagi config18:00
mdragonthat's how rs adds region info to the notifications. Yagi does it.18:00
mdragonbased on the source queue18:00
mdragonbut, yah for stv3, it might be usefull to pass some extra traits in when creating the event, so yagi could tell it what it's region is.18:02
* mdragon adds to winchester TODO list18:02
cindyowe mainly needed tenant_id, and region for the event envelope.  I can ask roland if region is absolutiely necessary, but metrics have it18:03
mdragonare you processing these notifications through stackdistiller ?18:05
*** htruta has joined #openstack-monasca18:10
openstackgerritJonathan Halterman proposed a change to stackforge/monasca-common: WIP - Event changes for alarmed-metrics support  https://review.openstack.org/12165218:17
*** bklei has quit IRC18:35
*** craigbr has quit IRC18:42
*** craigbr has joined #openstack-monasca18:47
*** bklei has joined #openstack-monasca19:02
*** craigbr has quit IRC19:04
openstackgerritDeklan Dieterly proposed a change to stackforge/monasca-persister: Initial Python Persister  https://review.openstack.org/12200919:06
*** cindyo has quit IRC19:06
*** cindyo has joined #openstack-monasca19:32
*** craigbr has joined #openstack-monasca19:36
*** tongli has quit IRC19:38
openstackgerritDavid Schroeder proposed a change to stackforge/monasca-agent: Remove 'detail' dimension, fix a couple bugs  https://review.openstack.org/12222919:40
sandywalshinteresting microservices article http://www.activestate.com/blog/2014/09/microservices-and-paas-part-iii (cc:mdragon)19:42
*** jodah has quit IRC19:48
*** jodah has joined #openstack-monasca19:53
openstackgerritCindy O'Neill proposed a change to stackforge/python-monascaclient: updated README.rst for API clients  https://review.openstack.org/12193020:06
cindyomdragon: yes, but haven’t hooked it up the transform-engine yet20:08
*** craigbr has quit IRC20:16
*** craigbr has joined #openstack-monasca20:18
*** jodah has quit IRC20:19
*** craigbr has quit IRC20:24
mdragonAh. yah, just wanted to mention that for things like tenant, you can have distiller look at multiple fields, just make fields a list and it'll grab the first one that's in  the notification. So you could look at payload.tenant_id and _context_tenant if there isn't anything in payload20:24
cindyomdragon: that’s cool.  I think the reason we want to wrap it at the API in the envelope that has tenant_id is for the tenant custom metric case.  The api knows which tenant authenticated20:27
cindyotenant custom event case i mean.  Not a nova event20:28
*** craigbr has joined #openstack-monasca20:29
openstackgerritDavid Schroeder proposed a change to stackforge/monasca-agent: Remove 'detail' dimension, fix a couple bugs  https://review.openstack.org/12222920:40
openstackgerritDavid Schroeder proposed a change to stackforge/monasca-agent: Remove 'detail' dimension, fix a couple bugs  https://review.openstack.org/12222920:41
mdragoncindyo: Ah, ok.20:53
*** craigbr has quit IRC20:56
openstackgerritA change was merged to stackforge/python-monascaclient: updated README.rst for API clients  https://review.openstack.org/12193020:56
*** craigbr has joined #openstack-monasca21:01
*** craigbr has quit IRC21:03
*** craigbr has joined #openstack-monasca21:05
cindyosandywalsh: is notigen generally faster when you run it in realtime?  Since tick is moved for every list of events processed, this would seem slower21:20
openstackgerritDavid Schroeder proposed a change to stackforge/monasca-agent: Remove 'detail' dimension, fix a couple bugs  https://review.openstack.org/12222921:20
openstackgerritDavid Schroeder proposed a change to stackforge/monasca-agent: Remove 'detail' dimension, fix a couple bugs  https://review.openstack.org/12222921:21
*** bklei has quit IRC21:24
*** bklei has joined #openstack-monasca22:18
*** craigbr has quit IRC22:21
cindyosandywalsh: I see that realtime is slower, if you asked for 10 per hour.  Finally it’s quitting since I gave it an end time limit instead of nevents test22:30
cindyoworking much better22:34
*** craigbr has joined #openstack-monasca22:48
*** bklei has quit IRC22:50
*** craigbr has quit IRC22:53
*** bklei has joined #openstack-monasca22:54
*** rbak has quit IRC22:56
*** dschroeder has quit IRC23:05
*** bklei has quit IRC23:08
*** bklei has joined #openstack-monasca23:08
*** bklei has quit IRC23:13
*** jodah has joined #openstack-monasca23:37

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!