Monday, 2016-02-29

*** thorst has joined #openstack-telemetry00:08
*** Qiming_ has quit IRC00:14
*** thorst has quit IRC00:27
*** cheneydc has joined #openstack-telemetry01:03
*** Qiming_ has joined #openstack-telemetry01:14
*** ljxiash has joined #openstack-telemetry01:43
*** ljxiash has quit IRC01:44
*** ljxiash has joined #openstack-telemetry01:44
*** ljxiash has quit IRC01:45
*** ljxiash has joined #openstack-telemetry01:51
*** liamji has joined #openstack-telemetry01:51
*** liamji has quit IRC02:07
*** Qiming_ has quit IRC02:07
*** liamji has joined #openstack-telemetry02:07
*** Qiming has joined #openstack-telemetry02:08
*** ljxiash has quit IRC02:11
*** ljxiash has joined #openstack-telemetry02:11
*** ljxiash has quit IRC02:12
*** ljxiash has joined #openstack-telemetry02:12
*** thorst has joined #openstack-telemetry02:28
openstackgerritMerged openstack/ceilometer: Docs: Configure meters/events dispatch separately  https://review.openstack.org/28328202:35
*** thorst has quit IRC02:36
*** adreznec has quit IRC02:45
*** adreznec has joined #openstack-telemetry02:47
*** liamji has quit IRC02:49
*** kfox1111 has quit IRC02:49
*** liamji has joined #openstack-telemetry02:49
*** kfox1111 has joined #openstack-telemetry02:49
*** boris-42 has joined #openstack-telemetry02:50
*** julim has quit IRC03:07
*** ljxiash has quit IRC03:28
*** ljxiash has joined #openstack-telemetry03:29
*** liamji has quit IRC03:32
*** liamji has joined #openstack-telemetry03:33
*** ljxiash has quit IRC03:33
*** thorst has joined #openstack-telemetry03:36
*** thorst has quit IRC03:41
*** dave-mccowan has quit IRC03:42
*** links has joined #openstack-telemetry03:44
*** Ephur has quit IRC03:59
*** links has quit IRC04:01
*** david-lyle has joined #openstack-telemetry04:13
*** links has joined #openstack-telemetry04:18
*** Qiming_ has joined #openstack-telemetry04:35
*** Qiming has quit IRC04:35
*** david-lyle has quit IRC04:36
*** david-lyle has joined #openstack-telemetry04:50
*** thorst has joined #openstack-telemetry04:54
*** david-lyle has quit IRC04:56
*** yprokule has joined #openstack-telemetry05:00
*** thorst has quit IRC05:03
*** ljxiash has joined #openstack-telemetry05:28
*** thorst has joined #openstack-telemetry06:00
*** thorst has quit IRC06:07
*** _nadya_ has joined #openstack-telemetry06:28
*** _nadya_ has quit IRC06:29
*** thorst has joined #openstack-telemetry07:05
*** thorst has quit IRC07:12
*** _nadya_ has joined #openstack-telemetry07:13
openstackgerritZi Lian Ji proposed openstack/ceilometer: Ceilometer: fix MeterDefinitionException for py3  https://review.openstack.org/28519607:14
*** lsmola has joined #openstack-telemetry07:20
*** rcernin has joined #openstack-telemetry07:24
*** belmoreira has joined #openstack-telemetry07:25
*** pcaruana has joined #openstack-telemetry07:43
*** pasquier-s_ has quit IRC08:03
*** pasquier-s has joined #openstack-telemetry08:05
*** thorst has joined #openstack-telemetry08:11
*** thorst has quit IRC08:17
*** yassine has joined #openstack-telemetry08:24
*** rcernin has quit IRC08:29
*** rcernin has joined #openstack-telemetry08:37
*** lsmola has quit IRC08:44
*** shardy has joined #openstack-telemetry09:03
openstackgerritXia Linjuan proposed openstack/ceilometer: Enable the Load Balancer v2 for notification  https://review.openstack.org/28177709:13
*** thorst has joined #openstack-telemetry09:15
*** liamji has quit IRC09:15
*** ljxiash has quit IRC09:17
*** ljxiash has joined #openstack-telemetry09:17
*** ljxiash has quit IRC09:17
*** ljxiash has joined #openstack-telemetry09:18
*** ljxiash has quit IRC09:18
*** rpodolyaka has left #openstack-telemetry09:19
*** thorst has quit IRC09:22
*** mdih has joined #openstack-telemetry09:23
*** mdih has quit IRC09:23
*** mdih has joined #openstack-telemetry09:23
*** patrickeast has quit IRC09:24
*** patrickeast has joined #openstack-telemetry09:25
*** yprokule has quit IRC09:29
*** yprokule has joined #openstack-telemetry09:34
*** sheeprine has quit IRC09:47
*** sheeprine has joined #openstack-telemetry09:49
*** boris-42 has quit IRC09:54
*** thorst has joined #openstack-telemetry09:59
*** yprokule has quit IRC10:01
*** cheneydc has quit IRC10:01
*** thorst has quit IRC10:06
*** yprokule has joined #openstack-telemetry10:06
*** Qiming_ has quit IRC10:20
*** cdent has joined #openstack-telemetry10:58
*** thorst has joined #openstack-telemetry11:06
*** thorst has quit IRC11:11
*** Qiming has joined #openstack-telemetry11:16
*** permalac has joined #openstack-telemetry11:53
permalachello guys.11:53
permalacI would like to install ceilometer on HA, should I ask here or on the HA group?11:54
*** dave-mccowan has joined #openstack-telemetry11:55
*** cdent has quit IRC12:03
-openstackstatus- NOTICE: Infra currently has a long backlog. Please be patient and where possible avoid rechecks while it catches up.12:07
*** cdent has joined #openstack-telemetry12:27
*** cheneydc has joined #openstack-telemetry12:28
*** gordc has joined #openstack-telemetry12:32
*** thorst has joined #openstack-telemetry12:32
*** lsmola has joined #openstack-telemetry12:32
*** cheneydc has quit IRC12:39
*** sheeprine has quit IRC12:45
*** sheeprine has joined #openstack-telemetry12:46
*** ljxiash has joined #openstack-telemetry12:48
*** pcaruana has quit IRC12:53
*** julim has joined #openstack-telemetry12:56
*** pcaruana has joined #openstack-telemetry13:08
*** sheeprine has quit IRC13:09
*** sheeprine has joined #openstack-telemetry13:10
*** ljxiash has quit IRC13:12
*** tobasco has joined #openstack-telemetry13:15
tobascodoes ceilomter invoke any rebuilding of indices when using mongodb?13:15
tobascoevery night at 1 AM my mongodb goes down because it starts rebuilding for example the "meter" collection13:16
*** links has quit IRC13:18
gordctobasco: not that i know of. the only real periodic task that ceilometer uses is a ttl (if you enabled it)13:20
gordcthat's done natively by mongodb13:21
tobascogordc: thanks, im investigating a weird issue where mongodb rebuild the indices each night at 1 AM causing it to be available13:21
tobascoyour answer helps a lot13:21
gordcnp13:22
tobasco*unavailable13:22
*** sheeprine has quit IRC13:30
*** sheeprine has joined #openstack-telemetry13:30
*** liusheng has quit IRC13:39
*** tongli has joined #openstack-telemetry13:40
*** liusheng has joined #openstack-telemetry13:40
*** nicodemus_ has joined #openstack-telemetry13:42
nicodemus_hello gordc13:45
*** rickyrem has joined #openstack-telemetry13:45
gordcnicodemus_: hey, whatsup?13:45
nicodemus_I've just made a comment on the gnocchi 2.0 bug I reported13:46
gordcnicodemus_: yeah, can you send the error from the clean pool?13:47
nicodemus_sure, give me a few minutes and I'll attach it to the bug report13:47
gordcnicodemus_: can you also try this: http://paste.openstack.org/show/488559/13:50
nicodemus_gordc: would you like me to try that code on 2.0 with an empty pool?13:52
gordcsure13:52
gordci'm not exactly sure what is throwing error to be honest. overflowerror means the timestamp is too big... but i can't see why it'd be too big.13:55
*** links has joined #openstack-telemetry13:59
*** liamji has joined #openstack-telemetry13:59
*** yprokule has quit IRC14:00
*** eglynn has joined #openstack-telemetry14:00
*** yprokule has joined #openstack-telemetry14:05
*** liamji has quit IRC14:05
*** MVenesio has joined #openstack-telemetry14:09
*** liamji has joined #openstack-telemetry14:14
*** liamji has quit IRC14:15
*** liamji has joined #openstack-telemetry14:15
*** links has quit IRC14:16
*** boris-42 has joined #openstack-telemetry14:16
*** liamji has quit IRC14:17
*** liamji has joined #openstack-telemetry14:17
*** Qiming has quit IRC14:19
*** Qiming has joined #openstack-telemetry14:19
*** ljxiash has joined #openstack-telemetry14:20
*** liamji has quit IRC14:21
*** liamji has joined #openstack-telemetry14:22
*** KrishR has joined #openstack-telemetry14:27
*** yprokule has quit IRC14:38
*** pcaruana has quit IRC14:38
*** rbak__ has quit IRC14:39
*** yprokule has joined #openstack-telemetry14:43
nicodemus_gordc: here's the log file showing the error https://gist.github.com/nvlan/2059ad499a8eff6b2d5414:44
*** pradk has joined #openstack-telemetry14:50
gordcsileht:  you have any idea why ^?14:52
*** pcaruana has joined #openstack-telemetry14:52
*** rbak has joined #openstack-telemetry14:55
openstackgerritIlya Tyaptin proposed openstack/aodh: Add alarm checking to maximum of IntegerType  https://review.openstack.org/28609514:57
silehtgordc, not really, seems that we have to convert some int into long manually, because python is too dump to do it itself14:58
gordcsileht: yeah, i wonder why we get something so large though... it seems like the date it's trying to convert is very far in future http://pandas.pydata.org/pandas-docs/stable/gotchas.html#minimum-and-maximum-timestamps15:00
gordcor we have an extra digit somewhere.15:00
gordcweird. if i put a timestamp through round_timestamp, it gives me a complete different day: http://paste.openstack.org/show/488573/15:03
silehtgordc, that's the magic15:04
silehtgordc, this method is to get the file/object name of the timeseries15:04
gordcah right. rounds based on sample15:05
gordcsmapling interval15:05
gordchow do we round to a number bigger than the limit? or is it already too big for limit.15:06
silehtI think is already too big, this method should returns only lower timestamp15:07
gordcagreed15:08
*** permalac has quit IRC15:19
*** permalac has joined #openstack-telemetry15:19
*** permalac has quit IRC15:19
*** permalac has joined #openstack-telemetry15:20
permalachello guys, centos 7 on kilo, when installing ceilomenter I got this error => Requires: python-werkzeug15:21
permalacdo I really need the centos7 Extras repo?15:21
*** liamji has quit IRC15:24
*** liamji has joined #openstack-telemetry15:25
gordcpermalac: if you use the api, then you will need it15:28
permalacso , I need the extras repo just for that package.15:28
gordci'm not familiar with packaging but i'm going to say yes. :)15:29
ljxiashgordc: Hi, gordon, for the patch notification of lbaas https://review.openstack.org/#/c/281777/, I added metadata for those samples. We need those samples for billing requirements.15:34
ljxiashgordc: could you give some suggestions on this?15:35
gordcljxiash: i'm just curious, what query are you running that will give you useful billing data?15:35
permalacgordc, ok. I added the repo just for this package and then it went ok on some servers, and python-requests broke the yum process in another. looks like a bug that is reproducible only sometimes.15:37
gordcbest kind of bug.15:38
ljxiashgordc: e.g. we can start billing when the loadbalancer is created.15:38
gordcljxiash: what query is that? ceilmeter sample-list?15:43
gordci feel like this only exists because you don't want to use event-api.15:43
rickyremgordc: The issue you helped me out with last week(involving mongodb) wasn't really an issue with ceilometer, but an oversight on my part since the project_id isn't always included when storing outgoing.bytes sample data.15:44
*** yprokule has quit IRC15:46
gordcrickyrem: i see. i take it it was filtering at api?15:46
rickyremYes15:46
ljxiashgordc: :) The lbaas v1 support to transform those event to samples, if we do not support this with lbaas v2, we lost this function.15:48
gordccool cool. feel free to raise a bug if you think project_id should be there. could be we just didn't include it15:48
*** rickyrem has quit IRC15:48
gordcljxiash: well you could add it yourself. the defintions are meant to be configurable.15:49
gordci'd rather see all the non-metrics stripped out into another file and just leave actual metrics in default meter.yaml15:50
*** julim has quit IRC15:51
*** rickyrem has joined #openstack-telemetry15:52
*** Qiming has quit IRC15:52
*** julim has joined #openstack-telemetry15:53
*** wolsen has joined #openstack-telemetry15:53
gordcljxiash: as is, i don't think i want to approve it. i don't want to keep supporting something should not exist (in my opinion).15:53
ljxiashgordc: I see. :) Thanks.15:57
gordcljxiash: if you want to keep, let's add it to another file. like https://github.com/openstack/ceilometer/tree/master/etc/ceilometer/examples15:58
ljxiashgordc: yes, ok, thanks for your help.16:02
openstackgerritXia Linjuan proposed openstack/ceilometer: Enable the Load Balancer v2 for events  https://review.openstack.org/28177716:15
*** rcernin has quit IRC16:16
*** pcaruana has quit IRC16:17
*** stevelle_ is now known as stevelle16:18
openstackgerritMerged openstack/ceilometer: Fix events rbac  https://review.openstack.org/23482316:18
*** rickyrem has quit IRC16:20
*** belmoreira has quit IRC16:24
*** cdent has quit IRC16:35
*** thorst is now known as thorst_afk16:44
*** rickyrem has joined #openstack-telemetry16:44
*** ljxiash has quit IRC16:49
*** liamji has quit IRC16:52
*** cdent has joined #openstack-telemetry16:54
*** boris-42 has quit IRC17:14
*** alextricity25_ is now known as alextricity2517:16
*** mdih has quit IRC17:17
*** openstackgerrit has quit IRC17:18
*** rickyrem has quit IRC17:18
*** openstackgerrit has joined #openstack-telemetry17:19
*** rickyrem has joined #openstack-telemetry17:19
*** david-lyle has joined #openstack-telemetry17:30
*** yassine has quit IRC17:36
*** pece has joined #openstack-telemetry17:41
*** david-lyle has quit IRC17:55
*** david-lyle_ has joined #openstack-telemetry17:55
*** tongli has quit IRC17:56
*** agireud has quit IRC18:01
*** agireud has joined #openstack-telemetry18:03
*** rickyrem has quit IRC18:04
*** rickyrem has joined #openstack-telemetry18:10
*** _nadya_ has quit IRC18:18
*** thorst_afk is now known as thorst18:23
*** _nadya_ has joined #openstack-telemetry18:25
*** boris-42 has joined #openstack-telemetry18:30
*** thorst is now known as thorst_afk18:31
*** pece has quit IRC18:34
*** trevor_ has joined #openstack-telemetry18:39
*** trevor_ has quit IRC18:47
openstackgerritAndreas Jaeger proposed openstack/aodh: Remove unused pngmath Sphinx extension  https://review.openstack.org/28620018:49
openstackgerritAndreas Jaeger proposed openstack/ceilometer: Remove unused pngmath Sphinx extension  https://review.openstack.org/28620218:50
*** thorst_afk is now known as thorst18:52
*** _nadya_ has quit IRC18:58
*** julim has quit IRC19:07
*** trevor__ has joined #openstack-telemetry19:07
*** julim has joined #openstack-telemetry19:10
*** rickyrem has quit IRC19:18
trevor__Hi everyone, I'm working on a bug for ceilometer to use the gnocchi dispatcher to store both the timestamp of when a resource was created and when the resource dissapears. I was told the gnocchi-api has the capability to do this but I haven't been able to find any documentation on it. I think I want to log when the resource was created in this function https://github.com/openstack/ceilometer/blob/master/ceilometer/dispa19:19
trevor__Any guidance or help here would be appreciated.19:20
*** _nadya_ has joined #openstack-telemetry19:21
nicodemus_hello trevor__19:30
nicodemus_are you referring to https://bugs.launchpad.net/ceilometer/+bug/1528243 ?19:30
openstackLaunchpad bug 1528243 in Ceilometer "gnocchi dispatcher should leverage events" [Wishlist,Triaged] - Assigned to Trevor McCasland (twm2016)19:31
trevor__Hello nicodemus, yes that's the one!19:33
nicodemus_trevor__, what I meant with my last comment is that each resource on gnocchi can have a "ended_at" timestamp: http://docs.openstack.org/developer/gnocchi/rest.html#resources19:35
*** tongli has joined #openstack-telemetry19:42
gordctrevor__: you'll probably need to send an update to set that attribute19:42
gordcmight need to leverage https://github.com/openstack/ceilometer/blob/master/ceilometer/dispatcher/gnocchi.py#L38219:43
gordcand modify gnocchi mappings to include end events.19:43
gordci don't think we actually looked at what the exact solution would be.19:43
*** rickyrem has joined #openstack-telemetry19:58
trevor__gordc_ I see what you mean, I edited the resource mapping to include an ended_at attribute. How would I use the _update_resource function to reflect these changes? It seems to me that it is already being updated here https://github.com/openstack/ceilometer/blob/master/ceilometer/dispatcher/gnocchi.py#L36920:07
gordctrevor__: i don't think you can just add in an ended_at attribute to existing file. that file only maps metrics. events are different datapoints so you'd have to enable the dispatcher to receive events and when it see specific events 'instance.create.end' events. you'd have to trigger an update_resource20:10
gordcso it'd be a different path from what already exists.20:11
gordcfor example, we have a record metric path https://github.com/openstack/ceilometer/blob/master/ceilometer/dispatcher/database.py#L7320:11
gordcand a record event path: https://github.com/openstack/ceilometer/blob/master/ceilometer/dispatcher/database.py#L10620:11
gordcgnocchi only does the metric path.20:12
*** david-lyle_ is now known as david-lyle20:12
*** _nadya_ has quit IRC20:20
*** _nadya_ has joined #openstack-telemetry20:30
*** tongli has quit IRC20:34
*** yarkot_ has joined #openstack-telemetry20:36
*** yarkot_ has quit IRC20:38
gordcnicodemus_: can you change that code i sent you to be isinstance(ts, pandas.tslib.Timestamp) vs isinstance(ts, pandas.Timestamp)20:47
nicodemus_gordc: sure20:47
gordci can't seem to reproduce this. i'm still curious what that value is that is so big that it's causing overflow20:48
gordcnicodemus_: thanks20:48
*** MVenesio has quit IRC20:49
*** rickyrem1 has joined #openstack-telemetry20:51
nicodemus_gordc: here's the log: https://gist.github.com/nvlan/64b8b5918c2f82a09d1620:52
*** rickyrem has quit IRC20:52
nicodemus_same pool, same hosts, same unprocessed measures20:52
*** rickyrem1 has quit IRC20:53
gordcnicodemus_: hmm.. i thought i wouldn't see those DatetimeIndex stuff with the code change. for some reason it's cool on my end.20:54
gordci'll try again20:54
*** lalolmalo has quit IRC20:58
*** chlong_ has joined #openstack-telemetry21:00
*** rickyrem has joined #openstack-telemetry21:05
gordcnicodemus_: one last try, can you change the log to LOG.debug('pandas: %s', pandas)21:10
nicodemus_gordc: certainly21:10
gordci wonder if it's a 32 vs 64 bit thing21:10
*** lalolmalo has joined #openstack-telemetry21:10
*** _nadya_ has quit IRC21:12
nicodemus_gordc: here's the log: https://gist.github.com/nvlan/c72df33ba3a1eb0ef59421:13
gordcare you on a 32bit os?21:14
nicodemus_gordc: I'd be more than happy to set up remote access for you to test if you can't reproduce it21:14
nicodemus_6421:14
nicodemus_uname: Linux gnocchi-metricd 3.13.0-46-generic #75-Ubuntu SMP Tue Feb 10 15:24:04 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux21:14
gordcdo you have /usr/local/lib64/*?21:15
nicodemus_I do not... just /usr/local/lib21:16
gordcnicodemus_: what happens if you open python shell and run21:19
gordcimport struct21:19
gordcprint struct.calcsize("P") * 821:19
nicodemus_gordc: let's see21:20
gordci'm using the 64bit lib when i run metricd. i wonder if that's why i never see overflow21:21
nicodemus_gordc: http://paste.openstack.org/show/488643/21:21
gordcso are you it seems. i guess you just don't have lib64... (or i googled wrong and that struct stuff doesn't prove anything).21:22
nicodemus_this gnocchi-metricd host is an openstack instance spawned from this image: https://cloud-images.ubuntu.com/trusty/current/trusty-server-cloudimg-amd64-disk1.img21:23
nicodemus_I guess it *should* be using 64-bit lib21:23
*** vishwanathj has joined #openstack-telemetry21:24
nicodemus_gordc: I'll have to disconnect, heading home. Will be back later to assist21:28
gordcnicodemus_: np. thanks for random help so far.21:29
gordci'll try finding a ubuntu machine21:29
*** nicodemus_ has quit IRC21:30
*** r-mibu has quit IRC21:46
*** trevor__ has quit IRC21:46
*** r-mibu has joined #openstack-telemetry21:46
*** rickyrem has quit IRC21:52
*** rickyrem has joined #openstack-telemetry21:54
*** thorst has quit IRC22:35
*** julim has quit IRC22:39
*** thorst has joined #openstack-telemetry22:42
*** claudiub has joined #openstack-telemetry22:43
cdentgordc: it's hilarious how difficult it is for all us cloud folk to find various machines. isn't this a solved problem?22:46
*** thorst has quit IRC22:46
cdentgordc: I have an actual real question. You recall the issue with non-uuid ids of resources? Do you recall if there were any patterns? Who makes the bad ids?22:47
gordccdent: not that i remember.22:48
gordcwe are one of them.22:48
gordci think keystone has some crazy ldap id but they started adopting that uuid5 trick you use for gnocchi22:49
gordcheat i still think has craziness... just not >255char craziness22:50
cdentwas it actual stacks that had the bad ids?22:51
gordci'm not exactly sure what tbh22:51
gordci feel like the answer is everyone is using a non-uuid item at some random stage22:52
gordccdent: you taking up the multi-year cause?22:52
cdentI have it buried on a long term to do list and I was just scrolling through that and was reminded22:53
gordcit was too big of a scope for me to even start thinking of. i'm not sure how we'd fix it without requiring massive migrations or breaking stuff.22:54
cdentIt seems at least like something that should never be done again, from scratch22:55
cdentbut I'm not sure anywhere says (in big neon letters): ffs just use a uuid22:55
gordcwe should start collecting critical breaking issues and just have a backward incompat version.22:57
gordc'everyone start using openstack only after this build'22:57
cdentnah22:58
cdentmore than that22:58
cdentjust start making a new one from scratch, tiny, tight and opinionated22:58
*** thorst has joined #openstack-telemetry23:00
*** thorst has quit IRC23:05
*** cdent has quit IRC23:09
*** KrishR has quit IRC23:25
*** mdih has joined #openstack-telemetry23:29
*** Qiming has joined #openstack-telemetry23:30
*** rickyrem has quit IRC23:31
*** mdih has quit IRC23:32
*** pradk has quit IRC23:32
*** nicodemus_ has joined #openstack-telemetry23:36
nicodemus_evening gordc23:44
openstackgerritgordon chung proposed openstack/gnocchi: fix timeseries update  https://review.openstack.org/28632523:45
gordcnicodemus_: hey23:45
gordcnicodemus_: sorry. no progress on the overflowerror bug23:45
gordcseems like your system is normal re: no lib6423:46
gordcor i tried on coworkers ubuntu system and i see the same23:46
nicodemus_gordc: np, just here in case you need me to test something :)23:46
nicodemus_let me know if you'd like access to my lab to test23:47
gordcnicodemus_: i should probably just try downloading ubuntu23:48
gordclet me do that now before i head home23:48
gordci'll try running ubuntu vm tomorrow. if i can't reproduce i'll try hopping on yours.23:48
nicodemus_gordc: sure, and tnx for your help with this issue!23:49
gordcprobably safer you keep me away from your envirnoment (i tend to break things)23:49
gordcnicodemus_: np. will catch up with you tomorrow. heading home now.23:49
gordcttyl23:49
*** gordc has quit IRC23:50
*** liusheng has quit IRC23:53
*** liusheng has joined #openstack-telemetry23:54
*** thorst has joined #openstack-telemetry23:56
*** thorst_ has joined #openstack-telemetry23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!