| *** ddieterly has joined #openstack-ceilometer | 00:04 | |
| *** ddieterly has quit IRC | 00:19 | |
| *** primechuck has quit IRC | 00:20 | |
| *** ddieterly has joined #openstack-ceilometer | 00:26 | |
| *** _cjones_ has quit IRC | 00:29 | |
| *** _nadya_ has joined #openstack-ceilometer | 00:32 | |
| *** _nadya_ has quit IRC | 00:37 | |
| *** ddieterly has quit IRC | 00:41 | |
| *** ddieterly has joined #openstack-ceilometer | 00:44 | |
| *** primechuck has joined #openstack-ceilometer | 00:50 | |
| *** Longgeek has joined #openstack-ceilometer | 01:00 | |
| *** primechuck has quit IRC | 01:10 | |
| *** liusheng has joined #openstack-ceilometer | 01:12 | |
| *** openstack has joined #openstack-ceilometer | 01:23 | |
| *** jruano has quit IRC | 01:26 | |
| *** htruta_ has joined #openstack-ceilometer | 01:34 | |
| *** jdandrea has quit IRC | 01:38 | |
| *** primechuck has joined #openstack-ceilometer | 01:44 | |
| *** jruano has joined #openstack-ceilometer | 01:48 | |
| *** ankita_wagh has joined #openstack-ceilometer | 01:59 | |
| *** ankita_wagh has quit IRC | 02:13 | |
| *** ankita_wagh has joined #openstack-ceilometer | 02:13 | |
| *** ankita_wagh has quit IRC | 02:14 | |
| *** ankita_wagh has joined #openstack-ceilometer | 02:15 | |
| openstackgerrit | Ren Qiaowei proposed openstack/ceilometer: Add necessary executable permission https://review.openstack.org/202353 | 02:16 |
|---|---|---|
| *** Longgeek has joined #openstack-ceilometer | 02:30 | |
| *** dikonoor has joined #openstack-ceilometer | 02:35 | |
| *** Longgeek has quit IRC | 02:35 | |
| *** julim has joined #openstack-ceilometer | 02:52 | |
| *** cmyster has quit IRC | 02:54 | |
| *** htruta_ has quit IRC | 03:04 | |
| *** primechuck has quit IRC | 03:17 | |
| *** dikonoor has quit IRC | 03:26 | |
| *** deepthi has joined #openstack-ceilometer | 03:35 | |
| *** serverascode has quit IRC | 03:45 | |
| *** zhiyan has quit IRC | 03:45 | |
| *** rex_lee has quit IRC | 03:46 | |
| *** h00327910_ has quit IRC | 03:46 | |
| *** boris-42 has quit IRC | 03:46 | |
| *** zhiyan has joined #openstack-ceilometer | 03:54 | |
| *** serverascode has joined #openstack-ceilometer | 03:58 | |
| *** jruano has quit IRC | 03:59 | |
| *** jruano has joined #openstack-ceilometer | 03:59 | |
| *** rex_lee has joined #openstack-ceilometer | 04:02 | |
| *** boris-42 has joined #openstack-ceilometer | 04:07 | |
| *** h00327910_ has joined #openstack-ceilometer | 04:11 | |
| *** belmoreira has joined #openstack-ceilometer | 04:15 | |
| *** jwcroppe has joined #openstack-ceilometer | 04:16 | |
| *** Longgeek has joined #openstack-ceilometer | 04:17 | |
| *** Longgeek has quit IRC | 04:25 | |
| *** Longgeek has joined #openstack-ceilometer | 04:25 | |
| *** belmoreira has quit IRC | 04:28 | |
| *** yatin has joined #openstack-ceilometer | 04:34 | |
| *** yprokule has joined #openstack-ceilometer | 04:45 | |
| *** ddieterly has quit IRC | 04:51 | |
| *** _nadya_ has joined #openstack-ceilometer | 04:56 | |
| *** _nadya_ has quit IRC | 04:57 | |
| *** _nadya_ has joined #openstack-ceilometer | 04:57 | |
| *** _nadya_ has quit IRC | 05:02 | |
| *** cmyster has joined #openstack-ceilometer | 05:03 | |
| *** cmyster has quit IRC | 05:03 | |
| *** cmyster has joined #openstack-ceilometer | 05:03 | |
| *** cmyster has quit IRC | 05:03 | |
| *** _nadya_ has joined #openstack-ceilometer | 05:14 | |
| openstackgerrit | Ryota MIBU proposed openstack/aodh: Refactor alarm scenario tests (TestAlarmsHistory) https://review.openstack.org/201966 | 05:21 |
| *** hans__ has joined #openstack-ceilometer | 05:23 | |
| *** hans_ has quit IRC | 05:26 | |
| *** jruano has quit IRC | 05:35 | |
| openstackgerrit | Rohit Jaiswal proposed openstack/ceilometer: add Trove(DBaaS) events https://review.openstack.org/200746 | 05:35 |
| *** _nadya_ has quit IRC | 05:38 | |
| *** _nadya_ has joined #openstack-ceilometer | 05:38 | |
| *** _nadya_ has quit IRC | 05:42 | |
| *** vishwana_ has joined #openstack-ceilometer | 05:43 | |
| *** vishwanathj has quit IRC | 05:47 | |
| *** ddieterly has joined #openstack-ceilometer | 05:52 | |
| *** ddieterly has quit IRC | 05:56 | |
| *** lakshmiS has joined #openstack-ceilometer | 06:03 | |
| lakshmiS | question for ceilometer team. In Openstack searchlight project we are consuming glance notifications. when ceilometer is running we dont seem to get the notifications even though we are using a different pool name in oslo messaging? | 06:04 |
| *** ildikov has quit IRC | 06:18 | |
| *** belmoreira has joined #openstack-ceilometer | 06:25 | |
| *** cmyster has joined #openstack-ceilometer | 06:27 | |
| *** Longgeek has quit IRC | 06:51 | |
| *** Longgeek has joined #openstack-ceilometer | 06:52 | |
| *** ddieterly has joined #openstack-ceilometer | 06:52 | |
| *** ddieterly has quit IRC | 06:57 | |
| *** ankita_wagh has quit IRC | 06:58 | |
| *** ankita_wagh has joined #openstack-ceilometer | 06:59 | |
| *** shardy has joined #openstack-ceilometer | 07:03 | |
| *** ankita_wagh has quit IRC | 07:03 | |
| *** ildikov has joined #openstack-ceilometer | 07:04 | |
| *** ankita_wagh has joined #openstack-ceilometer | 07:08 | |
| *** ankita_wagh has quit IRC | 07:16 | |
| *** _nadya_ has joined #openstack-ceilometer | 07:25 | |
| *** lan has quit IRC | 07:33 | |
| *** nijaba has quit IRC | 07:43 | |
| *** nijaba has joined #openstack-ceilometer | 07:44 | |
| *** nijaba has quit IRC | 07:44 | |
| *** nijaba has joined #openstack-ceilometer | 07:44 | |
| openstackgerrit | Chris Dent proposed openstack/ceilometer: [WIP] Attempt to use grenade plugin with devstack plugin https://review.openstack.org/202203 | 07:46 |
| *** Ala has joined #openstack-ceilometer | 07:49 | |
| *** ddieterly has joined #openstack-ceilometer | 07:53 | |
| *** lakshmiS has quit IRC | 07:53 | |
| *** Ala has quit IRC | 07:55 | |
| *** cdent has joined #openstack-ceilometer | 07:57 | |
| *** nsaje_ has joined #openstack-ceilometer | 07:57 | |
| *** ddieterly has quit IRC | 07:58 | |
| *** nsaje has quit IRC | 07:59 | |
| *** Ala has joined #openstack-ceilometer | 08:03 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/aodh: Use the right sqla type for JSONEncodedDict https://review.openstack.org/200476 | 08:05 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/aodh: api: Add location alarm creation https://review.openstack.org/202427 | 08:07 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/aodh: Add devstack support https://review.openstack.org/200467 | 08:07 |
| *** safchain has joined #openstack-ceilometer | 08:12 | |
| openstackgerrit | Merged openstack/aodh: Use the right sqla type for JSONEncodedDict https://review.openstack.org/200476 | 08:25 |
| *** boris-42 has quit IRC | 08:32 | |
| *** cdent has quit IRC | 08:33 | |
| *** cdent has joined #openstack-ceilometer | 08:33 | |
| *** yassine has joined #openstack-ceilometer | 08:40 | |
| *** exploreshaifali has joined #openstack-ceilometer | 08:41 | |
| *** exploreshaifali has quit IRC | 08:46 | |
| *** belmoreira has quit IRC | 08:51 | |
| *** ddieterly has joined #openstack-ceilometer | 08:54 | |
| *** ddieterly has quit IRC | 08:58 | |
| *** belmoreira has joined #openstack-ceilometer | 09:05 | |
| *** yatin has quit IRC | 09:06 | |
| openstackgerrit | liusheng proposed openstack/aodh: (WIP) Allow aodh directly acessing to its storage https://review.openstack.org/202454 | 09:16 |
| *** hans__ has quit IRC | 09:18 | |
| *** yatin has joined #openstack-ceilometer | 09:34 | |
| *** Beetnik has joined #openstack-ceilometer | 09:41 | |
| *** jaosorior has joined #openstack-ceilometer | 09:41 | |
| *** deepthi has quit IRC | 09:50 | |
| *** ddieterly has joined #openstack-ceilometer | 09:55 | |
| *** ddieterly has quit IRC | 09:59 | |
| _nadya_ | sileht, cdent: hi folks, it's stuck a bit, could you please take a look https://review.openstack.org/#/c/199504/ . All your comments are fixed | 10:02 |
| *** claudiub has joined #openstack-ceilometer | 10:03 | |
| sileht | _nadya_, done | 10:03 |
| _nadya_ | sileht: thanks! | 10:03 |
| * sileht thought that was merged :p | 10:04 | |
| * cdent looks | 10:05 | |
| cdent | it is now | 10:06 |
| cdent | (well, soon) | 10:06 |
| *** afazekas has joined #openstack-ceilometer | 10:10 | |
| *** liusheng has quit IRC | 10:13 | |
| *** liusheng has joined #openstack-ceilometer | 10:13 | |
| openstackgerrit | Merged openstack/aodh: Make GnocchiThreshold evaluator derived from ThresholdEvaluator https://review.openstack.org/199504 | 10:14 |
| openstackgerrit | Merged openstack/aodh: Refactor alarm scenario tests (TestAlarmsBase) https://review.openstack.org/201416 | 10:20 |
| cdent | _nadya_, sileht: can you guys push this, it will help with all the ceilo+gnocchi exploring going on this week: https://review.openstack.org/#/c/202245/ | 10:28 |
| cdent | thanks | 10:31 |
| cdent | sileht: this one too: https://review.openstack.org/#/c/202259/ | 10:34 |
| *** afazekas has quit IRC | 10:35 | |
| cdent | and this one: https://review.openstack.org/#/c/202191/ | 10:35 |
| sileht | cdent, have you seen this one: https://bugs.launchpad.net/gnocchi/+bug/1472546 | 10:36 |
| openstack | Launchpad bug 1472546 in Gnocchi "devstack: GNOCCHI_USE_MOD_WSGI no longer work by default" [Undecided,New] | 10:36 |
| cdent | huh, I haven't had the problem, I wonder what I've done differently | 10:37 |
| sileht | cdent, I wonder what is the plan of infra to have everything on port 80 | 10:38 |
| sileht | cdent, about logging in general | 10:38 |
| sileht | because one virtual host can only have on accesslog and one errorlog | 10:39 |
| cdent | you mean how will people find their stuff in those logs? Presumably by the prefix in the request URL? | 10:40 |
| * cdent doesn't know | 10:40 | |
| sileht | cdent, devstack prepare a screen with one log per tab | 10:40 |
| cdent | you mean the tail_log stuff? | 10:40 |
| sileht | yep | 10:41 |
| sileht | cdent, with one virtual host nothing seems exists in devstack to split the only log created with everything inside | 10:41 |
| cdent | tail log could presumably take an argument which is the prefix name (which is supposed to be the keystone endpoint) and do a grep during the tail | 10:42 |
| cdent | It's not something I've put anything though into, I never run my devstack's with screen, is far too much overhead and noise | 10:42 |
| *** exploreshaifali has joined #openstack-ceilometer | 10:43 | |
| cdent | that's probably why I didn't see that bug you've linked above | 10:43 |
| sileht | it's not only for screen, gate generates logs with tail_log too | 10:43 |
| cdent | why "generate logs" when they are already there? | 10:44 |
| cdent | I mean, at the end just copy the original log | 10:44 |
| sileht | sure | 10:45 |
| sileht | I just think devstack in not ready yet to run in that mode (everything on port 80) in gate | 10:46 |
| cdent | that's probably true, and it's fine: the gate expectation is that all settings should be made explicitly and no defaults used | 10:46 |
| cdent | so if we need to make our gate settings more explicit, we should do that | 10:47 |
| *** afazekas has joined #openstack-ceilometer | 10:48 | |
| cdent | sileht: anyway, the reason for setting the wsgi stuff to default to /metric etc and non-port now, for individuals doing testing, is so that the issues that switching to it in real life will be revealed more quickly\ | 10:53 |
| cdent | it's already shown a fair few assumptions | 10:53 |
| cdent | s/few/few bad/ | 10:53 |
| *** ddieterly has joined #openstack-ceilometer | 10:55 | |
| openstackgerrit | Chris Dent proposed openstack/gnocchi: Tail the correct apache log files in devstack https://review.openstack.org/202498 | 10:59 |
| *** ddieterly has quit IRC | 11:00 | |
| cdent | sileht: ^ | 11:00 |
| cdent | I'm testing it now (with USE_SCREEN true) | 11:00 |
| sileht | cdent, I would prefer the old behavior if GNOCCHI_SERVICE_PORT is set | 11:01 |
| sileht | cdent, and fallback to the catch in all case | 11:01 |
| cdent | that is the old behavior isn't it? | 11:01 |
| * sileht use often MOD_WSGI | 11:01 | |
| sileht | cdent, oh yes sorry, misreading | 11:02 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/ceilometer: Move gnocchi resources definition in yaml file https://review.openstack.org/202500 | 11:05 |
| *** cmyster has left #openstack-ceilometer | 11:07 | |
| openstackgerrit | Chris Dent proposed openstack/ceilometer: [WIP] Attempt to use grenade plugin with devstack plugin https://review.openstack.org/202203 | 11:12 |
| *** belmoreira has quit IRC | 11:15 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/ceilometer: Move gnocchi resources definition in yaml file https://review.openstack.org/202500 | 11:27 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/ceilometer: gnocchi: Remove useless resources patching https://review.openstack.org/202507 | 11:27 |
| *** _nadya_ has quit IRC | 11:31 | |
| *** cmyster has joined #openstack-ceilometer | 11:31 | |
| *** _nadya_ has joined #openstack-ceilometer | 11:32 | |
| *** _nadya_ has quit IRC | 11:36 | |
| openstackgerrit | Aleksey Ripinen proposed openstack/ceilometer: Batch recording metering data to gnocchi https://review.openstack.org/202511 | 11:38 |
| *** shardy_ has joined #openstack-ceilometer | 11:39 | |
| *** shardy has quit IRC | 11:39 | |
| *** belmoreira has joined #openstack-ceilometer | 11:40 | |
| openstackgerrit | Aleksey Ripinen proposed openstack/ceilometer: Batch recording metering data to gnocchi https://review.openstack.org/202511 | 11:41 |
| *** shardy_ has quit IRC | 11:44 | |
| *** shardy has joined #openstack-ceilometer | 11:45 | |
| *** thorst has joined #openstack-ceilometer | 11:47 | |
| openstackgerrit | Merged openstack/gnocchi: Use a settings file for the devstack plugin https://review.openstack.org/202191 | 11:50 |
| openstackgerrit | Merged openstack/gnocchi: Cleanup handling of metricd and its logs in devstack https://review.openstack.org/202259 | 11:51 |
| cdent | one more gnocchi+ceilometer+devstack related change: https://review.openstack.org/#/c/202192/ | 11:51 |
| *** Longgeek has quit IRC | 11:54 | |
| *** ddieterly has joined #openstack-ceilometer | 11:56 | |
| sileht | cdent, if the ceilometer plugin is enabled after the gnocchi one you can still have the issue | 11:57 |
| sileht | fg | 11:57 |
| sileht | oups | 11:57 |
| sileht | cdent, perhaps something to add to doc/source/install/development.rst | 11:58 |
| *** ddieterly has quit IRC | 12:01 | |
| *** Longgeek has joined #openstack-ceilometer | 12:05 | |
| *** prad has joined #openstack-ceilometer | 12:06 | |
| cdent | the collector problem sileht ? yeah, I'm not entirely sure what the real solution is | 12:11 |
| cdent | there's been some talk about ways to manage dependencies between plugins but it hasnt' been solved yet | 12:12 |
| sileht | cdent, just documentation I think for now | 12:12 |
| *** ddieterly has joined #openstack-ceilometer | 12:15 | |
| *** yatin has quit IRC | 12:20 | |
| *** gordc has joined #openstack-ceilometer | 12:24 | |
| *** pradk has joined #openstack-ceilometer | 12:27 | |
| *** yatin has joined #openstack-ceilometer | 12:29 | |
| gordc | jd__: you get a chance to read Angus' email about aodh+heat? | 12:32 |
| gordc | it seems we need to get a client out there for the split to work properly... not sure if we want to have ceilometer redirecting to aodh as another solution. | 12:33 |
| gordc | ildikov: cdent: ^^ you guys have opinion on best way to proceed? | 12:36 |
| gordc | http://lists.openstack.org/pipermail/openstack-dev/2015-July/069684.html | 12:37 |
| ildikov | by keeping the old code deprecated and having support in the client to hide the situation we kind of should be ok I guess | 12:37 |
| openstackgerrit | Merged openstack/gnocchi: Tail the correct apache log files in devstack https://review.openstack.org/202498 | 12:37 |
| cdent | gordc: this is kind of the same problem as "what do we do with ceilometerclient when gnocchi is turned on" | 12:38 |
| ildikov | cdent: what to do with the meters/samples part of the v2 API in general I would say | 12:39 |
| cdent | alarming is a bit easier to deal with because of the way endpoint handling works | 12:39 |
| gordc | cdent: true. | 12:39 |
| cdent | but it is still going to require some work | 12:39 |
| gordc | is the idea that we want to code ceilometerclient to point to the new services? | 12:40 |
| cdent | the frictionless thing to do is setup in-gate ceilo and aodh so they both occupy the same effective endpoint with two different wsgi apps | 12:40 |
| ildikov | does heat depend on the client only? | 12:40 |
| gordc | or have a hard break and tell them to use new aodhclient | 12:40 |
| ildikov | as much as I remember the discussion with julien on the thread, I think we ended up with the option to hide this change in the client | 12:40 |
| ildikov | will we have new aodh client? :) | 12:40 |
| gordc | ildikov: i would think so. unless we want ceilometerclient to be a super client which wraps all our sub libs | 12:41 |
| gordc | which i'm indifferent to... it seems that's the least amount of breakage. | 12:42 |
| ildikov | gordc: yeap, I know, I just didn't remember it from the roadmap, but I don't really sleep much these days so it might be a reason for my poor memory | 12:42 |
| gordc | cdent: does your suggestion still allow for same client to be used? | 12:43 |
| ildikov | ... and lazyness to check | 12:43 |
| gordc | ildikov: i don't think we discussed client much. | 12:43 |
| cdent | gordc: in theory, yes, but I wouldn't want to bet everything on it without more exploration | 12:43 |
| ildikov | gordc: I cannot remember too much discussion on it either | 12:44 |
| gordc | the reason i asked is because liusheng offered to help out on the ceilometer+aodh gaps. and he was sort of wondering where to start. | 12:44 |
| ildikov | gordc: is it decided whether we keep the old code for Liberty or not? | 12:45 |
| gordc | ildikov: the old code will sit as is for liberty | 12:45 |
| gordc | we will remove in M* | 12:45 |
| ildikov | gordc: ok, good, I wasn't 100% sure we finally decided it | 12:46 |
| gordc | ildikov: nope. that was one thing we definitely made decision on. | 12:46 |
| gordc | i need to look at client code to see if it's ok to just continue using ceilometerclient | 12:46 |
| ildikov | as for the gaps I think we need to figure out the client question first to see how to move on | 12:47 |
| gordc | i think that's the best solution for consumers | 12:47 |
| gordc | ildikov: agreed. | 12:47 |
| cdent | gordc: I think there's two ways to go on the client | 12:48 |
| ildikov | although I'm still concerned with the long enough deprecation period, but it's kinda my job in the group to be the worrying party | 12:48 |
| cdent | one is to leave it alone and assume the server side changes I suggested | 12:48 |
| *** shardy_ has joined #openstack-ceilometer | 12:48 | |
| cdent | the other is to make it aware of a new type of endpoint for anything to do with alarms | 12:48 |
| cdent | it ought to be possible to make that backward compatible: if able to find alarm endpoint then use it, otherwise use the old one... | 12:48 |
| cdent | etc | 12:48 |
| *** shardy has quit IRC | 12:49 | |
| * gordc looking | 12:49 | |
| gordc | cdent: i'm trying out your pollster patch. | 12:50 |
| gordc | good: it looks like it's drop cpu usage from compute agent | 12:51 |
| *** yatin has quit IRC | 12:51 | |
| gordc | side-effect: notification agent is consuming a massive amount of memory now | 12:51 |
| cdent | yeah, that's kind of expected | 12:51 |
| cdent | because now it has to have caches for everything and everyone | 12:51 |
| cdent | which is why you had to write that new spec | 12:52 |
| cdent | does the old compute-agent (without my changes) consume lots of memory in an allinone situation? | 12:52 |
| cdent | I haven't had a chance to actively play with it because gnocchi | 12:53 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/ceilometer: Move gnocchi resources definition in yaml file https://review.openstack.org/202500 | 12:53 |
| ildikov | cdent: I was also thinking about that backward compatible version for the client as falling back to the old one, but it only makes sene if we keep the old one for a while maybe | 12:53 |
| *** shardy_ has quit IRC | 12:53 | |
| cdent | ildikov: what we do wasn't really the concern I was worried about there | 12:53 |
| cdent | more about the same client being pointed at different clouds | 12:53 |
| cdent | some clouds will be old | 12:53 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/ceilometer: Move gnocchi resources definition in yaml file https://review.openstack.org/202500 | 12:53 |
| gordc | cdent: not really. the cpu usage would spike a lot more during polling cycle but i can't remember it ever jumping much in memory | 12:53 |
| cdent | then maybe we are just tickling a bug in the notification agent that was lying latent | 12:54 |
| *** shardy has joined #openstack-ceilometer | 12:54 | |
| ildikov | cdent: yeap, right, I had that option in mind too, so agreed | 12:54 |
| cdent | because in an a single node situation nothing should really have changed | 12:54 |
| gordc | cdent: i have notification using GB of memory right now | 12:54 |
| cdent | ossum | 12:55 |
| gordc | weird thing is, that collector is consuming just as much memory | 12:55 |
| cdent | hmmm | 12:55 |
| cdent | you sure something else isn't going on? | 12:55 |
| gordc | so it might be an oslo.messaging thing? i don't think anything happens on collecot | 12:55 |
| cdent | Opportunities | 12:56 |
| cdent | ™ | 12:56 |
| *** jruano has joined #openstack-ceilometer | 12:56 | |
| gordc | sileht: ^^ | 12:56 |
| sileht | gordc, I known that nova can create a payload of many megabytes | 12:57 |
| *** _nadya_ has joined #openstack-ceilometer | 12:57 | |
| cdent | gordc: I'm on a long slide into despair on finding and fixing little tiny problems in ceilo+gnocchi+devstack, once I rise out of that I can git the pollster thing a closer look but it might be days | 12:57 |
| gordc | sileht: so just for reference, i'm using oslo.messagin with harlowja patch to fix ack issue. | 12:57 |
| cdent | gordc: MAYBE WE SHOULD SWITCH BACK TO SINGLE SAMPLE PER NOTIFICATION :) | 12:57 |
| gordc | sileht: i'm polling every 10s | 12:57 |
| cdent | sexy | 12:58 |
| gordc | on 8VM. | 12:58 |
| sileht | gordc, yep I have added unit tests in its patch | 12:58 |
| sileht | gordc, me too | 12:58 |
| *** thorst has quit IRC | 12:58 | |
| gordc | cdent: did you performance test? | 12:59 |
| gordc | cdent: i will hear none of it, if you didn't. | 12:59 |
| cdent | no, I'm letting you performance test | 13:00 |
| gordc | performance test == watch top/htop manually like a chimp for a few minutes. | 13:00 |
| cdent | and clearly memory performacne is crap | 13:00 |
| gordc | cdent: just for reference, i did the same thing with existing master and collector will increase just the same. | 13:01 |
| cdent | that sound like a bug we could find | 13:01 |
| cdent | but the pollster does _not_ grow? | 13:01 |
| cdent | (on master) | 13:02 |
| gordc | cdent: not that i noticed... that said, i didn't test master that long... not recently | 13:03 |
| cdent | we have so much to do | 13:03 |
| cdent | however | 13:03 |
| cdent | all of this discovery is great | 13:03 |
| cdent | i love it when a plan comes together | 13:03 |
| *** ddieterly has quit IRC | 13:03 | |
| cdent | does "collector gets freaking huge" count as a bug? | 13:04 |
| gordc | sure why not | 13:04 |
| cdent | ossum | 13:04 |
| *** thorst has joined #openstack-ceilometer | 13:04 | |
| gordc | cdent: are you actually creating that? i have a copy of top for my env | 13:06 |
| cdent | I'm not, I was passively aggressively prompting you to do so | 13:06 |
| gordc | kk | 13:07 |
| gordc | i'm going to run master for 12hrs and see if it's any different | 13:07 |
| *** pauldix has joined #openstack-ceilometer | 13:09 | |
| *** edmondsw has joined #openstack-ceilometer | 13:28 | |
| *** primechuck has joined #openstack-ceilometer | 13:28 | |
| cdent | gordc: how much ram does your machine have? | 13:31 |
| cdent | (the one on which you are seeing the potential memory leak) | 13:31 |
| gordc | current one. 32GB | 13:31 |
| cdent | oh hey, I'm getting it too, 21.9g | 13:32 |
| cdent | (this is with gnocchi paired in as well) | 13:33 |
| cdent | gordc: have you restarted your rabbit lately? | 13:33 |
| gordc | ... 21g on one service or all? | 13:33 |
| gordc | cdent: | 13:33 |
| gordc | cdent: nope | 13:33 |
| cdent | one service! | 13:33 |
| cdent | that's just the collector | 13:33 |
| gordc | ... how much memory do you have!??!:?! | 13:33 |
| cdent | 32 | 13:34 |
| gordc | oh. | 13:34 |
| gordc | are you using one worker? | 13:34 |
| cdent | for the collector, yeah, at the moment | 13:34 |
| gordc | or just doing the math for me. | 13:34 |
| gordc | yikes. i know when i comparing mongo vs sql the mongo backend used less memory but way more cpu | 13:35 |
| gordc | right now i'm using sql as my backend when i have GBs of memory usage | 13:35 |
| cdent | the reason I asked about rabbit is because if it hasn't been cleared out since doing gnocchi-related stuff it might be causing issues | 13:35 |
| cdent | I'm not sure of devstack tidies rabbit up or not | 13:35 |
| gordc | what does gnoochi do that requires me to restart rabbit? | 13:36 |
| gordc | i haven't restarted since i tried to flood gnocchi with meters... it didn't work that well. | 13:36 |
| cdent | gnocchi causes vast amount of messages over the bus to the collector for the sake of the dispatcher and then sends some more after | 13:37 |
| gordc | but if the queue is empty it should be fine right? | 13:37 |
| cdent | and then if you haven't got the messaging patch in place they all get requeued | 13:37 |
| cdent | gordc: yeah, I think so | 13:37 |
| cdent | that was the real question: has your queue been confirmed as clean | 13:37 |
| gordc | ok, yeah i cleared all the queues.. i did a test where i queued a few thousand records across 3 queues. and let mongo, sql, and gnocchi try to store them | 13:38 |
| openstackgerrit | Chris Dent proposed openstack/ceilometer: Store and restore the xtrace option in devstack plugin https://review.openstack.org/202561 | 13:39 |
| gordc | mongo does really well | 13:39 |
| gordc | sql needs more than 2 workers. | 13:39 |
| openstackgerrit | Chris Dent proposed openstack/gnocchi: In devstack use our own install redis command https://review.openstack.org/202563 | 13:40 |
| gordc | gnocchi i'm pretty sure there's something wrong. i'm hoping it's the dispatcher | 13:40 |
| cdent | s/something/lots of things/ | 13:41 |
| cdent | but finding bugs is good | 13:41 |
| cdent | it means we get to fix thigns | 13:41 |
| sileht | gordc, do you use swift as backend ? | 13:41 |
| *** prad has quit IRC | 13:41 | |
| gordc | i don't know what the bug is unfortunately. didn't get time/know enough to debug. | 13:41 |
| gordc | sileht: yeah. i turned off ceilometermiddleware | 13:42 |
| gordc | sileht: i tried with file backend too | 13:42 |
| sileht | gordc, is it better with file ? | 13:42 |
| gordc | it was about the same (maybe a little better) | 13:42 |
| gordc | file is better. | 13:42 |
| * cdent starts a ceph run | 13:42 | |
| *** prad has joined #openstack-ceilometer | 13:42 | |
| sileht | gordc, I have increase the number of workers for swift: | 13:43 |
| sileht | [[post-config|${SWIFT_CONF_DIR}/proxy-server.conf]] | 13:43 |
| sileht | [DEFAULT] | 13:43 |
| sileht | workers = 40 | 13:43 |
| gordc | i said 'something wrong' because one time gnocchi+swift cleared a queue really really quick (near mongo speed) but i think it's because it just dropped all the messages. | 13:43 |
| gordc | sileht: what's the normal default? | 13:44 |
| sileht | one I guess | 13:44 |
| gordc | lol | 13:44 |
| sileht | one http connections at a time is a joke | 13:44 |
| gordc | i can try that change over the weekend. | 13:44 |
| gordc | sileht: yeah. i thought swift in devstack created a lot of workers. i'll try again and see if it improves. | 13:45 |
| gordc | sileht: is there a way to just use generic resource and not build resource specific ones? | 13:46 |
| gordc | or do i need to hack dispatcher. | 13:46 |
| sileht | gordc, hacking :) | 13:46 |
| *** jdandrea has joined #openstack-ceilometer | 13:46 | |
| gordc | sileht: kk. i'll try that if 40 workers don't work. | 13:46 |
| sileht | gordc, I'm currently review the workflow to reduce the number of patch for a resource | 13:47 |
| gordc | sileht: on gnocchi side or ceilometer? | 13:48 |
| sileht | gordc, ceilometer side | 13:48 |
| gordc | cool cool. | 13:48 |
| *** exploreshaifali has quit IRC | 13:48 | |
| gordc | just for reference, right now i'm sending 30-50 messages/second over 10s polling cycle. | 13:49 |
| sileht | but to be really efficient we need to put a maximun number of smaples into one message | 13:49 |
| cdent | there's a patch in progress for that | 13:49 |
| gordc | sileht: you mean batch them right? | 13:49 |
| cdent | https://review.openstack.org/#/c/202511/ | 13:49 |
| sileht | gordc, yes on sender side should be easier I guess | 13:49 |
| cdent | (btw, ceph fails to work with Error connecting to cluster: PermissionError, so I presumably have no idea what I'm doing, will skip ceph for now) | 13:50 |
| sileht | cdent, oh something like that but this patch afraid me | 13:50 |
| sileht | does record_batch_metering_data exists in the collector ? | 13:50 |
| cdent | yeah, I was commenting on the quality of the patch, just the existence thereof | 13:50 |
| sileht | I have missed something ? | 13:50 |
| cdent | s/was/wasn't/ | 13:51 |
| cdent | I've barely read it, just saw it flash by | 13:51 |
| gordc | sileht: it doesn't exist. | 13:51 |
| *** pradk has quit IRC | 13:52 | |
| sileht | the current method already batch by resource_id and counter_name, rewrite the whole workflow look wierd... | 13:52 |
| gordc | i don | 13:52 |
| gordc | i dont know where the batching is happening in that patch. iirc, we process it one at a time at the collector. | 13:52 |
| cdent | well, if we don't like that person's way, we probably ought to stop them sooner than later | 13:54 |
| gordc | there's this bp from a while ago: https://blueprints.launchpad.net/ceilometer/+spec/bulk-message-handling | 13:55 |
| gordc | cdent: you made me the bad guy | 13:57 |
| sileht | I comment | 13:57 |
| cdent | you know you wanted it | 13:57 |
| gordc | yeah | 13:57 |
| gordc | sileht: on the patch or bp? | 13:57 |
| sileht | gordc, on the patch | 13:57 |
| gordc | sileht: cool cool. | 13:58 |
| cdent | gordc, sileht: what fix do I need to o.messging | 14:01 |
| cdent | so that I'm not getting the REQUEUED related errors? | 14:02 |
| sileht | cdent, https://review.openstack.org/#/c/202202/ | 14:02 |
| cdent | thanks | 14:02 |
| sileht | cdent, don't look at it, just apply, otherwise you will stop doing python ;p | 14:02 |
| cdent | ha! | 14:02 |
| cdent | too late | 14:02 |
| *** Kennan has quit IRC | 14:02 | |
| *** Kennan has joined #openstack-ceilometer | 14:03 | |
| * cdent cries | 14:03 | |
| gordc | yeah. i already commented that it could be a one line change... but it is what it is.lol | 14:03 |
| *** rbak has joined #openstack-ceilometer | 14:06 | |
| cdent | so my collector is going to 5g within 30s | 14:08 |
| cdent | and growing by a gig about every 5 s | 14:08 |
| * cdent smells a bad loop | 14:09 | |
| *** claudiub has quit IRC | 14:15 | |
| cdent | it did that because as soon as it starts up all the noise on the message bus comes in all at once and we grow without bound | 14:16 |
| cdent | if we start the collector after a rabbit restart, then it ismoderably happy | 14:16 |
| cdent | sileht: if the eventlet executor is being used with get_notification_listener will that just continue to accept messages no matter how many it has going at once? | 14:19 |
| sileht | cdent, they are a limitation | 14:19 |
| gordc | cdent: i was going to say same thing before i got pulled aside | 14:19 |
| gordc | i grow about 100MB/10min | 14:20 |
| sileht | cdent, config: rpc_thread_pool_size=64 | 14:20 |
| gordc | this is with master+sql | 14:20 |
| sileht | so the collector process 64 messages per listener per collector | 14:20 |
| cdent | brb | 14:22 |
| gordc | sileht: so it'll grab 64messages, process each one individual (record_metering_data) and then go back and grab another 64? | 14:22 |
| sileht | gordc, this is a threads pool each message processing go to a thread | 14:22 |
| sileht | gordc, when a process finish the thread return to the pool | 14:23 |
| sileht | gordc, and an other can be processed | 14:23 |
| gordc | ah i see. | 14:23 |
| sileht | your should have ~ 64 messages per collector processed at the same times | 14:23 |
| gordc | sileht: kk that makes sense now. | 14:23 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/ceilometer: Move gnocchi resources definition in yaml file https://review.openstack.org/202500 | 14:23 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/ceilometer: gnocchi: reduce the number of patch to gnocchi API https://review.openstack.org/202589 | 14:23 |
| openstackgerrit | Aleksey Ripinen proposed openstack/ceilometer: Add complex query for statistic requests https://review.openstack.org/188333 | 14:26 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/ceilometer: gnocchi: reduce the number of patch to gnocchi API https://review.openstack.org/202589 | 14:26 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/ceilometer: Move gnocchi resources definition in yaml file https://review.openstack.org/202500 | 14:26 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/ceilometer: gnocchi: reduce the number of patch to gnocchi API https://review.openstack.org/202589 | 14:27 |
| sileht | gordc, cdent I have thought about using event to create/update resource but I unsure that will really works in pratice | 14:28 |
| sileht | I don't think we can have when the server_group of a heat stack is updated for example | 14:28 |
| cdent | yeah, it would be nice to be able to do but it is not clear if it is reliable | 14:29 |
| sileht | (without updating the instance resource of each notifications, because in this case we have the same perf than the current workflow) | 14:29 |
| cdent | s/reliable/universal/ | 14:29 |
| gordc | sileht: yeah i think that relates back to building compute metadata from event. | 14:29 |
| gordc | sileht: the reason i asked about just using generic resource was to see how much the patching affected performance. | 14:30 |
| gordc | just personally, i think it'd be good to remove all the metadata stuff from gnocchi. but that makes gnocchi sort of reliate on events in ceilometer. | 14:31 |
| gordc | cdent: if we build events using your pollster-no-transform stuff. does that make it more reliable? | 14:32 |
| gordc | probably not for heat i guess since we don't poll that. | 14:32 |
| sileht | gordc, but for heat and autoscaling, we need to aggregates measures of all instances in same server_group | 14:32 |
| cdent | yeah, gordc, that's the exact problem | 14:32 |
| cdent | we dont' have control over the informaiton | 14:32 |
| gordc | cdent: yeah. or the order we process it (assuming race) | 14:33 |
| sileht | gordc, the problem is that we have nowhere an id to identify a autoscaling group, just a name in instance user_metadata | 14:34 |
| gordc | sileht: is that an issue for ceilometer or heat? | 14:35 |
| sileht | for ceilometer | 14:36 |
| gordc | how do we (properly) track something that doesn't have an id? | 14:36 |
| sileht | gordc, remove the word 'properly' and that works :p | 14:37 |
| gordc | :) i'm not sure that's how it works | 14:37 |
| *** shardy_ has joined #openstack-ceilometer | 14:38 | |
| sileht | gordc, we don't track it, we track metrics of an instance and heat creates alarms triggered on an aggregation on multiple instances (by filtering with metadata) | 14:38 |
| sileht | that why metadata exists in gnocchi | 14:38 |
| *** shardy has quit IRC | 14:39 | |
| sileht | about your memory usage issue, this is something that occurs with oslo.msg 1.16.X too ? | 14:40 |
| cdent | sileht: I haven't had a chance to try yet | 14:42 |
| gordc | sileht: yeah. i guess my idea was that it'd need to do metadata filtering from event side... but there's a lot of work to synchronise the ids from meter and event db. | 14:42 |
| gordc | i didn't start looking at memory until 1.17.x | 14:42 |
| cdent | from what i can tell it only happens when a whole huge pile of stuff is in the queue | 14:43 |
| cdent | which is not super easy to set up unless there's that bug in place | 14:43 |
| gordc | i'll try with 1.16 | 14:43 |
| *** shardy_ has quit IRC | 14:43 | |
| sileht | cdent, removes the gnocchi/swift filter it will fill the queue quickly ;) | 14:44 |
| *** shardy has joined #openstack-ceilometer | 14:44 | |
| gordc | cdent: it can happen if you're doing upgrade but leaving pollsters up to continue meter collection? | 14:44 |
| gordc | sileht: :) you'll be in thousands within seconds. | 14:44 |
| cdent | that seems like a likely scenario, gordc | 14:45 |
| cdent | as long as you are polling fast | 14:45 |
| gordc | cdent: yeah... in my env i'm doing 10s and even if i start fresh, memory will increase... so i think it's pretty much just based on how consistently you're processing data. | 14:46 |
| gordc | i will try with 1.16 after meeting | 14:47 |
| * gordc switches polling to 600s. will see if it affects collector memory over meeting | 14:55 | |
| *** eglynn has joined #openstack-ceilometer | 14:55 | |
| *** _nadya_ has quit IRC | 14:55 | |
| *** _nadya_ has joined #openstack-ceilometer | 14:55 | |
| *** Longgeek has quit IRC | 14:58 | |
| *** _nadya_ has quit IRC | 14:59 | |
| *** Longgeek has joined #openstack-ceilometer | 15:00 | |
| *** _nadya_ has joined #openstack-ceilometer | 15:06 | |
| *** Longgeek has quit IRC | 15:07 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/ceilometer: gnocchi: reduce the number of patch to gnocchi API https://review.openstack.org/202589 | 15:13 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/ceilometer: Move gnocchi resources definition in yaml file https://review.openstack.org/202500 | 15:13 |
| *** belmoreira has quit IRC | 15:13 | |
| *** afazekas has quit IRC | 15:20 | |
| cdent | seen this yet sileht? I'm getting it now too, went to report the bug and found it was already there but brand new: https://bugs.launchpad.net/gnocchi/+bug/1475329 | 15:22 |
| openstack | Launchpad bug 1475329 in Gnocchi "Exception in gnocchi-metricd: ValueError: cannot reindex from a duplicate axis" [Undecided,New] | 15:22 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/aodh: api: Add location alarm creation https://review.openstack.org/202427 | 15:23 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/aodh: Add devstack support https://review.openstack.org/200467 | 15:23 |
| sileht | cdent, that looks bad | 15:24 |
| cdent | yeah, once it is there, the datastore is hosed | 15:24 |
| cdent | you can still get measures out, at least for some metrics | 15:25 |
| cdent | but stuff won't go in | 15:25 |
| *** rjaiswal has joined #openstack-ceilometer | 15:28 | |
| *** ig0r_ has quit IRC | 15:40 | |
| *** _nadya_ has quit IRC | 15:45 | |
| *** shardy_ has joined #openstack-ceilometer | 15:45 | |
| *** _nadya_ has joined #openstack-ceilometer | 15:45 | |
| *** vishwanathj has joined #openstack-ceilometer | 15:45 | |
| *** shardy has quit IRC | 15:46 | |
| *** vishwana_ has quit IRC | 15:47 | |
| *** _nadya_ has quit IRC | 15:50 | |
| *** shardy_ has quit IRC | 15:50 | |
| *** shardy has joined #openstack-ceilometer | 15:51 | |
| gordc | cdent: collector still increasing with 600s polling | 15:56 |
| gordc | about 15mb in an hour | 15:56 |
| sileht | gordc, for the record I have started this one day https://review.openstack.org/#/c/202666/ to allow configure pools on sender side, and provide the delivery assurance for all pools, not only the default 'notifications' one | 15:56 |
| gordc | sileht: cool cool. we need to replicate you so you can do more work. :) | 15:57 |
| sileht | gordc, unsure doing more unfinished work help a lot ;) | 15:58 |
| openstackgerrit | Ilya Tyaptin proposed openstack/gnocchi: InfluxDB storage driver https://review.openstack.org/165407 | 15:58 |
| *** ddaskal has joined #openstack-ceilometer | 15:59 | |
| *** ccrouch has left #openstack-ceilometer | 16:03 | |
| gordc | lol | 16:04 |
| openstackgerrit | Merged openstack/ceilometer: Set conf.gnocchi_dispatcher.url explicitly in tests https://review.openstack.org/202245 | 16:06 |
| cdent | gordc: if you could report your discoveries with that memory stuff somewhere, that would be handy, I may be back later, but gotta scoot now | 16:08 |
| * cdent waves | 16:08 | |
| *** cdent has quit IRC | 16:08 | |
| *** thorst has quit IRC | 16:18 | |
| *** edmondsw has quit IRC | 16:26 | |
| *** _cjones_ has joined #openstack-ceilometer | 16:30 | |
| *** ankita_wagh has joined #openstack-ceilometer | 16:33 | |
| *** rwsu has quit IRC | 16:44 | |
| *** safchain has quit IRC | 16:49 | |
| *** thorst has joined #openstack-ceilometer | 16:52 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/ceilometer: Updated from global requirements https://review.openstack.org/200659 | 16:59 |
| *** pasquier-s has quit IRC | 17:01 | |
| *** tuvenen has quit IRC | 17:03 | |
| *** ildikov has quit IRC | 17:05 | |
| gordc | nothing exciting at meeting. just unveiled roadmap and directing resources to ceilometer+aodh and ceilometer+gnocchi work | 17:06 |
| gordc | prad^ | 17:06 |
| *** pasquier-s has joined #openstack-ceilometer | 17:08 | |
| *** tuvenen has joined #openstack-ceilometer | 17:11 | |
| *** lexholden has joined #openstack-ceilometer | 17:12 | |
| *** tuvenen has quit IRC | 17:15 | |
| *** pasquier-s has quit IRC | 17:15 | |
| *** pasquier-s_ has joined #openstack-ceilometer | 17:22 | |
| *** tuvenen has joined #openstack-ceilometer | 17:23 | |
| gordc | prad: regarding https://review.openstack.org/#/c/197633 do you know when you'll have subsequent patches? | 17:24 |
| prad | gordc, working on them as we speak actually.. should have them out probably tonight/tomorrow | 17:31 |
| gordc | prad: cool cool. i have a comment but not critical. | 17:32 |
| prad | gordc, deprecating the code/tests is taking time | 17:32 |
| prad | gordc, i'll have multiple ones after this | 17:32 |
| gordc | prad: "rm <filepath>" | 17:33 |
| prad | gordc, cool, i'll address them in the subsequent ones if its not critical | 17:33 |
| gordc | just burn it all. | 17:33 |
| *** exploreshaifali has joined #openstack-ceilometer | 17:34 | |
| gordc | prad: are you working on volume plugin support next or deprecating? wondering if there's a split somehwere to make things faster. | 17:35 |
| prad | gordc, hehe, yea the instance ones are a bit tricky | 17:35 |
| prad | gordc, was thinking of deprecating whats already converted as next | 17:35 |
| gordc | tbh, i don't think the tests are doing naything. just verifying the processor works against some madeup notification. | 17:35 |
| prad | gordc, then we'll be done with one round and i can look into the plugin support | 17:35 |
| prad | gordc, yea i'm more excited about deprecating the handlers themselves | 17:36 |
| prad | gordc, tests i'll just nuke em | 17:36 |
| gordc | prad: ok. let me know if you run into issues. trying to make sure we have as much functionality in for liberty (all hopefully) | 17:36 |
| prad | gordc, and disabling them from the entrypoints etc | 17:36 |
| prad | gordc, yep will do | 17:37 |
| prad | gordc, if we can get the current one in, that gets us the main framework | 17:37 |
| prad | gordc, converting meters is just laborious | 17:38 |
| prad | gordc, and perhaps we can do that as we go and get as much done as possible for liberty | 17:38 |
| gordc | prad: or all. ;) | 17:38 |
| prad | gordc, we have enough time i think | 17:38 |
| gordc | prad: kk | 17:39 |
| gordc | prad: do you know how long jasonamyers is on holiday? | 17:39 |
| prad | gordc, donno, i was looking to ping him on the resource-metadata-caching to see where he was | 17:40 |
| gordc | yeah. i'll check by next week. that's one thing i really want to benchmark | 17:41 |
| gordc | or give us time to implement broader planb | 17:41 |
| prad | yea | 17:42 |
| *** yprokule has quit IRC | 17:43 | |
| *** htruta_ has joined #openstack-ceilometer | 17:46 | |
| openstackgerrit | Doug Hellmann proposed openstack/ceilometermiddleware: Drop use of 'oslo' namespace package https://review.openstack.org/202720 | 17:47 |
| *** edmondsw has joined #openstack-ceilometer | 17:49 | |
| *** edmondsw has quit IRC | 17:51 | |
| *** edmondsw has joined #openstack-ceilometer | 17:51 | |
| *** shardy_ has joined #openstack-ceilometer | 17:53 | |
| dhellmann | gordc: it would be great to get ^^ merged quickly this week so it doesn't hold up the oslo.messaging release | 17:53 |
| *** shardy has quit IRC | 17:54 | |
| gordc | dhellmann: +A'd :) | 17:54 |
| dhellmann | gordc: sweet, thanks | 17:54 |
| gordc | dhellmann: np | 17:54 |
| *** henriquetruta has joined #openstack-ceilometer | 17:57 | |
| *** henriquetruta has quit IRC | 17:58 | |
| *** shardy_ has quit IRC | 17:58 | |
| *** shardy has joined #openstack-ceilometer | 17:59 | |
| *** Kennan has quit IRC | 18:02 | |
| *** Kennan has joined #openstack-ceilometer | 18:03 | |
| *** Ala has quit IRC | 18:07 | |
| *** htruta_ has quit IRC | 18:18 | |
| *** Ephur has joined #openstack-ceilometer | 18:19 | |
| *** ildikov has joined #openstack-ceilometer | 18:22 | |
| *** promulo_ has joined #openstack-ceilometer | 18:30 | |
| *** yassine has quit IRC | 18:34 | |
| *** nsaje__ has joined #openstack-ceilometer | 18:42 | |
| *** nsaje_ has quit IRC | 18:43 | |
| *** lexholden has quit IRC | 18:44 | |
| *** jaosorior has quit IRC | 18:46 | |
| *** _nadya_ has joined #openstack-ceilometer | 18:46 | |
| *** lexholden has joined #openstack-ceilometer | 18:46 | |
| *** nsaje___ has joined #openstack-ceilometer | 18:48 | |
| *** lexholden has quit IRC | 18:48 | |
| *** _nadya_ has quit IRC | 18:50 | |
| *** nsaje__ has quit IRC | 18:51 | |
| *** nsaje____ has joined #openstack-ceilometer | 18:51 | |
| *** nsaje___ has quit IRC | 18:53 | |
| openstackgerrit | Merged openstack/ceilometermiddleware: Updated from global requirements https://review.openstack.org/201335 | 18:53 |
| *** _nadya_ has joined #openstack-ceilometer | 19:01 | |
| *** rbrooker has joined #openstack-ceilometer | 19:01 | |
| *** _nadya_ has quit IRC | 19:02 | |
| *** _nadya_ has joined #openstack-ceilometer | 19:02 | |
| *** htruta_ has joined #openstack-ceilometer | 19:04 | |
| openstackgerrit | Merged openstack/ceilometer: Declarative meters support https://review.openstack.org/197633 | 19:07 |
| ityaptin | gordc: Hi! Could you take a look into patch with elasticsearch ttl? https://review.openstack.org/#/c/200573/ | 19:10 |
| *** ankita_wagh has quit IRC | 19:13 | |
| *** ankita_wagh has joined #openstack-ceilometer | 19:15 | |
| *** belmoreira has joined #openstack-ceilometer | 19:18 | |
| *** htruta_ has quit IRC | 19:21 | |
| gordc | ityaptin: sure. i will try later today. trying to memory profile a bug currently. | 19:23 |
| ityaptin | gordc: With ceilometer-collector? | 19:24 |
| gordc | ityaptin: yeah | 19:25 |
| gordc | or it's somewhere in new oslo.messaging | 19:25 |
| gordc | when i use 1.16.0 it's fine. | 19:25 |
| gordc | 1.17.1, it'll explode. | 19:25 |
| ityaptin | gordc: Hmm, it look like oslo.messaging fault) | 19:32 |
| gordc | ityaptin: yep. just don't know what. something is being held. it's something obvious because it grows really really quickly | 19:33 |
| *** ankita_w_ has joined #openstack-ceilometer | 19:36 | |
| *** ankita_wagh has quit IRC | 19:36 | |
| ityaptin | gordc: i started nightly test with same scenario as described, but comment all dispatcher rpc in ceilometer collector. If mem doesn't grow up when ceilometer-collector is more guilty than we think :) | 19:40 |
| gordc | ityaptin: cool cool. let us know if you notice anything | 19:47 |
| *** harlowja has joined #openstack-ceilometer | 19:49 | |
| *** harlowja_ has quit IRC | 19:49 | |
| *** harlowja has quit IRC | 19:52 | |
| *** harlowja has joined #openstack-ceilometer | 19:53 | |
| *** _nadya_ has quit IRC | 19:57 | |
| *** _nadya_ has joined #openstack-ceilometer | 19:57 | |
| *** lexholden has joined #openstack-ceilometer | 20:01 | |
| *** _nadya_ has quit IRC | 20:02 | |
| *** exploreshaifali has quit IRC | 20:04 | |
| *** belmoreira has quit IRC | 20:11 | |
| prad | gordc, so when we deprecate the old ones, we need to move the cfg opts for exchange control somewhere .. i was thinking i'll just add them to the meter notification handler itself. Is there a better place? | 20:13 |
| gordc | prad: if you have meter handler enabled it'll be loaded anyways | 20:17 |
| gordc | right now it just tries to load same target over and over again which is why i added a check | 20:18 |
| prad | gordc, but we need to add the cfg opts for each exchange? otherwise oslo_config will give a no such option | 20:18 |
| gordc | ah the options. | 20:19 |
| gordc | yeah, just add them to meter or notification agent. | 20:19 |
| prad | yea | 20:19 |
| gordc | i think it's better at notification agent | 20:19 |
| gordc | we shouldn't really be defining targets in meters tbh. | 20:19 |
| *** pauldix has quit IRC | 20:22 | |
| openstackgerrit | Rohit Jaiswal proposed openstack/ceilometer: Handles dns.domain.exists event in Ceilometer https://review.openstack.org/202772 | 20:26 |
| *** Ephur has quit IRC | 20:27 | |
| openstackgerrit | Rohit Jaiswal proposed openstack/ceilometer: Handles dns.domain.exists event in Ceilometer https://review.openstack.org/202772 | 20:33 |
| openstackgerrit | Rohit Jaiswal proposed openstack/ceilometer: Fixes querying alarm history with severity field https://review.openstack.org/200238 | 20:37 |
| *** lexholden has quit IRC | 21:07 | |
| *** rjaiswal has quit IRC | 21:14 | |
| *** gordc has quit IRC | 21:33 | |
| *** boris-42 has joined #openstack-ceilometer | 21:42 | |
| *** gordc has joined #openstack-ceilometer | 21:42 | |
| *** edmondsw has quit IRC | 21:45 | |
| *** shardy has quit IRC | 22:00 | |
| *** jruano has quit IRC | 22:04 | |
| *** jruano has joined #openstack-ceilometer | 22:08 | |
| *** ddaskal has quit IRC | 22:10 | |
| *** primechuck has quit IRC | 22:13 | |
| *** primechuck has joined #openstack-ceilometer | 22:15 | |
| *** primechuck has quit IRC | 22:16 | |
| *** thorst has quit IRC | 22:21 | |
| *** gordc has quit IRC | 22:26 | |
| *** ankita_wagh has joined #openstack-ceilometer | 22:30 | |
| *** ankita_w_ has quit IRC | 22:34 | |
| *** cing has joined #openstack-ceilometer | 22:35 | |
| *** thorst has joined #openstack-ceilometer | 22:54 | |
| *** thorst has quit IRC | 22:56 | |
| *** _nadya_ has joined #openstack-ceilometer | 22:58 | |
| *** _nadya_ has quit IRC | 23:02 | |
| *** rbak has quit IRC | 23:02 | |
| *** Beetnik has quit IRC | 23:10 | |
| *** Beetnik has joined #openstack-ceilometer | 23:13 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/ceilometer: Updated from global requirements https://review.openstack.org/200659 | 23:14 |
| *** zigo has quit IRC | 23:21 | |
| *** ankita_wagh has quit IRC | 23:21 | |
| *** ankita_wagh has joined #openstack-ceilometer | 23:22 | |
| *** zigo has joined #openstack-ceilometer | 23:22 | |
| *** cing has quit IRC | 23:23 | |
| *** lexholden has joined #openstack-ceilometer | 23:29 | |
| *** openstackstatus has joined #openstack-ceilometer | 23:33 | |
| *** ChanServ sets mode: +v openstackstatus | 23:33 | |
| *** ddieterly has joined #openstack-ceilometer | 23:40 | |
| *** barra204 has joined #openstack-ceilometer | 23:54 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!