*** ankita_wagh has quit IRC | 00:15 | |
*** vishwanathj has quit IRC | 00:16 | |
*** jwcroppe has quit IRC | 00:52 | |
*** jwcroppe has joined #openstack-ceilometer | 00:52 | |
*** jwcroppe has quit IRC | 00:57 | |
*** boris-42 has quit IRC | 00:58 | |
*** mstyne has quit IRC | 00:59 | |
*** tasdomas has quit IRC | 00:59 | |
*** boris-42 has joined #openstack-ceilometer | 01:00 | |
*** mstyne has joined #openstack-ceilometer | 01:02 | |
*** tasdomas has joined #openstack-ceilometer | 01:04 | |
*** liusheng has joined #openstack-ceilometer | 01:09 | |
openstackgerrit | liusheng proposed openstack/aodh: Use the Serializer from oslo.messaging https://review.openstack.org/211922 | 01:09 |
---|---|---|
*** slogan621 has joined #openstack-ceilometer | 01:11 | |
*** drjones has quit IRC | 01:11 | |
*** rjaiswal has joined #openstack-ceilometer | 01:16 | |
*** thorst has joined #openstack-ceilometer | 01:34 | |
*** jwcroppe has joined #openstack-ceilometer | 01:34 | |
*** thorst has quit IRC | 01:55 | |
*** rohit has joined #openstack-ceilometer | 02:06 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/ceilometer: Updated from global requirements https://review.openstack.org/212244 | 02:10 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/ceilometermiddleware: Updated from global requirements https://review.openstack.org/212245 | 02:10 |
openstackgerrit | liusheng proposed openstack/aodh: Introduce Guru Meditation Reports into Aodh https://review.openstack.org/212263 | 02:15 |
openstackgerrit | liusheng proposed openstack/aodh: Introduce Guru Meditation Reports into Aodh https://review.openstack.org/212263 | 02:16 |
openstackgerrit | gordon chung proposed openstack/ceilometer: do not translate debug logs https://review.openstack.org/212287 | 02:44 |
*** jwcroppe has quit IRC | 02:50 | |
*** jwcroppe has joined #openstack-ceilometer | 02:51 | |
*** jwcroppe has quit IRC | 02:55 | |
*** ankita_wagh has joined #openstack-ceilometer | 02:55 | |
*** rjaiswal has quit IRC | 03:20 | |
*** ankita_wagh has quit IRC | 03:37 | |
*** rbak has joined #openstack-ceilometer | 03:48 | |
*** rbak has quit IRC | 03:49 | |
*** rohit has quit IRC | 04:10 | |
*** fawadkhaliq has joined #openstack-ceilometer | 04:32 | |
*** Ephur has quit IRC | 04:36 | |
*** fawadkhaliq has quit IRC | 04:39 | |
*** fawadkhaliq has joined #openstack-ceilometer | 04:39 | |
*** fawadkhaliq has quit IRC | 04:57 | |
*** yprokule has joined #openstack-ceilometer | 04:57 | |
*** fawadkhaliq has joined #openstack-ceilometer | 05:06 | |
*** hhuang has joined #openstack-ceilometer | 05:36 | |
*** hhuang has quit IRC | 05:38 | |
*** hhuang has joined #openstack-ceilometer | 05:39 | |
*** ildikov has quit IRC | 05:42 | |
*** nadya has quit IRC | 05:44 | |
*** nadya has joined #openstack-ceilometer | 05:58 | |
*** nadya has quit IRC | 06:12 | |
*** ildikov has joined #openstack-ceilometer | 06:31 | |
openstackgerrit | liusheng proposed openstack/aodh: Avoid translating debug log https://review.openstack.org/212370 | 06:32 |
openstackgerrit | liusheng proposed openstack/aodh: Avoid translating debug log https://review.openstack.org/212370 | 06:39 |
*** afazekas has joined #openstack-ceilometer | 06:40 | |
*** nadya has joined #openstack-ceilometer | 06:44 | |
*** cdent has joined #openstack-ceilometer | 07:22 | |
*** therve has quit IRC | 07:25 | |
*** therve has joined #openstack-ceilometer | 07:25 | |
*** changbl has quit IRC | 07:41 | |
*** openstackgerrit has quit IRC | 07:41 | |
*** tobias- has quit IRC | 07:41 | |
*** csd has quit IRC | 07:41 | |
*** changbl has joined #openstack-ceilometer | 07:42 | |
*** openstackgerrit has joined #openstack-ceilometer | 07:42 | |
*** tobias- has joined #openstack-ceilometer | 07:42 | |
*** csd has joined #openstack-ceilometer | 07:42 | |
*** csd has quit IRC | 07:45 | |
*** openstackgerrit has quit IRC | 07:45 | |
*** changbl has quit IRC | 07:46 | |
*** tobias- has quit IRC | 07:46 | |
*** tobias- has joined #openstack-ceilometer | 07:48 | |
*** csd has joined #openstack-ceilometer | 07:52 | |
*** openstackgerrit has joined #openstack-ceilometer | 08:00 | |
*** changbl has joined #openstack-ceilometer | 08:00 | |
*** yassine has joined #openstack-ceilometer | 08:04 | |
openstackgerrit | Merged openstack/gnocchi: sqlalchemy: use DBReferenceError to generate the correct exception https://review.openstack.org/211069 | 08:12 |
openstackgerrit | Merged openstack/gnocchi: indexer: remove wrong FK catch https://review.openstack.org/211070 | 08:12 |
*** Kennan has quit IRC | 08:14 | |
*** Kennan has joined #openstack-ceilometer | 08:21 | |
openstackgerrit | liusheng proposed openstack/aodh: Introduce Guru Meditation Reports into Aodh https://review.openstack.org/212263 | 08:26 |
openstackgerrit | Nadya Shakhat proposed openstack/ceilometer: Make it possible to run postgresql functional job https://review.openstack.org/211651 | 08:33 |
*** ankita_wagh has joined #openstack-ceilometer | 08:42 | |
*** rodrigods has quit IRC | 09:13 | |
*** rodrigods has joined #openstack-ceilometer | 09:13 | |
*** jwcroppe has joined #openstack-ceilometer | 09:28 | |
openstackgerrit | Merged openstack/ceilometer: remove alembic requirement https://review.openstack.org/212179 | 09:30 |
*** ankita_wagh has quit IRC | 09:41 | |
*** exploreshaifali has joined #openstack-ceilometer | 09:46 | |
openstackgerrit | Merged openstack/ceilometer: support multiple-meter payloads https://review.openstack.org/210512 | 09:47 |
openstackgerrit | Merged openstack/ceilometer: Convert instance, bandwidth and SwiftMiddleware meters https://review.openstack.org/209637 | 09:47 |
openstackgerrit | Merged openstack/ceilometer: start rpc deprecation https://review.openstack.org/211304 | 09:48 |
cdent | jd__: gnocchi indexer structure question for you if you're about | 09:53 |
jd__ | cdent: shoot | 09:53 |
cdent | I'm rerunning my tests from that document I pointed you at, with just one metricd process and I noticed something that seems funny in the metric table: | 09:54 |
cdent | after a few minutes of the 5163 rocs in the metric table only 442 have a resource_id that is not NULL | 09:54 |
cdent | is that expected? What are all these disassociated metric entries? | 09:54 |
cdent | s/rocs/rows/ | 09:55 |
cdent | (BTW, though a bit slower, it's fine with just one metricd process) | 09:55 |
openstackgerrit | Nadya Shakhat proposed openstack/ceilometer: Make it possible to run postgresql functional job https://review.openstack.org/211651 | 09:57 |
*** boris-42 has quit IRC | 10:00 | |
cdent | jd__: may have been a disk space failure, will rerun | 10:00 |
jd__ | cdent: oh cool :) | 10:03 |
jd__ | cdent: are you using MySQL? | 10:03 |
openstackgerrit | Chris Dent proposed openstack/aodh: Use generic keystone uri in devstack config https://review.openstack.org/212446 | 10:04 |
cdent | however even if it s diskspace faiure it still seems a strange error to have happen | 10:04 |
cdent | yeah, only because it reflects the defaults | 10:04 |
jd__ | well so it's not that strange | 10:04 |
jd__ | that's another good reason we recommend PostgreSQL | 10:04 |
jd__ | :) | 10:04 |
cdent | feh | 10:04 |
cdent | I agree the postgres is better, but even so | 10:04 |
cdent | not the sort of behavior we want to countenance really | 10:05 |
jd__ | that's not something that could happen with PG on a disk full | 10:05 |
jd__ | I mean we can't do anything about that in Gnocchi if it's really a problem with the RDBMS | 10:05 |
jd__ | unless we have a bug of course | 10:05 |
cdent | I'll run it again and see | 10:06 |
cdent | tmfd | 10:10 |
jd__ | :) | 10:14 |
cdent | s/drama/devstack | 10:15 |
jd__ | haha | 10:20 |
cdent | okay jd, fresh database, disk space available, within seconds of booting ten instances: | 10:22 |
cdent | metric count is 2503 | 10:23 |
cdent | null metric count is 2181 | 10:23 |
cdent | null meanning "no associated resource_id" | 10:23 |
cdent | jd__: ^ | 10:23 |
cdent | will now switch to postgres | 10:23 |
jd__ | ok, I need to check how the dispatcher work | 10:23 |
cdent | I tried to figure that out earlier in the week and went a bit crazy | 10:24 |
jd__ | cdent: if you stop and wait for the collector to finish,you still have orphaned metrics? | 10:24 |
cdent | lemme see | 10:24 |
jd__ | glancing at the dispatcher code I'm not sure it works correctly if resource_id is None – which should not happen but we never know | 10:28 |
jd__ | but that could be a theory of why you have orphaned metrics | 10:28 |
cdent | the collector and metricd are all caught up now and the counts are: 2833 total, 2391 no resource_id | 10:28 |
cdent | 13 rows in the resource table | 10:29 |
openstackgerrit | Chris Dent proposed openstack/ceilometer: Remove version from os_auth_url in service_credentials https://review.openstack.org/212456 | 10:34 |
cdent | jd__: this makes the aodh functional jobs voting, if you feel like we're ready for such things: https://review.openstack.org/212459 | 10:37 |
jd__ | cdent: what are the names of all those metrics? 13 resources and 2800 metrics? | 10:38 |
jd__ | I think the dispatcher is on a spree | 10:38 |
cdent | no names either | 10:38 |
jd__ | you have gnocchi-api logs that shows all those POST? | 10:38 |
cdent | should do, looking | 10:39 |
cdent | hmm | 10:41 |
cdent | I've got 7749 POST /metric/v1/resource/instance with a 400 response | 10:42 |
cdent | the collector has this: http://paste.openstack.org/show/412855/ | 10:43 |
cdent | (lots of that) | 10:43 |
cdent | so that clarifies things a bit | 10:43 |
cdent | on the dispatcher side we're still sending metrics for resources with ids we can't store | 10:44 |
cdent | I'm guessing? | 10:44 |
cdent | this is something about the dispatcher logic that I think is backwards: it makes a resource after it first does some meters | 10:45 |
cdent | this strikes me as backwards | 10:45 |
cdent | if we're never going to store the resource we should drop the measures on the floor | 10:45 |
* cdent coffees up | 10:45 | |
jd__ | cdent: that smells that indeed | 10:46 |
jd__ | but we're supposed to store all the resource | 10:47 |
jd__ | STORE ALL THE RESOURCES | 10:47 |
jd__ | that'd make a sticker | 10:47 |
EmilienM | "just don't use mongodb" | 10:47 |
EmilienM | that could also be a sticker | 10:47 |
jd__ | so yeah it's a bug in the dispatcher as I expected | 10:47 |
cdent | are we supposed to store all the resources? what do we do about id translation? | 10:50 |
cdent | EmilienM++ | 10:50 |
cdent | unfortunately no mongodb involved here | 10:51 |
cdent | but yeah, it is dire | 10:51 |
EmilienM | good to know | 10:51 |
cdent | liusheng: in the bug you just reported is there a step missing: "wait for a polling cycle to pass"? | 10:53 |
cdent | or something like that? I can't quite figure out what you're saying | 10:53 |
*** exploreshaifali has quit IRC | 11:00 | |
jd__ | cdent: we are supposed to store all the resources but they should have an UUID as an id | 11:03 |
jd__ | cdent: I think some such as the NIC of instance have no UUID but something weird | 11:03 |
cdent | there are _tons_ of notifcations, polling info, etc that have resource_id set to something pretty far off from uuid | 11:03 |
cdent | heat stacks, for example | 11:03 |
cdent | IIRC | 11:03 |
openstackgerrit | Merged openstack/aodh: Use the Serializer from oslo.messaging https://review.openstack.org/211922 | 11:05 |
*** eglynn has quit IRC | 11:15 | |
*** dikonoor has joined #openstack-ceilometer | 11:30 | |
*** dikonoo has joined #openstack-ceilometer | 11:30 | |
*** dikonoor has quit IRC | 11:33 | |
*** thorst has joined #openstack-ceilometer | 11:35 | |
*** annasort has quit IRC | 11:42 | |
*** ajc_ has joined #openstack-ceilometer | 11:43 | |
*** ajc_ has quit IRC | 11:43 | |
dikonoo | idegtiarov: Hi | 11:48 |
openstackgerrit | gordon chung proposed openstack/ceilometer: add test to validate jsonpath https://review.openstack.org/211314 | 11:48 |
openstackgerrit | Merged openstack/ceilometer: do not translate debug logs https://review.openstack.org/212287 | 11:49 |
dikonoo | idegtiarov: This is about your comment in https://review.openstack.org/#/c/211494/. Do you know if the current behaviour (that lets only admin acess events) documented somewhere ? IF yes, could you point me to it | 11:49 |
dikonoo | idegtiarov : If the current behavior is not documented, should the change ine behavior be documented. I had discussed this with gordc and he was of the opinion that it isn't required as the existing behavior isn't documented | 11:50 |
cdent | jd__: where did that earlier conversation go? do we need to make a bug or something? | 12:00 |
jd__ | cdent: I'd make a bug against Ceilometer because it's a problem with the dispatcher doing wrong thing if the resource_id is rejected | 12:01 |
jd__ | cdent: if you're willing to test I can try to make a patch I guess | 12:01 |
openstackgerrit | Julien Danjou proposed openstack/ceilometer: polling: remove deprecated agents https://review.openstack.org/212498 | 12:01 |
cdent | jd__: okay, will make bug, trying to capture the sitch | 12:02 |
openstackgerrit | Divya K Konoor proposed openstack/ceilometer: Add user_id,project_id traits to audit events https://review.openstack.org/211509 | 12:06 |
openstackgerrit | gordon chung proposed openstack/ceilometer: add mandatory limit value to complex query list https://review.openstack.org/199180 | 12:11 |
*** gordc has joined #openstack-ceilometer | 12:13 | |
*** liusheng has quit IRC | 12:15 | |
*** liusheng has joined #openstack-ceilometer | 12:15 | |
liusheng | cdent: Hi, no, I have set the polling interval to 20s | 12:17 |
liusheng | cdent: it cannot works | 12:17 |
liusheng | cdent: sorry, I was AFK just now | 12:21 |
*** liusheng_ has joined #openstack-ceilometer | 12:29 | |
*** liusheng has quit IRC | 12:30 | |
*** annasort has joined #openstack-ceilometer | 12:30 | |
*** annasort_ has joined #openstack-ceilometer | 12:31 | |
cdent | gordc: you already approved this once before, but I updated the config to remove a depends-on, can you go ahead and reapprove | 12:33 |
cdent | that will get us one step closer on the grenade plugin front: https://review.openstack.org/#/c/196441/ | 12:33 |
*** annasort has quit IRC | 12:35 | |
*** annasort_ is now known as annasort | 12:35 | |
gordc | cdent: tests | 12:35 |
gordc | not tests but testing* irc | 12:36 |
gordc | nm. gerrit works now | 12:36 |
cdent | gordc you never making any sense to me any more, I think we need counselling | 12:36 |
gordc | was checking if my internet crapped out or just gerrit | 12:36 |
cdent | when the opportunity presents itself to blame gerrit, blame gerrit | 12:37 |
gordc | i'm not willing to work on it. i say no counseling! | 12:37 |
gordc | now bring me a beer! | 12:37 |
cdent | this relationship is so over | 12:37 |
gordc | 50-50 rule exists in uk? | 12:38 |
gordc | you can take half my suit. i'll take half your home by the beach. | 12:38 |
dikonoo | gordc: hi | 12:40 |
gordc | cdent: will this break your grenade? https://review.openstack.org/#/c/212498/1 | 12:40 |
dikonoo | gordc: this is about https://review.openstack.org/#/c/211494/ | 12:40 |
gordc | dikonoo: morning | 12:40 |
gordc | dikonoo: sure. i have 10 mins before i drive to work... think it can be done? | 12:40 |
cdent | gordc why would it? | 12:41 |
dikonoo | gordc: yeah.. first on the documentation comments I have been getting..Of course you didn't comment on that ..but does it have a doc impact or not | 12:41 |
cdent | oh i see, that commit message is bad | 12:41 |
gordc | cdent: it drops the old compute/central agent | 12:41 |
dikonoo | gordc: Also, do you know where I can find the documentation if I have to change it | 12:41 |
cdent | yes, it will, i'll comment | 12:41 |
dikonoo | gordc: second, on https://github.com/openstack/ceilometer/blob/master/ceilometer/tests/functional/api/v2/test_event_scenarios.py | 12:42 |
gordc | dikonoo: um... i'm not sure we have a place which explicitly says admin is required... but you should add DocImpact to your commit message and someone will follow up on it | 12:42 |
dikonoo | gordc: ok.. | 12:43 |
dikonoo | gordc: can you point me to a sample | 12:43 |
gordc | DocImpact? | 12:43 |
gordc | dikonoo: https://review.openstack.org/#/c/196827/ | 12:44 |
gordc | just add "DocImpact" | 12:44 |
dikonoo | dikonoor: Ah..ok..Thanks.. | 12:45 |
gordc | it will auto create a bug in openstack-manuals | 12:45 |
dikonoo | gordc: on the test cases, I don't think /test_event_scenarios.py understands RBAC ..For eg. I tried changing the existing header at https://github.com/openstack/ceilometer/blob/master/ceilometer/tests/functional/api/v2/test_event_scenarios.py#L26 to non-admin hoping that will break the existing testcases | 12:47 |
dikonoo | gordc: The existing /events allow only admins..So when the X-Role in the header is not admin, the testcase should break..but it always passes | 12:47 |
gordc | dikonoo: uh... well that sucks. | 12:49 |
dikonoo | gordc: The configuration of the underlying pecan.test make_app initialization sets the policy_file to /etc/ceilometer/policy.json . I tried overiding it with new file, adding new rules..different permutation & combinations but it always passes..the tests never break | 12:49 |
gordc | i can try looking at it later today. | 12:49 |
gordc | dikonoo: sorry, i need to step out right now. i'll be back in a bit. feel free to email me or mailing list if you need to drop | 12:50 |
dikonoo | gordc: yeah..that will be great.. Thanks..Please leave me a note somewhere in the review if you don;t see me around | 12:51 |
*** gordc has quit IRC | 12:51 | |
*** fawadkhaliq has quit IRC | 12:52 | |
cdent | jd__: I updated my lame vaguebug to be more associated with the thing we talked about this morning (orphaned measures and bad resource ids): https://bugs.launchpad.net/ceilometer/+bug/1483634 | 12:54 |
openstack | Launchpad bug 1483634 in Ceilometer "gnocchi dispatcher still sending far too many resource updates" [High,Triaged] - Assigned to Chris Dent (chdent) | 12:54 |
cdent | aodh functional test just went gaiting | 12:55 |
cdent | lets see if goes boom! | 12:55 |
jd__ | cdent: ok cool I'll try to cook a patch :) | 12:59 |
*** openstackgerrit has quit IRC | 13:01 | |
*** openstackgerrit has joined #openstack-ceilometer | 13:01 | |
*** jasonamyers has joined #openstack-ceilometer | 13:03 | |
*** liusheng_ has quit IRC | 13:04 | |
*** edmondsw has joined #openstack-ceilometer | 13:05 | |
*** cmyster has joined #openstack-ceilometer | 13:06 | |
*** cmyster has joined #openstack-ceilometer | 13:06 | |
*** fawadkhaliq has joined #openstack-ceilometer | 13:13 | |
*** julim has quit IRC | 13:19 | |
*** cmyster has quit IRC | 13:26 | |
*** rjaiswal has joined #openstack-ceilometer | 13:30 | |
*** jwcroppe has quit IRC | 13:37 | |
*** jwcroppe has joined #openstack-ceilometer | 13:37 | |
*** prad_ has joined #openstack-ceilometer | 13:37 | |
*** gordc has joined #openstack-ceilometer | 13:41 | |
*** jwcroppe has quit IRC | 13:42 | |
nadya | cdent: hi! what do you think about it? https://review.openstack.org/#/c/212530/ | 13:43 |
nadya | cdent: I've realized that set DEVSTACK_GATE_POSTGRES in post_test_hook is too late | 13:43 |
nadya | cdent: it shouldn't break our functional-mongo job I believe | 13:44 |
cdent | nadya: looking | 13:45 |
*** julim has joined #openstack-ceilometer | 13:46 | |
cdent | I think that makes sense. the other option is to wait a few days for the devstack plugin to be active | 13:47 |
openstackgerrit | Divya K Konoor proposed openstack/ceilometer: Events RBAC needs scoped token https://review.openstack.org/212534 | 13:48 |
cdent | but that will probably still be a while | 13:48 |
*** jwcroppe has joined #openstack-ceilometer | 13:50 | |
*** exploreshaifali has joined #openstack-ceilometer | 13:50 | |
cdent | (this infra stuff is so confusing) | 13:50 |
cdent | nadya: have you been able to figure out what the GATE_POSTGRES thing actually does? | 13:52 |
cdent | (I haven't) | 13:52 |
nadya | cdent: as I understand it means smth like "install postgres when devstack is being deployed" | 13:53 |
cdent | that's what I've assumed too, but I've never been clear on where that's actually happening | 13:53 |
gordc | dikonoo: i'm going to try tests out now | 13:56 |
dikonoo | gordc:ok | 13:57 |
*** rbak has joined #openstack-ceilometer | 13:57 | |
*** thorst has quit IRC | 14:03 | |
*** afazekas has quit IRC | 14:03 | |
*** annasort has quit IRC | 14:03 | |
*** thorst has joined #openstack-ceilometer | 14:11 | |
openstackgerrit | Divya K Konoor proposed openstack/ceilometer: Add user_id,project_id traits to audit events https://review.openstack.org/211509 | 14:12 |
*** rbak has quit IRC | 14:13 | |
*** devlaps has quit IRC | 14:24 | |
*** rbak has joined #openstack-ceilometer | 14:25 | |
*** exploreshaifali has quit IRC | 14:25 | |
*** ocaner has joined #openstack-ceilometer | 14:28 | |
openstackgerrit | Divya K Konoor proposed openstack/ceilometer: Events RBAC needs scoped token https://review.openstack.org/212557 | 14:37 |
openstackgerrit | Divya K Konoor proposed openstack/ceilometer: Control Events RBAC from policy.json https://review.openstack.org/211494 | 14:44 |
*** dikonoo has quit IRC | 14:48 | |
openstackgerrit | Rohit Jaiswal proposed openstack/ceilometer: Adds support for dynamic event pipeline https://review.openstack.org/208068 | 14:54 |
*** eglynn has joined #openstack-ceilometer | 14:55 | |
openstackgerrit | Rohit Jaiswal proposed openstack/ceilometer: Fixed event requeuing/ack on publisher failure https://review.openstack.org/211779 | 14:55 |
gordc | eglynn: the clarification on alarm deprecation is from last week's meeting correct? | 14:57 |
eglynn | gordc: yep | 14:58 |
gordc | eglynn: cool cool | 14:58 |
eglynn | gordc: (I didn't add anything new to the agenda for today) | 14:58 |
gordc | eglynn: ok. just wanted to check in case it was re-add... was just me being lazy and not cleaning last week | 14:59 |
eglynn | cool :) | 14:59 |
*** Ephur has joined #openstack-ceilometer | 15:02 | |
gordc | for those interested... meeting is starting | 15:02 |
*** Ephur has quit IRC | 15:06 | |
*** thorst has quit IRC | 15:12 | |
openstackgerrit | Ryota MIBU proposed openstack/aodh: Storage: add 'exclude' constraint to get_alarms() https://review.openstack.org/210443 | 15:19 |
openstackgerrit | Chris Dent proposed openstack/ceilometer: integration: chown ceilometer directory properly https://review.openstack.org/212584 | 15:20 |
cdent | gordc, jd__: if that goes through the integration job should start working | 15:21 |
*** kfox1111 has left #openstack-ceilometer | 15:22 | |
*** hhuang has quit IRC | 15:23 | |
jd__ | cool | 15:23 |
*** haigang has joined #openstack-ceilometer | 15:24 | |
cdent | or at least get to the next break | 15:24 |
*** haigang has quit IRC | 15:24 | |
*** haigang has joined #openstack-ceilometer | 15:25 | |
*** vishwanathj has joined #openstack-ceilometer | 15:29 | |
nadya | gordc: please take a look after https://review.openstack.org/#/c/212530/ . I'm afraid of making changes in voting job but it looks rather safe | 15:30 |
openstackgerrit | Merged openstack/ceilometer: Updated from global requirements https://review.openstack.org/212244 | 15:33 |
openstackgerrit | Merged openstack/ceilometer: Remove version from os_auth_url in service_credentials https://review.openstack.org/212456 | 15:34 |
openstackgerrit | Merged openstack/ceilometer: Grenade plugin using devstack plugin for ceilometer https://review.openstack.org/196441 | 15:37 |
*** jwcroppe has quit IRC | 15:44 | |
*** jwcroppe has joined #openstack-ceilometer | 15:45 | |
openstackgerrit | Ryota MIBU proposed openstack/aodh: Refactor api tests (_update_alarm) https://review.openstack.org/212604 | 15:47 |
*** haigang has quit IRC | 15:49 | |
*** haigang has joined #openstack-ceilometer | 15:49 | |
*** thorst has joined #openstack-ceilometer | 15:56 | |
*** _cjones_ has joined #openstack-ceilometer | 15:59 | |
*** _cjones_ has quit IRC | 15:59 | |
*** _cjones_ has joined #openstack-ceilometer | 15:59 | |
openstackgerrit | Igor Degtiarov proposed openstack/ceilometer: Avoid from storing samples with empty or not numerical volumes https://review.openstack.org/212610 | 16:00 |
*** hhuang has joined #openstack-ceilometer | 16:01 | |
gordc | cdent: i have no idea what the danish reference is | 16:01 |
cdent | thaakns | 16:01 |
cdent | just looked danish to me | 16:01 |
gordc | i'm in americas... we do americas... | 16:01 |
* gordc steps out... giving a fun presentation on ceilometer | 16:02 | |
*** Ephur has joined #openstack-ceilometer | 16:02 | |
*** yassine has quit IRC | 16:04 | |
*** ocaner has quit IRC | 16:05 | |
*** edmondsw has quit IRC | 16:06 | |
gordc | hmm. jumped the gun by 30mins | 16:08 |
cdent | gordc: you're overwhelmed by all of this and plus your divorce from me. I think even if you aren't willing to do that therapy with me, you need to consider it for yourself | 16:10 |
cdent | or at least a visit to the spa | 16:10 |
gordc | hahahahah! i've been told spas are nice. | 16:10 |
*** alexpilotti_ has joined #openstack-ceilometer | 16:11 | |
*** haigang has quit IRC | 16:15 | |
*** hhuang has quit IRC | 16:18 | |
*** jasonamyers has quit IRC | 16:18 | |
*** alexpilotti_ is now known as alexpilotti | 16:19 | |
*** alexpilotti has quit IRC | 16:19 | |
*** alexpilotti has joined #openstack-ceilometer | 16:19 | |
*** alexpilotti has quit IRC | 16:19 | |
*** alejandrito has joined #openstack-ceilometer | 16:22 | |
nadya | lol | 16:24 |
openstackgerrit | gordon chung proposed openstack/ceilometer: fix event tests to use rbac properly https://review.openstack.org/212624 | 16:24 |
*** edmondsw has joined #openstack-ceilometer | 16:30 | |
*** openstackgerrit has quit IRC | 16:31 | |
*** openstackgerrit has joined #openstack-ceilometer | 16:31 | |
*** eglynn has quit IRC | 16:32 | |
*** exploreshaifali has joined #openstack-ceilometer | 16:35 | |
*** ildikov has quit IRC | 16:36 | |
*** ankita_wagh has joined #openstack-ceilometer | 16:36 | |
*** ankita_wagh has quit IRC | 16:37 | |
*** ankita_wagh has joined #openstack-ceilometer | 16:41 | |
*** nadya has quit IRC | 16:53 | |
*** yprokule has quit IRC | 17:03 | |
*** boris-42 has joined #openstack-ceilometer | 17:11 | |
*** vishwanathj has quit IRC | 17:15 | |
*** jasonamyers has joined #openstack-ceilometer | 17:22 | |
*** nijaba has joined #openstack-ceilometer | 17:36 | |
*** nijaba has quit IRC | 17:36 | |
*** nijaba has joined #openstack-ceilometer | 17:36 | |
*** nijaba_ has quit IRC | 17:36 | |
*** fawadkhaliq has quit IRC | 17:42 | |
*** nadya has joined #openstack-ceilometer | 17:42 | |
*** ankita_w_ has joined #openstack-ceilometer | 17:44 | |
*** ildikov has joined #openstack-ceilometer | 17:46 | |
*** Ephur_ has joined #openstack-ceilometer | 17:46 | |
*** ankita_wagh has quit IRC | 17:47 | |
*** srsakhamuri has quit IRC | 17:47 | |
*** Ephur has quit IRC | 17:48 | |
*** Ephur has joined #openstack-ceilometer | 17:50 | |
*** Ephur_ has quit IRC | 17:51 | |
openstackgerrit | gordon chung proposed openstack/ceilometer: fix event tests to use rbac properly https://review.openstack.org/212624 | 17:51 |
cdent | gordc: it was nice of you to +A that chown thing but the integration job is still not ready to fly | 17:55 |
cdent | there will need to be yet another followup patch: | 17:55 |
cdent | horizon is hogging apache making gnocchi too hard to find | 17:55 |
cdent | i'm looking into it now | 17:55 |
*** fawadkhaliq has joined #openstack-ceilometer | 17:56 | |
david-lyle | cdent: what do you mean by hogging? | 17:56 |
david-lyle | just curious | 17:56 |
gordc | cdent: should i remove +a? | 17:57 |
* gordc wonders if david-lyle has a script to track 'horizon' | 17:57 | |
david-lyle | indeed | 17:57 |
cdent | david-lyle: I've not got all the details yet, but if horizon is on port 80 with mod_wsgi and another service also wants to be on port 80 at a different path, horizon existing config gets in the way | 17:58 |
gordc | wow really? that's actually very efficient. | 17:58 |
david-lyle | gordc: my client handles it, so it's easy | 17:58 |
cdent | at some point in the past I made gnocchi default to running on port 80 with prefix in devstack | 17:58 |
cdent | but apparently all my testing was with horizon disabled | 17:58 |
david-lyle | cdent: ok that's why I asked, I have a patch that will interest you | 17:59 |
cdent | so now I'm trying to determine if it is possible to get horizon a bit more contained | 17:59 |
cdent | yay! | 17:59 |
david-lyle | https://review.openstack.org/#/c/206263/ | 17:59 |
david-lyle | it's blocked by a tempest change, but once that's the situation should be better | 17:59 |
*** fawadkhaliq has quit IRC | 18:00 | |
*** fawadkhaliq has joined #openstack-ceilometer | 18:00 | |
gordc | hmm... timing was oldly convenient | 18:00 |
gordc | oddly* | 18:00 |
david-lyle | we had a conflict with keystone too | 18:01 |
*** ankita_wagh has joined #openstack-ceilometer | 18:02 | |
david-lyle | sadly Horizon has been getting to this point for about 6 months | 18:02 |
cdent | that's just awesome | 18:02 |
cdent | thanks | 18:02 |
david-lyle | finally ready to land | 18:02 |
david-lyle | so, hopefully I saved you some time | 18:02 |
cdent | yes, very much so | 18:02 |
cdent | so yeah, gordc, when that lands it looks like the integration stuff will inch one step forward | 18:03 |
cdent | probably producing yet another bug to solve | 18:03 |
* david-lyle goes back to lurking | 18:03 | |
cdent | thanks for the quick whatever that was david-lyle | 18:03 |
cdent | very helpful | 18:03 |
gordc | cdent: so leave it +a? | 18:04 |
cdent | yeah, may as well | 18:04 |
*** ankita_w_ has quit IRC | 18:04 | |
cdent | we'll just fix whatever the next problem is when it comes along | 18:04 |
gordc | s/we/i/ | 18:05 |
rjaiswal | gordc: replied to your comment on https://review.openstack.org/#/c/211779/, please take a look | 18:06 |
*** ankita_w_ has joined #openstack-ceilometer | 18:06 | |
cdent | cheers thanks a lot gordc | 18:06 |
*** idegtiarov_ has joined #openstack-ceilometer | 18:08 | |
prad_ | gordc, are you looking into making the multi meter logic fit other optional cases? or should i? I think i'll need that for cpu as well. where type and unit are not part of the payload and staticly defined | 18:08 |
*** nadya has quit IRC | 18:08 | |
cdent | oh this reminds me | 18:09 |
prad_ | gordc, so basically instead of https://github.com/openstack/ceilometer/blob/master/ceilometer/meter/notifications.py#L216-L222 we might want to do that look up based on the fields in multi option? | 18:09 |
*** ankita_wagh has quit IRC | 18:09 | |
cdent | gordc: what prad is saying recalls a conversation I had with him earlier today where I was trying to push the idea that the declarative syntax should stay simple and the complex things ought to be left in code as signals that they are dirty and wrong and should be shunned back to the projects from whence they came | 18:09 |
gordc | rjaiswal: sure. sorry. been busy with a presentation. will get to it. | 18:10 |
rjaiswal | gordc: thanks | 18:10 |
prad_ | gordc, in cpu case i need that for colume and name, but set the type and unit based on whats statically defined in yaml | 18:10 |
gordc | prad_: yeah i think that was my plan | 18:10 |
gordc | cdent: i think that might be what is required. | 18:11 |
cdent | it should be that we are doing it because it is too hard to do it otherwise | 18:11 |
prad_ | yea there are some that are quite wacky to represent in yaml | 18:11 |
cdent | but because clean syntax in the yaml is the end goal | 18:11 |
gordc | cdent: that said, the multi meter stuff isn't actually dirty/wrong... it's just presents the data differently | 18:11 |
cdent | and being the yaml is cool | 18:11 |
cdent | so if your stuff can't go in the yaml you must be doing it completely wrong and should have a rethink | 18:12 |
prad_ | i think muti meter is fine | 18:12 |
* cdent shrugs | 18:12 | |
prad_ | what cdent might be referring to here is wacky match expressions like the ones in trove and dns | 18:12 |
cdent | mostly that, yes prad_ | 18:12 |
cdent | but generally speaking I think that the things producing the notifications should be held responsible for quality, not the other end | 18:13 |
gordc | prad_: s/match/math/? | 18:13 |
prad_ | match in this case.. the timeutils delta is a python expression rather than a pure math | 18:13 |
gordc | prad_: hmmm... it's definitely not straight forward... | 18:16 |
*** fawadkhaliq has quit IRC | 18:16 | |
gordc | i wonder if we should be supporting some sort of plugin mechanism like we have in events which can derive values | 18:16 |
gordc | the time delta shouldn't be difficult and seems like a useful use case. | 18:16 |
prad_ | it might be easier to just handle it as a python expression in yaml perhaps .. do a !!python/ . i also looked at pyparsing that works well for straight math expressions | 18:18 |
cdent | DON'T DESTROY THE SIMPLICITY | 18:18 |
cdent | it's okay for there to be both kinds of meters: the easy ones in yaml | 18:18 |
cdent | and the code ones | 18:18 |
prad_ | i agree, our motivation should be to make yaml look easy to use | 18:18 |
cdent | the code ones should just be python like they've always been | 18:19 |
prad_ | it would be nice to convert as much as possible to keep everything in one place .. but i agree if its just wacky to convert may be best to leave it or find an alternative like move it to a transformer or something | 18:20 |
gordc | https://github.com/openstack/ceilometer/blob/master/etc/ceilometer/event_definitions.yaml#L12-L16 simple enough no? a function call? | 18:20 |
gordc | the ipmi stuff can burn | 18:21 |
prad_ | yea | 18:21 |
gordc | but i feel like the delta stuff might be manageable...meh | 18:21 |
gordc | cdent: that patch you did for ipmi notifications does some crazy ass sh*t | 18:22 |
cdent | that's because the input was crazy | 18:22 |
cdent | but remind me, gotta link? | 18:22 |
gordc | cdent: yeah i saw the input | 18:23 |
gordc | and said f it | 18:23 |
gordc | i don't have patch... i don't think there's any way to fix it. | 18:23 |
cdent | that was back in the early days when I had no idea what I was doing and was getting a lot of pressure | 18:24 |
cdent | now I still have no idea what I'm doing and disregard the pressure | 18:24 |
gordc | lol nah, i saw the payload... it's craziness. | 18:25 |
gordc | i was going to go to ironic and ask why it was the way it was... but then decided to drive home. | 18:26 |
cdent | the long way | 18:28 |
gordc | gas is still expensive... the longer than normal way | 18:30 |
*** jasonamyers has quit IRC | 18:38 | |
*** jasonamy_ has joined #openstack-ceilometer | 18:38 | |
*** exploreshaifali has quit IRC | 18:49 | |
*** ankita_wagh has joined #openstack-ceilometer | 18:52 | |
*** ankita_w_ has quit IRC | 18:55 | |
*** jasonamyers has joined #openstack-ceilometer | 18:55 | |
*** jasonamyers has quit IRC | 18:59 | |
*** jasonamy_ has quit IRC | 18:59 | |
*** fawadkhaliq has joined #openstack-ceilometer | 19:01 | |
*** fawadkhaliq has quit IRC | 19:06 | |
*** exploreshaifali has joined #openstack-ceilometer | 19:12 | |
*** nadya has joined #openstack-ceilometer | 19:14 | |
*** cdent has quit IRC | 19:25 | |
*** kevinc_ has joined #openstack-ceilometer | 19:30 | |
*** nadya has quit IRC | 19:33 | |
*** alejandrito has quit IRC | 19:44 | |
openstackgerrit | Merged openstack/ceilometer: integration: chown ceilometer directory properly https://review.openstack.org/212584 | 20:07 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/ceilometer: Updated from global requirements https://review.openstack.org/212736 | 20:16 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/ceilometermiddleware: Updated from global requirements https://review.openstack.org/212245 | 20:16 |
gordc | prad_: hmm. we need away to customise metadata | 20:16 |
gordc | https://github.com/openstack/ceilometer/blob/master/ceilometer/telemetry/notifications.py#L62 | 20:17 |
prad_ | gordc, yea we could add attributes: with metadata we specifically want and filter out before passing sample generation | 20:18 |
prad_ | most cases we just store the whole payload from what i saw | 20:19 |
gordc | so should we add a new attr? | 20:20 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/python-ceilometerclient: Updated from global requirements https://review.openstack.org/210917 | 20:21 |
prad_ | gordc, we can keep it optional? and only look up if its defined if not we use the whole payload | 20:21 |
gordc | sure. want me to include that in my patch or you want to do it separately? | 20:22 |
gordc | i don't have a preference | 20:23 |
prad_ | do you need it right away? | 20:23 |
prad_ | i can add it tomorrow morning | 20:24 |
prad_ | or later tonight if i find time | 20:24 |
*** nadya has joined #openstack-ceilometer | 20:25 | |
gordc | not right away... just that i can't properly drop telemetry notification without it | 20:25 |
gordc | i'll work without it for now. | 20:26 |
gordc | and then rebase on whatever you have | 20:26 |
nadya | gate-ceilometer-dsvm-functional-postgresqlSUCCESS in 41m 02s :) I've almost managed with it | 20:27 |
* gordc does maths. | 20:27 | |
gordc | nadya: what time is it?lol | 20:27 |
nadya | :) time to sleep | 20:27 |
gordc | i have a random question for you tomorrow... why is it so slow in gate? | 20:27 |
gordc | but yay to postgres! | 20:28 |
*** nadya has quit IRC | 20:28 | |
*** alejandrito has joined #openstack-ceilometer | 20:28 | |
openstackgerrit | Pradeep Kilambi proposed openstack/ceilometer: Add support to compute cpu meters in yaml https://review.openstack.org/210619 | 20:35 |
prad_ | gordc, i modified the multi meter logic a little to get the above working for cpu meters | 20:36 |
prad_ | we still need to make it more extendable | 20:37 |
prad_ | gordc, i changed the yaml a bit as well https://review.openstack.org/#/c/210619/5/ceilometer/meter/data/meters.yaml | 20:39 |
gordc | what's separator? | 20:45 |
gordc | i don't think it's right. your meter definitions are acting on the same values but somehow giving different data/units | 20:47 |
*** fawadkhaliq has joined #openstack-ceilometer | 20:48 | |
prad_ | gordc, which part? | 20:51 |
prad_ | gordc, hmm i ran through the test_cpu.py | 20:52 |
*** julim has quit IRC | 20:52 | |
prad_ | gordc, so you're saying its not generating all the meters? | 20:53 |
gordc | prad_: no. it's generating too many | 20:55 |
gordc | https://github.com/openstack/ceilometer/blob/master/ceilometer/compute/notifications/cpu.py#L61-L62 | 20:55 |
gordc | it doesn't deal with the conditional. | 20:55 |
gordc | so both definitions will match all meters... and it'll build one set with unit=ns and another set with unit=% | 20:55 |
gordc | you need to make your jsonpath more restrictive. | 20:56 |
prad_ | ah i misread the original meters.. i thought there were two sets, what i did was intentional | 20:59 |
prad_ | gordc, good catch | 20:59 |
gordc | prad_: i'd tell you the jsonpath to check sibling values... but i don't know it without googling | 21:00 |
*** thorst has quit IRC | 21:14 | |
*** vishwanathj has joined #openstack-ceilometer | 21:17 | |
*** idegtiarov_ has quit IRC | 21:19 | |
*** slogan621 has quit IRC | 21:21 | |
gordc | hmmm... maybe we shouldn't be declaring the telemetry notifications | 21:22 |
gordc | if someone deletes/overrides it, everything goes to hell. | 21:23 |
gordc | prad_: ^ | 21:23 |
prad_ | gordc, well that could be said for others? maybe we put a note at the top saying: if you delete any of these meter you're screwed ? | 21:24 |
prad_ | gordc, is it getting too messy to convert? | 21:24 |
gordc | prad_: it's pretty straight forward... it's just that you need to map message_id, and source, and timestamp | 21:25 |
prad_ | i dont really see a way to check for siblings .. donno what Desendents are trying that | 21:25 |
gordc | these particular are something i don't think we should surface... it's internal to ceilometer... and if you delete one, you delete all polling/api post | 21:26 |
*** ankita_wagh has quit IRC | 21:26 | |
prad_ | yea i'm cool with leaving it .. i dont see much benefit to the user exposing telemetry ones anyway | 21:27 |
*** ankita_wagh has joined #openstack-ceilometer | 21:27 | |
gordc | i'll add support for mutliple everything... (minus message_id, source, timestamp)... but yeah i don't think we should expose it now that i think abou it. | 21:27 |
prad_ | what are they going to tweak there anyway | 21:27 |
prad_ | yea thats fine | 21:27 |
gordc | prad_: yeah, any check from user will explode something. | 21:27 |
gordc | s/check/tweak/ | 21:28 |
gordc | yeah i think the bigger problem is if they override meter.yaml they need to know to have it in their override version... and they won't. | 21:29 |
gordc | let's leave it! | 21:29 |
prad_ | ok | 21:31 |
*** ankita_wagh has quit IRC | 21:31 | |
kevinc_ | It appears that ceilometer polls swift and glance on a regular interval for object and image usage (storage.object.size and image.size). However volume.size seems to be based on events. Is there any way for ceilometer to poll cinder on a regular basis to collect usage? | 21:37 |
gordc | kevinc_: i believe cinder generates metrics periodically. | 21:38 |
gordc | let me check | 21:38 |
kevinc_ | gordc: Thanks! being able to get volume usage stats it the last piece of the puzzle that I need to be able to bill users | 21:39 |
*** alejandrito has quit IRC | 21:41 | |
*** ankita_wagh has joined #openstack-ceilometer | 21:42 | |
gordc | kevinc_: http://docs.openstack.org/admin-guide-cloud/content/section_telemetry-cinder-audit-script.html | 21:43 |
gordc | i'm not sure if this is what you were looking for. | 21:43 |
*** ankita_wagh has quit IRC | 21:43 | |
prad_ | gordc, the thing with unit lookup is, its defined statically in yaml, its not part of the message.. so there is nothing to look for, we'll have to do it outside of jsonparse | 21:43 |
*** ankita_wagh has joined #openstack-ceilometer | 21:43 | |
gordc | kevinc_: if that doesn't give you the info you need, we'll need to patch either ceilometer or cinder. not sure if it'll happen this late in development cycle | 21:45 |
gordc | prad_: hmmm.. i think you might be able to... it should be fine to define static value in jsonpath. | 21:46 |
gordc | i need to think about it... after i write this multi everything code | 21:46 |
kevinc_ | gordc: Thank you! I will take a look at that. Basically we want to get stats so we can charge users by the GB/hour for their cinder volume usage | 21:47 |
gordc | kevinc_: that should work but feel free to raise a bug if not | 21:47 |
prad_ | i dont see a way to do as part of the tree look up but we could just pass the static unit as part of the name path perhaps .. i'll poke around | 21:48 |
gordc | prad_: kk, i'll let you know if i find something | 21:48 |
kevinc_ | gordc: Thank you! I think that will do what I need. It looks like the admin has the cron job configured incorrectly. | 21:53 |
gordc | kevinc_: cool cool. | 21:54 |
*** alexpilotti has joined #openstack-ceilometer | 22:04 | |
*** exploreshaifali has quit IRC | 22:09 | |
openstackgerrit | gordon chung proposed openstack/ceilometer: full multi-meter support https://review.openstack.org/212815 | 22:19 |
*** gordc has quit IRC | 22:25 | |
*** rbak_ has joined #openstack-ceilometer | 22:31 | |
*** rbak has quit IRC | 22:32 | |
*** julim has joined #openstack-ceilometer | 22:32 | |
*** edmondsw has quit IRC | 22:48 | |
*** alexpilotti has quit IRC | 22:49 | |
*** rbak_ has quit IRC | 22:58 | |
*** prad_ has quit IRC | 23:08 | |
*** jwcroppe has quit IRC | 23:42 | |
*** jwcroppe has joined #openstack-ceilometer | 23:43 | |
*** jwcroppe has quit IRC | 23:43 | |
*** thorst has joined #openstack-ceilometer | 23:43 | |
*** jwcroppe has joined #openstack-ceilometer | 23:43 | |
*** julim has quit IRC | 23:47 | |
*** jwcroppe has quit IRC | 23:48 | |
*** fawadkhaliq has quit IRC | 23:50 | |
*** julim has joined #openstack-ceilometer | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!