*** raymondr has quit IRC | 00:02 | |
*** fnaval has joined #openstack-ceilometer | 00:15 | |
*** _cjones_ has quit IRC | 00:18 | |
*** _cjones_ has joined #openstack-ceilometer | 00:18 | |
*** ildikov_ has quit IRC | 00:18 | |
*** matsuhashi has joined #openstack-ceilometer | 00:27 | |
*** EmilienM has quit IRC | 00:30 | |
*** ondergetekende has quit IRC | 00:30 | |
*** ondergetekende has joined #openstack-ceilometer | 00:31 | |
*** nati_uen_ has joined #openstack-ceilometer | 00:31 | |
*** gordc has joined #openstack-ceilometer | 00:32 | |
*** nati_ueno has quit IRC | 00:34 | |
*** EmilienM has joined #openstack-ceilometer | 00:35 | |
*** _nadya_ has joined #openstack-ceilometer | 00:40 | |
*** _nadya_ has quit IRC | 00:44 | |
*** nati_uen_ has quit IRC | 00:50 | |
*** nati_ueno has joined #openstack-ceilometer | 00:50 | |
*** julim has quit IRC | 00:56 | |
*** matsuhashi has quit IRC | 01:11 | |
*** matsuhashi has joined #openstack-ceilometer | 01:14 | |
*** matsuhashi has quit IRC | 01:31 | |
*** matsuhashi has joined #openstack-ceilometer | 01:31 | |
*** fnaval has quit IRC | 01:32 | |
*** matsuhashi has quit IRC | 01:32 | |
*** fnaval has joined #openstack-ceilometer | 01:32 | |
*** matsuhashi has joined #openstack-ceilometer | 01:35 | |
*** gordc has quit IRC | 01:39 | |
*** gordc has joined #openstack-ceilometer | 01:41 | |
openstackgerrit | Jenkins proposed a change to openstack/ceilometer: Updated from global requirements https://review.openstack.org/77639 | 01:46 |
---|---|---|
*** nosnos has joined #openstack-ceilometer | 01:46 | |
openstackgerrit | Marc Solanas proposed a change to openstack/python-ceilometerclient: Checking the type of auth_token, and fixing it if necessary https://review.openstack.org/58051 | 01:49 |
*** gordc has quit IRC | 01:50 | |
*** _cjones__ has joined #openstack-ceilometer | 01:54 | |
*** _cjones_ has quit IRC | 01:56 | |
*** _cjones__ has quit IRC | 01:58 | |
*** mengxd has joined #openstack-ceilometer | 02:12 | |
*** xianghui has joined #openstack-ceilometer | 02:15 | |
*** fnaval has quit IRC | 02:15 | |
*** fnaval has joined #openstack-ceilometer | 02:16 | |
*** xianghui has quit IRC | 02:16 | |
*** xianghui has joined #openstack-ceilometer | 02:17 | |
*** _xianghui has joined #openstack-ceilometer | 02:17 | |
*** _xianghui has quit IRC | 02:17 | |
*** flwang has quit IRC | 02:23 | |
*** matsuhashi has quit IRC | 02:45 | |
*** matsuhashi has joined #openstack-ceilometer | 02:45 | |
*** matsuhashi has quit IRC | 02:46 | |
*** matsuhashi has joined #openstack-ceilometer | 02:46 | |
*** matsuhashi has quit IRC | 02:47 | |
*** matsuhashi has joined #openstack-ceilometer | 02:47 | |
*** matsuhashi has quit IRC | 02:48 | |
*** matsuhashi has joined #openstack-ceilometer | 02:49 | |
*** matsuhashi has quit IRC | 02:49 | |
*** matsuhashi has joined #openstack-ceilometer | 02:50 | |
*** terriyu has quit IRC | 02:50 | |
*** flwang has joined #openstack-ceilometer | 03:00 | |
*** nati_ueno has quit IRC | 03:21 | |
*** ryanpetrello has quit IRC | 03:27 | |
*** changbl has quit IRC | 03:33 | |
*** matsuhashi has quit IRC | 03:49 | |
*** Akshik has joined #openstack-ceilometer | 03:57 | |
*** gordc has joined #openstack-ceilometer | 04:19 | |
*** piyushmasrani has joined #openstack-ceilometer | 04:38 | |
*** matsuhashi has joined #openstack-ceilometer | 04:47 | |
*** ashestakov_ has joined #openstack-ceilometer | 04:47 | |
*** ashestakov_ has quit IRC | 04:51 | |
*** xianghui has quit IRC | 05:00 | |
*** xianghui has joined #openstack-ceilometer | 05:17 | |
*** anamalagon has joined #openstack-ceilometer | 05:19 | |
*** anamalagon_ has quit IRC | 05:21 | |
openstackgerrit | Jenkins proposed a change to openstack/ceilometer: Imported Translations from Transifex https://review.openstack.org/76762 | 06:03 |
*** nati_ueno has joined #openstack-ceilometer | 06:24 | |
*** _nadya_ has joined #openstack-ceilometer | 06:27 | |
*** _nadya_ has quit IRC | 06:37 | |
*** terriyu has joined #openstack-ceilometer | 06:46 | |
*** Akshik has left #openstack-ceilometer | 06:58 | |
*** ashestakov_ has joined #openstack-ceilometer | 07:01 | |
openstackgerrit | Shuangtai Tian proposed a change to openstack/ceilometer: Don't change list to tuple when get infomation from libvirt https://review.openstack.org/80192 | 07:03 |
*** ashestakov_ has quit IRC | 07:05 | |
*** ildikov_ has joined #openstack-ceilometer | 07:18 | |
openstackgerrit | Piyush Masrani proposed a change to openstack/ceilometer: Documenting hypervisor support for nova meters https://review.openstack.org/79910 | 07:18 |
*** stzilli has joined #openstack-ceilometer | 07:22 | |
*** inc0 has joined #openstack-ceilometer | 07:27 | |
*** matsuhashi has quit IRC | 07:32 | |
*** matsuhashi has joined #openstack-ceilometer | 07:32 | |
*** nosnos has quit IRC | 07:32 | |
*** nosnos_ has joined #openstack-ceilometer | 07:32 | |
*** tobi1 has joined #openstack-ceilometer | 07:37 | |
openstackgerrit | liusheng proposed a change to openstack/python-ceilometerclient: Deprecate 'alarm-update' https://review.openstack.org/80199 | 07:44 |
*** tobi1 has quit IRC | 07:58 | |
*** julienvey has joined #openstack-ceilometer | 08:05 | |
*** saju_m has joined #openstack-ceilometer | 08:12 | |
*** fnaval has quit IRC | 08:29 | |
*** nacim has joined #openstack-ceilometer | 08:44 | |
*** matsuhashi has quit IRC | 09:07 | |
*** nosnos has joined #openstack-ceilometer | 09:11 | |
*** nosnos_ has quit IRC | 09:11 | |
*** matsuhashi has joined #openstack-ceilometer | 09:12 | |
*** ashestakov_ has joined #openstack-ceilometer | 09:18 | |
*** ashestakov_ has quit IRC | 09:21 | |
*** nati_ueno has quit IRC | 09:21 | |
*** flwang has quit IRC | 09:22 | |
*** yassine has joined #openstack-ceilometer | 09:27 | |
*** yassine has quit IRC | 09:28 | |
*** yassine has joined #openstack-ceilometer | 09:28 | |
*** eglynn has joined #openstack-ceilometer | 09:31 | |
anamalagon | hi eglynn! | 09:41 |
openstackgerrit | Mehdi Abaakouk proposed a change to openstack/ceilometer: Permit usage of notifications for metering https://review.openstack.org/80225 | 09:43 |
openstackgerrit | Mehdi Abaakouk proposed a change to openstack/ceilometer: Eventlet monkeypatch must be done before anything https://review.openstack.org/79628 | 09:43 |
openstackgerrit | Mehdi Abaakouk proposed a change to openstack/ceilometer: Consume notif. from multiple message bus https://review.openstack.org/77612 | 09:43 |
openstackgerrit | Mehdi Abaakouk proposed a change to openstack/ceilometer: Use NotificationPlugin as an oslo.msg endpoint https://review.openstack.org/77611 | 09:43 |
openstackgerrit | Mehdi Abaakouk proposed a change to openstack/ceilometer: Use oslo.msg retry API in rpc publisher https://review.openstack.org/77845 | 09:43 |
openstackgerrit | Mehdi Abaakouk proposed a change to openstack/ceilometer: Sync latest sslutils from oslo-incubator https://review.openstack.org/78132 | 09:43 |
openstackgerrit | Mehdi Abaakouk proposed a change to openstack/ceilometer: Replace oslo.rpc by oslo.messaging https://review.openstack.org/57457 | 09:43 |
eglynn | anamalagon: hey | 09:44 |
*** matsuhashi has quit IRC | 09:44 | |
eglynn | anamalagon: ... apols, I was a bit nit-picky on https://review.openstack.org/79679 | 09:45 |
eglynn | anamalagon: ... feel free to apply your own judgement to any of the suggested changes to the commit msg | 09:45 |
*** sayalilunkad has joined #openstack-ceilometer | 09:46 | |
anamalagon | eglynn: ha no! It's good - the changes helped me understand better what was going on | 09:46 |
sileht | dhellmann, I have stole your bug about notification publisher (instead of RPC cast) https://bugs.launchpad.net/ceilometer/+bug/1005933 | 09:46 |
eglynn | anamalagon: cool | 09:46 |
*** sayalilunkad has left #openstack-ceilometer | 09:46 | |
eglynn | anamalagon: BTW we had a brief discussion about OPW at the weekly project IRC meeting yesterday | 09:46 |
eglynn | anamalagon: logs at http://eavesdrop.openstack.org/meetings/ceilometer/2014/ceilometer.2014-03-12-21.00.log.html | 09:46 |
anamalagon | eglynn: thanks | 09:47 |
eglynn | anamalagon: TL;DR folks are willing to watch out for your work and help out if necessary | 09:47 |
*** matsuhashi has joined #openstack-ceilometer | 09:47 | |
eglynn | anamalagon: ... do you have any questions related to https://bugs.launchpad.net/bugs/1290924 ? | 09:48 |
anamalagon | eglynn: :) thanks - I actually wanted to ask you about that... | 09:48 |
eglynn | anamalagon: shoot! | 09:49 |
anamalagon | so I have some general questions about how the syntax, but actually very basic before that I was having trouble getting tox to work | 09:50 |
eglynn | anamalagon: k, so let's deal with your questions on the syntax (of the API changes?) first | 09:50 |
anamalagon | eglynn: ok. So 1) I'm changing the .rst file, right? Do I need to include the GET commands in the Samples and Statistics section or should they be in the Functional Examples? | 09:52 |
anamalagon | sorry that's not even a syntax question | 09:52 |
eglynn | anamalagon: I think I provided a reference to the .rst file that needed to be changed | 09:53 |
anamalagon | eglynn: My syntax question was very basic - there seems to be an :members: declaration that makes all the functions appear | 09:53 |
eglynn | ... /me checks bug description | 09:53 |
anamalagon | you did | 09:54 |
eglynn | anamalagon: ... so basically I was thinking you'd just augment the "API Queries" section with some additional free-text | 09:54 |
anamalagon | right - sorry, ok think I know what I'm trying to ask now - | 09:55 |
*** mengxd has quit IRC | 09:55 | |
anamalagon | so basically my question is if the rst file is built into the html file why are they different? | 09:55 |
eglynn | anamalagon: ... in the relevant commit messages, the examples are written in pseudo-HTTP (... GET /v2/meter/cpu_util/statistics&aggregate.func=avg etc.) | 09:55 |
anamalagon | right | 09:56 |
anamalagon | I guess I'm confused as to why I see GET /v2/resources in the html version of the API documentation but not the rst version | 09:56 |
anamalagon | for example | 09:57 |
eglynn | anamalagon: ... a-ha I see where you coming from now | 09:57 |
eglynn | anamalagon: ... so for example consider "Retrieve definitions of all of the resources." on http://docs.openstack.org/developer/ceilometer/webapi/v2.html | 09:59 |
eglynn | anamalagon: ... then note in the API code https://github.com/openstack/ceilometer/blob/master/ceilometer/api/controllers/v2.py#L1449 | 09:59 |
anamalagon | it's including the doc strings | 10:00 |
eglynn | anamalagon: so basically sphinx will generate docco from embedded comments etc. in the python code | 10:00 |
eglynn | anamalagon: ... note also the classmethods called sample() | 10:00 |
anamalagon | I see. I had it totally backwards- I thought it was coming from the code of the .rst file | 10:00 |
anamalagon | not even backwards - just not the same | 10:01 |
anamalagon | sorry go ahead | 10:01 |
eglynn | anamalagon: ... the docstrs & sample() methods in the python code are combined with the .rst file to form the generated HTML | 10:02 |
eglynn | anamalagon: if you look a the rst file in "raw" form it might be clearer | 10:03 |
eglynn | anamalagon: https://raw.github.com/openstack/ceilometer/master/doc/source/webapi/v2.rst | 10:04 |
eglynn | anamalagon: ... you'll see the embedded references to the controller classes and the respresentation types | 10:04 |
eglynn | anamalagon: ... so for exampe under the "Samples and Statistics" statistics | 10:05 |
eglynn | s/statistics/section/ | 10:05 |
eglynn | note the ".. autotype:: ceilometer.api.controllers.v2.Sample" references | 10:05 |
anamalagon | yep | 10:06 |
eglynn | ... so you'll need also a corresponding ".. autotype:: ceilometer.api.controllers.v2.Aggregate" | 10:06 |
eglynn | then you could either add to the "Functional examples" section with some examples of selectable aggregation | 10:08 |
eglynn | the current examples are all curl-based | 10:08 |
eglynn | ... so I guess you could follow the same pattern for the aggregation examples | 10:09 |
eglynn | ... mabe also extend the "API Queries" section with a general explanation of what aggregates are available and how they may be selected | 10:10 |
eglynn | ... whatever you think would make sense and be helpful to a noob seeing this for the 1st time | 10:11 |
eglynn | anamalagon: ^^ that all make sense? | 10:11 |
anamalagon | yes! | 10:12 |
anamalagon | thanks, this is much clearer now | 10:12 |
eglynn | anamalagon: np! | 10:12 |
anamalagon | I have/had the functional examples written (mostly just what you layed out in the bug description) but need to add the Aggregate autotype part | 10:14 |
anamalagon | *had - starting a fresh vm to try and figure out the tox issue | 10:14 |
openstackgerrit | Jia Dong proposed a change to openstack/ceilometer: Implement meter query by 'counter_volume' field https://review.openstack.org/67384 | 10:16 |
inc0 | hi, statistics gave me some strange output. I have metric instance:whatever and at 13:30 I ran another instance of this flavor. 12:00-13:00 stats is 517, 14:00-15:00 is 1034, so that looks allright | 10:17 |
*** yfujioka has quit IRC | 10:18 | |
inc0 | but 13:00-14:00 is 6205... | 10:18 |
inc0 | I'm looking at sum | 10:18 |
eglynn | anamalagon: cool, sounds like good progress | 10:20 |
*** tobi1 has joined #openstack-ceilometer | 10:20 | |
eglynn | anamalagon: your first proposal doesn't have to perfect, feel free to push a work-in-progress | 10:21 |
eglynn | anamalagon: ... just mark it as such in gerrit | 10:21 |
eglynn | anamalagon: ... often good to get early eyes on something new | 10:21 |
eglynn | inc0: sum doesn't make a great deal of sense for instance | 10:21 |
eglynn | inc0: cardinality might be what you're looking for? | 10:22 |
eglynn | inc0: ... i.e. the number of samples from *distinct* instances in that time period | 10:22 |
inc0 | eglynn, basically I want to extract info of flavour / time per tenant | 10:22 |
anamalagon | eglynn: good point - I forgot about the work in progress button :) | 10:22 |
inc0 | so I want to get info that tenant x had 4hrs of vms of flavor x | 10:23 |
eglynn | inc0: are you using icehouse-3 or later? | 10:23 |
inc0 | eglynn, no, havana | 10:23 |
inc0 | but I can update ceilometer if that will help | 10:23 |
eglynn | inc0: the distinct aggregate was only added in icehouse-3 | 10:24 |
eglynn | inc0: see an example query in the commit msg for https://review.openstack.org/76879 | 10:24 |
eglynn | inc0: in your case, you'd need to s/instance/instance:flavor/ in that example but the general idea is similar | 10:25 |
inc0 | eglynn, thanks, I'll look into it | 10:26 |
eglynn | inc0: ... but as I said, you'd need to upgrade to i3 to take advantage of that new feature | 10:26 |
inc0 | as long as its only ceilometer, I think I can do that | 10:26 |
*** admin0 has joined #openstack-ceilometer | 10:39 | |
inc0 | eglynn, I can see that your patch apply to mongodb, which unfortunately doesn't fit me as I use mysql | 10:47 |
*** admin0 has quit IRC | 10:48 | |
eglynn | inc0: fortunately I also cooked up this one https://review.openstack.org/#/c/76278/ | 10:48 |
inc0 | eglynn, ok, shame, I thought I get to write something there;) | 10:49 |
inc0 | thanks a lot | 10:49 |
eglynn | inc0: np! | 10:49 |
*** Alexei_987 has quit IRC | 11:08 | |
*** matsuhashi has quit IRC | 11:11 | |
*** matsuhashi has joined #openstack-ceilometer | 11:12 | |
nprivalova | ping gordc | 11:15 |
*** admin0 has joined #openstack-ceilometer | 11:24 | |
inc0 | eglynn, it seems I'll get something to write anyway, python-ceilometerclient doesn't seem to suppory these aggregates | 11:29 |
eglynn | inc0: yeap, that's been on my list | 11:29 |
eglynn | inc0: ... so for the moment you can just use curl directly | 11:30 |
*** tobi2 has joined #openstack-ceilometer | 11:30 | |
*** tobi1 has quit IRC | 11:30 | |
eglynn | inc0: ... a short cut is to start with say ... $ ceilometer --debug statistics -m instance -p 900 | 11:30 |
inc0 | I'll write this implementation, since I have some code around ceilometerclient already, it will be faster | 11:30 |
eglynn | inc0: then simply append the relevaquery params to the curl target URI | 11:31 |
eglynn | inc0: cool, whatever suits | 11:31 |
*** admin0 has quit IRC | 11:38 | |
anamalagon | hey eglynn, quick question - I noticed a comment in one of the commit messages saying that the current patch only supports sqlalchemy - should I put in the patch id or refer to it in some other way in the documentation? | 11:47 |
eglynn | anamalagon: support for selectable aggregates is currently provided for both sqlalchemy and mongo | 11:47 |
eglynn | anamalagon: (via separate patches) | 11:47 |
eglynn | anamalagon: ... the intention of the capabilities API was so that client could discover the extent of this support in the currently configured storage driver | 11:48 |
eglynn | anamalagon: ... I think I mentioned that in the bug description | 11:48 |
eglynn | anamalagon: ... so you definitely could mention using capabilities to check if these aggregates are supported | 11:49 |
eglynn | anamalagon: ... and also possibly that the current state of play is that the feature is only supported by the sqlalchemy and mongo drivers | 11:50 |
anamalagon | ah! you're right, I also see the commit message for the mongodb patch was in the bug description..I need to keep better track :) | 11:50 |
openstackgerrit | Stéphane Albert proposed a change to openstack/python-ceilometerclient: Statistics groupby handling improvement https://review.openstack.org/80256 | 11:51 |
anamalagon | eglynn: ok, thanks I'll put that in | 11:51 |
*** admin0 has joined #openstack-ceilometer | 11:52 | |
*** tobi2 has quit IRC | 11:55 | |
openstackgerrit | Stéphane Albert proposed a change to openstack/python-ceilometerclient: Statistics groupby handling improvement https://review.openstack.org/80256 | 11:55 |
*** tobi1 has joined #openstack-ceilometer | 11:59 | |
*** mengxd has joined #openstack-ceilometer | 12:06 | |
*** mengxd has quit IRC | 12:11 | |
*** matsuhashi has quit IRC | 12:11 | |
*** promulo has quit IRC | 12:11 | |
*** matsuhashi has joined #openstack-ceilometer | 12:12 | |
inc0 | eglynn, do you have blueprint for this ceilometerclient patch? | 12:12 |
eglynn | inc0: no, this doesn't require a BP for the client side support | 12:12 |
eglynn | inc0: ... you could link to the corresponding service side BPs | 12:12 |
inc0 | ok | 12:12 |
inc0 | will do then | 12:13 |
eglynn | inc0: e.g. in commit msg ... Relates-to: BP selectable-aggregates | 12:13 |
*** nosnos has quit IRC | 12:15 | |
*** matsuhashi has quit IRC | 12:16 | |
*** gordc has quit IRC | 12:19 | |
*** gordc has joined #openstack-ceilometer | 12:22 | |
*** xianghui has quit IRC | 12:26 | |
*** matsuhashi has joined #openstack-ceilometer | 12:26 | |
nprivalova | gordc: hi! | 12:28 |
*** gordc has quit IRC | 12:36 | |
nprivalova | eglynn: hi! did you ever have a problem with mongo "not authorized for query on ..."? | 12:38 |
*** gordc has joined #openstack-ceilometer | 12:38 | |
eglynn | nprivalova: not that I recall ... have you configured a mongo password? | 12:38 |
nprivalova | eglynn: yep. mongo --verbose -u ceilometer -p Zkdlsfklsj 192.168.0.1/ceilometer works ok | 12:40 |
nprivalova | eglynn: I mean it goes to shell | 12:40 |
nprivalova | eglynn: but db.getCollectionNames() produces the error | 12:40 |
eglynn | nprivalova: and is the user & pass encoded in the database connection URL? | 12:40 |
eglynn | nprivalova: (i.e. the connetcion URL in the ceilometer.conf) | 12:41 |
eglynn | nprivalova: gotta run. back later | 12:41 |
nprivalova | eglynn: ok | 12:41 |
*** eglynn is now known as eglynn-afk | 12:41 | |
gordc | nprivalova: hi, whatsup? | 12:42 |
nprivalova | gordc: I have the report for you :) | 12:42 |
gordc | nprivalova: cool. let's hear the bad news :P | 12:43 |
nprivalova | gordc:not very bad, let me past images somewhere, 1 second | 12:43 |
gordc | nprivalova: ok, cool | 12:44 |
*** nprivalova has quit IRC | 12:50 | |
admin0 | hi .. if my transport is udp .. and the remote udp endpoint is down, is there a logging process somewhere from where i can see missed messages ? | 12:59 |
*** tobi1 has quit IRC | 13:00 | |
*** gordc has quit IRC | 13:02 | |
*** gordc has joined #openstack-ceilometer | 13:03 | |
ildikov_ | gordc: hi! | 13:04 |
*** nprivalova has joined #openstack-ceilometer | 13:04 | |
gordc | ildikov_: hi, whatsup? | 13:05 |
ildikov_ | gordc: here is this bug: https://bugs.launchpad.net/ceilometer/+bug/1291923 | 13:05 |
ildikov_ | gordc: I think it's the duplication of yours just for stable/havana | 13:06 |
*** tobi1 has joined #openstack-ceilometer | 13:06 | |
gordc | ildikov_: yeah. seems like a dup of the stuff i'm working on. | 13:06 |
ildikov_ | gordc: I thought to mark it as duplicated | 13:07 |
gordc | ildikov_: sounds good to me. | 13:07 |
ildikov_ | gordc: do we plan to do the fix for stable/havana? | 13:07 |
*** nprivalova has quit IRC | 13:07 | |
ildikov_ | gordc: I mean backporting yours, if it seems to be working | 13:07 |
gordc | ildikov_: hmmm... i hadn't thought about it. | 13:07 |
gordc | ildikov_: i'd need to look at havana code to see if it's an easy backport. | 13:08 |
ildikov_ | gordc: I'm not sure if it is a change that should go back by default, but I'm not that experienced in that topic | 13:08 |
gordc | ildikov_: we'll see how the fix goes with master and then go from there. i believe we should be supporting back two cycles so we may need to backport. | 13:10 |
gordc | ildikov_: i'll let eglynn and jd decide then since they handle releases. | 13:11 |
ildikov_ | gordc: cool, I will mark this bug as duplicated anyway, I do not know if I have the rights to add stable/havana as affected release to yours, but maybe it is better if you will do that after this discussion with eglynn and jd | 13:12 |
gordc | ildikov_: sounds good. | 13:13 |
ildikov_ | gordc: cool, thanks for help | 13:13 |
gordc | np | 13:13 |
*** nikhil__ is now known as nikhil|afk | 13:15 | |
*** nprivalova has joined #openstack-ceilometer | 13:16 | |
*** julim has joined #openstack-ceilometer | 13:17 | |
nprivalova | gordc: ubuntu's printscreen has killed my pc. twice | 13:17 |
nprivalova | gordc: so here the link http://postimg.org/image/6tcogn2pj/ | 13:17 |
*** gordc has quit IRC | 13:18 | |
*** changbl has joined #openstack-ceilometer | 13:19 | |
*** promulo has joined #openstack-ceilometer | 13:21 | |
*** promulo has quit IRC | 13:21 | |
*** promulo has joined #openstack-ceilometer | 13:22 | |
*** jdob has joined #openstack-ceilometer | 13:26 | |
*** gordc has joined #openstack-ceilometer | 13:32 | |
gordc | stupid internet... if i drop randomly, it's because my internet sucks. | 13:33 |
*** matsuhashi has quit IRC | 13:42 | |
*** flwang has joined #openstack-ceilometer | 13:44 | |
*** gordc has quit IRC | 14:03 | |
*** raymondr has joined #openstack-ceilometer | 14:04 | |
*** xianghui has joined #openstack-ceilometer | 14:05 | |
*** gordc has joined #openstack-ceilometer | 14:05 | |
*** thomasem has joined #openstack-ceilometer | 14:06 | |
openstackgerrit | Ilya Tyaptin proposed a change to openstack/ceilometer: Fix order of arguments in assertEquals https://review.openstack.org/71595 | 14:06 |
*** ryanpetrello has joined #openstack-ceilometer | 14:07 | |
nprivalova | gordc: ping | 14:14 |
gordc | nprivalova: pong | 14:15 |
nprivalova | gordc: great:) | 14:15 |
nprivalova | gordc: so here the link http://postimg.org/image/6tcogn2pj/ | 14:16 |
gordc | nprivalova: cool graphs. :) | 14:17 |
nprivalova | gordc: hehe. so the left one is with your patch | 14:17 |
nprivalova | gordc: y-axis is amount of seconds needed for notification processing | 14:18 |
gordc | nprivalova: was just going to ask | 14:18 |
gordc | nprivalova: i guess the lower number is good... need to solve the deadlock issue. | 14:18 |
nprivalova | gordc: yes, it looks much better | 14:19 |
gordc | nprivalova: do you tempest tests work? i'm pretty sure we're dropping a lot of samples right now because of deadlocking issue. | 14:20 |
nprivalova | gordc: previously we had 200 sec delay during half of testing | 14:20 |
gordc | nprivalova: i'd expect the processing time to jump a little bit. | 14:20 |
nprivalova | gordc: tempest tests fail not because of dropping. because of long processing | 14:21 |
gordc | nprivalova: it still fails because of long processing or use to fail? | 14:21 |
*** saju_m has quit IRC | 14:22 | |
nprivalova | gordc: I didn't try on gate-like-env. The results I showed are just from my devstack. I run tempest on devstack and processed collector logs | 14:22 |
gordc | nprivalova: ah i see. | 14:23 |
openstackgerrit | Ana Malagon proposed a change to openstack/ceilometer: Added documentation for selectable aggregates https://review.openstack.org/80299 | 14:24 |
gordc | nprivalova: you think it's worth applying my patch? | 14:24 |
*** anyaelise has quit IRC | 14:25 | |
nprivalova | gordc: yep, sure! look at my pretty pictures again :) in the right one we wait 200 seconds for each notification. but your fix made in between 20 and 40 | 14:25 |
*** anyaelise has joined #openstack-ceilometer | 14:25 | |
*** anyaelise has left #openstack-ceilometer | 14:25 | |
gordc | nprivalova: cool cool. let me fix sample.conf file in my patch so it passes. | 14:26 |
nprivalova | gordc: ok | 14:27 |
gordc | nprivalova: i should warn you, if you look at your logs, you'll notice a lot of dropped samples because of deadlocking... so the numbers may be a little skewed. | 14:27 |
nprivalova | gordc: will take a look now | 14:27 |
gordc | nprivalova: but at least it'll improve performance on other backends as well... i'm also testing a fix for deadlocking issue. | 14:27 |
*** parkerr_ has quit IRC | 14:28 | |
nprivalova | gordc: 'dropping' info in collector logs? | 14:30 |
gordc | nprivalova: see http://logs.openstack.org/62/79962/4/check/check-tempest-dsvm-postgres-full/6d0f66f/logs/screen-ceilometer-collector.txt.gz | 14:32 |
*** xianghui has quit IRC | 14:33 | |
*** xianghui has joined #openstack-ceilometer | 14:33 | |
*** gordc has quit IRC | 14:36 | |
*** nati_ueno has joined #openstack-ceilometer | 14:43 | |
*** parkerr_ has joined #openstack-ceilometer | 14:43 | |
*** eglynn-afk is now known as eglynn | 14:44 | |
openstackgerrit | Ilya Tyaptin proposed a change to openstack/ceilometer: Fix order of arguments in assertEquals https://review.openstack.org/71839 | 14:44 |
*** gordc has joined #openstack-ceilometer | 14:44 | |
gordc | nprivalova: i'm going to lose connection, but i meant this: http://logs.openstack.org/62/79962/3/check/check-tempest-dsvm-full/19597bc/logs/screen-ceilometer-collector.txt.gz?level=WARNING | 14:46 |
openstackgerrit | gordon chung proposed a change to openstack/ceilometer: spawn multiple workers in services https://review.openstack.org/79962 | 14:47 |
openstackgerrit | Micha? Jastrz?bski proposed a change to openstack/python-ceilometerclient: Client implementation of statistics aggregators https://review.openstack.org/80302 | 14:49 |
nprivalova | gordc: wow | 14:50 |
*** eglynn_ has joined #openstack-ceilometer | 14:50 | |
gordc | nprivalova: yeah... i'm working on dumping all those update statements. that should resolve it. | 14:51 |
*** sdake has quit IRC | 14:55 | |
*** xianghui has quit IRC | 14:55 | |
*** sdake has joined #openstack-ceilometer | 14:55 | |
*** xianghui has joined #openstack-ceilometer | 14:56 | |
*** thomasem has quit IRC | 15:02 | |
*** julim has quit IRC | 15:02 | |
*** thomasem has joined #openstack-ceilometer | 15:02 | |
*** julim has joined #openstack-ceilometer | 15:03 | |
*** prad_ has joined #openstack-ceilometer | 15:03 | |
*** eglynn has quit IRC | 15:05 | |
openstackgerrit | Ilya Tyaptin proposed a change to openstack/ceilometer: Fix order of arguments in assertEquals https://review.openstack.org/71841 | 15:08 |
*** raymondr has quit IRC | 15:13 | |
*** raymondr_ has joined #openstack-ceilometer | 15:17 | |
*** jergerber has joined #openstack-ceilometer | 15:21 | |
*** raymondr_ has quit IRC | 15:22 | |
*** raymondr has joined #openstack-ceilometer | 15:22 | |
*** nati_ueno has quit IRC | 15:23 | |
*** raymondr has quit IRC | 15:26 | |
*** nikhil|afk is now known as nikhil__ | 15:28 | |
openstackgerrit | Akhil Hingane proposed a change to openstack/ceilometer: VMware vSphere: Improve the accuracy of queried samples https://review.openstack.org/80314 | 15:31 |
*** raymondr has joined #openstack-ceilometer | 15:31 | |
nprivalova | gordc: with your fix and HBase collector fails in 1 sec :) | 15:34 |
gordc | nprivalova: lol | 15:35 |
gordc | nprivalova: is there some setup required to enable multiple connections in hbase? | 15:35 |
*** raymondr has quit IRC | 15:36 | |
nprivalova | gordc: so sad, so much efforts in refactoring and fixing but database schema looks wrong, need to think a lot to make it possible to work in multi-processing env | 15:36 |
gordc | nprivalova: yeah, we lived in the easy life of single thread for too long. | 15:37 |
nprivalova | gordc: :) | 15:38 |
gordc | nprivalova: it's time to explore crazy world of multi-processing. :) | 15:38 |
openstackgerrit | Akhil Hingane proposed a change to openstack/ceilometer: VMware vSphere: Improve the accuracy of queried samples https://review.openstack.org/80314 | 15:38 |
*** _cjones_ has joined #openstack-ceilometer | 15:38 | |
gordc | nprivalova: i guess we can hold off on patch for now if it breaks all the backends... i haven't tried mongo yet. | 15:38 |
nprivalova | gordc: let me try mongo now. I think it will not take too much time | 15:40 |
*** raymondr has joined #openstack-ceilometer | 15:41 | |
*** raymondr has quit IRC | 15:45 | |
*** njirap has joined #openstack-ceilometer | 15:53 | |
*** xianghui has quit IRC | 15:57 | |
*** Ruetobas has quit IRC | 16:01 | |
*** Ruetobas has joined #openstack-ceilometer | 16:03 | |
*** Ruetobas has quit IRC | 16:07 | |
*** Ruetobas has joined #openstack-ceilometer | 16:13 | |
*** yassine has quit IRC | 16:14 | |
openstackgerrit | gordon chung proposed a change to openstack/ceilometer: spawn multiple workers in services https://review.openstack.org/79962 | 16:14 |
*** tobi1 has quit IRC | 16:17 | |
*** bogdando has quit IRC | 16:22 | |
*** bogdando has joined #openstack-ceilometer | 16:24 | |
*** njirap has left #openstack-ceilometer | 16:25 | |
*** mst89 has joined #openstack-ceilometer | 16:28 | |
*** yassine has joined #openstack-ceilometer | 16:29 | |
openstackgerrit | Ana Malagon proposed a change to openstack/ceilometer: Added documentation for selectable aggregates https://review.openstack.org/80299 | 16:30 |
*** admin0 has quit IRC | 16:30 | |
*** admin0 has joined #openstack-ceilometer | 16:31 | |
*** Alexei_987 has joined #openstack-ceilometer | 16:34 | |
nprivalova | gordc: looks like everything is fine with mongo | 16:34 |
gordc | nprivalova: that's promising. | 16:35 |
nprivalova | gordc: don't see any errors in collector-logs | 16:35 |
gordc | nprivalova: cool cool. time to get sql and hbase to play nice then. | 16:37 |
nprivalova | gordc: yep, will continue with hbase tomorrow | 16:38 |
gordc | nprivalova: ok. thanks for looking at that. | 16:38 |
nprivalova | gordc: we have a proverb, smth like "I've started to cook this kasha (porridge)" with tempest :) | 16:40 |
gordc | nprivalova: lol i'll leave you to it then. | 16:41 |
*** changbl has quit IRC | 16:41 | |
nprivalova | gordc: no, I'm afraid I will not manage without you :) ok, need to go now! Have a good day! | 16:43 |
gordc | nprivalova: cheers. | 16:44 |
*** admin0 has quit IRC | 16:53 | |
openstackgerrit | Marc Solanas proposed a change to openstack/python-ceilometerclient: Checking the type of auth_token, and fixing it if necessary https://review.openstack.org/58051 | 16:54 |
*** admin0 has joined #openstack-ceilometer | 16:55 | |
openstackgerrit | gordon chung proposed a change to openstack/ceilometer: improve performance of resource-list in sql https://review.openstack.org/80343 | 17:05 |
*** nacim has quit IRC | 17:14 | |
openstackgerrit | Mehdi Abaakouk proposed a change to openstack/ceilometer: Filter meter in API according policy https://review.openstack.org/80348 | 17:22 |
openstackgerrit | Mehdi Abaakouk proposed a change to openstack/ceilometer: Filter meter in API according policy https://review.openstack.org/80348 | 17:31 |
*** _nadya_ has joined #openstack-ceilometer | 17:33 | |
*** changbl has joined #openstack-ceilometer | 17:33 | |
openstackgerrit | Mehdi Abaakouk proposed a change to openstack/ceilometer: Filter meter in API according policy https://review.openstack.org/80348 | 17:35 |
openstackgerrit | Mehdi Abaakouk proposed a change to openstack/ceilometer: Filter meter in API according policy https://review.openstack.org/80348 | 17:36 |
*** yassine has quit IRC | 17:38 | |
*** _nadya_ has quit IRC | 17:42 | |
*** Alexei_987 has quit IRC | 17:46 | |
openstackgerrit | Eoghan Glynn proposed a change to openstack/ceilometer: Ensure insecure config option propagated by alarm service https://review.openstack.org/80353 | 17:54 |
*** admin0 has quit IRC | 17:55 | |
*** changbl has quit IRC | 17:58 | |
*** eglynn_ has quit IRC | 17:59 | |
openstackgerrit | Marc Solanas proposed a change to openstack/python-ceilometerclient: Checking the type of auth_token, and fixing it if necessary https://review.openstack.org/58051 | 18:12 |
*** nati_ueno has joined #openstack-ceilometer | 18:14 | |
*** raymondr has joined #openstack-ceilometer | 18:16 | |
*** raymondr_ has joined #openstack-ceilometer | 18:18 | |
*** julienvey has quit IRC | 18:19 | |
*** _nadya_ has joined #openstack-ceilometer | 18:20 | |
*** raymondr has quit IRC | 18:21 | |
*** piyushmasrani has quit IRC | 18:21 | |
*** eglynn_ has joined #openstack-ceilometer | 18:26 | |
*** raymondr_ has quit IRC | 18:28 | |
*** raymondr has joined #openstack-ceilometer | 18:29 | |
openstackgerrit | Akhil Hingane proposed a change to openstack/ceilometer: VMware vSphere: Improve the accuracy of queried samples https://review.openstack.org/80314 | 18:31 |
*** raymondr_ has joined #openstack-ceilometer | 18:33 | |
*** raymondr has quit IRC | 18:33 | |
*** lionrug has joined #openstack-ceilometer | 18:33 | |
*** lionrug has quit IRC | 18:34 | |
openstackgerrit | Mehdi Abaakouk proposed a change to openstack/ceilometer: Consume notif. from multiple message bus https://review.openstack.org/77612 | 18:36 |
openstackgerrit | Mehdi Abaakouk proposed a change to openstack/ceilometer: Use oslo.msg retry API in rpc publisher https://review.openstack.org/77845 | 18:36 |
openstackgerrit | Mehdi Abaakouk proposed a change to openstack/ceilometer: Permit usage of notifications for metering https://review.openstack.org/80225 | 18:36 |
*** Alexei_987 has joined #openstack-ceilometer | 18:36 | |
openstackgerrit | Mehdi Abaakouk proposed a change to openstack/ceilometer: Filter meter in API according policy https://review.openstack.org/80348 | 18:36 |
*** raymondr_ has quit IRC | 18:37 | |
*** raymondr has joined #openstack-ceilometer | 18:47 | |
*** changbl has joined #openstack-ceilometer | 19:02 | |
*** _nadya_ has quit IRC | 19:02 | |
*** mst89 has quit IRC | 19:25 | |
*** nati_ueno has quit IRC | 19:33 | |
*** erecio has joined #openstack-ceilometer | 19:35 | |
*** erecio has quit IRC | 19:52 | |
*** erecio has joined #openstack-ceilometer | 19:53 | |
*** erecio has quit IRC | 19:53 | |
*** erecio has joined #openstack-ceilometer | 19:54 | |
*** ildikov_ has quit IRC | 19:55 | |
*** inc0 has quit IRC | 19:55 | |
*** mst89 has joined #openstack-ceilometer | 20:04 | |
*** Alexei_987 has quit IRC | 20:10 | |
*** julim has quit IRC | 20:15 | |
*** Alexei_987 has joined #openstack-ceilometer | 20:28 | |
openstackgerrit | gordon chung proposed a change to openstack/ceilometer: improve performance of resource-list in sql https://review.openstack.org/80343 | 20:33 |
*** jdob has quit IRC | 20:47 | |
*** nati_ueno has joined #openstack-ceilometer | 20:51 | |
*** mengxd has joined #openstack-ceilometer | 21:03 | |
*** yassine has joined #openstack-ceilometer | 21:13 | |
eglynn_ | ... /me would appreciate quick eyes on this femto-patch https://review.openstack.org/80353 if any cores are around | 21:23 |
*** ryanpetrello has quit IRC | 21:30 | |
*** thomasem has quit IRC | 21:37 | |
*** promulo has quit IRC | 21:39 | |
*** ildikov_ has joined #openstack-ceilometer | 21:48 | |
*** ryanpetrello has joined #openstack-ceilometer | 21:51 | |
*** ryanpetrello has quit IRC | 21:52 | |
openstackgerrit | Eoghan Glynn proposed a change to openstack/ceilometer: Rationalize get_resources for mongodb https://review.openstack.org/80105 | 22:02 |
*** _nadya_ has joined #openstack-ceilometer | 22:03 | |
eglynn_ | anamalagon: is all the feedback on https://review.openstack.org/80299 clear, or would some clarification be useful? | 22:06 |
*** _nadya_ has quit IRC | 22:07 | |
openstackgerrit | Luis A. Garcia proposed a change to openstack/ceilometer: Install global lazy _() https://review.openstack.org/70824 | 22:07 |
eglynn_ | anamalagon: ... I'll be around for the next ~20 mins if you want to run through any of it in detail | 22:08 |
*** sdake has quit IRC | 22:11 | |
*** changbl has quit IRC | 22:16 | |
mst89 | Hey, I would appreciate some reviews on https://review.openstack.org/#/c/58051/ | 22:22 |
*** jergerber has quit IRC | 22:34 | |
Alexei_987 | eglynn_: ping | 22:36 |
eglynn_ | Alexei_987: yo | 22:36 |
eglynn_ | Alexei_987: just reading your last comment on https://review.openstack.org/#/c/80105 | 22:36 |
Alexei_987 | eglynn_: even if we tolarate performance regression with 3 updates there is still concurrency issue | 22:36 |
Alexei_987 | it may happen that same resource will be updated in parallel | 22:36 |
Alexei_987 | which may lead to very bad things to happen | 22:37 |
Alexei_987 | eglynn_: so my answer is "append only" data model | 22:37 |
*** mengxd has quit IRC | 22:38 | |
Alexei_987 | eglynn_: and I would also insist in choosing single backend and droping support for the others | 22:39 |
eglynn_ | Alexei_987: would the 3 update case even be possible in practice? | 22:39 |
Alexei_987 | eglynn_: you mean concurrency issue? | 22:39 |
eglynn_ | Alexei_987: ... i.e. last_sample_timestamp >= current sample timestamp AND first_sample_timestamp > current sample timestamp? | 22:40 |
eglynn_ | Alexei_987: sorry: last_sample_timestamp <= current sample timestamp AND first_sample_timestamp > current sample timestamp | 22:41 |
Alexei_987 | eglynn_: not sure :) | 22:41 |
Alexei_987 | eglynn_: even if not I still don't like this solution | 22:41 |
eglynn_ | Alexei_987: ... so surely 2 updates would be the max | 22:42 |
Alexei_987 | eglynn_: even 2 updates may lead to issues in have of concurrency | 22:42 |
Alexei_987 | since they are not atomic | 22:42 |
eglynn_ | Alexei_987: ... but in any case the scope for changing to an "append only" data model for icehouse at this late stage is zero | 22:42 |
Alexei_987 | s/have/case/ | 22:42 |
eglynn_ | Alexei_987: ... an the scope for changing to an "append only" data model for stable/havana is less than zero | 22:43 |
Alexei_987 | eglynn_: yeah it can be goal for next cycle | 22:43 |
Alexei_987 | ok I get your point | 22:43 |
eglynn_ | Alexei_987: ... the goal for this patch is to get it landed for icehouse and possibly backported for a Havana-derived distro | 22:44 |
Alexei_987 | eglynn_: but still.. what we'll do in case of data corruption? | 22:44 |
*** prad_ has quit IRC | 22:44 | |
Alexei_987 | eglynn_: do we consider it as non critical? | 22:45 |
eglynn_ | Alexei_987: ... hold a mutex between updates? | 22:45 |
Alexei_987 | this will ruin performance completely | 22:45 |
Alexei_987 | well at least cause a significant degradation | 22:45 |
eglynn_ | Alexei_987: ... the worst that can happen is that the last sample timestamp is off and the resource metadata is non-current, or? | 22:45 |
Alexei_987 | yeah | 22:45 |
Alexei_987 | so it may be considered as non critical | 22:46 |
Alexei_987 | and we can possibly tolerate that | 22:46 |
Alexei_987 | since only timestamps will be messed up | 22:46 |
eglynn_ | Alexei_987: ... either way when the next sample arrives the last sample timestamp and the resource metadata will revert to sanity on the next sample | 22:46 |
eglynn_ | ... meh that wasn't very clearly expressed :( | 22:47 |
Alexei_987 | eglynn_ vs Alex - 2 : 0 | 22:47 |
Alexei_987 | eglynn_: another concern is that you raise a mongo version | 22:48 |
eglynn_ | ... I meant to say when any corruption occurs, it will be undone pretty quickly with the next sample for that resource | 22:48 |
Alexei_987 | eglynn_: is there any way to do without it? | 22:48 |
Alexei_987 | eglynn_: I get it you are right so corruption should not be a big issue | 22:48 |
eglynn_ | Alexei_987: short of doing yet another update for the first sample timestamp, the $setOnInsert seemed to fit the bill | 22:49 |
Alexei_987 | yeah but this small piece of code requires you to update your mongo installation and it can be quite a pain | 22:50 |
Alexei_987 | why don't we simply tolerate the case when this field missing? | 22:50 |
*** julim has joined #openstack-ceilometer | 22:51 | |
Alexei_987 | eglynn_: ^ | 22:51 |
eglynn_ | Alexei_987: true, but 2.4 has been the effective default for new installations for a while | 22:51 |
*** ryanpetrello has joined #openstack-ceilometer | 22:51 | |
eglynn_ | Alexei_987: already it may not be set for pre-existing resource documents | 22:51 |
eglynn_ | Alexei_987: so I wanted to ensure that at least it was set accurately for *new* resources | 22:52 |
Alexei_987 | eglynn_: sigh | 22:52 |
Alexei_987 | eglynn_: what about possible backport to havana (if they are using havana it's likely that they have old mongo)? | 22:53 |
Alexei_987 | eglynn_: in such case backport should not raise mongo version | 22:53 |
eglynn_ | Alexei_987: yes that may be problematic all right | 22:54 |
eglynn_ | Alexei_987: .. however as things stand GET /v2/resources is effetcively unusable in practice | 22:54 |
eglynn_ | Alexei_987: .. so maybe a radical solution is required (such as needing a mongo upgrade) | 22:55 |
Alexei_987 | eglynn_: I'm ok with this patch land in master but backport should be rewritten | 22:55 |
*** fnaval has joined #openstack-ceilometer | 22:55 | |
eglynn_ | Alexei_987: fair enough | 22:55 |
eglynn_ | Alexei_987: ... backport-wise it may end as something distro-specific | 22:56 |
Alexei_987 | eglynn_: yes possibly provide 2 versions of this fix | 22:56 |
eglynn_ | Alexei_987: ... i.e. an additional patch carried by some havana-derived distros of openstack | 22:56 |
eglynn_ | Alexei_987: ... yep, that's a possibility too | 22:56 |
*** mengxd has joined #openstack-ceilometer | 22:57 | |
eglynn_ | Alexei_987: I'm gonna have to drop off shortly ... this was an interesting discussion though, thanks for the detailed feedback! | 22:57 |
Alexei_987 | eglynn_: Ok I'll do another pass on review | 22:57 |
Alexei_987 | and change my mark if no new problems found | 22:57 |
eglynn_ | Alexei_987: cool, thanks! | 22:57 |
*** promulo has joined #openstack-ceilometer | 22:57 | |
*** eglynn_ has quit IRC | 22:58 | |
*** raymondr has quit IRC | 22:58 | |
*** julim has quit IRC | 22:59 | |
*** tasdomas has quit IRC | 23:04 | |
*** fnaval has quit IRC | 23:06 | |
*** fnaval has joined #openstack-ceilometer | 23:07 | |
*** flwang has quit IRC | 23:07 | |
*** tasdomas has joined #openstack-ceilometer | 23:09 | |
*** mengxd has quit IRC | 23:14 | |
*** raymondr has joined #openstack-ceilometer | 23:21 | |
*** flwang has joined #openstack-ceilometer | 23:21 | |
openstackgerrit | Eoghan Glynn proposed a change to openstack/ceilometer: Rationalize get_resources for mongodb https://review.openstack.org/80105 | 23:25 |
*** fnaval has quit IRC | 23:30 | |
*** yfujioka has joined #openstack-ceilometer | 23:36 | |
*** ryanpetrello_ has joined #openstack-ceilometer | 23:36 | |
*** _cjones__ has joined #openstack-ceilometer | 23:36 | |
*** raymondr_ has joined #openstack-ceilometer | 23:36 | |
*** julim has joined #openstack-ceilometer | 23:42 | |
*** raymondr has quit IRC | 23:45 | |
*** ryanpetrello has quit IRC | 23:45 | |
*** _cjones_ has quit IRC | 23:45 | |
*** ryanpetrello_ is now known as ryanpetrello | 23:45 | |
*** gordc has quit IRC | 23:54 | |
*** sdake has joined #openstack-ceilometer | 23:54 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!