*** shardy has quit IRC | 00:02 | |
*** shardy has joined #openstack-ceilometer | 00:03 | |
openstackgerrit | gordon chung proposed a change to openstack/ceilometer: DBDeadlock exception in sql backend https://review.openstack.org/80461 | 00:13 |
---|---|---|
*** _nadya_ has joined #openstack-ceilometer | 00:17 | |
*** _nadya_ has quit IRC | 00:22 | |
*** matsuhashi has joined #openstack-ceilometer | 00:31 | |
*** _cjones_ has quit IRC | 01:26 | |
*** _cjones_ has joined #openstack-ceilometer | 01:26 | |
*** _cjones_ has quit IRC | 01:30 | |
*** nosnos has joined #openstack-ceilometer | 01:37 | |
*** alexpilotti has joined #openstack-ceilometer | 01:42 | |
openstackgerrit | gordon chung proposed a change to openstack/ceilometer: DBDeadlock exception in sql backend https://review.openstack.org/80461 | 01:48 |
*** LuanNH has joined #openstack-ceilometer | 02:45 | |
*** matsuhashi has quit IRC | 03:04 | |
*** flwang has quit IRC | 03:06 | |
*** matsuhashi has joined #openstack-ceilometer | 03:10 | |
*** nosnos has quit IRC | 03:17 | |
*** changbl has joined #openstack-ceilometer | 03:20 | |
openstackgerrit | gordon chung proposed a change to openstack/ceilometer: DBDeadlock exception in sql backend https://review.openstack.org/80461 | 03:20 |
*** matsuhashi has quit IRC | 03:31 | |
*** flwang has joined #openstack-ceilometer | 03:39 | |
*** alexpilotti has quit IRC | 03:46 | |
*** matsuhashi has joined #openstack-ceilometer | 03:53 | |
*** jaycromer has joined #openstack-ceilometer | 03:55 | |
jaycromer | hello all | 03:58 |
*** jaycromer has quit IRC | 04:02 | |
*** nosnos has joined #openstack-ceilometer | 04:06 | |
*** liusheng has quit IRC | 04:09 | |
*** flwang has quit IRC | 04:30 | |
*** flwang has joined #openstack-ceilometer | 04:31 | |
openstackgerrit | gordon chung proposed a change to openstack/ceilometer: DBDeadlock exception in sql backend https://review.openstack.org/80461 | 04:38 |
openstackgerrit | gordon chung proposed a change to openstack/ceilometer: remove dump tables from previous migrations https://review.openstack.org/83657 | 04:41 |
*** _cjones_ has joined #openstack-ceilometer | 04:46 | |
*** nati_ueno has quit IRC | 05:09 | |
*** Ruetobas has quit IRC | 05:22 | |
*** Ruetobas has joined #openstack-ceilometer | 05:28 | |
*** Ruetobas has quit IRC | 05:33 | |
*** Ruetobas has joined #openstack-ceilometer | 05:33 | |
*** drjones has joined #openstack-ceilometer | 05:57 | |
*** drjones has quit IRC | 05:57 | |
*** drjones has joined #openstack-ceilometer | 05:58 | |
*** _cjones_ has quit IRC | 06:01 | |
*** drjones has quit IRC | 06:02 | |
openstackgerrit | Jenkins proposed a change to openstack/ceilometer: Imported Translations from Transifex https://review.openstack.org/76762 | 06:05 |
*** _nadya_ has joined #openstack-ceilometer | 06:07 | |
*** _nadya_ has quit IRC | 06:17 | |
*** _nadya_ has joined #openstack-ceilometer | 06:19 | |
*** ildikov_ has quit IRC | 06:27 | |
*** flwang has quit IRC | 06:35 | |
*** flwang has joined #openstack-ceilometer | 06:37 | |
*** saju_m has joined #openstack-ceilometer | 06:38 | |
*** flwang has quit IRC | 06:41 | |
*** flwang has joined #openstack-ceilometer | 06:43 | |
*** liusheng has joined #openstack-ceilometer | 06:45 | |
openstackgerrit | liusheng proposed a change to openstack/ceilometer: Fix the floatingip pollster https://review.openstack.org/83676 | 07:01 |
*** flwang has quit IRC | 07:02 | |
*** _nadya_ has quit IRC | 07:03 | |
*** mihgen has joined #openstack-ceilometer | 07:09 | |
*** matsuhashi has quit IRC | 07:20 | |
*** matsuhas_ has joined #openstack-ceilometer | 07:24 | |
*** urulama has joined #openstack-ceilometer | 07:33 | |
*** eglynn has joined #openstack-ceilometer | 07:34 | |
*** ildikov_ has joined #openstack-ceilometer | 07:49 | |
*** mihgen has quit IRC | 07:53 | |
openstackgerrit | Eoghan Glynn proposed a change to openstack/ceilometer: De-dupe selectable aggregate list in statistics API https://review.openstack.org/83511 | 08:27 |
*** eglynn has quit IRC | 08:27 | |
*** mihgen has joined #openstack-ceilometer | 08:33 | |
*** matsuhas_ has quit IRC | 08:53 | |
*** matsuhas_ has joined #openstack-ceilometer | 08:57 | |
*** inc0 has joined #openstack-ceilometer | 08:59 | |
inc0 | good morning | 08:59 |
*** ildikov_ has quit IRC | 09:03 | |
*** saju_m has quit IRC | 09:05 | |
*** eglynn has joined #openstack-ceilometer | 09:12 | |
*** nacim has joined #openstack-ceilometer | 09:12 | |
*** yassine has joined #openstack-ceilometer | 09:13 | |
*** vrovachev has joined #openstack-ceilometer | 09:17 | |
eglynn | jd__: hope it wasn't too cavalier of me, going ahead and targetting this late-breaking bug at RC1? | 09:19 |
eglynn | https://bugs.launchpad.net/ceilometer/+bug/1298514 | 09:19 |
eglynn | (... should be land-able today, depending on what o'clock ttx plans to cut RC1) | 09:19 |
*** saju_m has joined #openstack-ceilometer | 09:25 | |
*** ildikov_ has joined #openstack-ceilometer | 09:33 | |
*** bada has joined #openstack-ceilometer | 09:35 | |
* jd__ enters review mode | 09:36 | |
*** sayalilunkad has joined #openstack-ceilometer | 09:50 | |
*** matsuhas_ has quit IRC | 10:00 | |
nprivalova | eglynn, jd__, looks like we have working HBase with several threads :) but I need monkey patching for threading | 10:00 |
eglynn | nprivalova: cool, monkey patching due to eventlet issues, or? | 10:01 |
jd__ | so that's not several threads then :) | 10:01 |
jd__ | that's greenthreads | 10:01 |
nprivalova | eglynn: yes | 10:01 |
eglynn | nprivalova: ... so not true concurrency then as jd__ says | 10:02 |
nprivalova | jd__: sorry, I used to avoid any threading all my life :D | 10:02 |
jd__ | nprivalova: which is a good idea | 10:02 |
jd__ | says the guy spending his days debugging the multithreading nightmare of kazoo in tooz | 10:03 |
jd__ | true story | 10:03 |
nprivalova | jd__, eglynn, ok, I would say in another way. By default HBase doesn't work now with "simultaneous file read". I will upload new variant for review that works and you will fix my monkey-patching if needed, ok? | 10:05 |
jd__ | ok nprivalova | 10:05 |
jd__ | nprivalova: is that for rc1 or? | 10:05 |
nprivalova | jd__: it would be perfect | 10:06 |
inc0 | eglynn, tell me please, do we plan to implement aggregates with more than one param? | 10:12 |
eglynn | inc0: I thought about that originally | 10:13 |
eglynn | inc0: ... e.g. aggregate.func=quantile&aggregate.param=0.25,0.5,0.75 | 10:14 |
eglynn | inc0: ... but came to the conclusion that it would over complicate the API | 10:14 |
eglynn | inc0: ... and those cases could be handled instead via say: | 10:14 |
eglynn | aggregate.func=quantile&aggregate.param=0.25&aggregate.func=quantile&aggregate.param=0.5&... | 10:14 |
eglynn | inc0: ... make sense? | 10:15 |
ildikov_ | eglynn, inc0: complex query for statistics is upcoming, we planned it for early Juno | 10:15 |
eglynn | ildikov_: will that impact on the aggregate selection? | 10:16 |
*** nosnos has quit IRC | 10:16 | |
ildikov_ | eglynn, inc0: I think the structure of the request body will be capable of handling the multiple params situation | 10:17 |
eglynn | ildikov_: k, that's interesting | 10:17 |
eglynn | ildikov_: ... if we have a case that doesn't naturally decompose into multiple references to the same aggregate each with a single param | 10:18 |
eglynn | ildikov_: ... as does the quantile example above | 10:18 |
eglynn | ildikov_: ... or the multiple cardinalities we were discussing last night | 10:18 |
ildikov_ | eglynn: I think that it is the matter of design and needs how we handle the aggregates | 10:19 |
eglynn | ildikov_: yeah for the query-param version, prolly best to stick with single-param | 10:19 |
eglynn | ildikov_: ... but the JSON repr in the complex case obviously would give more flexibility | 10:20 |
ildikov_ | eglynn: I think quantile also could be handled, exactly because of the this flexibility | 10:20 |
*** alexpilotti has joined #openstack-ceilometer | 10:20 | |
ildikov_ | eglynn: as I said, it should be the matter of design, but I think it is not a mission impossible case | 10:21 |
ildikov_ | eglynn: do you agree? | 10:21 |
eglynn | ildikov_: ... yep, if there's a definite usecase for multi-param | 10:21 |
*** sayali has joined #openstack-ceilometer | 10:22 | |
openstackgerrit | Nadya Privalova proposed a change to openstack/ceilometer: Use ConectionPool instead of one Connection in HBase https://review.openstack.org/83435 | 10:23 |
ildikov_ | eglynn: sure, we need to identify that what makes sense here, like you've mentioned the quantile or yesterday's case with the multiple cardinalities | 10:24 |
*** sayalilunkad has quit IRC | 10:25 | |
openstackgerrit | Nadya Privalova proposed a change to openstack/ceilometer: Use ConectionPool instead of one Connection in HBase https://review.openstack.org/83435 | 10:27 |
eglynn | ildikov_: ... yep, for those examples above | 10:28 |
eglynn | ildikov_: ... as an API user I'd be happy enough with either form | 10:29 |
eglynn | ildikov_: ... i.e. func=cardinality¶m=resource_id&func=cardinality¶m=project_id | 10:29 |
eglynn | ildikov_: ... or something like func=cardinality¶m=resource_id,project_id | 10:29 |
ildikov_ | eglynn: sorry, I'm under mail mountains currently, so I just dropped here my first thoughts about this topic :) | 10:29 |
eglynn | ildikov_: ... but then again for somthing like say exponential smoothing | 10:29 |
eglynn | ildikov_: ... might make sense to have say: func=holt_trend¶m=alpha,beta | 10:30 |
eglynn | ildikov_: ... so yeah, multi-param could definitely make more sense the deeper we get into this | 10:30 |
ildikov_ | eglynn: complex query started because of making the requests more flexible | 10:31 |
ildikov_ | eglynn: query *was* started | 10:31 |
eglynn | ildikov_: true that, and now that I think on it more, that flexibility could definitely be useful for https://blueprints.launchpad.net/ceilometer/+spec/period-spanning-statistics | 10:32 |
ildikov_ | eglynn: hmm, looks interesting :) | 10:34 |
ildikov_ | eglyyn: as for pure multiple params support, I think it makes sense, these things are usually come into the picture as time goes by and a given feature is used more and more | 10:36 |
ildikov_ | eglynn: flexibility is important I think | 10:36 |
eglynn | ildikov_: +1 :) | 10:37 |
ildikov_ | eglynn: I have to think about a little bit more on this bp you've just sent :) | 10:37 |
eglynn | ildikov_: ... btw I'm hoping that BP will be taken on by an OPW intern if her application is successful | 10:38 |
ildikov_ | eglynn: I said earlier, when we were implementing complex query that we should discuss about statistics too, because of the flexibility it provides could be used there too for multiple purposes | 10:38 |
eglynn | sounds good :) | 10:38 |
ildikov_ | eglynn: so if it is ok with you, then we will get back to you with gibi, if we reach again the feature implementation phase and have some design like on the table | 10:39 |
eglynn | ildikov_: cool | 10:39 |
ildikov_ | eglynn: hm, nice bp for an intern :) | 10:40 |
ildikov_ | eglynn: ... I hope she will like it | 10:40 |
ildikov_ | eglynn: ... maybe I will let someone else reviewing that code, so that she will get a chance to get it landed once ;) | 10:41 |
eglynn | ildikov_: anamalagon (whom you know) is interested in the BP all right, but the OPW application process has to play out first | 10:41 |
eglynn | ildikov_: LOL ;) | 10:41 |
*** LuanNH has quit IRC | 10:43 | |
ildikov_ | eglynn: what is the schedule of the OPW process? | 10:45 |
eglynn | ildikov_: summarized here ... https://wiki.openstack.org/wiki/OutreachProgramForWomen#Schedule | 10:46 |
ildikov_ | eglynn: cool, thanks | 10:48 |
nprivalova | eglynn: could you please take a look https://review.openstack.org/#/c/83435/3/ceilometer/cli.py ? is it acceptable? | 10:59 |
eglynn | nprivalova: looking | 10:59 |
inc0 | sorry, I had ad-hoc meeting the moment I started topic;) Well, imho multi-param aggregates are just matter of time. We'll need it eventually. Maybe its worth creating a bp? | 11:08 |
inc0 | also I think constructions like aggregate.func=cardinality&aggregate.param.field=resource_id , so named params would also be worth thinking about | 11:11 |
ildikov_ | inc0: from complex query PoV, there is already a BP for statistics support, it only needs to be updated according to the new statistics functionality | 11:11 |
ildikov_ | inc0: if you plan to improve the current statistics endpoint, it's eglynn's area :) | 11:11 |
*** inc0_ has joined #openstack-ceilometer | 11:13 | |
eglynn | inc0: ... yeah from the discussion above, I'm tending to agree that multi-param has a real use-case | 11:13 |
eglynn | inc0_: ... yeah from the discussion above, I'm tending to agree that multi-param has a real use-case | 11:13 |
eglynn | inc0, inc0_: will the real inc0 please stand up? ;) | 11:14 |
eglynn | ... and yeah a BP would be good if you're interested | 11:14 |
inc0_ | here:) | 11:15 |
inc0_ | network is flapping :( | 11:15 |
ildikov_ | eglynn, inc0_: I think in case of the current statistics functionality, it is important to keep the API somehow as simple as possible | 11:16 |
*** inc0 has quit IRC | 11:16 | |
ildikov_ | eglynn, inc0_: I meant the named params here, but maybe I'm just a girl again and worrying too much as usual :) | 11:16 |
inc0_ | ildikov_, true, but again, in my opinion sooner or later someone would like to have multiparam aggregate | 11:17 |
inc0_ | ildikov_, its rather about "Explicit is better than implicit" from import this, but I tend to be zealotus;) for good or ill | 11:17 |
eglynn | inc0_: I guess the question is whether unamed multi-param would suffice, as opposed to kwarg-stylee? | 11:18 |
ildikov_ | inc0_: I know, that is why I mentioned the complex query related endpoints, where I have already a statistics bp, if it is only about having support somewhere | 11:18 |
eglynn | inc0_: ... anyway sounds like a detail that could be trashed out in the process of BP drafting and gerrit reviewing | 11:18 |
inc0_ | eglynn, possibly, but quite frankly I don't like that order in which you append GET params (func and params for aggregates) should matter, and now they do. | 11:19 |
ildikov_ | inc0_: if you plan to extend the current functionality, I'm not against the named params, I just said that it should be considered that which direction would be the best to not make the API too complex | 11:19 |
eglynn | inc0_: darned WSME! ;) | 11:19 |
ildikov_ | inc0_: WSME is not a nice "animal" in this "zoo" and that is all its fault... | 11:20 |
inc0_ | well, there was case with one particular giraffe in Denmark... | 11:21 |
*** julim has joined #openstack-ceilometer | 11:21 | |
eglynn | ... poor ol' Marius | 11:22 |
inc0_ | the lion was happy thou | 11:22 |
*** julim has quit IRC | 11:22 | |
eglynn | ... until some of his old friends got the bullet too | 11:23 |
ildikov_ | eglynn, inc0_: oh, Ive just found the wikipedia page about him :( | 11:23 |
inc0_ | I'm looking at your blueprint ildikov_, making queries using POST doesn't seem to be restful...maybe simply url-encoded json? | 11:25 |
inc0_ | in GET | 11:25 |
ildikov_ | eglynn, inc0_: I cannot clearly see the situation of our Marius, there were some initial missions to execute, but I cannot see the long term future in my crystal ball now | 11:26 |
ildikov_ | inc0_: I know, we had some bloody discussion about this earlier | 11:26 |
inc0_ | that approach would also help with aggregates = you could keep exactly the same datastructure in ceiloclient and api | 11:27 |
inc0_ | aggregates=json.dumps([{'func': 'cardinality', 'param': 'resource_id'}]) | 11:27 |
ildikov_ | inc0_: finally this solution got landed as there were also discussions about that it should be an extension of the current simple query and that is this syntax even good or bad, etc | 11:28 |
ildikov_ | inc0_: it is not easy to have a common agreement in a large community like this, I'm not saying that it is a perfect solution, but you cannot suggest anything that will be pure black or white for everyone | 11:30 |
inc0_ | ildikov_, well, thats the problem of most projects I am or have been into;) with more than 2 people in it | 11:30 |
ildikov_ | inc0_: the statistics bp is the second part of the one for complex query support, so the design was given in this case | 11:30 |
inc0_ | especially in Poland. | 11:30 |
*** julim has joined #openstack-ceilometer | 11:31 | |
ildikov_ | inc0_: I know the feeling exactly :) | 11:32 |
ildikov_ | inc0_: sorry, I need to run now to a short meeting, it's an extremely busy Friday :( | 11:33 |
inc0_ | ildikov_, have a nice meeting | 11:33 |
ildikov_ | inc0_: it will be enough for me, if it will not be ugly :) | 11:34 |
ildikov_ | inc0_: laters | 11:34 |
inc0_ | see ya | 11:35 |
*** saju_m has quit IRC | 11:50 | |
openstackgerrit | Ilya Tyaptin proposed a change to openstack/ceilometer: Add encoding argument to deserialising udp packets in collector https://review.openstack.org/83722 | 11:51 |
*** Alexei_987 has joined #openstack-ceilometer | 11:55 | |
*** urulama has quit IRC | 11:56 | |
nprivalova | jd__, sileht, please take a look https://review.openstack.org/#/c/83435/3/ceilometer/cli.py | 12:03 |
*** gordc has joined #openstack-ceilometer | 12:16 | |
openstackgerrit | gordon chung proposed a change to openstack/ceilometer: remove dump tables from previous migrations https://review.openstack.org/83657 | 12:18 |
openstackgerrit | Nadya Privalova proposed a change to openstack/ceilometer: Use ConectionPool instead of one Connection in HBase https://review.openstack.org/83435 | 12:19 |
nprivalova | gordc: hi! I really need your thought here https://review.openstack.org/#/c/83435/ . Finally I've made HBase work on real load, 1000 entries per minute. And we need this patch to say "Ceilometer supports HBase". If you have time please take a look | 12:23 |
gordc | nprivalova: this is for juno right? (and backport) | 12:29 |
nprivalova | gordc: I'm still dreaming about rc1 :) | 12:29 |
gordc | nprivalova: ... i think we were going to cut that today... | 12:31 |
gordc | nprivalova: i'll review it but i think you need to bump requirements as well. connectionpool is only available with >=0.5 but we're still accepting 0.4 | 12:32 |
nprivalova | gordc: yep, I know... I want HBase in Icehouse. It's not really important how it will be there. backporting may be ok. I don't know this procedure good enough | 12:33 |
nprivalova | gordc: I use connectionpool from happybase. I think it's different connection pool | 12:33 |
eglynn | gordc: re. RC1 timing, I was bugging ttx earlier for a definite deadline on this | 12:34 |
eglynn | (... so that we know where we stand re. landing the last few patches) | 12:34 |
eglynn | ... if necessary he's willing to cut the ceilo tag on Monday to allow release-critical patches land | 12:35 |
eglynn | ... however we should still probably be aiming for EoD today if at all poss | 12:35 |
gordc | eglynn: cool cool. i like EoD deadline. give us sometime to make sure all the patches that did get in didn't break each other. | 12:37 |
gordc | nprivalova: http://happybase.readthedocs.org/en/latest/api.html#happybase.ConnectionPool | 12:37 |
nprivalova | gordc: don't get you. you are worried about happybase version? | 12:38 |
gordc | nprivalova: yeah. iiuc, if someone uses happybase 0.4 (which requirements allow), your code will fail. | 12:39 |
*** claudiub has joined #openstack-ceilometer | 12:39 | |
nprivalova | gordc: ah, I see. We are changing that. We have a chance. Let me find an email | 12:41 |
nprivalova | gordc: Dependency freeze exception for happybase (I would like version 0.8) | 12:41 |
nprivalova | gordc: we may add 0.8 and remove 0.4 in one cr | 12:42 |
nprivalova | gordc: actually I prefer >=0.8... because all other are buggy | 12:43 |
gordc | nprivalova: i see.. yeah, we'll need to depend on that. | 12:46 |
nprivalova | gordc: writing email now | 12:46 |
openstackgerrit | Stéphane Albert proposed a change to openstack/python-ceilometerclient: Statistics groupby handling improvement https://review.openstack.org/80256 | 12:46 |
*** liusheng has quit IRC | 12:50 | |
*** jdob has joined #openstack-ceilometer | 12:56 | |
nprivalova | eglynn: could you please take a look https://review.openstack.org/#/c/78244/ once more? Do you have some more questions? | 13:00 |
eglynn | nprivalova: ... I'm in meetings for the next 2 hours solid, but will look again at this promptly at 1500 UTC | 13:01 |
nprivalova | eglynn: ok, np | 13:01 |
*** zigo has quit IRC | 13:13 | |
*** zigo has joined #openstack-ceilometer | 13:14 | |
*** AMike has quit IRC | 13:15 | |
openstackgerrit | A change was merged to openstack/ceilometer: improve performance of resource-list in sql https://review.openstack.org/80343 | 13:15 |
*** saju_m has joined #openstack-ceilometer | 13:15 | |
*** thomasem has joined #openstack-ceilometer | 13:27 | |
*** sayali has quit IRC | 13:27 | |
openstackgerrit | gordon chung proposed a change to openstack/ceilometer: remove dump tables from previous migrations https://review.openstack.org/83657 | 13:38 |
*** alexpilotti has quit IRC | 13:42 | |
*** flwang has joined #openstack-ceilometer | 13:42 | |
*** prad has joined #openstack-ceilometer | 13:42 | |
*** Wangpan has quit IRC | 13:42 | |
*** Wangpan has joined #openstack-ceilometer | 13:43 | |
*** zigo has quit IRC | 13:47 | |
*** zigo has joined #openstack-ceilometer | 13:47 | |
*** prad has quit IRC | 13:49 | |
*** zigo has quit IRC | 13:51 | |
*** prad has joined #openstack-ceilometer | 13:52 | |
*** zigo has joined #openstack-ceilometer | 13:55 | |
*** zigo has quit IRC | 13:59 | |
*** zigo has joined #openstack-ceilometer | 13:59 | |
*** nacim has quit IRC | 14:00 | |
*** jmckind has joined #openstack-ceilometer | 14:00 | |
*** nacim has joined #openstack-ceilometer | 14:01 | |
*** Ruetobas has quit IRC | 14:04 | |
*** Ruetobas has joined #openstack-ceilometer | 14:11 | |
*** inc0_ has quit IRC | 14:16 | |
*** Ruetobas has quit IRC | 14:16 | |
*** openstack has joined #openstack-ceilometer | 14:20 | |
*** Ruetobas has joined #openstack-ceilometer | 14:22 | |
*** alexpilotti has joined #openstack-ceilometer | 14:27 | |
openstackgerrit | A change was merged to openstack/ceilometer: Documenting hypervisor support for nova meters https://review.openstack.org/79910 | 14:29 |
openstackgerrit | gordon chung proposed a change to openstack/ceilometer: DBDeadlock exception in sql backend https://review.openstack.org/80461 | 14:33 |
openstackgerrit | Nadya Privalova proposed a change to openstack/ceilometer: Use ConectionPool instead of one Connection in HBase https://review.openstack.org/83435 | 14:34 |
*** rwsu has quit IRC | 14:38 | |
*** rwsu has joined #openstack-ceilometer | 14:41 | |
eglynn | nprivalova: see further question inline in https://review.openstack.org/#/c/78244/6/ceilometer/storage/impl_hbase.py | 15:06 |
nprivalova | eglynn: ok | 15:06 |
openstackgerrit | A change was merged to openstack/ceilometer: Remove escape character in string format https://review.openstack.org/83338 | 15:12 |
nprivalova | eglynn: I think that consistency problem still may be. But it's problem of data-model. I'm working on changing it. | 15:12 |
eglynn | nprivalova: I'm not too concerned with the possible interleaving as I think this resolves naturally when the next sample is persisted | 15:15 |
eglynn | nprivalova: however the TODO comment in the code and the reference to future changes is little vague | 15:16 |
nprivalova | eglynn: I think it should be a new bug instead of TODO comment :) | 15:17 |
eglynn | nprivalova: ... how about just being super-specific in the comment, e.g. | 15:17 |
eglynn | "# sample writes may be interleaved, but where slightly outdated resource metadata is persisted, this will naturally resolve when the next sample is encountered" | 15:18 |
eglynn | ... or words to that effect | 15:18 |
eglynn | nprivalova: whereas "this method works ok only in single-thread environment" would tend to set alarm bells off ;) | 15:18 |
nprivalova | eglynn: yep, it should be changed somehow :) | 15:19 |
nprivalova | gordc: are you here? | 15:19 |
openstackgerrit | gordon chung proposed a change to openstack/ceilometer: DO NOT MERGE https://review.openstack.org/83780 | 15:20 |
gordc | nprivalova: yep | 15:21 |
nprivalova | eglynn: it seems to me that Gordon doesn't agree with "resolves naturally when the next sample is persisted". I'm still trying to analyze it... | 15:21 |
nprivalova | gordc: we are talking about https://review.openstack.org/#/c/78244/6/ceilometer/storage/impl_hbase.py | 15:21 |
jd__ | seems we like patches for rc1 | 15:21 |
jd__ | s/like/miss/ | 15:21 |
eglynn | jd__: ttx indicated willingness earlier to cut RC1 on Monday if neccessary to let release-critical patches land | 15:23 |
nprivalova | jd__: https://review.openstack.org/#/c/83435/5 ? <cat from shrek> | 15:23 |
gordc | jd__: we can probably skip https://bugs.launchpad.net/ceilometer/+bug/1259724. the patch is up but it's not important | 15:23 |
eglynn | jd__: ... sounds we're gonna need that flexibility? | 15:23 |
gordc | nprivalova: i think it may eventually resolve with future samples but it's not guaranteed to. | 15:24 |
*** kin has joined #openstack-ceilometer | 15:25 | |
gordc | nprivalova: personally i think it doesn't make sense to get it into rc1 if we know it's going to need a backport to fix it properly. | 15:25 |
jd__ | eglynn: well likely because it's getting late for ttx anyway | 15:25 |
jd__ | I don't think everything will be merged in the next couple of hours | 15:25 |
eglynn | gordc: not guaranteed to if another sample is never received for that resource? | 15:26 |
eglynn | jd__: agreed | 15:26 |
nprivalova | gordc: as I said to eglynn, I'm working on changing model | 15:26 |
jd__ | but Monday should be ok so hurry up! :) | 15:26 |
eglynn | nprivalova: by changing the model, do you mean https://review.openstack.org/#/c/78244 is still a WIP? (i.e. not ready to land yet) | 15:27 |
gordc | eglynn: yeah, ie. if we lose meter and another sample for that meter never comes, it won't show in list of meters for that resource. | 15:27 |
gordc | eglynn: an edge case i guess. | 15:27 |
nprivalova | eglynn: no. new model is definitely a new change request | 15:28 |
eglynn | gordc: ... yeap fair point | 15:30 |
gordc | nprivalova: you'll need a new model to get it working properly with multithread though right? the way i see it, the patches can't coexist together (without adding a disclaimer that it won't always work correctly) | 15:30 |
eglynn | gordc: ... though it might be seen as an acceptable edge case, seeing as the list of meters associated with a resources is kind of secondary info in a sense | 15:31 |
nprivalova | gordc: 1. without Connection Pool Hbase doesn't work now | 15:31 |
eglynn | gordc: ... (as the same info can be reconstructed from the raw samples?) | 15:31 |
*** malini has joined #openstack-ceilometer | 15:32 | |
eglynn | nprivalova: "new model is definitely a new change request" => for RC1 or Juno? | 15:32 |
nprivalova | eglynn: Juno | 15:32 |
nprivalova | eglynn: now I just want to make it work :) | 15:32 |
eglynn | nprivalova: got it | 15:33 |
gordc | eglynn: yep. that was my original suggestion to just use raw samples... right now it seems https://review.openstack.org/#/c/78244 will fix the bug and then connectionpool patch will cause a similar bug to happen again. | 15:33 |
eglynn | nprivalova: so can we address gordc's concern that the two patches are mutually exclusive? | 15:33 |
eglynn | two patches == https://review.openstack.org/78244 & https://review.openstack.org/83435 | 15:34 |
nprivalova | eglynn: let me try to explain again :) | 15:34 |
*** saju_m has quit IRC | 15:35 | |
nprivalova | eglynn: we need https://review.openstack.org/83435 in any case because HBase doesn't work without it | 15:35 |
eglynn | nprivalova: so no 83435 => every falls apart with "Simultaneous file access" | 15:37 |
nprivalova | eglynn: yes | 15:37 |
*** ryanpetrello has left #openstack-ceilometer | 15:37 | |
gordc | nprivalova: just to clarify, you mean doesn't work with multiple collectors or doesn't work (full stop). | 15:37 |
nprivalova | gordc: even if we start 1 collector but use rpc publisher record_metering_data starts to be "not_one_thread" | 15:38 |
gordc | ok. so doesn't work. | 15:38 |
nprivalova | gordc: yep | 15:38 |
malini | Hello!! I saw recent emails in the dev list about updating the Mongo version at the gate - but lost track of where it ended. Were you able to get Mongo updated? | 15:39 |
eglynn | nprivalova: so it sounds like 83435 is absolutely crucial, without it we might as well say HBase isn't supported in Icehouse, correct? | 15:39 |
nprivalova | eglynn: yep | 15:40 |
eglynn | nprivalova: ... in that case 83435 should be marked Critical? | 15:40 |
gordc | tbh, i'd rather have 83435 (after we get requirement bump)... and leave the other patch as a backport (since it'll need one anyways). | 15:40 |
nprivalova | eglynn: 78244 lives not very good with 83435. but it makes things better. without 78244 user will see more inconsistency | 15:41 |
gordc | malini: not sure what status is regarding mongo on gate... i would assume it's a dream for now. | 15:41 |
eglynn | nprivalova: whereas the bug for https://review.openstack.org/78244 is far less serious | 15:42 |
eglynn | nprivalova: ... so if we're gonna sacrifice one for the other? | 15:42 |
nprivalova | eglynn: yep, but I was afraid to mark bug as critical :) | 15:42 |
eglynn | ... https://review.openstack.org/78244 gets bumped | 15:42 |
malini | gordc: do you have a workaround meanwhile? We have the same issue in Marconi & we are considering 3rd part testing | 15:42 |
eglynn | nprivalova: and we mark https://bugs.launchpad.net/ceilometer/+bug/1298455 as critical and land that patch only? | 15:42 |
nprivalova | eglynn, gordc, I'm ok with delay for 78244 | 15:43 |
nprivalova | eglynn: ok, agreed | 15:43 |
eglynn | nprivalova: ... cool, lets do that so ... I'l retarget in LP now | 15:43 |
gordc | nprivalova: eglynn: cool. let's fix the other bug properly as a single backport. | 15:43 |
nprivalova | malini: Mongo on gating seems unreachable :) | 15:44 |
eglynn | nprivalova: ... https://bugs.launchpad.net/ceilometer/+bug/1288284 is now off the radar for RC1 | 15:44 |
eglynn | nprivalova: ... https://bugs.launchpad.net/ceilometer/+bug/1298455 is on for RC1 and critical | 15:44 |
malini | nprivalova: :( | 15:45 |
nprivalova | malini: wrong smile, agreed | 15:45 |
eglynn | nprivalova, gordc: and lets try to get https://review.openstack.org/83435 landed by EoD | 15:45 |
nprivalova | eglynn: and this https://review.openstack.org/#/c/82438/ | 15:45 |
gordc | eglynn: i should bring up there is a clause with that patch. it requires a requiremnts bump | 15:45 |
eglynn | nprivalova: ... a-ha, darn! | 15:46 |
nprivalova | eglynn: :D | 15:46 |
*** nealph has quit IRC | 15:46 | |
eglynn | nprivalova: ... so we're past dependency freeze, since last Tuesday IIRC | 15:46 |
nprivalova | eglynn: there was a discussion in mailing list | 15:47 |
eglynn | nprivalova: so ttx is happy with "happybase>=0.4,!=0.6,!=0.7" | 15:48 |
nprivalova | eglynn: I'll talk to ttx now | 15:48 |
eglynn | http://lists.openstack.org/pipermail/openstack-dev/2014-March/031278.html | 15:48 |
eglynn | nprivalova: ... ^^^ is that sufficient for you? | 15:48 |
nprivalova | eglynn: he doesn't use Ceilometer every day :) Let me try to talk to him | 15:49 |
eglynn | nprivalova: cool | 15:49 |
*** nati_ueno has joined #openstack-ceilometer | 15:54 | |
openstackgerrit | A change was merged to openstack/ceilometer: De-dupe selectable aggregate list in statistics API https://review.openstack.org/83511 | 16:01 |
*** Ruetobas has quit IRC | 16:01 | |
*** Ruetobas has joined #openstack-ceilometer | 16:03 | |
*** mihgen has quit IRC | 16:03 | |
*** giroro_ has joined #openstack-ceilometer | 16:06 | |
*** Ruetobas has quit IRC | 16:08 | |
*** changbl has quit IRC | 16:14 | |
*** _cjones_ has joined #openstack-ceilometer | 16:20 | |
*** claudiub has quit IRC | 16:25 | |
*** nati_ueno has quit IRC | 16:27 | |
eglynn | gordc: FYI nprivalova has decoupled https://review.openstack.org/83435 from https://review.openstack.org/82438 | 16:29 |
eglynn | (ttx is agreed that the "de facto" happybase version used is gonna be 0.8 by any sane deployer of hbase) | 16:30 |
gordc | eglynn: so we're keeping happybase>=0.4,<=0.6 in our requirements? | 16:33 |
eglynn | gordc: yes, with the understanding that in reality (in a deployment that actually uses hbase) these constraints will not be respected | 16:34 |
eglynn | gordc: ... i.e. we turn blind eye to stated requirements in this case | 16:35 |
gordc | eglynn: oh... doesn't it throw requirement failures if you have something outside the range? | 16:36 |
gordc | eglynn: or does it just give you warning? | 16:36 |
eglynn | gordc: do you mean in the gate or in production? | 16:36 |
eglynn | gordc: apparently we don't truely use hbase anywhere in the gate | 16:37 |
gordc | gordc: i guess in production... i really just use devstack which i think stops you from continuing | 16:37 |
*** nealph has joined #openstack-ceilometer | 16:38 | |
eglynn | gordc: TBH I've never used hbase in anger myself, but IIUC in production it would be the distro controlling the versioning, not the requirements we use in-tree | 16:39 |
gordc | eglynn: i see... not a fan of this but i guess since it's an optional path and hidden from gates we can let this in? | 16:41 |
eglynn | gordc: I don't like it either, but seems to me we're caught between a rock and a hard place | 16:41 |
gordc | eglynn: i blame nprivalova if this fails. lol | 16:42 |
eglynn | gordc: ... and this approach presents a pragmatic way out that's been endorsed by our illustrious release manager | 16:42 |
*** vrovachev has quit IRC | 16:43 | |
*** sayalilunkad has joined #openstack-ceilometer | 16:43 | |
*** jaypipes is now known as leakypipes | 16:43 | |
gordc | eglynn: cool cool. something to revisit early in juno. | 16:43 |
eglynn | gordc: definitely! | 16:43 |
gordc | eglynn: did ttx say monday was last day? i guess we only have one rc1 bug left: https://bugs.launchpad.net/ceilometer/+bug/1259724 | 16:45 |
gordc | eglynn: and i'm pretty indifferent whether we get it in or not since it's low priority... makes me wonder if we should just push it and say after connectionpool patch we're done for rc1 | 16:45 |
*** eglynn_ has joined #openstack-ceilometer | 16:47 | |
*** eglynn has quit IRC | 16:48 | |
openstackgerrit | Eoghan Glynn proposed a change to openstack/ceilometer: Add note on aggregate duplication to API docco https://review.openstack.org/83817 | 16:48 |
openstackgerrit | gordon chung proposed a change to openstack/ceilometer: DBDeadlock exception in sql backend https://review.openstack.org/80461 | 16:51 |
*** inc0 has joined #openstack-ceilometer | 16:52 | |
inc0 | good afternoon everyone | 16:53 |
eglynn_ | ... folks I'm gonna delay cutting 1.0.10 until Monday, in line with RC1 | 16:53 |
eglynn_ | ... also gives a chance for https://review.openstack.org/83514 to land | 16:53 |
*** jmckind has quit IRC | 17:03 | |
*** promulo has joined #openstack-ceilometer | 17:10 | |
*** nati_ueno has joined #openstack-ceilometer | 17:11 | |
*** malini has left #openstack-ceilometer | 17:19 | |
*** saju_m has joined #openstack-ceilometer | 17:20 | |
*** sayalilunkad has quit IRC | 17:27 | |
*** changbl has joined #openstack-ceilometer | 17:27 | |
*** saju_m has quit IRC | 17:35 | |
*** saju_m has joined #openstack-ceilometer | 17:36 | |
*** promulo has quit IRC | 17:36 | |
*** promulo has joined #openstack-ceilometer | 17:36 | |
*** eglynn_ has quit IRC | 17:46 | |
*** inc0 has quit IRC | 17:53 | |
*** nacim has quit IRC | 17:54 | |
openstackgerrit | gordon chung proposed a change to openstack/ceilometer: test do not merge https://review.openstack.org/83842 | 17:55 |
*** ildikov_ has quit IRC | 18:17 | |
*** Alexei_987 has quit IRC | 18:27 | |
*** shakayumi has joined #openstack-ceilometer | 18:44 | |
*** shakayumi has quit IRC | 18:44 | |
openstackgerrit | A change was merged to openstack/ceilometer: Use ConectionPool instead of one Connection in HBase https://review.openstack.org/83435 | 18:47 |
*** openstackgerrit has quit IRC | 18:48 | |
*** openstackgerrit has joined #openstack-ceilometer | 18:48 | |
*** shakayumi has joined #openstack-ceilometer | 18:58 | |
*** shakayumi has quit IRC | 18:58 | |
*** _nadya_ has joined #openstack-ceilometer | 18:58 | |
*** _nadya_ has quit IRC | 18:59 | |
*** _nadya_ has joined #openstack-ceilometer | 19:00 | |
*** _nadya_ has quit IRC | 19:05 | |
openstackgerrit | A change was merged to openstack/ceilometer: remove dump tables from previous migrations https://review.openstack.org/83657 | 19:06 |
*** _nadya_ has joined #openstack-ceilometer | 19:16 | |
openstackgerrit | gordon chung proposed a change to openstack/ceilometer: test do not merge https://review.openstack.org/83842 | 19:26 |
*** Alexei_987 has joined #openstack-ceilometer | 19:31 | |
*** ildikov_ has joined #openstack-ceilometer | 19:34 | |
Alexei_987 | gordc: Hi you can ping me here to reduce latency between comments | 20:11 |
*** yassine has quit IRC | 20:16 | |
*** _nadya_ has quit IRC | 20:25 | |
*** julim has quit IRC | 20:27 | |
gordc | Alexei_987: whoops. didn't see your msg. my bad. | 20:30 |
Alexei_987 | gordc: we almost agreed anyway | 20:31 |
gordc | i added a comment... let me know what you think we can go from there. this isn't really targetting rc1 unless people find it useful as a stopgap between proper schema fix in Juno. | 20:32 |
Alexei_987 | gordc: what is the simplest way to reproduce this issue? | 20:32 |
Alexei_987 | gordc: running devstack with workers > 5 would be enough? | 20:32 |
gordc | Alexei_987: ok sounds good. sorry for misleading title. was just quoting the error the database throws... | 20:33 |
gordc | Alexei_987: i've tried to reproduce it all today. it's being masked by maximum recursion error. | 20:33 |
*** julim has joined #openstack-ceilometer | 20:33 | |
Alexei_987 | gordc: you mean you get a recursion on create_or_update? | 20:34 |
gordc | Alexei_987: yes. so when i added logic to fix _create_or_update, i made it 'retry' by calling itself.... in previous code it'd do a requery. | 20:35 |
Alexei_987 | gordc: (facepalm) | 20:35 |
gordc | https://github.com/openstack/ceilometer/commit/21237b333ca2e6766a74dc28c5f788160349a9ce#diff-f0fc20a5e281dd5d212292afe53c6670 | 20:35 |
Alexei_987 | gordc: yeah I've seen this one | 20:35 |
Alexei_987 | gordc: it seems that our test sucks | 20:36 |
Alexei_987 | gordc: cause we are letting huge amount of bugs to slip through | 20:36 |
gordc | well the recursion works unless your writing too slowly... | 20:36 |
Alexei_987 | gordc: "works unless" is not good | 20:37 |
Alexei_987 | slow writes may happen for many reasons | 20:37 |
gordc | Alexei_987: so it's technically pointing us to performance problem... i switch to recursion since previously it was just guessing (often wrong) that a obj would be found on query | 20:38 |
gordc | Alexei_987: also, this code is not testable against sqlite...we need the real backend tests enabled | 20:38 |
Alexei_987 | gordc: I've proposed a session on summit to discuss performance issues and new data model | 20:38 |
Alexei_987 | we could make postgres tests work | 20:38 |
Alexei_987 | only review is needed :) | 20:39 |
gordc | Alexei_987: cool, that'll be approved... performance was one of main concerns Julien and i had. | 20:39 |
gordc | Alexei_987: we can't put it in post FFE! follow the rules! lol | 20:39 |
openstackgerrit | Eoghan Glynn proposed a change to openstack/ceilometer: Add note on aggregate duplication to API docco https://review.openstack.org/83817 | 20:40 |
Alexei_987 | gordc: I just don't like the fact that we are applying many hotfixes just to push release out | 20:40 |
Alexei_987 | I think that a cleaner way would be to postpone release and fix code properly | 20:40 |
gordc | Alexei_987: you'll run into arguments what needs to be 'fixed' and the scope will drag the postponement on forever. | 20:41 |
Alexei_987 | gordc: I prefer having nightly builds and proper tests | 20:42 |
gordc | Alexei_987: perfect world sure... this isn't. i see post FFE as fix small stuff and fix critical stuff. | 20:42 |
Alexei_987 | gordc: in such case any build is stable enough to be released | 20:42 |
gordc | Alexei_987: +1000 proper tests | 20:42 |
gordc | Alexei_987: when the real backend tests get in we'll be better. (hopefully) | 20:43 |
gordc | Alexei_987: that said postgres is the db with issues. mysql is the one throwing most of the issues. | 20:43 |
Alexei_987 | gordc: I had both of them passing tests locally :) | 20:44 |
gordc | Alexei_987: share your password so we can all huddle around and use it :) | 20:44 |
*** alexpilotti has quit IRC | 20:45 | |
Alexei_987 | gordc: it's running from this branch https://github.com/Alexei-Kornienko/ceilometer/tree/real-backends | 20:45 |
gordc | Alexei_987: tempest should catch most of these issues... shame we have issues getting it to work. | 20:45 |
Alexei_987 | gordc: question about tempest - how can we test all backends on tempest? | 20:46 |
Alexei_987 | since it provides deployment with only 1 backend | 20:46 |
gordc | Alexei_987: well i think there is a hope mongo will be available in future.... hbase is going to be a harder sell. | 20:47 |
Alexei_987 | gordc: I will also support hbase soon :) | 20:47 |
Alexei_987 | I will help nprivalova in supporting/developing it | 20:47 |
openstackgerrit | Eoghan Glynn proposed a change to openstack/ceilometer: Add note on aggregate duplication to API docco https://review.openstack.org/83817 | 20:48 |
gordc | Alexei_987: i'm thinking we should really choose 2 or 3 backends and say 'we officially will work on these backends' if you want somehting else, you'll need to manage it yourself. | 20:48 |
gordc | Alexei_987: yeah, hbase will be awesome once we get it going. | 20:48 |
Alexei_987 | gordc: +1 to choose blessed backend | 20:48 |
openstackgerrit | Eoghan Glynn proposed a change to openstack/ceilometer: Add note on aggregate duplication to API docco https://review.openstack.org/83817 | 20:49 |
gordc | i think we should choose to really work hard on sql and hbase (or cassandra) and maybe mongo... we can't keep supporting every single db...we should leave the rest as 'use your db against this interface' | 20:49 |
gordc | Alexei_987: i think we tried to choose one in HK. but no one was prepared to answer teh question. | 20:50 |
Alexei_987 | gordc: voting on mongodb :) | 20:51 |
gordc | Alexei_987: we should do a poll... i'm all for hbase and cassandra if they're easy to set up... sooo not hbase :) | 20:52 |
Alexei_987 | gordc: we should take many factors into account | 20:53 |
Alexei_987 | gordc: especially good horizontal scalability and reliability | 20:53 |
Alexei_987 | gordc: I don't think that easy setup is enough | 20:54 |
gordc | Alexei_987: make an action item -- everyone come to summit with notes on what db they want... and we'll argue for a hour until we end up with 2 officiall databases. | 20:54 |
*** _nadya_ has joined #openstack-ceilometer | 20:55 | |
gordc | you have a link to your performance session? just so i know what you want to cover and see if we need additional sessions. | 20:55 |
Alexei_987 | gordc: http://summit.openstack.org/cfp/details/163 | 20:56 |
Alexei_987 | gordc: database backend can also be discussed during this session | 20:56 |
Alexei_987 | since it's coupled with data model | 20:56 |
Alexei_987 | at least on the level of SQL vs NoSQL | 20:56 |
gordc | yeah. it'd be good to choose a backend or two and then agree on how to model each one.... right now all our dbs have the same model which make no sense as they're different dbs | 20:57 |
gordc | Alexei_987: we might need two sessions for that but we'll figure it out. | 20:58 |
Alexei_987 | gordc: I'm just afraid that with many sessions we would not be able to attend all of them | 20:59 |
*** julim has quit IRC | 20:59 | |
Alexei_987 | gordc: since I plan to visit not only ceilometer discussions | 20:59 |
gordc | Alexei_987: who said you can work on other stuff outside ceilometer! :) | 21:00 |
gordc | Alexei_987: we'll see what sessions are proposed. but yeah, data model is defiinitely a key topic. | 21:01 |
Alexei_987 | gordc: It's quite hard to have your stuff reviewed quickly so have to find other places to contribute to | 21:01 |
gordc | Alexei_987: yeah, this session was a bit cluttered (a lot of people focused outside ceilometer). hoping we're a bit more focused in Juno especially before Juno-3. Icehouse-3 was just flooded here. | 21:03 |
gordc | this /session/cycle/ | 21:03 |
Alexei_987 | gordc: let's discuss latest gossip :) who plans to be a PTL for the next cycle? | 21:05 |
gordc | lol pm me. j/k | 21:05 |
gordc | i guess anyone can be nomiated.... we'll see. | 21:05 |
gordc | i need to head out to run some errands. good hearing your ideas... enjoy your weekend. | 21:06 |
Alexei_987 | gordc: have a nice day :) | 21:06 |
*** gordc has quit IRC | 21:07 | |
*** jergerber has joined #openstack-ceilometer | 21:08 | |
*** jdob has quit IRC | 21:11 | |
*** _nadya_ has quit IRC | 21:50 | |
*** thomasem has quit IRC | 21:53 | |
*** prad has quit IRC | 22:02 | |
*** _nadya_ has joined #openstack-ceilometer | 22:18 | |
*** _nadya_ has quit IRC | 22:33 | |
*** _nadya_ has joined #openstack-ceilometer | 22:35 | |
*** jergerber has quit IRC | 22:57 | |
*** dhellmann is now known as dhellmann_ | 23:13 | |
*** giroro_ has quit IRC | 23:54 | |
*** julim has joined #openstack-ceilometer | 23:54 | |
*** leakypipes has quit IRC | 23:55 | |
*** leakypipes has joined #openstack-ceilometer | 23:55 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!