*** prad_ has quit IRC | 00:09 | |
openstackgerrit | Boris Pavlovic proposed a change to openstack/ceilometer-specs: Add spec for osprofiler notification plugin https://review.openstack.org/102393 | 00:18 |
---|---|---|
openstackgerrit | A change was merged to openstack/python-ceilometerclient: Fix alarm-threshold-update --query option https://review.openstack.org/90882 | 00:20 |
*** jaypipes has quit IRC | 00:35 | |
*** matsuhashi has joined #openstack-ceilometer | 00:35 | |
openstackgerrit | Lianhao Lu proposed a change to openstack/ceilometer: Fixed various import issues exposed by unittest https://review.openstack.org/99280 | 00:50 |
*** ddieterly has joined #openstack-ceilometer | 00:59 | |
*** _cjones_ has quit IRC | 01:03 | |
*** _cjones_ has joined #openstack-ceilometer | 01:04 | |
*** _cjones_ has quit IRC | 01:08 | |
*** fnaval has joined #openstack-ceilometer | 01:10 | |
*** Qiming has joined #openstack-ceilometer | 01:23 | |
*** nati_ueno has quit IRC | 01:40 | |
*** Qiming has quit IRC | 01:42 | |
*** ddieterly has quit IRC | 01:49 | |
*** Ruetobas has quit IRC | 01:51 | |
*** nosnos has joined #openstack-ceilometer | 01:51 | |
*** alexpilotti has quit IRC | 01:55 | |
*** nosnos has quit IRC | 01:56 | |
*** nosnos has joined #openstack-ceilometer | 01:57 | |
*** Ruetobas has joined #openstack-ceilometer | 01:58 | |
*** Ruetobas has quit IRC | 02:02 | |
*** Ruetobas has joined #openstack-ceilometer | 02:03 | |
openstackgerrit | liusheng proposed a change to openstack/ceilometer: Fix SQL exception getting statitics with metaquery https://review.openstack.org/102150 | 02:05 |
openstackgerrit | Shuangtai Tian proposed a change to openstack/ceilometer: Bump hacking to 0.9.x https://review.openstack.org/99276 | 02:14 |
*** ddieterly has joined #openstack-ceilometer | 02:20 | |
*** ddieterly has quit IRC | 02:25 | |
*** openstackgerrit has quit IRC | 02:31 | |
*** changbl has joined #openstack-ceilometer | 02:32 | |
*** ddieterly has joined #openstack-ceilometer | 02:34 | |
*** ddieterl_ has joined #openstack-ceilometer | 02:36 | |
*** mitz_ has joined #openstack-ceilometer | 02:36 | |
*** ddieterly has quit IRC | 02:38 | |
*** ddieterl_ has quit IRC | 02:40 | |
*** Alice911 has joined #openstack-ceilometer | 02:42 | |
*** ddieterly has joined #openstack-ceilometer | 02:43 | |
*** Qiming has joined #openstack-ceilometer | 02:47 | |
*** nati_ueno has joined #openstack-ceilometer | 03:25 | |
*** terriyu has quit IRC | 03:34 | |
*** matsuhashi has quit IRC | 03:42 | |
*** matsuhashi has joined #openstack-ceilometer | 03:43 | |
*** ddieterly has quit IRC | 03:45 | |
*** matsuhashi has quit IRC | 03:47 | |
*** nosnos has quit IRC | 03:51 | |
*** terriyu has joined #openstack-ceilometer | 04:00 | |
*** nati_ueno has quit IRC | 04:08 | |
*** nati_ueno has joined #openstack-ceilometer | 04:09 | |
*** deepthi has joined #openstack-ceilometer | 04:12 | |
*** nati_ueno has quit IRC | 04:29 | |
*** matsuhashi has joined #openstack-ceilometer | 04:31 | |
*** nosnos has joined #openstack-ceilometer | 04:37 | |
*** terriyu has quit IRC | 04:41 | |
boris-42 | ildikov hi | 04:47 |
*** ajc_ has joined #openstack-ceilometer | 04:59 | |
*** Underyx|off has joined #openstack-ceilometer | 05:03 | |
*** Underyx|off is now known as underyx | 05:03 | |
*** underyx is now known as Guest13909 | 05:03 | |
*** ddieterly has joined #openstack-ceilometer | 05:04 | |
*** fnaval has quit IRC | 05:05 | |
*** ddieterly has quit IRC | 05:08 | |
*** Guest13909 is now known as Underyx|off | 05:14 | |
*** psharma has joined #openstack-ceilometer | 05:16 | |
*** nati_ueno has joined #openstack-ceilometer | 05:17 | |
*** rwsu has quit IRC | 05:24 | |
*** nati_ueno has quit IRC | 05:26 | |
*** ildikov has quit IRC | 05:27 | |
*** zqfbot has quit IRC | 05:30 | |
*** zqfbot has joined #openstack-ceilometer | 05:33 | |
*** ddieterly has joined #openstack-ceilometer | 05:34 | |
*** ddieterly has quit IRC | 05:38 | |
*** yatin has joined #openstack-ceilometer | 05:44 | |
*** ildikov has joined #openstack-ceilometer | 05:44 | |
ildikov | boris-42: hi | 06:05 |
*** inc0_ has joined #openstack-ceilometer | 06:21 | |
*** _nadya_ has joined #openstack-ceilometer | 06:25 | |
*** ddieterly has joined #openstack-ceilometer | 06:34 | |
*** ddieterly has quit IRC | 06:39 | |
*** psharma_ has joined #openstack-ceilometer | 06:42 | |
*** nati_ueno has joined #openstack-ceilometer | 06:42 | |
*** psharma__ has joined #openstack-ceilometer | 06:45 | |
*** psharma has quit IRC | 06:45 | |
*** psharma_ has quit IRC | 06:49 | |
*** psharma_ has joined #openstack-ceilometer | 06:52 | |
*** psharma__ has quit IRC | 06:55 | |
*** _nadya_ has quit IRC | 07:01 | |
boris-42 | ildikov hi there one more time=) | 07:01 |
*** Qiming has quit IRC | 07:02 | |
*** Underyx|off is now known as underyx | 07:03 | |
boris-42 | ildikov hm I finished spec for my patch https://review.openstack.org/#/c/102393/ | 07:05 |
boris-42 | ildikov lol it's bigger then patch=) | 07:05 |
*** _cjones_ has joined #openstack-ceilometer | 07:09 | |
ildikov | boris-42: haha :) it can happen nowadays :) | 07:10 |
*** _cjones_ has quit IRC | 07:10 | |
ildikov | boris-42: I saw that you uploaded the spec, I will try to have a look at today | 07:11 |
*** _cjones_ has joined #openstack-ceilometer | 07:11 | |
boris-42 | ildikov thank you | 07:11 |
ildikov | boris-42: np! | 07:12 |
*** yatin has quit IRC | 07:13 | |
*** Qiming has joined #openstack-ceilometer | 07:17 | |
*** yatin has joined #openstack-ceilometer | 07:17 | |
*** ifarkas has joined #openstack-ceilometer | 07:20 | |
*** yatin has quit IRC | 07:23 | |
*** ddieterly has joined #openstack-ceilometer | 07:34 | |
*** Longgeek has joined #openstack-ceilometer | 07:37 | |
*** Longgeek has quit IRC | 07:37 | |
*** Longgeek has joined #openstack-ceilometer | 07:37 | |
*** _nadya_ has joined #openstack-ceilometer | 07:38 | |
*** ddieterly has quit IRC | 07:39 | |
*** ddieterly has joined #openstack-ceilometer | 07:46 | |
*** ddieterly has quit IRC | 07:50 | |
*** matsuhashi has quit IRC | 07:57 | |
*** matsuhashi has joined #openstack-ceilometer | 07:58 | |
*** _cjones__ has joined #openstack-ceilometer | 08:00 | |
*** IvanBerezovskiy has joined #openstack-ceilometer | 08:01 | |
*** _cjones_ has quit IRC | 08:03 | |
*** matsuhashi has quit IRC | 08:05 | |
*** matsuhashi has joined #openstack-ceilometer | 08:10 | |
*** matsuhashi has quit IRC | 08:17 | |
*** matsuhashi has joined #openstack-ceilometer | 08:18 | |
*** amarao has joined #openstack-ceilometer | 08:18 | |
*** nijaba has joined #openstack-ceilometer | 08:21 | |
*** nijaba has quit IRC | 08:22 | |
*** nijaba has joined #openstack-ceilometer | 08:22 | |
*** _cjones__ has quit IRC | 08:23 | |
*** _cjones_ has joined #openstack-ceilometer | 08:23 | |
*** yatin has joined #openstack-ceilometer | 08:24 | |
*** isviridov|away is now known as isviridov | 08:26 | |
*** matsuhashi has quit IRC | 08:31 | |
*** Ju_ has quit IRC | 08:34 | |
*** _cjones_ has quit IRC | 08:40 | |
*** _cjones_ has joined #openstack-ceilometer | 08:41 | |
*** _cjones_ has quit IRC | 08:45 | |
*** eglynn has joined #openstack-ceilometer | 08:45 | |
*** nosnos has quit IRC | 08:45 | |
*** openstackgerrit has joined #openstack-ceilometer | 08:52 | |
*** nijaba has quit IRC | 08:56 | |
*** _nadya_ has quit IRC | 09:03 | |
DinaBelova | eglynn, o/ Just read your msg to amalagon about "Options for Period-Spanning Statistics in Gnocchi" doc - what's this? | 09:12 |
DinaBelova | eglynn, sorry, I think I missed this somehow.. | 09:12 |
eglynn | DinaBelova: good morning! | 09:15 |
eglynn | DinaBelova: ... that's just a write-up that Ana is working on | 09:15 |
DinaBelova | eglynn, good morning sir! | 09:15 |
eglynn | DinaBelova ... of options for computing moving-averages, exponential smoothing and the likes, over gnocchi time-series | 09:15 |
DinaBelova | eglynn, oh, so that's not published yet? | 09:15 |
eglynn | DinaBelova: (her OPW project is based on that idea) | 09:15 |
eglynn | DinaBelova: ... no it's just a rough WIP deriving from an IRC conversation earlier in the week | 09:16 |
DinaBelova | eglynn, oh, ok! | 09:16 |
eglynn | DinaBelova: ... but I can cerrainly ask her to share it more widely if you're interested? | 09:16 |
DinaBelova | eglynn, yes, please! | 09:16 |
DinaBelova | eglynn, really it's interesting topic | 09:16 |
eglynn | DinaBelova: np! ... she'll prolly want to polish a bit more, but additional eyes would be good | 09:17 |
DinaBelova | eglynn, and I guess it might be really helpful | 09:17 |
DinaBelova | eglynn, thank you sir | 09:17 |
openstackgerrit | Tatsuro Makita proposed a change to openstack/ceilometer: Add log output of "x-openstack-request-id" from nova https://review.openstack.org/101465 | 09:18 |
DinaBelova | eglynn, btw, strangely our openstackgerrit bot is failing really frequently - SergeyLukjanov had to restart it yesterday evening and this morning too :-\ | 09:19 |
eglynn | DinaBelova: yeah, is there a separate bot per project? ... or a single global one? | 09:20 |
eglynn | DinaBelova: ... we've hardly been working it to death recently | 09:20 |
DinaBelova | eglynn, it's one shared bot | 09:21 |
DinaBelova | but sometimes it losts some of the channels | 09:21 |
eglynn | a-ha | 09:21 |
DinaBelova | and ceilometer channel is lucky one :D | 09:21 |
eglynn | DinaBelova: ... just outta interest, did you get OpenTSDB up & running? | 09:21 |
* eglynn is just casting around for realistic comparison points with gnocchi and infux ... | 09:21 | |
* eglynn notes with interest ... | 09:22 | |
eglynn | "OpenTSDB stores data at the original resolution indefinitely, requesting data for a long time span can return millions of points." | 09:22 |
DinaBelova | eglynn, not myself | 09:22 |
eglynn | ... it's also made outta Java | 09:22 |
eglynn | ... ickkk! | 09:22 |
DinaBelova | it's hbase based | 09:22 |
eglynn | yeah | 09:23 |
DinaBelova | that's why it has all pros and cons of hbase :) | 09:23 |
DinaBelova | it's fast, scalable, good working with the time-series data (due to built-it tim fields, etc) | 09:23 |
DinaBelova | but it's not so easy as Mongo, for instance | 09:23 |
eglynn | yeah | 09:24 |
eglynn | ... the hbase-tax ;) | 09:24 |
DinaBelova | :D | 09:24 |
DinaBelova | hehe, indeed | 09:24 |
eglynn | the point in their docco about data retention was interesting | 09:24 |
eglynn | policy seems to be ... keep everything | 09:24 |
eglynn | ... but also provide simple downsampling of query results | 09:25 |
eglynn | also their notion of aggregation is a little different to ours | 09:25 |
eglynn | for OpenTSDB, aggregation is a way of *combining* datapoints from multiple time-series | 09:26 |
eglynn | (as opposed to rolling up data to a lower resultion *within* a single time-series) | 09:26 |
eglynn | WTF is "resultion" eglynn? | 09:26 |
eglynn | *resolution | 09:27 |
DinaBelova | eglynn, sorry, did not get your "WTF is "resultion" eglynn?" | 09:27 |
eglynn | DinaBelova: just talking to myself, poking fun at my chronic inability to spell stuff ... | 09:28 |
DinaBelova | heh, sorry :D | 09:28 |
DinaBelova | as for the openstdb | 09:28 |
DinaBelova | yes, they have other solutions that are chosen by pandas, for instance | 09:28 |
eglynn | "other solutions" for metric storage? | 09:29 |
DinaBelova | I'm about the aggregation stuff that's built-in | 09:29 |
eglynn | a-ha, k | 09:29 |
DinaBelova | not pandas, probably, but current gnocchi stuff - wrong word combination, sorry | 09:30 |
DinaBelova | but still it has lots of advantages - speaking about large scale thing | 09:30 |
DinaBelova | and I found the python client for them | 09:31 |
eglynn | DinaBelova: you've lost me there on the "current gnocchi stuff"? | 09:31 |
boris-42 | eglynn pls take a look at my spec =) | 09:31 |
*** nati_ueno has quit IRC | 09:31 | |
eglynn | boris-42: yep, it's on my list | 09:31 |
boris-42 | eglynn thank you | 09:31 |
*** safchain has joined #openstack-ceilometer | 09:32 | |
DinaBelova | eglynn, nah, sorry, I just mean that current gnocchi == pandas + swift with our own solutions about aggregation, etc. if it'll be opentsdb backend, we'll need to check that all our 'vocabulary' is ok to be used in the opentsdb world | 09:32 |
DinaBelova | eglynn, but i guess it'll be ok :) | 09:33 |
eglynn | DinaBelova: a-ha, yes, I see what you mean ... concern about possible "impedance mismatch" between aggregation models | 09:34 |
*** _nadya_ has joined #openstack-ceilometer | 09:34 | |
DinaBelova | eglynn, yes - as we have chosen one of them, opentsdb uses other one | 09:34 |
DinaBelova | but anyway, we may extend what do we name 'aggregation' | 09:35 |
DinaBelova | and make this backend-specific, for instance | 09:35 |
DinaBelova | or find more common meaning for this inside our code | 09:35 |
DinaBelova | eglynn, btw - https://pypi.python.org/pypi/potsdb/0.0.7 | 09:35 |
eglynn | DinaBelova: so IIUC, our concept of aggregation is more akin to the OpenTSDB concept of downsampling | 09:35 |
DinaBelova | eglynn, yes - like making dataset smaller | 09:36 |
*** nosnos has joined #openstack-ceilometer | 09:36 | |
DinaBelova | well, not the dataset, but 'some amount of data is the average meaning' | 09:36 |
*** matsuhashi has joined #openstack-ceilometer | 09:36 | |
DinaBelova | their aggregation is like 'combination' | 09:37 |
DinaBelova | sorry, dunno how to name this stuff better | 09:37 |
*** nijaba has joined #openstack-ceilometer | 09:37 | |
*** nijaba has quit IRC | 09:37 | |
*** nijaba has joined #openstack-ceilometer | 09:37 | |
eglynn | their tagging notion is interesting too ... | 09:38 |
eglynn | e.g. a datapoint of form ... cpu_util time0 42% host=X instance=Y autoscaling.group=Z | 09:38 |
*** Alice911 has quit IRC | 09:39 | |
eglynn | the host, instance, autoscaling.group tags then form different dimensions along which these data can be "aggregated" | 09:39 |
DinaBelova | eglynn, yes, and it's flexible enough imho | 09:39 |
*** Alice911 has joined #openstack-ceilometer | 09:40 | |
eglynn | ... so I guess the interesting thing is we don't currently have a gnocchi concept analogous to tags | 09:41 |
eglynn | (IIUC) | 09:41 |
DinaBelova | eglynn, yes, we just have one way of aggregation now | 09:41 |
DinaBelova | and no, well, ways to choose what and how to aggregate | 09:42 |
*** Alice911 has quit IRC | 09:42 | |
DinaBelova | I guess that is future it might be some common interface - that will have different capabilities for different backends | 09:42 |
DinaBelova | eglynn, imho opentsdb is a better solution (comparing with the influxdb, for instance), as that's more stable and well-supported thing | 09:44 |
DinaBelova | as it's not the new one in this world | 09:45 |
eglynn | DinaBelova: ... I've been thinking that we'll need to tackle some form of dimensionality in gnocchi anyway | 09:45 |
eglynn | DinaBelova: ... so *something* around that will be needed I think as a "core capability" | 09:45 |
eglynn | DinaBelova: ... re. OpenTSDB versus InfluxDB | 09:45 |
DinaBelova | eglynn, indeed - probably we can use 'tagging' naming here, btw | 09:46 |
DinaBelova | it's a good one | 09:46 |
eglynn | DinaBelova: ... we'll have one of the main influx contributors attending in Paris next week | 09:46 |
DinaBelova | eglynn, cool! | 09:46 |
eglynn | DinaBelova: ... so we could get him to do a compare-and-contrast with OpenTSDB | 09:46 |
DinaBelova | yes, it'll be simply great | 09:47 |
DinaBelova | eglynn, btw :) | 09:47 |
DinaBelova | I have goood news :) | 09:47 |
eglynn | DinaBelova: ... I'm sure he encountered that question once or twice before | 09:47 |
DinaBelova | I got visa :) | 09:47 |
eglynn | DinaBelova: cool, the 4am trip not wasted so :) | 09:47 |
DinaBelova | eglynn, heh, yes, comparing here will be anyway | 09:47 |
DinaBelova | eglynn, yes, I feel happy :D | 09:47 |
*** _nadya_ has quit IRC | 09:52 | |
openstackgerrit | Igor Degtiarov proposed a change to openstack/ceilometer: Fix E251 violations and re-enable gating https://review.openstack.org/102479 | 09:53 |
*** Qiming has quit IRC | 09:53 | |
SergeyLukjanov | eglynn, btw trusty will be the default slave soon | 09:54 |
SergeyLukjanov | eglynn, probably today :) | 09:54 |
eglynn | SergeyLukjanov: yeah that great news! | 09:54 |
*** matsuhashi has quit IRC | 09:54 | |
eglynn | SergeyLukjanov: ... mtreinish & clarkb were talking about it last night at the project/release meeting | 09:55 |
SergeyLukjanov | eglynn, yup | 09:55 |
*** matsuhashi has joined #openstack-ceilometer | 09:55 | |
* eglynn looks forward to full gating against mongodb finally! :) | 09:55 | |
SergeyLukjanov | eglynn, I've been extremely sleepy at this meething, so, duplicating :) | 09:55 |
eglynn | SergeyLukjanov: nah, it is major step forward, /me is a happy man! :) | 09:56 |
ildikov | SergeyLukjanov: duplicating good news is always accepted :) | 09:56 |
*** yatin has quit IRC | 09:57 | |
eglynn | SergeyLukjanov: ... though of course the downside for me | 09:57 |
SergeyLukjanov | eglynn, ildikov ;) | 09:57 |
eglynn | SergeyLukjanov: ... is that it somewhat cuts the legs out from under one motivation for using Fedora20 more widely in the gate | 09:57 |
*** matsuhas_ has joined #openstack-ceilometer | 09:57 | |
*** matsuhashi has quit IRC | 09:57 | |
eglynn | SergeyLukjanov: ... but hey, that's an argument for another day | 09:57 |
eglynn | SergeyLukjanov: ... BTW presumably you'll be in Darmstadt at the qa/infra meetup? | 09:58 |
SergeyLukjanov | eglynn, I'm don't think that fedora will be popular for gate due to the too many releases :) | 09:58 |
eglynn | SergeyLukjanov: (... there will also be a couple Red Hatters there beating the f20/centos7 drum) | 09:58 |
SergeyLukjanov | eglynn, I'm not planning going to the Darmstadt right now | 09:58 |
eglynn | SergeyLukjanov: ... a-ha, k | 09:58 |
SergeyLukjanov | eglynn, but I'll be on your sprint with Dina :) | 09:59 |
*** underyx is now known as Underyx|off | 09:59 | |
eglynn | SergeyLukjanov: excellent! :) | 09:59 |
SergeyLukjanov | eglynn, are you going to Darmstadt? | 10:01 |
eglynn | SergeyLukjanov: probably not, but there are a couple other Red Hatters going | 10:02 |
eglynn | SergeyLukjanov: ... unfortunately that's not likely to include ianw though | 10:02 |
eglynn | SergeyLukjanov: ... logistics of travelling from .au are too prolly awkward for him | 10:03 |
eglynn | SergeyLukjanov: ... but Attila and Pavel will be there and on hand to address some of the f20-related concerns | 10:03 |
eglynn | SergeyLukjanov: (... e.g. the starvation issue in the nodepool grant allocation aglo) | 10:04 |
eglynn | *algo | 10:04 |
*** _nadya_ has joined #openstack-ceilometer | 10:18 | |
openstackgerrit | Igor Degtiarov proposed a change to openstack/ceilometer: Fix E265 violations and re-enable gating https://review.openstack.org/102485 | 10:19 |
SergeyLukjanov | eglynn, cool | 10:19 |
DinaBelova | eglynn, hehe, I *love* this chain :D https://review.openstack.org/#/c/102485/1 | 10:21 |
DinaBelova | that's the top commit there :) | 10:21 |
DinaBelova | better code - better project :) | 10:21 |
*** amarao has quit IRC | 10:22 | |
eglynn | ... and more OCD-prone coders ;) | 10:22 |
DinaBelova | eglynn :D | 10:23 |
*** _nadya_ has quit IRC | 10:27 | |
*** _nadya_ has joined #openstack-ceilometer | 10:28 | |
*** matsuhas_ has quit IRC | 10:28 | |
*** matsuhashi has joined #openstack-ceilometer | 10:28 | |
*** Underyx|off is now known as underyx | 10:30 | |
*** ifarkas has quit IRC | 10:32 | |
*** matsuhashi has quit IRC | 10:37 | |
*** matsuhashi has joined #openstack-ceilometer | 10:37 | |
*** yatin has joined #openstack-ceilometer | 10:50 | |
SergeyLukjanov | eglynn, https://review.openstack.org/#/c/102323/1 | 10:57 |
SergeyLukjanov | :) | 10:57 |
eglynn | SergeyLukjanov: nice :) | 10:59 |
openstackgerrit | Igor Degtiarov proposed a change to openstack/ceilometer: Fix F402 violations and re-enable gating https://review.openstack.org/102492 | 11:14 |
DinaBelova | eglynn, btw, are there any webinar records? | 11:28 |
DinaBelova | I had no opportunity to attend, but I really would like to go through it ^) | 11:28 |
*** yatin has quit IRC | 11:29 | |
eglynn | DinaBelova: slides ... http://www.slideshare.net/openstack/telemetry-juno | 11:29 |
eglynn | DinaBelova: audio will be on youtube in a couple days apparently | 11:29 |
DinaBelova | eglynn, thanks a lot! | 11:29 |
eglynn | DinaBelova: ... on this channel http://www.youtube.com/user/OpenStackFoundation | 11:41 |
DinaBelova | eglynn, thank you! | 11:41 |
*** yatin has joined #openstack-ceilometer | 11:44 | |
*** erecio has joined #openstack-ceilometer | 11:44 | |
*** dmsimard_away is now known as dmsimard | 11:49 | |
openstackgerrit | Ladislav Smola proposed a change to openstack/ceilometer: Enhancing test data script for UI testing https://review.openstack.org/102502 | 11:54 |
*** amarao has joined #openstack-ceilometer | 11:55 | |
DinaBelova | lsmola__, o/ https://review.openstack.org/#/c/102225/ won't be good for you in the future? :) | 11:56 |
lsmola__ | DinaBelova: I started to poke about the other script https://review.openstack.org/#/c/102502/ | 11:58 |
DinaBelova | hehe, I see this :) | 11:58 |
DinaBelova | ok, I'm glad the current one meets all your needs :) | 11:58 |
lsmola__ | DinaBelova: I will comment the sample generator, seems like those two should have similar interface | 11:58 |
DinaBelova | lsmola__, I guess it'll be nice - please feel free to do this :) | 12:00 |
lsmola__ | DinaBelova: yeah, I will just make some minor enhancement and it should be enough for shellscript that will set complete set of meters for UI testing | 12:00 |
lsmola__ | DinaBelova: btw. for us we will probably want to see how the UI looks like with year of data | 12:01 |
lsmola__ | DinaBelova: which will be quicker if we put it directly into DB | 12:01 |
*** terriyu has joined #openstack-ceilometer | 12:01 | |
DinaBelova | lsmola__, what do you mean here? | 12:06 |
DinaBelova | sorry, I may not understand you correctly | 12:06 |
DinaBelova | what kind of data do you want to see presented in the db? | 12:06 |
lsmola__ | DinaBelova: like the other script is sending it through messaging system, so setting large number of samples will eb slower | 12:07 |
DinaBelova | a-ha, so smth like emulating huge amount of data already presented in the db? | 12:07 |
lsmola__ | DinaBelova: basically we want to see how it will look like in Production | 12:08 |
lsmola__ | DinaBelova: yeah | 12:08 |
DinaBelova | lsmola__, btw, are you interested in the performance testing results? | 12:08 |
DinaBelova | for the ceilo? | 12:08 |
lsmola__ | DinaBelova: yeah | 12:08 |
DinaBelova | currently we have the results for the icehouse cut | 12:08 |
lsmola__ | DinaBelova: nice, it would be nice to know the limits | 12:09 |
DinaBelova | and ityaptin is working on testing the current code and future vectors | 12:09 |
DinaBelova | lsmola__, one moment | 12:09 |
DinaBelova | lsmola__, we have tested the api and collectors working | 12:09 |
DinaBelova | lsmola__, here it is - https://docs.google.com/document/d/1ARpKiYW2WN94JloG0prNcLjMeom-ySVhe8fvjXG_uRU/edit?usp=sharing | 12:09 |
DinaBelova | that was done for the icehouse code, currently MySQL, for instance, will look much better :) | 12:10 |
lsmola__ | DinaBelova: nice, thank you, this will be handy | 12:11 |
DinaBelova | lsmola__, np | 12:11 |
*** erecio has quit IRC | 12:11 | |
*** erecio has joined #openstack-ceilometer | 12:12 | |
DinaBelova | one of the ceilo bottlenecks (for the hbase and mongo at least) is the queue - we even could not create load huge enough that will meet DB max throughput, the problem was in the slow queue presented | 12:13 |
*** erecio has quit IRC | 12:13 | |
DinaBelova | lsmola__, ^^ - that's why we're working on the oslo.messaging improvement as well | 12:13 |
*** erecio has joined #openstack-ceilometer | 12:14 | |
*** alexpilotti has joined #openstack-ceilometer | 12:15 | |
*** jdob has joined #openstack-ceilometer | 12:16 | |
lsmola__ | DinaBelova: right, I can see that can be kind of bottleneck | 12:18 |
*** erecio has quit IRC | 12:20 | |
*** erecio has joined #openstack-ceilometer | 12:21 | |
*** promulo has quit IRC | 12:23 | |
*** ajc_ has quit IRC | 12:23 | |
*** amalagon has joined #openstack-ceilometer | 12:32 | |
*** deepthi has quit IRC | 12:36 | |
*** yatin has left #openstack-ceilometer | 12:39 | |
*** Qiming has joined #openstack-ceilometer | 12:54 | |
*** prad_ has joined #openstack-ceilometer | 12:56 | |
*** _nadya_ has quit IRC | 12:57 | |
*** matsuhashi has quit IRC | 12:59 | |
*** matsuhashi has joined #openstack-ceilometer | 12:59 | |
*** julim has joined #openstack-ceilometer | 13:03 | |
*** matsuhashi has quit IRC | 13:04 | |
*** safchain has quit IRC | 13:06 | |
*** safchain has joined #openstack-ceilometer | 13:06 | |
*** thomasem has joined #openstack-ceilometer | 13:10 | |
*** matsuhashi has joined #openstack-ceilometer | 13:10 | |
openstackgerrit | Igor Degtiarov proposed a change to openstack/ceilometer: Fix H307 violations and re-enable gating https://review.openstack.org/102525 | 13:20 |
*** fnaval has joined #openstack-ceilometer | 13:21 | |
openstackgerrit | Igor Degtiarov proposed a change to openstack/ceilometer: Fix F402 violations and re-enable gating https://review.openstack.org/102492 | 13:27 |
*** matsuhashi has quit IRC | 13:33 | |
*** matsuhashi has joined #openstack-ceilometer | 13:33 | |
*** underyx is now known as Underyx|off | 13:34 | |
*** matsuhashi has quit IRC | 13:38 | |
jd__ | I'm getting crazy with those statistics stuff | 13:42 |
*** psharma_ has quit IRC | 13:43 | |
DinaBelova | jd__, what's up? | 13:43 |
*** nosnos has quit IRC | 13:43 | |
jd__ | I'm tired, what about you DinaBelova? | 13:43 |
DinaBelova | jd__, hehe :D | 13:43 |
openstackgerrit | Ren Qiaowei proposed a change to openstack/ceilometer-specs: Spec for xenapi support https://review.openstack.org/102529 | 13:43 |
DinaBelova | me too, but I have good news :) | 13:43 |
*** terriyu has quit IRC | 13:43 | |
DinaBelova | I'll be in Paris :) | 13:44 |
jd__ | ah awesome | 13:44 |
*** matsuhashi has joined #openstack-ceilometer | 13:44 | |
DinaBelova | jd__, try not to become too exhausted :( that's bad :( | 13:44 |
*** matsuhashi has quit IRC | 13:44 | |
jd__ | yeah I'll sleep at some point :) | 13:45 |
*** matsuhashi has joined #openstack-ceilometer | 13:45 | |
DinaBelova | jd__, good luck! | 13:47 |
*** matsuhashi has quit IRC | 13:49 | |
amalagon | jd__: if you need an extra pair of hands to do something, let me know! | 13:54 |
*** promulo has joined #openstack-ceilometer | 13:54 | |
*** Ruetobas has quit IRC | 13:54 | |
jd__ | amalagon: thanks :) I think I'm waiting for eglynn to lighten me on how we should handle various things | 13:54 |
jd__ | cf the mail thread | 13:54 |
* amalagon reading the thread | 13:55 | |
*** nati_ueno has joined #openstack-ceilometer | 13:55 | |
*** fnaval has quit IRC | 13:57 | |
*** Ruetobas has joined #openstack-ceilometer | 14:01 | |
eglynn | jd__: sorry for being such a pain, labouring that pairwise-cumulative point to death | 14:04 |
jd__ | no problem eglynn | 14:05 |
jd__ | we need to have that discussion to progress | 14:05 |
*** Ruetobas has quit IRC | 14:05 | |
openstackgerrit | Igor Degtiarov proposed a change to openstack/ceilometer: Fix H307 violations and re-enable gating https://review.openstack.org/102525 | 14:06 |
eglynn | jd__: ... will reply to your latest on that thread shortly | 14:06 |
*** ildikov has quit IRC | 14:06 | |
jd__ | cool thanks | 14:06 |
jd__ | I'm writing tooz documentation in the meantime | 14:06 |
jd__ | you know, to chill out | 14:06 |
eglynn | jd__: LOL :) | 14:06 |
jd__ | *screaming* | 14:06 |
*** ddieterly has joined #openstack-ceilometer | 14:09 | |
*** Ruetobas has joined #openstack-ceilometer | 14:12 | |
*** nati_ueno has quit IRC | 14:16 | |
openstackgerrit | Igor Degtiarov proposed a change to openstack/ceilometer: Fix H307 violations and re-enable gating https://review.openstack.org/102525 | 14:17 |
*** sileht has quit IRC | 14:20 | |
*** sileht has joined #openstack-ceilometer | 14:23 | |
eglynn | jd__: just sent ... apols for the delay, /me on a boring internal call | 14:24 |
*** amalagon_ has joined #openstack-ceilometer | 14:24 | |
*** IvanBerezovskiy has left #openstack-ceilometer | 14:28 | |
* DinaBelova still thinking what will happen with swift (that actually has different endpoints in replicas for the some object) - I mean with replicas... at one time we have no possibility to guarantee it'll be exactly one file on every replica - it'll be consistent finally, but not at every moment | 14:28 | |
DinaBelova | jd__, probably I'm wrong here ^^, I'm not really sure... | 14:29 |
*** ildikov has joined #openstack-ceilometer | 14:30 | |
eglynn | DinaBelova: eventually consistency would be less of a potential issue if the only operations where ... | 14:30 |
eglynn | (1) write a new datapoint | 14:31 |
eglynn | (2) bulk expiry of old datapoints | 14:31 |
eglynn | (i.e. no roll-up/downsampling in situ) | 14:31 |
DinaBelova | eglynn, yes, I know this, this idea just came to my mind | 14:32 |
DinaBelova | as datapoints may be added time by time - from the ceilo itself, they'll be collected periodically | 14:33 |
DinaBelova | just meters | 14:33 |
DinaBelova | for instance | 14:33 |
*** gordc has joined #openstack-ceilometer | 14:33 | |
DinaBelova | so if it'll be request - give all new datapoints | 14:34 |
DinaBelova | some new ones might not be presented | 14:34 |
DinaBelova | as we dunno what swift server will actually perform the request | 14:35 |
*** fnaval has joined #openstack-ceilometer | 14:38 | |
*** _nadya_ has joined #openstack-ceilometer | 14:38 | |
eglynn | DinaBelova: ... so first let's simplify and assume *no downsampling* | 14:39 |
*** fnaval has quit IRC | 14:39 | |
*** fnaval has joined #openstack-ceilometer | 14:39 | |
eglynn | DinaBelova: ... datapoints {p1, p2, ..., p_i} are submitted and are stored in an eventually consistent way | 14:40 |
eglynn | DinaBelova: ... possible issue 1: a query returns only {p1, p2, ..., p_(i-1)} | 14:40 |
eglynn | DinaBelova: ... ^^^is that the way swift eventual consistency actually works? | 14:41 |
eglynn | DinaBelova: ... in any case, I'm not sure that's a big issue ... the caller just sees slightly laggy, but not *wrong* data | 14:41 |
DinaBelova | eglynn, I'm not the specialist here (will investigate this moment), but as far as I remember, swift first of all updates one server, and then shares the data. So yes, that might look like this. And yes, that' not the biggest problem here | 14:42 |
DinaBelova | :) | 14:42 |
DinaBelova | that'll be the opportunity to get not updated data | 14:42 |
eglynn | DinaBelova: ... possible issue 2: a further datapoint {p_(i+1)} arrives and is folded into {p1, p2, ..., p_(i-1)} instead of {p1, p2, ..., p_i} | 14:42 |
eglynn | DinaBelova: ... issue #2 would be the real concern I think | 14:43 |
DinaBelova | eglynn, sorry, I need to test this somehow... | 14:43 |
DinaBelova | I'm not sure what kind of situation we'll have here | 14:43 |
DinaBelova | #1 I guess we'll meet for sure, but #2 - not so.. | 14:44 |
eglynn | DinaBelova: we have an expert in the house! :) ... https://julien.danjou.info/blog/2012/openstack-swift-consistency-analysis | 14:44 |
DinaBelova | hehe | 14:44 |
DinaBelova | ^) | 14:44 |
DinaBelova | :) | 14:44 |
DinaBelova | eglynn, I guess I | 14:44 |
DinaBelova | will ask jd__when he'll stop dying because of cumulative aggregations :) | 14:45 |
*** rwsu has joined #openstack-ceilometer | 14:49 | |
*** terriyu has joined #openstack-ceilometer | 14:52 | |
openstackgerrit | Igor Degtiarov proposed a change to openstack/ceilometer: Fix F402 violations and re-enable gating https://review.openstack.org/102492 | 14:52 |
*** terriyu has quit IRC | 14:54 | |
openstackgerrit | Igor Degtiarov proposed a change to openstack/ceilometer: Fix F402 violations and re-enable gating https://review.openstack.org/102492 | 14:56 |
*** fnaval has quit IRC | 15:12 | |
*** fnaval has joined #openstack-ceilometer | 15:13 | |
*** idegtiarov has quit IRC | 15:15 | |
*** fnaval has quit IRC | 15:17 | |
*** terriyu has joined #openstack-ceilometer | 15:22 | |
*** terriyu has quit IRC | 15:29 | |
*** terriyu has joined #openstack-ceilometer | 15:29 | |
*** terriyu has quit IRC | 15:29 | |
*** fnaval has joined #openstack-ceilometer | 15:37 | |
*** _nadya_ has quit IRC | 15:40 | |
*** _nadya_ has joined #openstack-ceilometer | 15:58 | |
*** Qiming has quit IRC | 16:00 | |
*** Ruetobas has quit IRC | 16:01 | |
*** Ruetobas has joined #openstack-ceilometer | 16:03 | |
*** Ruetobas has quit IRC | 16:08 | |
*** Ruetobas has joined #openstack-ceilometer | 16:14 | |
*** _cjones_ has joined #openstack-ceilometer | 16:18 | |
*** _cjones_ has quit IRC | 16:19 | |
*** _cjones_ has joined #openstack-ceilometer | 16:20 | |
*** packet has joined #openstack-ceilometer | 16:24 | |
*** safchain has quit IRC | 16:56 | |
*** amarao has quit IRC | 16:59 | |
*** eglynn has quit IRC | 17:07 | |
*** jaypipes has joined #openstack-ceilometer | 17:17 | |
*** rbowen has joined #openstack-ceilometer | 17:39 | |
*** jaypipes has quit IRC | 17:44 | |
*** jaypipes has joined #openstack-ceilometer | 17:45 | |
*** eglynn has joined #openstack-ceilometer | 17:46 | |
*** fnaval has quit IRC | 17:52 | |
*** nati_ueno has joined #openstack-ceilometer | 18:00 | |
*** Qiming has joined #openstack-ceilometer | 18:01 | |
*** Qiming has quit IRC | 18:09 | |
*** ddieterly has quit IRC | 18:10 | |
*** inc0_ has quit IRC | 18:18 | |
*** ddieterly has joined #openstack-ceilometer | 18:24 | |
*** ddieterly has quit IRC | 18:28 | |
*** ddieterly has joined #openstack-ceilometer | 18:29 | |
*** isviridov is now known as isviridov|away | 18:32 | |
*** ddieterly has quit IRC | 18:33 | |
*** ddieterly has joined #openstack-ceilometer | 18:34 | |
*** ddieterly has quit IRC | 18:38 | |
*** ddieterly has joined #openstack-ceilometer | 18:38 | |
*** ddieterly has quit IRC | 18:43 | |
*** ddieterly has joined #openstack-ceilometer | 18:43 | |
*** ddieterly has quit IRC | 18:47 | |
*** ddieterly has joined #openstack-ceilometer | 18:48 | |
*** ddieterly has quit IRC | 18:50 | |
*** ddieterly has joined #openstack-ceilometer | 18:50 | |
*** amalagon_ has quit IRC | 18:52 | |
*** _nadya_ has quit IRC | 18:54 | |
*** ddieterly has quit IRC | 18:55 | |
*** aviau has quit IRC | 18:55 | |
*** ddieterly has joined #openstack-ceilometer | 18:55 | |
*** ddieterly has quit IRC | 18:58 | |
*** ddieterl_ has joined #openstack-ceilometer | 18:58 | |
*** Fabio_ has joined #openstack-ceilometer | 19:00 | |
*** openstackgerrit has quit IRC | 19:04 | |
*** Longgeek has quit IRC | 19:04 | |
*** openstackgerrit has joined #openstack-ceilometer | 19:05 | |
*** yjiang5 is now known as yjiang5_away | 19:08 | |
*** Longgeek has joined #openstack-ceilometer | 19:08 | |
*** aviau has joined #openstack-ceilometer | 19:10 | |
*** amalagon_ has joined #openstack-ceilometer | 19:14 | |
*** fnaval has joined #openstack-ceilometer | 19:16 | |
*** liusheng has quit IRC | 19:20 | |
*** liusheng has joined #openstack-ceilometer | 19:20 | |
*** _nadya_ has joined #openstack-ceilometer | 19:24 | |
*** alexpilotti has quit IRC | 19:32 | |
*** amalagon_ has left #openstack-ceilometer | 19:44 | |
*** _cjones_ has quit IRC | 19:44 | |
*** _cjones_ has joined #openstack-ceilometer | 19:45 | |
*** ddieterl_ has quit IRC | 19:46 | |
*** erecio has quit IRC | 19:52 | |
*** erecio has joined #openstack-ceilometer | 19:57 | |
*** openstackgerrit has quit IRC | 20:05 | |
*** Longgeek has quit IRC | 20:05 | |
*** openstackgerrit has joined #openstack-ceilometer | 20:05 | |
*** ddieterly has joined #openstack-ceilometer | 20:12 | |
*** amarao has joined #openstack-ceilometer | 20:17 | |
*** Underyx|off is now known as underyx | 20:19 | |
*** underyx is now known as Underyx|off | 20:26 | |
*** ivan has joined #openstack-ceilometer | 20:27 | |
*** Underyx|off is now known as underyx | 20:29 | |
*** promulo has quit IRC | 20:50 | |
boris-42 | eglynn ildikov guys did you have a chance to take a look at my spec? | 20:51 |
*** yjiang5_away is now known as yjiang5 | 20:52 | |
*** erecio has quit IRC | 20:56 | |
openstackgerrit | Phil Neal proposed a change to openstack/ceilometer-specs: PaaS Usage Event Collection https://review.openstack.org/102647 | 21:03 |
eglynn | boris-42: ... I have now | 21:03 |
boris-42 | eglynn thanks | 21:03 |
ildikov | boris-42: I had a quick look, not a heavy weight docco for sure ;) | 21:05 |
* eglynn scurries off to watch France grind out a nil-nil with Ecuador | 21:10 | |
*** jdob has quit IRC | 21:10 | |
eglynn | ... considers it prep for the mid-cycle in Paris next week ;) | 21:10 |
boris-42 | eglynn replied to your comment | 21:12 |
ildikov | eglynn: ... yeap, better to be prepared :) | 21:12 |
*** promulo has joined #openstack-ceilometer | 21:15 | |
*** amarao has quit IRC | 21:16 | |
*** julim has quit IRC | 21:16 | |
*** julim has joined #openstack-ceilometer | 21:20 | |
*** julim has quit IRC | 21:24 | |
openstackgerrit | Boris Pavlovic proposed a change to openstack/ceilometer-specs: Add spec for osprofiler notification plugin https://review.openstack.org/102393 | 21:25 |
boris-42 | eglynn ^ addressed your issues | 21:26 |
boris-42 | s/issues/comments/ | 21:27 |
*** gordc has quit IRC | 21:34 | |
*** jaypipes has quit IRC | 21:34 | |
*** rbowen has quit IRC | 21:47 | |
*** _nadya_ has quit IRC | 21:52 | |
*** thomasem has quit IRC | 21:52 | |
*** ivan has quit IRC | 21:54 | |
ildikov | boris-42: eglynn: posted a question on that spec | 21:56 |
boris-42 | ildikov ? | 21:56 |
*** ivan has joined #openstack-ceilometer | 21:57 | |
boris-42 | ildikov i added my answers=) | 21:57 |
boris-42 | ildikov hmmm | 21:57 |
boris-42 | ildikov how to do that?) | 21:57 |
ildikov | boris-42: it should be visible now | 21:58 |
boris-42 | ildikov new table? | 21:58 |
ildikov | boris-42: yeap, I was thinking about that | 21:59 |
boris-42 | ildikov hm and how to do that wihtotu copy paste of existing notification plugins ?) | 21:59 |
boris-42 | ildikov I mean implementation will require a lot of code | 22:00 |
boris-42 | 1) changes in API and client | 22:00 |
ildikov | boris-42: I think it will need some additional code, I do not really see an extra simple solution for that right now | 22:00 |
boris-42 | 2) adding one more framework for notifications plugins | 22:01 |
boris-42 | 3) changes in DB | 22:01 |
boris-42 | 4) a lot of tests & as well we will need functional tests (that will be not so simple to implement) | 22:01 |
boris-42 | not sure that it's better then just to add notification plugin | 22:02 |
*** yjiang5 is now known as yjiang5_away | 22:02 | |
*** yjiang5_away has quit IRC | 22:02 | |
ildikov | I know, I'm just a bit concerned about to mix this data completely | 22:02 |
boris-42 | ildikov hm but event types are different | 22:03 |
boris-42 | ildikov so you can query data quite simple | 22:03 |
ildikov | we have a ttl mechanism for samples for instance, which may should be different in case of profiling data | 22:04 |
boris-42 | ildikov ttl? | 22:04 |
ildikov | time-to-live | 22:04 |
*** nikhil___ is now known as nikhil___|afk | 22:04 | |
boris-42 | ildikov you mean temporary samples? | 22:04 |
ildikov | well, it depends on what you call temporary :) | 22:05 |
boris-42 | ildikov that will be deleted after some period of time (automatically) | 22:06 |
ildikov | then yes | 22:06 |
boris-42 | ildikov not sure that I would like to use it for profiling stuff | 22:06 |
boris-42 | ildikov I would prefer to have API method to delete them | 22:07 |
boris-42 | ildikov but not do this automatically | 22:07 |
ildikov | sure, so it is one point, where profiling data should be handled differently | 22:08 |
boris-42 | ildikov probably we should just be able to delete samples by query? | 22:09 |
boris-42 | ildikov I am afraid actually about writing something custom for profiler | 22:09 |
ildikov | it's another sensitive question related to billing | 22:09 |
boris-42 | eglynn ^ what do you think about all this ? | 22:10 |
boris-42 | ildikov heh I like KISS approach =) | 22:10 |
ildikov | ... so maybe we could provide this possibility to the admin user, but still questionable | 22:11 |
boris-42 | ildikov actually it will be very useful | 22:12 |
boris-42 | ildikov for operators | 22:12 |
boris-42 | ildikov for example you would like to check how your cloud works | 22:12 |
ildikov | heh, sure, we can keep it simple from coding PoV, but it's not the only thing :) | 22:12 |
boris-42 | ildikov under load | 22:12 |
boris-42 | ildikov so you run rally create billions of samples | 22:12 |
boris-42 | ildikov pre production testing | 22:13 |
boris-42 | ildikov and now you would like to cleanup all of them | 22:13 |
*** ddieterly has quit IRC | 22:14 | |
*** dmsimard is now known as dmsimard_away | 22:15 | |
ildikov | I know it would be useful in general, I mean profiling | 22:15 |
ildikov | the only thing is that in my opinion it would be better to separate the data and data handling from metering | 22:16 |
ildikov | ... so I raised this question now, better earlier than later IMHO | 22:16 |
boris-42 | ildikov sure | 22:16 |
*** yjiang5_1 has joined #openstack-ceilometer | 22:18 | |
ildikov | so I like profiler, I'm just simply the member of the Ceilo guardians team in this discussion, so I try to act like that :) | 22:18 |
*** _nadya_ has joined #openstack-ceilometer | 22:19 | |
boris-42 | ildikov okay going to sleep now=) see you tomorrow | 22:19 |
ildikov | good idea | 22:21 |
ildikov | I guess eglynn practices how to celebrate France at the moment :) | 22:21 |
ildikov | ... so let's continue this tomorrow | 22:21 |
*** ddieterly has joined #openstack-ceilometer | 22:24 | |
*** ddieterly has quit IRC | 22:26 | |
*** ddieterly has joined #openstack-ceilometer | 22:26 | |
*** openstackgerrit has quit IRC | 22:35 | |
*** openstackgerrit has joined #openstack-ceilometer | 22:35 | |
*** nsaje has quit IRC | 23:01 | |
*** nsaje has joined #openstack-ceilometer | 23:05 | |
*** ddieterly has quit IRC | 23:21 | |
*** ddieterly has joined #openstack-ceilometer | 23:22 | |
*** ddieterly has quit IRC | 23:23 | |
*** fnaval has quit IRC | 23:44 | |
*** r-daneel has joined #openstack-ceilometer | 23:48 | |
*** r-daneel has quit IRC | 23:52 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!