Tuesday, 2014-08-05

*** fnaval has quit IRC00:13
*** fnaval has joined #openstack-ceilometer00:14
*** yasukun has joined #openstack-ceilometer00:18
*** fnaval has quit IRC00:19
*** flwang_ has joined #openstack-ceilometer00:22
*** _nadya_ has quit IRC00:26
*** flwang_ has quit IRC00:26
*** shakamunyi has quit IRC00:43
*** _nadya_ has joined #openstack-ceilometer00:52
*** jergerber has quit IRC01:19
*** fnaval has joined #openstack-ceilometer01:26
*** Ruetobas has quit IRC01:35
*** Ruetobas has joined #openstack-ceilometer01:43
*** raymondr has joined #openstack-ceilometer01:44
*** Ruetobas has quit IRC01:47
*** nosnos has joined #openstack-ceilometer01:50
*** shakamunyi has joined #openstack-ceilometer01:54
*** fnaval has quit IRC01:57
*** Ruetobas has joined #openstack-ceilometer02:02
*** sbfox has joined #openstack-ceilometer02:06
*** Ruetobas has quit IRC02:06
*** shakamunyi has quit IRC02:07
*** raymondr has quit IRC02:11
*** safchain has quit IRC02:12
*** fnaval has joined #openstack-ceilometer02:19
*** Ruetobas has joined #openstack-ceilometer02:20
*** shakamunyi has joined #openstack-ceilometer02:22
*** flwang_ has joined #openstack-ceilometer02:23
*** Ruetobas has quit IRC02:25
*** palar has quit IRC02:26
*** flwang_ has quit IRC02:27
*** Ruetobas has joined #openstack-ceilometer02:31
*** sbfox has quit IRC02:37
*** mspreitz has joined #openstack-ceilometer02:58
*** yasukun has quit IRC03:25
*** deepthi has joined #openstack-ceilometer03:27
*** cmyster has joined #openstack-ceilometer03:58
*** cmyster has joined #openstack-ceilometer03:58
*** raymondr has joined #openstack-ceilometer04:04
*** cmyster has quit IRC04:05
*** flwang has left #openstack-ceilometer04:05
*** palar has joined #openstack-ceilometer04:10
openstackgerritA change was merged to openstack/ceilometer: Fix listener for update.start notifications  https://review.openstack.org/9741304:14
*** cmyster has joined #openstack-ceilometer04:14
*** palar has quit IRC04:14
*** flwang has joined #openstack-ceilometer04:19
*** yasukun has joined #openstack-ceilometer04:23
*** flwang_ has joined #openstack-ceilometer04:24
*** fnaval has quit IRC04:26
*** fnaval has joined #openstack-ceilometer04:27
*** flwang_ has quit IRC04:28
*** raymondr has quit IRC04:29
*** fnaval has quit IRC04:31
*** k4n0 has joined #openstack-ceilometer04:43
*** ildikov_ has quit IRC04:50
*** yatin has joined #openstack-ceilometer04:59
openstackgerritMike Spreitzer proposed a change to openstack/ceilometer: Documented Stevedore usage and source details  https://review.openstack.org/11190705:12
*** Dev_Jin has joined #openstack-ceilometer05:19
*** ccrouch has quit IRC05:24
*** sbfox has joined #openstack-ceilometer05:27
*** dmsimard_away is now known as dmsimard05:30
*** raymondr has joined #openstack-ceilometer05:30
*** mspreitz has quit IRC05:32
*** Longgeek has joined #openstack-ceilometer05:33
*** raymondr has quit IRC05:35
*** shakamunyi has quit IRC05:42
*** sbfox has quit IRC05:44
*** palar has joined #openstack-ceilometer05:58
*** palar has quit IRC06:03
*** eglynn-dayoff has joined #openstack-ceilometer06:04
*** dmsimard is now known as dmsimard_away06:08
*** shakamunyi has joined #openstack-ceilometer06:10
*** giroro_ has joined #openstack-ceilometer06:20
*** Ruetobas has quit IRC06:20
*** _cjones_ has joined #openstack-ceilometer06:22
*** ildikov has joined #openstack-ceilometer06:23
*** shakamunyi has quit IRC06:24
*** giroro_ has quit IRC06:24
*** flwang_ has joined #openstack-ceilometer06:25
*** Longgeek has quit IRC06:28
*** Longgeek has joined #openstack-ceilometer06:28
*** Longgeek has quit IRC06:29
*** Longgeek_ has joined #openstack-ceilometer06:29
*** flwang_ has quit IRC06:29
*** Ruetobas has joined #openstack-ceilometer06:30
*** Longgeek_ has quit IRC06:31
*** drjones has joined #openstack-ceilometer06:33
*** _cjones_ has quit IRC06:36
*** _nadya_ has quit IRC06:40
*** _nadya_ has joined #openstack-ceilometer06:40
*** Longgeek has joined #openstack-ceilometer06:42
*** ifarkas has joined #openstack-ceilometer06:47
*** shakamunyi has joined #openstack-ceilometer06:51
*** shakamunyi has quit IRC06:58
*** _nadya_ has quit IRC07:07
*** arezmerita has joined #openstack-ceilometer07:24
*** drjones has quit IRC07:29
*** _cjones_ has joined #openstack-ceilometer07:29
*** raymondr has joined #openstack-ceilometer07:31
*** IvanBerezovskiy1 has joined #openstack-ceilometer07:32
*** _cjones_ has quit IRC07:34
*** raymondr has quit IRC07:35
*** palar has joined #openstack-ceilometer07:47
*** palar has quit IRC07:51
*** shakamunyi has joined #openstack-ceilometer07:56
*** eglynn-dayoff is now known as eglynn07:57
*** rwsu has quit IRC07:59
openstackgerritIgor Degtiarov proposed a change to openstack/ceilometer: Implement redesigned separator in names of columns in HBase  https://review.openstack.org/10637608:05
*** alexpilotti has joined #openstack-ceilometer08:07
*** claudiub has joined #openstack-ceilometer08:08
openstackgerritIgor Degtiarov proposed a change to openstack/ceilometer: [HBase] Refactor hbase.utils  https://review.openstack.org/11127008:08
*** _cjones_ has joined #openstack-ceilometer08:09
*** safchain has joined #openstack-ceilometer08:09
*** shakamunyi has quit IRC08:10
*** flwang_ has joined #openstack-ceilometer08:13
*** _cjones_ has quit IRC08:17
*** flwang_ has quit IRC08:17
*** cmyster has quit IRC08:19
*** cmyster has joined #openstack-ceilometer08:24
*** cmyster has joined #openstack-ceilometer08:24
*** raymondr has joined #openstack-ceilometer08:29
*** raymondr has quit IRC08:34
*** deepthi has quit IRC08:34
*** deepthi has joined #openstack-ceilometer08:47
*** _nadya_ has joined #openstack-ceilometer08:53
*** deepthi has quit IRC08:59
openstackgerritRikimaru Honjo proposed a change to openstack/ceilometer: Set page size when Glance API request is called  https://review.openstack.org/10630409:07
*** deepthi has joined #openstack-ceilometer09:13
*** _cjones_ has joined #openstack-ceilometer09:14
*** Longgeek has quit IRC09:14
*** _cjones_ has quit IRC09:19
*** Longgeek has joined #openstack-ceilometer09:22
*** palar has joined #openstack-ceilometer09:35
*** yasukun has quit IRC09:38
*** palar has quit IRC09:40
*** deepthi has quit IRC09:41
*** flwang_ has joined #openstack-ceilometer09:48
*** shengjiemin has quit IRC09:48
idegtiarov__eglynn: ildikov: Probably we could merge this patch https://review.openstack.org/#/c/106376/ what do you think?09:54
eglynnidegtiarov__: _nadya_ has given her belssings?09:55
idegtiarov__eglynn: Yes she did!09:55
eglynnidegtiarov__: (for a hbase domain expert PoV)09:55
eglynnidegtiarov__: (*from a hbase domain expert PoV)09:55
eglynnidegtiarov__: cool! agreed let's try to get this over the line ... I'll do a sanity check this morning09:56
idegtiarov__eglynn: Thank you sir!09:56
*** shakamunyi has joined #openstack-ceilometer09:57
*** deepthi has joined #openstack-ceilometer09:57
*** palar has joined #openstack-ceilometer10:00
*** shakamunyi has quit IRC10:01
*** idegtiarov_ has quit IRC10:01
*** shengjiemin has joined #openstack-ceilometer10:01
*** idegtiarov has quit IRC10:01
*** idegtiarov__ has quit IRC10:01
*** idegtiarov has joined #openstack-ceilometer10:02
*** _cjones_ has joined #openstack-ceilometer10:09
*** sijo_ has joined #openstack-ceilometer10:15
openstackgerritIlya Tyaptin proposed a change to openstack/ceilometer: [Hbase] Add column for source filter in _get_meter_samples  https://review.openstack.org/10055810:15
*** _cjones_ has quit IRC10:17
sijo_How can  I get the CPU utilization of a VM10:39
eglynnsijo_: the meter is called cpu_util10:40
*** Longgeek has quit IRC10:41
*** Longgeek has joined #openstack-ceilometer10:42
eglynnsijo_: e.g. to get hourly aggregates over a time period ... $ ceilometer statistics -m cpu_util -q 'resource=INSTANCE_UUID;timestamp>START;timestamp<=END' --period 360010:42
*** Longgeek has quit IRC10:44
*** Longgeek has joined #openstack-ceilometer10:46
_nadya_eglynn, idegtiarov, yes, I've tested on real HBase, everything is fine. As I understand, a separator will become configurable in a separate patch, right, idegtiarov?10:52
*** yatin has quit IRC10:54
openstackgerritNejc Saje proposed a change to openstack/ceilometer-specs: Revert "Central agent horizontal scaling spec"  https://review.openstack.org/11197510:54
idegtiarov_nadya_:  Actually now we can use any characters in manes of metrics without restrictions, so we don't need to configure separator any more.10:55
idegtiarov*names10:55
openstackgerritNejc Saje proposed a change to openstack/ceilometer-specs: Central agent horizontal scaling spec  https://review.openstack.org/11197811:02
_nadya_idegtiarov: yep, you are right! thanks for explanation11:06
*** Ruetobas has quit IRC11:09
*** nosnos has quit IRC11:10
openstackgerritA change was merged to openstack/ceilometer-specs: Revert "Central agent horizontal scaling spec"  https://review.openstack.org/11197511:10
*** yatin has joined #openstack-ceilometer11:10
*** _cjones_ has joined #openstack-ceilometer11:12
*** Ruetobas has joined #openstack-ceilometer11:15
*** _cjones_ has quit IRC11:17
*** Ruetobas has quit IRC11:19
*** Ruetobas has joined #openstack-ceilometer11:25
idegtiaroveglynn: Thanks for looking thru patch, answering your question I can say that Ilya Tyaptin is going to prepare patch set with migrations for HBase. So we can merge this patch now or wait for patch set from Ilya, but I don't know when it will be done.11:28
eglynnidegtiarov: would it make more sense to reverse the ordering?11:29
eglynnidegtiarov: migration first, change seperator second11:29
eglynn(depends somewhat on Ilya's progress)11:30
idegtiaroveglynn: If we really have any data that is stored into HBase with old separators it will be more sense to have migration patch first I think.11:30
*** palar_ has joined #openstack-ceilometer11:31
eglynnidegtiarov: yep, I agree11:32
eglynnidegtiarov: can you check with ityaptin on the rate of progress on the migrations?11:32
idegtiaroveglynn: As far as I know Ilya is busy now with performance testing.11:33
*** palar has quit IRC11:34
*** chrisf has joined #openstack-ceilometer11:35
ityaptinHi!11:35
*** palar_ has quit IRC11:35
lsmolaeglynn: hola11:38
lsmolaeglynn: could you checkout this please https://review.openstack.org/#/c/111692/11:38
lsmolaeglynn: going to write arithmetic transformers for TripleO, so I just want to make sure it will be part of default transformers11:40
eglynnlsmola: will look shortly11:40
*** Alexei_987 has joined #openstack-ceilometer11:41
*** Alexei_987 has left #openstack-ceilometer11:41
lsmolaeglynn: excellent, thank you11:41
_nadya_eglynn: I'm afraid 'migration' is not for HBase... Of course it can be implemented with a special map-reduce job. Do we really need this now? I will investigate it today anyway11:41
eglynn_nadya_: yes, I think if we're changing the storage format, don't we need to migrate the old data?11:42
eglynn_nadya_: (if not via a sql-a style migration script, then via more other kinda of mapping)11:43
eglynn_nadya_: (in the mongodb case, if we change the storage format, we map from the old to the new)11:43
*** deepthi has quit IRC11:43
*** Alexei_987 has joined #openstack-ceilometer11:43
ityaptineglynn, _nadya_, I'm trying to parse and put data from old format rows to new. And delete old rows.11:45
ityaptineglynn, _nadya_, It's not fast approach, but in happybase we have not so many variants.11:47
*** vrovachev has joined #openstack-ceilometer11:47
eglynnityaptin: cool, so it sounds reasonable to wait on the outcome of that work before changing the separator?11:48
*** shakamunyi has joined #openstack-ceilometer11:48
openstackgerritAlexei Kornienko proposed a change to openstack/ceilometer: Switch to use oslo.db  https://review.openstack.org/11199011:48
*** Alexei_987 has left #openstack-ceilometer11:48
ityaptineglynn, first patchset for this I can send to review tomorrow. But I don't believe what now we may have big troubles with changing row format.11:52
eglynnityaptin: cool, thanks!11:52
ityaptineglynn, base problem, how i understand with natural sorting data in tables, because in scan, get requests we ignore table row11:54
eglynnityaptin: I don't fully understand your question ... but perhaps _nadya_ can clarify that for you?11:54
*** shakamunyi has quit IRC11:58
ityaptineglynn, sorry, I write too slow( I try to say what we save order of data in responses for requests even if we use old data and new data in same db11:58
*** flwang_ has quit IRC12:03
_nadya_ityaptin: let's investigate this. I understand what you are asking.12:03
*** cmyster has quit IRC12:04
ityaptinSummary, I try to say, what we may not save order of 'migration' -> 'changing delimeters patch', because we will not have issues with old and new data in tables.12:06
*** _cjones_ has joined #openstack-ceilometer12:12
*** _cjones_ has quit IRC12:16
*** palar has joined #openstack-ceilometer12:18
*** _nadya_ has quit IRC12:31
*** _nadya_ has joined #openstack-ceilometer12:32
*** yatin has quit IRC12:32
openstackgerritlitong01 proposed a change to openstack/ceilometer: add http dispatcher  https://review.openstack.org/10985312:34
*** prad has joined #openstack-ceilometer12:36
*** tongli has joined #openstack-ceilometer12:36
*** k4n0 has quit IRC12:50
*** ccrouch has joined #openstack-ceilometer12:58
*** ddieterly has joined #openstack-ceilometer13:02
*** gordc has joined #openstack-ceilometer13:02
*** jasondotstar has joined #openstack-ceilometer13:03
*** julim has joined #openstack-ceilometer13:06
_nadya_eglynn: do we have any restrictions on merging?13:07
eglynn_nadya_: do you mean, is there a minimum amount of time that a proposal needs to be under review before it can be landed?13:08
_nadya_eglynn: no. I mean release-cycles. When j3 will take place? I'm a little bit lost13:10
eglynn_nadya_: juno-3 == Sept 4th13:10
_nadya_eglynn: code freeze?13:10
eglynn_nadya_: https://wiki.openstack.org/wiki/Icehouse_Release_Schedule13:10
eglynn_nadya_: we've a "feature proposal freeze" approx 2 weeks before j-313:11
eglynn_nadya_: that's when the *initial* version of the patches should be proposed13:11
*** _cjones_ has joined #openstack-ceilometer13:11
_nadya_eglynn: ok, thank you!13:11
*** _cjones_ has quit IRC13:12
*** _cjones_ has joined #openstack-ceilometer13:12
*** mgagne has quit IRC13:12
*** dhellmann_ is now known as dhellmann13:12
*** mgagne has joined #openstack-ceilometer13:13
*** mgagne is now known as Guest2729513:13
*** gordc has quit IRC13:14
*** vrovachev has quit IRC13:14
*** Dev_Jin has quit IRC13:14
*** jaypipes has quit IRC13:14
*** changbl has quit IRC13:14
*** gordc has joined #openstack-ceilometer13:15
*** vrovachev has joined #openstack-ceilometer13:15
*** Dev_Jin has joined #openstack-ceilometer13:15
*** jaypipes has joined #openstack-ceilometer13:15
openstackgerritAla Rezmerita proposed a change to openstack/ceilometer-specs: Spec for alarm quotas  https://review.openstack.org/11201113:16
*** _cjones_ has quit IRC13:17
*** arezmerita has quit IRC13:19
*** ddieterly has quit IRC13:21
*** raymondr has joined #openstack-ceilometer13:27
*** itisit has joined #openstack-ceilometer13:28
*** arezmerita has joined #openstack-ceilometer13:31
*** dhellmann has quit IRC13:32
*** dhellmann has joined #openstack-ceilometer13:33
*** eglynn has quit IRC13:33
*** claudiub has quit IRC13:35
*** chuck_ has joined #openstack-ceilometer13:35
*** zul has quit IRC13:36
*** dhellmann has quit IRC13:36
*** raymondr has quit IRC13:37
*** dhellmann has joined #openstack-ceilometer13:39
*** raymondr has joined #openstack-ceilometer13:40
*** renatoarmani has joined #openstack-ceilometer13:40
*** shakamunyi has joined #openstack-ceilometer13:42
*** thomasem has joined #openstack-ceilometer13:43
*** underyx is now known as underyx|off13:45
*** raymondr has quit IRC13:45
*** underyx|off is now known as underyx13:48
*** shakamunyi has quit IRC13:49
*** ddieterly has joined #openstack-ceilometer13:58
*** flwang_ has joined #openstack-ceilometer14:04
openstackgerritDina Belova proposed a change to stackforge/gnocchi: [WIP] Add OpenTSDB storage driver  https://review.openstack.org/10798614:05
*** eglynn has joined #openstack-ceilometer14:06
*** flwang_ has quit IRC14:08
*** raymondr has joined #openstack-ceilometer14:10
*** shakamunyi has joined #openstack-ceilometer14:11
*** _cjones_ has joined #openstack-ceilometer14:13
*** Dev_Jin has quit IRC14:14
*** fnaval has joined #openstack-ceilometer14:16
*** _cjones_ has quit IRC14:17
*** shakamunyi has quit IRC14:32
sijo_eglynn: thanks14:34
*** Longgeek has quit IRC14:41
*** _nadya_ has quit IRC14:45
*** dmsimard_away is now known as dmsimard14:45
*** sijo_ has quit IRC14:51
*** chuck_ is now known as zul14:54
*** zul has quit IRC14:54
*** zul has joined #openstack-ceilometer14:54
*** ildikov has quit IRC14:55
*** ildikov has joined #openstack-ceilometer15:00
openstackgerritPradeep Kilambi proposed a change to openstack/ceilometer: Support for per disk volume measurements  https://review.openstack.org/11103815:05
*** _nadya_ has joined #openstack-ceilometer15:07
*** ccrouch1 has joined #openstack-ceilometer15:08
*** ccrouch has quit IRC15:12
*** shakamunyi has joined #openstack-ceilometer15:12
*** IvanBerezovskiy1 has left #openstack-ceilometer15:14
*** ilyashakhat_ has quit IRC15:20
*** ityaptin has quit IRC15:20
*** vrovachev has quit IRC15:20
*** ityaptin has joined #openstack-ceilometer15:20
*** ilyashakhat has joined #openstack-ceilometer15:20
*** prad has quit IRC15:26
*** shakamunyi has quit IRC15:28
*** ilyashakhat has quit IRC15:35
*** ityaptin has quit IRC15:35
*** ityaptin has joined #openstack-ceilometer15:35
*** ilyashakhat has joined #openstack-ceilometer15:35
*** mspreitz has joined #openstack-ceilometer15:37
mspreitzCan a cloud provider introduce configuration options?  When I try to define some in my pollster, it fails because it is too late.15:37
*** deepthi has joined #openstack-ceilometer15:39
*** mspreitz has quit IRC15:44
*** ifarkas has quit IRC15:44
*** tomoiaga has joined #openstack-ceilometer15:48
*** raymondr has quit IRC15:52
openstackgerritA change was merged to openstack/ceilometer: Debug env for tox  https://review.openstack.org/11070715:55
*** fabiog has joined #openstack-ceilometer15:59
tomoiagaI'm curious if there is a way to get (from API) specific fields for samples. I don't need all the fields each time I do a query, just a few of them.15:59
*** raymondr has joined #openstack-ceilometer16:00
*** Ruetobas has quit IRC16:01
*** fnaval has quit IRC16:02
eglynntomoiaga: we don't have a way of selectively excluding some sample fields from the API output16:02
*** Ruetobas has joined #openstack-ceilometer16:03
tomoiagaeglynn: ok, thank you!16:03
*** flwang_ has joined #openstack-ceilometer16:04
*** thomasem has quit IRC16:05
*** fnaval has joined #openstack-ceilometer16:06
*** Ruetobas has quit IRC16:08
*** flwang_ has quit IRC16:09
*** thomasem has joined #openstack-ceilometer16:12
*** Ruetobas has joined #openstack-ceilometer16:13
*** deepthi has quit IRC16:13
*** openstackstatus has quit IRC16:17
*** openstack has joined #openstack-ceilometer16:17
*** openstackstatus has joined #openstack-ceilometer16:17
*** ChanServ sets mode: +v openstackstatus16:17
*** tomoiaga has quit IRC16:23
*** raymondr has quit IRC16:24
*** raymondr has joined #openstack-ceilometer16:25
*** tovstun has joined #openstack-ceilometer16:27
*** raymondr has quit IRC16:30
*** shang has joined #openstack-ceilometer16:30
*** regebro has joined #openstack-ceilometer16:31
*** prad has joined #openstack-ceilometer16:32
*** safchain has quit IRC16:39
*** rwsu has joined #openstack-ceilometer16:43
*** ddieterly has quit IRC16:45
openstackgerritOpenStack Proposal Bot proposed a change to openstack/ceilometer: Updated from global requirements  https://review.openstack.org/11009616:48
*** promulo has joined #openstack-ceilometer16:51
*** mrmoje has joined #openstack-ceilometer17:00
*** sbfox has joined #openstack-ceilometer17:07
*** mspreitz has joined #openstack-ceilometer17:11
mspreitzCan anybody explain why my Ceilometer has network.incoming.packets.rate samples?  I see nothing about that in my Ceilometer entry_points.txt nor the debug loggin in central.log17:12
*** shang has quit IRC17:12
ildikovmspreitz: it comes from a transformer configured in pipeline.yaml: https://github.com/openstack/ceilometer/blob/master/etc/ceilometer/pipeline.yaml#L12817:14
ildikovmspreitz: more information about pipelines: http://docs.openstack.org/developer/ceilometer/configuration.html#pipelines17:15
mspreitzInteresting... my entry_points has stuff for ...bytes.rate but not packets.rate, and my pipeline specifies derivation of rate for both bytes and packets!17:16
mspreitzWhy does my config specify two sources for ...bytes.rate?17:17
ildikovmspreitz: which two sources do you mean?17:17
mspreitzIn my Ceilometer egg, entry_points.txt has, e.g., network.incoming.bytes.rate = ceilometer.compute.pollsters.net:IncomingBytesRatePollster (and same for outgoing).  And pipeline.yaml says how to derive network.incoming.bytes.rate from network.incoming.bytes17:18
ildikovmspreitz: but it's still one source17:20
ildikovmspreitz: or maybe I didn't get your concern17:20
mspreitzildikov: my entry_points.txt says network.incoming.bytes = ceilometer.compute.pollsters.net:IncomingBytesPollster --- and that, all by itself, produces network.incoming.bytes Samples...17:21
mspreitzMy entry_points.txt also says network.incoming.bytes.rate = ceilometer.compute.pollsters.net:IncomingBytesRatePollster.. so I suppose that all by itself is sufficient to produce network.incoming.bytes.rate Samples ...17:22
mspreitzAnd then my pipeline gives another way to produce network.incoming.bytes.rate Samples17:22
*** sbfox has quit IRC17:23
ildikovmspreitz: ah, ok, I see now17:25
ildikovmspreitz: good question, currently I cannot answer this question, I would need to check the code17:26
mspreitzildikov: thanks, that would be helpful17:28
ildikovmspreitz: I need to run soon17:28
ildikovmspreitz: can you check back tomorrow within UTC office hours?17:29
mspreitzIt's not an immediate blocker, an answer later would be great.  mspreitz@us.ibm.com17:29
mspreitzI'll try17:29
mspreitzthanks17:29
ildikovmspreitz: cool, if it's not that urgent, then I will drop you a mail, if I could get there to check this17:30
mspreitzthanks, any clues will be appreciated17:30
ildikovmspreitz: sure, I will check tomorrow and let you know about the details17:31
mspreitzthanks17:31
*** sbfox has joined #openstack-ceilometer17:34
*** fnaval has quit IRC17:35
*** fnaval has joined #openstack-ceilometer17:35
DinaBelovafabiog, eglynn, folks, some follow-up questions after the call17:38
DinaBelovaI decided to move them here as we were running out of time actually17:38
DinaBelovafabiog, eglynn - that's sad Marco left us during the discussion - as I feel something uncomfortable about the taskflow+scalability17:39
DinaBelovaeglynn - please correct me if i'm awfully wrong - but as far as I know taskflow is really not distributed thing to be used17:39
*** fnaval has quit IRC17:39
eglynnDinaBelova: do you mean that you have doubts about the scalability of taskflow?17:39
DinaBelovayes, indeed17:39
DinaBelovaeglynn - I understand the openstacky patern of extracting things to the libs, etc. to be reused17:40
DinaBelovabut actually as I'm not the expert here (I mean taskflow) - and I see no way to use it not only in the active/passive mode17:40
DinaBelovabecause tooz currently (at least as I understood while surfing its code) is only leadership election thing - well, okay, probably we may make it better, etc. But actually I see no job around making taskflow something distributed17:41
DinaBelovathat's why fabiog's solution is something I can see not only HA, but scalable as well17:42
DinaBelovaand something with taskflow - no - at least with the understanding I have currently17:43
eglynnDinaBelova: why is taskflow relevant?17:43
eglynnDinaBelova: neither approach uses taskflow17:43
DinaBelovaeglynn, I mean the Julien's idea not to store tasks info in the ceilo DB, but use the taskflow to manage the tasks17:44
DinaBelovaand here I see no way to make this scalable in the closest future - but  actually I might be awfully wrong here with some terrible misunderstanding17:45
DinaBelovaeglynn, am I? Really I want to solve this mystery and central agent HA+scalability asap - because this feature is really important for us (well, for all of us I guess)17:47
eglynnDinaBelova: IIUC fabiog just included tasklow in that preso because he wanted to see how his notion of database-based locking would map onto taskflow17:47
mspreitzI have a couple of quick questions about https://github.com/openstack/ceilometer/blob/master/ceilometer/agent.py#L109 ...17:47
eglynnDinaBelova: so just to re-iterate, neither solution requires taskflow17:48
mspreitzFirst and foremost, can one really just gin up an admin context like that?  No real auth token?17:48
nsajeDinaBelova: tooz is not just leader election. Tooz provides distributed coordination primitives. Those include leader election, group membership and distributed locking currently17:49
DinaBelovaeglynn, mmmm.... well, as far as I understood that was one of the greatest disagreement Julien had with Alexey and then with Fabio17:49
DinaBelovansaje, a-ha!17:49
nsajeDinaBelova: and it's entirely scalable. Currently it has Zookeeper and Memcached backends available, both of which are scalable17:50
nsajeDinaBelova, in the future, we might only need AMQP even17:50
DinaBelovansaje, so the services running in one group might be fully active/active17:50
nsajeDinaBelova, exactly17:50
eglynnDinaBelova: here's the proposal https://review.openstack.org/#/c/111978/1/specs/juno/central-agent-partitioning.rst17:50
DinaBelovaeglynn, yes, I went through it quickly before the presentation17:51
eglynnDinaBelova: when we talked about the alternative on that call just now, that's it what we meant ^^^17:51
eglynnDinaBelova: i.e. not the prior discussion at summit with Alexey etc.17:51
DinaBelovaeglynn, no-no, I kept in mind the mid-cycle discussion17:52
DinaBelovaand I guess I misunderstood current tooz functionality17:52
fabiogDinaBelova: I guess Taskflow now is out of the picture17:52
DinaBelovafabiog, yes, okay17:52
fabiogDinaBelova: Tomorrow I want to understand what Tooz adds compared to just use Zookeper17:53
eglynnDinaBelova, fabiog: yep https://review.openstack.org/#/c/111978/1/specs/juno/central-agent-partitioning.rst only requires shared knowledge of the other agent's existence17:53
*** aviau has quit IRC17:53
eglynnDinaBelova, fabiog: i.e. no central authority to distribute tasks such as taskflow17:54
fabiogeglynn: so the agents are talking to each other or asking tooz?17:54
nsajefabiog, tooz is just an abstraction and enables you to use different backends17:54
nsajefabiog, so you're not bound to zookeeper17:54
DinaBelovafabiog, nsaje - so actually we're communicating with zookeeper for now17:54
fabiognsaje: if the solution relies on a clustering technique I don't need the abstraction17:54
eglynnDinaBelova, fabiog: was that lack of a taskflow dependency not clear from the gerrit proposal and the discussion on the call?17:55
nsajeDinaBelova, fabiog: No, we're using distributed coordination primitives. Backend is irrelevant17:55
fabiognsaje: I just use the one I like17:55
gordcfabiog: i think the idea is that what you like isn't necessarily the solution for everyone.17:55
nsajefabiog, DinaBelova: I suggest we take this discussion to gerrit :)17:55
fabiogeglynn: is that last time you proposed the usage of Taskflow and mentioned that the Job Board would be used to know the status of all the jobs (agents)17:55
gordcso that abstraction allows everyone ability to choose.17:56
fabiogeglynn: I guess this is what created the confusion17:56
DinaBelovaeglynn, just to make sure - as I clearly remember Julien was strictly about the taskboard usage17:56
DinaBelovafabiog, exactly17:56
DinaBelovaeglynn, I mean TaskBoard in the TaskFlow17:56
*** renatoarmani has quit IRC17:56
*** ildikov has quit IRC17:56
nsajeDinaBelova, here are the two specs we're talking about, so we're on the same page: https://review.openstack.org/#/c/101282/5 and https://review.openstack.org/#/c/111978/117:57
eglynnDinaBelova, fabiog: but again, the prior discussions about potentially using taskflow isn't really relevant to the current state of either proposal, or?17:57
fabiogeglynn: I never wanted to use taskflow, but at that time it seemed a requirement to use this library as part of the Openstack ecosysten17:58
DinaBelovaeglynn, if so, that makes much more sense for me - I'm really sorry I misunderstood current tooz proposal - it was something linked with the taskflow as a technique in my mind17:58
DinaBelovaI mean, due to the previous endless discussions17:59
fabiogeglynn: if that requirement is gone, then I don't need to investigate further since I don't believe Taskflow is suited for HA17:59
DinaBelovansaje, yeah, thanks17:59
DinaBelovafabiog, ++17:59
fabiogeglynn: I believe you guys have reached the same conclusion :-)17:59
eglynnfabiog: the preference was to use the prior art in the ecosystem, *if* this was relevant to the solution18:00
eglynnfabiog: as opposed to "you must use taskflow for the sake of using taskflow!" ;)18:00
DinaBelovaeglynn, ok, so it looks like fabiog and /me missed the taskflow disappearing from the tooz proposal18:01
eglynnDinaBelova: well it was never in the proposal on gerrit18:01
eglynnIIUC18:01
eglynnbut yeah, it featured in the initial discussions18:02
eglynn(at summit and mid-cycle)18:02
DinaBelovaeglynn, yes, you're right. mid-cycle thing tricked me much18:02
* DinaBelova needs to go through the https://review.openstack.org/#/c/111978/1/specs/juno/central-agent-partitioning.rst one more time for sure18:02
DinaBelovaat least I have time before tomorrow :)18:03
eglynnfabiog, DinaBelova: /me needs to drop for another call now18:03
eglynn(already very late)18:03
eglynnchat more tmrw18:03
DinaBelovaeglynn, oh, sorry18:03
eglynnDinaBelova: np!18:03
DinaBelovaeglynn, see u18:03
fabiogeglyn: good night and thanks for your time18:03
gordcfabiog: unrelated but have you seen this spec: https://github.com/openstack/oslo-specs/blob/master/specs/juno/taskflow-redis-jobs.rst18:03
nsajeyeah, good night guys!18:05
*** flwang_ has joined #openstack-ceilometer18:05
*** changbl has joined #openstack-ceilometer18:07
*** flwang_ has quit IRC18:10
*** ildikov has joined #openstack-ceilometer18:12
DinaBelova nsaje, thank you for your time, bye!18:12
*** raymondr_ has joined #openstack-ceilometer18:16
*** promulo_ has joined #openstack-ceilometer18:23
*** promulo has quit IRC18:23
*** regebro has quit IRC18:31
openstackgerritOpenStack Proposal Bot proposed a change to openstack/ceilometer: Updated from global requirements  https://review.openstack.org/11009618:32
openstackgerritgordon chung proposed a change to openstack/ceilometer: normalise resource data  https://review.openstack.org/11131318:33
*** sbfox has quit IRC18:33
*** sbfox has joined #openstack-ceilometer19:07
*** rwsu has quit IRC19:18
*** aviau has joined #openstack-ceilometer19:19
*** underyx has quit IRC19:20
*** mspreitz has quit IRC19:22
*** dhellmann is now known as dhellmann_19:22
*** aviau has quit IRC19:25
openstackgerritA change was merged to openstack/ceilometer: Sahara integration with Ceilometer  https://review.openstack.org/11024919:26
eglynngordc: quick question about the pycadf token leak CVE19:28
eglynni.e. https://review.openstack.org/#/q/Ia1bfa1bd24989681db1d2f385defc12e69a01f8d,n,z19:28
eglynngordc: ^^^ should that have been backported to stable/havana also?19:29
eglynngordc: (or didn't impact on the havana codebase?)19:29
gordceglynn: wasn't it backported to stable/havana? or are you asking if it shouldn't have been?19:30
eglynngordc: I was more asking if it need to be backported to stable/havana ... i.e. if the bug existed in the havana timeframe?19:31
gordchttps://review.openstack.org/#/c/101799/19:31
gordceglynn: it was backported to havana ceilometer19:32
gordcbut yes, the bug did exists in havana... whether or not it was actually used by anyone is another item.19:32
*** fnaval has joined #openstack-ceilometer19:33
eglynngordc: a-ha, sorry, I mis-read the output of my own gerrit query ... my bad!19:33
eglynngordc: apols for the noise19:33
gordc:) np19:34
gordci do that once a day.19:34
*** sbfox has quit IRC19:34
*** alexpilotti has quit IRC19:34
*** sbfox has joined #openstack-ceilometer19:36
*** mspreitz has joined #openstack-ceilometer19:37
*** fabiog has quit IRC19:48
*** _nadya_ has quit IRC19:48
*** sbfox has quit IRC19:52
*** _nadya_ has joined #openstack-ceilometer19:52
*** _nadya_ has quit IRC19:54
*** rwsu has joined #openstack-ceilometer19:54
*** sbfox has joined #openstack-ceilometer19:56
*** raymondr_ has quit IRC19:58
*** raymondr_ has joined #openstack-ceilometer20:01
*** dhellmann_ is now known as dhellmann20:02
*** flwang_ has joined #openstack-ceilometer20:06
*** palar_ has joined #openstack-ceilometer20:07
*** palar has quit IRC20:10
*** flwang_ has quit IRC20:11
*** palar_ has quit IRC20:12
*** fnaval has quit IRC20:21
*** fnaval has joined #openstack-ceilometer20:22
*** _nadya_ has joined #openstack-ceilometer20:25
*** fnaval has quit IRC20:26
*** tovstun has quit IRC20:30
*** julim has quit IRC20:34
*** sbfox has quit IRC20:35
*** eglynn has quit IRC20:42
*** sbfox has joined #openstack-ceilometer20:48
*** ccrouch1 has quit IRC20:48
*** fnaval has joined #openstack-ceilometer20:50
openstackgerritEric Pendergrass proposed a change to openstack/ceilometer-specs: Placeholder commit during draft stage  https://review.openstack.org/11213720:54
flwangeglynn-office: ping20:54
*** ccrouch has joined #openstack-ceilometer20:57
*** thomasem has quit IRC21:02
*** sbfox has quit IRC21:03
*** sbfox has joined #openstack-ceilometer21:07
*** eglynn has joined #openstack-ceilometer21:08
openstackgerritEric Pendergrass proposed a change to openstack/ceilometer-specs: Placeholder commit during draft stage  https://review.openstack.org/11213721:15
*** openstackgerrit has quit IRC21:16
*** openstackgerrit has joined #openstack-ceilometer21:16
*** jasondotstar has quit IRC21:20
*** sbfox has quit IRC21:24
*** mspreitz has quit IRC21:26
openstackgerritEric Pendergrass proposed a change to openstack/ceilometer-specs: Placeholder commit during draft stage  https://review.openstack.org/11213721:30
*** gordc has quit IRC21:38
*** sbfox has joined #openstack-ceilometer21:42
*** sdake has quit IRC21:49
*** thomasem has joined #openstack-ceilometer21:51
*** thomasem has quit IRC21:59
*** jaypipes has quit IRC22:05
*** sbfox has quit IRC22:06
*** sbfox has joined #openstack-ceilometer22:07
*** flwang_ has joined #openstack-ceilometer22:07
*** prad has quit IRC22:11
*** flwang_ has quit IRC22:12
*** itisit has quit IRC22:28
*** sdake has joined #openstack-ceilometer22:31
*** sdake has joined #openstack-ceilometer22:31
*** underyx has joined #openstack-ceilometer22:44
*** eglynn has quit IRC22:45
*** changbl has quit IRC22:50
*** eglynn has joined #openstack-ceilometer23:01
*** raymondr_ has quit IRC23:05
*** dmsimard is now known as dmsimard_away23:07
*** palar has joined #openstack-ceilometer23:09
*** palar has quit IRC23:10
*** palar has joined #openstack-ceilometer23:10
*** palar has quit IRC23:10
*** palar has joined #openstack-ceilometer23:11
*** _cjones_ has joined #openstack-ceilometer23:12
*** ccrouch has quit IRC23:13
openstackgerritA change was merged to openstack/ceilometer: Add notifications for identity CRUD events  https://review.openstack.org/10961623:18
*** sbfox has quit IRC23:27
*** _cjones_ has quit IRC23:30
*** _cjones_ has joined #openstack-ceilometer23:31
*** Ruetobas has quit IRC23:46
*** Ruetobas has joined #openstack-ceilometer23:54
openstackgerritOpenStack Proposal Bot proposed a change to openstack/ceilometer: Updated from global requirements  https://review.openstack.org/11009623:57
*** rbowen has quit IRC23:59
*** Ruetobas has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!