Tuesday, 2016-04-05

*** thorst has quit IRC00:01
*** ChrisBenson1 has joined #openstack-telemetry00:17
*** ChrisBenson has quit IRC00:17
*** thorst has joined #openstack-telemetry00:20
*** thorst_ has joined #openstack-telemetry00:33
*** thorst has quit IRC00:36
*** julim has quit IRC00:43
*** diogogmt has quit IRC00:49
*** cheneydc has joined #openstack-telemetry01:15
*** KrishR has quit IRC01:32
*** diogogmt has joined #openstack-telemetry01:58
*** liamji has joined #openstack-telemetry02:15
*** thorst_ has quit IRC02:57
*** thorst has joined #openstack-telemetry02:57
*** jwcroppe has joined #openstack-telemetry03:02
*** thorst has quit IRC03:06
*** jwcroppe has quit IRC03:08
*** sekrit has joined #openstack-telemetry03:17
*** links has joined #openstack-telemetry03:39
*** r-mibu has quit IRC03:49
*** dongc has joined #openstack-telemetry03:58
*** cheneydc has quit IRC03:59
*** dongc is now known as cheneydc03:59
*** thorst has joined #openstack-telemetry04:03
*** dave-mccowan has quit IRC04:07
*** thorst has quit IRC04:10
*** r-mibu has joined #openstack-telemetry04:29
openstackgerritMerged openstack/ceilometer: drop magnetodb support  https://review.openstack.org/30124505:04
*** dave-mccowan has joined #openstack-telemetry05:05
*** jwcroppe has joined #openstack-telemetry05:06
*** dave-mcc_ has joined #openstack-telemetry05:07
*** thorst has joined #openstack-telemetry05:08
*** dongc has joined #openstack-telemetry05:10
*** dave-mccowan has quit IRC05:10
*** cheneydc has quit IRC05:10
*** dongc is now known as cheneydc05:10
*** jwcroppe has quit IRC05:11
*** thorst has quit IRC05:16
*** dongc has joined #openstack-telemetry05:19
*** cheneydc has quit IRC05:20
*** dongc is now known as cheneydc05:20
*** cheneydc has quit IRC05:27
*** cheneydc has joined #openstack-telemetry05:30
*** dave-mcc_ has quit IRC05:31
*** cheneydc has quit IRC05:38
*** cheneydc has joined #openstack-telemetry05:38
*** cheneydc has quit IRC05:43
*** cheneydc has joined #openstack-telemetry05:43
openstackgerritEyal proposed openstack/aodh: use set literal where possible  https://review.openstack.org/30144905:43
*** dongc has joined #openstack-telemetry05:46
*** cheneydc has quit IRC05:47
*** cheneydc has joined #openstack-telemetry05:50
*** dongc has quit IRC05:51
*** rcernin has joined #openstack-telemetry05:52
*** thorst has joined #openstack-telemetry06:14
*** yprokule has joined #openstack-telemetry06:14
*** thorst has quit IRC06:21
*** sheeprine has quit IRC06:22
*** sheeprine has joined #openstack-telemetry06:25
openstackgerritMerged openstack/python-aodhclient: Use pifpaf to setup tests  https://review.openstack.org/29778906:28
*** nadya has joined #openstack-telemetry06:34
openstackgerritEyal proposed openstack/python-gnocchiclient: Remove redundant parentheses  https://review.openstack.org/30147306:40
openstackgerritMerged openstack/ceilometer: publisher: clean out context usage  https://review.openstack.org/30035406:52
*** lsmola has joined #openstack-telemetry07:04
*** jwcroppe has joined #openstack-telemetry07:09
*** jwcroppe has quit IRC07:14
*** thorst has joined #openstack-telemetry07:19
*** nadya has quit IRC07:22
*** thorst has quit IRC07:26
*** pcaruana has joined #openstack-telemetry07:37
*** shardy has joined #openstack-telemetry07:48
*** thorst has joined #openstack-telemetry08:24
*** eglynn has joined #openstack-telemetry08:30
*** thorst has quit IRC08:30
*** ChrisBenson1 has quit IRC08:34
*** chlong has quit IRC08:35
*** yassine__ has joined #openstack-telemetry08:36
*** Liuqing has joined #openstack-telemetry08:54
*** nadya has joined #openstack-telemetry09:01
*** jwcroppe has joined #openstack-telemetry09:11
*** jwcroppe has quit IRC09:17
*** Liuqing has quit IRC09:21
*** cdent has joined #openstack-telemetry09:25
*** thorst has joined #openstack-telemetry09:28
openstackgerritJulien Danjou proposed openstack/gnocchi: carbonara: catch LockAcquireFailed exception  https://review.openstack.org/30128509:31
openstackgerritJulien Danjou proposed openstack/gnocchi: Enable CORS by default  https://review.openstack.org/29042909:32
*** thorst has quit IRC09:36
*** purplerbot has joined #openstack-telemetry09:39
*** Liuqing has joined #openstack-telemetry09:57
*** cheneydc has quit IRC10:02
openstackgerritJulien Danjou proposed openstack/python-gnocchiclient: Use pifpaf instead of overtest to run tests  https://review.openstack.org/30155310:15
openstackgerritJulien Danjou proposed openstack/gnocchi: Enable CORS by default  https://review.openstack.org/29042910:28
*** thorst has joined #openstack-telemetry10:33
*** thorst has quit IRC10:41
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: tests: tempest plugin  https://review.openstack.org/30158511:09
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: tests: tempest plugin  https://review.openstack.org/30158511:12
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: tests: tempest plugin  https://review.openstack.org/30158511:13
*** jwcroppe has joined #openstack-telemetry11:14
*** jwcroppe has quit IRC11:19
cdentsileht: thank you _so_ much for doing that tempest+gabbi stuff. has given me all kinds of ideas.11:23
*** thorst has joined #openstack-telemetry11:44
*** thorst_ has joined #openstack-telemetry11:45
*** thorst has quit IRC11:48
openstackgerritJulien Danjou proposed openstack/python-gnocchiclient: Use pifpaf instead of overtest to run tests  https://review.openstack.org/30155312:03
*** pradk has quit IRC12:17
*** pradk has joined #openstack-telemetry12:17
openstackgerritJulien Danjou proposed openstack/gnocchi: Use pbr WSGI feature to build gnocchi-api  https://review.openstack.org/30161112:25
*** gordc has joined #openstack-telemetry12:46
*** julim has joined #openstack-telemetry12:52
openstackgerritJulien Danjou proposed openstack/python-aodhclient: Remove keystonemiddleware dependency  https://review.openstack.org/30045013:01
*** jwcroppe has joined #openstack-telemetry13:17
*** mgagne_ has joined #openstack-telemetry13:20
*** jwcroppe has quit IRC13:21
*** nadya has quit IRC13:21
*** agireud has quit IRC13:21
*** mgagne has quit IRC13:21
*** LanceHaig has quit IRC13:21
*** fc__ has quit IRC13:21
*** adreznec has quit IRC13:21
*** titilambert has quit IRC13:21
*** liusheng has quit IRC13:21
*** hparekh has quit IRC13:21
*** tasdomas has quit IRC13:21
*** smurke has quit IRC13:21
*** achatterjee has quit IRC13:21
*** shardy has quit IRC13:21
*** ityaptin has quit IRC13:21
*** Liuqing has quit IRC13:21
*** cdent has quit IRC13:21
*** yprokule has quit IRC13:21
*** rcernin has quit IRC13:21
*** vishwanathj has quit IRC13:21
*** harlowja has quit IRC13:21
*** raginbajin has quit IRC13:21
*** tonyb has quit IRC13:21
*** zqfan has quit IRC13:21
*** sileht has quit IRC13:21
*** afazekas has quit IRC13:21
*** llu has quit IRC13:21
*** yarkot has quit IRC13:21
*** larainema has quit IRC13:21
*** jroll has quit IRC13:21
*** samstudio8 has quit IRC13:21
*** EmilienM has quit IRC13:21
*** iberezovskiy has quit IRC13:21
*** tobasco has quit IRC13:21
*** bapalm has quit IRC13:21
*** jmlowe has quit IRC13:21
*** swamireddy has quit IRC13:21
*** kbyrne has quit IRC13:21
*** krotscheck has quit IRC13:21
*** ryanpetrello has quit IRC13:21
*** ildikov has quit IRC13:21
*** tristanC has quit IRC13:21
*** mstyne_ has quit IRC13:21
*** gordc has quit IRC13:21
*** pcaruana has quit IRC13:21
*** Ephur has quit IRC13:21
*** jdandrea has quit IRC13:21
*** openstackgerrit has quit IRC13:21
*** sbadia has quit IRC13:21
*** gzhai2 has quit IRC13:21
*** pradk has quit IRC13:21
*** purplerbot has quit IRC13:21
*** eglynn has quit IRC13:21
*** hughhalf has quit IRC13:21
*** wolsen has quit IRC13:21
*** john5223 has quit IRC13:21
*** julim has quit IRC13:21
*** thorst_ has quit IRC13:21
*** lsmola has quit IRC13:21
*** toddnni has quit IRC13:21
*** DinaBelova has quit IRC13:21
*** jd__ has quit IRC13:21
*** zigo has quit IRC13:21
*** stevelle has quit IRC13:21
*** sekrit has quit IRC13:21
*** david-lyle has quit IRC13:21
*** mnaser has quit IRC13:22
*** r-mibu has quit IRC13:22
*** diogogmt has quit IRC13:22
*** serverascode has quit IRC13:22
*** elemoine- has quit IRC13:22
*** boris-42 has quit IRC13:22
*** g3ek has quit IRC13:22
*** nicodemus_ has quit IRC13:22
*** anteaya has quit IRC13:22
*** stupidnic has quit IRC13:22
*** sheeprine has quit IRC13:22
*** liamji has quit IRC13:22
*** idegtiarov has quit IRC13:22
*** yassine__ has quit IRC13:22
*** nijaba has quit IRC13:22
*** j_king_ has quit IRC13:22
*** ekarlso- has quit IRC13:22
*** kragniz has quit IRC13:22
*** fc__ has joined #openstack-telemetry13:24
*** nadya_ has joined #openstack-telemetry13:24
*** peristeri has joined #openstack-telemetry13:24
*** julim has joined #openstack-telemetry13:24
*** gordc has joined #openstack-telemetry13:24
*** pradk has joined #openstack-telemetry13:24
*** thorst_ has joined #openstack-telemetry13:24
*** Liuqing has joined #openstack-telemetry13:24
*** purplerbot has joined #openstack-telemetry13:24
*** cdent has joined #openstack-telemetry13:24
*** yassine__ has joined #openstack-telemetry13:24
*** eglynn has joined #openstack-telemetry13:24
*** shardy has joined #openstack-telemetry13:24
*** pcaruana has joined #openstack-telemetry13:24
*** lsmola has joined #openstack-telemetry13:24
*** sheeprine has joined #openstack-telemetry13:24
*** yprokule has joined #openstack-telemetry13:24
*** rcernin has joined #openstack-telemetry13:24
*** r-mibu has joined #openstack-telemetry13:24
*** sekrit has joined #openstack-telemetry13:24
*** liamji has joined #openstack-telemetry13:24
*** diogogmt has joined #openstack-telemetry13:24
*** david-lyle has joined #openstack-telemetry13:24
*** zqfan has joined #openstack-telemetry13:24
*** Ephur has joined #openstack-telemetry13:24
*** vishwanathj has joined #openstack-telemetry13:24
*** nicodemus_ has joined #openstack-telemetry13:24
*** jdandrea has joined #openstack-telemetry13:24
*** openstackgerrit has joined #openstack-telemetry13:24
*** adreznec has joined #openstack-telemetry13:24
*** titilambert has joined #openstack-telemetry13:24
*** liusheng has joined #openstack-telemetry13:24
*** bapalm has joined #openstack-telemetry13:24
*** jmlowe has joined #openstack-telemetry13:24
*** harlowja has joined #openstack-telemetry13:24
*** swamireddy has joined #openstack-telemetry13:24
*** kbyrne has joined #openstack-telemetry13:24
*** sileht has joined #openstack-telemetry13:24
*** idegtiarov has joined #openstack-telemetry13:24
*** serverascode has joined #openstack-telemetry13:24
*** krotscheck has joined #openstack-telemetry13:24
*** achatterjee has joined #openstack-telemetry13:24
*** ityaptin has joined #openstack-telemetry13:24
*** mnaser has joined #openstack-telemetry13:24
*** raginbajin has joined #openstack-telemetry13:24
*** toddnni has joined #openstack-telemetry13:24
*** ryanpetrello has joined #openstack-telemetry13:24
*** elemoine- has joined #openstack-telemetry13:24
*** nijaba has joined #openstack-telemetry13:24
*** afazekas has joined #openstack-telemetry13:24
*** smurke has joined #openstack-telemetry13:24
*** tasdomas has joined #openstack-telemetry13:24
*** hparekh has joined #openstack-telemetry13:24
*** ildikov has joined #openstack-telemetry13:24
*** llu has joined #openstack-telemetry13:24
*** tristanC has joined #openstack-telemetry13:24
*** sbadia has joined #openstack-telemetry13:24
*** mstyne_ has joined #openstack-telemetry13:24
*** j_king_ has joined #openstack-telemetry13:24
*** ekarlso- has joined #openstack-telemetry13:24
*** boris-42 has joined #openstack-telemetry13:24
*** yarkot has joined #openstack-telemetry13:24
*** larainema has joined #openstack-telemetry13:24
*** gzhai2 has joined #openstack-telemetry13:24
*** anteaya has joined #openstack-telemetry13:24
*** jroll has joined #openstack-telemetry13:24
*** hughhalf has joined #openstack-telemetry13:24
*** g3ek has joined #openstack-telemetry13:24
*** samstudio8 has joined #openstack-telemetry13:24
*** EmilienM has joined #openstack-telemetry13:24
*** iberezovskiy has joined #openstack-telemetry13:24
*** kragniz has joined #openstack-telemetry13:24
*** DinaBelova has joined #openstack-telemetry13:24
*** wolsen has joined #openstack-telemetry13:24
*** jd__ has joined #openstack-telemetry13:24
*** tonyb has joined #openstack-telemetry13:24
*** stupidnic has joined #openstack-telemetry13:24
*** john5223 has joined #openstack-telemetry13:24
*** tobasco has joined #openstack-telemetry13:24
*** zigo has joined #openstack-telemetry13:24
*** stevelle has joined #openstack-telemetry13:24
*** openstackstatus has quit IRC13:24
*** mgagne_ has quit IRC13:24
*** mgagne_ has joined #openstack-telemetry13:24
*** openstackstatus has joined #openstack-telemetry13:27
*** ChanServ sets mode: +v openstackstatus13:27
*** agireud has joined #openstack-telemetry13:27
*** links has quit IRC13:35
*** liamji has quit IRC13:37
*** nicodemus_ has quit IRC13:42
*** ametts has joined #openstack-telemetry13:42
*** anush_ has joined #openstack-telemetry13:45
*** Qingqing has joined #openstack-telemetry13:47
*** gordc has quit IRC13:50
*** KrishR has joined #openstack-telemetry13:51
*** yprokule has quit IRC13:54
*** gordc has joined #openstack-telemetry13:57
*** yprokule has joined #openstack-telemetry14:00
*** rbak has joined #openstack-telemetry14:01
openstackgerritMerged openstack/gnocchi: carbonara: catch LockAcquireFailed exception  https://review.openstack.org/30128514:04
*** nicodemus_ has joined #openstack-telemetry14:09
jd__Apr  5 15:56:28 localhost kernel: gnocchi-metricd[1528423]: segfault at 0 ip 00007f4fa8ec246e sp 00007ffc560e93c0 error 4 in hashtable.so[7f4fa8e93000+52000]14:13
*** nadya_ has quit IRC14:13
jd__I guess 700k bundles of measures is too much14:13
jd__:]14:13
gordcjd__: you performance testing?14:15
jd__yes14:15
gordci should probably tell you, i haven't done anything since the lab i'm suppose to have is 4months delayed14:15
gordchow's your tests going so far?14:16
nicodemus_jd__, if it helps... I've had up to 80k backlog with no segfault nor OOM issues with 2.0.1.dev1 and .dev4314:17
jd__gordc: pretty good, I redid some benchmarks of the API it's even a bit faster, I manage to send up to 190k metric/s14:17
jd__nicodemus_: yeah mine is 700k bundles and the size of a bundle is between 1 and 5k points so… I guess that's 2 or 3 M points, probably too much at this point14:18
jd__though it's not a realistic usage14:18
jd__I precise: 3 M points on _1_ metric lol14:18
jd__that's what it crashed14:18
jd__s/what/why/14:18
gordci wonder how it performs with many metrics. i think that's the slower route right now.14:19
nicodemus_jd__, looks like when we had 6,5M backlog lol14:19
jd__nicodemus_: if it's on a few thousands different metric that should work fine14:20
jd__gordc: yeah I'll try that I guess14:20
*** julim has quit IRC14:21
*** nadya has joined #openstack-telemetry14:22
*** diogogmt has quit IRC14:39
nicodemus_One question... what could cause to have N unprocessed measures that gnocchi-metricd acknowledges but don't process? (with 2.0.1.dev1 and 2.0.1.dev46)14:45
*** yprokule has quit IRC14:58
openstackgerritJulien Danjou proposed openstack/gnocchi: Use pbr WSGI feature to build gnocchi-api  https://review.openstack.org/30161114:58
*** ametts has quit IRC15:00
*** jwcroppe has joined #openstack-telemetry15:03
*** pcaruana has quit IRC15:06
openstackgerritJulien Danjou proposed openstack/gnocchi: Use pbr WSGI feature to build gnocchi-api  https://review.openstack.org/30161115:06
*** ametts has joined #openstack-telemetry15:13
*** links has joined #openstack-telemetry15:15
*** links has quit IRC15:25
*** dave-mccowan has joined #openstack-telemetry15:27
openstackgerritMerged openstack/python-ceilometerclient: Fix the disorder of items of Traits in the output of event-list  https://review.openstack.org/29499915:28
*** diogogmt has joined #openstack-telemetry15:28
*** anush_ has quit IRC15:30
*** Liuqing has quit IRC15:38
*** nadya has quit IRC15:45
*** jwcroppe has quit IRC15:48
openstackgerritMerged openstack/gnocchi: Fix --version string on all command line tools  https://review.openstack.org/30052215:49
*** cdent has quit IRC15:52
*** cdent has joined #openstack-telemetry15:53
jd__nicodemus_: nothing in theory16:02
openstackgerritgordon chung proposed openstack/ceilometer: change keystone to openstack cli  https://review.openstack.org/30179616:03
*** diogogmt_ has joined #openstack-telemetry16:06
*** diogogmt has quit IRC16:07
*** diogogmt_ is now known as diogogmt16:07
*** Qingqing has quit IRC16:19
*** anush_ has joined #openstack-telemetry16:30
*** anush_ has quit IRC16:35
*** anush_ has joined #openstack-telemetry16:39
*** aggaatul has joined #openstack-telemetry17:07
*** zqfan has quit IRC17:12
*** aggaatul has quit IRC17:14
openstackgerritJulien Danjou proposed openstack/gnocchi: Use pbr WSGI feature to build gnocchi-api  https://review.openstack.org/30161117:28
*** iberezovskiy is now known as iberezovskiy_17:31
*** shardy has quit IRC17:34
*** Qingqing has joined #openstack-telemetry17:35
*** davidlenwell has quit IRC17:42
*** julim has joined #openstack-telemetry17:48
*** davidlenwell has joined #openstack-telemetry17:49
openstackgerritJulien Danjou proposed openstack/aodh: Use pbr wsgi_scripts to build aodh-api  https://review.openstack.org/30185017:52
*** Qingqing has quit IRC18:02
*** diogogmt_ has joined #openstack-telemetry18:04
*** diogogmt has quit IRC18:06
*** diogogmt_ is now known as diogogmt18:06
*** nadya has joined #openstack-telemetry18:07
*** diogogmt has quit IRC18:17
*** nadya has quit IRC18:20
*** diogogmt has joined #openstack-telemetry18:29
*** cdent has quit IRC18:32
*** ChrisBenson has joined #openstack-telemetry18:35
openstackgerritgordon chung proposed openstack/ceilometer: add ceilometer to gnocchi configuration notes  https://review.openstack.org/30186518:38
*** rcernin has quit IRC18:41
*** nadya has joined #openstack-telemetry18:41
*** nadya has quit IRC18:42
*** yassine__ has quit IRC18:51
*** eglynn has quit IRC19:02
openstackgerritJulien Danjou proposed openstack/aodh: Use pbr wsgi_scripts to build aodh-api  https://review.openstack.org/30185019:14
openstackgerritJulien Danjou proposed openstack/gnocchi: Use pbr WSGI feature to build gnocchi-api  https://review.openstack.org/30161119:16
*** ametts has quit IRC19:17
*** pradk has quit IRC19:28
*** pradk has joined #openstack-telemetry19:29
*** julim has quit IRC19:30
*** ametts has joined #openstack-telemetry19:31
*** gordc has quit IRC19:33
*** nadya has joined #openstack-telemetry19:38
*** cdent has joined #openstack-telemetry19:49
*** gordc has joined #openstack-telemetry19:54
openstackgerritgordon chung proposed openstack/ceilometer: add ceilometer to gnocchi configuration notes  https://review.openstack.org/30186519:58
*** david-lyle_ has joined #openstack-telemetry20:28
*** david-lyle has quit IRC20:29
*** david-lyle_ is now known as david-lyle20:29
*** cdent has quit IRC21:02
*** thorst_ has quit IRC21:11
*** thorst_ has joined #openstack-telemetry21:12
*** thorst_ has quit IRC21:16
*** peristeri has quit IRC21:17
*** larainema has quit IRC21:20
*** larainema has joined #openstack-telemetry21:23
*** nadya has quit IRC21:26
*** thorst_ has joined #openstack-telemetry21:32
*** thorst_ has quit IRC21:37
*** marcin12345 has joined #openstack-telemetry21:42
*** jwcroppe has joined #openstack-telemetry21:42
marcin12345hey guys, I have realized that they way Gnocchi works with Swift is writing measures to a temporary container called "measure", then metricd is picking those up dong its aggregation and writing to different containers per resource updating objects in it (none, mean, max, min etc.)21:44
marcin12345the problem with this design is that container "measure" is a bottleneck, because more controllers you have they all write to the same swift container, making it not very scalable horizontally21:45
gordcmarcin12345: yep, that's pretty much how it works21:45
marcin12345I may be wrong, but my got felling is that it would make sense to keep contant of "measure" on some temporary disk (maybe ramdisk) locally to Gnocchi worker on the same host, what do you thinl?21:46
*** anush_ has quit IRC21:46
gordcmarcin12345: the reason it's global currently is so we can process related datapoints together. one issue with storing locally is that now if we have meeasures in two locations, we need to process (resample data) twice, instead of once.21:48
marcin12345the problem I have is with only 20 VMs, and collecting measures every 30 seconds from only one compute, Swift cannot keep up updating its metadata even with ssds21:48
*** hparekh has quit IRC21:48
*** adreznec has quit IRC21:48
gordcnot saying the current way is perfect. but plus/minuses either way.21:49
marcin12345how come you could have measures on 2 locations (servers), if the process that collected it, is running on the same server that metricd, it should be no issue21:49
gordcis the issue with writing to temporary store or processing from temporary store?21:49
marcin12345problem is with Swift not being able to update Sqlite metadata information about objects, that are so small and tiny - so problem is with writing21:51
gordcin theory, if you have a very high frequency metric, your first sample could be received and (temp) stored in gnocchi, and a second sample be received and again (temp) stored in gnocchi before the first one is processed21:51
*** hparekh has joined #openstack-telemetry21:52
*** adreznec has joined #openstack-telemetry21:52
gordcin current design, both points will be processed together in one go. while if we split it, it may be done separately (although there's proabbly ways to batch measures still)21:52
gordcmarcin12345: so as you mentioned there's two stages of writing, the temp and aggregated locations. is the backlog on api not accepting from ceilometer collector fast enough, or is the backlog on metricd processing?21:54
*** dave-mccowan has quit IRC21:55
marcin12345so as far as Gnocchi and Ceilometer is concern it sends data out with PUT to swift just fine no problems there21:55
marcin12345but once you looks what Swift is doing is throwing those errors at a time of writing21:56
gordcmarcin12345: yeah, the swift backend is probably the weakest of the lot21:56
marcin12345maybe there should be change on policy for Gnocchi in Swift21:56
marcin12345but unsure to what21:56
marcin12345how come Ceph does not have this problem?21:57
marcin12345I mean, I am assuming it doe snot21:57
gordci'm not entirely sure if all the errors are invalid but i know a good chunk of them are. swift just logs any non 200 as an error, even if it's expected (it's expected in ceilometer+gnocchi case)21:57
gordc.. _Aodh: http://docs.openstack.org/developer/aodh/21:58
gordcwhoops: this bug is one reason https://bugs.launchpad.net/gnocchi/+bug/155475921:58
openstackLaunchpad bug 1554759 in Gnocchi "swiftclient 404 errors on new metric" [High,Triaged]21:58
gordcalso this https://bugs.launchpad.net/gnocchi/+bug/155473921:58
openstackLaunchpad bug 1554739 in Gnocchi "json decode errors thrown by swift driver" [High,Triaged]21:58
gordcboth bugs are arguably on swift's end.21:59
*** nicodemus_ has quit IRC22:02
*** dave-mccowan has joined #openstack-telemetry22:02
marcin12345do you guys have any idea how Ceph is handling this problem?22:10
gordcmarcin12345: the json problem i have no idea why swift is throwing it. it's a bug either in swift or the client22:11
gordcthe 404 errors is a swiftclient bug https://bugs.launchpad.net/python-swiftclient/+bug/121317922:12
openstackLaunchpad bug 1213179 in python-swiftclient "swiftclient logs all ClientException (404) at ERROR (with traceback)" [High,Confirmed]22:12
gordcimo, the client should not be deciding what an error is and shouldn't have it's own logging for it.22:12
*** jwcroppe has quit IRC22:13
gordcin ceph and file backend, if something doesn't exists, it raises it and let's gnocchi handle it.22:13
gordcin swift, if something doesn't eixst, they catch it, spew logs, and some other stuff.22:13
openstackgerritgordon chung proposed openstack/ceilometer: remove redundant info from devstack install  https://review.openstack.org/30194922:14
openstackgerritgordon chung proposed openstack/ceilometer: delete verbose/redundant/deprecated text  https://review.openstack.org/30195022:14
openstackgerritgordon chung proposed openstack/ceilometer: delete verbose/redundant/deprecated text  https://review.openstack.org/30194922:16
gordcmarcin12345: i think we can look to see how we can better handle processing with metricd service... will brainstorm for summit.22:18
gordcgoing to drop. feel free to raise more issues to ML or here22:19
*** gordc has quit IRC22:19
openstackgerritDmitriy Ukhlov proposed openstack/ceilometer: Fixes ceilo after oslo.messaging refactoring  https://review.openstack.org/30195322:23
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: tests: tempest plugin  https://review.openstack.org/30158522:38
*** rbak has quit IRC22:43
*** Ephur has quit IRC22:44
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: tests: tempest plugin  https://review.openstack.org/30158522:46
*** diogogmt has quit IRC22:48
*** diogogmt has joined #openstack-telemetry22:51
*** ametts has quit IRC22:58
*** KrishR has quit IRC23:01
marcin12345What is the biggest deployment Ceilometer/Gnocchi has ever been tested?23:03
*** NotMyNameEither has joined #openstack-telemetry23:15
NotMyNameEitherHi! We are currently evaluating Gnocchi, for a potential deployment in our production environment (4000 instances/Gnocchi site). We were wondering if Gnocchi was ever tested at this scale yet? With which storage drivers?23:18
*** thorst has joined #openstack-telemetry23:24
*** thorst_ has joined #openstack-telemetry23:28
*** thorst has quit IRC23:30
openstackgerritgordon chung proposed openstack/ceilometer: re-org existing manually install notes  https://review.openstack.org/30132123:40
openstackgerritgordon chung proposed openstack/ceilometer: change keystone to openstack cli  https://review.openstack.org/30179623:41
openstackgerritgordon chung proposed openstack/ceilometer: add ceilometer to gnocchi configuration notes  https://review.openstack.org/30186523:41
*** ChrisBenson has quit IRC23:42
openstackgerritgordon chung proposed openstack/ceilometer: add ceilometer to gnocchi configuration notes  https://review.openstack.org/30186523:55
openstackgerritgordon chung proposed openstack/ceilometer: delete verbose/redundant/deprecated text  https://review.openstack.org/30194923:55

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!