*** psachin has joined #openstack-telemetry | 02:49 | |
*** Bhujay has joined #openstack-telemetry | 03:53 | |
*** Bhujay has quit IRC | 05:29 | |
*** dave-mccowan has joined #openstack-telemetry | 06:01 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/aodh master: Imported Translations from Zanata https://review.openstack.org/617882 | 06:06 |
---|---|---|
*** threestrands has quit IRC | 06:34 | |
*** gkadam has joined #openstack-telemetry | 07:12 | |
*** dave-mccowan has quit IRC | 07:25 | |
*** pcaruana has joined #openstack-telemetry | 07:42 | |
*** cdent has joined #openstack-telemetry | 08:04 | |
*** pvradu has joined #openstack-telemetry | 09:13 | |
*** pvradu has quit IRC | 09:23 | |
*** pvradu has joined #openstack-telemetry | 09:23 | |
*** cdent has quit IRC | 09:43 | |
*** Bhujay has joined #openstack-telemetry | 09:50 | |
*** Bhujay has quit IRC | 09:51 | |
*** Bhujay has joined #openstack-telemetry | 09:51 | |
*** dave-mccowan has joined #openstack-telemetry | 09:54 | |
*** cdent has joined #openstack-telemetry | 10:06 | |
*** dave-mccowan has quit IRC | 10:07 | |
ivve | out of context, could anyone point me where to troubleshoot this kind of error: https://hastebin.com/cujidovoja.sql | 10:31 |
ivve | it comes from gnocchi-metricd | 10:31 |
*** alexchadin has joined #openstack-telemetry | 10:49 | |
jd_ | hi ivve | 11:04 |
jd_ | ivve: what's your coordination backend? | 11:04 |
ivve | hi jd_ | 11:04 |
ivve | im using ceilometer, aodh and gnocchi so ceilometer | 11:05 |
ivve | and store in ceph | 11:05 |
ivve | you think its a problem somewhere else? | 11:05 |
*** dave-mccowan has joined #openstack-telemetry | 11:06 | |
ivve | i have done tons of troubleshooting, so far i have tried different stuff with gnocchi.conf | 11:07 |
ivve | i have tried purging my ceph pool and running gnocchi-upgrade. no issues with that and gnocchi-config is created | 11:07 |
ivve | however im not exactly sure how that object should look like | 11:07 |
ivve | but contents look like this: {"sacks": 128} | 11:08 |
ivve | tried running with debug for extra info, no cigar | 11:08 |
ivve | tried installting tooz | 11:09 |
ivve | gnocchi version is 7.0.2 | 11:09 |
ivve | how important is [incoming] in gnocchi.conf when using ceph? i only have the ceph settings in the [storage] stanza | 11:10 |
ivve | jd_: im open for any suggestions and i can provide more logs/confs if needed | 11:11 |
jd_ | you did not answer my question | 11:11 |
jd_ | also gnocchi 7.0.2 does not exist, that's gnocchiclient version | 11:11 |
jd_ | you should put your coordination backend to redis or something like that | 11:12 |
ivve | ah | 11:12 |
jd_ | though it should not raise an error, so that's also a bug you should report :) | 11:13 |
ivve | ceph then, not using redis | 11:13 |
jd_ | you cannot use ceph as a coordinator | 11:14 |
jd_ | check your coordination_url parameter in gnocchi.conf | 11:14 |
ivve | guess i have a problem then | 11:14 |
ivve | :) | 11:15 |
jd_ | if it's unset, set it to something like a Redis URL | 11:15 |
jd_ | (i'd suggest use redis for incoming too) | 11:15 |
ivve | its strange because i checked exactly gnocchi.conf for two versions (kolla-ansible) and the difference in [incoming] is empty vs redis or empty | 11:16 |
ivve | and the first one worked, meaning [incoming] was completely empty | 11:16 |
*** alexchadin has quit IRC | 11:16 | |
ivve | i guess i could redeploy and see the difference. im just so surprised it worked before and now it doesn't | 11:17 |
ivve | jd_: so how would this even work? https://github.com/openstack/kolla-ansible/blob/stable/queens/ansible/roles/gnocchi/templates/gnocchi.conf.j2 | 11:18 |
ivve | jd_: ill deploy a redis and deploy it, see if that solves it. thanks for the clue :) | 11:21 |
ivve | redeploy gnocchi* | 11:21 |
*** dave-mccowan has quit IRC | 11:28 | |
*** cdent has quit IRC | 11:36 | |
*** cdent has joined #openstack-telemetry | 12:12 | |
*** dave-mccowan has joined #openstack-telemetry | 12:25 | |
ivve | jd_: configured redis n all, now this :( https://hastebin.com/sehogaburu.sql | 12:38 |
ivve | something tells me it can't load any incoming drivers at all, therefor previous setup also had issues | 12:40 |
ivve | btw, something i was under the impression is confirmed here | 12:41 |
ivve | from gnocchi docs: By default, the incoming driver is configured to use the same value as the storage driver. | 12:42 |
ivve | in my case ceph.. so ceph can't be incoming? | 12:42 |
ivve | i've had it like that before.. and it worked :D | 12:42 |
ivve | sorry im not an expert of gnocchi :) | 12:44 |
ivve | alright i think i got it now. the default coordinator is tooz and incoming and outgoing backends are ceph | 12:52 |
ivve | funyn thing is first error message just whined about tooz | 12:52 |
ivve | and now its whining about redis after i switched | 12:52 |
ivve | so its the coordinator indeed that is broken. i will investigate further :) | 12:52 |
jd_ | you can have ceph as incoming, though it's not recommended | 12:56 |
jd_ | you can't have ceph as coordinator | 12:56 |
ivve | im checking the docker files for tooz versions and trying to find the virtualenv | 12:56 |
ivve | jd_: check, i didn't know the default was baked into metricd docker | 12:57 |
ivve | and that it was tooz | 12:57 |
ivve | :) | 12:57 |
ivve | so tooz comes in the openstack-base image | 12:58 |
ivve | and it looks like it doesn't install with ubuntu, which im using | 13:00 |
ivve | but panko is there | 13:00 |
ivve | lets try with panko then :) | 13:00 |
ivve | i love these kind of learning experience | 13:02 |
ivve | s | 13:02 |
*** Bhujay has quit IRC | 13:14 | |
*** gmann has joined #openstack-telemetry | 13:22 | |
*** openstackgerrit has quit IRC | 13:51 | |
*** zigo has joined #openstack-telemetry | 13:56 | |
*** dave-mccowan has quit IRC | 14:03 | |
*** lemko has joined #openstack-telemetry | 14:46 | |
*** gkadam has quit IRC | 14:58 | |
*** cdent has quit IRC | 15:09 | |
*** cdent has joined #openstack-telemetry | 15:12 | |
*** pvradu has quit IRC | 15:47 | |
*** dave-mccowan has joined #openstack-telemetry | 16:04 | |
*** cdent has quit IRC | 16:06 | |
*** irclogbot_3 has quit IRC | 16:07 | |
*** irclogbot_3 has joined #openstack-telemetry | 16:08 | |
*** dave-mccowan has quit IRC | 16:20 | |
*** pcaruana has quit IRC | 16:29 | |
*** cdent has joined #openstack-telemetry | 16:46 | |
*** jmlowe has joined #openstack-telemetry | 16:52 | |
*** psachin has quit IRC | 16:58 | |
*** pcaruana has joined #openstack-telemetry | 17:11 | |
*** cdent has quit IRC | 17:38 | |
*** openstackgerrit has joined #openstack-telemetry | 17:55 | |
openstackgerrit | Rafael Folco proposed openstack/aodh master: DNM: Remove tripleo newton and ocata jobs https://review.openstack.org/618004 | 17:55 |
*** psachin has joined #openstack-telemetry | 18:12 | |
*** psachin has quit IRC | 18:25 | |
*** lemko has quit IRC | 19:19 | |
ivve | jd_: i had gnocchi 4.3.0, upgraded to 4.3.2 and ran gnocchi-upgrade and it solved my issue (tested with redis) | 19:48 |
*** jmlowe has quit IRC | 19:50 | |
ivve | jd_: wierdly enough this is the same problem https://github.com/gnocchixyz/gnocchi/issues/966 | 19:52 |
ivve | anyways, im off to rebuild the container | 19:53 |
*** pcaruana has quit IRC | 19:54 | |
*** threestrands has joined #openstack-telemetry | 21:32 | |
*** dave-mccowan has joined #openstack-telemetry | 23:17 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!