opendevreview | Merged openstack/openstack-ansible-os_cinder stable/2023.1: Allow to skip volume type management by role https://review.opendev.org/c/openstack/openstack-ansible-os_cinder/+/919873 | 11:56 |
---|---|---|
nixbuilder | Has anyone seen an error in cloudkitty where that module insists on finding an endpoint for region=RegionOne (which we do not have). Installation is Rocky 9.3, Bobcat, 28.2.0. All other modules work just fine with our region name. | 15:24 |
jrosser_ | nixbuilder: can you be clearer about what you mean by “module”? | 16:57 |
jrosser_ | is this an error in the ansible role or in the cloudkitty service, or in the service configuration? | 16:58 |
nixbuilder | jrosser_: I am not sure... what are all the openstack components (such as neutron, nova, cloudkitty, ceph, etc.) called? | 17:10 |
jrosser_ | guess i would call them services | 17:10 |
nixbuilder | jrosser_: Ok... the cloudkitty service... :) Anyway... here is the exact error: https://paste.openstack.org/show/bzSoxTpAS8vfoJdUGwFs/. | 17:11 |
nixbuilder | jrosser: Also I have grep'd call the configuration files... dumped the databases... searched everywhere on my deployment server and infra nodes and cannot find one mention or configuration option that specifies a region of 'RegionOne' (other than of course the example configuration files). | 17:13 |
jrosser_ | well, there might be configuration options for the various clients in a service in the config file | 17:13 |
jrosser_ | and those which are unspecified in the config file will have default values | 17:14 |
jrosser_ | so that could be a thing to check, put the service into debug logging and restart it, I think you should get a dump of all the settings as it starts up | 17:15 |
nixbuilder | jrosser_: https://paste.openstack.org/show/b0uowgcsg2mlRD9RzErm/ | 17:18 |
nixbuilder | jrosser_: Started in debug mode and there is no indication of any settings related to region. | 17:25 |
jrosser_ | nixbuilder: what about this? https://docs.openstack.org/cloudkitty/latest/admin/configuration/fetcher.html | 17:34 |
jrosser_ | your stack trace error is "internalURL endpoint for metric service in RegionOne region not found" | 17:35 |
jrosser_ | and in your service catalog is "| DevOps-HSV | gnocchi | metric | True | internal | http://172.29.236.101:8041 " | 17:35 |
jrosser_ | so there is an internal endpoint for the metric service (gnocchi) defined | 17:36 |
jrosser_ | to me it looks like there is a bit of confusion between what is needed for the [fetcher_gnocchi] and [fetcher_keystone] sections here https://github.com/openstack/openstack-ansible-os_cloudkitty/blob/master/templates/cloudkitty.conf.j2#L36-L37 | 17:40 |
jrosser_ | but tbh i don't run cloudkitty to have any actual experience of this | 17:41 |
nixbuilder | jrosser_: My fetcher settings seem correct... at least OSA seems to have configured it properly https://paste.openstack.org/show/buYQWrcCBbyne9E5sRwy/ | 17:44 |
jrosser_ | are you sure? | 17:44 |
jrosser_ | `auth_section` is not an option listed in the documentation for `[fetcher_gnocchi]` | 17:45 |
jrosser_ | and further than that - `[fetcher_gnocchi] region_name` defaults to `RegionOne` which is exactly the error you see | 17:46 |
jrosser_ | anyway - i just look at the documentation and say what i see :) | 17:47 |
jrosser_ | it could also be that the cloudkitty documentation is incomplete / confusing | 17:48 |
nixbuilder | jrosser_: Hmmm... well looking at the documentation it seems you are right about it being confusing... | 17:50 |
jrosser_ | nixbuilder: you are completely right about it being broken i think, look at this log from a OSA cloudkitty CI job https://zuul.opendev.org/t/openstack/build/e1345ff22c5a4a00b6315b0ed80f5cc8/log/logs/host/cloudkitty-processor.service.journal-18-31-28.log.txt#275 | 17:52 |
jrosser_ | its exactly the same as what you see over and over again | 17:52 |
nixbuilder | jrosser_: Yep... ugh... so you are getting the same error :-( | 17:55 |
jrosser_ | it seems so | 17:56 |
nixbuilder | jrosser_: At least now I don't feel so dumb. | 17:56 |
jrosser_ | i would start by modifying the cloudkitty.conf to be actually like what the docs say | 17:56 |
nixbuilder | jrosser_: That is what I am looking at now... I'll let you know how it goes. | 17:56 |
jrosser_ | oh doh this is sooo confusing `auth_section` is actually mentioned in `[fetcher_gnocchi]` in the doc | 17:57 |
jrosser_ | but it also says " If keystone is chosen, credentials can be specified in a section pointed at by the auth_section parameter." | 17:58 |
jrosser_ | and unclear if that includes region or not | 17:59 |
nixbuilder | jrosser_: Well I may have made *some* progress. I altered the configuration and now I am getting a 503 error... at least not a region error. | 18:48 |
nixbuilder | jrosser_: I give up... I've just stopped and masked the services. I was hoping to be able to get usage statistics by domain and project for internal use... can't even use grafana as it seems :'( | 20:29 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!