Wednesday, 2024-01-24

-@gerrit:opendev.org- Bernhard Berg proposed: [zuul/zuul] 905700: Add a zuul unreachable variable to indicate if a host node is unreachable https://review.opendev.org/c/zuul/zuul/+/90570009:25
-@gerrit:opendev.org- Fabien Boucher proposed on behalf of Artem Goncharov: [zuul/zuul] 813136: Check blocking_discussions_resolved in gitlab driver https://review.opendev.org/c/zuul/zuul/+/81313610:06
-@gerrit:opendev.org- Fabien Boucher proposed: [zuul/zuul] 906355: gitlab doc - update the reference pipelines https://review.opendev.org/c/zuul/zuul/+/90635510:37
@mfeder:matrix.orgHello, I'm curious about the configuration and setup of Graphite, specifically regarding retention, used for https://grafana.opendev.org/. I noticed significant disk consumption (around 10GB in approximately 4 hours) when collecting metrics from a single, non-HA instance of Zuul. I came across this configuration at https://opendev.org/opendev/system-config/src/branch/master/playbooks/roles/graphite/templates. Is this the configuration employed for Graphite at grafana.opendev.org?11:45
@mhuin:matrix.orgnice!12:46
-@gerrit:opendev.org- Benedikt Löffler proposed: [zuul/zuul] 906524: Test 10s delay bug after skipped task https://review.opendev.org/c/zuul/zuul/+/90652414:14
@jim:acmegating.commfeder: yes, that's the actual production config with the retention and aggregation tuned for use with statsd14:37
@jim:acmegating.commfeder: you can see the disk usage at http://cacti.openstack.org/cacti/graph_view.php -- curerntly 385GB14:38
@jim:acmegating.commfeder: disk usage doesn't scale by time, it scales by metric14:39
-@gerrit:opendev.org- Zuul merged on behalf of Fabien Boucher: [zuul/zuul] 906103: gitlab - avoid trigger build when reviewers added/removed https://review.opendev.org/c/zuul/zuul/+/90610315:38
-@gerrit:opendev.org- Zuul merged on behalf of Fabien Boucher: [zuul/zuul] 906355: gitlab doc - update the reference pipelines https://review.opendev.org/c/zuul/zuul/+/90635518:43
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/nodepool] 906544: Add support for AWS IMDSv2 https://review.opendev.org/c/zuul/nodepool/+/90654419:21
@mfeder:matrix.orgcorvus: Thank you. I applied the same Graphite configs, and the deployment looks good so far. 20:23
Just one thing is missing on my side. I'm wondering how you collect statsd metrics from ZooKeeper. I did not find any supported direct mechanism on the ZooKeeper side. So, my assumption is that you use a path like this: ZooKeeper JMX Metrics -> Metrics Collection Agent (e.g., Jolokia) -> Statsd/Graphite.
Could you drop some hints on this as well?
-@gerrit:opendev.org- Fabien Boucher proposed on behalf of Artem Goncharov: [zuul/zuul] 813136: Check blocking_discussions_resolved in gitlab driver https://review.opendev.org/c/zuul/zuul/+/81313620:38
@jim:acmegating.commfeder: opendev uses a script i wrote called zookeeper-statsd.py -- you should be able to find it in the system-config repo.  alternatively, zk has a prometheus exporter now if you have a prometheus laying around.20:56
@fungicide:matrix.orgyeah, if we already had a prometheus live in the opendev collaboratory, we'd likely use that instead of a home-grown statsd emitter script20:59
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 906433: Add support for persisting add_host across playbooks https://review.opendev.org/c/zuul/zuul/+/90643321:46
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/nodepool] 906596: Fix duplicate fd registration in nodescan https://review.opendev.org/c/zuul/nodepool/+/90659623:00
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/nodepool] 906544: Add support for AWS IMDSv2 https://review.opendev.org/c/zuul/nodepool/+/90654423:11

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!