Monday, 2023-06-05

@jjbeckman:matrix.orgHi folks. Is it only me, but when using the Kubernetes driver, all jobs that execute something on the node pod take 30+ seconds to complete. For example, a simple `echo` command takes like 32 seconds to complete. Any advice on what I can do to pinpoint the reason this happens?05:00
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/nodepool] 883463: Use cached ids in node iterator more often https://review.opendev.org/c/zuul/nodepool/+/88346305:51
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com:06:06
- [zuul/nodepool] 884784: Use cache more aggressively when searching for ready nodes https://review.opendev.org/c/zuul/nodepool/+/884784
- [zuul/nodepool] 884788: Log large TreeCache queue sizes https://review.opendev.org/c/zuul/nodepool/+/884788
@rancher:matrix.org> <@fungicide:matrix.org> Rancher: sorry, it's the api path mentioned in your error log, so http://localhost:9000/api/tenant/tenant/project/gitlab.com/saneladinic/zuul-config though your log says that returned an http 500 (internal server) error08:39
Okay, so once again I tried `http` to a GitLab deployment on my network using a `gitlab` driver, and it's the same `GetProjectMetadata` error along with `HTTP 500` when opening the config project. Full log: https://privatebin.net/?4c1787f73e860bb6#GPYcgLSde7VnBn7X1kB7JLsGj41DjN5VFzepe6DWJq8a
@rancher:matrix.org> <@fungicide:matrix.org> Rancher: sorry, it's the api path mentioned in your error log, so http://localhost:9000/api/tenant/tenant/project/gitlab.com/saneladinic/zuul-config though your log says that returned an http 500 (internal server) error08:39
* Okay, so once again I tried `http` to a GitLab deployment on my network using the `gitlab` driver, and it's the same `GetProjectMetadata` error along with `HTTP 500` when opening the config project. Full log: https://privatebin.net/?4c1787f73e860bb6#GPYcgLSde7VnBn7X1kB7JLsGj41DjN5VFzepe6DWJq8a
@rancher:matrix.org * Okay, so once again I tried `http` to a GitLab deployment on my network using the `gitlab` driver, and it's the same `GetProjectMetadata` error along with `HTTP 500` when opening the config project. Full log: https://privatebin.net/?2d26eca9a0e7c06f#4gmTrhqVJzszsFGtSRzd2w1ZMEbrEvqxqJnDvpzdbtJU08:53
-@gerrit:opendev.org- Dong Zhang proposed: [zuul/nodepool] 885212: Should not clean up baremetal ports https://review.opendev.org/c/zuul/nodepool/+/88521209:35
-@gerrit:opendev.org- Dong Zhang proposed: [zuul/nodepool] 885212: Do not clean up baremetal ports https://review.opendev.org/c/zuul/nodepool/+/88521209:40
-@gerrit:opendev.org- Dong Zhang proposed wip: [zuul/nodepool] 885212: Do not clean up baremetal ports https://review.opendev.org/c/zuul/nodepool/+/88521211:01
-@gerrit:opendev.org- Dong Zhang proposed wip: [zuul/nodepool] 885212: Do not clean up baremetal ports https://review.opendev.org/c/zuul/nodepool/+/88521211:03
@fungicide:matrix.org> <@rancher:matrix.org> Okay, so once again I tried `http` to a GitLab deployment on my network using the `gitlab` driver, and it's the same `GetProjectMetadata` error along with `HTTP 500` when opening the config project. Full log: https://privatebin.net/?2d26eca9a0e7c06f#4gmTrhqVJzszsFGtSRzd2w1ZMEbrEvqxqJnDvpzdbtJU14:32
that indicates `tenant.layout.getProjectMetadata(project.canonical_name)` is returning `None` for project `gitlab/root/zuul-config` in your `tenant` tenant
@fungicide:matrix.orgthough your log says this:`web_1           | 2023-06-05 08:50:30,412 INFO zuul.TenantParser: Loading configuration from root/zuul-config/zuul.d/pipelines.yaml@main`14:34
@fungicide:matrix.orgi wonder if that's supposed to be `gitlab/root/zuul-config` instead?14:35
@fungicide:matrix.orglike maybe something isn't canonicalized somewhere when it should be14:36
@fungicide:matrix.orgRancher: can you see if the non-canonical http://192.168.33.78:9000/t/tenant/project/root/zuul-config returns content?14:37
@fungicide:matrix.org> <@jjbeckman:matrix.org> Hi folks. Is it only me, but when using the Kubernetes driver, all jobs that execute something on the node pod take 30+ seconds to complete. For example, a simple `echo` command takes like 32 seconds to complete. Any advice on what I can do to pinpoint the reason this happens?14:38
how long does it take to run that same command via kubeadm from the executor? maybe you can trace the call to identify delays (maybe it's trying ipv6 and then falling back to v4 after a timeout, or failing to perform a dns lookup and then falling back on an alternate resolver, et cetera)
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/nodepool] 885099: Use asynchronous fetch operations for tree cache https://review.opendev.org/c/zuul/nodepool/+/88509917:09
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 885298: Use os.open with setpag https://review.opendev.org/c/zuul/zuul/+/88529817:27
@jim:acmegating.comfungi: Clark ^17:27
@jim:acmegating.comianw: ^17:27
-@gerrit:opendev.org- Clark Boylan proposed: [zuul/zuul] 885299: Document the source of the afs 0x40084301 ioctl magic number https://review.opendev.org/c/zuul/zuul/+/88529917:49
-@gerrit:opendev.org- Clark Boylan proposed: [zuul/zuul] 885299: Document the source of the afs 0x40084301 ioctl magic number https://review.opendev.org/c/zuul/zuul/+/88529917:54
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul] 885298: Use os.open with setpag https://review.opendev.org/c/zuul/zuul/+/88529819:57
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/nodepool] 885199: Add extra-resources handling to openshift drivers https://review.opendev.org/c/zuul/nodepool/+/88519921:52

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!