Tuesday, 2023-05-23

-@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] 880138: Ensure cycle dependencies are enqueued ahead https://review.opendev.org/c/zuul/zuul/+/88013807:13
@westphahl:matrix.orgClark: thanks, I think there won't be an issue (see my reply), but I think your suggestion still makes sense07:16
@newbie23:matrix.orghi guys, we are using Zuul+GitHub(unprotected branches excluded, as suggested by the doc): what is the best way to implement stacked pull requests?08:30
Essentially, we want the jobs when someone creates a pull request project-foo@branch-bar -> project-foo@branch@baz (so any branch).
The ideas would be to have exclude-unprotected-branches: true at tenant level, and then set the it to false for specific projects where developers want stacked PRs.
https://zuul-ci.org/docs/zuul/latest/tenants.html#tenant
Any comment, suggestion, experience to share? :)
@rancher:matrix.orgI'm out of ideas. GetProjectMetadata() error all over again. I don't see any other errors before it (apart from Gerrit ones, which I don't use). Here's the full log and config files, if someone can take a look, please: https://privatebin.net/?110f8c4d92adb803#BYCoH9MtChu4hrfUTDABUZzCvfwkuRwbRJYRMZw8Bqr08:49
@jjbeckman:matrix.orgHi folks, would appreciate any advice. In the documentation, I found the following snippet of information.09:03
> Access to Zuul’s REST API and web interface can optionally be restricted. By default, anonymous read access to any tenant is permitted. Optionally, some administrative actions may also be enabled and restricted to authorized users.
https://zuul-ci.org/docs/zuul/latest/authentication.html
Apparently, there is an option to restrict access to the Web UI? I am unable to find any information on how this can be achieved. Could someone point me in the right direction?
@mhuin:matrix.orgjjbeckman: You can enable openID Connect authentication on the web UI with a third-party Identity Provider. This will enable authenticated users that match your defined admin rules to perform administrative actions such as dequeues and autoholds from the web UI09:09
@mhuin:matrix.orgThere is a step-by-step tutorial to do so with keycloak in the doc: https://zuul-ci.org/docs/zuul/latest/howtos/openid-with-keycloak.html09:09
@mhuin:matrix.orgOpenID Connect being an open standard, doing so with other providers should be similar09:09
@mhuin:matrix.orgyou can also run a test compose with keycloak to test authentication on the web UI: https://zuul-ci.org/docs/zuul/latest/tutorials/keycloak.html09:10
-@gerrit:opendev.org- Marvin Becker proposed: [zuul/nodepool] 873716: Add gpu support for k8s/openshift pods https://review.opendev.org/c/zuul/nodepool/+/87371609:10
-@gerrit:opendev.org- Simon Westphahl proposed on behalf of Tobias Henkel: [zuul/nodepool] 883058: Defer node request when label is not available https://review.opendev.org/c/zuul/nodepool/+/88305809:23
-@gerrit:opendev.org- Marvin Becker proposed: [zuul/nodepool] 883900: Add k8s annotations to pods https://review.opendev.org/c/zuul/nodepool/+/88390009:29
@rancher:matrix.org> <@jim:acmegating.com> Rancher: you might find the configurator at https://acmegating.com/acme-enterprise-zuul/#start helpful.  it will help you make the configuration files with gitlab.  you can use it on its own (it produces a docker-compose file like the quick-start), or just take the gitlab parts and splice them into the zuul quick-start.11:36
Is there a way to download the configs without cloud settings? It throws some errors when I use its "docker-compose.yaml" file, and I'm not sure what to remove to disable AWS/Azure/Google.
Pipelines do work (they show up in the Status page), but I'd still like to use my own. There are some errors in the logs though, for instance:
ERROR zuul.Pipeline.tenant.check: Exception loading ZKObject <zuul.model.PipelineState object at 0x7f19e3076e50> at /zuul/tenant/tenant/pipeline/check
WARNING zuul.Pipeline.tenant.check: Initializing pipeline state for check; this is expected only for new pipelines
ERROR zuul.Pipeline.tenant.check: Exception loading ZKObject <zuul.model.PipelineChangeList object at 0x7f19e114be10> at /zuul/tenant/tenant/pipeline/check/change_list
WARNING zuul.Pipeline.tenant.check: Initializing pipeline change list for check; this is expected only for new pipelines
-@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] 883935: Add test for reporting of transient build errors https://review.opendev.org/c/zuul/zuul/+/88393512:22
@jim:acmegating.comRancher: you can ignore those errors (those are new pipelines, so that's an expected error)13:33
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/nodepool] 883940: Parallelize static startup more https://review.opendev.org/c/zuul/nodepool/+/88394014:07
-@gerrit:opendev.org- Clark Boylan proposed: [zuul/nodepool] 883864: Move nodepool functests to podman https://review.opendev.org/c/zuul/nodepool/+/88386415:38
@jim:acmegating.comfungi: i don't see an easy way to install podman >= 4.3.0 in our bullseye container; do you?  https://packages.debian.org/search?searchon=names&keywords=podman16:16
@jim:acmegating.comfungi: (looking at that, i don't see it in any backport repos, so i think that means we'd need a rebuild, or we'd need to upgrade our images to bookworm)16:16
@clarkb:matrix.orgUpgrading images to bookworm should be doable but we should probably do that after the revert to docker hub for those images if we do that16:18
@clarkb:matrix.orgThose images will be first to move too so that rebuilds of other images use the proper location so shouldn't take long16:18
@jim:acmegating.comClark: right because opendev doesn't have bookworm images yet, and that would be step 1 of that process?16:19
@clarkb:matrix.orgyup16:20
@clarkb:matrix.orgwe also build atop the library/python images so would need them to have bookworm images too16:20
@clarkb:matrix.orghttps://hub.docker.com/_/python/tags?page=1&name=bookworm16:21
@jim:acmegating.comalso doesn't show up as 'testing' which is an alias16:21
@fungicide:matrix.org> <@jim:acmegating.com> fungi: (looking at that, i don't see it in any backport repos, so i think that means we'd need a rebuild, or we'd need to upgrade our images to bookworm)16:31
a middle ground might be to use apt pinning to pull podman and its deps from bookworm into the bullseye-based image, but given how close bookworm is to releasing (a couple weeks out) it probably makes more sense to switch the whole image to bookworm now
@jim:acmegating.comfungi: it looks like podman requires a new libsemanage-common which may pull in a bunch of other stuff...16:32
@fungicide:matrix.orgright, odds are you'd end up with an almost-bookworm image in the end anyway16:32
@fungicide:matrix.orgbut also now i see Clark 's comment about the python images not being bookworm based yet either16:33
@fungicide:matrix.orgthe need for newer libsemanage also means trying to make our own backport build (to stick in a ppa or similar) is probably going to be a royal pain16:34
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/nodepool] 883952: DNM: See if newer podman means we can remove the cgroup hack https://review.opendev.org/c/zuul/nodepool/+/88395216:35
@fungicide:matrix.orghttps://github.com/docker-library/python/pull/82216:35
@fungicide:matrix.orgthat seems to be where it's happening16:35
@jim:acmegating.comfungi: i just did a hacky install of bookworm podman in that change ^ -- i did a dry run locally and got this: https://paste.opendev.org/show/b8mp3rE6C0ONbQaVkWzq/16:36
@jim:acmegating.com`9 upgraded, 5 newly installed, 1 to remove and 173 not upgraded.` isn't too bad, but it's several source packages and some low level stuff16:37
@jim:acmegating.comso i think i still don't love the "bulid it ourselves".  i think maybe we can just use this hacky approach to figure out what we might be able to do in a little bit when bookworm releases16:37
@fungicide:matrix.orgyeah, doable as a backport i suppose, but maybe if we're going to build something ourselves temporarily anyway then building temporary bookworm python images based on the above pr would make more sense16:38
@fungicide:matrix.orgor putting the podman work on hold until that pr lands (presumably in a couple of weeks when bookworm is out)16:40
-@gerrit:opendev.org- Zuul merged on behalf of Simon Westphahl: [zuul/zuul] 880138: Ensure cycle dependencies are enqueued ahead https://review.opendev.org/c/zuul/zuul/+/88013816:48
@jim:acmegating.comi'm poking at this because Clark is switching to running podman as root, and i think this bugfix that's in a later podman might negate that need.  so if this does all shake out, maybe we run podman as root for a few weeks then roll that back.16:49
@fungicide:matrix.orgooh, yeah that sounds promising16:56
@clarkb:matrix.orgcorvus: https://review.opendev.org/c/zuul/nodepool/+/883864 passed. So I guess I need to cleanup my comments so they are accurate and useful and then I'd like to run a dib change against it to exercise podman in podman then we can see about merging things17:00
@jim:acmegating.comClark: sounds like a plan17:01
-@gerrit:opendev.org- Clark Boylan proposed: [zuul/nodepool] 883864: Move nodepool functests to podman https://review.opendev.org/c/zuul/nodepool/+/88386417:02
@clarkb:matrix.org`remote:   https://review.opendev.org/c/openstack/diskimage-builder/+/883958 DNM testing if depends-on parent change works with dib [NEW]`17:04
@clarkb:matrix.orghttps://zuul.opendev.org/t/openstack/build/5df4e0caa9f44a4d90a383ae9d8dd3a0 I think this shows that podman in podman is ok?18:30
@clarkb:matrix.orgI suspect that we can proceed with the podman job updates for zuul and nodepool given ^18:30
@jim:acmegating.comcool :)18:31
@clarkb:matrix.orgalso those jobs were just exploding due to the siblings stuff so the fact that it works implies siblings is also addressed (this was expected as the siblings issues are due to not being able to lookup tags for things outside of docker.io mirrors with docker)18:34
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul] 877178: Conditionally render ANSI console text with a black background https://review.opendev.org/c/zuul/zuul/+/87717819:50
@iwienand:matrix.orgthe only thing i'd say about this is do we intend to switch the nodepool-builders in production to podman too?  Because it seems like we'll have no testing of the production builders using docker?22:23
@clarkb:matrix.orgianw: we cannot because the builders are not jammy. We can replacethem with jammy nodes and switch them to podman but I think replacing them is necessary first22:44
@clarkb:matrix.orgone thing we can do is improve the opendev ci of the builders too to cover the bases there22:44
@clarkb:matrix.orgit is a risk but I think a relatively small one? the biggest risk is probably in doing the cgroup change removal with newer podman but we can revert that if necessary without too much fuss22:48
@jim:acmegating.comif we want, we can explicitly test that in opendev by pointing the image at an insecure-registry build22:49
@jim:acmegating.com * if we want, we can explicitly test that in opendev by pointing the image at an intermediate-registry build22:49
@jim:acmegating.com(but also, i suspect any issue with that would either show up in nodepool repo testing, or in a production workload, so probably not worth it)22:50
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 883985: Add error information to config-errors API endpoint https://review.opendev.org/c/zuul/zuul/+/88398522:55
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 883985: Add error information to config-errors API endpoint https://review.opendev.org/c/zuul/zuul/+/88398523:07
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/nodepool] 883952: DNM: See if newer podman means we can remove the cgroup hack https://review.opendev.org/c/zuul/nodepool/+/88395223:29
@jim:acmegating.comClark: ^ we got an initial okay on removing the cgroup hack -- that update also removes the sudos you added, so that should be a complete test23:30
@clarkb:matrix.orgcorvus: there is one more sudo I added in https://review.opendev.org/c/zuul/nodepool/+/883864/6/tools/functional-test-check.sh that I think you want to remove23:31
@jim:acmegating.comoh heh it's a literal sudo23:32
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/nodepool] 883952: DNM: See if newer podman means we can remove the cgroup hack https://review.opendev.org/c/zuul/nodepool/+/88395223:32
@jim:acmegating.comClark: thx23:32

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!