Wednesday, 2021-08-25

@iwienand:matrix.orgdid we change something about the log viewer page?  I'm seeing blank buttons00:23
-@gerrit:opendev.org- Ian Wienand proposed: [zuul/zuul-jobs] build-docker-image: Add flag to use BuildKit https://review.opendev.org/c/zuul/zuul-jobs/+/80591100:25
@jim:acmegating.comianw: i don't recall that being an intentional change00:40
@jim:acmegating.comi'm seeing the same00:40
@jim:acmegating.commaybe happened due to some js upgrade?00:40
@iwienand:matrix.orgsigh, probably.  i'll look into it00:40
-@gerrit:opendev.org- Ian Wienand proposed: [zuul/zuul] web: LogFile: fix severity toggle buttons https://review.opendev.org/c/zuul/zuul/+/80591900:56
-@gerrit:opendev.org- Zuul merged on behalf of Ian Wienand: [zuul/zuul-jobs] build-docker-image: Add flag to use BuildKit https://review.opendev.org/c/zuul/zuul-jobs/+/80591101:28
@jim:acmegating.comianw: -1 on that change you just self-approved02:37
@jim:acmegating.comianw: mind fixing that?02:37
@jim:acmegating.comianw: also, what's the hurry?  can't you test that with a depends-on?02:37
-@gerrit:opendev.org- Ian Wienand proposed: [zuul/zuul-jobs] build-docker-image: fix indentation of documentation https://review.opendev.org/c/zuul/zuul-jobs/+/80592802:40
@iwienand:matrix.orgcorvus: sorry about that.  it wasn't picked up by depends-on : https://zuul.opendev.org/t/openstack/build/5b9b909f4a474eaaaf4bb41567aed7b8/02:43
@jim:acmegating.comah that's running in a config project02:46
@iwienand:matrix.orgyeah; it has worked as intended in https://zuul.opendev.org/t/openstack/build/0a659c6533604344a5faa3dde59125ae -- i'm just working on splitting it out now02:48
@iwienand:matrix.orgthe reason for using it -- to pull in the assets image based on a scratch image i'm not 100% sure about.  that definitely needs comment when it's working02:48
-@gerrit:opendev.org- Zuul merged on behalf of Ian Wienand: [zuul/zuul-jobs] build-docker-image: fix indentation of documentation https://review.opendev.org/c/zuul/zuul-jobs/+/80592808:31
-@gerrit:opendev.org- Simon Westphahl proposed:10:40
- [zuul/zuul] Implement ABC for caching changes in Zookeeper https://review.opendev.org/c/zuul/zuul/+/805835
- [zuul/zuul] wip: Add source interfaces for cached changes https://review.opendev.org/c/zuul/zuul/+/805836
- [zuul/zuul] wip: Resolve change dependency references lazily https://review.opendev.org/c/zuul/zuul/+/805844
- [zuul/zuul] wip: Gerrit change cache in Zookeeper https://review.opendev.org/c/zuul/zuul/+/805837
- [zuul/zuul] wip: Github change cache in Zookeeper https://review.opendev.org/c/zuul/zuul/+/805838
- [zuul/zuul] dnm: make tests pass temporarily https://review.opendev.org/c/zuul/zuul/+/805839
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul] Improve gitlab request logging https://review.opendev.org/c/zuul/zuul/+/80566412:16
-@gerrit:opendev.org- Matthieu Huin https://matrix.to/#/@mhuin:matrix.org proposed: [zuul/zuul] Tests: add non-voting unit testing for Python 3.10 https://review.opendev.org/c/zuul/zuul/+/79627012:44
-@gerrit:opendev.org- Matthieu Huin https://matrix.to/#/@mhuin:matrix.org proposed: [zuul/nodepool] [DNM] Add unit testing with python 3.10 https://review.opendev.org/c/zuul/nodepool/+/79669112:44
-@gerrit:opendev.org- Monty Taylor https://matrix.to/#/@mordred:inaugust.com proposed: [zuul/zuul] Use buildkit to mount instead of copy /output https://review.opendev.org/c/zuul/zuul/+/71271713:24
@mordred:inaugust.comianw: ^^ I updated that patch now that you landed the buildkit support. fwiw, I wrote almost the same patch you did a year ago: https://review.opendev.org/c/zuul/zuul-jobs/+/712716 ;) 13:24
@jpew:matrix.orgI'm a little confused about artifacts. Is the onus on my job to upload the artifacts somewhere, or will zuul do it for me? I need to transfer some data (either an archive or loose files) between jobs, and I'm not sure how to do it; I don't necessarily want the files to stick around after the last job that needs them exits14:28
-@gerrit:opendev.org- Zuul merged on behalf of Monty Taylor https://matrix.to/#/@mordred:inaugust.com: [zuul/zuul] Use node image to build javascript https://review.opendev.org/c/zuul/zuul/+/72869015:12
@clarkb:matrix.org> <@jpew:matrix.org> I'm a little confused about artifacts. Is the onus on my job to upload the artifacts somewhere, or will zuul do it for me? I need to transfer some data (either an archive or loose files) between jobs, and I'm not sure how to do it; I don't necessarily want the files to stick around after the last job that needs them exits15:21
Generally the jobs are required to store, retrieve, and delete the data. The zuul_return system allows you to record those changes between jobs so they can coordinate.
@clarkb:matrix.orgzuul-jobs docker image build and publishing jobs may be a good example as they do all of that to manage image lifecycle s15:22
@erbarr:matrix.orghow can I make things show up in the summary, artifacts, logs, console?15:25
@jpew:matrix.org> <@clarkb:matrix.org> Generally the jobs are required to store, retrieve, and delete the data. The zuul_return system allows you to record those changes between jobs so they can coordinate.15:26
Ok, thanks
@clarkb:matrix.org> <@erbarr:matrix.org> how can I make things show up in the summary, artifacts, logs, console?15:28
I believe this relies on storing the JSON job manifest at the root of the build log location. And that file records data about stuff like that. The console log may only depend on the Ansible JSON log file being present at the root though
@clarkb:matrix.orgerbarr https://f918f4eca95000e5dd6c-6bcda3a769a6c31ee12f465dd60bb9a2.ssl.cf5.rackcdn.com/712717/3/check/tox-linters/43a3054/ that is what the log root looks like for a zuul linters check job. Note the manifest and job-output.json.15:30
@erbarr:matrix.orgthanks15:36
-@gerrit:opendev.org- Monty Taylor https://matrix.to/#/@mordred:inaugust.com proposed: [zuul/zuul] Use buildkit to mount instead of copy /output https://review.opendev.org/c/zuul/zuul/+/71271715:55
@refi64:linuxcafe.chatHey there! I'm looking to *maybe* self-host Gerrit, and I was curious as to, err, roughly what the minimum amount of resources a self-hosted Zuul would need. Like, I know the docs say 8GB, but I'm looking for *really* minimal, maybe at most one or two jobs at a time, just a few projects to begin with16:14
@avass:vassast.orgre:fi.64 🏳️‍🌈: it's hard to say but I really don't think you need a lot of resources to host everything if you're not gonna have a lot of load16:16
@jim:acmegating.comre:fi.64 🏳️‍🌈: the quick-start setup should be able to run in 2G of ram: https://zuul-ci.org/docs/zuul/tutorials/quick-start.html 16:16
@avass:vassast.orgre:fi.64 🏳️‍🌈: I was hosting my zuul on a two node k8s cluster with 2Gb/2Cpu per machine for a while and that worked pretty well16:17
@avass:vassast.org(until i started adding more services :)16:17
@mordred:inaugust.comcorvus: with the ianw patch for enabling buildkit, https://review.opendev.org/c/zuul/zuul/+/712717/ is now passing the image build. it's maybe a nitpicky optimization, so I'd love for you to take a look at it... I don't know how you feel about our dockerfile requiring buildkit. I will not be offended if we don't want to do it17:03
@jim:acmegating.commordred, tristanC: is there any podman-related reason to avoid that?17:03
@jim:acmegating.com(i mean -- it's buildkit so i assume "no" but that's the only reason not to i can think of :)17:04
@mordred:inaugust.comyeah - it should only impact build of the images and removing some extraneous stuff from intermediate layers. it might make it harder/impossible for buildah to build based on the Dockerfile17:04
@mordred:inaugust.comthat said - buildah has supported using mounts in image builds for *AGES* - so I'd imagine they'd want to jump on supporting the dockerfile syntax17:06
@avass:vassast.orgalso: can dib handle it? ;)17:06
@jim:acmegating.comavass: dib?17:06
@avass:vassast.orgdiskimage builder? but I'd guess no one would care about that17:07
@jim:acmegating.comavass: i'm just confused about how dib relates?  you mean using the new containerfile elements?17:08
@jim:acmegating.commordred: i think tristanC is on vacation, btw17:09
@jim:acmegating.comi guess we could try running "podman build" and see if it works :)17:09
@mordred:inaugust.comI'm 99.9% certain it won't ;)17:09
@mordred:inaugust.combut worth a try!17:09
@avass:vassast.orgcorvus: yeah, I suppose it would technically be possible to build zuul with containerfile. but my guess is that there's about ~0 people who are gonna care if that works or not17:11
@fungicide:matrix.orgi mean, if people want to build container images of zuul instead of using teh ones we publish, it's normal to expect them to use the same basic tools we do to build those images, right?17:15
it's not like we're relying on proprietary compilers or something, this is all built with openly-licensed tools
@refi64:linuxcafe.chat> <@avass:vassast.org> re:fi.64 🏳️‍🌈: I was hosting my zuul on a two node k8s cluster with 2Gb/2Cpu per machine for a while and that worked pretty well17:18
Ah okay I think I can make that work, thanks!
@jim:acmegating.commordred: it does indeed fail; and i can't find any info on podman/buildah's plans to support bind mounts... but i may be bad at searching17:21
@jim:acmegating.comfungi, mordred: i think the layer optimization makes this worthwhile.  i mostly just don't want to surprise anyone with a change like this.17:26
@fungicide:matrix.orgmakes sense17:46
-@gerrit:opendev.org- Monty Taylor https://matrix.to/#/@mordred:inaugust.com proposed: [zuul/zuul-jobs] Update binfmt support image used https://review.opendev.org/c/zuul/zuul-jobs/+/80605722:41

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!