Thursday, 2022-04-21

-@gerrit:opendev.org- Ian Wienand proposed: [zuul/zuul] 838843: ansible zuul_json callback : handle string results https://review.opendev.org/c/zuul/zuul/+/83884308:44
@iwienand:matrix.orgcorvus: Clark ^ I could replicate this independently with the zuul_json plugin.  maybe someone has even more context on the logging issues there and we can make the patch even better, but that is my KISS proposal08:46
@jpew:matrix.orgfungi: Well, the periodic pipeline using the wrong variables happened again, even after a full-reconfigure on the scheduler. Unfortunately, I can't easily reproduce it on my scheduler because theres no way to enqueue a Timer build manually from the command line or UI (that I can figure out anyway, it always fails). I did notice this however: for this particular job we have a lot of job definitions for the "master" branch; some of them are on non-master branches and have the variable the way it's actually being run. Is perhaps Zuul (or myself) confused about which of these job variants(?) should be selected? I had assumed that a Timer triggered job for the master branch would choose the variant from the master branch (and we have `branches: ["master"]` in this job config) but maybe it's choosing another one?13:39
-@gerrit:opendev.org- Dr. Jens Harbott proposed: [zuul/nodepool] 838909: Add binutils to nodepool builder docker image https://review.opendev.org/c/zuul/nodepool/+/83890914:50
@q:fricklercloud.deianw: ^ should fix Jammy builds. not nice from debootstrap to silently fail when no ar is there14:59
-@gerrit:opendev.org- Oleksandr Kozachenko proposed: [zuul/zuul-jobs] 838919: Update promote-docker-image https://review.opendev.org/c/zuul/zuul-jobs/+/83891915:44
-@gerrit:opendev.org- Oleksandr Kozachenko proposed: [zuul/zuul-jobs] 838919: Update promote-docker-image https://review.opendev.org/c/zuul/zuul-jobs/+/83891915:52
@jim:acmegating.comzuul-maint: how does this look for a zuul release? commit 8582dac3ade1959c39510449b2872590a4d5b654 (HEAD -> master, tag: 5.2.3, origin/master, gerrit/master)15:53
@clarkb:matrix.orgcorvus: looks like mostly bug fixes and dependency updates and backend database changes for performance16:01
@clarkb:matrix.orgcorvus: the one change that might want to be 5.3.0 is the one I wrote to remove collision errors from regex matching. But I think that is safe too since anyone with a collision would've had errors which means the change should be a noop for any existing users16:02
@jim:acmegating.comClark: i agree it's borderline, but it sounds like we're both leaning toward 5.2.3...?16:05
@clarkb:matrix.orgyes 5.2.3 is my inclination since existing users should't notice my change16:05
@clarkb:matrix.orgits a behavior change but existing users shouldn't be impacted since we're relaxing what was an error before16:06
@jpew:matrix.orgI have my repository set to use `merge-mode: cherry-pick` (because this is what Gerrit is doing), but it means that Zuul can't handle merge changes between branches16:07
@jim:acmegating.compushed 5.2.316:08
@mnaser:matrix.orgI've got a fun little thing I realize we'll run into:16:09
https://review.opendev.org/c/zuul/zuul-jobs/+/838919
This is a change to modify the `promote-docker-image` to instead use `skoepo` to allow promoting to things *other* than Docker Hub. However, there is an assumption that `promote-docker-image` runs without a nodeset, so these changes won't work -- but once we land the changes to allow unrestricted Ansible, they *will* work, and since zuul-jobs is not branched/released, we'll probably have to either.. break users .. or create another role?
Something to keep some thoughts about, if not already discussed..
@jim:acmegating.commnaser: that might be better as a new role then?16:09
@clarkb:matrix.orgmnaser: I thought the executor side of all that already uses skopeo16:09
@mnaser:matrix.org> <@clarkb:matrix.org> mnaser: I thought the executor side of all that already uses skopeo16:10
nope, it's doing some `uri` fancy magic that is quite dockerhub-hard-coded
@jim:acmegating.comthe current version of that role is designed to use minimal api calls so that the promotion is near instantaneous16:10
@jim:acmegating.comit is intentionally called promote-*docker*-image16:11
@clarkb:matrix.orgah16:11
@jim:acmegating.comi suggest the name promote-container-image for the new role16:12
@jim:acmegating.com(reducing the delay between merging and promotion reduces the window during which zuul might use a wrong image in a build; so that's important for some users)16:14
@mnaser:matrix.orgYeah, I think the intention is that this can also run inside of the executor once the new Ansible changes land but as of today, it’s not 16:15
@jim:acmegating.comyes, though it will still be slower than the docker api call (we could have implemented the original with skopeo on the executor as well but chose not to because of the delay pulling and pushing incurs)16:16
@mnaser:matrix.orgI thought skopeo did the smart thing and didn’t pull and push but I guess not16:17
@mnaser:matrix.orgSo if we use Google artifact registry maybe it’s worth looking at how we can craft something similar with API calls only to avoid the push/pull16:17
@jim:acmegating.comeven if it doesn't have to move the body for any layers, it should still be slower than just the re-tagging operation.  it might be fast enough.  i'm just saying let's leave the docker role the way it is and explore the alternative in a new role.  solves all problems.  :)16:19
@jim:acmegating.com * even if it doesn't have to move the body for any layers, it should still be slower than just the re-tagging operation.  it might be fast enough for some/most purposes.  i'm just saying let's leave the docker role the way it is and explore the alternative in a new role.  solves all problems.  :)16:19
-@gerrit:opendev.org- Joshua Watt proposed: [zuul/zuul] 838924: merger: Handle merges with cherry-pick merge-mode https://review.opendev.org/c/zuul/zuul/+/83892416:22
@avass:vassast.orgApparently zuul-web doesn't correctly handle job names with characters that uses special characters not allowed in a url ("@", "/", ":", and so on). Is anyone opposed to url encoding/decoding job names for job pages (https://zuul.opendev.org/t/zuul/job/apply-helm-charts)?16:23
We set up rules to make sure job names are prefixed with the project name, so they look something like: <org>/<project>@<test-command>
This way job definitions are unique and it's easy to copy/paste the test command and run it locally.
@avass:vassast.orgAlso I think this is also true for tenants with special characters :)16:24
@jim:acmegating.comAlbin Vass: that seems like something that only applies to the js app, right?16:25
@avass:vassast.orgcorvus: I think so yep, we didn't notice until we used it for a couple of weeks16:26
@jim:acmegating.comie, the fix would be to have the js app just needs to encode the urls it generates internally; anyway, that sounds reasonable16:26
@jim:acmegating.com * ie, the fix would be to have the js app encode the urls it generates internally; anyway, that sounds reasonable16:27
@avass:vassast.orgYeah, i took a quick look at it yesterday and it looks like a simple fix16:27
@jim:acmegating.comAlbin Vass: we have limited unit testing of react components -- but this might be a good one for a test since we're unlikely to encounter it otherwise.16:29
@avass:vassast.orgActually i think the python app also needs to decode the name. From some testing it looked like cherrypy doesn't do that automatically since it's in the path and not a query16:29
@avass:vassast.orgI'll try find some time to push a change tomorrow with a fix :)16:30
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 838929: Don't report NO_JOBS to the database https://review.opendev.org/c/zuul/zuul/+/83892916:48
@jim:acmegating.comzuul-maint: sadly it was the actual release of 5.2.3 which brought that problem to my attention ^16:48
@jim:acmegating.comi think we should merge that asap, roll opendev, and issue 5.2.416:48
@jim:acmegating.com(if that sounds familiar, we fixed it before, but didn't add a test, once again verifying our mantra "if it's not tested it's broken")16:50
@clarkb:matrix.orgcorvus: did that need a git add for the yaml config file?16:50
@jim:acmegating.comyep16:51
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 838929: Don't report NO_JOBS to the database https://review.opendev.org/c/zuul/zuul/+/83892916:51
@clarkb:matrix.orgcouple of questions inline16:54
@clarkb:matrix.orgif you have a second to look16:54
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 838929: Don't report NO_JOBS to the database https://review.opendev.org/c/zuul/zuul/+/83892916:55
@jim:acmegating.comClark: fixed16:55
@jim:acmegating.comcopypasta16:55
@clarkb:matrix.org+2 thanks16:57
@jim:acmegating.comtristanC: ^ would you mind re-reviewing?  thanks :)16:58
@jim:acmegating.comi'd really like to get that moving, so i've approved it under the assumption tristanC is still okay with it17:05
@michiel:piscaer.comI'm looking at https://docs.opendev.org/vexxhost/ansible-collection-atmosphere/latest/user/quickstart.html to see if I can use it with Zuul. It uses tox to deploy Openstack Helm. Does this mean that is also integrate easily with the tox in Zuul?17:37
@mnaser:matrix.orgMichiel Piscaer: I think at the moment, we depend pretty heavily on collections and newer versions of Ansible that are not (yet) supported inside Zuul.  Eventually, they will and we can run this stuff natively, however in the meantime, I think it's best to use a combination of tox (or directly calling `ansible-playbook`) in a Zuul job17:38
@mnaser:matrix.orgbut in due time, hopefully we can have it run natively via Zuul once collections can be a bit more native (which should be soon IMHO with all the unrestricted ansible changes coming in)17:39
@michiel:piscaer.comok, thanks.17:41
-@gerrit:opendev.org- Joshua Watt proposed: [zuul/zuul] 838924: merger: Handle merges with cherry-pick merge-mode https://review.opendev.org/c/zuul/zuul/+/83892417:46
@clarkb:matrix.orgcorvus: the image builds for 838929 will use the assemble update. I don't expect problems based on my local checking but thought I'd call that out17:55
@jim:acmegating.comClark: thanks, gtk :)18:01
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 838933: Add a gearman-style backoff for executor job starts https://review.opendev.org/c/zuul/zuul/+/83893318:19
-@gerrit:opendev.org- Joshua Watt proposed: [zuul/zuul] 838924: merger: Handle merges with cherry-pick merge-mode https://review.opendev.org/c/zuul/zuul/+/83892418:26
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul] 838929: Don't report NO_JOBS to the database https://review.opendev.org/c/zuul/zuul/+/83892919:27
@jim:acmegating.comthat's ^ running on opendev now20:02
@clarkb:matrix.organd a hard refresh on the zuul status page returns a working website. assemble updates look good20:18
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 838933: Add a gearman-style backoff for executor job starts https://review.opendev.org/c/zuul/zuul/+/83893321:13
@spamaps:spamaps.ems.hosthttps://news.ycombinator.com/item?id=31108828 <-- A zuul-able conversation.21:19
@clarkb:matrix.orgSomeone has mentioned zuul at least21:32
@clarkb:matrix.orgianw I left a thought on the zuul json change. I suspect its fine but theorized a way it might not be if we can test that better22:19
@clarkb:matrix.orgzuulians https://review.opendev.org/c/zuul/zuul/+/837852 got a new patchset. I think corvus wanted some broad agreement on that one so would be good to rereview23:04
@jim:acmegating.comzuul-maint: how does this look for a zuul release? commit dd0135baa51cdf21a18831926c04227caa060878 (HEAD -> master, tag: 5.2.4, origin/master, gerrit/master, refs/changes/29/838929/3)23:42
@iwienand:matrix.orgClark: yeah the type is AnsibleUnsafeText at that point, I think23:53
@iwienand:matrix.orgi'm trying to think of something that sets results, but doesn't actually install packages for testing23:54
@iwienand:matrix.org(sets results as a list of strings)23:55

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!