Friday, 2024-02-09

-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 906320: Finish circular dependency refactor https://review.opendev.org/c/zuul/zuul/+/90632000:12
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed:00:12
- [zuul/zuul] 907628: Change status json to use "refs" instead of "changes" https://review.opendev.org/c/zuul/zuul/+/907628
- [zuul/zuul] 908211: Clean up safety check https://review.opendev.org/c/zuul/zuul/+/908211
- [zuul/zuul] 908330: Remove most model_api backwards-compat handling https://review.opendev.org/c/zuul/zuul/+/908330
- [zuul/zuul] 908333: Remove updateJobParentData method https://review.opendev.org/c/zuul/zuul/+/908333
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed:01:15
- [zuul/zuul] 906320: Finish circular dependency refactor https://review.opendev.org/c/zuul/zuul/+/906320
- [zuul/zuul] 907628: Change status json to use "refs" instead of "changes" https://review.opendev.org/c/zuul/zuul/+/907628
- [zuul/zuul] 908211: Clean up safety check https://review.opendev.org/c/zuul/zuul/+/908211
- [zuul/zuul] 908330: Remove most model_api backwards-compat handling https://review.opendev.org/c/zuul/zuul/+/908330
- [zuul/zuul] 908333: Remove updateJobParentData method https://review.opendev.org/c/zuul/zuul/+/908333
-@gerrit:opendev.org- Benjamin Schanzel proposed: [zuul/zuul] 908420: Zuul-Web: substring search for builds, buildsets https://review.opendev.org/c/zuul/zuul/+/90842007:46
-@gerrit:opendev.org- Benjamin Schanzel proposed: [zuul/zuul] 908420: Zuul-Web: substring search for builds, buildsets https://review.opendev.org/c/zuul/zuul/+/90842010:17
-@gerrit:opendev.org- Francisco Seruca Salgado proposed: [zuul/zuul] 908507: Update decrypt_secret.py https://review.opendev.org/c/zuul/zuul/+/90850711:05
@johan.alenius:matrix.orgHi, we are running Zuul version 9.2.0+acme6 ee4e18189 and have noticed that the build's console log does not always match the raw log (job-output.txt) as produced by:11:47
https://zuul-ci.org/docs/zuul-jobs/latest/log-roles.html#role-upload-logs-s3
Is this a known issue?
@johan.alenius:matrix.orgExample:11:47
@johan.alenius:matrix.orgbuild/a4f3ce42ae6446fbacd5c342adbff078/console:11:48
2024-02-08T07:47:06Z [client] INFO -
2024-02-08T07:47:06Z [client] INFO - Job #510856 CREATED (QUEUED)
... lots of lines ...
2024-02-08T09:16:03Z [client] INFO - Job URL: http://server/jobs/510856 FAILED
Command a-python-script failed.
@johan.alenius:matrix.orgWhereas this is missing lines:11:48
https://s3-ceph.net/zuul-log-bucket-prod/a-zuul-job/a4f3ce4/job-output.txt:
2024-02-08 07:47:06.850546 | node-static-driver | 2024-02-08T07:47:06Z [client] INFO -
2024-02-08 09:16:34.354399 | [Zuul] Log Stream did not terminate
2024-02-08 09:16:34.354806 | node-static-driver | ERROR
@johan.alenius:matrix.orgThe error message seems to be logged in two different code paths around here: https://opendev.org/zuul/zuul/src/commit/7c01bb0f620d11f52b0003b29765f3ec1bea5153/zuul/ansible/base/callback/zuul_stream.py#L47111:51
-@gerrit:opendev.org- Francisco Seruca Salgado proposed: [zuul/zuul] 908507: Update decrypt_secret.py https://review.opendev.org/c/zuul/zuul/+/90850713:49
-@gerrit:opendev.org- Benjamin Schanzel proposed on behalf of Matthieu Huin https://matrix.to/#/@mhuin:matrix.org: [zuul/zuul] 793159: Web UI: make more filters selectable in build, buildset searches https://review.opendev.org/c/zuul/zuul/+/79315913:50
@b.schanzel:matrix.orgmhu: I took the freedom to rebase your change https://review.opendev.org/c/zuul/zuul/+/793159 as I wanted to follow up on that. I hope thats okay.13:53
You latest patchset introduced a limit of 1000 select elements until the typeahead is disabled. But even with a large number < 1000 of elements, the performance significantly drops (current chromium). Maybe, following up on this thread https://github.com/patternfly/patternfly-react/issues/7483, switching over to a Menu component would be worth a try?
@b.schanzel:matrix.org * mhu: I took the freedom to rebase your change https://review.opendev.org/c/zuul/zuul/+/793159 as I wanted to follow up on that. I hope thats okay.13:53
Your latest patchset introduced a limit of 1000 select elements until the typeahead is disabled. But even with a large number \< 1000 of elements, the performance significantly drops (current chromium). Maybe, following up on this thread https://github.com/patternfly/patternfly-react/issues/7483, switching over to a Menu component would be worth a try?
@mhuin:matrix.orgSure, that was an arbitrary tradeoff anyway. I still believe using a Trie would significantly improve performance, if you can implement that in a Menu component13:56
-@gerrit:opendev.org- Samuel Surovka proposed: [zuul/nodepool] 908579: Add a new metric, for handleable requests per provider https://review.opendev.org/c/zuul/nodepool/+/90857913:59
-@gerrit:opendev.org- Samuel Surovka proposed: [zuul/nodepool] 908579: Add a new metric, for handleable requests per provider https://review.opendev.org/c/zuul/nodepool/+/90857914:02
-@gerrit:opendev.org- Samuel Surovka proposed: [zuul/nodepool] 908579: Add a new metric, for handleable requests per provider https://review.opendev.org/c/zuul/nodepool/+/90857914:08
-@gerrit:opendev.org- Francisco Seruca Salgado proposed: [zuul/zuul] 908507: Update decrypt_secret.py scritp https://review.opendev.org/c/zuul/zuul/+/90850714:10
@b.schanzel:matrix.orgYea, I'll have a more throughout look sometime.14:13
@b.schanzel:matrix.orgIn this patch stack of yours, you also have two changes to allow for substring searches on builds/buildsets).14:14
I would have another proposal for that here https://review.opendev.org/c/zuul/zuul/+/908420
Opinions are very welcome.
@jim:acmegating.comjohan.alenius: that could be caused by an issue with the log streamer on the remote system, or the connection to the remote system.  i think i'd need a little more info about what's going on; i can help you debug further in private.14:38
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 906320: Finish circular dependency refactor https://review.opendev.org/c/zuul/zuul/+/90632014:43
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed:14:44
- [zuul/zuul] 907628: Change status json to use "refs" instead of "changes" https://review.opendev.org/c/zuul/zuul/+/907628
- [zuul/zuul] 908211: Clean up safety check https://review.opendev.org/c/zuul/zuul/+/908211
- [zuul/zuul] 908330: Remove most model_api backwards-compat handling https://review.opendev.org/c/zuul/zuul/+/908330
- [zuul/zuul] 908333: Remove updateJobParentData method https://review.opendev.org/c/zuul/zuul/+/908333
-@gerrit:opendev.org- Samuel Surovka proposed: [zuul/nodepool] 908579: Add a new metric, for handleable requests per provider https://review.opendev.org/c/zuul/nodepool/+/90857914:45
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed:15:40
- [zuul/zuul] 906320: Finish circular dependency refactor https://review.opendev.org/c/zuul/zuul/+/906320
- [zuul/zuul] 907628: Change status json to use "refs" instead of "changes" https://review.opendev.org/c/zuul/zuul/+/907628
- [zuul/zuul] 908211: Clean up safety check https://review.opendev.org/c/zuul/zuul/+/908211
- [zuul/zuul] 908330: Remove most model_api backwards-compat handling https://review.opendev.org/c/zuul/zuul/+/908330
- [zuul/zuul] 908333: Remove updateJobParentData method https://review.opendev.org/c/zuul/zuul/+/908333
@jpew:matrix.orgIs it possible (or planned) to be able to limit the pipeline window on a per-project basis? We have a project that is pretty resource intensive and when the gate pipeline is deep, its slowing the servers down a lot15:47
@jim:acmegating.comjpew: in case this wasn't clear: the window is configured per-pipeline but tracked per-queue; so if you configure a window of 5 in the pipeline, then queue X (with projects A and B) get a window of 5; and queue Y (with projects C and D) get a window of 5.  and they scale independently.15:51
@clarkb:matrix.orgyou can also set a ceiling15:51
@jpew:matrix.org> <@jim:acmegating.com> jpew: in case this wasn't clear: the window is configured per-pipeline but tracked per-queue; so if you configure a window of 5 in the pipeline, then queue X (with projects A and B) get a window of 5; and queue Y (with projects C and D) get a window of 5.  and they scale independently.15:52
Yes, I understand that part
@jpew:matrix.org> <@clarkb:matrix.org> you can also set a ceiling15:52
Ya, I basically want a per-project ceiling
@clarkb:matrix.orgno I don't think that exists. When the windowing feature was implemented I think we saw it as a system level monitor not a per project optimization15:53
@clarkb:matrix.orgside note I'm impressed that people have been needing the ceiling feature15:54
@jpew:matrix.orgYa, that's fair, I was just looking for a way to keep our expensive project gate queue from adversely affecting other projects15:55
@jim:acmegating.comif it were to be configurable at a closer level, it would have to be at the queue level, not project15:56
@jpew:matrix.orgThe real problem is that for $BAD_REASONS the git repo for this project is like 5GB, so it really uses a lot of resources on the merger/executors when its queued15:56
@jpew:matrix.org> <@jim:acmegating.com> if it were to be configurable at a closer level, it would have to be at the queue level, not project15:57
That would be fine
@jpew:matrix.org> <@clarkb:matrix.org> side note I'm impressed that people have been needing the ceiling feature16:02
Zuul All the Things!
@jim:acmegating.comone thing i've heard from clients is it's helpful if the short-term probability of success gets ahead of the long-term probability of success; and it's better to slow things down a little rather than grow until you reset an eventually really long tail.16:04
@jim:acmegating.comzuul-maint: fyi i would like to merge this change so that we can experiment with circular deps on opendev, but i want to make it clear that i'm not proposing a policy change in how we review changes (we should still only use linear dependencies in the zuul project so we don't accidentally break continuous deployment)  https://review.opendev.org/90836616:06
@clarkb:matrix.orgcorvus: is that a merge after opendev update or should I approve it now?16:07
@jim:acmegating.comfine now i think16:07
@clarkb:matrix.orgtristanC: beat me to it16:08
@clarkb:matrix.orgcorvus: I guess we can't manually test the web ui update for refs because the current zuul installs don't use that attribute?16:17
@clarkb:matrix.orgbut we have automated testing that is probably sufficient16:18
@jim:acmegating.comyeah, we actually do have tests for that16:18
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/nodepool] 908610: Switch functional openstack job to jammy https://review.opendev.org/c/zuul/nodepool/+/90861017:47
-@gerrit:opendev.org- Clark Boylan proposed: [zuul/nodepool] 908613: Use Debian packaged dnf-plugins-core https://review.opendev.org/c/zuul/nodepool/+/90861318:30
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 908333: Remove updateJobParentData method https://review.opendev.org/c/zuul/zuul/+/90833318:36
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 908670: Fix race in test_deps_by_topic_git_needs https://review.opendev.org/c/zuul/zuul/+/90867018:58
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 908360: Replace Ansible 6 with Ansible 9 https://review.opendev.org/c/zuul/zuul/+/90836019:22
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul-jobs] 908671: Remove command.warn usage https://review.opendev.org/c/zuul/zuul-jobs/+/90867119:26
@clarkb:matrix.orgwoah!19:33
@jim:acmegating.comhuzzah!19:34
@clarkb:matrix.orgcorvus: does that create errors if set? Kind of annoying if so because then we'll get the warnings from ansible 8 again?19:34
@jim:acmegating.comyes :(19:34
@jim:acmegating.comit's possible we may have missed a gracefur deprecation/removal step sometime prior to this.  but we're here now.19:35
@jim:acmegating.com * it's possible we may have missed a graceful deprecation/removal step sometime prior to this.  but we're here now.19:35
-@gerrit:opendev.org- Clark Boylan proposed: [zuul/nodepool] 908613: Fetch compatibile dnf download command in container image https://review.opendev.org/c/zuul/nodepool/+/90861319:57

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!