| -@gerrit:opendev.org- Zuul merged on behalf of Felix Edel: [zuul/zuul] 945686: Add queue name to MQTT payload https://review.opendev.org/c/zuul/zuul/+/945686 | 09:07 | |
| @newbie23:matrix.org | Hi guys, is it possible to configure Zuul merger to do shallow clones to speed up workspace preparation? | 09:38 |
|---|---|---|
| Context: having to deal with a huge legacy repo that cannot be downsized. | ||
| @sylvass:albinvass.se | newbie23: in the control plane or on the worker nodes? | 11:42 |
| @sylvass:albinvass.se | newbie23: These two changes merged earlier this year and made zuul faster at managing git repos: | 11:47 |
| https://review.opendev.org/c/zuul/zuul/+/937211 | ||
| https://review.opendev.org/c/zuul/zuul/+/937210 | ||
| -@gerrit:opendev.org- Benjamin Schanzel proposed: [zuul/zuul] 945457: web: Pass auth header to log endpoint if serving from the same origin https://review.opendev.org/c/zuul/zuul/+/945457 | 14:15 | |
| @clarkb:matrix.org | newbie23: as Albin Vass mentioned there are recent changes that improve workspace preparation but I'm not aware of any that do shallow cloning. Shallow clones can be problematic in a number of circumstances. In particular speculative states can't be prepared from a shallow clone unless the shallow clone is deep enough for both sides of the merge to be present. And that will vary based on the commits in question. It may be theoretically possible but likely prone to errors and I don't think anyone has done work to explore that yet | 16:56 |
| @clarkb:matrix.org | The mergers should all keep their git repo caches fairly warm though. SO the biggest hit is the first time | 16:57 |
| @clarkb:matrix.org | and then subsequent preparation should be quicker | 16:57 |
| @fungicide:matrix.org | also if it's really the time spent copying repository state from executors to remote job nodes that's the time consuming part, keeping a warm cache in your node images can speed it up a ton | 17:08 |
| @fungicide:matrix.org | in opendev we re-warm a git cache of all active repositories in our node images daily | 17:08 |
| @fungicide:matrix.org | that way the delta from the executors is at most a day's worth of commits plus whatever speculative state is being added | 17:09 |
| @fungicide:matrix.org | well, for our most-used images anyway, for infrequently-used images we may only refresh them weekly | 17:10 |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 945906: Add Windows live log streaming https://review.opendev.org/c/zuul/zuul/+/945906 | 17:17 | |
| @jim:acmegating.com | newbie23: Clark and fungi addressed the worker-node side; Albin Vass pointed at changes that address the executor side. note that one of those requires action on your part; try setting this to `auto`: https://zuul-ci.org/docs/zuul/latest/config/job.html#attr-job.workspace-checkout | 17:41 |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: | 17:45 | |
| - [zuul/zuul] 940824: Use niz nodes for unit tests https://review.opendev.org/c/zuul/zuul/+/940824 | ||
| - [zuul/zuul] 945743: Remove tenant references from project parsing https://review.opendev.org/c/zuul/zuul/+/945743 | ||
| - [zuul/zuul] 945744: Stop copying ProjectConfig objects when adding to layout https://review.opendev.org/c/zuul/zuul/+/945744 | ||
| - [zuul/zuul] 945745: Check for nodeset label perms in layout https://review.opendev.org/c/zuul/zuul/+/945745 | ||
| - [zuul/zuul] 945746: Check for job timeouts in layout https://review.opendev.org/c/zuul/zuul/+/945746 | ||
| - [zuul/zuul] 945747: Resolve required-projects in layout https://review.opendev.org/c/zuul/zuul/+/945747 | ||
| - [zuul/zuul] 945748: Resolve include-vars projects in layout https://review.opendev.org/c/zuul/zuul/+/945748 | ||
| - [zuul/zuul] 945749: Check allowed-projects in layout https://review.opendev.org/c/zuul/zuul/+/945749 | ||
| - [zuul/zuul] 945750: Move ignore_allowed_projects to job freeze https://review.opendev.org/c/zuul/zuul/+/945750 | ||
| - [zuul/zuul] 945751: Move post_review setting to job freezing https://review.opendev.org/c/zuul/zuul/+/945751 | ||
| - [zuul/zuul] 945752: Move base job check to layout https://review.opendev.org/c/zuul/zuul/+/945752 | ||
| - [zuul/zuul] 945753: Resolve role references when freezing https://review.opendev.org/c/zuul/zuul/+/945753 | ||
| - [zuul/zuul] 945754: Set playbook trusted flag when freezing https://review.opendev.org/c/zuul/zuul/+/945754 | ||
| - [zuul/zuul] 945755: Determine job branch matchers when freezing https://review.opendev.org/c/zuul/zuul/+/945755 | ||
| - [zuul/zuul] 945756: Remove trusted flag from source context https://review.opendev.org/c/zuul/zuul/+/945756 | ||
| - [zuul/zuul] 945757: Move some pipeline attributes to manager https://review.opendev.org/c/zuul/zuul/+/945757 | ||
| - [zuul/zuul] 945758: Move some manager attributes to pipeline https://review.opendev.org/c/zuul/zuul/+/945758 | ||
| - [zuul/zuul] 945759: Move queue-related methods to PipelineState https://review.opendev.org/c/zuul/zuul/+/945759 | ||
| - [zuul/zuul] 945760: Remove the manager attribute from pipelines https://review.opendev.org/c/zuul/zuul/+/945760 | ||
| - [zuul/zuul] 945761: Remove layout.pipelines https://review.opendev.org/c/zuul/zuul/+/945761 | ||
| - [zuul/zuul] 945762: Remove tenant attribute from pipeline https://review.opendev.org/c/zuul/zuul/+/945762 | ||
| - [zuul/zuul] 945763: Move formatStatusJSON to manager https://review.opendev.org/c/zuul/zuul/+/945763 | ||
| - [zuul/zuul] 945764: Move allowed triggers/reporter checks to layout https://review.opendev.org/c/zuul/zuul/+/945764 | ||
| - [zuul/zuul] 945765: Remove tenant from configloader parse context https://review.opendev.org/c/zuul/zuul/+/945765 | ||
| - [zuul/zuul] 945766: Refactor unprotected branch tests https://review.opendev.org/c/zuul/zuul/+/945766 | ||
| - [zuul/zuul] 945767: Add error list to error accumulator https://review.opendev.org/c/zuul/zuul/+/945767 | ||
| - [zuul/zuul] 945768: Store object errors separately https://review.opendev.org/c/zuul/zuul/+/945768 | ||
| - [zuul/zuul] 945769: Add ConfigObjectCache https://review.opendev.org/c/zuul/zuul/+/945769 | ||
| - [zuul/zuul] 945770: Reuse configuration objects https://review.opendev.org/c/zuul/zuul/+/945770 | ||
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 945985: Remove unecessary code from manager._postConfig https://review.opendev.org/c/zuul/zuul/+/945985 | 18:15 | |
| -@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul] 945893: Make test_nodepool_relative_priority more deterministic https://review.opendev.org/c/zuul/zuul/+/945893 | 18:56 | |
| -@gerrit:opendev.org- Zuul merged on behalf of Clark Boylan: [zuul/zuul] 945234: Try to use mariadb in unittest again https://review.opendev.org/c/zuul/zuul/+/945234 | 21:35 | |
| @clarkb:matrix.org | corvus: ^ I realize now that that switches us to run py311 on bookworm. I think its fine if that switches back to jammy though now that we know the root of the mariadb issue. That may simplify your zuul launcher dogfooding | 21:38 |
| @jim:acmegating.com | Clark: so we should just push up a change to switch that to jammy? | 21:39 |
| @clarkb:matrix.org | ya I can do that now | 21:39 |
| @jim:acmegating.com | thanks, i'll review it real quick like :) | 21:40 |
| -@gerrit:opendev.org- Clark Boylan proposed: [zuul/zuul] 946002: Switch nox job default back to Jammy https://review.opendev.org/c/zuul/zuul/+/946002 | 21:42 | |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 945906: Add Windows live log streaming https://review.opendev.org/c/zuul/zuul/+/945906 | 22:50 | |
| -@gerrit:opendev.org- Zuul merged on behalf of Clark Boylan: [zuul/zuul] 946002: Switch nox job default back to Jammy https://review.opendev.org/c/zuul/zuul/+/946002 | 22:58 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!