Wednesday, 2022-10-26

-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul] 859354: Simplify tenant_authorizatons check https://review.opendev.org/c/zuul/zuul/+/85935402:21
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed:03:23
- [zuul/zuul] 859355: Add check_auth tool to zuul-web https://review.opendev.org/c/zuul/zuul/+/859355
- [zuul/zuul] 859356: Hide components in whitelabel tenants https://review.opendev.org/c/zuul/zuul/+/859356
- [zuul/zuul] 859357: Add api-root tenant config object https://review.opendev.org/c/zuul/zuul/+/859357
- [zuul/zuul] 859466: Linger on auth_callback page until login is complete https://review.opendev.org/c/zuul/zuul/+/859466
- [zuul/zuul] 859481: Web: always set redux auth and wait for it https://review.opendev.org/c/zuul/zuul/+/859481
- [zuul/zuul] 860032: Show login button any time auth is available https://review.opendev.org/c/zuul/zuul/+/860032
- [zuul/zuul] 860033: Add access-rules configuration and documentation https://review.opendev.org/c/zuul/zuul/+/860033
- [zuul/zuul] 860034: Set Access-Control-Allow-Origin headers in check_auth tool https://review.opendev.org/c/zuul/zuul/+/860034
- [zuul/zuul] 860035: Support authz for read-only web access https://review.opendev.org/c/zuul/zuul/+/860035
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed on behalf of Ian Wienand: [zuul/zuul] 860632: web/api: Reject unknown methods and consolidate CORS and request checking https://review.opendev.org/c/zuul/zuul/+/86063203:23
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul] 859355: Add check_auth tool to zuul-web https://review.opendev.org/c/zuul/zuul/+/85935504:51
-@gerrit:opendev.org- Artem Goncharov proposed: [zuul/zuul] 859940: Implement tests of the gitea driver https://review.opendev.org/c/zuul/zuul/+/85994009:27
@bingberg:matrix.orgOne of the features we have are bisect pipelines, it bisects issues on a corresponding periodic pipeline (e.g. a nightly pipeline). That is, if there is an error in the nightly build the pipeline finds the commit that introduced the error using git bisect (interval halving the commit tree).09:28
In order to make this work with zuul pipelines we would need a way to tell zuul which commit it should schedule a pipeline for, what would be the best way of doing this? Is there an api that can be called? Should we write our own driver for this purpose?
-@gerrit:opendev.org- Fabien Boucher proposed: [zuul/zuul] 862678: Ensure a buildset_doc have a start_date https://review.opendev.org/c/zuul/zuul/+/86267810:02
-@gerrit:opendev.org- Fabien Boucher proposed: [zuul/zuul] 862678: Ensure a buildset_doc have a start_date https://review.opendev.org/c/zuul/zuul/+/86267810:03
@fungicide:matrix.org> <@bingberg:matrix.org> One of the features we have are bisect pipelines, it bisects issues on a corresponding periodic pipeline (e.g. a nightly pipeline). That is, if there is an error in the nightly build the pipeline finds the commit that introduced the error using git bisect (interval halving the commit tree).12:49
>
> In order to make this work with zuul pipelines we would need a way to tell zuul which commit it should schedule a pipeline for, what would be the best way of doing this? Is there an api that can be called? Should we write our own driver for this purpose?
based on your description i would have assumed you meant that a single build of a periodic (timer trigger) job of the current branch state would repeatedly rerun some test payload against different checked-out states of the repository until it found adjacent successful and unsuccessful behaviors. but since you're asking to be able to enqueue builds for specific commits, it sounds like you may be wanting to rerun individual builds instead of doing the bisecting tests within a single build... can you elaborate?
@fungicide:matrix.orgif you're trying to do it with lots of separate buildsets, it could probably be engineered by using zuul-client enqueue with some admin credentials to create arbitrary buildsets in some appropriate pipeline, but that's not really how zuul is designed to be used (it's not an orchestration engine, it's meant to respond to triggering events)12:54
-@gerrit:opendev.org- Zuul merged on behalf of Clark Boylan:12:54
- [zuul/zuul-jobs] 862628: Pin py38 jobs to focal https://review.opendev.org/c/zuul/zuul-jobs/+/862628
- [zuul/zuul-jobs] 862629: Add tox-py311 job https://review.opendev.org/c/zuul/zuul-jobs/+/862629
@bingberg:matrix.org> <@fungicide:matrix.org> if you're trying to do it with lots of separate buildsets, it could probably be engineered by using zuul-client enqueue with some admin credentials to create arbitrary buildsets in some appropriate pipeline, but that's not really how zuul is designed to be used (it's not an orchestration engine, it's meant to respond to triggering events)13:13
The zuul-client enqueue approach sounds like it could do what we want to do. I will have to have a look at it.
The basic issue is that when the nightly pipeline fails there could be hundreds of commits which is the culprit. In order to quickly pinpoint the problem we currently have our jenkins servers manually enqueueing the nightly pipeline according to the git bisect logic (basically if the error is introduced somewhere in commit 1->N first try to run on pipeline with the build from commit N/2 to half the search interval, repeat until the first commit that introduces the bug is found).
The logic is slightly more complicated since there are multiple repositories but that's the rough outline of how it works.
In this context we wish to reuse the entire zuul pipeline and not replicate the pipeline outside of zuul as the test could very well be failing due to bad zuul configurations.
@jim:acmegating.comEssentially faking a ref-updated event via zuul-client with the specific shas you want may work.  it's worth a shot.  :)13:19
@jim:acmegating.com(you would need to use ref-updated to specify the sha, since branch tip items (which is what the timer trigger enqueues) don't allow that specification)13:23
-@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] 862703: wip: Initialize pipelines during pipeline processing https://review.opendev.org/c/zuul/zuul/+/86270314:23
-@gerrit:opendev.org- Jeremy Stanley https://matrix.to/#/@fungicide:matrix.org proposed on behalf of Clark Boylan: [zuul/nodepool] 862630: Add Python 3.11 testing https://review.opendev.org/c/zuul/nodepool/+/86263015:55
-@gerrit:opendev.org- Jeremy Stanley https://matrix.to/#/@fungicide:matrix.org proposed: [zuul/nodepool] 862732: Pin py38 jobs to focal https://review.opendev.org/c/zuul/nodepool/+/86273215:55
@fungicide:matrix.orgClark: ^ looks like the nodepool repo needed a similar fix for its py38 jobs15:55
@fungicide:matrix.orgstacked your py311 addition on it since they would have merge-conflicted anyway15:56
@clarkb:matrix.orgI went ahead and approved that change as it is minimal15:57
@clarkb:matrix.orgfungi: I mentioned this yesterday but I don't think we should land 826630 as is. Instead I think what we want to do is get https://review.opendev.org/c/opendev/system-config/+/862631 in then update the zuul and nodepool changes to build their docker images on that. Once we have that working and the functional testing that relies on the docker images are happy we can add py311 unittesting and drop py310 testing (just test our low and high end)16:04
@clarkb:matrix.orgI suspect the next hurdle will be wheels existing in particular for arm. This may take a few weeks as our deps make new releases or add wheels for old releases16:04
@clarkb:matrix.orgI'm not in a rush, I just wanted to make sure we were catching issues early if they existed. I think zuul acts as a good canary for that stuff because it is a non trivial python project that is well tested and the opendev maintainers are familiar with it so can figure out if bugs exist in the platform or the software16:05
-@gerrit:opendev.org- Zuul merged on behalf of Jeremy Stanley https://matrix.to/#/@fungicide:matrix.org: [zuul/nodepool] 862732: Pin py38 jobs to focal https://review.opendev.org/c/zuul/nodepool/+/86273216:48
@fungicide:matrix.org> <@clarkb:matrix.org> fungi: I mentioned this yesterday but I don't think we should land 826630 as is. Instead I think what we want to do is get https://review.opendev.org/c/opendev/system-config/+/862631 in then update the zuul and nodepool changes to build their docker images on that. Once we have that working and the functional testing that relies on the docker images are happy we can add py311 unittesting and drop py310 testing (just test our low and high end)17:20
should those zuul and nodepool changes be set to wip then?
@clarkb:matrix.orgfungi: ya I can do that17:25
-@gerrit:opendev.org- Artom Lifshitz proposed: [zuul/zuul-jobs] 862739: DNM: Debugging failures https://review.opendev.org/c/zuul/zuul-jobs/+/86273917:38
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com:18:09
- [zuul/zuul] 859356: Hide components in whitelabel tenants https://review.opendev.org/c/zuul/zuul/+/859356
- [zuul/zuul] 859357: Add api-root tenant config object https://review.opendev.org/c/zuul/zuul/+/859357
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul] 859466: Linger on auth_callback page until login is complete https://review.opendev.org/c/zuul/zuul/+/85946618:09
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul] 859481: Web: always set redux auth and wait for it https://review.opendev.org/c/zuul/zuul/+/85948119:28
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/nodepool] 862522: Convert openstack driver to statemachine https://review.opendev.org/c/zuul/nodepool/+/86252220:16
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/nodepool] 862754: Add an OpenStack test script https://review.opendev.org/c/zuul/nodepool/+/86275420:29
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed:20:54
- [zuul/nodepool] 862522: Convert openstack driver to statemachine https://review.opendev.org/c/zuul/nodepool/+/862522
- [zuul/nodepool] 862754: Add an OpenStack test script https://review.opendev.org/c/zuul/nodepool/+/862754
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed:20:57
- [zuul/nodepool] 862522: Convert openstack driver to statemachine https://review.opendev.org/c/zuul/nodepool/+/862522
- [zuul/nodepool] 862754: Add an OpenStack test script https://review.opendev.org/c/zuul/nodepool/+/862754
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/nodepool] 858447: Aws: add support for volume iops and throughput https://review.opendev.org/c/zuul/nodepool/+/85844721:08
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul] 860032: Show login button any time auth is available https://review.opendev.org/c/zuul/zuul/+/86003221:58
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 862760: Refactor merge mode name lookup https://review.opendev.org/c/zuul/zuul/+/86276023:10
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 861926: Detect errors with non-permitted parent jobs https://review.opendev.org/c/zuul/zuul/+/86192623:31

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!