| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 874524: Re-enqueue changes if dequeued missing deps https://review.opendev.org/c/zuul/zuul/+/874524 | 00:00 | |
| @flaper87:matrix.org | > <@q:fricklercloud.de> do you have `exclude-unprotected-branches: true` set for your tenant? if no, you really should. if yes, verify that branch protection is actually enabled for your target branch | 05:31 |
|---|---|---|
| I had it, then removed it. I've added back now and I made sure branch protection is enabled (it wasn't). | ||
| @flaper87:matrix.org | > <@clarkb:matrix.org> If you don't see anything on the merger or in the scheduler log about merging things then I'm guessing that the scheduler doesn't think your event applies to any pipelinrs | 05:35 |
| I see this in the scheduler: | ||
| `2023-02-21 05:34:10,629 DEBUG zuul.GithubConnection: [e: 5c6d9bf0-b1a9-11ed-8e65-0818ae57f95a] Scheduling event from github: <GithubTriggerEvent 0x7f38faeb1290 pull_request org/zuul-ci-test refs/pull/1/head reopened github.com/org/zuul-ci-test 1,bb71193c6a7109efb4f07a6fc9262f1e9605b58c delivery: 5c6d9bf0-b1a9-11ed-8e65-0818ae57f95a>` | ||
| @flaper87:matrix.org | But then, nothing else (I'm trying to trigger the check pipeline) | 05:35 |
| @flaper87:matrix.org | I created the pipeline definition using [this configurator](https://acmegating.com/acme-enterprise-zuul/#start) | 05:38 |
| @flaper87:matrix.org | I see the `reopen` event in the list of events that should trigger the pipeline | 05:39 |
| @flaper87:matrix.org | I guess another question is whether I should see a CI job/check on GH. So far, I don't see anything: | 06:22 |
| @flaper87:matrix.org | Alright, in my latest attempts I've been trying to run the enqueue command: | 08:16 |
| `zuul-client --use-config pace enqueue --tenant zuul-infra --pipeline check --project org/zuul-ci-test --change 1,bb71193c6a7109efb4f07a6fc9262f1e9605b58c` | ||
| But it fails with a 400 error. I've checked that project, org, token, and change,ref are all correct. The zuul-web logs don't say much besides the 400 error calling the post for the `enqueue` action | ||
| @flaper87:matrix.org | Another thing I noticed is that the `zuul-ci-test` project does not appear in the projects list, even tho it has the `.zuul.yaml` file with the project definition in it: | 08:58 |
| ``` | ||
| - project: | ||
| check: | ||
| jobs: | ||
| - noop | ||
| ``` | ||
| @flaper87:matrix.org | This project is in a private GH org. I can see zuul has all the permissions needed in the org | 08:59 |
| @q:fricklercloud.de | corvus: it seems https://review.opendev.org/c/zuul/nodepool/+/862522 might have broken FIP handling. when deleting a used node, nodepool gets stuck 15 minutes waiting for FIP deletion to happen. on the neutron side the deletion is finished in less than a second | 09:29 |
| @q:fricklercloud.de | oh, I think I see the issue. commented on the review, will try to confirm locally | 09:37 |
| -@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] 874544: dnm: Store generic trigger event in queue item https://review.opendev.org/c/zuul/zuul/+/874544 | 09:45 | |
| @flaper87:matrix.org | I added the repo to `untrusted-projects` (not sure if this is the right thing to do here) and now I see this in the scheduler `2023-02-21 09:48:05,306 WARNING zuul.ConfigLoader: Merge mode merge not supported by project github.com/org/zuul-ci-test` | 09:58 |
| This is weird considering that zuul docs say `merge` mode should be used for GH repos. Maybe I shouldn't add this project to the `untrusted-porjects` list in the first place | ||
| @flaper87:matrix.org | FWIW, I called the GH API for this repo and I see all the merge modes enabled: | 10:46 |
| -@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] 874578: Fix user creation in Docker test setup script https://review.opendev.org/c/zuul/zuul/+/874578 | 12:58 | |
| @westphahl:matrix.org | Clark: can you take a look at ^? The update to MySQL 8 for the local test setup broke the user/permission creation in the test script. | 13:00 |
| -@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] 874544: dnm: Store generic trigger event in queue item https://review.opendev.org/c/zuul/zuul/+/874544 | 13:05 | |
| -@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] 874544: wip: Store generic trigger event in queue item https://review.opendev.org/c/zuul/zuul/+/874544 | 14:08 | |
| @flaper87:matrix.org | > <@flaper87:matrix.org> sent an image. | 14:21 |
| Alright, I think I solved this by cleaning a cache entry in zookeper. `_branch_cache` was outdated, apparently. | ||
| @flaper87:matrix.org | still stuck with all the rest. I can't get any of my actions on Github to trigger a job | 14:21 |
| @newbie23:matrix.org | Hi guys, | 14:47 |
| documentation https://zuul-ci.org/docs/zuul/latest/job-content.html says: | ||
| > NODE_FAILURE | ||
| > The test instance provider was unable to fullfill the nodeset request. | ||
| > This can happen if Nodepool is unable to provide the requested node(s) for the request. | ||
| > | ||
| This is an exceptional situation when there is an error/issue within Nodepool. | ||
| In the scenario where there are no more available nodes, the job would be simply stay in the queue until a node is available. | ||
| Is my understanding correct? | ||
| @jim:acmegating.com | q: that's fixed in master in change https://review.opendev.org/871803 | 14:53 |
| @q:fricklercloud.de | oh, right, I was only running zuul from latest, not nodepool. but that again rises the question why such crucial fixes aren't released in a more timely fashion | 15:00 |
| @scrungusss:matrix.org | Hi guys, not sure if this is the right place to put this but i had a question about something which is not quite clear to me from the docs. If I am running a job that is pulled from another project, how can I change which checkout of that project is being used? i.e. currently i have something like | 15:01 |
| ``` | ||
| - project: | ||
| queue: magnum | ||
| check: | ||
| jobs: | ||
| - magnum-tempest-plugin-tests-api | ||
| ``` | ||
| But I need something like: | ||
| ``` | ||
| ``` | ||
| @scrungusss:matrix.org | Hi guys, not sure if this is the right place to put this but i had a question about something which is not quite clear to me from the docs. If I am running a job that is pulled from another project, how can I change which checkout of that project is being used? i.e. currently i have something like: | 15:02 |
| ``` | ||
| - project: | ||
| queue: magnum | ||
| check: | ||
| jobs: | ||
| - magnum-tempest-plugin-tests-api | ||
| ``` | ||
| But I need something like: | ||
| ``` | ||
| - project: | ||
| queue: magnum | ||
| check: | ||
| jobs: | ||
| - magnum-tempest-plugin-tests-api | ||
| override-checkout: refs/changes/59/872759/28 | ||
| ``` | ||
| @jim:acmegating.com | scrungus: the way to tell zuul to include a specific non-merged change in the repo used for testing is with the "depends-on" footer: https://zuul-ci.org/docs/zuul/latest/gating.html#cross-project-dependencies | 15:07 |
| @scrungusss:matrix.org | yeah this was my initial attempt, but i couldn't get it to work. I'll try swapping around the depends-on | 15:09 |
| @clarkb:matrix.org | swest: sorry about that +2. There is also the switch to mariadb proposed. I don't think this is an issue for that though as mariadb seems to support create user too | 15:36 |
| @jim:acmegating.com | zuul: commit d57942a41b9077152b29e0f40f30e904a62a8fbc (HEAD -> master, tag: 8.2.0, origin/master, gerrit/master) | 16:17 |
| nodepool: commit f399292401b43b51b62c9297bc6c09cde4d236b9 (HEAD -> master, tag: 8.2.0, origin/master, gerrit/master) | ||
| @jim:acmegating.com | zuul-maint: ^ how does that look for releases? | 16:17 |
| @jim:acmegating.com | i believe that's what opendev is running since friday | 16:17 |
| @clarkb:matrix.org | Nodepool should auto update to latest pretty quickly in opendev and that zuul commit landed prior to our ~00:00 UTC Saturday restarts. I belive that opendev is running those too | 16:25 |
| @clarkb:matrix.org | corvus: I think q had a concern about some builds in buildsets getting lost? not sur eifthat got rundown to being considered fine | 16:26 |
| @q:fricklercloud.de | at least those are still to be seen pretty regularly on zuul02.o.o. plus some other things that look weird like eg https://paste.opendev.org/show/bC6IqAqYYUyUeVWjPSwe/ | 16:31 |
| @q:fricklercloud.de | is there an easy way to map between docker image id and git sha? | 16:34 |
| @clarkb:matrix.org | q: I believe the docker image build records the zuul sha and also the change. Note thats the zuul merged sha which is often different than the final gerrit merge. But the change info should give a strong mappying | 16:37 |
| @g_gobi:matrix.org | Hi, | 16:57 |
| When I start the executor container, I see the following log. I see it try to sync the trusted and untrusted repositories. | ||
| ``` | ||
| executor_1 | 2023-02-21 16:42:54,588 INFO zuul.ExecutorServer: Updating repo gitlab/test/zuul_config | ||
| executor_1 | 2023-02-21 16:42:55,895 INFO zuul.Merger: Updating local repository gitlab/test/zuul_config | ||
| executor_1 | 2023-02-21 16:42:56,859 INFO zuul.ExecutorServer: Merge <MergeRequest 10b8a5db446e41eaa333d025e57e8ae4, job_type=cat, state=running, path=/zuul/merger/requests/10b8a5db446e41eaa333d025e57e8ae4> complete, merged: False, updated: True, commit: None, branches: [] | ||
| executor_1 | 2023-02-21 16:42:56,911 INFO zuul.ExecutorServer: Updating repo gitlab/test/zuul_config | ||
| executor_1 | 2023-02-21 16:42:56,912 INFO zuul.Merger: Updating local repository gitlab/test/zuul_config | ||
| executor_1 | 2023-02-21 16:42:57,844 INFO zuul.ExecutorServer: Merge <MergeRequest 3ad5482fbcee4708b9fff7b9d5fb828c, job_type=cat, state=running, path=/zuul/merger/requests/3ad5482fbcee4708b9fff7b9d5fb828c> complete, merged: False, updated: True, commit: None, branches: [] | ||
| ``` | ||
| But I don't understand what are all these **Merge <MergeRequest 3ad5482fbcee4708b9fff7b9d5fb828c, job_type=cat, state=running, path=/zuul/merger/requests/3ad5482fbcee4708b9fff7b9d5fb828c> complete, merged: False, updated: True, commit: None, branches: []** | ||
| Whether these are all commits in the repo or something else? | ||
| @g_gobi:matrix.org | * Hi, | 16:58 |
| When I start the executor container, I see the following log. It looks like executor tries to sync the trusted and untrusted repositories. | ||
| ``` | ||
| executor_1 | 2023-02-21 16:42:54,588 INFO zuul.ExecutorServer: Updating repo gitlab/test/zuul_config | ||
| executor_1 | 2023-02-21 16:42:55,895 INFO zuul.Merger: Updating local repository gitlab/test/zuul_config | ||
| executor_1 | 2023-02-21 16:42:56,859 INFO zuul.ExecutorServer: Merge <MergeRequest 10b8a5db446e41eaa333d025e57e8ae4, job_type=cat, state=running, path=/zuul/merger/requests/10b8a5db446e41eaa333d025e57e8ae4> complete, merged: False, updated: True, commit: None, branches: [] | ||
| executor_1 | 2023-02-21 16:42:56,911 INFO zuul.ExecutorServer: Updating repo gitlab/test/zuul_config | ||
| executor_1 | 2023-02-21 16:42:56,912 INFO zuul.Merger: Updating local repository gitlab/test/zuul_config | ||
| executor_1 | 2023-02-21 16:42:57,844 INFO zuul.ExecutorServer: Merge <MergeRequest 3ad5482fbcee4708b9fff7b9d5fb828c, job_type=cat, state=running, path=/zuul/merger/requests/3ad5482fbcee4708b9fff7b9d5fb828c> complete, merged: False, updated: True, commit: None, branches: [] | ||
| ``` | ||
| But I don't understand what are all these **Merge \<MergeRequest 3ad5482fbcee4708b9fff7b9d5fb828c, job\_type=cat, state=running, path=/zuul/merger/requests/3ad5482fbcee4708b9fff7b9d5fb828c> complete, merged: False, updated: True, commit: None, branches: \[\]** | ||
| Whether these are all commits in the repo or something else? | ||
| @mhuin:matrix.org | FYI I've written a small blog article about setting up an environmen in which one can run the unit tests suite for Zuul: https://www.softwarefactory-project.io/hacking-zuul-for-developers-running-unit-tests.html I think it might be of interest for new devs wanting to contribute | 17:05 |
| @mhuin:matrix.org | It's a bit more directive than the TESTING.md file in the repo so I thought it made more sense as an article | 17:07 |
| @g_gobi:matrix.org | * Hi, | 17:10 |
| When I start the executor container, I see the following log. It looks like executor tries to sync the trusted and untrusted repositories. | ||
| ``` | ||
| executor_1 | 2023-02-21 16:42:54,588 INFO zuul.ExecutorServer: Updating repo gitlab/test/zuul_config | ||
| executor_1 | 2023-02-21 16:42:55,895 INFO zuul.Merger: Updating local repository gitlab/test/zuul_config | ||
| executor_1 | 2023-02-21 16:42:56,859 INFO zuul.ExecutorServer: Merge <MergeRequest 10b8a5db446e41eaa333d025e57e8ae4, job_type=cat, state=running, path=/zuul/merger/requests/10b8a5db446e41eaa333d025e57e8ae4> complete, merged: False, updated: True, commit: None, branches: [] | ||
| executor_1 | 2023-02-21 16:42:56,911 INFO zuul.ExecutorServer: Updating repo gitlab/test/zuul_config | ||
| executor_1 | 2023-02-21 16:42:56,912 INFO zuul.Merger: Updating local repository gitlab/test/zuul_config | ||
| executor_1 | 2023-02-21 16:42:57,844 INFO zuul.ExecutorServer: Merge <MergeRequest 3ad5482fbcee4708b9fff7b9d5fb828c, job_type=cat, state=running, path=/zuul/merger/requests/3ad5482fbcee4708b9fff7b9d5fb828c> complete, merged: False, updated: True, commit: None, branches: [] | ||
| ``` | ||
| But I don't understand what are all these **Merge \<MergeRequest 3ad5482fbcee4708b9fff7b9d5fb828c, job\_type=cat, state=running, path=/zuul/merger/requests/3ad5482fbcee4708b9fff7b9d5fb828c> complete, merged: False, updated: True, commit: None, branches: \[\]** | ||
| I don't see any Merge request with this commit-id `3ad5482fbcee4708b9fff7b9d5fb828c` | ||
| Whether these are all commits in the repo or something else? | ||
| @g_gobi:matrix.org | * Hi, | 17:14 |
| When I start the executor container, I see the following log. It looks like executor tries to sync the trusted and untrusted repositories. | ||
| ``` | ||
| executor_1 | 2023-02-21 16:42:54,588 INFO zuul.ExecutorServer: Updating repo gitlab/test/zuul_config | ||
| executor_1 | 2023-02-21 16:42:55,895 INFO zuul.Merger: Updating local repository gitlab/test/zuul_config | ||
| executor_1 | 2023-02-21 16:42:56,859 INFO zuul.ExecutorServer: Merge <MergeRequest 10b8a5db446e41eaa333d025e57e8ae4, job_type=cat, state=running, path=/zuul/merger/requests/10b8a5db446e41eaa333d025e57e8ae4> complete, merged: False, updated: True, commit: None, branches: [] | ||
| executor_1 | 2023-02-21 16:42:56,911 INFO zuul.ExecutorServer: Updating repo gitlab/test/zuul_config | ||
| executor_1 | 2023-02-21 16:42:56,912 INFO zuul.Merger: Updating local repository gitlab/test/zuul_config | ||
| executor_1 | 2023-02-21 16:42:57,844 INFO zuul.ExecutorServer: Merge <MergeRequest 3ad5482fbcee4708b9fff7b9d5fb828c, job_type=cat, state=running, path=/zuul/merger/requests/3ad5482fbcee4708b9fff7b9d5fb828c> complete, merged: False, updated: True, commit: None, branches: [] | ||
| ``` | ||
| But I don't understand what are all these **Merge \<MergeRequest 3ad5482fbcee4708b9fff7b9d5fb828c, job\_type=cat, state=running, path=/zuul/merger/requests/3ad5482fbcee4708b9fff7b9d5fb828c> complete, merged: False, updated: True, commit: None, branches: \[\]** | ||
| I don't see any Merge request with this commit-id `3ad5482fbcee4708b9fff7b9d5fb828c` | ||
| Whether these are all commits in the repo or something else? | ||
| It takes a huge time to complete this process. Until then scheduler not loading the tenants. | ||
| -@gerrit:opendev.org- Zuul merged on behalf of Simon Westphahl: [zuul/zuul] 874578: Fix user creation in Docker test setup script https://review.opendev.org/c/zuul/zuul/+/874578 | 17:54 | |
| @g_gobi:matrix.org | Any idea about this? | 18:17 |
| @g_gobi:matrix.org | > <@g_gobi:matrix.org> Hi, | 18:35 |
| > When I start the executor container, I see the following log. It looks like executor tries to sync the trusted and untrusted repositories. | ||
| > | ||
| > ``` | ||
| > executor_1 | 2023-02-21 16:42:54,588 INFO zuul.ExecutorServer: Updating repo gitlab/test/zuul_config | ||
| > executor_1 | 2023-02-21 16:42:55,895 INFO zuul.Merger: Updating local repository gitlab/test/zuul_config | ||
| > executor_1 | 2023-02-21 16:42:56,859 INFO zuul.ExecutorServer: Merge <MergeRequest 10b8a5db446e41eaa333d025e57e8ae4, job_type=cat, state=running, path=/zuul/merger/requests/10b8a5db446e41eaa333d025e57e8ae4> complete, merged: False, updated: True, commit: None, branches: [] | ||
| > executor_1 | 2023-02-21 16:42:56,911 INFO zuul.ExecutorServer: Updating repo gitlab/test/zuul_config | ||
| > executor_1 | 2023-02-21 16:42:56,912 INFO zuul.Merger: Updating local repository gitlab/test/zuul_config | ||
| > executor_1 | 2023-02-21 16:42:57,844 INFO zuul.ExecutorServer: Merge <MergeRequest 3ad5482fbcee4708b9fff7b9d5fb828c, job_type=cat, state=running, path=/zuul/merger/requests/3ad5482fbcee4708b9fff7b9d5fb828c> complete, merged: False, updated: True, commit: None, branches: [] | ||
| > ``` | ||
| > | ||
| > But I don't understand what are all these **Merge \<MergeRequest 3ad5482fbcee4708b9fff7b9d5fb828c, job\_type=cat, state=running, path=/zuul/merger/requests/3ad5482fbcee4708b9fff7b9d5fb828c> complete, merged: False, updated: True, commit: None, branches: \[\]** | ||
| > I don't see any Merge request with this commit-id `3ad5482fbcee4708b9fff7b9d5fb828c` | ||
| > Whether these are all commits in the repo or something else? | ||
| > It takes a huge time to complete this process. Until then scheduler not loading the tenants. | ||
| Any idea about this? | ||
| @clarkb:matrix.org | Those look like merger cat jobs which are used by the scheduler to collect all of the distributed zuul config | 18:39 |
| @clarkb:matrix.org | Essentially when zuul restarts it needs to load it's configs. Newer zuul should cache those configs though making restarts far less impactful | 18:39 |
| @clarkb:matrix.org | The scheduler can't take action until it understands how it is configured | 18:40 |
| @clarkb:matrix.org | Upgrading zuul to take advantage of the caching as well as adding more mergers can make this go quicker | 18:49 |
| @g_gobi:matrix.org | > <@clarkb:matrix.org> The scheduler can't take action until it understands how it is configured | 19:17 |
| Thanks Clark: how to add more mergers? | ||
| These cat jobs are what will do? Its count is based on open merge requests/ size of the repository/ branches? | ||
| @g_gobi:matrix.org | * Thanks Clark: how to add more mergers? | 19:19 |
| what will these cat jobs are do? Its count is based on open merge requests/ size of the repository/ branches? | ||
| @g_gobi:matrix.org | Or | 19:21 |
| Can we limit these jobs by mentioning a particular trusted/ un-trusted repository branch to look at the config? | ||
| @clarkb:matrix.org | It is listing the .zuul.yaml and related files in every repo on every branch. I don't think you can limit it. Deploying another merger is just running another merger service with a separate filesystem from the others so they don't stomp on each other | 19:22 |
| @g_gobi:matrix.org | Got it. In an un-trusted repository what will it check? Because I have a repository that contains 200+ branches. It takes nearly 1-2hrs to complete. You mean it will check all the files in the branch? | 19:38 |
| @clarkb:matrix.org | It looks for the zuul config files in the branch in order to load that branches configs | 19:57 |
| @g_gobi:matrix.org | Okay. Since I'm not using zuul-configs in un-trusted repos, it's just checking the branches and printing the merge jobs. | 20:05 |
| @clarkb:matrix.org | I think that even if you tell it not to use configs from those repos it may still load them? | 20:11 |
| @clarkb:matrix.org | I'm not 100% sure if that and may be worth trying | 20:11 |
| @jim:acmegating.com | if all config objects are excluded from a repo it won't run the cat jobs | 20:16 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!