| -@gerrit:opendev.org- Zuul merged on behalf of Guillaume Chauvel: [zuul/zuul] 770817: Fix zuul_stream test setup https://review.opendev.org/c/zuul/zuul/+/770817 | 00:03 | |
| @chgans:matrix.org | Let say i have the following repositories: | 01:30 |
|---|---|---|
| - project1 | ||
| - project2 | ||
| - ci-jobs | ||
| When project1 and/or project2 are modified (Gerrit' "Submitted together"), i want the jobs defined in "ci-jobs" to be triggered. | ||
| I do not want to have zull.yaml in any projectX repo, only in ci-jobs. Is [jo.required-projects](https://zuul-ci.org/docs/zuul/latest/config/job.html#attr-job.required-projects) the solution? | ||
| @iwienand:matrix.org | Christian Gagneraud: you seem to be describing in ci-jobs what we in opendev/openstack land call "project-config". basically a repo where we have jobs defined for projects; e.g. https://opendev.org/openstack/project-config/src/branch/master/zuul.d/projects.yaml | 01:35 |
| @chgans:matrix.org | yes, but in my case, project1 and project2 cannot be built on their own. you need both source tree to build the product. | 01:38 |
| @iwienand:matrix.org | in that case yes, i imagine required-projects is what you want. you would build a job that has project1 & project2 as required projects, and then that job should install/build/whatever from zuul's checkout of those projects in the job | 01:39 |
| @chgans:matrix.org | thx for that. I've been looking at existing conf (opendev, zuul itself), it helps a bit, but they are quite complex! :) | 01:49 |
| @iwienand:matrix.org | yeah, they have had 10 years of work on them :) | 01:49 |
| @iwienand:matrix.org | i'm trying to think of some good examples. nodepool and dib might be one | 01:50 |
| @iwienand:matrix.org | hrm, it used to be, but there's a fair bit of complexity in that now with containers | 01:51 |
| @iwienand:matrix.org | you can sort of see it in https://opendev.org/zuul/nodepool/src/branch/master/.zuul.yaml#L108 | 01:52 |
| @iwienand:matrix.org | this gist is that that job is used by both nodepool and diskimage-builder for testing | 01:53 |
| @chgans:matrix.org | looking at this right now: https://www.softwarefactory-project.io/zuul-hands-on-part-6-cross-project-dependencies.html | 01:53 |
| @iwienand:matrix.org | both projects use that job, which is why they're both listed as required projects | 01:54 |
| @jim:acmegating.com | separately, i'd put the `project` stanza in a config-project (that will specify that you want to run that job on changes to project1 and project2), but i would put the `job` definition itself in an untrusted-project so that you can speculatively execute changes to it. so that would mean 4 repos involved. | 01:58 |
| @chgans:matrix.org | how to specify the dependencies the the config repo? Should i declare a base job for that? AFAIU, deps can only be declared on a job basis | 02:01 |
| @chgans:matrix.org | * how to specify the dependencies the the config repo? Should i declare a base job for that? AFAIU, deps can only be declared at the `job` level | 02:02 |
| @jim:acmegating.com | Christian Gagneraud: something like this: https://etherpad.opendev.org/p/NfK5MERYApGiXkIYeITK | 02:05 |
| @jim:acmegating.com | (next step after that: use a project-template to reduce the duplication in the project-config repo... but save that for later to keep things simple :) | 02:08 |
| @chgans:matrix.org | yes, for now i'm replicating an AOSP project with just 2 dummy source repos. I'm just evaluating what can be done or not. I want to see a job run and an auto-merge with changes across 2 repos. | 02:10 |
| @jim:acmegating.com | Christian Gagneraud: since you said the magic words "submitted together" you'll want to include a shared queue definition that allows circular dependencies. i updated the etherpad with an example. | 02:11 |
| @chgans:matrix.org | yeah, i grep'ed "submitted together" in zull repo and found mentions of it in the Queue section | 02:12 |
| @jim:acmegating.com | Christian Gagneraud: if you have submitWholeTopic enabled in gerrit, that will automatically create circular dependencies in zuul for changes in the same topic. we also just added automatic job deduplication in dependent (gate) pipelines. you won't see that happen in independent (check) pipelines, but when gating, it should only run one copy of "my-job" for all changes in the same topic. | 02:13 |
| @jim:acmegating.com | at least, it should... the deduplication feature is so new i don't think it's made it to production for anyone yet. but it works in tests. ;) | 02:14 |
| @jim:acmegating.com | (technically opendev's zuul is running it in prod, but we don't have submitWholeTopic enabled, or circular deps, so we don't get to see it in action here) | 02:14 |
| @chgans:matrix.org | hmmm not sure this is working as expected. the job get executed twice and both fail with "can't find /path/to/gerrit/aosp-jobs" ... | 03:56 |
| @chgans:matrix.org | `Error: Unable to find playbook /var/lib/zuul/builds/79223ee9511e4003afaea22d28e50dc6/untrusted/project_0/gerrit/devops_aosp-jobs/playbooks/helloworld.yaml` that's the playbook of the check job which is defined in devops_aosp-jobs/zuul.yaml | 03:59 |
| -@gerrit:opendev.org- Zuul merged on behalf of Clark Boylan: [zuul/zuul-jobs] 846206: Fix two testing problems https://review.opendev.org/c/zuul/zuul-jobs/+/846206 | 04:23 | |
| -@gerrit:opendev.org- Ian Wienand proposed: [zuul/zuul-jobs] 846248: Revert "Install venv for all platforms in ensure-pip" https://review.opendev.org/c/zuul/zuul-jobs/+/846248 | 04:52 | |
| @chgans:matrix.org | ```Build failed. | 04:53 |
| aosp-check http://localhost:9000/t/aosp/build/eca9485111cf4081b56ef27c952e9541 : ERROR Unable to find playbook /var/lib/zuul/builds/eca9485111cf4081b56ef27c952e9541/untrusted/project_0/gerrit/devops_aosp-jobs/playbooks/helloworld.yaml in 1s | ||
| Debug information: | ||
| Project <ProjectConfig gerrit/aosp_build source: devops_aosp-config/zuul.d/projects.yaml@master None> matched | ||
| Project <ProjectConfig gerrit/aosp_build source: devops_aosp-config/zuul.d/projects.yaml@master None> matched | ||
| Freezing job graph | ||
| Freezing job aosp-check | ||
| Collecting job variants for aosp-check | ||
| Variant <Job aosp-check branches: None source: devops_aosp-jobs/zuul.yaml@master#1> matched | ||
| Collecting job variants for aosp-base | ||
| Variant <Job aosp-base branches: None source: devops_aosp-config/zuul.d/jobs.yaml@master#1> matched | ||
| Pipeline variant <Job aosp-check branches: None source: devops_aosp-config/zuul.d/projects.yaml@master#6> matched``` | ||
| @chgans:matrix.org | running zuul 6.0.1.dev63 1f968bb67 using doc/sources/example docker-compose | 04:54 |
| @iwienand:matrix.org | Christian Gagneraud: does project_0 have helloworld.yaml in it? | 05:13 |
| @chgans:matrix.org | `/zuul/builds` is empty, i wonder if it is cleaned up on completion | 05:14 |
| @chgans:matrix.org | on the executor | 05:14 |
| @chgans:matrix.org | Maybe i can hold it with the `autoholds` feature? | 05:16 |
| @iwienand:matrix.org | i feel like there is an option to not clean the executor for debugging | 05:17 |
| @chgans:matrix.org | NVM, it was a typo!?! playbook vs playbooks!!! 😠| 05:27 |
| @chgans:matrix.org | OK, jobs are now green, but behaviour is not what was expected. I tried a non dependent check and a dependent gate. And all commits on all repo are all considered isolated. commits get merged one by one disregarding topics and "submit together". | 05:47 |
| @chgans:matrix.org | could be a misconfig on gerrit side or misuse from me, will dig deeper ... | 05:52 |
| -@gerrit:opendev.org- Artem Goncharov proposed: [zuul/zuul] 845592: [WIP] Add Gitlab commit status reporting https://review.opendev.org/c/zuul/zuul/+/845592 | 10:30 | |
| @q:fricklercloud.de | is there a specific reason that exclude-unprotected-branches does not seem to affect config-projects? | 13:10 |
| I have a config-project on github and zuul executes e.g. post jobs on development branches for it | ||
| @jpew:matrix.org | Is there a way to do a reverse-lookup up on a job and find all the places where a base job has been inherited? I seem to recall someone previously mentioning a tool for this but I can't find it anymore | 13:18 |
| @mhuin:matrix.org | jpew: you can have a look at this tool: https://www.softwarefactory-project.io/introducing-zuul-weeder.html | 13:33 |
| @jpew:matrix.org | That was it, thanks | 13:33 |
| -@gerrit:opendev.org- Artem Goncharov proposed: [zuul/zuul] 845592: [WIP] Add Gitlab commit status reporting https://review.opendev.org/c/zuul/zuul/+/845592 | 13:37 | |
| @jim:acmegating.com | jpew: an alternative would be a script to iterate over jobs in the api and look for parents. here's a similar script that iterates over projects: https://opendev.org/zuul/zuul/src/branch/master/tools/deprecated-queues.py | 13:39 |
| @jpew:matrix.org | Is this.... haskell? | 13:51 |
| @jpew:matrix.org | Anyway, zuul-weeder doesn't seem to work for me; I get `Unable to find project connection's provider name` :/ | 13:57 |
| @tristanc_:matrix.org | jpew: I uploaded a new container image with https://softwarefactory-project.io/r/c/software-factory/zuul-weeder/+/25279 to show what is the name of the connection missing. Did you provided the same zuul.conf as the one of the scheduler? | 14:30 |
| @jpew:matrix.org | tristanC: Yes | 14:31 |
| @tristanc_:matrix.org | jpew: then there is a bug somewhere. If you could restart the service after a container pull, then the error message should indicate what is the affected project | 14:33 |
| @jpew:matrix.org | tristanC: Ya I need to figure out how to pull that; we have a local docker registry cache that makes `latest` pulls problematic :/ | 14:34 |
| @jpew:matrix.org | Need to figure out how to invalidate the cache first | 14:34 |
| @jpew:matrix.org | tristanC: Heh, some of your metadata may be a little off: `quay.io/software-factory/zuul-weeder latest 2f60150d32c4 52 years ago 147MB` | 14:40 |
| @jpew:matrix.org | tristanC: `zuul-weeder: Unable to find project connection's provider name: ConnectionName "gerrit", for project: TenantProject {name = ProjectName "zuul/config", includedConfigElements = fromList [PipelineT,JobT,SemaphoreT,ProjectT,ProjectTemplateT,NodesetT,SecretT,QueueT], configPaths = [".zuul.yaml","zuul.yaml",".zuul.d/","zuul.d/"]}` | 14:44 |
| @tristanc_:matrix.org | jpew: then it seems like the connection named "gerrit" can't be decoded from the zuul.conf. Would you be able to paste the config section? | 14:59 |
| @jpew:matrix.org | ``` | 15:00 |
| [connection "gerrit"] | ||
| driver=gerrit | ||
| server=my.server.com | ||
| sshkey=/var/ssh/zuul/key.prv | ||
| user=zuul | ||
| password=%(ZUUL_PASSWORD)s | ||
| baseurl=https://my.server.com/code-review | ||
| ``` | ||
| @tristanc_:matrix.org | jpew: thanks, I think we need to trim the `"` around the connection name. I'll update the image shortly. Thanks! | 15:02 |
| @tristanc_:matrix.org | jpew: the latest image should now be fixed. Feel free to report issues on the bug tracker if the project does not work for you. | 15:13 |
| -@gerrit:opendev.org- Artem Goncharov proposed: [zuul/zuul] 845592: [WIP] Add Gitlab commit status reporting https://review.opendev.org/c/zuul/zuul/+/845592 | 15:14 | |
| @jpew:matrix.org | tristanC: Thanks. I'll give it another try | 15:14 |
| @jpew:matrix.org | tristanC: Cool, it looks like it works. Thanks! | 15:33 |
| @sdodsley:matrix.org | Hi - new here and looking for some guidance on our OpenStack 3rd Party CI system. This is a new build, deployed with Software Factory. When ever our CI build jobs are created and DevStack built, the DEVSTACK_HOSTNAME always seems to have a `.novalocal` in the name which is causing all lookups to fail. We have tried setting `dhcp_domain: ""` in the setup role tasks main.yaml for nova.conf [api] section, but that has no affect | 15:36 |
| @fungicide:matrix.org | Simon Dodsley: those are really implementation details of the job you're trying to run. that configuration is maintained by the OpenStack QA team (in #openstack-qa on OFTC), though there's also a #openstack-third-party-ci IRC channel which is sometimes helpful | 15:39 |
| @clarkb:matrix.org | > <@sdodsley:matrix.org> Hi - new here and looking for some guidance on our OpenStack 3rd Party CI system. This is a new build, deployed with Software Factory. When ever our CI build jobs are created and DevStack built, the DEVSTACK_HOSTNAME always seems to have a `.novalocal` in the name which is causing all lookups to fail. We have tried setting `dhcp_domain: ""` in the setup role tasks main.yaml for nova.conf [api] section, but that has no affect | 15:39 |
| That value is set by devstack via `hostname -f` looks like: https://opendev.org/openstack/devstack/src/branch/master/lib/tls#L43 I'm not sure this is something that the zuul maintainers will eb able to help with as a result | ||
| -@gerrit:opendev.org- Zuul merged on behalf of Ade Lee: [zuul/zuul-jobs] 844704: Add the post-reboot-tasks role https://review.opendev.org/c/zuul/zuul-jobs/+/844704 | 15:47 | |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/nodepool] 846432: AWS driver create/delete improvements https://review.opendev.org/c/zuul/nodepool/+/846432 | 17:15 | |
| @jim:acmegating.com | zuul-maint: opendev has been running nodepool master since yesterday. i think we can tag this: | 17:52 |
| commit 1b1eab77b0461fc45dbfecb071c6b5b0900d5ed7 (HEAD -> master, tag: 6.1.0, origin/master, gerrit/master, refs/changes/20/846220/1) | ||
| how does that look? | ||
| @jim:acmegating.com | (opendev is in the middle of a zuul rolling restart; i think we should wait for that to finish before tagging zuul) | 17:53 |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/nodepool] 846437: Fix typo in release notes https://review.opendev.org/c/zuul/nodepool/+/846437 | 17:55 | |
| @jim:acmegating.com | or maybe we land that first and tag it ^ | 17:56 |
| @mhuin:matrix.org | corvus: on that note ... zuul-client could use a new tag, I've made some suggestions here: https://etherpad.opendev.org/p/zuul-client_0.0.5 | 18:33 |
| @mhuin:matrix.org | one of the "must have" patches I've listed would require a fix to the REST API | 18:33 |
| @jim:acmegating.com | mhu any reason not to tag current master since it has a bunch of bugfixes? | 18:53 |
| @mhuin:matrix.org | we could, then have the rest in 0.0.6 later | 19:03 |
| @mhuin:matrix.org | but I'd like to see the feature that simplifies authentication out in a tag sooner than later | 19:04 |
| @mhuin:matrix.org | I think many users have been confused about it after the gearmanectomy | 19:04 |
| -@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/nodepool] 846437: Fix typo in release notes https://review.opendev.org/c/zuul/nodepool/+/846437 | 19:13 | |
| -@gerrit:opendev.org- Guillaume Chauvel proposed: [zuul/zuul] 735475: Fix zuul_run_command ret when command is not found https://review.opendev.org/c/zuul/zuul/+/735475 | 19:31 | |
| @jim:acmegating.com | mhu: either way wfm. :) | 19:44 |
| @mhuin:matrix.org | cool, thanks! | 19:45 |
| @jim:acmegating.com | zuul-maint: revised nodepool release proposal: | 19:51 |
| commit b2d4e3c356dcbbe61fa0807fe27d60580cf8b552 (HEAD -> master, tag: 6.1.0, origin/master, refs/changes/37/846437/1) | ||
| @jim:acmegating.com | opendev has finished its zuul restart onto c5b55e59c8644060f01137e8d771777c6b5d56dc (except a few executors that are 1 rev behind that -- that should be inconsequential) | 19:57 |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/nodepool] 846442: WIP Update ZooKeeper class connection methods https://review.opendev.org/c/zuul/nodepool/+/846442 | 20:17 | |
| @vlotorev:matrix.org | Hi, I don't understand how value from paused job is transferred to dependent job. | 20:59 |
| E.g. there is zuul-quick-start build https://zuul.opendev.org/t/zuul/build/6a79556a6cbd4b43a57ab69db998d170. This build is expected to have some registry-ip provided from zuul-build-image but I failed to find variable/artifacts regarding registry in inventory.yaml for zuul-quick-start. | ||
| @jpew:matrix.org | vlotorev: zuul_return https://zuul-ci.org/docs/zuul/latest/job-content.html#return-values | 21:00 |
| @vlotorev:matrix.org | * Hi, I don't understand how value from paused job is transferred to dependent job. | 21:00 |
| E.g. there is zuul-quick-start build https://zuul.opendev.org/t/zuul/build/6a79556a6cbd4b43a57ab69db998d170. This build is expected to have some registry-ip provided from zuul-build-image but I failed to find variable/artifacts regarding registry in `zuul-info/inventory.yaml` for zuul-quick-start. | ||
| @vlotorev:matrix.org | I was expecting that zuul_return would inject variables to inventory.yaml. Is not this true? | 21:01 |
| @jim:acmegating.com | vlotorev: the registry roles use secret_data (mentioned in the link from jpew) so it won't show up there | 21:02 |
| @vlotorev:matrix.org | * I was expecting that zuul_return would inject variables to inventory.yaml to dependent jobs. Is not this true? | 21:02 |
| @jim:acmegating.com | (regular zuul_return data would though) | 21:02 |
| @jim:acmegating.com | vlotorev: https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/run-buildset-registry/tasks/main.yaml#L70-L77 | 21:03 |
| @vlotorev:matrix.org | Thanks. So zuul_return.secret_data is not added to inventory, while zuul_return.data should be added. | 21:07 |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 846445: WIP: Add ssh_server option to Gerrit driver https://review.opendev.org/c/zuul/zuul/+/846445 | 21:20 | |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 846448: Add --wait-for-init scheduler option https://review.opendev.org/c/zuul/zuul/+/846448 | 22:44 | |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed wip: [zuul/zuul] 846445: WIP: Add ssh_server option to Gerrit driver https://review.opendev.org/c/zuul/zuul/+/846445 | 22:47 | |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 846449: Add extra validation to dynamic-only projects https://review.opendev.org/c/zuul/zuul/+/846449 | 23:00 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!