| @g_gobi:matrix.org | Hi Guys, | 04:08 |
|---|---|---|
| I'm facing issue in zuul like scheduler pick the changes and enqueue it but it didn't trigger the job. It says no job configured. In zuul dashboard I can able to view the jobs configured for the pipeline. | ||
| Here added the logs for ref | ||
| @g_gobi:matrix.org | * Hi Guys, | 04:09 |
| I'm facing issue in zuul like scheduler pick the changes and enqueue it but it didn't trigger the job. It says no job configured. In zuul dashboard I can able to view the jobs configured for the pipeline. | ||
| Here added the logs for reference. Thanks. | ||
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul] 834857: WIP: Fix bug in getting changed files https://review.opendev.org/c/zuul/zuul/+/834857 | 06:03 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul] 834857: WIP: Fix bug in getting changed files https://review.opendev.org/c/zuul/zuul/+/834857 | 07:00 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul] 834857: WIP: Fix bug in getting changed files https://review.opendev.org/c/zuul/zuul/+/834857 | 08:04 | |
| @sean-k-mooney:matrix.org | fungi: i got https://github.com/SeanMooney/ansible_role_devstack working. its now reusing the zuul-jobs roles, devstack roles and openstack-zuul-jobs roles repos to deploy a 3 node devstack without zuul/nodepool using molecure to spin up vm via vagrant/libvirt | 09:33 |
| @sean-k-mooney:matrix.org | i required surprisingly little hacks https://github.com/SeanMooney/ansible_role_devstack/blob/master/ansible/roles/devstack_common/tasks/main.yml#L4-L12 | 09:34 |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul] 834857: WIP: Fix bug in getting changed files https://review.opendev.org/c/zuul/zuul/+/834857 | 11:09 | |
| @tibeer:matrix.org | Hi, i'd like to ask if there is a way to get the secrets defined in GItHub and make them available as a secret for a job. | 11:28 |
| @avass:vassast.org | Tim Beermann: I don't think there's any built-in support in zuul to do that, but you could easily write a role you can use that fetches secrets from github | 11:31 |
| @tibeer:matrix.org | Albin Vass: Thanks for the hint! I'll look into it. | 11:39 |
| @d-j-j:matrix.org | Hi, I'm trying to generate the docs locally. Made a venv based on doc/requirements.txt and ran "make html". It fails with different python import errors or various "not found" errors depending on what working dir I'm using (zuul root, doc, ...). Could you give me a hint how to call it correctly? | 11:42 |
| @avass:vassast.org | d-j-j: docs for the zuul repo? I think it should be enought to run `tox -e docs` if you have tox installed | 11:42 |
| @avass:vassast.org | then tox should set up a venv correctly for you and build the docs | 11:43 |
| @d-j-j:matrix.org | Albin Vass: thanks! I didn't realize it's also a tox env. | 11:43 |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul] 834857: WIP: Fix bug in getting changed files https://review.opendev.org/c/zuul/zuul/+/834857 | 12:41 | |
| -@gerrit:opendev.org- Simon Westphahl proposed: [zuul/nodepool] 836013: Add support for label quota https://review.opendev.org/c/zuul/nodepool/+/836013 | 13:03 | |
| @ekapoun1:matrix.org | Hello, regarding circular dependencies - do they work across repos, or only within the same repo? We're testing the consequences of enabling it, but although we have a shared queue set up between two different repos, where both queue definitions say circular dependencies are allowed, Zuul says a dependency cycle is detected and gives a -1. Is there a tenant configuration to enable/disable circular dependencies as well? | 13:14 |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul] 834857: WIP: Fix bug in getting changed files https://review.opendev.org/c/zuul/zuul/+/834857 | 13:37 | |
| -@gerrit:opendev.org- Albin Vass proposed: [zuul/zuul] 836022: Document prometheus_port, prometheus_addr for all components https://review.opendev.org/c/zuul/zuul/+/836022 | 14:02 | |
| -@gerrit:opendev.org- Dominik Jaeger proposed: [zuul/zuul] 836023: Add zuul/requirements.txt to docs env https://review.opendev.org/c/zuul/zuul/+/836023 | 14:03 | |
| @d-j-j:matrix.org | > <@gerrit:opendev.org> Dominik Jaeger proposed: [zuul/zuul] 836023: Add zuul/requirements.txt to docs env https://review.opendev.org/c/zuul/zuul/+/836023 | 14:05 |
| I came across an import error when generating the docs. This solved it but not sure if it's the preferred solution... | ||
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul] 834857: WIP: Fix bug in getting changed files https://review.opendev.org/c/zuul/zuul/+/834857 | 14:08 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul] 834857: WIP: Fix bug in getting changed files https://review.opendev.org/c/zuul/zuul/+/834857 | 14:54 | |
| @mnaser:matrix.org | I've got a few simple reviews I'd like to ask for reviews on: | 16:35 |
| - https://review.opendev.org/c/zuul/zuul-jobs/+/835162 | ||
| - https://review.opendev.org/c/zuul/zuul-jobs/+/835156 | ||
| - https://review.opendev.org/c/zuul/zuul-registry/+/835772 | ||
| - https://review.opendev.org/c/zuul/zuul-registry/+/835773 | ||
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 835918: Create missing db entries and retry https://review.opendev.org/c/zuul/zuul/+/835918 | 17:28 | |
| @pearcetyler:matrix.org | Zuul is occasionally getting stuck in an infinite loop of trying to start jobs, reaching hundreds+ retry attempts to start a job on default settings (Which should limit retry to 3 I thought?). Any idea what could cause this? | 20:09 |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 836086: Fix implied branch matchers with regex chars https://review.opendev.org/c/zuul/zuul/+/836086 | 20:54 | |
| @iwienand:matrix.org | Tyler Pearce: oh, weird. are you running with https://review.opendev.org/c/zuul/zuul/+/830840 ? | 20:55 |
| @avass:vassast.org | ianw: that should only allow jobs to abort early without retrying | 20:58 |
| @avass:vassast.org | Tyler Pearce: usually that happens when an executor fails during setup (before the actual job starts) I'd check the executor logs for errors | 20:59 |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: | 21:03 | |
| - [zuul/zuul-helm] 835480: Add license file https://review.opendev.org/c/zuul/zuul-helm/+/835480 | ||
| - [zuul/zuul-helm] 836090: Disable functional test job in gate https://review.opendev.org/c/zuul/zuul-helm/+/836090 | ||
| @pearcetyler:matrix.org | I do see some errors `ERROR zuul.AnsibleJob: ValueError: SHA b'05197b9de40446fdf516a6691a7950b8d479f450' could not be resolved, git returned: b'05197b9de40446fdf516a6691a7950b8d479f450 missing'` but it seems odd that the sha would go missing 🤔 What would cause this? It doesn't look like anything changed in the branch after starting the gate pipeline | 21:07 |
| -@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul-helm] 836090: Disable functional test job in gate https://review.opendev.org/c/zuul/zuul-helm/+/836090 | 21:09 | |
| @pearcetyler:matrix.org | Zuul might be failing to merge things? `Could not fetch refs to merge from remote` is there a cap on the retries here or is it possible it's getting stuck here? | 21:12 |
| ``` | ||
| # Return ABORTED so that we'll try again. At this point all of | ||
| # the refs we're trying to merge should be valid refs. If we | ||
| # can't fetch them, it should resolve itself. | ||
| self.log.exception("Could not fetch refs to merge from remote") | ||
| ``` | ||
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 835918: Create missing db entries and retry https://review.opendev.org/c/zuul/zuul/+/835918 | 21:12 | |
| -@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul-helm] 835480: Add license file https://review.opendev.org/c/zuul/zuul-helm/+/835480 | 21:15 | |
| @vlotorev:matrix.org | Hi, I have created a tenant with two gerrit connections and both have 'sandbox' project. Zuul doesn't start and ends with exception: | 22:13 |
| ``` | ||
| scheduler_1 | projects_matching_regex = tenant.getProjectsByRegex(regex) | ||
| scheduler_1 | File "/usr/local/lib/python3.8/site-packages/zuul/model.py", line 5325, in getProjectsByRegex | ||
| scheduler_1 | raise Exception("Project name '%s' is ambiguous, " | ||
| scheduler_1 | Exception: Project name 'sandbox' is ambiguous, please fully qualify the project with a hostname. Valid hostnames are dict_keys(['gerrit1.com', ''gerrit2.com']). | ||
| ``` | ||
| @clarkb:matrix.org | vlotorev: as mentioned in there you'll need to fully qualify the project names to distinguish them and remove the collision | 22:15 |
| @clarkb:matrix.org | gerrit1.com/sandbox and gerrit2.com/sandbox | 22:16 |
| @vlotorev:matrix.org | Original tenants.yaml: | 22:21 |
| ``` | ||
| - tenant: | ||
| name: sometenant | ||
| source: | ||
| gerrit1: | ||
| untrusted-projects: | ||
| - sandbox | ||
| gerrit2: | ||
| config-projects: | ||
| - sandbox | ||
| ``` | ||
| If I change to | ||
| ``` | ||
| - tenant: | ||
| name: sometenant | ||
| source: | ||
| gerrit1: | ||
| untrusted-projects: | ||
| - sandbox | ||
| gerrit2: | ||
| config-projects: | ||
| - gerrit2.com/sandbox | ||
| ``` | ||
| Then zuul starts but tries to check for 'gerrit2.com/sandbox' repo on gerrit2.com server which results into 'gerrit2.com/gerrit2.com/sandbox'. This is name is seen on zuul web when I click on project details. | ||
| @clarkb:matrix.org | I think it is ok to have your first config there since they are unambious in that context. But in your in repo configs you need todifferentiate? | 22:25 |
| @vlotorev:matrix.org | Zuul doesn't reload (zuul-scheduler full-reconfigure), it ends with an exception as I posted above. | 22:27 |
| @vlotorev:matrix.org | * Zuul doesn't reload configuration (`zuul-scheduler full-reconfigure`), it ends with an exception as I posted above. Full traceback: | 22:29 |
| ``` | ||
| Traceback (most recent call last): | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/cmd/scheduler.py", line 152, in run | ||
| self.sched.prime(self.config) | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/scheduler.py", line 636, in prime | ||
| self._doReconfigureEvent(event) | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/scheduler.py", line 942, in _doReconfigureEvent | ||
| tenant = loader.loadTenant(self.abide, tenant_name, | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/configloader.py", line 2357, in loadTenant | ||
| new_tenant = self.tenant_parser.fromYaml( | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/configloader.py", line 1621, in fromYaml | ||
| tenant.layout = self._parseLayout( | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/configloader.py", line 2199, in _parseLayout | ||
| self._addLayoutItems(layout, tenant, data) | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/configloader.py", line 2144, in _addLayoutItems | ||
| projects_matching_regex = tenant.getProjectsByRegex(regex) | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/model.py", line 5325, in getProjectsByRegex | ||
| raise Exception("Project name '%s' is ambiguous, " | ||
| Exception: Project name 'sandbox' is ambiguous, please fully qualify the project with a hostname. Valid hostnames are dict_keys(['gerrit1.com', ''gerrit2.com']). | ||
| ``` | ||
| @vlotorev:matrix.org | * With the first config Zuul doesn't reload configuration (`zuul-scheduler full-reconfigure`), it ends with an exception as I posted above. Full traceback: | 22:30 |
| ``` | ||
| Traceback (most recent call last): | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/cmd/scheduler.py", line 152, in run | ||
| self.sched.prime(self.config) | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/scheduler.py", line 636, in prime | ||
| self._doReconfigureEvent(event) | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/scheduler.py", line 942, in _doReconfigureEvent | ||
| tenant = loader.loadTenant(self.abide, tenant_name, | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/configloader.py", line 2357, in loadTenant | ||
| new_tenant = self.tenant_parser.fromYaml( | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/configloader.py", line 1621, in fromYaml | ||
| tenant.layout = self._parseLayout( | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/configloader.py", line 2199, in _parseLayout | ||
| self._addLayoutItems(layout, tenant, data) | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/configloader.py", line 2144, in _addLayoutItems | ||
| projects_matching_regex = tenant.getProjectsByRegex(regex) | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/model.py", line 5325, in getProjectsByRegex | ||
| raise Exception("Project name '%s' is ambiguous, " | ||
| Exception: Project name 'sandbox' is ambiguous, please fully qualify the project with a hostname. Valid hostnames are dict_keys(['gerrit1.com', ''gerrit2.com']). | ||
| ``` | ||
| @vlotorev:matrix.org | * :Clark: With the first config Zuul doesn't reload configuration (`zuul-scheduler full-reconfigure`), it ends with an exception as I posted above. Full traceback: | 22:33 |
| ``` | ||
| Traceback (most recent call last): | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/cmd/scheduler.py", line 152, in run | ||
| self.sched.prime(self.config) | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/scheduler.py", line 636, in prime | ||
| self._doReconfigureEvent(event) | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/scheduler.py", line 942, in _doReconfigureEvent | ||
| tenant = loader.loadTenant(self.abide, tenant_name, | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/configloader.py", line 2357, in loadTenant | ||
| new_tenant = self.tenant_parser.fromYaml( | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/configloader.py", line 1621, in fromYaml | ||
| tenant.layout = self._parseLayout( | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/configloader.py", line 2199, in _parseLayout | ||
| self._addLayoutItems(layout, tenant, data) | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/configloader.py", line 2144, in _addLayoutItems | ||
| projects_matching_regex = tenant.getProjectsByRegex(regex) | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/model.py", line 5325, in getProjectsByRegex | ||
| raise Exception("Project name '%s' is ambiguous, " | ||
| Exception: Project name 'sandbox' is ambiguous, please fully qualify the project with a hostname. Valid hostnames are dict_keys(['gerrit1.com', ''gerrit2.com']). | ||
| ``` | ||
| @vlotorev:matrix.org | * Clark: With the first config Zuul doesn't reload configuration (`zuul-scheduler full-reconfigure`), it ends with an exception as I posted above. Full traceback: | 22:33 |
| ``` | ||
| Traceback (most recent call last): | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/cmd/scheduler.py", line 152, in run | ||
| self.sched.prime(self.config) | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/scheduler.py", line 636, in prime | ||
| self._doReconfigureEvent(event) | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/scheduler.py", line 942, in _doReconfigureEvent | ||
| tenant = loader.loadTenant(self.abide, tenant_name, | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/configloader.py", line 2357, in loadTenant | ||
| new_tenant = self.tenant_parser.fromYaml( | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/configloader.py", line 1621, in fromYaml | ||
| tenant.layout = self._parseLayout( | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/configloader.py", line 2199, in _parseLayout | ||
| self._addLayoutItems(layout, tenant, data) | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/configloader.py", line 2144, in _addLayoutItems | ||
| projects_matching_regex = tenant.getProjectsByRegex(regex) | ||
| File "/usr/local/lib/python3.8/site-packages/zuul/model.py", line 5325, in getProjectsByRegex | ||
| raise Exception("Project name '%s' is ambiguous, " | ||
| Exception: Project name 'sandbox' is ambiguous, please fully qualify the project with a hostname. Valid hostnames are dict_keys(['gerrit1.com', ''gerrit2.com']). | ||
| ``` | ||
| @clarkb:matrix.org | Yes I think that is failing in your in repo configs not the tenant config | 22:36 |
| @clarkb:matrix.org | I think what we need to see are your project regex stanzas | 22:37 |
| @vlotorev:matrix.org | Clark: Do you mean `.zuul.yaml/.zuul.d` configuration in repos that might be referring to 'sandbox' project? | 22:43 |
| @clarkb:matrix.org | yes | 22:45 |
| @clarkb:matrix.org | but specifically your any regex stanzas since that is the part of the code that is angry | 22:45 |
| @clarkb:matrix.org | https://opendev.org/openstack/project-config/src/branch/master/zuul.d/projects.yaml#L9 is an example from opendev's config | 22:45 |
| @vlotorev:matrix.org | The thing is tenant config posted above is almost literal, I do have only two sandbox projects and they are empty (no zuul files), I removed other repos from tenant config while tracing the issue. Let me recheck and removed data directory with scheduler cloned repos. | 22:50 |
| @vlotorev:matrix.org | * The thing is tenant config posted above is almost literal, I do have only two sandbox projects and they are empty (no zuul files), I removed other repos from tenant config while tracing the issue. Let me recheck and remove the data directory with scheduler cloned repos. | 22:50 |
| @clarkb:matrix.org | It isn't the tenant config though | 22:52 |
| @clarkb:matrix.org | it is your in repo config | 22:52 |
| @vlotorev:matrix.org | I have only two sandbox projects which don't have in-repo configs. | 22:57 |
| BTW, might it be that zookeeper caches some state? | ||
| @clarkb:matrix.org | zookeeper does cache state to improve performance (prevents needing to go out to git repos to load data) | 22:57 |
| @clarkb:matrix.org | vlotorev: looking at the code the getProjectsByRegex() seems to only be called if you have a regex project definition like iwth the example I shared. That is a project name that starts with ^ and is treated as config that applies to all projects that match the regex | 23:01 |
| @vlotorev:matrix.org | Clark: Thanks, I was wrong about 'only two empy sandbox projects'. I have project-config with following stanza: | 23:48 |
| ``` | ||
| - project: | ||
| name: ^.*$ | ||
| check: | ||
| jobs: [] | ||
| gate: | ||
| jobs: [] | ||
| ``` | ||
| I inserted it into my configuration as recommended here https://zuul-ci.org/docs/zuul/latest/tutorials/quick-start.html#configure-zuul-pipelines. | ||
| Why it's recommended then? | ||
| @vlotorev:matrix.org | * Clark: Thanks, I was wrong about 'only two empy sandbox projects'. I have project-config with following stanza: | 23:50 |
| ``` | ||
| - project: | ||
| name: ^.*$ | ||
| check: | ||
| jobs: [] | ||
| gate: | ||
| jobs: [] | ||
| ``` | ||
| I inserted it into my configuration as recommended here https://zuul-ci.org/docs/zuul/latest/tutorials/quick-start.html#configure-zuul-pipelines. | ||
| Why is it recommended then? | ||
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!