| @woockashek:matrix.org | hello everyone, I went through zuul documentation but haven't found the answer for my question. | 10:56 |
|---|---|---|
| I have some base zuul job where I wanted to define some `files` and `irrelevant-files` filters. The thing is that I would lile to use there some variables that will be defined in the child jobs as in the posted screen. | ||
| My solution is not working, is there any specific syntax or mechanism that will allow me to do something similar? | ||
| @bingberg:matrix.org | Hi I wanted to verify a finding, is there no way to make the zuul ui send authenticated requests to the log server? it seems that even when you have an openid connect driver and a tenant with access-rules it still sends the requests to the log server without any credentials | 12:23 |
| @bingberg:matrix.org | from looking at the source as far as I can tell it performs these calls with raw `Axios.get(url)` calls but I'm not sure if I'm missing something here | 12:25 |
| @clarkb:matrix.org | > <@bingberg:matrix.org> from looking at the source as far as I can tell it performs these calls with raw `Axios.get(url)` calls but I'm not sure if I'm missing something here | 12:44 |
| I think you want https://opendev.org/zuul/zuul-storage-proxy then configure auth/ACLS in that system | ||
| @clarkb:matrix.org | > <@woockashek:matrix.org> hello everyone, I went through zuul documentation but haven't found the answer for my question. | 12:44 |
| > I have some base zuul job where I wanted to define some `files` and `irrelevant-files` filters. The thing is that I would lile to use there some variables that will be defined in the child jobs as in the posted screen. | ||
| > My solution is not working, is there any specific syntax or mechanism that will allow me to do something similar? | ||
| > | ||
| > | ||
| I think files and irrelevant files always override parent values. But double check the docs on this. If you you need to define the list in the child | ||
| @clarkb:matrix.org | * I think files and irrelevant files always override parent values. But double check the docs on this. If so you need to define the list in the child | 12:45 |
| @bingberg:matrix.org | > <@clarkb:matrix.org> I think you want https://opendev.org/zuul/zuul-storage-proxy then configure auth/ACLS in that system | 12:57 |
| thanks, there doesn't seem to be any documentation for the system and I don't quite get how it works and where it's supposed to be placed, is the zuul-storage-proxy between the end-user and the storage server? how does it know that the get request from the zuul web client is form an authenticated user? | ||
| @clarkb:matrix.org | > <@bingberg:matrix.org> thanks, there doesn't seem to be any documentation for the system and I don't quite get how it works and where it's supposed to be placed, is the zuul-storage-proxy between the end-user and the storage server? how does it know that the get request from the zuul web client is form an authenticated user? | 13:14 |
| Yes I think it sits in between the user and the logs. You run auth in your uwsgi server/web server. I think BMW may use this they may have more info | ||
| @bingberg:matrix.org | > <@clarkb:matrix.org> Yes I think it sits in between the user and the logs. You run auth in your uwsgi server/web server. I think BMW may use this they may have more info | 13:19 |
| hmm I must be missing some critical piece of the puzzle, the zuul web ui performs a get request to the server without sending any identifier, atleast as far as I can tell, how would the zuul-storage-proxy know it was sent by the zuul web ui and not some rando on the internet? | ||
| @woockashek:matrix.org | but the point is that I don't want to repeat it over and over again. I have around 10 jobs dervied from the base job | 13:22 |
| @woockashek:matrix.org | there are multiple paths for `filters` and every time the difference is a single folder in the path | 13:23 |
| @clarkb:matrix.org | I'm not sure it would. You may need to login separately I'm not sure | 13:24 |
| @clarkb:matrix.org | Our logs are all public. I just recall this was written to address a similar issue | 13:25 |
| @bingberg:matrix.org | I see, thanks for the tips, I guess I could put both the logs and the storage proxy behind the same domain name with cookie authentication, you wouldn't happen to know if there is some way of telling zuul to use cookies for the jwt instead of a Authorization header? | 13:49 |
| @sdodsley:matrix.org | Can anyone point me in the right direction for this crash when starting the scheduler: | 14:31 |
| ``` | ||
| 2023-06-19 14:15:36,786 INFO zuul.TenantParser: Loading configuration from config/zuul.d/_jobs-base.yaml@master | ||
| 2023-06-19 14:15:36,790 INFO zuul.TenantParser: Loading configuration from config/zuul.d/_jobs-openshift.yaml@master | ||
| 2023-06-19 14:15:36,792 INFO zuul.TenantParser: Loading configuration from config/zuul.d/_jobs-pages.yaml@master | ||
| 2023-06-19 14:15:36,793 INFO zuul.TenantParser: Loading configuration from config/zuul.d/_pipelines.yaml@master | ||
| 2023-06-19 14:15:36,802 INFO zuul.TenantParser: Loading configuration from config/zuul.d/_projects.yaml@master | ||
| 2023-06-19 14:15:36,803 INFO zuul.TenantParser: Loading configuration from config/zuul.d/_secret_install_server.yaml@master | ||
| 2023-06-19 14:15:36,804 INFO zuul.TenantParser: Loading configuration from config/zuul.d/_secret_service_user.yaml@master | ||
| 2023-06-19 14:15:36,805 INFO zuul.TenantParser: Loading configuration from config/zuul.d/_secret_sflogs.yaml@master | ||
| 2023-06-19 14:15:36,806 INFO zuul.TenantParser: Loading configuration from config/zuul.d/_secret_sfpages.yaml@master | ||
| 2023-06-19 14:15:37,264 INFO zuul.MergeClient: Merge <gear.Job 0x7f09f40c2be0 handle: b'H:::ffff:10.231.128.143:2' name: merger:cat unique: dc60a99c45e142319748ae4a72e7fd7a> complete, merged: False, updated: True, commit: None, branches: [] | ||
| 2023-06-19 14:15:37,265 INFO zuul.TenantParser: Loading configuration from sf-jobs/zuul.d/_included-jobs.yaml@master | ||
| 2023-06-19 14:15:37,313 INFO zuul.MergeClient: Merge <gear.Job 0x7f09f40c2d68 handle: b'H:::ffff:10.231.128.143:3' name: merger:cat unique: a725c7a1cd61416797ffc5f40a15ab87> complete, merged: False, updated: False, commit: None, branches: [] | ||
| 2023-06-19 14:15:37,313 ERROR zuul.Scheduler: Error starting Zuul: | ||
| Traceback (most recent call last): | ||
| File "/usr/lib/python3.6/site-packages/zuul/cmd/scheduler.py", line 148, in run | ||
| self.sched.prime(self.config, self.args.validate_tenants) | ||
| File "/usr/lib/python3.6/site-packages/zuul/scheduler.py", line 551, in prime | ||
| self._doReconfigureEvent(event) | ||
| File "/usr/lib/python3.6/site-packages/zuul/scheduler.py", line 784, in _doReconfigureEvent | ||
| event.validate_tenants) | ||
| File "/usr/lib/python3.6/site-packages/zuul/configloader.py", line 2293, in loadConfig | ||
| abide, conf_tenant, ansible_manager) | ||
| File "/usr/lib/python3.6/site-packages/zuul/configloader.py", line 1616, in fromYaml | ||
| self._cacheTenantYAML(abide, tenant, loading_errors, cache_ltime) | ||
| File "/usr/lib/python3.6/site-packages/zuul/configloader.py", line 1845, in _cacheTenantYAML | ||
| raise Exception("Cat job %s failed" % (job,)) | ||
| Exception: Cat job <gear.Job 0x7f09f40c2d68 handle: b'H:::ffff:10.231.128.143:3' name: merger:cat unique: a725c7a1cd61416797ffc5f40a15ab87> failed | ||
| ``` | ||
| @jim:acmegating.com | Simon Dodsley: look for that job uid (a725...) on a merger or executor to see why it failed | 14:35 |
| @sdodsley:matrix.org | corvus: where would i look? I don't see anything in the executor log for that job. I'm not a zuul expert | 14:38 |
| @jim:acmegating.com | the logs for one of the mergers or executors is where the error should be found. you might need to restart them with debug logging enabled to see all the relevant info | 14:46 |
| @sdodsley:matrix.org | OK - how do i enable debugging in zuul? | 14:48 |
| @jim:acmegating.com | `-d` | 14:49 |
| @sdodsley:matrix.org | 👍️ | 14:49 |
| @jim:acmegating.com | https://zuul-ci.org/docs/zuul/latest/operation.html#operation has the docs for that | 14:50 |
| @sdodsley:matrix.org | OK - fixed the issue. Apparently one of the repos had a corrupted .git/config file | 15:49 |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: | 21:18 | |
| - [zuul/nodepool] 886432: Add ZK cache stats https://review.opendev.org/c/zuul/nodepool/+/886432 | ||
| - [zuul/nodepool] 886433: Limit TreeCache playback queue size https://review.opendev.org/c/zuul/nodepool/+/886433 | ||
| @fungicide:matrix.org | https://review.opendev.org/839550 might have allowed some of what you're looking for, unfortunately the proponent for it disappeared before getting all the way there. could be worth revisiting? | 23:54 |
| @fungicide:matrix.org | there was a potential implementation in https://review.opendev.org/828125 | 23:56 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!