Monday, 2025-07-14

-@gerrit:opendev.org- Michal Nasiadka proposed: [zuul/zuul-operator] 953748: Add connections mounts to zuul-web https://review.opendev.org/c/zuul/zuul-operator/+/95374806:21
-@gerrit:opendev.org- Michael Kelly proposed: [zuul/zuul-operator] 883595: deploy: Surface disk_limit_per_job in operator CRD https://review.opendev.org/c/zuul/zuul-operator/+/88359506:22
-@gerrit:opendev.org- Michael Kelly proposed: [zuul/zuul-operator] 883596: Broaden scope of potential config updates https://review.opendev.org/c/zuul/zuul-operator/+/88359606:22
-@gerrit:opendev.org- Michal Nasiadka proposed: [zuul/zuul-operator] 954893: Add support for setting web.root https://review.opendev.org/c/zuul/zuul-operator/+/95489306:39
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul] 954825: Add use-nodepool tenant option https://review.opendev.org/c/zuul/zuul/+/95482510:02
-@gerrit:opendev.org- Simon Westphahl proposed:10:52
- [zuul/zuul] 954915: End nodeset request span https://review.opendev.org/c/zuul/zuul/+/954915
- [zuul/zuul] 954916: Add nodeset request processing launcher span https://review.opendev.org/c/zuul/zuul/+/954916
- [zuul/zuul] 954917: Add provider node lifetime span https://review.opendev.org/c/zuul/zuul/+/954917
- [zuul/zuul] 954918: Export spans for provider node create/delete phase https://review.opendev.org/c/zuul/zuul/+/954918
-@gerrit:opendev.org- Michal Nasiadka proposed: [zuul/zuul-operator] 954920: Add authentication config https://review.opendev.org/c/zuul/zuul-operator/+/95492011:22
-@gerrit:opendev.org- Michal Nasiadka proposed: [zuul/zuul-operator] 954920: Add authentication config https://review.opendev.org/c/zuul/zuul-operator/+/95492012:13
-@gerrit:opendev.org- Simon Westphahl proposed:12:18
- [zuul/zuul] 954916: Add nodeset request processing launcher span https://review.opendev.org/c/zuul/zuul/+/954916
- [zuul/zuul] 954917: Add provider node lifetime span https://review.opendev.org/c/zuul/zuul/+/954917
- [zuul/zuul] 954918: Export spans for provider node create/delete phase https://review.opendev.org/c/zuul/zuul/+/954918
-@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] 954950: Add compatibility with Gerrit pull-replication https://review.opendev.org/c/zuul/zuul/+/95495013:57
@nerutto:matrix.orgHi I find a strange issue when adding github as a connection in Zuul. I am running Zuul in my local PC. I created the GitHub app and tested that the packet delivery to the zuul server. Payloads are delivered fine until I add the GitHub connection information in the zuul.conf.15:21
@nerutto:matrix.orgIsn't this not supported?15:28
@nerutto:matrix.orgOr any additional workarounds are needed?15:28
@nerutto:matrix.orgIf someone has tried, could any one you share comments?16:01
@clarkb:matrix.orgNerutto: many zuul installations are tied to github repos. Do you have any errors in the logs? Are you using a github app?16:40
@clarkb:matrix.orgI wouldn't expect adding non github app config to zuul to affect the delivery of events. The one thing that might is validation of the events might be failing given some shared information (not sure if that is the case)16:41
@clarkb:matrix.orgbut if event validation was failing I would expect the logs to indicate that this is the case16:41
@nerutto:matrix.orgClark:  Thank you for your reply.17:02
Yes, I am using a GitHub App. The app send the requests to a reverse-proxy(nginx) in an EC2. This inturn delivers the payload to the zuul ci server with am running in my local pc.
By the default settings, the if I send a test payload from the GitHub app, it is showing 200 status.
However, after adding the GitHub app information in the zuul.conf, the site goes down
```
$ curl http://zuul.testdomain1234.com:9000
curl: (7) Failed to connect to zuul.testdomain1234.com port 9000 after 74 ms: Couldn't connect to server
```
@nerutto:matrix.orgI am sure that the GitHub app information are valid17:05
@nerutto:matrix.org```17:09
INFO zuul.GithubConnection: Starting GitHub connection: app1
INFO zuul.GithubConnection.GithubClientManager: Authing to GitHub
INFO zuul.ComponentRegistry: Noticed new web component aec2d5ad3fca0000000028
INFO zuul.ComponentRegistry: Component web aec2d5ad3fca0000000028 updated: {'hostname': 'aec2d5ad3fca', 'kind': 'web', 'model_api': 32, 'state': 'stopped', 'version': '11.3.0'}
```
could not locate any useful items from logs. And this is what it surprises me. If there is something wrong shouldn't it be available in logs!
@clarkb:matrix.orgI would start by enabling debug logs if they aren't already. Then is that curl request against your proxy or zuul directly? That is a full connectivity error not an http 500 for example. I would double check that the container is listening on that port, and that the proxy hasn't marked it down due to the restart or some other check17:12
@clarkb:matrix.orgoh state: stopped probably explains it (I had to horizontally scroll for that)17:15
@clarkb:matrix.orgso ya I would look at debug logs and see why it is stopping17:15
@clarkb:matrix.orgthere is probably an error in your configuration17:15
@clarkb:matrix.orgpreventing it from running17:15
@nerutto:matrix.orgClark:  oh! is it. My bad. But is there an additional way I need to enable LEVEL=DEBUG or so to see the debug logs?17:23
@clarkb:matrix.orgit depends on how your logging is configured but usually running the zuul components with the `-d` flag will do it17:25
@nerutto:matrix.org```17:31
scheduler-1 | 2025-07-14 17:28:30,428 INFO zuul.GithubConnection: Starting GitHub connection: app1
scheduler-1 | 2025-07-14 17:28:30,428 INFO zuul.GithubConnection.GithubClientManager: Authing to GitHub
scheduler-1 | 2025-07-14 17:28:42,393 INFO zuul.nodepool: Watching nodepool requests
scheduler-1 | 2025-07-14 17:28:42,395 INFO zuul.ComponentRegistry: Noticed scheduler component 479b466a53750000000030 disappeared
scheduler-1 | 2025-07-14 17:28:42,401 INFO zuul.TimerDriver: Won timer election
```
Yes, I was monitoring the logs as you have mentioned, and had shared it in one of the previous chats.
@clarkb:matrix.orgthose are scheduler logs but its zuul-web that is the problem17:32
@clarkb:matrix.orgyou need to see why the web server is stopping which is what ultimately makes your curl request fail I suspect17:32
@nerutto:matrix.org```17:37
eb-1 | 2025-07-14 17:33:58,579 INFO zuul.ComponentRegistry: Noticed new web component fb058bd45d770000000030
web-1 | 2025-07-14 17:33:58,582 INFO zuul.ComponentRegistry: Component web fb058bd45d770000000030 updated: {'hostname': 'fb058bd45d77', 'kind': 'web', 'model_api': 32, 'state': 'stopped', 'version': '11.3.0'}
web-1 | 2025-07-14 17:33:58,588 INFO zuul.ComponentRegistry: System minimum data model version 32; this component 32
web-1 | 2025-07-14 17:33:58,665 INFO alembic.runtime.migration: Context impl MySQLImpl.
web-1 | 2025-07-14 17:33:58,665 INFO alembic.runtime.migration: Context impl MySQLImpl.
web-1 | 2025-07-14 17:33:58,665 INFO alembic.runtime.migration: Will assume non-transactional DDL.
web-1 | 2025-07-14 17:33:58,665 INFO alembic.runtime.migration: Will assume non-transactional DDL.
web-1 | 2025-07-14 17:33:58,682 INFO alembic.runtime.migration: Context impl MySQLImpl.
web-1 | 2025-07-14 17:33:58,682 INFO alembic.runtime.migration: Context impl MySQLImpl.
web-1 | 2025-07-14 17:33:58,682 INFO alembic.runtime.migration: Will assume non-transactional DDL.
web-1 | 2025-07-14 17:33:58,682 INFO alembic.runtime.migration: Will assume non-transactional DDL.
web-1 | 2025-07-14 17:33:58,720 INFO zuul.GithubConnection: Starting GitHub connection: app1
web-1 | 2025-07-14 17:33:58,721 INFO zuul.GithubConnection.GithubClientManager: Authing to GitHub
web-1 | 2025-07-14 17:34:14,393 INFO zuul.ComponentRegistry: Noticed web component fb058bd45d770000000030 disappeared
```
No critical stuffs could be noticed. This again narrow down to the fact that the issue is with my settings of app in zuul.conf?
@clarkb:matrix.orgthe last two messages are "Authing to GitHub" then "web component disappeared". I would guess auth is failing (and I would suspect debug logs would show that)17:38
@nerutto:matrix.orgdocker exec -it web-1 cat /etc/zuul/connections/app1/app_key17:46
I just checked if the key has been rightly mounted, and it is... This typically shows that the app_id is also correct.
@nerutto:matrix.orgapp_id is correct17:48
Key file is mounted correctly
Path in zuul.conf matches container path
File is valid PEM
File is readable by Zuul
I just confirmed the above
@clarkb:matrix.orglooking at the github connection code there are a number of debug messages that would indicate progress in setting up the app on the zuul side. I still think debug logging could be useful17:50
@nerutto:matrix.orgI value your time too Clark  I will troubleshoot it and would definitely notify you. Let me dig more for the logs as you have mentioned. :-) 17:53
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 954988: Stub provider documentation https://review.opendev.org/c/zuul/zuul/+/95498818:00

Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!