| @g_gobi:matrix.org | Hi, | 00:49 |
|---|---|---|
| When I run the below command | ||
| `zuul-client --zuul-url http://<host-dns>:80 dequeue --tenant My-stage --pipeline check-stage --project zuul/project1 --change 62,d0e1566e1a2742c2830136c8e1f473bd330c3120` | ||
| It says: | ||
| `requests.exceptions.ConnectionError: HTTPConnectionPool(host='<dns-name>', port=80): Max retries exceeded with url: /api/info (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f10c069ad10>: Failed to establish a new connection: [Errno 111] Connection refused'))` | ||
| But I can able to run `curl -X GET "http://<zuul-dns>:80/api/tenant/My-stage/builds"` | ||
| @g_gobi:matrix.org | Can someone help me in this? | 00:50 |
| @g_gobi:matrix.org | I tried to create auth-token tried with it says | 00:52 |
| `ERROR - Failed with the following exception: Invalid URL 'api/info': No scheme supplied. Perhaps you meant https://api/info?` | ||
| @g_gobi:matrix.org | * I tried to use auth-token then it says | 00:52 |
| `ERROR - Failed with the following exception: Invalid URL 'api/info': No scheme supplied. Perhaps you meant https://api/info?` | ||
| @g_gobi:matrix.org | * I tried to use auth-token but it says same error msg. | 00:57 |
| @g_gobi:matrix.org | * I tried to use auth-token but it says same error msg. | 00:59 |
| Then I tried with zuul-admin cli it says | ||
| `requests.exceptions.ConnectionError: HTTPConnectionPool(host='<dns-name>', port=80): Max retries exceeded with url: /api/tenant/My-stage/project/zuul/project1/dequeue (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fad90408c90>: Failed to establish a new connection: [Errno 111] Connection refused'))` | ||
| @mhuin:matrix.org | @tdlaw are you running zuul-client in a container? if so is that dns name known in the context of the container? | 03:57 |
| @g_gobi:matrix.org | Good catch. I'm using the same DNS name for my zk. So, it tried to connect to the zk instead of the server DNS. Thanks mhu | 04:18 |
| @g_gobi:matrix.org | For running zk with cert, I used zuul-server DNS as the hostname for zk. That caused the issue. | 04:20 |
| -@gerrit:opendev.org- Tobias Urdin proposed: | 09:21 | |
| - [zuul/zuul] 877587: web: add dark mode https://review.opendev.org/c/zuul/zuul/+/877587 | ||
| - [zuul/zuul] 877588: web: move Nodes page to react-table https://review.opendev.org/c/zuul/zuul/+/877588 | ||
| - [zuul/zuul] 877589: web: move Labels page to react-table https://review.opendev.org/c/zuul/zuul/+/877589 | ||
| - [zuul/zuul] 877590: web: move Projects page to react-table https://review.opendev.org/c/zuul/zuul/+/877590 | ||
| - [zuul/zuul] 877591: web: optimize Jobs page for dark mode https://review.opendev.org/c/zuul/zuul/+/877591 | ||
| - [zuul/zuul] 877592: web: fix css for timezone when dark mode https://review.opendev.org/c/zuul/zuul/+/877592 | ||
| - [zuul/zuul] 877593: web: fix config modal dialog when dark mode https://review.opendev.org/c/zuul/zuul/+/877593 | ||
| - [zuul/zuul] 877594: web: fix dark mode for swagger https://review.opendev.org/c/zuul/zuul/+/877594 | ||
| - [zuul/zuul] 877595: web: fix project page for dark mode https://review.opendev.org/c/zuul/zuul/+/877595 | ||
| - [zuul/zuul] 877596: web: fix job page for dark mode https://review.opendev.org/c/zuul/zuul/+/877596 | ||
| - [zuul/zuul] 877597: web: fix autohold page for dark mode https://review.opendev.org/c/zuul/zuul/+/877597 | ||
| - [zuul/zuul] 877598: web: fix semaphore page for dark mode https://review.opendev.org/c/zuul/zuul/+/877598 | ||
| - [zuul/zuul] 877599: web: fix build and buildoutput pages for dark mode https://review.opendev.org/c/zuul/zuul/+/877599 | ||
| @tobias-urdin:matrix.org | ^ after having done a lot of work shifts recently I decided to fix a dark mode because my eyes hurts so much with all the white backgrounds, that also fixes the the projects, labels and nodes pages to use react-table (so it looks like the table on the builds page) | 09:25 |
| @tobias-urdin:matrix.org | tested that with the opendev zuul api and looks pretty ok, i can provide some screenshots or in some meeting if interesting, or testing locally with yarn build && yarn start:openstack | 09:25 |
| @mhuin:matrix.org | Tobias Urdin: sounds cool, I think the CI generates sites with opendev and openstack as artifacts, so we should be able to test it out easily | 09:29 |
| @tobias-urdin:matrix.org | cool, let's see if tests pass :) | 09:29 |
| -@gerrit:opendev.org- Tobias Urdin proposed: [zuul/zuul] 877587: web: add dark mode https://review.opendev.org/c/zuul/zuul/+/877587 | 11:00 | |
| -@gerrit:opendev.org- Tobias Urdin proposed: [zuul/zuul] 877588: web: move Nodes page to react-table https://review.opendev.org/c/zuul/zuul/+/877588 | 11:00 | |
| -@gerrit:opendev.org- Tobias Urdin proposed: [zuul/zuul] 877588: web: move Nodes page to react-table https://review.opendev.org/c/zuul/zuul/+/877588 | 11:03 | |
| -@gerrit:opendev.org- Tobias Urdin proposed: [zuul/zuul] 877589: web: move Labels page to react-table https://review.opendev.org/c/zuul/zuul/+/877589 | 11:04 | |
| -@gerrit:opendev.org- Tobias Urdin proposed: [zuul/zuul] 877589: web: move Labels page to react-table https://review.opendev.org/c/zuul/zuul/+/877589 | 11:04 | |
| -@gerrit:opendev.org- Tobias Urdin proposed: [zuul/zuul] 877590: web: move Projects page to react-table https://review.opendev.org/c/zuul/zuul/+/877590 | 11:05 | |
| -@gerrit:opendev.org- Tobias Urdin proposed: [zuul/zuul] 877590: web: move Projects page to react-table https://review.opendev.org/c/zuul/zuul/+/877590 | 11:05 | |
| -@gerrit:opendev.org- Tobias Urdin proposed: [zuul/zuul] 877590: web: move Projects page to react-table https://review.opendev.org/c/zuul/zuul/+/877590 | 11:06 | |
| -@gerrit:opendev.org- Tobias Urdin proposed: [zuul/zuul] 877591: web: optimize Jobs page for dark mode https://review.opendev.org/c/zuul/zuul/+/877591 | 11:07 | |
| -@gerrit:opendev.org- Tobias Urdin proposed: [zuul/zuul] 877592: web: fix css for timezone when dark mode https://review.opendev.org/c/zuul/zuul/+/877592 | 11:07 | |
| -@gerrit:opendev.org- Tobias Urdin proposed: [zuul/zuul] 877593: web: fix config modal dialog when dark mode https://review.opendev.org/c/zuul/zuul/+/877593 | 11:07 | |
| -@gerrit:opendev.org- Tobias Urdin proposed: [zuul/zuul] 877594: web: fix dark mode for swagger https://review.opendev.org/c/zuul/zuul/+/877594 | 11:07 | |
| -@gerrit:opendev.org- Tobias Urdin proposed: [zuul/zuul] 877595: web: fix project page for dark mode https://review.opendev.org/c/zuul/zuul/+/877595 | 11:07 | |
| -@gerrit:opendev.org- Tobias Urdin proposed: [zuul/zuul] 877595: web: fix project page for dark mode https://review.opendev.org/c/zuul/zuul/+/877595 | 11:08 | |
| -@gerrit:opendev.org- Tobias Urdin proposed: [zuul/zuul] 877596: web: fix job page for dark mode https://review.opendev.org/c/zuul/zuul/+/877596 | 11:08 | |
| -@gerrit:opendev.org- Tobias Urdin proposed: | 11:09 | |
| - [zuul/zuul] 877597: web: fix autohold page for dark mode https://review.opendev.org/c/zuul/zuul/+/877597 | ||
| - [zuul/zuul] 877598: web: fix semaphore page for dark mode https://review.opendev.org/c/zuul/zuul/+/877598 | ||
| -@gerrit:opendev.org- Tobias Urdin proposed: [zuul/zuul] 877599: web: fix build and buildoutput pages for dark mode https://review.opendev.org/c/zuul/zuul/+/877599 | 11:09 | |
| @newbie23:matrix.org | Hello guys, I am debugging a Zuul setup with Zuul CI + GitHub. | 14:04 |
| I have untrusted project A and A-config. | ||
| Project template for A is defined in A-config. | ||
| I have a protected branch "foo" defined for both repos. | ||
| Pipeline and jobs are triggered for A-config, but for A no jobs are found. | ||
| From the schedulre logs, it seems when the scheduler freezes the job graph it cannot find the project template because it does not even consider A-config@foo as an implied branch (no ImpliedBranchMatcher:ImpliedBranchMatcher:foo in the logs). | ||
| Any clues about that is going on or where could I have a look into? | ||
| @fungicide:matrix.org | make sure zuul is configured to use the intended branch of your config project, it uses the default branch of the repository by default unless told otherwise, i think (though i don't run a zuul that ingests configuration through the github driver so not sure if projecting branches changes that mechanism for github specifically) | 14:25 |
| @fungicide:matrix.org | newbie23: https://zuul-ci.org/docs/zuul/latest/project-config.html#configuration-loading "The config project branch can be configured with the tenant configuration tenant.config-projects.<project>.load-branch attribute." | 14:26 |
| @fungicide:matrix.org | basically, if your config project in github has a default branch named `main` and you put your configuration in that branch, zuul will find it without additional configuring. if you use a non-default branch to contain the configuration then you need to tell zuul which one you intended to use. this is specific to config projects, zuul only uses one branch of a config project to load configuration even if that config project has multiple branches (unlike the behavior with reading configuration from untrusted project branches) | 14:30 |
| @fungicide:matrix.org | newbie23: also, if you continue to run into trouble, you can find companies listed at https://zuul-ci.org/start offering introductory training and similar services | 14:32 |
| @newbie23:matrix.org | Thanks! But in my case are both untrusted projects | 14:35 |
| @fungicide:matrix.org | ah, i misunderstood what you meant by "I have untrusted project A and A-config." (typically a project with a name like A-config would imply a trusted config project, so i thought you meant only project A was untrusted) | 14:36 |
| @fungicide:matrix.org | you'll want to create a trusted config project to contain at least your base job definition, or use A-config as a trusted config project | 14:37 |
| @fungicide:matrix.org | seems like you probably already have a trusted config project somewhere though, if jobs are being triggered, so i guess you have more than just the two projects you listed? | 14:41 |
| @newbie23:matrix.org | My bad a I did not give enough context :) | 14:41 |
| There is also a trusted config project and everything(TM) works. | ||
| I am trying to understand why how the Zuul scheduler learn about a specific (protected) branch to find out why [untrusted]A-config@foo protected branch is not considered as implied branch when a pull request is targetting A@foo | ||
| @fungicide:matrix.org | that makes more sense. is it possible you have project templates applied on other branches? are there any explicit branch matchers configured? | 14:44 |
| @fungicide:matrix.org | newbie23: also per https://zuul-ci.org/docs/zuul/latest/config/project.html#project-template any implied-branch-matcher pragmas you've set can affect whether a project-template is applicable | 14:47 |
| @fungicide:matrix.org | * newbie23: also per https://zuul-ci.org/docs/zuul/latest/config/project.html#project-template any implied-branch pragmas you've set can affect whether a project-template is applicable | 14:48 |
| @fungicide:matrix.org | and just to be clear, you defined the project-template in A-config@foo and are trying to add it to the project stanza in the configuration in A@foo but zuul is giving you an error when trying to merge that pr saying that the project-template can't be found? | 14:51 |
| @newbie23:matrix.org | > that makes more sense. is it possible you have project templates applied on other branches? are there any explicit branch matchers configured? | 14:57 |
| > | ||
| yes! | ||
| > that makes more sense. is it possible you have project templates applied on other branches? are there any explicit branch matchers configured? | ||
| > | ||
| I need to carefully check this. | ||
| > and just to be clear, you defined the project-template in A-config@foo and are trying to add it to the project stanza in the configuration in A@foo | ||
| > | ||
| yes! | ||
| > but zuul is giving you an error when trying to merge that pr saying that the project-template can't be found? | ||
| > | ||
| During job freeze, Zuul scheduler does not find any jobs, and apparently did not find any protected branch (i.e. A-config@foo) having the template definition. | ||
| @fungicide:matrix.org | is is possible configuration was merged to a protected branch without zuul testing it. i.e. not through a pull request/approval gating workflow? have you checked for configuration errors in the loaded projects (a bell icon at the top-right corner of the web dashboard for that tenant)? | 14:59 |
| @fungicide:matrix.org | * is it possible configuration was merged to a protected branch without zuul testing it. i.e. not through a pull request/approval gating workflow? have you checked for configuration errors in the loaded projects (a bell icon at the top-right corner of the web dashboard for that tenant)? | 15:00 |
| @fungicide:matrix.org | during each reconfiguration zuul should also debug log any configuration loading/parsing errors in existing branches. aside from that, i'm about out of ideas. someone who uses github may have better suggestions specific to that driver | 15:06 |
| @newbie23:matrix.org | > <@fungicide:matrix.org> is it possible configuration was merged to a protected branch without zuul testing it. i.e. not through a pull request/approval gating workflow? have you checked for configuration errors in the loaded projects (a bell icon at the top-right corner of the web dashboard for that tenant)? | 15:09 |
| Unfortunately not this time :( | ||
| @newbie23:matrix.org | > <@fungicide:matrix.org> during each reconfiguration zuul should also debug log any configuration loading/parsing errors in existing branches. aside from that, i'm about out of ideas. someone who uses github may have better suggestions specific to that driver | 15:10 |
| Thanks for the explanations and ideas! You are right, I should try to see in the logs if I can spot any problems. | ||
| In general do you know how the scheduler learns about the repos/projects and parse the configuration? | ||
| Is the executor involved in some way? (I will also look into the code) | ||
| @fungicide:matrix.org | the projects have to be listed in the tenant configuration, and then at reconfiguration zuul schedulers load configuration from all appropriate branches in each of those projects | 15:12 |
| @fungicide:matrix.org | also when adding projects to the tenant config, it's possible to exclude loading some or all types of configuration from them (pipelines, jobs, et cetera) with additional parameters in each project entry in the tenant | 15:13 |
| @fungicide:matrix.org | technically i think the tenant config can also be a dynamic script which gets run to generate the actual tenant configuration, and tenant configuration can also add projects by pattern matches rather than by their full names. checking the docs to make sure i've got that correct | 15:14 |
| @newbie23:matrix.org | > <@fungicide:matrix.org> technically i think the tenant config can also be a dynamic script which gets run to generate the actual tenant configuration, and tenant configuration can also add projects by pattern matches rather than by their full names. checking the docs to make sure i've got that correct | 15:15 |
| this is interesting! | ||
| @newbie23:matrix.org | Thank you fungi for all your help, I guess I am going to dig into the configs/code :) | 15:15 |
| @fungicide:matrix.org | newbie23: i remembered correctly about tenant configuration possibly being dynamically generated by referring to an executable instead of a static yaml file, though i don't see confirmation that project names can be wildcarded or similarly pattern-matched there (though regular expressions are allowed for matching some kinds of things for projects): https://zuul-ci.org/docs/zuul/latest/tenants.html#tenant-config | 15:19 |
| @fungicide:matrix.org | but anyway, that should give you somewhere to start | 15:19 |
| -@gerrit:opendev.org- Antoine Musso proposed: [zuul/zuul-jobs] 877700: Remove ignored success-url job attribute https://review.opendev.org/c/zuul/zuul-jobs/+/877700 | 16:52 | |
| @g_gobi:matrix.org | Hi, | 17:22 |
| I'm facing the below issue | ||
| ``Failed to import the required Python library (Docker SDK for Python: docker above 5.0.0 (Python >= 3.6) or docker before 5.0.0 (Python 2.7) or docker-py (Python 2.6)) on cisystem's Python /usr/bin/python3. Please read the module documentation and install it in the appropriate location. If the required library is installed, but Ansible is using the wrong Python interpreter, please consult the documentation on ansible_python_interpreter, for example via `pip install docker` (Python >= 3.6) or `pip install docker==4.4.4` (Python 2.7) or `pip install docker-py` (Python 2.6). The error was: No module named 'docker'`` | ||
| My `ansible_python_interpreter: auto` and I only have a single python version is installed in the worker | ||
| the docker pkg is available too | ||
| ``` | ||
| python3 -m pip list | grep docker | ||
| docker 6.0.1 | ||
| ``` | ||
| Am I missing something here? | ||
| @clarkb:matrix.org | > <@g_gobi:matrix.org> Hi, | 17:30 |
| > I'm facing the below issue | ||
| > ``Failed to import the required Python library (Docker SDK for Python: docker above 5.0.0 (Python >= 3.6) or docker before 5.0.0 (Python 2.7) or docker-py (Python 2.6)) on cisystem's Python /usr/bin/python3. Please read the module documentation and install it in the appropriate location. If the required library is installed, but Ansible is using the wrong Python interpreter, please consult the documentation on ansible_python_interpreter, for example via `pip install docker` (Python >= 3.6) or `pip install docker==4.4.4` (Python 2.7) or `pip install docker-py` (Python 2.6). The error was: No module named 'docker'`` | ||
| > | ||
| > My `ansible_python_interpreter: auto` and I only have a single python version is installed in the worker | ||
| > the docker pkg is available too | ||
| > ``` | ||
| > python3 -m pip list | grep docker | ||
| > docker 6.0.1 | ||
| > ``` | ||
| > Am I missing something here? | ||
| maybe double check `/usr/bin/python2 -m pip list` in case alternatives or something is running a different python3 unexpectedly? | ||
| @clarkb:matrix.org | oh nevermind the ansible docs have it | 17:31 |
| @clarkb:matrix.org | https://docs.ansible.com/ansible/latest/collections/community/docker/docsite/scenario_guide.html#requirements | 17:31 |
| @clarkb:matrix.org | you need to install the docker module in the same python env as ansible | 17:32 |
| @clarkb:matrix.org | not the remote host | 17:32 |
| @clarkb:matrix.org | maybe that is the mixup? | 17:32 |
| @g_gobi:matrix.org | `/usr/bin/python2: No such file or directory` | 17:32 |
| ``` | ||
| $ python | ||
| python3 python3-config python3.10 python3.10-config | ||
| ``` | ||
| @g_gobi:matrix.org | I'm using the `docker_container` ansible module. To remove the containers in remote-host (worker). | 17:34 |
| @clarkb:matrix.org | yes, and the python docker module needs to be installed where you are executing `ansible-playbook` assuming this is zuul then you need to ensure it gets installed into the virtualenvs zuul installs ansible to. There is a way to do that via the install tool (you set an env var or write out extra deps to some file iirc) | 17:35 |
| @g_gobi:matrix.org | You mean docker module needs to be installed in **zuul-executer** container too? | 17:37 |
| @clarkb:matrix.org | `zuul-manage-ansible` is the command. `ANSIBLE_EXTRA_PACKAGES` is the env var to set with extra things to install to those venvs when you run the command | 17:37 |
| @clarkb:matrix.org | > <@g_gobi:matrix.org> You mean docker module needs to be installed in **zuul-executer** container too? | 17:38 |
| That is how I read the docs I linked to. It says you need to install the python docker library where you execute `ansible-playbook` | ||
| @g_gobi:matrix.org | If possible could you please share the doc link? | 17:48 |
| @g_gobi:matrix.org | Noticed docker pkg was not available in the root user. I installed it with the root user. I'll let you know if it works. | 17:53 |
| @clarkb:matrix.org | tdlaw: https://docs.ansible.com/ansible/latest/collections/community/docker/docsite/scenario_guide.html#requirements I posted it above too | 17:54 |
| @fungicide:matrix.org | tdlaw: and if you meant the related zuul documentation, https://zuul-ci.org/docs/zuul/latest/installation.html#executor-deployment covers the zuul-manage-ansible command on the executors | 18:06 |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/nodepool] 877707: Fix exception in cache update https://review.opendev.org/c/zuul/nodepool/+/877707 | 18:38 | |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/nodepool] 877708: DNM: extra cache debugging https://review.opendev.org/c/zuul/nodepool/+/877708 | 18:41 | |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/nodepool] 877708: DNM: extra cache debugging https://review.opendev.org/c/zuul/nodepool/+/877708 | 18:55 | |
| -@gerrit:opendev.org- Tobias Urdin proposed: [zuul/zuul] 877588: web: move Nodes page to react-table https://review.opendev.org/c/zuul/zuul/+/877588 | 20:14 | |
| -@gerrit:opendev.org- Tobias Urdin proposed: [zuul/zuul] 877589: web: move Labels page to react-table https://review.opendev.org/c/zuul/zuul/+/877589 | 20:15 | |
| -@gerrit:opendev.org- Tobias Urdin proposed: [zuul/zuul] 877590: web: move Projects page to react-table https://review.opendev.org/c/zuul/zuul/+/877590 | 20:15 | |
| -@gerrit:opendev.org- Tobias Urdin proposed: [zuul/zuul] 877591: web: optimize Jobs page for dark mode https://review.opendev.org/c/zuul/zuul/+/877591 | 20:15 | |
| -@gerrit:opendev.org- Tobias Urdin proposed: [zuul/zuul] 877592: web: fix css for timezone when dark mode https://review.opendev.org/c/zuul/zuul/+/877592 | 20:16 | |
| -@gerrit:opendev.org- Tobias Urdin proposed: [zuul/zuul] 877593: web: fix config modal dialog when dark mode https://review.opendev.org/c/zuul/zuul/+/877593 | 20:16 | |
| -@gerrit:opendev.org- Tobias Urdin proposed: [zuul/zuul] 877594: web: fix dark mode for swagger https://review.opendev.org/c/zuul/zuul/+/877594 | 20:16 | |
| -@gerrit:opendev.org- Tobias Urdin proposed: [zuul/zuul] 877595: web: fix project page for dark mode https://review.opendev.org/c/zuul/zuul/+/877595 | 20:16 | |
| -@gerrit:opendev.org- Tobias Urdin proposed: [zuul/zuul] 877596: web: fix job page for dark mode https://review.opendev.org/c/zuul/zuul/+/877596 | 20:17 | |
| -@gerrit:opendev.org- Tobias Urdin proposed: [zuul/zuul] 877597: web: fix autohold page for dark mode https://review.opendev.org/c/zuul/zuul/+/877597 | 20:17 | |
| -@gerrit:opendev.org- Tobias Urdin proposed: [zuul/zuul] 877598: web: fix semaphore page for dark mode https://review.opendev.org/c/zuul/zuul/+/877598 | 20:17 | |
| -@gerrit:opendev.org- Tobias Urdin proposed: [zuul/zuul] 877599: web: fix build and buildoutput pages for dark mode https://review.opendev.org/c/zuul/zuul/+/877599 | 20:18 | |
| -@gerrit:opendev.org- Tobias Urdin proposed: [zuul/zuul] 877599: web: fix build and buildoutput pages for dark mode https://review.opendev.org/c/zuul/zuul/+/877599 | 20:21 | |
| @jim:acmegating.com | zuul-maint: does anyone happen to know if we or someone we know owns the zuul namespace on quay.io? | 20:27 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!