| -@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] 913314: Limit bytes when reading Ansible output https://review.opendev.org/c/zuul/zuul/+/913314 | 10:27 | |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 913390: Fix web dequeue of post items https://review.opendev.org/c/zuul/zuul/+/913390 | 14:40 | |
| @picog:matrix.org | Has anyone seen something like this: | 14:49 |
|---|---|---|
| ``` | ||
| TASK [fetch-subunit-output : Find stestr or testr executable] | ||
| ks-linters-node | ERROR | ||
| ks-linters-node | { | ||
| ks-linters-node | "msg": "Failed to connect to the host via ssh: Shared connection to node closed.", | ||
| ks-linters-node | "unreachable": true | ||
| ks-linters-node | } | ||
| ``` | ||
| I'm not sure if it's related but on my target node, I see the following in ssh | ||
| ``` | ||
| Unable to negotiate with 10.89.0.138 port 57514: no matching host key type found. Their offer: ecdsa-sha2-nistp384,ecdsa-sha2-nistp384-cert-v01@openssh.com [preauth] | ||
| Unable to negotiate with 10.89.0.138 port 57522: no matching host key type found. Their offer: ecdsa-sha2-nistp521,ecdsa-sha2-nistp521-cert-v01@openssh.com [preauth] | ||
| ``` | ||
| seems to be nodepool-launcher. | 00:02 | |
| @clarkb:matrix.org | That may just be ssh host key scanning. Nodepool won't try to ssh all the way in but it does do host key scanning and I think that works by asking for all the potential keys some of which will fail if not present | 14:56 |
| @picog:matrix.org | Ah okay, thanks. | 14:56 |
| @clarkb:matrix.org | Connection closed error implies some sort of network problem I think. | 14:58 |
| @picog:matrix.org | Is this the right script that is failing? | 14:58 |
| https://opendev.org/zuul/zuul-jobs/src/commit/984147663cd7251a837aeb53888fde2505d4f297/roles/fetch-subunit-output/files/find-testr.sh | ||
| @clarkb:matrix.org | Ansible keeps a connection open long term and when it goes to run the next task finds that it is closed unexpectedly | 14:59 |
| @clarkb:matrix.org | I don't think it gets far enough to even start running that script | 14:59 |
| @picog:matrix.org | The linting job itself seems to work just fine though | 15:00 |
| @picog:matrix.org | This is in post | 15:00 |
| @picog:matrix.org | * This is in post that it fails | 15:00 |
| @clarkb:matrix.org | Is there a firewall that might be closing idle connections in your environment? You may work around that by setting keepalives which I think are supported | 15:00 |
| @clarkb:matrix.org | Ya I suspect it has to do with a period of idle time on the connection. You job may not have those circumstances but the post playbook does | 15:01 |
| @picog:matrix.org | Okay, let me check for anything like that | 15:01 |
| @picog:matrix.org | I'm not too familiar with selinux, but what are these strange flags that ansible is adding to my authorized_keys: | 15:38 |
| I have a feeling that is the problem: | ||
| ``` | ||
| ls -Zl /var/lib/containers/storage/volumes/zuul_nodessh/_data | ||
| -rw-------. 1 root root system_u:object_r:container_file_t:s0:c70,c1017 2276 Mar 15 17:24 authorized_keys | ||
| ``` | ||
| With those flags set, I can't cat my own authorized_keys from the container. | ||
| @picog:matrix.org | I think it's the add-build-sshkey task that is doing that. | 15:42 |
| @clarkb:matrix.org | selinux flags files and processes and you have to match up in order to access the files | 15:46 |
| @picog:matrix.org | I've set it to permissive on the host to try simplify things for now. | 15:51 |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 913421: Replace status_url with item_url in pipeline reporter templates https://review.opendev.org/c/zuul/zuul/+/913421 | 16:12 | |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 913434: Use NodesetNotFoundError class https://review.opendev.org/c/zuul/zuul/+/913434 | 17:10 | |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 913435: Use ProjectNotFoundError https://review.opendev.org/c/zuul/zuul/+/913435 | 17:25 | |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 913435: Use ProjectNotFoundError https://review.opendev.org/c/zuul/zuul/+/913435 | 17:48 | |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: | 18:27 | |
| - [zuul/zuul] 913434: Use NodesetNotFoundError class https://review.opendev.org/c/zuul/zuul/+/913434 | ||
| - [zuul/zuul] 913435: Use ProjectNotFoundError https://review.opendev.org/c/zuul/zuul/+/913435 | ||
| @clarkb:matrix.org | corvus: there are some small testing issues in ^ still (I think two tests need fixing in the parent and two in the child) | 21:52 |
| @clarkb:matrix.org | basically checking raises vaules and string error contents that no longer line up | 21:52 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!