Monday, 2024-05-06

-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul] 917782: Speed up merger git resets https://review.opendev.org/c/zuul/zuul/+/91778209:56
-@gerrit:opendev.org- Andrei Dmitriev proposed: [zuul/nodepool] 916732: Add ssh-private-key to OpenStack CloudImage https://review.opendev.org/c/zuul/nodepool/+/91673211:33
-@gerrit:opendev.org- Andrei Dmitriev proposed: [zuul/nodepool] 916732: Add ssh-private-key to OpenStack CloudImage https://review.opendev.org/c/zuul/nodepool/+/91673211:37
-@gerrit:opendev.org- Andrei Dmitriev proposed: [zuul/nodepool] 916732: Add ssh-private-key to OpenStack CloudImage https://review.opendev.org/c/zuul/nodepool/+/91673211:39
-@gerrit:opendev.org- Andrei Dmitriev proposed: [zuul/nodepool] 916732: Add ssh-private-key to OpenStack CloudImage https://review.opendev.org/c/zuul/nodepool/+/91673212:04
-@gerrit:opendev.org- Andrei Dmitriev proposed: [zuul/nodepool] 916732: Add ssh-private-key to OpenStack CloudImage https://review.opendev.org/c/zuul/nodepool/+/91673212:16
-@gerrit:opendev.org- Andrei Dmitriev proposed: [zuul/nodepool] 916732: Add ssh-private-key to OpenStack CloudImage https://review.opendev.org/c/zuul/nodepool/+/91673212:31
-@gerrit:opendev.org- Andrei Dmitriev proposed: [zuul/nodepool] 916732: Add ssh-private-key to OpenStack CloudImage https://review.opendev.org/c/zuul/nodepool/+/91673213:24
-@gerrit:opendev.org- Andrei Dmitriev proposed: [zuul/nodepool] 916732: Add ssh-private-key to OpenStack CloudImage https://review.opendev.org/c/zuul/nodepool/+/91673213:40
@jpew:matrix.org`tests.unit.test_v3.TestEarlyFailure.test_pre_run_failure_retry` seems to failing somewhat consistently on Python 3.12?18:10
@clarkb:matrix.org> <@jpew:matrix.org> `tests.unit.test_v3.TestEarlyFailure.test_pre_run_failure_retry` seems to failing somewhat consistently on Python 3.12?18:24
Looking at the log on the chagne I suspect you saw this on it seems that the test job we're iterating waiting for took 34 seconds to complete but the test suite is only waiting 30 seconds before the wait and raise if timeout happens
@clarkb:matrix.orgits possible that python3.12 is making things generally slower or differences in runtime are exposing some sort of race condition that causes things to take longer18:24
@jpew:matrix.orgmmm, makes sense. Needs a longer timeout perhaps?18:25
@clarkb:matrix.orgthat might be a good quick workaround18:25
@clarkb:matrix.orgsorry it was 36 seconds18:25
@clarkb:matrix.orglooks like the jobs are doing an ansible wait_for on a file being written to. maybe we need to have that poll the file more often too18:26
@clarkb:matrix.orglooks like ansible waits 1 second between checks by default18:27
@clarkb:matrix.orgreading a bit more I'm wondering if it is never writing the flag file to let that job continue and that is why it is hitting the timeout.18:31
@clarkb:matrix.orgok I think that job that took 36 seconds is the 4th "wait" job build and we're really waiting on three pre-failure jobs to finish18:36
@clarkb:matrix.orgya my new read on this is that the third job finished up near that 30 seconds limit and we got "lucky". We can probably make the looping and/or ansible a little faster but bumping the timeout is probably reasonable18:38
@clarkb:matrix.organother thought would be to configure zuul to only allow 2 retries instead of three18:40
@clarkb:matrix.orgthat should cover the same code paths in a quicker amount of time18:41
-@gerrit:opendev.org- Clark Boylan proposed: [zuul/zuul] 918338: Check pre run failure cases with only 2 retry attempts https://review.opendev.org/c/zuul/zuul/+/91833818:48
@clarkb:matrix.orgsomething like that maybe18:48
@jim:acmegating.comcurious that it's suddenly so persistent with 3.12.  there was an ansible release on apr 24, but that doesn't quite line up.18:54
-@gerrit:opendev.org- Zuul merged on behalf of Joshua Watt: [zuul/zuul] 914818: gerrit: Add `approval-change` trigger https://review.opendev.org/c/zuul/zuul/+/91481819:33
-@gerrit:opendev.org- Zuul merged on behalf of Simon Westphahl: [zuul/zuul] 913314: Limit bytes when reading Ansible output https://review.opendev.org/c/zuul/zuul/+/91331420:15

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!