Monday, 2022-09-19

*** rlandy is now known as rlandy|out01:27
*** akahat is now known as akahat|ruck04:37
*** ysandeep|away is now known as ysandeep04:49
*** jpena|off is now known as jpena07:34
*** ysandeep is now known as ysandeep|lunch08:22
*** ysandeep|lunch is now known as ysandeep09:00
*** rlandy|out is now known as rlandy|rover10:20
*** anbanerj is now known as frenzyfriday10:26
*** ysandeep is now known as ysandeep|afk10:34
opendevreviewAnanya proposed openstack/ci-log-processing master: Adding overcloud_deploy.log.txt.gz to the list of files downloaded by logscraper  https://review.opendev.org/c/openstack/ci-log-processing/+/85830612:00
*** ysandeep|afk is now known as ysandeep12:03
opendevreviewJeremy Stanley proposed openstack/project-config master: Move queues from pipeline to project level  https://review.opendev.org/c/openstack/project-config/+/85830712:19
opendevreviewJeremy Stanley proposed openstack/project-config master: Move queues from pipeline to project level  https://review.opendev.org/c/openstack/project-config/+/85830712:33
opendevreviewMerged openstack/project-config master: Move queues from pipeline to project level  https://review.opendev.org/c/openstack/project-config/+/85830712:51
opendevreviewLukas Piwowarski proposed openstack/ci-log-processing master: WIP: Add index with individual test results  https://review.opendev.org/c/openstack/ci-log-processing/+/85837313:01
opendevreviewDr. Jens Harbott proposed openstack/devstack-gate master: [CI] Move queue setting to project level  https://review.opendev.org/c/openstack/devstack-gate/+/85837613:09
*** soniya is now known as soniya|afk13:11
*** prometheanfire is now known as Guest93113:29
*** Guest772 is now known as dasm13:30
-opendevstatus- NOTICE: As of the weekend, Zuul only supports queue declarations at the project level; if expected jobs aren't running, see this announcement: https://lists.opendev.org/pipermail/service-announce/2022-September/000044.html13:38
eolivarehi anybody knows why these jobs started failing due to NODE_FAILURE recently?13:48
eolivarehttps://zuul.opendev.org/t/openstack/builds?project=x%2Ftobiko&result=NODE_FAILURE&skip=013:48
fungieolivare: looks like those may all use nodesets relying on "nestedvirt" labels, so it's possible we're having trouble satisfying those node requests (only a subset of our providers support them)13:56
eolivareslaweq, ^^ maybe we should configure tobiko-infrared and tobiko-infrared-fedora as non-voting temporarily?13:58
slaweqeolivare yes, we can probably do that to unblock our gate13:59
fungiit does look like we're intermittently failing to satisfy the node requests for those, it's not consistent: https://zuul.opendev.org/t/openstack/builds?job_name=tobiko-infrared-fedora&project=x/tobiko14:03
eolivarefungi, slaweq this is the nodeset used by the jobs failing since Saturday: https://opendev.org/x/tobiko/src/branch/master/zuul.d/infrared.yaml#L12214:37
eolivarefedora-36 nodes14:37
fungieolivare: but intermittently? so it's not that we're completely failing to boot those images i guess14:41
eolivarefungi, https://zuul.opendev.org/t/openstack/builds?job_name=tobiko-infrared&job_name=tobiko-infrared-fedora&project=x%252Ftobiko&skip=014:42
eolivare3 pass vs 4 fail today14:43
fungicurrently we have 3 fedora-36 nodes in use in iweb-mtl01 and one that's been in a ready state there for a few days14:44
fungiwait, no, those are in a building state, not in use14:44
fungii've deleted the days-old ready node so that it doesn't confuse things (no idea why it wasn't getting used by any jobs)14:46
fungiyeah, looks like we're seeing failures to boot fedora-36 at least in iweb-mtl0114:46
fungiit's trying to boot one in inmotion-iad3 now14:47
eolivarefungi++ thanks, I'll recheck my patch14:47
fungithe one in inmotion-iad3 went ready pretty quickly14:47
fungiseems like it may be that we're having trouble booting recent fedora-36 images in some providers but not others14:48
*** ysandeep is now known as ysandeep|dinner14:58
fungiyeah, saw a boot failure for one in rax-ord now14:58
opendevreviewJeremy Stanley proposed openstack/project-config master: Add missing fedora-36 label to nl01  https://review.opendev.org/c/openstack/project-config/+/85839715:07
fungieolivare: slaweq: i think that ^ should help, but may not the the only problem15:07
eolivarefungi, ack15:09
clarkbfedora-36 was going to drop bios support iirc. But then everyone said "but cloud" and they didn't make that change15:11
clarkbBut it makes me wonder if some other similar change did end up goingthrough that broke us.15:12
fungipossible. once 858397 rolls out and the noise level from that is reduced, i'll see if i can spot more problems15:15
*** dulek_ is now known as dulek15:28
opendevreviewMerged openstack/project-config master: Add missing fedora-36 label to nl01  https://review.opendev.org/c/openstack/project-config/+/85839715:38
*** ysandeep|dinner is now known as ysandeep16:02
*** ysandeep is now known as ysandeep|out16:03
*** jpena is now known as jpena|off16:28
*** dasm is now known as dasm|off22:00
*** rlandy|rover is now known as rlandy|out22:50

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!