Tuesday, 2023-09-05

-@gerrit:opendev.org- Zuul merged on behalf of Simon Westphahl: [zuul/zuul] 893598: Ignore missing nodes in lost-request iterator https://review.opendev.org/c/zuul/zuul/+/89359806:10
-@gerrit:opendev.org- Zuul merged on behalf of Benjamin Schanzel: [zuul/zuul] 879542: Fix zk host env var for tests https://review.opendev.org/c/zuul/zuul/+/87954212:52
-@gerrit:opendev.org- Zuul merged on behalf of Moritz Haase: [zuul/zuul-jobs] 871822: roles/ensure-python: Fix 'python_use_stow' option https://review.opendev.org/c/zuul/zuul-jobs/+/87182214:53
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul-sphinx] 893800: Update autojob to handle branch regexes https://review.opendev.org/c/zuul/zuul-sphinx/+/89380018:05
@jim:acmegating.comzuul-maint: ^ something like that is needed to handle the new re2 changes.  (see https://zuul.opendev.org/t/openstack/build/34639816118f4ea8aaadf6166f5cfcb7 for an example of a failure i expect that to fix)18:06
@clarkb:matrix.orgack18:07
@jim:acmegating.comalso, i totally blorped that change, 1 sec18:08
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul-sphinx] 893800: Update autojob to handle branch regexes https://review.opendev.org/c/zuul/zuul-sphinx/+/89380018:09
@jim:acmegating.comthat's what i meant to type ^18:09
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul-sphinx] 893800: Update autojob to handle branch regexes https://review.opendev.org/c/zuul/zuul-sphinx/+/89380018:30
@jim:acmegating.comzuul-maint: how does this release look for zuul-sphinx? commit f51dd26d25eea55a0c1b0ff016652d8324263434 (HEAD -> master, tag: 0.7.0, origin/master, origin/HEAD, refs/changes/00/893800/2)19:05
@clarkb:matrix.orgcorvus: fungi I'm helping someone with disk image builder problems today and I'm entertaining the possibility that newer mkfs.ext4 tooling might produce filesystems that older grub (like for focal or bionic) cannot understand19:37
@clarkb:matrix.orgwe may want to pull on that a bit more to understand it before updating nodepool to bookworm images in case bookworm's ext4 mkfs defaults are a problem for older grub19:37
@jim:acmegating.comClark: https://zuul.opendev.org/t/zuul/job/nodepool-functional-container-openstack-release  something like that job i think may be useful19:55
@fungicide:matrix.orglooking at the monitoring doc, i notice that there's some (small) overlap between statsd and prometheus metrics. does anyone know of ongoing work to expose more of the statsd data for prometheus? or is that architecturally hard (pull vs push, et cetera)20:14
@mhuin:matrix.org@fungi: you can use the statsd exporter to convert statsd metrics to prometheus20:14
@mhuin:matrix.orgmaybe the doc could include an howto to do that, unless it's out of scope20:15
@fungicide:matrix.orgyeah, i guess that would mean running a separate service to receive statsd emissions and communicate with prometheus as a sort of protocol proxy?20:15
@mhuin:matrix.orgI think we do so with Software Factory, so I can look into how we configured the service20:16
@mhuin:matrix.orgif you're interested20:16
@fungicide:matrix.orgi was less wondering about current workarounds, and more about whether there was any current work on parity between statsd and prometheus support in zuul (and any known challenges)20:17
@jim:acmegating.comthere is one particularly hard thing to do with prometheus, and that's dealing with the cardinality of the job data that we export via statsd.  most prometheus exporter configurations reduce that to a manageable level20:17
@tristanc_:matrix.orgfungi: I remember trying to expose more of the statsd data in prometheus using labels for per project/job metric, but that was not practical because the /metric endpoints response got really big. The statsd model of fire and forget is better suited for such data.20:18
@jim:acmegating.comthat's the main blocker for just switching everything over.20:18
@fungicide:matrix.orgthe fact that there's a little overlap in the metrics for zuul-web gives the impression further parity is a potential option in the future, hence the question20:18
@fungicide:matrix.orgmakes sense, so basically zuul sends things via statsd that prometheus on its own would have a hard time digesting20:19
-@gerrit:opendev.org- Clark Boylan proposed: [zuul/nodepool] 893806: DNM Test if bookworm mkfs works with older grub https://review.opendev.org/c/zuul/nodepool/+/89380620:46
-@gerrit:opendev.org- Joshua Watt proposed: [zuul/nodepool] 891635: Add option to decline node request based on quota https://review.opendev.org/c/zuul/nodepool/+/89163520:54
@jpew:matrix.orgOk. I figured out how to do ^^ so that https://review.opendev.org/c/zuul/nodepool/+/892337 was unnecessary20:54
@clarkb:matrix.orgcorvus: fungi https://zuul.opendev.org/t/zuul/build/4ffd63fc90be45c9985ae7cedfc6f6cb/log/nodepool/builds/test-image-4e8bb52c10e44bc0a1c04c8164b1f402.log#4895-4897 makes me fairly confident that bookworm mkfs.ext4 is fine for building focal22:09
@fungicide:matrix.orgexcellent22:11
@clarkb:matrix.orgit would've complained about unknown fielsystem there and failed if there was an issue22:13
@jim:acmegating.comClark: cool; and that test setup lgtm.22:19
@jim:acmegating.comshould we go ahead and merge the bookworm updates?22:19
@clarkb:matrix.orgI'm good with that. Though I am about to pop out so can't help watch nodepool if it lands immediately22:23
@clarkb:matrix.orgzuul won't deploy in opendev until the weekend22:23
@jim:acmegating.commaybe let's do that tomorrow then22:24
@clarkb:matrix.orgsounds good22:24
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed:23:11
- [zuul/nodepool] 893811: Optimize order of operation in cleanupNodes https://review.opendev.org/c/zuul/nodepool/+/893811
- [zuul/nodepool] 893812: AWS: handle 'InvalidConversionTaskId.Malformed' error https://review.opendev.org/c/zuul/nodepool/+/893812

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!