Monday, 2022-05-02

-@gerrit:opendev.org- Benjamin Schanzel proposed: [zuul/nodepool] 839514: Default limits for k8s labels and quota support https://review.opendev.org/c/zuul/nodepool/+/83951407:36
-@gerrit:opendev.org- Dominik Jaeger proposed: [zuul/zuul] 828125: Add support for filesets in job configuration https://review.opendev.org/c/zuul/zuul/+/82812508:33
-@gerrit:opendev.org- Benjamin Schanzel proposed: [zuul/nodepool] 839514: Default limits for k8s labels and quota support https://review.opendev.org/c/zuul/nodepool/+/83951409:35
-@gerrit:opendev.org- Dominik Jaeger proposed: [zuul/zuul] 828125: Add support for filesets in job configuration https://review.opendev.org/c/zuul/zuul/+/82812510:32
@fungicide:matrix.org> <@mnaser:matrix.org> is there a good way of getting out of a situation where a config-project is not passing tests?12:19
in opendev, we have a gerrit administrator merge a fix bypassing zuul, but yes it's painful. that's why we adopted a testing policy for nontrivial changes to our base job: https://opendev.org/opendev/base-jobs/src/commit/d821d115975563fbb15f2c874c557303faeaec70/zuul.d/jobs.yaml#L5-L23
-@gerrit:opendev.org- Dominik Jaeger proposed: [zuul/zuul] 828125: Add support for filesets in job configuration https://review.opendev.org/c/zuul/zuul/+/82812512:55
-@gerrit:opendev.org- Joshua Watt proposed: [zuul/zuul] 838924: merger: Handle merges with cherry-pick merge-mode https://review.opendev.org/c/zuul/zuul/+/83892413:13
-@gerrit:opendev.org- Joshua Watt proposed: [zuul/zuul] 838924: merger: Handle merges with cherry-pick merge-mode https://review.opendev.org/c/zuul/zuul/+/83892413:21
@mhuin:matrix.orgHello, do components require 2-way communication with the zookeeper service? What if we'd like to run an executor in a private network with no public IP - in the sense that zk, the scheduler etc can't directly connect to the executor13:51
@jpew:matrix.orgI'd like to connect Zuul to MS Teams for reporting project build results; the easiest way I can see to do this is with the SMTP driver emailing the channel e-mail address. However, I'd like each project somehow be able to configure which e-mail address it sends results to. Is this possible somehow?13:53
@avass:vassast.orgmhu: I think that should work, but you may need to set up a https://www.zuul-ci.org/docs/zuul/latest/configuration.html#finger-gateway to get live logs working13:53
@avass:vassast.orgI may be wrong though :)13:54
@avass:vassast.orgjpew: you could create a post/cleanup playbook that reports to MS Teams with the channel/e-mail being configurable with a variable by the project13:55
@jpew:matrix.orgI was hoping to do it at the pipeline level. The SMTP driver is about perfect, except that I can't change the address per-project (that I know of)13:57
@mhuin:matrix.orgAlbin Vass: the finger gw is for streaming logs only?13:58
@avass:vassast.orgmhu: I think so, yep13:58
@mhuin:matrix.orgAlbin Vass: the thing is, the components index in zk is incorrect, the executor node in the private network appears down14:00
@mhuin:matrix.orgit's probably a matter of opening the right ports or setting up the right port forwarding, but I can't find out which one14:01
@mhuin:matrix.orgit looks like zk is polling the nodes but I can't find doc on that14:03
@avass:vassast.orgmhu: zookeeper needs to be accessible on the configured `secureClientPort` by zuul-executor at least14:09
@mhuin:matrix.orgso there's no traffic from zk to the zuul-executor?14:10
@avass:vassast.orgno zk doesn't open any connection towards the zuul-executor14:10
@avass:vassast.orgso that should only need a one way port-forward to let zuul-executor connect to zk14:10
@mhuin:matrix.orgokay, interesting ... then being in a private network shouldn't be a problem14:11
@mhuin:matrix.orgokay turns out the problem was between the chair and the keyboard 🙂 thanks for your help14:52
@fungicide:matrix.org> <@jpew:matrix.org> I was hoping to do it at the pipeline level. The SMTP driver is about perfect, except that I can't change the address per-project (that I know of)15:06
yes, the smtp reporter is per-pipeline. it would probably make more sense to make a specific reporter driver for ms teams, or i guess you could set up a fan-out gateway which processes the received smtp reports and then redelivers delivers them to more specific addresses based on other heuristics like project name (i know how i'd do that trivially in exim, but i have no idea what mta you're relying on)
@fungicide:matrix.org> <@mhuin:matrix.org> so there's no traffic from zk to the zuul-executor?15:09
for reference, while the diagram doesn't have directional indicators, the prose here is intended to describe which components are establishing connections to which other components, directionally: https://zuul-ci.org/docs/zuul/latest/components.html
@fungicide:matrix.orgthe idea is thatyou should be able to put each of those components on different networks and have sufficient information from that document to be able to write firewall rules filtering the traffic between them15:15
@clarkb:matrix.orgcorvus: fungi any idea if that netaddr issue is a problem for ansible v5? I wonder if we should encourage them to add it as a dep to v5 if so. IPv6 isn't really optional functionality if IPv4 just works15:22
@jim:acmegating.comClark: i do not know (i don't believe we exercised v5 during the time it was broken); one could probably run a test playbook in a venv to test it.15:24
@jpew:matrix.orgfungi: Ah, I can run an intermediate exim server... would you happen to have an example on how to do the fan-out?16:14
@fungicide:matrix.orgjpew: http://www.exim.org/exim-html-4.90/doc/html/spec_html/filter_ch-exim_filter_files.html16:24
@fungicide:matrix.orgthat's the way i'm most familiar with, but there are a few different ways you could go about it with exim specifically, or you could do something similar i'm sure with postfix, procmail...16:25
@fungicide:matrix.org * jpew: http://www.exim.org/exim-html-current/doc/html/spec_html/filter_ch-exim_filter_files.html16:27
@clarkb:matrix.orgcorvus: re the stack at https://review.opendev.org/c/zuul/zuul/+/839672 is that the sort of thing you'd prefer to land after v6 is tagged? Or should I go ahead and rereview and probably approve things nowish?18:16
@clarkb:matrix.orgits the no_log handling in the callback for json stuff18:16
@jim:acmegating.comClark: i think we can merge that now18:46
@clarkb:matrix.orgcorvus: cool I ended up +2'ing the stack but not +A'ing did you want to +A or shoudl I go ahead and do that?18:46
@jim:acmegating.comClark: feel free to +A, i'm about to step away for a bit18:46
@clarkb:matrix.orgdone18:47
@jim:acmegating.comi think if there are still no fires by the end of the day, we can probably tag what opendev is running as 6.0, and that will just be in a later release; if there are fires, then that will be in 6.0 :)18:47
@clarkb:matrix.orgsounds good to me18:47
@clarkb:matrix.orgcorvus: when you get back you may want ot look at https://review.opendev.org/c/zuul/zuul/+/839784 it does seem like quickstart's test2 has been forgotten? I'm not entirely sure what its purpose was/is19:00
@jim:acmegating.comClark: it's there so users have other repos to experiment with.  including cross-repo-deps.19:23
@fungicide:matrix.orgi suppose one solution would be to add a depends-on exercise to the quickstart19:40
@fungicide:matrix.orgthen it's no longer unused19:40
@fungicide:matrix.org> <@jim:acmegating.com> i think if there are still no fires by the end of the day, we can probably tag what opendev is running as 6.0, and that will just be in a later release; if there are fires, then that will be in 6.0 :)19:50
no fires yet at least! today's not a particularly heavy activity day for us, but there's still enough going on i expect we'd have spotted significant issues by now
@clarkb:matrix.orghttps://review.opendev.org/c/zuul/zuul/+/840136 is another docs update that has me confused20:08
@clarkb:matrix.orgfungi: I'm trying to determine if netaddr needs to be installed for ansible v5. Do you know what tasks were failing under 2.9 without netaddr?20:28
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed:20:34
- [zuul/nodepool] 840241: Measure rate limits from start times https://review.opendev.org/c/zuul/nodepool/+/840241
- [zuul/nodepool] 840242: Fix object refresh in the AWS adapter https://review.opendev.org/c/zuul/nodepool/+/840242
@jim:acmegating.comClark: i think i linked to a build either here or in #_oftc_#opendev:matrix.org 20:35
@clarkb:matrix.orgya grepping around I think it is the | ipv6 filter20:35
@clarkb:matrix.orgthe |ipv4 filter fails similarly and they both fail under ansible 520:36
@jim:acmegating.comClark: https://matrix.to/#/!GXiijUJAGqDLBuZqwV:matrix.org/$Txm1-EY85nujDaMdOuM-dKqDB7rPwDATIlvy9SBdNM0?via=matrix.org&via=acmegating.com&via=inaugust.com20:36
@clarkb:matrix.orghttps://docs.ansible.com/ansible/latest/user_guide/playbooks_filters_ipaddr.html is the docs for that. I personally find it odd that they wouldn't depend on that for simple useful filters like this20:37
@clarkb:matrix.orgLooks like 8MB difference between my venv without netaddr installed and with netaddr installed20:39
@clarkb:matrix.orghttps://github.com/ansible-collections/ansible.netcommon/blob/main/requirements.txt it does list its requirements so now it is extra weird to me that the combo package called ansible on pypi wouldn't do something similar20:47
@jim:acmegating.comClark: maybe time to ask dmsimard ?20:48
@jim:acmegating.com(maybe not including the collections' requirements is an oversight?)20:48
@jim:acmegating.com * (maybe not including the superset of collections' requirements is an oversight?)20:49
@clarkb:matrix.orgdmsimard: hey do you know why netaddr isn't installed when you `pip install 'ansible<6'`, but it is listed as a dependency of `ansible.netcommon` in https://github.com/ansible-collections/ansible.netcommon/blob/main/requirements.txt ? Are the various requirements of the subrepos collected together into `ansible` not also merged? does it make sense to maybe do that?20:49
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed:20:57
- [zuul/zuul] 840243: Fix node request failures in dependency cycles https://review.opendev.org/c/zuul/zuul/+/840243
- [zuul/zuul] 840244: Deduplicate jobs in dependency cycles https://review.opendev.org/c/zuul/zuul/+/840244
-@gerrit:opendev.org- lotorev vitaly proposed wip: [zuul/nodepool] 833515: Log static node info on when failed to sync node https://review.opendev.org/c/zuul/nodepool/+/83351521:22
-@gerrit:opendev.org- lotorev vitaly proposed wip: [zuul/nodepool] 833515: Log node info when failed to sync static node https://review.opendev.org/c/zuul/nodepool/+/83351521:24
-@gerrit:opendev.org- lotorev vitaly proposed wip: [zuul/nodepool] 833515: Log node info when failing to sync static node https://review.opendev.org/c/zuul/nodepool/+/83351521:28
-@gerrit:opendev.org- lotorev vitaly marked as active: [zuul/nodepool] 833515: Log node info when failing to sync static node https://review.opendev.org/c/zuul/nodepool/+/83351521:34
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 840246: Add a spec for global semaphores https://review.opendev.org/c/zuul/zuul/+/84024621:34
@clarkb:matrix.org> <@clarkb:matrix.org> dmsimard: hey do you know why netaddr isn't installed when you `pip install 'ansible<6'`, but it is listed as a dependency of `ansible.netcommon` in https://github.com/ansible-collections/ansible.netcommon/blob/main/requirements.txt ? Are the various requirements of the subrepos collected together into `ansible` not also merged? does it make sense to maybe do that?22:16
hrm the ipv4 and ipv6 filters may actually live in this collection: https://github.com/ansible-collections/ansible.utils/blob/main/requirements.txt but it lists netaddr too
@jim:acmegating.comzuul-maint: how do these look for releases:22:34
zuul: commit a89ce345c0fb5fb304713b0b0aa8097312be59f5 (HEAD -> master, tag: 6.0.0, origin/master, gerrit/master, refs/changes/55/840055/1)
nodepool: commit a2e5e640ad13b5bf3e7322eb3b62005484e21765 (HEAD -> master, tag: 6.0.0, origin/master, gerrit/master)
(if those look good, i'll cut them during my morning tomorrow)
@clarkb:matrix.orgcorvus: did nodepool get restarted on that in opendev? If not do we think that is necessary?22:35
@clarkb:matrix.orgcorvus: the zuul commit lgtm though22:36
@clarkb:matrix.orgcorvus: looks like opendev launchers last restarted about 8 weeks ago so I don't think they are running that nodepool commit which is more recent22:37
@jim:acmegating.comClark: oh, i thought they were getting restarted for the jammy work22:42
@clarkb:matrix.orgcorvus: only the builders22:42
@jim:acmegating.commm hmm.22:42
@clarkb:matrix.orgits possible that the builders are the only things that got updates too (the builders automatically restart but not the launchers)22:42
@jim:acmegating.comwell, i guess i'll restart them now.22:42
@clarkb:matrix.orgwfm22:42

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!