Tuesday, 2022-02-08

-@gerrit:opendev.org- Ian Wienand proposed: [zuul/zuul-jobs] 798969: Add introduction to the container jobs documentation https://review.opendev.org/c/zuul/zuul-jobs/+/79896900:06
@iwienand:matrix.orgclarkb: ^ as discussed00:06
-@gerrit:opendev.org- Felix Edel proposed:06:42
- [zuul/zuul] 827299: Fix hanging MySQL database tests https://review.opendev.org/c/zuul/zuul/+/827299
- [zuul/zuul] 827215: Report NODE_FAILURES caused by node request failures to SQL database https://review.opendev.org/c/zuul/zuul/+/827215
@felixedel:matrix.orgClark:  Thanks, I've updated the patches06:44
-@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] 828224: Fix leaked semaphore cleanup https://review.opendev.org/c/zuul/zuul/+/82822407:16
-@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] 828224: Fix leaked semaphore cleanup https://review.opendev.org/c/zuul/zuul/+/82822407:18
-@gerrit:opendev.org- Dominik Jaeger proposed: [zuul/zuul] 828125: Add support for filesets in job configuration https://review.opendev.org/c/zuul/zuul/+/82812508:23
-@gerrit:opendev.org- Zuul merged on behalf of Alfredo Moralejo: [zuul/zuul-jobs] 827529: Make CentOS9 jobs voting https://review.opendev.org/c/zuul/zuul-jobs/+/82752909:19
-@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] 828098: Don't add changes already in superceding pipeline https://review.opendev.org/c/zuul/zuul/+/82809809:24
-@gerrit:opendev.org- Felix Edel proposed: [zuul/zuul] 828264: Ignore events without data in node cache update https://review.opendev.org/c/zuul/zuul/+/82826409:50
-@gerrit:opendev.org- Felix Edel proposed: [zuul/zuul] 828268: Ignore KeyErrors in node cache listener deleted events https://review.opendev.org/c/zuul/zuul/+/82826810:10
-@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] 828288: Avoid data races when dequeueing superceded items https://review.opendev.org/c/zuul/zuul/+/82828812:04
-@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] 828288: Avoid data races when dequeueing superceded items https://review.opendev.org/c/zuul/zuul/+/82828812:07
-@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] 828288: Avoid data races when dequeueing superceded items https://review.opendev.org/c/zuul/zuul/+/82828812:14
-@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] 828288: Avoid data races when dequeueing superceded items https://review.opendev.org/c/zuul/zuul/+/82828812:15
-@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] 828292: Avoid data races when dequeueing superceded items https://review.opendev.org/c/zuul/zuul/+/82829212:18
-@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] 828224: Fix leaked semaphore cleanup https://review.opendev.org/c/zuul/zuul/+/82822413:17
-@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] 828224: Fix leaked semaphore cleanup https://review.opendev.org/c/zuul/zuul/+/82822413:22
-@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] 827841: Don't lock pipelines during local layout update https://review.opendev.org/c/zuul/zuul/+/82784114:18
-@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] 828356: Serialize update of changes in timer driver https://review.opendev.org/c/zuul/zuul/+/82835614:53
-@gerrit:opendev.org- Simon Westphahl proposed:15:13
- [zuul/zuul] 828224: Fix leaked semaphore cleanup https://review.opendev.org/c/zuul/zuul/+/828224
- [zuul/zuul] 827841: Don't lock pipelines during local layout update https://review.opendev.org/c/zuul/zuul/+/827841
-@gerrit:opendev.org- Simon Westphahl proposed:17:02
- [zuul/zuul] 828292: Avoid data races when dequeueing superceded items https://review.opendev.org/c/zuul/zuul/+/828292
- [zuul/zuul] 827841: Don't lock pipelines during local layout update https://review.opendev.org/c/zuul/zuul/+/827841
@clarkb:matrix.orgLooks like there are a number of good bug fixes I'll need to try and review this afternoon17:28
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed on behalf of Simon Westphahl: [zuul/zuul] 828292: Avoid data races when dequeueing superceded items https://review.opendev.org/c/zuul/zuul/+/82829217:34
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed on behalf of Simon Westphahl: [zuul/zuul] 827841: Don't lock pipelines during local layout update https://review.opendev.org/c/zuul/zuul/+/82784117:35
@jim:acmegating.comswest: ^ made one tiny update to https://review.opendev.org/82829217:35
@jim:acmegating.comswest: can you take a look at https://review.opendev.org/827841 and make sure that your PS3 -> PS4 transition is correct?  it lost a lot of the commit message as well as other stuff... just want to make sure that was intentional17:40
@westphahl:matrix.orgcorvus: grr, no it wasn't :/17:49
@westphahl:matrix.orgpush the wrong branch17:49
@westphahl:matrix.org * pushed the wrong branch17:49
-@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] 827841: Don't lock pipelines during local layout update https://review.opendev.org/c/zuul/zuul/+/82784117:50
@westphahl:matrix.orgcorvus: ^ should be good now17:51
@westphahl:matrix.orgcorvus: wait, I think it's the wrong parent. too many changes at the end of the day ...17:53
@jim:acmegating.comi know the feeling...17:54
-@gerrit:opendev.org- Simon Westphahl proposed:17:55
- [zuul/zuul] 828224: Fix leaked semaphore cleanup https://review.opendev.org/c/zuul/zuul/+/828224
- [zuul/zuul] 827841: Don't lock pipelines during local layout update https://review.opendev.org/c/zuul/zuul/+/827841
@westphahl:matrix.orgcorvus: ^ that's how it should be (hopefully)17:56
@jim:acmegating.comswest: lgtm -- i left 2 comments on PS6 which are still relevant to PS7; i'll wait to hear your thoughts on them18:08
@jim:acmegating.comswest: and an ack on my change to https://review.opendev.org/828292 would be good when you have a sec18:09
@westphahl:matrix.orgcorvus: done18:45
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed on behalf of Simon Westphahl: [zuul/zuul] 827841: Don't lock pipelines during local layout update https://review.opendev.org/c/zuul/zuul/+/82784119:40
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed on behalf of Simon Westphahl: [zuul/zuul] 827841: Don't lock pipelines during local layout update https://review.opendev.org/c/zuul/zuul/+/82784119:41
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed on behalf of Simon Westphahl: [zuul/zuul] 828224: Fix leaked semaphore cleanup https://review.opendev.org/c/zuul/zuul/+/82822419:43
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed on behalf of Simon Westphahl: [zuul/zuul] 828292: Avoid data races when dequeueing superceded items https://review.opendev.org/c/zuul/zuul/+/82829219:49
-@gerrit:opendev.org- Zuul merged on behalf of Clark Boylan: [zuul/zuul] 828175: Add a merger graceful command https://review.opendev.org/c/zuul/zuul/+/82817520:06
@clarkb:matrix.orgwas https://review.opendev.org/c/zuul/zuul/+/827841 rebased off of the 828224 <- 828292 stack intentionally? just making sure I'm understanding the stuff involved here as I start reviewing21:03
@jim:acmegating.comClark: yes, i left a comment about that?21:09
@jim:acmegating.comi can elaborate if you want (but not sure if you saw it)21:10
@clarkb:matrix.orgah yup there it is21:10
@jim:acmegating.combut basically the only things stacked now are the two model changes; i think other than that everything is independent21:11
@jim:acmegating.comso i've rearranged things for hopefully easiest review + merging21:11
@clarkb:matrix.orggot it21:12
@clarkb:matrix.orgcorvus: swest left a thought (or maybe a few thoughts) on https://review.opendev.org/c/zuul/zuul/+/82822421:25
@clarkb:matrix.orgcan you take a look and let me know if there has been consideration for that or if maybe it is a non issue for some reason I've missed21:25
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 828429: Make a global component registry https://review.opendev.org/c/zuul/zuul/+/82842921:37
@jim:acmegating.comlookin21:37
@clarkb:matrix.orgI think the next change in the stack has a similar concern which I noted on review there21:40
@y2kenny:matrix.orgIs changing the keystore password possible?  If so, what's the best way to do it?  (I tried delete-state but I guess delete-state doesn't touch the keystore...)21:43
@clarkb:matrix.orgKenny Ho: I believe it will render all of your secrets invalid as they won't be decryptable. If you do this you'll be rotating all the secrets essentially. corvus should be able to confirm21:43
@jim:acmegating.comcorrect; i don't think we have a facility for that.21:46
@y2kenny:matrix.orgok. thanks.21:48
@y2kenny:matrix.org@corvus I just replied you elsewhere. I didn't see your message until now.21:48
@jim:acmegating.comKenny Ho: thanks, and no worries, glad it was still there to reply to :)21:49
@y2kenny:matrix.orgA separate question.  I have been trying to add OIDC auth to zuul-web.  The provider I am using is dex but seems like I am missing something (there's no error, but there's no OIDC sign in either.)  Other than [auth dex] for example, is there anything else I need to configure?  I feel like I need to have something that refers to the authenticator but I don't know what...21:56
@jim:acmegating.comKenny Ho: you made a tenant access rule definition? https://zuul-ci.org/docs/zuul/latest/tenants.html#admin-rule-definition21:59
@y2kenny:matrix.orgok... I saw that... but I wasn't sure if there was something default/automatic.  I will read into it22:00
@y2kenny:matrix.orgthanks.22:00
@jim:acmegating.comnp.  that'll establish a requirement that the authenticator can fulfill22:00
@y2kenny:matrix.org(my head was filled with all the LDAP stuff at the time and didn't want to dive into another set of things :))22:00
@y2kenny:matrix.orglooking at the doc, is zuul_uid the most basic type of authorization (I am not familiar with JWT or OIDC internals.)22:04
@jim:acmegating.comClark: replied.  i think it's a matter of how much effort we want to exert to make it bulletproof vs "should mostly work".22:04
@clarkb:matrix.orgcorvus: makes sense. I think I'm happy as long as we call out in the docs that stepping through feature releases wtih some period of time between them is a good idea now22:07
@clarkb:matrix.orgor doing disruptive updates with a zk cleanup step22:07
@clarkb:matrix.orgOpenDev shouldn't have any issues since we already step through all the things.22:07
@clarkb:matrix.orgcorvus: https://review.opendev.org/c/zuul/zuul/+/826400 and https://review.opendev.org/c/zuul/zuul/+/826789 appear to have merge conflicted.22:07
@clarkb:matrix.orgcorvus: any reason to wait for https://review.opendev.org/c/zuul/zuul/+/828224 and child to pass check before approving? If not I can approve otherwise I can take a look after the school run and approve then if check is happy22:08
@jim:acmegating.comClark: yeah, we'll have to take care with release notes once we remove backwards compat.22:10
@jim:acmegating.comClark: it was the 'graceful' change :)22:12
@clarkb:matrix.orgoh whoops22:12
@jim:acmegating.comi'll fix that up now with the assumption it won't conflict with in progress stuff, we'll see :)22:12
-@gerrit:opendev.org- Zuul merged on behalf of Felix Edel:22:14
- [zuul/zuul] 828264: Ignore events without data in node cache update https://review.opendev.org/c/zuul/zuul/+/828264
- [zuul/zuul] 828268: Ignore KeyErrors in node cache listener deleted events https://review.opendev.org/c/zuul/zuul/+/828268
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 826400: Add zuul-scheduler tenant-reconfigure https://review.opendev.org/c/zuul/zuul/+/82640022:14
@jim:acmegating.comlol22:14
@clarkb:matrix.orgI +2'd https://review.opendev.org/c/zuul/zuul/+/828224 and its child if you want to approve now. But I need to step out for a school run and can approve after checking if we want to wait on that22:14
@jim:acmegating.comClark: i don't see any conflicts between 826400 and master or any in-flight stuff so we should be good22:15
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 826789: Add some ZK data size stats https://review.opendev.org/c/zuul/zuul/+/82678922:23
@jim:acmegating.comand that one was the cache stat fix22:23
@y2kenny:matrix.orgAnother unrelated question: for pipeline.trigger.<connection> event comment-added, has there been any thoughts about making it more...  "complex" (beyond regex.)  i.e., perhaps extracting values from the comment to pass into the job?  Alternatively, is the comment passed into the context of a zuul job?22:28
@jim:acmegating.comKenny Ho: the comment is not passed in; that's at least partially by design, in that trigger events are not intended to alter what's run.  the builds are intended to be idempotent based only on the change content.  this way a build that's triggered by a comment, or an approval or a command line or a web ui or an mqtt event, etc, all behave the same way.23:07
@y2kenny:matrix.orgcorvus: Ah ok.  I was thinking along the line of giving devs the ability to selectively trigger jobs by comment.23:09
@clarkb:matrix.orgI rechecked https://review.opendev.org/c/zuul/zuul/+/827841 for more data but both py38 and py36 failed in sos's test_semaphore so I expect there may be a regression there23:13
@clarkb:matrix.orggoing to start reviewing it now. maybe it will pop out at me23:14
@jim:acmegating.comClark: i understand the issue, i'm currently halfway through writing a novel about it.23:14
@clarkb:matrix.orgha ok. Maybe I'll wait then23:15
@clarkb:matrix.orgor at least wait before leaving comments. I'll try to understand the change in genreal23:16
@jim:acmegating.comClark: novel complete23:19
@fungicide:matrix.org> <@y2kenny:matrix.org> corvus: Ah ok.  I was thinking along the line of giving devs the ability to selectively trigger jobs by comment.23:22
it comes up somewhat often, and one of the biggest problems is that it's unclear what the result of that should be. would zuul replace the build result of the independently triggered job from a previous buildset? or would that singular build become a separate buildset? should it replace the verified vote from the prior buildset? also, i'm sure you can already imagine the pathological incentives that option could open up for developers who "just want their change merged"
@fungicide:matrix.orgalso, job dependencies throw in a fairly giant wrench there, presumably you'd expect any dependency of the rerun job to also be rerun?23:23
@jim:acmegating.comi think it is possible to incorporate it into zuul's model, but it's far from trivial.23:26
@fungicide:matrix.orgif the rerun build required an atrifact provided by another build from that buildset, you may otherwise end up using an old artifact which wasn't built from the same repository state as the new build23:26
@fungicide:matrix.orgor which could even no longer be available23:27
@clarkb:matrix.orgcorvus: wow there is a lot going on in that change (827841). I'm still trying to make sense of it so that I can give the update a quicker review23:28
@fungicide:matrix.organd yes, these aren't intractable problems, but we'd need to answer those questions in some way, i think, before a design could be sketched out23:28
@jim:acmegating.comfungi: yeah, we answered about half of them when we sketched out a design for that for zuulv2.  the other half didn't exist then.  :)23:31
@clarkb:matrix.orgcorvus: can you check my questions on that change to make sure I'm following along?23:44
@y2kenny:matrix.orgfungi: I see.  Thanks for the explaination23:46

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!