Wednesday, 2021-11-10

-@gerrit:opendev.org- Zuul merged on behalf of Clark Boylan: [zuul/nodepool] 817114: Fix boto deps https://review.opendev.org/c/zuul/nodepool/+/81711401:52
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 817328: Clear and load TPCs before updating layouts on secondary schedulers https://review.opendev.org/c/zuul/zuul/+/81732802:21
@jim:acmegating.comClark, tobiash, swest: ^ that is the biggest one-line change i've written in quite a while02:22
@clarkb:matrix.orgI need to eat something with sugar in it then I can do a review02:23
@clarkb:matrix.orgcorvus: what is the call path between createDynamicLayout and updateTenantLayout? I'm currently trying to understand taht relationship so that I can understand the change better02:31
@clarkb:matrix.orgLooks like in the scheduler run loop we detect our layout isn't up to date when processing queues and call updateTenantLayout02:33
@clarkb:matrix.orgI think what is going on is that loadTPCs call sets things up for the manager getLayout calls that happen later02:38
@clarkb:matrix.orgI ended up writing down what i put together to make sense of this in review and suggested additioanl belts and suspenders or an alternative implementation. Mostly concerned that cacheConfig is relying on side effects in other code that are not entirely obvious so being explicit about it might be a good idea03:18
-@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul] 817342: WIP: Fix a bug in getting changed files https://review.opendev.org/c/zuul/zuul/+/81734204:22
-@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul] 817342: WIP: Fix a bug in getting changed files https://review.opendev.org/c/zuul/zuul/+/81734204:25
-@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul] 817342: WIP: Fix a bug in getting changed files https://review.opendev.org/c/zuul/zuul/+/81734204:48
-@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul] 817343: WIP: Fix a bug in getting changed files https://review.opendev.org/c/zuul/zuul/+/81734304:52
-@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul] 817343: Fix a bug in getting changed files https://review.opendev.org/c/zuul/zuul/+/81734305:52
-@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul] 817343: Fix a bug in getting changed files https://review.opendev.org/c/zuul/zuul/+/81734305:54
-@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul] 817343: Fix a bug in getting changed files https://review.opendev.org/c/zuul/zuul/+/81734305:55
@westphahl:matrix.orgcorvus: small comment on 81732806:10
-@gerrit:opendev.org- Simon Westphahl proposed on behalf of Felix Edel:06:33
- [zuul/zuul] 817159: Implement job endpoints directly in zuul-web https://review.opendev.org/c/zuul/zuul/+/817159
- [zuul/zuul] 817160: Implement project endpoints directly in zuul-web https://review.opendev.org/c/zuul/zuul/+/817160
- [zuul/zuul] 817196: Implement tenant endpoints directly in zuul-web https://review.opendev.org/c/zuul/zuul/+/817196
- [zuul/zuul] 817228: Remove gearman from zuul-web https://review.opendev.org/c/zuul/zuul/+/817228
-@gerrit:opendev.org- Simon Westphahl proposed:06:33
- [zuul/zuul] 817003: Store pipeline summary for zuul-web in Zookeeper https://review.opendev.org/c/zuul/zuul/+/817003
- [zuul/zuul] 817004: Use pipeline summary from Zookeeper in zuul-web https://review.opendev.org/c/zuul/zuul/+/817004
- [zuul/zuul] 817157: Use abide for listing pipelines in zuul-web https://review.opendev.org/c/zuul/zuul/+/817157
- [zuul/zuul] 817158: Use abide for getting public keys in zuul-web https://review.opendev.org/c/zuul/zuul/+/817158
- [zuul/zuul] 817164: Use abide for getting project SSH keys in zuul-web https://review.opendev.org/c/zuul/zuul/+/817164
- [zuul/zuul] 817171: Check authentication directly in zuul-web https://review.opendev.org/c/zuul/zuul/+/817171
- [zuul/zuul] 817172: Create list of admin tenants directly in zuul-web https://review.opendev.org/c/zuul/zuul/+/817172
- [zuul/zuul] 817174: Use abide to get (dis-)allowed labels in zuul-web https://review.opendev.org/c/zuul/zuul/+/817174
- [zuul/zuul] 817177: Create list of connections directly in zuul-web https://review.opendev.org/c/zuul/zuul/+/817177
- [zuul/zuul] 817193: Use config errors directly from layout in zuul-web https://review.opendev.org/c/zuul/zuul/+/817193
-@gerrit:opendev.org- Felix Edel proposed:07:59
- [zuul/zuul] 817160: Implement project endpoints directly in zuul-web https://review.opendev.org/c/zuul/zuul/+/817160
- [zuul/zuul] 817196: Implement tenant endpoints directly in zuul-web https://review.opendev.org/c/zuul/zuul/+/817196
- [zuul/zuul] 817228: Remove gearman from zuul-web https://review.opendev.org/c/zuul/zuul/+/817228
- [zuul/zuul] 817354: Align common parts in zuul-web API methods https://review.opendev.org/c/zuul/zuul/+/817354
-@gerrit:opendev.org- Felix Edel proposed: [zuul/zuul] 817354: Align common parts in zuul-web API methods https://review.opendev.org/c/zuul/zuul/+/81735408:03
-@gerrit:opendev.org- Felix Edel proposed on behalf of Simon Westphahl:08:35
- [zuul/zuul] 817003: Store pipeline summary for zuul-web in Zookeeper https://review.opendev.org/c/zuul/zuul/+/817003
- [zuul/zuul] 817004: Use pipeline summary from Zookeeper in zuul-web https://review.opendev.org/c/zuul/zuul/+/817004
- [zuul/zuul] 817157: Use abide for listing pipelines in zuul-web https://review.opendev.org/c/zuul/zuul/+/817157
- [zuul/zuul] 817158: Use abide for getting public keys in zuul-web https://review.opendev.org/c/zuul/zuul/+/817158
- [zuul/zuul] 817164: Use abide for getting project SSH keys in zuul-web https://review.opendev.org/c/zuul/zuul/+/817164
- [zuul/zuul] 817171: Check authentication directly in zuul-web https://review.opendev.org/c/zuul/zuul/+/817171
- [zuul/zuul] 817172: Create list of admin tenants directly in zuul-web https://review.opendev.org/c/zuul/zuul/+/817172
- [zuul/zuul] 817174: Use abide to get (dis-)allowed labels in zuul-web https://review.opendev.org/c/zuul/zuul/+/817174
- [zuul/zuul] 817177: Create list of connections directly in zuul-web https://review.opendev.org/c/zuul/zuul/+/817177
- [zuul/zuul] 817193: Use config errors directly from layout in zuul-web https://review.opendev.org/c/zuul/zuul/+/817193
-@gerrit:opendev.org- Felix Edel proposed:08:35
- [zuul/zuul] 814996: Make the ConfigLoader work independently of the Scheduler https://review.opendev.org/c/zuul/zuul/+/814996
- [zuul/zuul] 816361: Load system config and tenant layouts in zuul-web https://review.opendev.org/c/zuul/zuul/+/816361
- [zuul/zuul] 816362: Implement job freezing API in zuul-web https://review.opendev.org/c/zuul/zuul/+/816362
- [zuul/zuul] 816514: Handle management events directly in zuul-web https://review.opendev.org/c/zuul/zuul/+/816514
- [zuul/zuul] 816783: Implement autohold endpoints directly in zuul-web https://review.opendev.org/c/zuul/zuul/+/816783
- [zuul/zuul] 817159: Use abide to look up jobs directly in zuul-web https://review.opendev.org/c/zuul/zuul/+/817159
- [zuul/zuul] 817160: Use abide to look up projects directly in zuul-web https://review.opendev.org/c/zuul/zuul/+/817160
- [zuul/zuul] 817196: Use abide for listing tenants in zuul-web https://review.opendev.org/c/zuul/zuul/+/817196
- [zuul/zuul] 817228: Remove gearman from zuul-web https://review.opendev.org/c/zuul/zuul/+/817228
- [zuul/zuul] 817354: Align common parts in zuul-web API methods https://review.opendev.org/c/zuul/zuul/+/817354
-@gerrit:opendev.org- Felix Edel proposed on behalf of Simon Westphahl:08:53
- [zuul/zuul] 817003: Store pipeline summary for zuul-web in Zookeeper https://review.opendev.org/c/zuul/zuul/+/817003
- [zuul/zuul] 817004: Use pipeline summary from Zookeeper in zuul-web https://review.opendev.org/c/zuul/zuul/+/817004
- [zuul/zuul] 817157: Use abide for listing pipelines in zuul-web https://review.opendev.org/c/zuul/zuul/+/817157
- [zuul/zuul] 817158: Use abide for getting public keys in zuul-web https://review.opendev.org/c/zuul/zuul/+/817158
- [zuul/zuul] 817164: Use abide for getting project SSH keys in zuul-web https://review.opendev.org/c/zuul/zuul/+/817164
- [zuul/zuul] 817171: Check authentication directly in zuul-web https://review.opendev.org/c/zuul/zuul/+/817171
- [zuul/zuul] 817172: Create list of admin tenants directly in zuul-web https://review.opendev.org/c/zuul/zuul/+/817172
- [zuul/zuul] 817174: Use abide to get (dis-)allowed labels in zuul-web https://review.opendev.org/c/zuul/zuul/+/817174
- [zuul/zuul] 817177: Create list of connections directly in zuul-web https://review.opendev.org/c/zuul/zuul/+/817177
- [zuul/zuul] 817193: Use config errors directly from layout in zuul-web https://review.opendev.org/c/zuul/zuul/+/817193
-@gerrit:opendev.org- Felix Edel proposed:08:53
- [zuul/zuul] 816514: Handle management events directly in zuul-web https://review.opendev.org/c/zuul/zuul/+/816514
- [zuul/zuul] 816783: Implement autohold endpoints directly in zuul-web https://review.opendev.org/c/zuul/zuul/+/816783
- [zuul/zuul] 817159: Use abide to look up jobs directly in zuul-web https://review.opendev.org/c/zuul/zuul/+/817159
- [zuul/zuul] 817160: Use abide to look up projects directly in zuul-web https://review.opendev.org/c/zuul/zuul/+/817160
- [zuul/zuul] 817196: Use abide for listing tenants in zuul-web https://review.opendev.org/c/zuul/zuul/+/817196
- [zuul/zuul] 817228: Remove gearman from zuul-web https://review.opendev.org/c/zuul/zuul/+/817228
- [zuul/zuul] 817354: Align common parts in zuul-web API methods https://review.opendev.org/c/zuul/zuul/+/817354
-@gerrit:opendev.org- Felix Edel proposed: [zuul/zuul] 817363: Don't let zuul-web wait for management events to complete https://review.opendev.org/c/zuul/zuul/+/81736309:02
-@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] 817383: Shuffle list of tenants in run handler https://review.opendev.org/c/zuul/zuul/+/81738310:33
-@gerrit:opendev.org- Matthieu Huin https://matrix.to/#/@mhuin:matrix.org proposed: [zuul/zuul] 817388: Add testing for tenant authorizations override https://review.opendev.org/c/zuul/zuul/+/81738811:52
-@gerrit:opendev.org- Artem Goncharov proposed: [zuul/zuul] 817393: Fix gitlab squash merge https://review.opendev.org/c/zuul/zuul/+/81739312:23
-@gerrit:opendev.org- Matthieu Huin https://matrix.to/#/@mhuin:matrix.org proposed: [zuul/zuul] 768115: Web UI: allow a privileged user to request autohold https://review.opendev.org/c/zuul/zuul/+/76811512:23
-@gerrit:opendev.org- Matthieu Huin https://matrix.to/#/@mhuin:matrix.org proposed: [zuul/zuul] 768199: Web UI: add Autoholds, Autohold page https://review.opendev.org/c/zuul/zuul/+/76819912:23
-@gerrit:opendev.org- Matthieu Huin https://matrix.to/#/@mhuin:matrix.org proposed: [zuul/zuul] 810699: Web UI: Show pipeline types as icons https://review.opendev.org/c/zuul/zuul/+/81069912:24
-@gerrit:opendev.org- Matthieu Huin https://matrix.to/#/@mhuin:matrix.org proposed: [zuul/zuul] 781858: web UI: allow a privileged user to promote a change https://review.opendev.org/c/zuul/zuul/+/78185812:24
-@gerrit:opendev.org- Felix Edel proposed: [zuul/zuul] 817400: Move serialization helper methods to ZooKeeperBase class https://review.opendev.org/c/zuul/zuul/+/81740013:14
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 817328: Clear and load TPCs before updating layouts on secondary schedulers https://review.opendev.org/c/zuul/zuul/+/81732814:06
-@gerrit:opendev.org- Matthieu Huin https://matrix.to/#/@mhuin:matrix.org proposed: [zuul/zuul] 802559: Web UI: Add "Create Autohold Request" form, improve API error messages https://review.opendev.org/c/zuul/zuul/+/80255915:01
-@gerrit:opendev.org- Matthieu Huin https://matrix.to/#/@mhuin:matrix.org proposed: [zuul/zuul] 769943: Example Docker compose: keycloak integration https://review.opendev.org/c/zuul/zuul/+/76994315:01
-@gerrit:opendev.org- Simon Westphahl proposed:15:27
- [zuul/zuul] 815787: Refresh pipelines in tests when settled https://review.opendev.org/c/zuul/zuul/+/815787
- [zuul/zuul] 815278: DNM: execute tests with two schedulers https://review.opendev.org/c/zuul/zuul/+/815278
@spamaps:spamaps.ems.hostcorvus: FYI, I'm working on adding network specification to GCE pools. :)15:33
@spamaps:spamaps.ems.hostAlso trying out hooking nodepool up to Spotify's GKE clusters.15:34
@tobias.henkel:matrix.orgcorvus: +2 on 817328, do you want a re-review by clark or shall I +3?16:09
@jim:acmegating.comtobiash: ah thx; i just added the +w myself, i think Clark's ok with it16:11
-@gerrit:opendev.org- Simon Westphahl proposed on behalf of Felix Edel:16:48
- [zuul/zuul] 817354: Align common parts in zuul-web API methods https://review.opendev.org/c/zuul/zuul/+/817354
- [zuul/zuul] 817363: Don't let zuul-web wait for management events to complete https://review.opendev.org/c/zuul/zuul/+/817363
-@gerrit:opendev.org- Simon Westphahl proposed:16:48
- [zuul/zuul] 815787: Refresh pipelines in tests when settled https://review.opendev.org/c/zuul/zuul/+/815787
- [zuul/zuul] 815278: DNM: execute tests with two schedulers https://review.opendev.org/c/zuul/zuul/+/815278
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul] 817328: Clear and load TPCs before updating layouts on secondary schedulers https://review.opendev.org/c/zuul/zuul/+/81732817:27
@spamaps:spamaps.ems.hostI'm not familiar with nodepool review practices anymore. Can https://review.opendev.org/c/zuul/nodepool/+/817070 be +A'd?18:39
@jim:acmegating.comspamaps: normally i'd give Clark a chance to weigh in again, but he may be out today.  if not, we can probably +w since the new ps just added testing.18:41
@jim:acmegating.comer, by "if not" i mean "if he's unable to re-review"18:41
@clarkb:matrix.orgI can probably take a look. Sorry slow sickly day for me18:48
-@gerrit:opendev.org- Zuul merged on behalf of Clint Byrum: [zuul/nodepool] 817070: Fix infinite recursion in GCE provider https://review.opendev.org/c/zuul/nodepool/+/81707020:30
@spamaps:spamaps.ems.hostTY!21:01
@jim:acmegating.comomg i found the config_errors problem.  == instead of -21:24
@jim:acmegating.com * omg i found the config_errors problem.  == instead of =21:24
@jim:acmegating.comi spotted some other issues/potential issues, so i'm going to do a bit more work on it.21:30
@fungicide:matrix.orgwow, comparison instead of assignment... usually it's the other way around!22:01
@fungicide:matrix.organd yeah, that sort of mistake is really, really tough to spot22:01
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 817479: Fix buildset config_errors https://review.opendev.org/c/zuul/zuul/+/81747922:09
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 817479: Fix buildset config_errors https://review.opendev.org/c/zuul/zuul/+/81747922:09
-@gerrit:opendev.org- Ian Wienand proposed: [zuul/nodepool] 817482: Bump DIB to 3.15.1 https://review.opendev.org/c/zuul/nodepool/+/81748222:17
@tristanc_:matrix.orgfungi: though in that case, a static check should be able to tell the comparaison result was not used22:18
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 817484: Use a stable hash for ConfigurationErrorKeys https://review.opendev.org/c/zuul/zuul/+/81748422:19
@jim:acmegating.comyeah, i'm surprised pyflakes missed it22:19
@clarkb:matrix.orgcorvus the last assertEqual in the test for 817479 seems unnecessary. Is there a reason for that one?22:21
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 817486: Identify the object in ZKObject (de)serialization errors https://review.opendev.org/c/zuul/zuul/+/81748622:28
@jim:acmegating.comClark: i wanted to reassure myself that testing the equality through the list worked transitively.  :)  i agree it's very silly, but the actual code is very hard to test, so i thought getting as close to it as possible would be good.22:29
-@gerrit:opendev.org- Clint Byrum proposed: [zuul/nodepool] 817487: Add network and subnetwork to GCE driver https://review.opendev.org/c/zuul/nodepool/+/81748722:29
-@gerrit:opendev.org- Matthieu Huin https://matrix.to/#/@mhuin:matrix.org proposed: [zuul/zuul] 817488: WIP Fix authentication not carrying over tabs https://review.opendev.org/c/zuul/zuul/+/81748822:31
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 817490: Log null change key deference https://review.opendev.org/c/zuul/zuul/+/81749022:35
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 817491: Add repr to FrozenJob https://review.opendev.org/c/zuul/zuul/+/81749122:42
@jim:acmegating.comzuul-maint: 817479--817491 (series of 5 patches) are what i'd like to merge before we restart opendev again.  they either fix or add additional info for all the issues i'm aware of.22:44
@clarkb:matrix.orgcorvus: left a comment on a couple of the changes23:00
@jim:acmegating.comClark: thanks.  i'll fix, push up the stack, then run a local test suite23:11
@jim:acmegating.com(i'm pretty sure that is tested, just not sure which test)23:11
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed:23:12
- [zuul/zuul] 817479: Fix buildset config_errors https://review.opendev.org/c/zuul/zuul/+/817479
- [zuul/zuul] 817484: Use a stable hash for ConfigurationErrorKeys https://review.opendev.org/c/zuul/zuul/+/817484
- [zuul/zuul] 817486: Identify the object in ZKObject (de)serialization errors https://review.opendev.org/c/zuul/zuul/+/817486
- [zuul/zuul] 817490: Log null change key deference https://review.opendev.org/c/zuul/zuul/+/817490
- [zuul/zuul] 817491: Add repr to FrozenJob https://review.opendev.org/c/zuul/zuul/+/817491
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed:23:17
- [zuul/zuul] 817484: Use a stable hash for ConfigurationErrorKeys https://review.opendev.org/c/zuul/zuul/+/817484
- [zuul/zuul] 817486: Identify the object in ZKObject (de)serialization errors https://review.opendev.org/c/zuul/zuul/+/817486
- [zuul/zuul] 817490: Log null change key deference https://review.opendev.org/c/zuul/zuul/+/817490
- [zuul/zuul] 817491: Add repr to FrozenJob https://review.opendev.org/c/zuul/zuul/+/817491
@jim:acmegating.comcaught an issue with the hash change23:17
@clarkb:matrix.orgcorvus: tristanC has a couple of comments on that hash change too23:23
@jim:acmegating.comtristanC: thx, i'll implement as soon as the local test run finishes23:24
@tristanc_:matrix.orgyou're welcome, not sure the comments are correct though :) Also, a bytes -> string helper function to do the hashlib//update//hexdigest sequence might be useful to have too23:28
@jim:acmegating.comi'm pretty sure those are straight scalar types, so the comment doesn't apply.  and the sort isn't necessary, but i agree it's a good habit to get into for something like this.23:29
@jim:acmegating.comokay, no test failures on the current stack23:29
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed:23:31
- [zuul/zuul] 817484: Use a stable hash for ConfigurationErrorKeys https://review.opendev.org/c/zuul/zuul/+/817484
- [zuul/zuul] 817486: Identify the object in ZKObject (de)serialization errors https://review.opendev.org/c/zuul/zuul/+/817486
- [zuul/zuul] 817490: Log null change key deference https://review.opendev.org/c/zuul/zuul/+/817490
- [zuul/zuul] 817491: Add repr to FrozenJob https://review.opendev.org/c/zuul/zuul/+/817491
@jim:acmegating.comthat should do it23:31
@tristanc_:matrix.orgcorvus: thank you for the fast iteration!23:32
@jim:acmegating.comoh just saw the comment on the last change.  i'll alter that as well.23:33
@jim:acmegating.comactually... i think it's not possible for name to be unset, so i think maybe it's okay to leave it.23:34
@jim:acmegating.comfrozen jobs are only created from jobs, and they always have names23:34
@tristanc_:matrix.orgcorvus: I guess, but can we prevent using `zuul.model.FrozenJob()` ? otherwise, this will raise an AttributeError on the REPL23:38
@jim:acmegating.comwe can't but there's no code path that uses it, and it would not make sense to add one.  since it's a zkobject, we only instantiate it with .new() or .fromZK().23:40
@spamaps:spamaps.ems.hostweee got custom networks working on GCE23:53
@jim:acmegating.comi'm looking at what's required to finish removing gearman, and ironically, there's a bunch of web api tests that need to be changed :)23:57
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 817495: Use merger API for merger stats https://review.opendev.org/c/zuul/zuul/+/81749523:58
@spamaps:spamaps.ems.hostThat makes sense.23:58

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!