Friday, 2021-09-24

-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed:02:58
- [zuul/zuul] Only refresh deps if change messages have changed https://review.opendev.org/c/zuul/zuul/+/810787
- [zuul/zuul] Use structured change cache keys https://review.opendev.org/c/zuul/zuul/+/810801
@jim:acmegating.comClark, swest: topic:sos-change-cache has fixes for the change cache slowness we observed in opendev.  i tried to improve efficiency as much as possible, and at the end i added a change to how we're keying the change cache so that we don't have to actually fetch changes from the cache as often.  i tried to make all of this with the upcoming pipeline state in mind (thinking that the more change references can stand on their own, the better).  so i think we want to take a look at that stack asap because we should be able to run opendev on it again, and i think it'll be good to have in place for pipeline state.03:02
-@gerrit:opendev.org- Zuul merged on behalf of Matthieu Huin https://matrix.to/#/@mhuin:matrix.org: [zuul/zuul] web UI: add "show retries" toggles on buildset page https://review.opendev.org/c/zuul/zuul/+/80620109:07
-@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] wip: Store queue state in Zookeeper https://review.opendev.org/c/zuul/zuul/+/81092014:14
@westphahl:matrix.orgcorvus: re. the pipeline state I think we have a few use-cases where we want to instantiate ZKObjects w/o saving them to zookeeper. not sure if what I tried in https://review.opendev.org/c/zuul/zuul/+/809414/10/zuul/rpclistener.py is the best way to accomplish that14:16
@jim:acmegating.comswest: that makes sense to me14:21
@clarkb:matrix.orgcorvus: sos-change-cache is top of my priority this morning once I'm generally caught up today. It looks like ianw also pushed some changes to try and make handling of the github situation better?15:03
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] Verify ZK certs can be read https://review.opendev.org/c/zuul/zuul/+/79713516:40
@clarkb:matrix.orghttp://lists.openstack.org/pipermail/openstack-discuss/2021-September/025057.html may be of interest to zuul users using zuul config pragmas to override implied branch matchers17:07
@clarkb:matrix.orgTL;DR is you can accidentally match too many branches then have too many pre-run playbooks (and post-run I guess)17:07
@clarkb:matrix.orgI'm going to take a break then try to get back to reviewing the sos-change-cache stack again.17:08
@jim:acmegating.comClark, gtema: for future reference another way to have accomplished that would be to set required-projects: - {name: devstack, override-checkout: master} on the feature/r1 branch of sdk.17:28
@clarkb:matrix.orgI seem to recall they didn't want to do that for some reason but I can't remember17:29
@gtema:matrix.orgIf I remember correctly we tried that, but it didn't work for some reason17:29
@gtema:matrix.orgMordred pointed to this option as alternative17:30
@jim:acmegating.comthe pragma implied-branches is better at matching up things like "openstack victoria == ceph squiddy"17:30
@gtema:matrix.orghttps://review.opendev.org/c/openstack/openstacksdk/+/79102317:31
@gtema:matrix.orgHere I tried that17:31
@clarkb:matrix.orgcorvus: left a question and some comments on https://review.opendev.org/c/zuul/zuul/+/810539 if you have a second to take a look18:07
@jim:acmegating.comClark: thx, replied and updated18:48
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed:18:48
- [zuul/zuul] Remove onChangeUpdated method https://review.opendev.org/c/zuul/zuul/+/810539
- [zuul/zuul] Only refresh deps if change messages have changed https://review.opendev.org/c/zuul/zuul/+/810787
- [zuul/zuul] Use structured change cache keys https://review.opendev.org/c/zuul/zuul/+/810801
@clarkb:matrix.orgfollowup to evaluate the move sounds good to me18:51
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] Attempt to refresh deps less often https://review.opendev.org/c/zuul/zuul/+/81095418:53
@jim:acmegating.comthat's that18:53
-@gerrit:opendev.org- Matthieu Huin https://matrix.to/#/@mhuin:matrix.org proposed: [zuul/zuul] [WIP] GUI: Add tenant selector to top menu https://review.opendev.org/c/zuul/zuul/+/81095519:08
@clarkb:matrix.orgcorvus: https://review.opendev.org/c/zuul/zuul/+/810539/7 may be worth approving with carry over votes since the updates were minor? I'll let you decide on that. The changes below that one are approevd and the one after it has enough +2s. I'll keep looking at the others after some lunch19:21
@jim:acmegating.comClark: agreed and done19:32
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul] Add a test for github dependency updates https://review.opendev.org/c/zuul/zuul/+/81072620:09
-@gerrit:opendev.org- Matthieu Huin https://matrix.to/#/@mhuin:matrix.org proposed: [zuul/zuul] [WIP] GUI: Add tenant dropdown to top menu https://review.opendev.org/c/zuul/zuul/+/81095520:27
-@gerrit:opendev.org- Matthieu Huin https://matrix.to/#/@mhuin:matrix.org proposed: [zuul/zuul] [WIP] GUI: Add tenant dropdown to top menu https://review.opendev.org/c/zuul/zuul/+/81095520:28
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] Fix race in test_data_return_child_from_retried_paused_job https://review.opendev.org/c/zuul/zuul/+/81096120:36
@jim:acmegating.comzuul-maint: ^ i'm continuing to fix test races as i see them20:36
@clarkb:matrix.orgcorvus: small thing on https://review.opendev.org/c/zuul/zuul/+/810801 I +2'd becuase I think that can be addressed in a followup as well. But also happy to rereview the change if you update it20:43
@jim:acmegating.comClark: hrm, some of those values are also intentonally null...20:44
@jim:acmegating.comClark: so maybe we need a "strornull" converter method?20:44
@clarkb:matrix.orgoh ya that would be fine. I think the important bit is that we don't treat numbers as strings or vice versa20:45
@clarkb:matrix.orgit would be easy to do with the existing api20:45
@jim:acmegating.comok sounds good.  i'll revise it to do that20:45
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] Use structured change cache keys https://review.opendev.org/c/zuul/zuul/+/81080120:48
@jim:acmegating.comClark: ^ how's that look?20:49
@clarkb:matrix.orgthat looks good. You can clean up some of the str() conversions in the various drivers too if you like.20:50
@clarkb:matrix.orgI'm more worried about subsequent chagnes to the drivers or new drivers that end up mixing and matching types and the update addresses that  as is20:50
@jim:acmegating.comyeah.  tbh, i think belt and suspenders is probably good for this :)20:51
@clarkb:matrix.orghttps://review.opendev.org/c/zuul/zuul/+/810954 will need a rebase onto that latest update. But it lgtm20:53
@clarkb:matrix.organd possibly will help make things just a bit quicker occasionally :)20:54
@jim:acmegating.comrebased21:01
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] Attempt to refresh deps less often https://review.opendev.org/c/zuul/zuul/+/81095421:01
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] Allow more time in test_smart_reconfiguration https://review.opendev.org/c/zuul/zuul/+/81096721:53
@jim:acmegating.comanother test fix ^21:53
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] Fix race in component re-registration https://review.opendev.org/c/zuul/zuul/+/81096822:03
@jim:acmegating.comand another ^22:03
@clarkb:matrix.orgcorvus: minor cleanup suggested on that last one22:08
@jim:acmegating.comderp22:08
@jim:acmegating.comClark: thx nice catch :)22:09
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] Fix race in component re-registration https://review.opendev.org/c/zuul/zuul/+/81096822:09
@clarkb:matrix.orgcorvus: felixedel left some thoughts/questions on https://review.opendev.org/c/zuul/zuul/+/808091 if you want to take a look22:36
@clarkb:matrix.orgcorvus: https://review.opendev.org/c/zuul/zuul/+/808792 that one conflicts with your race fix above22:49
@clarkb:matrix.orgnot sure if you want to try and land that one instead if my comments in 808091 aren't too concerning22:49
-@gerrit:opendev.org- Zuul merged on behalf of Ian Wienand: [zuul/zuul] github: more complete mocking for app setup https://review.opendev.org/c/zuul/zuul/+/81055322:52
@jim:acmegating.comClark, felixedel:  hrm... i think i like my fix to that test race a little better; it's more conservative.  mostly this: we should always have a release() after we set hold to false23:01
@jim:acmegating.comClark: i think we should merge my fix for that and remove the similar fix from 80879223:02
@clarkb:matrix.orgwfm23:02
@jim:acmegating.comlooking at other comments now23:02
@jim:acmegating.comClark: replied23:21
@clarkb:matrix.orgok I +2'd but not sure if want to remove the test race fix and approve the stack together or if we should approve just that change for now23:23
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com:23:23
- [zuul/zuul] Add a test for dequeue-on-new-patchest https://review.opendev.org/c/zuul/zuul/+/810772
- [zuul/zuul] Remove onChangeUpdated method https://review.opendev.org/c/zuul/zuul/+/810539
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul] Only refresh deps if change messages have changed https://review.opendev.org/c/zuul/zuul/+/81078723:26
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed on behalf of Felix Edel:23:27
- [zuul/zuul] Don't use executor.builds when processing build result events https://review.opendev.org/c/zuul/zuul/+/808091
- [zuul/zuul] Don't use executor.builds to find out if tests are settled https://review.opendev.org/c/zuul/zuul/+/808792
- [zuul/zuul] Remove the local builds list from the executor client https://review.opendev.org/c/zuul/zuul/+/809175
@jim:acmegating.comClark: i went ahead and rebased it on my fix and removed the other23:27
@jim:acmegating.comi ran that test locally just to double check it still works :)23:27
@clarkb:matrix.orgcool I've updated my reviews on the stack23:31

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!