Thursday, 2023-12-07

*** elodilles_pto is now known as elodilles07:34
*** sfinucan is now known as stephenfin10:58
*** tobias-urdin9 is now known as tobias-urdin13:03
noonedeadpunkhi there! we have just branched OSA roles, but for some repos we do not see branches created in Zuul13:15
noonedeadpunkie: https://zuul.opendev.org/t/openstack/project/opendev.org/openstack/openstack-ansible-os_horizon missing 2023.2, thus jobs are not even started in Zuul13:15
funginoonedeadpunk: i think we've seen zuul miss ref-updated events when multiple branch creations occur in a very short span of time (not sure if gerrit fails to emit them or zuul fails to process them). were there multiple repos branched somewhat simultaneously? i think we've addressed it in the past with an online scheduler reconfiguration13:56
fungii'm not really around today (or the first part of tomorrow), but hopefully someone else can help soon13:56
noonedeadpunkyeah, quite some branches were created at the same time indeed14:01
noonedeadpunkand around 6 of them were left without update on zuul side14:01
tonybfungi: I know you aren't really around.  I can do the reconfigure, I'm gussing it's seomthing like sudo docker exec -it --user zuul zuul-scheduler_scheduler_1 zuul-scheduler tenant-reconfigure openstack on zuul0115:38
clarkbtonyb: there was discussion of this the last time it came up in #opendev. We should be able to dig up what the command was from there15:55
clarkbwould've been around the recent openstack release. but ya your command is close. The thing I can't remmber is if we need to give flags for extra reconfiguration or not15:56
tonybclarkb: Okay.  I'll look15:58
clarkbtonyb: 2023-10-16T22:13:00+0000 docker exec zuul-scheduler_scheduler_1 zuul-scheduler tenant-reconfigure openstack that is in zuul02s root history15:59
clarkbI suspect that if we look at the #opendev log on that day it will show this is the command we settled on and that also matches your command16:00
tonybclarkb: LOL16:00
tonyb[2023-10-16 17:13:12] <clarkb> `docker exec zuul-scheduler_scheduler_1 zuul-scheduler tenant-reconfigure openstack` is what I ran on zuul0216:01
clarkbthere is also discussion around that time about why this happens in zuul16:02
clarkbnoonedeadpunk: ^ if you are curious about details16:02
noonedeadpunkit's happening in zuul matrix?16:08
tonybnoonedeadpunk: No, that was a discussion from Oct/16 16:09
noonedeadpunkah, ok, now I realized :)16:09
tonybclarkb: I the same command from the history on zuul0216:10
tonybclarkb: I guess the reconfig takes a little while16:10
noonedeadpunkwell, I kinda have no means to control how actively branching will happen as it's applied on patch merge16:11
clarkbtonyb: yes it takes $minutes16:12
clarkbthe suggestion we made to the release team was to batch them iirc16:12
tonybnoonedeadpunk: got it.  It's something for us to look into.  It's an annoyance for imapacted users but at this point not something you need to worry about16:12
tonybclarkb: Yeah.  We could do that.16:13
noonedeadpunkyeah, that would be fair thing to do I guess.16:13
noonedeadpunkBut not sure that applying semaphore would be enough, as in our case we have just huge list of repos that are getting branched in one go16:14
noonedeadpunkso it's indeed smth to look in tooling itself16:15
tonybYes.16:15
tonybthe release tooling and/or adding debugging to zuul to dig into this16:16
clarkbfrom memory (haven't looked at the logs yet) the issue is when we have a bunch of reconfigurations that happen during a reconfiguration16:17
clarkbby batching them we can try and avoid the number of sequential reconfigurations16:17
noonedeadpunkok, branches have appeared16:37
noonedeadpunkthanks for the help!16:43
tonybnp16:43
*** pmatulis_ is now known as pmatulis17:04
pmatuliscan anyone nail this doc PR for the OpenStack Charms project? https://review.opendev.org/c/openstack/openstack-manuals/+/90269517:04
clarkbpmatulis: I think you need someone from this group https://review.opendev.org/admin/groups/238e9f33453744139facac78a6eb17de63c46a00,members17:06
tonybpmatulis: you can try poking on #openstack-doc17:08
pmatulismy understanding was that this channel took over from #openstack-doc , which is now shuttered17:14
tonybpmatulis: oh that could be.  I  apologise if I sent you in the wrong direction17:16
fricklerpmatulis: tonyb: actually it is the tc taking over reviews for that mostly nowadays, so asking in #openstack-tc is even better. I also have had that patch open for a day already, but didn't get round to actually verifying that the docs links are working17:20
*** tobias-urdin34 is now known as tobias-urdin17:27
tonybfrickler: Ahh okay.  I wonder if it's worth updating the topic and/or setting a channel redirect17:32
JayFgoing to be honest, I didn't even realize TC were review owners on that repo17:34
JayFgood news, review incoming17:34
JayFalso jamespage is on TC And can review changes, and he's charm project adjacent17:34
tonybJayF: neither did I TIL17:42
fricklerJayF: tonyb: this explains it a bit, not sure if there was some official tc decision around it https://review.opendev.org/c/openstack/project-config/+/88023517:50
JayFI mean, contextually, there's no docs team so it makes sense17:50
fricklerregarding branching, if someone creates like 60 branches in a single review, there's not much the release team can do about that, either https://review.opendev.org/c/openstack/releases/+/901959/4/deliverables/bobcat/openstack-ansible-roles.yaml18:01
frickleralthough that was actually elodilles proposing that patch ... hmm18:05
tonybyeah it's automated so we could update the tools to do no more than $n per review as a workaround 18:07
pmatulisoh #openstack-tc ok18:17
gmannJayF: frickler: doc SIG is officially moved under TC since there was no maintainer left in doc team. all the doc repo are in TC owned repo since then https://github.com/openstack/governance/blob/master/reference/technical-committee-repos.yaml18:38
gmannthat is why i made gerritbot change so that more TC start looking into those repo review. i keep doing for incoming one but hope more TC can start taking look18:39
gmannpmatulis: +A 18:45
elodillesfrickler: yes, unfortunately openstack-ansible-roles have that many repos in its collection. if this is the same issue as with the high number of eol'd branch deletion, then the solution is (as clark wrote) to batch them somehow in the release tooling19:00
elodillesit's good to know that this can occur in case of branching as well, not just branch deletion :S19:01
clarkbelodilles: yes its the same code paths in zuul iirc19:02
elodillesclarkb: ack19:02

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!