Tuesday, 2023-06-27

clarkbjust about meeting time. I'm not sure how many of us there will be so I may end up quickly running through the highlights19:00
clarkb#startmeeting infra19:01
opendevmeetMeeting started Tue Jun 27 19:01:10 2023 UTC and is due to finish in 60 minutes.  The chair is clarkb. Information about MeetBot at http://wiki.debian.org/MeetBot.19:01
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.19:01
opendevmeetThe meeting name has been set to 'infra'19:01
clarkb#link https://lists.opendev.org/archives/list/service-discuss@lists.opendev.org/thread/77NQ27ARPLEVBLT7ZSUVDWER6YYACCXN/ Our Agenda19:01
clarkb#topic Announcements19:01
clarkbNext tuesday, July 4, is a US holiday. I won't be able to attend this meeting on that day as I'll either be traveling (you might have noticed my timezone hasn't shifted and that is because I caught covid and shift all my travel back by two weeks), or celebrating the holiday wondering how much longer it will take to get over covid19:02
clarkbI suspect that others will also be afk so we can probably cancel that meeting19:03
clarkb#topic Bastion Host Changes19:04
clarkb#link https://review.opendev.org/q/topic:bridge-backups This set of changes still needs additonal reviewers19:04
clarkb#topic Mailman 319:05
clarkbI suspect fungi isn't able to join today and I also doubt much new has happened on this one due to the summit and travel etc19:05
clarkbfungi: please let us know if these assumptions are bad19:05
clarkb#topic Gerrit Updates19:06
clarkb#link https://review.opendev.org/c/opendev/system-config/+/885317 Update Gerrit 3.8 image to final 3.8 release19:06
clarkbThis is a bit of a bookkeeping change to bump up gerrit versions. We were previously testing with a hacked up gerrit 3.8 rc build19:07
clarkb#link https://review.opendev.org/c/opendev/system-config/+/884779 Revert bind mounts for Gerrit plugin data19:07
clarkbAnd this undoes the bind mounting of plugin data so that we clear out the leaked replication task files when we down/up the container19:07
clarkbI continue to think this isn't urgent but the longer we put it off the more files there will be to clean up in the end19:07
clarkb#topic Upgrading Servers19:08
clarkbtonyb's efforts to make the ci registry more testable have resulted in better testing and a new host replacing the old one. THank you for that !19:08
clarkbThe old host still needs to be removed https://review.opendev.org/c/opendev/system-config/+/887001 but we can queue that up behind the zuul executor replacements19:09
clarkbsince they all update the inventory file it the prod job queues can get fairly long19:09
clarkbonce that chagne lands we can delete the old server too. The new server is in production though due to dns updates and the rest of this is lower priority19:09
clarkbThanks again for the help and happy to help work through more of these with interested volunteers19:10
clarkb#topic Fedora Cleanup19:10
clarkbI haven't seen any new movement on this and don't think we have tonyb here today19:10
clarkbHowever, it is probably worth noting that frickler expanding afs volumes to move the logjam out of the way for bookworm19:10
clarkbthank you for pushing that forward frickler 19:11
clarkb#topic Quo vadis Storyboard19:11
clarkbThere was discussion in #openstack-infra ealier today about making projects inactive possibling removing those projects from search lists making it difficult to find the project IDs to perform cleanup activities19:12
fungiaround for a moment, assumptions about mm3 are spot on, unfortunately :(19:12
clarkbI don't think we understand all the details here, but probably worth clarifying with projects as we mark them inactive if this is the case19:12
clarkbso that they are aware any potential cleanup actions they want ot take may be more complicated (though it doesn't seem like any of the actions were prevented just more difficult to find identifiers)19:13
fungiwe can also look up sb project ids with a db query if the api isn't sufficient in that case19:13
fungi(but does require a root sysadmin)19:14
clarkback, considering this is he first time it has come up that may be good enough19:15
clarkbdoesn't seem to be a common occurrence in any case19:15
clarkb#topic Gitea 1.2019:15
clarkbGitea 1.20 exists in RC form now (up to rc2)19:15
clarkbI've pushed a change to start testing things, but we don't have a proper change log yet so this is unlikely to be comprehensive19:15
clarkb#link https://review.opendev.org/c/opendev/system-config/+/88699319:15
clarkbThe "good" news is that this has exposed a problem in the oauth2 implementation where despite us disabling it it insists a JWT_SECRET value be set then tries to write it back to disk which fails because we don't allow gitea to write to its config file19:16
clarkb#link https://github.com/go-gitea/gitea/issues/2537719:16
clarkblooks like upstream may treat this as a bug, but they say the undocumented behavior of gitea writing back new config to its own config file is intended and won't be changed19:16
clarkbpeople really need to stop designing software this way. Makes it impossible to use ocnfiguration management sanely19:17
clarkbPoking around at it I think the only real issue there is the JWT_SECRET though and the other normalization I did doesn't appera to be required. It doesn't result in failed writes back to disk at least19:17
corvusalso super unsafe19:18
fungidoesn't allow privilege separation between write access to configs and processes for the service19:18
clarkbya I think we should continue to set up perms on that file os that gitea can't write back to it then rely on our ci system to ensure we're configuring things properly19:19
clarkbaka make it fail if it wants to write back19:19
clarkb#topic Etherpad 1.9.119:19
clarkb#link https://review.opendev.org/c/opendev/system-config/+/88700619:19
clarkbThere is a new etherpad release. However I'm not sure we want to upgrade at this point... Number lists don't increment the number values. They are always just 1. 1. 1. etc apparently (though I've not tested this myself)19:20
clarkbAlso the tagged commit for 1.9.1 doesn't actually build. So 887006 checks out a commit a few commits later after they fixed the lock file contents so that it can build19:20
fungii guess this is per a bug report somewhere?19:20
clarkbI'm hoping we get a 1.9.2 that fixes the build issue at least and then we can consider building that19:21
corvus🎶...one is the onliest number that you'll ever know...🎶19:21
clarkbfungi: yes there is an issue for the numbered list thing19:21
clarkbI've got github release event alerts enabled for both gitea and etherpad so hopefully we see new releases with fixes for things19:23
clarkbunitl then be aware of the change and feel free to review them. But we probably won't upgrade until a few things get fixed19:23
clarkb#topic Open Discussion19:24
clarkbAnything else?19:24
corvusre server upgrades: i've resumed the attempt to update the zuul-executors to jammy19:24
corvus(after fungi's fix to the apt config which is what caused the previous rollback)19:24
corvuser, to be clear, the incorrect apt config caused the rollback; fungi fixed it.  :)19:25
corvusnot caused it :)19:25
fungijust a reminder that i'm not around much this week, popping in from time to time as i get a moment (like now obviously). i'll be my usual self again next week19:25
corvusbe whoever you want to be, i say19:26
fungisage advice19:27
clarkbI'll be around but also trying to take it easy. I'm still testing positive for covid as of today19:28
fungihope you and the fam feel better soon19:28
corvus++19:29
clarkband in theory I'm traveling a week from now. That should be long enough to shake this off19:29
clarkband then timezones will be weird. But for this week I'm around19:29
fungii'll be home and caught up by the time you're travelling, so that should work out19:29
clarkbsounds good19:30
clarkbI don't need to take up any more of our time today. Thank you everyone! We'll likely skip next week (I won't be here anyway) and then try to pick this back up July 1119:30
clarkb#endmeeting19:31
opendevmeetMeeting ended Tue Jun 27 19:31:01 2023 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)19:31
opendevmeetMinutes:        https://meetings.opendev.org/meetings/infra/2023/infra.2023-06-27-19.01.html19:31
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/infra/2023/infra.2023-06-27-19.01.txt19:31
opendevmeetLog:            https://meetings.opendev.org/meetings/infra/2023/infra.2023-06-27-19.01.log.html19:31
fungisounds great. thanks clarkb!19:31

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!