Tuesday, 2022-01-11

clarkbAnyone else here for the meeting?19:00
jentoiohere19:00
clarkbI'm checking on gitea upgrades and getting my notes together but we shall start momentarily19:00
clarkb#startmeeting infra19:01
opendevmeetMeeting started Tue Jan 11 19:01:03 2022 UTC and is due to finish in 60 minutes.  The chair is clarkb. Information about MeetBot at http://wiki.debian.org/MeetBot.19:01
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.19:01
opendevmeetThe meeting name has been set to 'infra'19:01
clarkb#link https://lists.opendev.org/pipermail/service-discuss/2022-January/000311.html Our Agenda19:01
clarkbone thing that occured to me as I prepared for this meeting is that we have https on our list servers now but don't redirect http to https19:01
clarkbfungi: ^ should we do redirects on all of the vhosts now that https is working happily?19:01
jentoiothe link to the agenda works via http19:02
clarkbthat isn't urgent so I'll continue on, but wanted to call it out19:02
clarkbjentoio: yup it works via both. I think we should force http to redirect https though19:02
clarkb*to redirect to19:03
jentoioright19:03
clarkb#topic Announcements19:03
fungii can try setting up https redirects for that, it's worth noting that http is hard-coded into a lot of the urls though so it may end up with more browser warnings19:03
clarkbfungi: ah that is too bad.19:03
fungiunless we configure it to also rewrite page content19:03
fungii think it's configurable though19:03
fungiwe'd just need to update the mailman configs to use https urls everywhere19:04
clarkbThe OpenInfra Foundation board election is happening right now. If you are an individual member for long enough (I forget the exact period of time) you should have received a ballot in your email inbox. Please don't forget to vote19:04
fungisix months19:04
fungialso the ballot includes a measure to update the wording for the bylaws19:04
fungiso you'll be prompted to vote for that as well on the same ballot19:05
fungiwell, for or against19:05
clarkbyup and you'll get separate email receipts for your votes against the bylaw update and the membership vote19:05
clarkbAlso this is your reminder that OpenDev Service coordinator nominations run January 25, 2022 - February 8, 2022. I'm more than happy for someone else to give it a go :)19:06
clarkbIf you are interested feel free to reach out with questions. And I'll definitely be around to help assist should someone else take it on19:06
clarkb#topic Actions from last meeting19:06
clarkb#link http://eavesdrop.openstack.org/meetings/infra/2021/infra.2021-12-14-19.01.txt minutes from last meeting19:07
clarkbThere were no actions recorded. Not surprising as we were already slowing down for the year at that point. But we are back now :)19:07
clarkbLet's dive into the topic list now19:07
clarkb#topic Ansible lint failures19:07
clarkbI had this on the agenda to make sure we didn't let these issues linger longer than necessary. But ya'll are on top of it and the fixes I pushed appear to have all merged overnight19:08
clarkbThis means we can land zuul ansible updates again19:08
clarkbThank you to everyone who jumped on that19:08
clarkb#topic Improving OpenDev's CD Throughput19:08
clarkbianw is still out for the holidays. I believe the spec outlining the next step here still needs review though19:09
clarkb#link https://review.opendev.org/c/opendev/infra-specs/+/821645 -- spec outlining some of the issues with secrets19:09
clarkbinfra-root ^ if you have time to review that it would be appreciated (I need to review it myself)19:09
clarkb#topic Container Maintenance19:10
clarkb#link https://etherpad.opendev.org/p/opendev-container-maintenance19:10
clarkbThis is something that I'm starting to pick up now that I'm back.19:10
clarkbkopecmartin will test the refstack bullseye image update and if that doesn't look problematic I'll go ahead and approve it in the next day or two hopefully19:10
clarkbWe've also got lodgeit bullseye updates sitting behind the uwsgi image update.19:11
clarkb#link https://review.opendev.org/c/opendev/system-config/+/821339 to update uwsgi for lodgeit19:11
clarkbIf we can go ahead and land the uwsgi image update for bullseye then we can land the lodgeit update (they are separate chagnes) when we are able to monitor. I probably have time for that this week as well19:11
clarkbI'd prefer to not single core approve uwsgi updates since it is sort of a hack around a problem. But that reminds me that maybe upstream fixed the problem and we can check that directly first and maybe avoid the hack19:12
clarkbThe other big thing I've started to look at is updating some of our containers to run with dedicated users. Sounds like jentoio is willing to help me with that (thanks!). I'll try to set up time this week with jentoio to go over what is needed and propose more changes19:12
clarkbThat etherpad has a few other things we should look into but I think they are all good followups for once the above set of updates are completed (bullseye updates and better user management specifically)19:13
clarkbI'm just going to keep running through the agenda. I think we've got low attendance today as people aren't all quite back from holidays and there isn't a ton to cover yet as we paused work for a bit too19:14
clarkb#topic Nodepool image cleanups19:14
clarkbWe now have volunteers to maintain OpenSUSE Leap 15 and Gentoo.19:14
clarkbThat leaves us with CentOS 8, Fedora 34, and Tumbleweed needing cleanup. The tumbleweed removal actually happened overnight.19:15
clarkbI believe ianw was looking at Fedora 34 so we can probably wait for ianw to return to finish that up19:15
fricklerF34 still has a couple of months unless I'm mistaken19:15
clarkbfrickler: it does, but we cannot boot it reliably because they broke their initramfs generation19:15
frickleralso devstack+neutron still depend on it19:16
clarkbour f34 images only boot in like 2 clouds right now19:16
frickleroh, I thought that that issue was with F3519:16
clarkbso the plan ianw proposed was to switch to f35 whcih doesn't have initramfs problems19:16
clarkbfrickler: they both had it but they fixed f35 and not f3419:16
fungiright, they ended up not backporting the fix19:17
clarkbIt seems that the problem didn't meet the level of urgency to fix on f34 at least not urgently19:17
fungithey simply left 34 broken19:17
fricklerso maybe some of the RH neutron folks can help with getting F35 to run for them19:17
fungithat only seems fair ;)19:17
clarkbIts not a perfect solution but one that is in line with our previous treatment of fedora (basically move everything to latest fedora when available and drop old)19:17
clarkb++19:17
clarkbFWIW I expect CentOS 8 removal to be similarly painful but at larger scale because lots of things use it19:18
clarkbI guess I should send a reminder and maybe an email to opensatck specifically19:18
fungithough folks are already noticing things breaking on centos-8 images19:18
clarkbsome people have already started converting to stream which is good but I doubt all have.19:18
clarkbI'll make a note to send the reminder that CentOS 8 is EOL and opendev will be working to remove the image today19:19
clarkbBut then I think we start pushing up changes and force merging updates if we have to after people have a chance to do it more gracefully19:20
fungisounds good to me19:21
clarkb#topic Scheduling Gerrit Project Renames19:21
clarkbWe have project rename requests. I think we'll want to be careful to do this in a way that doesn't interfere with the openstack release schedule or Zuuls as zuul approachs zuulv519:22
clarkbAnytime in january is probably fine https://releases.openstack.org/yoga/schedule.html does anyone have opinions on this?19:23
clarkbnormally I'd suggest the 21st but I think I have a doctors appointment that day19:23
fungii'm available any time, but yeah i agree on the timing suggestions19:23
clarkbperhaps do it on a Monday the 23th?19:23
clarkber 24th19:23
clarkb(I cannot type)19:23
fungiwfm19:23
clarkbok lets pencil that in and can start proper planning on the 18th19:24
fungiand preferably not at peak activity that day19:24
clarkbya yseterday was super quiet activity wise, but I wonder if that will hold up through january. Today is much busier in zuul19:25
clarkbseparately I've been looking at using the gerrit rename-project plugin to do renames. This plugin can do renames without a downtime. but introduces races replicating projects. I've got a change up that doesn't pass currently trying to test this. I don't think we should block on itand instead use our established process. This will come up again and we can make use of no19:25
clarkbdowntime renames then19:25
clarkbthat was all I had on the agenda19:26
clarkb#topic Open Discussion19:26
clarkbI'm sure I've missed stuff with the holidays and all that. Feel free to call out anything else now19:26
jentoioI believe CFP for summit is open (reminder)19:27
fungialso worth mentioning, openstackid.org is becoming id.openinfra.dev, and i've got a few changes up to work through impact on systems we manage under topic:openinfraid19:28
fungispecifically i'll need to make database edits to zanata and refstack for the new ids19:29
clarkblooks like you were going to do translate -dev first and then when that is happy do the others?19:30
fungicorrect. i'll use translate-dev to test the transition19:30
fricklera date for the PTG was also announced (2022-04-04 - 08), at least that was news to me19:30
fungibasically i need to figure out if zanata supports multiple openids in its database, or if i need to replace existing openids directly19:31
fungiso translate-dev gives me an opportunity to experiment19:31
fungiwe'll probably also want to update the keycloak poc for that transition19:32
clarkbI feel like other people are more clued in on the events than I am. Not necessarily a bad thing but I work with the organizers :)19:32
clarkbfungi: did keycloak get configured to talk to the old name?19:33
fungiyes19:33
clarkbor is it just a matter of using the correct new name now when it gets configured19:33
clarkbah ok19:33
fungiwe tested it with openstackid.org19:33
fungiand also google, i think19:33
clarkbI'll give it a few more minutes for anything else then call it and we can all go find lunch/dinner/$MEAL19:35
clarkbSounds like that may be it. Thank you everyone and welcome back, happy new year :)19:38
jentoiothanks!19:38
fungithanks clarkb!19:38
clarkb#endmeeting19:38
opendevmeetMeeting ended Tue Jan 11 19:38:53 2022 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)19:38
opendevmeetMinutes:        https://meetings.opendev.org/meetings/infra/2022/infra.2022-01-11-19.01.html19:38
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/infra/2022/infra.2022-01-11-19.01.txt19:38
opendevmeetLog:            https://meetings.opendev.org/meetings/infra/2022/infra.2022-01-11-19.01.log.html19:38

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!