Tuesday, 2024-12-03

*** jbernard_ is now known as jbernard15:11
gmanngouthamr: I would not be able to join today meeting  due to some appointment. 16:46
gouthamrack gmann, thanks for letting me know16:46
gouthamrtc-members: a gentle reminder that we're meeting here and on Zoom for the weekly meeting today. Link to Zoom is here: https://wiki.openstack.org/wiki/Meetings/TechnicalCommittee17:02
gouthamr^ in ~58 minutes17:02
gouthamr#startmeeting tc 18:00
opendevmeetMeeting started Tue Dec  3 18:00:08 2024 UTC and is due to finish in 60 minutes.  The chair is gouthamr. Information about MeetBot at http://wiki.debian.org/MeetBot.18:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.18:00
opendevmeetThe meeting name has been set to 'tc'18:00
gouthamr#info Today's meeting is being held primarily via video call. Action items and meeting minutes will be documented in IRC but for a full replay of the meeting, please visit the OpenStack TC youtube channel, where the recording will be uploaded soon.18:00
gouthamrWelcome to the weekly meeting of the OpenStack Technical Committee. A reminder that this meeting is held under the OpenInfra Code of Conduct available at https://openinfra.dev/legal/code-of-conduct.18:01
gouthamrToday's meeting agenda can be found at https://wiki.openstack.org/wiki/Meetings/TechnicalCommittee18:01
gouthamr#topic Roll Call18:01
noonedeadpunko/18:01
bauzas\o18:01
gtemao/18:01
spotz[m]coming!18:01
gouthamrwe've slaweq on the zoom call18:02
gouthamrnoted absence: g m a n n, f r i c k l e r18:02
gouthamrcourtesy ping: cardoe 18:03
slaweqo/18:03
gouthamrthanks for joining, lets get started18:05
gouthamr#topic Last Week's AIs18:05
gouthamrGate Health and Docker Hub Rate Limits:18:06
gouthamrwe sent out a note to projects to consider alternatives to DockerHub as part of the TC Weekly Summary18:06
gouthamr#link https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/7WNB6WGAXO5I3RPCM76JNZVQSHDH2VGC/ (OpenStack TC meeting Summary 26th Nov 2024) 18:07
gouthamrUbuntu Noble Migration18:07
gouthamrReach out to remaining projects with failing jobs to guide migration or pinning nodesets 18:07
gouthamr#link https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/message/UFV3YPHI7ZECBS2HS35CFJOFNRAAGURH/ ([all][tc][ptl][qa] Migrating upstream CI/CD jobs to Ubuntu Noble (24.04))18:08
gouthamrPostgreSQL Support Documentation:18:09
gouthamrThe TC summary included a note to confirm whether any projects still run PostgreSQL jobs and coordinate updates to governance or documentation as needed.18:09
gouthamr^ i've moved this item to the TC tracker18:10
gouthamrthese were the AIs that I was tracking; were there any other AIs you were pursuing?18:10
gouthamrlets move on to the next topic18:11
* gouthamr is changing up the order today to accommodate the new topic over the existing regular items18:12
gouthamr#topic Unmaintained branch cleanup18:12
gouthamr#link https://governance.openstack.org/tc/resolutions/20230724-unmaintained-branches.html (Resolution)18:12
gouthamrBy default, only the latest eligible Unmaintained branch is kept. When a new branch is eligible, the Unmaintained branch liaison must opt-in to keep all previous branches active.18:14
gouthamr^ this seems to be the first problem jens raised18:15
gouthamrfungi says there was no process defined to have people sign up to be unmaintained branch liaisons18:15
gouthamrso, project teams don't have one - it's unclear18:16
gouthamrwe need a process to perform this sort of cleanup of older unmaintained branches - maybe a post to the ML asking for liaisons for unmaintained branches18:16
gouthamrwhat do we do now; 18:17
gouthamrjens proposed and wanted to EOM the Victoria branch18:18
gouthamr#link https://review.opendev.org/c/openstack/releases/+/935373 (Transition victoria-eom branches to EOL)18:18
gouthamrthis keeps getting delayed by discussions around the patch18:18
gouthamrnoonedeadpunk is asking where we draw a line around unmaintained branches.. he highlighted that the latest user survey indicated that the yoga branch was deployed quite a bit18:19
gouthamrand its currently unmaintained, do we cull it?18:19
gouthamrwe need to refine the process so we can understand what unmaintained branches we can cull18:19
gouthamrslaweq and bauzas said that the user survey may indicate usage, but, doesn't mean operators are relying on the upstream community to keep the branches open18:20
gouthamrfungi suggests that the user survey can't indicate who may be interested to volunteer to care for a specific branch18:21
gouthamrit's anonymous18:21
gouthamrnoonedeadpunk says project teams may be more tied in to users/operators that rely on older branches 18:22
gouthamrthe TC doesn't have all the visibility here.. 18:22
gouthamrso we can't make a blanket decision.. 18:24
gouthamri think we can use the past strategy that we had with extended maintenance branches - i.e., when a new branch went to extended maintenance, the oldest extended maintenance branch was EOL'ed18:24
gouthamrin terms of policy, we have said that only SLURP releases can go to "unmaintained"18:26
gouthamrbobcat, dalmatian would go straight to EOL18:26
gouthamrfungi says if projects are concerned maintaining Yoga (because we used it as a base branch to test out SLURP upgrades), the TC can designate this as a special branch18:27
gouthamrwe're now discussing how to find volunteers, how to find liaisons for specific branches18:30
gouthamrwe have an "unmaintained-core" team that we handed these questions off to.. 18:30
gouthamrbut, how much of this team is active?18:31
gouthamrthe release team is stretched too thin and cannot be burdened with this.. but, unfortunately is having to bring this up.. 18:31
fungijust a data point: https://review.opendev.org/c/openstack/cinder/+/925097 is a security fix which merged to unmaintained/xena earlier today18:34
noonedeadpunk++18:34
noonedeadpunkjust in time18:34
gouthamrthanks, good point.. 18:35
gouthamrwe're asking if there are any objections to V, X, W branches being EOLed 18:35
fungi(took over 4 months from when it was proposed, 6 months from when the advisory was published, but it did merge)18:36
gouthamrthere was no objection on the Zoom call18:36
noonedeadpunkI think that Cinder was the last/only project who didn't backport the fix for this CVE to Xena in time?18:36
gouthamr#agreed a ML post will be sent to EOL V, W, X branches 18:37
gouthamrwhat's left is to address this note from the original resolution:18:38
gouthamr"The TC will maintain and document the full steps and guidelines for transitioning from maintained to unmaintained, and for the eventual branch deletion."18:38
gouthamrnoonedeadpunk suggests tabling this to a future IRC meeting when we have a few more hands on deck18:39
gouthamri agree, and prefer making incremental progress here18:40
gouthamrlets move on to the next topic18:40
gouthamr#topic A check on gate health18:40
gouthamris anyone noticing any new flakiness in the CI?18:40
gouthamrnoonedeadpunk brought up that all horizon plugins are broken due to the noble migration18:41
gouthamrbauzas says nova tempest jobs are flakey since the past month; he's not looked in-depth at this.. patches are needing more rechecks to merge18:42
gouthamrthe nova team is triaging some new guest kernel issues noted in the job logs18:42
gouthamrclarkb noted that project teams have started migrating to alternatives to DockerHub18:44
gouthamrand the rework of proxies seems to hve helped avoiding DockerHub rate limits18:44
gouthamrso the problem is cooling off now18:44
gouthamrclarkb also noted a problem with booting CS10 nodes because of new CPU requirements18:44
gouthamr^ fungi and clarkb note that this may affect how we do Supported Runtimes for future releases18:45
gouthamrif we can't boot the OS on our cloud providers, they can't be in our runtimes18:45
gouthamrOpenMetal and RAXFlex seem like the only CI providers that could handle these CPU requirements18:46
gouthamr"CentOS Stream 10 requires x86_64-v3 at minimum" 18:47
clarkbhttps://review.opendev.org/c/openstack/diskimage-builder/+/936024 is one of the diskimage builder changes where they have been trying to sort out testing with these images18:49
spotz[m]And if anyone is coming to FOSDEM CentOS Connect will be he Thursday and Friday before so a good opportunity to talk to folks🙂18:49
gouthamrthanks clarkb fungi and spotz[m].. 18:50
gouthamrany other gate issues to bring up18:50
gouthamr#topic PTG AIs and the TC Tracker18:50
gouthamr#link https://etherpad.opendev.org/p/tc-2025.1-tracker (Technical Committee activity tracker - 2025.1)18:50
clarkband I guess the bit that is implied is that opendev won't be able to support centos 10 stream test nodes unless something changes18:50
clarkbwe're just caught in the middle and can't really make those changes ourselves18:50
gouthamr++18:50
gouthamrneed some eyes on the eventlet goal proposal reworked here:18:52
clarkbhttps://developers.redhat.com/articles/2024/01/02/exploring-x86-64-v3-red-hat-enterprise-linux-10# this is from january so a bit old but apparently it was just an exploration at one point. Not sure if any concrete decisions have been made18:53
gouthamr#link https://review.opendev.org/c/openstack/governance/+/931254 (rework the initial eventlet goal proposal)18:53
gouthamr#topic Open Discussion18:54
gouthamr<fungi> 18:55
gouthamrin case anyone is interested in taking on additional leadership responsibilities: a reminder that nominations for the 2025 open infrastructure foundation board of director individual member elections are currently open, closing at 23:59 utc on december 13: https://lists.openinfra.dev/archives/list/foundation@lists.openinfra.dev/thread/5R57DDIS7TARSUQGHL2Y5XBCEPNLGHVC/18:55
gouthamr^ reposting this from last week18:55
gouthamrthere are some candidates that need more nominations from the community18:56
gouthamr#link https://openinfra.dev/election/2025-individual-director-election/candidates (see Candidates Not Yet On The Ballot)18:56
gouthamranything else for today?18:57
gouthamrwe wrapped up the Zoom call18:57
gouthamrthank you all for joining18:57
gouthamrwill see you here next week for our regular weekly IRC meeting18:57
gouthamr#endmeeting18:58
opendevmeetMeeting ended Tue Dec  3 18:58:00 2024 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)18:58
opendevmeetMinutes:        https://meetings.opendev.org/meetings/tc/2024/tc.2024-12-03-18.00.html18:58
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/tc/2024/tc.2024-12-03-18.00.txt18:58
opendevmeetLog:            https://meetings.opendev.org/meetings/tc/2024/tc.2024-12-03-18.00.log.html18:58
spotz[m]clarkb fungi OpenInfra NA (SCaLe) might be an opportunity to talk to some of the CentOS folks as well18:59
clarkbspotz[m]: possibly I worry that may be too late if we're trying to address it on the rhel/centos side though19:00
clarkbif the decision has been made I don't think they can rollback after they release which aiui is soon though not known19:00
fungiseems likely it's already too late if they've built all their packages with optimizations for those processors19:00
fungian archive-wide rebuild probably takes months19:01
clarkbthat said I think that the distros should be better about working with the clouds if they are making these decisiosn and the clouds can't support them19:01
spotz[m]Might be something that could be packaged and used out of EPEL?19:01
fungiwell, if it's compiler flags in various languages, then it might end up being an entire shadow base package set19:02
clarkbwhat opensuse has done is to target specific packages that show improvements with the newer instructions and have mix in packages for those. Things like python19:02
clarkbso the vast majority of the distro is still v2 then if the package manager detects hardware support for v3 they install the mix in packages for packages that have them19:03
clarkbbut the bulk of the distro is built one way and only places with the greatest impact get the extra work19:03
clarkbanyway I don't really feel responsible here. I mostly wanted to call it out for people who have ties to clouds and distros (both of which are represented in our community and on the TC) with the hope that they can sort it out between themselves19:04
fungiyeah, it does at least seem like a shame if centos makes a release that can't run on major cloud providers19:16
cardoeWell I did end up being on that plane ride during the meeting. Can’t do Zoom on planes. So I missed today.19:24
fungigotta upgrade those planes!19:25

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!