Monday, 2024-10-28

rpittaugood morning ironic! o/08:00
masgharGood morning!08:29
masgharShall I go ahead and make the heading 'Agenda for October 28, 2024' here? https://wiki.openstack.org/wiki/Meetings/Ironic08:33
rpittaumasghar: sure go ahead :)08:50
kubajjgood morning Ironic! o/08:52
opendevreviewMohammed Boukhalfa proposed openstack/sushy-tools master: Add TLS option to external notifier  https://review.opendev.org/c/openstack/sushy-tools/+/93355109:12
iurygregorygood morning Ironic09:30
opendevreviewMohammed Boukhalfa proposed openstack/sushy-tools master: Add TLS option to external notifier  https://review.opendev.org/c/openstack/sushy-tools/+/93355110:01
opendevreviewPierre Riteau proposed openstack/tenks master: Use openstackdocstheme for release notes  https://review.opendev.org/c/openstack/tenks/+/93305910:44
masghar(I've added Bug deputy updates to the agenda)10:52
rpittaumasghar: I've checked the translation periodic job, I think we need to update it, it's still running on ubuntu-bionic!11:18
opendevreviewMerged openstack/virtualpdu master: Drop unnecessary 'x' bit from doc config file  https://review.opendev.org/c/openstack/virtualpdu/+/93326811:32
jssfrwe have a node in error state in ironic, but it's actually quite healthy and alive12:41
opendevreviewMerged openstack/metalsmith master: Replace outdated python job template  https://review.opendev.org/c/openstack/metalsmith/+/93326412:41
opendevreviewMerged openstack/metalsmith master: Bump minimum python version  https://review.opendev.org/c/openstack/metalsmith/+/93326512:41
jssfris there a way to get it back to "active" in ironic without touching the database and without undeploying it?12:41
TheJuliagood morning13:17
TheJuliajssfr: for our context, what was in the last_error field for the node?13:18
TheJuliaAlso, good morning everyone13:18
opendevreviewMerged openstack/ironic master: Gracefully handle bad request exception  https://review.opendev.org/c/openstack/ironic/+/93184913:20
TheJuliajssfr: long story short, unlikely short of doing a quick db edit, but the context around the error would be helpful since there may be a bug there or a defect, or some edge case we're unaware of13:27
JayFThey can maybe temporarily change the driver to fake to get it deployed in the database. We have docs around doing that to adopt things with Nova, but I suspect you could do it to get an ironic node in okay shape13:29
jssfrTheJulia, thanks, I'll extract the error in a moment...13:33
jssfrTheJulia, last_error             | Failed to change power state to 'power on': IPMI call failed: power status.13:33
jssfrI'm a bit confused because all other nodes also had IPMI issues and didn't enter error state, but that could be because the other nodes were already marked active by Ironic, while with that node, it failed to switch during deployment?13:34
jssfr(where someone then might have manually pressed a power button)13:34
opendevreviewMerged openstack/ironic-ui master: Add note about requirements lower bounds  https://review.opendev.org/c/openstack/ironic-ui/+/93351213:59
opendevreviewMerged openstack/sushy-tools master: Add TLS option to external notifier  https://review.opendev.org/c/openstack/sushy-tools/+/93355114:11
iurygregoryI will skip the weekly meeting today, going to lay down a bit because of a headache14:34
masgharTake care, Iury!14:48
rpittau#startmeeting ironic15:00
opendevmeetMeeting started Mon Oct 28 15:00:11 2024 UTC and is due to finish in 60 minutes.  The chair is rpittau. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
opendevmeetThe meeting name has been set to 'ironic'15:00
cardoeo/15:00
TheJuliao/15:00
rpittauHello everyone!15:00
rpittauWelcome to our weekly meeting!15:00
rpittauThe meeting agenda can be found here:15:00
rpittauhttps://wiki.openstack.org/wiki/Meetings/Ironic#Agenda_for_October_28.2C_202415:00
TheJuliaGood morning!15:00
masgharo/15:00
cido/15:00
rpittaugoing to give 1-2 minutes for people to join15:01
TheJuliajssfr: so! I think NobodyCam has hit this exact same issue15:01
TheJuliajssfr: the tl;dr seems to be some grouping of BMCs out there sometimes go on vacation after the power-off command, but we don't know really have enough details to properly figure out a clean workaround15:02
rpittauokey dokey, let's start! :)15:03
rpittau#topic Announcements/Reminders15:03
rpittau#info Standing reminder to review patches tagged ironic-week-prio and to hashtag any patches ready for review with ironic-week-prio:15:03
rpittau#link https://tinyurl.com/ironic-weekly-prio-das15:03
rpittauerrr15:03
rpittauwrong link15:03
rpittau#link https://tinyurl.com/ironic-weekly-prio-dash15:03
rpittauwe have a bunch of py3.8 removal patches15:03
cardoeget it gone :)15:03
rpittauplease have a look at them, I think they just need a +W15:04
TheJuliaack15:04
cardoeThe WSGI module thing is a blocker for the next set of pyproject.toml updates15:04
rpittauyep15:04
rpittauthat's first in the list :)15:04
rpittau#info 2025.1 Epoxy Release Schedule15:05
rpittau#link  https://releases.openstack.org/epoxy/schedule.html15:05
rpittaunothing to add there15:05
rpittaubut!15:05
rpittauI would like to do a first release of all the projects next week or the week after at the latest15:05
TheJuliaMarch, of course :)15:05
TheJuliaAre there any new features or bugfixes? that seems like a bit quick given the release timeline15:06
rpittauwell mmilestone 1 is the week of November 1115:06
TheJuliaThat has nothing to do with it15:06
rpittauwe don't really follow that15:06
TheJuliayeah, it is more about substance, truthfully15:07
rpittaubut I was thinking to do a first release right asfter we remove py3.8 support15:07
TheJuliaIf there is substance, cool. If not, why go through motions needlessly?15:07
TheJuliaThat could be reasonable if everything is resolved by then15:07
cardoeSo there's nothing really changed in removing Python 3.815:08
rpittauyep, need to evaluate 15:08
cardoeThe only thing of note would be sushy supporting Python 3.12. Which it didn't before.15:08
rpittaucardoe: the min version will be py3.9 and it's explicit15:08
rpittauthat is a huge breaking change15:08
cardoeI disagree with the "explicit" it's a comment.15:08
cardoeThe next series of patches will actually make it explicit by setting python_requires15:09
rpittauexactly that15:09
cardoeWeighing changing to using pyproject.toml move vs setup.cfg15:09
cardoes/move/more/15:10
rpittauwe agreed that will be after a while, during the cycle15:10
rpittauanyway, if we go late in November with the release we may just wait for the next bugfix15:11
rpittaulet's see where we are in 1-2 weeks15:11
cardoeIf we do that then the setup.py entry point can go. Which then removes the setuptools dependency entirely. Which is another hurdle for Python 3.14? support15:11
cardoeSo it's more above being forward looking.15:12
rpittauI think we're getting a bit too far ahead :)15:12
cardoered diffs are the best diffs. :)15:12
rpittau:)15:13
rpittau#info Epoxy OpenInfra PTG was October 21-25, 202415:13
rpittau#link  https://etherpad.opendev.org/p/ironic-ptg-october-202415:13
rpittauwondering if anyone has any feedback on the PTG15:14
jssfrTheJulia, ah no, in our case it was simply that we borked the network15:14
jssfrI think, anyway15:15
kubajjo/15:15
TheJuliaI think the PTG was quite good15:15
rpittauI agree :)15:15
TheJuliaI would love to see blog posts/videos/summaries15:15
jssfrand by "bork the network" I mean that we broke layer 2 between the IPMI interfaces and ironic15:16
rpittauTheJulia: I sent my summary already as OpenInfra is planning a blog post, there wil lalso be a OIL about that15:16
TheJuliaoh cool cool15:16
rpittaunot sure about the dates yet15:16
TheJuliaa blog post on ironicbaremetal.org would be good though :)15:17
rpittautrue!15:17
rpittauI'm out starting Wednesday though, not sure I'll be able to do that this week, if someone else has the time and wants to do it please go ahead :)15:19
rpittauany other feedback on PTG ?15:19
cidHow does publishing on ironicbaremetal.org work.15:20
TheJuliacid: I can cover that later :)15:20
cidOk great,15:20
rpittauok, moving forward15:20
rpittau#info 2023.1 Antelope transition to Unmaintained at the end of October15:20
rpittau#info all projects got their final release15:21
rpittau#link  https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/UDQAC7SR5JAQJE5WBAG54A2MTBVBTJ44/15:21
rpittaunothing to add there15:21
rpittau#topic Discussion15:21
rpittauI've already asked feedback for the PTG15:22
rpittauanything else to discuss?15:22
TheJuliaAs an aside from the meeting, jssfr's issue sounds like https://bugs.launchpad.net/ironic/+bug/2069074, where the bmc went on vacation or connectivity to the bmc went on vacation for a little bit at the very last step.15:22
TheJuliaI don't really think so, expect a couple specs in the next few days15:23
rpittauok15:23
rpittauand yes jssfr issue sounds indeed like that15:24
jssfr(my money is still on "we broke the network and it's not a BMC issue")15:24
TheJuliaperhaps15:24
TheJuliasimilar issues :)15:24
rpittauanyhow! moving on15:25
rpittau#topic Bug Deputy Updates15:25
masgharWe had 8-9 new bugs, and an RFE15:26
masghar(2 bugs are related to the same situation)15:26
masgharI've added a link to a Google document with my thoughts on how to triage each bug15:26
TheJuliagoogle document?15:27
rpittauthanks masghar, anything we should urgently look at?15:27
masgharIf anything looks amiss, do let me know! (I also realized that I can't add the triaged label or set Importance)15:27
masgharTheJulia: https://docs.google.com/document/d/1fGGfg3OP69rOYvvn17zZ2ve_muVZKreMbrS_UVrs3IA/edit?tab=t.0#heading=h.2pr03n6dei3615:27
masgharrpittau: No, I don't think so15:28
rpittaumasghar: for the permissions change I honestly don't remember, but I think we recently changed that for cid, maybe he remembers how to do that15:28
TheJuliaI think  you have to be added to the ironic bugs group (I don't remember the precise name)15:29
cidI can indeed help with that rpittau, masghar.15:29
rpittauok, thanks cid 15:29
masgharThanks cid!15:29
rpittaumasghar: for the issue with the translation job I think we need to update that as it's still running ubuntu bionic15:30
masgharThe job configuration should be in the respective repositories? 15:31
masgharI can take a look, try to find the configs and put up a PR15:31
rpittaumasghar: should be in the project-config repo15:32
masgharoh thanks, okay!15:32
rpittauor zuul-jobs ? :)15:32
rpittauanyway, one of the two, I think15:32
masgharAlright, will take a look :D15:33
rpittauthanks!15:33
masgharFor the openstack/ironic-lib and networking-baremetal projects, does it make sense to update the links in the docs?15:34
rpittauI think so15:35
rpittaualthough I'm a little surprised we don't run periodics for them15:35
rpittauwe may want to investigate if we can add them back, if they were removed at some point15:37
masgharHold on, I may have made a mistake there, because I now see job runs for ironic-lib: https://zuul.opendev.org/t/openstack/builds?project=openstack%2Fironic-lib&pipeline=periodic&pipeline=periodic-stable&result=FAILURE&result=RETRY_LIMIT&result=POST_FAILURE&result=ERROR&skip=015:37
rpittaummm no builds found15:37
masgharAnd also for networking-baremetal now: https://zuul.opendev.org/t/openstack/builds?project=openstack%2Fnetworking-baremetal&pipeline=periodic&pipeline=periodic-stable&skip=015:38
TheJuliaI've found historical searches can take a while to eecute15:38
TheJuliaand show as no results while the query runs15:38
rpittauok15:38
rpittauso NBM looks ok15:39
masgharOh that explains it 15:39
TheJuliasince it is going back into 2022 in the history15:39
rpittauironic-lib is not actually documented in our docs, so looks fine 15:39
masgharMakes sense!15:39
rpittauwe can revisit this and maybe decide to add them, but not urgent15:40
rpittauanything else to report ?15:40
masgharNo15:40
rpittauthanks masghar :)15:40
rpittaucan I ask for a volunteer for this week bug deputy ?15:41
masgharI can take it15:41
cidThanks, masghar. I could handle it for the week.15:41
cidor both of us, if you don't mind.15:41
rpittaulet's switch to cid for this week, thanks masghar :)15:41
cid++15:41
masgharThanks cid! Go right ahead15:41
rpittauand thanks cid!15:41
rpittauok, I've dupated the meeting page15:42
rpittauanything else to discuss today?15:42
TheJuliaso we can close the meeting and I can cover how to publish to the ironicbaremetal.org site15:42
rpittauperfect15:42
rpittauthanks everyone!15:43
rpittau#endmeeting15:43
opendevmeetMeeting ended Mon Oct 28 15:43:04 2024 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:43
opendevmeetMinutes:        https://meetings.opendev.org/meetings/ironic/2024/ironic.2024-10-28-15.00.html15:43
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/ironic/2024/ironic.2024-10-28-15.00.txt15:43
opendevmeetLog:            https://meetings.opendev.org/meetings/ironic/2024/ironic.2024-10-28-15.00.log.html15:43
TheJuliaSo, the secret to ironicbaremetal.org is https://github.com/OpenStackweb/ironic-website15:43
cidmasghar, quick question, on the docs, what importance do you have in mind when you say 'normal'?15:43
TheJuliaChanges are pull requests, blog posts specifically are treated as markdown15:43
TheJuliahttps://github.com/OpenStackweb/ironic-website/pull/50/files15:43
TheJuliaExample15:43
masgharcid: Is there an equivalent importance level to Normal? 15:44
cidI see: https://usercontent.irccloud-cdn.com/file/GEgCP1Hw/image.png15:45
masgharTheJulia: oh I wasn't aware of this Github organization15:45
masgharcid: Medium should it15:45
cidAlright.15:45
cidTheJulia: Thanks. So, create a pull request, get reviewed, approved or declined, just like with code -)15:46
TheJuliaSo, the whole thing with website is the foundation did the base design/template using the same underlying tooling they use15:46
TheJuliacid: exactly15:46
TheJuliaThe pull request should get a result posted to the change for CI purposes15:47
TheJuliawhich should have a preview15:47
TheJuliabut it has been a while since I've made a change15:47
TheJuliaif that doesn't work, we can engage the staff15:48
TheJuliain the backend, everything gets converted to rendered html, and there is a way to do it locally, but I honestly don't remember15:48
TheJuliamasghar: So the foundation has always hosted websites as separate from project items/materials since largely it is foundation staff in the driving seat as opposed to the project. For that they use github, and on the ironic-website repo we have specific permissions shared with us. I think we have sufficient access to grant others with access as well, but I'd need to check. In any event, getting the staff to chnage 15:55
TheJuliasomething is not a big deal15:55
masgharTheJulia: that makes sense! It would be nice to have PTG discussions on the website too 15:56
masgharIt can signal: The project is alive and well!15:57
TheJuliaexactly15:57
mohammed_Hi dtantsur and rpittau the small TLS patch got merged into sushytools wondering if I can get patch release soon v1.3.1 ? 16:15
* dtantsur is not a release manager, deferring to rpittau16:18
cardoehrm let's do the py3.8 drop first?16:19
rpittaumohammed_: we should wait for the py3.8 removal https://review.opendev.org/c/openstack/sushy-tools/+/93325916:20
mohammed_Thanks rpittau 16:23
cidhttps://bugs.launchpad.net/ironic/+bug/208471316:23
cidThis one may not be a bug — yet — (just as masghar documented), what to do!16:23
opendevreviewDoug Goldstein proposed openstack/sushy-tools master: add pyproject.toml to support pip 23.1  https://review.opendev.org/c/openstack/sushy-tools/+/93359416:23
cardoeerr I meant pip 23.1 support16:24
TheJuliarpittau: when did you send the email to the list? Asking because I'm not seeing anything in my mailbox (yet)16:32
rpittauTheJulia: haven't sent the mail to the list, directly to openinfra16:33
TheJuliahuh?16:33
TheJuliaI'm not sure I understand16:33
opendevreviewDoug Goldstein proposed openstack/python-ironicclient master: bump minimum pbr version for pip 23.1 support  https://review.opendev.org/c/openstack/python-ironicclient/+/93359716:33
rpittauTheJulia: I sent the summary directly for an article on the SuperUser Blog, not to the mailing list16:34
TheJuliaOH!16:34
TheJuliaokay16:34
TheJulianow I understand!16:34
TheJuliathanks!16:34
rpittaunp :)16:35
TheJuliarpittau: any idea when that will be published?16:35
rpittauI don't have any dates yet, I think next week though16:35
TheJuliaokay cool!16:36
rpittaugood night! o/16:48
opendevreviewJulia Kreger proposed openstack/ironic-specs master: OCI Container Registry Image Source  https://review.opendev.org/c/openstack/ironic-specs/+/93361219:17
opendevreviewJulia Kreger proposed openstack/ironic-specs master: OCI Container Registry Image Source  https://review.opendev.org/c/openstack/ironic-specs/+/93361219:26
opendevreviewJulia Kreger proposed openstack/ironic-specs master: OCI Container Registry Image Source  https://review.opendev.org/c/openstack/ironic-specs/+/93361219:30
mnasiadkaHello - anybody LLDP savvy? I'm getting "Organizationally Unique ID 0012bb not recognized" from ironic_inspector.common.lldp_parsers on a couple of bare metals21:08
mnasiadkaOk, that looks to be LLDP MED extension, let me find is that bloody ConnectX firmware or the Cumulus switch sending these...21:16
opendevreviewJulia Kreger proposed openstack/ironic-specs master: OCI Container Registry Image Source  https://review.opendev.org/c/openstack/ironic-specs/+/93361223:59
opendevreviewJulia Kreger proposed openstack/ironic-specs master: Support for bootable containers  https://review.opendev.org/c/openstack/ironic-specs/+/93362023:59

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!