Monday, 2023-11-13

opendevreviewSteve Baker proposed openstack/ironic-python-agent master: Fully parse EFI boot entry device path  https://review.opendev.org/c/openstack/ironic-python-agent/+/90073903:26
arne_wiebalckGood morning, Ironic!07:48
rpittaugood morning ironic! o/07:49
opendevreviewMerged openstack/sushy-tools master: Add Support testing for HttpBootUri  https://review.opendev.org/c/openstack/sushy-tools/+/89696310:03
opendevreviewBaptiste Jonglez proposed openstack/networking-generic-switch master: Introduce NGS agent design  https://review.opendev.org/c/openstack/networking-generic-switch/+/89704710:44
opendevreviewBaptiste Jonglez proposed openstack/networking-generic-switch master: Fix batching error due to outdated etcd3gw  https://review.opendev.org/c/openstack/networking-generic-switch/+/88640410:47
iurygregorygood morning Ironic12:14
opendevreviewAdam Rozman proposed openstack/ironic master: implement basic-auth support for user image download process  https://review.opendev.org/c/openstack/ironic/+/89041113:37
TheJuliagood morning13:49
iurygregorygood morning TheJulia =)13:50
*** dking is now known as Guest684014:21
rpittauTheJulia: discussion ongoing in the release channel for the bugfix branches retirement14:23
TheJuliaack, thanks14:23
TheJulia(focusing on a call at the moment)14:24
Guest6840I know that it's technically off topic for here, but any of the Metal3/BaremetalOperator guys here know about hosts getting stuck in the "preparing" state? I have a node that's in "preparing", but in Ironic, it looks fine in the "manageable" state.14:24
TheJuliadtantsur: iurygregory: ^^^14:24
TheJuliaGuest6840: is the node in maintenance?14:25
TheJuliaGuest6840: Also, you might want to change your nick name :) Unless it is truly Guest6840 :)14:25
*** Guest6840 is now known as dking14:26
TheJuliao/ dking14:26
dkingStupid IRC client. lol For some reason, it refuses to log me in here.14:26
iurygregoryit happens14:26
TheJuliadking: just don't give cookies to your IRC client, it has misbehaved :)14:27
TheJuliaspeaking of, is CI behaving this morning?14:27
TheJulia(speaking of cookies, that is)14:27
dkingMaybe I haven't given it enough cookies. I'm a bad IRC client parent.14:27
dkingTheJulia: It is currently not in maintenance.14:28
iurygregoryI remember some issues with the nodes stuck in preparing state, but I think we got some PRs merged to fix that...14:28
TheJuliadking: heh, if the IRC client is a corgi, "always" with a look of sadness. At least if the client was my corgi.14:30
TheJuliadking: Any idea on version/when the Metal3 operator your using is from?14:30
TheJuliaiurygregory: I remember one or two similar things super early on, but nothing recent14:30
iurygregoryyeah14:31
TheJuliadking: do you have introspection setup/known working?14:33
TheJuliaI'm kind of wondering if things have gone sideways there, I wonder what introspection things is going on14:34
dkingTheJulia: It looks like we're using quay.io/metal3-io/baremetal-operator:v0.4.014:35
dkingTheJulia: I don't think that we're doing anything with introspection. We do a lot with inspection, but that seemed to complete well.14:36
TheJuliaso that is likely where we need to dig at14:37
dkingIn Ironic, it looks fine.14:38
TheJuliawhat about ironic-inspector?14:38
dkingHowever, now I tried to delete the node to re-add it, and it's not deleting, so I'm wondering if BMO has something deeper going on.14:38
TheJulia... Interesting14:38
iurygregoryprobably is still doing something on the BMH?14:41
iurygregoryand you are in a state in BMO where you can't really delete?14:42
dkingIt looks like BMO was just updated recently, so now we're looking at something a little deeper. It might need some further investigation.14:43
dkingWe might have some stuff broken.14:43
dkingI heard something about version 0.4.0 having some breaking changes. Does anybody know?14:44
iurygregorynot sure14:45
iurygregorybut I would ask in the k8s slack14:45
dkingOkay. We're going to break and maybe redeploy. Thank you.14:46
dtantsurdking: preparing is ~ manual cleaning14:48
dtantsurit gets triggered on BIOS settings or RAID settings changes. Have you changed anything?14:48
dtantsurwhen a stage change is reflected in BMO but not in Ironic, it's a good sign that BMO has failed to prepare for something14:49
dkingdtantsur: It was a new node, so the change was that it was added to BMO.14:50
dtantsurhmm, then only BMO logs can tell14:50
TheJuliaWas I supposed to run the meeting this week?15:02
* dtantsur no idea15:02
TheJulia#startmeeting ironic15:02
opendevmeetMeeting started Mon Nov 13 15:02:47 2023 UTC and is due to finish in 60 minutes.  The chair is TheJulia. Information about MeetBot at http://wiki.debian.org/MeetBot.15:02
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:02
opendevmeetThe meeting name has been set to 'ironic'15:02
TheJuliao/15:02
iurygregoryo/15:02
dtantsuro/15:02
rpittauo/15:02
TheJuliaGreetings folks, Welcome to our weekly meeting! With your host this week, TheJulia!15:03
TheJulia#link https://wiki.openstack.org/wiki/Meetings/Ironic#Agenda_for_next_meeting15:03
TheJulia#topic Announcements / Reminders15:03
JayFtime got away from me, sorry15:03
TheJulia#chair JayF15:04
opendevmeetCurrent chairs: JayF TheJulia15:04
JayFI'm here just didn't see the clock tick over :D downside of starting work before 7a15:04
TheJuliaJayF: would you like to drive15:04
TheJulia?15:04
JayFI can15:04
TheJuliahappy to just keep going15:04
JayF#topic  Caracal release schedule15:04
JayF#link https://releases.openstack.org/caracal/schedule.html15:04
TheJuliaJayF: you blew past the standing reminder15:04
* TheJulia serves JayF more coffee15:05
JayFWhy did I read it as #info'd in the logs if it wasn't?15:05
JayFHey folks; review hash-tagged things, please?15:05
JayFIf someone is reading our meeting minutes; I trust they have the review dashboard bookmarked and will not worry about the minutes :D 15:05
JayFCarcal release, R-20, libraries release have been proposed15:06
JayFwe have patches up proposing releases for sushy and metalsmith15:06
JayFThat's really the only action from release timeline, anything else or i'll move on15:06
TheJuliaWe do have some patches up for sushy now, so reviews there might be good if we're looking to cut a new release15:07
JayF#info Please review sushy patches: https://review.opendev.org/q/status:open+-is:wip+repo:openstack/sushy in anticipation of C-1 release of it15:08
JayFMoving on15:08
JayF#topic Review Ironic CI Status15:08
JayFhow are things? I think stuff is landing again now?15:09
TheJuliaWe had lots of intermittence last week it seemed15:09
TheJuliaI haven't looked yet this week, downside of 7 am for me right now15:09
JayFack; yeah, things are landing there is nothing systemmatic15:10
JayFI'd believe there are intermittant issues15:10
JayFIf nothing else on ci, going to move on15:11
JayF#topic Bug Deputy role proposal15:12
JayFAs discussed at vPTG, I've proposed a bug deputy role15:13
JayF#link https://review.opendev.org/c/openstack/ironic/+/90044915:13
JayFPlease review for scope and scheduling. Please do not bother +2'ing such a change unless you'd be willing to be the deputy for at least a week15:13
JayFOn a related note, while working on setup for this, I added LP bugtrackers for IPA-builder, metalsmith, IPE15:14
dtantsurWe really need some dashboards rather than a ton of links..15:14
dtantsurhave you had any success finding a home for my old dashboard?15:14
JayFdtantsur: I agree-ish, but I also think doing ~something is better than waiting for it all to front load15:14
JayFdtantsur: I scoped myself to write the doc for now primarily due to time and because of review15:15
dtantsurI'm vary of a quick burn-out followed by abandoning bugs again15:15
dtantsurif you find where to deploy the dashboard, I can try to ensure it's in a good shape. I have some cycles this week.15:15
dtantsur(In other words, you can consider me the bug deputy for this week)15:16
JayFwell, we don't know what that means yet :D but I'm onboard lol15:16
dtantsurThe first week will be about defining what it means and maybe forming some good practices. And the dashboards.15:17
JayF++ that makes sense, lets just make sure that definition ends up in taht doc I proposed above15:17
JayF(or somewhere else in Ironic docs, I don't care where as much as "written down at all")15:17
dtantsuryeah. I guess that gives me the right to +2 this document :)15:18
JayFlol my comment there was more like15:18
JayFI mean more like, help define the scope if you're going to be a part of the group :D15:18
dtantsur++15:18
JayFAight, we need to review that, dtantsur and I will work together on finding a home for the dash15:19
iurygregoryI will take a look at it15:20
JayFSo, I'm going to skip back in agenda15:20
JayFin the chaos of me msising it was 7am I skipped15:20
JayF#topic  Review action items from previous meeting: http://eavesdrop.openstack.org/meetings/ironic/2023/15:20
JayF#info DONE JayF [from PTG] Submit something to contributor docs, drafting a bug deputy role which triages bugs, checks periodic job status, and runs a bug jam meeting15:21
JayF#info DONE JayF [from PTG] Setup IPA-builder in launchpad (just follow normal lp instructions, add to openstack group)15:21
JayF#info DONE, output mailed to list JayF Book a meeting with stakeholders; TheJulia JayF and johnthetubaguy minimum, on Nova driver bug fixing/hunting 15:21
JayFIf you haven't read it, you really should read the email I put to the list about Ironic<>Nova driver if you care about Ironic<>Nova integrations ^15:21
JayF#topic Open Discussion15:22
JayFSo I have an open discussion item15:22
JayFnext week is a US holiday on Thursday, American Thanksgiving15:22
TheJuliaJayF: when was that email w/r/t nova<->ironic sent?15:22
JayFI will be OOO visiting family all week.15:22
JayFWould someone like to run the meeting or should we cancel it?15:22
TheJuliaI volunteered a couple weeks back to run it15:23
JayFoh, good15:23
JayF#info TheJulia to run the 11/20 meeting15:23
JayF#link https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/EUP3AITYONBPAMGZHXWT7TXLF7DYKC4Y/15:24
JayFTheJulia: ^15:24
JayFAnything else for open discussion?15:24
rpittauone more for the open discussion: retiring bugfix branches15:24
rpittauI've made some progress hacking the release tool to correctly edit the yaml files to add the eol tags, we just need to convince the release team, discussion ongoing in the release channel :)15:24
rpittauI just need to give the correct series at the beginning of the script as it gives as assumed we're working on a stable branch15:25
JayFThanks for tackling that; if there is not a lot of progress in IRC I'd suggest taking the context and the discussion to the list.15:25
rpittausounds good15:25
JayFAnything else for open discussion?15:27
JayFLast call?15:29
JayF#endmeeting15:30
opendevmeetMeeting ended Mon Nov 13 15:30:15 2023 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:30
opendevmeetMinutes:        https://meetings.opendev.org/meetings/ironic/2023/ironic.2023-11-13-15.02.html15:30
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/ironic/2023/ironic.2023-11-13-15.02.txt15:30
opendevmeetLog:            https://meetings.opendev.org/meetings/ironic/2023/ironic.2023-11-13-15.02.log.html15:30
JayFTheJulia: thanks for covering for me to start it, I saw the clock and had an oh-crap moment, heh15:30
JayFthe 7am meeting is right when I start work so it's either, I slip right into flow state right before the meeting and miss it or I am frantically rushing and slip into my chair just in time to start it15:30
JayFIronically being late to start the meeting equates to being early to starting work lol15:31
TheJuliaHeh, for you :)15:33
TheJuliaI'm just used to getting my workday started stupidly early most days15:33
JayFfungi: clarkb: We have an Ironic bug dashboard that we're trying to revitalize. We're evaluating if we're better off running it "out of band" so to speak or if we can do the legwork to get it running in infra. Looking for if you all have thoughts on that. "Please not more crap to run" is an OK answer :D 15:34
JayFdtantsur: ^15:35
fungiJayF: we ran something like that called "bugday" for a very long time, but decommissioned it because it was basically unused and bitrotting with nobody looking at it15:39
fungione option might be for ironic volunteers to run it on a vm opendev boots for that purpose, similar to how dpawlik is running the opensearch-based job log analysis system15:40
JayFfungi: that would be ~ideal, I think, if we did it out of band I likely would've gotten a VPS booted and gave it to dtantsur lol15:40
dtantsurworks for me15:41
JayFit's also a trivial python app that would probably be ezpz to containerize15:41
JayFdoes it need a db dtantsur ? it doesn't, does it?15:41
dtantsurit's completely stateless now15:41
fungiwe can discuss it with the broader opendev sysadmin team in tomorrow's 19:00 utc meeting if you like (in #opendev-meeting)15:41
dtantsura bit late for me but I can try15:42
JayFdtantsur: maybe summarize what we need in an etherpad, I'll rep us15:42
JayFdtantsur: you can sleep/relax/have an evening15:42
fungii can probably represent the request in the meeting if desired, just please add it to https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Agenda_for_next_meeting so that it will be included in the agenda clarkb sends out later today15:42
dtantsurJayF: all we need is an ability to run a Python application15:44
* JayF adding running https://github.com/dtantsur/ironic-bug-dashboard to agenda15:45
fungithanks!15:45
dtantsurhere, got a dockerfile https://github.com/dtantsur/ironic-bug-dashboard/blob/master/Dockerfile16:11
rpittauJayF, TheJulia, dtantsur: bugfix branches retirement: this is the result of the hacking so far https://review.opendev.org/c/openstack/releases/+/90081016:58
TheJuliahow does the "eol" flag get set?17:00
* JayF AFK for a couple hours-ish17:02
rpittauTheJulia: as for other releases a tag is created, in this case with the bugfix-name-eol17:03
rpittauonce the patch merges17:03
TheJuliaack, that seems sensible17:03
rpittauthis follow exactly the same workflow as for creating the bugfix branches, but also the same as all other branches17:04
TheJuliaawesome17:04
rpittaunot sure if there's a better way to get the corresponding stable branch17:06
rpittaulet's see what the release team says17:06
rpittauand time to go, see you tomorrow! o/17:10
TheJuliao/17:20
dtantsurJayF: I've reworked the dashboard significantly: added missing projects, changed style, moved to aiohttp18:44
dtantsurI think I'll leave it there for now18:44
JayFack18:45
JayFonce we get it up and running, might not hurt to email the list about it18:45
JayFwith other projects going back to LP, they may want to use it for their own purposes18:45
JayFand it's obviously not built for that now, but if they wanna make it configurable I'm sure you'd take the patches, right? lol18:45
dtantsursure thing18:46
opendevreviewSteve Baker proposed openstack/ironic-python-agent master: Parse efibootmgr type and details  https://review.opendev.org/c/openstack/ironic-python-agent/+/89977521:52
opendevreviewSteve Baker proposed openstack/ironic-python-agent master: Fully parse EFI boot entry device path  https://review.opendev.org/c/openstack/ironic-python-agent/+/90073921:52

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!