opendevreview | Steve Baker proposed openstack/ironic-python-agent master: Fully parse EFI boot entry device path https://review.opendev.org/c/openstack/ironic-python-agent/+/900739 | 03:26 |
---|---|---|
arne_wiebalck | Good morning, Ironic! | 07:48 |
rpittau | good morning ironic! o/ | 07:49 |
opendevreview | Merged openstack/sushy-tools master: Add Support testing for HttpBootUri https://review.opendev.org/c/openstack/sushy-tools/+/896963 | 10:03 |
opendevreview | Baptiste Jonglez proposed openstack/networking-generic-switch master: Introduce NGS agent design https://review.opendev.org/c/openstack/networking-generic-switch/+/897047 | 10:44 |
opendevreview | Baptiste Jonglez proposed openstack/networking-generic-switch master: Fix batching error due to outdated etcd3gw https://review.opendev.org/c/openstack/networking-generic-switch/+/886404 | 10:47 |
iurygregory | good morning Ironic | 12:14 |
opendevreview | Adam Rozman proposed openstack/ironic master: implement basic-auth support for user image download process https://review.opendev.org/c/openstack/ironic/+/890411 | 13:37 |
TheJulia | good morning | 13:49 |
iurygregory | good morning TheJulia =) | 13:50 |
*** dking is now known as Guest6840 | 14:21 | |
rpittau | TheJulia: discussion ongoing in the release channel for the bugfix branches retirement | 14:23 |
TheJulia | ack, thanks | 14:23 |
TheJulia | (focusing on a call at the moment) | 14:24 |
Guest6840 | I know that it's technically off topic for here, but any of the Metal3/BaremetalOperator guys here know about hosts getting stuck in the "preparing" state? I have a node that's in "preparing", but in Ironic, it looks fine in the "manageable" state. | 14:24 |
TheJulia | dtantsur: iurygregory: ^^^ | 14:24 |
TheJulia | Guest6840: is the node in maintenance? | 14:25 |
TheJulia | Guest6840: Also, you might want to change your nick name :) Unless it is truly Guest6840 :) | 14:25 |
*** Guest6840 is now known as dking | 14:26 | |
TheJulia | o/ dking | 14:26 |
dking | Stupid IRC client. lol For some reason, it refuses to log me in here. | 14:26 |
iurygregory | it happens | 14:26 |
TheJulia | dking: just don't give cookies to your IRC client, it has misbehaved :) | 14:27 |
TheJulia | speaking of, is CI behaving this morning? | 14:27 |
TheJulia | (speaking of cookies, that is) | 14:27 |
dking | Maybe I haven't given it enough cookies. I'm a bad IRC client parent. | 14:27 |
dking | TheJulia: It is currently not in maintenance. | 14:28 |
iurygregory | I remember some issues with the nodes stuck in preparing state, but I think we got some PRs merged to fix that... | 14:28 |
TheJulia | dking: heh, if the IRC client is a corgi, "always" with a look of sadness. At least if the client was my corgi. | 14:30 |
TheJulia | dking: Any idea on version/when the Metal3 operator your using is from? | 14:30 |
TheJulia | iurygregory: I remember one or two similar things super early on, but nothing recent | 14:30 |
iurygregory | yeah | 14:31 |
TheJulia | dking: do you have introspection setup/known working? | 14:33 |
TheJulia | I'm kind of wondering if things have gone sideways there, I wonder what introspection things is going on | 14:34 |
dking | TheJulia: It looks like we're using quay.io/metal3-io/baremetal-operator:v0.4.0 | 14:35 |
dking | TheJulia: I don't think that we're doing anything with introspection. We do a lot with inspection, but that seemed to complete well. | 14:36 |
TheJulia | so that is likely where we need to dig at | 14:37 |
dking | In Ironic, it looks fine. | 14:38 |
TheJulia | what about ironic-inspector? | 14:38 |
dking | However, now I tried to delete the node to re-add it, and it's not deleting, so I'm wondering if BMO has something deeper going on. | 14:38 |
TheJulia | ... Interesting | 14:38 |
iurygregory | probably is still doing something on the BMH? | 14:41 |
iurygregory | and you are in a state in BMO where you can't really delete? | 14:42 |
dking | It looks like BMO was just updated recently, so now we're looking at something a little deeper. It might need some further investigation. | 14:43 |
dking | We might have some stuff broken. | 14:43 |
dking | I heard something about version 0.4.0 having some breaking changes. Does anybody know? | 14:44 |
iurygregory | not sure | 14:45 |
iurygregory | but I would ask in the k8s slack | 14:45 |
dking | Okay. We're going to break and maybe redeploy. Thank you. | 14:46 |
dtantsur | dking: preparing is ~ manual cleaning | 14:48 |
dtantsur | it gets triggered on BIOS settings or RAID settings changes. Have you changed anything? | 14:48 |
dtantsur | when a stage change is reflected in BMO but not in Ironic, it's a good sign that BMO has failed to prepare for something | 14:49 |
dking | dtantsur: It was a new node, so the change was that it was added to BMO. | 14:50 |
dtantsur | hmm, then only BMO logs can tell | 14:50 |
TheJulia | Was I supposed to run the meeting this week? | 15:02 |
* dtantsur no idea | 15:02 | |
TheJulia | #startmeeting ironic | 15:02 |
opendevmeet | Meeting started Mon Nov 13 15:02:47 2023 UTC and is due to finish in 60 minutes. The chair is TheJulia. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:02 |
opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:02 |
opendevmeet | The meeting name has been set to 'ironic' | 15:02 |
TheJulia | o/ | 15:02 |
iurygregory | o/ | 15:02 |
dtantsur | o/ | 15:02 |
rpittau | o/ | 15:02 |
TheJulia | Greetings folks, Welcome to our weekly meeting! With your host this week, TheJulia! | 15:03 |
TheJulia | #link https://wiki.openstack.org/wiki/Meetings/Ironic#Agenda_for_next_meeting | 15:03 |
TheJulia | #topic Announcements / Reminders | 15:03 |
JayF | time got away from me, sorry | 15:03 |
TheJulia | #chair JayF | 15:04 |
opendevmeet | Current chairs: JayF TheJulia | 15:04 |
JayF | I'm here just didn't see the clock tick over :D downside of starting work before 7a | 15:04 |
TheJulia | JayF: would you like to drive | 15:04 |
TheJulia | ? | 15:04 |
JayF | I can | 15:04 |
TheJulia | happy to just keep going | 15:04 |
JayF | #topic Caracal release schedule | 15:04 |
JayF | #link https://releases.openstack.org/caracal/schedule.html | 15:04 |
TheJulia | JayF: you blew past the standing reminder | 15:04 |
* TheJulia serves JayF more coffee | 15:05 | |
JayF | Why did I read it as #info'd in the logs if it wasn't? | 15:05 |
JayF | Hey folks; review hash-tagged things, please? | 15:05 |
JayF | If someone is reading our meeting minutes; I trust they have the review dashboard bookmarked and will not worry about the minutes :D | 15:05 |
JayF | Carcal release, R-20, libraries release have been proposed | 15:06 |
JayF | we have patches up proposing releases for sushy and metalsmith | 15:06 |
JayF | That's really the only action from release timeline, anything else or i'll move on | 15:06 |
TheJulia | We do have some patches up for sushy now, so reviews there might be good if we're looking to cut a new release | 15:07 |
JayF | #info Please review sushy patches: https://review.opendev.org/q/status:open+-is:wip+repo:openstack/sushy in anticipation of C-1 release of it | 15:08 |
JayF | Moving on | 15:08 |
JayF | #topic Review Ironic CI Status | 15:08 |
JayF | how are things? I think stuff is landing again now? | 15:09 |
TheJulia | We had lots of intermittence last week it seemed | 15:09 |
TheJulia | I haven't looked yet this week, downside of 7 am for me right now | 15:09 |
JayF | ack; yeah, things are landing there is nothing systemmatic | 15:10 |
JayF | I'd believe there are intermittant issues | 15:10 |
JayF | If nothing else on ci, going to move on | 15:11 |
JayF | #topic Bug Deputy role proposal | 15:12 |
JayF | As discussed at vPTG, I've proposed a bug deputy role | 15:13 |
JayF | #link https://review.opendev.org/c/openstack/ironic/+/900449 | 15:13 |
JayF | Please review for scope and scheduling. Please do not bother +2'ing such a change unless you'd be willing to be the deputy for at least a week | 15:13 |
JayF | On a related note, while working on setup for this, I added LP bugtrackers for IPA-builder, metalsmith, IPE | 15:14 |
dtantsur | We really need some dashboards rather than a ton of links.. | 15:14 |
dtantsur | have you had any success finding a home for my old dashboard? | 15:14 |
JayF | dtantsur: I agree-ish, but I also think doing ~something is better than waiting for it all to front load | 15:14 |
JayF | dtantsur: I scoped myself to write the doc for now primarily due to time and because of review | 15:15 |
dtantsur | I'm vary of a quick burn-out followed by abandoning bugs again | 15:15 |
dtantsur | if you find where to deploy the dashboard, I can try to ensure it's in a good shape. I have some cycles this week. | 15:15 |
dtantsur | (In other words, you can consider me the bug deputy for this week) | 15:16 |
JayF | well, we don't know what that means yet :D but I'm onboard lol | 15:16 |
dtantsur | The first week will be about defining what it means and maybe forming some good practices. And the dashboards. | 15:17 |
JayF | ++ that makes sense, lets just make sure that definition ends up in taht doc I proposed above | 15:17 |
JayF | (or somewhere else in Ironic docs, I don't care where as much as "written down at all") | 15:17 |
dtantsur | yeah. I guess that gives me the right to +2 this document :) | 15:18 |
JayF | lol my comment there was more like | 15:18 |
JayF | I mean more like, help define the scope if you're going to be a part of the group :D | 15:18 |
dtantsur | ++ | 15:18 |
JayF | Aight, we need to review that, dtantsur and I will work together on finding a home for the dash | 15:19 |
iurygregory | I will take a look at it | 15:20 |
JayF | So, I'm going to skip back in agenda | 15:20 |
JayF | in the chaos of me msising it was 7am I skipped | 15:20 |
JayF | #topic Review action items from previous meeting: http://eavesdrop.openstack.org/meetings/ironic/2023/ | 15:20 |
JayF | #info DONE JayF [from PTG] Submit something to contributor docs, drafting a bug deputy role which triages bugs, checks periodic job status, and runs a bug jam meeting | 15:21 |
JayF | #info DONE JayF [from PTG] Setup IPA-builder in launchpad (just follow normal lp instructions, add to openstack group) | 15:21 |
JayF | #info DONE, output mailed to list JayF Book a meeting with stakeholders; TheJulia JayF and johnthetubaguy minimum, on Nova driver bug fixing/hunting | 15:21 |
JayF | If you haven't read it, you really should read the email I put to the list about Ironic<>Nova driver if you care about Ironic<>Nova integrations ^ | 15:21 |
JayF | #topic Open Discussion | 15:22 |
JayF | So I have an open discussion item | 15:22 |
JayF | next week is a US holiday on Thursday, American Thanksgiving | 15:22 |
TheJulia | JayF: when was that email w/r/t nova<->ironic sent? | 15:22 |
JayF | I will be OOO visiting family all week. | 15:22 |
JayF | Would someone like to run the meeting or should we cancel it? | 15:22 |
TheJulia | I volunteered a couple weeks back to run it | 15:23 |
JayF | oh, good | 15:23 |
JayF | #info TheJulia to run the 11/20 meeting | 15:23 |
JayF | #link https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/EUP3AITYONBPAMGZHXWT7TXLF7DYKC4Y/ | 15:24 |
JayF | TheJulia: ^ | 15:24 |
JayF | Anything else for open discussion? | 15:24 |
rpittau | one more for the open discussion: retiring bugfix branches | 15:24 |
rpittau | I've made some progress hacking the release tool to correctly edit the yaml files to add the eol tags, we just need to convince the release team, discussion ongoing in the release channel :) | 15:24 |
rpittau | I just need to give the correct series at the beginning of the script as it gives as assumed we're working on a stable branch | 15:25 |
JayF | Thanks for tackling that; if there is not a lot of progress in IRC I'd suggest taking the context and the discussion to the list. | 15:25 |
rpittau | sounds good | 15:25 |
JayF | Anything else for open discussion? | 15:27 |
JayF | Last call? | 15:29 |
JayF | #endmeeting | 15:30 |
opendevmeet | Meeting ended Mon Nov 13 15:30:15 2023 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:30 |
opendevmeet | Minutes: https://meetings.opendev.org/meetings/ironic/2023/ironic.2023-11-13-15.02.html | 15:30 |
opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/ironic/2023/ironic.2023-11-13-15.02.txt | 15:30 |
opendevmeet | Log: https://meetings.opendev.org/meetings/ironic/2023/ironic.2023-11-13-15.02.log.html | 15:30 |
JayF | TheJulia: thanks for covering for me to start it, I saw the clock and had an oh-crap moment, heh | 15:30 |
JayF | the 7am meeting is right when I start work so it's either, I slip right into flow state right before the meeting and miss it or I am frantically rushing and slip into my chair just in time to start it | 15:30 |
JayF | Ironically being late to start the meeting equates to being early to starting work lol | 15:31 |
TheJulia | Heh, for you :) | 15:33 |
TheJulia | I'm just used to getting my workday started stupidly early most days | 15:33 |
JayF | fungi: clarkb: We have an Ironic bug dashboard that we're trying to revitalize. We're evaluating if we're better off running it "out of band" so to speak or if we can do the legwork to get it running in infra. Looking for if you all have thoughts on that. "Please not more crap to run" is an OK answer :D | 15:34 |
JayF | dtantsur: ^ | 15:35 |
fungi | JayF: we ran something like that called "bugday" for a very long time, but decommissioned it because it was basically unused and bitrotting with nobody looking at it | 15:39 |
fungi | one option might be for ironic volunteers to run it on a vm opendev boots for that purpose, similar to how dpawlik is running the opensearch-based job log analysis system | 15:40 |
JayF | fungi: that would be ~ideal, I think, if we did it out of band I likely would've gotten a VPS booted and gave it to dtantsur lol | 15:40 |
dtantsur | works for me | 15:41 |
JayF | it's also a trivial python app that would probably be ezpz to containerize | 15:41 |
JayF | does it need a db dtantsur ? it doesn't, does it? | 15:41 |
dtantsur | it's completely stateless now | 15:41 |
fungi | we can discuss it with the broader opendev sysadmin team in tomorrow's 19:00 utc meeting if you like (in #opendev-meeting) | 15:41 |
dtantsur | a bit late for me but I can try | 15:42 |
JayF | dtantsur: maybe summarize what we need in an etherpad, I'll rep us | 15:42 |
JayF | dtantsur: you can sleep/relax/have an evening | 15:42 |
fungi | i can probably represent the request in the meeting if desired, just please add it to https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Agenda_for_next_meeting so that it will be included in the agenda clarkb sends out later today | 15:42 |
dtantsur | JayF: all we need is an ability to run a Python application | 15:44 |
* JayF adding running https://github.com/dtantsur/ironic-bug-dashboard to agenda | 15:45 | |
fungi | thanks! | 15:45 |
dtantsur | here, got a dockerfile https://github.com/dtantsur/ironic-bug-dashboard/blob/master/Dockerfile | 16:11 |
rpittau | JayF, TheJulia, dtantsur: bugfix branches retirement: this is the result of the hacking so far https://review.opendev.org/c/openstack/releases/+/900810 | 16:58 |
TheJulia | how does the "eol" flag get set? | 17:00 |
* JayF AFK for a couple hours-ish | 17:02 | |
rpittau | TheJulia: as for other releases a tag is created, in this case with the bugfix-name-eol | 17:03 |
rpittau | once the patch merges | 17:03 |
TheJulia | ack, that seems sensible | 17:03 |
rpittau | this follow exactly the same workflow as for creating the bugfix branches, but also the same as all other branches | 17:04 |
TheJulia | awesome | 17:04 |
rpittau | not sure if there's a better way to get the corresponding stable branch | 17:06 |
rpittau | let's see what the release team says | 17:06 |
rpittau | and time to go, see you tomorrow! o/ | 17:10 |
TheJulia | o/ | 17:20 |
dtantsur | JayF: I've reworked the dashboard significantly: added missing projects, changed style, moved to aiohttp | 18:44 |
dtantsur | I think I'll leave it there for now | 18:44 |
JayF | ack | 18:45 |
JayF | once we get it up and running, might not hurt to email the list about it | 18:45 |
JayF | with other projects going back to LP, they may want to use it for their own purposes | 18:45 |
JayF | and it's obviously not built for that now, but if they wanna make it configurable I'm sure you'd take the patches, right? lol | 18:45 |
dtantsur | sure thing | 18:46 |
opendevreview | Steve Baker proposed openstack/ironic-python-agent master: Parse efibootmgr type and details https://review.opendev.org/c/openstack/ironic-python-agent/+/899775 | 21:52 |
opendevreview | Steve Baker proposed openstack/ironic-python-agent master: Fully parse EFI boot entry device path https://review.opendev.org/c/openstack/ironic-python-agent/+/900739 | 21:52 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!