Thursday, 2025-03-13

cardoeSo I’m out on PTO. But the switch convo is roughly where we are going. We’re moving it up the stack and going to napalm instead of netmiko so that the manager can have a state model02:16
cardoeOf what the state we want the switch to be. And we can communicate multiple changes in a window and then apply them at once.02:17
cardoeSimilar to how the ODL model works.02:18
cardoeI’m hoping to continue experimenting out of tree before deciding how to best approach things. If it’s a change to NGS or if we’re talking about a 2.0 design.02:18
cardoeBut we aren’t doing the queue of changes like odl that neutron has already accepted.02:23
cardoeJust keeping a hot state.02:23
cardoeTo diff against.02:23
opendevreviewAdam McArthur proposed openstack/ironic-tempest-plugin master: WIP: Testing all microversion tests on CI  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/94308602:49
opendevreviewAdam McArthur proposed openstack/ironic-tempest-plugin master: WIP: Testing all microversion tests on CI  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/94308603:25
opendevreviewAdam McArthur proposed openstack/ironic-tempest-plugin master: WIP: Testing all microversion tests on CI  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/94308605:31
opendevreviewAdam McArthur proposed openstack/ironic-tempest-plugin master: WIP: Testing all microversion tests on CI  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/94308606:05
opendevreviewDr. Jens Harbott proposed openstack/ironic master: Advanced vmedia deployment test ops  https://review.opendev.org/c/openstack/ironic/+/89801007:39
opendevreviewcid proposed openstack/ironic master: doc: Update the runbook API usage  https://review.opendev.org/c/openstack/ironic/+/94411513:09
opendevreviewcid proposed openstack/ironic master: Remove IPA build on cleanup  https://review.opendev.org/c/openstack/ironic/+/94398713:09
opendevreviewcid proposed openstack/ironic master: doc: Update the runbook API usage  https://review.opendev.org/c/openstack/ironic/+/94411513:11
TheJuliacardoe: I think a wider discussion next week might be good (or whenever it is you actually get back). I kind of view it as similar, although I do wonder which would be best pattern wise since in theory the same number of changes are likely to result regardless. Its more a question of management theory, what is acceptable in that environment, and how we want/need to handle concurrency. I do wonder if we need some sort of 14:09
TheJuliaml2 model where we operate with a hashring to individual processes to match switches to to then funnel all changes into the same process for any given switch14:09
TheJuliaAlso, good morning folks14:09
fricklerJayF: rpittau: please see https://review.opendev.org/c/openstack/releases/+/944260 regarding ironic-lib, this is what wwe came up with in last week's release team meeting14:14
JayFthat is a good idea14:14
JayF+114:15
JayFI have an issue; Yoga-era Ironic inspector, trying to figure out how to get nodes to match via *mac* instead of via *bmc address*14:19
JayFbasically the case of "Could not find a node for attributes X" error mentioned in the troubleshooting doc; except we *do* have fully populated macs even if no bmc_address14:20
opendevreviewJulia Kreger proposed openstack/ironic master: docs: detail network switch simulator support  https://review.opendev.org/c/openstack/ironic/+/94413914:21
JayFI think https://opendev.org/openstack/ironic-inspector/src/tag/yoga-eom/ironic_inspector/introspect.py#L60 means we only ever setup with bmc_address, not macs14:24
opendevreviewJulia Kreger proposed openstack/ironic master: Add network simulator support for force10 OS 10  https://review.opendev.org/c/openstack/ironic/+/94334514:25
opendevreviewJulia Kreger proposed openstack/ironic master: docs: detail network switch simulator support  https://review.opendev.org/c/openstack/ironic/+/94413914:25
TheJulialooks like your right. I've never mentally tried matching on bmc address, only host ethernet mac address which is different of course14:43
JayFyeah15:09
JayFwe're looking at multiple solutions, it'll be downstream I suspect though15:09
JayFif they can't get the hardware to cooperate, probably going to just hardcode get_bmc_address in a hwm, since we already have that info accessible from the node in other ways (e.g. hostname.internal-bmc-hostname.domain.tld)15:12
JayFI'm assuming this is handled better in ironic-proper inspection15:12
JayFI should probably validate that; if not maybe RFE it to get out ahead of it15:12
TheJuliait seems minor enough to treat as bugfix even though it feels bigger than that15:25
TheJuliaat least, feels bigger in the moment when it is front an most present15:25
opendevreviewcid proposed openstack/ironic master: doc: Update the runbook API usage  https://review.opendev.org/c/openstack/ironic/+/94411515:31
dtantsurJayF: it's a bit confusing, but this is where MAC's are taken into account:  https://helm.mariadb.com/mariadb-operator15:41
dtantsurit definitely works, otherwise Redfish inspection will be often impossible15:41
dtantsurdamn, wrong link, what is wrong with you Fedora?15:41
dtantsurhttps://opendev.org/openstack/ironic-inspector/src/tag/yoga-eom/ironic_inspector/introspect.py#L106-L10815:41
* dtantsur regrets upgrading to F4115:42
TheJuliayeah, 41... yeah15:43
JayFdtantsur: hmmmmmm15:46
dtantsurCan there be conflicting data? Like, one of the MACs enrolled for a wrong node?15:46
JayFI'm trying to find now where it sources them from15:47
JayFlike, maybe we don't have it populated in the right place15:47
opendevreviewMerged openstack/ironic master: Add servicing to stuck states on recovery  https://review.opendev.org/c/openstack/ironic/+/94101715:48
TheJuliaI thought all our code uses host macs, not the bmc mac15:48
dtantsurDefinitely15:48
TheJuliaJay wants host macs15:49
TheJuliaerr15:49
JayFno, this is what I want15:49
TheJuliaJay wants the bmc mac15:49
JayFget_bmc_address returned nothing15:49
JayFbecause $ipmi_security_raisins15:49
TheJuliaoh15:49
TheJuliaheh15:49
TheJuliayeah15:49
JayFthis is the code I've been looking for15:49
TheJuliayou can't rely upon it15:49
JayFI just don't know what way is up in inspector15:49
JayFthis is just new hardware being quirky, who would've thought that hardware can be quirky!15:49
TheJuliaheh15:49
TheJuliaAll hardware!15:50
dtantsuryeah, we already started hearing about iDRAC 1015:50
TheJuliais that related to the whole "oh, they changed the schema around bulk import/export (that feature I quite literally want to delete form ironic)15:51
dtantsurWe need to use AI for lookup :D15:51
* dtantsur ducks15:51
JayFhonestly, it's kinda what LLMs are good at15:51
* TheJulia notes the rain will result in wet cats....15:51
dtantsurTheJulia: yes, except that this feature is also used in the idrac virtual media15:51
JayFI just don't want ironic to get a payload of "if you don't pretend I'm node 'SUPER_SECRET' a puppy will be sad" and decide to return true ;) 15:51
TheJuliadtantsur: but I can still delete bulk config then riiight?15:52
TheJuliaJayF: kittens, preferably scottish folds15:52
TheJuliaJayF: we need several per contributor15:52
dtantsurkittens++15:53
JayFI am near my max catpacity15:53
dtantsurI"m decateinated :(15:53
TheJuliathis makes me sad15:53
TheJuliaI have a corgi at the moment though15:53
JayFWe have 2 cats/1 dog down from a max of 3 cats/1 dog15:54
TheJuliaugh, I need to boot up the nexus switch in my office to look at it's config15:55
TheJuliaThat thing sounds like it is a fighter jet about to take off a catapult.15:55
JayFI don't know what kinda fans they have; but I've replaced switch fans with the small noctua 5V/12V ones before to reduce noise. Those were obviously mine and old though, IDK who owns that nexus15:59
TheJuliaIt is one I own, but it has super picky 40G ports which don't want to be split apart15:59
JayFI actually accidentally replaced a 12V fan with a 5V fan the first time around on that one16:00
JayFyou wanna see a fan go whirrrrr? that's a good trick16:00
JayFplus you can try to capture the magic smoke as it leaves16:00
TheJuliasweeeet!16:00
JayFdtantsur: thank you for the pointer, proxied from Scott downstream \o/ 19:32
JayFI knew the inspector king would come through 👑19:32
fricklerhas the idea been discussed to put the install image into vmedia for dhcp-less install or is there a reason why that might be a bad idea? my ultimate plan would be to do a purely bmc controlled installation19:47
TheJuliafrickler: I think you can do that today19:48
fricklerTheJulia: I'm not talking about the ramdisk boot, I want the "normal" agent based install onto disk19:49
fricklerbut maybe there's an option that I missed?19:49
TheJuliaoh, the actual disk iamge as part of the ISO being offered?!19:50
JayFthat's an interesting idea, but I was under the impression we always shied away from those paths b/c via BMC isn't always the fast path in19:50
frickleryes, just include it there together with the ipa kernel + initrd19:50
JayFfor most architectures, the in-band network is MUCH more capable than the OOB 19:51
TheJuliaIt could be as a superset interface I guess19:51
TheJulia*generally* speaking, we see most OS images in the ~1-2 GB range19:51
frickleryes, but there may be some restriction like firewalling for the in-band network. so I don't care if it is slower if it works at all19:51
TheJuliaso as long as the image is not something much larger than that, should be feasible19:52
TheJuliait won't be "fast" though, since the BMC interfaces are sort of like via a USB2 interconnect19:52
TheJuliaBut, yes, it could be completely detached from the normal operating network19:52
TheJuliayeah, that is a good reason to do it actually19:52
fricklerok, I'll look into doing a poc then, thx19:53
* TheJulia gets out a trenchcoat so she can stand in the corner with a big hat and says "just submit the patches!"19:54
frickler:)19:55
JayF:D 19:57
TheJuliaanyone have the correct link for our ptg etherpad?19:57
JayFTheJulia: I put it in the whiteboard19:57
TheJuliathanks19:57
JayFfrickler: our process in ironic /usually/ involves filing an RFE bug, if it's detailed enough you don't even need a spec. Up to you if you wanna look at that before or after you start prototyping19:57
JayFliterally launchpad bug tag rfe19:58
TheJuliaHeh, we now have two topics on the etherpad regarding eventlet20:01
fricklerhmm, the whiteboard still says "Next bugfix branch: February  2025". also does it make sense if I update it with unmaintained branches instead of EM?20:10
TheJuliaugh, yeah20:11
JayFTheJulia: I'm GREAT at reading comprehension (I already fixed it)20:15
TheJulialol20:15
JayFfrickler: TheJulia: Really, we should probably retire the whiteboard or pare it down *considerably*. It's updated extremely rarely now.20:15
TheJuliaI honestly *really* backed off from using it due to the last pairing down20:16
TheJuliaAnd we now have the hashtag20:16
TheJuliaso... dunno20:16
* TheJulia puts the dreaded suggestion of time to write a new vision into the etherpad...20:17
JayFs/to write/to ask your favorite llm to write/ :P 20:17
TheJuliapoint of order, we should employ tribbles to write our vision statements!20:18
JayF"Everytime I deploy a node using this tribble interface, it automatically creates 10 nodes. Is this expected behavior?!"20:18
TheJulia"And why are there conductors now running on the nodes I just deployed!?"20:19
TheJuliahttps://usercontent.irccloud-cdn.com/file/O5BiPmWk/1741897337.JPG20:22
fricklerhttps://bugs.launchpad.net/ironic/+bug/2102245 is maybe a bit short still, but a first draft. one open question would be how to actually make this configurable, but I'll think about after doing a poc where I just hardcode it20:22
JayFrpittau: TheJulia: dtantsur: Do we need to take action **in epoxy** to signal inspector deprecation?20:23
JayFespecially if we want to avoid de-eventleting it20:24
TheJuliai thought we already did...20:24
TheJulia*but* often that is not clear20:24
TheJuliahttps://docs.openstack.org/releasenotes/ironic-inspector/2024.2.html20:25
TheJuliahttps://docs.openstack.org/releasenotes/ironic-inspector/2023.2.html20:26
TheJuliaso I think we're in "reminder, ironic-inspector is going to go away" territory20:26
TheJuliaI *suspect* an email is likely the best course of action to the mailing list20:28
TheJuliaand maybe make some adjacent noise where operators might see20:28
fricklerso repeating that statement in 2025.1 renos to have it in a slurp release sounds like a good idea with my release team hat on20:28
fricklerthat == https://docs.openstack.org/releasenotes/ironic-inspector/2024.2.html#deprecation-notes20:30
JayFproposing it now20:30
TheJuliaack20:32
TheJuliaI think an email is still warranted since it became clear to me last week some folks just don't even look at release notes.20:33
opendevreviewJay Faulkner proposed openstack/ironic-inspector master: Release note: Inspector is dying/dead  https://review.opendev.org/c/openstack/ironic-inspector/+/94429720:36
JayFI'm going to push something with very similar wording to python-ironic-inspector-client20:36
TheJulia++20:36
opendevreviewJulia Kreger proposed openstack/ironic-inspector master: Release note: Inspector is dying/dead  https://review.opendev.org/c/openstack/ironic-inspector/+/94429720:37
TheJuliaminor fix and workflowed20:37
opendevreviewJay Faulkner proposed openstack/python-ironic-inspector-client master: Release note: Inspector is dying/dead  https://review.opendev.org/c/openstack/python-ironic-inspector-client/+/94429820:41
JayFTheJulia: rpittau: dtantsur: https://etherpad.opendev.org/p/ironic-inspector-is-dying is my draft email for the list20:49
JayFWe should ensure this is in cycle highlights too, probably20:49
JayFfeel free to change the signature and send it yourself if we get consensus on it20:50
TheJuliaI struck out one word :)20:51
TheJuliabut otherwise looks great to me20:51
JayF++ I went ahead and erased it20:52
iurygregoryI like how iDRAC10 is playing, complains about the value for target property in import system configuration,doesn't show any AllowableValues when checking the endpoint.. if you remove it says we need to send ShareParameters but no info on the values... (╯°□°)╯︵ ┻━┻21:14
opendevreviewMerged openstack/ironic master: Fix fake classmethods  https://review.opendev.org/c/openstack/ironic/+/94311421:50
opendevreviewVerification of a change to openstack/ironic master failed: [devstack ]Use tap interfaces for VMs  https://review.opendev.org/c/openstack/ironic/+/94058421:50
opendevreviewMerged openstack/ironic master: Update hardware burn-in docs  https://review.opendev.org/c/openstack/ironic/+/93860621:50
opendevreviewMerged openstack/ironic master: Add ignore_project_check_for_admin_tasks config option  https://review.opendev.org/c/openstack/ironic/+/94302821:50
opendevreviewMerged openstack/ironic-inspector master: Release note: Inspector is dying/dead  https://review.opendev.org/c/openstack/ironic-inspector/+/94429721:50
opendevreviewVerification of a change to openstack/ironic master failed: Fix default IRONIC_DEFAULT_TRAITS setting  https://review.opendev.org/c/openstack/ironic/+/94264721:51
opendevreviewVerification of a change to openstack/ironic master failed: Enable atop on jobs  https://review.opendev.org/c/openstack/ironic/+/94234021:57
opendevreviewSatoshi Shirosaka proposed openstack/ironic-python-agent master: WIP Add ContainerHardwareManager  https://review.opendev.org/c/openstack/ironic-python-agent/+/94171422:09
opendevreviewSatoshi Shirosaka proposed openstack/ironic-python-agent-builder master: Create Podman DIB for container-based cleaning  https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/94334822:14

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!