Tuesday, 2024-03-26

TheJuliacid: feedback posted on that, really good job it looks like, just a little more verbosity is needed for context setting, I think. :)00:08
cidI just saw it, will definitely incorporate that, ... later today 00:49
*** mmalchuk_ is now known as mmalchuk06:49
rpittaugood morning ironic! o/08:12
opendevreviewDmitry Tantsur proposed openstack/sushy master: Handle NotAcceptable when Accept-Encoding: identity is not allowed  https://review.opendev.org/c/openstack/sushy/+/91411810:06
dtantsurWorks in our testing ^^^10:06
iurygregorygood morning ironic11:06
iurygregorydtantsur, +211:28
dtantsurthx!11:49
iurygregorynp11:51
*** dking is now known as Guest397212:27
*** Guest3972 is now known as dking12:29
*** jamesdenton__ is now known as jamesdenton12:32
TheJuliagood morning13:11
opendevreviewJulia Kreger proposed openstack/ironic stable/zed: CI: Lock Zed CI to Zed IPA  https://review.opendev.org/c/openstack/ironic/+/91424313:33
rpittauI wonder if there's a way to get this ^ dynamically13:34
TheJuliaabsolutely13:35
TheJuliabut lets do that on master branch13:35
rpittauyeah13:35
TheJuliaZUUL_BRANCH13:35
rpittauexactly13:35
TheJuliaI'm going to jump in the shower and try to get my sinuses to clear, afterwards I'll post it to master branch13:37
rpittaugreat :)13:37
TheJuliawell, magical set13:37
opendevreviewcid proposed openstack/ironic-tempest-plugin master: Patch to enforce json extension works in existing API behaviour  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/91392613:45
opendevreviewJulia Kreger proposed openstack/ironic master: ci: automatically set the branch for IPA to match zuul_branch  https://review.opendev.org/c/openstack/ironic/+/91425013:58
rpittauwonderful, thanks TheJulia :)14:06
TheJuliaI looked at the others with master, and two of them, afaik are branchless actually, so really it didn't make sense to do much more than IPA14:07
TheJulia(being branchless is not an issue, fwiw)14:07
rpittauyep sounds good14:09
opendevreviewMerged openstack/sushy master: Handle NotAcceptable when Accept-Encoding: identity is not allowed  https://review.opendev.org/c/openstack/sushy/+/91411814:18
TheJuliacid: so I guess, reading your ironic API change, the base issue forcing the tempest change is there are tests which explicitly expect the bad behavior regardless of future version. I guess it makes sense then as long as we can get the tempest patch merged without the ironic patch.14:23
JayFTheJulia: I suggested to cid, (1) write a tempest test verifying existing behavior, which can later be modified to have a max_microversion, (2) change behavior behind microversion + add a patch on top of i-t-p to cap max_microversion on the existing test (3) write a test with min_microversion asserting new behavior14:25
TheJuliain that case, and at a glance of the tests, I'm unsure the ironic patch needs to be dependent on the ironic-tempest-plugin patch.14:27
JayFthe depends-on will let him use the first test to verify he changed behavior in ironic14:27
JayFremember he doesn't have a reliable local testing environment14:27
TheJuliaokay, so the intent is to remove it then before merging, that is fine then14:27
TheJuliayeah14:27
JayFso trying to cradle the changes in lots of testing :)14:27
TheJulia++14:28
TheJuliahttps://zuul.opendev.org/t/openstack/build/829cc68c66ab414f98c76259985bcf69 likely suggests we need to fix the microversion logic in the tempest plugin so skiptest gets applied14:31
cidfirst i-t-p change validated the existing behavior and the dependence setting showed ironic change (second patchset-ish) failed.14:31
TheJuliasince the test cannot run if the server can't see/speak it14:31
TheJulia(1.91 being requested against a 1.90 max api14:32
TheJulia)14:32
TheJuliaokay14:32
JayFTheJulia: I think all that logic is driven by conf, yeah? Remember the patch I had to push to zed(?)14:36
TheJuliaThis seems to be the big issue with the ironic patch, fwiw: AttributeError: <module 'ironic.api.controllers.v1.utils' from '/home/zuul/src/opendev.org/openstack/ironic/ironic/api/controllers/v1/utils.py'> does not have the attribute 'get_rpc_allocation_with_suffix'14:36
TheJuliaJayF: conf is likely a bad expectation to set if the test can clearly know based upon mins/maxes discoverable it is impossible14:36
TheJuliathink newer test with older ironic :)14:37
JayFThe older ironic would have max_microversion set to "x.yy" in the config and would automatically drop tests for newer microversions14:37
JayFI agree it shouldn't /need/ a conf, all the info is there14:37
JayFbut the way it's setup now is one patch per branch (at cut time if we were more disciplined) afaict14:37
TheJuliaYeah, that only makes sense if we were the sole consumer/user of the plugin, but people use the plugins externally and the more knowledge which needs to be encoded in configuration, the signifigantly harder the plugin becomes to use14:41
TheJuliaI'll post a patch to it after I eat some breakfast unless I get derailed14:41
JayFAh, I get what you're saying14:41
JayFI'm thinking only CI use case for i-t-p14:41
JayFwhen other folks (I'm assuming your downstream included) use it to validate installed clouds14:41
TheJuliayup14:42
cidhmm. I'm fixing the AttributeError now though14:47
cidoh, I see.... :D. 15:34
opendevreviewJulia Kreger proposed openstack/ironic-tempest-plugin master: WIP: leverage remote microversion without requiring human config  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/91427015:48
TheJuliaI think that might do it15:50
TheJuliaI guess we can see how horribly it blows up in CI :)15:51
TheJuliajanders: dtantsur: some some folks internally are looking to see if we can upload new secure boot keys via redfish. It looks like Dell supports posting to the Secure Boot Certificate Database, where as HPE does not. I've emailed Nisha directly, if you know of a way, I wonder if it might make sense to turn into a feature16:06
rpittauTheJulia: I think we were talking to the same people :)16:06
TheJuliawas the answer basically "uhh... looks like the standard suggests read-only"16:07
rpittauilo 5 does not provide a way to upload certificates for secure boot using redfish API16:07
dtantsurTheJulia: I did some early research and certain sushy patches. We're not crazily far from it, extensive testing on real hardware will be key16:07
TheJuliaThey ahppen to be looking at ilo616:07
TheJuliaHappen16:07
TheJuliaBut even then, looks read only apparently16:07
rpittaummm it looks like it was ilo5 for me HP gen 10 - DL380 Gen10 and DL360 Gen10 Plus16:08
dtantsurTheJulia: you need to look at the right place though: redfish is convoluted in this area16:09
dtantsura mix of CertificateService and actual SecureBoot resources16:09
rpittauanyway, looking at the official HP documentation plus the redfish api explorer it does look like it's read only16:09
TheJuliadtantsur: oh yeah, I already figured that out16:09
TheJuliarpittau: the ilo6 page someone sent me showed GET and Delete only16:09
dtantsuryeah, I left a TODO at the most interesting part https://opendev.org/openstack/sushy/commit/4abea1879fb2296b42590b2235a219e5f0a81d76 :D16:10
dtantsurah, I did https://opendev.org/openstack/sushy/commit/fa2e0015854b2885e6fbc532a0836a01f2ae329d as well16:10
TheJuliadtantsur: i <3 those todos16:10
TheJulia:)16:10
TheJuliawell, I emailed Nisha, we can see what she comes back with16:11
dtantsurhttps://opendev.org/openstack/sushy/commit/d7983c90b2b808e39116150837e961c3e9b8b7bc has interesting stuff, including comments I no longer remember, as well16:11
TheJuliaHeh, yup16:12
TheJuliawell aware of that one :)16:12
TheJuliarpittau: https://review.opendev.org/c/openstack/releases/+/914200 has a comment now16:14
TheJuliasince doing that double bump has bitten us in the past.16:14
rpittaummm even if the bump is just to avoid conflicts between dependencies?16:16
rpittauI mean, there are not actual changes in either scciclient or proliantutils, just using pyasn1 instead of pyasn1-lextudio16:16
rpittaumm ok nvm, I read it in reverse :D16:18
rpittauI'll for 24.1.116:18
arne_wiebalckGood morning, Ironic!16:25
TheJuliagood morning arne16:26
rpittauhey arne_wiebalck :)16:26
TheJuliarpittau: either, or16:26
TheJuliaJust the release mapping update needs to go in realistically16:26
arne_wiebalckHi TheJulia and rpittau (and congrats!)16:26
rpittauarne_wiebalck: thanks! :D16:26
rpittauTheJulia: yes, I'd rather have the bumps in ASAP as I'm scared of dependencies conflict :)16:27
TheJuliarpittau: ++++ do it!16:27
arne_wiebalckWe're looking into some issue installing/booting Windows images from Ironic and it seems that https://github.com/openstack/ironic-lib/blob/master/ironic_lib/disk_utils.py#L239 may be too restrictive.16:38
arne_wiebalckI have an EFI partition with an MBR partition table, and the flags read 'boot,lba'.16:39
Nisha_AgarwalTheJulia, hi16:46
Nisha_Agarwali saw ur mail. One query , could you tell me the screen where you see the UI allows the uploading of New Secureboot keys? probably the URI may not have the "secureboot" in it....16:48
opendevreviewMerged openstack/ironic master: Imported Translations from Zanata  https://review.opendev.org/c/openstack/ironic/+/91373316:53
rpittauarne_wiebalck: two questions: 1) why using MBR? 2) isn't it mandatory for Windows to have the boot partition on GPT if using UEFI?16:53
JayFI think you can EFI boot windows on hybrid GPT which is MBR-ish16:54
JayFI'm not 100% sure what that looks like on disk, I haven't seen it in a long time16:54
rpittauI asked because I was reading from the Microsfot FAQs: "Systems that support UEFI require that boot partition must reside on a GPT disk."16:58
JayFrpittau: I am a retro computer hobbyist, and I'm talking about stuff from like, XP/Vista era that may still exist in some form -- I would be surprised if it's relevant ... but for windows, you can never assume "this is the old way" means it's gone :D17:00
rpittauoh yeah, I get it :)17:00
arne_wiebalckrpittau: 1) I would need to check with the Wind experts if there is a specific reason, it just worked up to now (but "now" (Yoga) Ironic became more strict and it does not anymore)17:01
arne_wiebalckrpittau: 2) I am getting mixed answers from the internet on this, but the physical nodes here say "no" :)17:01
JayFhttps://www.rodsbooks.com/gdisk/hybrid.html I really, really suspect it's hybrid mbr/hybrid gpt17:02
arne_wiebalckthe UEFI spec will just ignore the code in the MBR17:02
arne_wiebalcksorry, the UEFI implementation (following the UEFI spec) will just ignore the code in the MBR17:02
JayFYeah the hybrid stuff I linked exists in the grey area between the specs17:03
rpittauthis may be a problem "When confronted with a hybrid MBR, Windows tries to treat the disk as an MBR disk, ignoring the GPT partitions completely" :D17:04
rpittauor THE problem17:04
arne_wiebalckwell, THE problem as I see it at the moment is that Ironic fails for a Win image with an MBR which points to a valid EFI partition17:05
JayFGenerally even if it's not a hybrid, I think we're maybe dealing with windows being a little less strict about what is labelled what17:05
JayF"MBR with a valid EFI partition" is hybrid \o/17:05
arne_wiebalckbut, I agree, worth checking if it needs to be MBR17:05
JayFat least I think so(?)17:05
arne_wiebalck:-D17:06
JayFarne_wiebalck: do you know the code change which makes that check pass in your env on yoga?17:06
arne_wiebalckJayF: I need to dig it out, but we ignored some errors in the past and mgoddard made it patch at some point to make it more strict again (which looked ok to me)17:07
arne_wiebalck*made a patch17:07
JayFyeah, sometimes those stackhpc local fixes don't make there way upstream without some prodding :D 17:07
JayFs/there/their/17:07
rpittauI'm just thinking that removing the restriction and allowing UEFI on MBR (or hybrid) would actually be a step back17:10
rpittaualso even if it does work I'm not sure it follows the EFI standard17:10
JayFHybrid MBR is not in the EFI standards at all17:10
JayFit's a microsoft invention17:10
arne_wiebalckCouldn't the code use the partition ID rather than the flags ... ?17:11
rpittauyeah :)17:11
JayFthat link above describes it in as much detail as I've seen just about anywhere describe it17:11
rpittaujust had a glance17:11
JayFI agree with the sentiment of "should we even support this?" generally, but from arne's perspective we already did, and broke it17:11
arne_wiebalckthe function tries to find an EFI partition, so a partition with an EFI partition ID should do17:11
JayFaccidentally made things work /o\ lolsob17:11
arne_wiebalckwell17:12
arne_wiebalckit worked, since we ignored the error17:12
arne_wiebalck(I think)17:12
dtantsurarne_wiebalck: wdym under "partition ID" in the context of MBR?17:15
rpittauarne_wiebalck: I think we decided to use the flags because we wanted specifically GPT17:15
rpittauI just have some concerns at this point17:15
dtantsurI know we could check for a certain GUID, but it won't help you17:15
arne_wiebalckdtantsur: sorry, partition type as per the MBR partition information17:16
dtantsurarne_wiebalck: is there a standard type for UEFI partitions?17:17
dtantsuror at least a de facto standard?17:17
arne_wiebalckhttps://en.wikipedia.org/wiki/Partition_type#PID_EFh17:17
arne_wiebalckmaybe?17:17
arne_wiebalckFWIU, there is one byte in the partition info for each partition described by an MBR17:18
dtantsurGPT protective MBR is a different thing IIRC17:18
dtantsurJust a placeholder in the presence of a real GPT17:18
dtantsurah, EFh. I looked at EEh17:18
rpittauthe protective MBR is definitely a differnt thing17:19
arne_wiebalckI think this is what `fdisk -l` uses17:19
dtantsurCould work. Needs trying on real systems.17:19
arne_wiebalckso, when it displays "EFI" I think it is taking this from the 0xEF on the specific byte in the partition description in the MBR17:20
clarkblinux allows mbr + wfi right? So even if windows theoretically doesn't but maybe does in practice thati s somethign that should generally work?17:20
rpittauI gues depends on the Windows version17:20
JayFclarkb: Yeah I think we're just trying to find the new "edge" to draw the validation on17:20
rpittaumost recent ones won't allow it AFAIK17:20
arne_wiebalckclarkb: mbr + efi? I think so: the f/w will just ignore the MBR and look for the EFI partition, but the internet is not consistent on this information :)17:21
JayFrpittau: I'm so tempted to take that as a challenge, to prove it can work ;). So much stuff in Windows works when they document "NOPE IT DOESN'T WORK" almost like they're trying to talk you outta using the backward compat support ;) 17:21
JayFI'm pretty sure back in the migrating-y eras, you could EFI boot from MBR but not secure boot from it 17:22
JayFbut I don't think the installer would get you to that setup17:22
dtantsurI cannot blame them :D17:22
JayFyou had to use some manual commands to migrate your MBR+BIOS to MBR+EFI17:22
arne_wiebalckJayF: yes, secure boot is different17:22
arne_wiebalckhave to run ... thanks for your input, we'll keep digging :)17:23
rpittauI probably expressing myself poorly, I'm not saying it does not work, but it's not supported17:23
rpittauconsidering how Windows works, I would not install it in an unsupported way17:23
JayFI agree with you, except for one bit that clarkb shone a light on: Ironic doesn't know Windows vs Linux17:24
clarkbya my main point is that I don't think windows matters here17:24
JayFand if it can work with linux, there's no reason for us to filter it invalidation17:24
JayFin validation17:24
JayF(that space matters LOL)17:24
clarkbbasically you either support this because its valid in some cases or you don't because its weird. Windows is orthogonal17:24
arne_wiebalckclarkb: ++17:25
rpittaubut we don't support it in Linux either :)17:25
arne_wiebalckrpittau: we don't support it by accident :)17:26
JayFrpittau: This is another topic, not urgent -- gmann sent an email to the list about pypi maintainer cleanup; I've tracked Ironic projects here over the last 18 months: https://etherpad.opendev.org/p/openstack-pypi-maintainers-cleanup-ironic there are still issues in 4 of 'em. Maybe people will respond to your emails ;)17:27
rpittauJayF: thank you for the reminder, I saw that, need to retrieve the emails of the owners, do you have them?17:29
JayFrpittau: how about I send a second round of emails, cc you, it's only a slight bit more effort than just fetching the emails :D17:29
rpittauJayF: sounds great! :)17:29
JayFiurygregory: ^^^ along those lines, did your pypi account ever get recovered?17:30
arne_wiebalckgood night everyone o/17:30
rpittauarne_wiebalck: honestly I would not do anything that goes against Windows supported things, but if the majority wants to relax the rule on the EFI+GPT only I'm not going to block it of course, up to the users then :)17:31
rpittausee you tomorrow everyone! o/17:32
TheJuliaNisha_Agarwal: dunno, trying to get the person who says it in the UI to join irc, but I don't have hardware I can search on my own at the moment17:39
Nisha_AgarwalTheJulia, thats fine...i searched the ilo rest api documnetation and have shared the details with you...17:40
Nisha_Agarwali havent tried though17:40
Nisha_Agarwali will check with firmware team tomorrow and confirm my understanding17:41
iurygregoryJayF, nope, not yet17:44
iurygregoryI will ping the person in the PR to see if I get an update17:45
JayFiurygregory: can you update the line dedicated to that in the linked etherpad with whatever the status is?17:45
iurygregoryJayF, sure17:48
JayFrpittau: Those emails are off now, btw, with you CC'd. Maybe you might know better ways to contact some of these folks :D 17:48
TheJuliaNisha_Agarwal: Thanks!17:50
iurygregoryJayF, done17:56
JayFthanks!17:56
TheJuliarpittau: dtantsur: Back to secure boot keys: so! It looks like folks have different URLs based upon implementations, at least in terms of modeling and mapping. I think there might actually be a misunderstanding on dell's URL forming, but without having looked at all the location hinting along the way off the root I have no way to know for sure. I think the tl;dr is there might need to be a higher level API defined in the 18:53
TheJuliaDMTF or just a lack of standardization that needs to be addressed. It just looks like it might also be a slightly difficult area given how far deep "under the hood" that is as well.18:53
TheJuliaI guess the way to put it is "I can see where HPE was at, and sort of mostly thinking even if it is not super discoverable",  but Dell... after re-checking the docs I think hit page down by accident and superimposed two things together, and then I'm still sort of further confused but maybe I could also sort of see how they might have gotten there as well.18:57
*** dmellado6 is now known as dmellado22:26
*** dmellado4 is now known as dmellado22:52
*** zbitter is now known as zaneb23:22

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!