Tuesday, 2023-09-19

opendevreviewDmitry Tantsur proposed openstack/ironic master: Trivial: attach versions to release series  https://review.opendev.org/c/openstack/ironic/+/89577809:47
dtantsurJayF, you may want this ^^^ before the release09:47
dtantsurhjensas, hey, thank you for https://bugs.launchpad.net/ironic/+bug/2036455, are you planning on fixing it yourself?09:54
dtantsur(or we can probably give it to oureachy interns, if we get any)10:28
iurygregorygood morning ironic11:25
opendevreviewHarald Jensås proposed openstack/ironic master: inspect_utils, handle bracketed IPv6 redfish addr  https://review.opendev.org/c/openstack/ironic/+/89580711:27
hjensasdtantsur: yes, I have proposed patches to both ironic-inspector and ironic.11:30
dtantsurthx!11:37
iurygregorywhy I'm not surprised to see someone asking if openstack projects are planning to change the coding language from Python to Go? :D12:20
dtantsurjesus...12:26
ravlewGood morning ironic12:37
ravlewjsyk this job was successful even though one of the tasks failed: https://zuul.opendev.org/t/openstack/build/9edff21bb28e4f0ba96d7cca55e9326812:38
ravlew1 job failed here: https://cc0741b30642056b8bca-c8461721173beff53bec22363106ef2b.ssl.cf5.rackcdn.com/893946/1/check/bifrost-integration-redfish-vmedia-uefi-centos-8/9edff21/logs/bifrost.log12:39
ravlewEnsure logrotate service is started returned "msg": "Could not find the requested service logrotate: host"12:39
ravlewalso looking for some core reviews for bifrost logrotate backports to Antelope https://review.opendev.org/c/openstack/bifrost/+/893949 and Zed https://review.opendev.org/c/openstack/bifrost/+/89395012:45
opendevreviewHarald Jensås proposed openstack/ironic master: inspect_utils, handle bracketed IPv6 redfish addr  https://review.opendev.org/c/openstack/ironic/+/89580712:55
opendevreviewHarald Jensås proposed openstack/ironic-inspector master: Handle bracketed IPv6 redfish_address  https://review.opendev.org/c/openstack/ironic-inspector/+/89573413:01
TheJuliabrraaaaiiinnnsss13:16
opendevreviewHuy Mai proposed openstack/sushy-tools master: Add fake_ipa inspection, lookup and heartbeater to fake system  https://review.opendev.org/c/openstack/sushy-tools/+/87536613:18
adam-metal3dtantsur, hi, I have seen you increased the priority of the multipathd issue, is someone already working on it or is it still fine if I do it ? I had no time yet but soon...13:36
opendevreviewJulia Kreger proposed openstack/ironic-inspector master: Update the project status and move broken jobs to experimental  https://review.opendev.org/c/openstack/ironic-inspector/+/89516413:38
TheJuliaJayF: dtantsur: so the job ended up swapping launching 4 1 GB VMs on an 8 GB test node.... And OOMing. :\13:39
TheJuliaI've tuned it down as such.13:39
dtantsurI expected something like that13:44
JayFthank you Julia for that14:03
iurygregoryI think I fixed the DB problem \o/14:09
opendevreviewKaifeng Wang proposed openstack/ironic-python-agent master: Fix un-serialized hwinfo returned from IPA  https://review.opendev.org/c/openstack/ironic-python-agent/+/89489414:11
dtantsurJayF, it's outreachy time, wdyt about this idea: https://etherpad.opendev.org/p/ironic-outreachy ?14:12
JayFdtantsur: when does outreachy start?14:12
JayFdtantsur: I have an MLH fellow starting their fellowship next week (means they should be in IRC in a couple weeks)14:13
dtantsurJayF, it will be something like Dec-Feb, but the projects need to be submitted by end of Sep14:13
JayFDM'd you the equivalent for my fellowship; it's just a googley doc so don't want it in the channel14:14
* TheJulia needs new sinuses14:17
JayFdtantsur: reflecting on the content of that etherpad, two comments: 1) client/sdk should be first class, not bonus 2) Just personally, seems like we could prioritize the fields to migrate out (maybe cpu_arch and *_network first?)14:29
opendevreviewJake Hutchinson proposed openstack/bifrost master: Bifrost NTP configuration  https://review.opendev.org/c/openstack/bifrost/+/89569114:30
opendevreviewMerged openstack/ironic stable/2023.1: Fix anaconda stage2_id loading from image properties  https://review.opendev.org/c/openstack/ironic/+/88357514:30
dtantsurJayF, 1) I sorta agree, but it may simply fall out of the 3 months window14:34
dtantsur2) I put network stuff last as it's somewhat more complex (I mean, the location in the code where they're used)14:34
JayFah that's a good point14:35
JayFand cpu_arch has some config tied into it now14:35
JayF(kuba's changes)14:35
JayFdtantsur: TheJulia: FYI https://github.com/openstack/oslo.db/commit/115c3247b486c713176139422647144108101ca3 is about to be released and included in 2023.214:38
JayFdtantsur: TheJulia: That should eliminate any straggler node locking issues and also hide them so I wanted you to be aware14:39
TheJulia... I want booze14:39
dtantsurfun....14:45
JayFreal fail in the latest grenade run, it seems?14:53
JayFhttps://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_f72/895164/5/experimental/ironic-inspector-grenade/f723908/controller/logs/grenade.sh_log.txt14:53
JayF> 2023-09-19 14:26:52.578 | No attached ports found to associate floating IP with14:53
TheJulianova_server1 failed to create15:01
TheJuliaNode 72a1883e-a7b8-495e-8bf2-c8614ecab2e2 moved to provision state "deploy failed" from state "wait call-back"; target provision state is "active"15:03
TheJuliawow, not enough ram15:03
TheJulialets fix that15:03
opendevreviewJulia Kreger proposed openstack/ironic-inspector master: Update the project status and move broken jobs to experimental  https://review.opendev.org/c/openstack/ironic-inspector/+/89516415:03
JayFWhat do folks think abuot https://review.opendev.org/c/openstack/ironic/+/765569 ? 15:46
JayF(port name API changes)15:46
JayFI am not keen on landing a new API microversion a couple of days before we release15:46
JayFbut I didn't want to make that decision in a vacuum15:46
JayFwe either need to land it nowish or make it wait15:46
JayFunless we know of an urgent need for this change; I'd rather it wait15:47
JayFhttps://review.opendev.org/c/openstack/ironic/+/863999/ should be landed for the release, needs 1 more +2; it's a kinda-bugfix that is unlikely to be backportable so we need to get it in15:48
dtantsurhttps://review.opendev.org/c/openstack/ironic/+/895778 has a release note fix15:49
JayFI've got a +2 on that15:49
dtantsuryeah, thanks, highlighting for other reviewers15:50
JayFhttps://review.opendev.org/c/openstack/ironic/+/895729 needs another +2A as well for redfish v6 fix15:50
JayFdtantsur: opinions on port name API?15:50
dtantsurthinking15:50
JayFThe more I think abuot it and look at context (it's been ongoing since Dec 2022) the more I land on "wait and have it be the first patch after release is cut"15:50
JayFwe don't even have client support for name15:51
dtantsurtrue15:51
JayFsyntax sugar without client support is just a potential to break stuff IMO15:51
opendevreviewJake Hutchinson proposed openstack/bifrost master: Bifrost NTP configuration  https://review.opendev.org/c/openstack/bifrost/+/89569115:51
dtantsurhmm, I don't like the new version of the Harald's patch..15:52
JayFI'll be interested to see your comment15:52
JayFinspector hooks landing in Ironic before release is not useful, right? Those only become living code when we are done with inspector?15:54
JayFre: https://review.opendev.org/c/openstack/ironic/+/890817 (I am trying not to pop things in the gate unless we need them for release, since gate is highly loaded)15:54
dtantsurJayF, they can be used today, but chances are high most people won't use them15:55
JayFack; I will wait on that one too15:55
dtantsurokay, the Harald's patch is fine, I forgot about some exotic cases in parsing Redfish stuff15:57
JayFdtantsur: you forgot to +2, you just +A'd :P 15:57
JayFhttps://review.opendev.org/c/openstack/ironic/+/895729 not that it /really/ matters but it wouldn't hurt to make it right lol15:57
dtantsurI do that pretty often when I'm lazy :D16:02
JayFyou don't get credit in stats for a review on that, I think16:02
dtantsurpoor me16:02
JayFwhich likely doesn't matter for you but it does for some16:02
JayFlol16:02
JayFI think at this point people know you're doing stuff though :P 16:02
dtantsurthey seem to be getting used to me, apparently :D16:03
iurygregoryhttps://paste.opendev.org/show/bu8hVLWX7jxYcNUE4lZb/ \o/16:23
iurygregorybut the node is still in clean wait for some reason...16:23
iurygregoryhttps://paste.opendev.org/show/bnohAuBsl8o78zeA8QNE/16:24
JayFCI failed as well, I wonder if that means there's something missing inthe state transition that should be findable16:25
iurygregoryhttps://paste.opendev.org/show/bz9QAdUqUHuhxq6G9FDN/16:26
JayFhttps://zuul.opendev.org/t/openstack/build/37a73dcb494043e094c4d08b199a6d6b 3 hour timeout is highly sucpisious16:26
iurygregory\o/ it worked16:26
* iurygregory is crying16:26
JayFnice16:26
JayFnow just convince CI and you'll be the big winner ;)16:26
iurygregorywell, first I need to update the patch based on the reviews and re-test hehe16:27
iurygregoryafter going to the doc appointment I have in 30min16:27
iurygregorybrb16:27
opendevreviewMerged openstack/ironic master: redfish_address - wrap_ipv6 address  https://review.opendev.org/c/openstack/ironic/+/89572917:20
opendevreviewMerged openstack/ironic master: inspect_utils, handle bracketed IPv6 redfish addr  https://review.opendev.org/c/openstack/ironic/+/89580717:41
opendevreviewHarald Jensås proposed openstack/ironic stable/2023.1: redfish_address - wrap_ipv6 address  https://review.opendev.org/c/openstack/ironic/+/89579518:44
JayFTheJulia !!!! ironic-inspector-grenade https://zuul.opendev.org/t/openstack/build/76929125092441838cffe7cad5620306 : SUCCESS in 56m 10s18:53
JayFtempest is still failing but you fixed grenade18:53
* JayF throws a ticker-tape parade18:53
opendevreviewVerification of a change to openstack/ironic stable/wallaby failed: [iRMC] Fix parse_driver_info bug enforcing SNMP v3 under FIPS mode  https://review.opendev.org/c/openstack/ironic/+/88524618:57
iurygregorydo we need to approve any patches to unblock the inspector CI? let me know19:12
JayFI'll let you know. I might try to figure out the tempest job before we land that, and I think if we get them passing we'll want to move them back out of experimental19:15
opendevreviewJay Faulkner proposed openstack/ironic-inspector master: Fix bindep for debian bookworm for py3.11  https://review.opendev.org/c/openstack/ironic-inspector/+/89585519:45
iurygregoryTheJulia, regarding https://review.opendev.org/c/openstack/ironic/+/885425/5/ironic/drivers/modules/redfish/firmware.py#300 do you think we should add a new config? just double checking since I'm pushing a new patch set in a few19:49
iurygregoryalso if anyone has thoughts about the other two comments that are open let me know19:49
JayFiurygregory: when in doubt, I typically go the route of new config19:50
JayFbut that may not be a good universal rule; it's just mine :)19:50
iurygregoryI'm trying to figure out the save_and_reraise_exception and if we should handle get_task with try/except 19:50
iurygregoryJayF, I would totally add a new config, but names will be very close to the ones we have and people can get confused pretty easily I would say =)19:51
JayFyep19:51
JayFthat's the other side 19:51
JayFthat's why I say I may not be right :D19:51
iurygregorygot it =)19:51
JayFiurygregory: I just posted a comment about that get_task -- we should ensure a bug gets filed for those other uses that don't have err handlind19:52
JayFiurygregory: so we can fix+backport the fix after firmware is done19:52
* iurygregory looks19:52
iurygregoryJayF, ack =)19:53
iurygregoryJayF, now I'm wondering if we don't already cover the case of errors in get_task, this is from TaskMonitor in sushy and we are already handling error when we get the TaskMonitor via redfish_utils.get_task_monitor ...20:06
JayFI'll be honest, I trust you know more than me20:06
iurygregory<thinking face>20:06
JayFbut if there is a bug lets make sure it gets more than a note in a gerrit change :D20:06
iurygregory++20:07
iurygregoryor maybe we should be first using the property https://github.com/openstack/sushy/blob/82772d3424d739b69fd096a169ab211aa7adc737/sushy/taskmonitor.py#L152 and in case is None we do get_task to initialize it...20:09
* iurygregory grabs more coffee20:09
JayFtempest job is still failing with partition image shenanigans in inspector20:43
opendevreviewIury Gregory Melo Ferreira proposed openstack/ironic master: RedfishFirmware Interface  https://review.opendev.org/c/openstack/ironic/+/88542521:25
TheJuliaJayF: did the held node reveal anything?21:27
TheJuliaor was it for a different job?21:27
JayFTheJulia: I held one for grenade, for overnight last night, the issue you had fixed before I was on IRC21:27
JayFTheJulia: so there is no held one for the partition job21:28
JayFI can ask them to hold one for that but my thought was ... update your PR, lets land it, then do tempest as a separate change?21:28
TheJuliayou could hold one, but I have good confidence in the overall code state. Test bitrot most likely21:28
JayFMe too21:28
TheJuliaWell, it was Dmitry's changeset21:28
TheJuliaoriginally21:28
JayFI think at this point we all own it a little? lol21:29
TheJuliaheh, yeah21:29
JayFI'd prefer grenade be back in check, even if -nv21:29
JayFgiven it's working right now21:29
TheJuliaI'm fine with the release note as-is, fwiw21:29
JayFI have a +2 on the change21:29
TheJuliak21:29
TheJuliajfdi'ed21:30
JayFin that case also  https://review.opendev.org/c/openstack/ironic-inspector/+/895855 that one please21:30
TheJuliaJayF: did you see, the in the original state of the zuul project config, the tempest job your chasing was non-voting to begin with... I wonder how long it has been nv21:31
JayFheh. hehehehe. heheheheheheheheheheheheheheheheheheheheh 😭😭😭😭😭😭😭😭😭😭😭😭😭21:32
TheJuliaewwww21:34
TheJuliaso, that job, should likely have been shutdown a while ago21:34
JayFyes21:34
TheJuliaexplicitly set to netboot21:34
JayFTheJulia: That elicitied a major WTF to me when I saw it, and started searching our code for references to that env var21:35
JayFTheJulia: my brain went more like "of course it doesn't work if it says netboot" than "of course it's bitrotted if it says netboot" LOL21:35
TheJuliaTheJulia and dtantsur have since murdered "classic netboot", and grub now has to work, and it may never have in the image21:35
JayFyep21:35
* JayF goes to kill that job21:36
JayFwell I gotta wait for yours to merge21:36
JayFI'll kill it in the morning lol21:36
TheJuliaok21:36
TheJuliaso the difference is managed_boot21:36
TheJuliaand it is the only job where that flag is set21:36
TheJuliaso maybe move that flag elsewhere... *shrug*21:36
JayFOr just make damned sure we migrate inspector next cycle21:36
JayFand slim our matrix down21:37
opendevreviewJulia Kreger proposed openstack/ironic-inspector master: CI: re-add genade job to normal CI queues  https://review.opendev.org/c/openstack/ironic-inspector/+/89586321:37
* JayF gets in his openstack time machine and convinces everyone that inspector was a part of Ironic all along21:37
JayF[opens eyes] did it work?21:37
TheJuliaNo, what did you change?!?! My cats have been replaced with moopsy21:38
TheJuliaAnd if you don't get that reference: https://www.youtube.com/watch?v=P2oMlTFUJgo21:39
JayFgeeze, spoilers for lower decks :D 21:39
JayFthat is hilarious21:40
* TheJulia needs many moopsy21:40
opendevreviewMerged openstack/ironic-inspector master: Update the project status and move broken jobs to experimental  https://review.opendev.org/c/openstack/ironic-inspector/+/89516422:30
opendevreviewMerged openstack/ironic-inspector master: Fix bindep for debian bookworm for py3.11  https://review.opendev.org/c/openstack/ironic-inspector/+/89585522:31
JayF\o/22:32
TheJuliaiurygregory: one thing on https://review.opendev.org/c/openstack/ironic/+/88542522:38
TheJuliajust for consistency and all22:38
iurygregoryTheJulia, tks22:44
iurygregoryI'm wondering which number it should be22:45
iurygregoryin cleaning I added before management, thinking about the same in deploy (if makes sense)22:45
TheJulialikely 3 or 422:47
TheJuliacloser to the hardware is generally lower, for some reason deploy is in the middle22:47
TheJulia*shrug*22:47
TheJuliaalso firmware is closer to management, I guess any number could be made argument wise22:47
iurygregoryack =)22:47
JayFdeploy is almost always talking about doing stuff to the disk22:48
JayFso it makes sense as kinda close to the hardware22:48
JayFI can see it22:48
TheJuliayeah22:48
TheJuliamanagement *should* be lower in the lists, but it is not22:48
TheJuliac'est la vie22:48
TheJuliaiurygregory: take a look at like 70, but admittedly I don't grok verify steps22:49
* iurygregory looks22:49
* TheJulia runs to the market22:50
iurygregorythe part about highest value will be executed first?22:50
TheJuliano, likely should put it in the list there too22:51
TheJuliasince anytime a step can be executed with the reference order22:51
iurygregoryack22:51
iurygregoryjesus, I just noticed the list is not in order :D22:51
iurygregory7,9,10,8,11,1222:52
JayFgood thing you care and are editing that code22:52
JayFit won't be disordered long!22:52
iurygregoryconsider it done =)22:53
opendevreviewIury Gregory Melo Ferreira proposed openstack/ironic master: RedfishFirmware Interface  https://review.opendev.org/c/openstack/ironic/+/88542522:58

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!