Thursday, 2024-11-14

opendevreviewJulia Kreger proposed openstack/ironic-tempest-plugin master: Fix failure cases around test_ports  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/93438701:11
dtantsurJayF: I will take a look12:02
dtantsur(re configdrive)12:02
ykarelHi can someone check https://bugs.launchpad.net/virtualbmc/+bug/208661713:41
ykarelnot specific to virtualbmc though, but other branchless project sushy-tools, ironic-tempest-plugin13:42
TheJuliaThe problem is on the branches, we need to pin the version to use. It has happened in the past :(14:05
TheJuliagood morning14:15
TheJuliaIn reality, it is not a virutalbmc bug, but an issue for each and every impacted project14:16
opendevreviewDmitry Tantsur proposed openstack/ironic master: Agent deploy: account for disable_power_off  https://review.opendev.org/c/openstack/ironic/+/93463714:33
ykarelTheJulia, yes right, i have pushed the patch to do so but one of the job is failing and i don't know why so15:12
ykarelif someone from ironic team can check it would be good to clear this15:13
TheJuliaso https://b3858d48ad9ee4e7fde1-83ee41d1d15b6e7c94a25488c54501c9.ssl.cf5.rackcdn.com/934036/3/check/ironic-tempest-uefi-redfish-vmedia/afeaaf5/testr_results.html likely is a result of a defect in our overall CI job model where we attempt to prepare a partition image, which sometimes doesn't work out so well. Specifically the image preparation falls over and the image extraction never actually completes ... the side 15:40
TheJuliaeffects of which are visible in https://b3858d48ad9ee4e7fde1-83ee41d1d15b6e7c94a25488c54501c9.ssl.cf5.rackcdn.com/934036/3/check/ironic-tempest-uefi-redfish-vmedia/afeaaf5/controller/logs/ironic-bm-logs/node-0_console_2024-11-04-19%3A10%3A01_log.txt15:40
TheJuliaBecause of this on newer branches, we have dialed back the partition image testing15:41
TheJuliaRelated question, is https://review.opendev.org/#/q/I61f7a6d1af3a66d0e8cc610eda5829c7703d144f only applied to the two branches which are impacted by/using focal or are there others?15:42
ykarelTheJulia, should apply to even older unmaintained too xena/yoga15:47
ykarelin neutron periodic queue we have one ironic job running in zed+ so only pushed for those branches15:47
ykarelok seems you meant https://review.opendev.org/c/openstack/ironic/+/913270 with "we have dialed back the partition image testing"15:56
cardoeTheJulia: can I poke ya to look at https://bugs.launchpad.net/ironic/+bug/2086823 whenever you have some $TIME?18:00
JayFcardoe: I find myself wondering if "pointing to an empty policy file" rather than "not specifying a policy file" could be some weird edge18:10
JayFcardoe: as CID asked, can you plop the node object in there too / confirm the node.owner setting on it18:10
cardoebleh didn't see CID's comment sorry.18:12
cardoeis there a ``` in launchpad to say this is a block of code?18:12
* TheJulia looks at her hat, and notes jira items are still attached ot it at the moment18:20
TheJuliacardoe: ping me after 1pm pacific and you can have the rest fo my brain spoons for the day at that time18:21
cardoeIt's an ugly comment but I've attached it.. https://bugs.launchpad.net/ironic/+bug/2086823 cid, you can see the owner is the correct project_id18:21
JayFcardoe: fwiw -f yaml is really good for this kinda thing in the future (I think it's -f yaml) 18:24
JayFhonestly one of the things I <3 the most about our client is so many output options18:24
cardoeyeah that works18:24
opendevreviewAdam McArthur proposed openstack/ironic-tempest-plugin master: WIP: Microversion handling test  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/93397018:34
cardoeJayF: launchpad eats the whitespace18:34
cardoeCause why not18:34
JayFwhitespace is delicious18:35
cardoeso the yaml output sucks18:35
JayFoh. hahahathud18:36
* JayF gotta go again &18:38
opendevreviewAdam McArthur proposed openstack/ironic-tempest-plugin master: WIP: Microversion handling test  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/93397018:56
TheJuliaJayF: https://review.opendev.org/c/openstack/ironic/+/931055 has a quick question19:19
opendevreviewJulia Kreger proposed openstack/networking-baremetal master: prevent break on communications failure  https://review.opendev.org/c/openstack/networking-baremetal/+/93314919:23
TheJuliacardoe: just a minor commit message fix on ^19:23
cardoe+2'd19:25
opendevreviewMerged openstack/ironic stable/2024.2: add qemu-img to necessary dependency list  https://review.opendev.org/c/openstack/ironic/+/93433619:35
opendevreviewMerged openstack/ironic master: update doc and drop deprecated plugin  https://review.opendev.org/c/openstack/ironic/+/89815719:35
opendevreviewAdam McArthur proposed openstack/ironic-tempest-plugin master: Testing microversions on v1/shards  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/93521919:39
JayFTheJulia: I thought I had fixed that. That's my mistake. We can either land it as is and I'll follow up or I'll get an updated change posted at some point.19:41
* JayF at the vet office 19:41
adamcarthur5https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/935219: Jay and I want to start testing wrong microversion handling in our tempest tests. This is the first of many, starting with shard. 19:42
adamcarthur5It will better ensure we are not changing any behaviour while we are making changes like https://review.opendev.org/c/openstack/ironic/+/928919 going forward.19:42
JayF💪💪💪19:43
adamcarthur5And hopefully its a pattern we can keep up: write the tests in tempest, then write the validation change.19:43
adamcarthur5cc @gtema stephenfin - when this gets merged, I will recheck against it, then we can get the validation for shard merged :)19:44
opendevreviewAdam McArthur proposed openstack/ironic master: api: Introduce new mechanism for API versioning  https://review.opendev.org/c/openstack/ironic/+/92891920:03
opendevreviewAdam McArthur proposed openstack/ironic master: WIP: api: Add schema validation framework  https://review.opendev.org/c/openstack/ironic/+/92892020:03
opendevreviewAdam McArthur proposed openstack/ironic master: WIP: api: Add schema for allocations API  https://review.opendev.org/c/openstack/ironic/+/92892120:03
adamcarthur5Just rebasing further up the relation chain, sorry for the extra messages20:04
TheJuliaJayF: ack, no worries21:03
TheJuliadone, and change should be showing up in a moment21:07
opendevreviewJulia Kreger proposed openstack/ironic master: trivial: remove libpq from bindep file  https://review.opendev.org/c/openstack/ironic/+/93522621:07
TheJuliacardoe: so...21:07
JayFwait, what21:08
JayFhttps://review.opendev.org/c/openstack/ironic/+/931055/7/bindep.txt21:08
JayFI'm showing it's not in there21:08
JayFDEVSTACK/FILES/BINDEP.TXT OhHhhhhhh21:08
JayFI checked /bindep.txt approximately 9000 times :D 21:08
TheJuliaheh21:13
TheJuliano worries, I got it :)21:16
TheJuliacardoe: i love your config file btw :)21:20
TheJuliaredaction text, that is :)21:20
cardoeI had fun with it. :)21:27
TheJuliaokay, yeah, this is a bug21:27
cardoeJayF: yeah that libpq I even asked if you meant to leave it in21:28
TheJuliai think it is a quick fix, let me confirm21:28
JayFlike I said, I was looking at the wrong file the whole time21:28
JayFI'm glad we got it sorted in any event21:28
TheJuliayeah, this is a easy-ish bug to fix21:30
TheJuliacardoe: so your issue is basically that if one is doing any node policy comparison against a rule which requires subfield matching, the handler needs to populate that data and be aware of it21:34
TheJuliaone cannot just call check_policy directly21:34
TheJuliawe have a special handler for that in the api utilities21:34
TheJuliabut cid didn't know that nor the reviewers really were not concious of it when the runbooks change was reviewed21:35
JayFYeah, I'm very curious to see the fix21:35
JayFbecause this is news to me too21:35
TheJuliayeah, looks like with the runbook policy check itself, it was done right21:42
jamesdentonwhen IPA is pushing introspection data to inspector:5050, i'm getting a read timeout (30 sec default), but it looks like data eventually comes back maybe 10 seconds later. Is that timeout value configurable?21:42
TheJuliaJayF: this is one of those things where the tests will take me like 30 minutes21:47
JayFyeah, makes sense, I'll still make a point to look at it once it's up, please tag cid in it too21:48
cardoejamesdenton: inspector is deprecated. long live agent21:49
JayFI'm still looking , Idon't see anything in config21:49
cardoejamesdenton: read on which side?21:53
JayFjamesdenton: https://opendev.org/openstack/oslo.service/src/branch/master/oslo_service/_options.py#L86 looks like the only config option we have, and it's set to ... 15 minutes afaict21:53
JayFI suspect I'm looking at the wrong seam 21:54
cidI will love to see , re policy fix21:55
jamesdentonbrb21:57
TheJuliastill working on the tests :)22:02
opendevreviewMerged openstack/ironic master: Remove postgresql testing and documentation  https://review.opendev.org/c/openstack/ironic/+/93105522:02
TheJuliahmm, the extra set_provision_state code is fun22:07
jamesdentoncardoe deprecated, schmeprecated22:14
jamesdentonJayF gonna try ipa-http-request-timeout on the kernel command line22:17
jamesdentonthat defaults to 30 seconds22:17
TheJuliaalmost got it22:20
JayFaha, good stuff jamesdenton 22:24
JayFjamesdenton: btw; almost all of those you can bake into a config and drop in your ramdisk22:24
JayFjamesdenton: if you find it's static and want to not have the worlds longest kernel command line :D 22:25
jamesdentonif i were good at this I would consider that22:25
opendevreviewJulia Kreger proposed openstack/ironic master: Fix policy checks  https://review.opendev.org/c/openstack/ironic/+/93523022:31
TheJuliaThere you guys go22:31
TheJuliathat will be one ice cream sandwich or tasty whiskey22:31
TheJulia:)22:32
TheJuliaI guess my subject should have been slightly better22:32
opendevreviewJulia Kreger proposed openstack/ironic master: Fix policy checks added with runbooks  https://review.opendev.org/c/openstack/ironic/+/93523022:32
TheJuliathere we go22:32
opendevreviewVerification of a change to openstack/ironic master failed: Use patched dnsmasq from PPA  https://review.opendev.org/c/openstack/ironic/+/93310422:36
JayFso we have to call check_owner_policy for things we want for project-scoped users?22:36
JayFat least in cases like that where we check late22:36
TheJuliaif you want to compare anything which has a node.*something match in the policy22:37
JayFI guess node is the only real scoped object we have (so far)22:37
TheJuliaif you look at the runbooks thing, it got its own owner handler as well, and that was good22:38
JayFoooh, runbooks are too! that's right!22:38
TheJuliayeah22:38
TheJuliaand ports through inheratance relationshiop22:38
JayFI was wondering about that22:38
TheJuliaits a little weird, admittedly22:38
JayFmakes sense why it's not explicit22:38
TheJuliabut it is also super easy to miss22:38
TheJuliabecause if your not aware of the need on the check, you'll never know about it22:38
JayFhonestly my takeaway is more like, we should've had these provision state tests22:38
TheJuliaYes, exactly22:38
JayFthis is the reason I'm asking adamcarthur5 to do tempest-microversion-testing ahead of us changing them22:39
TheJuliaI didn't see added tests for the policies and that would have highlighted it... or at least started to22:39
TheJuliaI did shuffle it slightly because the rbac checks were deferred22:39
TheJuliaand they really shouldn't be22:39
TheJuliaso I fixed that as well which brought validity to the check, so success we know is 409, failure with 403 is insufficient access22:40
TheJuliathe lesser access checks likely fail because they don't have rights, but that should be okay.22:40
TheJuliaRBAC checks are not easy, that is for sure22:40
TheJuliamyself or stevebaker are good resources for that22:40
cidthanks cardoe, for that catch and, TheJulia, for the fix :D23:00
JayFthere's always a bright side to someone finding a bug you wrote: someone used the code you wrote :D 23:08
JayFand apparently Rackspace is gonna be runbooking before our downstream is :D 23:08
TheJulianope, it was the if not runbook then apply new ACLs path23:29
TheJuliaso they were not doing runbooks.23:29
cardoeJayF: yeah this was just attempting to run stuff with steps.23:35
cardoeI wanna be runbooking23:36
JayFah, I see23:39
opendevreviewJulia Kreger proposed openstack/ironic master: Task Manager: Log if the lock takes too long  https://review.opendev.org/c/openstack/ironic/+/89241223:42
cardoeJayF: you okay with me using ruff like sushy?23:44
JayFI am generally going to be onboard with using more modern python toolsets, with two caveats: 1) it's being used somewhere else in openstack already and 2) packages are generally available on most OSes our devs will use23:52
JayFbut I am probably the lowest bar to clear for stuff like that among team consensus23:53

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!