opendevreview | Steve Baker proposed openstack/ironic master: Capture [pxe]loader_file_paths for distros https://review.opendev.org/c/openstack/ironic/+/815392 | 04:17 |
---|---|---|
arne_wiebalck | Good morning, Ironic! | 07:34 |
dtantsur | morning ironic | 07:38 |
dtantsur | I'd really appreciate reviews on https://review.opendev.org/c/openstack/ironic/+/820017/ and https://review.opendev.org/c/openstack/ironic/+/819620 please. Ideally to fit into the upcoming release. | 07:47 |
opendevreview | Arne Wiebalck proposed openstack/ironic-python-agent master: Burn-in: Add SMART self test to disk burn-in https://review.opendev.org/c/openstack/ironic-python-agent/+/819505 | 07:55 |
opendevreview | Dmitry Tantsur proposed openstack/ironic master: Trivial: log current state when continuing cleaning https://review.opendev.org/c/openstack/ironic/+/820476 | 08:10 |
opendevreview | Dmitry Tantsur proposed openstack/ironic master: [WIP] Do not use RPC continue_node_deploy/clean in agent_base https://review.opendev.org/c/openstack/ironic/+/756354 | 08:11 |
* MahnoorAsghar Hello everyone! I am Mahnoor (she/her), an Outreachy intern, for the project Auto-Documenting REST API classes for Ironic. Excited to start working on the project! | 08:11 | |
opendevreview | Arne Wiebalck proposed openstack/ironic-python-agent master: Burn-in: Add SMART self test to disk burn-in https://review.opendev.org/c/openstack/ironic-python-agent/+/819505 | 08:12 |
arne_wiebalck | stendulker: thanks for the review and ^^ :-) | 08:12 |
dtantsur | Hi MahnoorAsghar! You may want to sync with your mentors per email, none of them are currently online. | 08:12 |
* MahnoorAsghar Yes, I have synced with them :) | 08:13 | |
stendulker | arne_wiebalck: :) | 08:14 |
opendevreview | Dmitry Tantsur proposed openstack/bifrost master: [PoC] use sqlite instead of mysql https://review.opendev.org/c/openstack/bifrost/+/820479 | 08:34 |
opendevreview | Verification of a change to openstack/ironic master failed: Install isolinux on devstack https://review.opendev.org/c/openstack/ironic/+/820393 | 08:36 |
rpittau | good morning ironic! o/ | 08:50 |
opendevreview | Verification of a change to openstack/ironic master failed: Install isolinux on devstack https://review.opendev.org/c/openstack/ironic/+/820393 | 08:53 |
rpittau | dtantsur, TheJulia, I added the change for the meeting time here https://review.opendev.org/c/opendev/irc-meetings/+/820477 | 08:56 |
dtantsur | thx! | 08:57 |
dtantsur | I suspect iury will need to ack that | 08:57 |
rpittau | probably, I added him to the review | 08:58 |
hgy | Hello, Ironic! | 08:59 |
opendevreview | Dmitry Tantsur proposed openstack/bifrost master: [PoC] use sqlite instead of mysql https://review.opendev.org/c/openstack/bifrost/+/820479 | 09:06 |
dtantsur | rpittau: as part of your stream-9 work, we should probably add a deprecation note that stream-8 will be best-effort supported starting with next cycle. WDYT? | 09:17 |
rpittau | dtantsur: yes, sounds good | 09:18 |
opendevreview | Dmitry Tantsur proposed openstack/bifrost master: [PoC] use sqlite instead of mysql https://review.opendev.org/c/openstack/bifrost/+/820479 | 09:26 |
rpittau | dtantsur: I was starting to look at the bugfix releases, not sure we can justify one for inspector | 09:38 |
opendevreview | Riccardo Pittau proposed openstack/ironic-inspector master: [trivial] Fix Xena release notes versions https://review.opendev.org/c/openstack/ironic-inspector/+/820483 | 09:42 |
opendevreview | Dmitry Tantsur proposed openstack/bifrost master: [PoC] use sqlite instead of mysql https://review.opendev.org/c/openstack/bifrost/+/820479 | 09:48 |
janders | hey arne_wiebalck dtantsur rpittau hgy and Ironic o/ | 09:55 |
rpittau | hey janders :) | 09:55 |
arne_wiebalck | hey hgy janders rpittau dtantsur o/ | 09:57 |
rpittau | hey arne_wiebalck :) | 10:00 |
dtantsur | o/ | 10:01 |
opendevreview | Dmitry Tantsur proposed openstack/ironic master: [WIP] Do not use RPC continue_node_deploy/clean in agent_base https://review.opendev.org/c/openstack/ironic/+/756354 | 10:02 |
opendevreview | Riccardo Pittau proposed openstack/bifrost master: Prepare for bugfix release https://review.opendev.org/c/openstack/bifrost/+/820487 | 10:04 |
opendevreview | Riccardo Pittau proposed openstack/ironic-python-agent master: [trivial] Fix Xena release notes versions https://review.opendev.org/c/openstack/ironic-python-agent/+/820488 | 10:09 |
opendevreview | Riccardo Pittau proposed openstack/ironic-python-agent master: Prepare for bugfix release https://review.opendev.org/c/openstack/ironic-python-agent/+/820489 | 10:18 |
opendevreview | Merged openstack/bifrost stable/xena: Fix RedHat required defaults https://review.opendev.org/c/openstack/bifrost/+/820340 | 10:19 |
opendevreview | Riccardo Pittau proposed openstack/bifrost master: [trivial] Fix Xena and Wallaby release notes versions https://review.opendev.org/c/openstack/bifrost/+/820510 | 10:22 |
dtantsur | arne_wiebalck: if you have a second today, this is quite trivial: https://review.opendev.org/c/openstack/bifrost/+/820173 | 10:22 |
rpittau | other 2 lightning-fast reviews for bifrost https://review.opendev.org/c/openstack/bifrost/+/787509 and https://review.opendev.org/c/openstack/bifrost/+/820365 | 10:25 |
* rpittau needs coffee before reviewing ironic release notes | 10:26 | |
arne_wiebalck | rpittau: the 1st one is ready for review? (has a -1, and W-1) | 10:27 |
rpittau | whoops wrong one, I meant https://review.opendev.org/c/openstack/bifrost/+/819057 | 10:31 |
* rpittau confirms he needs coffee | 10:31 | |
opendevreview | Aija Jauntēva proposed x/sushy-oem-idrac master: Migrate constants to enums https://review.opendev.org/c/x/sushy-oem-idrac/+/817028 | 10:35 |
opendevreview | Dmitry Tantsur proposed openstack/bifrost master: Use the combined Ironic service instead of API+conductor https://review.opendev.org/c/openstack/bifrost/+/820390 | 10:41 |
arne_wiebalck | rpittau: heh | 10:44 |
opendevreview | Riccardo Pittau proposed openstack/bifrost master: Prepare for bugfix release https://review.opendev.org/c/openstack/bifrost/+/820487 | 11:04 |
opendevreview | Merged openstack/bifrost master: Catch all exceptions from pbr when importing the root package https://review.opendev.org/c/openstack/bifrost/+/820173 | 11:15 |
opendevreview | Merged openstack/bifrost master: Update tarballs base url https://review.opendev.org/c/openstack/bifrost/+/820365 | 11:20 |
opendevreview | Dmitry Tantsur proposed openstack/bifrost stable/xena: Catch all exceptions from pbr when importing the root package https://review.opendev.org/c/openstack/bifrost/+/820497 | 11:20 |
opendevreview | Dmitry Tantsur proposed openstack/bifrost stable/xena: Catch all exceptions from pbr when importing the root package https://review.opendev.org/c/openstack/bifrost/+/820497 | 11:20 |
dtantsur | damn, same branch :) | 11:20 |
rpittau | :) | 11:21 |
opendevreview | Dmitry Tantsur proposed openstack/bifrost stable/wallaby: Catch all exceptions from pbr when importing the root package https://review.opendev.org/c/openstack/bifrost/+/820498 | 11:21 |
opendevreview | Merged openstack/bifrost master: Remove unused integration job https://review.opendev.org/c/openstack/bifrost/+/819057 | 11:37 |
opendevreview | Dmitry Tantsur proposed openstack/ironic master: Avoid RPC notify_conductor_resume_{deploy,clean} in agent_base https://review.opendev.org/c/openstack/ironic/+/756354 | 11:42 |
opendevreview | Riccardo Pittau proposed openstack/ironic master: Prepare for bugfix release https://review.opendev.org/c/openstack/ironic/+/820515 | 11:46 |
opendevreview | Dmitry Tantsur proposed openstack/ironic master: DNM remove force_remote_call for continue_node_* https://review.opendev.org/c/openstack/ironic/+/820516 | 11:51 |
opendevreview | Dmitry Tantsur proposed openstack/bifrost master: [PoC] use sqlite instead of mysql https://review.opendev.org/c/openstack/bifrost/+/820479 | 11:52 |
opendevreview | Dmitry Tantsur proposed openstack/bifrost master: [PoC] use sqlite instead of mysql https://review.opendev.org/c/openstack/bifrost/+/820479 | 11:53 |
jamesdenton | Good morning, all. I recently upgraded from W->X, and am starting to see these errors with my existing images: "Agent heartbeat received for node f7945b37-...-1277d0a5777f without an agent token". I understand that tokens are now required, but even after trying one of the ramdisk images at https://tarballs.opendev.org/openstack/ironic-python-agent/dib/files/ still can't get it to work. Any ideas? | 12:20 |
opendevreview | Merged openstack/ironic master: Install isolinux on devstack https://review.opendev.org/c/openstack/ironic/+/820393 | 12:29 |
opendevreview | Dmitry Tantsur proposed openstack/ironic master: All-in-one Ironic service with a local RPC bus https://review.opendev.org/c/openstack/ironic/+/819620 | 12:56 |
dtantsur | jamesdenton: are you sure you're using Xena images? | 12:56 |
jamesdenton | i'm pretty sure? :D but i will double check here in a few | 12:57 |
jamesdenton | ipa-centos8-stable-xena.initramfs and the kernel should do the trick, right? | 12:59 |
dtantsur | yeah | 12:59 |
opendevreview | Dmitry Tantsur proposed openstack/ironic master: [WIP] Add rpc_transport == none https://review.opendev.org/c/openstack/ironic/+/820036 | 13:03 |
opendevreview | Dmitry Tantsur proposed openstack/bifrost master: [PoC] use sqlite instead of mysql and rpc_transport none https://review.opendev.org/c/openstack/bifrost/+/820479 | 13:04 |
dtantsur | just to double check, rpittau, when is our meeting today? | 13:18 |
rpittau | dtantsur: it should be at 16 UTC | 13:29 |
rpittau | so one hour later | 13:29 |
dtantsur | thx | 13:38 |
TheJulia | good morning | 13:43 |
dtantsur | morning TheJulia | 13:43 |
dtantsur | (dunno about the good bit, I'm freezing) | 13:43 |
TheJulia | ugh :( | 13:52 |
TheJulia | evil tilt in the plant's rotation | 13:52 |
opendevreview | Dmitry Tantsur proposed openstack/ironic master: [WIP] Add rpc_transport == none https://review.opendev.org/c/openstack/ironic/+/820036 | 13:54 |
dtantsur | on the bright side, https://review.opendev.org/c/openstack/ironic/+/819620 Works On Bifrost (tm) :) | 14:13 |
dtantsur | would really appreciate reviews (+ the parent patch) | 14:13 |
opendevreview | Merged openstack/bifrost stable/xena: Catch all exceptions from pbr when importing the root package https://review.opendev.org/c/openstack/bifrost/+/820497 | 14:19 |
* TheJulia yawsn | 14:19 | |
opendevreview | Merged openstack/bifrost stable/wallaby: Catch all exceptions from pbr when importing the root package https://review.opendev.org/c/openstack/bifrost/+/820498 | 14:39 |
opendevreview | Merged openstack/metalsmith stable/xena: Set binding:host_id on VIFs https://review.opendev.org/c/openstack/metalsmith/+/819831 | 14:50 |
jamesdenton | dtantsur no luck w/ that ramdisk, same issue. On the client side i am getting an error that corresponds to the server-side error - "Error sending heartbeat to http://10.20.0.11:6385: HeartbeatError: Error heartbeating to Agent API: Invalid Status Code: 400". Not sure which came first. Should there be any logs on the conductor side referencing a token request from IPA? | 14:59 |
dtantsur | probably rather in the API | 15:01 |
dtantsur | could it be that the old agent is still used anywhere? | 15:01 |
jamesdenton | that's where we see ERROR ironic.api.controllers.v1.ramdisk [req-03936361-d8dc-46be-87af-f4790078e69c - - - - -] Agent heartbeat received for node f7945b37-f43f-4b69-b987-1277d0a5777f without an agent token. | 15:02 |
dtantsur | as there any logs before that in both the agent and API/conductor as to *why* the token wasn't generated or provided | 15:03 |
jamesdenton | the only reference to an agent token in the logs is when we see that message above. | 15:06 |
jamesdenton | as for an old agent, this is the only node (with the new image and ramdisk) that's being deployed for testing. | 15:08 |
opendevreview | Merged openstack/metalsmith stable/wallaby: Set binding:host_id on VIFs https://review.opendev.org/c/openstack/metalsmith/+/819832 | 15:12 |
dtantsur | jamesdenton: when the agent starts, it asks Ironic for the token (unless you use virtual media). There should be some traces of this conversation in the logs. | 15:14 |
jamesdenton | good to know, thank you. | 15:22 |
TheJulia | braaaains | 15:27 |
opendevreview | Dmitry Tantsur proposed openstack/ironic master: Add "none" RPC transport that disables the RPC bus https://review.opendev.org/c/openstack/ironic/+/820036 | 15:34 |
opendevreview | Dmitry Tantsur proposed openstack/bifrost master: Use "none" RPC by default, disable JSON RPC https://review.opendev.org/c/openstack/bifrost/+/820479 | 15:40 |
opendevreview | Dmitry Tantsur proposed openstack/bifrost master: DNM expose_json_rpc https://review.opendev.org/c/openstack/bifrost/+/820543 | 15:41 |
* dtantsur is curious what the team will say when they see his list of proposed patches to review this week.... | 15:44 | |
* dtantsur drops a few bifrost patches for the sake of sanity | 15:46 | |
TheJulia | heh | 15:46 |
* TheJulia adds https://review.opendev.org/c/openstack/ironic/+/820077 :) | 15:47 | |
dtantsur | can I just add my stuff or should we discuss them on the meeting first | 15:48 |
TheJulia | I'd just add stuff | 15:50 |
TheJulia | This is the end of the year after all | 15:51 |
dtantsur | on the bright side, https://review.opendev.org/c/openstack/ironic/+/756354 is something we've wanted for years | 15:51 |
dtantsur | remind me, who's chairing the meeting today? | 15:58 |
TheJulia | #startmeeting ironic | 16:00 |
opendevmeet | Meeting started Mon Dec 6 16:00:18 2021 UTC and is due to finish in 60 minutes. The chair is TheJulia. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
opendevmeet | The meeting name has been set to 'ironic' | 16:00 |
TheJulia | o/ | 16:00 |
dtantsur | o/ | 16:00 |
TheJulia | How does that work? | 16:00 |
TheJulia | lol | 16:00 |
dtantsur | :) | 16:00 |
rloo | o/ | 16:00 |
ajya | o/ | 16:00 |
TheJulia | Welcome everyone to this week's Ironic meeting of Bare Metal irony! | 16:00 |
TheJulia | I'm TheJulia, and I'll be your Game Show host today! | 16:01 |
rpittau | o/ | 16:01 |
dtantsur | \o/ | 16:01 |
TheJulia | Our agenda this week is on the wiki, although I suspect it is out of date.... maybe?!? | 16:01 |
TheJulia | #link https://wiki.openstack.org/wiki/Meetings/Ironic#Agenda_for_next_meeting | 16:01 |
TheJulia | Onward~ | 16:01 |
TheJulia | err | 16:01 |
stendulker | o/ | 16:02 |
TheJulia | #topic Announcements / Reminders | 16:02 |
dtantsur | well, the point about releasing *this week* is still important | 16:02 |
rpittau | very important | 16:02 |
TheJulia | #info *we really* need to release this week. | 16:02 |
rpittau | I started reviewing release notes, I wil ladd the patches to the prios | 16:02 |
TheJulia | #info TC has semi-agreed that this release is a transition release from Python 3.6 for Centos8 to supporting Centos9 which would include Python 3.8 and 3.9 support. | 16:03 |
dtantsur | I'd really like to get the single-process ironic there | 16:03 |
TheJulia | In other words! we shouldn't expect 3.6 breakages to *really* appear at all this cycle. | 16:03 |
TheJulia | Your regular host, is on PTO this month, and I believe our last meeting of the year is next week. | 16:03 |
TheJulia | Does anyone have anything else to add? | 16:04 |
TheJulia | rpittau: much appreciated | 16:04 |
rpittau | TheJulia: I have some patches to revert the py3.6 additional jobs https://review.opendev.org/q/topic:%22pure-yoga-tests%22+(status:open%20OR%20status:merged) | 16:04 |
TheJulia | rpittau: tagged for the week's review? | 16:05 |
rpittau | I will add them too, yeah | 16:05 |
TheJulia | Onward then! | 16:06 |
TheJulia | #topic Review Action items from prior meeting | 16:06 |
TheJulia | rpittau: well, I believe your action item was satisified, we are meeting an hour later today. | 16:07 |
rpittau | it was indeed, thanks! | 16:07 |
TheJulia | dtantsur: And I believe you also updated the whiteboard | 16:07 |
TheJulia | So onward? | 16:07 |
dtantsur | I did | 16:07 |
TheJulia | Excellent, then we can proceed! | 16:07 |
TheJulia | #topic Review subteam status reports | 16:07 |
TheJulia | #link https://etherpad.openstack.org/p/IronicWhiteBoard | 16:07 |
TheJulia | So, our priorities for the cycle have not merged, but we have ?5? core reviewers who have voted on it, I think we can merge with lazy consensus at this point | 16:08 |
dtantsur | yeah, and I've already populated the whiteboard based on it :) | 16:08 |
TheJulia | excellent | 16:09 |
dtantsur | btw if anyone has any energy to figure out why DIB jobs are failing on bifrost, would be awesome | 16:09 |
dtantsur | I'll get there.. one day. but maybe someone will get there earlier | 16:09 |
TheJulia | i might be able to get there this week depending on interruptions | 16:10 |
dtantsur | it was something about python vs python3 in DIB the last time I checked | 16:10 |
TheJulia | Does anyone else want to review https://review.opendev.org/c/openstack/ironic-specs/+/815308/ before it is workflowed? | 16:11 |
TheJulia | dtantsur: ugh | 16:11 |
TheJulia | dtantsur: that is... not good | 16:11 |
rpittau | I'll try to have a look as well during the week | 16:11 |
TheJulia | I think the whiteboard looks good, are we good to proceed onward? | 16:13 |
rpittau | dtantsur: the biforst patch you mentioned for bifrost ARM CI is really for CentOS 9, do we want to split that ? | 16:13 |
dtantsur | rpittau: no, sorry, I just derped because of lack of sleep and warmth :( | 16:14 |
dtantsur | although, yeah, RHEL 9 support is a topic we need | 16:14 |
rpittau | oh no worries! | 16:14 |
rpittau | let's add another topic, we're on that anyway | 16:14 |
dtantsur | done | 16:14 |
rpittau | thanks! | 16:14 |
TheJulia | We've already done some for that, but testing it internally will be much better overall | 16:15 |
TheJulia | Onward? | 16:15 |
dtantsur | ++ | 16:15 |
rpittau | yep | 16:16 |
TheJulia | #topic Priorities for the coming week | 16:16 |
TheJulia | #link https://review.opendev.org/q/hashtag:ironic-week-prio+status:open | 16:16 |
TheJulia | There are a ton of items on here | 16:16 |
dtantsur | yeah, I've recently added a few :) | 16:16 |
TheJulia | Perhaps we just all review after the meeting? | 16:16 |
rpittau | heh my recent additions! :) | 16:16 |
dtantsur | well, rpittau's patches should be trivial to get merged, let's do it afterwards | 16:17 |
TheJulia | ++ | 16:17 |
dtantsur | mine are a bit more sophisticated, but I'm available for questions :) | 16:17 |
rpittau | yes, very quick, just strings update for renos | 16:17 |
dtantsur | (until I fall asleep for exhaustion) | 16:17 |
dtantsur | "Use only Yoga tests" - should it wait for the template change first? | 16:18 |
* TheJulia adds https://review.opendev.org/c/openstack/ironic/+/820077 to the list | 16:18 | |
TheJulia | That is part of what ate my last week | 16:18 |
rpittau | oh shoot I thought it was merged already | 16:18 |
rpittau | I'll remove the tag | 16:19 |
arne_wiebalck | there are also some simple sushy patches from me on the list (well, code-wise simple) ... if anyone wants to take a look | 16:19 |
TheJulia | arne_wiebalck: are they tagged with ironic-week-prio? | 16:19 |
arne_wiebalck | yes | 16:19 |
TheJulia | ack | 16:19 |
TheJulia | Okay, sounds good | 16:20 |
TheJulia | Anything else? Are we good to proceed? | 16:20 |
dtantsur | ++ | 16:21 |
TheJulia | dtantsur: I guess we don't need to discuss py36 anymore? | 16:22 |
dtantsur | nope | 16:22 |
TheJulia | arne_wiebalck: anything to discuss for baremetal sig? | 16:22 |
TheJulia | For this week, at least | 16:22 |
TheJulia | #topic Baremetal SIG | 16:22 |
TheJulia | dtantsur: aren't you doing a presentation ?tomorrow? | 16:22 |
* TheJulia need calendar invites or something | 16:22 | |
arne_wiebalck | Next week we have dtantsur on Metal3 (with demo!) :-D | 16:22 |
TheJulia | ahh, next week! | 16:23 |
arne_wiebalck | Next week I think | 16:23 |
TheJulia | #info Next week dtantsur will present on Metal3 | 16:23 |
TheJulia | Anything else? | 16:23 |
dtantsur | oh damn :D | 16:23 |
TheJulia | dtantsur: heh | 16:23 |
arne_wiebalck | heh | 16:23 |
arne_wiebalck | I will send the mails and tweets in due time. | 16:23 |
arne_wiebalck | That's it from me for today. | 16:24 |
TheJulia | Okay, onward! | 16:24 |
TheJulia | #topic RFE Review | 16:24 |
TheJulia | ajya: I believe you have an RFE for us today? | 16:24 |
ajya | no.. | 16:24 |
ajya | that's from last time not removed | 16:24 |
dtantsur | I think it also was last time | 16:24 |
TheJulia | okay then | 16:24 |
TheJulia | #topic Open Discussion! | 16:24 |
TheJulia | Anything to discuss? Recipes to share? Worlds to conquer? | 16:25 |
TheJulia | New books to read? | 16:25 |
dtantsur | mmm, books | 16:25 |
TheJulia | fwiw, Termination Shock is good, just... also hits close to home as it was clearly written during the beginning of the pandemic. | 16:25 |
dtantsur | I haven't read a single one in a while :( | 16:25 |
dtantsur | have unfinished https://www.goodreads.com/book/show/45154547-a-desolation-called-peace on by phone | 16:26 |
rpittau | just started the 9th (and last) book in The Expanse saga, seems pretty good so far | 16:26 |
arne_wiebalck | dtantsur: oh, just started the first one :) | 16:27 |
dtantsur | nice :) | 16:27 |
TheJulia | rpittau: umm... I thought there was a 10th book | 16:27 |
TheJulia | oh | 16:28 |
TheJulia | now not shipping until 2022 | 16:28 |
TheJulia | well that is unfortunate | 16:28 |
rpittau | TheJulia: seems like the 9th will be the last one, the 10th one is a collection | 16:28 |
TheJulia | hmm | 16:28 |
TheJulia | Interesting | 16:28 |
TheJulia | I need to finish termination shock first before I get back on the expanse train | 16:28 |
rpittau | *collection of short stories | 16:28 |
TheJulia | Well, is there anything else for us to discuss this week? | 16:29 |
dtantsur | midcycle? | 16:29 |
* dtantsur hides | 16:29 | |
TheJulia | I suspect that may be best planned for sometime in January, but we should get our PTL engaged to help plan it | 16:30 |
TheJulia | Maybe we should start an ideas etherpad? | 16:30 |
opendevreview | Merged openstack/bifrost master: [trivial] Fix Xena and Wallaby release notes versions https://review.opendev.org/c/openstack/bifrost/+/820510 | 16:31 |
opendevreview | Merged openstack/bifrost master: Prepare for bugfix release https://review.opendev.org/c/openstack/bifrost/+/820487 | 16:31 |
dtantsur | maybe? I'm mostly planting the thought in the heads :) | 16:32 |
TheJulia | okay | 16:32 |
TheJulia | #topic Who is going to run next week's meeting? | 16:32 |
dtantsur | of course it won't be the same as a year ago *sobbing* | 16:32 |
TheJulia | Any volunteers? | 16:32 |
rpittau | I can run the next one :) | 16:32 |
dtantsur | was about to say we can appoint rpittau :) | 16:32 |
rpittau | :D | 16:32 |
TheJulia | dtantsur: 2... years :( | 16:32 |
* TheJulia cries | 16:33 | |
dtantsur | don't say that! | 16:33 |
* dtantsur hugs TheJulia | 16:33 | |
TheJulia | Okay, rpittau has been appointed next week's victim for meeting running | 16:33 |
TheJulia | And with that, Thanks everyone! | 16:33 |
rpittau | yay (?) | 16:33 |
TheJulia | Now, everyone! Go review! | 16:33 |
TheJulia | chop chop, the code won't merge itself! | 16:33 |
TheJulia | :) | 16:33 |
* TheJulia is in rare form today | 16:33 | |
rloo | (wonders if that is cuz TheJulia is running today's meeting...) | 16:34 |
* dtantsur curious about a rare form TheJulia | 16:34 | |
TheJulia | dtantsur: slightly more crazy than normal | 16:34 |
TheJulia | its all okay, I'm double caffinated today! | 16:34 |
dtantsur | \o/ | 16:34 |
TheJulia | Thanks everyone! | 16:34 |
TheJulia | Have a wonderful week! | 16:34 |
TheJulia | #endmeeting | 16:34 |
opendevmeet | Meeting ended Mon Dec 6 16:34:53 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:34 |
opendevmeet | Minutes: https://meetings.opendev.org/meetings/ironic/2021/ironic.2021-12-06-16.00.html | 16:34 |
opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/ironic/2021/ironic.2021-12-06-16.00.txt | 16:34 |
opendevmeet | Log: https://meetings.opendev.org/meetings/ironic/2021/ironic.2021-12-06-16.00.log.html | 16:34 |
TheJulia | ajya: w/r/t https://review.opendev.org/c/openstack/sushy/+/820076, I'm not disagreeing we can't consider fall back again, just there is a lot of risk and I'm not sure a ton of value to hide it from the library consumer | 16:39 |
TheJulia | or is that fall back forward | 16:39 |
rpittau | dtantsur: the issue with DIB does not look like our fault, at least at a glance, I proposed a patch https://review.opendev.org/c/openstack/diskimage-builder/+/820563 | 16:41 |
arne_wiebalck | dtantsur: "a BMC implementation using headers.etags[0]" :-D | 16:41 |
arne_wiebalck | dtantsur: not unlikely! | 16:41 |
dtantsur | arne_wiebalck: I'd not be too surprised :) | 16:41 |
TheJulia | arne_wiebalck: I was just looking at that thinking the same thing | 16:41 |
* arne_wiebalck shudders | 16:41 | |
dtantsur | if somebody will review my combined ironic patches, https://review.opendev.org/c/openstack/bifrost/+/820479/ show-cases it (see the "ironic" service in the logs) | 16:44 |
ajya | TheJulia: what is fallback in this context? The way I see it, there are 2 cases 1) legit AccessError 2) AccessError accessing SessionService before auth. The patch fixes 1), but it also breaks 2) Redfish Sessions for at least some BMCs. | 16:45 |
* dtantsur will go get some rest o/ | 16:46 | |
jamesdenton | dtantsur i think i'm about to feel real stupid. I had been changing the image properties but there were hardcoded deploy_kernel and deploy_ramdisk values on the baremetal nodes themselves. Curious - are the latter optional if they're set on the images? | 16:46 |
opendevreview | Julia Kreger proposed openstack/ironic master: Trivial: minor follow-up to redfish fix https://review.opendev.org/c/openstack/ironic/+/820564 | 16:46 |
dtantsur | jamesdenton: I never used properties on images, tbh.. I'm surprised that it works. | 16:47 |
dtantsur | I mean, it works for instance images, but for deploy images? | 16:47 |
jamesdenton | probably some misinforation/instructions on my part. Not sure it works, either | 16:47 |
TheJulia | arne_wiebalck: so should your etag fixes be backported? | 16:47 |
dtantsur | deploy images are used in situations where there are not instance images | 16:47 |
dtantsur | (cleaning, inspection) | 16:47 |
jamesdenton | ahh right | 16:47 |
TheJulia | ajya: So, in the identified case, the X-Auth-Token removal fix was not present which likely contributed to the failure, so in a sense it was case `. Case 2, I'm really not sure about and at that point it seems more like we've got bad input data. At least, I would think | 16:50 |
arne_wiebalck | TheJulia: Maybe. I have already seen hardware which does not like etags to be passed back. So, I have an additional local patch to retry without when the etags have not changed. | 16:51 |
arne_wiebalck | TheJulia: I am little worried in case we backport this, we will have others run into this | 16:52 |
TheJulia | ajya: https://www.dmtf.org/sites/default/files/standards/documents/DSP0266_1.14.1.pdf 15.3.4.1 seems vauge but also suggests finding details before authenticating... | 16:52 |
arne_wiebalck | TheJulia: Not sure how to properly handle this. | 16:52 |
TheJulia | hmm... very carefully then | 16:52 |
arne_wiebalck | TheJulia: The logic I have downstream now is: try with etag, if that fails, check if the etag changed, if not retry without | 16:53 |
TheJulia | so lets see how it pans out, if we need to backport stuffs later I guess we can | 16:53 |
arne_wiebalck | TheJulia: I think this is a server side bug, though: you cannot reject the etag you handed out. | 16:53 |
arne_wiebalck | TheJulia: I guess I should get in touch with my vendor to see what they say. | 16:55 |
TheJulia | ++ | 16:56 |
TheJulia | arne_wiebalck: feel free to loop me in if we need backports based upon that | 16:56 |
arne_wiebalck | TheJulia: thanks! | 17:05 |
opendevreview | Merged openstack/ironic-specs master: Yoga Themes https://review.opendev.org/c/openstack/ironic-specs/+/815308 | 17:09 |
dking1 | So, I was looking at that issue I noticed with Inspector last week, and it certainly seems to me to be a memory leak. It seems to be related to the requests. We do pound the service rather hard, with 200 servers having all their data polled each minute, and it seems that the memory usage of Inspector is growing at a rather consistent 1M per five or six minutes. As the memory is expanded, if I dump the memory and thing pass it t | 17:10 |
dking1 | o `strings`, I mostly get "req-*" IDs, and a bunch of "fpfd", but that's probably not an actual text string. | 17:10 |
rpittau | bye everyone! o/ | 17:10 |
dking1 | rpittau: Have a good night! | 17:11 |
TheJulia | dking1: hmmmm | 17:11 |
*** dking1 is now known as dking | 17:11 | |
dking | I'm about to put in a story, but this is related to the issue I mentioned last week about Inpsector using up RAM. | 17:12 |
*** dking is now known as Guest7793 | 17:12 | |
TheJulia | yeah, sounds like it | 17:12 |
Guest7793 | It got to about 47G | 17:12 |
TheJulia | that at least gives us a solid place to start | 17:12 |
* TheJulia mv Guest7793 dking | 17:13 | |
*** Guest7793 is now known as dking | 17:13 | |
* TheJulia gets out superglue and glues dking's nick to the irc channel | 17:13 | |
* TheJulia is totally loosing her mind | 17:13 | |
dking | Thanks. I can't seem to get this nick thing straight these days. lol | 17:13 |
TheJulia | lol | 17:13 |
dking | Story: https://storyboard.openstack.org/#!/story/2009727 | 17:17 |
dking | Is there many further debugging information that I should give? I didn't know whether it would be worth it for me to try to setup a docker container somewhere and try to create replication with fake or non-sensitive data in it. | 17:20 |
dking | My guess is that somewhere there's going to be a variable that Python isn't cleaning up properly. | 17:21 |
TheJulia | dking: I can look in like 5 minutes | 17:23 |
*** sshnaidm is now known as sshnaidm|afk | 17:25 | |
dking | Thank you very much. | 17:25 |
TheJulia | dking: any configuration details. How is it being launched, if you can suppply what the configuration is, that would also be helpful | 17:26 |
TheJulia | sanitized of sensitive details of course | 17:26 |
TheJulia | Just so we have a reference when digging through the code | 17:27 |
dking | Okay. I added it in a comment: https://paste.opendev.org/show/811490/ | 17:32 |
opendevreview | Verification of a change to openstack/sushy master failed: Use Etag in precondition header when setting boot options https://review.opendev.org/c/openstack/sushy/+/818114 | 17:34 |
opendevreview | Merged openstack/sushy master: Handle weak Etags https://review.opendev.org/c/openstack/sushy/+/818110 | 17:41 |
TheJulia | begin the merge party! | 17:44 |
arne_wiebalck | \o/ | 18:04 |
opendevreview | Verification of a change to openstack/ironic master failed: Use test_with_retry to get the tap device name https://review.opendev.org/c/openstack/ironic/+/818703 | 18:06 |
arne_wiebalck | bye everyone, see you tomorrow o/ | 18:13 |
* TheJulia gets out the suspicious corgi look | 18:13 | |
TheJulia | o/ arne_wiebalck | 18:13 |
* TheJulia senses ci problem | 18:13 | |
opendevreview | Julia Kreger proposed openstack/ironic-tempest-plugin master: WIP: An idea for rbac positive/negative testing https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/819165 | 19:07 |
opendevreview | Merged openstack/ironic master: Trivial: log current state when continuing cleaning https://review.opendev.org/c/openstack/ironic/+/820476 | 19:33 |
opendevreview | Merged openstack/ironic-inspector master: [trivial] Fix Xena release notes versions https://review.opendev.org/c/openstack/ironic-inspector/+/820483 | 19:34 |
opendevreview | Merged openstack/ironic master: Remove redfish cache entry upon errors https://review.opendev.org/c/openstack/ironic/+/820077 | 19:34 |
opendevreview | Merged openstack/ironic-python-agent master: [trivial] Fix Xena release notes versions https://review.opendev.org/c/openstack/ironic-python-agent/+/820488 | 19:34 |
opendevreview | Merged openstack/ironic master: Prepare for bugfix release https://review.opendev.org/c/openstack/ironic/+/820515 | 19:34 |
stevebaker[m] | morning | 19:35 |
TheJulia | Good morning | 19:36 |
opendevreview | Julia Kreger proposed openstack/ironic-tempest-plugin master: WIP: An idea for rbac positive/negative testing https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/819165 | 19:45 |
opendevreview | Julia Kreger proposed openstack/ironic stable/xena: Remove redfish cache entry upon errors https://review.opendev.org/c/openstack/ironic/+/820588 | 19:54 |
opendevreview | Verification of a change to openstack/ironic master failed: Use test_with_retry to get the tap device name https://review.opendev.org/c/openstack/ironic/+/818703 | 20:00 |
opendevreview | Julia Kreger proposed openstack/ironic bugfix/18.1: Remove redfish cache entry upon errors https://review.opendev.org/c/openstack/ironic/+/820589 | 20:09 |
opendevreview | Julia Kreger proposed openstack/ironic bugfix/18.1: Remove redfish cache entry upon errors https://review.opendev.org/c/openstack/ironic/+/820589 | 21:01 |
opendevreview | Julia Kreger proposed openstack/ironic stable/xena: Remove redfish cache entry upon errors https://review.opendev.org/c/openstack/ironic/+/820588 | 21:06 |
opendevreview | Julia Kreger proposed openstack/ironic stable/wallaby: Remove redfish cache entry upon errors https://review.opendev.org/c/openstack/ironic/+/820597 | 21:48 |
TheJulia | stevebaker[m]: if you have some time at some point, take a glance at the py3 failures on ^^^ | 21:48 |
TheJulia | or, well, one failure which is making zero sense | 21:48 |
opendevreview | Julia Kreger proposed openstack/sushy stable/xena: Raise an AccessError with SessionService init https://review.opendev.org/c/openstack/sushy/+/820598 | 21:51 |
opendevreview | Julia Kreger proposed openstack/sushy stable/wallaby: Raise an AccessError with SessionService init https://review.opendev.org/c/openstack/sushy/+/820599 | 21:53 |
opendevreview | Julia Kreger proposed openstack/sushy stable/victoria: Raise an AccessError with SessionService init https://review.opendev.org/c/openstack/sushy/+/820600 | 21:56 |
opendevreview | Julia Kreger proposed openstack/sushy stable/ussuri: Raise an AccessError with SessionService init https://review.opendev.org/c/openstack/sushy/+/820602 | 21:57 |
opendevreview | Julia Kreger proposed openstack/sushy stable/train: Raise an AccessError with SessionService init https://review.opendev.org/c/openstack/sushy/+/820603 | 22:02 |
opendevreview | Merged openstack/ironic-tempest-plugin master: Move API base out of admin test location https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/819164 | 22:58 |
opendevreview | Steve Baker proposed openstack/bifrost master: Don't create ironic_tftp_master_path directory, change default https://review.opendev.org/c/openstack/bifrost/+/820311 | 23:42 |
opendevreview | Steve Baker proposed openstack/bifrost master: WIP support grub network boot https://review.opendev.org/c/openstack/bifrost/+/807220 | 23:42 |
stevebaker[m] | TheJulia: ok, I think this will fix the selinux denial https://review.opendev.org/c/openstack/bifrost/+/820311 | 23:43 |
janders | good morning Ironic o/ | 23:50 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!