Monday, 2023-02-20

vanougood morning ironic02:36
vanouTheJulia: I appreciate that advice. I'll be available at '2/21 08:00-12:00(JST)' that is '2/20 23:00-2/21 03:00(UTC)'. How can I communicate with you?02:41
arne_wiebalckGood morning, Ironic!07:09
kubajjGood morning vanou, arne_wiebalck, and Ironic!08:16
vanouHi kubajj arne_wiebalck08:20
rpittaugood morning ironic! o/09:34
adam_Hi Ironic !10:22
iurygregorygood morning Ironic12:01
dtantsurJayF: node inventory support actually works, but it only copies information from inspector to ironic12:18
dtantsuri.e. there is a duplication12:18
dtantsuriurygregory, rpittau, FYI I asked JayF to remove me from release liaisons. So the missing releases are up to you now ;)12:21
rpittauit's a trap!12:40
iurygregorydtantsur, OH NO!13:10
iurygregorybut it's ok =)13:10
iurygregoryheads-up I will probably miss the begin of the weekly meeting (I have another meeting at the same time today)13:46
TheJuliagood morning14:05
dtantsurmorning TheJulia 14:06
TheJuliaI hope everyone had a good weekend14:15
iurygregorymorning TheJulia o/14:15
dtantsurpretty good, bouldering in a new gym. you?14:15
TheJuliaLots of fighting the 3d printers14:16
iurygregoryI've spent the weekend going to some parties (Feb in Brazil we have Brazilian Carnival )14:17
TheJulia... I stood in a store for 20 minutes waiting for someone to come to the wire cutting area so I could get some copper wire for a repair, and they never showed up. Put an order in online and it is labeled "ready for pickup 7 minutes after the store opens :(14:28
iurygregoryouch =( 14:29
TheJuliait may have been 30 minutes...14:36
TheJuliaI was holding replacement breakers and looking frustrated14:37
TheJuliavanou: I need to run an errand into town, but I'll try to do that in advance of that first time window. That is 3PM my time14:43
JayFrpittau: iurygregory; given previous comments, I assume you're already aware of https://lists.openstack.org/pipermail/openstack-discuss/2023-February/032313.html :D 14:49
JayFand I just saw this mentioned to me in DM, it's being handled14:51
rpittauyep :)14:52
JayF#startmeeting ironic15:00
opendevmeetMeeting started Mon Feb 20 15:00:39 2023 UTC and is due to finish in 60 minutes.  The chair is JayF. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
opendevmeetThe meeting name has been set to 'ironic'15:00
TheJuliao/15:00
matfechnero/15:00
JayFGood morning15:01
JayFWho all is here?15:01
JayFNote: it's a holiday in the US (President's Day), so be aware when working with folks from America15:01
JayF#topic Announcements/Reminder15:01
JayFAs always, review patches marked ironic-week-prio, and hashtag your patches with it if its ready for review. For more info see the whiteboard.15:02
JayFChecking action items from last week, none, skipping that15:03
JayFAny updates on Ironic CI? I haven't seen anything troubling15:03
JayFI think our efforts early/mid cycle to fix up CI are paying off with relatively smooth sailing now15:03
dtantsurhas anyone looked at the clients' CI?15:03
TheJuliaI haven't looked yet this morning. As of Friday the requirements repo still wasn't taking patches15:03
dtantsurI think they still have stable/zed updates hanging15:03
JayFI've not looked at clients CI15:04
JayFdtantsur: I'm not sure what you mean by updates hanging?15:04
TheJulia\o/ requirements is good again15:04
dtantsurhttps://review.opendev.org/c/openstack/python-ironic-inspector-client/+/856419/15:04
dtantsurpossibly, the functional job requires its regular massaging15:04
TheJuliahmm... no logging at all :(15:05
JayFSo is there someone who wants to the the action of cleaning this up? 15:05
JayFWe shouldn't live troubleshoot in the meeting, but I appreciate it being brought to more light15:06
JayF*take the action of cleaning this up15:06
TheJuliaI can take a look after the meeting15:07
JayFthank you15:07
JayF#action TheJulia to look into stable/zed patches needed to get python-ironic-inspector-client happy (and maybe others?)15:08
JayFmoving on15:08
JayFrpittau: any response on virtualpdu?15:08
rpittauo/15:08
rpittauJayF: unfortunately not :/15:08
JayF#note Ironic, despite having promises from a VirtualPDU maintainer that we could take it over, is now being ghosted.15:09
JayFWe should consider a hard fork soon. Maybe brainstorm some names lol15:09
TheJuliaghosted how?15:09
JayFThe timeline as I understand it is:15:09
TheJuliaCould it be a lack of response being consent ?15:09
TheJuliain the whole lazy-consensus model15:10
JayF1) We ( rpittau ) reached out, they said "yeah, you can have it"15:10
JayF2) rpittau said "make me a core and then I can handle everything else"15:10
JayF3) they disappeared15:10
TheJuliaif we have that in writing, shouldn't that be enough to get opendev to consider granting rights?15:10
JayFbecause it's an "x" namespace project, unless they voluntarily make one of us a core to adopt it into openstack, we can't hostile take it over15:10
TheJuliayeah15:10
JayFI'm sure we could try to make that case; I'm not sure I'd want to put opendev in that position just so we don't have to change a name15:11
rpittauI was wondering if the mail would be enough15:11
JayFfungi: are you around, by chance?15:11
TheJuliaThe conundrum that comes to mind is that this is likely going to happen to others in the community since we so heavily relied upon lazy consensus15:11
rpittau(sorry if I'm slow answering but I'm in another meeting!)15:12
JayFrpittau: I can't tell :) 15:12
TheJuliaand inaction will then be paralysis15:12
TheJuliaGranted, it is all about balancing the needful15:12
JayFI'm going to move on to release countdown, if we get a reply from fungi we can circle back or else just ask when he's around15:12
JayF#topic Release countdown: 4 weeks15:13
TheJuliahard fork is likely the cleanest option but we may want to look at shutting down the x repo namespace eventually if we can, just for clarity purposes15:13
JayF#link https://review.opendev.org/c/openstack/releases/+/874338 Please place a review on cycle highlights if you haven't already15:13
JayFTheJulia++15:13
JayF#link https://etherpad.opendev.org/p/IronicWorkstreams2023.1 2023 workstreams15:13
JayFis there anything partially complete we can work together to land entirely before the release is cut?15:14
TheJuliaI don't think so on that list, we're basically blocked on sqla right now15:15
JayFis the metal3 job being worked on?15:15
JayFand/or is it close?15:16
* dtantsur pokes rpittau15:16
rpittausorry, no progress last week :/15:16
TheJuliaas for not on that list, I've got the metrics collection patch for the conductor on my screen now, and the prometheus exporter patch shouldn't take long to wrap up now that we have the requirements lib merged15:17
TheJulia(for ironic-lib)15:17
JayFWe still need to land release notes for sharding too https://review.opendev.org/c/openstack/ironic/+/87365215:18
TheJuliathat is easy15:18
JayFyeah just putting it in front of eyes while folks are here :)15:18
TheJuliaapproved15:18
JayFif there's something specific I can help with troubleshooting that new metal3 job, or landing patches, or whatever please let me know15:18
TheJuliaothers can amend it if they so desire :)15:19
JayF++15:19
dtantsurthat human cloning machine that TheJulia promised us long ago... can you finish it?15:19
TheJuliacan we get the ptg etherpad added to the ironic whiteboard15:20
TheJuliadtantsur: sadly I believe it was last assigned to mordred15:20
JayFhttps://etherpad.opendev.org/p/ironic-bobcat-ptg15:20
TheJuliaJayF: thanks, adding15:20
JayFthanks15:22
JayF#topic open discussion15:22
JayFanything else?15:22
TheJuliauhh15:22
TheJulialets see15:22
TheJuliaI have some crazy ideas floating to the surface15:22
TheJuliaBased upon our recent baremetal sig discussion, I put words into https://review.opendev.org/c/openstack/ironic-specs/+/87366215:22
TheJuliaI've already mentioned the modify steps idea15:22
TheJuliaAnd I was looking at some DPU related stuff with the need to toggled multiple BMC's power/boot modes to fully deploy a node, and came up with https://review.opendev.org/c/openstack/ironic-specs/+/87418915:23
JayFhonestly I'm nervous to review that last one until after I know more about what a DPU is15:23
TheJulia... which would address some of the asks for the ability to speak to a BMC and say a power-strip to shutdown additional power15:24
JayFand given the number of WTF-looks exchanged between me, dtantsur and arne during the hardware enablement track chair meetings, I think lack of knowledge about DPUs is fairly common lol15:24
TheJuliaJayF: I've got a little bit of an intro in it, but ack15:24
JayFokay good good I'll be less scared to review it then LOL15:24
TheJuliajust think a machine could today have 3 independent BMCs15:24
TheJulia(newer bluefield cards can be connected, or not for same BMC management, and you can have 2 in a machine)15:25
* TheJulia suspects this would be the case where lots of extra power is needed15:26
TheJuliaAnyway, they are both early thoughts, I would love feedback15:26
TheJuliaand feedback on Modify steps if anyone wants to put a bunch of pieces together and realize some of the neat functionality which falls out :)15:26
TheJuliahttps://review.opendev.org/c/openstack/ironic-specs/+/87234915:26
JayF#link https://review.opendev.org/c/openstack/ironic-specs/+/872349 modify steps spec (formerly active steps)15:27
JayF#link https://review.opendev.org/c/openstack/ironic-specs/+/874189 DPU management spec15:27
opendevreviewMerged openstack/ironic master: Fixes console port conflict occurs in certain path  https://review.opendev.org/c/openstack/ironic/+/86834215:27
opendevreviewMerged openstack/ironic master: Make metrics names a little more consistent  https://review.opendev.org/c/openstack/ironic/+/86987915:27
JayF#link https://review.opendev.org/c/openstack/ironic-specs/+/873662 cross-conductor-rpc spec15:27
JayFTheJulia: I'll try to get to those; but I need to do sharding api client first15:27
TheJuliaThanks15:28
JayFthanks for writing those up, it's good to be thinking about what's coming in bobcat15:28
JayF#link https://etherpad.opendev.org/p/ironic-bobcat-ptg15:28
JayFIs there anything else before we call it?15:29
kubajjo/15:30
TheJuliaI've got nothing15:30
JayF#endmeeting15:30
opendevmeetMeeting ended Mon Feb 20 15:30:31 2023 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:30
opendevmeetMinutes:        https://meetings.opendev.org/meetings/ironic/2023/ironic.2023-02-20-15.00.html15:30
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/ironic/2023/ironic.2023-02-20-15.00.txt15:30
opendevmeetLog:            https://meetings.opendev.org/meetings/ironic/2023/ironic.2023-02-20-15.00.log.html15:30
JayFhappy presidents' day :D 15:30
dtantsurkubajj: hi, have you officially wrapped up with coding on the inventory API?15:30
kubajjdtantsur: for now, I think so.15:32
dtantsurnice, congrats! and thank you for your effort kubajj 15:32
kubajjI still need to do the evaluation, and write up the document, so I might have questions, but thanks for all the help with the project everyone.15:36
opendevreviewMerged openstack/ironic bugfix/21.0: Align iRMC driver with Ironic's default boot_mode  https://review.opendev.org/c/openstack/ironic/+/86665615:37
opendevreviewVerification of a change to openstack/ironic stable/zed failed: Align iRMC driver with Ironic's default boot_mode  https://review.opendev.org/c/openstack/ironic/+/86662515:39
opendevreviewVerification of a change to openstack/bifrost master failed: Use a more traditional ansible approach to include_vars  https://review.opendev.org/c/openstack/bifrost/+/85580615:48
opendevreviewVerification of a change to openstack/bifrost master failed: Refactor use of include_vars  https://review.opendev.org/c/openstack/bifrost/+/85580715:48
opendevreviewVerification of a change to openstack/bifrost master failed: Fixes "too many spaces after colon" lint error  https://review.opendev.org/c/openstack/bifrost/+/87263315:51
opendevreviewVerification of a change to openstack/bifrost master failed: Finally fix jinja[spacing]  https://review.opendev.org/c/openstack/bifrost/+/87263415:51
TheJuliagah,  "msg": "Source /tmp/ansible.tidt3w_h/shim-signed//usr/lib/shim/shimx64.efi.signed not found"15:51
dtantsurSomething I should have really mentioned on the meeting.. do we have any projects for outreachy (poking iurygregory and TheJulia)15:53
dtantsur?15:53
TheJuliai have zero capacity16:02
TheJuliaunfortuantely16:02
TheJuliaI wonder if we could get one to prototype something16:03
opendevreviewMerged openstack/networking-generic-switch master: Add ngs_ssh_disabled_algorithms setting  https://review.opendev.org/c/openstack/networking-generic-switch/+/86831616:04
TheJuliahmm, looks like skyline already has some baremetal support16:04
JayFHonestly, I think we have a project around making smaller, well-documented demos16:06
JayFwe should have a handful of basic use cases, with dictated steps to build it up16:06
JayFmight be too big for an outreachy, but I think there's some value to be gained there16:07
iurygregorydtantsur, I couldn't think about anything .-. but I'm happy to be a mentor16:13
TheJulia.... That could also be semi-right sized16:13
iurygregorymaybe a few bits to merge ironic-inspector in ironic could be done.. not sure...16:13
dtantsuryeah, we could probably text one of the next items there16:13
TheJuliait is not coding, but... might still be applicable16:13
dtantsuroutreachy is not only about coding btw16:13
TheJuliayeah, it leans towards it, and some demo-ish stuff might make a ton of sense16:14
TheJuliaesp on ironicbaremetal.org16:14
TheJuliaspeaking of, I ran across a link where someone pointed towards the openstack.org use case instead of ironicbaremetal.org16:17
dtantsurwe can propose both ideas16:19
opendevreviewVerification of a change to openstack/ironic stable/zed failed: Align iRMC driver with Ironic's default boot_mode  https://review.opendev.org/c/openstack/ironic/+/86662516:19
opendevreviewJulia Kreger proposed openstack/ironic master: Get conductor metric data  https://review.opendev.org/c/openstack/ironic/+/86544716:42
TheJuliaboom16:42
rpittaugood night! o/16:44
opendevreviewJulia Kreger proposed openstack/ironic master: Get conductor metric data  https://review.opendev.org/c/openstack/ironic/+/86544716:48
opendevreviewJulia Kreger proposed openstack/ironic-prometheus-exporter master: Support extraction of ironic internal metrics  https://review.opendev.org/c/openstack/ironic-prometheus-exporter/+/86950916:52
TheJulianow to see if that passes16:52
opendevreviewMerged openstack/ironic bugfix/20.2: Align iRMC driver with Ironic's default boot_mode  https://review.opendev.org/c/openstack/ironic/+/86678017:15
opendevreviewVerification of a change to openstack/ironic bugfix/21.2 failed: Update .gitreview for bugfix/21.2  https://review.opendev.org/c/openstack/ironic/+/86782617:15
opendevreviewMerged openstack/ironic stable/zed: Update TOX_CONSTRAINTS_FILE for stable/zed  https://review.opendev.org/c/openstack/ironic/+/85903817:15
opendevreviewMerged openstack/ironic master: Add release note for node sharding  https://review.opendev.org/c/openstack/ironic/+/87365217:15
TheJuliajoy17:22
TheJuliaso... hmm17:22
TheJuliaI guess a week early17:22
TheJuliaerr, no17:23
TheJuliabraaaainns17:23
JayFTheJulia: revised those cycle highlights with a question17:32
TheJuliaanswered, but tl;dr yes should be able to get merged in antelope if anyone has any ideas for https://zuul.opendev.org/t/openstack/build/8f36be99eade4dd3a46a0f0dd3212a5f17:34
iurygregoryhummm interesting17:34
TheJuliayeah...17:35
TheJuliaso genconfig is happy.... soo... wut17:35
* JayF wonders if we're getting wrong versions of things installed17:37
TheJuliahttps://review.opendev.org/c/openstack/ironic/+/865447 <-- actual change17:39
iurygregoryok you are moving [conductor]sensor_data to a whole new section right?17:39
opendevreviewJay Faulkner proposed openstack/ironic-prometheus-exporter master: DNM: CI SCIENCE  https://review.opendev.org/c/openstack/ironic-prometheus-exporter/+/87444917:41
* JayF seeing if master passes17:41
iurygregoryTheJulia, I don't see ironic/conf/sensor_data.py 17:41
iurygregoryin https://review.opendev.org/c/openstack/ironic/+/865447 17:42
TheJuliaoh...17:42
TheJuliawut17:42
TheJuliabingo17:42
TheJuliawow17:42
TheJuliathat is... hmm17:42
iurygregoryI see you removed the options from the condutor.py https://review.opendev.org/c/openstack/ironic/+/865447/9/ironic/conf/conductor.py17:42
iurygregorybut I couldn't find the matching file with the options again =)17:42
opendevreviewJulia Kreger proposed openstack/ironic master: Get conductor metric data  https://review.opendev.org/c/openstack/ironic/+/86544717:42
opendevreviewJulia Kreger proposed openstack/ironic master: Get conductor metric data  https://review.opendev.org/c/openstack/ironic/+/86544717:43
TheJuliaokay, that was a silly error, this should be much happier17:43
iurygregoryit happens17:43
opendevreviewJulia Kreger proposed openstack/ironic-prometheus-exporter master: Support extraction of ironic internal metrics  https://review.opendev.org/c/openstack/ironic-prometheus-exporter/+/86950917:45
TheJulianow to see what CI says17:45
iurygregoryfingers crossed17:46
TheJuliagoing much better so far18:00
opendevreviewJulia Kreger proposed openstack/ironic master: Set lockutils default logging  https://review.opendev.org/c/openstack/ironic/+/87260818:08
iurygregoryTheJulia, now it failed with Could not find np0033188693-ironic.metrics in /opt/stack/ironic-bm-logs/ipe'18:27
iurygregorythe name "np0033188693-" is a bit strange to me tbh18:27
TheJuliafar better!18:27
TheJuliayeah...18:28
iurygregorywhy not hardcode something since is in the plugin.sh?18:29
iurygregoryhttps://review.opendev.org/c/openstack/ironic-prometheus-exporter/+/869509/7/devstack/plugin.sh#8818:29
iurygregoryjust wondering if the file was really created..18:29
TheJuliayeah, that is what I'd kind of wonder off hand18:30
TheJuliait *worked* locally! :)18:30
* TheJulia digs more at python-ironic-inspector-client18:30
iurygregoryyeah, since it reached the part to check for data I would say is just some name problem...18:31
*** gmann is now known as gmann_afk18:37
TheJuliaso I think I've figured out why python-ironic-inspector-client is broken18:48
iurygregory\o/18:51
*** gmann_afk is now known as gmann18:51
iurygregoryTheJulia, I think you logic is wrong in the plugin.sh...  [ -f "$IRONIC_PROMETHEUS_EXPORTER_LOCATION/$stats_file" ] should this execute the curl instead of exiting? 19:05
iurygregoryI've checked and the file indeed exists19:05
TheJuliaI don't think I mentally got that far19:05
TheJulia\o/19:05
opendevreviewJulia Kreger proposed openstack/ironic-inspector stable/zed: [zed-only] Fix functional tests  https://review.opendev.org/c/openstack/ironic-inspector/+/87448819:15
opendevreviewJulia Kreger proposed openstack/python-ironic-inspector-client stable/zed: Update .gitreview for stable/zed  https://review.opendev.org/c/openstack/python-ironic-inspector-client/+/85641919:16
TheJulialets see if that works19:16
fungiJayF: sorry, obviously wasn't around (travelling this week, sitting in the atlanta airport at the moment)19:33
JayFyeah, it's alright19:33
JayFfungi: tl;dr: we have an email from x/virtualpdu core saying "you can have it"19:33
JayFbut they never replied to rpittau's request to be made a core19:33
JayFwe're wondering about options to move forward if they continue to not reply19:33
fungiif we have some written record from one of the virtualpdu maintainers, that could be enough. i'd want to talk it over with the other opendev collaboratory sysadmins first19:33
JayFrpittau: ^ Can you get that email in a spot where we could show fungi (and he could show other opendev sysadms?)19:34
TheJuliavanou: looks like we will need to chat tomorrow19:34
fungiwe'd probably want full headers, just for a complete record in case something crops up later19:34
TheJuliavanou: It is a holiday here and I need to leave early since something got scheduled for 3PM local that I expected into the evening.19:35
TheJuliafungi: that sounds totally reasonable19:54
opendevreviewMerged openstack/ironic stable/zed: Align iRMC driver with Ironic's default boot_mode  https://review.opendev.org/c/openstack/ironic/+/86662520:38
TheJuliastevebaker[m]: https://docs.openstack.org/ironic/latest//cli/ironic-status.html#upgrade21:29
vanougood morning ironic22:58
vanouTheJulia: Understand. Tomorrow is ok. I'll be available between '2/21 23:00 - 2/22 08:00 UTC'. Have a nice holiday :)22:58
stevebaker[m]TheJulia: ah cool, thanks23:04
opendevreviewEbbex proposed openstack/bifrost master: remove unused variables  https://review.opendev.org/c/openstack/bifrost/+/87451823:05
opendevreviewEbbex proposed openstack/bifrost master: remove pymysql system packages requirement  https://review.opendev.org/c/openstack/bifrost/+/87451923:05
opendevreviewEbbex proposed openstack/bifrost master: remove iniparse system packages requirement  https://review.opendev.org/c/openstack/bifrost/+/87452023:05
opendevreviewEbbex proposed openstack/bifrost master: remove nginx system packages requirement  https://review.opendev.org/c/openstack/bifrost/+/87452123:05
opendevreviewEbbex proposed openstack/bifrost master: remove setuptools system packages requirement  https://review.opendev.org/c/openstack/bifrost/+/87452223:05
opendevreviewEbbex proposed openstack/bifrost master: Refactor the use of include_vars  https://review.opendev.org/c/openstack/bifrost/+/87452323:05
stevebaker[m]TheJulia: BTW, TIL, openstacksdk has prometheus integration. If a registry is configured it gets populated with metrics for all requests23:05
TheJuliaNeato, link?23:08
TheJuliaJayF: I didn’t say they were *good* alternatives! WRT dpu, I excluded chassis since we basically need a full driver suite and can deploy an OS to the card (or not). We also, likely, can’t put general purpose workloads on cards. I’ll update it tomorrow. Oh, and the strong push back on all of the prior “let’s use chassis” discussions which relate.23:59
JayFDo not take my statement of "why not chassis" as "use chassis" :) 23:59

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!