opendevreview | Steve Baker proposed openstack/sushy-tools master: Add virtual-media-boot to openstack driver https://review.opendev.org/c/openstack/sushy-tools/+/906768 | 02:54 |
---|---|---|
adamcarthur5 | After talking with Jay and Julia, they helped figure out that I need to run OS_CLOUD=devstack-system-admin before running "openstack baremetal" commands in devstack to get it to work. I went to try it again tonight and it did not work. Am I forgetting a step that I maybe completed but forgot about? | 04:14 |
adamcarthur5 | I have gone through the commands I ran in the command history but cannot see anything of note | 04:18 |
adamcarthur5 | ls | 04:19 |
JayF | make sure you didn't ever source the openrc file | 04:21 |
JayF | if you did get a fresh env | 04:21 |
adamcarthur5 | Yeah, so I opened a fresh ssh instance, and just went straight to running the command, no luck | 04:26 |
JayF | you have that cloud defined in /etc/openstack/clouds.yaml (iirc) (?) | 04:27 |
adamcarthur5 | Yeah. Looking through the keystone logs it seems that there is a problem with SQL? something to investigate tomorrow. My two ideas. | 04:31 |
adamcarthur5 | - Someone (a hacker) is crawling for exposed devstack instances (I think this is unlikely but incase its something that happens i'll include it) and doing "interesting things" | 04:31 |
adamcarthur5 | - My VPN is doing something interesting / breaking when snapshots are created | 04:31 |
adamcarthur5 | Well, I thought I would test the latter by trying to rollback to a snapshot from just after running ./stack.sh but that has created more errors. Time to roll back to pre-stack I think :^) | 04:34 |
opendevreview | Adam McArthur proposed openstack/ironic-prometheus-exporter master: [codespell] Adding Tox Target for Codespell https://review.opendev.org/c/openstack/ironic-prometheus-exporter/+/906778 | 04:44 |
opendevreview | Adam McArthur proposed openstack/ironic-prometheus-exporter master: [codespell] Adding CI target for Tox Codespell https://review.opendev.org/c/openstack/ironic-prometheus-exporter/+/906779 | 04:44 |
JayF | yeah I was kinda worried about your exposure to getting botted with a public-ip'd devstack instance | 05:07 |
JayF | I'm going to bed o/ | 05:07 |
opendevreview | Adam McArthur proposed openstack/ironic master: [codespell] Fixing Spelling Mistakes https://review.opendev.org/c/openstack/ironic/+/906806 | 05:23 |
opendevreview | Adam McArthur proposed openstack/ironic master: [codespell] Adding Tox Target for Codespell https://review.opendev.org/c/openstack/ironic/+/906807 | 05:23 |
opendevreview | Adam McArthur proposed openstack/ironic master: [codespell] Adding CI target for Tox Codespell https://review.opendev.org/c/openstack/ironic/+/906808 | 05:23 |
opendevreview | Adam McArthur proposed openstack/networking-baremetal master: [codespell] Fixing Spelling Mistakes https://review.opendev.org/c/openstack/networking-baremetal/+/906788 | 05:26 |
opendevreview | Adam McArthur proposed openstack/networking-baremetal master: [codespell] Fixing Spelling Mistakes https://review.opendev.org/c/openstack/networking-baremetal/+/906788 | 05:30 |
opendevreview | Adam McArthur proposed openstack/networking-baremetal master: [codespell] Adding Tox Target for Codespell https://review.opendev.org/c/openstack/networking-baremetal/+/906789 | 05:30 |
opendevreview | Adam McArthur proposed openstack/networking-baremetal master: [codespell] Adding CI target for Tox Codespell https://review.opendev.org/c/openstack/networking-baremetal/+/906790 | 05:30 |
adam-metal3 | Hello Ironic! Is this the best IRC channel to ask about sushy-tools/emulator in relation to OVB or is there a better one? I have a hard time finding sushy specific IRC . | 07:48 |
rpittau | good morning ironic! o/ | 07:50 |
*** jph0 is now known as jph | 08:25 | |
dtantsur | adam-metal3: generally, sushy stuff is here | 10:09 |
adam-metal3 | dtantsur, thanks do you happened to know what is correct way to supply OpenStack username and password for sushy-emulator if I would like to use the "Systems resource driver: OpenStack" ? | 10:14 |
dtantsur | adam-metal3: https://docs.openstack.org/sushy-tools/latest/user/dynamic-emulator.html#systems-resource-driver-openstack it expects a populated clouds.yaml (standard openstack credentials storage) and you pass the cloud name | 10:15 |
adam-metal3 | dtantsur, thanks! | 10:16 |
iurygregory | good morning Ironic | 10:37 |
masghar | Good morning! | 10:44 |
opendevreview | Verification of a change to openstack/ironic bugfix/22.0 failed: Make sure we eject media from DVD when CD is requested https://review.opendev.org/c/openstack/ironic/+/899337 | 11:17 |
opendevreview | Merged openstack/sushy master: Force constraints when installing a package during tox test https://review.opendev.org/c/openstack/sushy/+/907461 | 11:49 |
opendevreview | Merged openstack/ironic stable/2023.1: Fix service role support https://review.opendev.org/c/openstack/ironic/+/907269 | 12:21 |
opendevreview | Merged openstack/ironic master: Basic support for OVN VTEP switches https://review.opendev.org/c/openstack/ironic/+/900568 | 12:40 |
opendevreview | Merged openstack/ironic-python-agent stable/2023.1: preserve/handle config drives on 4k block devices https://review.opendev.org/c/openstack/ironic-python-agent/+/893736 | 12:44 |
iurygregory | FYI I will miss the weekly meeting today | 13:03 |
TheJulia | goodmorning | 13:59 |
TheJulia | err, good morning | 13:59 |
* TheJulia clearly needs to start sipping the coffee | 13:59 | |
rpittau | I second that and I'll go grab another espresso quickly | 14:05 |
TheJulia | so, regarding the VTEP change, any chance we can dial down the requirement to jsonschema 4.16 ? 4.19 is not in Centos9 Stream yet so things are breaking | 14:20 |
iurygregory | sounds good to me | 14:23 |
JayF | I set the requirement where I did to make it pass reliably on all python versions | 14:40 |
JayF | As long as CI is happy, I will be | 14:40 |
JayF | But we have to have support for something that's only in the newer ones, I think it was the ability to set dependent fields | 14:41 |
JayF | Can someone moderate the meeting this morning? | 14:44 |
TheJulia | was there something specific that we went to use that was only in 4.19 ? | 14:44 |
* TheJulia pokes packages.ubuntu.com | 14:47 | |
TheJulia | looks like launchpad is also down | 14:49 |
JayF | TheJulia: the ability to set dependent fields iirc | 14:50 |
JayF | There is something in the schema for the VTe0 ports that we don't have anywhere else, that didn't work reliably between older and newer versions | 14:50 |
JayF | I'll note that since then, I seen some of Iury changes that set a schema URL explicitly, and I wonder if that might also be a solution | 14:51 |
TheJulia | i guess the underlying challenge is to support installation on a binary distribution, I wonder if we need to revisit the logic there to be able to dial it to slightly older so it is in distributions | 14:54 |
TheJulia | fairly up to date debian 4.10 | 14:56 |
JayF | I'm saying I painted with a broad brush | 14:57 |
TheJulia | understood | 14:57 |
JayF | because upgrading requirements IMO is a positive thing unless there's a hitch (like this) | 14:57 |
JayF | and I can probably be more targetted now that I know there's a hitch | 14:57 |
JayF | I guess I'll run the meeting in lieu of volunteers, I may not be around afterwards, woke up feeling a bit ill | 14:57 |
TheJulia | debian unstable is still 4.10 | 14:58 |
JayF | I suspect >=4 is fine | 14:58 |
TheJulia | I can run it, go get some rest | 14:58 |
TheJulia | I'm just in another meeting right now | 14:58 |
JayF | eh if it's just me and you it's going to be a lot of #topic #topic #topic #end | 14:58 |
JayF | lol | 14:58 |
TheJulia | it is likely going to wrap any minute | 14:58 |
TheJulia | true, lack of quorum | 14:58 |
JayF | if it's just me and you maybe I bail the meeting with exactly that message | 14:59 |
JayF | unless there's a pressing item on genda | 14:59 |
* TheJulia starts the coffee maker | 14:59 | |
JayF | #startmeeting Ironic | 15:00 |
opendevmeet | Meeting started Mon Feb 5 15:00:13 2024 UTC and is due to finish in 60 minutes. The chair is JayF. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
opendevmeet | The meeting name has been set to 'ironic' | 15:00 |
TheJulia | o/ | 15:00 |
* TheJulia hands out coffee to everyone awake | 15:00 | |
JayF | Do we have quorum? | 15:00 |
JayF | o/ | 15:00 |
masghar | o/ | 15:00 |
TheJulia | Is there some holiday we didn't get a memo on? | 15:00 |
JayF | Not today afaik | 15:00 |
* TheJulia suspects we don't have quorum | 15:00 | |
JayF | Unless there is objection, I'm going to close the meeting for lack of quorum. I see nothing pressing on https://wiki.openstack.org/wiki/Meetings/Ironic to make me wanna push forward with 3 folks | 15:01 |
TheJulia | Well, we can just punt and if there is a specific topic or decision we can handle it as needed | 15:01 |
TheJulia | +1 to lack of quorum/end the meeting for today | 15:01 |
masghar | ++, agreed | 15:01 |
JayF | #info Only three Ironic contributors for meeting, cancelling for lack of quorum. | 15:03 |
JayF | #endmeeting | 15:03 |
opendevmeet | Meeting ended Mon Feb 5 15:03:07 2024 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:03 |
opendevmeet | Minutes: https://meetings.opendev.org/meetings/ironic/2024/ironic.2024-02-05-15.00.html | 15:03 |
opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/ironic/2024/ironic.2024-02-05-15.00.txt | 15:03 |
opendevmeet | Log: https://meetings.opendev.org/meetings/ironic/2024/ironic.2024-02-05-15.00.log.html | 15:03 |
opendevreview | Julia Kreger proposed openstack/ironic master: packaging: reduce jsonschema revision https://review.opendev.org/c/openstack/ironic/+/907759 | 15:29 |
TheJulia | added ironic-week-prio flag to ^ | 15:38 |
rpittau | TheJulia: just FYI ubuntu jammy has 3.2.0 | 15:58 |
TheJulia | yeah, 3.2.0 fails | 16:18 |
TheJulia | 3.2.0 was released nov 18, 2019 | 16:19 |
rpittau | yep | 16:22 |
TheJulia | I'm not sure we want to take on the additional complexity to get 3.2.0 working, since ubuntu is sort of not moving it forward anyway | 16:24 |
rpittau | I don't think it's worth either, and there are multiple ways to work around that | 16:28 |
TheJulia | Yeah | 16:28 |
JayF | The thing is I'm not sure four is actually required to make it work... I will probably take a timeboxed look at this later | 16:29 |
TheJulia | 3.2.0 was the last release before 4.0.0 | 16:29 |
TheJulia | 4.0.0 itself was yanked, 4.0.1 was uploaded | 16:29 |
*** ravlew is now known as Guest1715 | 16:29 | |
rpittau | good night! o/ | 17:13 |
opendevreview | Merged openstack/networking-generic-switch master: [codespell] Adding Tox Target for Codespell https://review.opendev.org/c/openstack/networking-generic-switch/+/906792 | 17:41 |
AcormierAtJunip | We hit a pretty serious Neutron networking issue related to baremetal nodes when using OVN: https://bugs.launchpad.net/neutron/+bug/1995078. I believe this issue prevents anyone from operating an HA Openstack/Ironic environment with the networking generic switch driver. | 18:11 |
AcormierAtJunip | The short of it is that Neutron has a different scheduling mechanism for external/baremetal ports than it does for the L3 router interface. If these two ports in OVN land on a different chassis (odds are they will) the packets will get dropped. | 18:11 |
opendevreview | Dmitry Tantsur proposed openstack/ironic master: Extract common code for managers with periodics and workers https://review.opendev.org/c/openstack/ironic/+/907898 | 18:11 |
TheJulia | AcormierAtJunip: yeouch | 18:12 |
AcormierAtJunip | Just wanted to call this out for posterity. It was very difficult for me to reach the bottom of what issue we were facing. The symptom was that no ARP response was being generated by OVN for the internal gateway. | 18:13 |
dtantsur | Could you file a bug against ironic? Sounds like at least it has to be tracked. | 18:13 |
dtantsur | or s/ironic/networking-generic-switch/ | 18:13 |
JayF | I'm adding NGS as impacted | 18:13 |
AcormierAtJunip | I can do that. I figured that since OVN seems to be taking over as default network driver this would be pretty critical for Ironic | 18:14 |
TheJulia | ... I wonder how we might fix this. | 18:15 |
dtantsur | JayF: I'd rather have a baremetal-specific bug tbh | 18:15 |
JayF | dtantsur: then file what you want? | 18:15 |
JayF | I don't know what you're looking for unless we have code changes to coordinate | 18:15 |
dtantsur | I don't understand it even remotely enough | 18:15 |
JayF | Yeah that's why I'm not filing a bug and just making it as Ironic-y | 18:15 |
AcormierAtJunip | There is a PR which is kind of abandoned: https://review.opendev.org/c/openstack/neutron/+/872033 | 18:15 |
dtantsur | which is largely why I'd want it written | 18:15 |
JayF | this is wildly out of my wheelhouse of Ironic knowledge :) | 18:15 |
AcormierAtJunip | But I BELIEVE would fix the issue | 18:16 |
JayF | the OVN VTEP stuff was all taken from one AcormierAtJunip's original patch lol | 18:16 |
JayF | launchpad is having a bad day | 18:16 |
AcormierAtJunip | The owner of that issue is Rodolfo Alonso, which I believe is a lead for Neutron | 18:16 |
JayF | I think I added NGS as impacted but couldn't get a comment through | 18:16 |
TheJulia | launchpad is definitely having a very bad day | 18:17 |
AcormierAtJunip | Was kind of hoping we might be able to convey the importance of this issue to Ironic's functionality. Assuming networking baremetal nodes with VMs is a priority | 18:17 |
JayF | I mentioned it in Neutron IRC | 18:18 |
JayF | we'll see what folks say | 18:18 |
JayF | I don't have much technical help to offer but I can poke people and ask them nicely to do things :D | 18:18 |
AcormierAtJunip | That's about as much I can hope, appreciate it. | 18:19 |
TheJulia | AcormierAtJunip: Thank you for raising visibility | 18:21 |
TheJulia | I've let some downstream folks know as well | 18:21 |
AcormierAtJunip | Of course | 18:22 |
TheJulia | oh where oh where did I put my brain | 18:23 |
opendevreview | Merged openstack/sushy master: [codespell] Adding Tox Target for Codespell https://review.opendev.org/c/openstack/sushy/+/906798 | 18:53 |
opendevreview | Merged openstack/ironic master: packaging: reduce jsonschema revision https://review.opendev.org/c/openstack/ironic/+/907759 | 19:16 |
opendevreview | Merged openstack/ironic master: tox: Drop envdir https://review.opendev.org/c/openstack/ironic/+/907560 | 19:16 |
opendevreview | Merged openstack/sushy master: [codespell] Adding CI target for Tox Codespell https://review.opendev.org/c/openstack/sushy/+/906799 | 19:24 |
opendevreview | Merged openstack/ironic stable/2023.1: [Backport] Fixes Raid creation in iLO6 and other BMC with latest schema https://review.opendev.org/c/openstack/ironic/+/904069 | 19:40 |
opendevreview | Merged openstack/sushy master: Handle session-uri in body https://review.opendev.org/c/openstack/sushy/+/867969 | 20:55 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!