Thursday, 2021-11-25

opendevreviewGhanshyam proposed openstack/ironic master: Updating yoga tested python versions in classifier  https://review.opendev.org/c/openstack/ironic/+/81922902:01
opendevreviewGhanshyam proposed openstack/ironic-inspector master: Updating yoga tested python versions in classifier  https://review.opendev.org/c/openstack/ironic-inspector/+/81923002:01
opendevreviewGhanshyam proposed openstack/ironic-prometheus-exporter master: Updating yoga tested python versions in classifier  https://review.opendev.org/c/openstack/ironic-prometheus-exporter/+/81923102:01
opendevreviewGhanshyam proposed openstack/ironic-lib master: Updating yoga tested python versions in classifier  https://review.opendev.org/c/openstack/ironic-lib/+/81923202:01
opendevreviewGhanshyam proposed openstack/metalsmith master: Updating yoga tested python versions in classifier  https://review.opendev.org/c/openstack/metalsmith/+/81923502:07
opendevreviewGhanshyam proposed openstack/networking-generic-switch master: Updating yoga tested python versions in classifier  https://review.opendev.org/c/openstack/networking-generic-switch/+/81923602:07
opendevreviewGhanshyam proposed openstack/ironic-python-agent master: Updating yoga tested python versions in classifier  https://review.opendev.org/c/openstack/ironic-python-agent/+/81923702:07
opendevreviewGhanshyam proposed openstack/python-ironic-inspector-client master: Updating python testing as per Yoga testing runtime  https://review.opendev.org/c/openstack/python-ironic-inspector-client/+/81923902:17
opendevreviewGhanshyam proposed openstack/networking-baremetal master: Updating yoga tested python versions in classifier  https://review.opendev.org/c/openstack/networking-baremetal/+/81924002:17
opendevreviewGhanshyam proposed openstack/python-ironicclient master: Updating yoga tested python versions in classifier  https://review.opendev.org/c/openstack/python-ironicclient/+/81924102:17
opendevreviewGhanshyam proposed openstack/sushy master: Updating yoga tested python versions in classifier  https://review.opendev.org/c/openstack/sushy/+/81924202:17
opendevreviewGhanshyam proposed openstack/sushy-tools master: Test all supported python version  https://review.opendev.org/c/openstack/sushy-tools/+/81924302:25
opendevreviewGhanshyam proposed openstack/virtualbmc master: Test all supported python version  https://review.opendev.org/c/openstack/virtualbmc/+/81924402:25
opendevreviewGhanshyam proposed openstack/tenks master: Test all supported python version  https://review.opendev.org/c/openstack/tenks/+/81924502:25
stevebaker[m]TheJulia: oh, on centos /boot/efi is mounted with umask=0077 so only root can read shim/grub. This is a problem for ironic-conductor loader_file_paths02:43
*** tkajinam is now known as Guest674106:15
opendevreviewMichal Nasiadka proposed openstack/ironic-python-agent master: Add LVM based image support to MD scenario  https://review.opendev.org/c/openstack/ironic-python-agent/+/81668506:45
opendevreviewMichal Nasiadka proposed openstack/ironic-python-agent master: Add LVM based image support to MD scenario  https://review.opendev.org/c/openstack/ironic-python-agent/+/81668506:47
rpittaugood morning ironic! o/06:51
iurygregorygood morning rpittau and Ironic o/07:31
rpittauhey iurygregory :)07:31
iurygregoryI'm wondering if we really need to run the functional tests in 3.9 https://review.opendev.org/c/openstack/python-ironic-inspector-client/+/819239 thoughts?07:35
opendevreviewMerged openstack/networking-baremetal master: Updating yoga tested python versions in classifier  https://review.opendev.org/c/openstack/networking-baremetal/+/81924007:45
arne_wiebalckGood morning rpittau iurygregory and Ironic!07:45
rpittauhey arne_wiebalck :)07:45
opendevreviewMerged openstack/networking-generic-switch master: Updating yoga tested python versions in classifier  https://review.opendev.org/c/openstack/networking-generic-switch/+/81923607:46
iurygregoryhey arne_wiebalck o/07:46
opendevreviewMerged openstack/ironic master: Updating yoga tested python versions in classifier  https://review.opendev.org/c/openstack/ironic/+/81922907:52
opendevreviewMerged openstack/ironic-inspector master: Updating yoga tested python versions in classifier  https://review.opendev.org/c/openstack/ironic-inspector/+/81923007:52
opendevreviewMerged openstack/ironic-lib master: Updating yoga tested python versions in classifier  https://review.opendev.org/c/openstack/ironic-lib/+/81923207:52
opendevreviewMerged openstack/ironic-prometheus-exporter master: Updating yoga tested python versions in classifier  https://review.opendev.org/c/openstack/ironic-prometheus-exporter/+/81923107:52
rpittaummm weird it seems like the latest ironic-lib broke ipa, or it was broken even before but we didn't realize it because there was no keyword argument08:33
dtantsurmorning folks08:36
rpittaugood morning dtantsur :)08:36
dtantsurrpittau: any reference? also, hmm, why didn't the CI job catch it08:36
rpittaudtantsur: it's "just" unit tests https://review.opendev.org/c/openstack/ironic-python-agent/+/81923708:37
rpittauI tested on py36 and py37 too, same result08:37
rpittaualso if we change and add run_as_root=True it gives the same erro but for the run_as_root argument08:38
dtantsurugh08:38
dtantsurwell, okay, I suspect we may be doing something nasty in unit tests08:38
dtantsurwhy is it lambda, not a mock?08:38
iurygregoryyeah, I'm getting  TypeError: <lambda>() got an unexpected keyword argument 'sparse_size'08:40
dtantsurmeanwhile, the enum craziness is coming to its end: I think https://review.opendev.org/c/openstack/sushy/+/819097 and https://review.opendev.org/c/openstack/sushy/+/819099 are the last two patches before I can clean everything up and write a release note (and fix any fallout in ironic)08:50
opendevreviewDmitry Tantsur proposed openstack/ironic master: Do not assume sushy constants are strings - part 2  https://review.opendev.org/c/openstack/ironic/+/81926908:59
dtantsurand this is the fallout ^^^08:59
opendevreviewDmitry Tantsur proposed openstack/ironic master: Add a unit test job with Sushy from source  https://review.opendev.org/c/openstack/ironic/+/81855309:00
opendevreviewMark Goddard proposed openstack/tenks master: Test all supported python version  https://review.opendev.org/c/openstack/tenks/+/81924509:10
dtantsurrpittau, iurygregory, is anybody looking into the failing tests or should I?09:38
iurygregorydtantsur, I'm testing a few things locally, but no luck yet09:39
rpittaudtantsur: sorry I was taken by other stuff downstream09:39
dtantsuriurygregory: in RealFilePartitioningTestCase we should either get rid of lambdas or use lambda _*, _**: ...09:41
dtantsurline 1105 is the culprit09:41
dtantsurusing a Mock is probably more reasonable09:41
iurygregoryso, remove the lambda and set to autospec and mock things right?09:43
arne_wiebalckThere is no way to check an active node via, say, the cleaning framework to do a quick CPU burn-in, right? This is what we do manually at the moment after a CPU replacement (boot into a live image & run stress-ng manually). Would be great Ironic for this.09:46
dtantsuriurygregory: a light version would be to literally replace a lambda with a mock.Mock (or MagicMock? I don't remember which is callable)09:46
iurygregoryok let me try this here09:47
arne_wiebalck*to use09:47
dtantsurarne_wiebalck: we have toyed with the idea of "active steps", but nobody volunteered to do the heavy lifting09:47
arne_wiebalckdtantsur: thanks, is there a spec or something?09:48
dtantsurarne_wiebalck: a spec is the first thing to do :)09:50
arne_wiebalck dtantsur heh :-D09:50
dtantsurtechnically it shouldn't be hard. there are some policy decisions to make though: do we allow only OOB or also rebooting, etc09:51
opendevreviewAija Jauntēva proposed x/sushy-oem-idrac master: Updating yoga tested python versions in classifier  https://review.opendev.org/c/x/sushy-oem-idrac/+/81927709:52
arne_wiebalckdtantsur: right, thanks09:53
iurygregorydtantsur, thanks for the feedback in the yoga themes =)10:00
dtantsursure thing10:01
iurygregoryfor sure mock is something magic... I've changed (disk_utils, 'convert_image', lambda *_: None) to (disk_utils, 'convert_image', autospec=True) added the mock param in the tests -> Green O.o10:03
opendevreviewMichal Nasiadka proposed openstack/ironic-python-agent master: Add LVM based image support to MD scenario  https://review.opendev.org/c/openstack/ironic-python-agent/+/81668510:03
iurygregorylet's see what CI will say10:05
dtantsurwell, lambda *_ only accepts positional arguments, while ironic-lib uses keyword ones10:07
dtantsurMock does not care10:07
opendevreviewIury Gregory Melo Ferreira proposed openstack/ironic-python-agent master: Fix unit tests in RealFilePartitioningTestCase  https://review.opendev.org/c/openstack/ironic-python-agent/+/81928310:07
iurygregoryyeah10:07
iurygregoryusing *_, **__ would also solve the problem (at least it worked locally)10:08
dtantsuryeah, but using mocks is probably a more natural thing10:09
iurygregory++10:09
iurygregorygoing to review the enum patches in sushy now10:09
dtantsuriurygregory: I wonder if we should convert all instances of lambda to future-proof oursevles10:09
dtantsur(and to use autospec)10:09
iurygregoryI can do that10:09
opendevreviewIury Gregory Melo Ferreira proposed openstack/ironic-python-agent master: Get rid of lambda in RealFilePartitioningTestCase  https://review.opendev.org/c/openstack/ironic-python-agent/+/81928310:24
iurygregorydtantsur, done ^10:24
dtantsurthx!10:24
ajyaHi dtantsur , virtual media boot has been fixed in iDRAC since 4.40.10.00 (released spring '21). Could the restriction be loosen up based on firmware_version to allow use it with >= 4.40.10.00 iDRACs? https://opendev.org/openstack/ironic/src/branch/master/ironic/drivers/modules/redfish/boot.py#L41511:43
dtantsurw000t!12:06
dtantsurajya: yeah, I'm all for it. wanna propose a patch (especially if you have hardware to test it)?12:07
opendevreviewMerged openstack/sushy master: Migrate Fabric to enums  https://review.opendev.org/c/openstack/sushy/+/81909712:09
dtantsurajya: we may need to start somehow caching the firmware version to avoid querying it inside of the validation code.. or just move this validations to prepare_ramdisk where all information is available.12:09
opendevreviewMerged openstack/ironic master: Enable iPXE boot interface by default  https://review.opendev.org/c/openstack/ironic/+/81682412:11
plundraHello12:16
plundraBy your relation to Sushy, is why I'm asking so bare with me. Does anyone know what the redfish endpoints are for the Multi Node stuff on Supermicro's BigTwin machines?12:17
dtantsurunfortunately, I'm familiar with neither Multi Node nor BigTwin12:19
dtantsurtimeu: does it ring any bells?12:19
timeuhmm we do have some SuperMicro but haven't used them with Redfish only Lenovo server/blades12:21
timeualso definately not BigTwin machines 12:21
dtantsurthen sorry, I might have confused you with someone else :)12:22
hgySorry, I'm not familiar with it12:25
hgytoo12:25
opendevreviewMerged openstack/sushy master: Migrate System Network to enums  https://review.opendev.org/c/openstack/sushy/+/81909912:25
ajyadtantsur: ok, will take a look and propose a patch12:26
dtantsur++12:27
opendevreviewDmitry Tantsur proposed openstack/sushy master: Finalize the enum migration  https://review.opendev.org/c/openstack/sushy/+/81930912:41
dtantsurthis change adds the release note ^^^ feedback really appreciated12:41
hgyHello, sorry to bother12:48
hgyCould I ask a question?12:48
hgyI was configure network for Ironic via https://docs.openstack.org/ironic/victoria/install/configure-networking.html12:51
hgyBut before I add nic to ovs-bridge, network down, even if I had move IP to ovs-bridge12:52
hgyI coundn't ping gateway and external network12:53
hgyMy operations like this: https://paste.opendev.org/show/811281/12:53
dtantsurI'm not really familiar with these things, maybe mgoddard or hjensas_ could help?13:05
hgydtantsur: love you, dtantsur13:06
* hjensas_ looks13:08
hjensas_hgy: I'm spoiled with deployment tooling doing this for me. What is the output of 'ip addr show br0', 'ovs-vsctl show', 'ip route'?13:13
hgyhjensas_: hey, thank you so much. It's here: https://paste.opendev.org/show/811282/13:16
hgyhjensas_: This is a clean environment. I just did the ovs bridge operation, but I still coundn't connect the network13:17
hjensas_hgy: is ens2 up? 'ip addr show ens2'? Try to bring it up if not. Try tcpdump? Do you see traffic going out ens2 when you try to ping something external on 10.12.21.0/2413:24
bkrahas anyone succeeded to boot a PXE deployment image using UEFI Secure boot? 13:26
bkraor is there more info availble on this? can't seem to find info on this anywhere 13:31
hgyhjensas_: I'm so appreciate with you. look this: https://paste.opendev.org/show/811283/13:34
hgyhjensas_: I have operated "ens2 up". And tcpdump, but I coun't reach external network, and some messy packets were captured13:36
hgybkra: hey, Do you have an specific report of an error13:37
hgybkra: Community Document is the most detailed info: https://docs.openstack.org/ironic/latest/install/13:39
hjensas_hgy: the addresses you are pinging is off network, and there is no default route afict from the ip route command.13:40
hgybkra: you can refer to it first, and If you meet specific question, we can talk about it13:40
hjensas_hgy: ip route add default via <IP_of_router_on_10.12.21.0/24> network?13:41
hgybkra: but I'm just a newer, maybe I can just resolve small question. 13:42
hjensas_bkra: re secure-boot, thre is some docs here https://docs.openstack.org/ironic/latest/admin/security.html#secure-boot13:47
opendevreviewMerged openstack/ironic-python-agent master: Get rid of lambda in RealFilePartitioningTestCase  https://review.opendev.org/c/openstack/ironic-python-agent/+/81928313:47
hjensas_bkra: I know some people with knowledge is off-work this week, I'd try asking again on monday.13:48
hgyhjensas_: sorry, I didn't set the default dateway. I have set it and the tcpdump is: https://paste.opendev.org/show/811284/13:50
hgyhjensas_: you are really a good people13:51
hgyhjensas_: love you13:51
hjensas_hgy: afict the "21:48:44.918123 ARP, Request who-has 10.12.21.1 tell 10.12.21.143, length 28" indicates that your node is sending traffic on to the network. Asking for the MAC address of the gateway.13:52
bkrathanks alot guys, gonna look into the property13:55
hgyhjensas_: This host is a macvtap(bridge model) virtual machine, maybe this could effect it? 13:55
hjensas_hgy: possibly. It is strange I also see ARP requests originating from the gateway - "21:48:30.806370 ARP, Request who-has 10.12.21.63 tell 10.12.21.1, length 46"13:57
dtantsurbkra: PXE and secure boot is a pain. you basically need to use grub, which is not something Ironic supports out of box. TheJulia has been playing with it.13:57
TheJuliaWell, you *also* need a signed grub NetBoot binary13:58
dtantsuroh, it's a different one? (good morning TheJulia)13:59
bkradtantsur: That's new for me; So you mean you can use GRUB to handle the PXE process instead of using the NIC Vendor's UEFI/BIOS PXE process? 13:59
TheJuliaUbuntu ships one, and I think that is it. Some people do ask MSFT to sign ipxe for this purpose, and they have gone on the record saying they will but that requires time and process and a little money14:00
TheJuliadtantsur: unfortunately yeah14:00
TheJuliaStock grub doesn’t know networking14:00
hgyhjensas_: well, thank you so much, I will check it soon. Or switch an environment14:00
TheJuliaIt will start but it won’t know to load confit so you get a grub shell and that is all folks14:01
dtantsurunrelated: looking for reviews on https://review.opendev.org/c/openstack/ironic/+/819269 please, it is blocking a sushy release14:01
TheJuliaErr config14:01
dtantsurTheJulia: do you recall if our standard UEFI PXE (not iPXE) procedure is compatible with secure boot (for bkra's question)?14:02
dtantsurI mean https://docs.openstack.org/ironic/latest/install/configure-pxe.html#uefi-pxe-grub-setup14:02
dtantsurseems like it may be actually14:03
TheJuliadtantsur: yes, I believe so.14:03
dtantsurokay, bkra, you may try following https://docs.openstack.org/ironic/latest/install/configure-pxe.html#uefi-pxe-grub-setup (not the iPXE guide)14:04
TheJuliaWe even have the  I job but I dont think we force the vm into secure boot mode14:04
TheJuliaErr ci job14:04
dtantsurno, I don't think so either14:04
* TheJulia needs a caffeine in14:05
TheJuliaIf14:07
TheJuliaErrr autocorrect14:07
opendevreviewMerged openstack/tenks master: Test all supported python version  https://review.opendev.org/c/openstack/tenks/+/81924514:10
bkraTheJulia: thanks, will do14:10
* TheJulia resumes cat cuddling14:11
opendevreviewRiccardo Pittau proposed openstack/ironic-tempest-plugin master: Update pep8 requirements  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/81931914:13
TheJuliaQuestion of the day: why are corgi’s like neutron stars?14:16
opendevreviewRiccardo Pittau proposed openstack/ironic-tempest-plugin master: Update jobs for yoga cycle  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/81932114:18
dtantsurTheJulia: because gravity?14:19
rpittauTheJulia: in terms of mass? or they spin very fast? :)14:19
TheJuliaMass14:19
TheJuliaThey can spin too, but are not sitting on my leg then14:20
rpittau:D14:21
dtantsurjust imagine corgis SPINNING on your leg :D14:22
TheJuliaEeek14:22
bkraDo you have to specify boot_mode:uefi before IPA installs the deployment image? My Dell server still doesn't recognize any UEFI filesystems :-(14:40
bkraCould it be that I have to instruct DIB to create UEFI specfic files for my deployment image?14:41
bkranvm i think i forgot to specify block-device-efi 14:45
dtantsurboth :)14:45
arne_wiebalckTheJulia: this one stems back from when Belmiro had a look: https://bugs.launchpad.net/nova/+bug/193395514:56
arne_wiebalckTheJulia: you even commented back then :)14:56
TheJuliaarne_wiebalck: that is an easy one to fix14:58
TheJuliaI likely can't slip it into my current change https://review.opendev.org/c/openstack/nova/+/813897 ;)14:58
TheJuliaI'd have to retitle it "fix all the problems!"14:58
arne_wiebalckheh: the ultimate patch!14:59
TheJuliabkra: that is weird...14:59
TheJuliaso... it *shouldn't* need to scan the filesystems, we inject the UEFI nvram entry. Does it not find what is defined on the uefi nvram entry?  of course,, yeah, you do need that if your doing a dib image :)14:59
rloohi dtantsur, I've got a question about configdrives in ironic. Puzzled by this method check_allow_configdrive: https://opendev.org/openstack/ironic/src/branch/master/ironic/api/controllers/v1/utils.py#L967. I'm not sure that works if the configdrive is gzipped, base64-encoded (which is what nova is passing to ironic)15:17
dtantsurrloo: I think this is not called for gzipped configdrives15:18
rloo(someone downstream said they were having issues with ironic wrt configdrives, so I'm looking through the code cuz I don't have access to their cluster right now)15:18
rlooit is called from https://opendev.org/openstack/ironic/src/branch/master/ironic/api/controllers/v1/node.py#L109315:20
dtantsurrloo: maybe the schema allows a string? I don't remember, on a meeting now15:21
rloook, no worries, i didn't want to spend time trying to reproduce... 15:22
opendevreviewMerged openstack/sushy master: Finalize the enum migration  https://review.opendev.org/c/openstack/sushy/+/81930915:23
rlooah, the schema DOES allow a string. (so it isn't really validating much in that case but is fine...) thx dtantsur!15:24
opendevreviewVerification of a change to openstack/ironic-tempest-plugin master failed: Move API base out of admin test location  https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/81916415:38
dtantsurTheJulia: DIB does not add an EFI partition by default...15:45
TheJuliadtyeah, it should15:46
opendevreviewDavid Hill proposed openstack/python-ironicclient master: Convert mac addresses to lowercase to avoid mismatch  https://review.opendev.org/c/openstack/python-ironicclient/+/81935816:40
rpittauwell after some tests I can say that we're definitely not ready to run bifrost on centos 9 stream16:51
rpittauwe can blame centos 9 though16:52
dtantsurmmm?16:52
rpittauseems still missing a bunch of stuff16:53
dtantsurfor example?16:54
dtantsurI'm afraid we will have to figure it out sooner or later16:54
rpittauepel repo needs to be installed manually, libvirt-devel is missing...16:55
rpittauoh definitely we can work around that16:55
rpittauoh mmm lsb_release is not maintained anymore16:55
dtantsurwe probably don't really need lsb_release16:56
dtantsurlibvirt-devel is really strange16:56
opendevreviewMichal Nasiadka proposed openstack/ironic-python-agent master: Add LVM based image support to MD scenario  https://review.opendev.org/c/openstack/ironic-python-agent/+/81668517:01
rpittaumaybe it changed name? but still odd17:02
rpittauoh ok... I found it17:02
dtantsurwhere? I'm looking at a stream9 container and cannot see anything17:03
rpittauit's in a disabled repo17:04
dtantsur\o/17:04
dtantsurI guess it makes sense17:04
rpittau:/17:04
rpittaulet's try a new run17:04
dtantsurhmm, the stream9 image is significantly smaller than stream817:05
dtantsurthis is promising17:05
rpittau"Ironic is installed and running"17:31
rpittauafter fixing a couple of things the installation went through and I'm happy with that for today :)17:31
dtantsurwoohoo17:32
dtantsurany patches to review?17:32
rpittaunot yet, the nodesets are not ready17:32
dtantsurle sigh17:32
dtantsurany ETA on that? or just at some point in time?17:33
rpittauwell, they're there, just not available yet17:33
dtantsurOo17:33
rpittauI think we're missing something on zuul side and infra, the definition should be in https://opendev.org/opendev/base-jobs/src/branch/master/zuul.d/nodesets.yaml but it's not17:38
rpittauanyway, I have too many tabs open in my brain at the moment, needs to rest, see you tomorrow! o/17:39
dtantsursee you17:40
dtantsurI'll probably go get some dinner too18:00
stevebaker[m]morning19:20
arne_wiebalckhey stevebaker[m] o/19:22
opendevreviewMerged openstack/metalsmith master: Updating yoga tested python versions in classifier  https://review.opendev.org/c/openstack/metalsmith/+/81923519:23
arne_wiebalckbye everyone o/20:00
opendevreviewSteve Baker proposed openstack/ironic master: Write master grub config on startup  https://review.opendev.org/c/openstack/ironic/+/81558021:00
opendevreviewSteve Baker proposed openstack/ironic master: Capture [pxe]loader_file_paths for distros  https://review.opendev.org/c/openstack/ironic/+/81539221:00
opendevreviewSteve Baker proposed openstack/ironic master: Remove isfile check from place_loaders_for_boot  https://review.opendev.org/c/openstack/ironic/+/81937821:00
opendevreviewSteve Baker proposed openstack/bifrost master: Use distro conf loader_file_paths to copy ipxe/grub files  https://review.opendev.org/c/openstack/bifrost/+/81870921:00
opendevreviewSteve Baker proposed openstack/bifrost master: WIP support grub network boot  https://review.opendev.org/c/openstack/bifrost/+/80722021:00
opendevreviewGhanshyam proposed openstack/virtualbmc master: Updating python testing as per Yoga testing runtime  https://review.opendev.org/c/openstack/virtualbmc/+/81924421:38

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!