Thursday, 2021-08-19

*** pmannidi is now known as pmannidi|SA00:30
iurygregorygood morning Ironic06:20
iurygregoryhey janders o/06:35
jandersgood morning iurygregory o/06:35
iurygregorygood afternoon/night for you :D06:36
arne_wiebalckGood morning janders iurygregory and Ironic!06:49
iurygregorymorning arne_wiebalck o/06:49
*** rpittau|afk is now known as rpittau07:08
rpittaugood morning ironic! o/07:08
iurygregorymorning rpittau o/07:09
rpittauhey iurygregory :)07:09
iurygregoryin about 1hr our CI might be back to normal :D (if https://review.opendev.org/c/openstack/devstack/+/805040 merges)07:11
opendevreviewMerged x/sushy-oem-idrac master: Update default IncludeInExport value  https://review.opendev.org/c/x/sushy-oem-idrac/+/80049707:29
arne_wiebalckdtantsur: I could not find a section on Ironic's power sync explaining sync_power_state_workers for instance. I am happy to give it a shot, unless you are better at finding documentation :)07:36
opendevreviewMerged x/sushy-oem-idrac stable/victoria: Revert "Add get PXE port MACs for BIOS mode"  https://review.opendev.org/c/x/sushy-oem-idrac/+/79906107:37
opendevreviewMerged x/sushy-oem-idrac stable/victoria: Revert "Add export system configuration"  https://review.opendev.org/c/x/sushy-oem-idrac/+/79906207:38
opendevreviewMerged x/sushy-oem-idrac stable/victoria: Update RETRY_COUNT for virtual media boot  https://review.opendev.org/c/x/sushy-oem-idrac/+/79706607:39
opendevreviewMerged x/sushy-oem-idrac stable/victoria: Update virtual media boot-related constants  https://review.opendev.org/c/x/sushy-oem-idrac/+/79706507:39
arne_wiebalckdtantsur: All I find is how the sync with Nova works.07:42
opendevreviewMerged x/sushy-oem-idrac master: Add RAID mode conversion methods  https://review.opendev.org/c/x/sushy-oem-idrac/+/79950607:44
opendevreviewMerged x/sushy-oem-idrac master: Add RAID clear foreign config method  https://review.opendev.org/c/x/sushy-oem-idrac/+/80007107:44
opendevreviewAija Jauntēva proposed x/sushy-oem-idrac master: Add OEM Task extension  https://review.opendev.org/c/x/sushy-oem-idrac/+/80026907:53
*** redrobot1 is now known as redrobot07:59
cenneGood mornings ironic.08:04
cenneiurygregory:  that's very good news! re CI08:05
iurygregorycenne, morning! yeah \o/08:05
cenne: )08:06
iurygregoryFeel free to recheck your patches :D08:31
rpittauhttps://memegenerator.net/img/instances/85667456/recheck-all-the-things.jpg08:33
dtantsurmorning ironic08:33
rpittauhey dtantsur :)08:34
dtantsurarne_wiebalck: if it's not in https://docs.openstack.org/ironic/latest/admin/tuning.html, it probably does not exist08:34
iurygregoryrpittau,++08:36
iurygregorymorning dtantsur 08:36
arne_wiebalckdtantsur: I will add it here: https://docs.openstack.org/ironic/latest/admin/power-sync.html (make the section more general)08:39
dtantsurarne_wiebalck: honestly, I have a feeling that "Tuning" is a better place for it, since it's about performance08:39
dtantsurbut up to you08:40
arne_wiebalckdtantsur: the thing is that section describes some of the options already and I would like to avoid repetition ... maybe some cross-referecing will do?08:40
arne_wiebalckreferencing08:40
iurygregorycross-referencing sounds good to me ^08:41
dtantsuryep08:42
dtantsurfolks, now that the CI behaves, could we merge https://review.opendev.org/c/openstack/ironic-lib/+/804194 and https://review.opendev.org/c/openstack/ironic-lib/+/804195/? these are holding the ironic-lib release.08:43
iurygregorydtantsur, ++08:46
iurygregorylol I saw the old +2 in https://review.opendev.org/c/openstack/ironic-lib/+/804195/ I've +W but I've removed the +W already, +2 for now08:48
opendevreviewArne Wiebalck proposed openstack/ironic master: [doc] Update power sync documentation  https://review.opendev.org/c/openstack/ironic/+/80516809:04
fmuyassarovGood morning Ironic. Is there a way I can instruct the IPA to start some systemd daemons when it is initially booted on the node09:05
dtantsurfmuyassarov: I think a custom DIB element is the way to go09:16
dtantsuryou can create a systemd service with Before: ironic-python-agent09:16
fmuyassarovdtantsur, thanks. I didn't know that it's possible with DIB element. I thought whatever we write in DIB element will be executed only while building IPA image and not when it is booted later on. 09:18
dtantsurfmuyassarov: your element can add systemd services or really anything to the final image09:23
dtantsuryou can check how it's done in the main element09:23
arne_wiebalckfmuyassarov: FWIW, we do what dtantsur suggests to disable/enable services in our image and it is pretty easy to use09:26
fmuyassarovarne_wiebalck, dtantsur that's good to know. I will go with DIB element than. Thank you!09:45
jandersdtantsur iurygregory rpittau I wanted to briefly go back to the discussion we had some time back about the default values of Inserted and WriteProtected fields in insert_media request payload10:05
jandersreference:10:05
jandershttps://review.opendev.org/c/openstack/sushy/+/80245210:06
jandersand10:06
* dtantsur is on a meeting, will respond slowly10:06
jandershttps://review.opendev.org/c/openstack/sushy/+/80269010:06
jandersdtantsur: noted!10:06
jandersthe question is - what do we do with this - and what is the "right thing" to do10:06
janderschanging defaults per se won't change much cause Ironic is calling insert_media with true,true10:07
* janders is finding link to that part of the code10:07
* iurygregory looks10:08
jandershttps://opendev.org/openstack/ironic/src/branch/master/ironic/drivers/modules/redfish/boot.py#L19910:08
jandersif we also changed Ironic behaviour, we will need to make sure the PATCH-based attachment is still fed with Inserted=True otherwise older Lenovos will break as we learned10:09
jandersso - what would be the best way about this:10:09
janders1) do nothing10:09
janders2) change ironic and sushy to match Redfish schema defaults - and have hacks in place for PATCH-based attachments (e.g. hardcode Inserted=True if use_patch)10:10
janders3) another approach?10:10
janderswhen you have time, have a look and let me know what you think10:10
jandersnow that we have the supermicro fix merged in master and backported to stable, I'm not too worried, but it seems kinda reasonable to align Ironic/sushy defaults with RF schema defaults if it doesn't wreak havoc10:12
iurygregoryInserted True is the default by redfish right?10:12
jandersI believe so10:12
iurygregoryand the only scenario so far we need this to be sent is with PATCH afaik10:12
janderscorrect10:12
iurygregoryI think its fine to change their defaults to None, and we keep in mind that Inserted is required when doing Patch (at least for Lenovo) I don't think WriteProtected is required (we need to test this scenario)10:15
iurygregoryat least I saw this in the lenovo support https://datacentersupport.lenovo.com/us/en/products/servers/thinksystem/sr650/7x06/solutions/ht508834-redfish-internal-error-when-mounting-remote-image-on-thinksystem-lenovo-thinksystem10:16
jandersWe could also set WriteProtected to True if use_patch - just to follow the principle of minimum change10:19
janders(I think Ironic and Sushy have been passing WriteProtected=True since vMedia support was added)10:20
iurygregoryyeah10:20
jandersalso don't think it's needed but maybe it's safer not to change it if there is no need?10:20
janders(no need to make the change)10:20
jandersOK - now how about the Ironic bit - do we change it not to send Inserted=True WriteProtected=True (and just send nothing)?10:21
janders(if we keep it as is that won't cause issues per se, but will be confusing, as sushy will drop these)10:22
iurygregoryIt would be better if we don't send Inserted/WriteProtected I think10:22
jandersand then just hardcode Inserted|WriteProtected to True in use_patch conditional?10:23
janders(ugly, but I can't think of a better solution)10:23
iurygregorybecause we don't really send the info in SMC...10:23
iurygregoryso it's a bit weird having hardcoded in Ironic while sushy will do some magic to remove before calling the BMC10:23
jandersyeah agreed10:23
jandersfeels like one day someone will be reading the code to make some change or debug something and will go what da...10:24
iurygregorylets wait a bit to see what others think since they are in another meeting hehe10:24
iurygregoryjanders, yeah!10:24
jandersok! I think this is a good plan, thank you iurygregory10:24
iurygregorywe will be like "wait we send True True, but sushy didn't send this information"10:24
iurygregoryetc :D10:24
jandersyeah10:25
jandershow to track the flow of information through all the layers10:25
jandersthings magically disappearing doesnt help10:26
jeevais there anywhere i can get information on the physical aspect of Ironic, in regards to physical routers & Switches configurations. We're currently running openstack deployed via kolla-ansible.10:27
iurygregoryjeeva, I'm not familiar how kolla does the deployment, but we have some general documentation about Ironic and maybe the installation guide can give some information for you  https://docs.openstack.org/ironic/latest/#installation-guide10:29
jeevai've read through pretty much all the docs but nothing address physical switches/router setups10:32
jeevaunless im missing something10:32
jeevagot about 200 nodes i want to move from hypervisors to ironic10:33
arne_wiebalckjeeva: so, instead of virtual machines you want to hand out physical instances to users directly ?10:35
jeevayes, since they have nvidia tesla V100 / A100's in them10:35
jeevaand will give a minor speed performance10:35
arne_wiebalckjeeva: GPUs work with virtual machines as well, no?10:36
jeevayes they do10:36
jeevabut 1-3% speed increase going baremetal is worth it for us10:36
* arne_wiebalck is not arguing against the idea, just likes to understand Ironic use cases10:37
arne_wiebalckjeeva: yep, this is about the same we see10:37
jeevawe analyze meerkat/ square kilometer array data10:37
jeeva"Star data"10:37
arne_wiebalckjeeva: and why we are converting some of our hosts from hypervisors to bare metal instances10:37
jeevahowever our team cant really find any concrete details about what we should do with our networking10:38
jeevafor ironic10:38
jeevabecause our network component is managed by the university's Network engineers, so we need to put on paper what they need to do for us regarding that component10:39
jeevaeverything else we self-manage10:39
iurygregoryhave you check the common considerations for network? https://docs.openstack.org/ironic/latest/install/refarch/common.html#networking10:41
iurygregorywe also have some small information regarding small cloud with trusted tennats https://docs.openstack.org/ironic/latest/install/refarch/small-cloud-trusted-tenants.html#networking10:41
jeevathanks, will have to see how this clashes with MAAS10:43
arne_wiebalckjeeva: if time permits, mgoddard may able to point you into the right direction when it comes to kolla and Ironic deployments10:51
*** pmannidi|SA is now known as pmannidi|AFK10:55
*** pmannidi|AFK is now known as pmannidi10:56
*** pmannidi is now known as pmannidi|AFK11:27
opendevreviewMerged openstack/ironic-lib master: json_rpc: list_opts() should return tuple  https://review.opendev.org/c/openstack/ironic-lib/+/80419411:37
opendevreviewMerged openstack/ironic-lib master: json_rpc: setup.cfg is missing entrypoint for json_rpc's list_opts  https://review.opendev.org/c/openstack/ironic-lib/+/80419511:37
cenneHi, would this be considered about ready for merge before the freeze? https://review.opendev.org/c/openstack/ironic/+/800084 :)11:41
iurygregorycenne, we don't really have a freeze :D and this week we are only doing release for libs11:42
iurygregorysushy, ironic-lib11:42
cenneoh okay. cool. Thanks :)11:42
iurygregoryI will try to take a look at your patch later today11:43
dtantsurwe will try to get it in. as iurygregory said, we don't have formal freezes, other than some openstack-wide library freezes11:43
dtantsurcenne: but note that next week is the freeze for ironicclient, so you may want to get that in shape asap11:43
cennedtantsur: it's ready https://review.opendev.org/c/openstack/python-ironicclient/+/80397011:44
dtantsurah, right, I've seen that and started thinking about 'secure boot on/off'11:44
dtantsuryou see, we have two different precedences: `power on/off` and `maintenance set/unset`11:44
dtantsurI guess 'on/off' makes more sense, since it's a complex action, closer to power11:45
dtantsurany opinions? iurygregory?11:45
dtantsurbut then we have `boot mode set`...11:46
iurygregoryon/off makes sense "secure boot on" "secure boot off"11:48
iurygregoryor enabled/disabled11:48
dtantsurokay, I think I won't break my head on this, will just go with the cenne's proposal11:49
cenneOn module function level it should btw be able to take even True/False etc. There's conversion to bool happening in the end. 11:53
cenneon cli on/off is slightly easier to type :P11:54
dtantsuryep12:02
cenneRe openstacksdk, the tests seem to fail on some 'cloud' tests though. 12:03
cenneIt's failing even on older patch that zuul had already blessed earlier, so I think it's def unrelated.12:03
cennehttps://review.opendev.org/c/openstack/openstacksdk/+/80210112:04
dtantsuryeah, I think there was a CI failure12:04
dtantsursee https://review.opendev.org/c/openstack/openstacksdk/+/804530/ and linked patches12:05
cenneack12:05
janderssee you tomorrow Ironic o/12:25
arne_wiebalckbye janders o/12:28
cennebye janders  o/12:30
mgoddardjeeva: hi12:36
TheJuliagood morning13:26
opendevreviewAija Jauntēva proposed x/sushy-oem-idrac stable/wallaby: Fix IncludeInExport allowed value validation  https://review.opendev.org/c/x/sushy-oem-idrac/+/80514513:29
opendevreviewAija Jauntēva proposed openstack/ironic master: Add better error messages for invalid conf molds  https://review.opendev.org/c/openstack/ironic/+/80522213:32
dtantsurmorning TheJulia 13:46
arne_wiebalckHey TheJulia o/ 13:47
iurygregorygood morning TheJulia welcome back =)13:49
iurygregoryjust a reminder I've sent the email with the midcycle schedule already - so if anyone think we should change something please let me know today13:52
iurygregoryoh I should probably mention we will be using the meetpad https://meetpad.opendev.org/ironic13:52
dtantsurcould I get a 2nd +2 on https://review.opendev.org/c/openstack/bifrost/+/802532 https://review.opendev.org/c/openstack/sushy-tools/+/803598 and https://review.opendev.org/c/openstack/sushy-tools/+/803596 please?14:52
dtantsurof these 3 only the 1st is non-trivial14:52
opendevreviewAija Jauntēva proposed x/sushy-oem-idrac master: Add OEM Task extension  https://review.opendev.org/c/x/sushy-oem-idrac/+/80026915:00
iurygregorydtantsur, done sorry for the long time the bifrost one was quite big :D15:37
dtantsurno worries, thanks much :)15:37
iurygregoryironic-cores one thing to keep in mind, the deadline for PTL Nomination is Aug 24 (ie Tuesday next week)15:40
rpittaubye, good night! o/15:51
*** rpittau is now known as rpittau|afk15:51
arne_wiebalckbye everyone o/16:04
*** sshnaidm is now known as sshnaidm|afk16:09
opendevreviewMerged openstack/sushy-tools master: Use correct status code with werkzeug exceptions  https://review.opendev.org/c/openstack/sushy-tools/+/80359816:21
opendevreviewMerged openstack/sushy-tools master: Support HTTP basic auth  https://review.opendev.org/c/openstack/sushy-tools/+/80359616:29
opendevreviewMerged openstack/bifrost master: Move Nginx code to a new role bifrost-nginx-install  https://review.opendev.org/c/openstack/bifrost/+/80253216:35
opendevreviewDmitry Tantsur proposed openstack/sushy-tools master: Handle HTTP errors when downloading virtual media  https://review.opendev.org/c/openstack/sushy-tools/+/80525517:07
opendevreviewDmitry Tantsur proposed openstack/sushy-tools master: Support credentials for virtual media  https://review.opendev.org/c/openstack/sushy-tools/+/80249317:09
opendevreviewDmitry Tantsur proposed openstack/sushy-tools master: Support credentials for virtual media  https://review.opendev.org/c/openstack/sushy-tools/+/80249317:20
opendevreviewVerification of a change to openstack/sushy-tools master failed: Add lower-constraints job to current development branch  https://review.opendev.org/c/openstack/sushy-tools/+/80437617:28
dtantsuro/17:34
TheJuliastevebaker: you around?20:16
stevebakerTheJulia: hi!20:37
TheJuliaI am starting to think grub is the root of all evil20:40
stevebakerTheJulia: I concur20:46
stevebakerTheJulia: oh I didn't realise this was already proposed for train, nice https://review.opendev.org/c/openstack/puppet-ironic/+/80443020:51
TheJuliaWell, last week :)20:52
stevebakerits taken me a week to get back to baseline after pfizer-120:54
opendevreviewMerged openstack/ironic stable/wallaby: Retry stdlib ssl.SSLError  https://review.opendev.org/c/openstack/ironic/+/80367521:02
TheJuliastevebaker: yeouch :(21:48
TheJuliaI'm not looking forward to moderna-321:48
stevebakerhey, its better than the alternative. I can't wait for pfizer-2 now that delta is spreading here21:51
TheJuliaugh :(21:51
stevebakerwe had a good run21:55
TheJuliayeah21:59
stevebakerIt will be interesting to see if an elimination strategy can work with delta. The whole country went into hard lockdown as soon as case 1 was found22:08
jandersgood morning Ironic o/22:50
*** pmannidi|AFK is now known as pmannidi23:21
*** pmannidi is now known as pmannidi|brb23:31

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!