Thursday, 2022-06-16

opendevreviewSteve Baker proposed openstack/ironic master: Allocation candidates prefer matching name  https://review.opendev.org/c/openstack/ironic/+/84585603:31
arne_wiebalckGood morning, Ironic!06:25
waleedmTheJulia, Can you please review this https://review.opendev.org/c/openstack/ironic-python-agent/+/84558307:21
ajyaiurygregory, janders is this about 730 or 740? Or both?07:21
rpittaugood morning ironic! o/07:33
dmelladohiya rpittau ;)07:47
rpittauhey dmellado :)07:48
dmelladohumidity 72% and hitting 30ยบ today, let's see xD07:48
rpittaukind of in the same situation here :/07:49
* dmellado wonders how July would be07:49
rpittau:(07:50
ajyaiurygregory, janders I checked - in 13G (R730) there is no support for these management functions, in 14G (R740) there is. Generally, I wouldn't use Redfish with 13G, try WS-Man. cc rpioso 07:53
ajyawhile in 13G there is some Redfish support, it does not receive new features and sometimes bugs are not backported too. 13G is still WS-Man world.07:54
ajyae.g., Redfish RAID interface is not working in 13G too.07:55
jandersThank you ajya09:02
jandersajya I wonder - should we enhance clear_job_queue (and other clean/verify steps specific to iDRAC) so that they check the generation and don't run on 13G (or older hardware in general)?09:02
jandersthey won't run on non-Dells, but once we have a node with iDRAC driver Ironic will always try running them AFAIK09:03
jandersalso - do we need to install any specific packages to use iDRAC specific stuff ( clean/verify steps, using idrac-redfish-virtualmedia boot interface )?09:06
ajyajanders: there is idrac-wsman implementation for clear_job_queue. Or do you want to keep using idrac-redfish on 13G?09:08
jandersI can try (to get to the bottom of it) but the problem is that downstream things tend to be streamlined and we don't have as much control as in Ironic09:08
ajyaabout packages - like sushy-oem-idrac or python-dracclient?09:08
jandersyeah this kind of stuff09:09
janders(for the context - downstream = metal3/ocp, not OSP - OSP is very much like upstream in this sense - more tweakable)09:09
ajyalooking at the errors, you already have sushy-oem-idrac installed otherwise wouldn't get so far. Not sure how metal3 installs these, but can check if they are there out of the box09:14
ajyajanders: metal3 has option for idrac-wsman (with idrac://), but wsman has no support for virtual media boot.09:16
ajyaIt's possible to mix and match idrac-wsman and idrac-redfish but as you said, metal3 does not have that flexibility09:16
rpittauajya: the sushy-oem-idrac is installed in the ironic container in metal309:17
rpittauwe take the pkgs from tripleo repos09:18
ajyawhether to enhance idrac-redfish steps to check for 13G, it could be doable, but still better to use wsman with 13G09:19
ajyamaybe it is not documented enough that this is preferred way, there is some initial redfish support, but it can't keep up with what's possible in Ironic now09:20
ajyathanks rpittau 09:20
jandersajya if we check for support for idrac-redfish steps, what approach would you recommend? check for server generation? check for presence of the RedFish URLs required for things to work?09:22
rpittauI'm actually wondering if an issue I'm investigating can be due to "old" hardware not supporting virtualmedia09:23
jandersI may put a patch together 09:23
jandersif I do I will request a review from you :)09:23
ajyajanders: checking for presence would be easier, otherwise have to start parsing model names and model number conventions to determine generation or have a list of all generation models.09:30
jandersajya ACK, will have a look into that09:30
ajyajanders: maybe even check that in sushy-oem-idrac https://opendev.org/openstack/sushy-oem-idrac/src/branch/master/sushy_oem_idrac/resources/manager/manager.py#L16609:30
jandershmmm that may be a good idea09:31
ajyaand then raise missing error that Ironic chooses to handle as ignore09:31
ajyarpittau: how old? From what I saw for virtual media boot in 13G there is functionality for idrac-redfish-virtual-media, but we are not actively testing 13G.09:32
rpittauajya: not sure, I need to double-check, the problem is that even if we use idrac-virtualmedia it does not get the correct bios_interface, at the moment I'm checking to see if it's a regression in one of the metal3 components09:34
ajyajanders: same would be needed for idrac_card_service as that's where reset_idrac step uses09:36
ajyas/where/what09:37
ajyarpittau: I can check if deployment with latest 13G iDRAC succeeds using idrac-redfish in all places, minus verify steps09:38
rpittauajya: thanks!09:48
* TheJulia yawns10:24
jandersguys, is there an easy-enough way to deploy bifrost with Ironic from the time of a particular merged change?11:04
iurygregorythank you ajya, I will follow-up with folks here to see what we can do since is unsupported =)11:13
opendevreviewVerification of a change to openstack/networking-generic-switch master failed: Trim spaces in ngs_trunk_ports and ngs_physical_networks  https://review.opendev.org/c/openstack/networking-generic-switch/+/84577411:26
TheJuliajanders: replace the branch with a commit hash11:36
TheJuliafor the assets used11:36
rpittauah snap we don't checkout swiftclient from master, we need a new release :/11:38
dmelladojanders: should be here https://docs.openstack.org/bifrost/latest/install/index.html#clone-bifrost11:38
dmelladobeware of the python3.6 issue, depending on your environment and so, though11:38
TheJuliarpittau: unfortunately11:39
rpittauI think it's time to remove support for py3.6 from bifrost, we're not testing it anymore11:41
TheJuliaI cannot send a single line with enough +'s11:41
rpittaulol11:41
* TheJulia goes back to reading a proposal11:41
opendevreviewRiccardo Pittau proposed openstack/bifrost master: Remove support for Python 3.6 and 3.7  https://review.opendev.org/c/openstack/bifrost/+/84615411:54
iurygregoryajya, would it be a problem to add a check in clear_job_queue to check for "The attribute Links/Oem/Dell/DellJobService is missing from the resource /redfish/v1/Managers/iDRAC.Embedded.1']" in case is not present we would not fail. Does WS-Man supports virtual-media? (This is a requirement in the setup they are testing downstream)11:57
opendevreviewRiccardo Pittau proposed openstack/bifrost master: Remove support for Python 3.6 and 3.7  https://review.opendev.org/c/openstack/bifrost/+/84615412:04
opendevreviewRiccardo Pittau proposed openstack/ironic master: Use bifrost on centos9 integration job  https://review.opendev.org/c/openstack/ironic/+/84615512:06
opendevreviewRiccardo Pittau proposed openstack/ironic master: Use bifrost on centos9 integration job  https://review.opendev.org/c/openstack/ironic/+/84615512:08
ajyaiurygregory: wouldn't be a problem, talked with janders about it earlier;12:09
ajyaiurygregory: in Ironic there is no WS-Man option for virtual media, but now thinking if there were support at iDRAC for that. Not sure if this has come up, or ppl just went straight with redfish.12:11
TheJuliaThe biggest issue is boot mode management from my POV12:13
TheJuliathat has repeatedly come up in the last few weeks with people trying to use the idrac hw type with wsman drivers12:14
TheJuliaOf course, that skews my own perception12:14
TheJuliaBut I also think many went directly to redfish for virtual media12:14
TheJuliaThe drivers for irmc/ilo were much more high security deployment ops12:14
TheJuliaaiui12:14
ajyaTheJulia: yes, there is a little dance in WS-Man to get it set and it is slower, that's why use Redfish whenever possible.12:18
dmelladorpittau++ on the removal xD12:25
rpittau:)12:25
dmelladoit was the first time ever that I had to go and debug pip...12:26
dmelladoxD12:26
opendevreviewRiccardo Pittau proposed openstack/ironic-python-agent master: lsblk: output all available columns  https://review.opendev.org/c/openstack/ironic-python-agent/+/84578512:38
rpittaudmellado: oh that's no fun, did it a lot of times and it's always messy12:39
TheJuliaajya: did we change the default load order yet, perhaps it is time? Meaning towards redfish. I'm finding internally some people don't grok/delineate mainly because there has not been a forced need nor have an easy knob, so we end up in some bad patterns/expectations. On a plus side, I think we save the interfaces and they become static after the fact on the object model, so only differing behavior with new nodes13:20
TheJuliaiurygregory: any objection of a blog post w/r/t the baremetal sig session ?13:23
TheJuliaasking because I'm unlikely to self approve content for ironicbaremetal.org :)13:23
ajyaTheJulia: idrac-wsman is still default, but could look at changing that. Have to look at the gaps left and differences, they are small though, and might not be applicable to all.13:33
TheJuliaI think it would be good to go ahead and do so, but definitely something that needs to be done with intention and some detailed research first :)13:52
iurygregoryTheJulia, none =)14:10
opendevreviewDerek Higgins proposed openstack/ironic-python-agent master: Gather details about bond interfaces if present  https://review.opendev.org/c/openstack/ironic-python-agent/+/84617714:10
TheJuliaderekh: like auto-forming bonds ?14:15
derekhTheJulia: in the setup we hit this networking (including bonds) is setup with nmstate/NetworkManager , then once ready IPA gets started in a container14:17
TheJulianice14:17
TheJuliawas not aware it could do that!14:17
derekhits a recent change to how we run IPA in IPI but now people are passing bonding info in via nmstate and we're no longer collecting the IP address on the bonds...14:19
TheJuliaugh14:39
ajyarpittau: was able to deploy a node using idrac-redfish-virtual-media and other idrac-redfish interfaces successfully on R630. The only thing out of ordinary was that from grub menu to IPA it took almost 5 mins. 15:00
TheJuliaThat is a while...15:11
TheJuliabut, that is highly variable on the bmc/network connectivity more than anything else 15:11
ajyanot sure what's causing it, but on the same network 14G/15G systems are much faster when loading IPA15:15
TheJuliahmmm15:15
TheJuliastill a ton of variables with a different model and all15:15
rpittauajya: thanks! that's really useful info15:33
opendevreviewRiccardo Pittau proposed openstack/bifrost master: Remove support for Python 3.6 and 3.7  https://review.opendev.org/c/openstack/bifrost/+/84615415:37
opendevreviewRiccardo Pittau proposed openstack/bifrost master: Remove old unused CentOS Stream 8 based jobs  https://review.opendev.org/c/openstack/bifrost/+/84619315:42
rpittaugood night! o/17:05
JayFI think IPA gate may be busted? There's a basically noop change failing the same jobs over and over -- ipa-tempest-bios-ipmi-direct-src and ipa-tempest-uefi-redfish-vmedia-src18:05
JayFIs there any known issue going on? Or is this fresh breakage18:05
JayFlooks like something broken inside DIB18:06
JayFHmm, CentOS 8. I wonder if this is related to the DIB py26 deprecation that had to be reverted...18:10
* JayF has come full circle, troubleshooting a gate breakage in another project that a change he pushed caused18:13
TheJuliaWhere did the day go18:58
* TheJulia feels confuzzled18:58
* TheJulia calls it a day20:01
stevebaker[m]good morning20:42
TheJuliagood morning stevebaker[m] 20:50
stevebaker[m]TheJulia: welcome back!20:50
TheJuliaThanks20:53
TheJuliaFeeling slightly fried, but I started my day a little after 3 am this morning20:53
stevebaker[m]TheJulia: whelp that doesn't match with *any* timezone you've been in :p21:04

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!