stevebaker | janders: just for fun/fitness/dog-exercise | 00:01 |
---|---|---|
*** markmcclain has quit IRC | 00:13 | |
janders | nice! :) and I'm sure the dog would +1 | 00:14 |
*** ijw_ has quit IRC | 00:14 | |
*** ijw has joined #openstack-ironic | 00:14 | |
*** markmcclain has joined #openstack-ironic | 00:15 | |
*** markmcclain has quit IRC | 00:24 | |
*** Goneri has quit IRC | 00:41 | |
*** rloo has quit IRC | 00:52 | |
*** xinliang has joined #openstack-ironic | 00:54 | |
janders | stevebaker have you installed bifrost and enrolled VMs into ironic lately? | 01:13 |
janders | I'm hitting this: | 01:14 |
janders | http://paste.openstack.org/show/796931/ | 01:14 |
janders | I wonder if others have seen this issue | 01:14 |
stevebaker | janders: I haven't used bifrost, I've got my own container based startup script derived from a metal3 script | 01:15 |
janders | it happens with both master codebase and a patch I'm testing which is based on master from end of July | 01:15 |
janders | right! | 01:15 |
janders | weird thing is if I run baremetal commands it's all good, it's just the playbook that's having hassles | 01:16 |
stevebaker | janders: I wonder if you're hit by the addition of basic-auth as an alternative to noauth | 01:16 |
janders | what was the timeframe for adding this in? | 01:16 |
janders | sounds very likely | 01:16 |
stevebaker | janders: added in this change https://review.opendev.org/#/c/741964/ | 01:16 |
patchbot | patch 741964 - bifrost - Support HTTP basic auth and switch bifrost-cli to it (MERGED) - 26 patch sets | 01:16 |
janders | yep the timeframe matches | 01:17 |
janders | perhaps there is some work that needs to be done in playbooks so that they support the new ways | 01:18 |
janders | thanks for pointing me to this stevebaker | 01:18 |
stevebaker | janders: maybe, or that change broke noauth | 01:18 |
janders | your first comment is pointing exactly to what Ansible is getting | 01:19 |
janders | http://paste.openstack.org/show/796932/ | 01:24 |
janders | reproduced! | 01:24 |
janders | now I gotta figure out how to make ansible read the creds properly | 01:25 |
janders | one would think it would *just work* but apparently not | 01:25 |
stevebaker | janders: hmm, is something doing export OS_CLOUD=bifrost? | 01:29 |
janders | good question | 01:29 |
janders | checking | 01:29 |
janders | I hardwired cloud and auth_type into the role to match clouds.yaml and it worked | 01:33 |
janders | something is not getting passed correctly it seems - or it's an RTFM issue :) | 01:33 |
janders | maybe I need to re-read the install docs | 01:33 |
janders | it doesn't seem to be the RTFM case so far | 01:36 |
stevebaker | janders: it could be a gap in supporting .config/openstack/clouds.yaml, because most folk just export OS_* variables | 01:43 |
stevebaker | janders: like, this is my stackrc ;) http://paste.openstack.org/show/796933/ | 01:44 |
janders | I think I got it | 01:52 |
janders | if we deploy with http_basic auth by default, we need to change: | 01:52 |
janders | playbooks/roles/bifrost-cloud-config/defaults/main.yml | 01:52 |
janders | from noauth_mode: true to noauth_mode: false by default too | 01:52 |
janders | seems our defaults are out of whack between how we configure ironic and how we configure the playbooks | 01:53 |
janders | do you think this is making sense? shall I propose a change to cover this? | 01:54 |
stevebaker | janders: that sounds plausable | 01:59 |
janders | ok! I will track it down further, cause on one hand we have this: | 02:00 |
janders | https://github.com/openstack/bifrost/blob/master/playbooks/roles/bifrost-ironic-install/templates/ironic.conf.j2#L32 | 02:01 |
janders | and this: | 02:01 |
janders | https://github.com/openstack/bifrost/blob/master/playbooks/roles/bifrost-ironic-install/defaults/main.yml#L263 | 02:01 |
*** ociuhandu has joined #openstack-ironic | 02:01 | |
janders | and on the other hand we have this: | 02:02 |
janders | https://github.com/openstack/bifrost/blob/master/playbooks/roles/bifrost-cloud-config/defaults/main.yml | 02:02 |
janders | yet for some reason bifrost seems to deploy ironic configured with http_basic while the enroll playbook tries to use noauth (and hence the error I was getting) | 02:03 |
janders | looks like something somewhere is overriding ironic-side auth settings even though it looks like it should be deployed with noauth | 02:04 |
*** gudrutis0 has joined #openstack-ironic | 02:04 | |
stevebaker | janders: yeah it sounds like the desired noauth_mode is not propagating to all roles for some reason | 02:04 |
*** another_larsks has joined #openstack-ironic | 02:05 | |
janders | I have a sneaking suspicion it has to do with the http_basic is the "catch-all" in the ironic.conf template | 02:05 |
*** zzzeek has quit IRC | 02:05 | |
*** gudrutis has quit IRC | 02:05 | |
*** mgoddard has quit IRC | 02:05 | |
*** weshay|ruck has quit IRC | 02:05 | |
*** larsks has quit IRC | 02:05 | |
*** gryf has quit IRC | 02:05 | |
*** gudrutis0 is now known as gudrutis | 02:05 | |
janders | stevebaker I fully agree | 02:05 |
*** weshay has joined #openstack-ironic | 02:06 | |
*** benj_ has quit IRC | 02:06 | |
janders | well now that I have a workaround I fill finish my testing and doco and then I might look into this further | 02:06 |
janders | it's been giving me grief since yesterday | 02:06 |
*** tzumainn has quit IRC | 02:06 | |
stevebaker | I wonder why CI passes | 02:06 |
*** ociuhandu has quit IRC | 02:06 | |
janders | thanks for oyur help, without it I would still be stuck and frantically grepping through the playbooks :) | 02:07 |
*** benj_ has joined #openstack-ironic | 02:07 | |
*** ricolin has quit IRC | 02:09 | |
stevebaker | no problem | 02:09 |
*** zzzeek has joined #openstack-ironic | 02:11 | |
janders | good question re CI - maybe enroll playbook doesn't have enough coverage | 02:12 |
janders | the code looks allright to me but clearly something somewhere is causing a disconnect between values passed to different playbooks | 02:12 |
*** Qianbiao has joined #openstack-ironic | 02:16 | |
*** ricolin has joined #openstack-ironic | 02:19 | |
*** rcernin has quit IRC | 02:21 | |
*** gryf has joined #openstack-ironic | 02:22 | |
openstackgerrit | Huang Cheng proposed openstack/ironic master: Fix: port attribute name propagate_uplink_status https://review.opendev.org/746828 | 02:45 |
*** rcernin has joined #openstack-ironic | 02:59 | |
*** stevebaker has quit IRC | 03:14 | |
openstackgerrit | Vishal Manchanda proposed openstack/ironic-ui master: [goal] Migrate testing to ubuntu focal https://review.opendev.org/744708 | 03:34 |
*** mkrai has joined #openstack-ironic | 03:41 | |
*** stevebaker has joined #openstack-ironic | 03:43 | |
*** rcernin has quit IRC | 04:14 | |
*** rcernin has joined #openstack-ironic | 04:21 | |
*** xinliang has quit IRC | 04:28 | |
*** rh-jelabarre has quit IRC | 04:29 | |
*** rcernin has quit IRC | 04:37 | |
*** yolanda has quit IRC | 04:41 | |
*** rcernin has joined #openstack-ironic | 04:46 | |
*** stevebaker has quit IRC | 04:51 | |
*** abdysn has joined #openstack-ironic | 05:00 | |
*** gudrutis9 has joined #openstack-ironic | 05:10 | |
*** gudrutis92 has joined #openstack-ironic | 05:12 | |
*** gudrutis has quit IRC | 05:13 | |
*** gudrutis92 is now known as gudrutis | 05:13 | |
*** gudrutis9 has quit IRC | 05:15 | |
*** gyee has quit IRC | 05:20 | |
*** ianychoi_ has joined #openstack-ironic | 05:25 | |
*** ianychoi has quit IRC | 05:28 | |
*** janders has quit IRC | 05:51 | |
*** janders has joined #openstack-ironic | 05:52 | |
*** dmellado has quit IRC | 06:11 | |
*** janders has quit IRC | 06:27 | |
*** janders has joined #openstack-ironic | 06:31 | |
*** dmellado has joined #openstack-ironic | 06:41 | |
*** patchbot has quit IRC | 06:41 | |
*** yolanda has joined #openstack-ironic | 06:50 | |
*** patchbot has joined #openstack-ironic | 06:52 | |
*** xinliang has joined #openstack-ironic | 06:54 | |
*** dmellado has quit IRC | 07:07 | |
iurygregory | good morning Ironic | 07:12 |
janders | hey iurygregory o/ | 07:12 |
janders | how are you today? | 07:12 |
iurygregory | hey janders o/ | 07:13 |
*** mkrai has quit IRC | 07:13 | |
iurygregory | still about 85% =) | 07:13 |
janders | definitely "glass half full" then, but could be fuller :) | 07:13 |
*** mkrai has joined #openstack-ironic | 07:13 | |
janders | I figured out the permission issue I was hitting yesterday with help from stevebaker | 07:14 |
janders | hitting something new now | 07:14 |
janders | the permission issue is somehow linked to the introduction of http_basic auth | 07:14 |
iurygregory | wow | 07:15 |
janders | even though bifrost should be deploying ironic in noauth by default, it isn't | 07:15 |
janders | I haven't tracked down exactly where things get out of whack but I will | 07:16 |
janders | long story short ironic gets deployed with http_basic yet clouds.yaml is configured with noauth | 07:16 |
janders | hence the mismatch and permission issues | 07:16 |
iurygregory | let me grab some more coffee and I can look with you =) | 07:16 |
janders | ok! :) | 07:16 |
iurygregory | there is a way to make sure it gets deploy to noauth | 07:16 |
iurygregory | brb | 07:17 |
*** belmoreira has joined #openstack-ironic | 07:19 | |
*** hjensas has joined #openstack-ironic | 07:27 | |
*** mkrai has quit IRC | 07:31 | |
iurygregory | janders, I knew this would happen =X | 07:35 |
iurygregory | `Support HTTP basic auth and switch bifrost-cli to it ` | 07:35 |
iurygregory | =D | 07:35 |
iurygregory | so well, we switched the cli to it... | 07:36 |
janders | I think this one will be an easy fix, we just gotta figure out where ironic-install roles and node-enroll nodes get out of whack | 07:37 |
janders | cause they all seem configured to default to noauth | 07:37 |
janders | however I hit something else nasty which I wanted to ask you about | 07:37 |
janders | I reinstalled my bifrost using my patch | 07:37 |
janders | I wasn't able to deploy the VMs | 07:37 |
iurygregory | huh? =O | 07:38 |
janders | dnsmasq was acting silly, it seemed that I can't PXE anything | 07:38 |
janders | i went looking and ended up killing dnsmasq processes manually and copying ironic-generated config to libvirt dnsmasq config file | 07:38 |
iurygregory | did you get Dmitry's setup? lol | 07:38 |
iurygregory | I remember he had some issues with PXE lol | 07:38 |
janders | now VMs booted (we'll see if they deploy) but this was _really_ hacky | 07:39 |
janders | I wonder what went wrong | 07:39 |
janders | it looks to me like bifrost didn't touch libvirt's dnsmasq | 07:39 |
iurygregory | yeah seems strange .-. | 07:39 |
janders | and libvirt's dnsmasq isn't configured for PXE over httpd by default I think | 07:39 |
janders | have you seen this before? | 07:40 |
janders | looks like Dmitry might have | 07:40 |
iurygregory | I haven't seen .-. | 07:40 |
janders | it was uber weird... reminded me the very early days of using ironic | 07:41 |
janders | hunting for tftp config issues | 07:41 |
janders | it's nasty cause there is so little troubleshooting tools at that stage | 07:41 |
iurygregory | about the http_basic problem | 07:42 |
iurygregory | I think you may be right about the enroll using noauth | 07:43 |
janders | I've tracked it down to about 80% | 07:43 |
janders | let me dig out code references | 07:43 |
iurygregory | https://github.com/openstack/bifrost/blob/master/playbooks/roles/ironic-enroll-dynamic/tasks/main.yml | 07:43 |
iurygregory | uses bifrost-cloud-config | 07:43 |
janders | the only issue is even though it my seem that both ironic-install and cloud-config are using noauth by default | 07:44 |
janders | one is and one is not | 07:44 |
iurygregory | that is default to noauth, so maybe when using the bifrost-cli we need to make sure to set a few things before running the command so it will override things in the bifrost-cloud-config | 07:44 |
janders | and I haven't figured out where exactly things get mixed up | 07:44 |
* iurygregory cheks ironic-install | 07:44 | |
janders | good news is my deploy worked (on hacked dnsmasq config) | 07:44 |
janders | so let's look at auth issues togetehr | 07:45 |
*** ijw has quit IRC | 07:45 | |
janders | cause its a matter of time and others will hit it | 07:45 |
janders | it needs fixing (or at least better understanding) | 07:45 |
janders | https://github.com/openstack/bifrost/blob/master/playbooks/roles/bifrost-cloud-config/defaults/main.yml | 07:45 |
janders | so this one defaults to noauth | 07:45 |
janders | https://github.com/openstack/bifrost/blob/master/playbooks/roles/bifrost-ironic-install/defaults/main.yml#L263 | 07:46 |
janders | this one defaults to noauth, too | 07:46 |
iurygregory | maybe we need to make it read a variable that is set... | 07:46 |
janders | however in the jinja2 template, http_basic is the "catch-all" | 07:46 |
iurygregory | and re use the value | 07:46 |
janders | https://github.com/openstack/bifrost/blob/master/playbooks/roles/bifrost-ironic-install/templates/ironic.conf.j2#L32 | 07:46 |
janders | in my env ironic-install var was set to noauth: true yet it still installed with http_basic | 07:47 |
janders | I think it's not passed correctly somewhere and then the catch-all kicks in | 07:47 |
iurygregory | yeah | 07:47 |
janders | one good news is that if http_basic is configured correctly across the board it *just works* | 07:47 |
janders | (unless it's http_basic auth that broke my httpboot :) ) | 07:48 |
iurygregory | I have the feeling we should change to | 07:49 |
iurygregory | "{{ lookup('env','NOAUTH_MODE') }}" | 07:49 |
iurygregory | something like this... | 07:49 |
iurygregory | because since it's hardcoded to true it will probably try to execute things with noauth and BOOM | 07:50 |
janders | right! | 07:51 |
janders | so this way the user sets an env variable and then both bifrost-cli and ansible base their settings on it? | 07:51 |
iurygregory | I know for CI it works like that | 07:52 |
iurygregory | and there are ofc some env vars you can set that will identify your setup | 07:52 |
iurygregory | for example if you want an specific location for your venv you can set VENV | 07:52 |
janders | yep, I used that a lot | 07:53 |
*** dmellado has joined #openstack-ironic | 07:53 | |
janders | on the good news front, all the breakages aside I managed to get bifrost to use the ironic codebase from my patch | 07:53 |
janders | and re-tested successfully | 07:54 |
iurygregory | \o/ | 07:54 |
janders | http://paste.openstack.org/show/796935/ | 07:54 |
janders | this is the steps | 07:54 |
janders | (this includes a workaround to the issue we are discussing; I haven't included the dnsmasq fix as I don't yet fully understand what happened there) | 07:55 |
iurygregory | gotcha | 07:55 |
iurygregory | there is also one thing since you run the playbooks by hand you may need to pass -e noauth_mode=false | 07:56 |
janders | that's a good idea in general however I don't think it will help for this particular issue | 07:56 |
iurygregory | yeah | 07:56 |
iurygregory | only something that came up on my mind hehehe | 07:57 |
janders | cause (to my best understanding) the issue is that ironic gets installed with noauth_mode=false and clouds.yaml gets populated with noauth_mode=true | 07:57 |
janders | and that happens from bifrost-cli level | 07:57 |
iurygregory | yup | 07:57 |
janders | and by the time we run enroll, damage is already done | 07:57 |
janders | as much as I agree it would be safer to control behaviour of both playbooks from one var | 07:58 |
janders | im really curious where the disconnect happens cause the way Dmitry wrote the code seems slick and logical, to me it looks like it should *just work* | 07:58 |
iurygregory | yep | 07:58 |
janders | but for some reason the value of noauth_mode gets mangled between here: https://github.com/openstack/bifrost/blob/master/playbooks/roles/bifrost-ironic-install/defaults/main.yml#L263 | 07:59 |
iurygregory | CI is also happy hehe | 07:59 |
janders | and here: https://github.com/openstack/bifrost/blob/master/playbooks/roles/bifrost-ironic-install/templates/ironic.conf.j2#L32 | 07:59 |
iurygregory | https://media.giphy.com/media/Ykttn9oms8Iii1V7QD/giphy.gif our daily life | 08:01 |
janders | this reminds me coming back from holiday early this year when we had the big fires going | 08:01 |
janders | we were supposed to overnight in a town which almost burned down the day before | 08:01 |
iurygregory | yeah =( | 08:02 |
iurygregory | sorry bad joke >.< | 08:02 |
iurygregory | I forgot about the fire =( | 08:02 |
janders | called the hotel and the local police and they were both like "yesterday it was terrible, but today the wind changed, so it's all good, the fire is 10km away, you can come" | 08:02 |
janders | no worries :) I see the analogy too | 08:02 |
iurygregory | wow | 08:02 |
janders | insane what climate change can do | 08:03 |
iurygregory | truth | 08:03 |
rpittau | good morning ironic! o/ | 08:09 |
janders | good morning rpittau o/ | 08:10 |
rpittau | hey janders :) | 08:11 |
janders | rpittau we tracked down that 401 error I was hitting yesterday to some disconnect in auth config between ironic server and client side | 08:13 |
janders | in my lab it seems that if default settings are used, ironic is deployed with http_basic while the client side is deployed with noauth and BOOM | 08:13 |
janders | still looking at it | 08:13 |
*** ijw has joined #openstack-ironic | 08:13 | |
iurygregory | good morning rpittau o/ | 08:14 |
rpittau | hey iurygregory :) | 08:14 |
janders | I will have a quick break and will be back to troubleshooting this | 08:15 |
iurygregory | rpittau, just fyi the removal of the filter in ironic didn't help =( | 08:15 |
*** lucasagomes has joined #openstack-ironic | 08:16 | |
rpittau | iurygregory: yeah, I was looking at that | 08:16 |
rpittau | maybe adding some logging there would help | 08:16 |
*** dtantsur|afk is now known as dtantsur | 08:16 | |
dtantsur | morning ironic | 08:16 |
rpittau | hey dtantsur :) | 08:17 |
iurygregory | morning dtantsur =) | 08:17 |
iurygregory | rpittau, yeah I will look in a bit, going to try something about the tempest tests now =) | 08:17 |
*** ijw has quit IRC | 08:18 | |
*** belmoreira has quit IRC | 08:21 | |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic-inspector bugfix/10.3: Correct the constraints link in tox.ini https://review.opendev.org/746853 | 08:23 |
dtantsur | rpittau: please ^^^ | 08:23 |
rpittau | yeah | 08:23 |
*** mkrai has joined #openstack-ironic | 08:23 | |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: Validate that the services are running after installation https://review.opendev.org/743569 | 08:26 |
janders | back | 08:27 |
janders | good morning dtantsur | 08:27 |
janders | I have some questions if you have time? | 08:27 |
dtantsur | totally | 08:28 |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost bugfix/8.3: Update TOX_CONSTRAINTS_FILE for bugfix/8.3 https://review.opendev.org/746179 | 08:29 |
janders | maybe let's start with the clean-steps patch | 08:29 |
janders | https://review.opendev.org/#/c/744117/ | 08:29 |
patchbot | patch 744117 - ironic - [WIP]Generic way to configure clean step priorites - 10 patch sets | 08:29 |
janders | I did my best to address your comments - does this revision look better? | 08:30 |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic bugfix/15.2: Update TOX_CONSTRAINTS_FILE for bugfix/15.2 https://review.opendev.org/746797 | 08:30 |
dtantsur | janders: I haven't had a chance to look yet - a large backlog this morning | 08:31 |
janders | okay - please take your time | 08:31 |
janders | hopefully the other questions will be quicker :) | 08:31 |
*** mkrai has quit IRC | 08:31 | |
*** mkrai_ has joined #openstack-ironic | 08:32 | |
janders | I hit auth issues while doing a fresh install of bifrost this morning | 08:32 |
janders | it seems that ironic-install role ends up using http_basic auth by default | 08:32 |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic-python-agent bugfix/6.3: Update TOX_CONSTRAINTS_FILE for bugfix/6.3 https://review.opendev.org/746795 | 08:32 |
janders | while client config is still on noauth | 08:32 |
dtantsur | janders: you mean, the client config is not updated correctly? | 08:32 |
janders | my understanding is that on default settings both ironic-server and client config should be noauth | 08:33 |
janders | or am I wrong on this? | 08:33 |
dtantsur | bifrost-cli defaults to HTTP basic, the playbooks default to no-auth for now (will change in W) | 08:33 |
dtantsur | it's a bit unfortunate, but the dynamic playbooks are supposed to take the authentication information from clouds.yaml | 08:34 |
janders | ok so that's expected | 08:34 |
janders | I was thinking I'm hitting a bug | 08:34 |
*** ociuhandu has joined #openstack-ironic | 08:34 | |
janders | would it make sense to switch over the playbooks to match? | 08:34 |
janders | it should be a one liner change | 08:35 |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: dynamic: always use clouds.yaml when it is available https://review.opendev.org/746859 | 08:35 |
dtantsur | in the W cycle because of backward compatibility. you may be hitting ^^^ though | 08:36 |
dtantsur | this patch should be a bit more sophisticated, but you get an idea | 08:36 |
janders | ok! I will look into this a bit more | 08:37 |
janders | my fix for the day was "sed -i s/^noauth_mode: true/noauth_mode: false’ ~/bifrost/playbooks/roles/bifrost-cloud-config/defaults/main.yml" :) | 08:37 |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: dynamic: always use clouds.yaml when it is available https://review.opendev.org/746859 | 08:37 |
dtantsur | janders: yeah, rather ^^^ | 08:37 |
janders | last question: when doing a fresh install of bifrost, I noticed dnsmasq setup was totally busted | 08:38 |
dtantsur | Oo | 08:38 |
janders | it wasn't passing next-server info | 08:38 |
janders | I think libvirt's default config was left behind | 08:38 |
dtantsur | we haven't changed it for a while... | 08:38 |
janders | I ended up manually copying the bifrost-generated dnsmasq.conf over the top of libvirt and that fixed it | 08:38 |
rpittau | janders: you mean re-installing on top of an old install ? | 08:39 |
* dtantsur blinks | 08:39 | |
janders | yes, but I ran my uninstall script first | 08:39 |
dtantsur | janders: the libvirt dnsmasq.conf should not come into play at all | 08:39 |
dtantsur | maybe the uninstall script was too eager at some point? | 08:39 |
janders | probably not in regards to the libvirt stuff, it only destroys and undefines VMs | 08:40 |
janders | how does bifrost inject the appropriate dnsmasq config during install? | 08:41 |
janders | I suppose it needs to change what libvirt set up by default to get VMs to get ipxe from /httpboot right? | 08:41 |
janders | I think in my case this didn't happen for some reason | 08:41 |
janders | it's possible dnf updates contributed to this | 08:42 |
dtantsur | I suspect we configure libvirt to not provide its own DHCP | 08:42 |
dtantsur | i.e. using a bridged network or whatever | 08:42 |
dtantsur | I need to look into bifrost-create-vms to be sure | 08:42 |
janders | I will check if I had any libvirt updates coming in | 08:43 |
janders | this would explain what happened | 08:43 |
*** ijw has joined #openstack-ironic | 08:44 | |
openstackgerrit | Kaifeng Wang proposed openstack/ironic-inspector master: Identify accelerator devices during introspection https://review.opendev.org/745289 | 08:45 |
janders | I did update libvirt since the last bifrost install, so this might have messed up dnsmasq configs :( | 08:48 |
openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/ironic-tempest-plugin master: Update basic_ops https://review.opendev.org/741445 | 08:49 |
*** ijw has quit IRC | 08:49 | |
openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/ironic master: Add tempest default_boot_option and altflavor https://review.opendev.org/741886 | 08:52 |
openstackgerrit | Harald Jensås proposed openstack/ironic master: Switch Ironic to openstacksdk for Neutron https://review.opendev.org/734873 | 08:54 |
*** mkrai_ has quit IRC | 08:55 | |
*** mkrai has joined #openstack-ironic | 08:55 | |
iurygregory | ok, fingers crossed now to see how nova will deal with it | 08:55 |
openstackgerrit | Merged openstack/ironic bugfix/15.2: Update .gitreview for bugfix/15.2 https://review.opendev.org/746796 | 08:55 |
openstackgerrit | Merged openstack/ironic-python-agent bugfix/6.3: Update .gitreview for bugfix/6.3 https://review.opendev.org/746794 | 08:55 |
openstackgerrit | Merged openstack/ironic-inspector bugfix/10.3: Correct the constraints link in tox.ini https://review.opendev.org/746853 | 08:55 |
*** k_mouza has joined #openstack-ironic | 09:14 | |
*** ijw has joined #openstack-ironic | 09:15 | |
*** ijw has quit IRC | 09:20 | |
dtantsur | I'd like to pull the trigger on removing non-venv support in bifrost. any objections? or anyone who wants to do it themselves? | 09:20 |
janders | no objections from me | 09:27 |
janders | sounds reasonable | 09:27 |
rpittau | dtantsur: no objections at all | 09:27 |
janders | I will have an hour's break before the team meeting - braindead after a day of wrestling auth and pxeboot issues, at least I am winning :) | 09:36 |
*** mkrai has quit IRC | 09:39 | |
*** mkrai_ has joined #openstack-ironic | 09:39 | |
*** Lucas_Gray has joined #openstack-ironic | 09:42 | |
iurygregory | dtantsur, no objections also | 09:42 |
*** rcernin has quit IRC | 09:43 | |
*** Qianbiao has quit IRC | 09:44 | |
*** Qianbiao has joined #openstack-ironic | 09:45 | |
*** ijw has joined #openstack-ironic | 09:46 | |
*** rcernin has joined #openstack-ironic | 09:49 | |
*** ijw has quit IRC | 09:51 | |
*** mkrai_ has quit IRC | 09:54 | |
*** mkrai__ has joined #openstack-ironic | 09:54 | |
*** Lucas_Gray has quit IRC | 09:58 | |
*** Lucas_Gray has joined #openstack-ironic | 10:01 | |
openstackgerrit | Verification of a change to openstack/bifrost failed: Update .gitreview for bugfix/8.3 https://review.opendev.org/746178 | 10:15 |
*** ijw has joined #openstack-ironic | 10:18 | |
*** ijw has quit IRC | 10:23 | |
*** xinliang has quit IRC | 10:29 | |
*** rcernin has quit IRC | 10:30 | |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: dynamic: always use clouds.yaml when it is available https://review.opendev.org/746859 | 10:30 |
*** rcernin has joined #openstack-ironic | 10:34 | |
*** mkrai__ has quit IRC | 10:36 | |
*** rcernin has quit IRC | 10:48 | |
*** ijw has joined #openstack-ironic | 10:50 | |
*** rcernin has joined #openstack-ironic | 10:52 | |
*** Qianbiao has quit IRC | 10:53 | |
*** ijw has quit IRC | 10:54 | |
*** uzumaki has joined #openstack-ironic | 11:01 | |
*** rcernin has quit IRC | 11:07 | |
dtantsur | janders: https://review.opendev.org/#/c/746859/ passes CI, a test is appreciated | 11:18 |
patchbot | patch 746859 - bifrost - dynamic: always use clouds.yaml when it is available - 3 patch sets | 11:18 |
janders | dtantsur ACK; happy to help :) | 11:18 |
dtantsur | janders: it probably boils down to testing if it works for you without hacking the defaults | 11:18 |
*** rcernin has joined #openstack-ironic | 11:21 | |
*** ijw has joined #openstack-ironic | 11:21 | |
*** ijw has quit IRC | 11:26 | |
*** belmoreira has joined #openstack-ironic | 11:27 | |
janders | sounds good - I can run the patch through my bifrost install process | 11:29 |
*** k_mouza has quit IRC | 11:30 | |
openstackgerrit | Riccardo Pittau proposed openstack/ironic-python-agent-builder master: Build centos8 on centos8 https://review.opendev.org/746901 | 11:50 |
*** ijw has joined #openstack-ironic | 11:52 | |
openstackgerrit | Riccardo Pittau proposed openstack/ironic-python-agent master: Prepare to move ipa-builder jobs https://review.opendev.org/746766 | 11:54 |
openstackgerrit | Riccardo Pittau proposed openstack/ironic-python-agent-builder master: [DNM] Test CI https://review.opendev.org/746767 | 11:54 |
*** Qianbiao has joined #openstack-ironic | 11:55 | |
*** rh-jelabarre has joined #openstack-ironic | 11:58 | |
*** ijw has quit IRC | 11:59 | |
*** Qianbiao has quit IRC | 12:00 | |
*** ijw has joined #openstack-ironic | 12:23 | |
*** sshnaidm is now known as sshnaidm|afk | 12:26 | |
*** ijw has quit IRC | 12:28 | |
*** ijw has joined #openstack-ironic | 12:30 | |
openstackgerrit | Kaifeng Wang proposed openstack/ironic-specs master: Support node history https://review.opendev.org/652811 | 12:33 |
*** k_mouza has joined #openstack-ironic | 12:34 | |
*** rh-jelabarre has quit IRC | 12:41 | |
janders | see you tomorrow Ironic o/ | 12:44 |
rpittau | bye janders | 12:45 |
iurygregory | bye janders | 12:46 |
*** rcernin has quit IRC | 12:46 | |
*** weshay is now known as weshay|interview | 12:47 | |
*** Goneri has joined #openstack-ironic | 12:47 | |
*** rcernin has joined #openstack-ironic | 12:48 | |
*** mkrai has joined #openstack-ironic | 12:52 | |
*** guilhermesp has joined #openstack-ironic | 12:55 | |
guilhermesp | hey there! are we bumping ironic-inspector victoria in stable/ussuri? iurygregory has been helping me and we ended up finding out this weird thing below | 12:56 |
guilhermesp | https://www.irccloud.com/pastebin/BT7U7n5I/ | 12:56 |
guilhermesp | ironic-inspector==10.3.0 which is victoria, right? | 12:57 |
guilhermesp | so our inspector is not happy | 12:57 |
guilhermesp | https://www.irccloud.com/pastebin/xVAoOxar/ | 12:57 |
iurygregory | correct 10.3.0 is Victoria | 12:57 |
iurygregory | some how your upgrade is just looking at 10.x tags and think it's ussuri I would say | 12:58 |
iurygregory | but it's funny that it doesn't push ironic-lib to victoria (and boom problems) | 12:59 |
guilhermesp | yep, im trying to get the bottom of it | 12:59 |
*** k_mouza has quit IRC | 12:59 | |
dtantsur | define "we" in "we bumping" please | 13:00 |
iurygregory | osa | 13:00 |
dtantsur | 10.3.0 is a recent master (victoria) release | 13:00 |
guilhermesp | btw, we use openstack-ansible stable/ussuri, so we are getting this sha | 13:01 |
guilhermesp | https://www.irccloud.com/pastebin/uyUEsgdT/ | 13:01 |
rpittau | mmm ironic 21 looks coming from the future :) | 13:01 |
dtantsur | stable/ussuri is b26838b2913bbc739e88555c2441d1bc7fcd8429 now | 13:02 |
*** rh-jelabarre has joined #openstack-ironic | 13:02 | |
dtantsur | but yeah, the sha was probably valid at that date | 13:02 |
iurygregory | rpittau, yep | 13:03 |
*** k_mouza has joined #openstack-ironic | 13:05 | |
*** ijw has quit IRC | 13:06 | |
*** weshay|interview is now known as weshay | 13:10 | |
*** rloo has joined #openstack-ironic | 13:13 | |
iurygregory | maybe somehow osa thinks that 10.x is valid for ussuri | 13:13 |
iurygregory | thats the only thing that comes to my mind | 13:13 |
guilhermesp | yeah im trying to find out how inspector is being bumped. We only clone the repo and then create a venv based on the sha we were pointing https://github.com/openstack/openstack-ansible/blob/a21b05dd378c267ee3235e2532d01acb599d3fb6/playbooks/defaults/repo_packages/openstack_services.yml#L217 | 13:16 |
*** weshay is now known as weshay|ruck | 13:21 | |
*** ijw has joined #openstack-ironic | 13:25 | |
*** mkrai has quit IRC | 13:27 | |
*** trandles_ has joined #openstack-ironic | 13:29 | |
dtantsur | folks, it looks like we could use stable releases of ironic on ussuri and train | 13:31 |
*** priteau has joined #openstack-ironic | 13:31 | |
rpittau | guilhermesp: you probably need to change the sha to b26838b2913bbc739e88555c2441d1bc7fcd8429 first to have the latest HEAD | 13:31 |
guilhermesp | yep i just changed rpittau | 13:32 |
rpittau | dtantsur: I can propose those after this meeting (~30 mins) if noone else do it first | 13:32 |
guilhermesp | https://www.irccloud.com/pastebin/o9pVN3J1/ | 13:32 |
iurygregory | I can do it now | 13:32 |
guilhermesp | "ironically" it is still getting 10.3.0 for inspector | 13:32 |
guilhermesp | https://www.irccloud.com/pastebin/T6Zc8Kml/ | 13:32 |
iurygregory | can I go ahead rpittau ? =) | 13:32 |
rpittau | iurygregory: sure! :) | 13:32 |
* dtantsur likes that we have a competition for this role :) | 13:32 | |
iurygregory | it's not a competition lol | 13:33 |
iurygregory | my mind is going crazy with nova filters already | 13:33 |
iurygregory | so it's good to switch | 13:33 |
rpittau | guilhermesp: I don't see any upper constraints being set for ironic-inspector, that's why it gets 10.3.0 | 13:36 |
rpittau | guilhermesp: I'm talking about this file https://opendev.org/openstack/requirements/raw/commit/e770c44a9f83ff4a1d06366cb563c5907a8b21a0/upper-constraints.txt | 13:37 |
rpittau | we probably need to add it :) | 13:38 |
rpittau | actually it shouldn't be there, but osa reads it from there, I guess the logic behind ironic installation in osa is not perfect on that side | 13:39 |
*** tzumainn has joined #openstack-ironic | 13:42 | |
iurygregory | dtantsur, train 13.0.6 and ussuri 15.0.1 wdyt? | 13:45 |
dtantsur | iurygregory: whatever the next versions are, I guess :) | 13:46 |
iurygregory | dtantsur, done | 13:47 |
TheJulia | Can I go back to bed? | 13:49 |
*** trandles_ is now known as trandles | 13:50 | |
dtantsur | TheJulia: yes. good night. | 13:50 |
dtantsur | :) | 13:50 |
iurygregory | TheJulia, you can | 13:51 |
*** seba has quit IRC | 13:52 | |
*** ijw has quit IRC | 13:56 | |
*** ijw_ has joined #openstack-ironic | 13:56 | |
TheJulia | I've got an open case in front of me with more lacp + agent issues | 13:56 |
* TheJulia sighs | 13:57 | |
*** mkrai has joined #openstack-ironic | 13:58 | |
rpittau | heh :/ | 13:58 |
guilhermesp | yeah rpittau that is probably a OSA thing, im taking a look here and will let you guys know when we fix in our side :P | 13:58 |
guilhermesp | valheeeeeu iurygregory :P | 13:58 |
rpittau | guilhermesp: ok! :) | 13:59 |
iurygregory | guilhermesp, lol =P | 13:59 |
iurygregory | you owe me a beer in CG =) | 13:59 |
guilhermesp | wonder when you will be able to do it lol | 13:59 |
iurygregory | yeah, fingers crossed for Dec/Jan | 14:00 |
guilhermesp | for now, lets do the imaginary beer | 14:00 |
iurygregory | or only Sept next year hehe | 14:00 |
* rpittau looks like a good time for tea and cookies | 14:01 | |
*** ijw_ has quit IRC | 14:01 | |
iurygregory | rpittau, don't forget to give cookie to zuul | 14:02 |
*** abdysn has quit IRC | 14:15 | |
openstackgerrit | Kaifeng Wang proposed openstack/ironic-specs master: Snapshot support https://review.opendev.org/746935 | 14:15 |
iurygregory | humm only the uefi jobs failed and the multinode... | 14:24 |
*** Lucas_Gray has quit IRC | 14:27 | |
*** ijw has joined #openstack-ironic | 14:27 | |
guilhermesp | iurygregory: rpittau solution https://review.opendev.org/#/c/746931/ https://review.opendev.org/#/c/746933/ | 14:28 |
patchbot | patch 746931 - openstack-ansible - Add ironic-inspector to the openstack_services - 2 patch sets | 14:28 |
patchbot | patch 746933 - openstack-ansible-os_ironic - Add ironic-inspector to constraints - 1 patch set | 14:28 |
iurygregory | guilhermesp, ++ =) | 14:29 |
rpittau | guilhermesp: that will help :) | 14:30 |
guilhermesp | yep ive got inspector running now :) | 14:30 |
trandles | using bifrost, inspector is giving me grief | 14:31 |
trandles | http://paste.openstack.org/show/796953/ | 14:31 |
*** ijw has quit IRC | 14:32 | |
*** tkajinam has quit IRC | 14:33 | |
*** Lucas_Gray has joined #openstack-ironic | 14:34 | |
*** rcernin has quit IRC | 14:37 | |
*** Lucas_Gray has quit IRC | 14:39 | |
iurygregory | trandles, inspector is running fine? | 14:39 |
iurygregory | have you checked the logs | 14:39 |
*** Lucas_Gray has joined #openstack-ironic | 14:40 | |
*** ijw has joined #openstack-ironic | 14:41 | |
*** sshnaidm|afk is now known as sshnaidm | 14:42 | |
trandles | running fine, but the logs (only in journalctl) are nothing but debug messages about syncing with ironic and periodic clean up | 14:42 |
trandles | no logs in /var/log/ironic-inspector | 14:43 |
iurygregory | O.o | 14:43 |
trandles | indeed | 14:43 |
dtantsur | trandles: this is a client misconfiguration | 14:44 |
dtantsur | the inspector client tries to talk to ironic | 14:44 |
dtantsur | I wonder what's in your clouds.yaml | 14:44 |
dtantsur | and yes, /var/log is no longer used since recently | 14:45 |
dtantsur | or rather: is only used for ramdisk logs | 14:47 |
trandles | where can I find clouds.yaml? Apologies, this is the first I've tried bifrost in probably 2ish years. | 14:48 |
dtantsur | trandles: ~/.config/openstack/ | 14:49 |
trandles | I see references to it in the docs howto page | 14:49 |
trandles | updated with clouds.yaml: http://paste.openstack.org/show/796955/ | 14:50 |
*** belmoreira has quit IRC | 14:55 | |
dtantsur | hmm, looks fine to me | 14:56 |
dtantsur | trandles: you don't have any OS_ variables defined, do you? check with `env | grep OS_` | 14:57 |
trandles | I do, sourced from env-vars | 14:57 |
trandles | OS_AUTH_TYPE and OS_ENDPOINT | 14:57 |
trandles | that was it | 14:58 |
trandles | unset those two and now I don't get the 404 (not trying to hit ironic-api with introspection requests) | 14:59 |
trandles | I do get "endpoint of type baremetal-introspection was not found" | 14:59 |
trandles | it works if I add "--os-endpoint=http://localhost:5050" though | 15:01 |
dtantsur | trandles: just export OS_CLOUD=bifrost and provide nothing else | 15:05 |
trandles | :+1: | 15:06 |
rpittau | not sure I should laugh, but the centos8 patch for ipa-builder is failing ALL tinyipa jobs | 15:07 |
rpittau | "Could not find a version that satisfies the requirement bcrypt>=3.1.3" ok.... | 15:07 |
iurygregory | ops =( | 15:07 |
rpittau | yeah ipa-builder ci is broken because of that, probably cache as bcrypt is at 3.2.0 already | 15:08 |
openstackgerrit | Dmitry Tantsur proposed openstack/python-ironic-inspector-client master: Provide a clear error message when trying to access ironic (not inspector) https://review.opendev.org/746956 | 15:09 |
dtantsur | this should help debugging in the future ^^^ | 15:09 |
*** rloo has quit IRC | 15:24 | |
*** rloo has joined #openstack-ironic | 15:25 | |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic-python-agent master: Enable the logs collection by default https://review.opendev.org/746959 | 15:25 |
dtantsur | bfournie: ^^^ | 15:25 |
openstackgerrit | Dmitry Tantsur proposed openstack/sushy master: Add a CI job with UEFI+vmedia and clean up the job definitions https://review.opendev.org/746962 | 15:35 |
openstackgerrit | Dmitry Tantsur proposed openstack/sushy master: DNM try breaking vmedia https://review.opendev.org/746963 | 15:36 |
*** gyee has joined #openstack-ironic | 15:44 | |
*** seba has joined #openstack-ironic | 15:45 | |
dtantsur | TheJulia: https://storyboard.openstack.org/#!/story/2008038 lemme know if it makes sense or I'm still delirious from an alpine air poisoning | 15:45 |
*** patchbot has quit IRC | 15:47 | |
*** patchbot has joined #openstack-ironic | 15:47 | |
*** dougsz has joined #openstack-ironic | 15:49 | |
TheJulia | dtantsur: it seems reasonable to me | 15:54 |
TheJulia | not all bmc's expose it though, but it is better than nothing and improves the odds overall | 15:54 |
dtantsur | TheJulia: we'll add "exposes EthernetInterfaces" to our Redfish profile :) | 15:59 |
TheJulia | ++ | 15:59 |
TheJulia | of course, that only works with cards that can interact with the bmc firmware | 16:00 |
* TheJulia ducsk | 16:00 | |
TheJulia | ducks | 16:00 |
*** lucasagomes has quit IRC | 16:01 | |
dtantsur | sigh | 16:01 |
dtantsur | I hope most of cards can | 16:01 |
* dtantsur is curious if janders wants to give https://storyboard.openstack.org/#!/story/2008038 a try | 16:02 | |
TheJulia | The HPE's and Dells of the world yes. Supermicro's I think are limited to one type of card if my memory's last reading of their docs are correct | 16:03 |
* TheJulia needs to replace her lab router so she can have an actual dedicated BMC network | 16:04 | |
*** mkrai has quit IRC | 16:04 | |
openstackgerrit | Merged openstack/bifrost master: dynamic: always use clouds.yaml when it is available https://review.opendev.org/746859 | 16:17 |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost bugfix/8.3: dynamic: always use clouds.yaml when it is available https://review.opendev.org/746978 | 16:23 |
openstackgerrit | Merged openstack/ironic-inspector stable/ussuri: Fix URL parsing to enable redfish_address matching https://review.opendev.org/746718 | 16:27 |
*** ociuhandu_ has joined #openstack-ironic | 16:30 | |
*** Lucas_Gray has quit IRC | 16:32 | |
*** ociuhandu has quit IRC | 16:34 | |
*** ociuhandu_ has quit IRC | 16:34 | |
*** dougsz has quit IRC | 16:36 | |
openstackgerrit | Merged openstack/ironic-inspector master: Replace retrying with tenacity https://review.opendev.org/745667 | 16:44 |
*** ociuhandu has joined #openstack-ironic | 16:48 | |
dtantsur | a simple patch adding better CI coverage for sushy: https://review.opendev.org/#/c/746962/ | 16:52 |
patchbot | patch 746962 - sushy - Add a CI job with UEFI+vmedia and clean up the job... - 1 patch set | 16:52 |
*** ociuhandu has quit IRC | 16:52 | |
*** dtantsur is now known as dtantsur|afk | 17:01 | |
dtantsur|afk | o/ | 17:01 |
*** k_mouza has quit IRC | 17:05 | |
*** k_mouza has joined #openstack-ironic | 17:15 | |
*** k_mouza has quit IRC | 17:20 | |
*** k_mouza has joined #openstack-ironic | 17:54 | |
*** k_mouza has quit IRC | 17:59 | |
*** k_mouza has joined #openstack-ironic | 18:08 | |
*** k_mouza has quit IRC | 18:14 | |
*** ijw has quit IRC | 18:18 | |
*** k_mouza has joined #openstack-ironic | 18:23 | |
*** k_mouza has quit IRC | 18:26 | |
*** ijw has joined #openstack-ironic | 18:33 | |
*** ijw has quit IRC | 18:37 | |
*** ijw has joined #openstack-ironic | 18:38 | |
*** k_mouza has joined #openstack-ironic | 18:40 | |
*** k_mouza has quit IRC | 18:40 | |
*** ociuhandu has joined #openstack-ironic | 19:04 | |
*** ociuhandu has quit IRC | 19:34 | |
*** priteau has quit IRC | 19:44 | |
*** Lucas_Gray has joined #openstack-ironic | 20:22 | |
*** ociuhandu has joined #openstack-ironic | 20:22 | |
openstackgerrit | Jay Faulkner proposed openstack/ironic-python-agent master: Eventlet should be monkey patched as early as possible https://review.opendev.org/746774 | 20:25 |
*** ijw has quit IRC | 20:27 | |
*** ijw has joined #openstack-ironic | 20:28 | |
*** ijw has quit IRC | 20:31 | |
*** ijw has joined #openstack-ironic | 20:31 | |
*** dustinc has quit IRC | 20:49 | |
*** stevebaker has joined #openstack-ironic | 20:53 | |
*** uzumaki has quit IRC | 21:01 | |
*** ociuhandu has quit IRC | 21:06 | |
JayF | Is there any special setup required for `tox -efunctional` to work? | 21:11 |
JayF | and/or should they be expected to pass outside of devstack generally? | 21:12 |
JayF | (Talking about in Ironic-Python-Agent) | 21:14 |
*** hjensas has quit IRC | 21:18 | |
*** ijw_ has joined #openstack-ironic | 21:29 | |
*** ijw has quit IRC | 21:33 | |
TheJulia | for ipa, I don't know... | 22:29 |
TheJulia | I think it should work but I just don't remember | 22:29 |
janders | good morning Ironic o/ | 22:36 |
*** rloo has quit IRC | 22:40 | |
TheJulia | good morning | 22:51 |
TheJulia | in case anyone ever wants to modify https://github.com/OpenStackweb/ironic-website feel free to ping me, I should now be able to approve pull requests | 22:52 |
JayF | Well FWIW, functional tests fail pretty rapidly, without much useful output, at least when run on CentOS 7. | 22:54 |
TheJulia | woot | 22:54 |
JayF | > requests.exceptions.HTTPError: 404 Client Error: NOT FOUND for url: http://localhost:9999/v1/commands/ | 22:54 |
JayF | so little output it's extremely difficult to tell how/where it's actually breaking. | 22:54 |
TheJulia | hmm | 22:54 |
JayF | It looks like it's missing cached_node['instance_info'], but I'm unsure where it'd be getting that from | 22:54 |
JayF | unless it's actually attempting to do a lookup into ironic's API, with a prepopulated node | 22:54 |
JayF | which is what I was presuming, since it only runs in the gate under devstack | 22:55 |
TheJulia | oh... I bet it is | 22:55 |
TheJulia | or wants to :( | 22:55 |
*** Lucas_Gray has quit IRC | 22:55 | |
JayF | if that's what it needs; that's fine. I am just trying to answer the questions "should these be run downstream?" and "how would we run them downstream?" | 22:55 |
JayF | the answer seems to be shrug and shrug | 22:56 |
TheJulia | I'm sitting here feeling like I looked at them about 9 months ago and sobbed some | 22:56 |
TheJulia | and don't remember the rest | 22:56 |
JayF | it is worth noting that AFAICT there are zero docs about how these run or what they require, outside of bindep.txt | 22:56 |
JayF | Yeah; I sorta took the sign they were nonvoting as an implied lack of confidence in them | 22:57 |
TheJulia | it is more a I don't think they've really been modified much at all over its lifetime | 22:57 |
TheJulia | The entire project is more integration scenario test driven anyway | 22:57 |
JayF | sounds like a pretty firm answer to me of "not worth it", which I'll take | 22:58 |
*** tkajinam has joined #openstack-ironic | 22:58 | |
*** rcernin has joined #openstack-ironic | 22:59 | |
*** Lucas_Gray has joined #openstack-ironic | 23:02 | |
*** ociuhandu has joined #openstack-ironic | 23:06 | |
*** ociuhandu has quit IRC | 23:11 | |
*** Lucas_Gray has quit IRC | 23:24 | |
*** Goneri has quit IRC | 23:27 | |
*** trandles has quit IRC | 23:28 | |
openstackgerrit | Bill Dodd proposed openstack/ironic master: WIP: Add Redfish RAID management to Ironic https://review.opendev.org/730000 | 23:31 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!