| kamlesh6808c_ | HI Team, In devstack, having 404 resource not found while running baremetal node list ..tried to restart ironic conductor and api service which did not help. Any suggestion ? | 05:33 |
|---|---|---|
| *** pmannidi is now known as pmannidi|brb | 06:18 | |
| iurygregory | good morning Ironic | 06:23 |
| iurygregory | kamlesh6808c_, all the services are running fine? did you by any chance reboot the machine running devstack? | 06:25 |
| kamlesh6808c_ | iurygregory : it happened on running devstack where no manual changes were done like reboot or service stop start..we are observing same on multiple devstack setup.. | 06:27 |
| iurygregory | kamlesh6808c_, well if you did a reboot on the machine that was running devstack you need to re-install again | 06:29 |
| iurygregory | devstack doesn't handle things very well since is mostly used only for testing purposes | 06:29 |
| kamlesh6808c_ | we didn't perform reboot | 06:29 |
| iurygregory | oh ok I was too fast and I missed the "no manual changes" my bad | 06:30 |
| iurygregory | did you check the ironic logs to see what shows when you try running the baremetal node list? | 06:31 |
| iurygregory | maybe also nova logs (if you are creating the nodes via nova) and also keystone | 06:32 |
| kamlesh6808c_ | nova-api logs : Sep 29 08:47:49 dell62 devstack@ir-api.service[92159]: ERROR ironic.api.method [None req-53e781f3-d0dd-4143-a650-7d1a24d0fb54 demo admin] Server-side error: "index() got an unexpected keyword argument 'fields'". Detail: Sep 29 08:47:49 dell62 devstack@ir-api.service[92159]: Traceback (most recent call last): Sep 29 08:47:49 dell62 devstack@ir-api.service[92159]: File "/opt/stack/ironic/ironic/api/method.py", line 42, in cal | 06:34 |
| kamlesh6808c_ | in callfunction Sep 29 08:47:49 dell62 devstack@ir-api.service[92159]: result = f(self, *args, **kwargs) Sep 29 08:47:49 dell62 devstack@ir-api.service[92159]: TypeError: index() got an unexpected keyword argument 'fields' | 06:35 |
| iurygregory | don't paste everything in the irc channel | 06:36 |
| iurygregory | try to paste in paste.openstack.org | 06:36 |
| iurygregory | =) | 06:36 |
| kamlesh6808c_ | pardon ..fairly new to ironic-community .Nova api failure log while running baremetal node list : https://paste.openstack.org/show/809684/ | 06:39 |
| iurygregory | kamlesh6808c_, no worries =) | 06:39 |
| iurygregory | so, you are just trying to run "baremetal node list" without any other args right? which version you are using in devstack ? (master, stable/wallaby ,...) | 06:40 |
| kamlesh6808c_ | its master..Xena Release | 06:41 |
| kamlesh6808c_ | restacking as well did not help ..even updating devstack along with ironic and then restart of services as well did not fix issue | 06:43 |
| iurygregory | updating devstack? .-. | 06:43 |
| kamlesh6808c_ | git pull inside devstack till the latest commit | 06:44 |
| iurygregory | if you do git pull you would need to re-run stack.sh to update things I think | 06:45 |
| iurygregory | and you would lose your current setup | 06:45 |
| kamlesh6808c_ | yes we did..getting same "404 resource not found" during restack.. | 06:46 |
| iurygregory | did you run unstack.sh before? normally this would be required before trying to run stack.sh again | 06:46 |
| iurygregory | at least afaik | 06:47 |
| kamlesh6808c_ | yes .unstack and then clean we performed.. | 06:48 |
| kamlesh6808c_ | Any suggestion how it can be fixed ? | 06:59 |
| arne_wiebalck | Good morning, Ironic! | 07:01 |
| kamlesh6808c_ | by mistake i mentioned nova api log,its ironic api log failure portion.. | 07:01 |
| iurygregory | the error doesn't tell that much.., unexpected keyword argument fields, seems like you are trying to request specific fields in baremetal node list and they are not valid | 07:02 |
| iurygregory | morning arne_wiebalck o/ | 07:02 |
| *** pmannidi|brb is now known as pmannidi | 07:07 | |
| * dtantsur slowly blinks | 07:20 | |
| iurygregory | morning dtantsur =) | 07:22 |
| dtantsur | is it? :) | 07:30 |
| iurygregory | somewhere in the world it's morning :D | 07:32 |
| dtantsur | fair | 07:32 |
| rpittau | good morning ironic! o/ | 07:54 |
| iurygregory | morning rpittau o/ | 07:54 |
| rpittau | hey iurygregory :) | 07:55 |
| rpittau | kamlesh6808c_: that looks very similar to the error we were seeing in the CI a couple of days ago, and it was related to devstack, now fixed. My suggestion is to give it a try with a new deployment from scratch using the very latest version of devstack | 07:57 |
| kamlesh6808c_ | thanks rpittau : i will give a try and will update. | 08:16 |
| janders | hey iurygregory arne_wiebalck dtantsur rpittau and Ironic o/ | 08:28 |
| rpittau | hey janders :) | 08:28 |
| iurygregory | hey janders o/ | 08:29 |
| arne_wiebalck | hey janders o/ | 08:42 |
| kamlesh6808c_ | rpittau: can you please help to share failure build link and patch link used to fix it it will help to analyse in detail. | 08:49 |
| rpittau | kamlesh6808c_: this is the link to the discussion in the openstack mailing list http://lists.openstack.org/pipermail/openstack-discuss/2021-September/025101.html | 09:01 |
| opendevreview | Riccardo Pittau proposed openstack/ironic-python-agent master: Use json for lsblk output https://review.opendev.org/c/openstack/ironic-python-agent/+/775391 | 09:14 |
| iurygregory | rpittau, hey o/ regarding https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/776507 just wondering if there is a specific reason to bump (if there is it would be good to have in the commit message probably or maybe a releasenote?) | 09:19 |
| dtantsur | arne_wiebalck: hi! I think I missed your response re https://github.com/metal3-io/ironic-hardware-inventory-recorder-image | 09:20 |
| dtantsur | have you ended up using it? | 09:20 |
| arne_wiebalck | dtantsur: yes, it worked | 09:22 |
| arne_wiebalck | dtantsur: we have a couple of 100 nodes to run it on, but I have not planned this yet | 09:23 |
| dtantsur | arne_wiebalck: I wonder if you'd like to maintain it yourself. We don't have any uses cases for it in Metal3. | 09:23 |
| arne_wiebalck | dtantsur: this is to update some missing RAM and serial number information | 09:23 |
| dtantsur | or maybe we could move it to opendev? | 09:23 |
| arne_wiebalck | dtantsur: you mean downstream? | 09:23 |
| arne_wiebalck | dtantsur: sure, I was thinking of making a copy anyway | 09:23 |
| dtantsur | arne_wiebalck: downstream, on your github, here on opendev.. | 09:23 |
| dtantsur | we're trying to get rid of projects that we don't really use or maintain | 09:24 |
| arne_wiebalck | dtantsur: | 09:24 |
| arne_wiebalck | ok I see | 09:24 |
| dtantsur | and you may have easier time without being blocked on our reviews | 09:24 |
| dtantsur | wdyt? | 09:24 |
| dtantsur | (if you're prefer it to stay, we can make it work) | 09:24 |
| dtantsur | * you'd | 09:24 |
| arne_wiebalck | it would be good to find a place in case someone wants to do manual inspection from a container | 09:24 |
| arne_wiebalck | a public place I mean | 09:25 |
| arne_wiebalck | not sure what would be a good fir | 09:25 |
| arne_wiebalck | *fit | 09:25 |
| dtantsur | an independent opendev.org/x repository? dunno | 09:27 |
| dtantsur | or if you want to help maintaining it in metal3, we can make it work too | 09:28 |
| dtantsur | but it's a bit weird since it's not metal3-specific in any way | 09:28 |
| iurygregory | I'm wondering how the CI would look like in opendev | 09:32 |
| dtantsur | well, given how sophisticated the CI is now https://github.com/metal3-io/ironic-hardware-inventory-recorder-image/blob/master/.travis.yml it shouldn't be hard to do on zuul | 09:33 |
| iurygregory | are we still using travis there? WOW | 09:34 |
| dtantsur | I'm actually not sure any jobs run there | 09:35 |
| iurygregory | yeah =) | 09:36 |
| rpittau | iurygregory: I have the intention to add a release note for sure | 09:56 |
| rpittau | once it works :) | 09:57 |
| iurygregory | rpittau, no worries! | 09:57 |
| iurygregory | :D | 09:57 |
| janders | dtantsur: when you have time, would you be able to comment on question from iurygregory here: https://review.opendev.org/c/openstack/ironic/+/800001/37/ironic/drivers/base.py#264 ? Thanks in advance :) | 10:20 |
| rpittau | when someone has a minute can I please get another look at https://review.opendev.org/c/openstack/bifrost/+/806328 ? thanks! | 10:41 |
| arne_wiebalck | dtantsur: sorry, got dragged into sth else | 10:41 |
| arne_wiebalck | dtantsur: we could also make it part of another project (like inspector), in the end, it is mostly a docker file | 10:42 |
| dtantsur | this is an interesting thought | 10:43 |
| dtantsur | iurygregory, janders, we have no way to pass args to verify steps, right? | 10:44 |
| dtantsur | it's like automated cleaning which also does not accept args | 10:44 |
| janders | dtantsur: yes, I believe this is the case | 10:44 |
| iurygregory | yeah, I just wanted to be sure =) | 10:44 |
| janders | iurygregory - so, no change required in https://review.opendev.org/c/openstack/ironic/+/800001/37/ironic/drivers/base.py#264 right? | 10:45 |
| iurygregory | yes =) | 10:45 |
| janders | (I fixed the other issue you pointed out, so I will upload a revised version now) | 10:45 |
| iurygregory | janders, ack | 10:45 |
| janders | thank you dtantsur iurygregory | 10:46 |
| opendevreview | Jacob Anders proposed openstack/ironic master: Add support for verify steps https://review.opendev.org/c/openstack/ironic/+/800001 | 10:46 |
| opendevreview | Riccardo Pittau proposed openstack/ironic-python-agent master: Use json for lsblk output https://review.opendev.org/c/openstack/ironic-python-agent/+/775391 | 11:57 |
| TheJulia | good morning | 13:39 |
| rpittau | good morning TheJulia :) | 13:39 |
| dtantsur | morning TheJulia | 13:44 |
| arne_wiebalck | hey TheJulia o/ | 13:44 |
| TheJulia | iurygregory: for your comment on 810249 to be true, we need to change the VM default to UEFI, which I guess I'm okay with tbh. Any objections out there? | 13:46 |
| rpittau | I was looking at that now, fine by me | 13:47 |
| iurygregory | TheJulia, I would say it makes sense to do +1 from me | 13:47 |
| iurygregory | good morning TheJulia =) | 13:47 |
| TheJulia | ohhh ahh fips jobs passed | 13:48 |
| TheJulia | but removing debian override package file list bombs | 13:48 |
| TheJulia | whisky tango | 13:48 |
| TheJulia | why devstack, why!!!! | 13:48 |
| TheJulia | iurygregory: rpittau: okay, once the caffeine hits me I'll rev the change set | 13:49 |
| iurygregory | take your time =D | 13:49 |
| iurygregory | caffeine ++ | 13:49 |
| opendevreview | Julia Kreger proposed openstack/ironic master: Yoga: Change default boot mode to uefi https://review.opendev.org/c/openstack/ironic/+/810249 | 14:15 |
| * TheJulia crosses fingers | 14:15 | |
| rpittau | zuul did not look happy :) | 14:17 |
| dtantsur | old grumpy zuul | 14:20 |
| TheJulia | zuul is often very grumpy and needs lots of cookies. And maybe illicit substances | 14:21 |
| TheJulia | doh | 14:22 |
| opendevreview | Julia Kreger proposed openstack/ironic master: Yoga: Change default boot mode to uefi https://review.opendev.org/c/openstack/ironic/+/810249 | 14:23 |
| TheJulia | I suspect it wants 48vdc electrons | 14:24 |
| TheJulia | negative 48vdc at that | 14:24 |
| TheJulia | Well, it passed syntax sanity checking that time and jobs are queued | 14:25 |
| * TheJulia begins to suspect bindep only gets run if is_fedora is matched | 14:33 | |
| opendevreview | Julia Kreger proposed openstack/ironic master: Remove debian packages file for devstack https://review.opendev.org/c/openstack/ironic/+/810314 | 14:49 |
| TheJulia | wheee pxe tests being thread unhappy | 14:54 |
| opendevreview | Julia Kreger proposed openstack/ironic master: Yoga: Change default boot mode to uefi https://review.opendev.org/c/openstack/ironic/+/810249 | 14:55 |
| TheJulia | bahahahaha "Package libvirt-bin is not available, but is referred to by another package." | 15:06 |
| iurygregory | enr =( | 15:19 |
| opendevreview | Derek Higgins proposed openstack/ironic master: Ensure enable_netboot_fallback writes out pxe config on adopt. https://review.opendev.org/c/openstack/ironic/+/811989 | 15:33 |
| ade_lee | TheJulia, nice! -- https://review.opendev.org/c/openstack/ironic/+/797739 | 15:42 |
| JayF | zer0c00l: rloo: https://review.opendev.org/c/openstack/ironic/+/797739/18/devstack/lib/ironic#154 fixes an issue you all used to have to workaround for ironic devstack on rhel, jfyi | 15:44 |
| ade_lee | TheJulia++, stevebaker++ ^^ | 15:44 |
| rpittau | good night! o/ | 15:59 |
| NobodyCam | Good Morning Ironic'ers | 16:04 |
| rloo | thx JayF! | 16:11 |
| JayF | That entire change req looks relevent to you alls' interested. | 16:11 |
| JayF | *interests | 16:11 |
| TheJulia | ade_lee: If you want, maybe hammer the overrides on to two of the existing jobs and just change the base os?! We don't need two more slightly different jobs running if we can help it | 16:12 |
| *** pmannidi is now known as pmannidi|AFK | 16:33 | |
| opendevreview | Merged openstack/bifrost master: Support debian 11 "bullseye" https://review.opendev.org/c/openstack/bifrost/+/806328 | 16:36 |
| ayoung | https://adam.younglogic.com/2021/09/debugging-a-clean-failure-in-ironic/ | 16:41 |
| ayoung | I probably should add that we figured out why the DHCP was messed up. THe IPA image moved to using new style ethernet names, not eth0. Adding the backwards compat flags on the Kernel command line fixed it. | 16:42 |
| ayoung | So, thanks to all here that helped. | 16:43 |
| dtantsur | nice! | 16:53 |
| dtantsur | ayoung: I hope you stick around nonetheless :) | 16:54 |
| ayoung | Oh, I am here for the duration. I'm now at a Hardware company, and we are using the Ironic cluster to test OS images | 16:55 |
| ayoung | We do unspeakable things in metal! | 16:55 |
| dtantsur | awesome! so may be we'll cross our paths again one day (in person, I mean) | 16:55 |
| dtantsur | and omg, this is an impressive list: https://adam.younglogic.com/climbing/climbing-resume/ | 16:56 |
| ayoung | I miss climbing. Hoping to get back in to it post covid | 16:57 |
| ayoung | GOt out once last spring, local crag. But it is no Yosemite. | 16:57 |
| dtantsur | ayoung: I would assume it's a covid-friendly hobby? | 16:57 |
| * dtantsur hasn't climbed real (non-plastic) rock, let alone something as impressive as yosemite | 16:58 | |
| ayoung | Once you get hookced on crack, you never go back | 16:59 |
| dtantsur | I can imagine :) Not so much rock around me, unfortunately | 16:59 |
| TheJulia | iurygregory: *so* I added eliminating our use of wiki.openstack.org to the ptg discussion topic list | 17:06 |
| TheJulia | I also started deleting things | 17:07 |
| TheJulia | Notes on the etherpad of course | 17:07 |
| iurygregory | TheJulia, ack I will take a look at it o/ | 17:07 |
| TheJulia | ayoung: we *really* should have a sig for that, I know at least one other person who works for a hardware company which does QA of their chips... and actually there are several companies which do so. | 17:08 |
| iurygregory | TheJulia, quick question, I noticed that in the ethercal we have 11 slots (just wondering if is correct) | 17:09 |
| TheJulia | iurygregory: I think that sounds about right | 17:10 |
| iurygregory | TheJulia, ack =) | 17:10 |
| TheJulia | I only put them in there to reserve time early | 17:10 |
| iurygregory | got it | 17:11 |
| iurygregory | maybe I will miss the first day of the PTG (Monday 18th), I will only be sure a week before the PTG starts | 17:12 |
| TheJulia | I should be around no problem if worst comes to worst | 17:13 |
| TheJulia | I'll be on the east coast, but the house has internet there so I should be *good* as long as it works. | 17:13 |
| TheJulia | And worst comes to worst I have keys for my cousin's apartment down the road. | 17:13 |
| iurygregory | got it =) | 17:14 |
| TheJulia | ... and the internet is in my name there... oddly. | 17:14 |
| * TheJulia wonders if they would finally let me get that transferred out this trip | 17:15 | |
| iurygregory | I have a friend from Brazil that will come to visit Prague on the week of the PTG, so I'm thinking about using monday 18th as PTO, so I can see him on sunday and monday | 17:15 |
| TheJulia | nice! | 17:16 |
| opendevreview | Julia Kreger proposed openstack/ironic master: Yoga: Change default boot mode to uefi https://review.opendev.org/c/openstack/ironic/+/810249 | 17:52 |
| opendevreview | Julia Kreger proposed openstack/python-ironicclient stable/wallaby: Fix the functional tests https://review.opendev.org/c/openstack/python-ironicclient/+/812012 | 18:23 |
| TheJulia | stevebaker: I think we need to merge ^^^ to fix python-ironicclient stable/wallaby | 18:24 |
| erbarr | zuul has a built in system to register and lock resources? That'd be nice to know how to use | 18:28 |
| TheJulia | erbarr: I remember monty and jim talking about such | 18:29 |
| TheJulia | I just don't know the details | 18:29 |
| erbarr | cool, I'll need to look into that, thanks! | 18:30 |
| TheJulia | erbarr: no problem | 18:32 |
| TheJulia | stevebaker: rechecked 804000 for you. I can't reproduce the failure locally. Looks like maybe you just got unlucky with a bad mirror. There was chatter in the opendev channel earlier about a broken fedora mirror | 18:53 |
| ayoung | 7 releases bad luck | 19:18 |
| ayoung | (that is what happens when you break a Fedora mirror) | 19:20 |
| * ayoung ducks | 19:20 | |
| TheJulia | ayoung: you need lots of kittens | 19:23 |
| ayoung | Not with my Dog I don't. THat would be bad for the kittens | 19:24 |
| TheJulia | corgi plays with kittens! | 19:31 |
| opendevreview | Tzu-Mainn Chen proposed openstack/ironic master: Fix restricted allocation creation https://review.opendev.org/c/openstack/ironic/+/812007 | 20:44 |
| TheJulia | tzumainn: so, any chance you could include an explicit test or supply what the actual request payload/context was. I guess I'm worried I'm over thinking it but need to see exactly what was being attempted | 21:39 |
| opendevreview | Merged openstack/python-ironicclient stable/wallaby: Fix the functional tests https://review.opendev.org/c/openstack/python-ironicclient/+/812012 | 22:18 |
| *** pmannidi|AFK is now known as pmannidi | 23:50 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!