| *** Goneri has quit IRC | 00:10 | |
| *** Qianbiao has joined #openstack-ironic | 00:43 | |
| stevebaker | afternoon | 00:47 |
|---|---|---|
| janders | hey stevebaker | 00:51 |
| *** gyee has quit IRC | 00:54 | |
| Qianbiao | hey stevebaker janders | 01:02 |
| *** larsks has joined #openstack-ironic | 01:48 | |
| *** mkrai has joined #openstack-ironic | 02:40 | |
| *** uzumaki has joined #openstack-ironic | 02:42 | |
| *** Qianbiao has quit IRC | 02:59 | |
| *** mkrai has quit IRC | 03:07 | |
| *** mkrai_ has joined #openstack-ironic | 03:07 | |
| *** mkrai_ has quit IRC | 03:12 | |
| *** uzumaki has quit IRC | 03:14 | |
| *** mkrai_ has joined #openstack-ironic | 03:18 | |
| *** mkrai has joined #openstack-ironic | 03:20 | |
| *** mkrai_ has quit IRC | 03:20 | |
| *** Qianbiao has joined #openstack-ironic | 03:39 | |
| *** mkrai has quit IRC | 04:04 | |
| *** tonyb has quit IRC | 04:10 | |
| *** anuradha1904 has joined #openstack-ironic | 04:27 | |
| *** mkrai has joined #openstack-ironic | 04:30 | |
| *** Qianbiao has quit IRC | 04:50 | |
| *** abdysn has joined #openstack-ironic | 05:07 | |
| *** mkrai has quit IRC | 05:13 | |
| *** mkrai has joined #openstack-ironic | 05:14 | |
| *** tkajinam has quit IRC | 05:21 | |
| *** tkajinam has joined #openstack-ironic | 05:22 | |
| *** bdodd has quit IRC | 05:55 | |
| *** bdodd has joined #openstack-ironic | 05:57 | |
| *** ricolin has quit IRC | 06:00 | |
| arne_wiebalck | Good morning, ironic! | 06:21 |
| openstackgerrit | Ankit Kumar proposed openstack/ironic-tempest-plugin master: Test case for uefi-https-boot in standalone ironic https://review.opendev.org/757696 | 06:29 |
| *** belmoreira has joined #openstack-ironic | 06:34 | |
| openstackgerrit | Arne Wiebalck proposed openstack/ironic-python-agent master: [trivial] Remove redundant list conversion https://review.opendev.org/757699 | 06:34 |
| janders | good morning arne_wiebalck | 06:52 |
| arne_wiebalck | Hey janders o/ | 06:53 |
| iurygregory | good morning arne_wiebalck janders and Ironic! | 06:58 |
| arne_wiebalck | Hey iurygregory o/ | 06:59 |
| janders | good morning iurygregory o/ | 07:01 |
| *** jtomasek has joined #openstack-ironic | 07:01 | |
| iurygregory | o/ | 07:02 |
| *** Qianbiao has joined #openstack-ironic | 07:14 | |
| * iurygregory grabs more coffee | 07:16 | |
| *** tosky has joined #openstack-ironic | 07:26 | |
| *** rpittau|afk is now known as rpittau | 07:27 | |
| rpittau | good morning ironic! o/ | 07:27 |
| rpittau | mmm I lost around 5 hours of logs | 07:27 |
| arne_wiebalck | no logs, no errors :) | 07:31 |
| rpittau | chat logs :) | 07:31 |
| *** SpamapS has quit IRC | 07:35 | |
| iurygregory | morning rpittau o/ | 07:37 |
| rpittau | hey iurygregory :) | 07:41 |
| *** SpamapS has joined #openstack-ironic | 07:52 | |
| *** rcernin has quit IRC | 07:52 | |
| *** lucasagomes has joined #openstack-ironic | 08:05 | |
| *** ricolin has joined #openstack-ironic | 08:06 | |
| Qianbiao | Morning | 08:09 |
| iurygregory | morning Qianbiao | 08:09 |
| Qianbiao | rpittau no doubt, your time is stole. | 08:10 |
| Qianbiao | Morning iurygregory | 08:10 |
| Qianbiao | there are no messages last 5 hours indeed :) | 08:10 |
| rpittau | hey Qianbiao :) | 08:22 |
| rpittau | yeah, some disconnection of sort | 08:23 |
| Qianbiao | Hey rpittau | 08:23 |
| *** pmannidi has quit IRC | 08:24 | |
| *** pmannidi has joined #openstack-ironic | 08:24 | |
| *** k_mouza has joined #openstack-ironic | 08:32 | |
| *** priteau has joined #openstack-ironic | 08:34 | |
| *** ociuhandu has joined #openstack-ironic | 08:34 | |
| *** ociuhandu has quit IRC | 08:35 | |
| *** ociuhandu has joined #openstack-ironic | 08:35 | |
| iurygregory | funny, IPE CI on stable/train is having kernel panic but ussuri is fine (with same config) O.o | 08:42 |
| rpittau | mmmm | 08:42 |
| *** rcernin has joined #openstack-ironic | 08:44 | |
| *** derekh has joined #openstack-ironic | 08:44 | |
| iurygregory | or maybe the cloud provider is mad XD | 08:46 |
| *** jtomasek has quit IRC | 08:52 | |
| *** jtomasek has joined #openstack-ironic | 08:54 | |
| iurygregory | rpittau, do you think would be worth bump the memory to 512? https://review.opendev.org/#/c/753067/ | 08:58 |
| patchbot | patch 753067 - ironic-prometheus-exporter (stable/train) - Fallback to `node_uuid` if`node_name` is not present - 2 patch sets | 08:58 |
| rpittau | iurygregory: always :) | 08:58 |
| *** dtantsur|afk is now known as dtantsur | 09:06 | |
| dtantsur | morning ironic | 09:06 |
| iurygregory | morning dtantsur | 09:08 |
| rpittau | good morning dtantsur :) | 09:10 |
| janders | good morning dtantsur | 09:10 |
| iurygregory | lol "fatal: unable to access 'https://opendev.org/openstack/ironic-prometheus-exporter/': Failed to connect to opendev.org port 443: Connection timed out" | 09:13 |
| rpittau | yep opendev is having some issues | 09:13 |
| iurygregory | oh ok =) | 09:13 |
| iurygregory | I was thinking it was my internet provider =D | 09:14 |
| rpittau | no, I'm also having trouble connecting | 09:14 |
| rpittau | I reported it in their channel | 09:17 |
| *** k_mouza has quit IRC | 09:21 | |
| *** mkrai has quit IRC | 09:21 | |
| *** k_mouza has joined #openstack-ironic | 09:21 | |
| iurygregory | yay | 09:24 |
| iurygregory | this should happen on monday's only hahah | 09:25 |
| *** k_mouza has quit IRC | 09:26 | |
| *** k_mouza has joined #openstack-ironic | 09:28 | |
| rpittau | what is tuesday if not a second monday? | 09:29 |
| *** mkrai has joined #openstack-ironic | 09:30 | |
| *** mkrai has quit IRC | 09:32 | |
| iurygregory | rpittau, noooooo =( | 09:33 |
| *** rcernin has quit IRC | 09:33 | |
| rpittau | :/ | 09:34 |
| *** rcernin has joined #openstack-ironic | 09:34 | |
| *** jtomasek has quit IRC | 09:36 | |
| iurygregory | yay opendev now is happy with me | 09:40 |
| rpittau | yep, working again | 09:40 |
| rpittau | could be random though | 09:40 |
| iurygregory | I've put a script to run every 10s git pull | 09:41 |
| iurygregory | hahaha | 09:41 |
| rpittau | lol | 09:41 |
| openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/ironic-prometheus-exporter stable/train: Increase memory for stable/train https://review.opendev.org/757800 | 09:43 |
| iurygregory | gerritbot is back from PTO | 09:43 |
| iurygregory | =D | 09:43 |
| *** rcernin has quit IRC | 09:58 | |
| *** rcernin has joined #openstack-ironic | 09:59 | |
| dtantsur | iurygregory: did you end up writing a patch to remove dstat from openstacksdk? | 10:02 |
| iurygregory | dtantsur, hey I have it locally (disabled on the ironic job only) | 10:04 |
| dtantsur | if you propose it, I can approve | 10:04 |
| iurygregory | dtantsur, done | 10:06 |
| dtantsur | thx | 10:07 |
| iurygregory | np | 10:08 |
| openstackgerrit | Riccardo Pittau proposed openstack/ironic-python-agent-builder master: [WIP] Use centos element for dib on focal https://review.opendev.org/757808 | 10:09 |
| rpittau | ^ locally seems working | 10:10 |
| iurygregory | works in devstack =) | 10:12 |
| dtantsur | ship it \o/ | 10:12 |
| openstackgerrit | Riccardo Pittau proposed openstack/ironic-python-agent-builder master: Use centos element for dib on focal https://review.opendev.org/757808 | 10:13 |
| *** rcernin has quit IRC | 10:14 | |
| rpittau | 380M compressed size | 10:14 |
| dtantsur | could I get another +2 on https://review.opendev.org/#/c/756343/ please? it's just moving code around. | 10:15 |
| patchbot | patch 756343 - ironic - Refactoring: split away continue_node_deploy/clean - 1 patch set | 10:15 |
| dtantsur | rpittau: looks acceptable | 10:15 |
| rpittau | yeah | 10:15 |
| *** rcernin has joined #openstack-ironic | 10:25 | |
| iurygregory | dtantsur, looking now | 10:25 |
| *** priteau has quit IRC | 10:30 | |
| openstackgerrit | Riccardo Pittau proposed openstack/ironic master: [WIP] Use centos as base element for dib images https://review.opendev.org/757811 | 10:32 |
| dtantsur | can anybody think of a reason to keep running the tempest job on python-ironic-inspector-client? | 10:34 |
| openstackgerrit | Riccardo Pittau proposed openstack/ironic-python-agent master: Run dib ipa src jobs on ubuntu focal https://review.opendev.org/757812 | 10:35 |
| iurygregory | maybe would be to make sure we won't break things, but we have functional tests job so it should be ok to drop? | 10:40 |
| arne_wiebalck | rpittau: uh, centos-minimal instead of centos? | 10:40 |
| rpittau | arne_wiebalck: the contrary | 10:41 |
| rpittau | centos instead of centos-minimal | 10:41 |
| arne_wiebalck | rpittau: and that makes the image smaller? | 10:41 |
| rpittau | arne_wiebalck: well, locally it doesn't make the image too much bigger | 10:42 |
| rpittau | we're not doing it for the size | 10:42 |
| rpittau | but for compatibility with CI requirements | 10:42 |
| arne_wiebalck | rpittau: ah. ok | 10:42 |
| rpittau | arne_wiebalck: https://etherpad.opendev.org/p/ipa-builder-focal-migration | 10:42 |
| rpittau | I think I forgot to add a link to the whiteboard :) | 10:43 |
| * arne_wiebalck wonders why it is called minimal when the size is more or less the same | 10:43 | |
| rpittau | the base is different | 10:44 |
| rpittau | centos-minimal uses very few elements to bootstrap a base environment | 10:44 |
| rpittau | centos starts from the centos cloud image | 10:44 |
| arne_wiebalck | ok, thanks! | 10:45 |
| rpittau | np :) | 10:45 |
| *** belmoreira has quit IRC | 11:03 | |
| *** belmoreira has joined #openstack-ironic | 11:10 | |
| *** Abdallahyas has joined #openstack-ironic | 11:15 | |
| *** belmoreira has quit IRC | 11:16 | |
| *** abdysn has quit IRC | 11:19 | |
| iurygregory | https://review.opendev.org/ Proxy Error | 11:56 |
| iurygregory | now I agree with rpittau that Tuesday is just another Monday.... | 11:56 |
| *** k_mouza has quit IRC | 12:07 | |
| *** rcernin has quit IRC | 12:11 | |
| *** k_mouza has joined #openstack-ironic | 12:13 | |
| *** k_mouza has quit IRC | 12:18 | |
| *** Abdallahyas has quit IRC | 12:19 | |
| *** abdysn has joined #openstack-ironic | 12:20 | |
| *** k_mouza has joined #openstack-ironic | 12:22 | |
| rpittau | \o/ | 12:47 |
| *** Goneri has joined #openstack-ironic | 12:54 | |
| *** tzumainn has joined #openstack-ironic | 12:58 | |
| TheJulia | brraaaiiins | 13:13 |
| TheJulia | it is another monday | 13:13 |
| TheJulia | Just in disguise! | 13:13 |
| dtantsur | morning TheJulia | 13:14 |
| TheJulia | how is everyone this morning? | 13:14 |
| dtantsur | another Monday, another screaming inside from our vmedia code | 13:14 |
| rpittau | good morning TheJulia :) | 13:14 |
| dtantsur | for some ungodly reason we pass fake BOOTIF that is "None" (a string) for standalone case breaking inspection | 13:14 |
| dtantsur | (for the context, BOOTIF is a PXE-specific kernel parameter) | 13:15 |
| rpittau | the sun is shining and the limitation of max 6 people in private houses doesn't block us to play Gloomhaven, so all good :) | 13:15 |
| TheJulia | but the code looks for it for inspection :\ | 13:15 |
| dtantsur | yes, and behaved well if it's not present | 13:15 |
| dtantsur | but not if it's set to a string "None" | 13:16 |
| TheJulia | figures for a monday | 13:16 |
| *** openstackgerrit has quit IRC | 13:17 | |
| *** rloo has joined #openstack-ironic | 13:18 | |
| *** openstackgerrit has joined #openstack-ironic | 13:18 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: Support redfish-virtual-media with legacy boot https://review.opendev.org/757848 | 13:18 |
| janders | see you tomorrow Ironic o/ | 13:19 |
| dtantsur | see you janders | 13:19 |
| openstackgerrit | Riccardo Pittau proposed openstack/ironic-python-agent master: Run dib ipa src jobs on ubuntu focal https://review.opendev.org/757812 | 13:20 |
| rpittau | bye janders | 13:20 |
| rpioso | Good morning, ironic :) | 13:46 |
| dtantsur | derekh: hey, do you think we can fix https://github.com/metal3-io/ironic-image/blob/master/Dockerfile#L19-L21 on the ironic side? | 13:50 |
| dtantsur | I'm not sure this procedure will play well with secure boot.. | 13:51 |
| dtantsur | cc TheJulia | 13:51 |
| derekh | dtantsur: possibly, I wonder does it work if we set grub_config_path or maybe have ironic place it it multiple common paths | 13:55 |
| derekh | "it" being grub.cnf | 13:55 |
| *** larsks has quit IRC | 13:56 | |
| *** larsks has joined #openstack-ironic | 13:58 | |
| dtantsur | yeah | 13:59 |
| dtantsur | I can look into that, I've been diving into the vmedia code recently | 13:59 |
| dtantsur | derekh: yeah, grub_config_path looks exactly like what we need | 14:00 |
| dtantsur | not sure why it was not considered | 14:00 |
| derekh | dtantsur: yup, I forget tbh, I may not have known it existed | 14:01 |
| *** Qianbiao has quit IRC | 14:09 | |
| *** Qianbiao has joined #openstack-ironic | 14:10 | |
| iurygregory | for uefi aren't we just using efibootmgr? not grub2? O.o | 14:12 |
| dtantsur | this is about ISO boot | 14:15 |
| TheJulia | erbarr: hey, is your ramdisk cached and maybe needing to be upodated? | 14:17 |
| erbarr | TheJulia, idk, let me look | 14:18 |
| TheJulia | dtantsur: that step is intended or at least was intended to build a secure bootable uefi esp iamge | 14:19 |
| TheJulia | oh | 14:19 |
| TheJulia | it now uses grub2-mkimage | 14:19 |
| TheJulia | yeah, no, that is not going to work | 14:19 |
| dtantsur | yep | 14:19 |
| dtantsur | it seems that we can just guess the correct path to put grub.cfg to | 14:19 |
| TheJulia | yeah | 14:19 |
| dtantsur | which I see as $ ls /boot/efi/EFI | grep -v BOOT | 14:20 |
| dtantsur | at least I don't have smarter ideas :) | 14:20 |
| *** Abdallahyas has joined #openstack-ironic | 14:23 | |
| *** abdysn has quit IRC | 14:25 | |
| *** Abdallahyas has quit IRC | 14:27 | |
| erbarr | TheJulia, I'm using https://images.rdoproject.org/master/rdo_trunk/current-tripleo/overcloud-full.tar | 14:30 |
| TheJulia | erbarr: that is super out of date | 14:30 |
| TheJulia | take a look at the dates on the files | 14:30 |
| *** jamesdenton has quit IRC | 14:31 | |
| erbarr | okay, what should i use then? | 14:32 |
| TheJulia | erbarr: wouldn't it make sense to just enable the local build of the image so your not using cached images ? You could likely use the centos IPA image published to tarballs.o.o/ironic-python-agent | 14:32 |
| iurygregory | dtantsur, oh ok =) | 14:33 |
| erbarr | okay, i'll try to enable building | 14:33 |
| *** jamesdenton has joined #openstack-ironic | 14:42 | |
| *** Qianbiao has quit IRC | 14:49 | |
| *** ociuhandu_ has joined #openstack-ironic | 14:50 | |
| rpioso | erbarr: What's the date on that file? | 14:51 |
| dtantsur | iurygregory: re dhcp-less deploy. wdyt about a hybrid mode where we don't use the simple-init element but call glean as a library from IPA? | 14:52 |
| dtantsur | a bit lame, but would allow for multi-purpose IPA images | 14:52 |
| iurygregory | dtantsur, wow! | 14:52 |
| erbarr | rpioso, 2/27/2020 | 14:52 |
| dtantsur | iurygregory: :) I'm worried about two images mode (I'm also worried about dhcp-all-interfaces taking minutes, but one thing at a time) | 14:53 |
| iurygregory | dtantsur, this would requires changes on IPA code right or there is a way we can tell IPA to run glean? | 14:53 |
| dtantsur | iurygregory: no such way, needs implementing | 14:53 |
| *** ociuhandu has quit IRC | 14:54 | |
| iurygregory | I'm trying to think on the workflow for this | 14:54 |
| iurygregory | using the hybrid approach | 14:55 |
| iurygregory | we would need to make sure the node has the network_data information so we can proceed | 14:55 |
| iurygregory | and some type of configuration that would tell ipa that it should try to run glean to set up things right? | 14:56 |
| rpioso | dtantsur: On stable/train, inspector in-band introspection does not add boot_mode:uefi to properties's capabilities when the system is in UEFI boot mode. It did so previously. Sound familiar? | 14:58 |
| dtantsur | I think there is an option for that | 15:00 |
| *** rh-jelabarre has quit IRC | 15:06 | |
| *** SpamapS has quit IRC | 15:10 | |
| *** SpamapS has joined #openstack-ironic | 15:10 | |
| rpioso | dtantsur: Thank you! | 15:21 |
| iurygregory | dtantsur, I've pushed 2.3.0 for IPA-B, just wondering if `Use tinycore 11 to build tinyipa` would require a major release instead of minor | 15:35 |
| dtantsur | I don't think so | 15:35 |
| dtantsur | not unless we break operators with it | 15:35 |
| dtantsur | (and they shouldn't be using tinyIPA at all) | 15:35 |
| rpittau | worst case scenario we break CI :P | 15:36 |
| dtantsur | we use IPA-builder from git, not from releases | 15:36 |
| rpittau | uh true, then we won't break anything with that change | 15:37 |
| iurygregory | cool =) | 15:41 |
| *** dtantsur is now known as dtantsur|afk | 15:42 | |
| dtantsur|afk | o/ | 15:42 |
| *** ociuhandu_ has quit IRC | 15:46 | |
| *** ociuhandu has joined #openstack-ironic | 15:47 | |
| arne_wiebalck | TheJulia: Scale tests: I reduced from 3 to 1 conductor and tried to deploy 200 nodes (to finally trigger an OOM situation). | 15:50 |
| arne_wiebalck | TheJulia: 143 instances ended in ERROR, but I think this is mostly due to a nova timeout. | 15:51 |
| arne_wiebalck | TheJulia: With 3 conductors 190/200 worked just fine (the rest ignored power off commands or got stuck before PXE). | 15:52 |
| arne_wiebalck | TheJulia: I can check tomorrow if there is a timeout on nova I can increase, but I am really having a hard time to break it ... :) | 15:52 |
| arne_wiebalck | TheJulia: Neither the nova nor the ironic conductor want to give up ... | 15:53 |
| TheJulia | hehehehe | 15:53 |
| *** gyee has joined #openstack-ironic | 15:54 | |
| arne_wiebalck | TheJulia: It just seems to work. | 15:54 |
| iurygregory | blame nova =D | 15:54 |
| iurygregory | blame neutron | 15:54 |
| TheJulia | no no, blame ironic! | 15:54 |
| iurygregory | only after neutron XD | 15:54 |
| arne_wiebalck | blame ironic that it works! | 15:54 |
| arne_wiebalck | we replaced our *very* old grub with a new one, this made a huge difference | 15:55 |
| iurygregory | \o/ | 15:58 |
| openstackgerrit | Aija Jaunteva proposed openstack/ironic master: Fix redfish BIOS apply config error handling https://review.opendev.org/755776 | 15:59 |
| openstackgerrit | Aija Jaunteva proposed openstack/ironic master: Fix idrac-wsman BIOS step async error handling https://review.opendev.org/755821 | 15:59 |
| openstackgerrit | Aija Jaunteva proposed openstack/ironic master: Fix idrac-wsman RAID step async error handling https://review.opendev.org/755731 | 15:59 |
| dking | I'm having some trouble today launching my updated Hardware Manager. I added a new Hardware Manager with a couple of clean steps. Now, it seems that when a node is cleaned, it hangs before even running get_clean_steps. I see that it finds my hardware managers and runs evaluate_hardware_support, but no cleaning is done, and I'm stumped. | 16:01 |
| dking | If anybody would like to take a look, here's my /var/log/messages: http://sprunge.us/LYcA3l | 16:02 |
| *** rh-jelabarre has joined #openstack-ironic | 16:03 | |
| *** lucasagomes has quit IRC | 16:03 | |
| openstackgerrit | Kafilat Adeleke proposed openstack/sushy master: Adds sushy library overview https://review.opendev.org/757907 | 16:10 |
| arne_wiebalck | dking: maintenance is false for the node? | 16:10 |
| dking | arne_wiebalck: Correct. It is false and in "clean wait". | 16:13 |
| JayF | Ironic logs is the place to look to troubleshoot that -- the agent is getting no incoming API calls from Ironic AFAICT. Perhaps a network connectivity problem? | 16:13 |
| dking | JayF: Interesting. It did seem to start going idle after network setup. But that's odd because I'm actually accessing the node from Bifrost server. Is there any specific curl I could try? To port :9999? | 16:15 |
| JayF | I'd absolutely be checking Ironic conductor logs for that node. | 16:16 |
| JayF | I know that I would use a curl, but I don't have an agent with token support, so I think that may uncomplicate that a little | 16:16 |
| JayF | and you'd want to curl the exact URL printed in that "announcing callback URL" log | 16:17 |
| JayF | from the conductor that should be managing the node | 16:17 |
| JayF | with token caveats aside, hitting the root of that should give you a 200 and some json | 16:17 |
| dking | It seems like I can connect fine, at least: http://paste.openstack.org/show/799000/ | 16:20 |
| rpittau | goodnight! o/ | 16:21 |
| *** rpittau is now known as rpittau|afk | 16:21 | |
| dking | I'm looking through the conductor logs. Here's a snippet from those: http://paste.openstack.org/show/799001/ | 16:23 |
| JayF | > 2020-10-13 16:18:10.537 1149806 WARNING ironic.drivers.modules.agent_base_vendor [-] Heartbeat from node 28000169-698c-4ed8-90d7-3bb6e93a5d16 in maintenance mode; not taking any action. | 16:24 |
| JayF | The node *is* in maintenance, as arne_wiebalck suggested | 16:24 |
| dking | Oh, in deed it is... | 16:24 |
| dking | I was looking for that, and I must have somehow looked at the wrong column. | 16:24 |
| dking | I feel silly. I bet I put it in maintenance mode when I started testing a couple images ago. | 16:25 |
| arne_wiebalck | dking: it also goes into maintenance when cleaning fails | 16:25 |
| arne_wiebalck | dking: so, it may be the result of an earlier failed attempt to clean | 16:25 |
| dking | Yeah. It failed earlier because I didn't set the 'interface' key in the cleaning steps. So, I updated my code and tried again. That's probably what did it. | 16:26 |
| arne_wiebalck | dking: btw, this is a nice method to put a breakpoint to debug cleaning ;) | 16:26 |
| arne_wiebalck | dking: I use this to give me time to log in and watch what cleaning is doing. | 16:27 |
| dking | Yeah, I really helped out as I was able to get in and run the commands manually which worked, so there's that. | 16:27 |
| JayF | if you can craft a curl to run a clean step | 16:27 |
| JayF | you've discovered the backdoor way to develop them ;) | 16:27 |
| JayF | maint node -> long cleanwait timeouts -> able to make API calls to IPA all day long | 16:28 |
| *** rpittau|afk has quit IRC | 16:31 | |
| dking | I suppose that I just need to learn the IPA API. :) | 16:31 |
| *** uzumaki has joined #openstack-ironic | 16:34 | |
| *** rpittau|afk has joined #openstack-ironic | 16:34 | |
| openstackgerrit | Kafilat Adeleke proposed openstack/sushy master: Adds sushy library overview https://review.opendev.org/757907 | 16:34 |
| dking | Really, I try to do as much testing as I can in my build process, but I do have to mock the actual hardware cleaning, so it would be helpful for when I have to do the first tests. | 16:34 |
| dking | on actual hardware. | 16:34 |
| *** k_mouza has quit IRC | 16:38 | |
| arne_wiebalck | Bye everyone o/ | 16:39 |
| *** priteau has joined #openstack-ironic | 16:39 | |
| * TheJulia goes and makes "no more meetings... at least for two hours" coffee | 16:44 | |
| *** k_mouza has joined #openstack-ironic | 16:45 | |
| *** k_mouza has quit IRC | 16:50 | |
| *** ociuhandu_ has joined #openstack-ironic | 16:54 | |
| *** k_mouza has joined #openstack-ironic | 16:54 | |
| *** ociuhandu has quit IRC | 16:57 | |
| *** uzumaki has quit IRC | 16:57 | |
| *** ociuhandu_ has quit IRC | 16:58 | |
| *** k_mouza has quit IRC | 16:58 | |
| *** derekh has quit IRC | 17:00 | |
| *** bdodd has quit IRC | 17:00 | |
| dking | Does anybody know the priority on erase_block_devices? | 17:03 |
| *** k_mouza has joined #openstack-ironic | 17:07 | |
| *** k_mouza has quit IRC | 17:11 | |
| *** k_mouza has joined #openstack-ironic | 17:14 | |
| TheJulia | 10 by default | 17:14 |
| TheJulia | it is configurable | 17:14 |
| * TheJulia looks at unit tests and wonders if maybe touching them during the board meeting was a bad idea | 17:15 | |
| *** k_mouza has quit IRC | 17:19 | |
| dking | Nah, the best time to play with tests is during a meeting, preferably when you're presenting features. :p | 17:20 |
| dking | So, this is odd. I just had a successful clean, but I tried to do it again, and for some reason now, after an update and reboot as part of the cleaning process, I'm getting an error saying that the heartbeat can't connect and is getting a 400 error. | 17:22 |
| dking | However, I can't replicate. Logged onto the node, I can curl Ironic fine, with the same IP and port. It doesn't give the actual URL, though. | 17:22 |
| *** vesper11 has joined #openstack-ironic | 17:25 | |
| *** ociuhandu has joined #openstack-ironic | 17:27 | |
| dking | Oh, interesting: "Received heartbeat for node ... with callback URL http://10.8.0.167:9999. This is not expected, and the heartbeat will not be processed." | 17:27 |
| *** ociuhandu has quit IRC | 17:32 | |
| *** k_mouza has joined #openstack-ironic | 17:38 | |
| dking | How could the node be in a "clean wait" state and not expect a heartbeat? | 17:39 |
| *** bdodd has joined #openstack-ironic | 17:42 | |
| *** k_mouza has quit IRC | 17:42 | |
| TheJulia | ahh hah, It was not me, it is how the unit test is written | 17:43 |
| TheJulia | dking: has the callback url changed? | 17:44 |
| iurygregory | how magic works lol | 17:44 |
| dking | We have a bit of a rule here to not muck around with things during meetings. But it sure takes the fun out of things. lol | 17:45 |
| dking | TheJulia: Nope. It's the same as it was before the reboot. | 17:45 |
| TheJulia | dking: I'd compare the logic that filters that against what you know the node state to be | 17:46 |
| dking | The reboot was part of the clean step, which unfortunately was also "abortable: False". | 17:46 |
| dking | I might have to do that. First, I'm going to hope it's just a fluke as it cleaned once before with no problem, on the same node. | 17:47 |
| dking | I just have to figure out how to get it to abort the cleaning. | 17:47 |
| *** priteau has quit IRC | 17:53 | |
| *** priteau has joined #openstack-ironic | 17:54 | |
| dking | TheJulia: Do you know where I could find that logic? It looks like it's doing it even after I start a new clean. | 17:57 |
| *** priteau has quit IRC | 18:01 | |
| *** k_mouza has joined #openstack-ironic | 18:15 | |
| *** k_mouza has quit IRC | 18:19 | |
| *** k_mouza has joined #openstack-ironic | 18:23 | |
| *** sshnaidm is now known as sshnaidm|afk | 18:24 | |
| TheJulia | so your hitting a but where we don't know | 18:24 |
| TheJulia | that it is rebooting | 18:24 |
| TheJulia | in that the agent token needs to be deleted if it is going to reboot | 18:25 |
| TheJulia | it is a security mechanism | 18:25 |
| *** k_mouza has quit IRC | 18:28 | |
| *** k_mouza has joined #openstack-ironic | 18:38 | |
| *** k_mouza has quit IRC | 18:42 | |
| *** k_mouza has joined #openstack-ironic | 18:56 | |
| *** k_mouza has quit IRC | 19:00 | |
| tzumainn | hi! question if I may - I'm trying to understand the intended behavior when booting from a volume | 19:01 |
| tzumainn | I do the volume connector/target steps, and then connect the node to the provisioning network and deploy | 19:01 |
| tzumainn | and for some reason ironic detaches the node from the provisioning network, deletes the neutron port, and then throws an error saying that neutron port can't be found | 19:02 |
| tzumainn | is that supposed to happen for a reason I don't quite understand? | 19:02 |
| *** k_mouza has joined #openstack-ironic | 19:21 | |
| guilhermesp | hey there! is there a way to enroll nodes with openBMC nowadays? | 19:21 |
| guilhermesp | adding the ipmi info returns me `Error: Unable to retrieve boot device for Ironic node. IPMI call failed: chassis bootparam get 5. (HTTP 500)` | 19:21 |
| *** k_mouza has quit IRC | 19:25 | |
| dking | TheJulia: As a follow up, I think that the issue was that it was attempting to use a different IP than what was listed as the "agent_url". For some reason, the later was set to the first NIC, where before, it was using the IP on the second NIC. I'm running again, but that seems like the sort of thing that could cause intermittent issues. | 19:27 |
| *** k_mouza has joined #openstack-ironic | 19:29 | |
| *** k_mouza has quit IRC | 19:34 | |
| *** k_mouza has joined #openstack-ironic | 19:38 | |
| guilhermesp | i see that the initial patches are pretty much abandoned https://review.opendev.org/#/c/429836/ https://review.opendev.org/#/c/403835/ | 19:39 |
| patchbot | patch 429836 - ironic - Add OpenBMC class for accessing nodes using OpenBMC - 12 patch sets | 19:39 |
| patchbot | patch 403835 - ironic - OpenBMC Hardware Type - 8 patch sets | 19:39 |
| TheJulia | dking: if you want to propose a knob to control that option, I'd happily +2 it | 20:24 |
| TheJulia | s/option/check/ | 20:24 |
| *** iurygregory has quit IRC | 20:50 | |
| *** iurygregory has joined #openstack-ironic | 20:50 | |
| *** ociuhandu has joined #openstack-ironic | 20:55 | |
| *** ociuhandu has quit IRC | 21:43 | |
| janders | good morning Ironic | 21:47 |
| *** rloo has quit IRC | 21:52 | |
| *** rcernin has joined #openstack-ironic | 22:16 | |
| *** ociuhandu has joined #openstack-ironic | 22:38 | |
| *** ociuhandu has quit IRC | 22:42 | |
| *** rcernin has quit IRC | 22:45 | |
| *** anuradha1904 has quit IRC | 22:46 | |
| *** tosinfarai has joined #openstack-ironic | 22:49 | |
| *** rcernin has joined #openstack-ironic | 22:50 | |
| *** rcernin has quit IRC | 22:51 | |
| *** rcernin has joined #openstack-ironic | 22:51 | |
| *** tosinfarai has quit IRC | 22:52 | |
| *** tosin has joined #openstack-ironic | 22:57 | |
| *** k_mouza has quit IRC | 23:01 | |
| *** k_mouza has joined #openstack-ironic | 23:01 | |
| *** tosin has quit IRC | 23:05 | |
| *** k_mouza has quit IRC | 23:06 | |
| *** k_mouza has joined #openstack-ironic | 23:07 | |
| *** k_mouza has quit IRC | 23:11 | |
| *** tosin has joined #openstack-ironic | 23:12 | |
| *** tosin has quit IRC | 23:15 | |
| *** jamesdenton has quit IRC | 23:20 | |
| *** jamesdenton has joined #openstack-ironic | 23:20 | |
| *** naved001 has quit IRC | 23:22 | |
| *** naved001 has joined #openstack-ironic | 23:22 | |
| *** k_mouza has joined #openstack-ironic | 23:22 | |
| *** hoonetorg has quit IRC | 23:22 | |
| *** bnemec has quit IRC | 23:22 | |
| *** zigo has quit IRC | 23:23 | |
| *** bnemec has joined #openstack-ironic | 23:24 | |
| openstackgerrit | Julia Kreger proposed openstack/ironic master: IPMI: Handle vendor set boot device differences https://review.opendev.org/757198 | 23:26 |
| TheJulia | o/ janders | 23:26 |
| *** k_mouza has quit IRC | 23:26 | |
| TheJulia | guilhermesp: so last I heard from openbmc folks was that they supported ipmi so there was no point in implementing a openbmc driver | 23:27 |
| TheJulia | mjturek: ^^ | 23:27 |
| TheJulia | mjturek: btw, I know you responded to me async a while back and I've been insanely busy | 23:27 |
| TheJulia | janders: o/ | 23:27 |
| janders | o/ | 23:28 |
| TheJulia | guilhermesp: hmm... did you explicitly ask for the boot devices? | 23:28 |
| TheJulia | speaking of bootparam 5 :(... dtantsur|afk and bfournie: https://review.opendev.org/757198 should do the trick.... I think. | 23:31 |
| patchbot | patch 757198 - ironic - IPMI: Handle vendor set boot device differences - 2 patch sets | 23:31 |
| *** pmannidi has quit IRC | 23:33 | |
| *** pmannidi has joined #openstack-ironic | 23:33 | |
| *** hoonetorg has joined #openstack-ironic | 23:34 | |
| *** tosky has quit IRC | 23:40 | |
| *** Goneri has quit IRC | 23:48 | |
| *** k_mouza has joined #openstack-ironic | 23:53 | |
| *** k_mouza has quit IRC | 23:58 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!