| *** livelace has joined #openstack-ironic | 00:02 | |
| *** livelace has quit IRC | 00:12 | |
| openstackgerrit | yuanliu proposed openstack/ironic master: If the [conductor]XXX_timeout is less than 0，disable periodic task https://review.opendev.org/723795 | 01:05 |
|---|---|---|
| openstackgerrit | yuanliu proposed openstack/ironic master: If the "[conductor]XXX_timeout" is less than 0，disable periodic task https://review.opendev.org/723795 | 01:06 |
| openstackgerrit | yuanliu proposed openstack/ironic master: If the "[conductor]XXX_timeout" is less than 0，disable periodic task https://review.opendev.org/723795 | 01:08 |
| *** stevebaker has quit IRC | 01:18 | |
| *** yaawang has quit IRC | 01:35 | |
| *** yaawang has joined #openstack-ironic | 01:36 | |
| *** stevebaker has joined #openstack-ironic | 01:51 | |
| *** ricolin_ has joined #openstack-ironic | 01:54 | |
| *** ricolin_ has quit IRC | 03:25 | |
| *** uzumaki has quit IRC | 03:35 | |
| *** uzumaki has joined #openstack-ironic | 03:37 | |
| SpamapS | TheJulia: aw I missed your IRC ping because I've kind of been ignoring le IRC. :-P | 04:14 |
| *** ricolin has quit IRC | 05:22 | |
| *** yolanda has joined #openstack-ironic | 06:18 | |
| *** michchap has joined #openstack-ironic | 06:22 | |
| *** Qianbiao has joined #openstack-ironic | 06:38 | |
| arne_wiebalck | Good morning, ironic! | 06:57 |
| arne_wiebalck | TheJulia: Yes, but we do not use Ironic's tfp infra, but point to our own central PXE/tftp infrastructure. | 06:59 |
| arne_wiebalck | *tftp | 06:59 |
| arne_wiebalck | TheJulia: force_raw_images is not set | 07:08 |
| arne_wiebalck | TheJulia: not sure what is the default | 07:08 |
| arne_wiebalck | TheJulia: what about this one: parallel_image_downloads | 07:09 |
| arne_wiebalck | TheJulia: Seems there is already some means to throttle? | 07:09 |
| iurygregory | good morning arne_wiebalck and Ironic o/ | 07:16 |
| arne_wiebalck | hey iurygregory o/ | 07:34 |
| *** rpittau|afk is now known as rpittau | 07:36 | |
| rpittau | good morning ironic! o/ | 07:36 |
| *** uzumaki has quit IRC | 07:37 | |
| iurygregory | morning rpittau o/ | 07:42 |
| rpittau | hey iurygregory :) | 07:42 |
| *** lucasagomes has joined #openstack-ironic | 07:56 | |
| *** dtantsur|afk is now known as dtantsur | 08:04 | |
| rpittau | dtantsur|afk: you were asking for different distro support for devstack, centos8 was added -> https://review.opendev.org/726647 (haven't tested it yet) | 08:04 |
| patchbot | patch 726647 - devstack (stable/ussuri) - CentOS 8 support - 2 patch sets | 08:04 |
| dtantsur | morning ironic | 08:04 |
| dtantsur | w00t! | 08:04 |
| rpittau | hey dtantsur :) | 08:04 |
| *** ericlei has joined #openstack-ironic | 08:06 | |
| dtantsur | arne_wiebalck: commented on https://storyboard.openstack.org/#!/story/2007646. I don't think I like a generic reset-state API, to be honest. I'd rather fix any missing transitions we have. | 08:08 |
| dtantsur | and if we're fine with letting people bypass cleaning, maybe we allow setting node.automated_clean=False? | 08:10 |
| arne_wiebalck | dtantsur: I think the main transition we want is error->"something which does not require direct DB manipulation" | 08:11 |
| dtantsur | arne_wiebalck: you can use "deleted" on "error", no? | 08:12 |
| dtantsur | at least according to the state machine? | 08:12 |
| *** ericlei has quit IRC | 08:12 | |
| * arne_wiebalck has a deja-vu deja-vu | 08:12 | |
| arne_wiebalck | dtantsur: the command would be which one? | 08:13 |
| dtantsur | `openstack baremetal node undeploy` | 08:13 |
| arne_wiebalck | ok, I don't think I ever tried this on error | 08:14 |
| arne_wiebalck | if this works, we covered at least my point 100% | 08:14 |
| dtantsur | our commands/transitions don't seem discoverable enough indeed | 08:14 |
| arne_wiebalck | we discussed this one exactly, hence the double dja-vu | 08:14 |
| dtantsur | I wonder what we could do to improve that | 08:14 |
| arne_wiebalck | deja -vu | 08:15 |
| dtantsur | heh | 08:15 |
| dtantsur | arne_wiebalck: okay, so what did you try? which options seemed obvious to you? | 08:15 |
| arne_wiebalck | none, I was looking for something that would reset the state :-) | 08:15 |
| *** akahat has quit IRC | 08:15 | |
| *** SpamapS has quit IRC | 08:15 | |
| arne_wiebalck | undeploy does not sound like fixing nodes in error | 08:16 |
| arne_wiebalck | esp. as the node was not deployed, deployment failed | 08:16 |
| *** SpamapS has joined #openstack-ironic | 08:16 | |
| arne_wiebalck | I see now how this nicely includes cleaning | 08:17 |
| dtantsur | so, I'm pondering smth like `openstack baremetal node recover` which would apply the necessary transition | 08:17 |
| dtantsur | yeah | 08:17 |
| arne_wiebalck | sounds like sth I might have found | 08:18 |
| arne_wiebalck | ;) | 08:18 |
| dtantsur | arne_wiebalck: may I edit your your RFE to reflect this discussion and some other ideas we talked about on Friday? | 08:19 |
| arne_wiebalck | oh, sure! | 08:19 |
| *** hjensas|afk has quit IRC | 08:20 | |
| *** alexmcleod has joined #openstack-ironic | 08:22 | |
| gudrutis2 | Morning all | 08:25 |
| dtantsur | arne_wiebalck: how does it look now? https://storyboard.openstack.org/#!/story/2007646 | 08:30 |
| dtantsur | morning gudrutis2 | 08:30 |
| dtantsur | arne_wiebalck: next, I'm thinking about aborting `cleaning` and `deploying`, but these are tough | 08:31 |
| dtantsur | it's not hard to break a lock and update the state, but how to stop conductor from doing whatever it's doing now? | 08:31 |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic stable/ussuri: Add timeout and retries to JSON RPC client https://review.opendev.org/726753 | 08:33 |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic stable/train: Add timeout and retries to JSON RPC client https://review.opendev.org/726754 | 08:33 |
| arne_wiebalck | dtantsur: very nice, thank you! | 08:35 |
| *** hjensas has joined #openstack-ironic | 08:35 | |
| gudrutis2 | dtantsur: I have a question about our bellowed introspection rules. If I have an array of disk, can I count them and check the number in the condition? | 08:36 |
| arne_wiebalck | dtantsur: I checked my notes: we used undeploy for ACTIVE nodes without an instance, not for nodes in ERROR. | 08:36 |
| dtantsur | gudrutis2: I don't remember from the top of my head, sorry | 08:37 |
| *** derekh has joined #openstack-ironic | 08:37 | |
| * dtantsur has found https://storyboard.openstack.org/#!/story/2003158 and O_o | 08:41 | |
| *** k_mouza has joined #openstack-ironic | 08:43 | |
| *** livelace has joined #openstack-ironic | 08:44 | |
| iurygregory | morning dtantsur o/ | 08:45 |
| openstackgerrit | Riccardo Pittau proposed openstack/ironic-python-agent-builder master: [WIP] Build tinyipa on focal https://review.opendev.org/725799 | 08:53 |
| openstackgerrit | Riccardo Pittau proposed openstack/ironic-inspector master: Convert jobs to dib https://review.opendev.org/712516 | 08:54 |
| openstackgerrit | Riccardo Pittau proposed openstack/python-ironic-inspector-client master: Convert job to dib https://review.opendev.org/718698 | 08:55 |
| *** ericlei has joined #openstack-ironic | 09:08 | |
| openstackgerrit | Riccardo Pittau proposed openstack/networking-baremetal master: Convert networking-baremetal job to dib https://review.opendev.org/718697 | 09:09 |
| openstackgerrit | Riccardo Pittau proposed openstack/networking-baremetal master: Convert networking-baremetal job to dib https://review.opendev.org/718697 | 09:10 |
| *** ericlei12 has joined #openstack-ironic | 09:10 | |
| openstackgerrit | Riccardo Pittau proposed openstack/ironic-inspector master: [WIP] Use latest version of python construct https://review.opendev.org/724822 | 09:12 |
| *** ericlei has quit IRC | 09:13 | |
| *** sshnaidm|off is now known as sshnaidm | 09:15 | |
| *** ricolin has joined #openstack-ironic | 09:20 | |
| *** ericlei12 has quit IRC | 09:25 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic master: [WIP] Replace retrying with tenacity https://review.opendev.org/376574 | 09:33 |
| *** priteau has joined #openstack-ironic | 09:44 | |
| *** hjensas is now known as hjensas|afk | 09:46 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic-python-agent-builder master: Install linux-firmware in DIB images https://review.opendev.org/726769 | 09:54 |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic-python-agent-builder master: Install linux-firmware in DIB images https://review.opendev.org/726769 | 09:55 |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic-lib master: image_convert: retry resource unavailable and make RLIMIT configurable https://review.opendev.org/726378 | 10:09 |
| *** rpittau is now known as rpittau|bbl | 10:15 | |
| openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/ironic-tempest-plugin master: Add standalone redfish jobs https://review.opendev.org/720675 | 10:57 |
| openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/ironic-tempest-plugin master: Add standalone redfish jobs https://review.opendev.org/720675 | 10:59 |
| *** iurygregory has quit IRC | 11:37 | |
| openstackgerrit | Merged openstack/ironic stable/ussuri: Native zuulv3 grenade job for ironic https://review.opendev.org/726643 | 11:38 |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic-python-agent-builder master: Install linux-firmware in DIB images https://review.opendev.org/726769 | 11:43 |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic-python-agent-builder master: Install linux-firmware in DIB images https://review.opendev.org/726769 | 11:45 |
| *** rpittau|bbl is now known as rpittau | 11:58 | |
| *** iurygregory has joined #openstack-ironic | 11:58 | |
| * iurygregory is back, the internet company came to change the router and modem XD | 11:59 | |
| rpittau | iurygregory: can you tell them to come and change mine too please? :P | 11:59 |
| iurygregory | rpittau, sure, UPC was bought by Vodafone and they want to change the equipment, I can call your provider if it helps =) | 12:00 |
| *** rh-jelabarre has joined #openstack-ironic | 12:00 | |
| openstackgerrit | Merged openstack/ironic stable/ussuri: Silence debug messages from oslo_messaging https://review.opendev.org/726633 | 12:01 |
| openstackgerrit | Merged openstack/ironic-inspector master: Convert jobs to dib https://review.opendev.org/712516 | 12:06 |
| arne_wiebalck | So nice when Ironic deploys on a disk which the BIOS does not consider (or cannot even see) for booting ... | 12:09 |
| dtantsur | Oo | 12:09 |
| iurygregory | *magic* | 12:09 |
| dtantsur | iurygregory: vodafone is buying everything, our provider (unitymedia) also belongs to them | 12:10 |
| iurygregory | dtantsur, wow =O | 12:10 |
| TheJulia | arne_wiebalck: force_raw_images defaults to true, what is parllel_image_downloads set to? | 12:12 |
| arne_wiebalck | TheJulia: also not touched, so default | 12:12 |
| *** akahat has joined #openstack-ironic | 12:12 | |
| arne_wiebalck | boot issue: the node has local drives plus an enclosure, but some of the disks in the enclosure are smaller than the disks in the node ... | 12:13 |
| dtantsur | morning TheJulia | 12:13 |
| dtantsur | arne_wiebalck: so, root device hints needed? | 12:14 |
| arne_wiebalck | ... so I guess Ironic happily picked one of the small ones in the enclosure, but then the BIOS goes: what would you like me to boot from? | 12:14 |
| arne_wiebalck | dtantsur: yes, this is what I have done now, worked in the past :) | 12:14 |
| arne_wiebalck | dtantsur: crossing fingers it works here as well ... | 12:14 |
| dtantsur | We need to somehow make it clear that root device hints are highly recommended for machines with different disks | 12:15 |
| * iurygregory thinks rpittau is happy since https://review.opendev.org/712516 merged | 12:16 | |
| patchbot | patch 712516 - ironic-inspector - Convert jobs to dib (MERGED) - 18 patch sets | 12:16 |
| rpittau | was about time | 12:16 |
| rpittau | :)_ | 12:16 |
| rpittau | still have 3 to go | 12:16 |
| *** priteau has quit IRC | 12:16 | |
| *** bfournie has left #openstack-ironic | 12:17 | |
| openstackgerrit | Riccardo Pittau proposed openstack/networking-baremetal master: Convert networking-baremetal job to dib https://review.opendev.org/718697 | 12:23 |
| arne_wiebalck | dtantsur: usually the arrays have larger/slower drives, so not often an issue | 12:24 |
| arne_wiebalck | dtantsur: this time the node has a h/w RAID (so the "disk" is larger) and the enclosure has some additional very small and fast devices | 12:25 |
| arne_wiebalck | dtantsur: what would be cool would be if Ironic would prefer local drives over ones in an enclosure | 12:26 |
| *** hjensas|afk is now known as hjensas | 12:26 | |
| arne_wiebalck | dtantsur: or even configurable | 12:26 |
| dtantsur | arne_wiebalck: can we detect that? | 12:28 |
| dtantsur | the default algorithm is bad, but we've been unable to find anything that will satisfy more people | 12:28 |
| arne_wiebalck | dtantsur: I think the default is not too bad | 12:29 |
| arne_wiebalck | dtantsur: it works for the vast maority | 12:29 |
| arne_wiebalck | dtantsur: we have some code to count enclosures, so it should be doable to see which disks are where | 12:30 |
| dtantsur | I'd not object to a patch that puts them behind in the priority list | 12:30 |
| dtantsur | if we can detect them reliably | 12:30 |
| arne_wiebalck | dtantsur: yeah ... not sure about this later point | 12:30 |
| dtantsur | false negatives are fine, I'm worried about false positives | 12:30 |
| dtantsur | if we can rule out the latter it will be a big improvement already | 12:31 |
| *** tkajinam has quit IRC | 12:31 | |
| arne_wiebalck | hmm, yeah, I can have a look | 12:31 |
| arne_wiebalck | do the root device hints provide sth already which would help with this? | 12:32 |
| dtantsur | I doubt it | 12:33 |
| arne_wiebalck | scsi address maybe | 12:33 |
| TheJulia | can change if bus init order changes | 12:33 |
| TheJulia | or drive rload order | 12:34 |
| arne_wiebalck | hmm, yeah, but the current "/dev/sda" suffers from the very same issue | 12:34 |
| * TheJulia needs a caffeine IV | 12:35 | |
| *** bfournie has joined #openstack-ironic | 12:35 | |
| arne_wiebalck | hints can be ANDed, right? | 12:35 |
| arne_wiebalck | yes | 12:36 |
| arne_wiebalck | does not help much if the devices are behind a RAID controller | 12:37 |
| iurygregory | arne_wiebalck, I'm wondering if you answered yourself =) | 12:41 |
| arne_wiebalck | yes :) | 12:42 |
| iurygregory | good =) | 12:42 |
| * arne_wiebalck is not sure if this is a good thing ... | 12:42 | |
| iurygregory | if your answer is correct it's a good thing =) | 12:42 |
| openstackgerrit | Riccardo Pittau proposed openstack/ironic-python-agent-builder master: [WIP] Build tinyipa on focal https://review.opendev.org/725799 | 12:56 |
| openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/ironic-inspector master: Merge jobs https://review.opendev.org/726121 | 12:56 |
| dtantsur | folks, I may need some brainstorming for the ironic-inspector uwsgi issue | 12:58 |
| rpittau | dtantsur: sure thing | 12:58 |
| dtantsur | note that I accept "just remove oslo.msg and use JSON RPC" as a valid answer :) | 12:58 |
| dtantsur | the situation is, we're seeing pretty regular failures https://zuul.openstack.org/builds?job_name=ironic-inspector-non-standalone-tempest | 12:58 |
| dtantsur | inspection fails because ironic received HTTP 502 when accessing inspector | 12:59 |
| dtantsur | looks like https://zuul.openstack.org/build/2b7625959ac641b2a1f8ae476e0454cf/log/controller/logs/screen-ir-cond.txt#1026 | 12:59 |
| openstackgerrit | Riccardo Pittau proposed openstack/ironic-python-agent-builder master: Build tinyipa on focal https://review.opendev.org/725799 | 13:00 |
| dtantsur | I cannot find anything particular in the inspector API logs, nor any difference from how ironic API is deployed | 13:00 |
| openstackgerrit | Merged openstack/ironic stable/train: Silence debug messages from oslo_messaging https://review.opendev.org/726634 | 13:00 |
| dtantsur | well, this is the only clue: https://zuul.openstack.org/build/2b7625959ac641b2a1f8ae476e0454cf/log/controller/logs/screen-ironic-inspector-api.txt#791 | 13:01 |
| dtantsur | the timing doesn't match well, however | 13:01 |
| *** iurygregory has quit IRC | 13:01 | |
| *** iurygregory has joined #openstack-ironic | 13:02 | |
| *** livelace has quit IRC | 13:04 | |
| *** livelace has joined #openstack-ironic | 13:04 | |
| *** kbaegis has joined #openstack-ironic | 13:04 | |
| *** kbaegis has quit IRC | 13:09 | |
| *** kbaegis has joined #openstack-ironic | 13:10 | |
| *** Goneri has joined #openstack-ironic | 13:21 | |
| *** zzzeek has quit IRC | 13:25 | |
| *** zzzeek has joined #openstack-ironic | 13:26 | |
| *** zzzeek has quit IRC | 13:26 | |
| *** zzzeek has joined #openstack-ironic | 13:27 | |
| *** rloo has joined #openstack-ironic | 13:34 | |
| *** kbaegis has quit IRC | 13:36 | |
| *** kbaegis has joined #openstack-ironic | 13:41 | |
| *** beekneemech is now known as bnemec | 13:47 | |
| *** tzumainn has joined #openstack-ironic | 13:47 | |
| *** kbaegis has quit IRC | 13:49 | |
| openstackgerrit | Riccardo Pittau proposed openstack/python-ironic-inspector-client master: Convert job to dib https://review.opendev.org/718698 | 13:55 |
| *** jdandrea has joined #openstack-ironic | 13:57 | |
| openstackgerrit | Verification of a change to openstack/ironic failed: Limit the number of ipmitool retries https://review.opendev.org/725954 | 14:00 |
| *** uzumaki has joined #openstack-ironic | 14:01 | |
| *** livelace has quit IRC | 14:04 | |
| *** cdearborn has joined #openstack-ironic | 14:09 | |
| dtantsur | rpittau: bad news, if we return linux-firmware to DIB images, we start running out of 2G of RAM :( | 14:12 |
| rpittau | dtantsur: I'm prone to think by experience that that is an issue on rabbitmq itself, it might require some tweaking on rabbitmq parameters | 14:12 |
| rpittau | oh gosh | 14:12 |
| dtantsur | we probably need to use 3G instead | 14:12 |
| TheJulia | how big are the images being generated? | 14:13 |
| dtantsur | 387M after re-adding | 14:13 |
| rpittau | well no alternative if we need that | 14:13 |
| dtantsur | https://zuul.opendev.org/t/openstack/build/f0abf4f8c5a74e46977eb7d8cd961099/log/job-output.txt#44295 | 14:13 |
| dtantsur | we've already got reports that without linux-firmware our images don't work on some bare metal machines | 14:14 |
| TheJulia | dtantsur: uncompressed? | 14:14 |
| dtantsur | TheJulia: compressed | 14:14 |
| TheJulia | yeah, what is the uncompressed value | 14:14 |
| dtantsur | I'm not sure how to figure it out, we don't record that in our jobs, I think | 14:14 |
| TheJulia | ok | 14:14 |
| dtantsur | cpio outputs 2160091 blocks | 14:15 |
| dtantsur | maybe somebody can make any sense out of it? | 14:15 |
| TheJulia | yeah, seeking in my braincells | 14:15 |
| rpittau | oO | 14:15 |
| dtantsur | probably * 512 | 14:15 |
| TheJulia | more like 1k if memory serves | 14:15 |
| rpittau | 2g and a half? roughly ? | 14:16 |
| TheJulia | if it is 512 | 14:16 |
| dtantsur | a bit more than 1G | 14:16 |
| TheJulia | then... 3GB should work | 14:16 |
| TheJulia | but barely | 14:16 |
| TheJulia | it may OOM if it tries to do anything super fancy in startup | 14:17 |
| dtantsur | 2G works with current 267M images | 14:17 |
| dtantsur | if we can fit 4G testing VMs into the CI, we can do that as well | 14:17 |
| *** dtantsur is now known as dtantsur|brb | 14:17 | |
| TheJulia | yeah, there, I think the formula is 2xcompressed size+50% | 14:18 |
| TheJulia | err | 14:18 |
| TheJulia | 2x uncompressed + 50% | 14:18 |
| iurygregory | I think we can go for 4GB | 14:23 |
| iurygregory | we are only creating 1 VM | 14:23 |
| iurygregory | not sure how infra will see this =) | 14:24 |
| TheJulia | honestly they will be unlikely to notice unless we start failing our jobs in general | 14:26 |
| openstackgerrit | Dhuldev Valekar proposed openstack/ironic master: DRAC: Added redfish management clean steps https://review.opendev.org/721593 | 14:28 |
| *** jhesketh has quit IRC | 14:35 | |
| *** uzumaki has quit IRC | 14:37 | |
| *** uzumaki has joined #openstack-ironic | 14:37 | |
| iurygregory | yay for CI | 14:37 |
| iurygregory | a lot of "E: Unable to locate package <name>" XD | 14:37 |
| TheJulia | ugh | 14:38 |
| TheJulia | did the image suddenly change from bionic? Or is the mirror just missing packages? | 14:39 |
| TheJulia | i.e. 404s | 14:39 |
| *** kaifeng has joined #openstack-ironic | 14:43 | |
| openstackgerrit | Riccardo Pittau proposed openstack/networking-baremetal master: Convert networking-baremetal job to dib https://review.opendev.org/718697 | 14:46 |
| *** zaneb has quit IRC | 14:46 | |
| rpittau | just a bunch of connection timeout everywhere | 14:47 |
| *** zaneb has joined #openstack-ironic | 14:47 | |
| openstackgerrit | Riccardo Pittau proposed openstack/ironic master: [WIP] Fix grub2 pxe job with native bionic ovmf https://review.opendev.org/716889 | 14:51 |
| iurygregory | well I hope infra will send an email when they are going to switch to focal LOL | 14:53 |
| *** aedc has joined #openstack-ironic | 14:54 | |
| kaifeng | focal is a new cloud provider? | 14:55 |
| rpittau | kaifeng: ubuntu focal LTS 20.04 :) | 14:56 |
| *** sshnaidm is now known as sshnaidm|afk | 14:57 | |
| kaifeng | ouch.. I haven't tried 20.04 yet, last week I tried to install it into my macbook mid2009 and it failed to boot :( | 14:57 |
| *** dtantsur|brb is now known as dtantsur | 14:59 | |
| *** stendulker has joined #openstack-ironic | 14:59 | |
| rpittau | iurygregory: the patch to add the new nodeset is still WIP, so I guess we have some time | 14:59 |
| iurygregory | rpittau, well I hope we will have time to solve the problems =) | 15:00 |
| rpittau | I'm much interested in building tinyipa with tinycore 11.x, that's why the tests | 15:00 |
| *** livelace has joined #openstack-ironic | 15:00 | |
| TheJulia | #startmeeting ironic | 15:00 |
| openstack | Meeting started Mon May 11 15:00:18 2020 UTC and is due to finish in 60 minutes. The chair is TheJulia. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| TheJulia | o/ | 15:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
| *** openstack changes topic to " (Meeting topic: ironic)" | 15:00 | |
| iurygregory | o/ | 15:00 |
| rpittau | o/ | 15:00 |
| openstack | The meeting name has been set to 'ironic' | 15:00 |
| TheJulia | \o | 15:00 |
| kaifeng | o/ | 15:00 |
| stendulker | o/ | 15:00 |
| TheJulia | Good morning everyone! | 15:00 |
| erbarr | o/ | 15:00 |
| arne_wiebalck | o/ | 15:00 |
| rloo | o/ | 15:00 |
| TheJulia | Our agenda can be found on the wiki. | 15:01 |
| TheJulia | #link https://wiki.openstack.org/wiki/Meetings/Ironic#Agenda_for_next_meeting | 15:01 |
| ajya | o/ | 15:01 |
| TheJulia | #topic Announcements / Reminders | 15:01 |
| *** openstack changes topic to "Announcements / Reminders (Meeting topic: ironic)" | 15:01 | |
| TheJulia | Three items to note this week! | 15:01 |
| mgoddard | \o | 15:01 |
| rpioso | o/ | 15:02 |
| TheJulia | #info Victoria Priorities Document under discussion, please join that discussion in review! | 15:02 |
| dtantsur | o/ | 15:02 |
| TheJulia | #link https://review.opendev.org/#/c/720100/ | 15:02 |
| patchbot | patch 720100 - ironic-specs - WIP - Victoria Cycle Priorit(y|ies) - 1 patch set | 15:02 |
| *** aedc_ has joined #openstack-ironic | 15:02 | |
| *** aedc has quit IRC | 15:02 | |
| TheJulia | #info Baremetal Whitepaper effort will be holding it's third session on Tuesday May 12th, at 2PM UTC | 15:02 |
| TheJulia | #link https://cern.zoom.us/j/94248770580 | 15:02 |
| *** uzumaki has quit IRC | 15:03 | |
| TheJulia | #info PTG Topics etherpad is up for comments/additions/thoughts/crazy ideas. | 15:03 |
| TheJulia | #link https://etherpad.opendev.org/p/Ironic-VictoriaPTG-Planning | 15:03 |
| TheJulia | Does anyone have anything else to announce or remind us of this week? | 15:03 |
| * iurygregory doesn't | 15:05 | |
| * TheJulia goes and sees if we had any action items from last week | 15:05 | |
| TheJulia | No meeting related action items, so it seems like we could skip to reviewing subteam status. | 15:06 |
| dtantsur | ++ | 15:06 |
| * TheJulia wonders if we need to file a "Take over the world" or "world domination" action item every week. | 15:06 | |
| dtantsur | won't hurt at least, will it? | 15:06 |
| TheJulia | It will be more words to type every monday morning :) | 15:07 |
| iurygregory | ++ | 15:07 |
| iurygregory | I can type the action if needed | 15:07 |
| TheJulia | Okay, well then I guess we'll move on! | 15:07 |
| TheJulia | #topic Review sub-team status reports | 15:08 |
| *** openstack changes topic to "Review sub-team status reports (Meeting topic: ironic)" | 15:08 | |
| TheJulia | #link https://etherpad.opendev.org/p/IronicWhiteBoard | 15:08 |
| -openstackstatus- NOTICE: Our CI mirrors in OVH BHS1 and GRA1 regions were offline between 12:55 and 14:35 UTC, any failures there due to unreachable mirrors can safely be rechecked | 15:08 | |
| TheJulia | \o/ | 15:08 |
| iurygregory | \o/ | 15:08 |
| dtantsur | well, at least they're back :) | 15:08 |
| rajinir | o/ | 15:08 |
| TheJulia | Starting around line 220 in the etherpad | 15:08 |
| TheJulia | Any thoughts on logging the wsme changes on the items to review? | 15:10 |
| dtantsur | +1 | 15:10 |
| rpittau | yeah | 15:10 |
| iurygregory | ++ | 15:10 |
| TheJulia | k, if someone wants to add some of those links now it would be awesome | 15:10 |
| TheJulia | I guess we can nuke the software raid item? | 15:11 |
| arne_wiebalck | yes | 15:12 |
| *** aedc_ has quit IRC | 15:12 | |
| TheJulia | done! | 15:12 |
| iurygregory | Old items from the Grenade work we want to keep track or I can remove old things? =) | 15:12 |
| TheJulia | iurygregory: remove the old things! | 15:12 |
| iurygregory | TheJulia, sure | 15:12 |
| dtantsur | usually stuff older than 2 weeks can be safely removed | 15:12 |
| dtantsur | (unless it's still up-to-date) | 15:12 |
| TheJulia | ++ | 15:13 |
| iurygregory | dtantsur, ok =) | 15:13 |
| TheJulia | Looks like the v6 ci jobs needs a rebase | 15:13 |
| iurygregory | I think we are done with Python3 | 15:13 |
| iurygregory | wdyt rpittau ? | 15:13 |
| iurygregory | I think we can remove the topic =) | 15:14 |
| rpittau | we can remove that yes | 15:14 |
| *** aedc has joined #openstack-ironic | 15:15 | |
| TheJulia | Looks like two of the dib changes need reviews | 15:15 |
| rpittau | yes, please, they're the last 2 | 15:16 |
| TheJulia | Adding to the list | 15:16 |
| *** riuzen has joined #openstack-ironic | 15:17 | |
| TheJulia | I wonder if there is any interest on deployment state callbacks with nova | 15:17 |
| TheJulia | I guess that really depends on the number of new deployments being performed against baremetal | 15:18 |
| *** zbitter has joined #openstack-ironic | 15:18 | |
| arne_wiebalck | And the power state callbacks were quite some work already. | 15:19 |
| dtantsur | could be a huge scalability improvement | 15:19 |
| dtantsur | wait for CERN to start hitting problems with periodic sync? :-P | 15:19 |
| *** zbitter has quit IRC | 15:19 | |
| TheJulia | Yeah, I'd just prefer it be driven by those actually actively encountering it | 15:19 |
| *** zbitter has joined #openstack-ironic | 15:19 | |
| arne_wiebalck | :) | 15:20 |
| TheJulia | Anyway, shall we proceed to priorities for the coming week? | 15:20 |
| dtantsur | ++ | 15:21 |
| *** zaneb has quit IRC | 15:21 | |
| TheJulia | #topic Priorities for the coming week | 15:21 |
| *** openstack changes topic to "Priorities for the coming week (Meeting topic: ironic)" | 15:21 | |
| TheJulia | #link https://etherpad.opendev.org/p/IronicWhiteBoard | 15:21 |
| dtantsur | can we get the release model spec there please? | 15:22 |
| TheJulia | dtantsur: please add it | 15:22 |
| dtantsur | done | 15:23 |
| rpittau | TheJulia: the ci failure on the dib conversion patch was because the timeout | 15:23 |
| dtantsur | TheJulia: https://review.opendev.org/#/c/688299/ needs removing -2 (not urgent) | 15:24 |
| patchbot | patch 688299 - python-ironicclient - Add `network_data` ironic node attribute support - 9 patch sets | 15:24 |
| TheJulia | Thanks | 15:24 |
| TheJulia | Done | 15:24 |
| TheJulia | That looks good to me, but does anyone see anything we're missing or that needs to be added? | 15:25 |
| dtantsur | nope, looks fine | 15:26 |
| rpittau | lgtm :) | 15:26 |
| TheJulia | dtantsur: what about timeouts/retries to jsonrpc? | 15:26 |
| dtantsur | mm, yeah, there are stable backports to merge | 15:26 |
| * dtantsur is sleepy today | 15:27 | |
| iurygregory | it's monday =) | 15:27 |
| TheJulia | it is a monday | 15:27 |
| dtantsur | oh, https://review.opendev.org/725867 another fun one | 15:27 |
| patchbot | patch 725867 - ironic - Mark more configuration options as reloadable - 2 patch sets | 15:27 |
| dtantsur | and https://review.opendev.org/#/c/726378/ could use opinions | 15:28 |
| patchbot | patch 726378 - ironic-lib - image_convert: retry resource unavailable and make... - 3 patch sets | 15:28 |
| * dtantsur loves his own definition of "nope" | 15:28 | |
| iurygregory | hehehe | 15:28 |
| dtantsur | it's not just Monday, it's Monday after night when a storm tried to make a music instrument out of our balcony | 15:29 |
| iurygregory | wow | 15:29 |
| kaifeng | an idea for 726378, maybe perform reduced memory limit on retry? | 15:29 |
| dtantsur | kaifeng: how will reducing help? if anything, it will increase the chance of failing | 15:30 |
| *** zbitter is now known as zaneb | 15:30 | |
| dtantsur | anyway, let's discuss on the patch | 15:30 |
| kaifeng | if memory is low, keep retry with the same resource limit seems identical | 15:31 |
| kaifeng | np | 15:31 |
| TheJulia | I looked at the source of qemu-img, and it dynamically scales as it assembles, so stepping down the amount of ram may not help if it truly needs to map out something basically fragmeneted | 15:32 |
| TheJulia | fragmeneted | 15:32 |
| TheJulia | Which kind of caused me to think of https://review.opendev.org/#/c/726483/ as a guard so we hopefully avoid OOM conditions | 15:33 |
| patchbot | patch 726483 - ironic - WIP: Guard conductor from consuming all of the ram - 1 patch set | 15:33 |
| TheJulia | Anyway, the list looks good to me. Are we good to proceed? | 15:33 |
| dtantsur | ++ | 15:33 |
| iurygregory | ++ | 15:33 |
| kaifeng | ++ | 15:34 |
| TheJulia | We have no explicit topics. I believe we've also basically covered the SIG item, unless there is more arne_wiebalck ? | 15:34 |
| TheJulia | Which I guess takes us to RFE Review | 15:34 |
| dtantsur | I actually did have a topic.. | 15:34 |
| arne_wiebalck | nope | 15:34 |
| * dtantsur not sure where it went | 15:34 | |
| dtantsur | It was about the new release model proposal, maybe we should just ask people to review it | 15:34 |
| TheJulia | dtantsur: I moved it to annoucements earlier, unless you really think there is something to discuss right now? | 15:35 |
| dtantsur | ah, ok | 15:35 |
| dtantsur | no, I think it requires careful reading | 15:35 |
| dtantsur | I just hope people do read it :) | 15:35 |
| TheJulia | Okay, then RFE review it is! | 15:36 |
| TheJulia | #topic RFE Review | 15:36 |
| *** openstack changes topic to "RFE Review (Meeting topic: ironic)" | 15:36 | |
| TheJulia | Looks like we have two items that have been proposed, would anyone like to introduce them? | 15:37 |
| dtantsur | yeah | 15:37 |
| dtantsur | They're not mine, but I've added them, soo | 15:37 |
| dtantsur | #link https://storyboard.openstack.org/#!/story/2007646 More convenient state transitions in case of failures | 15:37 |
| dtantsur | this came from the Friday's SPUC (one of the action items) | 15:37 |
| dtantsur | two pretty minor additions that may potentially make newcomers' life easier | 15:37 |
| iurygregory | this one sounds interesting =) | 15:38 |
| TheJulia | seems reasonable, at least from a 10,000 foot view | 15:39 |
| kaifeng | we have just discussed this kind of guard today :) | 15:39 |
| dtantsur | to be clear, it doesn't add anything new, just aliases for existing things | 15:39 |
| dtantsur | but ones that are hopefully easier to discover and remember | 15:39 |
| dtantsur | I had another RFE with aliases for provisioning verbs, but I've lost it in storyboard.... | 15:39 |
| dtantsur | ... found it, thank you firefox | 15:39 |
| dtantsur | #link https://storyboard.openstack.org/#!/story/2007551 An RFE in a similar spirit with 2 more actions | 15:40 |
| TheJulia | +1000 | 15:41 |
| dtantsur | both are pretty easy to implement. so, while I can do it, I encourage anyone who want to get into ironic development to take them | 15:41 |
| *** livelace has quit IRC | 15:41 | |
| dtantsur | any objections to either of these two? | 15:41 |
| iurygregory | Can I take the second? =) | 15:42 |
| dtantsur | iurygregory: sure, assign yourself | 15:42 |
| TheJulia | no objections at all | 15:42 |
| iurygregory | done =) | 15:42 |
| *** livelace has joined #openstack-ironic | 15:42 | |
| kaifeng | no objection, in addition I'd like to seek a transition from deploy wait to deploy failed | 15:42 |
| dtantsur | kaifeng: mmm, interesting, maybe we should make 'abort' do that? | 15:43 |
| dtantsur | rather than being an alias for 'deleted'? | 15:43 |
| dtantsur | (this is re 1st RFE action #2) | 15:43 |
| *** uzumaki has joined #openstack-ironic | 15:43 | |
| rpittau | abort suggests a return to a precedent state though | 15:43 |
| rloo | for 2007646, (sorry if this is bikeshedding', but I wonder if 'recover' is the right word. this is just moving the node's provision state, right? | 15:43 |
| rloo | oh wait. what does 'initial proposal (obsolete)" mean? | 15:43 |
| kaifeng | dtantsur: quite alike, there is no way to cancel we can only wait it fails itself. | 15:43 |
| dtantsur | rloo: the initial text of the RFE as filed by arne_wiebalck | 15:44 |
| rloo | wait. i have to actually READ it... | 15:44 |
| rpittau | maybe call it explicitely 'fail' ? | 15:44 |
| dtantsur | rpittau: we even have a 'fail' action, we just don't expose it | 15:44 |
| dtantsur | rloo: 'recover' is based on the questions I receive pretty often: "How do I recover a node from the error state?" and similar | 15:45 |
| dtantsur | I agree that it's far from being perfect | 15:45 |
| kaifeng | inspector use abort to fail a inspection, so maybe it suits for ironic | 15:45 |
| dtantsur | abort on clean wait causes clean failed | 15:45 |
| dtantsur | yeah, I agree, abort on deploy wait should end up in deploy failed | 15:46 |
| dtantsur | updated https://storyboard.openstack.org/#!/story/2007646 | 15:47 |
| kaifeng | looks like i misundertood the recover, so it just moves node out of a failed state, do we care the clean up too? | 15:47 |
| rloo | i'm confused. in the rfe, it sez 'a node can be recovered by applying the deleted transition'. i don't think that's what the initial proposal is. or maybe i misunderstand. | 15:47 |
| dtantsur | the proposed 'recover' action is an alias for whatever action moved a failed node to a non-failed state | 15:48 |
| dtantsur | e.g. deploy failed -> (deleted) -> available | 15:48 |
| dtantsur | based on the current state and target_provision_state | 15:48 |
| dtantsur | it won't have any new logic behind it | 15:48 |
| rloo | i don't think that's what was desired. i think it is more like 'deploying' -> error, but the user wants the node to go back to active state. | 15:49 |
| rloo | more like nova's reset, i forgot the exact command. | 15:49 |
| dtantsur | I'd quite like a 'retry' action | 15:49 |
| kaifeng | oh, so it's an alias to avoid the old word which is kind of misleading, but maybe it doen't help for non- new comers :) | 15:49 |
| dtantsur | arne_wiebalck pointed out that "undeploy" is not an obvious way to make a failed node available again | 15:50 |
| dtantsur | btw do we have an agreement on the 2nd half, i.e. supporting abort on 'deploy wait'? | 15:50 |
| arne_wiebalck | dtantsur: yes | 15:50 |
| rloo | abort works on 'clean failed' and 'inspect failed' ? | 15:51 |
| dtantsur | rloo: yes | 15:51 |
| dtantsur | wait | 15:51 |
| dtantsur | on 'wait' | 15:51 |
| JayF | abort is to get you from *_wait -> * failed | 15:51 |
| dtantsur | abort works on 'clean wait' and 'inspect wait', but not on 'deploy wait' | 15:51 |
| TheJulia | Quick note, we only have about 8 minutes left. | 15:51 |
| arne_wiebalck | rloo: the original idea was to have reset-state command, but maybe that is too big of a hammer | 15:52 |
| rloo | am looking at our state xsition diagram, and don't see 'abort' from 'clean failed': https://docs.openstack.org/ironic/latest/_images/states.svg | 15:52 |
| TheJulia | arne_wiebalck: but the purpose of a big hammer is actually what is needed | 15:52 |
| JayF | clean failed is the target state after an abort | 15:52 |
| *** kbaegis has joined #openstack-ironic | 15:52 | |
| JayF | clean failed is restored by going manage->provide | 15:52 |
| JayF | which puts it in mangeable and restarts cleaning | 15:52 |
| dtantsur | TheJulia: I'm not convinced the big hammer is needed if we get other things right | 15:52 |
| dtantsur | a good thing about editing the database is that people know they're in danger.. | 15:53 |
| TheJulia | dtantsur: that presumes we can see and handle all edge cases | 15:53 |
| dtantsur | that's our mission :) | 15:53 |
| JayF | dtantsur: that's a really unreasonable answer for the real world, IMO | 15:53 |
| TheJulia | we already... for a very long time now, have had people delete notes completely as their big hammer... except that is also the last thing we want them to ever do | 15:53 |
| dtantsur | JayF: that's why we have API and any levels of protection | 15:53 |
| rloo | downstream we've seen where the node is in a wedged state. i don't recall the details now. | 15:54 |
| dtantsur | trust me, your position on "don't let people disable cleaning" is not shared by a lot of field folks either :) | 15:54 |
| JayF | dtantsur: and we made that configurable :) | 15:54 |
| dtantsur | and people just disabled the heck out if it | 15:54 |
| JayF | dtantsur: real talk, not from current job, but I've seen manual DB edits cause downtime when someone fat fingered something | 15:54 |
| JayF | dtantsur: I don't think that's a reasonable alternative | 15:55 |
| rloo | i think this discussion might be more relevant if we provided details wrt when a node gets wedged. (haven't had time to dig into that) | 15:55 |
| dtantsur | the edge case I don't know how to handle (a PTG topic) is how to break out from stuck "deploying" | 15:55 |
| TheJulia | rloo: ++ | 15:55 |
| dtantsur | but just editing it to 'available' may get us into trouble | 15:55 |
| TheJulia | dtantsur: ++ | 15:55 |
| rloo | i don't think our usecase was to move a node to available. | 15:55 |
| arne_wiebalck | rloo: one example is the conductor crashing during deploy | 15:56 |
| arne_wiebalck | rloo: this leaves the nodes in error | 15:56 |
| dtantsur | error is not a stuck state | 15:56 |
| rloo | it was that a bm node has an instance. maybe it was rebuilding and something happened in the code (I don't recall). the node is still 'active' (from nova sense) but we can't update the ironic state. | 15:56 |
| rloo | ie, i think we can put the instance into active in nova, but no equiv in ironic. | 15:56 |
| dtantsur | my objection is based on the fact that we don't know what will happen to a node if we just edit the state in the DB, bypassing locks, cleaning, and so on | 15:57 |
| arne_wiebalck | rloo: in nova and cinder you can set the state to whatever the admin thinks is right | 15:57 |
| rloo | dtantsur: error isn't a stuck state BUT there isn't any way to put that ironic node into 'active' :-( | 15:57 |
| dtantsur | rloo: 'deleted' | 15:57 |
| TheJulia | rloo: that is actually the adopt feature, except it only starts from ?two? possible states, not later on in the ownership of the node | 15:57 |
| dtantsur | which is very obscure, hence the 'recover' proposal | 15:57 |
| rloo | no. deleted won't put it into active, it'll make it available. | 15:57 |
| JayF | dtantsur: I'd assume any such API would cancel locks and such as well, although that is pretty complex | 15:57 |
| dtantsur | ah, sorry | 15:58 |
| rloo | or did something change recently? | 15:58 |
| dtantsur | rloo: how do you imagine putting a half-deleted node back to active? | 15:58 |
| dtantsur | it might have had its VIFs already removed.. | 15:58 |
| rloo | dtantsur: how does nova put a half-deployed (NOT DELETED) node back to active? | 15:58 |
| rloo | dtantsur: it relies on the admin knowing what they are doing. | 15:58 |
| TheJulia | Everyone, we have two minutes left and this really seems like a topic that needs higher bandwidth discussion | 15:58 |
| rloo | dtantsur: we (me anyway) are not talking about deleting anything. | 15:59 |
| TheJulia | and an understanding of failure cases that people presentlly encounter | 15:59 |
| dtantsur | rloo: 'error' happens when deleting fails | 15:59 |
| rloo | ++ agree with Julia. | 15:59 |
| rloo | we're talking about (I am) rebuilding. | 15:59 |
| dtantsur | and 'rebuild' can recover it back to 'active' | 15:59 |
| dtantsur | note that deleting->(fail)->error is the only way to get to error | 15:59 |
| kaifeng | some *-ing is transitional states and there is no way to quit, restarting conductor can recover the state but I believe it would be nice to have some guarding task. | 16:00 |
| rloo | i don't really think this discussion is productive. i think we need real use cases. | 16:00 |
| TheJulia | s/use/failure/ | 16:00 |
| rloo | cuz we're mixing deploy/delete/error/failure/active/available. | 16:00 |
| TheJulia | Anyway, does anyone have anything else too discuss or raise before we end the meeting | 16:00 |
| TheJulia | rloo: ++++ | 16:00 |
| * dtantsur will respond kaifeng after the meeting | 16:00 | |
| TheJulia | rloo: a chart is needed, honestly | 16:00 |
| rloo | i like our state diagram :) | 16:00 |
| *** kbaegis has quit IRC | 16:01 | |
| dtantsur | if anybody wants to take the 'abort' part - feel welcome | 16:01 |
| dtantsur | this one seems not controversial | 16:01 |
| TheJulia | Thanks everyone! Have a wonderful week! | 16:01 |
| kaifeng | it's a simple change anyone can take it :) | 16:02 |
| rloo | dtantsur: maybe a new RFE, I think it means allow ironic node in 'deploy wait' to be aborted? | 16:02 |
| rloo | 'deploy wait' -> abort -> 'deploy failed' ? | 16:02 |
| dtantsur | rloo: https://storyboard.openstack.org/#!/story/2007646 | 16:02 |
| TheJulia | I think deploy already kind of allows it | 16:02 |
| TheJulia | I _think_ | 16:02 |
| dtantsur | no | 16:02 |
| dtantsur | it has 'deleted', but that brings is all the way through cleaning | 16:03 |
| TheJulia | ahh | 16:03 |
| TheJulia | for an admin that is likely "okay" | 16:03 |
| rloo | in fact, it isn't 'deploy wait' i think it is 'callback wait' or something odd like that. would be great to rename that state... | 16:03 |
| dtantsur | wait call-back, yeah | 16:03 |
| rloo | dtantsur: thx, i see you updated 2007646. I"m good with 2. But not with 1. Not yet anyway. | 16:04 |
| rloo | I'll comment in the rfe. | 16:04 |
| dtantsur | thanks! | 16:04 |
| *** gyee has joined #openstack-ironic | 16:04 | |
| dtantsur | TheJulia: time for #endmeeting? | 16:05 |
| *** alexmcleod has quit IRC | 16:05 | |
| TheJulia | #endmeeting | 16:05 |
| *** openstack changes topic to "Bare Metal Provisioning | Status: http://bit.ly/ironic-whiteboard | Docs: http://docs.openstack.org/ironic/ | Bugs: https://storyboard.openstack.org/#!/project_group/75 | Contributors are generally present between 6 AM and 12 AM UTC, If we do not answer, please feel free to pose questions to openstack-discuss mailing list." | 16:05 | |
| openstack | Meeting ended Mon May 11 16:05:50 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:05 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/ironic/2020/ironic.2020-05-11-15.00.html | 16:05 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/ironic/2020/ironic.2020-05-11-15.00.txt | 16:05 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/ironic/2020/ironic.2020-05-11-15.00.log.html | 16:05 |
| dtantsur | kaifeng: the problem with -ing states is that ironic is doing something with the nodes at this point | 16:06 |
| dtantsur | and we have no way to tell it to stop | 16:06 |
| dtantsur | i.e. it may be writing an image or even doing something out-of-band | 16:06 |
| dtantsur | I was thinking about poisoning a TaskManager object, i.e. modifying it in a way that the next access to task.node will blow up | 16:06 |
| kaifeng | yep, i have experienced available -> deploying and stuck there | 16:06 |
| dtantsur | but that requires some kind of cross-greenthread synchronization | 16:07 |
| dtantsur | and won't help with something long-running | 16:07 |
| dtantsur | so dunno. ideas welcome. | 16:07 |
| openstackgerrit | Riccardo Pittau proposed openstack/ironic master: [WIP] Fix grub2 pxe job with native bionic ovmf https://review.opendev.org/716889 | 16:08 |
| rpittau | good night! o/ | 16:09 |
| *** rpittau is now known as rpittau|afk | 16:09 | |
| *** ianychoi_ is now known as ianychoi | 16:09 | |
| kaifeng | rarely seen recently though, we'll have massive ironic adoption this year, I donno, things may emerge if something is still hidden there | 16:10 |
| dtantsur | yeah, it's not impossible for -ing states to get stuck | 16:10 |
| dtantsur | and I'm very keen on finding a solution better than restarting a conductor | 16:11 |
| * dtantsur wonders if it's possible to kill a green thread | 16:12 | |
| kaifeng | hmm, maybe a guarding task from the outside, but this needs the controversial rfe talked above, which can explicitly set a node to a target state.. | 16:13 |
| *** stendulker has quit IRC | 16:13 | |
| dtantsur | well, we can do things internally | 16:13 |
| dtantsur | I doesn't necessary have to be exposed to the API | 16:13 |
| dtantsur | The question is, how to make ironic stop whatever it's doing to the node | 16:13 |
| *** lucasagomes has quit IRC | 16:15 | |
| * dtantsur senses a PTG topic | 16:15 | |
| *** Qianbiao has quit IRC | 16:15 | |
| kaifeng | it needs more thought, as we even don't know whether it behaves correctly | 16:15 |
| dtantsur | kaifeng: I've added to the PTG etherpad, hopefully we can discuss it | 16:17 |
| kaifeng | dtantsur: thanks! | 16:18 |
| *** dtantsur is now known as dtantsur|afk | 16:19 | |
| dtantsur|afk | o/ | 16:19 |
| *** dking has joined #openstack-ironic | 16:31 | |
| *** uzumaki has quit IRC | 16:32 | |
| *** derekh has quit IRC | 17:01 | |
| openstackgerrit | Verification of a change to openstack/ironic-python-agent failed: Convert jobs to dib https://review.opendev.org/718627 | 17:03 |
| *** sshnaidm|afk is now known as sshnaidm | 17:12 | |
| arne_wiebalck | bye everyone o/ | 17:39 |
| *** riuzen has quit IRC | 17:47 | |
| *** k_mouza has quit IRC | 17:48 | |
| iurygregory | clarkb, ignore_basepython_conflict can be in the tox section in tox.ini correct? e.g https://opendev.org/openstack/sushy-cli/src/branch/master/tox.ini#L5 | 17:48 |
| clarkb | iurygregory: yes that should make it apply to all tox targets (that looks fine to me) | 17:49 |
| clarkb | iurygregory: I think most projects have figured it out already, but we keep having these questions pop up semi regularly so I wanted to point it out again | 17:49 |
| iurygregory | clarkb, cool! | 17:49 |
| iurygregory | we are missing in 4 projects it seems | 17:49 |
| iurygregory | I don't think is worth send to spec repos XD | 17:50 |
| iurygregory | so it will be less | 17:50 |
| openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/metalsmith master: Add ignore_basepython_conflict https://review.opendev.org/726915 | 17:51 |
| iurygregory | clarkb, do I need to set minversion ? ^ | 17:53 |
| clarkb | ya minversion should be 3.1.0 based on https://tox.readthedocs.io/en/latest/config.html#conf-ignore_basepython_conflict I should've mentioned that. Oh well | 17:53 |
| openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/ironic-python-agent-builder master: Update tox.ini https://review.opendev.org/726916 | 17:55 |
| openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/metalsmith master: Update tox.ini https://review.opendev.org/726915 | 17:56 |
| iurygregory | clarkb, tks! | 17:58 |
| *** k_mouza has joined #openstack-ironic | 18:16 | |
| *** k_mouza has quit IRC | 18:17 | |
| *** kaifeng has quit IRC | 18:23 | |
| *** Lucas_Gray has joined #openstack-ironic | 18:23 | |
| *** iurygregory has quit IRC | 18:25 | |
| *** iurygregory has joined #openstack-ironic | 18:38 | |
| *** Lucas_Gray has quit IRC | 19:38 | |
| openstackgerrit | Verification of a change to openstack/ironic failed: Limit the number of ipmitool retries https://review.opendev.org/725954 | 20:19 |
| *** k_mouza has joined #openstack-ironic | 20:32 | |
| *** k_mouza has quit IRC | 20:36 | |
| *** zaneb has quit IRC | 21:07 | |
| *** zaneb has joined #openstack-ironic | 21:13 | |
| *** k_mouza has joined #openstack-ironic | 21:28 | |
| *** k_mouza has quit IRC | 21:32 | |
| *** livelace has quit IRC | 21:48 | |
| *** sshnaidm is now known as sshnaidm|afk | 22:11 | |
| *** tkajinam has joined #openstack-ironic | 22:55 | |
| *** sshnaidm|afk has quit IRC | 23:14 | |
| *** sshnaidm has joined #openstack-ironic | 23:15 | |
| *** sshnaidm is now known as sshnaidm|afk | 23:16 | |
| stevebaker | TheJulia: I have a basic auth middleware working locally :) | 23:24 |
| TheJulia | Kick-Ass! Post it! :) | 23:24 |
| stevebaker | I should proooobably write some tests first | 23:25 |
| TheJulia | Yeeeaaahhh! | 23:26 |
| stevebaker | TheJulia: I've only implemented the bcrypt digest format so far, because its the only one which is secure and standard https://httpd.apache.org/docs/current/misc/password_encryptions.html | 23:30 |
| TheJulia | odds are you could beat me to hacking on the client at this rate | 23:38 |
| stevebaker | TheJulia: where are you first thinking of adding client support? | 23:41 |
| openstackgerrit | Julia Kreger proposed openstack/ironic-python-agent master: Hint 404 lookup failures for Operators https://review.opendev.org/726976 | 23:43 |
| TheJulia | stevebaker: yeah, I talked to mordred and cmurphy last week about it | 23:44 |
| TheJulia | the consensus was to add a openstacksdk plugin for keystoneauth1, and basically have it define and pass in | 23:44 |
| stevebaker | TheJulia: ok, I'll let you know if I start looking at that | 23:46 |
| TheJulia | stevebaker: if you have bandwidth and seems like something fun go right ahead, I'm basically maxed out on bandwidth | 23:50 |
| stevebaker | TheJulia: ok, as long as I'm not taking something fun you were looking forward to | 23:51 |
| TheJulia | you wouldn't be | 23:51 |
| openstackgerrit | Julia Kreger proposed openstack/ironic master: Add ussuri release notes version https://review.opendev.org/726978 | 23:54 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!
