| *** dmellado170420 is now known as dmellado17042 | 05:05 | |
| iurygregory | good morning Ironic | 11:44 |
|---|---|---|
| iurygregory | ok, either we have something wrong with BaremetalRamdiskBootIsoIPXE test, or is just randomly slow in some nodes... | 11:52 |
| *** mgoddard- is now known as mgoddard | 12:28 | |
| dtantsur | I'm not aware of anything | 12:28 |
| iurygregory | so far I only saw failures in the patch to make metal3-integration NV | 12:29 |
| iurygregory | but I see they had a PR that should fix things for us in metal3-dev-env | 12:31 |
| iurygregory | right, last run in the PR to make nv metal3-integration https://zuul.opendev.org/t/openstack/build/d873c86061ba4ec48de9481eb5f1caac : SUCCESS in 38m 50s (non-voting) | 12:31 |
| iurygregory | \o/ | 12:32 |
| dtantsur | nice! | 12:32 |
| iurygregory | let us have a second success and I will abandon :D | 12:33 |
| iurygregory | checking status for 886533 :D | 12:33 |
| iurygregory | if we are green I will +W your patch dtantsur | 12:34 |
| dtantsur | thx! | 12:34 |
| iurygregory | now it's time to pray for zuul | 12:55 |
| TheJulia | good morning! | 12:57 |
| iurygregory | good morning TheJulia | 12:58 |
| * TheJulia needs coffee | 13:33 | |
| opendevreview | Merged openstack/ironic master: Migrate the inspector's /continue API https://review.opendev.org/c/openstack/ironic/+/875944 | 14:37 |
| iurygregory | dtantsur, now you can dance | 14:45 |
| * dtantsur dances \o/ \o/ \o/ | 14:45 | |
| dtantsur | Now only 4-5 (6? 7??) more patches, and inspector will be gone | 14:45 |
| iurygregory | you probably don't need to hurry, but I do XD | 14:46 |
| iurygregory | why I love grenade? | 14:53 |
| iurygregory | ironic-grenade https://zuul.opendev.org/t/openstack/build/78c1ee8e1b524e1d903e6e73b91a8e28 : FAILURE in 2h 06m 41s | 14:53 |
| iurygregory | ironic-grenade-skip-level https://zuul.opendev.org/t/openstack/build/2ec6c5859afc4e5896916bba61d3a863 : SUCCESS in 1h 09m 48s (non-voting) | 14:53 |
| iurygregory | probably some random failure -.-' | 14:53 |
| iurygregory | dtantsur, if you have time today/tomorrow on https://review.opendev.org/c/openstack/ironic/+/883062 https://review.opendev.org/c/openstack/ironic/+/885276/ the first one seems ready, the second I will need to update anyway since we merged the inspectors continue API, but having a feedback would be good ^^ | 14:56 |
| opendevreview | Alex Welsh proposed openstack/bifrost master: Replace Cirros references with generic descriptors https://review.opendev.org/c/openstack/bifrost/+/883943 | 15:02 |
| dtantsur | iurygregory: yep, will put on my list for tomorrow (need to leave early today) | 15:17 |
| JayF | we need to make that skip-level voting | 15:41 |
| JayF | iurygregory: did that grenade freeze during migrations :| | 15:42 |
| JayF | iurygregory: I suspect it did given the timestamps | 15:42 |
| JayF | nah, doesn't look like it | 15:43 |
| JayF | +++ /opt/stack/old/ironic/devstack/lib/ironic:enroll_nodes:2551 : openstack --os-cloud devstack-admin baremetal node create --chassis 500be72b-7418-44fc-9717-a9c5e94c6e69 --driver ipmi --name node-2 --resource-class baremetal --property cpu_arch=x86_64 --property capabilities=boot_mode:bios --driver-info ipmi_address=158.69.73.139 --driver-info ipmi_username=admin | 15:43 |
| JayF | --driver-info ipmi_password=password --driver-info ipmi_port=6230 --driver-info ipmi_port=6231 --driver-info ipmi_port=6232 -f value -c uuid | 15:43 |
| JayF | Timed out waiting for a reply to message ID 73bf7ec9283047969c576e15c08fc1f9 (HTTP 500) | 15:43 |
| JayF | that's a consolation, at least | 15:43 |
| JayF | have we seen the migrations freeze in tempest/grenade? | 15:43 |
| iurygregory | yeah | 15:46 |
| iurygregory | JayF, nope .-. I haven't see migrations problem in grenade | 15:46 |
| iurygregory | normally is a very slow node =( | 15:47 |
| * iurygregory is wondering why hexchat is not showing notifications when he is mentioned... | 15:47 | |
| JayF | we have to find a path forward for unit tests | 15:48 |
| JayF | I don't think me throwing time at it in bulk is going to get any results unless I have a more explicit approach | 15:48 |
| opendevreview | Julia Kreger proposed openstack/ironic-python-agent-builder stable/2023.1: Add libaio engine for fio on Centos/Rhel9 https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/886488 | 16:54 |
| opendevreview | Julia Kreger proposed openstack/ironic-python-agent-builder stable/zed: Add libaio engine for fio on Centos/Rhel9 https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/886489 | 16:55 |
| opendevreview | Julia Kreger proposed openstack/ironic-python-agent-builder stable/yoga: Add libaio engine for fio on Centos/Rhel9 https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/886670 | 16:55 |
| opendevreview | Julia Kreger proposed openstack/ironic-python-agent-builder stable/xena: Add libaio engine for fio on Centos/Rhel9 https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/886652 | 17:01 |
| opendevreview | Julia Kreger proposed openstack/ironic-python-agent-builder stable/wallaby: Add libaio engine for fio on Centos/Rhel9 https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/886671 | 17:02 |
| opendevreview | Iury Gregory Melo Ferreira proposed openstack/ironic master: Add DB API for Firmware and Object https://review.opendev.org/c/openstack/ironic/+/883062 | 17:45 |
| opendevreview | Iury Gregory Melo Ferreira proposed openstack/ironic master: Firmware Interface https://review.opendev.org/c/openstack/ironic/+/885276 | 17:59 |
| JayF | /win 21 | 18:53 |
| JayF | whoops | 18:53 |
| iurygregory | seems like we have some examples of migrations that are taking too long https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_d14/883062/15/check/ironic-tox-unit-with-driver-libs/d148ff4/testr_results.html | 19:35 |
| JayF | this actually seems like good news to me | 19:44 |
| JayF | perhaps implies something system level | 19:44 |
| JayF | because one times out, then the others time out | 19:44 |
| JayF | it's like the server itself is left in a bad state | 19:44 |
| JayF | we need to catch that timeoutexception and pull some stats | 19:44 |
| JayF | yeah this is absolutely confirmation the problem is in the DB engine, I think | 19:55 |
| JayF | b/c during all the timeouts we were reading from the mysql conn, if I'm reading the traceback correctly | 19:55 |
| JayF | hmm or I wonder if the timeout itself leaves things in a bad state | 20:06 |
| JayF | I wonder if sql server versions matter here for repro | 20:06 |
| iurygregory | yeah, I don't think we have pipfreeze from this jobs... | 20:07 |
| JayF | so mariadb in jammy | 20:10 |
| JayF | I think it's time for me to setup a jammy vm | 20:10 |
| iurygregory | we can probably also ask infra to hold a VM for us I think | 20:11 |
| iurygregory | I will try to ask them when I'm back, bbl o/ | 20:12 |
| JayF | iurygregory: I'll ask em | 20:12 |
| BobZAnnapolis___ | apologise in advance if this is the wrong place but current kayobe aio install is failing during 'kayobe control host bootstrap' step with the following msg : "[WARNING]: - mrlesmithjr.manage-lvm was NOT installed successfully: - sorry, mrlesmithjr.manage-lvm was not found on https://galaxy.ansible.com/api/."; tia | 20:48 |
| JayF | Hey BobZAnnapolis___, welcome. | 20:48 |
| JayF | I think you probably should ask for help in a kayobe channel | 20:48 |
| JayF | looks like that's generlaly in #openstack-kolla | 20:49 |
| JayF | Hey BobZAnnapolis___, did you catch that? | 20:49 |
| JayF | I think you probably should ask for help in a kayobe channel looks like that's generally in #openstack-kolla | 20:50 |
| JayF | Since the error is related to ansible pieces I think they might be able to point you in a good direction | 20:50 |
| JayF | if not, you can ask here again or on the mailing list; I'm personally not an expert in that corner of the code | 20:51 |
| JayF | and most who are usually aren't here ~2pm PST | 20:51 |
| TheJulia | Yeah, we’re thin in us afternoons | 20:52 |
| * TheJulia is out to lunch and then hardware store before going back to the computer | 20:53 | |
| JayF | he was replying to me in DM fwiw | 20:53 |
| TheJulia | Cool cool | 20:53 |
| JayF | I think whatever web client was in use might not have been user friendly | 20:53 |
| TheJulia | Yeah | 20:55 |
| * iurygregory is back | 23:17 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!