| opendevreview | Julia Kreger proposed openstack/ironic-python-agent master: Fix checksum validation logic https://review.opendev.org/c/openstack/ironic-python-agent/+/882109 | 00:26 |
|---|---|---|
| TheJulia | so that should fix things along with a change to ironic itself. | 00:30 |
| TheJulia | well, the devstack plugin not to hand an md5 checksum in | 00:30 |
| opendevreview | Steve Baker proposed openstack/ironic stable/2023.1: On rpc service stop, wait for node reservation release https://review.opendev.org/c/openstack/ironic/+/882114 | 03:50 |
| rpittau | good morning ironic! o/ | 07:45 |
| dmellado | rpittau morning ;) | 08:21 |
| dtantsur | a wild dmellado appears! hi, long time no see. do you bifrost still? :) | 08:29 |
| janders | hey rpittau dmellado dtantsur and Ironic o/ | 08:32 |
| rpittau | hey janders dmellado :) | 08:35 |
| opendevreview | Merged openstack/ironic-python-agent master: Fix checksum validation logic https://review.opendev.org/c/openstack/ironic-python-agent/+/882109 | 08:42 |
| opendevreview | Verification of a change to openstack/ironic master failed: Remove use of nomodeset by default https://review.opendev.org/c/openstack/ironic/+/881576 | 09:58 |
| opendevreview | Dmitry Tantsur proposed openstack/ironic-python-agent master: Add network interface speed to the inventory https://review.opendev.org/c/openstack/ironic-python-agent/+/879156 | 10:20 |
| dtantsur | folks, looking for a 2nd +2 on https://review.opendev.org/c/openstack/ironic-specs/+/880941 please | 10:21 |
| opendevreview | Merged openstack/ironic-specs master: Amend the inspector merger spec with details about PXE filters https://review.opendev.org/c/openstack/ironic-specs/+/880941 | 10:43 |
| dtantsur | bifrost CS9 is still broken, right? anyone looking into it? | 11:25 |
| rpittau | dtantsur: haven't checked since last week | 11:49 |
| rpittau | I've also seen some issues with standalone redfish | 11:54 |
| rpittau | and it looks like snmp job doesn't really work on jammy :/ | 11:54 |
| dtantsur | I think standalone redfish is something TheJulia's patch is fixing | 12:37 |
| dtantsur | https://review.opendev.org/c/openstack/ironic/+/882097 | 12:38 |
| dtantsur | rpittau: ^^ | 12:39 |
| rpittau | ah cool | 12:46 |
| rpittau | approved | 12:47 |
| TheJulia | good morning | 13:26 |
| opendevreview | Harald Jensås proposed openstack/ironic-python-agent master: Add support for CentOS SUM files https://review.opendev.org/c/openstack/ironic-python-agent/+/882152 | 13:29 |
| opendevreview | Verification of a change to openstack/ironic master failed: Remove autocommit, again. https://review.opendev.org/c/openstack/ironic/+/862832 | 13:48 |
| TheJulia | :(.... | 13:49 |
| TheJulia | oh, still running | 13:49 |
| * TheJulia needs to wake up | 13:49 | |
| TheJulia | hjensas: I left a comment on that change, code wise it looks good, but you need two more tests :) | 13:51 |
| TheJulia | ... and a release note | 13:51 |
| TheJulia | :) | 13:51 |
| opendevreview | Merged openstack/ironic master: Change wholedisk image checksum to sha256 https://review.opendev.org/c/openstack/ironic/+/882097 | 13:59 |
| TheJulia | yay! | 14:02 |
| dtantsur | TheJulia: discussing md5 on the metal3 meeting now | 14:10 |
| dtantsur | people have reservations about removing it completely. I'll relay any further feedback. | 14:13 |
| * dtantsur is not fond of just turning it off without deprecation either, but this ship has sailed, I guess | 14:14 | |
| TheJulia | I mean... there is no good path given folks just won't change if we don't force it | 14:17 |
| TheJulia | got a link to the meeting | 14:17 |
| TheJulia | ? | 14:18 |
| dtantsur | It's over already. When we discussed this at the PTG, I thought we would put up a deprecation warning first. | 14:35 |
| dtantsur | The problem is, BMO has md5 as part of its public API. | 14:35 |
| JayF | you can enable md5 still via config, yeah? | 14:36 |
| dtantsur | Requires rebuilding IPA | 14:36 |
| TheJulia | ... we could supply it as a kernel arg to allow a conductor side option | 14:47 |
| TheJulia | would that be... acceptable? | 14:47 |
| dtantsur | even just a kernel arg would be fine | 14:48 |
| TheJulia | sure | 14:48 |
| TheJulia | I don't see any issue with that | 14:48 |
| JayF | Uh, I do? | 14:49 |
| JayF | It's a security setting. | 14:49 |
| JayF | We typically don't expose those to dynamic setting | 14:50 |
| TheJulia | dtantsur: do you guys force raw conversion in metal3? | 14:50 |
| JayF | I would presume someone with access enough to collide an MD5 hash would also have access to inject a kernel cli config | 14:50 |
| dtantsur | TheJulia: I think it's happening by default, right? | 14:51 |
| TheJulia | dtantsur: then... I *believe* the hash is getting updated to sha256 | 14:51 |
| dtantsur | Yeah, possibly. Maybe it's not such an issue for us. (Hard to verify for me - we don't use images in OpenShift) | 14:51 |
| NobodyCam | Good morning Ironic Folks, Happy Hump day! | 15:37 |
| TheJulia | Good morning NobodyCam | 15:38 |
| JayF | It's only Wednesday :| | 15:39 |
| JayF | good morning | 15:39 |
| opendevreview | Julia Kreger proposed openstack/ironic master: Support longer checksums for redfish firmware upgrade https://review.opendev.org/c/openstack/ironic/+/882163 | 15:48 |
| opendevreview | Julia Kreger proposed openstack/ironic master: Support sha256/sha512 with the ilo firmware upgrade logic https://review.opendev.org/c/openstack/ironic/+/882164 | 15:48 |
| opendevreview | Julia Kreger proposed openstack/ironic-python-agent master: Fix nvidia hardware manager url parser to permit https https://review.opendev.org/c/openstack/ironic-python-agent/+/881410 | 15:59 |
| rpittau | good night! o/ | 16:02 |
| JayF | A blogpost I wrote a while ago about OpenStack testing metrices just got published -> https://www.gresearch.co.uk/blog/article/invisible-work-of-openstack-testing-matrices/ | 16:03 |
| iurygregory | morning Ironic | 16:08 |
| iurygregory | o/ | 16:08 |
| * iurygregory is a bit late today because of medical exams | 16:08 | |
| TheJulia | good morning! | 16:12 |
| iurygregory | what are the dates for the summit? | 16:18 |
| TheJulia | june 13th through 15th | 16:21 |
| TheJulia | you will need to check if you can do visa on arrival or electronic travel authority, or if you'll need to pull a visa entirely | 16:22 |
| TheJulia | JayF: a possible option is an on-connection configuration option like we do with disk erasure settings | 16:24 |
| JayF | as long as it's more secure than "inject pxe" to override :D | 16:25 |
| TheJulia | yeah, it would be under the cover of the https session between ironic and the agentg | 16:25 |
| TheJulia | agent | 16:26 |
| JayF | that's what I thought :D ++ | 16:27 |
| TheJulia | I... Think I already started that patch somewhere | 16:29 |
| TheJulia | too many things in progress | 16:30 |
| TheJulia | yeah, I already codified it | 16:31 |
| TheJulia | in the original patch | 16:31 |
| opendevreview | Mahnoor Asghar proposed openstack/ironic master: Add to Redfish hardware inventory collection https://review.opendev.org/c/openstack/ironic/+/881783 | 16:32 |
| iurygregory | tks TheJulia , yeah I can use eTA (just need to double check since my US visa is in my old passport, but the visa is still valid) | 16:39 |
| iurygregory | now I need to hope that the flight to vancouver will be like the same price of the one I booked last year to Columbus (but had to cancel) | 16:39 |
| JayF | I'd strongly suspect it'd be cheaper | 16:41 |
| JayF | it's international for you in either case, and Vancouver is a larger airport | 16:41 |
| iurygregory | yeah, checking on the american airlines it seems cheaper, just need a confirmation from the travel agency and talk with my manager | 16:42 |
| opendevreview | Julia Kreger proposed openstack/ironic master: Permit Ironic to notify IPA it can support MD5 https://review.opendev.org/c/openstack/ironic/+/882168 | 16:53 |
| TheJulia | dtantsur: ^ | 16:53 |
| dtantsur | nice! | 17:10 |
| TheJulia | not explicitly tested it, but I copied the var name over and that is a pattern we've used a few times to do params like that | 17:13 |
| opendevreview | Julia Kreger proposed openstack/metalsmith master: Update MD5 checksum references https://review.opendev.org/c/openstack/metalsmith/+/882170 | 17:17 |
| opendevreview | Dmitry Tantsur proposed openstack/ironic master: [WIP] Migrate the inspector's /continue API https://review.opendev.org/c/openstack/ironic/+/875944 | 17:18 |
| opendevreview | Dmitry Tantsur proposed openstack/ironic master: [DNM] Test new inspection code path https://review.opendev.org/c/openstack/ironic/+/881492 | 17:19 |
| opendevreview | Dmitry Tantsur proposed openstack/ironic master: [WIP] Very basic in-band inspection with a new "agent" interface https://review.opendev.org/c/openstack/ironic/+/877814 | 17:22 |
| TheJulia | So neighbors have recommended taking the waterfront downtown train | 18:06 |
| opendevreview | Verification of a change to openstack/ironic-python-agent stable/zed failed: Fix UTF-16 result handling for efibootmgr https://review.opendev.org/c/openstack/ironic-python-agent/+/881658 | 18:54 |
| opendevreview | Verification of a change to openstack/ironic master failed: Remove use of nomodeset by default https://review.opendev.org/c/openstack/ironic/+/881576 | 19:14 |
| TheJulia | ci why do you hate me | 19:57 |
| TheJulia | oh, that was arm gate | 19:57 |
| opendevreview | Harald Jensås proposed openstack/ironic-python-agent master: Add support for CentOS SUM files https://review.opendev.org/c/openstack/ironic-python-agent/+/882152 | 20:04 |
| stevebaker[m] | good morning | 20:46 |
| opendevreview | Verification of a change to openstack/ironic master failed: Remove autocommit, again. https://review.opendev.org/c/openstack/ironic/+/862832 | 20:51 |
| TheJulia | good morning stevebaker[m] | 20:53 |
| JayF | We still have grenade problems, I think | 20:54 |
| JayF | > 2023-05-03 20:17:33.375 | + /opt/stack/new/grenade/projects/60_nova/resources.sh:create:113 : openstack server create --image cirros-0.5.2-x86_64-disk --flavor baremetal --security-group nova_grenade --nic net-id=17de8689-6d80-4f5e-94d2-bb14fc70d571 nova_server1 --wait | 20:55 |
| JayF | this 500'd, it's the same flavor problem | 20:55 |
| TheJulia | yeah | 21:00 |
| TheJulia | it doesn't record the post to create which was a 500 though | 21:00 |
| TheJulia | at least, not in nova-api's log | 21:00 |
| TheJulia | 10.209.0.197 - - [03/May/2023:20:17:35 +0000] "POST /compute/v2.1/servers HTTP/1.1" 500 802 "-" "python-novaclient" | 21:02 |
| TheJulia | May 03 20:17:35.809427 np0033934537 devstack@n-api.service[85091]: DEBUG nova.api.openstack.wsgi [None req-bb9b4386-7047-40c5-8ed8-9237a4e0407b nova_grenade nova_grenade] Action: 'create', calling method: <bound method ServersController.create of <nova.api.openstack.compute.servers.ServersController object at 0x7feb7a614970>>, body: {"server": {"name": "nova_server1", "imageRef": "37cc7ca5-64f4-40ce-91ec-82e504aeebcf", | 21:09 |
| TheJulia | "flavorRef": "05ad8cb1-94c4-4a1e-9370-f5946d79b757", "min_count": 1, "max_count": 1, "security_groups": [{"name": "ec567d71-f379-4cd3-8082-66d43dba3835"}], "networks": [{"uuid": "17de8689-6d80-4f5e-94d2-bb14fc70d571"}]}} {{(pid=85091) _process_stack /opt/stack/old/nova/nova/api/openstack/wsgi.py:511}} | 21:09 |
| TheJulia | May 03 20:17:36.071689 np0033934537 devstack@n-api.service[85091]: DEBUG nova.network.neutron [None req-bb9b4386-7047-40c5-8ed8-9237a4e0407b nova_grenade nova_grenade] validate_networks() for [('17de8689-6d80-4f5e-94d2-bb14fc70d571', None, None, None, None, None)] {{(pid=85091) validate_networks /opt/stack/old/nova/nova/network/neutron.py:2623}} <-- last thing that happens in the logs | 21:12 |
| TheJulia | I think this is an issue with the network not being right or known | 21:15 |
| TheJulia | take a look aroudn that time in https://6e35da529aad4707b8b4-f6495af2602100b34baeae26a45cd2d3.ssl.cf1.rackcdn.com/862832/7/gate/ironic-grenade/2dd0a0d/controller/logs/screen-q-svc.txt | 21:18 |
| JayF | May 03 20:17:35.753890 np0033934537 neutron-server[85856]: INFO neutron.wsgi [None req-42c5ba4d-70d3-4a95-802f-9d3041ca5586 nova_grenade nova_grenade] 10.209.0.197 "GET /v2.0/security-groups/nova_grenade HTTP/1.1" status: 404 len: 328 time: 0.0110013 | 21:22 |
| JayF | May 03 20:17:35.796444 np0033934537 neutron-server[85856]: INFO neutron.wsgi [None req-572b1f31-3404-4ad8-90cf-482a0a514a0b nova_grenade nova_grenade] 10.209.0.197 "GET /v2.0/security-groups?name=nova_grenade HTTP/1.1" status: 200 len: 2969 time: 0.0394650 | 21:22 |
| JayF | that's weird | 21:22 |
| TheJulia | if it is a quota issue... then https://github.com/openstack/nova/blob/master/nova/network/neutron.py#L2656 would only raise an exception if it was <= 0 | 21:27 |
| TheJulia | but less than 0 means over committed | 21:27 |
| JayF | is that a bug? should that catch the 0 case, too? | 21:27 |
| TheJulia | less than 0, available ports would have to be start out as -1 | 21:28 |
| TheJulia | feels like an off by 1 error to me | 21:28 |
| TheJulia | but ... given the logging state, I'm not sure if we're actually hitting there or not. We definitely get to the port list query | 21:28 |
| TheJulia | based upon the neutron log | 21:28 |
| TheJulia | actually, that compare is after the subtrction | 21:43 |
| TheJulia | so it could be zero to -1 | 21:43 |
| TheJulia | but... that gives us a lead, are quotas in a healthy state | 21:43 |
| opendevreview | Verification of a change to openstack/ironic master failed: Remove use of nomodeset by default https://review.opendev.org/c/openstack/ironic/+/881576 | 21:48 |
| TheJulia | wasn't pingable | 21:49 |
| JayF | I'm sorry, I'm not doing an awesome job of helping. Not feeling very well today and the brain is moving slowly. | 21:51 |
| opendevreview | Merged openstack/ironic-python-agent stable/zed: Fix UTF-16 result handling for efibootmgr https://review.opendev.org/c/openstack/ironic-python-agent/+/881658 | 21:51 |
| TheJulia | no worries | 21:53 |
| TheJulia | I'm kind of stumped | 21:53 |
| JayF | Maybe worthwhile to summarize findings on the list and see if anyone from another project has ideas? | 21:53 |
| TheJulia | headline will be "grenade unreliable" | 21:54 |
| TheJulia | I'm likely going to disappear in a little bit | 21:55 |
| TheJulia | I can resume looking tomorrow | 22:02 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!