opendevreview | Steve Baker proposed openstack/ironic master: Add missing mode setting on pxe created directories https://review.opendev.org/c/openstack/ironic/+/809294 | 01:54 |
---|---|---|
opendevreview | Steve Baker proposed openstack/ironic master: WIP chmod fetched pxe kernel/ramdisk files https://review.opendev.org/c/openstack/ironic/+/809295 | 01:54 |
*** pmannidi|AFK is now known as pmannidi | 02:09 | |
*** pmannidi is now known as pmannidi|brb | 05:57 | |
iurygregory | good morning Ironic | 06:03 |
arne_wiebalck | Good morning iurygregory and Ironic! | 07:02 |
iurygregory | morning arne_wiebalck o/ | 07:03 |
*** pmannidi|brb is now known as pmannidi | 07:22 | |
opendevreview | Merged openstack/python-ironicclient master: Fix distribution compatability for configdrive build https://review.opendev.org/c/openstack/python-ironicclient/+/809258 | 07:41 |
ajya | Good morning, if there is any 2nd core reviewer who could take a look at these: https://review.opendev.org/c/openstack/ironic/+/804112 https://review.opendev.org/c/openstack/ironic/+/804848 | 07:57 |
opendevreview | Merged openstack/ironic stable/ussuri: Fix Redfish jobs by pinning sushy-tools https://review.opendev.org/c/openstack/ironic/+/809275 | 08:00 |
*** pmannidi is now known as pmannidi|AFK | 08:10 | |
opendevreview | ZhouHao proposed openstack/ironic master: [iRMC] Avoid repeatedly resuming clean after creating raid configuration https://review.opendev.org/c/openstack/ironic/+/809022 | 10:39 |
opendevreview | ZhouHao proposed openstack/ironic master: [iRMC] Set polling after RAID is built https://review.opendev.org/c/openstack/ironic/+/809023 | 10:39 |
opendevreview | Merged openstack/ironic master: Fix RAID steps for non-RAID in idrac-redfish https://review.opendev.org/c/openstack/ironic/+/804112 | 11:31 |
opendevreview | Merged openstack/ironic master: Fix clear foreign config in idrac-redfish RAID https://review.opendev.org/c/openstack/ironic/+/804848 | 12:27 |
opendevreview | Verification of a change to openstack/ironic-python-agent-builder master failed: Support non-genisoimage binaries https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/809299 | 12:47 |
opendevreview | Julia Kreger proposed openstack/ironic master: Attempt to reduce odds of neutron port startup failure https://review.opendev.org/c/openstack/ironic/+/809415 | 13:39 |
TheJulia | good morning | 13:39 |
TheJulia | so I am hoping ^^^ might reduce some of our erronious failures in the gate. I've seen a few instances where our jobs have failed on the neutron port setup recently and neutron is kind of known not to be the fastest in that area | 13:40 |
iurygregory | good morning TheJulia | 13:53 |
iurygregory | TheJulia, do we think we can just go ahead with ngs and networking-baremetal release? (for ipa-builder I think we can wait for https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/809299 ) | 13:56 |
TheJulia | iurygregory: can you take a look at https://review.opendev.org/c/openstack/ironic/+/809145 <-- stable backport just need an extra approval | 13:58 |
iurygregory | sure looking now | 13:59 |
TheJulia | iurygregory: yeah, ngs and networking-baremetal sound reasonable | 13:59 |
TheJulia | looks like we need another core review on https://review.opendev.org/c/openstack/ironic/+/806859 that is not Iury | 14:02 |
TheJulia | iurygregory: I'm going to workflow https://review.opendev.org/c/openstack/ironic/+/809288 | 14:06 |
TheJulia | if there are no objections | 14:06 |
iurygregory | TheJulia, I can +W https://review.opendev.org/c/openstack/ironic/+/809288 (since is just a fix for our CI) | 14:07 |
TheJulia | iurygregory: works for me | 14:07 |
iurygregory | I just saw your comment and it makes sense | 14:07 |
TheJulia | yeouch https://2d9a473fba18604e747c-da887b185713bfa3a6995c0b44f5e463.ssl.cf2.rackcdn.com/803855/10/check/ironic-tempest-ipa-partition-pxe_ipmitool/1de197f/controller/logs/syslog.txt <-- indcates we hit 1.1MB free in one job | 14:08 |
TheJulia | I guess it took out mysqld :\ | 14:10 |
iurygregory | =( | 14:17 |
opendevreview | Julia Kreger proposed openstack/ironic stable/train: Fix Redfish jobs by pinning sushy-tools https://review.opendev.org/c/openstack/ironic/+/809285 | 14:17 |
TheJulia | ugh, had to lower the mysql version even further | 14:17 |
TheJulia | hmm, multiple hits on the neutron tap not being up yet | 14:23 |
TheJulia | oh! I see what is going on with neutron | 14:29 |
TheJulia | It is crashing | 14:29 |
iurygregory | neutron stop crashing, we will give you cookies :D | 14:30 |
TheJulia | https://paste.opendev.org/show/809374/ | 14:36 |
TheJulia | it is really funky | 14:36 |
iurygregory | oh god =( | 14:38 |
TheJulia | The agent code hasn't changed in months | 14:47 |
TheJulia | err, wrong agent | 14:49 |
TheJulia | looks like it has changed some recently | 14:50 |
opendevreview | Iury Gregory Melo Ferreira proposed openstack/ironic bugfix/18.1: Fix driver task pattern to reduce periodic db load https://review.opendev.org/c/openstack/ironic/+/809376 | 15:24 |
opendevreview | Julia Kreger proposed openstack/ironic master: CI: set Neutron OVS of_inactivity_probe for CI load https://review.opendev.org/c/openstack/ironic/+/809426 | 15:30 |
opendevreview | Merged openstack/ironic stable/ussuri: Use shim-signed on Ubuntu, shim is empty now https://review.opendev.org/c/openstack/ironic/+/809145 | 15:43 |
opendevreview | Julia Kreger proposed openstack/ironic master: CI: set Neutron OVS of_inactivity_probe for CI load https://review.opendev.org/c/openstack/ironic/+/809426 | 15:55 |
TheJulia | iurygregory: ^^ now with bashate fix :( | 15:58 |
opendevreview | Merged openstack/ironic master: Dial back gate job memory allocation https://review.opendev.org/c/openstack/ironic/+/809288 | 16:08 |
opendevreview | Julia Kreger proposed openstack/ironic master: CI: set Neutron OVS of_inactivity_probe for CI load https://review.opendev.org/c/openstack/ironic/+/809426 | 16:38 |
opendevreview | Merged openstack/ironic-python-agent-builder master: Support non-genisoimage binaries https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/809299 | 16:39 |
opendevreview | Merged openstack/ironic stable/wallaby: Fix driver task pattern to reduce periodic db load https://review.opendev.org/c/openstack/ironic/+/808983 | 16:51 |
iurygregory | TheJulia, ack I will keep an eye on it | 16:59 |
opendevreview | Julia Kreger proposed openstack/ironic master: CI: set Neutron OVS of_inactivity_probe for CI load https://review.opendev.org/c/openstack/ironic/+/809426 | 17:33 |
opendevreview | Merged openstack/ironic master: Expand the driver contributor documentation https://review.opendev.org/c/openstack/ironic/+/807284 | 18:09 |
opendevreview | Merged openstack/ironic master: Remove images from the OS profiler docs https://review.opendev.org/c/openstack/ironic/+/807326 | 18:09 |
opendevreview | Julia Kreger proposed openstack/python-ironicclient stable/xena: Fix distribution compatability for configdrive build https://review.opendev.org/c/openstack/python-ironicclient/+/809380 | 18:11 |
opendevreview | Julia Kreger proposed openstack/python-ironicclient stable/wallaby: Fix distribution compatability for configdrive build https://review.opendev.org/c/openstack/python-ironicclient/+/809381 | 18:12 |
opendevreview | Verification of a change to openstack/ironic bugfix/18.1 failed: Fix driver task pattern to reduce periodic db load https://review.opendev.org/c/openstack/ironic/+/809376 | 18:28 |
opendevreview | Julia Kreger proposed openstack/ironic master: CI: set Neutron OVS of_inactivity_probe for CI load https://review.opendev.org/c/openstack/ironic/+/809426 | 18:35 |
bfournie | Hi TheJulia, so for https://review.opendev.org/c/openstack/ironic/+/802389, we haven't found this particular patch to be helpful in that it didn't resolve the issue of the boot order changing after reboot. We recently isolated that to a particular (deprecated) hardware model for that vendor, the new h/w did not have the issue. I'll update the story. I can iterate on the patch if you think it would be useful in other | 18:37 |
TheJulia | bfournie: sounds like in that case, the patch should just be abandoned | 18:38 |
bfournie | TheJulia: ok, will do. Sorry you spent time reviewing it, I should have updated the story last week, will do it now | 18:40 |
opendevreview | Julia Kreger proposed openstack/ironic stable/train: Fix Redfish jobs by pinning sushy-tools https://review.opendev.org/c/openstack/ironic/+/809285 | 18:40 |
TheJulia | bfournie: no worries! | 18:41 |
TheJulia | It *does* raise some legitimate questions, fwiw | 18:41 |
TheJulia | and a path we likely ought to explore | 18:41 |
bfournie | TheJulia: yeah, but we haven't really seen an reproducible issue that setting the device first helps | 18:42 |
TheJulia | I feel like we're starting to encounter increased vendor specific "weirdness" | 18:44 |
bfournie | TheJulia: yep | 18:50 |
opendevreview | Merged openstack/bifrost master: Use TLS for virtual media when TLS is enabled https://review.opendev.org/c/openstack/bifrost/+/805874 | 19:06 |
TheJulia | stevebaker: hmmmm https://zuul.opendev.org/t/openstack/build/cf1c28a9e4b14bccbd00197c1fa74113 <-- shim missing | 19:59 |
opendevreview | Julia Kreger proposed openstack/ironic stable/train: Use shim-signed on Ubuntu, shim is empty now https://review.opendev.org/c/openstack/ironic/+/809146 | 20:11 |
stevebaker | TheJulia: is that what ^^ fixes? | 20:24 |
TheJulia | ahh, right | 20:25 |
TheJulia | chasing a few too many unhappy jobs | 20:25 |
stevebaker | I'll land them both as soon as they're green | 20:31 |
TheJulia | ok, another is https://review.opendev.org/c/openstack/ironic/+/809426 which I just rechecked | 20:34 |
TheJulia | tl;dr this may be our "our port never appeared" issue in ironic | 20:35 |
TheJulia | I've chased down 4-5 separate failures in the past 24 hours which were all basically that issue and the tl;dr is neutron-openvswitch-agent exits with a RuntimeError | 20:36 |
TheJulia | which causes it never to appear for the dhcp agent in ovs, which *boom* | 20:36 |
stevebaker | TheJulia: I have another tricky thing which might need your help. Rabi has a change to switch ironic and neutron to using basic auth on the undercloud. featureset001 was green on that change until my change to switch to uefi boot landed. Nodes deploy but ssh times out. https://review.opendev.org/c/openstack/tripleo-heat-templates/+/794912 https://review.rdoproject.org/zuul/build/2bed88354c8c4f18baeb0e8a90aa7eef | 20:46 |
TheJulia | stevebaker: would it be okay to look tomorrow? | 20:49 |
stevebaker | TheJulia: absolutely | 20:49 |
TheJulia | stevebaker: okay, I'm shifting my brain into some srbac stuffs and then heading to the store.... I ordered a compressed air dryer attachment with the wrong fitting size, so I need to get an adapter before I can cut some steel tomorrow night. | 20:51 |
stevebaker | badass | 20:51 |
TheJulia | I think at some point, I'm going to include presentation photos of "don't be like julia" | 20:52 |
TheJulia | "don't weld in shorts" | 20:52 |
stevebaker | haha! | 20:55 |
opendevreview | Samuel Zuk proposed openstack/ironic-specs master: Power control intermediary spec proposal https://review.opendev.org/c/openstack/ironic-specs/+/808804 | 21:18 |
TheJulia | stevebaker: you might want to take a look at https://review.opendev.org/c/openstack/tripleo-heat-templates/+/781571 | 21:35 |
opendevreview | Merged openstack/ironic stable/train: Fix Redfish jobs by pinning sushy-tools https://review.opendev.org/c/openstack/ironic/+/809285 | 23:21 |
opendevreview | Merged openstack/ironic stable/train: Use shim-signed on Ubuntu, shim is empty now https://review.opendev.org/c/openstack/ironic/+/809146 | 23:21 |
*** pmannidi|AFK is now known as pmannidi | 23:47 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!