| arne_wiebalck | Good morning, Ironic! | 07:11 |
|---|---|---|
| opendevreview | OpenStack Release Bot proposed openstack/ironic stable/yoga: Update .gitreview for stable/yoga https://review.opendev.org/c/openstack/ironic/+/835003 | 07:49 |
| opendevreview | OpenStack Release Bot proposed openstack/ironic stable/yoga: Update TOX_CONSTRAINTS_FILE for stable/yoga https://review.opendev.org/c/openstack/ironic/+/835004 | 07:49 |
| opendevreview | OpenStack Release Bot proposed openstack/ironic master: Update master for stable/yoga https://review.opendev.org/c/openstack/ironic/+/835005 | 07:49 |
| opendevreview | OpenStack Release Bot proposed openstack/ironic master: Add Python3 zed unit tests https://review.opendev.org/c/openstack/ironic/+/835006 | 07:50 |
| rpittau | good morning ironic! o/ | 07:50 |
| rpittau | finally ironic yoga \o/ | 07:51 |
| arne_wiebalck | hey rpittau o/ | 07:53 |
| rpittau | hey arne_wiebalck :) | 07:53 |
| arne_wiebalck | new release means the update season starts | 07:53 |
| * arne_wiebalck put no emoticon at the end for a reason | 07:54 | |
| rpittau | updates uh? what could go wrong! | 07:55 |
| arne_wiebalck | "should work" | 07:55 |
| dtantsur | morning folks | 08:32 |
| rpittau | good morning dtantsur :) | 08:35 |
| opendevreview | Merged openstack/ironic master: Update master for stable/yoga https://review.opendev.org/c/openstack/ironic/+/835005 | 08:49 |
| opendevreview | Merged openstack/ironic stable/yoga: Update .gitreview for stable/yoga https://review.opendev.org/c/openstack/ironic/+/835003 | 08:54 |
| opendevreview | Merged openstack/ironic stable/yoga: Update TOX_CONSTRAINTS_FILE for stable/yoga https://review.opendev.org/c/openstack/ironic/+/835004 | 08:56 |
| janders | hey arne_wiebalck rpittau dtantsur and @yoga! :) | 09:51 |
| iurygregory | good morning Ironic o/ | 09:54 |
| iurygregory | habemus Yoga \o/ | 09:54 |
| iurygregory | congrats everyone! | 09:54 |
| rpittau | hey janders :) | 10:04 |
| rpittau | hey iurygregory :) | 10:04 |
| arne_wiebalck | hey janders o/ | 10:42 |
| *** pmannidi is now known as pmannidi|Away | 10:43 | |
| opendevreview | Merged openstack/ironic master: Add Python3 zed unit tests https://review.opendev.org/c/openstack/ironic/+/835006 | 11:00 |
| iurygregory | Hey team we have some open changes in our tempest plugin https://review.opendev.org/q/project:openstack/ironic-tempest-plugin+is:mergeable+status:open should we try to merge some of them before cutting the release in yoga? https://review.opendev.org/c/openstack/releases/+/833576 | 12:30 |
| dtantsur | would be nice towards the tempest team, I guess | 12:31 |
| iurygregory | the ones with the clean-up right? | 12:32 |
| iurygregory | https://review.opendev.org/q/topic:tempest-scenario-manager-cleanup+project:openstack/ironic-tempest-plugin | 12:32 |
| dtantsur | yeah | 12:32 |
| iurygregory | ok, I've reviewed all the open changes for the new interface o/ | 13:23 |
| iurygregory | if possible I think we can include https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/829665 | 13:24 |
| dtantsur | folks, does anyone remember: do we timeout if a certain deploy step takes too long? | 13:30 |
| TheJulia | I *think* we do if it takes >1hr | 13:30 |
| dtantsur | hmm. what would people say about per deploy step timeouts? | 13:34 |
| TheJulia | only if it runs with a reasonable default | 13:35 |
| TheJulia | The older I get, the less tollerant of insane defaults I become | 13:35 |
| TheJulia | :) | 13:35 |
| dtantsur | I'd expect the defaults not to change | 13:35 |
| TheJulia | sounds good to me then! :) | 13:35 |
| TheJulia | (And I anticipated you would say that, fwiw) | 13:35 |
| dtantsur | rather to be able to say "I have a crazy deploy steps which can run for ages" (which is my reality nowadays) | 13:35 |
| TheJulia | we need the ability to ship back status or health or something | 13:36 |
| TheJulia | "still running, sorry, I'm 11% completed" | 13:36 |
| iurygregory | can we calculate the %? | 13:37 |
| dtantsur | not in my case | 13:37 |
| dtantsur | at the risk of causing some heart attacks: I have a case that has a user confirmation somewhere on the deploy path | 13:37 |
| iurygregory | well well... | 13:38 |
| dtantsur | yeah | 13:38 |
| iurygregory | are we back to monday now? | 13:38 |
| dtantsur | I'll hopefully be in a tent by a lake on Monday | 13:38 |
| dtantsur | so my Monday is today | 13:38 |
| TheJulia | dtantsur: maybe we need a pause button | 13:38 |
| TheJulia | too.... | 13:38 |
| iurygregory | ++ we want pictures of the lake when you are back :D | 13:38 |
| TheJulia | and the interaction could pause/resume | 13:39 |
| dtantsur | TheJulia: you'll get them :) | 13:39 |
| dtantsur | ehmm, iurygregory | 13:39 |
| iurygregory | XD just kidding | 13:39 |
| iurygregory | but we want the name of the place :D | 13:39 |
| dtantsur | TheJulia: maybe we should start distinguishing between "Ironic has no idea what is going on for 60 minutes" and "the deploy step is running, just taking a lot of time" | 13:40 |
| iurygregory | pause/resume sounds interesting | 13:40 |
| dtantsur | I think right now we use the same timeout for PXE booting and for deploy steps. which is weird. | 13:40 |
| TheJulia | dtantsur: possibly, sounds like there are a few different ways to approach it | 13:40 |
| TheJulia | agreed | 13:41 |
| dtantsur | okay, when I come back from PTO, hopefully fresh, I'll try to propose something | 13:42 |
| TheJulia | okay | 13:43 |
| TheJulia | dtantsur: ptg etherpad? | 13:43 |
| iurygregory | he will be back at the PTG week | 13:46 |
| iurygregory | maybe just add as a topic and we can discuss in the last day | 13:46 |
| iurygregory | I will be sending an idea for the schedule on Monday after the weekly meeting | 13:47 |
| dtantsur | added | 13:47 |
| rloo | ++ for individual deploy step timeouts | 14:14 |
| rloo | (assuming that will apply to clean steps too if we don't have that already) | 14:14 |
| opendevreview | Arne Wiebalck proposed openstack/ironic master: [doc] Document dynamic network burn-in https://review.opendev.org/c/openstack/ironic/+/835079 | 14:21 |
| opendevreview | Verification of a change to openstack/ironic-tempest-plugin master failed: create_server method full removal https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/834122 | 14:35 |
| opendevreview | Verification of a change to openstack/ironic-tempest-plugin master failed: Remove get_remote_client & check_vm_connectivity methods https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/834124 | 14:35 |
| opendevreview | Verification of a change to openstack/ironic-tempest-plugin master failed: Remove create_timestamp method https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/834127 | 14:35 |
| iurygregory | ofc this would happen :D | 14:36 |
| iurygregory | Error: Failed to tear down from cleaning for node fae6296d-0cbf-4115-afcd-8f7850e2d870, reason: IPMI call failed: power off. \o/ | 14:39 |
| TheJulia | sweet | 14:42 |
| TheJulia | iurygregory: what did ipmitool log? | 14:43 |
| dtantsur | I think vbmc sometimes dies | 14:44 |
| iurygregory | I'm checking the logs to see, since is tempest I'm expecting it was a race condition or something... (since things were working just fine...) | 14:44 |
| iurygregory | https://662fbc83c91c32a8789e-45518917cf8baf33fe991d0324b9a061.ssl.cf2.rackcdn.com/834122/1/gate/ironic-standalone/4ca9d48/controller/logs/screen-ir-cond.txt doesn't look good =X | 14:55 |
| iurygregory | vbmc doesn't look strange https://zuul.opendev.org/t/openstack/build/4ca9d488c4c74f61adb3e2c0274d0e8c/log/controller/logs/screen-virtualbmc.txt | 14:58 |
| TheJulia | weird, node-1's vbmc is still working after the failure | 15:33 |
| TheJulia | hmm | 15:50 |
| TheJulia | I think we may need to improve vbmc's logging | 15:50 |
| TheJulia | so, we *have* seen some fluke ipmitool misbehaviors in the past, but multiple in a row make me think it is vbmc | 16:25 |
| dtantsur | oh fun. I've caught a condition in the combined ironic, where the automation uses the API *before* the built-in conductor is started | 17:02 |
| opendevreview | Dmitry Tantsur proposed openstack/ironic master: Start API after conductor is started in the combined executable https://review.opendev.org/c/openstack/ironic/+/835098 | 17:08 |
| dtantsur | please watch the bifrost jobs when reviewing ^^^ | 17:11 |
| zer0c00l | Looks like redhat may not fix the %onerror issues on RHEL 7.9 | 17:12 |
| zer0c00l | This is the response i got "yes this does appear to be a reproducible bug. Unfortunately, there have not been previous reports of this bug, and because RHEL 7 is in Maintenance Support 2 Phase of its lifecycle, RHEL 7.9 is the last minor release. New versions of the installation media are only released with new minor releases. | 17:12 |
| TheJulia | :( | 17:25 |
| TheJulia | so I've been looking at the python-libvirt stuffs | 17:25 |
| TheJulia | Since it is autogenerated, it is a bit difficult, but it seems there is a recognition that keyerror and attribute error can bubble up from within | 17:26 |
| TheJulia | which makes me think our focus on libvirtError as the only exception that can be raised may be hiding issues from us | 17:26 |
| TheJulia | and could explain invalid response messages... I guess | 17:27 |
| iurygregory | wow | 17:29 |
| TheJulia | if memory serves, pyghmi gets in a state where "Error: Unable to establish IPMI v2 / RMCP+ session" is the result if it gets None back from the method it calls | 17:30 |
| opendevreview | Julia Kreger proposed openstack/virtualbmc master: Handle any error from libvirt operations https://review.opendev.org/c/openstack/virtualbmc/+/835104 | 17:39 |
| TheJulia | I have no idea if that will pass, can't run any of the tools locally since it still has py2 stuffs | 17:39 |
| iurygregory | jesus | 17:39 |
| iurygregory | <O> | 17:39 |
| iurygregory | pray for CI | 17:39 |
| TheJulia | I *think* there was a reason for that... | 17:39 |
| TheJulia | I think. | 17:40 |
| TheJulia | since I'm re-watching Babylon 5... this seems appropriate: "God be between you and harm in all the empty places where you must walk." | 17:43 |
| TheJulia | http://scv.bu.edu/~aarondf/b5quotes.html | 17:43 |
| TheJulia | it feels... so absurdly weird to see a ~username path in a url | 17:44 |
| TheJulia | get out your public_html folders! | 17:44 |
| rpittau | good night! o/ | 17:48 |
| iurygregory | good night o/ | 17:48 |
| dtantsur | https://review.opendev.org/c/openstack/ironic/+/835098 seems to do what I expect it to do and passes the bifrost jobs. PTAL | 18:21 |
| dtantsur | o/ | 18:23 |
| TheJulia | o/ | 18:25 |
| iurygregory | gerrit is a bit slow? | 18:48 |
| iurygregory | maybe is just for me... | 18:48 |
| opendevreview | Merged openstack/ironic-tempest-plugin master: create_server method full removal https://review.opendev.org/c/openstack/ironic-tempest-plugin/+/834122 | 20:26 |
| opendevreview | Harald Jensås proposed openstack/networking-baremetal master: Add OpenConfig classes for iface vlan plugging https://review.opendev.org/c/openstack/networking-baremetal/+/835157 | 22:57 |
| opendevreview | Harald Jensås proposed openstack/networking-baremetal master: Add OpenConfig classes for switch vlans https://review.opendev.org/c/openstack/networking-baremetal/+/835158 | 22:57 |
| opendevreview | Harald Jensås proposed openstack/networking-baremetal master: Add OpenConfig classes for network-instance https://review.opendev.org/c/openstack/networking-baremetal/+/835159 | 22:57 |
| opendevreview | Harald Jensås proposed openstack/networking-baremetal master: Add OpenConfig classes for interface aggregate https://review.opendev.org/c/openstack/networking-baremetal/+/835160 | 22:57 |
| opendevreview | Harald Jensås proposed openstack/networking-baremetal master: Add OpenConfig classes for LACP https://review.opendev.org/c/openstack/networking-baremetal/+/835161 | 22:57 |
| opendevreview | Julia Kreger proposed openstack/virtualbmc master: Handle any error from libvirt operations https://review.opendev.org/c/openstack/virtualbmc/+/835104 | 23:50 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!