| openstackgerrit | Julia Kreger proposed openstack/ironic stable/victoria: Always retry locking when performing task handoff https://review.opendev.org/c/openstack/ironic/+/778241 | 00:13 |
|---|---|---|
| TheJulia | eandersson: so can you look at your api logs to see if the heartbeat is coming in multiple times and getting delayed at all? | 00:16 |
| *** tosky has quit IRC | 00:17 | |
| TheJulia | eandersson: looks like we had 752716 in stable/victoria when the branch was cut which is kind of mixed in with everything, and is kind of the bug that allows requests to stack in the first place, which I think we would end up logging in the conductor, just don't use grep to look for it :) | 00:17 |
| stevebaker | TheJulia: will do | 00:23 |
| openstackgerrit | Julia Kreger proposed openstack/ironic master: WIP wait if the agent is busy https://review.opendev.org/c/openstack/ironic/+/778345 | 00:34 |
| TheJulia | eandersson: ^^ might be too.. direct | 00:34 |
| TheJulia | but as demonstrated by the couple different backports to victoria of things all kind of centered around the same area/place/interaction, it kind of ends up being quite a puzzle. | 00:35 |
| * TheJulia goes and gets the mail, exercises, and calls it a day | 00:36 | |
| eandersson | TheJulia I see that it drops the exclusive lock just before things go wrong | 00:53 |
| *** rloo has quit IRC | 00:53 | |
| eandersson | https://github.com/openstack/ironic/blob/master/ironic/conductor/utils.py#L883 | 00:54 |
| TheJulia | hmm | 00:59 |
| TheJulia | interesting | 00:59 |
| TheJulia | so basically a race | 01:00 |
| TheJulia | one thread is wrapping up the other is incoming | 01:00 |
| eandersson | Yea looks like that at least | 01:02 |
| eandersson | Gonna set some breakpoints and see what is up :D | 01:02 |
| eandersson | but I bet that will break the race condition | 01:02 |
| *** gyee has quit IRC | 01:17 | |
| TheJulia | likely, but i guess my fix is more in lines with what should be done. We can still be doing a thing, we can still be heartbeated into the logic to try and proceed since heartbeating is detached from the api service | 01:22 |
| TheJulia | well, by fix I mean the last wip I posted | 01:23 |
| stevebaker | TheJulia: I think diskimage-builder is not installing efibootmgr ever! tralalaaaaAAAHH | 01:46 |
| TheJulia | Woot | 01:47 |
| *** uzumaki has quit IRC | 01:52 | |
| *** rcernin has quit IRC | 02:00 | |
| eandersson | I'll keep testing your patches tomorrow. I rolled back because I didn't have an easy way to get them out of the long timeout when it failed. | 02:13 |
| *** mkrai has joined #openstack-ironic | 02:14 | |
| *** dtantsur has quit IRC | 02:25 | |
| *** dtantsur has joined #openstack-ironic | 02:29 | |
| *** rcernin has joined #openstack-ironic | 02:29 | |
| *** rcernin has quit IRC | 02:29 | |
| *** naved001 has quit IRC | 02:29 | |
| *** rcernin has joined #openstack-ironic | 02:30 | |
| *** naved001 has joined #openstack-ironic | 02:33 | |
| *** Xuchu_ has joined #openstack-ironic | 02:43 | |
| *** rcernin has quit IRC | 02:44 | |
| *** Xuchu has quit IRC | 02:46 | |
| *** jamesdenton has quit IRC | 02:58 | |
| *** jamesdenton has joined #openstack-ironic | 02:58 | |
| *** dtantsur has quit IRC | 03:14 | |
| *** dtantsur has joined #openstack-ironic | 03:15 | |
| *** rcernin has joined #openstack-ironic | 03:16 | |
| *** uzumaki has joined #openstack-ironic | 03:53 | |
| *** paras333 has joined #openstack-ironic | 04:00 | |
| *** k_mouza has joined #openstack-ironic | 04:00 | |
| *** k_mouza has quit IRC | 04:05 | |
| *** zzzeek has quit IRC | 04:17 | |
| *** zzzeek has joined #openstack-ironic | 04:17 | |
| *** zzzeek has quit IRC | 04:22 | |
| *** zzzeek has joined #openstack-ironic | 04:23 | |
| *** mkrai has quit IRC | 04:30 | |
| *** mkrai_ has joined #openstack-ironic | 04:30 | |
| *** tzumainn has quit IRC | 05:08 | |
| *** zzzeek has quit IRC | 06:06 | |
| *** Xuchu_ has quit IRC | 06:22 | |
| *** Xuchu has joined #openstack-ironic | 06:22 | |
| *** anuradha1904 has joined #openstack-ironic | 06:23 | |
| *** jamesdenton has quit IRC | 06:27 | |
| *** jamesdenton has joined #openstack-ironic | 06:27 | |
| *** zzzeek has joined #openstack-ironic | 06:41 | |
| *** bnemec has quit IRC | 06:41 | |
| *** moshiur has joined #openstack-ironic | 06:48 | |
| *** bnemec has joined #openstack-ironic | 06:49 | |
| *** paras333 has joined #openstack-ironic | 06:53 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/ironic-ui master: Imported Translations from Zanata https://review.opendev.org/c/openstack/ironic-ui/+/778368 | 06:53 |
| *** mkrai_ has quit IRC | 06:55 | |
| *** paras333 has quit IRC | 06:57 | |
| openstackgerrit | Merged openstack/ironic-python-agent master: Remove default parameter from execute https://review.opendev.org/c/openstack/ironic-python-agent/+/778201 | 07:14 |
| *** paras333 has joined #openstack-ironic | 07:16 | |
| *** paras333 has quit IRC | 07:20 | |
| *** rcernin has quit IRC | 07:44 | |
| arne_wiebalck | Good morning, ironic! | 07:47 |
| *** rpittau|afk is now known as rpittau | 07:52 | |
| rpittau | good morning ironic! o/ | 07:52 |
| janders | good morning rpittau o/ | 08:11 |
| *** ociuhandu has joined #openstack-ironic | 08:13 | |
| openstackgerrit | Merged openstack/ironic-ui master: Imported Translations from Zanata https://review.opendev.org/c/openstack/ironic-ui/+/778368 | 08:14 |
| *** iurygregory_ has joined #openstack-ironic | 08:17 | |
| *** iurygregory has quit IRC | 08:18 | |
| *** ccstone has quit IRC | 08:22 | |
| *** ccstone has joined #openstack-ironic | 08:22 | |
| *** ociuhandu has quit IRC | 08:30 | |
| rpittau | hey janders :) | 08:31 |
| *** tosky has joined #openstack-ironic | 08:34 | |
| *** ociuhandu has joined #openstack-ironic | 08:35 | |
| *** mkrai has joined #openstack-ironic | 08:41 | |
| *** paras333_ has joined #openstack-ironic | 08:58 | |
| *** dougsz has joined #openstack-ironic | 08:59 | |
| *** paras333_ has quit IRC | 09:02 | |
| *** mkrai has quit IRC | 09:04 | |
| *** mkrai has joined #openstack-ironic | 09:04 | |
| *** lucasagomes has joined #openstack-ironic | 09:12 | |
| *** derekh has joined #openstack-ironic | 09:25 | |
| *** ociuhandu has quit IRC | 09:39 | |
| *** Xuchu has quit IRC | 09:43 | |
| *** frigo has joined #openstack-ironic | 09:44 | |
| frigo | good morning Ironic! i have a question on bifrost... I tried the master branch and it had all the cool features for UEFI support.. now I moved to the victoria branch for "stability" but.. it seems buggy and lacking a lot of features. I think my wish is to run bifrost master branch, with ironic from the victoria branch if that makes sense.. | 09:49 |
| frigo | Wondering if anyone here uses bifrost (or any other standalone distribution of ironic) | 09:49 |
| rpittau | frigo: you can try using the bifrost-cli command, there's an option to specify the branch to use, although I think it needs to match the bifrost release. If you saw bugs in bifrost you can report them in storyboard or directly here, maybe they're fixed in master and can be backproted to victoria | 09:59 |
| frigo | I see I could give a -e git_branch=stable/victoria maybe... but yes if we need to align bifrost with the rest that won't fly. I opened https://storyboard.openstack.org/#!/story/2008676, but basically I was mounting UEFI-compatible ISO and this seems to be supported only in the bifrost master branch | 10:04 |
| *** ociuhandu has joined #openstack-ironic | 10:04 | |
| *** sshnaidm|afk is now known as sshnaidm | 10:06 | |
| rpittau | frigo: that refers to rhel8.2 which I don't think it's supported, we're currently supporting centos stream which should be rhel >= 8.3 https://docs.openstack.org/bifrost/victoria/install/index.html | 10:12 |
| *** ociuhandu has quit IRC | 10:28 | |
| *** k_mouza has joined #openstack-ironic | 10:36 | |
| *** ociuhandu has joined #openstack-ironic | 10:37 | |
| rpittau | this should fix the build of ipa ramdisk in ussuri https://review.opendev.org/c/openstack/ironic-python-agent/+/778153 | 10:43 |
| rpittau | if anyone has a minute to check it | 10:43 |
| rpittau | one issue we have is that since we're building iso the ironic-python-agent-check-image-tinyipa-ussuri job will fail at that point | 10:44 |
| openstackgerrit | Dhuldev Valekar proposed openstack/ironic master: DRAC: Added redfish management clean steps https://review.opendev.org/c/openstack/ironic/+/721593 | 10:45 |
| rpittau | the fix was recently added to ipa-builder so unless we can modify version 2.2.0 and release a 2.2.1, that job will be broken | 10:46 |
| rpittau | or we can limit building the iso from victoria onwards | 10:46 |
| *** mkrai has quit IRC | 10:47 | |
| frigo | rpittau ticket updated :) | 10:49 |
| rpittau | frigo: can you please try with centos stream ? | 10:51 |
| frigo | argh, I thought I taken the latest centos, now I need to go and learn what's a centos stream | 10:51 |
| rpittau | frigo: just because we test with centos stream in victoria and it looks fine: https://review.opendev.org/c/openstack/bifrost/+/772926 | 10:52 |
| frigo | ok ok, hold my beer | 10:52 |
| rpittau | I can actually rebase that to see | 10:52 |
| openstackgerrit | Riccardo Pittau proposed openstack/bifrost stable/victoria: [DNM] test CI victoria https://review.opendev.org/c/openstack/bifrost/+/772926 | 10:53 |
| frigo | I think it used to work before the cryptography packaged started depending on rust, and everyone bumping the pip package version a few weeks ago. Just an hypothesis, going to try with the CentOS Stream version... | 10:57 |
| rpittau | frigo: it could be, I'm not entirely excluding it's broken | 10:57 |
| rpittau | mmm although I'm seeing alembic 1.4.2 installed with pip 19.1.1, I guess I can trigger a local installation and see how that goes | 11:01 |
| frigo | I'm doing just that, will report how it goes | 11:03 |
| frigo | so same error with the latest Centos Stream, but I did not run a yum update before, so I'm doing a last try with updated packages | 11:10 |
| *** paras333 has joined #openstack-ironic | 11:15 | |
| iurygregory_ | good morning Ironic | 11:19 |
| *** iurygregory_ is now known as iurygregory | 11:19 | |
| *** paras333 has quit IRC | 11:19 | |
| iurygregory | rpittau, fix for ipa-ussuri approved | 11:23 |
| iurygregory | rpittau, not 100% sure if we can release 2.2.1 (I think we can only do releases moving forward and we have 2.4.0 already...) | 11:25 |
| iurygregory | since ipa-builder is branchless | 11:25 |
| rpittau | frigo: I'm seeing the same error locally, let's see what the CI says | 11:36 |
| rpittau | iurygregory: yeah, not sure if we can do that | 11:36 |
| *** ociuhandu has quit IRC | 11:41 | |
| iurygregory | yep =( | 11:41 |
| frigo | rpittau ok. Anyway, bifrost victoria branch does not have all the features I want, so I'm going to stick to keep the master branch for now, until the next stable version is released... I just wish for bifrost to also "be branchless", so I could just use the master branch of bifrost with a stable version of ironic | 11:44 |
| rpittau | frigo: that's going to be hard as bifrost is usually tied to the features in ironic | 11:47 |
| *** frigo19 has joined #openstack-ironic | 11:48 | |
| *** frigo19 has quit IRC | 11:49 | |
| *** frigo51 has joined #openstack-ironic | 11:49 | |
| *** frigo has quit IRC | 11:50 | |
| *** frigo51 is now known as frigo | 11:50 | |
| openstackgerrit | Merged openstack/ironic stable/victoria: Handle agent still doing the prior command https://review.opendev.org/c/openstack/ironic/+/778237 | 11:56 |
| *** ociuhandu has joined #openstack-ironic | 12:12 | |
| *** ociuhandu has quit IRC | 12:17 | |
| janders | see you tomorrow Ironic o/ | 12:34 |
| rpittau | bye janders :) | 12:34 |
| *** ociuhandu has joined #openstack-ironic | 12:37 | |
| rpittau | frigo: CI seems ok and that's because we pin specific versions of the components setting a WORKSPACE dir, that option set some variables that will bypass the issue with alembic, otherwise you can set pip version to be >= 21.0.0 and it should work | 12:46 |
| iurygregory | bye janders o/ | 12:52 |
| openstackgerrit | Verification of a change to openstack/ironic-python-agent failed: Use UPPER_CONSTRAINTS_FILE to deal with ipa-builder https://review.opendev.org/c/openstack/ironic-python-agent/+/778153 | 13:01 |
| *** rh-jlabarre has quit IRC | 13:01 | |
| *** rh-jelabarre has joined #openstack-ironic | 13:11 | |
| *** rh-jelabarre has quit IRC | 13:11 | |
| *** rh-jelabarre has joined #openstack-ironic | 13:12 | |
| openstackgerrit | Riccardo Pittau proposed openstack/ironic-python-agent-builder master: Relax requirement of diskimage-builder https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/778457 | 13:17 |
| openstackgerrit | Riccardo Pittau proposed openstack/bifrost master: Upgrade pip version to fix pep-517 enforcing https://review.opendev.org/c/openstack/bifrost/+/778459 | 13:25 |
| openstackgerrit | Riccardo Pittau proposed openstack/bifrost master: Upgrade pip version to fix pep-517 enforcing https://review.opendev.org/c/openstack/bifrost/+/778459 | 13:26 |
| TheJulia | good morning | 13:36 |
| rpittau | good morning TheJulia :) | 13:38 |
| iurygregory | good morning TheJulia =) | 13:51 |
| TheJulia | Good morning | 13:51 |
| * TheJulia sips coffee and sees we may get to watch a SN10 launch today | 13:51 | |
| *** rloo has joined #openstack-ironic | 13:58 | |
| *** ociuhandu has quit IRC | 13:58 | |
| *** ociuhandu has joined #openstack-ironic | 13:59 | |
| *** ociuhandu has quit IRC | 14:04 | |
| *** ociuhandu has joined #openstack-ironic | 14:07 | |
| *** watersj has quit IRC | 14:23 | |
| *** iurygregory has quit IRC | 14:27 | |
| *** ociuhandu has quit IRC | 14:27 | |
| *** ociuhandu has joined #openstack-ironic | 14:28 | |
| *** iurygregory has joined #openstack-ironic | 14:29 | |
| *** ociuhandu has quit IRC | 14:33 | |
| arne_wiebalck | Good morning , TheJulia o/ | 14:34 |
| *** ociuhandu has joined #openstack-ironic | 14:40 | |
| *** tzumainn has joined #openstack-ironic | 14:45 | |
| *** frigo has quit IRC | 14:49 | |
| *** frigo has joined #openstack-ironic | 14:59 | |
| *** juanoterocas has joined #openstack-ironic | 15:02 | |
| *** mkrai has joined #openstack-ironic | 15:02 | |
| rpittau | anyone with a minute to spare please check https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/778457 and https://review.opendev.org/c/openstack/bifrost/+/778459 , it doesn't seem so but they're related :) | 15:43 |
| *** frigo has quit IRC | 15:50 | |
| *** moshiur has quit IRC | 16:01 | |
| *** mkrai has quit IRC | 16:05 | |
| *** mkrai has joined #openstack-ironic | 16:05 | |
| *** ociuhandu has quit IRC | 16:15 | |
| *** mkrai has quit IRC | 16:23 | |
| *** ayoung has quit IRC | 16:24 | |
| *** ociuhandu has joined #openstack-ironic | 16:31 | |
| openstackgerrit | Merged openstack/ironic master: Project Scoping Node endpoint https://review.opendev.org/c/openstack/ironic/+/773924 | 16:37 |
| *** frigo has joined #openstack-ironic | 16:38 | |
| *** anuradha1904 has quit IRC | 16:38 | |
| openstackgerrit | Bill Dodd proposed openstack/ironic master: Add Redfish RAID management to Ironic https://review.opendev.org/c/openstack/ironic/+/730000 | 16:44 |
| frigo | btw rpittau, still around the topic of versions of pip... this commit https://opendev.org/openstack/ironic-python-agent-builder/commit/7e2ba37e4a52181c246305985805f320be1c3e03 is not yet delivered in the latest ironic-python-agent-builder available on pypi. Is there something to do to deliver a new version in pypi? (or maybe pypi not a recommended | 16:53 |
| frigo | way to install the ipa builder?) | 16:53 |
| * TheJulia curses allocations | 16:55 | |
| TheJulia | frigo: we need to cut a release | 16:56 |
| rpittau | frigo: usually that is published to pypy after released | 16:56 |
| rpittau | frigo: but you can install ipa-builder from source | 16:56 |
| TheJulia | or we could cut a release | 16:56 |
| rpittau | we could, maybe we should | 16:57 |
| TheJulia | ++ | 16:57 |
| rpittau | let's | 16:57 |
| rpittau | I'm going to prepare it now | 16:58 |
| TheJulia | k | 16:58 |
| frigo | you guys rock :) | 16:58 |
| TheJulia | ping me when posted | 16:58 |
| rpittau | TheJulia: yup | 16:58 |
| TheJulia | I'm goign to go back to allocations and possibly consider becoming a witch and casting spells | 16:58 |
| rpittau | that would work | 16:58 |
| rpittau | mmm for ipa-builder I'll wait for https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/778457 to merge | 16:59 |
| TheJulia | ack | 17:00 |
| * TheJulia goes back to allocations and starts speaking fragments of latin | 17:00 | |
| *** pmannidi has quit IRC | 17:01 | |
| *** hoonetorg has quit IRC | 17:01 | |
| *** mkowalski has quit IRC | 17:01 | |
| *** lifeless_ has quit IRC | 17:01 | |
| *** mgoddard has quit IRC | 17:01 | |
| *** lucasagomes has quit IRC | 17:02 | |
| *** openstackgerrit has quit IRC | 17:02 | |
| rpittau | frigo: btw I submitted a couple of patches that should help with bifrost on victoria, thanks for reporting the issue with pip! | 17:05 |
| frigo | for IPA builder there is also this annoying thing https://bugs.launchpad.net/diskimage-builder/+bug/1916346 | 17:06 |
| openstack | Launchpad bug 1916346 in diskimage-builder "proliant-tools installation fails, miss dependencies" [Undecided,New] | 17:06 |
| frigo | (I guess at some point I will stop complaining and actually submit the fixes by myself like a grown up) | 17:06 |
| frigo | I gave up victoria and switches to the master branch. woohooo | 17:06 |
| rpittau | frigo: that works too :) | 17:06 |
| *** pmannidi has joined #openstack-ironic | 17:07 | |
| *** hoonetorg has joined #openstack-ironic | 17:07 | |
| *** mkowalski has joined #openstack-ironic | 17:07 | |
| *** lifeless_ has joined #openstack-ironic | 17:07 | |
| *** mgoddard has joined #openstack-ironic | 17:07 | |
| rpittau | frigo: for that issue I think you'll have to address it to DIB directly | 17:07 |
| frigo | oh indeed | 17:08 |
| *** ociuhandu_ has joined #openstack-ironic | 17:21 | |
| *** ayoung has joined #openstack-ironic | 17:24 | |
| *** ociuhandu has quit IRC | 17:25 | |
| *** ociuhandu_ has quit IRC | 17:26 | |
| arne_wiebalck | bye everyone o/ | 17:32 |
| *** ociuhandu has joined #openstack-ironic | 17:32 | |
| *** dougsz has quit IRC | 17:34 | |
| *** ociuhandu has quit IRC | 17:37 | |
| rpittau | problem: we can't use ipa-builder higher than 2.2.0 in ussuri to build and check ipa-ramdisk because we need to use bionic and tinycore 10.x BUT we can't check/build iso because it was only fixed recently | 17:41 |
| rpittau | so or we remove the iso check from ipa-builder entirely, or we check it only from victoria onwards in some way, or we backport the fix to ipa-builder (which is branchless....) in some other way | 17:41 |
| iurygregory | the iso check we have in 2.2.0 is broken? | 17:58 |
| rpittau | yep | 17:58 |
| iurygregory | ouch | 18:01 |
| iurygregory | can we skip the check/build fo iso in ussuri? | 18:01 |
| iurygregory | not sure if we have some env var that controls the build for iso etc | 18:02 |
| rpittau | yeah, I think, I just published a WIP patch for that | 18:02 |
| rpittau | https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/778526 | 18:02 |
| iurygregory | nice | 18:03 |
| rpittau | I don't really like it though, I think it's a point in favor of having ipa-builder branches | 18:04 |
| iurygregory | yeah, well it's a workaround we will need (or we can just create branches in ipa and backport?!) | 18:04 |
| iurygregory | create a branch based on the tag probably and we can try to backport... | 18:05 |
| rpittau | that would be the ideal path | 18:05 |
| *** derekh has quit IRC | 18:05 | |
| iurygregory | gotcha, just wondering what stable team will think XD | 18:06 |
| rpittau | heh yeah | 18:06 |
| * iurygregory hides | 18:07 | |
| rpittau | :) | 18:09 |
| rpittau | is gerrit bot dead ? | 18:09 |
| rpittau | anyway... | 18:10 |
| rpittau | in theory we could backport the fix on top of 2.2.0 and manually request a 2.2.1 release with that commit, it might work (so convoluted....) | 18:10 |
| rpittau | TheJulia: https://review.opendev.org/c/openstack/releases/+/778529 | 18:11 |
| rpittau | oh well, maybe we can discuss during the next meeting | 18:11 |
| rpittau | bye everyone! o/ | 18:11 |
| *** rpittau is now known as rpittau|afk | 18:11 | |
| iurygregory | rpittau|afk, probably on pto =P | 18:14 |
| iurygregory | bye rpittau|afk | 18:14 |
| *** thiagop has joined #openstack-ironic | 18:33 | |
| *** thiagop is now known as outbrito | 18:33 | |
| eandersson | TheJulia gonna go back to trying your patches again. I rolled back as they caused the nodes to get stuck in waiting. | 18:33 |
| TheJulia | ok | 18:33 |
| eandersson | I also tried changing heartbeats to something high like 300s | 18:33 |
| eandersson | but didn't make a difference | 18:33 |
| *** frigo has quit IRC | 18:34 | |
| eandersson | *initially rolledback | 18:34 |
| *** bburns has quit IRC | 18:44 | |
| *** juanoterocas has quit IRC | 18:46 | |
| *** bburns has joined #openstack-ironic | 18:46 | |
| *** frigo has joined #openstack-ironic | 18:59 | |
| *** sshnaidm is now known as sshnaidm|afk | 19:00 | |
| bdodd | I guess that when zuul runs tests it downloads Python packages from pypi mirrors that may not have the latest. Is there a way to tell when or if the mirrors have a particular package version? (in this case sushy 3.7.0) | 19:01 |
| TheJulia | bdodd: hmm | 19:02 |
| TheJulia | bdodd: typically that is a sign of a mirror issue | 19:02 |
| TheJulia | when did this job run? | 19:03 |
| *** frigo59 has joined #openstack-ironic | 19:03 | |
| bdodd | Just now | 19:03 |
| *** frigo59 has quit IRC | 19:03 | |
| TheJulia | okay, so if memory serves, and fungi likely knows way better, but I think all the mirrors point at fastly and that points at a pypi regional mirror cache which las limited space in ?london? if memory serves | 19:03 |
| TheJulia | s/las/has/ | 19:03 |
| TheJulia | it could have run out again.. | 19:03 |
| *** frigo has quit IRC | 19:05 | |
| fungi | yes, our pypi "mirror" urls are simply localized apache mod_proxy caches which forward requests to pypi.org with a short timeout on the indices (the other files are immutable, save for deletions, as pypi stores them by checksum) | 19:06 |
| fungi | bdodd: have a link to the build failure on zuul.o.o? i can see if i can read the tea lives for it | 19:07 |
| bdodd | fungi Thanks. Yes, here is the failure: https://zuul.opendev.org/t/openstack/build/6bd69ebcad584e77bfabced297e7e4e6 | 19:08 |
| fungi | er, tea leaves too | 19:09 |
| fungi | thanks, sometimes these errors are not so straightforward as they might appear from the output | 19:09 |
| *** juanoterocas has joined #openstack-ironic | 19:14 | |
| fungi | bdodd: TheJulia: you'll want to depends-on https://review.opendev.org/778367 or wait until it merges | 19:14 |
| fungi | pip was asked to install a version of sushy strictly greater than the version being constrainted by the central upper-constraints.txt file | 19:15 |
| bdodd | fungi Ah, thanks. I had only been watching https://review.opendev.org/c/openstack/releases/+/777960 | 19:18 |
| eandersson | It is looking good TheJulia | 19:18 |
| TheJulia | \o/ | 19:18 |
| TheJulia | oh yeah, that does need to merge | 19:18 |
| TheJulia | eandersson: awesome | 19:18 |
| fungi | bdodd: conveniently, the constraints patches are automatically pushed by the release process via another zuul job, so at least the only human intervention is for a requirements reviewer to approve them. but lengthy integrated gate queues can delay merging by a bit | 19:21 |
| eandersson | Maybe I called that one too early. It seems stuck now. | 19:24 |
| eandersson | The Ironic logs made it look like it was retrying, but the IPA logs does not show the same. | 19:25 |
| eandersson | Also, it never respected the reboot_requested flag | 19:25 |
| eandersson | We might actually be stuck in a race condition now because nothing has logged in over 15 minutes | 19:30 |
| eandersson | *deadlock | 19:30 |
| eandersson | I see it trying to do many tasks twice lol | 19:33 |
| bdodd | fungi Got it. Makes sense. Thanks for the help and the explanation! | 19:35 |
| * TheJulia is glued to SN10 launch at the moment | 19:41 | |
| TheJulia | eandersson: so.. hmm | 19:46 |
| TheJulia | connection retries I guess | 19:46 |
| TheJulia | ugh | 19:46 |
| eandersson | http://paste.openstack.org/show/X65G1aHmyc8OTfNH0XPX/ | 19:48 |
| eandersson | This is the firmware step | 19:48 |
| *** frigo has joined #openstack-ironic | 19:50 | |
| *** frigo has quit IRC | 19:50 | |
| TheJulia | hmmm | 19:51 |
| eandersson | The bash script in this case is just a simple script with sleep 60 && exit 0 | 19:51 |
| eandersson | but the error happened without a sleep as well | 19:52 |
| *** lifeless_ is now known as lifeless | 19:56 | |
| * TheJulia smiles seeing signs of life from lifeless | 20:28 | |
| *** rcernin has joined #openstack-ironic | 20:46 | |
| *** k_mouza has quit IRC | 20:49 | |
| *** openstackgerrit has joined #openstack-ironic | 20:54 | |
| openstackgerrit | Francois Rigault proposed openstack/bifrost master: Relax format of checksum file https://review.opendev.org/c/openstack/bifrost/+/778578 | 20:54 |
| TheJulia | stevebaker: so looking at https://docs.openstack.org/api-ref/baremetal/?expanded=list-allocations-detail#list-allocations I'm thinking node search doesn't actully work... | 20:57 |
| TheJulia | oh, nevermind | 20:57 |
| TheJulia | I see get_all maps to it | 20:57 |
| stevebaker | node search? | 20:59 |
| TheJulia | yeah | 20:59 |
| * TheJulia adds another option | 21:00 | |
| *** gyee has joined #openstack-ironic | 21:01 | |
| lifeless | TheJulia: o/ | 21:01 |
| stevebaker | lifeless: hey stranger | 21:01 |
| lifeless | stevebaker: hey hey | 21:02 |
| TheJulia | lifeless: how goes the new hemisphere? | 21:02 |
| lifeless | TheJulia: 2 really.. both west and north are new to us :). And good. | 21:03 |
| TheJulia | lifeless: Awesome! | 21:03 |
| lifeless | Spring has sprung, so it looks like we survived winter. | 21:03 |
| lifeless | Repairs on the new house start Monday | 21:03 |
| TheJulia | Very nice! | 21:03 |
| lifeless | Work is fun... though we really need more excellent people to come join us ;) | 21:04 |
| openstackgerrit | Julia Kreger proposed openstack/ironic master: WIP: Allocation support for project scoped RBAC https://review.opendev.org/c/openstack/ironic/+/778340 | 21:05 |
| TheJulia | stevebaker: Okay,, I've got all the ACL tests passing... finally. I still need to strip prints out and clean things up quite a lot, but extra sanity checking would be very welcome since it is the completely different controller | 21:05 |
| TheJulia | ^^ | 21:05 |
| TheJulia | oh, and looks like I have 80+ standard unit tests failing... from the prior patch in the series 8( Most likely it is just return code changes | 21:06 |
| TheJulia | but I can look at that tomorrow on a fresh brain | 21:07 |
| TheJulia | wut... only 4 tests failing | 21:09 |
| TheJulia | Where is vincini, I need him to say inconcievable! | 21:09 |
| stevebaker | TheJulia: I'll check it out, actually this time | 21:09 |
| lifeless | You keep using that word. I do not think it means what you think it means. | 21:10 |
| * TheJulia looks at the 8177 tests passing and is just mind boggling that we've added like 1500 in 2 months | 21:11 | |
| JayF | put that in the release notes for Wallaby, lol | 21:17 |
| JayF | (that is 100% a serious suggestion) | 21:17 |
| *** rcernin has quit IRC | 21:17 | |
| TheJulia | I was already thinking about it | 21:18 |
| TheJulia | it is a bit insane | 21:18 |
| *** irclogbot_0 has quit IRC | 21:33 | |
| *** ianw has quit IRC | 21:33 | |
| *** zer0c00l has quit IRC | 21:33 | |
| *** shadower has quit IRC | 21:33 | |
| *** janders has quit IRC | 21:33 | |
| *** irclogbot_0 has joined #openstack-ironic | 21:34 | |
| *** ianw has joined #openstack-ironic | 21:34 | |
| *** zer0c00l has joined #openstack-ironic | 21:34 | |
| *** shadower has joined #openstack-ironic | 21:34 | |
| *** janders has joined #openstack-ironic | 21:34 | |
| *** zzzeek has quit IRC | 21:44 | |
| *** zzzeek has joined #openstack-ironic | 21:45 | |
| *** devtolu1__ has joined #openstack-ironic | 21:47 | |
| *** juanoterocas has quit IRC | 21:49 | |
| *** juanoterocas has joined #openstack-ironic | 21:51 | |
| *** devtolu1__ has quit IRC | 21:54 | |
| *** rcernin has joined #openstack-ironic | 22:05 | |
| *** rcernin has quit IRC | 22:11 | |
| *** rcernin has joined #openstack-ironic | 22:11 | |
| *** jamesdenton has quit IRC | 22:15 | |
| *** jamesdenton has joined #openstack-ironic | 22:15 | |
| eandersson | Finally found a work around for the the issue with reboot_requested. Not sure the cause yet, but I changed the priority to be the first task (priority 99) and it worked. | 22:22 |
| eandersson | It was set to priority 70 before. | 22:22 |
| *** sdanni has quit IRC | 22:39 | |
| TheJulia | hmm | 22:48 |
| TheJulia | hmmm | 22:48 |
| *** k_mouza has joined #openstack-ironic | 22:49 | |
| *** juanoterocas has quit IRC | 22:52 | |
| *** k_mouza has quit IRC | 22:54 | |
| *** rcernin has quit IRC | 22:56 | |
| *** rcernin has joined #openstack-ironic | 23:01 | |
| *** rloo has quit IRC | 23:01 | |
| *** k_mouza has joined #openstack-ironic | 23:17 | |
| *** k_mouza has quit IRC | 23:22 | |
| *** uzumaki has quit IRC | 23:23 | |
| *** uzumaki has joined #openstack-ironic | 23:24 | |
| *** rcernin has quit IRC | 23:26 | |
| *** k_mouza has joined #openstack-ironic | 23:27 | |
| *** k_mouza has quit IRC | 23:31 | |
| *** k_mouza has joined #openstack-ironic | 23:36 | |
| janders | good morning Ironic o/ | 23:37 |
| *** zzzeek has quit IRC | 23:40 | |
| janders | TheJulia I fixed up https://review.opendev.org/c/openstack/ironic/+/778134 as per your and Riccardo's comments and I'm after the second review if you have the time. | 23:40 |
| *** k_mouza has quit IRC | 23:41 | |
| *** zzzeek has joined #openstack-ironic | 23:42 | |
| stevebaker | janders: hey | 23:45 |
| janders | hey stevebaker o/ | 23:45 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!