| *** mrunge_ is now known as mrunge | 07:32 | |
| opendevreview | Antoine Musso proposed opendev/git-review master: Command to delete applied local branches https://review.opendev.org/c/opendev/git-review/+/955094 | 09:32 |
|---|---|---|
| stephenfin | fungi: There are a few pbr changes awaiting your attention, should you have time today https://review.opendev.org/q/project:openstack/pbr+is:open 🙏 | 10:10 |
| fungi | thanks stephenfin! i think i got through all of the open ones now | 16:16 |
| fungi | though looks like there's a merge conflict in some of the approved commits now | 16:18 |
| corvus | i'm going to restart the zuul schedulers, web, and launchers | 16:20 |
| fungi | thanks! i sadly have to disappear in about 20 minutes for a dental checkup but that should hopefully not take more than 60-90 minutes | 16:21 |
| corvus | it does look like the weekend restart failed again | 16:24 |
| corvus | apt lock on zm07; likely same problem as before | 16:25 |
| fungi | hrm... | 16:28 |
| fungi | different server this time, i think it was ze09 previously? | 16:29 |
| corvus | yeah, i just mean it seems like we're pretty consistently colliding with, i guess, an unattended upgrades run on the noble servers | 16:33 |
| corvus | if that's the case, i'd expect it to be a little different each time due to timing | 16:33 |
| opendevreview | James E. Blair proposed openstack/project-config master: Disable nodepool for all tenants https://review.opendev.org/c/openstack/project-config/+/955214 | 16:38 |
| fungi | well, last time the process was hung in the middle of an update | 16:38 |
| corvus | ooohh lemme check zm07 to see if it's still running | 16:40 |
| fungi | and yeah, in this case i see an apt-get update process with a start date of june 30, so maybe it hung around the same time as ze09 and we just never noticed | 16:40 |
| corvus | ah that makes sense | 16:40 |
| fungi | probably we need to check them all, i can try to scan for other instances when i get back from my appointment | 16:40 |
| fungi | headed out now | 16:40 |
| corvus | i'll kill the underlying command on zm07 | 16:41 |
| corvus | fungi: have fun | 16:41 |
| fungi | i think that's what i did last time, yeah | 16:41 |
| fungi | thanks! always a joy to get my teeth scraped at and photographed | 16:41 |
| corvus | https://review.opendev.org/955220 should fix an issue i observed in opendev... we're leaking lock znodes. that could become a problem if we leak too many. i'm going to manually delete the ones i see now to make sure we have headroom. | 17:38 |
| fungi | cool, taking a look in a sec | 17:45 |
| fungi | yeah, lgtm and the child change for it as well | 18:14 |
| corvus | thanks! | 18:17 |
| corvus | the requisite components have been restarted, so we're ready for https://review.opendev.org/955214 any time | 18:17 |
| fungi | i've approved it | 18:23 |
| corvus | cool, when that's done, i'll shut down nodepool servers and let them sit idle for a while | 18:25 |
| fungi | i checked zm08 and it didn't have any stuck apt-get processes | 18:30 |
| fungi | the rest of the servers seem to have upgraded so they were already in okay shape | 18:30 |
| opendevreview | Merged openstack/project-config master: Disable nodepool for all tenants https://review.opendev.org/c/openstack/project-config/+/955214 | 18:34 |
| fungi | woo!!! | 18:35 |
| corvus | wow the nodepool secret vars are a trip down memory lane | 18:47 |
| fungi | Build succeeded (deploy pipeline). | 18:54 |
| opendevreview | James E. Blair proposed opendev/system-config master: Remove nodepool documentation https://review.opendev.org/c/opendev/system-config/+/955228 | 19:18 |
| opendevreview | James E. Blair proposed opendev/system-config master: Remove nodepool configuration https://review.opendev.org/c/opendev/system-config/+/955229 | 19:18 |
| corvus | the nodepoolectomy ^ | 19:18 |
| corvus | no rush on that; i don't think we should merge those until we're about ready to delete the servers (like.. next week?) | 19:19 |
| corvus | as part of that, i did perform some cleanup of some very obviously not-used variables in hiera on bridge. i don't expect any fallout, obviously, but mentioning it in case i introduced a mistake. | 19:20 |
| corvus | (mostly, i did things like delete the gearman ssl cert info, and jenkins api keys) | 19:20 |
| fungi | trip down memory lane indeed | 20:11 |
| opendevreview | James E. Blair proposed openstack/project-config master: Remove nodepool config jobs https://review.opendev.org/c/openstack/project-config/+/955235 | 20:18 |
| opendevreview | James E. Blair proposed opendev/system-config master: Remove nodepool configuration https://review.opendev.org/c/opendev/system-config/+/955229 | 20:20 |
| corvus | now that undefined labels are an error, i updated https://review.opendev.org/954761 to change our approach to the xenial "dummy" nodesets we added earlier; so that is now an omnibus fix-the-errors change in openstack-zuul-jobs. | 20:35 |
| fungi | awesome | 20:36 |
| hashar | hi it is late for me, but I suspect `git-review -T sometopic` ends up pushing to `refs/for/sometopic` and the change is shown as targetting the non existing branch "sometopic" :) | 20:42 |
| hashar | cause it no more sets a default topic: https://review.opendev.org/c/opendev/git-review/+/921879 | 20:42 |
| hashar | what I suspect is `-T` is ignored and no more consumes the next argument | 20:42 |
| hashar | which ends up becoming the branch | 20:42 |
| hashar | but it is too late for me to verify and I am almost sleeping :) I will try to remember about it tomorrow | 20:43 |
| hashar | or I am confusied somehow :) | 20:44 |
| corvus | looking at the code, it looks like "-T" was just a toggle and never should have consumed an argument | 20:44 |
| hashar | yeah :) I need more detailled reports from our users | 20:44 |
| corvus | "-t" (lowercase) does consume and argument (and should still work) | 20:44 |
| hashar | +1 :) | 20:44 |
| opendevreview | James E. Blair proposed opendev/zuul-providers master: Remove niz- nodesets https://review.opendev.org/c/opendev/zuul-providers/+/955239 | 20:45 |
| opendevreview | James E. Blair proposed opendev/zuul-providers master: Remove niz- labels from providers https://review.opendev.org/c/opendev/zuul-providers/+/955240 | 20:45 |
| opendevreview | James E. Blair proposed opendev/zuul-providers master: Remove niz- labels https://review.opendev.org/c/opendev/zuul-providers/+/955241 | 20:45 |
| fungi | yes, seems like they probably want -t instead of -T there | 20:47 |
| corvus | cool, all 3 of those are green; so it looks like we did clean up all the niz- stuff and we can merge those now | 20:47 |
| hashar | fungi: yeah I suspect someone mixed up -t and -T indeed. | 20:49 |
| hashar | anyway we shall see, if there is an issue I'll come back with a patch:) | 20:49 |
| * hashar sleeps | 20:49 | |
| fungi | corvus: minor comment on the first one. nearly-nit but probably better to clean up now rather than later | 20:50 |
| opendevreview | James E. Blair proposed opendev/zuul-providers master: Remove niz- nodesets https://review.opendev.org/c/opendev/zuul-providers/+/955239 | 20:51 |
| opendevreview | James E. Blair proposed opendev/zuul-providers master: Remove niz- labels from providers https://review.opendev.org/c/opendev/zuul-providers/+/955240 | 20:51 |
| opendevreview | James E. Blair proposed opendev/zuul-providers master: Remove niz- labels https://review.opendev.org/c/opendev/zuul-providers/+/955241 | 20:51 |
| corvus | fungi: yep thanks! | 20:51 |
| opendevreview | Merged opendev/zuul-providers master: Remove niz- nodesets https://review.opendev.org/c/opendev/zuul-providers/+/955239 | 22:49 |
| opendevreview | Merged opendev/zuul-providers master: Remove niz- labels from providers https://review.opendev.org/c/opendev/zuul-providers/+/955240 | 22:49 |
| opendevreview | Merged opendev/zuul-providers master: Remove niz- labels https://review.opendev.org/c/opendev/zuul-providers/+/955241 | 22:50 |
Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!