| DeHackEd | opened as a bug report, and included the code I'm using | 00:48 |
|---|---|---|
| opendevreview | Merged openstack/swift master: Use entry_points for server executables https://review.opendev.org/c/openstack/swift/+/918365 | 02:35 |
| opendevreview | ASHWIN A NAIR proposed openstack/swift master: object-server: return 503 not 404 if meta or data file unlinked https://review.opendev.org/c/openstack/swift/+/909674 | 17:57 |
| opendevreview | ASHWIN A NAIR proposed openstack/swift master: object-server: return 503 not 404 if meta or data file unlinked https://review.opendev.org/c/openstack/swift/+/909674 | 18:02 |
| opendevreview | ASHWIN A NAIR proposed openstack/swift master: object-server: return 503 not 404 if meta or data file unlinked https://review.opendev.org/c/openstack/swift/+/909674 | 18:13 |
| kota | good morning | 20:56 |
| timburke | kota, o/ | 20:57 |
| fuleco | Hello o/ | 20:57 |
| kota | o/ | 20:57 |
| timburke | #startmeeting swift | 21:00 |
| opendevmeet | Meeting started Wed Jul 10 21:00:15 2024 UTC and is due to finish in 60 minutes. The chair is timburke. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:00 |
| opendevmeet | The meeting name has been set to 'swift' | 21:00 |
| timburke | who's here for the swift meeting? | 21:00 |
| kota | o/ | 21:00 |
| fuleco | I'm here | 21:00 |
| mattoliver | o/ | 21:01 |
| timburke | as usual, the agenda's at | 21:01 |
| timburke | #link https://wiki.openstack.org/wiki/Meetings/Swift | 21:01 |
| timburke | first up, just a few status updates | 21:01 |
| timburke | #topic account-reaper and sharded containers | 21:02 |
| timburke | #link https://bugs.launchpad.net/swift/+bug/2070397 | 21:02 |
| patch-bot | Bug #2070397 - Account reaper do not reap sharded containers (New) | 21:02 |
| timburke | i still haven't even started on a probe test for it :-( | 21:02 |
| timburke | if anyone else would like to take a stab at it, you'd be more than welcome -- otherwise, i'll try to use this meeting to keep it on my radar | 21:03 |
| timburke | #topic cooperative tokens | 21:03 |
| mattoliver | Oh, because it won't shrink the empty shards | 21:03 |
| timburke | mattoliver, i think it goes deeper than that -- i think it can't even list the objects to delete | 21:04 |
| mattoliver | Oh, it's talking to the broker, so not getting objects | 21:04 |
| mattoliver | Damn, yeah Oh course! Good find | 21:04 |
| timburke | yeah, direct_client to get around the 410... | 21:04 |
| timburke | #link https://review.opendev.org/c/openstack/swift/+/890174 | 21:05 |
| patch-bot | patch 890174 - swift - common: add memcached based cooperative token mech... - 33 patch sets | 21:05 |
| timburke | looks like jianjian has gotten some reviews and things keep moving forward | 21:05 |
| mattoliver | Yup, I've been living at it | 21:06 |
| mattoliver | *looking | 21:06 |
| timburke | thanks mattoliver! i also seem to remember hearing good things about it as we've been cautiously trying it out in prod, but i don't have any numbers at my fingertips right now | 21:07 |
| mattoliver | (Sorry visitors sleeping my my office, so on my phone for meeting, so auto correct going to be a pain) | 21:07 |
| timburke | no worries :-) | 21:07 |
| timburke | #topic pkg_resources warnings in editable installs | 21:07 |
| timburke | first patch merged! | 21:07 |
| timburke | #link https://review.opendev.org/c/openstack/swift/+/918365 | 21:07 |
| patch-bot | patch 918365 - swift - Use entry_points for server executables (MERGED) - 4 patch sets | 21:07 |
| timburke | thanks mattoliver and zaitcev! | 21:08 |
| mattoliver | Well we've rolled it out to 1/2 of prod and initial numbers look awesome and promising (re coop) | 21:08 |
| timburke | next in the chain is still fairly mechanical | 21:08 |
| timburke | #link https://review.opendev.org/c/openstack/swift/+/922151 | 21:08 |
| patch-bot | patch 922151 - swift - Use entry_points for a bunch more executables - 4 patch sets | 21:08 |
| mattoliver | Nps, will work my way up the chain | 21:08 |
| mattoliver | That next one is a big one 😀 | 21:09 |
| timburke | as we get further out, more code ends up moving, so i expect them to trigger more discussion | 21:09 |
| timburke | #topic ISO timestamps and swift-drive-audit | 21:10 |
| timburke | DeHackEd brought this to our attention | 21:10 |
| timburke | #link https://bugs.launchpad.net/swift/+bug/2072609 | 21:10 |
| patch-bot | Bug #2072609 - swift-drive-audit does not handle ISO timestamps in logs (New) | 21:10 |
| timburke | and even provided a fix in the bug report | 21:10 |
| timburke | i'll aim to get a patch up later today, if anyone can spare some review cycles | 21:11 |
| mattoliver | Oh nice | 21:11 |
| mattoliver | Yup, just ping me to remind me | 21:12 |
| timburke | 👍 | 21:12 |
| timburke | next up | 21:12 |
| timburke | #topic multi-policy containers | 21:12 |
| timburke | fuleco, how's it going? anything else you need from us in the short term? | 21:12 |
| fuleco | So for this we are still running some testing and it's been working good until now | 21:13 |
| fuleco | I think we're in good shape as it is, just gonna take us some time to wrap it up and send upstream | 21:13 |
| mattoliver | Cool | 21:13 |
| timburke | 🎉 | 21:13 |
| timburke | all right then, last item i've got | 21:14 |
| timburke | #topic operator-driven node exclusion | 21:14 |
| timburke | zigo brought my attention to this message on the ML (thanks, i probably would have missed it otherwise!) | 21:15 |
| timburke | #link https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/IZUXNXUQFKBZIP6YIOQJMLXPK5RI6M45/ | 21:15 |
| timburke | core idea is to give operators the ability to tell proxies to ignore specific backend nodes, and dynamically manipulate that ignore list | 21:16 |
| mattoliver | Oh interesting, I haven't read it yet, bit what they auto adding things to error limitted nodes or something | 21:16 |
| mattoliver | Lol, so yes | 21:17 |
| mattoliver | Maybe.. I should look | 21:17 |
| mattoliver | I guess I'd like to know the usecase | 21:18 |
| timburke | kind of, but not exactly. it's a sticky flag and requires some process to clear it when the node's back up/should receive traffic | 21:18 |
| timburke | my read has been that there are at least a couple different use-cases | 21:19 |
| mattoliver | Ok, so a "better" or more global error limitted list maybe. | 21:19 |
| timburke | there's flagging known-failed devices that you're in the process of replacing -- and even once the device is replaced and remounted, you might want to avoid proxies talking to it so it can focus on incoming rsyncs | 21:20 |
| mattoliver | We have discussed in the past the ability to disable nodes in the ring, but this sounds more dynamic, which is good. | 21:20 |
| mattoliver | Kk, interesting I guess best if a give it a read rather then speculating. Because I wonder how the sticky flag will work etc. | 21:22 |
| timburke | yeah, i was thinking that it might work well in the ring file, too -- there seemed to be some concern about the time required to propagate configs though | 21:22 |
| timburke | i think the cardinality is expected to be pretty small, so everything's written in a flat file, one ip:port to exclude per line | 21:23 |
| mattoliver | Ok, but sp long as we're sure it'll be small, in swift things tend to grow :😜 | 21:24 |
| mattoliver | I did have that global error limitor patch that uses memcache.. so could do something similar. | 21:24 |
| timburke | but yeah, it definitely felt related (but decidedly different!) to some other ideas we've had over the years, like ring v2 and clayg's overseer | 21:24 |
| mattoliver | Yeah | 21:25 |
| timburke | the concern about config propagation time kind of makes me want to pick up https://review.opendev.org/c/openstack/swift/+/670674 again and give it some gossip protocol... | 21:26 |
| patch-bot | patch 670674 - swift - WIP: Allow ring lookups via a service - 3 patch sets | 21:26 |
| timburke | anyway, i wanted to make sure that other people saw the conversation | 21:27 |
| timburke | that's all i've got for this week | 21:27 |
| timburke | #topic open discussion | 21:27 |
| timburke | anything else we should bring up this week? | 21:27 |
| mattoliver | Well I'm still reorienting after vacation. Am playing with not hashing memcache key prefixes (so I can play with prefix routing) in the memcache layer.. but that still early work. | 21:28 |
| mattoliver | And just want to have a patch in our back pocket incase it's needed. | 21:29 |
| mattoliver | Will push something up to gerrit soon but it'll be wip | 21:30 |
| mattoliver | Well I should say, optionally not hashing prefixes. I wouldn't just change behaviour. We use mcrouter, so could be really interesting for us. | 21:31 |
| timburke | sounds good -- would that be an update to https://review.opendev.org/c/openstack/swift/+/890139 or a new patch? | 21:32 |
| patch-bot | patch 890139 - swift - proxy-server: use a prefixed shard range cache key - 1 patch set | 21:32 |
| mattoliver | Yeah, update that, and modernise | 21:34 |
| timburke | 👍 | 21:34 |
| mattoliver | Seems swift has moved on a little in the way memcache keys work :) | 21:35 |
| mattoliver | And we (swift) have some summer school students working on some stuff. They've pushed up some patches and also plan to tackle some sharper and storage policy index ops tooling for us | 21:35 |
| mattoliver | *sigh* sharder | 21:35 |
| timburke | oh yeah! should we go ahead and merge https://review.opendev.org/c/openstack/swift/+/921664 ? i'm kind of inclined to | 21:35 |
| patch-bot | patch 921664 - swift - add object-count quota for accounts in middleware - 3 patch sets | 21:35 |
| mattoliver | Thanks timburke | 21:36 |
| mattoliver | Yeah, I might go merge that 😀 | 21:36 |
| mattoliver | There is also a reaper patch | 21:36 |
| timburke | https://review.opendev.org/c/openstack/swift/+/922833 | 21:36 |
| patch-bot | patch 922833 - swift - Periodic reaper recon dump showing current progress - 5 patch sets | 21:36 |
| timburke | (which i should be sure to take a look at) | 21:36 |
| mattoliver | Yup thanks! | 21:36 |
| mattoliver | There is a follow up to the quota one if anyone is interesting in writing 😀 | 21:37 |
| mattoliver | Basically moving the api to x-account-quota namespace and store in sysmeta | 21:38 |
| mattoliver | That's all I can think of atm | 21:39 |
| timburke | all right, i think i'll call it early then | 21:39 |
| timburke | thank you all for coming, and thank you for working on swift! | 21:39 |
| timburke | #endmeeting | 21:39 |
| opendevmeet | Meeting ended Wed Jul 10 21:39:59 2024 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 21:39 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/swift/2024/swift.2024-07-10-21.00.html | 21:39 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/swift/2024/swift.2024-07-10-21.00.txt | 21:39 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/swift/2024/swift.2024-07-10-21.00.log.html | 21:39 |
| indianwhocodes | o/ - too late , will just catch up on the msgs | 22:03 |
| opendevreview | Clay Gerrard proposed openstack/swift master: Delete s3api MPU segments when expiring the manifest https://review.opendev.org/c/openstack/swift/+/800701 | 23:01 |
| opendevreview | Clay Gerrard proposed openstack/swift master: DNM expirer: new options to control task iteration https://review.opendev.org/c/openstack/swift/+/914713 | 23:01 |
| opendevreview | Clay Gerrard proposed openstack/swift master: Configurable object_expirer_task_container_per_day https://review.opendev.org/c/openstack/swift/+/920452 | 23:01 |
| opendevreview | Clay Gerrard proposed openstack/swift master: refactor: remove iter_task_accounts_to_expire https://review.opendev.org/c/openstack/swift/+/919639 | 23:01 |
| opendevreview | Clay Gerrard proposed openstack/swift master: Parallel distirbuted task container iteration https://review.opendev.org/c/openstack/swift/+/918366 | 23:01 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!