Wednesday, 2024-09-25

opendevreviewJianjian Huo proposed openstack/swift master: Object-expirer: continue to process next container on listing errors  https://review.opendev.org/c/openstack/swift/+/93039300:52
opendevreviewJianjian Huo proposed openstack/swift master: Object-expirer: continue to process next container on listing errors  https://review.opendev.org/c/openstack/swift/+/93039301:01
opendevreviewAlistair Coles proposed openstack/swift feature/mpu: merge master to feature/mpu  https://review.opendev.org/c/openstack/swift/+/93048014:44
opendevreviewAlistair Coles proposed openstack/swift feature/mpu: mpu: cleanup mpu GET and HEAD response headers.  https://review.opendev.org/c/openstack/swift/+/93036914:50
opendevreviewAlistair Coles proposed openstack/swift feature/mpu: WIP: func test symlink to MPU  https://review.opendev.org/c/openstack/swift/+/93023514:50
opendevreviewAlistair Coles proposed openstack/swift feature/mpu: func tests: fix etag-quoter insertion in pipeline  https://review.opendev.org/c/openstack/swift/+/93048214:50
opendevreviewAlistair Coles proposed openstack/swift feature/mpu: mpu: fix listParts response headers  https://review.opendev.org/c/openstack/swift/+/93048314:50
opendevreviewClay Gerrard proposed openstack/swift master: implement_spooky_action_at_distance  https://review.opendev.org/c/openstack/swift/+/93049115:52
opendevreviewAlistair Coles proposed openstack/swift master: proxy: fix is_useful_response for py2  https://review.opendev.org/c/openstack/swift/+/93050018:00
timburke#startmeeting swift21:00
opendevmeetMeeting started Wed Sep 25 21:00:02 2024 UTC and is due to finish in 60 minutes.  The chair is timburke. Information about MeetBot at http://wiki.debian.org/MeetBot.21:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.21:00
opendevmeetThe meeting name has been set to 'swift'21:00
timburkewho's here for the swift meeting?21:00
fulecorafao/21:00
mattolivero/21:01
timburkeas usual, the agenda's at21:01
timburke#link https://wiki.openstack.org/wiki/Meetings/Swift21:01
timburkefirst up21:01
timburke#topic PTG21:02
timburkeit's only a month away!21:02
acoleso/ sorry I'm late21:02
timburkewe *are* signed up now, at least :-)21:02
timburkeregistration is appreciated21:02
timburke#link https://ptg2024.openinfra.dev/21:02
mattoliveroh yeah, need to add topics to the etherpad. I'll try and think of things you haven't added today.21:03
timburkeand we need to choose some meeting slot times21:03
timburke#link https://framadate.org/LQOsGVVWXDhXqQUw21:03
timburkei'll aim to start booking slots around this time next week21:03
timburkeand following up on what mattoliver said, please add topics to the etherpad as you think of them21:04
timburke#link https://etherpad.opendev.org/p/swift-ptg-epoxy21:04
timburkeand i'll aim to flesh out the ones i already added some more21:04
mattoliverkk21:06
timburkei think that's most everything for the PTG for now21:06
timburke#topic labeled metrics21:06
timburkewe've been running with this in prod for a bit now, and i hear our SRE have even started making some per-tenant dashboards based on it21:07
timburkecurrently two main patches worth looking at21:07
timburke#link https://review.opendev.org/c/openstack/swift/+/90988221:07
patch-botpatch 909882 - swift - stats: API for native labeled metrics - 36 patch sets21:07
timburke#link https://review.opendev.org/c/openstack/swift/+/91771121:07
patch-botpatch 917711 - swift - Add labeled metrics to proxy-logging - 19 patch sets21:07
timburkewe were talking this morning and i think there's a growing consensus that it's about ready to merge!21:08
timburkeso we probably ought to find some time to review it :P21:08
jianjiansaw the new labeled metrics on Grafana panels yesterday, looked great!21:08
jianjianSRE also said there were some issues with Grafana, probably not related to the patches, sorry forgot what it is21:10
mattoliverkk, then I'll try and get around to review it. although I'll be off on vacation next week.. so have to see where I get to.21:10
timburkei don't know that i have much more to say about it, just wanted to call it out since we haven't mentioned it for a bit and ask for some review bandwidth :-)21:10
timburke#topic pyeclib wheels21:11
timburkemattoliver's been taking a look at the start of the chain! thanks, mattoliver!21:11
timburke#link https://review.opendev.org/c/openstack/pyeclib/+/81749821:11
patch-botpatch 817498 - pyeclib - Add Dockerfile to build manylinux wheels - 18 patch sets21:11
jianjiani will try to take a look of those two patches21:12
timburkethanks, jianjian!21:12
timburkei rechecked the rest of the patches in the chain; they'd failed with some transient repo error last week21:13
timburkeonce we have those (and maybe mattoliver's p 930171) i think i'd like to get a fresh pyeclib release out21:14
patch-bothttps://review.opendev.org/c/openstack/pyeclib/+/930171 - pyeclib - Call liberasurecode_instance_destroy in destructor - 3 patch sets21:14
timburkeoh, and i made a pyeclib/liberasurecode dashboard for myself, but maybe other people would find it useful, too21:16
timburke#link https://review.opendev.org/dashboard/?title=Erasure+Code+Patches&liberasurecode%20(Active)=project:openstack/liberasurecode+is:open+-age:12w&pyeclib%20(Active)=project:openstack/pyeclib+is:open+-age:12w&liberasurecode%20(Landed)=project:openstack/liberasurecode+is:merged+-age:2w&pyeclib%20(Landed)=project:openstack/pyeclib+is:merged+-age:2w21:16
mattoliveryeah, I'll add it to my gerrit thanks tim! Nice21:17
mattoliveryeah, I'm on an pyeclib wave atm, so want to finish the wheels chain. 21:17
jianjiannice dashboard .... wow, quite a lot of patches21:17
acolesI like a dashboard :)21:17
timburke:D21:17
* diablo_rojo sneaks in the back of the room21:18
timburkefwiw, i modeled it after another of my favorites -- i forget if i shared it here before21:18
timburke#link https://review.opendev.org/dashboard/?title=The Fortnight That Was&foreach=-age:2week&Landed (Server)=is:merged project:openstack/swift&Landed (Client)=is:merged project:openstack/python-swiftclient&Active (Server)=is:open project:openstack/swift&Active (Client)=is:open project:openstack/python-swiftclient&Abandoned (Server)=is:abandoned project:openstack/swift&Abandoned (Client)=is:abandoned project:openstack/python-sw21:18
timburkeiftclient21:18
timburkebah! too long!21:18
timburkealso it botched the spaces :-/21:19
timburkeoh well21:19
diablo_rojotimburke: chuck it in a paste or an etherpad?21:19
timburkethanks :-) doesn't matter too much right now21:20
timburkenext up21:20
timburke#topic s3api bugs21:20
timburkesorry, fulecorafa, i think these are still languishing :-(21:20
fulecorafaAll good hehe :)21:21
timburkeagain, though, i really want to get to them -- at the very least, dig into the traceback21:21
acolesI'm waiting for "The fortnight that will be" dashboard ;-)21:21
timburke#link https://bugs.launchpad.net/swift/+bug/208110321:21
patch-botBug #2081103 - s3api: Deleting the current version of an object can (sometimes?) 500 (New)21:21
timburkethat's about all i've got21:22
fulecorafatimburke if you want any help exploring this bug in the future, feel free to call me21:22
timburke#topic open discussion21:22
diablo_rojoI've got a topic :) 21:22
timburkefulecorafa, thanks!21:22
timburkediablo_rojo, go ahead!21:23
fulecorafaI mean this because I tried replicating the bug with some tens of thousands of buckets in my machine and could not. Possible needed a bigger throughput21:23
diablo_rojoA university in North Dakota is looking for projects for students to do for the next semester (starting in January and going till May). Since you mentored for Carnegie Mellon and that seemed to go well I wanted to see if you might be interested in doing it again?21:23
diablo_rojoI don't need project descriptions till probably December so you have time. 21:24
diablo_rojoJust wanted to toss it out there :) 21:24
diablo_rojoOverall it would be very similar to the last bout, just a different university and timezone. 21:24
diablo_rojoThis is a senior capstone course so the students are in their last 1-3 semesters of their CS degrees.21:25
diablo_rojoAny questions? Or immediate thoughts?21:25
timburkethe CMU students were located in Qatar; do we know whether the north dakota students are there or elsewhere?21:27
diablo_rojoThey will be in North Dakota this time. 21:27
diablo_rojoSo US Central. 21:27
diablo_rojoGood question!21:27
timburkecool! should simplify some things :-)21:27
diablo_rojoYes for sure :) 21:27
mattoliverJan to May, so a longer stint though. And might be mostly during my night21:28
timburkei think we're interested -- just need to think of some good project(s)21:28
diablo_rojoYeah it'll be a full semester instead of a summer course. 21:28
diablo_rojoMaybe you can get acoles in on the party mattoliverau and timburke :) 21:28
timburkeor even clayg :-)21:28
diablo_rojotimburke: sweet! When would you like me to bother you again about this? :) 21:28
timburkeyes please!21:29
diablo_rojoAh yes! clayg as well :) 21:29
mattolivermaybe we get policy migration fully working :P 21:29
acolesnot a huge overlap with my time zone21:29
diablo_rojotimburke: lol yes I plan to, but when should I poke again? How much time do you need to get the proposal together? 21:29
timburkehow about we check in again after the ptg?21:30
diablo_rojotimburke: you got it :) 21:30
diablo_rojoAny other questions from anyone? 21:30
diablo_rojoacoles: the students might not necessarily be working during normal US timezone hours since they are in school - they could be largely nocturnal for all I know. I was as a student :)21:31
* diablo_rojo lets timburke have the floor back and moves to the back of the room 21:31
fulecorafaI also have a topic21:32
timburkefulecorafa, go ahead!21:32
fulecorafaSo, just to update, we're moving on here on our development to object-locking21:32
fulecorafaJust doing a heads up here and if you have any implementation suggestions, I'm all years21:33
fulecorafaIn the mean time, we're looking at https://wiki.openstack.org/wiki/Swift/ideas/object-lock21:33
fulecorafa#link https://wiki.openstack.org/wiki/Swift/ideas/object-lock21:33
fulecorafaI've seen this some months ago, we'll be joining the discussion soon.21:34
mattoliverYou coming to the PTG. Good place to discuss :) 21:35
fulecorafaSorry, haven't quite looked at PTG yet. But will certainly bring it if I go21:35
mattoliverits remote and free21:36
acolesdo we know who was the author of https://wiki.openstack.org/wiki/Swift/ideas/object-lock ?21:36
mattoliverand we can put some time aside to talk about plans, ideas, or even progress. 21:36
fulecorafaThere is a thread in mailing list21:37
fulecorafaJust a sec...21:37
fulecorafa#link https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/PGHHFTIUU4DIICVPV4D4CSK2QYIJ5QUV/#UPR35ONG53AZWE4MF7VKLCX22GO63D7221:37
timburkethe hard parts seem likely to be around eventual consistency/partial failures, and maybe auth. i'd recommend thinking about some good probe tests21:37
timburke(though it might be a little tricky given how small the "cluster" is)21:37
mattolivermaybe even create a collab etherpad doc to brainstorm ideas async? better then the wiki probably. 21:37
fulecorafaThanks mattoliver! I'll lookup some information on how to participate as soon as I'm available21:37
acolesthanks fulecorafa 21:38
mattoliverI'd be interested in helping brainstorm etc. Always better with more heads and upstream from the start ;) 21:39
fulecorafaAlso the etherpad seems like a great idea. Any place of discussion actually.21:39
acolesadding any metadata to objects currently replaces all existing metadata21:39
fulecorafaI also have some collegues that would like to participate in this conversation, although async, so yeah, 21:40
fulecorafaacoles yes but we're regularly using it for some other features. Maybe just being careful about changing this could be enough?21:40
timburkeor we develop some new "sticky meta" namespace, where metadata items are individually reconciled similar to account/container meta21:41
acolesyes, it'll likely require inventing an entirely new other-metadata concept21:42
timburkei seem to recall us talking about the idea some years ago, though i don't think anyone ever devoted any code to it21:42
acoleswe sort of have it for the special case of content-type21:43
fulecorafaBut that's it. Just giving a heads up. We'll be working on it in the next weeks/months21:45
mattolivercool!21:46
acolesmaybe there's some opportunity around Lock in that it'll be the *last* metadata update on the object, ... ever IIUC 🤷21:46
timburkevery cool! i'm not sure how best to help, but i'm interested!21:47
timburkeall right, i think i'll call the meeting a little early21:49
timburkethank you all for coming, and thank you for working on swift!21:49
timburke#endmeeting21:49
opendevmeetMeeting ended Wed Sep 25 21:49:28 2024 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)21:49
opendevmeetMinutes:        https://meetings.opendev.org/meetings/swift/2024/swift.2024-09-25-21.00.html21:49
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/swift/2024/swift.2024-09-25-21.00.txt21:49
opendevmeetLog:            https://meetings.opendev.org/meetings/swift/2024/swift.2024-09-25-21.00.log.html21:49
mattolivercool breakfast time!21:52
opendevreviewJianjian Huo proposed openstack/swift master: common: add memcached based cooperative token mechanism.  https://review.opendev.org/c/openstack/swift/+/89017421:53

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!