clayg | timburke: p 724141 looks good too (cc zaitcev) | 00:00 |
---|---|---|
patchbot | https://review.opendev.org/#/c/724141/ - swift - swift-get-nodes: Allow users to specify either quo... - 3 patch sets | 00:00 |
zaitcev | Yeah, I meant to look at it today. I'm okay with --quoted too. | 00:09 |
zaitcev | I wish it were -n but these days --quoted is inevitable. | 00:10 |
timburke | clayg, i'd meant to test against actual S3 but never quite got around to it. did you try to cancel or upload another part after the initial complete? how'd it go? | 00:13 |
*** tkajinam has quit IRC | 00:18 | |
*** tkajinam has joined #openstack-swift | 00:25 | |
*** tkajinam_ has joined #openstack-swift | 00:33 | |
*** tkajinam has quit IRC | 00:33 | |
*** renich has joined #openstack-swift | 01:26 | |
*** renich_ has joined #openstack-swift | 01:56 | |
*** renich has quit IRC | 01:57 | |
*** renich_ is now known as renich | 01:57 | |
*** renich_ has joined #openstack-swift | 02:19 | |
*** renich has quit IRC | 02:21 | |
*** renich_ is now known as renich | 02:21 | |
*** renich has quit IRC | 02:29 | |
*** rcernin has quit IRC | 02:59 | |
*** rcernin has joined #openstack-swift | 03:15 | |
*** rcernin has quit IRC | 03:17 | |
*** rcernin has joined #openstack-swift | 03:18 | |
*** psachin has joined #openstack-swift | 03:24 | |
*** gyee has quit IRC | 03:27 | |
*** evrardjp has joined #openstack-swift | 04:33 | |
*** rcernin has quit IRC | 07:08 | |
*** ccamacho has joined #openstack-swift | 07:08 | |
*** ravsingh has joined #openstack-swift | 07:25 | |
*** rpittau|afk is now known as rpittau | 07:54 | |
*** rpittau is now known as rpittau|bbl | 10:11 | |
openstackgerrit | Hervé Beraud proposed openstack/swift-bench master: drop mock from lower-constraints and requirements https://review.opendev.org/734559 | 10:14 |
godog | hi, I'm debugging an issue with s3api and multipart uploads, specifically I have SLO enabled (i.e. swift upload with --segment-size works as expected and I can download the file whole) however doing multipart uploads with e.g. s3cmd and then downloading the file again results in downloading the SLO json manifest and not the file contents. I can see the PUT with multipart-manifest in the query | 10:30 |
godog | string and yet I can't download the file contents, any pointers for further debugging ? thanks! | 10:30 |
*** tkajinam_ has quit IRC | 10:39 | |
*** m75abrams has joined #openstack-swift | 10:42 | |
*** threestrands has quit IRC | 11:27 | |
*** tkajinam has joined #openstack-swift | 11:32 | |
*** ravsingh has quit IRC | 11:59 | |
*** lifeless has quit IRC | 12:08 | |
*** rpittau|bbl is now known as rpittau | 12:11 | |
*** lifeless has joined #openstack-swift | 12:15 | |
clayg | timburke: i didn't try to cancel or upload another part - but trying to list parts did say unknown uploadid | 13:10 |
clayg | zaitcev: what's the mnemonic for -n? timburke went with -Q and the patch is really straight forward | 13:11 |
zaitcev | -Q is fine too | 13:34 |
zaitcev | Just needs to press Shift | 13:34 |
*** tkajinam has quit IRC | 13:49 | |
*** gmann is now known as gmann_afk | 13:52 | |
*** ravsingh has joined #openstack-swift | 14:31 | |
*** gmann_afk is now known as gmann | 14:36 | |
openstackgerrit | Clay Gerrard proposed openstack/swift master: WIP: s3api: Make multi-deletes async https://review.opendev.org/648263 | 14:51 |
*** ravsingh has quit IRC | 15:03 | |
*** gyee has joined #openstack-swift | 15:49 | |
*** renich has joined #openstack-swift | 15:55 | |
*** psachin has quit IRC | 15:56 | |
*** renich has quit IRC | 15:58 | |
*** manuvakery has joined #openstack-swift | 15:58 | |
manuvakery | Hi . added a hack to make the copy command for multipart object work with aws cli version 2 . As object tagging is not implemented i had to create a dummy controller to serve the tagging requests and now the aws commands are working good. here is the new controller | 16:02 |
manuvakery | http://paste.openstack.org/show/794533/ | 16:02 |
*** renich has joined #openstack-swift | 16:04 | |
*** rpittau is now known as rpittau|afk | 16:09 | |
*** renich has quit IRC | 16:14 | |
timburke | manuvakery, nice! that makes perfect sense; i remember we did something similar before we had *full* versioning support to at least support reads while continuing to 501 writes: https://review.opendev.org/#/c/575838/ | 16:14 |
patchbot | patch 575838 - swift - s3api: Add basic support for ?versions bucket list... (MERGED) - 4 patch sets | 16:14 |
timburke | manuvakery, would you be able to propose something like that to swift? i'm guessing there were at least a couple more changes than just the controller | 16:15 |
*** renich has joined #openstack-swift | 16:15 | |
manuvakery | timburke: am yet to go through the contribution guides and setup. I will try to propose in couple of days | 16:18 |
timburke | thanks! let me know if you need any help with that | 16:18 |
manuvakery | sure i will msg u if required | 16:19 |
timburke | godog, that's *very* strange! i've never encountered that; what's your swift setup like? what version of swift is it? is there any chance that there are multiple proxies, some with slo in the pipeline and some without? | 16:20 |
timburke | godog, did you just use --segment-size, or was it --segment-size with --use-slo? swiftclient defaults to using DLOs; we should consider changing that... | 16:32 |
timburke | nvm on that last one -- you already said you see the json manifest, so it *must* be doing the SLO thing. 🤔 hmm... | 16:33 |
clayg | godog: i use aws s3api tool on the command line and mpu works great (also https://gist.github.com/clayg/5d17b261c9cc1fd970ba7915bdc57680 ) you might check allow_multipart_uploads is True in the s3api config section (the default is True) | 16:41 |
*** m75abrams has quit IRC | 16:52 | |
openstackgerrit | Tim Burke proposed openstack/swift master: memcached: Plumb logger into MemcacheRing https://review.opendev.org/734659 | 17:50 |
openstackgerrit | Merged openstack/swift master: swift-get-nodes: Allow users to specify either quoted or unquoted paths https://review.opendev.org/724141 | 17:54 |
*** renich has quit IRC | 18:27 | |
*** renich has joined #openstack-swift | 18:28 | |
godog | timburke: thanks for your help! this is swift 2.19.1 on Debian Buster, I'm talking to a local proxy which has slo enabled AFAICT, tomorrow EU day I'll do some more tests/investigation and report back | 19:01 |
timburke | 👍 | 19:02 |
godog | clayg: sweet -- I'll try with that script too, I'm running with the s3api filter with default options, thanks! | 19:02 |
*** ianychoi__ has joined #openstack-swift | 19:16 | |
*** ianychoi_ has quit IRC | 19:19 | |
openstackgerrit | Pete Zaitcev proposed openstack/swift master: memcached: Plumb logger into MemcacheRing https://review.opendev.org/734659 | 19:32 |
zaitcev | le sigh | 19:32 |
timburke | thanks. i fixed up the other two but somehow i didn't see that one | 20:03 |
*** manuvakery has quit IRC | 21:28 | |
openstackgerrit | Tim Burke proposed openstack/swift master: WIP: run probe tests on CentOS 8 https://review.opendev.org/690717 | 22:18 |
*** rcernin has joined #openstack-swift | 22:22 | |
*** tkajinam has joined #openstack-swift | 22:43 | |
timburke | i'm so confused about https://github.com/openstack/swift/commit/72020ef -- what did the readconf change have to do with anything? does anything *actually use* raw=True? | 22:43 |
DHE | someone accidentally pushed additional chunks into their commit? I've done that... but usually people catch it | 22:46 |
openstackgerrit | Tim Burke proposed openstack/swift master: WIP: run probe tests on CentOS 8 https://review.opendev.org/690717 | 22:54 |
*** rcernin has quit IRC | 22:59 | |
*** rcernin has joined #openstack-swift | 23:01 | |
*** gyee has quit IRC | 23:13 | |
mattoliverau | morning | 23:18 |
openstackgerrit | Tim Burke proposed openstack/swift master: WIP: run probe tests on CentOS 8 https://review.opendev.org/690717 | 23:28 |
*** ccamacho has quit IRC | 23:42 | |
openstackgerrit | Tim Burke proposed openstack/swift master: py3: (Better) fix percentages in configs https://review.opendev.org/734721 | 23:52 |
openstackgerrit | Tim Burke proposed openstack/swift master: WIP: run probe tests on CentOS 8 https://review.opendev.org/690717 | 23:54 |
openstackgerrit | Tim Burke proposed openstack/swift master: WIP: run probe tests on CentOS 8 https://review.opendev.org/690717 | 23:59 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!