notmyname | hello mattoliverau | 00:01 |
---|---|---|
mattoliverau | notmyname: o/ | 00:02 |
mattoliverau | notmyname: shouldn't you be enjoying your Sunday arvo? | 00:02 |
notmyname | :-) | 00:02 |
notmyname | been watching some world cup today. chatting with some people online and saw you were here | 00:03 |
mattoliverau | If other word stuff doesn't distract me today, I plan to review a few of torgomatic's patches today. And will hold the hand of a few patches that were +Aed but failed to land over the weekend. | 00:04 |
mattoliverau | *work | 00:04 |
mattoliverau | notmyname: sounds like a nice way to relax on a Sunday, some of us live in the future so already have to work ;) | 00:05 |
kota_ | good morning | 00:09 |
mattoliverau | kota_: morning | 00:10 |
kota_ | hi mattoliverau | 00:10 |
openstackgerrit | Merged openstack/swift master: Describe separate keymaster config file in docs https://review.openstack.org/578782 | 00:43 |
*** bkopilov has quit IRC | 01:30 | |
*** openstackgerrit has quit IRC | 01:49 | |
*** psachin has joined #openstack-swift | 02:41 | |
*** openstackgerrit has joined #openstack-swift | 02:41 | |
openstackgerrit | Merged openstack/swift master: swob: Stop auto-encoding unicode bodies https://review.openstack.org/578227 | 02:41 |
openstackgerrit | Merged openstack/swift master: Make ACLs work with Unicode in user/account names https://review.openstack.org/571048 | 02:52 |
*** bkopilov has joined #openstack-swift | 02:53 | |
*** SkyRocknRoll has joined #openstack-swift | 03:24 | |
*** SkyRocknRoll has quit IRC | 03:56 | |
*** rcernin has quit IRC | 04:55 | |
*** cshastri has joined #openstack-swift | 05:01 | |
*** links has joined #openstack-swift | 05:09 | |
*** links has quit IRC | 05:09 | |
*** nguyenhai has joined #openstack-swift | 05:21 | |
nguyenhai | Hello everybody, can I ask about the limitation of Erasure Coding in Swift right now? Thank you. | 05:22 |
*** rcernin has joined #openstack-swift | 05:41 | |
*** rcernin has quit IRC | 05:41 | |
*** rcernin has joined #openstack-swift | 05:41 | |
*** rcernin has quit IRC | 05:41 | |
*** rcernin has joined #openstack-swift | 05:42 | |
*** psachin has quit IRC | 05:48 | |
*** armaan has joined #openstack-swift | 05:59 | |
*** nguyenhai_ has joined #openstack-swift | 06:26 | |
*** nguyenhai has quit IRC | 06:29 | |
kota_ | nguyenhai: what's limitation are you thinking? Erasure Coding is an option and it depends on your use case that how erasure code is effective for you. | 06:30 |
*** ccamacho has joined #openstack-swift | 06:32 | |
*** threestrands has joined #openstack-swift | 06:33 | |
*** threestrands has quit IRC | 06:33 | |
*** threestrands has joined #openstack-swift | 06:33 | |
nguyenhai_ | hi kota_, thanks for reply. What scenario that Erasure Coding is suitable for? | 06:33 |
*** ccamacho has quit IRC | 06:33 | |
kota_ | nguyenhai_: generally speaking, sort of archiving, backup, and larger files for each, those cases are recommended. | 06:34 |
*** threestrands has quit IRC | 06:37 | |
nguyenhai_ | thank you kota_ | 06:38 |
*** ccamacho has joined #openstack-swift | 06:40 | |
kota_ | I don't think it's Swift specific, all of storage systems using Erasure Coding technique, tho. | 06:42 |
*** hseipp has joined #openstack-swift | 06:46 | |
*** cbartz has joined #openstack-swift | 07:00 | |
*** cbartz has quit IRC | 07:04 | |
*** cbartz has joined #openstack-swift | 07:04 | |
*** armaan has quit IRC | 07:07 | |
*** armaan has joined #openstack-swift | 07:08 | |
*** rcernin has quit IRC | 07:09 | |
acoles | good morning | 07:19 |
*** armaan has quit IRC | 07:26 | |
*** armaan has joined #openstack-swift | 07:27 | |
*** tesseract has joined #openstack-swift | 07:27 | |
*** psachin has joined #openstack-swift | 07:33 | |
*** d0ugal has joined #openstack-swift | 08:01 | |
*** d0ugal has quit IRC | 08:01 | |
*** d0ugal has joined #openstack-swift | 08:01 | |
*** geaaru has joined #openstack-swift | 08:04 | |
*** armaan has quit IRC | 08:06 | |
*** armaan has joined #openstack-swift | 08:07 | |
*** armaan has quit IRC | 08:12 | |
*** armaan has joined #openstack-swift | 08:13 | |
*** cbartz has quit IRC | 08:18 | |
*** seongsoocho has joined #openstack-swift | 08:22 | |
openstackgerrit | Nguyen Hai proposed openstack/swift master: Update doc building instructions in Development Guidelines https://review.openstack.org/579486 | 08:22 |
openstackgerrit | Mark McArdle proposed openstack/swift master: IP Range restrictions in temp urls https://review.openstack.org/569404 | 08:34 |
openstackgerrit | Mark McArdle proposed openstack/swift master: IP Range restrictions in temp urls https://review.openstack.org/569404 | 08:37 |
*** bharath1234 has joined #openstack-swift | 08:47 | |
bharath1234 | I came across this comment in the utils.py file in the class ContextPool."GreenPool subclassed to kill its coros when it gets gc'ed ". It is describing the class i think.What is gc'ed? | 08:49 |
*** bharath1234 has quit IRC | 08:49 | |
*** armaan has quit IRC | 08:50 | |
*** armaan has joined #openstack-swift | 08:50 | |
acoles | bharath1234 you've left channel...but anyway, I'd guess 'garbage collected' | 08:52 |
*** armaan has quit IRC | 08:59 | |
*** armaan has joined #openstack-swift | 08:59 | |
*** gkadam has joined #openstack-swift | 09:06 | |
*** cbartz has joined #openstack-swift | 09:07 | |
*** lifeless has quit IRC | 09:17 | |
*** lifeless has joined #openstack-swift | 09:18 | |
*** spsurya_ has joined #openstack-swift | 09:40 | |
*** bharath1234 has joined #openstack-swift | 09:40 | |
*** bharath1234 has quit IRC | 09:40 | |
*** armaan has quit IRC | 09:47 | |
*** armaan has joined #openstack-swift | 09:47 | |
*** silor has joined #openstack-swift | 09:51 | |
*** d0ugal has quit IRC | 09:55 | |
*** d0ugal has joined #openstack-swift | 09:55 | |
*** d0ugal has quit IRC | 09:55 | |
*** d0ugal has joined #openstack-swift | 09:55 | |
*** silor1 has joined #openstack-swift | 10:02 | |
*** silor has quit IRC | 10:03 | |
*** silor1 is now known as silor | 10:03 | |
*** bkopilov has quit IRC | 10:17 | |
DHE | kota_: generally erasure coding is slower. you will likely not get gigabit transfer speeds even with a core i7 when erasure codes are in use... but you can tolerate N offline copies without needing N+1 copies of the object in question distributed around your cluster. | 10:19 |
DHE | can't remember the specifics but it was probably a desktop core i7 which, when I ran the numbers, had a PUT processing speed around 400 megabits | 10:20 |
*** ejat has joined #openstack-swift | 10:21 | |
*** ejat has quit IRC | 10:21 | |
*** ejat has joined #openstack-swift | 10:21 | |
*** cbartz has quit IRC | 10:53 | |
openstackgerrit | Merged openstack/swift master: Make COPY work with unicode account names https://review.openstack.org/571049 | 10:58 |
openstackgerrit | Merged openstack/swift master: functests: Clean up objects better https://review.openstack.org/571050 | 11:04 |
*** seongsoocho has quit IRC | 11:11 | |
*** silor has quit IRC | 11:31 | |
*** hseipp has quit IRC | 11:35 | |
*** mvk has quit IRC | 11:37 | |
*** hseipp has joined #openstack-swift | 11:38 | |
openstackgerrit | Mark McArdle proposed openstack/swift master: IP Range restrictions in temp urls https://review.openstack.org/569404 | 11:51 |
*** bkopilov has joined #openstack-swift | 11:54 | |
*** kei_yama has quit IRC | 12:01 | |
*** cbartz has joined #openstack-swift | 12:01 | |
openstackgerrit | Mark McArdle proposed openstack/swift master: IP Range restrictions in temp urls https://review.openstack.org/569404 | 12:03 |
*** lounge-user97 is now known as mark-mcardle | 12:22 | |
*** psachin has quit IRC | 12:33 | |
*** mvk has joined #openstack-swift | 12:41 | |
*** gkadam has quit IRC | 12:47 | |
*** gkadam has joined #openstack-swift | 12:58 | |
*** zaitcev__ has joined #openstack-swift | 13:00 | |
*** ChanServ sets mode: +v zaitcev__ | 13:00 | |
*** zaitcev_ has quit IRC | 13:03 | |
*** tesseract has quit IRC | 13:04 | |
*** tesseract has joined #openstack-swift | 13:10 | |
*** tesseract has quit IRC | 13:10 | |
*** d0ugal has quit IRC | 13:13 | |
openstackgerrit | Alexandre Lécuyer proposed openstack/swift master: Configure diskfile per storage policy https://review.openstack.org/447129 | 13:19 |
openstackgerrit | Nguyen Hai proposed openstack/swift master: Update doc building instructions in Development Guidelines https://review.openstack.org/579486 | 13:33 |
*** d0ugal has joined #openstack-swift | 13:35 | |
*** tesseract has joined #openstack-swift | 13:38 | |
*** gkadam_ has joined #openstack-swift | 13:57 | |
*** gkadam has quit IRC | 13:58 | |
*** hoonetorg has quit IRC | 14:06 | |
*** armaan has quit IRC | 14:21 | |
*** armaan has joined #openstack-swift | 14:22 | |
*** cshastri has quit IRC | 14:23 | |
DHE | nguyenhai_: oops, that above comment was intended for you... | 14:47 |
*** armaan has quit IRC | 14:47 | |
openstackgerrit | Mark McArdle proposed openstack/swift master: IP Range restrictions in temp urls https://review.openstack.org/569404 | 14:51 |
*** gkadam_ has quit IRC | 14:52 | |
*** gkadam_ has joined #openstack-swift | 14:52 | |
*** cbartz has quit IRC | 15:28 | |
*** ccamacho has quit IRC | 15:38 | |
*** gyee has joined #openstack-swift | 15:58 | |
openstackgerrit | Alexandre Lécuyer proposed openstack/swift master: Configure diskfile per storage policy https://review.openstack.org/447129 | 16:01 |
*** mvk has quit IRC | 16:08 | |
*** armaan has joined #openstack-swift | 16:12 | |
*** hseipp has quit IRC | 16:21 | |
notmyname | good morning | 16:32 |
*** bharath1234 has joined #openstack-swift | 16:33 | |
*** bharath1234 has left #openstack-swift | 16:33 | |
timburke | good morning | 16:33 |
notmyname | mattoliverau: FWIW, on https://review.openstack.org/#/c/541058/ we will likely have to take over this patch from sam. (we == all the rest of us) | 16:34 |
patchbot | patch 541058 - swift - Add fallocate_reserve to account and container ser... | 16:34 |
*** armaan has quit IRC | 16:36 | |
*** armaan has joined #openstack-swift | 16:36 | |
*** bkopilov has quit IRC | 16:51 | |
*** tesseract has quit IRC | 17:02 | |
*** ejat has quit IRC | 17:09 | |
*** armaan has quit IRC | 17:12 | |
*** ejat has joined #openstack-swift | 17:12 | |
*** ejat has quit IRC | 17:12 | |
*** ejat has joined #openstack-swift | 17:12 | |
*** armaan has joined #openstack-swift | 17:12 | |
*** mvk has joined #openstack-swift | 17:30 | |
*** geaaru has quit IRC | 17:49 | |
openstackgerrit | Alistair Coles proposed openstack/swift master: Enable FakeConn to handle multiple requests/responses https://review.openstack.org/579228 | 18:23 |
openstackgerrit | Alistair Coles proposed openstack/swift master: WIP PUT+POST: test proxy object controller PUT path https://review.openstack.org/579229 | 18:23 |
timburke | huh. that's the darnedest thing. `nosetests test/unit/cli/test_manage_shard_ranges.py:TestManageShardRanges.test_enable test/unit/cli/test_relinker.py:TestRelinker.test_cleanup test/unit/cli/test_ringbuilder.py:TestRebalanceCommand.test_debug` dumps a whole bunch of ring builder debug output to my console | 18:25 |
timburke | but drop either the relinker or the manage-shard-ranges test, and it's nice and quiet | 18:25 |
timburke | dito if you *swap the order* of those two other tests | 18:25 |
timburke | :-/ | 18:25 |
acoles | timburke: :( | 18:26 |
openstackgerrit | Alistair Coles proposed openstack/swift master: PUT+POST: break out putter specific test classes https://review.openstack.org/579227 | 18:27 |
openstackgerrit | Alistair Coles proposed openstack/swift master: Enable FakeConn to handle multiple requests/responses https://review.openstack.org/579228 | 18:27 |
openstackgerrit | Alistair Coles proposed openstack/swift master: WIP PUT+POST: test proxy object controller PUT path https://review.openstack.org/579229 | 18:27 |
acoles | zaitcev__: with the extra support in p 579228 we now have some realistic DoublePutter tests in p 579229 | 18:29 |
patchbot | https://review.openstack.org/#/c/579228/ - swift - Enable FakeConn to handle multiple requests/responses | 18:29 |
patchbot | https://review.openstack.org/#/c/579229/ - swift - WIP PUT+POST: test proxy object controller PUT path | 18:29 |
zaitcev__ | acoles: thanks a lot | 18:35 |
zaitcev__ | acoles: should I squash all of that? Or leave as-is? | 18:36 |
acoles | zaitcev__: we might want to consider doing the test restructuring in p 579227 as a separate patch *ahead* of the PUT+POST patch because it will be much easier to review those structural changes on their own. That would mean moving the DoublePutter related tests out of 579227. | 18:42 |
patchbot | https://review.openstack.org/#/c/579227/ - swift - PUT+POST: break out putter specific test classes | 18:42 |
acoles | zaitcev__: so IDK. I can keep hacking away as is. | 18:43 |
zaitcev__ | acoles: sounds persuasive; what patch do you want to use for it? One of the existing pre-requisits, file a new one? | 18:43 |
acoles | zaitcev__: maybe split the DoublePutter stuff out of 579227 then reordering so p 427911 is based on p 579227; much of the change in https://review.openstack.org/#/c/427911/29/test/unit/proxy/controllers/test_obj.py isn't needed so revert that first to avoid conflicts. | 18:48 |
patchbot | patch 427911 - swift - Replace MIME with PUT+POST for EC and Encryption | 18:48 |
patchbot | patch 427911 - swift - Replace MIME with PUT+POST for EC and Encryption | 18:48 |
patchbot | patch 579227 - swift - PUT+POST: break out putter specific test classes | 18:48 |
acoles | I could take a stab at it tomorrow | 18:48 |
acoles | but if you get to it first that's cool | 18:49 |
* acoles away now | 18:50 | |
zaitcev__ | okay, please let me try | 18:50 |
*** d0ugal has quit IRC | 19:34 | |
*** rcernin has joined #openstack-swift | 22:18 | |
openstackgerrit | Merged openstack/swift master: py3: port proxy/controllers/info.py https://review.openstack.org/578611 | 23:11 |
mattoliverau | notmyname: yeah, I suspect so, unless we want to merge it as is. but am happy to have discussions on it, and take it over if need be :) | 23:19 |
mattoliverau | also morning :) | 23:20 |
*** kei_yama has joined #openstack-swift | 23:22 | |
*** threestrands has joined #openstack-swift | 23:43 | |
*** gyee has quit IRC | 23:45 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!