Wednesday, 2016-05-04

*** Jeffrey4l has joined #openstack-swift00:10
*** garthb has quit IRC00:10
*** suyash has quit IRC00:23
*** pgbridge has joined #openstack-swift00:24
*** ukaynar has quit IRC00:25
*** ukaynar has joined #openstack-swift00:26
*** ukaynar has quit IRC00:30
*** klamath has quit IRC00:46
*** NM has quit IRC00:55
*** TMax has quit IRC00:58
*** NM has joined #openstack-swift01:12
*** dukhlov has quit IRC01:13
*** lyrrad has quit IRC01:14
*** dukhlov has joined #openstack-swift01:15
openstackgerritTim Burke proposed openstack/swift: Allow concurrent bulk deletes  https://review.openstack.org/31181701:29
*** ozialien10 has joined #openstack-swift01:46
*** ozialien10 has quit IRC01:46
*** ozialien10 has joined #openstack-swift01:47
*** pgbridge has quit IRC01:54
*** dukhlov has quit IRC02:00
*** NM has quit IRC02:10
*** gyee has quit IRC02:12
*** cdelatte has quit IRC02:15
*** NM has joined #openstack-swift02:19
*** asettle has quit IRC02:22
*** asettle has joined #openstack-swift02:22
*** asettle has quit IRC02:27
*** SkyRocknRoll has joined #openstack-swift02:31
*** NM has quit IRC02:41
*** ozialien10 has quit IRC02:52
*** ozialien10 has joined #openstack-swift02:52
*** arch-nemesis has quit IRC02:54
openstackgerritAnne Gentle proposed openstack/swift: Adds migrated API reference files  https://review.openstack.org/31231502:58
*** sgundur- has joined #openstack-swift02:58
*** sgundur- has left #openstack-swift02:58
*** wanghua has joined #openstack-swift03:18
*** mingdang1 has joined #openstack-swift03:23
*** fbo has quit IRC03:23
*** sc has quit IRC03:24
*** sc has joined #openstack-swift03:24
*** sc is now known as Guest4008303:24
*** fbo has joined #openstack-swift03:25
*** jamielennox is now known as jamielennox|away03:28
*** dukhlov has joined #openstack-swift03:31
*** nadeem has joined #openstack-swift03:36
*** fbo has quit IRC03:36
*** dukhlov has quit IRC03:36
*** jamielennox|away is now known as jamielennox03:37
*** fbo has joined #openstack-swift03:38
*** ppai has joined #openstack-swift03:41
*** sanchitmalhotra has quit IRC03:44
*** dukhlov has joined #openstack-swift03:44
*** sanchitmalhotra has joined #openstack-swift03:44
*** ppai has quit IRC03:50
*** ukaynar has joined #openstack-swift03:59
*** ppai has joined #openstack-swift04:03
*** dukhlov has quit IRC04:05
*** dukhlov has joined #openstack-swift04:06
*** dmorita has quit IRC04:19
*** links has joined #openstack-swift04:25
*** dukhlov has quit IRC04:29
*** dmorita has joined #openstack-swift04:40
*** dmorita has quit IRC04:44
*** amit213 has quit IRC04:44
*** asettle has joined #openstack-swift04:45
*** ukaynar has quit IRC04:49
*** asettle has quit IRC04:50
mahaticacoles_: thanks for the crypto doc. will look at it. Also, on using container key + path based iv for etags +104:54
*** asettle has joined #openstack-swift04:54
*** ChubYann has quit IRC05:11
*** classicsnail has joined #openstack-swift05:21
*** SkyRocknRoll has quit IRC05:24
*** classicsnail has quit IRC05:24
*** classicsnail has joined #openstack-swift05:24
*** classicsnail has left #openstack-swift05:25
*** dmorita has joined #openstack-swift05:25
*** dmorita has quit IRC05:30
*** natarej_ has joined #openstack-swift05:35
*** natarej has quit IRC05:37
*** jamielennox is now known as jamielennox|away05:40
*** geaaru has joined #openstack-swift05:57
*** david-lyle has quit IRC06:05
*** openstackgerrit has quit IRC06:17
*** openstackgerrit has joined #openstack-swift06:18
*** klrmn has quit IRC06:25
*** zaitcev has quit IRC06:32
*** mingdang1 has quit IRC06:36
*** ppai has quit IRC06:36
*** ppai has joined #openstack-swift06:48
*** nadeem has quit IRC06:59
*** tesseract has joined #openstack-swift07:01
*** tesseract is now known as Guest2331907:01
*** jmccarthy has joined #openstack-swift07:11
openstackgerritChristopher Bartz proposed openstack/swift: Improves log message in swift.obj.replicator  https://review.openstack.org/31204207:14
*** dmorita has joined #openstack-swift07:20
*** acoles_ is now known as acoles07:21
*** jamielennox|away is now known as jamielennox07:22
*** dmorita has quit IRC07:25
*** sanchitmalhotra has quit IRC07:25
*** sanchitmalhotra has joined #openstack-swift07:25
acolesgood morning07:26
mattoliverauacoles: morning07:52
*** dmk0202 has joined #openstack-swift07:54
*** SkyRocknRoll has joined #openstack-swift08:03
*** joeljwright has joined #openstack-swift08:10
*** ChanServ sets mode: +v joeljwright08:10
*** joeljwright has quit IRC08:10
*** joeljwright has joined #openstack-swift08:10
*** ChanServ sets mode: +v joeljwright08:10
*** mvk_ has joined #openstack-swift08:23
*** jistr has joined #openstack-swift08:24
*** mvk has quit IRC08:26
*** silor has joined #openstack-swift08:28
*** ozialien10 has quit IRC08:28
*** ozialien10 has joined #openstack-swift08:29
*** silor1 has joined #openstack-swift08:31
*** silor has quit IRC08:33
*** silor1 is now known as silor08:33
*** mhu has joined #openstack-swift08:45
*** jordanP has joined #openstack-swift08:58
*** natarej__ has joined #openstack-swift09:10
*** natarej_ has quit IRC09:10
*** peterlisak has quit IRC09:13
*** asettle has quit IRC09:13
*** asettle has joined #openstack-swift09:14
*** peterlisak has joined #openstack-swift09:15
*** asettle has quit IRC09:18
*** asettle has joined #openstack-swift09:19
acolesjoeljwright: the client docs merged before I got round to reviewing but they look great! nice work!09:19
openstackgerritAlistair Coles proposed openstack/swift: crypto - add overview doc (WIP)  https://review.openstack.org/31209609:28
joeljwrightacoles: thanks, we managed to get them merged on Friday09:29
joeljwrightacoles: I spent some time with notmyname and the docs peeps trying to work out how we can show multiple versions of the client docs09:30
joeljwrightneed to speak to him tonight to see if he got anywhere (I had to leave for my flight)09:30
*** daemontool has joined #openstack-swift09:35
*** admin6 has joined #openstack-swift09:41
*** peterlisak13 has joined #openstack-swift09:45
*** peterlisak13 has quit IRC09:56
*** dmk0202 has quit IRC09:59
*** ozialien10 has quit IRC10:18
*** ozialien10 has joined #openstack-swift10:18
*** NM has joined #openstack-swift10:34
*** NM has quit IRC10:34
*** mingdang1 has joined #openstack-swift10:37
openstackgerritChristian Schwede proposed openstack/swift: Don't delete misplaced dbs if not replicated  https://review.openstack.org/30399410:39
*** links has quit IRC10:45
*** mvk_ has quit IRC10:46
*** david-lyle has joined #openstack-swift10:58
*** NM has joined #openstack-swift11:03
*** asettle has quit IRC11:08
*** asettle has joined #openstack-swift11:08
*** SkyRocknRoll has quit IRC11:09
*** chmouel has left #openstack-swift11:12
*** SkyRocknRoll has joined #openstack-swift11:21
*** NM has quit IRC11:25
*** daemontool has quit IRC11:27
*** ppai has quit IRC11:32
*** NM has joined #openstack-swift11:39
*** ppai has joined #openstack-swift11:44
*** ppai has quit IRC11:53
*** mvk_ has joined #openstack-swift11:54
*** ppai has joined #openstack-swift11:58
*** links has joined #openstack-swift11:59
admin6 Hi there, do you know where I’m supposed to find logs of the object reconstructor for EC? Both replicator and reconstructor are configured the same way in object-server.conf, and I have replication logs in /var/log/swift/object-replicator.log but can’t find logs for the reconstructor.12:00
*** cdelatte has joined #openstack-swift12:02
tdasilvaacoles, jrichli, ppai: good morning, just wanted to give a heads up that I've been going through timburke's comments on copy middleware and hope to send a patch later today...12:03
tdasilvadriving to the office, will log in again a bit later..12:04
*** ozialien10 has quit IRC12:24
*** ozialien10 has joined #openstack-swift12:25
*** asettle has quit IRC12:26
*** peterlisak13 has joined #openstack-swift12:28
*** peterlisak13 has quit IRC12:29
*** rickyrem has joined #openstack-swift12:44
*** links has quit IRC12:46
*** pauloewerton has joined #openstack-swift12:51
*** ri0 has joined #openstack-swift12:56
openstackgerritAnne Gentle proposed openstack/swift: Adds migrated API reference files  https://review.openstack.org/31231512:56
*** ntt has quit IRC13:12
*** ri0 has left #openstack-swift13:13
*** asettle has joined #openstack-swift13:14
*** ntt has joined #openstack-swift13:14
*** glange has joined #openstack-swift13:18
*** ChanServ sets mode: +v glange13:18
*** fordek has joined #openstack-swift13:18
*** ntt has quit IRC13:18
tdasilvagood morning13:19
*** asettle has quit IRC13:19
*** fordek has left #openstack-swift13:21
openstackgerritMichael Barton proposed openstack/swift: go: hashes.invalid  https://review.openstack.org/28683313:25
*** diogogmt has quit IRC13:28
*** Harin has joined #openstack-swift13:28
*** esker has quit IRC13:29
*** NM has quit IRC13:30
*** diogogmt has joined #openstack-swift13:31
*** BigWillie has joined #openstack-swift13:33
*** sgundur- has joined #openstack-swift13:37
*** Harin has quit IRC13:39
*** Harin has joined #openstack-swift13:41
*** diogogmt has quit IRC13:43
*** d0ugal has quit IRC13:46
*** d0ugal has joined #openstack-swift13:47
*** mingdang1 has quit IRC13:49
*** ametts has joined #openstack-swift13:55
openstackgerritAlistair Coles proposed openstack/swift: crypto - add overview doc (WIP)  https://review.openstack.org/31209613:58
*** _JZ_ has joined #openstack-swift14:00
*** klamath has joined #openstack-swift14:00
*** klamath has quit IRC14:00
*** klamath has joined #openstack-swift14:01
*** diogogmt has joined #openstack-swift14:02
acolestdasilva: thanks for headsup, and for working on it14:04
*** TMax has joined #openstack-swift14:12
*** dmk0202 has joined #openstack-swift14:14
acolesjrichli: mahatic i think patch 305794 might be next to get landed on crypto if you have chance to review14:14
patchbotacoles: https://review.openstack.org/#/c/305794/ - swift (feature/crypto) - crypto - only set body crypto meta if body is read...14:14
*** daemontool has joined #openstack-swift14:19
jrichliacoles: will do.  tdasilva: thanks, and I'll take a look at that patch as well.14:21
*** Harin has quit IRC14:22
*** rickyrem has quit IRC14:25
acolesjrichli: btw thanks for all the comments on the doc14:25
*** Harin has joined #openstack-swift14:26
*** BigWillie has quit IRC14:30
*** ozialien10 has quit IRC14:31
*** dmk0202 has quit IRC14:33
*** pgbridge has joined #openstack-swift14:46
*** vinsh_ has quit IRC14:47
*** vinsh has joined #openstack-swift14:47
openstackgerritMerged openstack/swift: go: shuffle GetNodes  https://review.openstack.org/29385514:51
*** nadeem has joined #openstack-swift14:52
*** esker has joined #openstack-swift14:54
*** garthb has joined #openstack-swift14:56
*** esker has quit IRC14:58
*** esker has joined #openstack-swift14:58
*** asettle has joined #openstack-swift15:03
bkeller`acoles, are the encryption overview docs far enough along for me to start nitpicking grammar? :p15:05
acolesbkeller`: surely they're ain't none grammer mistakes are their? :P15:07
acolesbkeller`: please do, it has to be correct eventually15:07
*** asettle has quit IRC15:08
*** arch-nemesis has joined #openstack-swift15:11
*** dmorita has joined #openstack-swift15:18
*** SkyRocknRoll has quit IRC15:19
*** dmorita has quit IRC15:22
*** TMax has quit IRC15:22
notmynamegood morning15:23
notmynamejoeljwright: no, didn't get anywhere on the version selector15:23
*** dmorita has joined #openstack-swift15:29
*** Harin has quit IRC15:32
bkeller`acoles, you misled me by only having mistakes at the beginning :(15:35
*** jistr has quit IRC15:37
acolesbkeller`: ouch I cannot believe I typed "Client's" :/ thanks for reviewing!15:38
openstackgerritBrian Ober proposed openstack/swift: Storage Account Object Count Quota Support  https://review.openstack.org/31260315:39
bkeller`Are the probe tests in the SAIO supposed to work?15:45
*** Guest23319 has quit IRC15:46
glangehaha15:46
notmynamebkeller`: yes, but torgomatic was saying yesterday that a recent patch may have inadvertantly broken them15:47
notmynamebkeller`: and it was totally my fault since I reviewed the patch ;-)15:47
bkeller`lol15:47
bkeller`I was struggling with that yesterday but now I noticed the saio-probe CI tests were failing on things like doc changes15:48
notmynameyeah. patch 27484015:49
patchbotnotmyname: https://review.openstack.org/#/c/274840/ - swift - change default ports for servers (MERGED)15:49
*** lakshmiS has joined #openstack-swift15:50
notmynamethe summary is that all the examples were changed to have the ports using the 62xx range, but the probe tests do some math to find the port (assuming the old 6xxx range) and the global find/replace didn't work for that15:50
*** nadeem has quit IRC15:51
*** NM has joined #openstack-swift15:53
*** nadeem has joined #openstack-swift15:53
notmynamedfg_: redbo: interesting conversation this morning in the -dev channel about doing dependencies in go. http://eavesdrop.openstack.org/irclogs/%23openstack-dev/%23openstack-dev.2016-05-04.log.html15:53
notmynamedfg_: redbo: so far, how are you dealing with 3rd party dependencies? froma quick glance at the code, you're just referencing the github repos?15:54
*** dmorita has quit IRC15:55
*** NM has quit IRC15:55
*** jistr has joined #openstack-swift15:58
*** dmorita has joined #openstack-swift15:59
*** Harin has joined #openstack-swift16:03
*** rickyrem has joined #openstack-swift16:03
redboYeah, it's something I haven't really worried about yet.16:05
notmynameok16:05
notmynameany opinions on it yet?16:05
*** dmorita has quit IRC16:14
redboNot really, I haven't tried godeps or any of its competitors.  Vendoring is simple but has always seemed kind of gross.16:14
notmynameyeah16:15
*** TMax has joined #openstack-swift16:15
*** admin6 has left #openstack-swift16:17
*** Harin has quit IRC16:19
*** jordanP has quit IRC16:20
jrichlibkeller` : see if patch 311899 fixes your issues16:26
patchbotjrichli: https://review.openstack.org/#/c/311899/ - swift - Fix probe tests from commit cf48e7516:26
*** vinsh has quit IRC16:26
*** vinsh_ has joined #openstack-swift16:26
*** lyrrad has joined #openstack-swift16:27
*** daemontool_ has joined #openstack-swift16:27
*** tmoreira_ is now known as tmoreira16:27
*** tmoreira is now known as Guest381516:28
*** daemontool_ has quit IRC16:28
*** daemontool has quit IRC16:28
*** daemontool has joined #openstack-swift16:29
openstackgerritAlistair Coles proposed openstack/swift: crypto - cleanup decrypter exception handling  https://review.openstack.org/30480616:29
*** ozialien10 has joined #openstack-swift16:29
*** Guest3815 has quit IRC16:30
*** Guest3815 has joined #openstack-swift16:30
*** Guest3815 is now known as tmoreira16:32
sgundur-notmyname: sorry about the failing probetests due to my patch :(    I ll debug it and fix16:34
notmynamesgundur-: no worries. I reviewed it, so it's my fault too :-)16:35
notmynameI'm runnign torgomatic's patch now locally16:36
sgundur-notmyname:  I see that they r failing in _get_container_db_files , was trying to debug using tox16:36
*** cbartz has left #openstack-swift16:37
*** dmorita has joined #openstack-swift16:38
*** TMax has quit IRC16:39
*** TMax has joined #openstack-swift16:40
sgundur-notmyname:  tox doesn't seem to work on probetests16:40
notmynamejrichli: acoles: I just finished watching your crypto summit talk. it was great!16:40
sgundur-notmyname:  any ideas how do I debug probetests16:41
acolesnotmyname: thanks16:42
bkeller`I don't think it worked but I'm also not confident I still have it set up correctly16:43
notmynamesgundur-: is this with torgomatic's patch?16:43
sgundur-notmyname: nope, just with my changes. I havn't added his patch16:43
notmynamebkeller`: the probetests are specifically written to run against the saio setup described in the docs (eg default policy has 4 drives and is replicated and has servers on particular ports and drives at particular paths)16:44
notmynamesgundur-: from his commit message, seems that the probetests are looking for particular ports (62xx), but the rings are still using 6xxx16:45
*** dmorita has quit IRC16:48
notmynamehmm...I'm still getting 1 error and 2 failures with his patch16:48
*** ppai has quit IRC16:49
notmynameI need to step away, but I'll dig into it in a bit16:49
sgundur-notmyname: I guess, my mistake was I only switched the 6000-6003 ports to 6200-620316:49
sgundur-notmyname:  I thought this 6000 range is the base upon which the other port ranges (for 4 modes in saio) were calculated16:51
sgundur-notmyname: looks like I was wrong, ll look at the code16:52
*** jistr has quit IRC16:54
*** nadeem has quit IRC16:56
*** TMax has quit IRC17:00
*** nadeem has joined #openstack-swift17:06
*** suyash has joined #openstack-swift17:08
*** bigdogstl has joined #openstack-swift17:09
*** dmorita has joined #openstack-swift17:11
*** ChubYann has joined #openstack-swift17:13
*** rickyrem has quit IRC17:15
*** bigdogstl has quit IRC17:15
*** klrmn has joined #openstack-swift17:17
*** diogogmt has quit IRC17:22
*** joeljwright has quit IRC17:23
*** diogogmt has joined #openstack-swift17:24
*** dmorita has quit IRC17:32
notmynamesgundur-: I'm back for a few minutes. did you find anything?17:34
*** bigdogstl has joined #openstack-swift17:35
*** dmorita has joined #openstack-swift17:36
sgundur-notmyname:  yes,  its calculating the node_id using the port # 601117:36
*** dmorita has quit IRC17:37
sgundur-notmyname: and checking it against 6200 range , need to change that17:37
notmynamesgundur-: ok, that sounds like what torgomatic told me yesterday. so patch 311899 just rolls back the probetest changes so that they match remakerings17:37
patchbotnotmyname: https://review.openstack.org/#/c/311899/ - swift - Fix probe tests from commit cf48e7517:37
*** tqtran has joined #openstack-swift17:37
*** 7GHAAYZOD has joined #openstack-swift17:38
sgundur-notmyname: will make changes locally and test and get back17:38
notmynamesgundur-: really doesn't matter which way the fix goes. just that they match. and it looks like torgomatic has already done it one way17:38
notmynameso start from there17:38
sgundur-notmyname:  I am lil confused on the port changes, do we make the changes to all the range i.e. 6010-40 , 6011-41,6012-42 ?17:39
notmynameyeah, I think the idea is s/60/62/g in all that17:41
notmynamehowever, don't try to refix what torgomatic has already fix. if his works, let's use that17:41
sgundur-notmyname: ok, thanks17:42
*** bigdogstl has quit IRC17:45
*** mmcardle has quit IRC17:45
*** mmcardle has joined #openstack-swift17:48
*** 7GHAAYZOD has quit IRC17:51
*** mvk_ has quit IRC17:53
jrichlinotmyname: thanks!  I am happy it's over, and I didn't pass-out.  Also glad we could answer the questions for the most part :-)17:54
openstackgerritAlistair Coles proposed openstack/swift: crypto - cleanup encrypter error handling  https://review.openstack.org/31266217:55
*** dmorita has joined #openstack-swift17:59
*** mmcardle has quit IRC18:00
*** acoles is now known as acoles_18:06
*** mmcardle has joined #openstack-swift18:07
*** ChubYann has quit IRC18:09
*** dmorita has quit IRC18:11
*** dmorita has joined #openstack-swift18:11
*** ChubYann has joined #openstack-swift18:21
*** dmorita has quit IRC18:22
*** silor has quit IRC18:25
*** diogogmt has quit IRC18:28
*** dmorita has joined #openstack-swift18:29
*** anderstj has quit IRC18:31
*** ntata- has quit IRC18:31
*** acorwin has quit IRC18:31
*** bigdogstl has joined #openstack-swift18:32
*** anderstj has joined #openstack-swift18:32
*** acorwin has joined #openstack-swift18:33
*** Jeffrey4l has quit IRC18:34
*** ntata- has joined #openstack-swift18:34
*** vinsh_ has quit IRC18:36
*** vinsh has joined #openstack-swift18:37
*** mmcardle has quit IRC18:39
*** asettle has joined #openstack-swift18:39
*** bigdogstl has quit IRC18:39
*** lakshmiS has quit IRC18:42
*** lakshmiS has joined #openstack-swift18:42
*** rickyrem has joined #openstack-swift18:43
*** bigdogstl has joined #openstack-swift18:43
*** asettle has quit IRC18:44
*** bigdogstl has quit IRC18:48
*** joeljwright has joined #openstack-swift18:56
*** ChanServ sets mode: +v joeljwright18:56
*** joeljwright2 has joined #openstack-swift18:59
*** mvk_ has joined #openstack-swift19:00
*** vinsh_ has joined #openstack-swift19:00
*** joeljwright has quit IRC19:01
*** vinsh has quit IRC19:04
*** joeljwright2 has quit IRC19:04
openstackgerritSamuel Merritt proposed openstack/swift: Skip SLO-reconciling probe test when SLO is off  https://review.openstack.org/31269819:04
*** joeljwright has joined #openstack-swift19:05
*** ChanServ sets mode: +v joeljwright19:05
*** ouchkernel has quit IRC19:13
timburkejoeljwright: don't forget to look at the other two in the chain: patch 312262 and patch 31226319:21
patchbottimburke: https://review.openstack.org/#/c/312262/ - python-swiftclient - Parse options to dict19:21
patchbottimburke: https://review.openstack.org/#/c/312263/ - python-swiftclient - Pull option processing out to service.py19:21
timburkeacoles_: i'm supposed to remind you to look at patch 310596, which means you should also look at those^19:23
patchbottimburke: https://review.openstack.org/#/c/310596/ - python-swiftclient - Default to v3 auth if we find a (user|project)-dom...19:23
*** ukaynar has joined #openstack-swift19:24
*** bigdogstl has joined #openstack-swift19:28
*** andrewmi has joined #openstack-swift19:29
*** ukaynar_ has joined #openstack-swift19:29
*** ukaynar has quit IRC19:30
sgundur-notmyname: with torgomatic's patch , I no longer get the probetests error associated with port# , but I do get the 3 other errors -http://paste.openstack.org/show/496139/19:30
andrewmiGood evening everyone. Does anyone know any good resources for offering swift as a service. So far I have read through "Openstack Swift by Joe Arnold & team" and done a fair share of googling.19:32
sgundur-notmyname: in the test_container_sync:TestContainerSync._test_sync ; put_object returns with 201 but after the container-sync the get_object fails with 40419:32
*** bigdogstl has quit IRC19:33
*** ukaynar has joined #openstack-swift19:37
*** ukaynar_ has quit IRC19:37
*** mkrcmari__ has joined #openstack-swift19:40
*** mvk_ has quit IRC19:44
*** rickyrem has quit IRC19:47
*** openstackgerrit has quit IRC19:48
*** openstackgerrit has joined #openstack-swift19:48
*** rickyrem has joined #openstack-swift19:52
*** gyee has joined #openstack-swift19:57
joeljwrighttimburke: looking at them now :)20:01
openstackgerritDavid Goetz proposed openstack/swift: go: extra detail in replication error log  https://review.openstack.org/31225620:02
*** pauloewerton has quit IRC20:06
openstackgerritDavid Goetz proposed openstack/swift: go: extra detail in replication error log  https://review.openstack.org/31225620:08
timburkethanks joeljwright. don't forget to sleep :P20:09
joeljwrighttimburke: no time for that!20:11
*** cdelatte has quit IRC20:12
*** dmk0202 has joined #openstack-swift20:14
*** mvk_ has joined #openstack-swift20:16
*** mvk has joined #openstack-swift20:18
*** mkrcmari__ has quit IRC20:19
*** mvk_ has quit IRC20:21
*** mkrcmari__ has joined #openstack-swift20:21
*** bigdogstl has joined #openstack-swift20:22
*** mvk has quit IRC20:25
*** bigdogstl has quit IRC20:27
*** gyee has quit IRC20:27
*** rickyrem has quit IRC20:27
*** asettle has joined #openstack-swift20:28
*** gyee has joined #openstack-swift20:30
*** cdelatte has joined #openstack-swift20:31
*** asettle has quit IRC20:32
*** bigdogstl has joined #openstack-swift20:38
*** mvk has joined #openstack-swift20:41
*** bigdogstl has quit IRC20:43
*** mkrcmari__ has quit IRC20:44
*** mvk_ has joined #openstack-swift20:44
notmynamemeeting in 15 minutes in #openstack-meeting20:45
*** mkrcmari__ has joined #openstack-swift20:47
*** mvk has quit IRC20:48
*** esker has quit IRC20:48
openstackgerritTim Burke proposed openstack/swift: Allow concurrent bulk deletes  https://review.openstack.org/31181720:50
*** mvk_ has quit IRC20:50
*** mvk has joined #openstack-swift20:51
*** mkrcmari__ has quit IRC20:53
*** mvk_ has joined #openstack-swift20:53
openstackgerritMichael Barton proposed openstack/swift: go: hashes.invalid  https://review.openstack.org/28683320:54
mattoliverauMorning20:54
kota_morning20:55
*** mkrcmari__ has joined #openstack-swift20:56
*** mvk has quit IRC20:56
*** acoles_ is now known as acoles20:57
joeljwrightmorning!20:57
acolestimburke: ack20:58
claygpeople that should be asleep keep saying morning - there must be a meeting today20:59
*** mvk_ has quit IRC20:59
notmynamekota_ doesn't get to sleep any more! https://twitter.com/bloodeagle40234/status/72775915773510860921:00
*** mvk_ has joined #openstack-swift21:00
notmynamemeeting time in #openstack-meeting21:00
acolesclayg: morning21:00
acolestimburke: your patches are on my calendar for tomorrow21:01
kota_notmyname: true21:01
timburkethanks acoles21:03
*** mkrcmari__ has quit IRC21:04
*** gyee has quit IRC21:06
*** _JZ_ has quit IRC21:12
*** gyee has joined #openstack-swift21:20
*** mingdang1 has joined #openstack-swift21:26
*** andrewmi has quit IRC21:27
*** gyee has quit IRC21:27
*** ukaynar has quit IRC21:28
*** lakshmiS has quit IRC21:32
*** bigdogstl has joined #openstack-swift21:34
*** gyee has joined #openstack-swift21:39
*** bigdogstl has quit IRC21:39
*** chlong has quit IRC21:45
*** _erick0zcr has quit IRC21:50
*** ukaynar has joined #openstack-swift21:57
* jrichli is off to yoga22:01
tdasilvaclayg, kota_: it's ok for me if kota_ wants to take that on...22:01
*** dmk0202 has quit IRC22:01
notmynametdasilva: nope. you're it ;-)22:01
notmynametdasilva: kota_ has a new baby22:01
kota_either is fine22:01
tdasilvaok22:02
kota_yeah, it might make it slow.22:02
claygoh right!22:02
notmynamelol, as if me sitting on it could in any way be described as "not slow"22:02
tdasilvaclayg, acoles: https://drive.google.com/file/d/0B1NYXakXGjh6WHItOU1SR29EVWc/view?usp=sharing22:03
tdasilvathis was a presentation given at Vault couple of weeks ago22:03
kota_tdasilva: anyways, i might be able to help you for the repo migration so please let me know if you have something.22:03
tqtranrandom question, but i noticed that a few of the test files in test/functional start with #!/usr/bin/python, is that pretty standard?22:03
tdasilvawhat *I* learned is that the tricky part with tiers is the algorightm to determine what to promote22:04
acolesjrichli: (when you return from yoga) my rough plan of action for crypto is to get patch 305794 and its dependents merged, then we have rough areas left: keymaster changes from last week, and tests22:04
patchbotacoles: https://review.openstack.org/#/c/305794/ - swift (feature/crypto) - crypto - only set body crypto meta if body is read...22:04
openstackgerritTim Burke proposed openstack/swift: Allow concurrent bulk deletes  https://review.openstack.org/31181722:05
claygtqtran: a few of us used to like the just `./path/to/some/test_something.py` but people started -x'ing those files and I realized I mostly just started using `nosetests /path/to/some/test_something.py` anyway so it probaly never got cleaned up22:05
tdasilvakota_: thanks! I will probably ping you!22:05
tdasilva:D22:05
tdasilvawith questions22:05
*** chlong has joined #openstack-swift22:05
kota_tdasilva: i hope you will say just "done" :P22:05
tqtranclayg: i see, thanks for the clarification. i guess is ok if i dont include them in new test files?22:06
tdasilvakota_: hehe, sounds good! actually I don't want to bother you, you should just enjoy baby!22:06
acolestdasilva: thanks. that is weird, i once wrote a device-mapper module called dm-cache, but I'm sure its no the one they talk about, although it did similar.22:06
kota_tdasilva: yeah, being offline to take care of her, maybe this week I can not take enough time to work, I will probably be back since the next week.22:07
tdasilvakota_: what's Kazuhiro's irc handle?22:07
kota_tdasilva: m_kazuhiro22:08
tdasilvathanks22:08
kota_tdasilva: I think he also will be back in the next week because this week is long contanious national holiday week in Japan.22:09
claygtqtran: yeah np22:09
*** rickyrem has joined #openstack-swift22:10
notmynamecompletely unrelated to swift, I'm guessing that most people here might find these two links pretty interesting http://www.ece.eng.wayne.edu/~sjiang/pubs/papers/wu15-lsm-trie.pdf and https://www.youtube.com/watch?v=NGFhc8R_uO422:10
tdasilvaacoles: you have implemented tiering before?22:11
notmynameredbo: on the topic of slab files and indexes for small-file optimization, section 6.7 on http://aosabook.org/en/git.html was interesting to me. specifically, the corruption risk of the naive format and their v2 pack file format22:14
acolestdasilva: I wouldn't call it tiering. caching implies there's a base copy.22:14
acolestdasilva: tiering implies relocating the entire resource, caching keeps copies of the resource (or parts of it) hot in other locations.22:15
*** joeljwright has quit IRC22:15
tdasilvaacoles: yep, makes sense22:15
*** asettle has joined #openstack-swift22:16
acolestdasilva: but agree, figurng out good cache eviction policies is one of the harder parts.22:16
tdasilvaacoles: yeah, I guess we can't just promote things back to hot cache just because of a single write to an object that is in a colder tie22:17
tdasilvaor actually a single 'read'22:18
*** asettle has quit IRC22:21
acoleswith finite capacity caches it comes down to whether there is something you are prepared to evict in favour of what is being touched. if you have space/eviction candidates then moe the latest accessed item to cache, assuming there is little overhead in doing so, and evicting it from cache is free. With tiering, there is a cost to each movement, and yes you probably don't want to move based on a single read.22:21
*** geaaru has quit IRC22:22
notmynamedfg_: redbo: have you played with memoizing (or otherwise) the memcache lookups in swift in order to avoid an extra network request?22:23
*** rushiagr has quit IRC22:24
*** blair has quit IRC22:24
acolestdasilva: i think the use cases you described to me last week where an operator knows that data older than say 24 hours is going cold are easier to reason about, rather than trying to dynamically "learn" when to promote/demote objects through tiers.22:26
acolestdasilva: or as clayg argued, leaving it to the client to decide.22:27
notmynamedfg_: redbo: eg https://gist.github.com/notmyname/c4ca69c1ebf85079b673b6b153bb5bb922:28
acolesgood night22:28
redbonotmyname: no.  I don't know how many proxy processes we have per cluster, but I suspect it's a lot.  If the processes could collude, it might be more interesting.22:28
*** acoles is now known as acoles_22:29
notmynameredbo: I think it would be interesting if you patched one proxy server to add the 2 lines needed to LRU memoize the _get_info_cache and see what happens ;-)22:29
notmynameredbo: also "interesting" because it's your prod cluster, not mine22:29
mattoliveraunotmyname: re:trie / links. interesting.. maybe tries in swift will be back one day :P22:36
notmynamemattoliverau: I keep trie-ing22:37
mattoliveraunotmyname: one day for sure!22:37
*** ametts has quit IRC22:52
*** mingdang1 has quit IRC23:01
openstackgerritJohn Dickinson proposed openstack/swift-specs: Killing specs  https://review.openstack.org/31277823:01
openstackgerritJohn Dickinson proposed openstack/swift: created other-requirements.txt  https://review.openstack.org/30921923:03
*** asettle has joined #openstack-swift23:04
openstackgerritJohn Dickinson proposed openstack/swift: created other-requirements.txt  https://review.openstack.org/30921923:04
*** nadeem has quit IRC23:05
*** arch-nemesis has quit IRC23:08
*** rchurch has quit IRC23:09
*** rchurch has joined #openstack-swift23:10
*** nadeem has joined #openstack-swift23:14
redbonotmyname: It would be fun to play with, but fragmentation/compaction seems like a really deep rabbit hole to me.  Also Dave Chinner would inevitably call us idiots.23:19
notmynameredbo: as opposed to now? ;-)23:20
redbohaha23:20
*** sorrison_laptop has joined #openstack-swift23:20
*** jmccarthy has quit IRC23:21
*** arch-nemesis has joined #openstack-swift23:24
redboYou should put that on the ideas page23:28
openstackgerritTim Burke proposed openstack/python-swiftclient: Check responses when retrying bodies  https://review.openstack.org/26925223:29
*** bapalm_ has quit IRC23:30
*** nadeem has quit IRC23:30
openstackgerritMerged openstack/swift-specs: remove reference to copy hook  https://review.openstack.org/28777323:32
redbohmm.. I'm not sure how to approach chunked puts on that one.23:33
*** nadeem has joined #openstack-swift23:35
openstackgerritMerged openstack/swift: Improves log message in swift.obj.replicator  https://review.openstack.org/31204223:35
openstackgerritMerged openstack/swift: go: extra detail in replication error log  https://review.openstack.org/31225623:36
notmynameredbo: on which one?23:38
*** nadeem has quit IRC23:38
redboon slabs23:38
*** pgbridge has quit IRC23:38
*** natarej__ has quit IRC23:39
notmynameah23:40
*** natarej__ has joined #openstack-swift23:40
notmynamewe could do something similar to EC. spool the segment size and if it's bigger than that it's "big" and doesn't get slabbed. if it's smaller, we can slab it23:41
notmynameEC segment size default is 1MB23:41
notmynameso if the object server spools more than one network segment up to the definition of "small" (for the purposes of the slab), then maybe that could work23:43
*** rickyrem has quit IRC23:44
*** amit213 has joined #openstack-swift23:51

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!