timburke | notmyname: to what degree should we worry about kilo and juno? they similarly use ignore-errors. juno caps coverage at 3.7.1, but kilo is uncapped | 00:02 |
---|---|---|
*** jerrygb_ has joined #openstack-swift | 00:04 | |
*** klrmn1 has joined #openstack-swift | 00:04 | |
*** jerrygb has quit IRC | 00:05 | |
notmyname | timburke: only care if there is a gerrit branch for them (eg gerrit/stable/juno). if it's not there, then don't care | 00:06 |
*** ho has joined #openstack-swift | 00:07 | |
*** zhill has quit IRC | 00:10 | |
ho | good morning! | 00:14 |
openstackgerrit | Tim Burke proposed openstack/python-swiftclient: Change ignore-errors to ignore_errors https://review.openstack.org/251591 | 00:18 |
*** tsg has quit IRC | 00:19 | |
*** klrmn1 has quit IRC | 00:22 | |
*** klrmn1 has joined #openstack-swift | 00:22 | |
*** tsg has joined #openstack-swift | 00:23 | |
*** openstackstatus has quit IRC | 00:24 | |
*** takashi has joined #openstack-swift | 00:25 | |
*** openstackstatus has joined #openstack-swift | 00:26 | |
*** ChanServ sets mode: +v openstackstatus | 00:26 | |
mattoliverau | ho: morning | 00:27 |
ho | mattoliverau: morning! | 00:27 |
takashi | good morning. | 00:27 |
ho | takashi: morning! | 00:27 |
takashi | ho: morning! | 00:28 |
*** sgundur has joined #openstack-swift | 00:29 | |
openstackgerrit | Merged openstack/python-swiftclient: Suppress iso8601 logging from --debug output https://review.openstack.org/222743 | 00:31 |
kota_ | good morning | 00:41 |
mattoliverau | kota_: morning | 00:41 |
mattoliverau | nice to have everyone back, the channel has been very quiet | 00:42 |
kota_ | mattoliverau: :-) | 00:43 |
ho | kota_: morning! | 00:43 |
kota_ | ho: o/ | 00:44 |
*** diogogmt has quit IRC | 00:45 | |
*** sgundur has left #openstack-swift | 00:47 | |
*** zhill has joined #openstack-swift | 01:10 | |
*** peterlisak has quit IRC | 01:11 | |
*** peterlisak has joined #openstack-swift | 01:12 | |
*** zhill has quit IRC | 01:14 | |
*** openstackgerrit has quit IRC | 01:22 | |
*** openstackgerrit has joined #openstack-swift | 01:22 | |
*** lpabon has joined #openstack-swift | 01:25 | |
openstackgerrit | Peter Chng proposed openstack/swift: Add round-trip encrypter/decrypter unit tests https://review.openstack.org/251606 | 01:45 |
*** zhill has joined #openstack-swift | 01:46 | |
*** haomaiwang has joined #openstack-swift | 01:46 | |
openstackgerrit | Peter Chng proposed openstack/swift: Add round-trip encrypter/decrypter unit tests https://review.openstack.org/251606 | 01:47 |
*** zhill has quit IRC | 01:50 | |
*** jerrygb_ has quit IRC | 01:51 | |
*** jerrygb has joined #openstack-swift | 01:52 | |
*** badari has quit IRC | 01:54 | |
*** jerrygb has quit IRC | 01:55 | |
*** haomaiwang has quit IRC | 02:01 | |
*** haomaiwang has joined #openstack-swift | 02:01 | |
*** ober37 has joined #openstack-swift | 02:03 | |
*** ober37 has left #openstack-swift | 02:03 | |
*** ober37 has joined #openstack-swift | 02:03 | |
*** diogogmt has joined #openstack-swift | 02:04 | |
*** zhill has joined #openstack-swift | 02:06 | |
*** klrmn1 has quit IRC | 02:07 | |
*** badari has joined #openstack-swift | 02:08 | |
*** zhill_ has joined #openstack-swift | 02:10 | |
*** zhill has quit IRC | 02:10 | |
openstackgerrit | Merged openstack/swift: Expose tempurl's header restrictions via /info https://review.openstack.org/232712 | 02:11 |
openstackgerrit | Merged openstack/python-swiftclient: improve readme contents https://review.openstack.org/235209 | 02:13 |
*** zhill_ has quit IRC | 02:14 | |
*** badari has quit IRC | 02:14 | |
*** haomaiwang has quit IRC | 02:33 | |
*** ober37 has quit IRC | 02:55 | |
*** tsg has quit IRC | 03:05 | |
*** breitz has quit IRC | 03:05 | |
*** sanchitmalhotra has joined #openstack-swift | 03:07 | |
*** sanchitmalhotra1 has joined #openstack-swift | 03:25 | |
*** sanchitmalhotra has quit IRC | 03:27 | |
*** lpabon has quit IRC | 03:35 | |
openstackgerrit | Merged openstack/swift: add sample proxy pipeline for keystone integration https://review.openstack.org/251500 | 03:36 |
*** venkat_p has joined #openstack-swift | 03:39 | |
*** links has joined #openstack-swift | 03:39 | |
*** venkat_p has quit IRC | 03:39 | |
*** venkat_p has joined #openstack-swift | 03:40 | |
*** venkat_p has quit IRC | 03:40 | |
*** venkat_p has joined #openstack-swift | 03:40 | |
*** mahatic has joined #openstack-swift | 03:54 | |
*** ppai has joined #openstack-swift | 03:55 | |
openstackgerrit | Merged openstack/swift: Merge branch 'master' into feature/crypto https://review.openstack.org/251507 | 03:55 |
mahatic | good morning | 04:03 |
kota_ | mahatic: morning | 04:04 |
*** tsg has joined #openstack-swift | 04:04 | |
ho | mahatic: morning! | 04:09 |
*** sanchitmalhotra1 has quit IRC | 04:16 | |
*** sanchitmalhotra has joined #openstack-swift | 04:16 | |
*** links has quit IRC | 04:17 | |
*** silor has joined #openstack-swift | 04:21 | |
*** sanchitmalhotra1 has joined #openstack-swift | 04:37 | |
mattoliverau | mahatic: morning | 04:37 |
*** sanchitmalhotra has quit IRC | 04:40 | |
*** ianbrown has joined #openstack-swift | 04:41 | |
mahatic | kota_: ho mattoliverau: hello! | 04:41 |
openstackgerrit | Mahati Chamarthy proposed openstack/swift: Decrypt multipart mime doc https://review.openstack.org/248377 | 04:50 |
*** gyee has quit IRC | 04:52 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/python-swiftclient: Updated from global requirements https://review.openstack.org/89250 | 05:05 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 05:06 |
*** changbl has quit IRC | 05:07 | |
*** haomaiwa_ has joined #openstack-swift | 05:08 | |
*** haomaiw__ has joined #openstack-swift | 05:11 | |
*** haomaiwa_ has quit IRC | 05:14 | |
*** badari has joined #openstack-swift | 05:19 | |
*** haomaiw__ has quit IRC | 05:30 | |
*** ianbrown has quit IRC | 05:32 | |
*** badari has quit IRC | 05:33 | |
*** jerrygb has joined #openstack-swift | 05:35 | |
*** links has joined #openstack-swift | 05:35 | |
ho | acoles: thanks for the review. i knew you have good dev env than me:P i prefer to not re-use containers and objects for the test because it's easy to understand the precondition for each test if there is no dependency with others. So my idea is reduce test cases using random.sample(cases, x). x will be around 250-300 cases (now 800). what do you think? | 05:44 |
ho | acoles: above is default behavior and I will add a flag to config for full testing. | 05:46 |
openstackgerrit | Merged openstack/swift: Add config sample reference to KeystoneAuth docs https://review.openstack.org/251520 | 05:46 |
*** jerrygb has quit IRC | 05:52 | |
*** tsg has quit IRC | 05:55 | |
openstackgerrit | Merged openstack/swift: Fix Python 3 issues in utils https://review.openstack.org/237039 | 06:01 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 06:10 |
*** badari has joined #openstack-swift | 06:14 | |
*** badari has quit IRC | 06:22 | |
*** zhill has joined #openstack-swift | 06:27 | |
*** ChubYann has quit IRC | 06:34 | |
*** sc68cal has quit IRC | 06:40 | |
mattoliverau | clayg: sigh concurrent gets hurts my head, I went down the greenlet rabbit hole..again.. now my brain hurts, there must be a simpler way, but here is a cleaner way to break out early of a green pile that doesn't cause the issues we're seeing in the tests in the latest patchset. but now other tests fail so am rage quitting until the morning :) patch 117710 | 06:42 |
patchbot | mattoliverau: https://review.openstack.org/#/c/117710/ - Add concurrent reads option to proxy | 06:42 |
*** sc68cal has joined #openstack-swift | 06:44 | |
*** silor has quit IRC | 06:53 | |
*** amit213 has quit IRC | 06:55 | |
*** amit213 has joined #openstack-swift | 06:55 | |
*** silor has joined #openstack-swift | 07:04 | |
*** trifon has joined #openstack-swift | 07:05 | |
*** arnox has joined #openstack-swift | 08:03 | |
*** zhill has quit IRC | 08:16 | |
*** ppai has quit IRC | 08:25 | |
*** zhill has joined #openstack-swift | 08:30 | |
*** zhill has quit IRC | 08:30 | |
*** rcernin has joined #openstack-swift | 08:37 | |
*** ppai has joined #openstack-swift | 08:37 | |
*** takashi has quit IRC | 08:38 | |
*** takashi has joined #openstack-swift | 08:38 | |
*** takashi has quit IRC | 08:38 | |
*** takashi has joined #openstack-swift | 08:39 | |
*** jerrygb has joined #openstack-swift | 08:52 | |
*** ho has quit IRC | 08:54 | |
openstackgerrit | Peter Lisák proposed openstack/swift: Change schedule priority of daemon/server in config https://review.openstack.org/238799 | 09:01 |
*** NM has joined #openstack-swift | 09:18 | |
*** hseipp has joined #openstack-swift | 09:22 | |
*** jordanP has joined #openstack-swift | 09:29 | |
*** ppai has quit IRC | 09:36 | |
*** sanchitmalhotra has joined #openstack-swift | 09:41 | |
*** sanchitmalhotra1 has quit IRC | 09:43 | |
*** jistr has joined #openstack-swift | 09:52 | |
*** ppai has joined #openstack-swift | 10:05 | |
*** aix has joined #openstack-swift | 10:05 | |
*** wuhg has joined #openstack-swift | 10:09 | |
*** NM has quit IRC | 10:09 | |
*** mahatic has quit IRC | 10:10 | |
*** silor has quit IRC | 10:11 | |
*** acoles_ is now known as acoles | 10:16 | |
venkat_p | Hi all, | 10:31 |
*** jerrygb has quit IRC | 10:31 | |
venkat_p | one basic doubt | 10:32 |
venkat_p | Is services in swift (account, container, object) knows where the other services are running? | 10:32 |
venkat_p | or only the proxy node knows ? | 10:33 |
*** mahatic has joined #openstack-swift | 10:33 | |
*** NM has joined #openstack-swift | 10:36 | |
ahale_ | yeah they know where services are, by reading the ring files that are pushed to all the machines - same as how proxies know i guess | 10:45 |
*** SkyRocknRoll has joined #openstack-swift | 10:47 | |
*** kei_yama has quit IRC | 10:57 | |
*** aix has quit IRC | 11:06 | |
mahatic | acoles: hi, thanks for the rebase. true, was cherrypicking the multi-range GET tests commit. This 248377 is ready for review | 11:07 |
*** jerrygb has joined #openstack-swift | 11:16 | |
*** aix has joined #openstack-swift | 11:18 | |
*** jerrygb has quit IRC | 11:19 | |
*** Guest73439 has quit IRC | 11:27 | |
*** flaper87 has quit IRC | 11:30 | |
*** flaper87 has joined #openstack-swift | 11:30 | |
*** chlong has quit IRC | 11:35 | |
*** chlong has joined #openstack-swift | 11:35 | |
*** flaper87 has quit IRC | 11:39 | |
*** flaper87 has joined #openstack-swift | 11:47 | |
*** flaper87 has joined #openstack-swift | 11:47 | |
*** tsg has joined #openstack-swift | 11:54 | |
openstackgerrit | Eran Rom proposed openstack/swift: Container-Sync to iterate only over synced containers https://review.openstack.org/205803 | 11:59 |
*** zackmdavis has quit IRC | 12:05 | |
*** zackmdavis has joined #openstack-swift | 12:07 | |
*** jerrygb has joined #openstack-swift | 12:20 | |
acoles | mahatic: ok | 12:26 |
*** jerrygb has quit IRC | 12:27 | |
*** NM has quit IRC | 12:30 | |
mahatic | acoles: I was wondering where in the line will this patch 211451 fit in? I saw your note on trello for a round-trip test for encrypter/decrypter | 12:34 |
patchbot | mahatic: https://review.openstack.org/#/c/211451/ - Modify unit tests to include real crypto | 12:34 |
acoles | mahatic: imho this ^^ would be first i.e. based on feature/crypto | 12:36 |
acoles | mahatic: i remember when this was first discussed there were differing opinions as to whether the tests should use real crypto or not. I still favour it. | 12:37 |
mahatic | acoles: right. will rebase this one and get it up to speed. It needs to be rebased on the latest revision of container listing that was merged | 12:40 |
acoles | mahatic: thanks! | 12:41 |
*** sileht has joined #openstack-swift | 12:47 | |
*** jmccarthy has quit IRC | 12:49 | |
*** jmccarthy has joined #openstack-swift | 12:50 | |
*** proteusguy has quit IRC | 12:55 | |
*** jerrygb has joined #openstack-swift | 13:01 | |
*** silor has joined #openstack-swift | 13:01 | |
openstackgerrit | Merged openstack/python-swiftclient: Unification of manpages and docstrings https://review.openstack.org/245227 | 13:03 |
*** silor1 has joined #openstack-swift | 13:06 | |
*** silor has quit IRC | 13:08 | |
*** silor1 is now known as silor | 13:08 | |
*** proteusguy has joined #openstack-swift | 13:10 | |
*** venkat_p has quit IRC | 13:12 | |
openstackgerrit | Peter Lisák proposed openstack/python-swiftclient: Add --decode-content option https://review.openstack.org/184957 | 13:17 |
*** stevemar has quit IRC | 13:22 | |
*** stevemar_znc has joined #openstack-swift | 13:23 | |
*** links has quit IRC | 13:47 | |
*** wuhg has quit IRC | 13:51 | |
*** tsg has quit IRC | 13:53 | |
*** ppai has quit IRC | 14:01 | |
*** sanchitmalhotra has quit IRC | 14:04 | |
*** breitz has joined #openstack-swift | 14:05 | |
*** mahatic has quit IRC | 14:16 | |
*** venkat_p has joined #openstack-swift | 14:22 | |
*** haomaiwa_ has joined #openstack-swift | 14:35 | |
*** badari has joined #openstack-swift | 14:41 | |
*** petertr7_away is now known as petertr7 | 14:53 | |
*** blmartin has joined #openstack-swift | 14:55 | |
openstackgerrit | Christian Schwede proposed openstack/swift: Add functional test for repeated SLO segments https://review.openstack.org/251909 | 15:04 |
*** tsg has joined #openstack-swift | 15:06 | |
*** NM has joined #openstack-swift | 15:06 | |
*** sgundur has joined #openstack-swift | 15:07 | |
*** SkyRocknRoll has quit IRC | 15:14 | |
*** sgundur has quit IRC | 15:18 | |
*** sgundur has joined #openstack-swift | 15:18 | |
pchng | acoles: If mahatic's patch 211451 is using real crypto and doing a round-trip, I might just abandon my change 251606, which is doing a round-trip test, but with the FakeCrypto (that's not favoured) | 15:21 |
patchbot | pchng: https://review.openstack.org/#/c/211451/ - Modify unit tests to include real crypto | 15:21 |
pchng | acoles: Either that, or change my patch 211451 to use real crypto for round-trip and base it on mahatic's patch 211451 | 15:22 |
patchbot | pchng: https://review.openstack.org/#/c/211451/ - Modify unit tests to include real crypto | 15:22 |
patchbot | pchng: https://review.openstack.org/#/c/211451/ - Modify unit tests to include real crypto | 15:22 |
pchng | err.. my patch is 251606, sorry | 15:22 |
acoles | pchng: i just took a quick look and i don't think 211451 adds any new tests, so rebasing 251606 and having it use real crypto would seem like the way forward. | 15:24 |
acoles | pchng: rebasing 251606 on 211451 perhaps, if necessary - I see its a new module so maybe it is independent | 15:25 |
*** chsc has joined #openstack-swift | 15:26 | |
pchng | acoles: You're right, I think it's independent because I created a new module just for the round-trip tests. So no need to rebase. | 15:26 |
pchng | acoles, jrichli: I think mahatic's changes in 211451 are adding real crypto into the existing *separate* encrypter/decrypter tests, while I'm adding the new round-trip ones. So I'll just amend and change mine to use real crypto. | 15:27 |
pchng | thanks for the input! | 15:27 |
acoles | pchng: sounds good. | 15:28 |
*** siva_krishnan has joined #openstack-swift | 15:38 | |
openstackgerrit | Peter Chng proposed openstack/swift: Add round-trip encrypter/decrypter unit tests https://review.openstack.org/251606 | 15:39 |
*** diogogmt has quit IRC | 15:39 | |
*** diogogmt has joined #openstack-swift | 15:41 | |
*** aix has quit IRC | 15:49 | |
gmmaha | notmyname: peluse: Good Morning | 15:53 |
gmmaha | sorry was on an extended thanksgiving break.. Just got the kid and wife on a plane back to San Fransico | 15:54 |
peluse | morning! | 15:54 |
peluse | no problem man | 15:54 |
*** diogogmt has quit IRC | 15:55 | |
*** petertr7 is now known as petertr7_away | 16:02 | |
*** wshao has joined #openstack-swift | 16:04 | |
gmmaha | peluse: guesing the keystone piece that you wanted to me to touch is done.. was there anything else you had in mind? :) | 16:04 |
*** rcernin has quit IRC | 16:04 | |
*** venkat_p has quit IRC | 16:05 | |
peluse | gmmaha: nope, notmyname nailed that one already | 16:07 |
gmmaha | :) | 16:08 |
*** changbl has joined #openstack-swift | 16:09 | |
notmyname | good morning | 16:10 |
*** SkyRocknRoll has joined #openstack-swift | 16:11 | |
*** petertr7_away is now known as petertr7 | 16:13 | |
*** petertr7 is now known as petertr7_away | 16:26 | |
*** changbl has quit IRC | 16:27 | |
*** petertr7_away is now known as petertr7 | 16:29 | |
*** venkat_p has joined #openstack-swift | 16:29 | |
*** venkat_p has quit IRC | 16:30 | |
*** diogogmt has joined #openstack-swift | 16:41 | |
*** changbl has joined #openstack-swift | 16:42 | |
*** sgundur has quit IRC | 16:47 | |
*** sgundur has joined #openstack-swift | 16:48 | |
*** venkat_p has joined #openstack-swift | 16:55 | |
*** petertr7 is now known as petertr7_away | 16:58 | |
*** petertr7_away is now known as petertr7 | 16:58 | |
*** venkat_p has quit IRC | 16:58 | |
*** haomaiwa_ has quit IRC | 17:00 | |
*** wshao has quit IRC | 17:01 | |
*** links has joined #openstack-swift | 17:08 | |
*** sgundur has quit IRC | 17:12 | |
*** sgundur has joined #openstack-swift | 17:13 | |
*** gyee has joined #openstack-swift | 17:14 | |
*** klrmn1 has joined #openstack-swift | 17:23 | |
*** stevemar_znc is now known as stevemar | 17:25 | |
*** tsg has quit IRC | 17:31 | |
*** petertr7 is now known as petertr7_away | 17:31 | |
*** sgundur has quit IRC | 17:36 | |
*** janonymous has joined #openstack-swift | 17:40 | |
openstackgerrit | Merged openstack/swift: Test for content-type params in multi-range response https://review.openstack.org/250427 | 17:43 |
*** klrmn1 has quit IRC | 17:43 | |
clayg | notmyname: I think we should put "use oslo.config" to the wishlist - people get so confused/freaked-out everytime they're like "how does an openstack project not use oslo.config!?" | 17:48 |
notmyname | clayg: is that from following the ML thread on oslo.messaging? | 17:49 |
clayg | notmyname: and by "use oslo.config" I mean a) fix everything in oslo.config that doesn't work for us b) figure out how to make it work for upgrades c) type type type | 17:49 |
clayg | notmyname: yeah | 17:49 |
*** janonymous_ has joined #openstack-swift | 17:49 | |
notmyname | lol. yeah it's (a) and (b) why nobody's done it yet ;-) | 17:50 |
notmyname | but as long as we acknowledge those, I'm ok with adding it to a wishlist | 17:50 |
clayg | notmyname: really I guess I don't care if *we* use oslo.config - it's more like ho's situation with policies where he just needs to use the oslo thing but everything in the library totally expects olso.config | 17:50 |
clayg | notmyname: is there something "below wishlist" like "alternative reality where motrals exist outside of finite time" | 17:51 |
clayg | notmyname: so if we just had a pattern with some docsk that was like "when you need olso.config - DON'T FREAK OUT - we have a /etc/swift/oslo.conf that you can put all your poop in" | 17:52 |
clayg | load it like this -> __MAGIC__ | 17:52 |
notmyname | clayg: don't we need to have a big ol' CONF global singleton to use that, though? | 17:53 |
notmyname | but yeah, the "when you need oslo.conf, dont' freak out, do XYZ" would be good anyway. probably starting today | 17:53 |
clayg | notmyname: yeah sure - but like we don't have to import it - only people that need to use it would | 17:53 |
*** sgundur has joined #openstack-swift | 17:54 | |
clayg | notmyname: last I looked the problem was that oslo.config is realy opiniated, like it's not super flexible about how the global conf gets made... | 17:54 |
*** jistr has quit IRC | 17:54 | |
clayg | notmyname: you'd think you could just be like oslo_conf = OsloConf.from_file('/path/from/my/for/realz/config') | 17:55 |
*** arnox has quit IRC | 17:55 | |
clayg | but because it's all global with like config option "registration" - it ends up being more like "oh did you import me? What was sys.argv[1] - great we'll load that" | 17:56 |
clayg | so... that'd be the step a bit | 17:56 |
notmyname | (since yesterday) I've been thinking of the "wishlist" items as just a place to put stuff that might be a good idea, but might not be. Just because someone adds a wishlist item doesn't mean it will get done or that it's even a good idea. so putting a "use oslo.config" there is perfectly fine IMO | 17:58 |
*** blmartin has quit IRC | 17:58 | |
acoles | clayg: thanks for the diffs! super improvements as always | 18:00 |
*** dmsimard is now known as dmsimard|afk | 18:00 | |
openstackgerrit | janonymous proposed openstack/swift: Eventlet green threads not released back to pool https://review.openstack.org/227855 | 18:04 |
*** klrmn1 has joined #openstack-swift | 18:14 | |
*** tsg has joined #openstack-swift | 18:15 | |
*** jordanP has quit IRC | 18:20 | |
*** links has quit IRC | 18:24 | |
*** klrmn1 has quit IRC | 18:28 | |
*** hseipp has quit IRC | 18:31 | |
*** rcernin has joined #openstack-swift | 18:37 | |
*** klrmn1 has joined #openstack-swift | 18:38 | |
*** petertr7_away is now known as petertr7 | 18:40 | |
*** siva_krishnan has quit IRC | 18:40 | |
*** ChubYann has joined #openstack-swift | 18:42 | |
*** vinsh has quit IRC | 18:53 | |
acoles | clayg: also your comment here https://gist.github.com/clayg/039a19b9d1d320b01a5d reminded me that had been bugging me | 18:55 |
*** klrmn1 has quit IRC | 18:59 | |
notmyname | acoles: what's status on fast-POST? | 19:00 |
openstackgerrit | Alistair Coles proposed openstack/swift: Make ECDiskFile report all fragments found on disk https://review.openstack.org/231121 | 19:00 |
acoles | notmyname: well, i was going to work on fast-post today but ended up on ^^ instead. | 19:01 |
*** gyee has quit IRC | 19:02 | |
notmyname | that's good too :-) | 19:02 |
acoles | notmyname: i need to fix the suffix hash calculation on fast-post | 19:02 |
notmyname | ok | 19:02 |
acoles | because clayg spotted that sync'd dirs could in fact have different hashes :/ i think its fixable just haven't got there yet | 19:02 |
*** patchbot has quit IRC | 19:03 | |
acoles | and i need to figure out how to handle slo's swift_bytes being appended to content-type, which slo can't reasonably do during a post | 19:04 |
*** siva_krishnan has joined #openstack-swift | 19:04 | |
acoles | notmyname: so fast-post is not forgotten! | 19:04 |
*** janonymous_ has quit IRC | 19:05 | |
openstackgerrit | Alistair Coles proposed openstack/swift: Merge branch 'master' into feature/crypto https://review.openstack.org/252024 | 19:08 |
acoles | notmyname: another easy merge ^^ :) | 19:09 |
*** tsg has quit IRC | 19:09 | |
*** patchbot has joined #openstack-swift | 19:10 | |
acoles | notmyname: just to explain the flurry of merges...stuff has been landing on master that we could use on feature/crypto. i wasn't expecting it all to land on master in quick succession. | 19:10 |
notmyname | acoles: didn't you just do that yesterday? | 19:10 |
notmyname | ah ok | 19:10 |
acoles | mahatic ^^ fyi | 19:11 |
*** klrmn1 has joined #openstack-swift | 19:12 | |
*** patchbot has quit IRC | 19:12 | |
*** patchbot has joined #openstack-swift | 19:13 | |
*** acoles is now known as acoles_ | 19:13 | |
*** janonymous_ has joined #openstack-swift | 19:14 | |
*** janonymous_ has quit IRC | 19:21 | |
*** janonymous_ has joined #openstack-swift | 19:33 | |
openstackgerrit | Bill Huber proposed openstack/swift: Refactor server side copy as middleware https://review.openstack.org/156923 | 19:41 |
notmyname | wbhuber: thanks for working on that one | 19:43 |
wbhuber | notmyname: sure. need to consult thiago on removing copy hooks, though. | 19:44 |
*** cdelatte has quit IRC | 19:44 | |
*** cdelatte has joined #openstack-swift | 19:45 | |
notmyname | wbhuber: oh, and I notice that one has DocImpact in the commit message. read the link in the topic about changes there | 19:45 |
*** dmsimard|afk is now known as dmsimard | 19:45 | |
tdasilva | wbhuber: i'm here :D | 19:46 |
tdasilva | sorry, was away last week | 19:46 |
*** cdelatte has quit IRC | 19:49 | |
wbhuber | notmyname: guess DocImpact in the commit message needs to be clarified. | 19:49 |
wbhuber | tdasilva: so was i. | 19:50 |
*** cdelatte has joined #openstack-swift | 19:50 | |
wbhuber | tdasilva: the changes in the commit message mention that the copy hooks in the config need to be eliminated when this middleware is placed before dlo/slo? | 19:51 |
*** petertr7 is now known as petertr7_away | 19:51 | |
tdasilva | wbhuber: yeah, so..that's a goal as part of moving copy to middlware... | 19:53 |
tdasilva | wbhuber: ho had a good summary of what's left to do in one of his comments | 19:54 |
tdasilva | wbhuber: i think the first step is this: make a common helper for versioned_write middleware and copy middleware | 19:54 |
wbhuber | tdasilva: noted | 19:56 |
*** petertr7_away is now known as petertr7 | 19:57 | |
tdasilva | wbhuber: you might also want to follow up with torgomatic because he might have started on that first step | 19:57 |
* torgomatic didn't make any useful progress on that | 19:57 | |
tdasilva | ok | 19:57 |
wbhuber | ok | 19:57 |
tdasilva | wbhuber: also, just a heads up, there's an issue with SLO manifests... | 19:58 |
notmyname | tdasilva: yeah, I'm reviewing that now | 19:58 |
notmyname | about to +2/+A | 19:58 |
notmyname | final tests running | 19:58 |
tdasilva | notmyname: mmm..not sure we are talking about the same thing | 19:59 |
tdasilva | what's the patch? | 19:59 |
notmyname | oh ok :-) | 19:59 |
tdasilva | :D | 19:59 |
notmyname | patch 250099 and it's dependency | 19:59 |
patchbot | notmyname: https://review.openstack.org/#/c/250099/ - Fix crash when a SLO repeats a segment. | 19:59 |
tdasilva | ok...no..the issue is raised when moving the copy middlware to the left of SLO. the first part of a copy (GET) on a SLO manifest returns a manifest that is not "valid" for a PUT request. | 20:00 |
notmyname | yeah, totally differnet issues with SLOs ;-) | 20:01 |
timburke | sounds like https://bugs.launchpad.net/swift/+bug/1252482 | 20:02 |
openstack | Launchpad bug 1252482 in OpenStack Object Storage (swift) "make slo multipart-manifest=get better" [Undecided,New] | 20:02 |
tdasilva | so when doing the PUT part, you might want to set some kind of flag on the env. so that the slo middlware will not try to validate the manifest | 20:02 |
tdasilva | timburke: yeah, sounds exactly like that | 20:02 |
notmyname | yes! I was just frustrated by that with testing this other patch | 20:02 |
timburke | and i was frustrated by it while doing slorange | 20:03 |
timburke | is multipart-manifest=get an official, supported API? can we make slo return something that looks more like an uploaded manifest? or should we change it so it can also eat backend manifests? i'm not sure i condone letting middleware PUT slo manifests without any validation, even if it should be fine on a copy... | 20:07 |
timburke | oh, and will the copy-as-middleware change also resolve https://bugs.launchpad.net/swift/+bug/1260446? it seems like it may...depending on implementation... | 20:09 |
openstack | Launchpad bug 1260446 in OpenStack Object Storage (swift) "when you copy a slo the destination doesn't get its content-length and etag set correctly in the container listings" [Undecided,In progress] - Assigned to Alistair Coles (alistair-coles) | 20:09 |
notmyname | yeah, it's the only way to get manifests back out, so it's a thing. but I hate that curl .../foo?multipart-manifest=get | curl .../bar?multipart-manifest=put doesn't work | 20:10 |
*** blmartin has joined #openstack-swift | 20:12 | |
*** silor has quit IRC | 20:13 | |
*** janonymous_ has quit IRC | 20:13 | |
timburke | notmyname: sure, it's a thing, but we don't give any guidance on its format (beyond "not what you sent me"), and even state that this should primarily be used for debugging: https://github.com/openstack/swift/blob/848d729/swift/common/middleware/slo.py#L148-L154 | 20:19 |
notmyname | yeah | 20:19 |
timburke | (granted, i'd need to fix swiftclient to not depend on the existing format....) | 20:19 |
notmyname | what about the put command accepting 2 different versions? | 20:20 |
timburke | yeah, i rather liked that idea when i said it :) | 20:20 |
notmyname | hash=etag, name=path, content-length=size-bytes, and ignore extra keys | 20:21 |
*** zhill has joined #openstack-swift | 20:22 | |
timburke | still probably wouldn't fix https://bugs.launchpad.net/swift/+bug/1213200 but it's definitely more useful than before | 20:22 |
openstack | Launchpad bug 1213200 in OpenStack Object Storage (swift) "Can't confirm receipt of multipart-manifest PUT w/ETag" [Wishlist,Confirmed] | 20:22 |
*** NM has quit IRC | 20:31 | |
notmyname | FYI a swift user's comments on using swift. https://twitter.com/duncsand/status/671783985782083585 (due to twitter's IMO poor UI, be sure to click the "view other replies" link) | 20:31 |
notmyname | tl;dr auth is hard, auth is hard, a "quick-start" guide would be nice | 20:32 |
*** sjmc7 has quit IRC | 20:32 | |
* notmyname lunk | 20:32 | |
* notmyname lunch | 20:33 | |
*** aerwin has joined #openstack-swift | 20:40 | |
*** tsg has joined #openstack-swift | 20:40 | |
aerwin | hello all. | 20:40 |
*** tamizh_geek has quit IRC | 20:44 | |
*** tamizh_geek has joined #openstack-swift | 20:44 | |
timburke | notmyname: on 2, i wonder how many of the endpoints were for a service with type object-store...as evidenced from https://wiki.openstack.org/wiki/API_Working_Group/Current_Design/Service_Catalog there's a lot of variability, but at least that part seems consistent, and i'd hope it should narrow down the choices a lot | 20:47 |
*** zhill has quit IRC | 20:48 | |
notmyname | timburke: yeah, it should | 20:56 |
*** doxavore has joined #openstack-swift | 20:59 | |
openstackgerrit | Sivasathurappan Radhakrishnan proposed openstack/swift: Added unit test cases for common/bufferedhttp.py https://review.openstack.org/244678 | 21:03 |
*** changbl has quit IRC | 21:12 | |
clayg | notmyname: oh wow, that confusing - so auth, auth, and docs | 21:17 |
notmyname | yeah, I'm really surprised by the 66-endpoint service catalog. sounds like once he got into the actual swift parts, things were working | 21:18 |
clayg | ok, on patch 117710 today - gunna see what I can do to help mattoliverau with those unittests | 21:25 |
patchbot | clayg: https://review.openstack.org/#/c/117710/ - Add concurrent reads option to proxy | 21:25 |
clayg | thanks for merging all the keystone/pipeline/docs stuff folks! | 21:26 |
blmartin | mattoliverau: if you get a moment I have a sharding question, I'm only getting shards into left containers (no .gt containers) | 21:29 |
*** rcernin has quit IRC | 21:31 | |
*** jerrygb has quit IRC | 21:32 | |
*** elligottmc has joined #openstack-swift | 21:35 | |
*** vinsh has joined #openstack-swift | 21:35 | |
mattoliverau | Morning | 21:45 |
mattoliverau | clayg: thanks for taking a look | 21:46 |
mattoliverau | blmartin: I pushed a new change up that fixes a few data consistences issues, mainly better at syncing/replicating the pivot points. Have you tried rebasing with master? | 21:47 |
blmartin | mattoliverau: I pulled the latest one you had with the new_part changes | 21:48 |
blmartin | I wiped everything and started from scratch! | 21:49 |
mattoliverau | OK, if that's not helping, can you explain and put steps to recreate in you trello card? And I'll take a look. | 21:50 |
blmartin | sure | 21:51 |
blmartin | I'll keep working though it because I need it working before I break everything with deleting non-leaf containers | 21:51 |
mattoliverau | Lol, please do :) | 21:53 |
elligottmc | blmartin: I just replied to the Trello card on deletions | 21:56 |
elligottmc | Has anyone tried creating ~100 containers and sharding them? | 21:58 |
elligottmc | I have been doing that inadvertently while writing these tests and notice that sharding definitely slows down | 21:59 |
notmyname | a few FYI things from the just-concluded cross-project meeting | 22:05 |
notmyname | (1) the meeting is now held in #openstack-meeting-cp | 22:05 |
notmyname | (2) patch 226157 is getting a lot of attention as a way to change the way compatibility is done for libraries. I *think* this means no more stable/* releases for swiftclient | 22:06 |
patchbot | notmyname: https://review.openstack.org/#/c/226157/ - Backwards compat for libraries and clients. | 22:06 |
notmyname | (3) there's now a new group of cross-project liaisons to manage openstack-specs | 22:06 |
notmyname | /fin | 22:06 |
*** elligottmc has quit IRC | 22:12 | |
*** elligottmc has joined #openstack-swift | 22:12 | |
openstackgerrit | Alan Erwin proposed openstack/swift: Refactoring the expiring objects feature https://review.openstack.org/252085 | 22:17 |
notmyname | aerwin: oh cool! | 22:17 |
*** trifon has quit IRC | 22:20 | |
*** gyee has joined #openstack-swift | 22:22 | |
*** diogogmt has quit IRC | 22:22 | |
aerwin | Thanks, thats is the first pass. I want to start getting some feedback from the community. | 22:23 |
*** NM has joined #openstack-swift | 22:23 | |
*** zhill has joined #openstack-swift | 22:23 | |
*** diogogmt has joined #openstack-swift | 22:25 | |
*** gmmaha has quit IRC | 22:26 | |
*** petertr7 is now known as petertr7_away | 22:26 | |
*** tsg has quit IRC | 22:27 | |
mattoliverau | elligottmc: the sharder deamon might need to be optimised :) | 22:27 |
mattoliverau | it's very serial atm. | 22:27 |
mattoliverau | step 1, does the idea work. Step to make it work betterer :P | 22:27 |
*** gmmaha has joined #openstack-swift | 22:27 | |
mattoliverau | aerwin: awesome!, I'll try and find time to take a look today! | 22:29 |
elligottmc | mattoliverau: yes I very much agree | 22:30 |
elligottmc | I'm actually enjoying experimenting with it | 22:30 |
elligottmc | learn more about the sharding code and the swift code every time | 22:31 |
mattoliverau | elligottmc: cool, and thanks I appreciate all the experimenting. | 22:31 |
mattoliverau | elligottmc: and when you find something I totally missed or could do better, fix it for me ;) | 22:32 |
elligottmc | As soon as I can get a clean run I'll post this code (and then probably immediately change it) | 22:32 |
mattoliverau | lol, you can go a git log and see how many times it's happened to me :) | 22:32 |
*** jerrygb has joined #openstack-swift | 22:32 | |
mattoliverau | elligottmc: I pushed up some new fixes a few days ago. Which is making more stable in my testing, but sure there a ways to go. The sharder being serial has helped debug it, but could really do with improving it, add some concurrency maybe. Feel free to tackle that :) | 22:34 |
elligottmc | much to learn I still have (sorry star wars fever) | 22:35 |
elligottmc | but sure I will take a look | 22:35 |
*** NM has quit IRC | 22:35 | |
*** NM has joined #openstack-swift | 22:36 | |
mattoliverau | :) | 22:37 |
blmartin | bug card added to trello, markdown is a pain | 22:37 |
*** jerrygb has quit IRC | 22:37 | |
mattoliverau | blmartin: lol, thanks man | 22:38 |
*** tsg has joined #openstack-swift | 22:43 | |
*** sgundur has quit IRC | 22:46 | |
*** chmouel has quit IRC | 22:55 | |
*** chmouel has joined #openstack-swift | 22:56 | |
*** klrmn1 has quit IRC | 22:58 | |
aerwin | mattoliverau: Thanks that would be great. | 22:58 |
aerwin | clayg: Where do you recommend I place docs/history for the expiring objects refactor. I currently have a spec, but is there a better place to explain this change? | 22:59 |
*** chsc has quit IRC | 23:00 | |
notmyname | aerwin: updating http://docs.openstack.org/developer/swift/overview_expiring_objects.html in your patch would be lovely | 23:01 |
openstackgerrit | Bill Huber proposed openstack/swift: Refactor server side copy as middleware https://review.openstack.org/156923 | 23:01 |
notmyname | aerwin: I mean, you already are updating that, but that's where that stuff goes (if not in a commit message) | 23:02 |
notmyname | aerwin: eg there's a "history" section on the rings overview page | 23:02 |
*** doxavore has quit IRC | 23:03 | |
*** km has joined #openstack-swift | 23:04 | |
*** km is now known as Guest75007 | 23:04 | |
*** omkarjoshi has joined #openstack-swift | 23:06 | |
*** NM has quit IRC | 23:06 | |
clayg | aerwin: oh yeah you could crib most of that stuff from the spec - I wouldn't stress to much about it tho - getting the migrations and replication shiz square is more important I think | 23:06 |
*** lucy has joined #openstack-swift | 23:09 | |
*** lucy is now known as Guest72556 | 23:09 | |
openstackgerrit | Samuel Merritt proposed openstack/swift: Allow smaller segments in static large objects https://review.openstack.org/252096 | 23:11 |
*** zhill has quit IRC | 23:11 | |
Guest72556 | hi guys, I have questions on the openstack swift acl | 23:19 |
Guest72556 | can somebody tell me the rules of the referrer and group as the acl string in contiainer level? | 23:20 |
Guest72556 | how does the .r and .rlisting giving acl permission to the specified users? | 23:20 |
aerwin | clayg: I agree. I will get the docs update with the next patch set. | 23:21 |
aerwin | notmyname: thanks for the info. | 23:21 |
*** klrmn1 has joined #openstack-swift | 23:22 | |
*** david-lyle has quit IRC | 23:25 | |
*** blmartin has quit IRC | 23:25 | |
*** sjmc7 has joined #openstack-swift | 23:27 | |
*** kei_yama has joined #openstack-swift | 23:29 | |
*** darrenc is now known as darrenc_afk | 23:31 | |
Guest72556 | Hello~? Anybody had experience dealing with openstack acl? | 23:31 |
*** Guest72556 has quit IRC | 23:43 | |
*** darrenc_afk is now known as darrenc | 23:52 | |
*** diogogmt has quit IRC | 23:57 | |
*** siva_krishnan has quit IRC | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!