*** petertr7_away is now known as petertr7 | 00:03 | |
*** lyrrad has quit IRC | 00:11 | |
*** petertr7 is now known as petertr7_away | 00:13 | |
*** HiramAbif has quit IRC | 00:28 | |
*** gyee has quit IRC | 00:34 | |
openstackgerrit | Merged openstack/swift: go: object server SYNC report newer files https://review.openstack.org/184617 | 00:35 |
---|---|---|
ho | mattoliverau: around? | 00:38 |
mattoliverau | Morning ho, yup here | 00:38 |
ho | mattoliverau: morning! thanks for the review. I don't understand "Since we are in the replicate function here" means. could you explain it? | 00:39 |
ho | mattolverau: I don't think there is replicate function. | 00:39 |
ho | mattoliverau: patch 138342 | 00:39 |
patchbot | ho: https://review.openstack.org/#/c/138342/ | 00:39 |
mattoliverau | The _replicate_object function your in is the point at which db replication call replicate object to a node. So you should always know which node failed to replicate on | 00:42 |
ho | mattoliverau: which line num. do I have repliacate logic? | 00:44 |
ho | mattoliverau: sorry. I re-write. could you tell me line num of replicate logic? | 00:46 |
mattoliverau | ho: 537 | 00:48 |
*** thurloat is now known as thurloat_isgone | 00:49 | |
ho | mattoliverau: I think the definition of replication succeed is finish "the basic replication procedure" without errors so til L564 it is difficult to decide whether it succeeded or not. | 00:52 |
ho | mattoliverau: http://paste.openstack.org/show/180912/ (a comment on patch#7) | 00:52 |
*** thurloat_isgone is now known as thurloat | 00:56 | |
*** kota_ has joined #openstack-swift | 01:08 | |
kota_ | Good morning! | 01:08 |
ho | kota_: morning! | 01:09 |
mattoliverau | ho: well in the old code, the success and failures were incremented per node, and if your going to send to recon the nodes that have the problem, the nodes that were successful aren't problem nodes. Wont that just confuse OPs.. looking for a problem on a node that didn't have one? | 01:22 |
mattoliverau | kota_: morning | 01:22 |
ho | mattoliverau: I didn't have one. replication works per db/partition and if the old code uses, the result consists of aggregation of replications. it might look like a problem but it's kind of same with the latest code | 01:32 |
*** fthiagogv has quit IRC | 01:35 | |
*** cppforlife_ has quit IRC | 01:36 | |
*** nottrobin has quit IRC | 01:36 | |
*** briancurtin has quit IRC | 01:36 | |
*** serverascode has quit IRC | 01:36 | |
*** zaitcev has quit IRC | 01:37 | |
*** zaitcev has joined #openstack-swift | 01:38 | |
*** ChanServ sets mode: +v zaitcev | 01:38 | |
*** cppforlife_ has joined #openstack-swift | 01:40 | |
kota_ | ho, mattoliverau: morning :) | 01:41 |
*** nottrobin has joined #openstack-swift | 01:42 | |
*** briancurtin has joined #openstack-swift | 01:43 | |
*** serverascode has joined #openstack-swift | 01:44 | |
*** shakamunyi_ has joined #openstack-swift | 01:46 | |
*** shakamunyi_ has quit IRC | 01:46 | |
*** wbhuber has joined #openstack-swift | 02:00 | |
*** asettle has quit IRC | 02:06 | |
*** fthiagogv has joined #openstack-swift | 02:06 | |
*** asettle has joined #openstack-swift | 02:09 | |
*** bkopilov has quit IRC | 02:13 | |
*** wbhuber has quit IRC | 02:17 | |
*** shakamunyi has joined #openstack-swift | 02:26 | |
*** thurloat is now known as thurloat_isgone | 02:27 | |
*** asettle is now known as asettle-afk | 02:27 | |
*** shakamunyi has quit IRC | 02:33 | |
*** chlong has quit IRC | 02:39 | |
*** lyrrad has joined #openstack-swift | 03:00 | |
*** chlong has joined #openstack-swift | 03:22 | |
*** asettle-afk is now known as asettle | 03:35 | |
*** asettle has quit IRC | 03:35 | |
*** dimasot has joined #openstack-swift | 03:44 | |
*** charlesw has quit IRC | 04:00 | |
*** [1]dimasot has joined #openstack-swift | 04:15 | |
*** dimasot has quit IRC | 04:18 | |
*** [1]dimasot is now known as dimasot | 04:18 | |
*** haigang has joined #openstack-swift | 04:19 | |
*** bkopilov has joined #openstack-swift | 04:23 | |
*** ppai has joined #openstack-swift | 04:23 | |
*** [1]dimasot has joined #openstack-swift | 04:23 | |
*** david-lyle has quit IRC | 04:24 | |
*** david-lyle has joined #openstack-swift | 04:25 | |
*** dimasot has quit IRC | 04:26 | |
*** [1]dimasot is now known as dimasot | 04:26 | |
*** kota_ has quit IRC | 04:26 | |
*** kota_ has joined #openstack-swift | 04:29 | |
*** ktsuyuzaki has joined #openstack-swift | 04:32 | |
*** zaitcev has quit IRC | 04:33 | |
*** kota_ has quit IRC | 04:34 | |
*** asettle has joined #openstack-swift | 04:34 | |
*** kota_ has joined #openstack-swift | 04:36 | |
*** ktsuyuzaki has quit IRC | 04:38 | |
*** ktsuyuzaki has joined #openstack-swift | 04:39 | |
*** kota_ has quit IRC | 04:40 | |
*** kota_ has joined #openstack-swift | 04:43 | |
*** ktsuyuzaki has quit IRC | 04:45 | |
*** ktsuyuzaki has joined #openstack-swift | 04:46 | |
*** 17WABZSPI has quit IRC | 04:46 | |
*** 16WAA4FX8 has quit IRC | 04:46 | |
*** delattec has joined #openstack-swift | 04:47 | |
*** delatte has joined #openstack-swift | 04:47 | |
*** kota_ has quit IRC | 04:48 | |
*** kota_ has joined #openstack-swift | 04:51 | |
*** ktsuyuzaki has quit IRC | 04:53 | |
*** ktsuyuzaki has joined #openstack-swift | 04:53 | |
*** kota_ has quit IRC | 04:55 | |
*** kota_ has joined #openstack-swift | 04:56 | |
openstackgerrit | Hisashi Osanai proposed openstack/swift: Enable Object Replicator's failure count in recon https://review.openstack.org/138342 | 04:57 |
*** ktsuyuzaki has quit IRC | 04:57 | |
*** ktsuyuzaki has joined #openstack-swift | 05:00 | |
*** kota_ has quit IRC | 05:02 | |
*** Triveni has joined #openstack-swift | 05:04 | |
*** kota_ has joined #openstack-swift | 05:07 | |
*** ktsuyuzaki has quit IRC | 05:09 | |
*** ktsuyuza_ has joined #openstack-swift | 05:09 | |
*** kota_ has quit IRC | 05:11 | |
swifterdarrell | cschwede: you see my comment at https://review.openstack.org/#/c/184189/ ? | 05:12 |
*** kota_ has joined #openstack-swift | 05:12 | |
*** nosnos has joined #openstack-swift | 05:12 | |
*** ktsuyuza_ has quit IRC | 05:14 | |
*** ktsuyuzaki has joined #openstack-swift | 05:14 | |
*** kota_ has quit IRC | 05:16 | |
*** kota_ has joined #openstack-swift | 05:17 | |
*** ktsuyuzaki has quit IRC | 05:19 | |
*** ktsuyuza_ has joined #openstack-swift | 05:19 | |
*** kota_ has quit IRC | 05:22 | |
*** kota_ has joined #openstack-swift | 05:22 | |
*** ktsuyuza_ has quit IRC | 05:24 | |
*** SkyRocknRoll has joined #openstack-swift | 05:24 | |
*** ktsuyuzaki has joined #openstack-swift | 05:24 | |
openstackgerrit | Kota Tsuyuzaki proposed openstack/swift: WIP: Fix missing container update https://review.openstack.org/186735 | 05:25 |
*** kota_ has quit IRC | 05:26 | |
*** kota_ has joined #openstack-swift | 05:29 | |
*** ktsuyuzaki has quit IRC | 05:31 | |
*** ktsuyuzaki has joined #openstack-swift | 05:31 | |
*** kota_ has quit IRC | 05:33 | |
*** kota_ has joined #openstack-swift | 05:36 | |
*** nosnos has quit IRC | 05:37 | |
*** ktsuyuzaki has quit IRC | 05:38 | |
*** ktsuyuzaki has joined #openstack-swift | 05:40 | |
*** kota_ has quit IRC | 05:42 | |
*** kota_ has joined #openstack-swift | 05:43 | |
openstackgerrit | Kota Tsuyuzaki proposed openstack/swift: Prevent to decode with invalid ec scheme https://review.openstack.org/177195 | 05:44 |
*** ktsuyuzaki has quit IRC | 05:44 | |
*** ktsuyuzaki has joined #openstack-swift | 05:47 | |
*** kota_ has quit IRC | 05:49 | |
*** kota_ has joined #openstack-swift | 05:52 | |
*** ktsuyuza_ has joined #openstack-swift | 05:54 | |
*** ktsuyuzaki has quit IRC | 05:55 | |
*** nadeem has joined #openstack-swift | 05:55 | |
*** ktsuyuzaki has joined #openstack-swift | 05:57 | |
*** kota_ has quit IRC | 05:57 | |
*** ppai has quit IRC | 05:59 | |
*** ktsuyuza_ has quit IRC | 05:59 | |
*** kota_ has joined #openstack-swift | 06:00 | |
*** ktsuyuza_ has joined #openstack-swift | 06:02 | |
*** ktsuyuzaki has quit IRC | 06:02 | |
cschwede | Good Morning! | 06:03 |
*** kota_ has quit IRC | 06:04 | |
ho | cschwede: Morning! | 06:04 |
cschwede | swifterdarrell: yes, thanks a lot for the numbers! first impression is that your patch makes quite a big difference in terms of performance. that looks great! | 06:06 |
cschwede | ho: Hello! | 06:06 |
*** kota_ has joined #openstack-swift | 06:07 | |
*** ktsuyuza_ has quit IRC | 06:09 | |
*** nadeem has quit IRC | 06:09 | |
*** ktsuyuzaki has joined #openstack-swift | 06:09 | |
*** kota_ has quit IRC | 06:11 | |
*** kota_ has joined #openstack-swift | 06:12 | |
*** ktsuyuzaki has quit IRC | 06:13 | |
*** ktsuyuzaki has joined #openstack-swift | 06:14 | |
*** kota_ has quit IRC | 06:16 | |
*** kota_ has joined #openstack-swift | 06:17 | |
*** ktsuyuzaki has quit IRC | 06:18 | |
*** ktsuyuzaki has joined #openstack-swift | 06:19 | |
*** kota_ has quit IRC | 06:21 | |
*** kota_ has joined #openstack-swift | 06:22 | |
*** ktsuyuzaki has quit IRC | 06:24 | |
*** ktsuyuzaki has joined #openstack-swift | 06:26 | |
mattoliverau | cschwede: morning | 06:28 |
cschwede | mattoliverau: Hello! | 06:28 |
*** kota_ has quit IRC | 06:28 | |
*** kota_ has joined #openstack-swift | 06:31 | |
*** ktsuyuza_ has joined #openstack-swift | 06:33 | |
*** ktsuyuzaki has quit IRC | 06:34 | |
*** kota_ has quit IRC | 06:35 | |
*** kota_ has joined #openstack-swift | 06:36 | |
*** ktsuyuza_ has quit IRC | 06:38 | |
*** ktsuyuzaki has joined #openstack-swift | 06:38 | |
*** ktsuyuza_ has joined #openstack-swift | 06:41 | |
*** kota_ has quit IRC | 06:43 | |
*** ktsuyuzaki has quit IRC | 06:43 | |
*** ppai has joined #openstack-swift | 06:45 | |
*** kota_ has joined #openstack-swift | 06:45 | |
*** ktsuyuza_ has quit IRC | 06:47 | |
*** ktsuyuzaki has joined #openstack-swift | 06:48 | |
*** kota_ has quit IRC | 06:50 | |
*** kota_ has joined #openstack-swift | 06:53 | |
*** krykowski has joined #openstack-swift | 06:53 | |
*** ktsuyuza_ has joined #openstack-swift | 06:55 | |
*** ktsuyuzaki has quit IRC | 06:57 | |
*** kota_ has quit IRC | 06:57 | |
*** kota_ has joined #openstack-swift | 06:57 | |
openstackgerrit | Merged openstack/swift: Tighten up overall metadata size tests https://review.openstack.org/187264 | 06:58 |
*** ktsuyuza_ has quit IRC | 07:00 | |
*** ktsuyuzaki has joined #openstack-swift | 07:00 | |
*** kota_ has quit IRC | 07:02 | |
*** kota_ has joined #openstack-swift | 07:02 | |
*** ktsuyuzaki has quit IRC | 07:05 | |
*** krykowski has quit IRC | 07:05 | |
*** ktsuyuzaki has joined #openstack-swift | 07:05 | |
*** kota_ has quit IRC | 07:07 | |
*** kota_ has joined #openstack-swift | 07:07 | |
*** ktsuyuzaki has quit IRC | 07:09 | |
*** ktsuyuzaki has joined #openstack-swift | 07:10 | |
*** haigang has quit IRC | 07:11 | |
*** kota_ has quit IRC | 07:12 | |
*** haigang has joined #openstack-swift | 07:12 | |
*** admin6 has joined #openstack-swift | 07:14 | |
*** kota_ has joined #openstack-swift | 07:14 | |
*** ktsuyuzaki has quit IRC | 07:16 | |
*** ktsuyuzaki has joined #openstack-swift | 07:17 | |
*** kota_ has quit IRC | 07:19 | |
*** ktsuyuza_ has joined #openstack-swift | 07:19 | |
*** ktsuyuzaki has quit IRC | 07:22 | |
*** hseipp has joined #openstack-swift | 07:22 | |
*** hseipp has quit IRC | 07:22 | |
*** kota_ has joined #openstack-swift | 07:22 | |
*** hseipp has joined #openstack-swift | 07:22 | |
openstackgerrit | Kota Tsuyuzaki proposed openstack/swift: WIP: Fix missing container update https://review.openstack.org/186735 | 07:23 |
*** ktsuyuza_ has quit IRC | 07:24 | |
*** ktsuyuzaki has joined #openstack-swift | 07:24 | |
*** kota_ has quit IRC | 07:26 | |
*** kota_ has joined #openstack-swift | 07:27 | |
*** ktsuyuzaki has quit IRC | 07:29 | |
*** ktsuyuzaki has joined #openstack-swift | 07:29 | |
*** kota_ has quit IRC | 07:31 | |
*** kota_ has joined #openstack-swift | 07:32 | |
*** ktsuyuzaki has quit IRC | 07:34 | |
*** ktsuyuzaki has joined #openstack-swift | 07:36 | |
*** kota_ has quit IRC | 07:38 | |
*** kota_ has joined #openstack-swift | 07:39 | |
*** ktsuyuzaki has quit IRC | 07:41 | |
*** ktsuyuzaki has joined #openstack-swift | 07:41 | |
*** kota_ has quit IRC | 07:43 | |
*** silor has joined #openstack-swift | 07:45 | |
*** kota_ has joined #openstack-swift | 07:46 | |
*** jistr has joined #openstack-swift | 07:48 | |
*** ktsuyuzaki has quit IRC | 07:48 | |
*** ktsuyuzaki has joined #openstack-swift | 07:48 | |
*** kota_ has quit IRC | 07:50 | |
*** kota_ has joined #openstack-swift | 07:51 | |
*** ktsuyuzaki has quit IRC | 07:53 | |
*** ktsuyuzaki has joined #openstack-swift | 07:53 | |
*** kota_ has quit IRC | 07:55 | |
*** chlong has quit IRC | 07:56 | |
*** kota_ has joined #openstack-swift | 07:56 | |
*** ktsuyuzaki has quit IRC | 07:58 | |
*** ktsuyuzaki has joined #openstack-swift | 07:58 | |
*** jordanP has joined #openstack-swift | 08:00 | |
*** kota_ has quit IRC | 08:00 | |
*** kota_ has joined #openstack-swift | 08:01 | |
*** ktsuyuzaki has quit IRC | 08:03 | |
*** ktsuyuzaki has joined #openstack-swift | 08:03 | |
*** kota_ has quit IRC | 08:06 | |
*** ktsuyuza_ has joined #openstack-swift | 08:06 | |
*** [1]dimasot has joined #openstack-swift | 08:07 | |
*** ktsuyuzaki has quit IRC | 08:08 | |
*** dimasot has quit IRC | 08:09 | |
*** [1]dimasot is now known as dimasot | 08:09 | |
*** kota_ has joined #openstack-swift | 08:10 | |
*** ktsuyuza_ has quit IRC | 08:13 | |
openstackgerrit | Hisashi Osanai proposed openstack/swift: Add metadata size tests on the border https://review.openstack.org/187489 | 08:13 |
*** ktsuyuzaki has joined #openstack-swift | 08:13 | |
ho | my review for patch #187264 didn't meet the dead line. So I added two more tests on it with above patch #187489. | 08:14 |
*** kota_ has quit IRC | 08:15 | |
*** kota_ has joined #openstack-swift | 08:15 | |
*** ktsuyuzaki has quit IRC | 08:17 | |
*** ktsuyuzaki has joined #openstack-swift | 08:20 | |
*** kota_ has quit IRC | 08:22 | |
*** kota_ has joined #openstack-swift | 08:22 | |
*** ktsuyuzaki has quit IRC | 08:25 | |
*** ktsuyuzaki has joined #openstack-swift | 08:25 | |
*** kota_ has quit IRC | 08:27 | |
*** kota_ has joined #openstack-swift | 08:28 | |
*** ktsuyuzaki has quit IRC | 08:30 | |
*** kota_ has quit IRC | 08:32 | |
*** leopoldj has joined #openstack-swift | 08:53 | |
*** acoles_away is now known as acoles | 08:55 | |
acoles | minwoob: yes i will take a look at your review - been busy sorry! | 09:00 |
*** aix has joined #openstack-swift | 09:01 | |
openstackgerrit | Alistair Coles proposed openstack/python-swiftclient: Document missing functional test config option https://review.openstack.org/187503 | 09:17 |
acoles | timburke: ^^ this is the one useful part of my abandoned skip-identical patch ;) | 09:18 |
*** [1]dimasot has joined #openstack-swift | 09:22 | |
*** dimasot has quit IRC | 09:26 | |
*** [1]dimasot is now known as dimasot | 09:26 | |
*** fthiagogv has quit IRC | 09:38 | |
*** aix has quit IRC | 09:45 | |
*** aix has joined #openstack-swift | 09:45 | |
*** ho has quit IRC | 09:48 | |
*** haigang has quit IRC | 09:50 | |
openstackgerrit | Merged openstack/swift-bench: add storage policy option https://review.openstack.org/184590 | 10:02 |
*** haigang has joined #openstack-swift | 10:08 | |
dimasot | Hi where I can find the version of the Swift durability calculator that supports EC ? this one supports replicas only - http://enovance.github.io/swift-durability-calculator/ | 10:13 |
openstackgerrit | Alistair Coles proposed openstack/python-swiftclient: Document missing functional test config option https://review.openstack.org/187503 | 10:14 |
cschwede | dimasot: you’re looking for the fork from kota - it’s here: https://github.com/bloodeagle40234/swift-durability-calculator/tree/ec_calculator | 10:19 |
*** haigang has quit IRC | 10:22 | |
*** haigang has joined #openstack-swift | 10:28 | |
acoles | notmyname: i added a couple of reviews to priority reviews page that have been hanging around for ages, hope thats ok! | 11:19 |
*** delatte has quit IRC | 11:42 | |
*** delattec has quit IRC | 11:42 | |
*** dimasot has quit IRC | 11:50 | |
*** haigang has quit IRC | 12:06 | |
*** haigang has joined #openstack-swift | 12:07 | |
*** cdelatte has joined #openstack-swift | 12:09 | |
*** jistr is now known as jistr|class | 12:17 | |
*** jistr|class is now known as jistr | 12:22 | |
*** bkopilov has quit IRC | 12:32 | |
*** kei_yama has quit IRC | 12:39 | |
*** petertr7_away is now known as petertr7 | 13:13 | |
*** km has quit IRC | 13:14 | |
*** wbhuber has joined #openstack-swift | 13:22 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 13:28 |
*** acampbel11 has joined #openstack-swift | 13:29 | |
*** acampbell has joined #openstack-swift | 13:29 | |
acoles | notmyname: some other backports that never got merged: patch 134082 | 13:30 |
patchbot | acoles: https://review.openstack.org/#/c/134082/ | 13:30 |
acoles | patch 146211 | 13:31 |
patchbot | acoles: https://review.openstack.org/#/c/146211/ | 13:31 |
openstackgerrit | Prashanth Pai proposed openstack/swift: Refactor server side copy as middleware https://review.openstack.org/156923 | 13:36 |
openstackgerrit | Prashanth Pai proposed openstack/swift: versioned writes middleware https://review.openstack.org/134347 | 13:36 |
*** SkyRocknRoll has quit IRC | 13:38 | |
openstackgerrit | pradeep kumar singh proposed openstack/python-swiftclient: SwiftClient object upload beginning with / or "./" https://review.openstack.org/185269 | 13:39 |
*** ErickHeinrich has joined #openstack-swift | 13:41 | |
*** ErickHeinrich has quit IRC | 13:41 | |
*** thurloat_isgone is now known as thurloat | 13:43 | |
*** Triveni has quit IRC | 13:48 | |
*** blmartin has joined #openstack-swift | 13:49 | |
*** ppai has quit IRC | 13:51 | |
openstackgerrit | pradeep kumar singh proposed openstack/swift: Handle Disk IO error Exception in swift account auditor https://review.openstack.org/182734 | 13:51 |
*** annegentle has joined #openstack-swift | 13:59 | |
*** mwheckmann has joined #openstack-swift | 14:07 | |
*** petertr7 is now known as petertr7_away | 14:08 | |
*** annegentle has quit IRC | 14:08 | |
*** petertr7_away is now known as petertr7 | 14:09 | |
*** jkugel has joined #openstack-swift | 14:10 | |
*** minwoob has joined #openstack-swift | 14:11 | |
*** bkopilov has joined #openstack-swift | 14:11 | |
*** hugespoon has joined #openstack-swift | 14:13 | |
*** charlesw has joined #openstack-swift | 14:15 | |
*** annegentle has joined #openstack-swift | 14:15 | |
*** mmcardle has joined #openstack-swift | 14:15 | |
*** jistr is now known as jistr|mtg | 14:16 | |
*** mmcardle has quit IRC | 14:21 | |
*** bi_fa_fu has joined #openstack-swift | 14:26 | |
dmsimard | Trying to figure out at what frequency the Swift proxy servers fetch the Keystone revocation list and how to configure it but not finding anything conclusive - any hints ? | 14:28 |
*** bi_fa_fu has quit IRC | 14:30 | |
*** jistr|mtg is now known as jistr | 14:30 | |
*** charlesw has quit IRC | 14:31 | |
*** charlesw has joined #openstack-swift | 14:32 | |
*** breitz has quit IRC | 14:32 | |
acoles | dmsimard: that would be an authtoken middleware option i guess. | 14:32 |
acoles | dmsimard: found this https://github.com/openstack/keystonemiddleware/blob/master/keystonemiddleware/auth_token/__init__.py#L285-285 | 14:33 |
*** breitz has joined #openstack-swift | 14:33 | |
dmsimard | acoles: Interesting, that's not where I was looking - was expecting to find something in https://github.com/openstack/swift/blob/master/swift/common/middleware/keystoneauth.py | 14:34 |
mgagne | dmsimard: read here https://github.com/openstack/swift/blob/master/etc/proxy-server.conf-sample#L275-L290 | 14:34 |
minwoob | Hi. Would it be recommendable to have an EC policy map to 2 rings, as per https://trello.com/c/QWaYXWNf/120-small-file-optimizations | 14:35 |
mgagne | dmsimard: both middlewares are loaded: authtoken and keystoneauth | 14:37 |
hugespoon | anyone have any thoughts about why a container updater sweep would be taking so long? i have 2 clusters, the larger/more used cluster takes about 600 seconds to complete on average, and the smaller is taking ~4000 seconds. I'm not seeing any overt errors in the logs at this point, are there some specific stats i should be looking at? both are on 2.2.2 atm | 14:37 |
acoles | dmsimard: keystoneauth has no communication with keystone service - authtoken validates tokens and authenticates, keystoneauth then authorises acces based on authtoken's id output. | 14:38 |
dmsimard | acoles: Makes sense, thanks | 14:38 |
*** charlesw has quit IRC | 14:40 | |
*** jrichli has joined #openstack-swift | 14:41 | |
*** B4rker has joined #openstack-swift | 14:44 | |
*** thurloat is now known as thurloat_isgone | 15:00 | |
*** acoles is now known as acoles_away | 15:00 | |
*** B4rker has quit IRC | 15:05 | |
*** B4rker has joined #openstack-swift | 15:07 | |
*** nadeem has joined #openstack-swift | 15:20 | |
*** acampbell has quit IRC | 15:23 | |
*** acampbel11 has quit IRC | 15:23 | |
openstackgerrit | Merged openstack/swift: Handle Disk IO error Exception in swift account auditor https://review.openstack.org/182734 | 15:23 |
*** B4rker has quit IRC | 15:23 | |
*** B4rker has joined #openstack-swift | 15:24 | |
*** lyrrad has quit IRC | 15:26 | |
*** petertr7 is now known as petertr7_away | 15:31 | |
*** barra204 has joined #openstack-swift | 15:35 | |
*** shakamunyi has joined #openstack-swift | 15:35 | |
*** petertr7_away is now known as petertr7 | 15:36 | |
*** acampbel11 has joined #openstack-swift | 15:39 | |
*** acampbell has joined #openstack-swift | 15:39 | |
minwoob | notmyname: Some of us had reached a consensus regarding this last time: https://trello.com/c/0KddRS3T/104-pyeclib-investigate-python-gil-related-concerns-for-multithreading | 15:42 |
*** openstackgerrit has quit IRC | 15:42 | |
*** openstackgerrit has joined #openstack-swift | 15:43 | |
minwoob | notmyname: Should it be marked as closed, or are there some reasons to keep it open? | 15:43 |
*** petertr7 is now known as petertr7_away | 15:45 | |
jordanP | hey. Is there something wrong with check-swift-dsvm-functional ? The job seems to run 0 test | 15:47 |
jordanP | "Ran 0 tests in 0.002s" | 15:47 |
*** thurloat_isgone is now known as thurloat | 15:49 | |
*** admin6 has quit IRC | 15:50 | |
*** lyrrad has joined #openstack-swift | 15:51 | |
*** blmartin has quit IRC | 15:52 | |
peluse | minwoob, weve decided to no longer use trello to track EC issues/todo items (FYI). I guess I should add a note to all open items and put them in a new column called 'archived' or something and put a note that bugs are to be used to track EC work from now on | 15:53 |
*** acampbell has quit IRC | 15:54 | |
*** bi_fa_fu has joined #openstack-swift | 15:54 | |
*** acampbel11 has quit IRC | 15:55 | |
minwoob | peluse: I see. Will optimization-related updates also be tracked as bugs? | 15:55 |
peluse | minwoob, yes or just push a patch... folks should use IRC or the email list to bring up questions/topics in this area (or updates on benchmark results) | 15:58 |
peluse | minwoob, right now Intel+Swiftstack are working on baselining a few clusters w/3x (like right this minute) and once its solid we'll fire up EC and will publish configs and results probably next week. | 15:59 |
*** mmcardle has joined #openstack-swift | 16:00 | |
*** jordanP has quit IRC | 16:01 | |
*** nadeem has quit IRC | 16:01 | |
wbhuber | peluse: will there be a dashboard specific to handle EC bugs/features, ranging from low hanging fruits to most significant ones? | 16:02 |
wbhuber | peluse: regarding clusters, we are configuring one at the moment too - 3 proxy, 3 meta and 5 storage nodes. once it's all set up we will get the data out hopefully by end of next week | 16:03 |
peluse | wbhuber, we talked about that too (dashboard) and I'm sure it can be revisted but it was decided that, to keep the dashboard from having too many project specific stuff, that for now the EC section would go away and a crypto section would go these instead | 16:04 |
peluse | wbhuber, great on the clsuter info. I meant to publish the cluster info that we (us and SwiftStack are using) last week but haven't gotten to it yet. It will be more intersting w/results included anyways :) | 16:05 |
*** jistr has quit IRC | 16:05 | |
*** proteusguy has joined #openstack-swift | 16:06 | |
wbhuber | peluse: since EC section would go away from the dashboard, would there be specific tags that keep track of those under which we can work on the EC materials? | 16:06 |
peluse | wbhuber, that would be a good question for notmyname as I'm not sure what the various options are but yeah I think something like makes sense at least til we hit production (just to make queries easier) | 16:09 |
*** gyee has joined #openstack-swift | 16:10 | |
*** leopoldj has quit IRC | 16:11 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 16:12 |
cschwede | jordanP: looking | 16:12 |
*** fthiagogv has joined #openstack-swift | 16:13 | |
*** fthiagogv has quit IRC | 16:14 | |
*** fthiagogv has joined #openstack-swift | 16:14 | |
*** nadeem has joined #openstack-swift | 16:16 | |
*** nadeem has quit IRC | 16:17 | |
*** nadeem has joined #openstack-swift | 16:18 | |
*** B4rker has quit IRC | 16:19 | |
*** mmcardle has quit IRC | 16:22 | |
*** annegentle has quit IRC | 16:29 | |
*** hseipp has left #openstack-swift | 16:29 | |
*** acoles_away is now known as acoles | 16:29 | |
*** acampbell has joined #openstack-swift | 16:29 | |
*** acampbel11 has joined #openstack-swift | 16:29 | |
MooingLemur | peluse: hiya, did you catch what I mentioned into the channel yesterday for clayg? (19:09 UTC) | 16:31 |
*** B4rker has joined #openstack-swift | 16:33 | |
*** lyrrad has quit IRC | 16:34 | |
openstackgerrit | Tim Burke proposed openstack/python-swiftclient: Centralize header parsing https://review.openstack.org/184336 | 16:34 |
*** mmcardle has joined #openstack-swift | 16:41 | |
peluse | MooingLemur, yeah and I'm puzzled :) I have one of the SwiftStack engineers on site here this week doing perf work so haven't been able to try and make sense of it in my head. did you see anything back yet from clayg? | 16:42 |
notmyname | good morning | 16:42 |
peluse | guten morgen | 16:42 |
MooingLemur | peluse: not yet | 16:42 |
peluse | MooingLemur, OK. I'll be offline here for many hours but will check the scrollback later thia afternoon and try to jump in where I can. Will have more time next week for regular work I hope | 16:44 |
MooingLemur | peluse: When I found what looked to be an object that had 10/12 fragments and isn't making its way to completion, that's when I decided to leave it alone and poke at it later with the guidance of someone more knowledgable about the internals of swift. It might be a smoking gun with respect to the as yet unexplainable disappearing fragments | 16:45 |
MooingLemur | (policy is 9+3) | 16:46 |
*** mmcardle has quit IRC | 16:46 | |
*** acampbell111 has joined #openstack-swift | 16:48 | |
*** mmcardle has joined #openstack-swift | 16:57 | |
notmyname | good morning | 17:02 |
notmyname | oh, I already said that ;-) | 17:02 |
*** samueldmq has joined #openstack-swift | 17:03 | |
samueldmq | ello | 17:03 |
samueldmq | hello* | 17:03 |
samueldmq | could someone with permissions to triage bugs mark this as 'invalid' for swift https://bugs.launchpad.net/swift/+bug/1458945 | 17:04 |
openstack | Launchpad bug 1458945 in murano "Use graduated oslo.policy instead of oslo-incubator code" [High,Confirmed] - Assigned to Ekaterina Chernova (efedorova) | 17:04 |
samueldmq | marking as invalid instead of 'no longer affects', so we can keep track of the changes on the whole openstack ecosystem :) | 17:04 |
*** B4rker has quit IRC | 17:05 | |
notmyname | samueldmq: oh. sorry, just removed it right before you said that | 17:05 |
notmyname | samueldmq: how do I add it back? | 17:05 |
samueldmq | notmyname, I am re-adding , and then you mark as invalid, ok ? | 17:06 |
samueldmq | notmyname, and ideally put somethign in the description, I'd guess something like 'swift does not use policy system' should be ok | 17:07 |
*** acampbell111 has quit IRC | 17:08 | |
*** mmcardle has quit IRC | 17:09 | |
*** dimasot has joined #openstack-swift | 17:11 | |
*** petertr7_away is now known as petertr7 | 17:21 | |
*** thurloat is now known as thurloat_isgone | 17:22 | |
*** thurloat_isgone is now known as thurloat | 17:31 | |
notmyname | samueldmq: I got pulled to a meeting | 17:33 |
notmyname | samueldmq: ok, looking again now | 17:34 |
samueldmq | notmyname, re-adding now , just a few seconds | 17:34 |
notmyname | thurloat: nice away nick ;-) | 17:34 |
samueldmq | notmyname, done | 17:34 |
samueldmq | notmyname, already re-added | 17:35 |
samueldmq | notmyname, thanks | 17:35 |
notmyname | samueldmq: done | 17:36 |
notmyname | bah. launchpad timeout error | 17:37 |
notmyname | samueldmq: still getting timeouts from LP | 17:46 |
samueldmq | notmyname, yes, people from other projects also got that | 17:46 |
samueldmq | notmyname, I am sorry for that :( | 17:47 |
samueldmq | notmyname, I'd appreciate if you could try it later | 17:47 |
notmyname | not your fault :-) | 17:47 |
thurloat | notmyname, playing with the ring builder, and I notice that the lower the weight, the higher the balance ends up on rebalance. What does the final balance number indicate? | 17:53 |
*** aix has quit IRC | 17:57 | |
*** openstackgerrit has quit IRC | 18:09 | |
*** openstackgerrit has joined #openstack-swift | 18:10 | |
notmyname | thurloat: balance closer to 0 is better. ie 0 == balanced | 18:10 |
notmyname | thurloat: positive numbers means that it's overweighted. ie it has more partitions assigned than the weight should allow, relative to the rest of the cluster | 18:11 |
notmyname | negative numbers are underweighted for the assigned weight relative to the rest of the clsuter | 18:11 |
thurloat | so my existing entries were set to ~-48.5, and my two new entries were set to 1950.0 | 18:15 |
thurloat | and the lower the weight i set on the new ones, the higher my final balance number is | 18:19 |
thurloat | wouldn't the balance be lower with a lower weight? since there is less balancing to do? | 18:19 |
thurloat | notmyname, trying to better understand the net effect on the cluster if I were to deploy these new rings. and how the balance/weight plays into it | 18:21 |
*** annegentle has joined #openstack-swift | 18:21 | |
thurloat | it was my understanding that the lower the initial weight, the more gradual the shuffling of partitions would be. | 18:22 |
openstackgerrit | Clint 'SpamapS' Byrum proposed openstack/python-swiftclient: Add a get_conn method to SwiftService https://review.openstack.org/187714 | 18:24 |
*** petertr7 is now known as petertr7_away | 18:33 | |
*** petertr7_away is now known as petertr7 | 18:37 | |
*** wbhuber_ has joined #openstack-swift | 18:37 | |
*** wbhuber has quit IRC | 18:41 | |
openstackgerrit | Darrell Bishop proposed openstack/swift: Allow 1+ object-servers-per-disk deployment https://review.openstack.org/184189 | 18:43 |
*** ChanServ sets mode: +v tdasilva | 18:46 | |
*** tdasilva has left #openstack-swift | 18:50 | |
*** tdasilva has joined #openstack-swift | 18:50 | |
*** ChanServ sets mode: +v tdasilva | 18:50 | |
*** silor1 has joined #openstack-swift | 18:53 | |
*** dimasot has quit IRC | 18:54 | |
*** silor has quit IRC | 18:55 | |
*** openstackgerrit has quit IRC | 18:56 | |
*** openstackgerrit has joined #openstack-swift | 18:56 | |
notmyname | I'd like to welcome tdasilva as a new swift core reviewer | 18:58 |
swifterdarrell | notmyname: tdasilva: woot! | 18:59 |
tdasilva | swifterdarrell, notmyname: thanks :) | 18:59 |
torgomatic | now get reviewing! /me cracks whip ;) | 19:00 |
tdasilva | hehe...the list of reviews is not that long, is it sam? ;) | 19:01 |
acoles | tdasilva: welcome aboard! | 19:07 |
tdasilva | acoles: thanks! :) | 19:08 |
minwoob | How would one recommend one to upload a patch set to a previous (not the current) patch set, and to do so cleanly? | 19:10 |
*** petertr7 is now known as petertr7_away | 19:10 | |
minwoob | It looks like at the current state I might be uploading 74 changed files, when I only should have 2. | 19:10 |
*** petertr7_away is now known as petertr7 | 19:12 | |
minwoob | (This is for https://review.openstack.org/#/c/178317/ btw. Been trying to make sure I'm modifying patch set 3, and not the most current one). | 19:12 |
notmyname | minwoob: if you check out patch set 3, make your changes, amend that commit, and push up again, that should be it. | 19:13 |
*** wbhuber__ has joined #openstack-swift | 19:15 | |
*** greghaynes has joined #openstack-swift | 19:15 | |
*** tellesnobrega_ has joined #openstack-swift | 19:16 | |
*** wbhuber_ has quit IRC | 19:18 | |
*** gyee has quit IRC | 19:21 | |
acoles | minwoob: what notmyname said, can be done with git review -d 178317,3 (NB ,3 at end) | 19:22 |
*** mjseger has quit IRC | 19:32 | |
*** annegentle has quit IRC | 19:35 | |
*** annegentle has joined #openstack-swift | 19:36 | |
*** thurloat is now known as thurloat_isgone | 19:43 | |
openstackgerrit | Minwoo Bae proposed openstack/swift: The hash_cleanup_listdir function should only be called when necessary. https://review.openstack.org/178317 | 19:44 |
*** annegent_ has joined #openstack-swift | 19:47 | |
minwoob | notmyname acoles: Thank you! | 19:48 |
*** annegentle has quit IRC | 19:50 | |
notmyname | acoles: oh, cool. I didn't know about ,N | 19:59 |
jrichli | tdasilva: congrats! | 20:03 |
portante | tdasilva: yes, congrats! | 20:03 |
*** samueldmq has quit IRC | 20:05 | |
openstackgerrit | Alistair Coles proposed openstack/python-swiftclient: WIP Make default get_auth timeout be None https://review.openstack.org/187749 | 20:05 |
*** openstackgerrit has quit IRC | 20:10 | |
*** openstackgerrit has joined #openstack-swift | 20:10 | |
*** tellesnobrega_ has quit IRC | 20:16 | |
tdasilva | jrichli, portante: thanks! | 20:19 |
openstackgerrit | Christian Schwede proposed openstack/swift: Don't skip tests if Swift is not running https://review.openstack.org/187754 | 20:19 |
notmyname | cschwede: isn't this related to the in-process tests portante put together? | 20:20 |
cschwede | notmyname: not sure, but at the end the plugin seems to catch the exception, which should not happen | 20:21 |
*** cdelatte has quit IRC | 20:22 | |
*** acoles is now known as acoles_away | 20:23 | |
*** nadeem has quit IRC | 20:32 | |
*** proteusguy has quit IRC | 20:35 | |
*** lcurtis has joined #openstack-swift | 20:39 | |
*** operator99 is now known as gyee | 20:39 | |
lcurtis | what is best way in swift to bring a server offline for several hours for maintenance without replicating all data | 20:40 |
notmyname | lcurtis: a whole server? | 20:40 |
lcurtis | notmyname yes | 20:40 |
notmyname | lcurtis: if you stop the servers (ie stop accespting swift -related connections on it, that will be fine | 20:41 |
notmyname | swift won't automatically rereplicate data on a down server (just for a down drive) | 20:41 |
lcurtis | what is the time before swift would start replicating to hand off node? | 20:41 |
notmyname | then when you bring it back online, swift will fix it all up | 20:41 |
*** fthiagogv has quit IRC | 20:41 | |
notmyname | it will immediately start putting new stuff on a handoff. but replication won't | 20:42 |
*** bi_fa_fu has quit IRC | 20:42 | |
MooingLemur | lcurtis: it's not like ceph. There is no time frame where it will start replicating from a down server. | 20:42 |
MooingLemur | lcurtis: it will only automatically increase durability for an unmounted drive with the swift server still running | 20:42 |
openstackgerrit | Samuel Merritt proposed openstack/swift: EC: support multiple ranges for GET requests https://review.openstack.org/173497 | 20:45 |
lcurtis | what is mechanism if server is down longer than x hours, new replicas will be created | 20:45 |
MooingLemur | lcurtis: I think you'd have to script that yourself, remove the devices from the ring or set them with zero weight, and rebalance. | 20:46 |
lcurtis | MooingLemur Thanks! | 20:47 |
lcurtis | man this is such a great channel..thank you folks | 20:47 |
MooingLemur | under normal circumstances, a server going down shouldn't affect durability, because in most cases the data will be fine. | 20:47 |
MooingLemur | you bring your server back up, and everything is still there | 20:47 |
lcurtis | right..I was just concerned with replicas | 20:48 |
lcurtis | like if server down longer than x hours, new replicas would be created | 20:48 |
MooingLemur | Of course, it could affect availability if multiple servers went down. But it's rather costly to move data around in terms of I/O and bandwidth, compared to the risk that some objects will temporarily get 404. | 20:49 |
lcurtis | sure | 20:49 |
lcurtis | makes sense | 20:49 |
notmyname | lcurtis: that's not done in swift intentionally. we don't want to have some automated cascading death spiral scenario | 20:49 |
notmyname | so a server down requires an operator (or management software) to take action on if it's something more serious than "wait for it to finish rebooting" or similar | 20:50 |
glange | can somebody create a blueprint for "automated cascading death spiral scenario"? :) | 20:50 |
lcurtis | notmyname agreed...very logical in that sense | 20:50 |
minwoob | Anyone have a link to a page that lists all the advantages of having an object server per disk? | 20:50 |
notmyname | minwoob: best you'll find right now, AFAIK, is the gerrit review page | 20:51 |
minwoob | If no such page exists, that's fine. | 20:51 |
minwoob | notmyname: Ah, I see. | 20:51 |
minwoob | notmyname: Thanks. | 20:51 |
*** silor1 has quit IRC | 20:52 | |
*** gyee has quit IRC | 20:53 | |
*** gyee has joined #openstack-swift | 20:53 | |
lcurtis | actually...make me think...does data then get replicated back from handoff nodes once server comes back up from maintenance? | 20:55 |
*** petertr7 is now known as petertr7_away | 21:02 | |
*** shakamunyi_ has joined #openstack-swift | 21:03 | |
*** shakamunyi__ has joined #openstack-swift | 21:04 | |
openstackgerrit | Janie Richling proposed openstack/swift: WIP - working on the encryption feature. https://review.openstack.org/157907 | 21:05 |
*** shakamunyi__ is now known as tylerdurden | 21:05 | |
*** tylerdurden has quit IRC | 21:08 | |
*** shakamunyi_ has quit IRC | 21:08 | |
notmyname | lcurtis: yup | 21:11 |
lcurtis | excellent...great to know...ty | 21:11 |
openstackgerrit | Minwoo Bae proposed openstack/swift: The hash_cleanup_listdir function should only be called when necessary. https://review.openstack.org/178317 | 21:12 |
*** nadeem has joined #openstack-swift | 21:15 | |
*** wbhuber__ has quit IRC | 21:16 | |
*** bi_fa_fu has joined #openstack-swift | 21:27 | |
*** nadeem has quit IRC | 21:27 | |
*** annegent_ has quit IRC | 21:29 | |
*** annegentle has joined #openstack-swift | 21:31 | |
mattoliverau | Yay! Congrats tdasilva! | 21:33 |
mattoliverau | Oh and good morning to all as well | 21:33 |
*** acampbell has quit IRC | 21:37 | |
*** acampbel11 has quit IRC | 21:37 | |
*** mwheckmann has quit IRC | 21:46 | |
*** jkugel has quit IRC | 21:46 | |
minwoob | So while I was looking through some unit tests while working on the hash_cleanup_listdir patch, I noticed in test.unit.obj.test_ssync_sender:TestBaseSsync._verify_diskfile_sync that it expects 'ETag' will be duplicated as 'Etag' by ssync. | 21:48 |
minwoob | Is there a reason for this, or have we identified a bug? | 21:48 |
*** annegentle has quit IRC | 21:48 | |
*** aix has joined #openstack-swift | 21:50 | |
minwoob | Moreover, I've read that ssync is used as a better alternative to rsync, but where would one find documentation that points to some of its advantages? | 21:51 |
*** bi_fa_fu has quit IRC | 21:51 | |
*** bi_fa_fu has joined #openstack-swift | 21:51 | |
*** bi_fa_fu is now known as bi_fa_fu_ | 21:53 | |
*** bi_fa_fu_ is now known as Ciipher | 21:59 | |
glange | minwoob: look for ssync on this page: http://docs.openstack.org/developer/swift/overview_replication.html | 22:00 |
glange | minwoob: ssync didn't work out for the testing we did, it was too slow | 22:01 |
*** Ciipher is now known as bi_fa_fu | 22:01 | |
*** bi_fa_fu is now known as Ciipher | 22:02 | |
glange | minwoob: also, you'll note that the planned index.db was never implemented -- that is where the hope for faster replication was | 22:03 |
glange | https://review.openstack.org/#/c/44115/ <-- the author described it as "experimental" and not for use in production clusters | 22:04 |
*** cppforlife_ has quit IRC | 22:04 | |
minwoob | glange: Thanks. What is the plan for it then? | 22:07 |
glange | the idea behind ssync and index.db was that if swift kept track of new objects/files on disk, replication wouldn't have to walk the file system computing hashes as much | 22:07 |
glange | you can't track what rysnc pushes really | 22:07 |
glange | I don't know what the status of it is or of the effort to improve replication | 22:07 |
glange | if there is even such an effort | 22:07 |
notmyname | minwoob: ssync and rsync are good at different things. unfortunately they're also bad at different things too. ssync is chatty, so replicating a whole partition with it isn't very good. but rsync isn't all that great if there's just a few differences between two partition replicas | 22:11 |
notmyname | ssync has been improved somewhat since it was added to swift, and EC requires it | 22:11 |
*** annegentle has joined #openstack-swift | 22:12 | |
minwoob | notmyname glange: Regarding how it duplicates 'ETag' with 'Etag', though, is that indicative of some functionality concerns? | 22:15 |
minwoob | Maybe it isn't quite as stable as we'd want it to be? | 22:16 |
notmyname | minwoob: I don't remember the details around that one thing, but the general idea (I think) is that the header name is case-insensitive, and that was added for some sort of compat reason | 22:16 |
*** wbhuber has joined #openstack-swift | 22:19 | |
minwoob | notmyname: The test itself may be fine, but when I was stepping through it with my debugger, I do remember a header that I had temporarily added was replicated with the wrong case (like 'ETag' to 'Etag'). | 22:20 |
minwoob | notmyname: If you're saying though, that ssync itself is the one that is case-insensitive about header names, then I guess there's no issue there (still wondering why that would be, though). | 22:24 |
*** annegentle has quit IRC | 22:29 | |
*** cppforlife_ has joined #openstack-swift | 22:38 | |
*** mmcardle has joined #openstack-swift | 22:40 | |
*** jrichli has quit IRC | 22:40 | |
*** kutija has joined #openstack-swift | 22:46 | |
peluse | minwoob, the etag duplciate thing was a bug that has since been addressed so you may still see some tests that make sure its not duplicate | 22:50 |
*** mmcardle has quit IRC | 22:50 | |
peluse | minwoob, it was introduced as part of the EC work. We had a few patches that kept it from happening in a few different places, can't check now but I think they both landed | 22:51 |
peluse | minwoob, and, BTW, the fix was specific to certain headers so I'm thinking you would have to change some code in order to introduce a new one that would end up getting duplicated | 22:52 |
peluse | minwoob, actually one part of it not in there yet: https://review.openstack.org/#/c/173973/ the other part that is in there, which is sufficient but combo is better we think is in init() of RebuildingECDiskFileStream() | 22:57 |
*** blmartin has joined #openstack-swift | 22:59 | |
*** kutija has quit IRC | 23:02 | |
*** km has joined #openstack-swift | 23:08 | |
*** annegentle has joined #openstack-swift | 23:18 | |
*** annegentle has quit IRC | 23:20 | |
*** chlong has joined #openstack-swift | 23:22 | |
*** kei_yama has joined #openstack-swift | 23:28 | |
*** minwoob has quit IRC | 23:35 | |
*** barra204 has quit IRC | 23:57 | |
*** shakamunyi has quit IRC | 23:57 | |
*** ho has joined #openstack-swift | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!