Thursday, 2019-02-07

*** vintbra has joined #openstack-swift00:16
*** vintbra has quit IRC00:16
*** itlinux has joined #openstack-swift00:26
*** itlinux has quit IRC00:33
*** itlinux has joined #openstack-swift00:34
*** itlinux has quit IRC00:38
*** itlinux has joined #openstack-swift00:39
*** itlinux has quit IRC00:44
*** itlinux has joined #openstack-swift00:46
*** itlinux has quit IRC00:48
openstackgerritTim Burke proposed openstack/swift master: encryption: Stop being cutesy with os.path.join()  https://review.openstack.org/63538000:51
timburkezigo: i'm so incredibly sorry. ^^^ may be a pre-req for p 633671, and it *definitely* complicates the resolution of https://bugs.launchpad.net/swift/+bug/1813725 :-(00:53
openstackLaunchpad bug 1813725 in OpenStack Object Storage (swift) "Object encryption key truncated sometimes when used with Barbican" [Undecided,New]00:53
patchbothttps://review.openstack.org/#/c/633671/ - swift - Fix decryption for broken objects - 6 patch sets00:53
*** itlinux has joined #openstack-swift01:06
*** itlinux has quit IRC01:10
*** gyee has quit IRC01:22
*** itlinux has joined #openstack-swift01:45
*** itlinux has quit IRC01:47
*** itlinux has joined #openstack-swift01:49
*** itlinux has quit IRC01:52
*** itlinux has joined #openstack-swift01:56
*** itlinux has quit IRC02:01
*** mahatic has quit IRC02:20
*** psachin has joined #openstack-swift02:56
*** rcernin has joined #openstack-swift03:07
*** rchurch_ has joined #openstack-swift03:24
*** rchurch has quit IRC03:25
*** itlinux has joined #openstack-swift03:41
*** gkadam has joined #openstack-swift04:06
*** rcernin has quit IRC04:35
*** itlinux has quit IRC04:44
*** itlinux_ has joined #openstack-swift04:45
*** itlinux_ has quit IRC04:45
*** itlinux has joined #openstack-swift04:59
*** itlinux has quit IRC05:03
*** itlinux has joined #openstack-swift05:04
*** itlinux has quit IRC05:26
*** itlinux has joined #openstack-swift05:40
*** e0ne has joined #openstack-swift06:10
*** pcaruana has joined #openstack-swift07:02
*** e0ne has quit IRC07:10
*** e0ne has joined #openstack-swift07:20
*** e0ne has quit IRC07:31
*** itlinux has quit IRC07:50
*** itlinux has joined #openstack-swift07:58
*** itlinux_ has joined #openstack-swift08:06
*** itlinux has quit IRC08:09
*** hseipp has joined #openstack-swift08:12
*** tkajinam has quit IRC08:15
*** ccamacho has joined #openstack-swift08:20
*** itlinux_ has quit IRC08:22
*** hseipp has quit IRC08:33
*** hseipp has joined #openstack-swift08:34
*** hseipp has quit IRC09:09
*** hseipp has joined #openstack-swift09:10
*** ccamacho has quit IRC09:23
*** e0ne has joined #openstack-swift10:03
*** ccamacho has joined #openstack-swift11:49
*** e0ne has quit IRC11:56
*** e0ne has joined #openstack-swift11:57
*** gkadam has quit IRC13:02
*** waverider has joined #openstack-swift13:56
*** psachin has quit IRC14:26
*** irclogbot_2 has joined #openstack-swift14:31
*** ccamacho has quit IRC15:24
openstackgerritClay Gerrard proposed openstack/swift master: Rebuild frags for unmounted disks  https://review.openstack.org/62905615:33
*** gyee has joined #openstack-swift16:13
*** pcaruana has quit IRC16:21
zigotimburke: For our patch, it looks like I overwrote stuff you commited, what you proposed was much nicer.16:22
*** ccamacho has joined #openstack-swift16:24
*** e0ne has quit IRC17:08
*** vr42 has joined #openstack-swift17:12
*** itlinux has joined #openstack-swift17:18
*** hseipp has quit IRC17:22
notmynamegood morning17:22
*** admin6 has left #openstack-swift17:23
*** itlinux_ has joined #openstack-swift17:26
*** itlinux has quit IRC17:27
openstackgerritMerged openstack/swift master: Fix flakey func test teardown  https://review.openstack.org/63444917:38
openstackgerritMerged openstack/swift master: Fix flakey func test setup  https://review.openstack.org/63436217:38
*** waverider has quit IRC17:47
*** itlinux_ has quit IRC17:58
*** vr42 has quit IRC18:04
timburkezigo: i'll see what i can do to get those stacked into something reasonable... but as a heads up, if you have objects (1) that were uploaded while you had encryption enabled, (2) whose name started with a slash on that initial PUT, and (3) got copied to another container (which would include a container in a different account)... it's going to be really difficult to find the correct path to use to decrypt container listings :-(18:05
timburkei *think* decrypting the actual object data may still be fairly straight-forward, though?18:05
timburkewe might want to prioritize getting https://review.openstack.org/#/c/634507/ to address https://bugs.launchpad.net/swift/+bug/172992118:06
openstackLaunchpad bug 1729921 in OpenStack Object Storage (swift) "Changing encryption root secret causes container listings to 500" [Low,Confirmed]18:06
patchbotpatch 634507 - swift - encryption: Be more tolerant of errors while decry... - 2 patch sets18:06
timburke(because it'd present in the same way)18:06
*** mvkr has quit IRC18:12
*** e0ne has joined #openstack-swift18:15
*** e0ne has quit IRC18:22
claygtimburke: what do you think about https://review.openstack.org/#/c/629056/7/swift/obj/reconstructor.py18:30
patchbotpatch 629056 - swift - Rebuild frags for unmounted disks - 7 patch sets18:30
claygthe more I think about it, the more i'm leaning towards ... maybe call it... "handoff_rebuild_node_count" ???18:31
timburkeclayg: with the replicator, do we have a cap on how deep we'll go?18:32
claygthat's a good thought18:35
claygdoesn't look like it18:35
timburkei kinda liked the idea of grabbing the next ec_n_unique_fragments nodes and rotating them according to the frag we're trying to place... then maybe we could repeat that until we run out of disks?18:39
timburkelike, the handoff serves two purposes -- first, ensure durability; we'll get that wherever we manage to rebuild. but second, to increase availability -- and we can only get that if it's early enough in the handoff list18:41
*** vr42 has joined #openstack-swift18:41
*** e0ne has joined #openstack-swift18:42
timburkei *do* think that the doubled-up-frag behavior may need to be different when we're sending to a handoff instead of a primary, though. primaries may need to double-up so the frag gets where it's going faster. but it didn't belong on the handoff in the first place, so a 409 (or something) when we've already got a frag we're responsible for seems reasonable18:43
*** cschwede has quit IRC18:43
timburkei'll be back in a bit -- got some other obligations to take care of -- but i'll keep thinking on it18:44
claygIf we do the rotate thing I think there’s a higher chance of doubling... if we do the skip thing availability doesn’t go up after a couple of replica counts because the proxy won’t look out there19:01
*** remi_ness has joined #openstack-swift19:04
openstackgerritvianney rancurel proposed openstack/liberasurecode master: fix: data access when having non-zero metadata size  https://review.openstack.org/63560319:12
openstackgerritvianney rancurel proposed openstack/liberasurecode master: fix: proper support of more than 32 fragments  https://review.openstack.org/63560419:12
openstackgerritvianney rancurel proposed openstack/liberasurecode master: feature: quadiron backend and tests  https://review.openstack.org/63560519:12
*** rchurch has joined #openstack-swift19:26
*** rchurch_ has quit IRC19:28
*** vr42 has quit IRC19:42
*** remi_ness has quit IRC20:07
timburketdasilva: how crazy would it be to include encryption in the pipeline for https://review.openstack.org/#/c/626663/ ? thinking about ways to ensure we can still read existing data following https://review.openstack.org/#/c/635380/20:14
patchbotpatch 626663 - swift - Add rolling upgrade tests - 4 patch sets20:14
patchbotpatch 635380 - swift - encryption: Stop being cutesy with os.path.join() - 1 patch set20:14
tdasilvatimburke: mmm...it would be great to test encryption, but a drawback would be the inability to test earlier releases20:16
timburkeyeah, i was thinking about that too :-/20:16
tdasilvabut maybe covering encryption might outweigh the benefit of testing earlier releases ??20:16
*** ccamacho has quit IRC20:28
timburkemaybe we could make it conditional on which version we start from?20:40
tdasilvaadding encryption you mean?20:56
tdasilvathat might work20:56
*** rdejoux has joined #openstack-swift21:03
*** rdejoux has quit IRC21:12
*** e0ne has quit IRC21:19
openstackgerritClay Gerrard proposed openstack/swift master: Rebuild frags for unmounted disks  https://review.openstack.org/62905621:35
claygtimburke: ^ well I talked myself into rebuild_handoff_node_count 🤷‍♂️21:35
timburkemight be time fo me to cherry-pick https://review.openstack.org/#/c/586903/ again...21:41
patchbotpatch 586903 - swift - Display crypto data/metadata details in swift-obje... - 4 patch sets21:41
openstackgerritTim Burke proposed openstack/swift master: encryption: Stop being cutesy with os.path.join()  https://review.openstack.org/63538021:50
openstackgerritPete Zaitcev proposed openstack/swift master: py3: port the container sharder  https://review.openstack.org/57032022:04
tdasilvawhy don't we include middlewares like slo in the pipeline of internal_client?22:09
timburkei'm guessing just because we've mainly thought about it in terms of the expirer (and later, reconciler), neither of which need it, and nobody's thought too hard about it otherwise22:16
timburkedoes the reconciler include ?multipart-manifest=get when re-PUTting data? with SLO enabled, will it be able to reconcile a busted SLO?22:18
zaitcevtimburke, mattoliverau: I dropped the _path out from sharder, this should be ready.22:22
tdasilvatimburke: not sure, will check out22:23
openstackgerritPete Zaitcev proposed openstack/swift master: Rename ContainerBroker.path to cpath  https://review.openstack.org/63567722:35
*** tkajinam has joined #openstack-swift22:55
*** mvkr has joined #openstack-swift23:03
*** takamatsu has quit IRC23:19

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!