Wednesday, 2017-05-31

*** itlinux has quit IRC00:11
*** MelindaBunny has quit IRC00:11
*** NM has joined #openstack-swift00:15
*** NM has quit IRC00:17
*** clarkb has joined #openstack-swift00:24
clarkbclayg: hey, so I've made a bit of progress in other areas that were tricky for enabling tls by default in devstack. Looks like the swift functional tests still fail with that enabled. Anything I can do to help out around that?00:25
clarkbclayg: I'm happy to write the chagnes if you can point me in the right direction00:25
*** alenavolk has quit IRC00:29
*** alenavolk has joined #openstack-swift00:31
*** alenavolk has quit IRC00:38
*** zhengyin has joined #openstack-swift00:47
timburkewell that's...interesting http://logs.openstack.org/69/469269/1/check/gate-swift-docs-ubuntu-xenial/9566728/console.html#_2017-05-30_21_55_27_93889601:03
timburkelooks like https://github.com/openstack/swift/commit/2ca3035 was a bit premature -- so when sphinx was updated in the gate following https://github.com/openstack/requirements/commit/6b4753c our docs broke01:05
timburkemeanwhile, the failure in https://8b86aea46fb38e6450f2-0e5f4c086da474abc1df58826577db2f.ssl.cf1.rackcdn.com/469269/6698/probetests/console.txt has a traceback that simply doesn't make any sense01:08
*** lucasxu has joined #openstack-swift01:17
*** lucasxu has quit IRC01:17
*** lucasxu has joined #openstack-swift01:20
*** lucasxu has quit IRC01:22
*** lucasxu has joined #openstack-swift01:23
*** NM has joined #openstack-swift01:31
*** ianychoi_ is now known as ianychoi01:35
*** tovin07_ has joined #openstack-swift01:39
kota_good morning01:44
*** aselius has quit IRC01:45
*** lan1 has quit IRC01:49
*** NM has quit IRC01:55
*** lucasxu has quit IRC02:01
*** klrmn has quit IRC02:02
*** alenavolk has joined #openstack-swift02:10
*** lucasxu has joined #openstack-swift02:11
*** lucasxu has quit IRC02:13
*** alenavolk has quit IRC02:14
*** lucasxu has joined #openstack-swift02:14
*** alenavolk has joined #openstack-swift02:25
*** mwheckmann has joined #openstack-swift02:30
*** lucasxu has quit IRC02:40
*** lucasxu has joined #openstack-swift02:45
*** lucasxu has quit IRC02:47
notmynamereminder, team meeting in about 4 hours02:49
*** klrmn has joined #openstack-swift02:51
openstackgerritTim Burke proposed openstack/swift master: Revert "Make Sphinx treat warnings as errors"  https://review.openstack.org/46931402:53
*** lucasxu has joined #openstack-swift02:56
openstackgerritTim Burke proposed openstack/swift master: Make Sphinx treat warnings as errors  https://review.openstack.org/46931502:57
timburkeland the first one to un-stick the gate, work with infra to get green balls on the second one02:58
*** lucasxu has quit IRC03:04
*** mwheckmann has quit IRC03:05
*** psachin has quit IRC03:29
*** sanchitmalhotra has joined #openstack-swift03:30
mattoliverautimburke: nice work on the gate issues.03:33
*** chsc has joined #openstack-swift03:33
*** chsc has joined #openstack-swift03:33
*** chsc has quit IRC03:39
*** cshastri has joined #openstack-swift03:41
*** links has joined #openstack-swift03:45
*** lucasxu has joined #openstack-swift03:45
*** kei_yama has quit IRC03:46
*** psachin has joined #openstack-swift03:47
*** kestrels has joined #openstack-swift03:55
*** kestrels2 has quit IRC03:55
*** kei_yama has joined #openstack-swift04:03
*** wasmum has quit IRC04:05
*** jaosorior has quit IRC04:10
*** lucasxu has quit IRC04:11
*** jaosorior has joined #openstack-swift04:13
*** zhurong has joined #openstack-swift04:15
*** zhurong has quit IRC04:19
*** alenavolk has quit IRC04:22
*** alenavolk has joined #openstack-swift04:25
*** zhengyin has quit IRC04:32
*** chsc has joined #openstack-swift04:51
*** chsc has quit IRC04:58
*** alenavolk has quit IRC05:09
*** alenavolk has joined #openstack-swift05:11
*** zhengyin has joined #openstack-swift05:11
*** alenavolk has quit IRC05:25
*** alenavolk has joined #openstack-swift05:26
*** alenavolk has quit IRC05:26
*** skudlik has joined #openstack-swift05:30
*** gyee has quit IRC05:34
mahaticrledisez: sure, no problem. Thanks for updating the agenda.05:43
*** ChubYann has quit IRC05:58
notmynamehello, world06:08
*** jaosorior has quit IRC06:08
*** mvk has quit IRC06:09
*** rcernin has joined #openstack-swift06:10
mattoliveraunotmyname: o/06:12
notmynamehey mattoliverau. how are you?06:13
mattoliverauOk, got some interviews lined up, so that's exciting. Been enjoying time with the family. Lucy is as a cool interactive stage.. so so far unemployment has been kinda nice :)06:14
*** jaosorior has joined #openstack-swift06:17
notmynamethat's fun. I hope you do find something soon06:23
*** m_kazuhiro has joined #openstack-swift06:29
*** zhengyin has quit IRC06:33
*** zhengyin has joined #openstack-swift06:34
tovin07_hi notmyname06:41
tovin07_recently, we talked about osprofiler in swift06:41
tovin07_last week, i publish a patch for this https://review.openstack.org/#/c/468316/06:41
patchbotpatch 468316 - swift - [WiP] OSprofiler in OpenStack Swift06:41
tovin07_can you take a look at it and drop some comments?06:41
notmynameyep. I glanced over it this morning, actually06:41
tovin07_oh, thanks :D06:42
notmynameI definitely appreciate all the detail you put in the commit message06:43
notmynameand I'm glad to see timburke working with you on it06:43
notmynameI'm still nervous about the extra dependencies06:44
*** zhengyin has quit IRC06:44
tovin07_yes, about extra dependencies, I tried not to use webob, and make osprofiler turned of by default06:47
tovin07_*off06:47
*** tesseract has joined #openstack-swift06:53
*** klrmn has quit IRC06:58
mahaticfyi, meeting time in about 3 mins in #openstack-meeting06:58
*** zhengyin has joined #openstack-swift07:00
notmynamemeeting time in #openstack-swift07:00
kota_notmyname: thx for reminder07:01
acolesgood morning07:02
*** mvk has joined #openstack-swift07:08
*** geaaru has joined #openstack-swift07:08
* kota_ is feeling i need availabe commands list when i was the chair on the irc meeting07:19
openstackgerritChristian Schwede proposed openstack/swift master: Add support to increase object ring partition power  https://review.openstack.org/33729707:19
notmynamekota_: #link #info #agreed #topic and #startmeeting are the ones I know07:22
notmynamethe vote one are tricky, so I just don't mess with them07:22
kota_notmyname: cool, thanks07:22
kota_I'll be add them into meeting wiki for other chairs07:23
kota_s/be//07:23
*** pcaruana has joined #openstack-swift07:26
acoleskota_: the commands are listed by meetbot whent he meeting starts, but having them on the wiki would be great too07:31
*** cbartz has joined #openstack-swift07:33
*** skudlik has quit IRC07:34
*** qwerty has joined #openstack-swift07:40
*** qwerty has quit IRC07:41
*** aselius has joined #openstack-swift07:45
*** adriant has quit IRC07:52
*** jeffli has joined #openstack-swift07:57
acolesrledisez: which is highest priority for you - https://review.openstack.org/#/c/435771/ or https://review.openstack.org/#/c/456921/ ?08:01
patchbotpatch 435771 - swift - Rewrite redirection in cname_lookup & domain_remap08:01
patchbotpatch 456921 - swift - Fix SSYNC failing to replicate unexpired object08:01
acolesrledisez: or both? :)08:01
rledisezSSYNC one, it's critical for, data availability08:01
rledisezcname_lookup, it's just broken :)08:01
rledisezso not a big deal :D08:02
notmynamemahatic: I'll review the meeting log my tomorrow and work on updating the meeting agenda page. also feel free to update it yourself as well :-)08:02
hugokuoanyone knows how's the correct string should be for delete object name like this08:02
acolesmahatic: ^^ note rledisez's response , if you have time to look at a patch08:02
* notmyname is off to bed08:02
acolesnotmyname: good night!08:02
hugokuoabc/abc/you're fine!abc08:03
mahaticnotmyname: sure, thanks. good night!08:03
hugokuoIf I put backslash prior to examination mark, Swift CLI decoded it as %5C%21 , but the actual file name should be decode as %2108:04
hugokuonot sure if this should be a bug in Swift CLI08:04
mahaticacoles: thanks, will do. SSYNC already seems to have a couple of people around. I'll try to get around the broken fix :)08:04
mahaticwill try to keep a tab on how SSYNC patch is progressing as well08:04
kota_notmyname: good night08:05
*** oshritf has joined #openstack-swift08:10
*** m_kazuhiro has quit IRC08:10
*** oshritf has quit IRC08:10
*** oshritf has joined #openstack-swift08:20
*** oshritf has quit IRC08:33
*** kei_yama has quit IRC08:44
*** vint_bra1 has joined #openstack-swift08:53
*** ediardo_ has joined #openstack-swift08:54
*** remixtj has joined #openstack-swift08:55
*** jeffl has joined #openstack-swift08:56
*** baffle__ has joined #openstack-swift08:56
*** briancli1e has joined #openstack-swift08:56
*** portante_ has joined #openstack-swift09:00
*** dmellado_ has joined #openstack-swift09:00
*** jeffli has quit IRC09:01
*** links has quit IRC09:01
*** remix_tj has quit IRC09:01
*** vint_bra has quit IRC09:01
*** ediardo has quit IRC09:01
*** baffle has quit IRC09:01
*** dmellado has quit IRC09:01
*** portante has quit IRC09:01
*** jistr has quit IRC09:01
*** briancline has quit IRC09:01
*** portante_ is now known as portante09:01
*** ediardo_ is now known as ediardo09:01
*** jistr has joined #openstack-swift09:02
*** charz has quit IRC09:03
*** mingyu has joined #openstack-swift09:03
*** charz has joined #openstack-swift09:06
*** links has joined #openstack-swift09:06
*** skudlik has joined #openstack-swift09:10
*** mingyu has quit IRC09:17
*** jaosorior is now known as jaosorior_lunch09:19
*** NM has joined #openstack-swift09:36
*** NM has quit IRC09:45
*** dmellado_ is now known as dmellado09:46
*** aselius has quit IRC09:54
*** mvk has quit IRC09:55
*** tovin07_ has quit IRC09:55
*** mvk has joined #openstack-swift10:10
openstackgerritAlistair Coles proposed openstack/swift master: Add structure to storage policy configuration guide  https://review.openstack.org/46836010:11
*** links has quit IRC10:16
*** links has joined #openstack-swift10:36
*** jaosorior_lunch is now known as jaosorior10:41
*** zhengyin has quit IRC11:08
*** mingyu has joined #openstack-swift11:23
*** mingyu has quit IRC11:33
*** psachin has quit IRC11:49
*** psachin has joined #openstack-swift11:49
*** mingyu has joined #openstack-swift11:52
*** mingyu has quit IRC11:57
*** MVenesio has joined #openstack-swift12:01
*** chlong has quit IRC12:03
*** psachin has quit IRC12:07
*** cshastri has quit IRC12:09
*** jeffl has quit IRC12:10
*** links has quit IRC12:11
tdasilvagood morning12:18
tdasilvajust got caught up with the meeting12:18
tdasilvamahatic: terrific job chairing the meeting! congrats!12:18
tdasilvajust coincidentally yesterday I was trying to re-load patch 371150 into my brain, so I will continue to work on it12:19
patchbothttps://review.openstack.org/#/c/371150/ - swift - Return 404 on a GET if tombstone is newer12:19
tdasilvadriving to the office, will be back in a bit...12:20
*** NM has joined #openstack-swift12:28
*** cshastri has joined #openstack-swift12:44
*** mat128 has joined #openstack-swift13:04
*** lan has joined #openstack-swift13:05
*** oshritf has joined #openstack-swift13:08
*** mat128 has quit IRC13:08
*** psachin has joined #openstack-swift13:09
*** lan has quit IRC13:09
*** lucasxu has joined #openstack-swift13:11
*** oshritf has quit IRC13:11
acolesmattoliverau: thanks for speedy review!13:14
*** lifeless has quit IRC13:15
*** chlong has joined #openstack-swift13:29
*** mat128 has joined #openstack-swift13:30
*** klamath has joined #openstack-swift13:33
*** lifeless has joined #openstack-swift13:33
*** klamath has quit IRC13:33
*** klamath has joined #openstack-swift13:34
*** oshritf has joined #openstack-swift13:40
*** zhurong has joined #openstack-swift13:42
*** chlong has quit IRC13:43
*** chlong has joined #openstack-swift13:46
*** cshastri has quit IRC13:49
*** psachin has quit IRC13:53
*** mwheckmann has joined #openstack-swift13:55
*** kestrels has quit IRC14:02
*** cebreidian has quit IRC14:02
*** kestrels has joined #openstack-swift14:02
*** hseipp has joined #openstack-swift14:08
*** kestrels has quit IRC14:09
*** aselius has joined #openstack-swift14:13
*** oshritf has quit IRC14:23
*** zhurong has quit IRC14:35
*** hoonetorg has quit IRC15:04
*** gyee has joined #openstack-swift15:09
*** mat128 has quit IRC15:14
*** hoonetorg has joined #openstack-swift15:16
*** mvk has quit IRC15:19
*** alenavolk has joined #openstack-swift15:24
*** cebruns has joined #openstack-swift15:57
*** cbartz has left #openstack-swift15:58
*** chsc has joined #openstack-swift15:58
*** chsc has quit IRC16:03
*** rcernin has quit IRC16:07
*** tesseract has quit IRC16:08
notmynamegood morning16:12
*** hseipp has quit IRC16:29
notmynamezhongjun: great to see you in the meeting yesterday. I hope the time was more convenient for you16:33
claygclarkb: I'll spin that up and try to capture some notes - I think I had a working(ish) swift test.conf16:35
claygclarkb: then there's this change needed in devstack -> https://gist.github.com/clayg/0134511526537410f9348e81d625ed9516:35
claygand swift needs to fix this lp bug #166783316:36
openstackLaunchpad bug 1667833 in OpenStack Object Storage (swift) "func tests must not assert accept-ranges on 304" [Undecided,New] https://launchpad.net/bugs/166783316:36
clarkbclayg: do you want to push the devstack change or is it easier if I do it?16:36
clayg... which I don't think should be complicated - it really should mostly just be the typing and then explaining the reason *why*16:36
claygclarkb: for the devstack change it would certainly be easier for you to do it - that may not be the best thing for my personal growth - but I think you've been more than patient and helpful - so... enough with that let's get shit done16:38
timburkegood morning16:39
claygthere is another change needed to devstack... something with how it writes out the test.conf when TLS is enabled16:39
claygIIRC I had gotten as far as what was "wrong" with the test.conf generated by devstack's perspective - and created a test.conf that would "work" - but not so far as where/what change needed to be made to swift/devstack so that the two could compromise16:40
claygI think perhaps - i have some vague memory (timburke help me out) of perhaps - sdauge working out a change to swift-*client*'s test.conf so that it could use a full auth_uri instead of `ssl = true`and other sillyness16:41
notmynameyeah, that landed16:41
timburkeno it didn't16:42
notmynameoh. well it was *proposed*!16:42
claygnotmyname: stand back and let timburke drop some knowledge16:42
timburkehttps://review.openstack.org/#/c/456791/16:42
patchbotpatch 456791 - python-swiftclient - Allow swift functional tests to use keystone auth uri16:42
notmynamethat's the one16:42
timburke(one aspect of) the trouble is that one of the swiftclient gates doesn't actually test the in-review change16:43
claygtimburke: that's cool16:44
*** rcernin has joined #openstack-swift16:46
*** chsc has joined #openstack-swift16:49
*** chsc has joined #openstack-swift16:49
*** mvk has joined #openstack-swift16:49
*** pcaruana has quit IRC16:50
*** klrmn has joined #openstack-swift17:02
*** klrmn has quit IRC17:05
*** klrmn has joined #openstack-swift17:09
*** ChubYann has joined #openstack-swift17:11
notmynametimburke: https://review.openstack.org/#/c/469314/ needs to land. any reason not to click +A on it right now?17:17
patchbotpatch 469314 - swift - Stop having Sphinx treat warnings as errors17:17
notmynameclarkb: ^^ are there cross-project implications?17:17
notmynamedo you know?17:17
timburkenotmyname: not that i can think of. there's a chance that something *else* has gone wrong, but we can address that if it comes up17:17
clarkbthere shouldn't be17:18
notmynameclarkb: thanks17:18
clarkbsince the docs are fairly self contained and where they reference between them its all via urls17:18
notmynametimburke: ok, I'll land it17:18
clarkbcurious why you wouldn't just fix the warnings instead?17:18
notmynamethen we can reject https://review.openstack.org/#/c/456921/17:18
patchbotpatch 456921 - swift - Fix SSYNC failing to replicate unexpired object17:18
timburkeit weirds me out that (1) the releasenotes job ran on the first patchset and (2) it failed because reno was treating warnings as errors (!?)17:18
notmynameclarkb: it's that the gate is using an old version of liberasurecode that emits a warning that sphinx catches and barfs on17:19
clarkboh interesting17:19
notmynamenot reject. recheck17:19
notmynameclarkb: http://logs.openstack.org/21/456921/3/gate/gate-swift-docs-ubuntu-xenial/efa34c2/console.html17:19
timburkenotmyname: yeah, "recheck" -- that's the one :-)17:19
*** mat128 has joined #openstack-swift17:22
notmynametimburke: so this doesn't break all of the gate17:25
notmynameI mean, we've had stuff land17:25
notmynamethe sphinx change happened nearly 2 months ago17:26
timburkenotmyname: but new sphinx didn't come into upper-constraints until yesterday -- https://github.com/openstack/requirements/commit/6b4753c17:26
notmynameoh, so it's the new sphinx that is doing the warn/error thing?17:27
notmynameor that is catching the dependency warning for the first time?17:27
*** tonanhngo has joined #openstack-swift17:31
*** ujjain has quit IRC17:33
*** oshritf has joined #openstack-swift17:38
*** jaosorior is now known as jaosorior_away17:44
*** cebruns has quit IRC17:56
*** ujjain has joined #openstack-swift18:01
*** ujjain has quit IRC18:01
*** ujjain has joined #openstack-swift18:01
*** chlong has quit IRC18:05
*** cebruns has joined #openstack-swift18:10
*** cebruns has quit IRC18:21
*** chlong has joined #openstack-swift18:22
*** cebruns has joined #openstack-swift18:36
*** cebruns has quit IRC18:36
*** cebruns has joined #openstack-swift18:38
*** cebruns has quit IRC18:39
*** cebruns has joined #openstack-swift18:41
*** cebruns has quit IRC18:41
*** cebruns has joined #openstack-swift18:42
*** cebruns has quit IRC18:42
portantenotmyname, clayg, torgomatic: have you folks run into behavior differences in the error output between ubuntu and fedora, where on uses `leading back-tick quotes' and the other users 'just single quotes'?18:42
portanteif so, do you know if there is a way to control that behavior?18:43
*** klrmn has quit IRC18:43
*** cebruns has joined #openstack-swift18:46
*** alenavolk has quit IRC18:59
*** alenavolk has joined #openstack-swift19:00
*** alenavolk has quit IRC19:05
*** alenavolk has joined #openstack-swift19:06
*** alenavolk has quit IRC19:08
*** mdrabe has joined #openstack-swift19:13
*** lucasxu has quit IRC19:13
*** geaaru has quit IRC19:13
*** oshritf has quit IRC19:31
*** oshritf has joined #openstack-swift19:36
portantehttps://unix.stackexchange.com/questions/364004/cp-error-message-uses-different-quoting-on-ubuntu-12-04-and-fedora-2419:41
notmynameportante: I have not seen that19:44
notmynameit's not a LOCALE thing?19:44
*** pcaruana has joined #openstack-swift19:45
portantenotmyname: not that we have seen, which is what I would have thought19:45
portantekills our hacky unit tests19:46
portante:(19:46
portanteI suspect when we find the answer we'll say, "Doh!"19:47
notmynameportante: also, ubuntu 12.04? I know you work at redhat and are used to supporting an OS for like 20 years or something, but canonical shot 12.04 in the head a while back I think ;-)19:54
portanteyeah, travis runs that version of ubuntu for us. :(19:55
clarkbportante: iirc you can pick a different version on travis19:59
clarkbits some directive in your yaml file19:59
timburkeinteresting... i've got a 14.04 vm handy that defaults to cannot stat ‘foo’ (i.e., it uses http://www.fileformat.info/info/unicode/char/2018/index.htm and http://www.fileformat.info/info/unicode/char/2019/index.htm) but it responds well to LC_ALL=C19:59
claygLC_ALL=C is *key*20:00
*** pcaruana has quit IRC20:02
openstackgerritMerged openstack/swift master: Stop having Sphinx treat warnings as errors  https://review.openstack.org/46931420:12
portanteclarkb: thanks, we'll try that20:14
*** klrmn has joined #openstack-swift20:14
portanteclayg: thanks, we tried that and it does not seem to work20:14
clarkbclayg: re increasing the allowed header size, I am writing the commit message now. Is theer a short version of why this is required? is it just that swift is able to use so many bytes for metadata?20:18
clarkband since the non tls'd jobs go straight to eventlet its a non issue there?20:18
claygyeah20:19
claygI'm realizing now it may have been possible to update the swift constraints to have a smaller limit on metadata... it's possible the tests already exercise the advertised limit and the problem was just the artificial limit in the middle rather than any specific requirement20:20
*** mat128 has quit IRC20:20
clarkbclayg: https://review.openstack.org/46964220:20
patchbotpatch 469642 - openstack-dev/devstack - Increase allowed header size with tls proxy20:20
*** lucasxu has joined #openstack-swift20:20
*** rcernin has quit IRC20:21
*** lucasxu has quit IRC20:21
*** oshritf has quit IRC20:22
*** rcernin has joined #openstack-swift20:22
claygclarkb: the other thing that gets us much closer to working on lp bug #1667833 is something with /etc/swift/test/conf20:23
openstackLaunchpad bug 1667833 in OpenStack Object Storage (swift) "func tests must not assert accept-ranges on 304" [Undecided,New] https://launchpad.net/bugs/166783320:23
claygOMM functests with tls enabled fail spectacularly until I change `auth_ssl = no` / `auth_ssl = yes`20:24
claygI see a `auth_uri = https://192.168.8.8:35357` option already in play - so maybe the best thing is to patch swift to use it?20:25
claygnotmyname: timburke: is there already a patch for that in progress?20:25
*** joeljwright has joined #openstack-swift20:26
*** ChanServ sets mode: +v joeljwright20:26
clarkbya devstack should know what the auth_uri is for the entire cloud and you should be able to write that in as appropriate to the swift config20:31
*** rcernin has quit IRC20:42
notmynameswift team meeting in 15 minutes20:45
*** skudlik has quit IRC20:46
*** m_kazuhiro has joined #openstack-swift20:52
openstackgerritTim Burke proposed openstack/python-swiftclient master: Allow swift functional tests to use keystone auth uri  https://review.openstack.org/45679120:52
*** chlong has quit IRC20:53
timburkei think that^^ is what we want, though i'm fairly certain it'll require a swiftclient release to actually be useable in swift's gate. if we want the gate on tls *before* that, we should plumb auth_ssl into lib/swift alongside the auth_port plumbing around https://github.com/openstack-dev/devstack/blob/master/lib/swift#L533-L53720:55
timburkei suppose i should have just gone ahead and done that when i did https://github.com/openstack-dev/devstack/commit/f43ea4720:56
kota_good morning20:58
mattoliverauMorning20:59
timburkethings would be *even better* if we land something like https://review.openstack.org/#/c/443104/ -- then we don't need to mangle auth_url based on auth_version (auth_version could almost even *go away* at that point, except we need a way to know whether to use keystone or v1 auth)20:59
patchbotpatch 443104 - python-swiftclient - Use generic keystone client instead of versioned one (ABANDONED)20:59
notmynamemeeting time in #openstack-meeting21:00
joeljwrighttimburke: somehow we need to work towards better keystone handling21:01
timburkejoeljwright: yup :-(21:01
*** chlong has joined #openstack-swift21:05
claygmattoliverau: I met someone from Oz the other day (yesterday?)... shit I where were they from... Brisbane I think - I couldn't remember where *you* were living now - I said you used to live in Melbourne - am I making this up?!21:11
*** pcaruana has joined #openstack-swift21:12
mattoliverauClose enough, I was in Melbourne, I'm now at the beach in a place called Surf Beach on the south coast of NSW.. but I was in Melbourne so yeah that works ;)21:12
*** skudlik has joined #openstack-swift21:12
tdasilvamattoliverau: there will be a couple of awesome soccer matches in Melbourne in a couple of weeks ;)21:13
mattoliverauThere is an OpenStack day Melbourne on today.. but couldn't convince work to pay for me to go :p21:14
cschwede_timburke: looks like we have a gate blocker (the sphinx issue?) i saw your patch 469315 - but do we need an "override" for it?21:26
patchbothttps://review.openstack.org/#/c/469315/ - swift - Make Sphinx treat warnings as errors (again)21:26
timburkecschwede_: nope; that's the follow-up to put it back. gate should be unblocked now, and i know there a re a few rechecks working their way through currently21:27
cschwede_timburke: oh my, i'm too tired. "warning-is-error = 1" - yeah, read first, talk second. nevermind, thx :)21:28
timburkeno worries :-)21:28
*** pcaruana has quit IRC21:29
tdasilvatimburke, clayg: hi, timburke left a comment asking in patch 371150 should also apply for containers and accounts, and to be honest I don't remember why I put the check there, it might be just because the bug called out objects, but i'm not sure21:30
patchbothttps://review.openstack.org/#/c/371150/ - swift - Return 404 on a GET if tombstone is newer21:30
tdasilvathoughts?21:31
*** NM has quit IRC21:31
tdasilvaany concerns about doing the same for account/containers?21:31
*** MVenesio has quit IRC21:31
*** MVenesio has joined #openstack-swift21:31
*** MVenesio has quit IRC21:32
openstackgerritMerged openstack/swift master: Add structure to storage policy configuration guide  https://review.openstack.org/46836021:36
acolestimburke: thanks for rechecking the ssync patch21:43
*** jarbod_ has quit IRC21:47
*** jarbod_ has joined #openstack-swift21:47
tdasilvatimburke: fwiw, i'm leaning more towards keeping it as is for the reasos you just mentioned, I think operators should definetely get in there and fix things, otherwise they might lose data22:01
timburkespeaking of deprecation and warnings, there's also patch 468065, patch 468077, and patch 46808422:03
patchbothttps://review.openstack.org/#/c/468065/ - swift - Log deprecation warnings for run_pause22:03
patchbothttps://review.openstack.org/#/c/468077/ - swift - Log deprecation warnings for account_white/blacklist22:03
patchbothttps://review.openstack.org/#/c/468084/ - swift - Log deprecation warning for allow_versions22:03
claygnotmyname: re-reading my comment on patch 468105 - I was hoping to trick someone into posting something to the os-ops ML regarding the coming change?  And maybe also to solicit feedback from people that have in the past few releases maybe started to see this warning?  Or are on an older version of swift and have a bad config - but with *no* warning?22:03
patchbothttps://review.openstack.org/#/c/468105/ - swift - Require that known-bad EC schemes be deprecated22:03
mattoliverauK breakfast time o/22:04
timburke'cause i totally want to rip out some config options a la patch 468099 -- but i want to make sure we've been complaining for a while first22:05
patchbothttps://review.openstack.org/#/c/468099/ - swift - Remove deprecated vm_test_mode option22:05
claygtimburke: joeljwright: can you think of *any* other use-case for wrapping segments in inline strings besides tar-archives?22:15
claygI don't want to add a generic feature that's entirely use-case specific22:15
*** klamath has quit IRC22:18
timburkeyou could build large xml documents from component ones22:19
claygtimburke: ok nice - that's something!22:20
clayg{"preamble": "<div class='some outer'>", path="some/inner.html", "postamble": "</div>"}22:21
timburkecould probably use it for various container formats -- though i don't know a whole lot about them. some of them probably demand more interleaving than you'd want to do with an slo -- better to just save the transcode as a separate object22:21
timburkeyup22:22
joeljwrightclayg: I can think of examples22:22
joeljwrightbut they're a bit more out there22:22
joeljwrightwe've considered building video files from audio/video segments with pre/postamble to build the container22:23
joeljwrightbut we've got no further than the idea22:23
claygstrictly speaking tho - it seems like support for inline segments *has* to support a superset of what you can do with pre/post-amble per segment.  But perhaps significantly more complex for a client that wants to use inline segments to wrap individual segments with buffers?22:24
claygi.e. [{'base64ineline': "preamble"}, {'path': "c/o2"}, {'base64inline': "postamble-preamble"}, {'path': 'c/o'}, {'base64inline': "postamble-footer"}] annoying if the who thing is to "wrap" each segment22:26
claygand I guess if you have a big thing made of a bunch of little things - it's pretty common that the big thing is going to have little bits of data "around" the little things22:27
claygso this implementation might have lowest impedance mismatch for known use-cases22:28
* clayg shrugs22:28
claygdo any other object storage api's have similar use-case support?  s3 has http://docs.aws.amazon.com/AmazonS3/latest/dev/S3TorrentRetrieve.html22:29
timburkeyeah, i keep going back and forth on which way i like more22:29
claygI sorta feel like "can I download this SLO as a tar archive" is not such a weird feature to implement - or even "here's a list of segments - make me a link I can download as a tar archive"22:30
timburkei think torgomatic also had a use-case... something something proxyfs? ish?22:31
claygwhy does the client have to tell us how to make it a tar archive... I guess it gives them more control - but do they *want* that much control?  If we just do it - and then maybe a few feature requests for strings to pull out (think content-deposition header support for tempurls or whatever) - maybe that's good enough better?22:31
*** mdrabe has quit IRC22:32
timburkei totally expect that this is infrastructure so that we can have the auto-tar come next22:32
claygok, sorry I keep struggling to embrace the idea with first class API support - seems pretty esoteric - but the use-case seems *entirely* sensible - which makes me think "oh it should be *simpler* to turn a list of segments into a tar!?"22:33
claygoic.... but if the goal is auto-tar... is first class pre/post-amble really a pre-req or just a half feature?22:34
timburkei thought we were all about pushing complexity to the client ;-)22:34
joeljwright:) I do want to explore more than tar using this too22:35
joeljwrightbut I see your point22:35
claygtimur: have you ever heard of this pre/post-amble SLO stuff?  Can you think of any analog for turning some soft of manifest or collection of objects into another format?  Or some sort of dynamic inline/padding bytes adorned to a response who's body is mostly data(s) from the object store?22:36
*** m_kazuhiro has quit IRC22:36
timburkejoeljwright: how far has that gotten? in your explorations, has it felt natural to always attach the extra bytes to a segment, or were there cases where it felt forced, like the data didn't really belong "with" one segment or the other, but just needed to be *between* them?22:37
claygtimburke: I think you misunderstood - I want API's with clear affordances and don't mind clients that have to be explicit in their requests - if clients *want* to upload tars with pre/post-amble wrapping the objects - by all means - give them their cake!  If they want to turn list of segments into tar archives - don't make them dance like monkies.22:37
claygtimburke: that's a good question22:38
joeljwrighttimburke: honestly I haven't had the chance to dig into that22:39
joeljwrightI'll see if I can spend some time thinking about that before next week22:41
joeljwrightbut I have to go now22:41
joeljwrightthanks for the help22:41
joeljwright:)22:41
*** joeljwright has quit IRC22:42
claygtimburke: what about instead of a json manfiest we just had a template of some kind?22:42
timburkeclayg: yes! let's dep on jinja2!22:43
claygread manifest, send bytes till {% SOME_OBJECT %}, send bytes in SOME_OBJECT, keep sending bytes22:43
claygtimburke: i mean maybe... I don't know if jinja2 supports a streaming semantic - i wouldn't want to have to render the whole template - and I don't know if jinja would be able to do sufficiently arbitrary byte strings to render a tar...22:44
timburkei was being difficult :P22:45
claygi'm just recognizing that in the xml case for example the pre-post idea seems like a difficult needle to thread22:45
claygthen there's all this encoding to make the bytes we want work in json22:45
notmynamewhy do I switch back to my IRC client and see a serious(?) conversation about adding a dependency on templating engines?22:46
timburkewe need *some* kind of encoding to differentiate between data and control channels22:46
claygi just wish someone else already had an API we could draw inspiration from... redis has pre-comipled LUA scripts - you define your own aritity and shit, make up your own new functions "download_as_tar obj1, obj2, ... objN"22:46
openstackgerritMerged openstack/swift master: Fix SSYNC failing to replicate unexpired object  https://review.openstack.org/45692122:49
notmynamewhoo!22:50
*** Sukhdev has joined #openstack-swift22:51
claygoh... that does sound nice?22:52
openstackgerritTim Burke proposed openstack/python-swiftclient master: Allow swift functional tests to use keystone auth uri  https://review.openstack.org/45679122:53
claygclarkb: (just rubber ducking, but ...) my apache is failing to start with `file '/opt/stack/data/devstack-cert.pem' does not exist or is empty` i'm wondering if `tls-proxy` in my enable_service local.conf is no longer entirely sufficient to get all the ssl goodness...22:56
clayg:q22:58
clarkbclayg: it should be sufficient, there was a recent change to that code to handle python35 hopefully I didn't break something (it passed tests >_>)23:00
*** chlong has quit IRC23:00
clarkbno it passed tests which would exercise the non python35 and python35 paths so it should be fine23:01
clarkbclayg: was this on a fresh run?23:02
claygit was not on a "fresh run in the gate" - no it was just in my environment - but i did just recreate the vm and run stack.sh with what I felt like was a reasonable configuration23:04
clarkbdo you have that localrc?23:05
clarkbdouble checking gate job runs tls-proxy is all we set in ENABLED_SERVICES23:07
clarkbclayg: the code that runs make_cert only runs if the file does not exist, so maybe you had the file exist and its not valid for some reason?23:09
claygyeah, it's strange code trace seems to indicate that's the only thing needed to create the file?  I didn't see the error where it tried to create it an failed tho?  http://paste.openstack.org/show/611146/23:09
clarkbeg it is empty?23:09
claygit doesn't exist now - perhaps it did?  re-running stack.sh did not create the file.23:09
openstackgerritTim Burke proposed openstack/swift master: Add support to increase object ring partition power  https://review.openstack.org/33729723:11
clarkbclayg: https://git.openstack.org/cgit/openstack-dev/devstack/tree/stack.sh#n814 init_cert there is what writes that file23:12
clarkband its just checking if tls-proxy is enabled23:12
clarkbyou can likely look in the devstack log and see if is_service_enabled tls-proxy returned true or false as devstack should run udner set -x23:12
claygmy code tracing lead me to a similar conclusion - i'm trying to verify I'm maybe not getting that far?23:15
clarkbclayg: http://logs.openstack.org/89/443189/24/gate/gate-tempest-dsvm-neutron-full-ubuntu-xenial/15b8873/logs/devstacklog.txt.gz#_2017-05-31_20_20_43_159 is an example of where it does that in a gate job23:15
claygoic, and here is where i blow up?  http://logs.openstack.org/89/443189/24/gate/gate-tempest-dsvm-neutron-full-ubuntu-xenial/15b8873/logs/devstacklog.txt.gz#_2017-05-31_20_20_40_79823:17
claygso close!23:17
clarkboh interesting23:18
claygwonder how my tls-ness got in the config files ahead of when the apache's wanted to start in this case... maybe I didn't blow away the vm!?23:18
clarkbya I'm guessing you have preexisting apache vhost configs floating around23:18
clarkbclayg: that is probably a good reason to move up the ca and cert stuff in the stack.sh script though23:19
claygsure, yeah probably23:19
clarkbhttps://git.openstack.org/cgit/openstack-dev/devstack/tree/stack.sh#n784 to there I think23:19
clarkbmaybe try move the block locally and see if that fixes it for you23:20
*** chsc has quit IRC23:20
*** chsc has joined #openstack-swift23:22
*** chsc has joined #openstack-swift23:22
*** kei_yama has joined #openstack-swift23:30
*** chsc has quit IRC23:40
torgomatictimburke: yeah, I wanted the pre/postamble for my own purposes, but if it doesn't happen, I'll deal23:53
timburketorgomatic: no no! clayg was just looking for more use-cases23:53
torgomatictimburke: fair enough. Having the pre/postambles (in whatever form it takes) in SegmentedIterable would make my life easier at some future point.23:54
claygclarkb: ok, http://paste.openstack.org/show/611148/ womm fwiw23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!