*** saschpe has quit IRC | 00:00 | |
openstackgerrit | Samuel Merritt proposed a change to openstack/swift: Move patch_policies in obj server tests https://review.openstack.org/81945 | 00:02 |
---|---|---|
*** saschpe has joined #openstack-swift | 00:07 | |
*** RK has joined #openstack-swift | 00:08 | |
*** zaitcev has quit IRC | 00:25 | |
*** shri has quit IRC | 00:33 | |
openstackgerrit | Samuel Merritt proposed a change to openstack/swift: tiny stylistic fixup https://review.openstack.org/81951 | 00:35 |
*** sungju- has quit IRC | 00:43 | |
*** sungju_ has joined #openstack-swift | 00:44 | |
openstackgerrit | A change was merged to openstack/python-swiftclient: Fix temporary pypy gate issue with setuptools https://review.openstack.org/81479 | 00:51 |
*** d89 has joined #openstack-swift | 00:56 | |
*** changbl has joined #openstack-swift | 01:26 | |
*** d89 has quit IRC | 01:44 | |
*** haomaiwa_ has quit IRC | 01:59 | |
openstackgerrit | Samuel Merritt proposed a change to openstack/swift: Block X-Backend* in gatekeeper https://review.openstack.org/81964 | 02:00 |
*** d89 has joined #openstack-swift | 02:04 | |
*** RK has quit IRC | 02:31 | |
*** saschpe has quit IRC | 02:31 | |
*** saschpe has joined #openstack-swift | 02:33 | |
openstackgerrit | Madhuri Kumari proposed a change to openstack/swift: Added swift-container-info tool. https://review.openstack.org/81968 | 02:36 |
*** d89 has quit IRC | 02:48 | |
*** madhuri__ has joined #openstack-swift | 02:48 | |
*** d89 has joined #openstack-swift | 02:53 | |
openstackgerrit | Madhuri Kumari proposed a change to openstack/swift: Added swift-container-info tool. https://review.openstack.org/81968 | 03:02 |
*** krtaylor has joined #openstack-swift | 03:11 | |
*** madhuri__ has quit IRC | 03:18 | |
*** RockKuo_iPad has joined #openstack-swift | 03:23 | |
*** RockKuo_iPad has quit IRC | 03:31 | |
*** RockKuo_iPad has joined #openstack-swift | 03:31 | |
*** RockKuo_iPad has quit IRC | 03:31 | |
*** RockKuo has joined #openstack-swift | 03:35 | |
*** saurabh_ has quit IRC | 04:13 | |
Anju1 | what is the usage of cdmi ?? | 04:25 |
*** haomaiwa_ has joined #openstack-swift | 04:32 | |
*** d89 has quit IRC | 04:49 | |
*** d89 has joined #openstack-swift | 04:57 | |
*** ppai has joined #openstack-swift | 05:06 | |
*** haomaiwa_ has quit IRC | 05:11 | |
*** haomaiwa_ has joined #openstack-swift | 05:11 | |
*** haomaiw__ has joined #openstack-swift | 05:22 | |
*** haomaiwa_ has quit IRC | 05:25 | |
*** nshaikh has joined #openstack-swift | 05:26 | |
*** gyee has quit IRC | 05:30 | |
*** d89 has quit IRC | 05:55 | |
*** RockKuo has quit IRC | 06:11 | |
*** d89 has joined #openstack-swift | 06:13 | |
*** psharma has joined #openstack-swift | 06:20 | |
*** saurabh_ has joined #openstack-swift | 06:22 | |
*** saurabh_ has joined #openstack-swift | 06:22 | |
openstackgerrit | A change was merged to openstack/swift: Make backend container requests use the same X-Timestamp https://review.openstack.org/81158 | 06:25 |
*** sungju_ has quit IRC | 06:31 | |
*** d89 has quit IRC | 06:48 | |
openstackgerrit | A change was merged to openstack/swift: Allow specification of object devices for audit https://review.openstack.org/75881 | 06:48 |
openstackgerrit | A change was merged to openstack/swift: Fix changing of storage policy index https://review.openstack.org/72536 | 06:54 |
*** d89 has joined #openstack-swift | 07:06 | |
*** RockKuo_iPad has joined #openstack-swift | 07:15 | |
*** RockKuo_iPad has quit IRC | 07:19 | |
*** RockKuo has joined #openstack-swift | 07:38 | |
openstackgerrit | Jenkins proposed a change to openstack/swift: Updated from global requirements https://review.openstack.org/81207 | 07:52 |
*** mlipchuk has joined #openstack-swift | 08:08 | |
openstackgerrit | A change was merged to openstack/swift: Purge self.policies from Swift https://review.openstack.org/81940 | 08:16 |
openstackgerrit | A change was merged to openstack/swift: tiny stylistic fixup https://review.openstack.org/81951 | 08:16 |
openstackgerrit | A change was merged to openstack/python-swiftclient: Copy Swift's .mailmap to swiftclient repo https://review.openstack.org/81027 | 08:16 |
openstackgerrit | A change was merged to openstack/swift: Move patch_policies in obj server tests https://review.openstack.org/81945 | 08:23 |
*** mmcardle has joined #openstack-swift | 08:33 | |
*** RockKuo has quit IRC | 08:44 | |
*** sphoorti has joined #openstack-swift | 08:50 | |
*** nacim has joined #openstack-swift | 08:56 | |
*** sphoorti has quit IRC | 08:58 | |
*** sayalilunkad has joined #openstack-swift | 09:00 | |
sayalilunkad | Hey, I want to upload a .jpeg file to a swift container using python swift client. The file gets uploaded but I don't see any contents in the file. I am using this command: put_object(container, obj, contents, content_length=None)ΒΆ | 09:02 |
sayalilunkad | So in this the contents field I am not sure what I am supposed to use | 09:03 |
*** bvandenh has quit IRC | 09:08 | |
*** bvandenh has joined #openstack-swift | 09:13 | |
sayalilunkad | chmouel: Hey | 09:26 |
sayalilunkad | chmouel: Could you please help with the query posted | 09:27 |
tristanC | sayalilunkad: if you put content_length = None and the contents is a file like interface (with a read method) it will perform a http chunked upload | 09:33 |
tristanC | (ie: content=open("your_file.jpeg"), content_length=None) | 09:34 |
sayalilunkad | tristanC: Thanks! it works:) | 09:35 |
*** sayalilunkad has quit IRC | 09:37 | |
*** psharma has quit IRC | 09:39 | |
openstackgerrit | Tristan Cacqueray proposed a change to openstack/python-swiftclient: Add requests related unit-tests https://review.openstack.org/74328 | 09:41 |
*** sayalilunkad has joined #openstack-swift | 09:44 | |
sayalilunkad | tristanC: Also how can I download an .jpeg object after I get it using the get_object command? | 09:46 |
*** saju_m has joined #openstack-swift | 09:55 | |
tristanC | sayalilunkad: yes, using the same url/container name/object name | 09:56 |
sayalilunkad | tristanC: Alright, will check that | 09:57 |
*** sayalilunkad has quit IRC | 10:00 | |
*** tanee-away is now known as tanee | 10:17 | |
*** tanee is now known as tanee-away | 10:17 | |
*** RockKuo has joined #openstack-swift | 10:32 | |
*** Gooch has quit IRC | 10:33 | |
*** RockKuo has quit IRC | 11:00 | |
*** saju_m has quit IRC | 11:22 | |
*** Trixboxer has joined #openstack-swift | 11:30 | |
*** d89 has quit IRC | 11:32 | |
*** mlipchuk has quit IRC | 11:35 | |
*** saju_m has joined #openstack-swift | 11:38 | |
*** nshaikh has quit IRC | 12:12 | |
*** dmsimard has joined #openstack-swift | 12:14 | |
*** nshaikh has joined #openstack-swift | 12:24 | |
*** JuanManuelOlle has joined #openstack-swift | 12:26 | |
*** russellb is now known as rustlebee | 12:40 | |
*** ppai has quit IRC | 12:51 | |
*** saju_m has quit IRC | 12:57 | |
*** mkollaro has joined #openstack-swift | 13:00 | |
*** mmcardle has quit IRC | 13:04 | |
*** saju_m has joined #openstack-swift | 13:06 | |
*** tdasilva has joined #openstack-swift | 13:15 | |
*** jasondotstar has joined #openstack-swift | 13:31 | |
*** mmcardle has joined #openstack-swift | 13:43 | |
*** byeager has joined #openstack-swift | 14:07 | |
*** piyush has joined #openstack-swift | 14:31 | |
*** mrsnivvel has quit IRC | 14:37 | |
*** pberis has quit IRC | 14:50 | |
*** mrsnivvel has joined #openstack-swift | 14:52 | |
openstackgerrit | paul luse proposed a change to openstack/swift: Container Confict on obj update with wrong Storage-Policy-Index https://review.openstack.org/79731 | 14:54 |
peluse | ^ rebase | 14:54 |
*** saju_m has quit IRC | 15:05 | |
openstackgerrit | paul luse proposed a change to openstack/swift: Add Storage Policy Support to Account HEAD https://review.openstack.org/73747 | 15:17 |
openstackgerrit | paul luse proposed a change to openstack/swift: Container Confict on obj update with wrong Storage-Policy-Index https://review.openstack.org/79731 | 15:22 |
*** mrsnivvel has quit IRC | 15:24 | |
openstackgerrit | paul luse proposed a change to openstack/swift: Add Storage Policy Support to Account HEAD https://review.openstack.org/73747 | 15:24 |
peluse | torgomatic: your test_set_storage_policy_index* tests were using bogus indexes (on purpose I assume) however with the two patches above they're checked via the pending file encoding that was added so I updated the tests to use valid patched policies. | 15:27 |
*** jasondotstar has quit IRC | 15:33 | |
*** byeager has quit IRC | 15:35 | |
*** byeager has joined #openstack-swift | 15:36 | |
*** byeager has quit IRC | 15:40 | |
*** nshaikh has quit IRC | 15:41 | |
*** byeager has joined #openstack-swift | 15:44 | |
*** gyee has joined #openstack-swift | 16:01 | |
*** Longgeek_ has joined #openstack-swift | 16:21 | |
*** Longgeek_ is now known as Longgeek | 16:27 | |
notmyname | good morning, everyone | 16:30 |
peluse | good morning! | 16:30 |
portante | notmyname: mornin' | 16:31 |
notmyname | close my computer and don't open it until the next day at the office? that'll be 201 unread emails | 16:31 |
peluse | it's a beautiful day! | 16:31 |
portante | good luck! | 16:31 |
*** pberis has joined #openstack-swift | 16:32 | |
creiht | mark all as read, the day is done :) | 16:32 |
*** mkollaro has quit IRC | 16:34 | |
peluse | make the 202, just sent you an email :) | 16:34 |
notmyname | peluse: I'll send you a text to check IRC where I'll mention that I replied to the email | 16:35 |
*** jogo is now known as flashgordon | 16:39 | |
*** jamie_h has joined #openstack-swift | 16:45 | |
*** jasondotstar has joined #openstack-swift | 16:48 | |
peluse | notmyname: excellent and I'll tweet something out once I see it :) | 16:48 |
notmyname | perfect. | 16:53 |
openstackgerrit | Chuck Thier proposed a change to openstack/swift: Add "If-None-Match: *" support to PUT https://review.openstack.org/81646 | 16:55 |
*** zaitcev has joined #openstack-swift | 17:00 | |
*** ChanServ sets mode: +v zaitcev | 17:00 | |
*** byeager has quit IRC | 17:02 | |
*** byeager has joined #openstack-swift | 17:02 | |
*** byeager has quit IRC | 17:07 | |
*** byeager has joined #openstack-swift | 17:11 | |
*** nacim has quit IRC | 17:19 | |
*** mkollaro has joined #openstack-swift | 17:22 | |
*** piyush has quit IRC | 17:26 | |
*** saju_m has joined #openstack-swift | 17:38 | |
*** sriram has joined #openstack-swift | 17:47 | |
*** saju_m has quit IRC | 17:58 | |
*** judd7_ has joined #openstack-swift | 18:01 | |
*** piyush has joined #openstack-swift | 18:15 | |
*** piyush1 has joined #openstack-swift | 18:16 | |
*** piyush has quit IRC | 18:19 | |
*** jamie_h has quit IRC | 18:23 | |
*** lpabon has joined #openstack-swift | 18:26 | |
*** mmcardle has quit IRC | 18:31 | |
openstackgerrit | paul luse proposed a change to openstack/swift: Add Storage Policy Support to Account HEAD https://review.openstack.org/73747 | 18:37 |
openstackgerrit | Samuel Merritt proposed a change to openstack/swift: Merge branch 'master' into feature/ec https://review.openstack.org/82165 | 18:42 |
*** iccha has joined #openstack-swift | 18:48 | |
iccha | hey i have some queries wrt python swiftclient | 18:49 |
zackmdavis | iccha, what about it? | 18:51 |
iccha | zackmdavis: we upgraded to using python-swiftclient-2.0.3 and have been seeing WARNING requests.packages.urllib3.connectionpool [-] HttpConnectionPool is full, discarding connection | 18:51 |
iccha | this is glance using swiftclient to talk to swift | 18:52 |
iccha | wondering if anything changed | 18:52 |
iccha | or if there is a setting for this anywhere | 18:52 |
zackmdavis | iccha, sorry, I haven't run into that and don't have anything useful to say | 18:53 |
*** dmsimard has quit IRC | 18:56 | |
zackmdavis | iccha, well, it looks like 2.0 (last month) switched to using Requests instead of httplib, so that would be the clear candidate for something-that-changed https://github.com/openstack/python-swiftclient/commit/19d7e1812a99d73785146667ae2f3a7156f06898 | 18:57 |
iccha | zackmdavis: http://stackoverflow.com/questions/18466079/can-i-change-the-connection-pool-size-for-pythons-requests-module | 18:57 |
iccha | looks like there is some setting in requests | 18:57 |
iccha | maybe a patch in swift client to increase or customize pool size | 19:06 |
iccha | adapter = requests.adapters.HTTPAdapter(pool_connections=100, pool_maxsize=100) | 19:06 |
openstackgerrit | Greg Lange proposed a change to openstack/swift: Fix account/container logging mismatch https://review.openstack.org/82174 | 19:16 |
clayg | peluse: is there some change for feature/ec that's waiting to merge and isn't merged? | 19:23 |
*** NM1 has joined #openstack-swift | 19:23 | |
clayg | nm, I think i found it | 19:23 |
NM1 | Cool! | 19:24 |
NM1 | But found what? | 19:24 |
peluse | clayg: only the 409 thing and the acct rollup that I know of | 19:24 |
clayg | peluse: yessir | 19:24 |
clayg | peluse: what about the un-.policies-ification? | 19:25 |
peluse | thought I saw that go through.... maybe not | 19:25 |
* peluse looks | 19:25 | |
peluse | yeah, its merged | 19:26 |
peluse | torgotmatic has a few others though I think also, all reconcliator-ifier... | 19:26 |
iccha | zackmdavis: https://bugs.launchpad.net/python-swiftclient/+bug/1295812 | 19:27 |
clayg | stupid swiftclient 2.0 | 19:29 |
iccha | +1 clayg | 19:29 |
iccha | lol | 19:29 |
clayg | torgomatic: peluse: I'm trying to get the container conflict thingy merged - but I"m still getting unittest failures in proxy server setup that says prosrv.polices <- AttributeError | 19:33 |
clayg | feature/ec does show purge self.polices is merged... | 19:33 |
clayg | i tried to rebase on that... | 19:33 |
peluse | I think there's an active rebase msater-->feature EC right now | 19:33 |
clayg | so strange, I just checked out feature/ec and sure enough it says prosrv.policies? | 19:34 |
torgomatic | peluse: clayg: merge is in the gate now, and I think it fixes that | 19:34 |
peluse | https://review.openstack.org/#/c/82165/ | 19:34 |
clayg | weird | 19:35 |
peluse | confirmed it does address that change | 19:35 |
peluse | clayg: container conflict thingy - I assume the one I updated this morning right? Did you look at the changes made based on your comments yet? Note that it's rebased as of my last push | 19:37 |
clayg | peluse: no you're talking about the account rollup yeah? | 19:38 |
clayg | i started to look at that - and it depends on the container-obj-put-409 change - which I'm trying to get merged/tested/approved! | 19:38 |
peluse | clayg: both actually, sorry. I rebased the 409 deal also but didn't make addtl changes beyond that. Yes wrt the comments I mean the acct rollup, sorry | 19:38 |
peluse | :) | 19:38 |
clayg | yeah i'm still looking at the latest changes to acct-rollup - it did look like you addressed most of the early stuff I spotted - thanks - will continue review | 19:39 |
peluse | gracias. need me to do anything on the 409 patch? | 19:40 |
clayg | peluse: don't think so - i rebased it on the pending merge and I'm giving the diff a final once over test run | 19:41 |
peluse | rock n roll! | 19:41 |
peluse | clayg: when you're ready we can talk about the policy index header replacement scheme, might have an idea for making that more efficient but will leave the patch alone for now til you review the other changes | 19:43 |
clayg | .... which part now? policy ohoh oh oh - that - yeah I mean i don't think it's gunna get worse :P | 19:44 |
clayg | peluse: I think the acct-rollup change may need some other stuff anyway - and I"m not looking at it for another 10 mins or - so if you had something in mind you wanna try out you can push it in the diff and I'll poke at it | 19:44 |
clayg | I don't have anything in mind that I'm just *sure* woudl be better - but I was planning on playing with it and seeing if anything I like jumps out | 19:45 |
peluse | cool, I'll dork wiht it a bit and see if anything pans out... | 19:45 |
clayg | no worries - we can also merge acct-rollup with that part like that and worry about it later, but it was ok before and sorta not great with the acct-rollup changes so I think it's worth a bit of our time | 19:46 |
clayg | ummm there's a fixme in container-obj-put-409 I'm going to try and cleanup | 19:48 |
peluse | there is? something you added?? | 19:50 |
clayg | yeah just something i noticed playing around with tests | 19:51 |
*** NM1 has quit IRC | 19:51 | |
peluse | ahhh, ok | 19:52 |
*** NM1 has joined #openstack-swift | 19:53 | |
clayg | hugokuo: can you link me the standalone script that spings up keystone? I've been wanting to take a stab at adding optional support for keystone to vagrant-swift-all-in-one... | 19:56 |
clayg | I mean I get by with my devstack setup, but I'm keen on having something backed into that tool, but a little leary of maintaining it in the face of updates to keystone | 19:57 |
clayg | i scripted a keystone setup once by hand - it wasn't that fun | 19:57 |
clayg | peluse: thanks for writing StoragePolicyCollection.__iter__ it's just what I wanted! | 19:59 |
*** NM1 has joined #openstack-swift | 20:02 | |
acorwin | clayg: i think this is what you want https://github.com/swiftstack/keystone_install | 20:05 |
*** saju_m has joined #openstack-swift | 20:05 | |
clayg | nice | 20:06 |
*** judd7_ has quit IRC | 20:12 | |
*** seandrummond has joined #openstack-swift | 20:16 | |
NM1 | Does anyone know how to set write permissions per container? I tried "curl -v -XPOST -H "X-Storage-Token: AUTH_xxx" -H "X-Container-Write: myuser" http://localhost:8081/v1/AUTH_swift/mycontainer/" | 20:16 |
*** shri has joined #openstack-swift | 20:16 | |
seandrummond | Hey guys since release of swift version 1.11.0 I should not be seeing 'X-If-Delete-At and X-Delete-At do not match' Correct? | 20:16 |
peluse | clayg: that would have been torgomatic for that particlar method | 20:16 |
clayg | git blame says you - you'll just have to take credit | 20:17 |
clayg | NM1: that looks pretty reasonable - does the server accept the request? what's the response code? | 20:17 |
NM1 | HTTP/1.1 204 No Content - But if I try to request a object with the user I got a 403 | 20:18 |
clayg | seandrummond: you could see those anytime, but it would mean that someone has an ojbect that is having it's x-delete-at updated frequently, and the .expiring_objects container listing is racing with the deletes | 20:19 |
clayg | NM1: does the X-Container-Write header get set on the container metadata tho? | 20:19 |
clayg | and when you say "try to request a object" you mean try and PUT and object yeah? read/write permissions are seperate - it's like ftp servers | 20:19 |
seandrummond | clayg: once the object gets upload it is not changed. The objects are getting uploaded with a header x-delete-at set with a timestamp for 36 hours from the time it gets uploaded | 20:20 |
clayg | hrmm... then you shouldn't really be seeing those messages - and you getting a lot of them? | 20:21 |
seandrummond | yes in fact it appears nothing is getting deleted and I am seeing the same issue reported in https://bugs.launchpad.net/swift/+bug/1257330 | 20:21 |
*** jasondotstar has quit IRC | 20:21 | |
seandrummond | however I have verified I am running 1.11.0 | 20:21 |
NM1 | The container has: | 20:22 |
NM1 | X-Container-Write: entretenimentocma | 20:22 |
NM1 | < X-Timestamp: 1395352461.87276 | 20:22 |
NM1 | < X-Container-Read: entretenimentocma | 20:22 |
*** openstackgerrit has quit IRC | 20:22 | |
*** openstackgerrit has joined #openstack-swift | 20:23 | |
NM1 | I cant request the object using the GET method using curl | 20:23 |
*** tdasilva has left #openstack-swift | 20:23 | |
*** samwright has joined #openstack-swift | 20:25 | |
clayg | seandrummond: yeah fix should be in 1.11 - I've verified the expirer recently | 20:25 |
clayg | seandrummond: the patch is pretty trivial - you might track down one of the servers that returned the 4XX to the expirer and check swift/common/exceptions for a DiskFileExpired exception | 20:26 |
clayg | https://review.openstack.org/#/c/59811/4/swift/common/exceptions.py,unified <- should look like that seandrummond | 20:26 |
*** lpabon has quit IRC | 20:27 | |
clayg | NM1: so either the token you're using with the GET request doesn't associate the name "entretenimentocma" with the groups for that GET request - or the auth system you're using doesn't support container acls? | 20:27 |
seandrummond | yup that is what I verified and I just did again | 20:27 |
NM1 | The token is new. I'm using Temp Auth. | 20:29 |
clayg | so it's possible you have some dark matter left around while the bug was effecting you (see gholt's script for help cleanup, it never got fixed in the auditor, although we should probably still take a stab tat that) | 20:29 |
clayg | seandrummond: but that wouldn't explain you still seeing it in the logs after you restarted all the daemons/servers with the new code | 20:30 |
openstackgerrit | Michael Barton proposed a change to openstack/swift: Sendfile acceleration for GET requests https://review.openstack.org/82186 | 20:30 |
clayg | NM1: oh then you need to either use the account name or include the full name of the user (e.g. "test:tester" works, or just "test" for all users in that account, but you can't say just "tester") | 20:30 |
clayg | well you can say just "tester" but then it doesn't work like you want it to ;) | 20:31 |
*** sriram has quit IRC | 20:31 | |
seandrummond | clayg: I can assure you they have all been restarted and I have my own clean up scripts that delete the data, similar to gholt's script | 20:31 |
seandrummond | [root@host swift]# grep -c "\ 412\ " object-server.log | 20:31 |
seandrummond | 198166 | 20:31 |
seandrummond | while straceing I can see the reason for the 412 I cannot see if output in the log itself | 20:32 |
NM1 | clayg: Do you think it mught be a bug from a old version? :( I'm using swift 1.7 | 20:33 |
clayg | NM1: no i'm pretty sure you have the wrong "user" in the header? what's the full tempauth "acct:username" for that user? | 20:34 |
seandrummond | could it be obj/server.py:608 ? sorry clayg I realize you are in the middle of two conversations I can speak with you later if you prefer | 20:34 |
clayg | seandrummond: no worries NM1 will get it figured out | 20:34 |
NM1 | plataforma:entretenimentocma | 20:35 |
*** jasondotstar has joined #openstack-swift | 20:35 | |
*** saju_m has quit IRC | 20:35 | |
clayg | yeah i mean that's the time you *want* it to return 412 tho, like I said they could come up anytime - but they shouldn't if you're not updating an objects X-Delete-At | 20:35 |
clayg | NM1: so you need to use that in your x-container-write/read headers | 20:35 |
clayg | seandrummond: so i'm remembering now that the bug there was the object server returning 404 for objects that had expired and not acctually deleting the .data file on disk - which the expirer would just assume was fine and delete the record in the expiring object acct | 20:38 |
NM1 | clayg: It worked like magic. | 20:38 |
openstackgerrit | A change was merged to openstack/swift: Merge branch 'master' into feature/ec https://review.openstack.org/82165 | 20:39 |
clayg | not magic - apis | 20:39 |
NM1 | Thank you. I lost all my afternoon with that... | 20:39 |
seandrummond | clayg: I am also getting many 404s but I was thinking that was from running multiple expirers | 20:39 |
clayg | seandrummond: ok that one makes sense then :P | 20:39 |
clayg | seandrummond: hrmm... the bug report specifically mentions the 412 - but that doens't make any sense in light of the patch? | 20:40 |
seandrummond | and it seems nothing is getting cleaned up | 20:40 |
*** jasondotstar has quit IRC | 20:41 | |
*** JuanManuelOlle has quit IRC | 20:48 | |
*** Trixboxer has quit IRC | 20:54 | |
peluse | clayg: so I think I have something better for the policy index replacement however I have a mtg now that will waste my time - err keep me occupied I mean - for a at least an hr | 20:55 |
peluse | clayg/torgomatic: sidenote it looks like there's a missing part from the 'purge policies' patch that was just merged. _convert_policy_to_index() needs the proxy application class .policies member and even unit tests fail for me, how did it get merged? Or am I in need or more coffee (quite possibly)? | 20:57 |
torgomatic | peluse: could be that I missed a spot; what unit test fails? test/unit/proxy/test_server.py? | 20:57 |
seandrummond | clayg: I am going to continue to look into it I will touch base again later possibly Monday | 20:58 |
peluse | torgomatic: whoa, looking on jenkins output for the patch it fails also... | 20:58 |
peluse | http://logs.openstack.org/40/81940/1/check/gate-swift-python26/5539ae0/nose_results.html | 20:59 |
torgomatic | peluse: so the tests failed, but the change merged anyway? | 20:59 |
peluse | looks like Jenkins says it passed even though the detail showed the failure, m aybe because it wasn't an explciit test? ex: ERROR: test suite for <module 'test.unit.proxy.test_server' | 20:59 |
torgomatic | peluse: okay, I have the same failure locally... let me see what I can do | 21:00 |
peluse | torgomatic: cool, thanks | 21:00 |
openstackgerrit | Samuel Merritt proposed a change to openstack/swift: Fix unit tests. https://review.openstack.org/82207 | 21:07 |
*** seandrummond has quit IRC | 21:09 | |
*** samwright has left #openstack-swift | 21:13 | |
openstackgerrit | Samuel Merritt proposed a change to openstack/swift: Allow overriding of storage policy index. https://review.openstack.org/82211 | 21:16 |
openstackgerrit | Samuel Merritt proposed a change to openstack/swift: Put X-Timestamp in object 404 responses https://review.openstack.org/80729 | 21:16 |
openstackgerrit | Samuel Merritt proposed a change to openstack/swift: Make the container replicator notice misplaced objects https://review.openstack.org/80731 | 21:16 |
openstackgerrit | Samuel Merritt proposed a change to openstack/swift: Add object-reconciler daemon https://review.openstack.org/80730 | 21:16 |
openstackgerrit | Samuel Merritt proposed a change to openstack/swift: Make object updater reconcile on 409s https://review.openstack.org/80732 | 21:16 |
*** byeager has quit IRC | 21:27 | |
*** byeager has joined #openstack-swift | 21:27 | |
*** piyush1 has quit IRC | 21:28 | |
*** piyush has joined #openstack-swift | 21:28 | |
*** piyush1 has joined #openstack-swift | 21:30 | |
*** piyush has quit IRC | 21:32 | |
* peluse thinks torgomatic must have a tommy gun that shoots patches :) | 21:34 | |
torgomatic | now all I need is one that shoots quality :) | 21:34 |
*** byeager has quit IRC | 21:34 | |
*** byeager has joined #openstack-swift | 21:35 | |
*** byeager has quit IRC | 21:39 | |
*** pberis has quit IRC | 21:48 | |
*** mkollaro has quit IRC | 21:53 | |
*** byeager has joined #openstack-swift | 21:57 | |
*** piyush1 has left #openstack-swift | 21:59 | |
portante | notmyname: what was the name of that flow tool your wrote? | 22:02 |
notmyname | I wrote a flow tool? | 22:03 |
notmyname | tell me more | 22:03 |
notmyname | (and I might remember it) | 22:03 |
portante | log flow, looks at swift logs and makes a graph? | 22:03 |
notmyname | oh yeah | 22:04 |
portante | goflow or something? | 22:04 |
notmyname | and look at that. I have a directory called "flow". that must be it :-) | 22:04 |
portante | logflow | 22:04 |
portante | got it | 22:04 |
portante | https://github.com/notmyname/logflow | 22:04 |
notmyname | portante: ya https://github.com/notmyname/logflow | 22:04 |
notmyname | portante: you wanna push some code there? :-) | 22:05 |
portante | we want to use it to help somebody learn what is happening and why it is breaking | 22:05 |
notmyname | cool | 22:05 |
notmyname | next steps I had for it were to somehow designate a particular set of log lines (maybe log file name?) as belonging to a particular server. that way you can actually see which servers (and how many) are involved in each task | 22:06 |
notmyname | I'll do that in my free time | 22:06 |
portante | yes, that would be cool | 22:06 |
notmyname | so maybe next August | 22:06 |
notmyname | (next == 2015) | 22:07 |
notmyname | portante: but I'd be happy to give you write access to that repo. | 22:07 |
notmyname | now that you reminded me of it (I seriously had forgotten), maybe I'll take another look | 22:07 |
notmyname | it's a good "on the airplane" project | 22:08 |
portante | yes | 22:09 |
portante | and I am going to try to use it tonight to help illuminate a problem | 22:09 |
notmyname | cool | 22:09 |
portante | both as a teaching instrument and to help debug | 22:09 |
notmyname | was that yes to working on the airplane or yes to commit acces? | 22:09 |
portante | yes on the airplane, if I make changes, I'll post a pull request first, and then you can decide if I should have write access to the repo. ;) | 22:10 |
*** byeager has quit IRC | 22:10 | |
notmyname | heh. like you don't have commit access to other projects? you know, like swift? ;-) | 22:10 |
portante | :) | 22:10 |
portante | already too dangerous | 22:11 |
notmyname | heh. ok. I'll be happy to merge your PR | 22:11 |
openstackgerrit | Matthew Treinish proposed a change to openstack/swift: Stop using use_develop with tox https://review.openstack.org/82228 | 22:13 |
mtreinish | notmyname: ^^ that should fix the unit test issue | 22:13 |
notmyname | hmm...seems like that project is not following the swift naming pattern. it should be swogflow. or slogflow. or just slow | 22:13 |
mtreinish | clarkb: ^^^ | 22:13 |
notmyname | mtreinish: ah, cool | 22:13 |
clarkb | mtreinish: is it usedevelop that breaks it? | 22:14 |
mtreinish | clarkb: yeah I ran it locally with and without it | 22:14 |
notmyname | hmm...added back in 2009 | 22:14 |
mtreinish | I have no idea why | 22:14 |
clarkb | interesting. I wonder if that is a setuptools bug | 22:14 |
clarkb | mtreinish: you should bug mordred about it | 22:14 |
mtreinish | clarkb: I'll save that for next week | 22:14 |
notmyname | mtreinish: https://gist.github.com/notmyname/e851249703427e3d9bdc | 22:15 |
openstackgerrit | paul luse proposed a change to openstack/swift: Add Storage Policy Support to Account HEAD https://review.openstack.org/73747 | 22:18 |
openstackgerrit | paul luse proposed a change to openstack/swift: Container Confict on obj update with wrong Storage-Policy-Index https://review.openstack.org/79731 | 22:18 |
peluse | clayg: the new acct rollup patch has a better way of doing the policy index/name thing but probably still needs another round... get/head for all requsts is no longer impacted and the gymnastics of fixing up the acct HEAD request are less | 22:19 |
openstackgerrit | Matthew Treinish proposed a change to openstack/swift: Stop using use_develop with tox https://review.openstack.org/82228 | 22:19 |
peluse | clayg: and not that I didn't add unit test coverage for the new strip function pending your input on a better way to skin the cat | 22:21 |
clayg | peluse: ah yeah cool - sorry I got all hung up making some of these container tests awesome | 22:30 |
peluse | cool... BTW, not sure why the 409 patch got updated when I pushed the acct rollup change.. something to do with the dependency no doubt but wasn't expected | 22:33 |
clayg | peluse: ok, but you didn't put any changes fixups there - it was just your general rebase mess? | 22:34 |
peluse | I sure hope so :) I didn't make any changes on purpose, no | 22:34 |
peluse | checking diff now... | 22:35 |
peluse | clayg: bunch of stuff I don't recognize so looks like it picked up the rebase from this morn | 22:38 |
peluse | or its just all jacked to hell now :-o | 22:39 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Container Confict on obj update with wrong Storage-Policy-Index https://review.openstack.org/79731 | 22:43 |
clayg | ^ that's all rebased up on fix unittests - but probably blew the account roll up one | 22:43 |
clayg | I need to checkout that branch to review it - so I'll do the rebase now if that's cool | 22:44 |
clayg | shit, nm that was the wrong branch :P | 22:45 |
* clayg really hates the branch names that you get with git review -d | 22:46 | |
notmyname | clayg: step 2 of `git review -d` is `git branch -m readable` | 22:46 |
*** jasondotstar has joined #openstack-swift | 22:47 | |
peluse | cool | 22:56 |
*** jasondotstar has quit IRC | 22:57 | |
*** piousbox has joined #openstack-swift | 23:00 | |
piousbox | I have an architectural question regarding the Swift API | 23:00 |
piousbox | Why is the account in the URL? | 23:00 |
torgomatic | where else would it be? | 23:00 |
piousbox | Here, for example: http://docs.openstack.org/api/openstack-object-storage/1.0/content/GET_showAccountDetails_v1__account__storage_account_services.html | 23:00 |
piousbox | Well, account information is passed in the headers. | 23:01 |
torgomatic | depending on your auth system, one user may have access to multiple Swift accounts | 23:01 |
torgomatic | if nothing else, admins can access any account | 23:02 |
piousbox | and if you want to prevent a used from accessing any account? | 23:02 |
piousbox | You still have to specify account information elsewhere, correct? | 23:02 |
clayg | torgomatic: back away slowly | 23:02 |
piousbox | used=user | 23:02 |
clayg | i think the best reason for having the fully qualified resource in the url is for shared access, and the fact that two users can have a container with the same name | 23:03 |
torgomatic | so, the user sends the X-Auth-Token header, and the auth system determines if they have access to the named resource | 23:03 |
clayg | if you a) don't allow users to name their resources or b) don't ever intend for resources to be public - there's little reason to include the owner of the resources in the url - otherwise - you sort of have too | 23:03 |
torgomatic | the first is identity, the second is the resource | 23:04 |
piousbox | Amazon S3 does not have account in their path, only bucket name. | 23:05 |
piousbox | Having containers with the same names and different users makes sense. | 23:05 |
clayg | they can't have multiple uses with the same container/bucket name | 23:05 |
clayg | and knowning is half the battle | 23:05 |
piousbox | Hm okay, thanks. | 23:06 |
clayg | np! | 23:07 |
*** jasondotstar has joined #openstack-swift | 23:11 | |
*** seandrummond has joined #openstack-swift | 23:12 | |
*** seandrummond has quit IRC | 23:14 | |
*** NM1 has quit IRC | 23:36 | |
*** jasondotstar has quit IRC | 23:43 | |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Container Confict on obj update with wrong Storage-Policy-Index https://review.openstack.org/79731 | 23:47 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Add Storage Policy Support to Account HEAD https://review.openstack.org/73747 | 23:47 |
*** NM1 has joined #openstack-swift | 23:56 | |
*** NM1 has quit IRC | 23:57 | |
*** NM1 has joined #openstack-swift | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!