*** bill_az has quit IRC | 00:02 | |
*** suyash has joined #openstack-swift | 00:05 | |
*** rvasilets__ has quit IRC | 00:06 | |
*** bill_az has joined #openstack-swift | 00:07 | |
*** diogogmt has quit IRC | 00:09 | |
*** suyash has quit IRC | 00:22 | |
kota_ | hello | 00:25 |
---|---|---|
kota_ | pdardeau: thanks for reviewing to my composite ring patch! will look at your comment! | 00:25 |
mattoliverau | kota_: morning | 00:31 |
kota_ | mattoliverau: morning | 00:31 |
*** lyrrad has quit IRC | 00:38 | |
*** tqtran has quit IRC | 00:45 | |
*** vint_bra has joined #openstack-swift | 00:49 | |
*** Jeffrey4l has quit IRC | 00:49 | |
*** nadeem has quit IRC | 00:50 | |
*** vint_bra1 has joined #openstack-swift | 00:51 | |
*** vint_bra has quit IRC | 00:52 | |
*** sams-gleb has joined #openstack-swift | 00:53 | |
*** bill_az has quit IRC | 00:59 | |
*** sams-gleb has quit IRC | 01:00 | |
*** vint_bra1 has quit IRC | 01:03 | |
*** kevinc has quit IRC | 01:06 | |
*** dmorita has quit IRC | 01:12 | |
openstackgerrit | Matthew Oliver proposed openstack/swift: disable_fallocate also disables fallocate_reserve https://review.openstack.org/317158 | 01:17 |
*** Jeffrey4l has joined #openstack-swift | 01:45 | |
-openstackstatus- NOTICE: Gerrit is about to be restarted to help with page timeouts | 01:47 | |
*** Jeffrey4l has quit IRC | 01:55 | |
*** sams-gleb has joined #openstack-swift | 01:57 | |
*** sams-gleb has quit IRC | 02:06 | |
*** Jeffrey4l has joined #openstack-swift | 02:08 | |
jrichli | symlink update: I made an attempt (very lacking) at starting to enumerate the various cases/failures we need to address with our current strategy. | 02:21 |
jrichli | Please add cases and scenarios that need to be addressed: https://etherpad.openstack.org/p/swift_symlinks | 02:21 |
pdardeau | kota_: interesting stuff (composite ring). i look forward to spending more time learning about it | 02:23 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/python-swiftclient: Updated from global requirements https://review.openstack.org/89250 | 02:40 |
*** _JZ_ has quit IRC | 02:45 | |
*** sams-gleb has joined #openstack-swift | 03:03 | |
*** Jeffrey4l has quit IRC | 03:03 | |
mahatic | good morning | 03:08 |
*** sams-gleb has quit IRC | 03:10 | |
*** gyee has quit IRC | 03:20 | |
*** psachin has joined #openstack-swift | 03:26 | |
*** links has joined #openstack-swift | 03:26 | |
*** Jeffrey4l has joined #openstack-swift | 03:36 | |
*** psachin has quit IRC | 04:04 | |
*** sams-gleb has joined #openstack-swift | 04:07 | |
*** klrmn has quit IRC | 04:14 | |
*** sams-gleb has quit IRC | 04:16 | |
*** psachin has joined #openstack-swift | 04:20 | |
*** lakshmiS has quit IRC | 04:32 | |
*** alpha_ori has quit IRC | 04:42 | |
*** alpha_ori has joined #openstack-swift | 04:44 | |
*** nadeem has joined #openstack-swift | 04:53 | |
*** Jeffrey4l has quit IRC | 04:53 | |
*** swiftfan has joined #openstack-swift | 05:08 | |
*** mariusv_ has joined #openstack-swift | 05:08 | |
*** hosanai_ has joined #openstack-swift | 05:09 | |
*** balajir_ has joined #openstack-swift | 05:10 | |
*** ntata| has joined #openstack-swift | 05:12 | |
*** balajir has quit IRC | 05:12 | |
*** pdardeau has quit IRC | 05:12 | |
*** ntata has quit IRC | 05:12 | |
*** hosanai has quit IRC | 05:12 | |
*** links has quit IRC | 05:12 | |
*** zul has quit IRC | 05:12 | |
*** anderstj has quit IRC | 05:12 | |
*** wer has quit IRC | 05:12 | |
*** swat30 has quit IRC | 05:12 | |
*** swiftfan_ has quit IRC | 05:12 | |
*** mariusv has quit IRC | 05:12 | |
*** sams-gleb has joined #openstack-swift | 05:13 | |
*** swat30 has joined #openstack-swift | 05:13 | |
*** alpha_ori has quit IRC | 05:13 | |
*** links has joined #openstack-swift | 05:13 | |
*** anderstj has joined #openstack-swift | 05:13 | |
*** wer has joined #openstack-swift | 05:14 | |
*** zul has joined #openstack-swift | 05:14 | |
*** balajir_ has quit IRC | 05:14 | |
*** nadeem has quit IRC | 05:14 | |
*** pdardeau has joined #openstack-swift | 05:15 | |
*** alpha_ori has joined #openstack-swift | 05:17 | |
*** balajir has joined #openstack-swift | 05:18 | |
*** sams-gleb has quit IRC | 05:21 | |
*** ChubYann has quit IRC | 05:24 | |
*** silor has joined #openstack-swift | 05:44 | |
*** rcernin has joined #openstack-swift | 05:47 | |
*** david-lyle has quit IRC | 06:05 | |
*** zaitcev has quit IRC | 06:11 | |
*** ppai has joined #openstack-swift | 06:16 | |
*** sams-gleb has joined #openstack-swift | 06:18 | |
*** Jeffrey4l has joined #openstack-swift | 06:21 | |
*** sams-gleb has quit IRC | 06:25 | |
*** rcernin has quit IRC | 06:47 | |
*** ozialien10 has quit IRC | 06:50 | |
*** Jeffrey4l has quit IRC | 06:50 | |
*** rcernin has joined #openstack-swift | 06:51 | |
openstackgerrit | Kazuhiro MIYAHARA proposed openstack/swift: WIP: Swift Automated Tiering https://review.openstack.org/287057 | 06:54 |
*** nadeem has joined #openstack-swift | 06:55 | |
*** nadeem has quit IRC | 07:00 | |
*** nadeem has joined #openstack-swift | 07:01 | |
*** duobei has joined #openstack-swift | 07:06 | |
*** Jeffrey4l has joined #openstack-swift | 07:10 | |
*** hseipp has joined #openstack-swift | 07:14 | |
mattoliverau | k I'm calling it a night... at least for now o/ | 07:20 |
*** rledisez has joined #openstack-swift | 07:22 | |
*** mmcardle has joined #openstack-swift | 07:22 | |
mahatic | mattoliverau: good night! | 07:22 |
*** sams-gleb has joined #openstack-swift | 07:22 | |
*** sams-gleb has quit IRC | 07:31 | |
*** duobei has quit IRC | 07:31 | |
*** jmccarthy1 has joined #openstack-swift | 07:31 | |
*** dmk0202 has joined #openstack-swift | 07:35 | |
*** jmccarthy has quit IRC | 07:40 | |
*** jmccarthy has joined #openstack-swift | 07:41 | |
*** sanchitmalhotra1 has quit IRC | 07:50 | |
*** jistr has joined #openstack-swift | 07:54 | |
*** daemontool has joined #openstack-swift | 07:55 | |
*** duobei has joined #openstack-swift | 07:56 | |
*** david-lyle has joined #openstack-swift | 07:57 | |
*** joeljwright has joined #openstack-swift | 07:57 | |
*** ChanServ sets mode: +v joeljwright | 07:57 | |
*** sams-gleb has joined #openstack-swift | 08:22 | |
*** acoles_ is now known as acoles | 08:23 | |
acoles | good morning | 08:26 |
mahatic | acoles: good morning | 08:31 |
joeljwright | morning! | 08:31 |
*** sams-gle_ has joined #openstack-swift | 08:40 | |
*** delattec has joined #openstack-swift | 08:40 | |
*** kozhukalov_ has joined #openstack-swift | 08:43 | |
*** matt6434 has joined #openstack-swift | 08:44 | |
*** bapalm_ has joined #openstack-swift | 08:44 | |
*** kei_yama_ has joined #openstack-swift | 08:45 | |
*** ntata has joined #openstack-swift | 08:45 | |
*** swiftfan_ has joined #openstack-swift | 08:45 | |
*** mhu1 has joined #openstack-swift | 08:45 | |
*** mathiasb_ has joined #openstack-swift | 08:45 | |
*** aerwin3 has quit IRC | 08:45 | |
*** wasmum has quit IRC | 08:45 | |
*** hosanai_ has quit IRC | 08:45 | |
*** ntata- has quit IRC | 08:45 | |
*** kaleta has quit IRC | 08:45 | |
*** mhu has quit IRC | 08:45 | |
*** hurricanerix has quit IRC | 08:45 | |
*** kei_yama has quit IRC | 08:45 | |
*** scotticus has quit IRC | 08:45 | |
*** a1|away has quit IRC | 08:45 | |
*** sams-gleb has quit IRC | 08:45 | |
*** bapalm has quit IRC | 08:45 | |
*** swiftfan has quit IRC | 08:45 | |
*** kota_ has quit IRC | 08:45 | |
*** kozhukalov has quit IRC | 08:45 | |
*** onovy has quit IRC | 08:45 | |
*** peterlisak has quit IRC | 08:45 | |
*** briancurtin has quit IRC | 08:45 | |
*** yarkot1 has quit IRC | 08:45 | |
*** mathiasb has quit IRC | 08:45 | |
*** cdelatte has quit IRC | 08:45 | |
*** philipw has quit IRC | 08:45 | |
*** mattoliverau has quit IRC | 08:45 | |
*** jamielennox has quit IRC | 08:45 | |
*** aerwin3 has joined #openstack-swift | 08:45 | |
*** kaleta has joined #openstack-swift | 08:45 | |
*** philipw has joined #openstack-swift | 08:45 | |
*** scott_ has joined #openstack-swift | 08:45 | |
*** mhu1 is now known as mhu | 08:45 | |
*** kota_ has joined #openstack-swift | 08:45 | |
*** ChanServ sets mode: +v kota_ | 08:45 | |
*** yarkot1 has joined #openstack-swift | 08:46 | |
*** hurricanerix has joined #openstack-swift | 08:46 | |
*** scott_ is now known as Guest43585 | 08:46 | |
*** peterlisak has joined #openstack-swift | 08:46 | |
*** onovy has joined #openstack-swift | 08:46 | |
*** serverascode has quit IRC | 08:47 | |
*** kozhukalov_ is now known as kozhukalov | 08:48 | |
*** marcusvrn_ has quit IRC | 08:48 | |
*** mvk has joined #openstack-swift | 08:49 | |
*** wadeholler has joined #openstack-swift | 08:49 | |
*** hosanai has joined #openstack-swift | 08:50 | |
*** ChanServ sets mode: +v hosanai | 08:50 | |
*** a1|away has joined #openstack-swift | 08:50 | |
*** jamielennox has joined #openstack-swift | 08:55 | |
*** wasmum has joined #openstack-swift | 08:57 | |
*** marcusvrn_ has joined #openstack-swift | 08:57 | |
*** daemontool_ has joined #openstack-swift | 09:00 | |
*** daemontool_ has quit IRC | 09:00 | |
*** kei_yama_ has quit IRC | 09:01 | |
*** daemontool has quit IRC | 09:03 | |
*** serverascode has joined #openstack-swift | 09:03 | |
*** briancurtin has joined #openstack-swift | 09:05 | |
*** nottrobin has quit IRC | 09:07 | |
*** nottrobin has joined #openstack-swift | 09:11 | |
*** asettle has joined #openstack-swift | 09:12 | |
*** nadeem has quit IRC | 09:13 | |
*** admin0 has joined #openstack-swift | 09:14 | |
*** daemontool has joined #openstack-swift | 09:18 | |
*** mvk_ has joined #openstack-swift | 09:24 | |
*** mvk has quit IRC | 09:28 | |
*** duobei has quit IRC | 09:30 | |
*** jmccarthy1 has quit IRC | 09:34 | |
*** jmccarthy1 has joined #openstack-swift | 09:34 | |
*** jmccarthy1 has quit IRC | 09:34 | |
*** duobei has joined #openstack-swift | 09:35 | |
*** jmccarthy1 has joined #openstack-swift | 09:39 | |
openstackgerrit | Merged openstack/swift: Add Encryption to the default pipeline https://review.openstack.org/316419 | 10:14 |
openstackgerrit | Merged openstack/swift: crypto: Remove BYOK support https://review.openstack.org/314856 | 10:15 |
*** pietervanw has joined #openstack-swift | 10:21 | |
*** Jeffrey4l has quit IRC | 10:25 | |
*** wadeholler has left #openstack-swift | 10:25 | |
*** duobei has quit IRC | 10:27 | |
openstackgerrit | Mahati Chamarthy proposed openstack/swift: crypto - Add "disable_encryption" config option https://review.openstack.org/315588 | 10:39 |
openstackgerrit | Mahati Chamarthy proposed openstack/swift: crypto - don't break conditional GETs on unencrypted objects https://review.openstack.org/314740 | 10:39 |
*** duobei has joined #openstack-swift | 10:43 | |
*** hosanai has quit IRC | 10:46 | |
*** duobei has quit IRC | 10:50 | |
*** pietervanw_ has joined #openstack-swift | 10:58 | |
*** pietervanw has quit IRC | 11:00 | |
*** asettle has quit IRC | 11:21 | |
*** asettle has joined #openstack-swift | 11:28 | |
*** mmcardle has quit IRC | 11:45 | |
*** diogogmt has joined #openstack-swift | 11:48 | |
*** mvk_ has quit IRC | 11:49 | |
*** McMurlock has joined #openstack-swift | 11:53 | |
*** admin0_ has joined #openstack-swift | 12:01 | |
*** diogogmt has quit IRC | 12:02 | |
*** admin0 has quit IRC | 12:04 | |
*** admin0_ is now known as admin0 | 12:04 | |
*** sams-gle_ has quit IRC | 12:06 | |
*** sams-gleb has joined #openstack-swift | 12:07 | |
*** zul has quit IRC | 12:14 | |
*** sams-gleb has quit IRC | 12:15 | |
*** mvk_ has joined #openstack-swift | 12:19 | |
*** admin0 has quit IRC | 12:21 | |
*** pietervanw__ has joined #openstack-swift | 12:21 | |
*** admin0 has joined #openstack-swift | 12:22 | |
openstackgerrit | Mahati Chamarthy proposed openstack/swift: crypto - don't break conditional GETs on unencrypted objects https://review.openstack.org/314740 | 12:23 |
*** pietervanw_ has quit IRC | 12:24 | |
mahatic | acoles: sorry for the rebase noise. (it earlier failed pep8, my bad) | 12:24 |
*** jordanP has joined #openstack-swift | 12:25 | |
*** raildo-afk is now known as raildo | 12:28 | |
*** pietervanw__ has quit IRC | 12:28 | |
*** mmcardle has joined #openstack-swift | 12:29 | |
*** links has quit IRC | 12:31 | |
*** chuck__ has joined #openstack-swift | 12:34 | |
*** links has joined #openstack-swift | 12:35 | |
*** SkyRocknRoll has joined #openstack-swift | 12:35 | |
*** psachin has quit IRC | 12:36 | |
*** SkyRocknRoll has quit IRC | 12:36 | |
*** SkyRocknRoll has joined #openstack-swift | 12:37 | |
*** SkyRocknRoll has quit IRC | 12:42 | |
*** SkyRocknRoll has joined #openstack-swift | 12:42 | |
*** klamath has joined #openstack-swift | 12:47 | |
*** klamath has quit IRC | 12:47 | |
*** psachin has joined #openstack-swift | 12:48 | |
*** klamath has joined #openstack-swift | 12:48 | |
*** takashi has joined #openstack-swift | 12:48 | |
pdardeau | good morning | 12:49 |
*** daemontool has quit IRC | 12:52 | |
openstackgerrit | Alistair Coles proposed openstack/swift: crypto - add overview doc (WIP) https://review.openstack.org/312096 | 12:54 |
acoles | jrichli: ^^ I think that now reflects what is currently implemented | 12:55 |
*** aj701 has quit IRC | 13:04 | |
*** aj701 has joined #openstack-swift | 13:06 | |
*** NM has joined #openstack-swift | 13:07 | |
*** _JZ_ has joined #openstack-swift | 13:11 | |
*** sams-gleb has joined #openstack-swift | 13:12 | |
*** links has quit IRC | 13:16 | |
*** sams-gleb has quit IRC | 13:20 | |
*** bill_az has joined #openstack-swift | 13:21 | |
*** pauloewerton has joined #openstack-swift | 13:22 | |
*** ppai has quit IRC | 13:23 | |
*** StraubTW has joined #openstack-swift | 13:24 | |
*** StraubTW has quit IRC | 13:24 | |
*** StraubTW has joined #openstack-swift | 13:24 | |
*** SkyRocknRoll has quit IRC | 13:29 | |
*** diogogmt has joined #openstack-swift | 13:33 | |
admin0 | how to trace the root cause of 503 errors ? | 13:36 |
*** Jeffrey4l has joined #openstack-swift | 13:36 | |
jrichli | admin0: if, by chance, you are seeing these from functests on an SAIO, then patch 317158 fixes the errors | 13:39 |
patchbot | jrichli: https://review.openstack.org/#/c/317158/ - swift - disable_fallocate also disables fallocate_reserve | 13:39 |
admin0 | getting this on a real old platfrom suddenly | 13:39 |
admin0 | not an AIO build | 13:39 |
*** vint_bra has joined #openstack-swift | 13:40 | |
jrichli | admin0: what request causes the error? I am afraid just old fashioned debugging is the the best advice I can give. | 13:40 |
admin0 | in swift-proxy i get a 503 with a txXXXX foloowed by some numbers like 1463577867.408714056 1463577867.415402889 | 13:41 |
*** SkyRocknRoll has joined #openstack-swift | 13:41 | |
admin0 | so my question is, how to do debug further on this ? | 13:41 |
admin0 | based on tx or based on those geoip looking numbers | 13:41 |
admin0 | geo-corordinate | 13:41 |
jrichli | do you have logs both proxy and the associated object server? | 13:42 |
*** jordanP has quit IRC | 13:42 | |
*** SkyRocknRoll has quit IRC | 13:43 | |
*** SkyRocknRoll has joined #openstack-swift | 13:44 | |
*** takashi has quit IRC | 13:44 | |
*** diogogmt has quit IRC | 13:44 | |
jrichli | acoles: taking a look at docs now | 13:44 |
admin0 | is it possible to find out in which object server to get the log from ? | 13:44 |
admin0 | or where it goes to | 13:45 |
jrichli | you could look for the tx(txn) id you were talking about | 13:46 |
jrichli | that identifies the transaction | 13:47 |
admin0 | i see account, container, object, object-server, object-replicator.logs | 13:48 |
admin0 | which is the one i should look for | 13:48 |
jrichli | do you have any information on what action / request caused this error? | 13:48 |
jrichli | if you don | 13:48 |
*** ametts has joined #openstack-swift | 13:49 | |
jrichli | if you don't have any clue, then you'd have to grep through them all, i suppose | 13:49 |
admin0 | GET | 13:49 |
jrichli | was it a GET for an object? not for a container to get a listing? | 13:50 |
admin0 | for a specific object | 13:50 |
*** jordanP has joined #openstack-swift | 13:50 | |
jrichli | I'd start with the object-server logs | 13:51 |
admin0 | GET /v1/AUTH_66797544cf82404bb4122b97b5e2c934/xx/xx/toolbarButton-search.png 503 - tx58695b145d494e0e978a7-00573c72e1 - 0.0053 - - 1463579361.754849911 1463579361.760139942 | 13:51 |
admin0 | something like those | 13:51 |
admin0 | ok | 13:51 |
admin0 | i get something back like "proxy-server 21801" 0.0007 back | 13:52 |
admin0 | after the txn in the object-server.log | 13:52 |
jrichli | admin0: I am not sure what that particular part signifies. But I wonder - are any requests to the object-server working right now? | 13:55 |
admin0 | i see a lot of GETs and PUTS in the object-server.log and no mention of ERROR | 13:56 |
jrichli | have you checked the network connections? | 13:56 |
*** eeiden has joined #openstack-swift | 13:56 | |
jrichli | are the GETs and PUTs recent? | 13:57 |
admin0 | yes | 13:57 |
admin0 | ongoing right now | 13:58 |
jrichli | ok, so its only a particular object that has this issue? | 13:58 |
admin0 | well, say only a few customers complaining | 13:58 |
admin0 | of 503s | 13:58 |
admin0 | i guess on particular/specific GET and PUTs | 13:58 |
jrichli | well, maybe the ones on a particular object-server | 13:59 |
admin0 | is there a way to figure out which object srever .. eelse i have to loop all 503 ids from all proxy servers ( 4 of them ) and then loop over the tx to all storage servers ( 32 of them ) | 14:00 |
jrichli | do you have some monitoring you could leverage? | 14:00 |
admin0 | coming to this chatroom was after finding nothing obvious there :( | 14:01 |
admin0 | are there any obvious signs, or patterns in logs that i can grep | 14:03 |
*** Jeffrey4l has quit IRC | 14:08 | |
ahale | those geo looking thjis are start/end request times i think | 14:08 |
jrichli | there is a tool that you can use to find out where a given path will go (based on the ring). let me dig up those details | 14:08 |
ahale | ^^ swift-get-nodes /path/to/ring acc cont obj | 14:08 |
jrichli | ahale: thanks! | 14:09 |
*** jordanP has quit IRC | 14:09 | |
*** links has joined #openstack-swift | 14:10 | |
ahale | there should be some more info in the proxy.error maybe, with the same tx id - it should log what it got back and why it chose a 507 | 14:10 |
admin0 | 503 | 14:10 |
admin0 | not a 507 | 14:10 |
*** sams-gleb has joined #openstack-swift | 14:18 | |
ahale | oh yeah sorry , 507 on the brain | 14:20 |
*** sams-gleb has quit IRC | 14:20 | |
*** sams-gleb has joined #openstack-swift | 14:21 | |
admin0 | http://pastebin.com/Xx9w5Hr7 — this is what i get | 14:22 |
admin0 | from those 2 lines , one from proxy , one from object server, i am not sure where to go further | 14:23 |
*** daemontool has joined #openstack-swift | 14:28 | |
jrichli | admin0: you might try turning on debug logging. so now you know an object-server that is reporting errors - see if there is a pattern where the failures occur like a particular disk or something? | 14:37 |
*** eeiden has quit IRC | 14:38 | |
jrichli | anyone else have experience with this type of debugging? | 14:38 |
*** CaioBrentano has joined #openstack-swift | 14:38 | |
*** links has quit IRC | 14:39 | |
openstackgerrit | Merged openstack/python-swiftclient: Correct doc string for http_conn argument https://review.openstack.org/315878 | 14:45 |
jrichli | admin0: a great reference in general - that may have some info to help - is http://docs.openstack.org/developer/swift/ops_runbook/index.html | 14:47 |
*** hseipp has quit IRC | 14:47 | |
acoles | jrichli: how far did you get with review on patch 314740 ? | 14:48 |
patchbot | acoles: https://review.openstack.org/#/c/314740/ - swift (feature/crypto) - crypto - don't break conditional GETs on unencrypt... | 14:48 |
jrichli | I reviewed the changes themselves, and they look good. i was just still going through the tests. but I can still do that and then propose changes later if needed. | 14:48 |
acoles | I am wondering if I should separate the test infrastructure in that patch out into a separate patch since we have 3 other patches dependent on the tests but not the code changes? | 14:49 |
jrichli | acoles: sounds like a good idea | 14:49 |
acoles | jrichli: ok, keep looking over the tests cos they still need reviewing, but I'll do some shifting around | 14:50 |
acoles | thanks | 14:50 |
acoles | jrichli: mahatic: gerrit didn't report this in channel so fyi patch 318148 is new | 14:51 |
patchbot | acoles: https://review.openstack.org/#/c/318148/ - swift (feature/crypto) - crypto - stop using key id to derive GET path keys | 14:51 |
*** nadeem has joined #openstack-swift | 14:56 | |
*** raildo is now known as raildo-afk | 14:56 | |
*** zaitcev has joined #openstack-swift | 14:58 | |
*** ChanServ sets mode: +v zaitcev | 14:58 | |
*** jistr is now known as jistr|mtg | 15:02 | |
*** jordanP has joined #openstack-swift | 15:03 | |
mahatic | acoles: separating tests sounds good | 15:11 |
mahatic | will look at the new patch | 15:12 |
acoles | mahatic: I'll rebase your patch 315588 while I am at it | 15:12 |
patchbot | acoles: https://review.openstack.org/#/c/315588/ - swift (feature/crypto) - crypto - Add "disable_encryption" config option | 15:12 |
*** McMurlock has quit IRC | 15:13 | |
mahatic | acoles: thanks. I wanted to add a small comment to the new test, but will do it if/when there are more comments to be addressed | 15:15 |
openstackgerrit | Alistair Coles proposed openstack/swift: crypto - stop using key id to derive GET path keys https://review.openstack.org/318148 | 15:15 |
openstackgerrit | Alistair Coles proposed openstack/swift: crypto - test varying proxy pipeline configs https://review.openstack.org/318167 | 15:15 |
openstackgerrit | Alistair Coles proposed openstack/swift: crypto - don't break conditional GETs on unencrypted objects https://review.openstack.org/314740 | 15:15 |
mahatic | acoles: gerrit woke up | 15:15 |
acoles | jrichli: mahatic: patch 318167 is the new one with tests, others depend on it | 15:16 |
patchbot | acoles: https://review.openstack.org/#/c/318167/ - swift (feature/crypto) - crypto - test varying proxy pipeline configs | 15:16 |
jrichli | acoles: thanks | 15:16 |
mahatic | acoles: great | 15:17 |
*** jistr|mtg is now known as jistr | 15:19 | |
*** rcernin has quit IRC | 15:24 | |
openstackgerrit | Alistair Coles proposed openstack/swift: crypto - Add "disable_encryption" config option https://review.openstack.org/315588 | 15:26 |
acoles | ok all done | 15:26 |
jrichli | done with crypto? great! ;-) acoles says feature is DONE! | 15:28 |
acoles | I said all not ALL ;) | 15:29 |
*** psachin has quit IRC | 15:32 | |
*** diogogmt has joined #openstack-swift | 15:33 | |
*** dmk0202 has quit IRC | 15:37 | |
*** dmk0202 has joined #openstack-swift | 15:37 | |
*** SkyRocknRoll has quit IRC | 15:39 | |
*** sams-gleb has quit IRC | 15:45 | |
*** sams-gleb has joined #openstack-swift | 15:46 | |
*** admin0 has quit IRC | 15:47 | |
*** admin0 has joined #openstack-swift | 15:47 | |
*** admin0 has quit IRC | 15:48 | |
*** ZZelle has quit IRC | 15:48 | |
*** dmk0202 has quit IRC | 15:51 | |
*** sams-gleb has quit IRC | 15:54 | |
*** lakshmiS has joined #openstack-swift | 15:55 | |
notmyname | good morning, world | 15:56 |
notmyname | wait, crypto is done? | 15:56 |
notmyname | that's the first thing I see in my buffer playback | 15:56 |
*** lyrrad has joined #openstack-swift | 15:57 | |
*** jistr has quit IRC | 16:00 | |
*** raildo-afk is now known as raildo | 16:03 | |
*** fbo has quit IRC | 16:04 | |
*** nadeem has quit IRC | 16:05 | |
*** asettle has quit IRC | 16:05 | |
*** fbo has joined #openstack-swift | 16:06 | |
*** nadeem has joined #openstack-swift | 16:11 | |
jrichli | notmyname :-) | 16:18 |
jrichli | actually, acoles just meant done with all the changes to patches this morning i think. but we are closer every day! | 16:18 |
notmyname | :-) | 16:18 |
notmyname | yeah, I need to check trello before today's meeting | 16:19 |
*** bill_az has quit IRC | 16:20 | |
acoles | notmyname: the todo list on trello may not be any shorter but it is *different* | 16:23 |
notmyname | things are happening | 16:24 |
*** gyee has joined #openstack-swift | 16:25 | |
*** dmorita has joined #openstack-swift | 16:26 | |
*** rledisez has quit IRC | 16:28 | |
*** Jeffrey4l has joined #openstack-swift | 16:28 | |
acoles | keyboards are clicking | 16:28 |
jrichli | * typey typey * | 16:29 |
*** raildo is now known as raildo-afk | 16:30 | |
*** raildo-afk is now known as raildo | 16:30 | |
*** ChubYann has joined #openstack-swift | 16:30 | |
*** lakshmiS has quit IRC | 16:33 | |
*** lakshmiS has joined #openstack-swift | 16:33 | |
*** bill_az has joined #openstack-swift | 16:33 | |
openstackgerrit | Alistair Coles proposed openstack/swift: crypto - remove default root secret (WIP) https://review.openstack.org/318208 | 16:33 |
*** diogogmt has quit IRC | 16:40 | |
*** diogogmt has joined #openstack-swift | 16:41 | |
*** jordanP has quit IRC | 16:43 | |
timburke | good morning | 16:45 |
*** asettle has joined #openstack-swift | 16:47 | |
*** admin0 has joined #openstack-swift | 16:48 | |
*** sams-gleb has joined #openstack-swift | 16:51 | |
*** jmccarthy1 has quit IRC | 16:51 | |
openstackgerrit | Merged openstack/swift: Remove the invalid project link https://review.openstack.org/316455 | 16:54 |
*** McMurlock has joined #openstack-swift | 16:55 | |
*** mittal has joined #openstack-swift | 16:57 | |
*** sams-gleb has quit IRC | 17:00 | |
*** arch-nemesis has joined #openstack-swift | 17:04 | |
mittal | I am having trouble with SELinux context on files in /var/cache/swift directory | 17:06 |
mittal | The object-replicator for example, creates the object.recon with correct context | 17:06 |
mittal | However, if I run swift-object-replicator /etc/swift/object-server.conf -ov | 17:08 |
mittal | that changes the context for object.recon | 17:08 |
mittal | And then I start getting 'Permission Denied' errors on that file | 17:08 |
*** mittal has quit IRC | 17:09 | |
*** vinsh has quit IRC | 17:10 | |
*** vinsh has joined #openstack-swift | 17:10 | |
*** hoonetorg has joined #openstack-swift | 17:11 | |
*** arch-nemesis has quit IRC | 17:14 | |
*** mittal has joined #openstack-swift | 17:14 | |
*** daemontool has quit IRC | 17:15 | |
*** klrmn has joined #openstack-swift | 17:16 | |
mittal | Any idea why object.recon SELinux context is modified when the same script is being run from object-replicator v/s from terminal ? | 17:16 |
*** vinsh_ has joined #openstack-swift | 17:21 | |
*** vinsh has quit IRC | 17:25 | |
*** mittal has quit IRC | 17:26 | |
*** arch-nemesis has joined #openstack-swift | 17:33 | |
*** arch-nemesis has quit IRC | 17:33 | |
*** arch-nemesis has joined #openstack-swift | 17:33 | |
*** acoles is now known as acoles_ | 17:34 | |
*** arch-nemesis has quit IRC | 17:34 | |
*** arch-nemesis has joined #openstack-swift | 17:35 | |
*** arch-nemesis has quit IRC | 17:35 | |
*** arch-nemesis has joined #openstack-swift | 17:36 | |
*** arch-nemesis has quit IRC | 17:36 | |
*** mvk_ has quit IRC | 17:37 | |
*** McMurlock has quit IRC | 17:39 | |
*** mittal has joined #openstack-swift | 17:39 | |
*** Suyi has joined #openstack-swift | 17:40 | |
*** tqtran has joined #openstack-swift | 17:43 | |
clayg | mittal: i've had nothing but bad luck with SELinux and Swift :'( | 17:46 |
clayg | well... i've had nothing but bad luck with SELinux ;) | 17:46 |
*** Jeffrey4l has quit IRC | 17:46 | |
clayg | if there's something swift could do better/different you could file a bug on launchpad? | 17:47 |
clayg | glopen | 17:47 |
*** sams-gleb has joined #openstack-swift | 17:57 | |
*** sams-gleb has quit IRC | 18:04 | |
CaioBrentano | is it normal to reset the percentage on object-replicator log? | 18:17 |
CaioBrentano | from the log: object-replicator: 84067/126187 (66.62%) => object-replicator: 300/126187 (0.24%) | 18:18 |
CaioBrentano | object-replicator: 8190/126187 (6.49%) => object-replicator: 1048/126187 (0.83%) | 18:18 |
CaioBrentano | (these lines are sequentially) | 18:20 |
clayg | maybe there was ring push? or they got restarted? | 18:22 |
clayg | maybe there's just churning over the partitions quickly (would be surprising with 126K parts on the node, even with a high concurrency like ~30)? | 18:23 |
CaioBrentano | a new ring was pushed yesterday. this happens now... 1h ago | 18:23 |
*** amit213 has quit IRC | 18:24 | |
*** asettle has quit IRC | 18:25 | |
clayg | yeah you don't normally expect the progress to reset - it probably mans the replicators are dying or getting restarted for some reason - probably worth investigating | 18:25 |
*** amit213 has joined #openstack-swift | 18:27 | |
CaioBrentano | clayg didn't get what you mean about "churning over the partitions quickly" | 18:28 |
CaioBrentano | I set log level to debug, but it didn't help | 18:30 |
clayg | well the other time the starts "restart" is when it finishes a loop and starts again | 18:30 |
*** mmcardle has quit IRC | 18:31 | |
*** swiftfan_ is now known as swiftfan | 18:32 | |
clayg | well lp bug #1582723 is pretty annoying :'( | 18:33 |
openstack | Launchpad bug 1582723 in OpenStack Object Storage (swift) "EC object may have wrong size in container listing after POST" [Undecided,In progress] https://launchpad.net/bugs/1582723 - Assigned to Alistair Coles (alistair-coles) | 18:33 |
*** mittal has left #openstack-swift | 18:36 | |
*** nadeem has quit IRC | 18:43 | |
*** McMurlock has joined #openstack-swift | 18:54 | |
*** sams-gleb has joined #openstack-swift | 19:01 | |
*** mmcardle has joined #openstack-swift | 19:01 | |
*** sams-gleb has quit IRC | 19:09 | |
*** mmcardle has quit IRC | 19:13 | |
*** bill_az has quit IRC | 19:22 | |
*** silor has quit IRC | 19:25 | |
klamath | are there any drawbacks to using swauth with multi-region swift? | 19:42 |
*** asettle has joined #openstack-swift | 19:51 | |
*** bill_az has joined #openstack-swift | 19:51 | |
openstackgerrit | Richard Hawkins proposed openstack/swift: a well-commented skeleton middleware https://review.openstack.org/281885 | 19:54 |
openstackgerrit | Richard Hawkins proposed openstack/swift: a well-commented skeleton middleware https://review.openstack.org/281885 | 19:55 |
*** dmorita has quit IRC | 20:05 | |
*** sams-gleb has joined #openstack-swift | 20:06 | |
*** joeljwright1 has joined #openstack-swift | 20:12 | |
*** mmcardle has joined #openstack-swift | 20:13 | |
*** ametts has quit IRC | 20:13 | |
*** sams-gleb has quit IRC | 20:14 | |
*** joeljwright has quit IRC | 20:15 | |
*** asettle has quit IRC | 20:15 | |
*** diogogmt has quit IRC | 20:21 | |
*** mmcardle has quit IRC | 20:25 | |
*** dmorita has joined #openstack-swift | 20:26 | |
tdasilva | hi, I won't be around for meeting today, but will try to catch up on the scrollback later today | 20:27 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/python-swiftclient: Updated from global requirements https://review.openstack.org/89250 | 20:27 |
*** McMurlock has quit IRC | 20:28 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 20:28 |
*** ametts has joined #openstack-swift | 20:30 | |
*** dmorita has quit IRC | 20:31 | |
*** diogogmt has joined #openstack-swift | 20:33 | |
notmyname | tdasilva: ok | 20:37 |
notmyname | tdasilva: I was hoping to get an update on the pyeclib and librasurecode migration status | 20:38 |
notmyname | cschwede: similarly, I was hoping for an update on https://etherpad.openstack.org/p/swift-rolling-upgrade-multinode-testing from you | 20:39 |
*** asettle has joined #openstack-swift | 20:43 | |
*** dmorita has joined #openstack-swift | 20:43 | |
*** asettle has quit IRC | 20:44 | |
*** joeljwright1 has quit IRC | 20:46 | |
*** asettle has joined #openstack-swift | 20:46 | |
*** joeljwright has joined #openstack-swift | 20:46 | |
*** ChanServ sets mode: +v joeljwright | 20:46 | |
*** jordanP has joined #openstack-swift | 20:48 | |
*** dmorita has quit IRC | 20:48 | |
*** raildo is now known as raildo-afk | 20:49 | |
*** matt6434 is now known as mattoliverau | 20:55 | |
*** StraubTW has quit IRC | 20:56 | |
*** StraubTW has joined #openstack-swift | 20:56 | |
*** ChanServ sets mode: +v mattoliverau | 20:56 | |
*** hosanai has joined #openstack-swift | 20:56 | |
*** ChanServ sets mode: +v hosanai | 20:56 | |
kota_ | morning | 20:57 |
notmyname | meeting time in #openstack-meeting | 21:00 |
*** acoles_ is now known as acoles | 21:01 | |
*** mathiasb_ is now known as mathiasb | 21:01 | |
*** pauloewerton has quit IRC | 21:03 | |
notmyname | kota_: when you see m_kazuhiro can you ask him to link to his tiering presentation on https://wiki.openstack.org/wiki/Swift/ideas ? | 21:07 |
*** ametts has quit IRC | 21:07 | |
kota_ | notmyname: yup. and he is in meeting channel now :) | 21:07 |
notmyname | thanks | 21:07 |
notmyname | yeah, didn't want to disturb there :-) | 21:07 |
kota_ | notmyname: ok | 21:08 |
notmyname | and I noticed he wasn't in here | 21:08 |
*** sams-gleb has joined #openstack-swift | 21:11 | |
*** nadeem has joined #openstack-swift | 21:13 | |
*** nadeem has quit IRC | 21:13 | |
*** nadeem has joined #openstack-swift | 21:15 | |
*** dmorita has joined #openstack-swift | 21:19 | |
*** sams-gleb has quit IRC | 21:19 | |
*** asettle has quit IRC | 21:21 | |
*** NM has quit IRC | 21:30 | |
*** lakshmiS has quit IRC | 21:34 | |
*** klamath has quit IRC | 21:43 | |
*** jordanP has quit IRC | 21:50 | |
*** klrmn has quit IRC | 22:00 | |
*** hosanai has quit IRC | 22:02 | |
notmyname | gotta rush off to a different meeting. be back in an hour or so | 22:02 |
*** ozialien10 has joined #openstack-swift | 22:03 | |
*** acoles is now known as acoles_ | 22:05 | |
*** klamath has joined #openstack-swift | 22:08 | |
*** joeljwright has quit IRC | 22:10 | |
*** nadeem has quit IRC | 22:15 | |
*** sams-gleb has joined #openstack-swift | 22:16 | |
*** klamath has quit IRC | 22:18 | |
*** StraubTW has quit IRC | 22:24 | |
*** sams-gleb has quit IRC | 22:25 | |
*** admin0 has quit IRC | 22:25 | |
*** StraubTW has joined #openstack-swift | 22:31 | |
*** StraubTW has quit IRC | 22:32 | |
*** mvk_ has joined #openstack-swift | 22:34 | |
*** Suyi has quit IRC | 22:52 | |
*** Suyi has joined #openstack-swift | 22:52 | |
*** Suyi has quit IRC | 22:52 | |
*** Suyi has joined #openstack-swift | 22:52 | |
*** jamielennox is now known as jamielennox|away | 23:04 | |
*** vint_bra has quit IRC | 23:08 | |
*** bill_az has quit IRC | 23:20 | |
*** sams-gleb has joined #openstack-swift | 23:22 | |
*** sams-gleb has quit IRC | 23:29 | |
*** NM has joined #openstack-swift | 23:41 | |
*** jamielennox|away is now known as jamielennox | 23:51 | |
*** lakshmiS has joined #openstack-swift | 23:57 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!