*** newmember has quit IRC | 00:00 | |
Chaos_ | I'm not sure how to do the upload with cURL, from what I understood I had to use the Swift client for the keystone authentication | 00:02 |
---|---|---|
Chaos_ | seems to happen with all sizes though. I've tried 10-21GB files | 00:02 |
timburke | i was thinking particularly small files -- a couple bytes, or even zero bytes :-) | 00:04 |
*** chsc has quit IRC | 00:04 | |
timburke | you can run `swift auth` to get your token and storage url -- from there you should be able to make requests like `curl -H "X-Auth-Token: $OS_AUTH_TOKEN" $OS_STORAGE_URL` | 00:05 |
timburke | create a container with `curl -H "X-Auth-Token: $OS_AUTH_TOKEN" $OS_STORAGE_URL/container-name -X PUT` | 00:05 |
timburke | upload an object with `curl -H "X-Auth-Token: $OS_AUTH_TOKEN" $OS_STORAGE_URL/container-name/object -T /path/to/some/file` | 00:06 |
Chaos_ | Tested a 0B file with that and it worked.. so its just the swift client having issues for some reason? | 00:15 |
Chaos_ | I can't do my larger file with curl so i'd still need the client to work :/ | 00:16 |
mattoliverau | Chaos_: you can, but you need to split it up your self, load it up as segments and then create an SLO manifest. But if your having trouble with 10G+ then sounds like something is timing out while uploading maybe. | 00:18 |
mattoliverau | do you have a firewall or proxy on your end? | 00:18 |
Chaos_ | Not on my end, this server is just running cPanel | 00:19 |
*** abhitechie has joined #openstack-swift | 00:19 | |
timburke | can you try out something in the 1-5GB range? what segment size are you using for the 10-20GB ones? | 00:20 |
timburke | and can we do tiny files with swiftclient? | 00:21 |
timburke | just trying to figure out some rough threshold for what works and what doesn't -- i'm glad *something* works! just gotta narrow down what's making it fail :-) | 00:23 |
*** links has joined #openstack-swift | 00:23 | |
*** dja has quit IRC | 00:28 | |
Chaos_ | Good news! Segmenting the large file with 1GB segments resolved the issue, i'm able to upload as long as I do that | 00:28 |
*** dja has joined #openstack-swift | 00:29 | |
Chaos_ | For whatever reason it shows the uploaded file as being 0B but it might just take a few moments for the manifest to update to show the correct size https://i.imgur.com/SzpRS86.png | 00:29 |
Chaos_ | downloading it appears to have the full 25ish GBs | 00:29 |
timburke | try tacking on a --use-slo flag -- then listings should show the right size | 00:36 |
Chaos_ | Worked perfectly, thank you so much for the hel | 00:44 |
Chaos_ | help* | 00:44 |
Chaos_ | dont know why i didn't think to change the segment size | 00:44 |
timburke | no worries! out of curiosity, what was it when it was failing? | 00:49 |
Chaos_ | The default, I didn't explicitly set it | 00:51 |
timburke | ah... interesting that swift didn't immediately respond with a 413... | 00:51 |
*** tovin07_ has joined #openstack-swift | 00:51 | |
Chaos_ | Interesting for sure | 00:52 |
*** dja has quit IRC | 01:02 | |
*** dja has joined #openstack-swift | 01:03 | |
*** Chaos_ has quit IRC | 01:04 | |
*** klrmn has quit IRC | 01:06 | |
*** dja has quit IRC | 01:08 | |
*** tovin07_ has quit IRC | 01:16 | |
*** peluse has quit IRC | 01:39 | |
*** psachin has joined #openstack-swift | 01:41 | |
*** tovin07_ has joined #openstack-swift | 01:41 | |
openstackgerrit | junbo.li proposed openstack/swift master: Make StringIO py3 compatible https://review.openstack.org/514962 | 01:42 |
*** wes_dillingham has quit IRC | 01:49 | |
*** itlinux has joined #openstack-swift | 01:50 | |
*** gyee has quit IRC | 01:52 | |
*** spectr has quit IRC | 02:03 | |
*** spectr has joined #openstack-swift | 02:04 | |
*** mat128 has joined #openstack-swift | 02:05 | |
*** peluse has joined #openstack-swift | 02:05 | |
*** klrmn has joined #openstack-swift | 02:16 | |
*** Sukhdev has joined #openstack-swift | 02:20 | |
*** itlinux has quit IRC | 02:29 | |
*** two_tired has joined #openstack-swift | 02:30 | |
openstackgerrit | Merged openstack/swift feature/deep: db_file passed to broker should not affect it's sharding state https://review.openstack.org/515150 | 02:41 |
openstackgerrit | Merged openstack/swift feature/deep: simple tool to display shard relationships https://review.openstack.org/514329 | 02:42 |
*** silor has joined #openstack-swift | 02:43 | |
*** itlinux has joined #openstack-swift | 02:45 | |
*** itlinux has quit IRC | 02:48 | |
*** itlinux has joined #openstack-swift | 02:53 | |
*** silor has quit IRC | 03:12 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/python-swiftclient master: Updated from global requirements https://review.openstack.org/89250 | 03:12 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/swift master: Updated from global requirements https://review.openstack.org/88736 | 03:15 |
*** itlinux has quit IRC | 03:22 | |
*** kei_yama has quit IRC | 03:40 | |
*** gkadam has joined #openstack-swift | 03:42 | |
*** abhitechie has quit IRC | 03:46 | |
notmyname | kota_: so what's the news about SHSS? I didn't understand it | 03:58 |
*** kei_yama has joined #openstack-swift | 04:02 | |
*** catintheroof has joined #openstack-swift | 04:19 | |
*** catintheroof has quit IRC | 04:19 | |
*** m_kazuhiro has joined #openstack-swift | 04:21 | |
*** catintheroof has joined #openstack-swift | 04:23 | |
*** abhitechie has joined #openstack-swift | 04:24 | |
*** mat128 has quit IRC | 04:35 | |
*** SkyRocknRoll has joined #openstack-swift | 04:38 | |
*** catintheroof has quit IRC | 04:38 | |
*** catintheroof has joined #openstack-swift | 04:38 | |
*** m_kazuhiro_ has joined #openstack-swift | 04:40 | |
*** catintheroof has quit IRC | 04:43 | |
*** m_kazuhiro has quit IRC | 04:44 | |
*** two_tired has quit IRC | 04:54 | |
*** mabrams has joined #openstack-swift | 05:10 | |
*** ChubYann has quit IRC | 05:27 | |
*** kallenp has joined #openstack-swift | 05:29 | |
*** kallenp has quit IRC | 05:30 | |
*** abhitechie has quit IRC | 05:33 | |
*** abhitechie has joined #openstack-swift | 05:33 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/python-swiftclient master: Updated from global requirements https://review.openstack.org/89250 | 05:45 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/swift master: Updated from global requirements https://review.openstack.org/88736 | 05:48 |
*** geaaru has quit IRC | 06:01 | |
*** kallenp has joined #openstack-swift | 06:03 | |
*** cshastri has joined #openstack-swift | 06:05 | |
*** Sukhdev has quit IRC | 06:19 | |
*** kallenp has joined #openstack-swift | 06:24 | |
* kota_ is back to online | 06:27 | |
*** SkyRocknRoll has quit IRC | 06:28 | |
*** kallenp has joined #openstack-swift | 06:37 | |
mattoliverau | kota_: \o/ welcome! | 06:41 |
*** SkyRocknRoll has joined #openstack-swift | 06:41 | |
*** abhitechie has quit IRC | 06:59 | |
*** abhitechie has joined #openstack-swift | 06:59 | |
*** rcernin has quit IRC | 07:04 | |
kota_ | mattoliverau: hi! | 07:07 |
*** tesseract has joined #openstack-swift | 07:09 | |
kota_ | notmyname: the iso work is by my colleague so I also don't get completely that :/ | 07:11 |
kota_ | notmyname: however, the iso docs (for preview) is https://www.iso.org/obp/ui/#iso:std:iso-iec:19592:-2:ed-1:v1:en | 07:11 |
kota_ | notmyname: and our SHSS has been an instance of the standardized secret sharing library IIUC. | 07:13 |
kota_ | about secret sharing, https://en.wikipedia.org/wiki/Secret_sharing | 07:14 |
*** kallenp has joined #openstack-swift | 07:21 | |
* kota_ starts to look up https://review.openstack.org/#/c/499634/3 but feeling he forgets a tons of things to be changed in the patch. | 07:22 | |
patchbot | patch 499634 - swift - Respect co-builder partition moves when min_part_h... | 07:22 |
*** geaaru has joined #openstack-swift | 07:29 | |
*** m_kazuhiro_ has quit IRC | 07:42 | |
*** kallenp has quit IRC | 07:46 | |
*** zhipeng has joined #openstack-swift | 07:53 | |
*** cbartz has joined #openstack-swift | 07:58 | |
*** oshritf has joined #openstack-swift | 08:05 | |
acoles | good morning | 08:09 |
*** klrmn has quit IRC | 08:12 | |
mattoliverau | acoles: morning | 08:13 |
acoles | mattoliverau: o/ | 08:17 |
*** zhipeng has quit IRC | 08:18 | |
*** d0ugal has quit IRC | 08:32 | |
*** d0ugal_ has joined #openstack-swift | 08:32 | |
*** d0ugal_ has quit IRC | 08:33 | |
*** d0ugal has joined #openstack-swift | 08:33 | |
*** d0ugal has quit IRC | 08:33 | |
*** d0ugal has joined #openstack-swift | 08:33 | |
kota_ | acoles: morning | 08:38 |
mattoliverau | kota_: I just started looking at the same patch.. but think it's simply too late for my brain to work :P (patch 499634) | 08:44 |
mattoliverau | acoles: ^ is that the same one your were talking about in Denver? Cause from an initial look, it looks familar :) | 08:45 |
kota_ | mattoliverau: hehe, I got back my head to the patch already, I think that looks almost good to me but just thinking of simplification... | 08:45 |
mattoliverau | kota_: well I'll let you take a first stab, and then I'll try and get my head around it in the morning if it's still around :) | 08:46 |
* mattoliverau has decided he's too tired to look at anymore code, so is going to go be a good husband and spend time with the wife :) | 08:46 | |
acoles | mattoliverau: yep, bug in composite ring rebalance | 08:50 |
acoles | mattoliverau: have a good evening | 08:50 |
kota_ | acoles, mattoliverau: done on patch 499634 | 09:05 |
patchbot | https://review.openstack.org/#/c/499634/ - swift - Respect co-builder partition moves when min_part_h... | 09:05 |
kota_ | JUST LGTM :) | 09:06 |
kota_ | (after deep thinking but no better idea than current code, awesome!) | 09:07 |
acoles | kota_: thank you! I appreciate your time reviewing that | 09:07 |
kota_ | acoles: you're welocome, and sorry it's been delayed. | 09:09 |
*** HCLTech-SSW has joined #openstack-swift | 09:12 | |
openstackgerrit | Kazuhiro MIYAHARA proposed openstack/swift master: Symlink implementation. https://review.openstack.org/232162 | 09:15 |
*** kallenp has joined #openstack-swift | 09:17 | |
kota_ | m_kazuhiro: Is symlink patch ready to review? | 09:20 |
kota_ | m_kazuhiro: Or are you still doing to fix/change something? | 09:22 |
*** m_kazuhiro has joined #openstack-swift | 09:24 | |
m_kazuhiro | kota_: Symlink patch is ready to review now! Please review it. | 09:29 |
openstackgerrit | HCLTech-SSW proposed openstack/swift master: Added the man page for container-reconciler.conf https://review.openstack.org/515018 | 09:32 |
kota_ | m_kazuhiro: quick question | 09:34 |
kota_ | m_kazuhiro: perhaps, does the change include almost of my follow-up at https://review.openstack.org/#/c/509149 ? not sure if all things are adrressed or not. | 09:35 |
patchbot | patch 509149 - swift - Follow up for symlink implementaion | 09:35 |
m_kazuhiro | kota_: Yes. Your follow-up is included. | 09:36 |
*** kallenp has quit IRC | 09:36 | |
kota_ | m_kazuhiro: all things? can i abondon it? | 09:36 |
m_kazuhiro | kota_: Yes, all things. You can abondon it. | 09:37 |
kota_ | m_kazuhiro: thx | 09:37 |
openstackgerrit | Kota Tsuyuzaki proposed openstack/swift master: Fix a small typo https://review.openstack.org/515335 | 09:43 |
*** kallenp has joined #openstack-swift | 09:44 | |
*** m_kazuhiro has quit IRC | 09:52 | |
*** hseipp has joined #openstack-swift | 09:55 | |
*** tovin07_ has quit IRC | 10:04 | |
*** kei_yama has quit IRC | 10:13 | |
*** kallenp1 has joined #openstack-swift | 10:13 | |
*** kallenp has quit IRC | 10:17 | |
*** abhitechie has quit IRC | 10:18 | |
*** abhitechie has joined #openstack-swift | 10:26 | |
*** kallenp has joined #openstack-swift | 10:28 | |
*** kallenp has left #openstack-swift | 10:30 | |
*** kallenp1 has quit IRC | 10:30 | |
openstackgerrit | Merged openstack/swift master: Fix a small typo https://review.openstack.org/515335 | 10:55 |
*** HCLTech-SSW has quit IRC | 11:00 | |
kota_ | thx acoles :) | 11:06 |
*** abhinavtechie has joined #openstack-swift | 11:07 | |
*** abhinavtechie has quit IRC | 11:08 | |
*** abhitechie has quit IRC | 11:08 | |
*** abhitechie has joined #openstack-swift | 11:09 | |
*** oshritf has quit IRC | 11:11 | |
*** oshritf has joined #openstack-swift | 11:12 | |
*** bkopilov_ has quit IRC | 11:28 | |
*** links has quit IRC | 11:36 | |
*** portante has quit IRC | 11:38 | |
*** ndk_ has quit IRC | 11:38 | |
*** oshritf has quit IRC | 11:40 | |
*** NM has joined #openstack-swift | 11:40 | |
*** ndk_ has joined #openstack-swift | 11:44 | |
*** portante has joined #openstack-swift | 11:44 | |
*** oshritf has joined #openstack-swift | 11:46 | |
*** oshritf has quit IRC | 11:49 | |
*** oshritf has joined #openstack-swift | 11:51 | |
*** wes_dillingham has joined #openstack-swift | 12:11 | |
*** ukaynar has joined #openstack-swift | 12:26 | |
kota_ | m_kazuhiro: it looks like you squashed up my buggy code as it is. please let me take a time to resolve it for a while. I have to leave my office today. | 12:49 |
*** mvk has quit IRC | 12:52 | |
*** oshritf has quit IRC | 13:02 | |
*** oshritf has joined #openstack-swift | 13:08 | |
*** abhitechie has quit IRC | 13:12 | |
*** oshritf has quit IRC | 13:17 | |
*** oshritf has joined #openstack-swift | 13:21 | |
*** mat128 has joined #openstack-swift | 13:24 | |
*** gkadam_ has joined #openstack-swift | 13:26 | |
*** gkadam has quit IRC | 13:27 | |
*** SkyRocknRoll has quit IRC | 13:32 | |
*** mvk has joined #openstack-swift | 13:32 | |
*** oshritf has quit IRC | 13:35 | |
*** gkadam_ has quit IRC | 13:37 | |
*** mjturek has joined #openstack-swift | 13:38 | |
*** oshritf has joined #openstack-swift | 13:40 | |
*** catintheroof has joined #openstack-swift | 13:45 | |
*** catintheroof has quit IRC | 13:46 | |
*** catintheroof has joined #openstack-swift | 13:46 | |
*** dosaboy has quit IRC | 13:48 | |
*** catinthe_ has joined #openstack-swift | 13:52 | |
*** catintheroof has quit IRC | 13:55 | |
*** dosaboy has joined #openstack-swift | 14:00 | |
*** rcernin has joined #openstack-swift | 14:08 | |
*** catinthe_ has quit IRC | 14:17 | |
*** catintheroof has joined #openstack-swift | 14:17 | |
*** newmember has joined #openstack-swift | 14:25 | |
*** ukaynar has quit IRC | 14:36 | |
*** cshastri has quit IRC | 14:45 | |
*** ianychoi_ has joined #openstack-swift | 14:45 | |
*** ianychoi has quit IRC | 14:48 | |
*** oshritf has quit IRC | 14:56 | |
*** oshritf has joined #openstack-swift | 14:57 | |
*** spectr has quit IRC | 15:02 | |
*** gkadam_ has joined #openstack-swift | 15:02 | |
*** rcernin has quit IRC | 15:04 | |
*** klrmn has joined #openstack-swift | 15:07 | |
*** newmember has quit IRC | 15:19 | |
*** newmember has joined #openstack-swift | 15:19 | |
*** catintheroof has quit IRC | 15:20 | |
*** catintheroof has joined #openstack-swift | 15:20 | |
*** catintheroof has quit IRC | 15:25 | |
*** vint_bra has joined #openstack-swift | 15:36 | |
*** mabrams has quit IRC | 15:38 | |
*** mvk has quit IRC | 15:39 | |
*** itlinux has joined #openstack-swift | 15:39 | |
*** spetersen has joined #openstack-swift | 15:43 | |
*** gyee has joined #openstack-swift | 15:43 | |
spetersen | I am stuck in a 100% disk full situation, I have added more drives to the three nodes but the drives are not emptying. | 15:44 |
spetersen | Is this a setting I should entertain? handoffs_first = False | 15:44 |
spetersen | Is this a setting I should entertain? handoffs_first = True | 15:44 |
spetersen | We increased the concurrency for the object-replicator and the max number of rsync connections for object server | 15:46 |
*** catintheroof has joined #openstack-swift | 15:51 | |
*** catintheroof has quit IRC | 15:55 | |
*** geaaru has quit IRC | 15:55 | |
*** catintheroof has joined #openstack-swift | 16:01 | |
*** HCLTech-SSW has joined #openstack-swift | 16:08 | |
*** psachin has quit IRC | 16:17 | |
notmyname | good morning | 16:20 |
*** cbartz has quit IRC | 16:21 | |
*** hseipp has quit IRC | 16:22 | |
*** cbartz has joined #openstack-swift | 16:25 | |
*** silor has joined #openstack-swift | 16:26 | |
*** silor has quit IRC | 16:35 | |
*** cbartz has quit IRC | 16:36 | |
timburke | good morning | 16:42 |
*** HCLTech-SSW has quit IRC | 16:51 | |
*** mvk has joined #openstack-swift | 16:54 | |
*** chsc has joined #openstack-swift | 16:57 | |
*** chsc has joined #openstack-swift | 16:57 | |
*** saint_ has joined #openstack-swift | 17:02 | |
*** oshritf has quit IRC | 17:20 | |
*** newmember has quit IRC | 17:33 | |
*** gkadam_ has quit IRC | 17:40 | |
*** tesseract has quit IRC | 17:45 | |
*** newmember has joined #openstack-swift | 17:50 | |
*** catintheroof has quit IRC | 18:13 | |
*** Sukhdev has joined #openstack-swift | 18:25 | |
*** Sukhdev has quit IRC | 18:33 | |
*** saint_ has quit IRC | 18:35 | |
*** SkyRocknRoll has joined #openstack-swift | 18:35 | |
*** SkyRocknRoll has quit IRC | 18:41 | |
*** catintheroof has joined #openstack-swift | 18:51 | |
*** SkyRocknRoll has joined #openstack-swift | 18:55 | |
*** catintheroof has quit IRC | 18:56 | |
*** catintheroof has joined #openstack-swift | 19:05 | |
*** catintheroof has quit IRC | 19:09 | |
*** wes_dillingham has quit IRC | 19:19 | |
*** ChubYann has joined #openstack-swift | 19:23 | |
*** ChubYann has left #openstack-swift | 19:23 | |
*** catintheroof has joined #openstack-swift | 19:28 | |
*** SkyRocknRoll has quit IRC | 19:34 | |
*** spetersen_ has joined #openstack-swift | 19:39 | |
*** spetersen_ has quit IRC | 19:39 | |
*** newmember has quit IRC | 20:28 | |
*** NM has quit IRC | 20:40 | |
*** catintheroof has quit IRC | 20:49 | |
*** mat128 has quit IRC | 21:03 | |
*** spetersen has quit IRC | 21:44 | |
*** wes_dillingham has joined #openstack-swift | 22:11 | |
*** itlinux has quit IRC | 22:39 | |
*** thurloat has quit IRC | 22:46 | |
*** mjturek has quit IRC | 22:52 | |
*** vint_bra has quit IRC | 23:03 | |
*** kei_yama has joined #openstack-swift | 23:33 | |
*** abhitechie has joined #openstack-swift | 23:34 | |
*** chsc has quit IRC | 23:35 | |
*** links has joined #openstack-swift | 23:46 | |
*** gkadam_ has joined #openstack-swift | 23:56 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!