notmyname | mattoliverau: welcome back! hope everything is good | 00:06 |
---|---|---|
mattoliverau | notmyname: yeah, the hospital visit was great, heard the baby's heart, midwifes we're awesome. Better then the local hospital.. but a little far away. If everything goes well wont need to do another drive up there until week 30 something.. so not for quite a while :) | 00:08 |
notmyname | glad to hear it | 00:08 |
notmyname | whenever you get a chance, read over the meeting notes from yesterday | 00:09 |
mattoliverau | now need to go through a bunch of emails and missed meeting minutes etc ;) | 00:09 |
mattoliverau | will do. | 00:09 |
openstackgerrit | Samuel Merritt proposed openstack/swift master: Don't dump recon stats when replicating only certain policies https://review.openstack.org/559198 | 00:13 |
*** d0ugal has quit IRC | 00:13 | |
*** d0ugal has joined #openstack-swift | 00:17 | |
openstackgerrit | Tim Burke proposed openstack/swift feature/deep: Merge branch 'master' into feature/deep https://review.openstack.org/559175 | 00:33 |
openstackgerrit | Samuel Merritt proposed openstack/swift master: Refactor replicator command-line-argument handling https://review.openstack.org/559202 | 00:42 |
*** tovin07_ has joined #openstack-swift | 00:45 | |
openstackgerrit | Clay Gerrard proposed openstack/swift feature/deep: Fix intermittent failing probetest https://review.openstack.org/559207 | 01:01 |
clayg | did I break gerrit? | 01:03 |
*** mikecmpbll has quit IRC | 01:11 | |
kota_ | good morning | 01:19 |
kota_ | clayg: which one is broken? | 01:20 |
mattoliverau | kota_: morning | 01:25 |
mattoliverau | clayg: I wouldn't put it past you :P | 01:25 |
*** cshastri has joined #openstack-swift | 01:25 | |
kota_ | mattoliverau: o/ | 01:25 |
clayg | no it's good - it started working | 01:25 |
clayg | it was probably my internet or computer or something - who knows | 01:25 |
kota_ | good to hear | 01:36 |
openstackgerrit | Kota Tsuyuzaki proposed openstack/swift feature/s3api: Change sysmeta name from swift3 to s3api https://review.openstack.org/557623 | 01:41 |
*** germs has quit IRC | 02:23 | |
*** germs has joined #openstack-swift | 02:24 | |
openstackgerrit | Merged openstack/swift feature/deep: Move misplaced objects when cleaving https://review.openstack.org/557547 | 02:44 |
*** psachin` has joined #openstack-swift | 02:49 | |
openstackgerrit | Merged openstack/swift feature/deep: Merge branch 'master' into feature/deep https://review.openstack.org/559175 | 03:35 |
*** armaan has quit IRC | 03:45 | |
*** armaan has joined #openstack-swift | 03:46 | |
*** links has joined #openstack-swift | 03:48 | |
*** kei_yama has quit IRC | 03:57 | |
*** SkyRocknRoll has joined #openstack-swift | 04:00 | |
*** kei_yama has joined #openstack-swift | 04:02 | |
*** rcernin has quit IRC | 04:04 | |
*** germs has quit IRC | 04:07 | |
*** rcernin has joined #openstack-swift | 04:19 | |
*** armaan has quit IRC | 04:43 | |
*** armaan has joined #openstack-swift | 04:52 | |
*** geaaru has quit IRC | 05:16 | |
*** gkadam_ has joined #openstack-swift | 05:48 | |
*** jistr has quit IRC | 06:30 | |
*** cbartz has joined #openstack-swift | 06:30 | |
*** jistr has joined #openstack-swift | 06:32 | |
*** gkadam_ has quit IRC | 06:42 | |
*** gkadam has joined #openstack-swift | 06:42 | |
*** ccamacho has quit IRC | 06:43 | |
*** hseipp has joined #openstack-swift | 06:46 | |
*** pcaruana has joined #openstack-swift | 06:47 | |
*** ccamacho has joined #openstack-swift | 06:53 | |
*** silor has joined #openstack-swift | 07:11 | |
*** SkyRocknRoll has quit IRC | 07:13 | |
*** tesseract has joined #openstack-swift | 07:20 | |
*** SkyRocknRoll has joined #openstack-swift | 07:26 | |
openstackgerrit | Nguyen Hai proposed openstack/python-swiftclient master: Remove py34 from envlist in tox.ini https://review.openstack.org/553429 | 07:27 |
*** armaan has quit IRC | 07:33 | |
*** armaan has joined #openstack-swift | 07:33 | |
*** threestrands has quit IRC | 07:36 | |
*** rcernin has quit IRC | 07:37 | |
*** geaaru has joined #openstack-swift | 07:49 | |
openstackgerrit | Merged openstack/swift master: Respect X-Backend-Etag-Is-At headers from left of SLO https://review.openstack.org/556683 | 07:55 |
*** armaan has quit IRC | 08:08 | |
*** armaan has joined #openstack-swift | 08:08 | |
acoles | good morning | 08:10 |
* acoles hugs clayg for https://review.openstack.org/559207 | 08:33 | |
patchbot | patch 559207 - swift (feature/deep) - Fix intermittent failing probetest | 08:33 |
*** armaan has quit IRC | 08:49 | |
*** armaan has joined #openstack-swift | 08:50 | |
*** gkadam has quit IRC | 08:52 | |
*** gkadam has joined #openstack-swift | 08:53 | |
*** mikecmpbll has joined #openstack-swift | 09:06 | |
openstackgerrit | Merged openstack/swift master: Support unicode characters in tempauth user names. https://review.openstack.org/558974 | 09:38 |
*** StevenK has quit IRC | 09:39 | |
*** StevenK has joined #openstack-swift | 09:42 | |
*** armaan has quit IRC | 09:42 | |
*** armaan has joined #openstack-swift | 09:43 | |
*** silor1 has joined #openstack-swift | 09:54 | |
*** silor has quit IRC | 09:55 | |
*** silor1 is now known as silor | 09:55 | |
*** kei_yama has quit IRC | 10:04 | |
*** armaan has quit IRC | 10:23 | |
*** armaan has joined #openstack-swift | 10:24 | |
*** cshastri has quit IRC | 10:27 | |
*** jistr has quit IRC | 10:27 | |
*** armaan has quit IRC | 10:28 | |
*** armaan has joined #openstack-swift | 10:28 | |
*** tovin07_ has quit IRC | 10:32 | |
*** jistr has joined #openstack-swift | 10:36 | |
*** tesseract has quit IRC | 10:37 | |
*** tesseract has joined #openstack-swift | 10:38 | |
*** gkadam has quit IRC | 10:47 | |
*** tesseract-RH has joined #openstack-swift | 10:59 | |
*** tesseract has quit IRC | 10:59 | |
*** cshastri has joined #openstack-swift | 11:13 | |
*** silor has quit IRC | 11:21 | |
*** armaan has quit IRC | 11:54 | |
*** jistr is now known as jistr|mtg | 12:02 | |
*** armaan has joined #openstack-swift | 12:05 | |
*** cshastri has quit IRC | 12:26 | |
*** jistr|mtg is now known as jistr | 12:31 | |
*** NM has joined #openstack-swift | 12:38 | |
*** armaan has quit IRC | 12:39 | |
*** armaan has joined #openstack-swift | 12:39 | |
*** armaan_ has joined #openstack-swift | 12:42 | |
*** armaan_ has quit IRC | 12:44 | |
*** armaan_ has joined #openstack-swift | 12:45 | |
*** armaan has quit IRC | 12:45 | |
acoles | clayg: thanks for updating trello! I have been moving completed cards to the *top* of the completed column by dragging, so its easier to see recent activity. | 12:50 |
openstackgerrit | Alistair Coles proposed openstack/swift feature/deep: Shard range updates should not revive deleted container https://review.openstack.org/559324 | 13:00 |
acoles | timburke: should stop deleted sharded containers coming back from the dead ^^ | 13:00 |
*** frickler has joined #openstack-swift | 13:15 | |
*** armaan_ has quit IRC | 13:20 | |
*** psachin` has quit IRC | 13:28 | |
*** links has quit IRC | 13:28 | |
*** gkadam has joined #openstack-swift | 13:30 | |
openstackgerrit | Alistair Coles proposed openstack/swift feature/deep: Shard range updates should not revive deleted container https://review.openstack.org/559324 | 13:48 |
openstackgerrit | Alistair Coles proposed openstack/swift feature/deep: Remove support for ShardRange PUT via headers https://review.openstack.org/559336 | 13:48 |
ccamacho | Hey guys!! | 13:59 |
ccamacho | Yesterday I was getting some information to push some big files to swift using service.py | 14:00 |
ccamacho | I managed to do it, but now Ill need to be able to download those files.. | 14:00 |
ccamacho | this is the result of my last test | 14:00 |
ccamacho | https://paste.fedoraproject.org/paste/V0JsXVqkYuj~XQb0HaN3MA | 14:00 |
ccamacho | can anyone if having some cycles tell me how to download the big file uploaded (6GB) instead of the manifest with all the segments? | 14:01 |
ccamacho | in the paste there is a better description | 14:01 |
*** ukaynar has joined #openstack-swift | 14:02 | |
DHE | if you're downloading the manifest instead of the big file, it means you didn't upload the manifest correctly | 14:02 |
DHE | oh, never mind you're not downloading the file "normally"... | 14:04 |
ccamacho | DHE aa ok the usual way for me is using `openstack container save undercloud-backupsasdf` | 14:05 |
ccamacho | you can't add the file name | 14:06 |
ccamacho | maybe there is another CLI option to get it correctly? | 14:06 |
DHE | I'm using the direct swift API, where I access http://proxyip:8080/v1/ACCOUNTNAME/CONTAINERNAME/OBJECTNAME and the manifest will be processing swift-side and produce the 6 GB file for me... | 14:10 |
*** germs has joined #openstack-swift | 14:10 | |
*** germs has quit IRC | 14:11 | |
*** germs has joined #openstack-swift | 14:11 | |
ccamacho | i.e. from docs (https://docs.openstack.org/swift/latest/overview_large_objects.html) | 14:11 |
ccamacho | So now, the following swift command would download the entire large object: swift download test_container large_file | 14:11 |
ccamacho | But, | 14:11 |
ccamacho | (undercloud) [stack@undercloud kk]$ swift download undercloud-backupsasdf asdf.tar.gz | 14:11 |
ccamacho | asdf.tar.gz [auth 3.399s, headers 3.787s, total 3.788s, 0.003 MB/s] | 14:11 |
ccamacho | (undercloud) [stack@undercloud kk]$ ls -ltah | 14:11 |
ccamacho | total 8.0K | 14:11 |
ccamacho | drwx------. 2 stack stack 25 Apr 6 14:09 . | 14:11 |
ccamacho | -rw-rw-r--. 1 stack stack 1019 Apr 6 13:47 asdf.tar.gz | 14:11 |
ccamacho | drwx------. 14 stack stack 4.0K Apr 6 12:47 .. | 14:11 |
ccamacho | DHE^ so there is no CLI option to get it? | 14:11 |
ccamacho | I have upstream master deployed for testing | 14:12 |
DHE | sorry I don't use those programs myself enough to tell you. it was my fault for not reading the paste completely before I replied | 14:12 |
ccamacho | hey DHE no worries :) | 14:15 |
*** germs has quit IRC | 14:15 | |
*** armaan has joined #openstack-swift | 14:26 | |
*** armaan has quit IRC | 14:30 | |
*** armaan has joined #openstack-swift | 14:49 | |
*** gkadam_ has joined #openstack-swift | 14:51 | |
*** gkadam has quit IRC | 14:53 | |
*** SkyRocknRoll has quit IRC | 14:55 | |
*** SkyRocknRoll has joined #openstack-swift | 15:09 | |
tdasilva | qq for ops, how do you usually health check background services? i.e., auditor, replication, updater, etc... | 15:09 |
*** gkadam_ has quit IRC | 15:10 | |
tdasilva | mlanner, rledisez_, onovy ^^^ | 15:10 |
*** armaan has quit IRC | 15:11 | |
*** armaan has joined #openstack-swift | 15:11 | |
*** armaan has quit IRC | 15:18 | |
*** armaan has joined #openstack-swift | 15:33 | |
*** openstackgerrit has quit IRC | 15:33 | |
*** cbartz has quit IRC | 15:36 | |
notmyname | good morning | 15:38 |
rledisez_ | tdasilva: tough question ;) we mainly rely on stats (number of unlined async_pending, number of removed partitions, …) and logs (we push stacks to a log plateform and watch the "top stacks"). For now, this "log" thing is only a POC on few servers but want to deploy it massively for every swift processes | 15:42 |
*** pcaruana has quit IRC | 15:49 | |
*** armaan has quit IRC | 15:53 | |
*** mikecmpbll has quit IRC | 16:04 | |
*** germs has joined #openstack-swift | 16:11 | |
*** germs has quit IRC | 16:11 | |
*** germs has joined #openstack-swift | 16:11 | |
*** germs has quit IRC | 16:16 | |
*** hseipp has quit IRC | 16:24 | |
*** germs has joined #openstack-swift | 16:30 | |
*** germs has quit IRC | 16:30 | |
*** germs has joined #openstack-swift | 16:30 | |
*** germs has quit IRC | 16:30 | |
*** germs has joined #openstack-swift | 16:31 | |
*** germs has quit IRC | 16:31 | |
*** germs has joined #openstack-swift | 16:31 | |
*** armaan has joined #openstack-swift | 16:44 | |
timburke | ccamacho: what headers do you get on download? might be able to tack on a `--debug` to see; i'm not as familiar with the openstack cli behavior | 16:57 |
*** links has joined #openstack-swift | 16:57 | |
timburke | and as a sanity check, what's your proxy-server pipeline look like? | 16:57 |
ccamacho | hey timburke thanks for the reply, the issue is fixed now, it was because uploading big files in the undercloud is disabled by default (enabled now in the proxy-server pipeline) | 16:58 |
timburke | ah, good. glad you figured it out :-) | 16:58 |
ccamacho | now to be fixed here https://review.openstack.org/#/q/topic:bug/1761412 | 16:58 |
ccamacho | timburke but thanks for asking! | 16:59 |
ccamacho | :) | 16:59 |
timburke | i keep meaning to have service.py go grab /info to check the server capabilities so it can do smarter things... but i also don't really want to incur an extra request every time you try to do something on the cli... really makes me wish we had somewhere to cache the results or something | 17:04 |
timburke | ("smarter things" in this case being "raise an exception explaining that SLO isn't available") | 17:05 |
*** openstackgerrit has joined #openstack-swift | 17:05 | |
openstackgerrit | Alistair Coles proposed openstack/swift feature/deep: Prevent pending file flushing to retiring db https://review.openstack.org/558625 | 17:05 |
openstackgerrit | Alistair Coles proposed openstack/swift feature/deep: Only redirect updates originating from the updater https://review.openstack.org/558626 | 17:05 |
*** links has quit IRC | 17:06 | |
*** links has joined #openstack-swift | 17:08 | |
*** SkyRocknRoll has quit IRC | 17:19 | |
openstackgerrit | Alistair Coles proposed openstack/swift feature/deep: Remove support for ShardRange PUT via headers https://review.openstack.org/559336 | 17:20 |
openstackgerrit | Alistair Coles proposed openstack/swift feature/deep: Shard range updates should not revive deleted container https://review.openstack.org/559324 | 17:20 |
*** armaan has quit IRC | 17:20 | |
openstackgerrit | Alistair Coles proposed openstack/swift feature/deep: Remove EXPANDING state https://review.openstack.org/558232 | 17:28 |
*** tesseract-RH has quit IRC | 17:35 | |
*** SkyRocknRoll has joined #openstack-swift | 17:36 | |
*** geaaru has quit IRC | 17:51 | |
openstackgerrit | Alistair Coles proposed openstack/swift feature/deep: Remove unnecessary conditional case in get_shard_usage() https://review.openstack.org/559391 | 17:58 |
*** armaan has joined #openstack-swift | 18:02 | |
*** armaan has quit IRC | 18:11 | |
*** silor has joined #openstack-swift | 18:17 | |
*** SkyRocknRoll has quit IRC | 18:29 | |
tdasilva | rledisez_: thanks! btw: the reason for the question is that we are containerizing swift services and IIUC, docker containers has a healthcheck instruction that we are trying to make use of... | 18:33 |
openstackgerrit | Samuel Merritt proposed openstack/swift master: Make multiprocess replicator's logs more readable https://review.openstack.org/556665 | 18:44 |
*** ukaynar has quit IRC | 18:45 | |
*** NM has quit IRC | 19:17 | |
*** NM has joined #openstack-swift | 19:32 | |
*** geaaru has joined #openstack-swift | 19:38 | |
openstackgerrit | Samuel Merritt proposed openstack/swift master: Don't dump recon stats when replicating only certain policies https://review.openstack.org/559198 | 19:39 |
*** ukaynar has joined #openstack-swift | 19:41 | |
openstackgerrit | Samuel Merritt proposed openstack/swift master: Refactor replicator command-line-argument handling https://review.openstack.org/559202 | 19:47 |
onovy | tdasilva: i'm crawling recon by own script and creating graph of all metrics | 19:49 |
onovy | tdasilva: and have limits on some of them, for example replicator time | 19:50 |
*** ukaynar has quit IRC | 19:54 | |
*** ukaynar has joined #openstack-swift | 20:01 | |
tdasilva | onovy: thanks | 20:12 |
onovy | np | 20:12 |
notmyname | tdasilva: answering for mlanner, we check via combination of recon stats and collectd metrics | 20:14 |
tdasilva | notmyname: thanks...i'm wondering if for this purpose, swift-orphans might work better | 20:19 |
openstackgerrit | Samuel Merritt proposed openstack/swift master: Make multiprocess reconstructor's logs more readable. https://review.openstack.org/557995 | 20:19 |
tdasilva | since the point of docker healthcheck is to make sure the process is running as expected...idk... | 20:19 |
notmyname | yeah, definitately | 20:19 |
notmyname | we've got our own agent that checks to see if a process exists. IIRC we use the presence of logs, metrics, etc for determining if it's healthy | 20:20 |
tdasilva | it's really at the process level check, as swift-recon is really looking at all (replicator) processes across the cluster... | 20:20 |
torgomatic | tdasilva: my company also has a WSGI healthcheck that runs a GET request through the account/container/object server. You've got to be careful with your 404 handling because of race conditions, but it's a pretty decent healthcheck | 20:20 |
tdasilva | torgomatic: yeah, planning to use that for those services... | 20:21 |
tdasilva | it's just that the background services don't have that | 20:21 |
torgomatic | true that | 20:21 |
*** paramite has joined #openstack-swift | 20:22 | |
tdasilva | thanks guys!! | 20:22 |
tdasilva | have a great weekend | 20:22 |
torgomatic | you too | 20:23 |
*** links has quit IRC | 20:28 | |
*** silor has quit IRC | 20:44 | |
*** paramite has quit IRC | 21:01 | |
*** zaitcev has quit IRC | 21:01 | |
*** itlinux has joined #openstack-swift | 21:03 | |
*** itlinux has quit IRC | 21:18 | |
*** ukaynar has quit IRC | 21:41 | |
openstackgerrit | Merged openstack/swift feature/deep: Fix intermittent failing probetest https://review.openstack.org/559207 | 22:29 |
openstackgerrit | Merged openstack/swift feature/deep: Remove support for ShardRange PUT via headers https://review.openstack.org/559336 | 22:32 |
openstackgerrit | Merged openstack/swift feature/deep: Remove unnecessary conditional case in get_shard_usage() https://review.openstack.org/559391 | 22:32 |
*** mikecmpbll has joined #openstack-swift | 23:13 | |
*** NM has quit IRC | 23:18 | |
*** mikecmpbll has quit IRC | 23:22 | |
*** itlinux has joined #openstack-swift | 23:39 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!