mattoliverau | clayg: os was it the de-json-ifying and if you make the ring use utf8 will json then behave and give you utf-8.. though maybe I'm yet to understand the problem | 00:00 |
---|---|---|
*** Jeffrey4l_ has joined #openstack-swift | 00:00 | |
clayg | mattoliverau: no, json always returns unicode | 00:01 |
briancline | oh, catching up. sorry, tmux on mobile is difficult :P | 00:02 |
clayg | i'm just trying to decide which standardization is going to give us the least amount of grief | 00:04 |
*** adu has joined #openstack-swift | 00:04 | |
clayg | i guess unicode everywhere - but then we may as well fix swob that seemed to think keeping the path utf-8 was a good idea? | 00:05 |
*** CaioBrentano has joined #openstack-swift | 00:09 | |
briancline | yeah, my problem was that it converted it way up in the stack, wasn't clear at all why that was preferable | 00:10 |
briancline | well, one of several problems | 00:10 |
briancline | there seemed to be tons of needless converting | 00:11 |
briancline | so you cant get gettext_ to give you back a unicode type? | 00:12 |
*** CaioBrentano has quit IRC | 00:14 | |
*** nadeem has quit IRC | 00:19 | |
clayg | briancline: no, i'm sure now that it never does - not in py2 anyway | 00:25 |
clayg | briancline: it acctually makes the traceback make more sense | 00:26 |
briancline | hmm. i had it printing the repr of my gettext_ call... so now im curious wth is happening | 00:27 |
clayg | the rhs isn't ever unicode - but it's have unicode patterens (from the ring devices) interpolated into it - which coerces the type of the utf-8 str to unicode, then we we try to interpolate the additional_info argument (which is utf-8 after translation and after interpolating the utf-8 path into it) - THEN it blows up | 00:27 |
kota_ | hello | 00:28 |
* kota_ is attending OpenStack Days Tokyo 2016 | 00:29 | |
*** _JZ_ has joined #openstack-swift | 00:31 | |
*** klamath has quit IRC | 00:32 | |
briancline | wait, now i'm really confused... so you're reproducing this with just unicode ring dev names and not from the unquoted req path? | 00:32 |
clayg | briancline: yeah you just need a downed node, non-ascii chars in your put object name, and a real ring | 00:36 |
clayg | existing unittests started blowing up as soon as I fixed our Fake to return data that looked more like the real. | 00:37 |
briancline | intriguing | 00:39 |
clayg | briancline: i guess, timburke and I shared some choice words about unicode - I don't think "interesting" was the mostly commonly used adjective | 00:41 |
openstackgerrit | Kota Tsuyuzaki proposed openstack/swift: Enable object server to return non-durable data https://review.openstack.org/215276 | 00:41 |
timburke | clayg: it's not so much that json always returns unicode; json *is* unicode! the spec defines it as a series of unicode codepoints | 00:42 |
openstackgerrit | Tim Burke proposed openstack/swift: Fix gettext_ calls https://review.openstack.org/336743 | 00:42 |
briancline | clayg: yeah. i have definitely been censoring myself | 00:43 |
*** diogogmt has quit IRC | 00:45 | |
clayg | timburke: it always confused me... it's supposed to be a data interchange format - but it seems like you have to encode an object to json, and then encode the json for the wire? | 00:49 |
timburke | i didn't say it made sense... | 00:49 |
clayg | maybe the assumption is that the json format SHOULD not have non-ascii characters in it (it has the \u format) - but most parsers have learned to expect utf-8 in those little blobs -> json.loads('"w\xc8\x81t"') | 00:50 |
*** m_kazuhiro has joined #openstack-swift | 00:50 | |
timburke | although you can definitely specify something different, like json.loads('"w\xc8\x81t"', encoding='latin1') | 00:56 |
*** Suyash has quit IRC | 00:58 | |
*** mint has joined #openstack-swift | 01:08 | |
*** mint has quit IRC | 01:08 | |
*** Suyash has joined #openstack-swift | 01:21 | |
*** tqtran has quit IRC | 01:22 | |
*** smile-luobin has joined #openstack-swift | 01:29 | |
*** NM has joined #openstack-swift | 01:32 | |
*** siva_krish has joined #openstack-swift | 01:34 | |
*** diogogmt has joined #openstack-swift | 01:37 | |
*** siva_krish has quit IRC | 01:39 | |
*** chlong has quit IRC | 01:40 | |
*** AndyWojo has joined #openstack-swift | 01:41 | |
*** siva_krish has joined #openstack-swift | 01:41 | |
AndyWojo | Hi anyone have a second? | 01:41 |
AndyWojo | I'm building my rings, (swift-ring-builder object.builder add --region 1 --zone 1 --ip 192.168.241.117 --port 6000 --device dm-6 --weight 100), is dm-6 correct here? or /dev/dm-6 | 01:42 |
kota_ | AndyWojo: not correct | 01:44 |
AndyWojo | Or both? | 01:45 |
AndyWojo | My FS is mounted: /srv/node/36005076300820ac270000000000000de, it's backed via /dev/mapper/36005076300820ac270000000000000de | 01:45 |
kota_ | AndyWojo: you need to mount the /dev/dm-6 to somewhere like /srv/node/sdb1 | 01:45 |
AndyWojo | which is a symlink to /dev/dm-6 | 01:45 |
AndyWojo | It is | 01:46 |
AndyWojo | ohh | 01:46 |
kota_ | and then you can set the mout point to swift ring. | 01:46 |
AndyWojo | So I put the filesystem? | 01:46 |
AndyWojo | So it would be... | 01:46 |
AndyWojo | swift-ring-builder object.builder add --region 1 --zone 1 --ip 192.168.241.117 --port 6000 --device /srv/node/36005076300820ac270000000000000de --weight 100 | 01:46 |
kota_ | maybe | 01:48 |
timburke | certainly looks more correct. you'll probably need to remove the /dev/dm-6 entry, as well | 01:49 |
AndyWojo | right | 01:51 |
AndyWojo | ill delete the gz files and rebuild the rings | 01:51 |
*** chlong has joined #openstack-swift | 01:53 | |
AndyWojo | Now I get: Account GET failed: http://gvicopnstk01:8080/v1/AUTH_00d93a1f7a0c484a9dad0e7fa39dd597?format=json 400 Bad Request [first 60 chars of response] Invalid path: //srv/node/36005076300820ac270000000000000df/5 | 01:56 |
AndyWojo | Let me go back through the implementation guide see if I missed anything | 01:57 |
*** _JZ__ has joined #openstack-swift | 02:01 | |
*** _JZ_ has quit IRC | 02:02 | |
zaitcev | No /srv/node in --device | 02:03 |
openstackgerrit | Cheng Li proposed openstack/python-swiftclient: Add python version constraint python>=2.7 https://review.openstack.org/334333 | 02:04 |
timburke | thanks zaitcev, i was just coming around to that... | 02:04 |
timburke | (i should really go through the full SAIO docs...) | 02:05 |
AndyWojo | sweet fixed it | 02:05 |
AndyWojo | My device isn't represented by the mount point, so I symlinked 36005076300820ac270000000000000de to /dev/dm-6 and took the /srv/node out | 02:06 |
AndyWojo | thanks! | 02:06 |
zaitcev | AndyWojo: Device names are just identificators with a flat namespace of Swift devices on a node. They have nothing with the underlying block device. Over years people tried various schemes, like "same as block device" for /dev/sda1 -> /srv/node/sda1 -> "sda1" device. This fell apart when block devices started to travel with every plug of a SAS cabel. | 02:06 |
AndyWojo | Ah. | 02:07 |
zaitcev | AndyWojo: So, one popular trick these days is 1) mount by label with LABEL=X or -L X, and then 2) use the same X in Swift namespace. | 02:07 |
AndyWojo | Ah I see | 02:07 |
AndyWojo | Makes sense | 02:07 |
AndyWojo | This works, this is just for a lab | 02:08 |
zaitcev | for example, I have a1 a2 s3 on node 'a', b1, b2, b3 on node 'b'. | 02:08 |
*** thurloat has quit IRC | 02:08 | |
mattoliverau | clayg: sorry was in meeting, then sidetracked with travel prep for midcycle. I think unicode is a great interchange format.. a bunch of code points can then be encoded into any utf-8,16, etc byte encoding.. but yeah if you want to send it as a byte stream down a wire then it' isn't necessarily the best for that type of interchange :) We could make our own utf8 json wrapper ;) | 02:08 |
zaitcev | then I know at once where the blasted device is when problems happen | 02:08 |
AndyWojo | zaitcev: gotcha! | 02:08 |
*** swat30 has quit IRC | 02:08 | |
AndyWojo | That makes sense | 02:08 |
AndyWojo | I only have one storage node in this case | 02:08 |
AndyWojo | What kind of cool stuff can I do with swift other than storing my ephemeral vm storage? | 02:09 |
zaitcev | Dunno... It is mostly the VM storage in my case. | 02:09 |
AndyWojo | Gotcha | 02:09 |
zaitcev | Backups for Glance. | 02:09 |
AndyWojo | Can you do tiered storage? For example I have a DS3700, an XIV and Flash storage. Is there a way to create different tiers of swift and have that presented in horizon? | 02:10 |
zaitcev | I dunno if you're into Japanimation, but maybe you heard about Crunchyroll. They serve all their video streams out of a Swift cluster. | 02:10 |
AndyWojo | oh cool | 02:10 |
AndyWojo | I have | 02:10 |
zaitcev | Sorry, we don't have a tiered storage solution baked in. IBM folks keep tinkering with it for their tape libraries, but it seems like a project with a forever receding horizon. | 02:11 |
AndyWojo | Ah | 02:11 |
AndyWojo | Maybe I'll ask the #openstack-powervm folks, they're all IBMers | 02:12 |
kota_ | AndyWojo: https://review.openstack.org/#/c/287057/ may be what you are looking for, it is still WIP though. | 02:13 |
patchbot | kota_: patch 287057 - swift - WIP: Swift Automated Tiering | 02:13 |
*** _JZ_ has joined #openstack-swift | 02:14 | |
*** _JZ__ has quit IRC | 02:15 | |
openstackgerrit | Cheng Li proposed openstack/python-swiftclient: Add python version constraint python>=2.7 https://review.openstack.org/334333 | 02:15 |
openstackgerrit | Tim Burke proposed openstack/python-swiftclient: Add python version constraint python>=2.7 https://review.openstack.org/334333 | 02:17 |
*** tanee_away is now known as tanee | 02:19 | |
*** _JZ_ has quit IRC | 02:20 | |
*** tqtran has joined #openstack-swift | 02:21 | |
openstackgerrit | Tim Burke proposed openstack/swift: Send correct SLO ETag for container updates https://review.openstack.org/337960 | 02:23 |
*** thurloat has joined #openstack-swift | 02:24 | |
*** _JZ_ has joined #openstack-swift | 02:24 | |
timburke | mattoliverau: yes! maybe we'll call it...simplejson! 'cause, y'know, it's so simple! :P | 02:24 |
*** swat30 has joined #openstack-swift | 02:25 | |
mattoliverau | timburke: genius! | 02:25 |
*** tqtran has quit IRC | 02:26 | |
timburke | AndyWojo: fwiw, you still *can* have tiered storage. we just don't (currently) automatically move the data between tiers for you. you can still define separate "storage policies", which can each have their own separate disks. so you could define separate SSD and HDD policies | 02:28 |
*** ManojK has quit IRC | 02:28 | |
timburke | i'm not sure what support horizon may have for storage policies, though | 02:28 |
AndyWojo | Gotcha, yeah that's the mystery | 02:28 |
AndyWojo | I want my users to be able to choose between different storage options | 02:29 |
AndyWojo | I'll experiment. | 02:29 |
timburke | (note to self, go look at horizon some...see what patches i can write...) | 02:29 |
*** NM has quit IRC | 02:30 | |
*** ManojK has joined #openstack-swift | 02:44 | |
*** siva_krish has quit IRC | 02:51 | |
*** gyee has quit IRC | 02:52 | |
*** siva_krish has joined #openstack-swift | 03:00 | |
*** ManojK has quit IRC | 03:04 | |
mattoliverau | AndyWojo: I know horizon are working on a new swift frontend.. not sure its storage policy support. But I can poke the guy who did a binch of the work (he's in my team).. tho he's on holidays this week. | 03:13 |
AndyWojo | No biggy. Basically I have all this storage in our lab, and I want to be able to present all the different kinds of storage as options when creating a VM within openstack | 03:14 |
AndyWojo | I thought swift might be the option | 03:14 |
AndyWojo | We have 5-6 types of storage I want to make available | 03:14 |
*** Suyash has quit IRC | 03:35 | |
openstackgerrit | Tim Burke proposed openstack/python-swiftclient: Add other-requirements.txt https://review.openstack.org/337982 | 03:44 |
*** _JZ_ has quit IRC | 03:45 | |
*** m_kazuhiro has quit IRC | 04:03 | |
*** m_kazuhiro has joined #openstack-swift | 04:08 | |
*** sgundur1 has joined #openstack-swift | 04:09 | |
*** sgundur1 has left #openstack-swift | 04:10 | |
*** klrmn has quit IRC | 04:11 | |
*** ManojK has joined #openstack-swift | 04:18 | |
*** tqtran has joined #openstack-swift | 04:23 | |
*** tqtran has quit IRC | 04:28 | |
*** ManojK has quit IRC | 04:29 | |
*** okdas has quit IRC | 04:33 | |
*** okdas has joined #openstack-swift | 04:35 | |
*** okdas has joined #openstack-swift | 04:35 | |
openstackgerrit | Tim Burke proposed openstack/python-swiftclient: Add other-requirements.txt https://review.openstack.org/337982 | 04:38 |
*** psachin has joined #openstack-swift | 04:42 | |
*** links has joined #openstack-swift | 04:48 | |
openstackgerrit | Tim Burke proposed openstack/python-swiftclient: Add other-requirements.txt https://review.openstack.org/337982 | 04:51 |
openstackgerrit | Tim Burke proposed openstack/python-swiftclient: Add other-requirements.txt https://review.openstack.org/337982 | 04:59 |
*** Victor has joined #openstack-swift | 05:00 | |
*** Victor is now known as Guest73850 | 05:01 | |
*** Guest73850 has quit IRC | 05:01 | |
*** Guest73850 has joined #openstack-swift | 05:01 | |
*** Guest73850 is now known as CR3ZNEZCH | 05:02 | |
*** sheel has joined #openstack-swift | 05:02 | |
*** SkyRocknRoll has joined #openstack-swift | 05:15 | |
*** asettle has joined #openstack-swift | 05:29 | |
*** asettle has quit IRC | 05:34 | |
*** zaitcev has quit IRC | 05:40 | |
*** hseipp has joined #openstack-swift | 05:50 | |
*** hseipp has quit IRC | 05:52 | |
*** siva_krish has quit IRC | 06:00 | |
*** pcaruana has joined #openstack-swift | 06:05 | |
*** rcernin has joined #openstack-swift | 06:09 | |
*** adu has quit IRC | 06:14 | |
-openstackstatus- NOTICE: All python 3.5 jobs are failing today, we need to build new xenial images first. | 06:28 | |
*** mmcardle has joined #openstack-swift | 06:30 | |
*** cshastri has joined #openstack-swift | 06:32 | |
*** CR3ZNEZCH has quit IRC | 06:34 | |
*** Victor has joined #openstack-swift | 06:34 | |
*** Victor is now known as Guest71815 | 06:34 | |
*** Guest71815 has quit IRC | 06:35 | |
*** Guest71815 has joined #openstack-swift | 06:35 | |
*** Guest71815 is now known as CR3ZNEZCH | 06:35 | |
*** SkyRocknRoll has quit IRC | 06:37 | |
*** CR3ZNEZCH has quit IRC | 06:38 | |
*** hosanai has quit IRC | 06:44 | |
*** SkyRocknRoll has joined #openstack-swift | 06:49 | |
*** hseipp has joined #openstack-swift | 06:55 | |
*** tesseract- has joined #openstack-swift | 07:21 | |
*** rledisez has joined #openstack-swift | 07:23 | |
*** joeljwright has joined #openstack-swift | 08:03 | |
*** ChanServ sets mode: +v joeljwright | 08:03 | |
openstackgerrit | Davanum Srinivas (dims) proposed openstack/swift: [WIP] Testing latest u-c https://review.openstack.org/318441 | 08:10 |
*** oshritf has joined #openstack-swift | 08:13 | |
*** smile-luobin_ has joined #openstack-swift | 08:20 | |
*** smile-luobin has quit IRC | 08:23 | |
*** asettle has joined #openstack-swift | 08:35 | |
*** asettle has quit IRC | 08:36 | |
*** asettle has joined #openstack-swift | 08:36 | |
*** asettle has quit IRC | 08:44 | |
*** asettle has joined #openstack-swift | 08:47 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/python-swiftclient: Updated from global requirements https://review.openstack.org/89250 | 08:50 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 08:51 |
*** kei_yama has quit IRC | 09:01 | |
*** ouchkernel has quit IRC | 09:02 | |
*** acoles_ is now known as acoles | 09:09 | |
*** ouchkernel has joined #openstack-swift | 09:09 | |
*** oshritf has quit IRC | 09:10 | |
*** dfflanders has joined #openstack-swift | 09:19 | |
*** tqtran has joined #openstack-swift | 09:25 | |
*** tqtran has quit IRC | 09:29 | |
*** SkyRocknRoll has quit IRC | 09:47 | |
*** daemontool has joined #openstack-swift | 09:49 | |
*** daemontool has quit IRC | 09:58 | |
*** daemontool has joined #openstack-swift | 09:58 | |
*** m_kazuhiro has quit IRC | 09:59 | |
*** links has quit IRC | 10:00 | |
*** jrichli has quit IRC | 10:04 | |
*** SkyRocknRoll has joined #openstack-swift | 10:04 | |
*** jrichli has joined #openstack-swift | 10:06 | |
*** oshritf has joined #openstack-swift | 10:06 | |
*** SkyRocknRoll has quit IRC | 10:38 | |
*** nadeem has joined #openstack-swift | 10:40 | |
*** jrichli has quit IRC | 10:42 | |
*** siva_krish has joined #openstack-swift | 10:44 | |
*** jrichli has joined #openstack-swift | 10:46 | |
openstackgerrit | Maria Malyarova proposed openstack/swift: Added missing parenthesis in print calls https://review.openstack.org/337690 | 10:49 |
*** SkyRocknRoll has joined #openstack-swift | 10:53 | |
*** asettle has quit IRC | 10:57 | |
*** asettle has joined #openstack-swift | 10:57 | |
*** asettle has quit IRC | 11:02 | |
*** Victor has joined #openstack-swift | 11:06 | |
*** Victor has joined #openstack-swift | 11:06 | |
*** Victor is now known as Guest32719 | 11:07 | |
*** Guest32719 is now known as CR3ZNEZCH | 11:07 | |
*** siva_krish has quit IRC | 11:19 | |
*** links has joined #openstack-swift | 11:24 | |
*** cdelatte has quit IRC | 11:24 | |
*** SkyRocknRoll has quit IRC | 11:24 | |
*** asettle has joined #openstack-swift | 11:25 | |
*** thurloat has quit IRC | 11:26 | |
*** swat30 has quit IRC | 11:26 | |
*** thurloat has joined #openstack-swift | 11:27 | |
*** swat30 has joined #openstack-swift | 11:28 | |
*** silor has joined #openstack-swift | 11:39 | |
*** SkyRocknRoll has joined #openstack-swift | 11:40 | |
*** CaioBrentano has joined #openstack-swift | 11:41 | |
*** silor1 has joined #openstack-swift | 11:42 | |
*** silor has quit IRC | 11:44 | |
*** silor1 is now known as silor | 11:44 | |
*** NM has joined #openstack-swift | 11:47 | |
*** oshritf has quit IRC | 11:50 | |
*** oshritf has joined #openstack-swift | 11:50 | |
*** permalac has joined #openstack-swift | 12:02 | |
*** oshritf has quit IRC | 12:02 | |
*** oshritf has joined #openstack-swift | 12:03 | |
*** oshritf_ has joined #openstack-swift | 12:03 | |
*** siva_krish has joined #openstack-swift | 12:04 | |
openstackgerrit | Alistair Coles proposed openstack/swift: Copy headers correctly when copying object https://review.openstack.org/272724 | 12:24 |
*** klamath has joined #openstack-swift | 12:41 | |
*** klamath has quit IRC | 12:41 | |
*** klamath has joined #openstack-swift | 12:42 | |
*** cshastri has quit IRC | 12:49 | |
*** takashi has joined #openstack-swift | 12:59 | |
*** cshastri has joined #openstack-swift | 13:04 | |
*** dfflanders has quit IRC | 13:11 | |
*** nadeem has quit IRC | 13:12 | |
*** vint_bra has joined #openstack-swift | 13:15 | |
*** CaioBrentano has quit IRC | 13:19 | |
*** ManojK has joined #openstack-swift | 13:23 | |
*** diogogmt has quit IRC | 13:23 | |
*** diogogmt has joined #openstack-swift | 13:25 | |
*** tqtran has joined #openstack-swift | 13:26 | |
*** SkyRocknRoll has quit IRC | 13:30 | |
*** tqtran has quit IRC | 13:30 | |
*** ametts has joined #openstack-swift | 13:33 | |
*** asettle has quit IRC | 13:37 | |
*** asettle has joined #openstack-swift | 13:37 | |
*** diogogmt has quit IRC | 13:41 | |
*** vinsh has joined #openstack-swift | 13:41 | |
openstackgerrit | Alistair Coles proposed openstack/swift: Add basic functests for user object metadata https://review.openstack.org/336741 | 13:48 |
acoles | clayg: hope you don't mind my change ^^ | 13:57 |
*** links has quit IRC | 13:57 | |
*** ManojK has quit IRC | 13:57 | |
*** ManojK has joined #openstack-swift | 14:00 | |
*** siva_krish has quit IRC | 14:04 | |
*** ManojK has quit IRC | 14:11 | |
*** oshritf has quit IRC | 14:18 | |
*** oshritf_ has quit IRC | 14:18 | |
*** CR3ZNEZCH has quit IRC | 14:24 | |
*** sgundur1 has joined #openstack-swift | 14:27 | |
*** psachin has quit IRC | 14:30 | |
*** vint_bra has quit IRC | 14:30 | |
*** vint_bra has joined #openstack-swift | 14:33 | |
*** vint_bra has quit IRC | 14:34 | |
*** siva_krish has joined #openstack-swift | 14:34 | |
*** ManojK has joined #openstack-swift | 14:35 | |
*** psachin has joined #openstack-swift | 14:35 | |
*** vint_bra has joined #openstack-swift | 14:39 | |
*** arch-nemesis has joined #openstack-swift | 14:40 | |
*** chsc has joined #openstack-swift | 14:47 | |
*** chsc has joined #openstack-swift | 14:47 | |
*** diogogmt has joined #openstack-swift | 14:54 | |
*** _JZ_ has joined #openstack-swift | 14:59 | |
*** thumpba has joined #openstack-swift | 15:00 | |
*** pcaruana has quit IRC | 15:06 | |
*** siva_krish has left #openstack-swift | 15:08 | |
*** psachin has quit IRC | 15:10 | |
*** vint_bra has quit IRC | 15:10 | |
*** rcernin has quit IRC | 15:10 | |
*** cshastri has quit IRC | 15:10 | |
*** psachin has joined #openstack-swift | 15:10 | |
*** klrmn has joined #openstack-swift | 15:19 | |
*** silor has quit IRC | 15:19 | |
*** NM has quit IRC | 15:29 | |
*** NM has joined #openstack-swift | 15:31 | |
*** rcernin has joined #openstack-swift | 15:49 | |
*** jmccarthy has quit IRC | 15:50 | |
*** jmccarthy has joined #openstack-swift | 15:50 | |
*** asettle has quit IRC | 15:51 | |
timburke | good morning | 16:00 |
*** vinsh has quit IRC | 16:03 | |
*** vinsh has joined #openstack-swift | 16:03 | |
*** vinsh_ has joined #openstack-swift | 16:08 | |
*** takashi has quit IRC | 16:09 | |
*** klrmn has quit IRC | 16:12 | |
*** vinsh has quit IRC | 16:12 | |
*** vint_bra has joined #openstack-swift | 16:13 | |
*** nadeem has joined #openstack-swift | 16:20 | |
*** gyee has joined #openstack-swift | 16:21 | |
*** psachin has quit IRC | 16:22 | |
briancline | morning timburke | 16:23 |
*** Suyash has joined #openstack-swift | 16:24 | |
*** ukaynar has joined #openstack-swift | 16:27 | |
*** zaitcev has joined #openstack-swift | 16:28 | |
*** ChanServ sets mode: +v zaitcev | 16:28 | |
notmyname | hello, world | 16:36 |
*** NM has quit IRC | 16:38 | |
*** admin6 has left #openstack-swift | 16:40 | |
*** hseipp has quit IRC | 16:41 | |
*** NM has joined #openstack-swift | 16:41 | |
*** Suyash has quit IRC | 16:42 | |
*** rledisez has quit IRC | 16:44 | |
*** gyee has quit IRC | 16:45 | |
*** tesseract- has quit IRC | 16:49 | |
*** gyee has joined #openstack-swift | 17:00 | |
*** redbo_ has quit IRC | 17:01 | |
*** redbo has joined #openstack-swift | 17:01 | |
*** ChanServ sets mode: +v redbo | 17:01 | |
*** ManojK has quit IRC | 17:07 | |
notmyname | and with very liberal use of "mark all as read", I've now sorted through the last 4 days' worth of email | 17:08 |
tdasilva | notmyname: howdy! how was camp? | 17:09 |
notmyname | tdasilva: it was nice http://d.not.mn/Kirby_cove_view.jpg http://d.not.mn/Kirby_cove_view2.jpg | 17:11 |
notmyname | I wasn't able to see fireworks from there, but otherwise, it was a great spot | 17:12 |
tdasilva | neat, looks like you were on the other side of the bridge right? that's SFO behind the bridge | 17:12 |
tdasilva | ? | 17:12 |
notmyname | yep. just over the bridge in marin and just below the overlook/observation area | 17:13 |
*** ChanServ changes topic to "Let's talk. We're nice. | Logs: http://eavesdrop.openstack.org/irclogs/%23openstack-swift/ | Meetings: https://wiki.openstack.org/wiki/Meetings/Swift | Hackathon: https://etherpad.openstack.org/p/swift_SA_hackathon_2016" | 17:13 | |
tdasilva | notmyname: sounds cool :-) | 17:14 |
*** acoles is now known as acoles_ | 17:14 | |
notmyname | literally and figuratively ;-) | 17:14 |
*** klrmn has joined #openstack-swift | 17:16 | |
*** daemontool has quit IRC | 17:18 | |
openstackgerrit | Tim Burke proposed openstack/swift: Send correct SLO ETag for container updates https://review.openstack.org/337960 | 17:18 |
tdasilva | notmyname: heh | 17:20 |
*** Suyash has joined #openstack-swift | 17:25 | |
*** tqtran has joined #openstack-swift | 17:27 | |
*** cdelatte has joined #openstack-swift | 17:28 | |
*** ukaynar has quit IRC | 17:30 | |
tdasilva | notmyname: just a heads up, now I can't get scrollbars on the community dashboard at all, even when making the window smaller | 17:30 |
*** ouchkernel has quit IRC | 17:32 | |
notmyname | tdasilva: ok, thanks. I think that's left over from the confetti stuff | 17:35 |
notmyname | I'll fix it shortly | 17:35 |
*** Jeffrey4l_ has quit IRC | 17:39 | |
*** Jeffrey4l_ has joined #openstack-swift | 17:44 | |
notmyname | tdasilva: should be fixed | 17:45 |
tdasilva | notmyname: yep! thanks | 17:46 |
*** nadeem has quit IRC | 17:51 | |
notmyname | Author:Cloud User <cloud-user@bounce.cisco.com> | 17:51 |
clayg | heyoh! | 17:53 |
clayg | acoles_: never! you always make everything better | 17:53 |
*** ManojK has joined #openstack-swift | 17:53 | |
klamath | any reason why "error_suppression_limit" is not working? | 18:06 |
klamath | do timeouts count as an "error" if the node is hard down? | 18:07 |
*** joeljwright has quit IRC | 18:07 | |
*** nadeem has joined #openstack-swift | 18:08 | |
klamath | http://comments.gmane.org/gmane.comp.cloud.openstack.devel/869 | 18:08 |
*** permalac has quit IRC | 18:09 | |
*** Jeffrey4l_ has quit IRC | 18:19 | |
openstackgerrit | Merged openstack/swift: Added missing parenthesis in print calls https://review.openstack.org/337690 | 18:25 |
*** ouchkernel has joined #openstack-swift | 18:48 | |
*** cdelatte has quit IRC | 18:50 | |
*** ChubYann has joined #openstack-swift | 18:50 | |
*** esumerfd has joined #openstack-swift | 18:54 | |
*** cdelatte has joined #openstack-swift | 18:55 | |
*** sheel has quit IRC | 18:55 | |
*** asettle has joined #openstack-swift | 19:00 | |
*** ManojK has quit IRC | 19:07 | |
*** ManojK has joined #openstack-swift | 19:12 | |
*** nadeem has quit IRC | 19:15 | |
*** asettle has quit IRC | 19:20 | |
openstackgerrit | Michael Barton proposed openstack/swift: go: storage policies https://review.openstack.org/338506 | 19:25 |
klamath | yay | 19:26 |
tdasilva | wow | 19:26 |
*** asettle has joined #openstack-swift | 19:29 | |
*** adu has joined #openstack-swift | 19:34 | |
*** asettle has quit IRC | 19:36 | |
*** adu has quit IRC | 19:37 | |
*** zul has quit IRC | 19:51 | |
clayg | wow @ storage policies in hummingbird!? | 19:52 |
*** cdelatte has quit IRC | 19:53 | |
*** asettle has joined #openstack-swift | 19:59 | |
*** mathiasb has quit IRC | 20:01 | |
*** sbelous_ has joined #openstack-swift | 20:01 | |
*** rcernin_ has joined #openstack-swift | 20:06 | |
tdasilva | clayg: yeah | 20:08 |
tdasilva | redbo: sounds great, would like to try it out soon | 20:09 |
*** nadeem has joined #openstack-swift | 20:09 | |
*** rcernin_ has quit IRC | 20:10 | |
notmyname | great to see :-) | 20:11 |
*** rcernin_ has joined #openstack-swift | 20:15 | |
*** cdelatte has joined #openstack-swift | 20:16 | |
*** rcernin_ has quit IRC | 20:19 | |
*** rcernin_ has joined #openstack-swift | 20:19 | |
*** rcernin_ has quit IRC | 20:20 | |
*** rcernin has quit IRC | 20:24 | |
*** rcernin has joined #openstack-swift | 20:25 | |
*** diazjf has joined #openstack-swift | 20:27 | |
*** vint_bra has quit IRC | 20:32 | |
*** mathiasb has joined #openstack-swift | 20:33 | |
*** rcernin has quit IRC | 20:38 | |
*** rcernin has joined #openstack-swift | 20:39 | |
*** kei_yama has joined #openstack-swift | 20:43 | |
*** thumpba has quit IRC | 20:46 | |
*** nadeem has quit IRC | 20:50 | |
*** nadeem has joined #openstack-swift | 20:54 | |
*** dfflanders has joined #openstack-swift | 20:54 | |
*** nadeem has quit IRC | 20:54 | |
*** nadeem has joined #openstack-swift | 20:55 | |
notmyname | swift team meeting in #openstack-meeting is 5 minutes | 20:55 |
*** sbelous_ has quit IRC | 20:57 | |
*** acoles_ is now known as acoles | 20:58 | |
*** dfflanders has quit IRC | 20:58 | |
mattoliverau | morning | 20:58 |
*** dfflanders has joined #openstack-swift | 20:59 | |
jrichli | mattoliverau: good morning! ready for the Texas heat? | 21:00 |
notmyname | swift team meeting time | 21:00 |
notmyname | jrichli: ugh. it's literally going to be double in TX from my home | 21:00 |
mattoliverau | notmyname: I had the same complaint about the doc's patches (new docfolders in the root directory and under doc). So I went to see if it could be moved, but the gerrit publish jobs (for ref-api and install-guide) look in the root, and it can't be changed without moving them in all of openstack.. but surely others have the same issue. | 21:01 |
notmyname | 100+ in san antonio. in the 50s in SF | 21:01 |
jrichli | wow! | 21:01 |
*** m_kazuhiro has joined #openstack-swift | 21:01 | |
notmyname | mattoliverau: yeah, I want one docs dir with one conf.py and one docs theme | 21:01 |
*** m_kazuhi_ has joined #openstack-swift | 21:01 | |
*** m_kazuhi_ has quit IRC | 21:02 | |
mattoliverau | jrichli: surface of the sun again huh.. I guess I'm as ready as I'll ever be :P | 21:02 |
*** rcernin has quit IRC | 21:03 | |
*** rcernin has joined #openstack-swift | 21:04 | |
*** diazjf has quit IRC | 21:07 | |
*** rcernin has quit IRC | 21:07 | |
*** rcernin has joined #openstack-swift | 21:07 | |
acoles | that sounds...'warm' | 21:08 |
*** vint_bra has joined #openstack-swift | 21:11 | |
*** asettle has quit IRC | 21:13 | |
*** esumerfd has quit IRC | 21:29 | |
*** NM has quit IRC | 21:31 | |
openstackgerrit | Merged openstack/swift: Change elifs to ifs https://review.openstack.org/336303 | 21:31 |
torgomatic | I've started thinking about temperatures in Kelvin. Makes the difference between SF and San Antonio seem smaller. | 21:32 |
hurricanerix | lol | 21:33 |
tdasilva | kota_ is not around today...does anybody know if dmorita will be in san antonio? would be cool to keep the auto tier conversation going | 21:33 |
hurricanerix | torgomatic: come on, it's only going to be around 100, thats a nice round number. =) | 21:33 |
torgomatic | hurricanerix: yes, and I am a nice round programmer who doesn't get along with high heat ;) | 21:33 |
acoles | torgomatic: lol. think in Celsius and they're almost on a par | 21:34 |
hurricanerix | torgomatic heh, don't worry we have air conditioning all over the place. also ice tea | 21:34 |
acoles | torgomatic: um, actually its probably not that cold in SF | 21:34 |
* jrichli if off to yoga | 21:36 | |
tdasilva | timur: Hi, timburke mentioned you have done some work with the swift+searchlight integration...do you have any updates? is the searchlight team doing most of the work? | 21:37 |
*** acoles is now known as acoles_ | 21:37 | |
*** rcernin has quit IRC | 21:37 | |
clayg | tdasilva: I don't think timur really monitors this channel, nor do I think he's in much contact with the searchlight team? You want me to ping him? | 21:38 |
tdasilva | clayg: if it's not too much trouble and it is not urgent, just trying to figure out where things are since Austin | 21:39 |
tdasilva | clayg: do you know if timur will be in San Antonio? | 21:39 |
timur | tdasilva: I've made some progress on the container-sync-like approach. Hopefully, I'll be able to push a version of that in the next couple of weeks. I haven't kept in touch with the searchlight folks though | 21:42 |
timur | tdasilva: I don't think I'll be in San Antonio though | 21:43 |
notmyname | tdasilva: yes, dmorita is signed up for the hackathon | 21:44 |
*** m_kazuhiro has quit IRC | 21:46 | |
tdasilva | timur: ok, thanks for the heads up. I think the searchlight team was going to try the "other" approach, correct? | 21:48 |
tdasilva | notmyname: cool! thanks | 21:49 |
tdasilva | timur: and by "other" approach I mean wsgi middleware...at least that's what I could understand from comments here: https://review.openstack.org/#/c/305404/ | 21:54 |
patchbot | tdasilva: patch 305404 - searchlight-specs - Searchlight Client Library | 21:54 |
*** gyee has quit IRC | 21:54 | |
timur | tdasilva: They were going to push on writing the middleware to get notifications from Swift into searchlight. I don't know what's happening with it though, as I haven't seen any updates on any of the patches | 21:55 |
timur | tdasilva: yea, that's the best reference above -- I was just looking around for it | 21:56 |
*** diazjf has joined #openstack-swift | 21:56 | |
mattoliverau | tdasilva: I believe dmorita is currently living in the states, so he'll probably be there. (If my memory serves) | 21:59 |
*** diazjf has quit IRC | 22:00 | |
notmyname | yeah, IIRC he's here in the Bay Area | 22:01 |
*** ametts has quit IRC | 22:02 | |
kota_ | ugh, my alarm didn't ring | 22:03 |
notmyname | kota_: no worries | 22:03 |
notmyname | kota_: the meeting summary is "we're looking forward to seeing you next week" :-) | 22:03 |
kota_ | notmyname: is there something new? | 22:03 |
openstackgerrit | Merged openstack/swift: Prevent down nodes failing PUTs with non-ascii obj names https://review.openstack.org/335373 | 22:03 |
kota_ | notmyname: \o/ definately! | 22:04 |
* kota_ is reading log... | 22:04 | |
mattoliverau | notmyname: kota_'s right to ask, cause looking forward to seeing him is nothing new ;) | 22:06 |
notmyname | :-) | 22:06 |
kota_ | lol | 22:06 |
mattoliverau | well looks like the meeting I'm suppose to be in now isn't happening, so I'm going to go find some breakfast \o/ | 22:07 |
kota_ | done for reading, it looks it was short meeting :-) | 22:12 |
kota_ | tdasilva: dmorita will be SanAantonio but m_kazuhiro won't because of his work :/ | 22:14 |
*** david-lyle_ has joined #openstack-swift | 22:21 | |
*** mmcardle has quit IRC | 22:29 | |
pdardeau | i took a stab at some code to hopefully illustrate the eventlet hub starvation problem. do you think it's a fair representation? https://github.com/pauldardeau/python-concurrent-disk-io | 22:32 |
*** vint_bra has quit IRC | 22:32 | |
*** david-lyle_ is now known as david-lyle | 22:35 | |
notmyname | pdardeau: oh wow. that's much more thorough than I expected when I first clicked on it | 22:37 |
openstackgerrit | Tim Burke proposed openstack/swift: Send correct SLO ETag for container updates https://review.openstack.org/337960 | 22:44 |
openstackgerrit | Tim Burke proposed openstack/swift: Fix X-*-Container-Update-Override-* header/footer precedence https://review.openstack.org/338588 | 22:44 |
*** vint_bra has joined #openstack-swift | 22:45 | |
*** ManojK has quit IRC | 22:47 | |
*** nadeem has quit IRC | 22:57 | |
*** chsc has quit IRC | 23:07 | |
clayg | pdardeau: so it looks like you have an implementation using native threads in a dozen languages (include jython) - then eventlet; then the golang runtime | 23:10 |
*** vint_bra has quit IRC | 23:16 | |
clayg | pdardeau: did you notice that the "jython" solution using threads runs just fine under cpython and doesn't exibit "the problem scenario" | 23:17 |
pdardeau | clayg: yep, you got it. i did not try the jython approach under cpython (i didn't think about it), but i'll give it a shot | 23:19 |
*** zul has joined #openstack-swift | 23:24 | |
*** vinsh_ has quit IRC | 23:28 | |
pdardeau | clayg: thanks for your suggestion. i just tried the python threaded version with cpython 2.7 and the problem did not appear. i also updated source file names and README with results. | 23:50 |
notmyname | pdardeau: clayg: that's expected, I'd think. but the next part would be to have the test running put an "interesting" load against it. instead of doing 4-5 concurrent clients, how does the server handle 400-500 clients? | 23:51 |
notmyname | pdardeau: clayg: I suspect that would show where threads fall down | 23:52 |
notmyname | (and why we use greenlets) | 23:52 |
pdardeau | notmyname: good points. maybe we can talk about it more at hackathon (even if not part of schedule) | 23:53 |
pdardeau | notmyname: is there a specific client-side testing tool for 400-500 clients? | 23:54 |
*** _JZ_ has quit IRC | 23:55 | |
notmyname | pdardeau: no. back in early swift days I wrote a simple putter script that uses eventlet on the client side to throw requests at a server. something like that would likely be sufficient | 23:56 |
*** Suyash has quit IRC | 23:56 | |
notmyname | pdardeau: IOW, I'd suggest actually using python+eventlet to get the workload concurrency up to interesting levels. (this would also have the advantage of only having to run one client instead of a bunch) | 23:56 |
notmyname | on my laptop, I can get eventlet to push several hundred swift PUTs/sec on a single core. of course you could write something in golang and get a lot more since it would use more than one core ;-) | 23:57 |
kota_ | Does someone know why swift set "sock" to args, here?, https://github.com/openstack/swift/blob/master/swift/common/memcached.py#L225 | 23:58 |
kota_ | it looks always None even if a Timeout raised and nothing to do in the method. | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!