*** hosanai has joined #openstack-swift | 00:00 | |
*** ChanServ sets mode: +v hosanai | 00:00 | |
zaitcev | So, the balance for some of my devices is 0.00 for some of my devices, and -0.00 for other devices. Maths how do they work. | 00:03 |
---|---|---|
clayg | zaitcev: it's like magnets | 00:11 |
*** garthb_ has joined #openstack-swift | 00:12 | |
*** garthb has quit IRC | 00:15 | |
*** garthb_ has quit IRC | 00:19 | |
*** david-lyle has quit IRC | 00:25 | |
*** david-lyle has joined #openstack-swift | 00:26 | |
*** david-lyle has quit IRC | 00:30 | |
kota_ | mornng | 00:41 |
kota_ | morning | 00:41 |
*** dtoast has quit IRC | 00:42 | |
*** tqtran has quit IRC | 00:46 | |
*** suyash has quit IRC | 00:46 | |
*** CaioBrentano has quit IRC | 00:46 | |
*** bill_az has quit IRC | 00:57 | |
*** bill_az has joined #openstack-swift | 00:58 | |
*** bill_az has quit IRC | 00:59 | |
zaitcev | Replica count of 16.0 requires more than 9 devices | 01:13 |
zaitcev | Excuse me what | 01:13 |
zaitcev | What has happened to "as good as possible" placement? | 01:13 |
*** adu has quit IRC | 01:23 | |
*** adu has joined #openstack-swift | 01:29 | |
*** elambert_ has quit IRC | 01:38 | |
*** dtoast has joined #openstack-swift | 01:54 | |
*** dtoast has quit IRC | 01:55 | |
*** sheel has joined #openstack-swift | 01:57 | |
kota_ | zaitcev: what's up? looks like around EC ring validation? | 02:03 |
kota_ | ah, no, it looks ring builder validation. | 02:04 |
zaitcev | kota_: Perhaps I'm confused and we only permitted other tiers to be fewer than replication, but not devices. | 02:04 |
kota_ | ring builder has a config 16 replicas, and just 9 devices exist there. | 02:04 |
zaitcev | I mean zones and nodes. | 02:04 |
kota_ | zaitcev: sounds true. | 02:06 |
*** m_kazuhiro has joined #openstack-swift | 02:07 | |
*** gyee has quit IRC | 02:36 | |
*** NM has joined #openstack-swift | 02:45 | |
*** sgundur1 has left #openstack-swift | 03:03 | |
openstackgerrit | Thiago da Silva proposed openstack/swift: update pyeclib and liberasurecode links https://review.openstack.org/325023 | 03:03 |
*** dmorita has quit IRC | 03:04 | |
NM | clayg: and notmyname: sorry again for the abrupt leaving. | 03:05 |
*** MooingLemur has quit IRC | 03:15 | |
*** dmorita has joined #openstack-swift | 03:25 | |
*** dmorita has quit IRC | 03:29 | |
*** natarej has joined #openstack-swift | 03:30 | |
*** natarej_ has quit IRC | 03:31 | |
openstackgerrit | Thiago da Silva proposed openstack/liberasurecode: add other-requirements.txt https://review.openstack.org/325029 | 03:37 |
*** jamielennox is now known as jamielennox|away | 03:39 | |
*** NM has quit IRC | 03:40 | |
*** adu has quit IRC | 03:52 | |
*** nadeem has joined #openstack-swift | 04:01 | |
*** diogogmt has quit IRC | 04:07 | |
*** klrmn has quit IRC | 04:17 | |
*** elambert_ has joined #openstack-swift | 04:33 | |
*** psachin has joined #openstack-swift | 04:35 | |
*** links has joined #openstack-swift | 04:38 | |
openstackgerrit | Merged openstack/swift: update pyeclib and liberasurecode links https://review.openstack.org/325023 | 04:46 |
*** SkyRocknRoll has joined #openstack-swift | 04:56 | |
*** rcernin has joined #openstack-swift | 04:58 | |
*** sams-gleb has joined #openstack-swift | 05:03 | |
*** rcernin has quit IRC | 05:04 | |
*** dmorita has joined #openstack-swift | 05:05 | |
*** adu has joined #openstack-swift | 05:05 | |
*** sams-gleb has quit IRC | 05:07 | |
openstackgerrit | Kota Tsuyuzaki proposed openstack/liberasurecode: Update README.md as 1.2.x now https://review.openstack.org/325046 | 05:08 |
kota_ | yey, all (git review, patchbot) work for liberausrecode | 05:09 |
*** dmorita has quit IRC | 05:09 | |
*** dtoast has joined #openstack-swift | 05:24 | |
*** janonymous has joined #openstack-swift | 05:32 | |
*** SkyRocknRoll has quit IRC | 05:33 | |
mattoliverau | kota_: nice work! | 05:37 |
kota_ | mattolivearu: alsmostly tdasilva work ;) | 05:42 |
*** elambert_ has quit IRC | 05:43 | |
*** rcernin has joined #openstack-swift | 05:46 | |
*** SkyRocknRoll has joined #openstack-swift | 05:47 | |
*** adu has quit IRC | 05:47 | |
*** adu has joined #openstack-swift | 05:54 | |
*** sams-gleb has joined #openstack-swift | 06:03 | |
*** sams-gleb has quit IRC | 06:08 | |
*** openstackgerrit has quit IRC | 06:17 | |
*** openstackgerrit has joined #openstack-swift | 06:18 | |
*** ppai has joined #openstack-swift | 06:19 | |
*** tanee is now known as tanee_away | 06:21 | |
*** adu has quit IRC | 06:37 | |
*** tanee_away is now known as tanee | 06:42 | |
*** geaaru has joined #openstack-swift | 06:47 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Imported Translations from Zanata https://review.openstack.org/325078 | 06:49 |
openstackgerrit | Merged openstack/swift: Remove unused (but defaulted) args https://review.openstack.org/324666 | 06:49 |
*** sams-gleb has joined #openstack-swift | 06:58 | |
*** bill_az has joined #openstack-swift | 07:02 | |
*** openstackgerrit has quit IRC | 07:03 | |
*** openstackgerrit has joined #openstack-swift | 07:03 | |
zigo | Vinsh: notmyname: clarkb: Ubuntu has their own Swift package, and don't copy it from Debian, they only take the dependencies from us. FYI, in Debian, there's full support for sysv-rc AND systemd .service files, even supporting multiple daemons if you want to use multiple conf files in let's say /etc/swift-objec/*.conf. We don't have native upstart support though, but I don't think anyone cares about this anymore (upstart | 07:06 |
zigo | users are fine with the sysv-rc init script anyway). | 07:06 |
*** bill_az has quit IRC | 07:17 | |
*** rledisez has joined #openstack-swift | 07:18 | |
*** jistr is now known as jistr|mtg | 07:22 | |
*** dtoast has quit IRC | 07:33 | |
*** dtoast has joined #openstack-swift | 07:33 | |
*** nadeem has quit IRC | 07:44 | |
*** admin6_ has joined #openstack-swift | 07:45 | |
*** mmcardle has joined #openstack-swift | 07:45 | |
*** admin6 has quit IRC | 07:48 | |
*** admin6_ is now known as admin6 | 07:48 | |
*** admin6_ has joined #openstack-swift | 07:52 | |
*** admin6 has quit IRC | 07:54 | |
*** admin6_ is now known as admin6 | 07:54 | |
*** kozhukalov has quit IRC | 07:58 | |
*** acoles_ is now known as acoles | 08:02 | |
*** daemontool has joined #openstack-swift | 08:06 | |
*** permalac has joined #openstack-swift | 08:08 | |
*** fesp has joined #openstack-swift | 08:11 | |
*** fesp has quit IRC | 08:16 | |
*** acoles is now known as acoles_ | 08:17 | |
*** MooingLemur has joined #openstack-swift | 08:19 | |
*** acoles_ is now known as acoles | 08:22 | |
*** jmccarthy has quit IRC | 08:32 | |
kota_ | acoles: good point of view for liberasurecode maintainancibility :) | 08:34 |
kota_ | thanks | 08:35 |
*** briancli1e has joined #openstack-swift | 08:38 | |
*** daemontool has quit IRC | 08:38 | |
*** anticw__ has joined #openstack-swift | 08:38 | |
zigo | clarkb: I just wrote this: https://wiki.debian.org/OpenStack/OpenStack/Mitaka-Debian-Maintained | 08:38 |
*** anticw_ has quit IRC | 08:39 | |
*** mathiasb has quit IRC | 08:39 | |
*** briancline has quit IRC | 08:39 | |
*** tonyb has quit IRC | 08:39 | |
*** urth has quit IRC | 08:39 | |
*** tonyb has joined #openstack-swift | 08:39 | |
*** hamr has joined #openstack-swift | 08:39 | |
*** mathiasb has joined #openstack-swift | 08:43 | |
*** jistr|mtg is now known as jistr | 08:43 | |
openstackgerrit | Alistair Coles proposed openstack/liberasurecode: Change link to pyeclib in README.md https://review.openstack.org/325132 | 08:46 |
*** SkyRocknRoll has quit IRC | 08:55 | |
*** kozhukalov has joined #openstack-swift | 08:57 | |
openstackgerrit | Alistair Coles proposed openstack/pyeclib: Change link to liberasurecode in README.md https://review.openstack.org/325135 | 08:59 |
acoles | jrichli: mahatic timburke tdasilva Note that if you have crypto middleware installed you may need to update your root secret in proxy-server.conf since commit 6557792 landed | 09:06 |
*** jmccarthy has joined #openstack-swift | 09:09 | |
*** SkyRocknRoll has joined #openstack-swift | 09:11 | |
mahatic | acoles: ack. thanks for letting us know. | 09:30 |
*** rcernin is now known as rcernin|lunch | 09:31 | |
*** jith_ has joined #openstack-swift | 09:32 | |
-openstackstatus- NOTICE: CI is experiencing issues with test logs, all jobs are currently UNSTABLE as a result. No need to recheck until this is fixed! Thanks for your patience. | 09:38 | |
*** dtoast has quit IRC | 09:41 | |
*** pcaruana has joined #openstack-swift | 09:44 | |
openstackgerrit | Kota Tsuyuzaki proposed openstack/swift: Apply container update probe to both of REPL/EC https://review.openstack.org/322773 | 09:47 |
openstackgerrit | Kota Tsuyuzaki proposed openstack/liberasurecode: Remove version value from README.md https://review.openstack.org/325046 | 09:53 |
*** dtoast has joined #openstack-swift | 09:56 | |
*** dtoast has quit IRC | 09:57 | |
*** logan_ has joined #openstack-swift | 09:57 | |
*** logan_ is now known as Guest62971 | 09:58 | |
*** charz_ has joined #openstack-swift | 09:59 | |
*** zackmdavis_ has joined #openstack-swift | 09:59 | |
*** logan- has quit IRC | 09:59 | |
*** hogepodge has quit IRC | 10:01 | |
*** zackmdavis has quit IRC | 10:01 | |
*** charz has quit IRC | 10:01 | |
*** Guest62971 is now known as logan- | 10:01 | |
*** kozhukalov has quit IRC | 10:02 | |
*** ujjain has quit IRC | 10:02 | |
*** mvk_ has joined #openstack-swift | 10:05 | |
*** tdasilva has quit IRC | 10:05 | |
*** marok has quit IRC | 10:05 | |
*** marok has joined #openstack-swift | 10:05 | |
*** thurloat has quit IRC | 10:06 | |
*** tdasilva has joined #openstack-swift | 10:07 | |
*** mvk has quit IRC | 10:07 | |
*** thurloat has joined #openstack-swift | 10:07 | |
-openstackstatus- NOTICE: CI is experiencing issues with test logs, all jobs are currently UNSTABLE as a result. No need to recheck until this is fixed! Thanks for your patience. | 10:10 | |
*** ChanServ changes topic to "CI is experiencing issues with test logs, all jobs are currently UNSTABLE as a result. No need to recheck until this is fixed! Thanks for your patience." | 10:10 | |
*** mvk_ has quit IRC | 10:12 | |
*** andymccr_ has joined #openstack-swift | 10:13 | |
*** ujjain has joined #openstack-swift | 10:13 | |
*** ujjain has joined #openstack-swift | 10:13 | |
*** mvk_ has joined #openstack-swift | 10:13 | |
*** mmotiani- has joined #openstack-swift | 10:15 | |
*** mathiasb has quit IRC | 10:16 | |
*** permalac has quit IRC | 10:16 | |
*** natarej has quit IRC | 10:16 | |
*** mmotiani_ has quit IRC | 10:16 | |
*** Vinsh has quit IRC | 10:16 | |
*** andymccr has quit IRC | 10:16 | |
*** andymccr_ is now known as andymccr | 10:16 | |
*** kozhukalov has joined #openstack-swift | 10:19 | |
*** rcernin|lunch is now known as rcernin | 10:20 | |
*** sams-gleb has quit IRC | 10:22 | |
*** tdasilva has quit IRC | 10:23 | |
openstackgerrit | Alistair Coles proposed openstack/swift: crypto - stop using key id to derive GET path keys https://review.openstack.org/318148 | 10:25 |
*** sams-gleb has joined #openstack-swift | 10:25 | |
acoles | jrichli: mahatic ^^ sorry for confusion, this should be correct, and I expanded the commit message with some more explanation | 10:26 |
*** tdasilva has joined #openstack-swift | 10:26 | |
*** SkyRocknRoll has quit IRC | 10:30 | |
openstackgerrit | Alistair Coles proposed openstack/swift: crypto - refactor footers callback https://review.openstack.org/324313 | 10:34 |
*** SkyRocknRoll has joined #openstack-swift | 10:36 | |
*** permalac has joined #openstack-swift | 10:45 | |
*** natarej has joined #openstack-swift | 10:46 | |
*** hogepodge has joined #openstack-swift | 10:49 | |
*** mathiasb has joined #openstack-swift | 10:49 | |
*** Vinsh has joined #openstack-swift | 10:49 | |
*** orwell.freenode.net changes topic to "Let's talk! We're nice | Review Dashboard: https://goo.gl/mtEv1C | Logs: http://eavesdrop.openstack.org/irclogs/%23openstack-swift/ | Meetings: https://wiki.openstack.org/wiki/Meetings/Swift | Community Dashboard: http://not.mn/swift/swift_community_dashboard.html" | 10:49 | |
*** raildo-afk is now known as raildo | 11:02 | |
*** dmorita has joined #openstack-swift | 11:30 | |
*** ouchkernel has quit IRC | 11:31 | |
*** m_kazuhiro has quit IRC | 11:33 | |
*** tesseract has joined #openstack-swift | 11:33 | |
*** d0ugal has quit IRC | 11:34 | |
*** dmorita has quit IRC | 11:35 | |
-openstackstatus- NOTICE: CI is experiencing issues with test logs, all jobs are currently UNSTABLE as a result. No need to recheck until this is fixed! Thanks for your patience. | 11:43 | |
*** ChanServ changes topic to "CI is experiencing issues with test logs, all jobs are currently UNSTABLE as a result. No need to recheck until this is fixed! Thanks for your patience." | 11:43 | |
*** pcaruana has quit IRC | 11:45 | |
*** admin6_ has joined #openstack-swift | 11:52 | |
*** admin6 has quit IRC | 11:55 | |
*** admin6_ is now known as admin6 | 11:55 | |
*** NM has joined #openstack-swift | 11:58 | |
*** sams-gleb has quit IRC | 12:06 | |
*** ppai has quit IRC | 12:07 | |
*** daemontool has joined #openstack-swift | 12:16 | |
*** ppai has joined #openstack-swift | 12:19 | |
*** sams-gleb has joined #openstack-swift | 12:40 | |
*** ppai has quit IRC | 12:47 | |
*** daemontool has quit IRC | 12:50 | |
mahatic | acoles: no issues. commit msg is more clear. Looking at it now | 12:53 |
*** d0ugal has joined #openstack-swift | 12:55 | |
*** mvk_ has quit IRC | 12:57 | |
*** hosanai has quit IRC | 12:58 | |
*** psachin has quit IRC | 12:59 | |
*** mmuffinman has quit IRC | 13:01 | |
*** ChanServ sets mode: +v tdasilva | 13:01 | |
*** SkyRocknRoll has quit IRC | 13:02 | |
tdasilva | good morning | 13:04 |
*** sams-gleb has quit IRC | 13:05 | |
openstackgerrit | Merged openstack/liberasurecode: Remove version value from README.md https://review.openstack.org/325046 | 13:05 |
*** sams-gleb has joined #openstack-swift | 13:05 | |
*** sams-gleb has quit IRC | 13:06 | |
*** sams-gleb has joined #openstack-swift | 13:06 | |
*** admin6 has quit IRC | 13:07 | |
*** kei_yama has quit IRC | 13:08 | |
*** sams-gle_ has joined #openstack-swift | 13:09 | |
*** sams-gleb has quit IRC | 13:09 | |
*** daemontool has joined #openstack-swift | 13:16 | |
mahatic | tdasilva: morning | 13:23 |
tdasilva | mahatic: o/ | 13:25 |
*** ametts has joined #openstack-swift | 13:52 | |
*** pauloewerton has joined #openstack-swift | 13:55 | |
*** sheel has quit IRC | 13:55 | |
*** MikeG451 has joined #openstack-swift | 13:56 | |
*** ChanServ changes topic to "Let's talk! We're nice | Review Dashboard: https://goo.gl/mtEv1C | Logs: http://eavesdrop.openstack.org/irclogs/%23openstack-swift/ | Meetings: https://wiki.openstack.org/wiki/Meetings/Swift | Community Dashboard: http://not.mn/swift/swift_community_dashboard.html" | 14:01 | |
-openstackstatus- NOTICE: Cleanup from earlier block storage disruption on static.openstack.org has been repaired, and any jobs which reported an "UNSTABLE" result or linked to missing logs between 08:00-14:00 UTC can be retriggered by leaving a "recheck" comment. | 14:01 | |
*** joeljwright has joined #openstack-swift | 14:05 | |
*** ChanServ sets mode: +v joeljwright | 14:05 | |
*** ouchkernel has joined #openstack-swift | 14:15 | |
Vinsh | zigo: ACK, ty for the info | 14:18 |
*** _JZ_ has joined #openstack-swift | 14:19 | |
*** CarlFK has joined #openstack-swift | 14:22 | |
CarlFK | >>> connection | 14:32 |
CarlFK | <swiftclient.client.Connection object at 0x7f09f95f0828> | 14:32 |
CarlFK | good. | 14:32 |
CarlFK | >>> connection.put_object('example','swift_uploader.py', open('swift_uploader.py','r') ) | 14:32 |
CarlFK | TypeError: 'str' does not support the buffer interface | 14:33 |
CarlFK | What? | 14:33 |
CarlFK | http://paste.ubuntu.com/16947614/ full stack dump | 14:33 |
*** hseipp has joined #openstack-swift | 14:34 | |
*** links has quit IRC | 14:36 | |
CarlFK | this works: >>> connection.put_object('example','swift_uploader.py', open('swift_uploader.py','r').read() ) | 14:45 |
CarlFK | but my files will be 100s of meg, so I don't really want to do that | 14:45 |
zaitcev | or you can open with 'rb' | 14:46 |
zaitcev | that's a workaround though | 14:46 |
*** rcernin has quit IRC | 14:46 | |
joeljwright | CarlFK: you're using python3 and opening in text mode | 14:47 |
joeljwright | the uploads need to be binary data | 14:47 |
CarlFK | ah | 14:47 |
CarlFK | thank you!!! | 14:47 |
joeljwright | hence zaitcev's solution | 14:47 |
joeljwright | open with 'rb' not 'r' | 14:48 |
*** sgundur1 has joined #openstack-swift | 14:52 | |
*** raildo is now known as raildo-afk | 14:53 | |
*** dmorita has joined #openstack-swift | 14:53 | |
joeljwright | CarlFK: if you're uploading lots of files you might want to try the SwiftService code - it handles a lot of this for you and will upload many files in parallel using a thread pool | 14:54 |
joeljwright | CarlFK: there's an example here: https://github.com/openstack/python-swiftclient/blob/master/examples/upload.py | 14:55 |
CarlFK | joeljwright: yeah, that example code is everywhere | 14:55 |
CarlFK | arg.. I hate that !!! | 14:55 |
*** arch-nemesis has joined #openstack-swift | 14:55 | |
*** arch-nemesis has joined #openstack-swift | 14:56 | |
joeljwright | CarlFK: ?? I'm happy to help if I can... | 14:56 |
CarlFK | I don't think that is a good example. It may be useful for uploading files, but as an example of how to use the SwiftService things.. they are all tangled up in clever code to manage walking a dir tree | 14:57 |
CarlFK | it is like 60+ lines. I think it should be about 6. | 14:57 |
joeljwright | CarlFK: the issue there is introducing the renaming of the files | 14:58 |
*** adu has joined #openstack-swift | 14:58 | |
joeljwright | most people don't want to upload files with the full filesystem path | 14:59 |
joeljwright | if you want to create objects without the full path you have to make the SwiftUploadObjects to tell the service how to rename them | 15:00 |
joeljwright | the only reason I mention it is because there's a lot of logic built into the service code to be helpful | 15:00 |
CarlFK | um... I ask this to better understand what it does, and also my app needs it: | 15:02 |
CarlFK | h = connection.put_object('example','swift_uploader.py', open('swift_uploader.py','rb') ) | 15:03 |
CarlFK | how can I get the ... URL to wget the file from? | 15:03 |
*** zul has quit IRC | 15:05 | |
joeljwright | CarlFK: you can't just wget an uploaded file, you need to make an authenticated download request using Connection.get_object(…) | 15:05 |
*** zul has joined #openstack-swift | 15:05 | |
CarlFK | um.. yes I can... | 15:05 |
*** _JZ__ has joined #openstack-swift | 15:07 | |
CarlFK | curl http://5cda49ca88af98bf1f1e-b4c3b47b38bb1b572e0805ecabeeb59c.r76.cf2.rackcdn.com/swift_uploader.py | 15:08 |
*** _JZ_ has quit IRC | 15:08 | |
joeljwright | CarlFK: Ok, so you're using rackspace + staticweb | 15:09 |
joeljwright | in which case I have no experience of what you're doing | 15:10 |
joeljwright | I don't use rackspace myself | 15:11 |
*** klrmn has joined #openstack-swift | 15:11 | |
*** sams-gle_ has quit IRC | 15:12 | |
mahatic | acoles: I left a comment on patch 318148, might account for a small change? | 15:14 |
patchbot | mahatic: https://review.openstack.org/#/c/318148/ - swift (feature/crypto) - crypto - stop using key id to derive GET path keys | 15:14 |
acoles | mahatic: about the override flag? I'm inclined to leave it there for future use, it is covered by tests, and that avoids more code churn. | 15:15 |
openstackgerrit | Alistair Coles proposed openstack/swift: Use source etag when copying unless using Range header https://review.openstack.org/324607 | 15:15 |
mahatic | acoles: oic | 15:16 |
*** suyash has joined #openstack-swift | 15:16 | |
*** ChubYann has quit IRC | 15:23 | |
*** rcernin has joined #openstack-swift | 15:31 | |
notmyname | good morning | 15:31 |
*** klamath has joined #openstack-swift | 15:32 | |
CarlFK | joeljwright: hmm. well.. from what you said about "logic built into the service code..." I suspect if I dig around in there I will find where it constructs a object ID. | 15:33 |
CarlFK | but.. I have to run for a few hours - bbl | 15:33 |
*** CarlFK has quit IRC | 15:34 | |
*** ChubYann has joined #openstack-swift | 15:35 | |
*** d0ugal has quit IRC | 15:39 | |
*** rcernin has quit IRC | 15:39 | |
*** asettle has quit IRC | 15:42 | |
*** elambert_ has joined #openstack-swift | 15:44 | |
tdasilva | acoles: i'm probably missing something obvious here, but where does that 6 come from? https://review.openstack.org/#/c/324607/2/test/unit/common/middleware/test_copy.py@613 | 15:49 |
patchbot | tdasilva: patch 324607 - swift - Use source etag when copying unless using Range he... | 15:49 |
tdasilva | passed, got it | 15:49 |
acoles | tdasilva: it's the length of the range, gets set in swob.Response https://github.com/openstack/swift/blob/219e259ae8310f57dcebdc9bb5e379654f61b69f/swift/common/swob.py#L1262-L1262 | 15:52 |
tdasilva | acoles: thanks | 16:00 |
*** bill_az has joined #openstack-swift | 16:04 | |
*** garthb has joined #openstack-swift | 16:11 | |
*** sams-gleb has joined #openstack-swift | 16:12 | |
*** klrmn has quit IRC | 16:13 | |
*** dmorita has quit IRC | 16:13 | |
*** dmorita has joined #openstack-swift | 16:15 | |
*** sams-gleb has quit IRC | 16:18 | |
openstackgerrit | Alistair Coles proposed openstack/swift: crypto - purge crypto sysmeta from responses https://review.openstack.org/320579 | 16:18 |
*** jmccarthy has quit IRC | 16:19 | |
*** tesseract has quit IRC | 16:19 | |
notmyname | FYI my company put together some reference architectures for hardware. while it's got our logo on it, it's pretty good info for people looking to build a swift cluster | 16:20 |
notmyname | https://www.swiftstack.com/wp-content/uploads/2016/05/SwiftStack-Reference-Architectures-05_2016.pdf | 16:20 |
acoles | tdasilva: timburke tests still pass when I cherry pick patch 324607 onto patch 320579 (note I ripped off the change to copy.py on master in 320579 on feature/crypto) | 16:21 |
patchbot | acoles: https://review.openstack.org/#/c/324607/ - swift - Use source etag when copying unless using Range he... | 16:21 |
patchbot | acoles: https://review.openstack.org/#/c/320579/ - swift (feature/crypto) - crypto - purge crypto sysmeta from responses | 16:21 |
tdasilva | acoles: cool! I gave a +1 on 324607, wasn't sure if it'd ok for me to add a +2... | 16:23 |
acoles | tdasilva: *I* think you can :) | 16:24 |
*** jmccarthy has joined #openstack-swift | 16:25 | |
acoles | tdasilva: see what timburke thinks | 16:25 |
*** sheel has joined #openstack-swift | 16:30 | |
*** rcernin has joined #openstack-swift | 16:31 | |
timburke | acoles: i think you're setting me up for some form of voter fraud... | 16:33 |
jrichli | notmyname: nice! thanks for sharing | 16:36 |
openstackgerrit | Alistair Coles proposed openstack/swift: crypto - add overview doc https://review.openstack.org/312096 | 16:40 |
*** rledisez has quit IRC | 16:41 | |
*** ankur-gupta-f2 has joined #openstack-swift | 16:45 | |
*** nadeem has joined #openstack-swift | 16:47 | |
*** nadeem has quit IRC | 16:47 | |
*** nadeem has joined #openstack-swift | 16:48 | |
pdardeau | notmyname: clayg: yesterday you guys made brief mention of 'hub starvation'. can you explain what that means? (sorry if this is a dumb question) | 16:49 |
notmyname | pdardeau: sure | 16:49 |
pdardeau | also, i'm happy to rtfm if you can point me to tfm ;-) | 16:49 |
notmyname | imagine this. you've got a bunch of greenlets all doing some blocking IO call and wrapped in a Timeout() | 16:50 |
notmyname | since they are all in the same thread, the OS can't reschedule the different greenlets to different cores or anything | 16:50 |
notmyname | so what if you've got a 5 second timeout but it takes 3 seconds to get a result back and you've got 10 different greenlets going at the same time | 16:51 |
notmyname | basically, the eventlet hub which is coordinating all of the greenlets can't cycle around to all of the greenlets before the timeout happens | 16:51 |
notmyname | so even though the operation may have succeeded, you'll still get the timeout | 16:52 |
pdardeau | notmyname: cool! thanks for that explanation. it clarifies a lot. | 16:52 |
notmyname | thus the "hub starvation" issue is when eventlet can't handle all the greenlets in atimely manner | 16:52 |
notmyname | when eventlet switches back to a greenlet, it checks the timeout at that moment, not at the moment when the blocking IO result was available | 16:53 |
notmyname | you can simulate it in a little test script on your box. wrap an eventlet IO call (eg some disk IO) in an N-second timeout. then have another greenlet time.sleep(N+1) [importantly, don't use the monkey-patched sleep] | 16:55 |
notmyname | the sleep will halt the whole process, and when eventlet switches back to the greenlet that did the IO, the Timeout() will fire and you'll get an error | 16:55 |
*** garthb has quit IRC | 16:58 | |
notmyname | FYI there's been a couple of more comments on the golang TC resolution https://review.openstack.org/#/c/312267/ | 16:59 |
patchbot | notmyname: patch 312267 - governance - add golang as an approved language | 16:59 |
openstackgerrit | Shashirekha Gundur proposed openstack/swift: Added unit test cases for cli/recon.py https://review.openstack.org/282547 | 17:03 |
*** garthb has joined #openstack-swift | 17:14 | |
*** sams-gleb has joined #openstack-swift | 17:15 | |
*** klrmn has joined #openstack-swift | 17:16 | |
openstackgerrit | Tim Burke proposed openstack/swift: Autovivify X-Versions-Location container https://review.openstack.org/265015 | 17:17 |
*** sams-gleb has quit IRC | 17:20 | |
*** rvasilets__ has joined #openstack-swift | 17:22 | |
*** joeljwright has quit IRC | 17:26 | |
ahale | oh that TC resolution thread is interesting | 17:28 |
ahale | i wonder which way it will drift now | 17:28 |
openstackgerrit | Merged openstack/swift: Imported Translations from Zanata https://review.openstack.org/325078 | 17:35 |
*** hseipp has quit IRC | 17:36 | |
*** ukaynar has joined #openstack-swift | 17:36 | |
*** ukaynar has quit IRC | 17:37 | |
*** nadeem has quit IRC | 17:40 | |
*** nadeem has joined #openstack-swift | 17:41 | |
*** daemontool has quit IRC | 17:44 | |
*** klamath has quit IRC | 17:52 | |
*** permalac has quit IRC | 17:58 | |
notmyname | ahale: indeed | 18:00 |
*** CaioBrentano has joined #openstack-swift | 18:05 | |
*** tqtran has joined #openstack-swift | 18:06 | |
*** CaioBrentano has quit IRC | 18:17 | |
*** nadeem has quit IRC | 18:17 | |
*** sambhare has joined #openstack-swift | 18:19 | |
*** suyash has quit IRC | 18:19 | |
acoles | notmyname: a quick update re crypto work - I have merged some stuff but there are three remaining patches listed on priority review page need to merge before we move to another branch | 18:20 |
notmyname | thanks. I had just seen those listed on priorityReviews | 18:21 |
acoles | notmyname: i know that jrichli is looking at https://review.openstack.org/318148 | 18:21 |
notmyname | briancli1e: I'm trying to remember our conversation about having commit SHAs (re your comment on https://review.openstack.org/#/c/324742/) | 18:22 |
patchbot | notmyname: patch 324742 - swift - AUTHORS/CHANGELOG updates for 2.8.0 release | 18:22 |
acoles | notmyname: I considered landing this one https://review.openstack.org/316924 but haven't yet, ideally it would get some review (actually timburke did but saw some errors that I have never been able to reproduce) | 18:22 |
acoles | notmyname: so hopefully early next week we'll be ready | 18:23 |
notmyname | acoles: that one's described as "no crypto knowledge needed". is it something that could/should be on master anyway? | 18:23 |
*** thumpba has joined #openstack-swift | 18:23 | |
timburke | acoles: yeah, i'm 99% sure that was just something in my env. lemme look again real quick, then i'll land it | 18:24 |
notmyname | clarkb: head's up, looks like there's a good chance for me to request a feature branch created early next week (feature/crypto_review) | 18:24 |
acoles | notmyname: the changes are only needed for crypto. basically, where we make assertions about the actual on disk data has to change to make assertions about the consistency of data because we may not know the ondisk data if it has been encrypted. | 18:25 |
*** ankur-gupta-f2 has left #openstack-swift | 18:25 | |
acoles | timburke: thank you. iirc i made a couple of small changes to the reconciler probe test since you last looked. minor i think, just to reassure myself. | 18:25 |
notmyname | ok | 18:26 |
acoles | timburke: pleas do go ahead and +A if you are happy since I am about to leave for weekend | 18:26 |
timburke | acoles: already did :-) | 18:26 |
acoles | notmyname: the doc patch I added +A earlier | 18:26 |
acoles | notmyname: any other patches on feature/crypto that are not listed on priority reviews are not requirements to move forward (IMO) - they could always be follow ups. | 18:27 |
*** NM1 has joined #openstack-swift | 18:27 | |
acoles | hey that timburke is *fast* - thanks! | 18:28 |
notmyname | great | 18:28 |
timburke | i'd already started looking at it... comments were already there | 18:28 |
acoles | notmyname: end of update. have a good weekend. | 18:29 |
*** NM has quit IRC | 18:29 | |
notmyname | acoles: thanks :-) | 18:29 |
notmyname | for the update. | 18:29 |
notmyname | have a good weekend | 18:29 |
acoles | sun is shining here :) | 18:30 |
*** NM has joined #openstack-swift | 18:30 | |
*** acoles is now known as acoles_ | 18:31 | |
*** NM1 has quit IRC | 18:34 | |
Vinsh | ERROR: Invalid Storage Policy Configuration in /etc/swift/swift.conf (Invalid option 'aliases' in storage-policy section, for index '0') | 18:44 |
Vinsh | how? :) | 18:44 |
notmyname | Vinsh: sounds like an older version of swift loading a newer config file | 18:44 |
Vinsh | This is swift 2.5.0 | 18:45 |
*** sheel has quit IRC | 18:45 | |
*** zul has quit IRC | 18:45 | |
notmyname | aliases were introduced in 2.6.0 | 18:45 |
Vinsh | d'oh. Thanks for the reality check :) | 18:46 |
notmyname | Vinsh: however, extra config options throwing an error is annoying (IMO) | 18:46 |
Vinsh | Yeah, I hadn't kept track and assumed aliases were always there. | 18:46 |
timburke | i was just thinking that. that feels like it ought to be a warning rather than an error | 18:46 |
*** asettle has joined #openstack-swift | 18:47 | |
notmyname | timburke: storage_policy.py:257 | 18:49 |
notmyname | timburke: if it's not in the config map, error is raised and turned into SystemExit | 18:49 |
*** bill_az has quit IRC | 18:49 | |
notmyname | timburke: maybe we could make a PolicyWarning exception and raise that? or just log a warning? logging could be hard to get plumbed through | 18:50 |
notmyname | or just flat out ignore it? | 18:50 |
notmyname | all the other configs just ignore extra config options | 18:51 |
*** zul has joined #openstack-swift | 18:51 | |
*** asettle has quit IRC | 18:52 | |
*** adu has quit IRC | 18:55 | |
*** zul has quit IRC | 18:56 | |
*** zul has joined #openstack-swift | 18:56 | |
*** bill_az has joined #openstack-swift | 18:56 | |
timburke | notmyname: yeah, but just ignoring it would kinda suck if you typed alaises instead of aliases. personally, i'd prefer the warning | 18:57 |
clayg | yeah i guess at somepoint someone reasoned that the immutable policy settings in the swift.conf were important to get "right" | 19:02 |
*** mvk_ has joined #openstack-swift | 19:08 | |
*** sams-gleb has joined #openstack-swift | 19:16 | |
*** sams-gleb has quit IRC | 19:21 | |
*** ametts has quit IRC | 19:22 | |
*** garthb_ has joined #openstack-swift | 19:24 | |
*** garthb has quit IRC | 19:25 | |
*** thumpba_ has joined #openstack-swift | 19:26 | |
*** thumpba has quit IRC | 19:28 | |
*** Jeffrey4l_ has quit IRC | 19:30 | |
*** Jeffrey4l_ has joined #openstack-swift | 19:35 | |
*** adu has joined #openstack-swift | 19:36 | |
openstackgerrit | Merged openstack/swift: crypto - make some probe tests compatible with crypto https://review.openstack.org/316924 | 19:43 |
openstackgerrit | Merged openstack/swift: crypto - add overview doc https://review.openstack.org/312096 | 19:44 |
*** asettle has joined #openstack-swift | 19:58 | |
*** klamath has joined #openstack-swift | 19:58 | |
*** asettle has quit IRC | 19:58 | |
openstackgerrit | Mohit Motiani proposed openstack/python-swiftclient: Insufficent info about read and write ACL syntax https://review.openstack.org/324739 | 19:59 |
-openstackstatus- NOTICE: The infrastructure team is taking Gerrit offline for maintenance this afternoon, beginning shortly after 20:00 UTC. We aim to have it back online around 00:00 UTC. | 20:00 | |
*** adu has quit IRC | 20:01 | |
*** nadeem has joined #openstack-swift | 20:04 | |
-openstackstatus- NOTICE: Gerrit is offline for maintenance until 00:00 UTC | 20:11 | |
*** ChanServ changes topic to "Gerrit is offline for maintenance until 00:00 UTC" | 20:11 | |
*** sambhare has quit IRC | 20:12 | |
*** sambhare has joined #openstack-swift | 20:12 | |
*** rcernin has quit IRC | 20:15 | |
*** gyee has joined #openstack-swift | 20:16 | |
*** sambhare has quit IRC | 20:17 | |
*** sambhare has joined #openstack-swift | 20:18 | |
*** sambhare has quit IRC | 20:18 | |
*** NM1 has joined #openstack-swift | 20:23 | |
*** NM has quit IRC | 20:25 | |
*** elambert_ has quit IRC | 20:29 | |
*** ouchkernel has quit IRC | 20:33 | |
*** ouchkernel has joined #openstack-swift | 20:39 | |
*** suyash has joined #openstack-swift | 20:59 | |
*** nadeem has quit IRC | 21:03 | |
*** pauloewerton has quit IRC | 21:09 | |
*** sams-gleb has joined #openstack-swift | 21:18 | |
*** sams-gleb has quit IRC | 21:23 | |
*** geaaru has quit IRC | 21:23 | |
*** sgundur1 has left #openstack-swift | 21:29 | |
*** daemontool has joined #openstack-swift | 21:31 | |
*** lcurtis has joined #openstack-swift | 21:33 | |
*** NM1 has quit IRC | 21:33 | |
*** arch-nemesis has quit IRC | 21:38 | |
*** klrmn has quit IRC | 21:44 | |
*** klrmn has joined #openstack-swift | 21:45 | |
*** rvasilets__ has quit IRC | 21:46 | |
*** arch-nemesis has joined #openstack-swift | 21:54 | |
*** daemontool has quit IRC | 22:26 | |
*** dmorita has quit IRC | 22:26 | |
*** dmorita_ has joined #openstack-swift | 22:27 | |
*** thumpba_ has quit IRC | 22:27 | |
*** MikeG451 has quit IRC | 22:45 | |
*** NM has joined #openstack-swift | 22:56 | |
*** sams-gleb has joined #openstack-swift | 23:00 | |
*** sams-gleb has quit IRC | 23:05 | |
*** mvk_ has quit IRC | 23:06 | |
*** klamath has quit IRC | 23:11 | |
*** adu has joined #openstack-swift | 23:16 | |
notmyname | FYI, my status on some of the swift-in-pypy testing. last issue that I had seen has been resolved, and we're working on pushing that upstream. it was a bug in eventlet (https://github.com/eventlet/eventlet/issues/318). After this gets resolved in eventlet upstream, I want to bump the min version of eventlet in our requirements and re-introduce the pypy gate job in -infra | 23:18 |
*** lcurtis has quit IRC | 23:23 | |
*** thumpba has joined #openstack-swift | 23:28 | |
*** suyash has quit IRC | 23:29 | |
notmyname | hmm....gerrit is down, all my meetings are over, and it's 4:30 on friday. I think I'm going home | 23:29 |
*** adu has quit IRC | 23:32 | |
*** thumpba has quit IRC | 23:33 | |
*** NM has quit IRC | 23:34 | |
*** gyee has quit IRC | 23:43 | |
*** garthb_ has quit IRC | 23:58 | |
*** _JZ__ has quit IRC | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!