*** nexusz99 has quit IRC | 00:00 | |
*** nadeem has quit IRC | 00:01 | |
*** lcurtis has quit IRC | 00:08 | |
*** jamielennox is now known as jamielennox|away | 00:08 | |
*** siva_krishnan has quit IRC | 00:10 | |
*** nexusz99 has joined #openstack-swift | 00:11 | |
*** siva_krishnan has joined #openstack-swift | 00:11 | |
*** nexusz99 has quit IRC | 00:12 | |
*** nbalaji has quit IRC | 00:18 | |
*** joeljwright has quit IRC | 00:19 | |
*** siva_krishnan has quit IRC | 00:19 | |
*** jamielennox|away is now known as jamielennox | 00:21 | |
*** m_kazuhiro has joined #openstack-swift | 00:28 | |
*** dmorita has joined #openstack-swift | 00:43 | |
*** diogogmt has quit IRC | 00:48 | |
notmyname | I get the same error as the gate when I run the unittests under tox. for https://review.openstack.org/#/c/244287/ | 00:49 |
---|---|---|
clayg | notmyname: yay! reproducibility is key! | 00:52 |
*** itlinux has joined #openstack-swift | 00:59 | |
*** bill_az has quit IRC | 01:08 | |
*** garthb__ has quit IRC | 01:10 | |
*** m_kazuhiro has quit IRC | 01:12 | |
*** m_kazuhiro has joined #openstack-swift | 01:12 | |
*** chsc has quit IRC | 01:15 | |
peluse | notmyname: beats me, I'm working from home | 01:21 |
peluse | notmyname: but he's not on internal IM either so probably not | 01:21 |
clayg | http://stackoverflow.com/questions/20124472/python-float-to-ratio lol @ Possible duplicates: every question ever asked about floating point math. | 01:35 |
*** lyrrad has quit IRC | 01:36 | |
*** mahatic has joined #openstack-swift | 01:36 | |
*** haomaiwa_ has joined #openstack-swift | 01:37 | |
notmyname | peluse: ah, ok. thanks | 01:38 |
notmyname | peluse: we're not in the same TZ anymore are we? | 01:38 |
mahatic | good morning! | 01:39 |
notmyname | hello mahatic | 01:39 |
peluse | notmyname: nope, you guys are an hour behind us now | 01:39 |
mahatic | hello notmyname | 01:39 |
peluse | mahatic: morning! | 01:40 |
notmyname | peluse: I think the correct phrase is that you're in The FUTURE! | 01:40 |
peluse | notmyname: most of the time i feel more like I'm in the past though :) | 01:40 |
mahatic | peluse: morning! | 01:40 |
mahatic | notmyname: nope, I am in the future, ha! | 01:40 |
peluse | OK, gotta go cook up some dinner.... l8r | 01:40 |
notmyname | peluse: that's only until DST ends ;-) | 01:40 |
notmyname | mahatic: It hink Zyric has us all beat. already nearly 3pm there ;-) | 01:41 |
mahatic | notmyname: oh yeah heh | 01:41 |
*** asettle is now known as asettle-afk | 01:44 | |
*** itlinux has quit IRC | 01:46 | |
*** pdardeau has joined #openstack-swift | 01:51 | |
*** Guest21151 has quit IRC | 01:54 | |
*** pdardeau has quit IRC | 01:56 | |
*** pdardeau has joined #openstack-swift | 01:57 | |
*** haomaiwa_ has quit IRC | 02:01 | |
*** haomaiwa_ has joined #openstack-swift | 02:01 | |
openstackgerrit | Tim Burke proposed openstack/swift: Stop logging "client disconnected" for 304 / 412 responses https://review.openstack.org/244394 | 02:06 |
*** bill_az has joined #openstack-swift | 02:12 | |
*** diogogmt has joined #openstack-swift | 02:13 | |
*** klrmn1 has quit IRC | 02:13 | |
*** gyee has quit IRC | 02:14 | |
*** pdardeau has quit IRC | 02:18 | |
*** zhill has quit IRC | 02:18 | |
clayg | how about the clients stop disconnecting!? | 02:21 |
clayg | oh wait... maybe I didn't read that correctly | 02:21 |
*** bill_az has quit IRC | 02:21 | |
*** Lickitysplitted has quit IRC | 02:32 | |
*** lnxnut has joined #openstack-swift | 02:37 | |
*** Lickitysplitted has joined #openstack-swift | 02:45 | |
openstackgerrit | Merged openstack/python-swiftclient: Centralize header parsing https://review.openstack.org/184336 | 02:53 |
*** haomaiwa_ has quit IRC | 03:01 | |
*** haomaiwa_ has joined #openstack-swift | 03:01 | |
*** mahatic has quit IRC | 03:04 | |
openstackgerrit | Clay Gerrard proposed openstack/swift: Ring Overview updates https://review.openstack.org/244412 | 03:05 |
clayg | gah - doing doc is the worst | 03:08 |
clayg | but it's good I picked at the overview because it was full of references to multiple replicas of the same part on the same device - lawl! | 03:10 |
*** wbhuber_ has joined #openstack-swift | 03:24 | |
*** wbhuber has quit IRC | 03:27 | |
*** jrichli has joined #openstack-swift | 03:28 | |
*** diazjf has joined #openstack-swift | 03:31 | |
*** diazjf has quit IRC | 03:34 | |
*** diazjf has joined #openstack-swift | 03:36 | |
*** rjaiswal has quit IRC | 03:45 | |
openstackgerrit | Merged openstack/swift: Added unit tests for ringbuilder command-line utility https://review.openstack.org/240076 | 03:47 |
*** jrichli_ has joined #openstack-swift | 03:49 | |
*** jrichli has quit IRC | 03:52 | |
*** sw3 has joined #openstack-swift | 03:52 | |
*** haomaiwa_ has quit IRC | 04:01 | |
*** haomaiwang has joined #openstack-swift | 04:01 | |
*** SkyRocknRoll has joined #openstack-swift | 04:08 | |
*** badari has quit IRC | 04:17 | |
*** badari has joined #openstack-swift | 04:22 | |
*** wbhuber_ has quit IRC | 04:26 | |
*** mahatic has joined #openstack-swift | 04:30 | |
*** haomaiwang has quit IRC | 04:37 | |
*** SkyRocknRoll has quit IRC | 04:38 | |
*** ppai has joined #openstack-swift | 04:40 | |
*** haomaiwang has joined #openstack-swift | 04:42 | |
*** ppai has quit IRC | 04:52 | |
*** haomaiwang has quit IRC | 04:56 | |
openstackgerrit | Clay Gerrard proposed openstack/swift: Bump PyECLib requirement to >=1.0.7 https://review.openstack.org/244287 | 05:06 |
*** links has joined #openstack-swift | 05:07 | |
*** asettle-afk is now known as asettle | 05:08 | |
*** jrichli_ has quit IRC | 05:09 | |
*** haomaiwang has joined #openstack-swift | 05:13 | |
*** diazjf has quit IRC | 05:26 | |
*** haomaiwang has quit IRC | 05:27 | |
*** haomaiwang has joined #openstack-swift | 05:38 | |
*** haomaiwang has quit IRC | 05:50 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/python-swiftclient: Updated from global requirements https://review.openstack.org/89250 | 05:58 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 05:58 |
*** trifon has joined #openstack-swift | 06:00 | |
*** km has joined #openstack-swift | 06:08 | |
*** km is now known as Guest45380 | 06:08 | |
*** haomaiwa_ has joined #openstack-swift | 06:09 | |
*** jerrygb has quit IRC | 06:14 | |
*** tsg has joined #openstack-swift | 06:21 | |
*** haomaiwa_ has quit IRC | 06:21 | |
tsg | notmyname, clayg: sorry was away with some ongoing 'Diwali' festivities today - will take a closer look at what's going on with patch 244287 | 06:23 |
patchbot | tsg: https://review.openstack.org/#/c/244287/ - Bump PyECLib requirement to >=1.0.7 | 06:23 |
tsg | looks like clayg's tox.ini change for LD_LIBRARY_PATH didn't help either | 06:23 |
*** haomaiwang has joined #openstack-swift | 06:25 | |
*** trifon_ has joined #openstack-swift | 06:38 | |
*** mac_ified has quit IRC | 06:41 | |
*** sc68cal has quit IRC | 06:45 | |
*** links has quit IRC | 06:45 | |
*** tsg has quit IRC | 07:00 | |
*** haomaiwang has quit IRC | 07:01 | |
*** haomaiwang has joined #openstack-swift | 07:01 | |
*** pchng_ has joined #openstack-swift | 07:03 | |
*** haomaiwang has quit IRC | 07:04 | |
*** links has joined #openstack-swift | 07:05 | |
*** pchng has quit IRC | 07:05 | |
*** mzhou has quit IRC | 07:08 | |
*** okdas has quit IRC | 07:14 | |
*** okdas has joined #openstack-swift | 07:15 | |
*** okdas has joined #openstack-swift | 07:15 | |
*** janonymous has joined #openstack-swift | 07:22 | |
*** haomaiwang has joined #openstack-swift | 07:24 | |
janonymous | notmyname, lifeless : I saw the comments above about testr , really now the picture is more clear :) | 07:28 |
*** haomaiwang has quit IRC | 07:38 | |
*** haomaiwang has joined #openstack-swift | 07:40 | |
*** haomaiwang has quit IRC | 07:51 | |
*** dmorita has quit IRC | 07:53 | |
*** aix has joined #openstack-swift | 07:55 | |
*** haomaiwa_ has joined #openstack-swift | 07:56 | |
*** janonymous has quit IRC | 08:00 | |
*** haomaiwa_ has quit IRC | 08:01 | |
*** haomaiwang has joined #openstack-swift | 08:01 | |
*** arnox has joined #openstack-swift | 08:04 | |
*** haomaiwang has quit IRC | 08:14 | |
*** rledisez has joined #openstack-swift | 08:15 | |
*** haomaiwang has joined #openstack-swift | 08:16 | |
*** sc68cal has joined #openstack-swift | 08:31 | |
*** haomaiwang has quit IRC | 08:32 | |
*** haomaiwang has joined #openstack-swift | 08:33 | |
*** ho has quit IRC | 08:39 | |
*** Pablo|off| has joined #openstack-swift | 08:40 | |
*** janonymous has joined #openstack-swift | 08:44 | |
*** geaaru has joined #openstack-swift | 08:46 | |
*** Pablo|off| is now known as pcaruana | 08:48 | |
*** rcernin has joined #openstack-swift | 08:50 | |
*** haomaiwang has quit IRC | 09:00 | |
*** janonymous has quit IRC | 09:01 | |
*** jistr has joined #openstack-swift | 09:03 | |
*** jordanP has joined #openstack-swift | 09:07 | |
*** haomaiwang has joined #openstack-swift | 09:08 | |
*** aix has quit IRC | 09:19 | |
*** aix has joined #openstack-swift | 09:21 | |
*** haomaiwang has quit IRC | 09:34 | |
*** haomaiwa_ has joined #openstack-swift | 09:38 | |
*** Zyric has quit IRC | 09:43 | |
*** openstackgerrit has quit IRC | 09:46 | |
*** openstackgerrit has joined #openstack-swift | 09:46 | |
*** haomaiwa_ has quit IRC | 09:58 | |
*** haomaiwa_ has joined #openstack-swift | 09:59 | |
*** haomaiwa_ has quit IRC | 10:01 | |
*** haomaiwa_ has joined #openstack-swift | 10:01 | |
*** haomaiwa_ has quit IRC | 10:11 | |
*** haomaiwang has joined #openstack-swift | 10:13 | |
*** openstackgerrit has quit IRC | 10:16 | |
*** openstackgerrit has joined #openstack-swift | 10:16 | |
*** joeljwright has joined #openstack-swift | 10:26 | |
*** ChanServ sets mode: +v joeljwright | 10:26 | |
*** haomaiwang has quit IRC | 10:31 | |
*** haomaiwang has joined #openstack-swift | 10:36 | |
*** jmccarthy has joined #openstack-swift | 10:38 | |
*** esker has joined #openstack-swift | 10:39 | |
*** jistr_ has joined #openstack-swift | 10:48 | |
*** rcernin_ has joined #openstack-swift | 10:48 | |
*** haomaiwang has quit IRC | 10:48 | |
*** aix_ has joined #openstack-swift | 10:48 | |
*** jistr has quit IRC | 10:49 | |
*** rcernin has quit IRC | 10:49 | |
*** rcernin has joined #openstack-swift | 10:50 | |
*** 7F1AAZM53 has joined #openstack-swift | 10:51 | |
*** aix has quit IRC | 10:51 | |
*** aix_ has quit IRC | 10:53 | |
*** rcernin_ has quit IRC | 10:53 | |
*** jistr_ has quit IRC | 10:54 | |
*** 7F1AAZM53 has quit IRC | 11:01 | |
*** haomaiwang has joined #openstack-swift | 11:01 | |
*** haomaiwang has quit IRC | 11:02 | |
*** aix_ has joined #openstack-swift | 11:05 | |
*** jistr_ has joined #openstack-swift | 11:05 | |
*** jamielennox is now known as jamielennox|away | 11:12 | |
*** haomaiwang has joined #openstack-swift | 11:12 | |
*** esker has quit IRC | 11:13 | |
*** jerrygb has joined #openstack-swift | 11:15 | |
*** esker has joined #openstack-swift | 11:17 | |
*** jerrygb has quit IRC | 11:19 | |
*** esker has quit IRC | 11:22 | |
*** haomaiwang has quit IRC | 11:24 | |
*** haomaiwang has joined #openstack-swift | 11:30 | |
*** Chavers has joined #openstack-swift | 11:32 | |
*** lnxnut has quit IRC | 11:39 | |
*** lpabon has joined #openstack-swift | 11:39 | |
*** haomaiwang has quit IRC | 11:41 | |
*** badari has quit IRC | 11:45 | |
*** haomaiwang has joined #openstack-swift | 11:47 | |
*** joeljwright has quit IRC | 11:58 | |
openstackgerrit | Merged openstack/swift: Fix testing issues https://review.openstack.org/235933 | 11:58 |
*** haomaiwang has quit IRC | 12:01 | |
*** haomaiwang has joined #openstack-swift | 12:01 | |
*** marzif has joined #openstack-swift | 12:08 | |
*** haomaiwang has quit IRC | 12:11 | |
*** haomaiwang has joined #openstack-swift | 12:11 | |
*** m_kazuhiro has quit IRC | 12:14 | |
*** jistr_ is now known as jistr | 12:20 | |
*** haomaiwang has quit IRC | 12:22 | |
*** haomaiwang has joined #openstack-swift | 12:23 | |
*** Chavers has quit IRC | 12:25 | |
*** CaioBren_ has joined #openstack-swift | 12:33 | |
*** CaioBrentano has quit IRC | 12:36 | |
*** haomaiwang has quit IRC | 12:42 | |
*** Chavers has joined #openstack-swift | 12:45 | |
*** mahatic has quit IRC | 12:46 | |
*** siva_krishnan has joined #openstack-swift | 12:47 | |
*** Guest45380 has quit IRC | 12:55 | |
*** lpabon has quit IRC | 13:00 | |
*** mahatic has joined #openstack-swift | 13:03 | |
*** haomaiwang has joined #openstack-swift | 13:08 | |
*** jerrygb has joined #openstack-swift | 13:15 | |
*** jerrygb_ has joined #openstack-swift | 13:18 | |
*** jerrygb has quit IRC | 13:22 | |
*** MVenesio has joined #openstack-swift | 13:29 | |
*** diogogmt has quit IRC | 13:37 | |
*** jerrygb_ has quit IRC | 13:39 | |
*** diogogmt has joined #openstack-swift | 13:40 | |
*** CaioBren_ has quit IRC | 13:40 | |
*** joeljwright has joined #openstack-swift | 13:50 | |
*** ChanServ sets mode: +v joeljwright | 13:50 | |
*** haomaiwang has quit IRC | 14:01 | |
*** haomaiwang has joined #openstack-swift | 14:01 | |
*** CaioBrentano has joined #openstack-swift | 14:01 | |
*** diogogmt has quit IRC | 14:01 | |
*** bill_az has joined #openstack-swift | 14:08 | |
*** joeljwright has quit IRC | 14:09 | |
*** minwoob has joined #openstack-swift | 14:11 | |
*** wbhuber_ has joined #openstack-swift | 14:16 | |
*** bill_az has quit IRC | 14:17 | |
*** marzif has quit IRC | 14:20 | |
*** jerrygb has joined #openstack-swift | 14:22 | |
*** MVenesio has quit IRC | 14:26 | |
*** proteusguy__ has joined #openstack-swift | 14:27 | |
*** proteusguy_ has quit IRC | 14:29 | |
openstackgerrit | Sivasathurappan Radhakrishnan proposed openstack/swift: Added unit test cases for common/bufferedhttp.py https://review.openstack.org/244678 | 14:30 |
*** siva_krishnan has quit IRC | 14:31 | |
*** MVenesio has joined #openstack-swift | 14:31 | |
*** siva_krishnan has joined #openstack-swift | 14:32 | |
*** petertr7_away is now known as petertr7 | 14:33 | |
*** siva_krishnan has quit IRC | 14:38 | |
*** badari has joined #openstack-swift | 14:43 | |
*** petertr7 is now known as petertr7_away | 14:47 | |
*** petertr7_away is now known as petertr7 | 14:49 | |
*** blmartin has joined #openstack-swift | 14:54 | |
*** pchng_ is now known as pchng | 14:55 | |
*** haomaiwang has quit IRC | 14:58 | |
*** haypo has joined #openstack-swift | 15:04 | |
*** BAKfr has quit IRC | 15:06 | |
*** esker has joined #openstack-swift | 15:06 | |
*** diogogmt has joined #openstack-swift | 15:07 | |
*** diogogmt has quit IRC | 15:07 | |
*** BAKfr has joined #openstack-swift | 15:09 | |
*** tsg has joined #openstack-swift | 15:10 | |
*** diogogmt has joined #openstack-swift | 15:10 | |
*** lnxnut has joined #openstack-swift | 15:16 | |
*** breitz has quit IRC | 15:18 | |
*** breitz has joined #openstack-swift | 15:18 | |
*** marzif has joined #openstack-swift | 15:21 | |
*** siva_krishnan has joined #openstack-swift | 15:22 | |
*** jrichli has joined #openstack-swift | 15:25 | |
*** garthb has joined #openstack-swift | 15:28 | |
*** CaioBren_ has joined #openstack-swift | 15:29 | |
*** CaioBrentano has quit IRC | 15:32 | |
*** petertr7 is now known as petertr7_away | 15:46 | |
*** petertr7_away is now known as petertr7 | 15:49 | |
*** jlhinson has joined #openstack-swift | 15:52 | |
*** aix_ has quit IRC | 15:52 | |
*** aix has joined #openstack-swift | 15:56 | |
notmyname | tsg: clayg: in my saio, if I (starting from no pyeclib at all) install via `sudo pip install pyeclib==1.0.7` then I get *only* the python part and not the liberasurecode or any other .so. however, if I use `sudo -H pip install pyeclib==1.0.7` I get all the .so libs installed correctly | 15:57 |
notmyname | I think this is a hint as to what's going wrong with tox | 15:57 |
notmyname | (just not sure what it means yet) | 15:57 |
*** trifon has quit IRC | 15:59 | |
haypo | notmyname: since pip 6, pip has an internal wheel cache. so PyEClib setup.py is not run again if you already have a local cached wheel file. see: find /home/haypo/.cache/pip/ -iname "pyeclib*.whl" | 16:04 |
*** pdardeau has joined #openstack-swift | 16:04 | |
notmyname | ah ok | 16:04 |
haypo | notmyname: so you may remove the cached wheel files to replay the upgrade | 16:04 |
haypo | wheel packages are not compatible with the "let's install a custom C library in setup.py" :-) | 16:05 |
*** pdardeau has quit IRC | 16:06 | |
*** jlhinson has quit IRC | 16:08 | |
*** jlhinson has joined #openstack-swift | 16:08 | |
notmyname | I'm trying to get back into the state I had last night where it was failing | 16:09 |
*** tongli has joined #openstack-swift | 16:09 | |
notmyname | haypo: so it's probably as simple as you jsut said. wheels don't work with installing .sos | 16:12 |
notmyname | and that's why tsg was saying that he wants to get another liberasurecode package built and deployed to the CI slaves | 16:12 |
*** esker has quit IRC | 16:12 | |
*** esker has joined #openstack-swift | 16:13 | |
haypo | notmyname: it may work, since pip are usually only built locally. so setup.py is run locally at least once | 16:13 |
haypo | but downgrade dance may not work | 16:13 |
*** mattymo has left #openstack-swift | 16:14 | |
notmyname | the situation we're in now is that the swift code works with >=1.0.7, we want to move to >=1.1.1, we can get stuff working locally and reasonably expect it to work in prod for upgrades, but we can't get the gate to pass on this intermediate step | 16:15 |
haypo | notmyname: for gates, the best would be to have distro packages | 16:16 |
haypo | notmyname: last time i checked, Ubuntu & Fedora had packages for liberasurecode (Ubuntu: 1.1.0, Fedora: 1.0.9) | 16:17 |
*** links has quit IRC | 16:18 | |
haypo | https://launchpad.net/ubuntu/+source/liberasurecode & https://admin.fedoraproject.org/pkgdb/package/liberasurecode/ | 16:18 |
notmyname | 1.1.0 had a bad install path and that's why there's a 1.1.1 | 16:19 |
haypo | notmyname: it doesn't matter for a linux package which probably override the default prefix, no? | 16:19 |
*** CaioBren_ has quit IRC | 16:21 | |
*** mahatic has quit IRC | 16:24 | |
*** mahatic has joined #openstack-swift | 16:25 | |
*** jbonjean has left #openstack-swift | 16:25 | |
*** CaioBrentano has joined #openstack-swift | 16:26 | |
*** MVenesio_ has joined #openstack-swift | 16:29 | |
*** MVenesio has quit IRC | 16:30 | |
*** jlhinson has quit IRC | 16:31 | |
*** chsc has joined #openstack-swift | 16:33 | |
tdasilva | notmyname, haypo: so how can i fix the whole 'local cached wheel' on my dev machine? If I just delete pyeclib*.whl and run pip install again, then it should work?? | 16:34 |
notmyname | tdasilva: make sure you clear out the stuff in /usr/local/lib too | 16:35 |
haypo | tdasilva: try: find ~/.cache/pip -iname "pyeclib*.whl" -delete | 16:35 |
haypo | tdasilva: (maybe begin without -delete ;-)) | 16:35 |
tdasilva | haypo: found this PyECLib-1.1.1-cp27-none-linux_x86_64.whl | 16:37 |
tdasilva | haypo: is that what you would expect, or should it be the 1.0.7 version? | 16:37 |
haypo | tdasilva: what do you want to do? | 16:38 |
haypo | if you remove the wheel cache, the setup.py will be executed again when you install PyEClib | 16:38 |
tdasilva | haypo: got it | 16:38 |
tdasilva | I was trying to review tushar's patch and ran into the same problem you guys already described | 16:39 |
haypo | ah, it looks like pip has an option: --no-binary :all: | 16:39 |
tdasilva | Failure: ImportError (liberasurecode.so.1: cannot open shared object file: No such file | 16:39 |
haypo | (and a deprecated option --no-use-wheel) | 16:39 |
tdasilva | hmm | 16:39 |
tdasilva | i don't see either option listed under 'pip --help' | 16:41 |
haypo | tdasilva: what is your pip version? | 16:41 |
haypo | the latest version is 7.1.2. transparent wheel cache is available and enabled by default since pip 6 | 16:41 |
tdasilva | pip 7.1.2 | 16:42 |
haypo | tdasilva: ah yes, try: pip install --help ;-) | 16:42 |
tdasilva | got it | 16:44 |
*** itlinux has joined #openstack-swift | 16:44 | |
*** nadeem has joined #openstack-swift | 16:47 | |
*** jlhinson has joined #openstack-swift | 16:48 | |
*** aix has quit IRC | 16:49 | |
*** rcernin has quit IRC | 16:50 | |
*** petertr7 is now known as petertr7_away | 16:52 | |
*** blmartin has quit IRC | 16:56 | |
*** gyee has joined #openstack-swift | 16:56 | |
tsg | haypo: has CI always used the "python setup.py bdist_wheel" target? (I assume not). | 16:58 |
tsg | haypo: if not, has this been a recent switch? or just a pip 7.1.x thing? | 16:58 |
*** petertr7_away is now known as petertr7 | 16:59 | |
*** marzif has quit IRC | 16:59 | |
tsg | haypo: (sorry, I missed parts of earlier conversation) | 16:59 |
haypo | tsg: i hope that the CI spawn fresh VM at each run | 16:59 |
gmmaha | i enabled swift to talk to keystone (install from source) and i am getting functional test errors https://gist.github.com/ganeshmaharaj/a49fab65665ba69d9e7f | 16:59 |
tsg | haypo: yes, they do :) and that's how I have been testing as well (with docker though) | 16:59 |
*** marzif has joined #openstack-swift | 17:00 | |
gmmaha | been tring to figure out why via pdb but no luck. | 17:00 |
haypo | tsg: so i don't think that the wheel cache matters on the CI | 17:00 |
gmmaha | has anyone seen this before? | 17:00 |
*** pdardeau has joined #openstack-swift | 17:01 | |
*** lcurtis has joined #openstack-swift | 17:04 | |
*** garthb has quit IRC | 17:05 | |
*** marzif has quit IRC | 17:05 | |
*** marzif has joined #openstack-swift | 17:06 | |
*** pcaruana has quit IRC | 17:06 | |
*** nadeem has quit IRC | 17:07 | |
*** diazjf has joined #openstack-swift | 17:14 | |
*** marzif has quit IRC | 17:20 | |
*** rcernin has joined #openstack-swift | 17:24 | |
*** mzhou has joined #openstack-swift | 17:25 | |
*** rledisez has quit IRC | 17:27 | |
*** geaaru has quit IRC | 17:28 | |
*** arnox has quit IRC | 17:30 | |
*** jlhinson has quit IRC | 17:31 | |
*** pdardeau has quit IRC | 17:31 | |
*** MVenesio has joined #openstack-swift | 17:40 | |
*** petertr7 is now known as petertr7_away | 17:40 | |
*** MVenesio_ has quit IRC | 17:41 | |
*** aix has joined #openstack-swift | 17:43 | |
*** david-lyle has quit IRC | 17:46 | |
* notmyname commutes | 17:46 | |
*** blmartin has joined #openstack-swift | 17:50 | |
*** klrmn1 has joined #openstack-swift | 17:55 | |
*** garthb has joined #openstack-swift | 18:06 | |
openstackgerrit | Sivasathurappan Radhakrishnan proposed openstack/swift: Added unit test cases for common/bufferedhttp.py https://review.openstack.org/244678 | 18:07 |
*** jistr has quit IRC | 18:22 | |
notmyname | good morning, again | 18:30 |
*** jordanP has quit IRC | 18:32 | |
*** petertr7_away is now known as petertr7 | 18:32 | |
*** CaioBrentano has quit IRC | 18:37 | |
*** diazjf has quit IRC | 18:38 | |
*** zul has quit IRC | 18:41 | |
*** zul has joined #openstack-swift | 18:42 | |
*** EmilienM has quit IRC | 18:42 | |
*** CaioBrentano has joined #openstack-swift | 18:43 | |
*** EmilienM has joined #openstack-swift | 18:46 | |
*** petertr7 is now known as petertr7_away | 18:47 | |
*** CaioBrentano has quit IRC | 18:50 | |
*** petertr7_away is now known as petertr7 | 18:56 | |
*** gyee has quit IRC | 18:56 | |
*** klrmn1 has quit IRC | 18:56 | |
*** klrmn1 has joined #openstack-swift | 18:57 | |
*** wbhuber_ has quit IRC | 19:00 | |
*** wbhuber has joined #openstack-swift | 19:01 | |
*** itlinux has quit IRC | 19:02 | |
clayg | heyoh! | 19:12 |
clayg | tsg: so we need to get the liberasure that goes with pyeclib 1.1.1 packaged and installed on the gate vm's yeah? | 19:12 |
clayg | tsg: notmyname: the only reason that pyeclib 1.1.1 was working on our saio's was because we already jerasure installed? | 19:13 |
notmyname | liberasurecode, but yeah (I think) | 19:13 |
notmyname | 1.1.1 doesn't have any jerasure with it | 19:13 |
*** diazjf has joined #openstack-swift | 19:14 | |
clayg | yeah but it's still a valid ec type - i'm pretty sure | 19:14 |
notmyname | only if the jerasure so is found | 19:14 |
clayg | notmyname: which it was on our saio's | 19:14 |
notmyname | yes, in an upgrade setting (ie jerasure isn't deleted by installing newer pyeclib) | 19:15 |
*** aix has quit IRC | 19:15 | |
clayg | notmyname: fair, but my point was that the newer liberasure isn't installed either - i had to compile from source (personally) to get the new liberasure_rs_vand ec type to work | 19:16 |
clayg | does anyone know anything about glance - re: lp bug #1511025 | 19:17 |
openstack | Launchpad bug 1511025 in OpenStack Object Storage (swift) "Image download with multi tenant true fails" [Undecided,Confirmed] https://launchpad.net/bugs/1511025 | 19:17 |
notmyname | oh, ok | 19:17 |
*** nadeem has joined #openstack-swift | 19:18 | |
tdasilva | clayg: hi, i'm reading your doc patch now (patch 244412), is it ok to push changes on top of that (minor fixes)? | 19:19 |
patchbot | tdasilva: https://review.openstack.org/#/c/244412/ - Ring Overview updates | 19:19 |
*** rohit_ has joined #openstack-swift | 19:19 | |
*** siva_krishnan has quit IRC | 19:19 | |
clayg | tdasilva: oh god please yes do! | 19:20 |
clayg | tdasilva: I'm absolutely the worst person to write docs - it's not that I shouldn't *write* docs (we should all write more stuff down) - but I have such terrible spelling and grammer and proof-reading I desperatly need a good editor - just wastes time to go back and forth - i agree with any improvements you have in mind a priori | 19:21 |
*** jlhinson has joined #openstack-swift | 19:25 | |
*** nadeem has quit IRC | 19:29 | |
tdasilva | clayg: ok, but it's a great job btw. thanks for taking the time to write it down | 19:30 |
*** nadeem has joined #openstack-swift | 19:30 | |
clayg | tdasilva: yeah for sure needed to happen - thank torgomatic_ and notmyname for telling me to do it! | 19:33 |
gmmaha | has anyone seen this before? | 19:34 |
gmmaha | sorry upkey in the wrong window | 19:34 |
wbhuber | clayg: regarding rebuilding the frag on a hand off node after discovering that one device goes off (unmounted or server down) that would fail the ec scheme (i.e. 4+2), is the reconstructor currently designed to handle fragments of an existing object whenever it is missing, misplaced or corrupted? | 19:39 |
wbhuber | clayg: i understand that when reconstructor finds missing or misplace fragments, it'd either rebuild or revert them to the correct place. | 19:39 |
tdasilva | lol: "The 'n' was probably thrown in because of Blade Runner." | 19:40 |
clayg | tdasilva: well who knows - it's just a theory | 19:40 |
tdasilva | heh | 19:40 |
wbhuber | clayg: from the top of your head, does it have the capability to count the # of valid fragments and find out that one is missing (due to one device out of touch), then we rebuild one on a hand off node. | 19:40 |
*** CaioBrentano has joined #openstack-swift | 19:41 | |
clayg | wbhuber: yeah - i mean they're somewhat orthogonal - if you have a rebuild job in hand and you decide to sync with some node you install that _build_fragment callback thing for ssync and start to sync - if a frag pops up as needed - in the callback we'll go talk to whatever nodes we need to inorder to rebuild the fragment that we want to ship to that node | 19:42 |
clayg | so I think if you just focus on that part of the loop of the rebuild job that's checking it's left and right parter and continuing around the ring if it can't connect - to do something more like "fire up a sync to a handoff" - the "getting the right fragments to rebuild" should suss itself out (maybe?) | 19:46 |
clayg | wbhuber: I haven't looked at this code in awhile | 19:46 |
clayg | wbhuber: it's going to be a really tricky change tho :\ | 19:46 |
notmyname | torgomatic_: with q.q() is there a way to have it not truncate the output? | 19:46 |
clayg | wbhuber: hope you're up for a challange - it's not terribly likely someone will nail it on the first go | 19:46 |
torgomatic_ | notmyname: not that I know of | 19:46 |
clayg | torgomatic_: notmyname: that seems exactly like what q.q should *not* do? | 19:47 |
wbhuber | clayg: i'm giving this one a shot. need to go over the path countless times to get it in the head. | 19:47 |
torgomatic_ | notmyname: if you feed it a long enough string, it dumps it to its own file | 19:48 |
notmyname | ah! so it does | 19:48 |
wbhuber | clayg: i think the loop of the rebuild job that checks its left and right partners from the ring to see everyone is connected. once it discovers one doesn't, we fire up a sync to a handoff. i think that's the segment i'm looking for. | 19:48 |
*** djc_ has joined #openstack-swift | 19:49 | |
clayg | wbhuber: yeah I don't think the flow is like that currently tho - if it finds one of it's primary partners is offline it just checks another primary partner - which is also useful - but some folks are thinking maybe not sufficient - hence the bug. | 19:49 |
clayg | wbhuber: anyway the main point is that it shouldn't do anything different unless it get's a 507 from a primary partner | 19:50 |
clayg | so we'll end up doing one thing for 507 and what's there currently for any other kind of error | 19:50 |
clayg | *maybe* this is good plan - but that's what the bug says to do anyway - so you'll have that going for you | 19:51 |
wbhuber | clayg: i think i would leave some room for any error conditions other than 507. i understand that 507 indicates insufficient storage error but that sounds like that there is not enough storage to store an object. does that error also "cover" the number of primary nodes (besides handoff) not meeting the size of the object? | 19:54 |
wbhuber | clayg: i'm thinking like those 4 nodes have only 100 mb avialble, but this incoming object has 110 mb. insufficient storage error pops up. | 19:54 |
wbhuber | clayg: or is it just that # of nodes (offline, etc.) is not satisfying the ec scheme (4+2) and the same error pops up? | 19:55 |
djc_ | is there an easy way to find out the size of a swift cluster? | 19:57 |
*** mahatic has quit IRC | 19:59 | |
*** joeljwright has joined #openstack-swift | 20:00 | |
*** ChanServ sets mode: +v joeljwright | 20:00 | |
*** pdardeau has joined #openstack-swift | 20:01 | |
clayg | djc_: keep uploading stuff to it until someone in devops tells you to stop - you can imagine that's roughly 80-90% of the capacity available | 20:06 |
jrichli | I thought I liked working with regular expressions, but then I wanted to understand _rfc_extension_pattern in common/utils.py | 20:07 |
djc_ | clayg: lol | 20:08 |
djc_ | clayg: I see swift-recon -d | 20:08 |
*** zhill has joined #openstack-swift | 20:09 | |
clayg | djc_: oh yeah that's a good way to go | 20:09 |
clayg | djc_: by size do you mean capacity or consumed - raw or usable? | 20:09 |
djc_ | clayg: both I guess. http://pastebin.com/srrrJHuN | 20:10 |
clayg | djc_: most of the time we talk about how much raw capacity is in the cluster (in 100's or 1000's of TB's) or how much user data in stored (which is collected from the account databases by tools like slogging) | 20:10 |
djc_ | clayg: so if we are talking about raw..the link I sent you showed 215937010335744 as capacity....Is that number raw? | 20:11 |
clayg | djc_: yeah and then monitoring for device usage/fullness and deviation is like sort of a seperate opperational task - we use collectd | 20:12 |
clayg | djc_: yeah! | 20:13 |
djc_ | clayg: so that is 215 terabytes I guess...We have 4 replicas. I don't have to multiply that number by 4 to find raw? | 20:13 |
clayg | djc_: no | 20:13 |
djc_ | clayg: thanks a bunch! | 20:14 |
djc_ | clayg: you've been very helpful | 20:14 |
*** zhill has quit IRC | 20:14 | |
clayg | djc_: but be careful trying to *devide* that number by 4 and estimate usable capacity - between filesystem metadata, object metadata, and account/container metadata you really just have what you have - raw/<replica> is *very* rough | 20:14 |
*** itlinux has joined #openstack-swift | 20:15 | |
clayg | well... I mean it won't be off by an order of magnitude or anything unless you have multiple storage policies EC, reduced-redundancy, then you really have to put on your thinking cap | 20:15 |
djc_ | clayg: I understand. thanks for the heads up | 20:15 |
clayg | djc_: nah man that was all you - i forgot about recon pooling devices | 20:16 |
clayg | *poll | 20:16 |
djc_ | clayg: thanks | 20:16 |
* clayg throws a shotout to pandemicsyn! | 20:16 | |
clayg | so but we're going with no f'ing clue on lp bug #1511025 - or did i miss something in scrollback? | 20:17 |
openstack | Launchpad bug 1511025 in OpenStack Object Storage (swift) "Image download with multi tenant true fails" [Undecided,Confirmed] https://launchpad.net/bugs/1511025 | 20:17 |
*** itlinux has quit IRC | 20:18 | |
*** itlinux has joined #openstack-swift | 20:20 | |
*** nikhil has joined #openstack-swift | 20:20 | |
*** diazjf has quit IRC | 20:22 | |
*** diazjf has joined #openstack-swift | 20:23 | |
*** jlhinson has quit IRC | 20:26 | |
*** diazjf has quit IRC | 20:27 | |
*** nadeem has quit IRC | 20:28 | |
*** diazjf has joined #openstack-swift | 20:28 | |
*** diazjf has quit IRC | 20:28 | |
*** itlinux has quit IRC | 20:29 | |
*** itlinux has joined #openstack-swift | 20:33 | |
*** Chavers has quit IRC | 20:34 | |
*** jlhinson has joined #openstack-swift | 20:42 | |
*** Zyric has joined #openstack-swift | 20:42 | |
*** siva_krishnan has joined #openstack-swift | 20:44 | |
*** tsg has quit IRC | 20:50 | |
gmmaha | sorry for being a pain, but has anyone seen this error with their swift+keystone setup? https://bugs.launchpad.net/swift/+bug/1176030 && https://gist.github.com/ganeshmaharaj/a49fab65665ba69d9e7f | 20:54 |
openstack | Launchpad bug 1176030 in OpenStack Object Storage (swift) "Swift functional tests fails when Keystone is used" [Undecided,Won't fix] | 20:54 |
gmmaha | my google searches havent been very helpful | 20:54 |
*** gyee has joined #openstack-swift | 20:58 | |
*** CaioBrentano has quit IRC | 21:01 | |
*** itlinux has quit IRC | 21:07 | |
*** wbhuber_ has joined #openstack-swift | 21:09 | |
*** nadeem has joined #openstack-swift | 21:10 | |
*** nadeem has quit IRC | 21:10 | |
*** nadeem has joined #openstack-swift | 21:11 | |
*** wbhuber has quit IRC | 21:13 | |
*** nadeem has quit IRC | 21:15 | |
*** Guest60041 is now known as scotticus | 21:18 | |
*** diogogmt has quit IRC | 21:27 | |
*** petertr7 is now known as petertr7_away | 21:28 | |
openstackgerrit | Merged openstack/swift: Small cleanup for unit/proxy/controllers/test_obj https://review.openstack.org/244179 | 21:30 |
*** petertr7_away is now known as petertr7 | 21:32 | |
wbhuber_ | clayg: one thing came up in mind - when a device goes off line, why do we need to rebuild a frag on a handoff node if we continue to meet policy.ec_ndata, using frags from parity nodes? | 21:35 |
wbhuber_ | clayg: i assume that the guy who opened the bug had three primary nodes going offline (using 4+2 scheme). | 21:38 |
*** joeljwright has quit IRC | 21:45 | |
*** jlhinson has quit IRC | 21:54 | |
*** petertr7 is now known as petertr7_away | 22:04 | |
*** jamielennox|away is now known as jamielennox | 22:05 | |
*** MVenesio has quit IRC | 22:08 | |
*** zhill has joined #openstack-swift | 22:11 | |
*** blmartin has quit IRC | 22:12 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 22:13 |
*** david-lyle has joined #openstack-swift | 22:16 | |
*** zhill has quit IRC | 22:16 | |
*** pdardeau has quit IRC | 22:19 | |
*** Guest90281 has joined #openstack-swift | 22:21 | |
Guest90281 | I get "ImportError: No module named swift.cli.ringbuilder" -- when I run remakerings for the first time on a SAIO set up. what's going wrong here/ | 22:22 |
Guest90281 | ? | 22:22 |
clayg | Guest90281: something with python package install | 22:23 |
clayg | Guest90281: go back into ~/swift (or wherever you cloned) and `pip install -e .` | 22:24 |
Guest90281 | oh yeah | 22:24 |
Guest90281 | there was an offending line in requirements.txt | 22:24 |
Guest90281 | http://pastebin.com/f5g5Rj2v | 22:27 |
clayg | ^ and so it beings lifeless haypo | 22:27 |
clayg | Guest90281: do a pip install -U pip pbr setuptools virtualenv | 22:27 |
clayg | *sudo* | 22:27 |
Guest90281 | clayg: Could not find any downloads that satisfy the requirement pbf | 22:30 |
clayg | pb*R* | 22:30 |
* Guest90281 slaps himself awake | 22:31 | |
Guest90281 | sorry | 22:31 |
clayg | np - werx? | 22:31 |
Guest90281 | works fine thanks ! | 22:31 |
Guest90281 | oh the original command still fails though | 22:32 |
Guest90281 | the one that you suggested runs fine .. and installs the relevant stuff | 22:32 |
*** lnxnut has quit IRC | 22:32 | |
Guest90281 | but .. I still get the same error .. like some kind of parser error | 22:33 |
clayg | well after the -U you still need to `pip install -e .` | 22:33 |
Guest90281 | as in the pastebin | 22:33 |
Guest90281 | oh okay makes sense | 22:33 |
clayg | Guest90281: you probably have the system seutptools installed and it's too old | 22:33 |
clayg | Guest90281: ubuntu? `apt-get purge python-setuptools -y` | 22:33 |
Guest90281 | clayg: i have an ubuntu trusty | 22:34 |
clayg | Guest90281: it's sort of a sad joke, but read the topic :'( | 22:35 |
*** djc_ has quit IRC | 22:35 | |
clayg | purge the system setuptools and run the pip -U command again then install the swift source - what a chore :'( | 22:35 |
clayg | so sorry :'( | 22:35 |
Guest90281 | clayg: thanks and np .. learning is learning ! | 22:36 |
openstackgerrit | Jonathan Hinson proposed openstack/swift: Transition to 'keymaster' https://review.openstack.org/244894 | 22:36 |
*** BAKfr has quit IRC | 22:38 | |
Guest90281 | cd | 22:39 |
Guest90281 | oops sorry | 22:40 |
*** BAKfr has joined #openstack-swift | 22:40 | |
clayg | home is where the heart is | 22:40 |
Guest90281 | yep ! | 22:41 |
*** tongli has quit IRC | 22:41 | |
*** wbhuber_ has quit IRC | 22:44 | |
*** wbhuber has joined #openstack-swift | 22:44 | |
*** wbhuber has quit IRC | 22:49 | |
openstackgerrit | Jonathan Hinson proposed openstack/swift: Transition to 'keymaster' https://review.openstack.org/244904 | 22:57 |
*** jlhinson has joined #openstack-swift | 22:59 | |
*** zhill has joined #openstack-swift | 23:05 | |
*** km has joined #openstack-swift | 23:06 | |
*** km is now known as Guest21878 | 23:06 | |
clayg | redbo: has the "thrash" bench tool always been in hummingbird? | 23:07 |
*** mac_ified has joined #openstack-swift | 23:12 | |
redbo | clayg: yeah, for quite a while. I use it to make a mixed workload for profiling and looking at memory usage and stuff. | 23:12 |
*** jamielennox is now known as jamielennox|away | 23:13 | |
clayg | $ hummingbird object -c /etc/swift/object-server.conf | 23:14 |
clayg | Unable to load object | 23:14 |
clayg | exits 1 - nothing in syslog :'( | 23:15 |
*** aix has joined #openstack-swift | 23:18 | |
*** darrenc is now known as darrenc_afk | 23:18 | |
*** minwoob has quit IRC | 23:19 | |
*** gyee has quit IRC | 23:19 | |
*** gyee has joined #openstack-swift | 23:21 | |
*** jamielennox|away is now known as jamielennox | 23:22 | |
redbo | hmm.. maybe that got broken :( I'll look at it in a bit. | 23:22 |
redbo | we only use object config directories | 23:22 |
clayg | oh dirs work now!? | 23:23 |
clayg | it's so hard to keep up | 23:23 |
clayg | redbo: well what's the default path? I can get `object -c /etc/swift/object-server.conf.d` to start but not `start object` | 23:26 |
clayg | nm i found it - you guys are trying to incompatible on purpose | 23:28 |
*** kei_yama has joined #openstack-swift | 23:30 | |
*** lcurtis has quit IRC | 23:31 | |
*** jlhinson has quit IRC | 23:33 | |
clayg | redbo: got my object server running - next command - next error -> https://gist.github.com/clayg/78f7fbafb05faec9bd65 | 23:36 |
clayg | wow, I think was just a 503 from recon? | 23:37 |
clayg | wtf logging? | 23:38 |
*** darrenc_afk is now known as darrenc | 23:39 | |
*** chsc has quit IRC | 23:44 | |
*** ho has joined #openstack-swift | 23:45 | |
*** Chavers has joined #openstack-swift | 23:46 | |
*** ChanServ changes topic to "Review Dashboard: https://goo.gl/iLt6Ld | Get an IRC bouncer at http://znc.in | Logs: http://eavesdrop.openstack.org/irclogs/%23openstack-swift/" | 23:51 | |
*** notmyname sets mode: -o notmyname | 23:51 | |
clayg | srly I'm getting nothing kicked out to syslog :\ | 23:52 |
*** fbo has quit IRC | 23:52 | |
*** fbo has joined #openstack-swift | 23:55 | |
notmyname | haypo: what breaks if pbr isn't in requirements.txt? | 23:56 |
clayg | haypo: what breaks if those marker lines that are screwing up the world aren't in requirements.txt? | 23:56 |
ho | good morning! | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!