*** harlowja_at_home has joined #openstack-oslo | 00:00 | |
*** harlowja_at_home has quit IRC | 00:47 | |
*** harlowja_at_home has joined #openstack-oslo | 01:30 | |
*** harlowja_at_home has quit IRC | 01:36 | |
*** harlowja_at_home has joined #openstack-oslo | 01:37 | |
*** yamahata has joined #openstack-oslo | 01:44 | |
*** oomichi has joined #openstack-oslo | 01:52 | |
*** harlowja_at_home has quit IRC | 02:23 | |
*** SridharG has joined #openstack-oslo | 02:32 | |
*** dims has quit IRC | 02:44 | |
*** dims has joined #openstack-oslo | 02:47 | |
*** dims has quit IRC | 02:47 | |
openstackgerrit | A change was merged to openstack/oslo.serialization: Updated from global requirements https://review.openstack.org/114065 | 03:43 |
---|---|---|
*** harlowja_at_home has joined #openstack-oslo | 03:44 | |
*** dims has joined #openstack-oslo | 03:48 | |
*** jecarey has joined #openstack-oslo | 03:50 | |
*** dims has quit IRC | 03:53 | |
*** Alexei_987 has joined #openstack-oslo | 03:59 | |
*** stevemar has quit IRC | 04:02 | |
*** SridharG has quit IRC | 04:05 | |
openstackgerrit | Joshua Harlow proposed a change to openstack/taskflow: A few action engine and action engine runner adjustments https://review.openstack.org/116544 | 04:17 |
*** harlowja_at_home has quit IRC | 04:22 | |
*** amotoki has joined #openstack-oslo | 04:29 | |
*** YorikSar has quit IRC | 04:41 | |
*** YorikSar has joined #openstack-oslo | 04:42 | |
*** dims has joined #openstack-oslo | 04:53 | |
*** YorikSar has quit IRC | 04:57 | |
*** dims has quit IRC | 04:59 | |
openstackgerrit | Joshua Harlow proposed a change to openstack/taskflow: A few action engine and action engine runner adjustments https://review.openstack.org/116544 | 05:09 |
*** flaper87|afk is now known as flaper87 | 05:10 | |
*** jecarey has quit IRC | 05:15 | |
openstackgerrit | Joshua Harlow proposed a change to openstack/taskflow: Fix engine iteration 'close-up shop' runtime path https://review.openstack.org/116544 | 05:18 |
openstackgerrit | Joshua Harlow proposed a change to openstack/taskflow: Tweak engine iteration 'close-up shop' runtime path https://review.openstack.org/116544 | 05:21 |
openstackgerrit | OpenStack Proposal Bot proposed a change to openstack/oslo.i18n: Imported Translations from Transifex https://review.openstack.org/116553 | 06:01 |
*** markmc has joined #openstack-oslo | 06:03 | |
*** k4n0 has joined #openstack-oslo | 06:05 | |
openstackgerrit | OpenStack Proposal Bot proposed a change to openstack/oslo.vmware: Imported Translations from Transifex https://review.openstack.org/114732 | 06:07 |
*** AAzza_afk has joined #openstack-oslo | 06:17 | |
*** AAzzal has joined #openstack-oslo | 06:18 | |
*** AAzza has quit IRC | 06:19 | |
*** AAzzal is now known as AAzza | 06:19 | |
*** AAzza_afk has quit IRC | 06:21 | |
*** dtantsur|afk is now known as dtantsur | 06:23 | |
*** YorikSar has joined #openstack-oslo | 06:36 | |
*** dims has joined #openstack-oslo | 06:42 | |
*** dims has quit IRC | 06:47 | |
*** ihrachyshka has joined #openstack-oslo | 07:24 | |
*** flaper87 is now known as flaper87|afk | 07:26 | |
*** jokke__ is now known as jokke_ | 07:31 | |
*** praneshp has quit IRC | 07:34 | |
*** ildikov has joined #openstack-oslo | 07:40 | |
*** ihrachyshka has quit IRC | 07:48 | |
openstackgerrit | Ann Kamyshnikova proposed a change to openstack/oslo.db: ModelsMigrationsSync: Add check for foreign keys https://review.openstack.org/116238 | 07:55 |
*** pblaho has joined #openstack-oslo | 08:05 | |
*** dims has joined #openstack-oslo | 08:31 | |
*** ihrachyshka has joined #openstack-oslo | 08:33 | |
*** dims has quit IRC | 08:36 | |
*** k4n0 has quit IRC | 08:39 | |
*** ihrachyshka has quit IRC | 08:48 | |
*** ihrachyshka has joined #openstack-oslo | 08:48 | |
*** akamyshnikova has quit IRC | 08:53 | |
*** k4n0 has joined #openstack-oslo | 08:53 | |
*** ihrachyshka has quit IRC | 08:56 | |
*** SridharGaddam has joined #openstack-oslo | 09:17 | |
*** SridharGaddam has quit IRC | 09:39 | |
openstackgerrit | Ann Kamyshnikova proposed a change to openstack/oslo.db: ModelsMigrationsSync: Add check for foreign keys https://review.openstack.org/116238 | 09:39 |
*** burgobianco has quit IRC | 09:42 | |
*** dtantsur is now known as dtantsur|lunch | 09:43 | |
*** yamahata has quit IRC | 09:43 | |
*** burgobianco has joined #openstack-oslo | 09:44 | |
openstackgerrit | Ann Kamyshnikova proposed a change to openstack/oslo.db: ModelsMigrationsSync: Add check for foreign keys https://review.openstack.org/116238 | 09:49 |
*** pblaho is now known as pblaho|afk | 10:01 | |
*** pcm_ has joined #openstack-oslo | 10:05 | |
openstackgerrit | Ann Kamyshnikova proposed a change to openstack/oslo.db: ModelsMigrationsSync: Add check for foreign keys https://review.openstack.org/116238 | 10:09 |
*** pcm_ has quit IRC | 10:09 | |
*** pcm_ has joined #openstack-oslo | 10:10 | |
openstackgerrit | Ann Kamyshnikova proposed a change to openstack/oslo.db: ModelsMigrationsSync: Add check for foreign keys https://review.openstack.org/116238 | 10:26 |
*** k4n0 has quit IRC | 10:47 | |
*** flaper87|afk is now known as flaper87 | 10:48 | |
openstackgerrit | Ann Kamyshnikova proposed a change to openstack/oslo.db: ModelsMigrationsSync: Add check for foreign keys https://review.openstack.org/116238 | 10:49 |
*** jecarey has joined #openstack-oslo | 10:55 | |
*** k4n0 has joined #openstack-oslo | 10:59 | |
*** pcm_ has quit IRC | 11:01 | |
*** pcm_ has joined #openstack-oslo | 11:03 | |
*** pblaho|afk is now known as pblaho | 11:04 | |
*** pcm_ has quit IRC | 11:04 | |
*** pcm_ has joined #openstack-oslo | 11:05 | |
*** yamahata has joined #openstack-oslo | 11:16 | |
*** pblaho is now known as pblaho|afk | 11:24 | |
*** dteselkin has quit IRC | 11:24 | |
*** dteselkin has joined #openstack-oslo | 11:25 | |
*** dims has joined #openstack-oslo | 11:29 | |
*** pblaho|afk is now known as pblaho | 11:40 | |
*** inteq has quit IRC | 11:50 | |
*** pblaho is now known as pblaho|afk | 11:57 | |
*** f13o has joined #openstack-oslo | 12:01 | |
*** flaper87 is now known as flaper87|afk | 12:04 | |
*** ihrachyshka has joined #openstack-oslo | 12:07 | |
*** flaper87|afk is now known as flaper87 | 12:07 | |
openstackgerrit | Ihar Hrachyshka proposed a change to openstack/oslo.db: Set utf8 encoding for mysql and postgresql https://review.openstack.org/111236 | 12:09 |
*** ihrachyshka has quit IRC | 12:13 | |
*** ihrachyshka has joined #openstack-oslo | 12:14 | |
*** kgiusti has joined #openstack-oslo | 12:20 | |
*** jecarey has quit IRC | 12:35 | |
*** gordc has joined #openstack-oslo | 12:39 | |
*** mtanino has quit IRC | 12:41 | |
*** pblaho|afk is now known as pblaho | 12:45 | |
*** ildikov has quit IRC | 13:01 | |
*** dtantsur|lunch is now known as dtantsur | 13:03 | |
*** dims has quit IRC | 13:06 | |
*** dims has joined #openstack-oslo | 13:06 | |
*** ildikov_ has joined #openstack-oslo | 13:07 | |
openstackgerrit | Julien Danjou proposed a change to openstack/oslo.messaging: Fix Python 3 testing https://review.openstack.org/116606 | 13:08 |
*** miqui has joined #openstack-oslo | 13:08 | |
*** jeckersb_gone is now known as jeckersb | 13:16 | |
*** bknudson has quit IRC | 13:18 | |
*** mriedem has joined #openstack-oslo | 13:24 | |
*** mtanino has joined #openstack-oslo | 13:31 | |
*** stevemar has joined #openstack-oslo | 13:31 | |
*** abhijeetm has joined #openstack-oslo | 13:32 | |
*** AAzza is now known as AAzza_afk | 13:33 | |
*** k4n0 has quit IRC | 13:35 | |
*** bknudson has joined #openstack-oslo | 13:37 | |
*** yassine has joined #openstack-oslo | 13:40 | |
openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack/oslo.vmware: VMWare: Support for pluggable Datastore selection https://review.openstack.org/114551 | 13:55 |
openstackgerrit | Julien Danjou proposed a change to openstack/oslo.messaging: Fix Python 3 testing https://review.openstack.org/116606 | 14:00 |
dims | dhellmann: ping | 14:03 |
dims | dhellmann: a few things from last week, when you get a chance | 14:08 |
dims | dhellmann: 1) Do we need to keep tests for code that already moved to libraries? https://review.openstack.org/#/c/114649/ | 14:09 |
dims | dhellmann: 2) lifeless was asking about a pbr release | 14:09 |
dims | 3) oslo.serialization is ready for a release | 14:10 |
dims | dhellmann: 3) oslo.serialization is ready for a release | 14:10 |
dims | dhellmann: 4) do we have a oslo.log repo? who is working on it? | 14:11 |
*** oomichi has quit IRC | 14:12 | |
*** amotoki has quit IRC | 14:14 | |
mriedem | why is simplejson in oslo-incubator's test-requirements when it's used in the runtime jsonutils code? | 14:16 |
*** jeckersb is now known as jeckersb_gone | 14:19 | |
*** yamahata has quit IRC | 14:22 | |
dims | mriedem: it's used in runtime only for python < 2.7 | 14:23 |
mriedem | dims: yeah.... https://bugs.launchpad.net/oslo/+bug/1361230 | 14:24 |
mriedem | i'm going to be updating global-reqs | 14:24 |
mriedem | and oslo's test-reqs | 14:24 |
mriedem | makes it very difficult for anyone doing CD on RHEL 6 using simplejson to know when their package deps need updating :) | 14:25 |
dims | mriedem: bug 1361230 failure is only in python 2.6 right? | 14:25 |
dims | ack | 14:26 |
mriedem | dims: so far that's all i've seen it on | 14:26 |
mriedem | rhel 6.5 | 14:26 |
*** mriedem has left #openstack-oslo | 14:26 | |
*** mriedem has joined #openstack-oslo | 14:26 | |
*** jraim__ has joined #openstack-oslo | 14:29 | |
*** noelbk has quit IRC | 14:31 | |
*** mgagne_ has joined #openstack-oslo | 14:32 | |
*** mgagne has quit IRC | 14:32 | |
*** freyes has quit IRC | 14:32 | |
*** lbragstad has quit IRC | 14:32 | |
*** jraim has quit IRC | 14:32 | |
*** mtreinish has quit IRC | 14:32 | |
*** jroll has quit IRC | 14:32 | |
*** russellb has quit IRC | 14:32 | |
*** therve has quit IRC | 14:32 | |
*** lbragstad has joined #openstack-oslo | 14:32 | |
*** mtreinish has joined #openstack-oslo | 14:32 | |
openstackgerrit | A change was merged to openstack/oslo-incubator: Remove unused/mutable default args https://review.openstack.org/116386 | 14:32 |
*** therve has joined #openstack-oslo | 14:33 | |
*** jroll has joined #openstack-oslo | 14:33 | |
*** russellb has joined #openstack-oslo | 14:33 | |
*** freyes has joined #openstack-oslo | 14:34 | |
*** tsekiyama has joined #openstack-oslo | 14:34 | |
*** jeckersb_gone is now known as jeckersb | 14:36 | |
*** ihrachyshka has quit IRC | 14:44 | |
*** mtreinish_ has joined #openstack-oslo | 14:50 | |
*** markmc_ has joined #openstack-oslo | 14:50 | |
*** lbragstad has quit IRC | 14:50 | |
*** mtreinish has quit IRC | 14:50 | |
*** markmc has quit IRC | 14:50 | |
*** lbragstad has joined #openstack-oslo | 14:50 | |
*** mtreinish_ is now known as mtreinish | 14:51 | |
flaper87 | Have any of you seen this pbr error before? http://logs.openstack.org/65/115265/3/check/check-tempest-dsvm-full/14edab9/logs/devstacklog.txt.gz#_2014-08-25_11_03_22_162 | 14:52 |
*** abhijeetm has quit IRC | 14:52 | |
flaper87 | I remember seeing something about pbr and semver in the mailing list (not long ago) | 14:52 |
*** AAzza_afk is now known as AAzza | 14:53 | |
dhellmann | flaper87: I suspect that's caused by the version format being invalid. Try re-tagging as 0.0.1.0a3. (the first 3 values are meant to be pure numbers) | 14:55 |
dhellmann | flaper87: we don't use alpha releases of pre-1.0 versions in oslo either, fwiw | 14:55 |
*** ildikov has joined #openstack-oslo | 14:55 | |
dhellmann | dims: thanks for filling in for me last week, I'm still catching up this morning | 14:55 |
flaper87 | dhellmann: ah, mmh, that explains it! | 14:55 |
dhellmann | dims: I have pbr, cliff, and oslo.serialization on my list for releases today | 14:56 |
*** AAzza is now known as AAzza_afk | 14:57 | |
dhellmann | flaper87: would you file a bug against pbr about this? we should report the error when the sdist is created to avoid having issues installing it | 14:57 |
flaper87 | dhellmann: absolutely, let me do that right away before I forget | 14:57 |
dhellmann | flaper87: and you'll want to test locally before pushing a new tag, since my answer is a guess :-) | 14:58 |
dims | dhellmann: cool | 14:58 |
*** ildikov_ has quit IRC | 14:58 | |
flaper87 | dhellmann: mmh, that's the thing, I can't replicate it locally. Since that's happening with devstack, I'm setting up a vm w/ devstack. Lets see if I can replicate it, it might be an old-pbr bug | 14:58 |
flaper87 | not sure, just guessing | 14:59 |
jd__ | if you want to unblock oslo.messaging gate here it should be https://review.openstack.org/#/c/116606/ :) | 14:59 |
dhellmann | flaper87: maybe you and I have a different version of pip than the CI systems? | 15:00 |
flaper87 | dhellmann: likely, let me check if I can get the pip version from the logs | 15:00 |
dims | pbr==0.10.1.dev8.g81c2000 | 15:01 |
flaper87 | dims: dhellmann: logs say pip 1.5.4-1 is installed | 15:01 |
flaper87 | I have 1.5.6 | 15:01 |
flaper87 | ah nevermind | 15:01 |
flaper87 | it's then manually updated anyway | 15:02 |
dhellmann | jd__: that change looks fine; did you think about using one of the decorators? https://docs.python.org/2/library/unittest.html#skipping-tests-and-expected-failures | 15:02 |
jd__ | dhellmann: I did in one place, I can use it everywhere if that's prefered indeed | 15:02 |
dhellmann | jd__: ah, I just looked at the first file so far | 15:03 |
dhellmann | flaper87: ah, indeed, it's a problem with the current master version of pbr | 15:03 |
dhellmann | dims: nice ^^ | 15:03 |
flaper87 | oh ok, then let me file that bug and tag a version w/o alpha | 15:03 |
dhellmann | flaper87: tagging without the alpha works, as does 0.0.1.0a3 (note that the alpha is in the 4th part of the version) | 15:04 |
flaper87 | dhellmann: yup, I'll just follow what we do for oslo, it makes sense to me. | 15:05 |
dhellmann | flaper87: ok | 15:05 |
openstackgerrit | Julien Danjou proposed a change to openstack/oslo.messaging: Fix Python 3 testing https://review.openstack.org/116606 | 15:05 |
jd__ | dhellmann: updated, fingers crossed | 15:05 |
dhellmann | jd__: what changed that makes raising at import time not work? do we need to make that more public to help other projects? | 15:07 |
jd__ | dhellmann: I honestly don't know, I think it's something that got released a few days ago since it used to work, like testrepository or subunit | 15:07 |
dhellmann | jd__: ok, just wondering | 15:08 |
jd__ | not sure it's a big deal since I don't expect a lot of projects doing that | 15:08 |
dhellmann | jd__: +2a | 15:08 |
jd__ | nice | 15:09 |
dhellmann | dims: regarding removing tests; yes, we need to keep the tests with modules in the incubator until we remove those modules | 15:09 |
dims | dhellmann: ack will re-instate them | 15:09 |
*** markmcclain has joined #openstack-oslo | 15:10 | |
dhellmann | dims: we need to rethink our approach to graduation. :-/ | 15:10 |
*** AAzza_afk is now known as AAzza | 15:12 | |
dhellmann | flaper87: would you let me know when you've got a new glance.store tagged? I don't want to release pbr if it's going to break you in other environments than our gate. | 15:14 |
openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack/oslo-incubator: Switch oslo-incubator to use oslo.utils https://review.openstack.org/114649 | 15:16 |
dims | dhellmann: i hear you :( | 15:17 |
*** markmcclain has quit IRC | 15:19 | |
*** markmcclain has joined #openstack-oslo | 15:21 | |
*** dtantsur is now known as dtantsur|afk | 15:23 | |
*** ildikov has quit IRC | 15:30 | |
openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack/oslo.vmware: VMWare: Support for pluggable Datastore selection https://review.openstack.org/114551 | 15:45 |
*** markmcclain has quit IRC | 15:46 | |
*** yassine has quit IRC | 15:48 | |
openstackgerrit | Doug Hellmann proposed a change to openstack/cliff: Add release notes for 1.7.0 https://review.openstack.org/116658 | 15:48 |
flaper87 | dhellmann: it's out: https://pypi.python.org/pypi/glance.store | 15:50 |
* flaper87 rechecks that devstack patch | 15:51 | |
flaper87 | lets see what happens | 15:51 |
dhellmann | flaper87: ok, let me know how the tests go and I'll release if they pass | 15:51 |
flaper87 | dhellmann: will do. Thanks! | 15:51 |
*** flaper87 is now known as flaper87|afk | 15:52 | |
openstackgerrit | Julien Danjou proposed a change to openstack/oslo.messaging: Fix Python 3 testing https://review.openstack.org/116606 | 15:53 |
jd__ | dhellmann: I had to update the patch, skipIf doesn't work on class actually | 15:54 |
dhellmann | jd__: le sigh | 15:54 |
*** enykeev has joined #openstack-oslo | 15:54 | |
*** zzzeek has joined #openstack-oslo | 16:03 | |
openstackgerrit | Doug Hellmann proposed a change to openstack/oslo.serialization: Clean up docs before first release https://review.openstack.org/116665 | 16:05 |
dhellmann | dims, bnemec : we should merge something like ^^ before releasing oslo.serialization | 16:06 |
*** pblaho has quit IRC | 16:10 | |
*** markmcclain has joined #openstack-oslo | 16:15 | |
openstackgerrit | Steve Martinelli proposed a change to openstack/oslotest: Add pdb support to tox with debug helper shell script https://review.openstack.org/116669 | 16:19 |
*** praneshp has joined #openstack-oslo | 16:19 | |
*** markmcclain has quit IRC | 16:20 | |
*** dims_ has joined #openstack-oslo | 16:23 | |
*** dims has quit IRC | 16:24 | |
*** markmc_ has quit IRC | 16:30 | |
*** celttechie has joined #openstack-oslo | 16:34 | |
*** ildikov has joined #openstack-oslo | 16:34 | |
*** dims has joined #openstack-oslo | 16:35 | |
*** dims_ has quit IRC | 16:35 | |
openstackgerrit | Steve Martinelli proposed a change to openstack/oslotest: Add pdb support to tox with debug helper shell script https://review.openstack.org/116669 | 16:36 |
*** markmcclain has joined #openstack-oslo | 16:37 | |
YorikSar | zzzeek: ping | 16:51 |
zzzeek | hey | 16:51 |
YorikSar | zzzeek: Hi | 16:51 |
YorikSar | zzzeek: I've found out that you're the author of dogpile.cache as well :) | 16:51 |
zzzeek | yep | 16:51 |
YorikSar | zzzeek: So I have a question. Do I get it right: when I use dogpile's memcached backend (in Keystone), it creates new connection for every new thread. | 16:52 |
YorikSar | zzzeek: Can this behavior be somehow changed? | 16:52 |
YorikSar | zzzeek: I've looked through code and it looks like it can't be turned off, right? | 16:53 |
zzzeek | YorikSar: i dont know if that is true. which backend specifically ? | 16:53 |
YorikSar | zzzeek: python-memcached is used by default | 16:54 |
zzzeek | YorikSar: according to https://github.com/linsomniac/python-memcached/blob/master/memcache.py#L129 that client is already a threading.local | 16:55 |
YorikSar | zzzeek: We ran into problem: under load Keystone ends up with huge number of opened connections to memcached. | 16:55 |
YorikSar | zzzeek: Ah... | 16:56 |
YorikSar | Why?... | 16:56 |
zzzeek | YorikSar: because a single TCP connection is not threadsafe | 16:56 |
YorikSar | zzzeek: Ok, thanks. Looks like we need to switch to pylibmc or smth... | 16:57 |
YorikSar | zzzeek: But we could reuse it in different threads. | 16:57 |
zzzeek | YorikSar: OK but the best you can do is a pool that is of more limited size | 16:57 |
YorikSar | zzzeek: Like keep a reference around for just a bit longer than thread lives. | 16:57 |
YorikSar | *then | 16:58 |
YorikSar | (or than) | 16:58 |
zzzeek | YorikSar: dogpile’s backend is also doing threading.local so if you want to use some kind of pool you’d need to adapt a custom backend | 16:58 |
*** yamahata has joined #openstack-oslo | 16:58 | |
YorikSar | zzzeek: Yeah... That's really strange for me... | 16:58 |
zzzeek | YorikSar: when you use regular threads, this is the easiest/most stable/simple way to go | 16:59 |
zzzeek | YorikSar: but when you are using greenlets, those asssumptions change | 16:59 |
zzzeek | YorikSar: because now you can have 10000 “threads" | 16:59 |
YorikSar | zzzeek: I think connection lifetime management should be decoupled from connection itself. | 16:59 |
zzzeek | YorikSar: so dogpile’s backend is not set up for large scale greenlet use | 16:59 |
YorikSar | zzzeek: Well, even for usual threads you could benefit from TCP connection reuse. | 17:00 |
zzzeek | YorikSar: as long as dogpile’s memcached backend doesn’t step on itself when run out of the box in a small application with just ten threads, sure | 17:00 |
*** openstackgerrit has quit IRC | 17:00 | |
YorikSar | zzzeek: And for 10 threads that rarely use memcached, 1 TCP connection would be enough. | 17:01 |
zzzeek | YorikSar: no its not | 17:01 |
*** harlowja has joined #openstack-oslo | 17:01 | |
zzzeek | YorikSar: unless you have an efficinet pooling system making sure it is sent correctly | 17:01 |
zzzeek | YorikSar: havent seen such a pool for memcached connections | 17:01 |
zzzeek | YorikSar: this would be totally custom backend for dogpile. not hard to do. dogpile’s backends are totally extensible. maybe there is one already | 17:02 |
YorikSar | zzzeek: But if python-memcached doesn't work like that, there's not much we can do. | 17:03 |
zzzeek | YorikSar: well pylibmc is much better | 17:03 |
zzzeek | YorikSar: it has some kind of pools but i dont know that I had good results with them | 17:03 |
YorikSar | zzzeek: But it's C. | 17:03 |
*** AAzza is now known as AAzza_afk | 17:03 | |
YorikSar | zzzeek: And it might block eventlet. | 17:03 |
zzzeek | YorikSar: i feel like pylibmc uses eventlet already | 17:04 |
zzzeek | guess not | 17:04 |
zzzeek | YorikSar: see this? https://blueprints.launchpad.net/oslo/+spec/eventlet-safe-memcache-client | 17:05 |
YorikSar | zzzeek: Huh... But that doesn't see to be true anymore - we use python-memcached and under load and no such effects. | 17:07 |
zzzeek | YorikSar: shrugs | 17:07 |
dims | dhellmann: are we doing oslo.log? (anytime soon) | 17:09 |
*** mgagne_ has quit IRC | 17:11 | |
*** mgagne_ has joined #openstack-oslo | 17:11 | |
*** openstackgerrit has joined #openstack-oslo | 17:13 | |
YorikSar | zzzeek: Ok, it seems I'll have to do smth as ugly as http://stackoverflow.com/a/22520633/238308 with a new dogpile backend for our next Icehouse release... | 17:13 |
YorikSar | zzzeek: But for upstream we really should find a better way. | 17:13 |
*** yamahata has quit IRC | 17:21 | |
dhellmann | dims: zul and I are on tap to do that, but neither of us have had a chance to start it | 17:21 |
*** AAzza_afk is now known as AAzza | 17:22 | |
*** markmcclain has quit IRC | 17:25 | |
openstackgerrit | Vipin Balachandran proposed a change to openstack/oslo.vmware: Refactoring to reduce noise in log files https://review.openstack.org/116504 | 17:30 |
*** mgagne_ is now known as mgagne | 17:39 | |
*** zzzeek has quit IRC | 17:51 | |
*** zzzeek has joined #openstack-oslo | 17:51 | |
openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack/oslo-incubator: Switch oslo-incubator to use oslo.utils https://review.openstack.org/114649 | 17:58 |
dhellmann | dims: is the oslo.utils situation with keystone worked out? | 18:01 |
dims | dhellmann: thanks for the reminder, so we need oslo.utils in stable branches, there were a few reviews, need to check on them | 18:02 |
dhellmann | dims: ok, let me know if I need to +2 anything there | 18:02 |
dims | dhellmann: yep will do | 18:02 |
*** AAzza is now known as AAzza_afk | 18:26 | |
*** AAzza_afk is now known as AAzza | 18:37 | |
openstackgerrit | gordon chung proposed a change to openstack/oslo-specs: graduate-oslo-middleware https://review.openstack.org/110353 | 18:39 |
*** dtantsur|afk is now known as dtantsur | 18:54 | |
*** pblaho has joined #openstack-oslo | 19:02 | |
*** pblaho has quit IRC | 19:02 | |
openstackgerrit | A change was merged to openstack/taskflow: Make greenexecutor not keep greenthreads active https://review.openstack.org/105922 | 19:06 |
*** tsekiyama has quit IRC | 19:14 | |
*** tsekiyama has joined #openstack-oslo | 19:16 | |
*** tpatil has joined #openstack-oslo | 19:22 | |
dhellmann | zzzeek: have a sec to talk about this test thread on the ML? | 19:26 |
zzzeek | sure | 19:26 |
zzzeek | so robert collins reached out to me and said he’d work on a sample integration point | 19:26 |
dhellmann | I hate to make you do this, but can you summarize the issue(s)? | 19:26 |
*** tpatil_ has joined #openstack-oslo | 19:27 | |
zzzeek | well we need resources that span multiple tests to be managed | 19:27 |
zzzeek | usually the way I’ve acheived that is by running hooks when the test suite starts up and when it tears down | 19:27 |
dhellmann | isn't this normally where we would do something like setupClass()? | 19:27 |
zzzeek | dhellmann: well setupclass is not expansive enough | 19:27 |
zzzeek | dhellmann: also it seems like we dont necessarily make use of setupclass/teardownclass, does testtools support it ? | 19:28 |
dhellmann | how does anything else know when it's safe to reuse vs. recreate the resource? | 19:28 |
zzzeek | dhellmann: well theres different ways to do this. robert collins pointed me to testresources | 19:28 |
dhellmann | I assume it does, but I don't know | 19:28 |
zzzeek | dhellmann: we can use testresources but i was looking for advise on how to set it up for a set of test runs. i dont like that it requires an explicit hook | 19:29 |
zzzeek | dhellmann: robert said on friday he’d work out something but havent heard from him | 19:29 |
dhellmann | zzzeek: ok, he's in Australia, so time zones are going to be way off | 19:30 |
zzzeek | dhellmann: initially i emulated someting I saw in other openstack reviews which was to use the hooks in .testr.conf as one way to have a global setup/terdown | 19:30 |
dhellmann | this isn't something I've looked into before, where did you find that pattern? | 19:30 |
*** tpatil has quit IRC | 19:30 | |
zzzeek | dhellmann: it was in a previous patch submitted by angus lees regarding a similar provisioning feature | 19:30 |
zzzeek | robert collins said it wasn’t appropriate. so that’s kind of a big -1 on that. | 19:31 |
*** AAzza is now known as AAzza_afk | 19:32 | |
dhellmann | sure, lifeless did a lot of work on the testing tools we're using, so I'll be interested to see what his input is on this | 19:32 |
zzzeek | dhellmann: well it looks like we would need to use the load_tests() hook in order to instrument some/all TestSuite objects | 19:32 |
zzzeek | dhellmann: that’s not a universally recognized hook | 19:33 |
zzzeek | dhellmann: so i was mostly asking, hey, OK i can’t hardcode to testr, but what test runners *do* we need to support, because neither nose nor pytest support load_tests() | 19:33 |
zzzeek | e.g. the “hardcode / dont hardcode” thing is starting to frustrate me | 19:33 |
dhellmann | we very very very much do not care about other test runners for openstack | 19:34 |
dhellmann | regardless of its faults, we're using testr for all of the projects | 19:34 |
zzzeek | dhellmann: ive been told otherwise | 19:34 |
dhellmann | because of its features | 19:34 |
dhellmann | which project? | 19:34 |
zzzeek | hold on | 19:34 |
zzzeek | there were a few when i grepped | 19:34 |
dhellmann | stevedore has not yet been converted, but I have a branch locally where I've started that work | 19:35 |
zzzeek | dhellmann: read james E blair on aug 21 9:19 pm at https://review.openstack.org/#/c/110486/ | 19:35 |
dhellmann | it doesn't use the db, so that conversion isn't a blocker | 19:35 |
zzzeek | dhellmann: dont see how to link to the comment | 19:35 |
zzzeek | “I agree with lifeless; we've fought hard to avoid requiring a specific test runner, and it's still the case that not all OpenStack projects have migrated to testr yet." | 19:35 |
zzzeek | dhellmann: also, the way that patch is, you *can* use any runner, its just the long-term provisioning thing wont take effect in those cases | 19:36 |
dhellmann | ok, well, that's news to me, I thought infra was the team that wanted us all using testr | 19:36 |
zzzeek | dhellmann: i dont see a .testr.conf in horizon | 19:37 |
dhellmann | they use the django test runner, I think, but I don't think that's important for this change | 19:37 |
zzzeek | dhellmann: testresources does a much more elaborate system of maintaining resources over many tests. it’s cool, but needs a more invasive hook setup | 19:37 |
zzzeek | dhellmann: e.g. the load_tests(), and i wanted to see if lifeless could provide an easy way to make that work across all tests... | 19:38 |
zzzeek | dhellmann: also, it changes TestSuite into OptimisingTestSuite | 19:38 |
zzzeek | dhellmann: meaning, it highly modifes how all tests are run | 19:38 |
dhellmann | yeah, that doesn't sound like a good thing | 19:38 |
zzzeek | dhellmann: it essentially tries to reorder tests | 19:38 |
zzzeek | dhellmann: well its part of the wohle testtools family | 19:38 |
dhellmann | I thought testr was doing that for us anyway | 19:38 |
zzzeek | dhellmann: not sure. | 19:38 |
zzzeek | dhellmann: so seems like, I need to take this series of patches and make a blueprint out of it | 19:39 |
zzzeek | i was going off the bug report i made: https://bugs.launchpad.net/oslo/+bug/1339206 | 19:39 |
dhellmann | how about if you work on a spec, so we can clarify the goals and get everyone to buy off on them before we make this big of a change. I'd like it to be circulated with the infra team and any other programs that want to have a say, and a spec is going to make it easier to log the decisions we make in that process | 19:40 |
zzzeek | also, Alexei Kornienko earlier on this patch series: “I don't like the fact that we do a vendor lock on testr. I don't think that this is something we should depend on. We've had similar problem in ceilometer and it's using a small shell script for the same purpose: https://github.com/openstack/ceilometer/blob/master/setup-test-env.sh” | 19:40 |
*** celttechie has quit IRC | 19:42 | |
tpatil_ | Hi dhellmann | 19:53 |
dhellmann | hi, tpatil_ | 19:53 |
tpatil_ | Can you please review patch https://review.openstack.org/#/c/103186/? this is a critical issue we are trying to fix from long time. | 19:53 |
stevemar | dhellmann, moved | 19:58 |
dhellmann | tpatil_: you want markmc, jd__ , sileht, and flaper87|afk to look at that -- they're all on the review list | 19:59 |
dhellmann | tpatil_: it looks like sileht (Mehdi) has already given some feedback | 19:59 |
tpatil_ | dhellmann: Yes, we had a lengthly discussion, he is not happy with calling gc.collect. | 20:00 |
dhellmann | stevemar: I'm not sure I understand your objection. | 20:00 |
dhellmann | tpatil_: the folks I listed above are much more familiar with the implementation of that library, so I'm likely to follow their advice | 20:01 |
stevemar | dhellmann, i wanted to add some notes about future use of oslo_debug_helper.sh, but currently, most of the content on the developer docs is actually generated from the README.rst file in the base directory | 20:01 |
stevemar | dhellmann, it just feels like the wrong place to add to it, do you mind if i muss around and restructure things (in a separate patch) | 20:02 |
tpatil_ | dhellmann:Sure, I will contact them. Thank you for your time. | 20:02 |
dhellmann | stevemar: I think we follow the pattern of importing the readme in most of the oslo libs, but this one does seem to have more than the usual amount of detail | 20:02 |
stevemar | dhellmann, ah didn't know that was the norm | 20:03 |
dhellmann | stevemar: well, like I said, usually there are fewer details. we should probably have moved these around, so if you want to do that I'm sure it'll be accepted | 20:04 |
stevemar | dhellmann, sure, i'll probably do it in 2 sets, 1) just add to the mess (add the steps in README.rst), then 2) move things around a bit and reduce the amount you see in README.rst | 20:05 |
*** yassine has joined #openstack-oslo | 20:05 | |
*** kgiusti has left #openstack-oslo | 20:06 | |
*** dtantsur is now known as dtantsur|afk | 20:07 | |
*** celttechie has joined #openstack-oslo | 20:08 | |
openstackgerrit | Joshua Harlow proposed a change to openstack/taskflow: Raise a runtime error when mixed green/non-green futures https://review.openstack.org/116487 | 20:10 |
dhellmann | stevemar: that approach seems fine, thanks | 20:14 |
openstackgerrit | Steve Martinelli proposed a change to openstack/oslotest: Restructure oslotest docs https://review.openstack.org/116716 | 20:31 |
*** miqui has quit IRC | 20:33 | |
*** tpatil_ has quit IRC | 20:40 | |
openstackgerrit | Steve Martinelli proposed a change to openstack/oslotest: Add documentation for running oslo_debug_heler.sh https://review.openstack.org/116722 | 20:43 |
openstackgerrit | Steve Martinelli proposed a change to openstack/oslotest: Restructure oslotest docs https://review.openstack.org/116716 | 20:48 |
*** jeckersb is now known as jeckersb_gone | 20:50 | |
*** ajo|mac has joined #openstack-oslo | 21:07 | |
*** ajo|mac is now known as ajo__ | 21:07 | |
openstackgerrit | Steve Martinelli proposed a change to openstack/oslotest: Add documentation for running oslo_debug_heler.sh https://review.openstack.org/116722 | 21:19 |
dhellmann | bnemec, dims : are you happy with the docs output in https://review.openstack.org/#/c/116665/ ? | 21:27 |
dhellmann | bnemec, dims : if so, I'll cut a release tomorrow after it merges | 21:28 |
bnemec | dhellmann: Yep, +A | 21:30 |
dhellmann | bnemec: cool | 21:30 |
*** markmcclain has joined #openstack-oslo | 21:30 | |
dhellmann | my cliff doc updates failed on neutron tests :-( | 21:30 |
openstackgerrit | Doug Hellmann proposed a change to openstack/cliff: Add release notes for 1.7.0 https://review.openstack.org/116658 | 21:39 |
openstackgerrit | Doug Hellmann proposed a change to openstack/cliff: Fix stable integration tests https://review.openstack.org/116731 | 21:39 |
*** mriedem has quit IRC | 21:42 | |
*** dims has quit IRC | 21:50 | |
*** dims has joined #openstack-oslo | 21:50 | |
*** stevemar has quit IRC | 21:53 | |
*** dims has quit IRC | 21:55 | |
*** ildikov_ has joined #openstack-oslo | 21:57 | |
*** dims has joined #openstack-oslo | 21:59 | |
*** dims_ has joined #openstack-oslo | 21:59 | |
*** ildikov has quit IRC | 22:00 | |
*** nealph__ has joined #openstack-oslo | 22:01 | |
dims_ | dhellmann: one nit - http://docs-draft.openstack.org/65/116665/1/check/gate-oslo.serialization-docs/bf1b993/doc/build/html/_sources/readme.txt | 22:02 |
dhellmann | dims_: looking | 22:02 |
dims_ | dhellmann: points to a page with ".. include:: ../../README.rst" | 22:02 |
dims_ | dhellmann: not a show stopper | 22:02 |
*** nealph_ has quit IRC | 22:03 | |
*** dims has quit IRC | 22:03 | |
dhellmann | dims: yeah, that's the source file for the page, isn't it? | 22:03 |
dhellmann | dims_: and that is accurately reflecting the source of the .rst file | 22:03 |
*** ajo__ has quit IRC | 22:04 | |
*** ajo|mac has joined #openstack-oslo | 22:05 | |
*** dims has joined #openstack-oslo | 22:05 | |
*** dims_ has quit IRC | 22:06 | |
*** tsekiyam_ has joined #openstack-oslo | 22:06 | |
*** gordc has quit IRC | 22:06 | |
*** pcm_ has quit IRC | 22:06 | |
*** ajo|mac is now known as ajo__ | 22:07 | |
*** tsekiyama has quit IRC | 22:08 | |
*** dims has quit IRC | 22:08 | |
*** jgrimm has joined #openstack-oslo | 22:09 | |
*** dims has joined #openstack-oslo | 22:09 | |
*** dims has quit IRC | 22:10 | |
*** dims_ has joined #openstack-oslo | 22:10 | |
*** ajo__ has quit IRC | 22:12 | |
*** HenryG_ has joined #openstack-oslo | 22:12 | |
*** sheeprine has quit IRC | 22:13 | |
*** HenryG has quit IRC | 22:15 | |
openstackgerrit | Abhishek Chanda proposed a change to openstack/stevedore: Migrate tox to use testr https://review.openstack.org/101673 | 22:20 |
*** markmcclain has quit IRC | 22:21 | |
openstackgerrit | A change was merged to openstack/oslotest: Add pdb support to tox with debug helper shell script https://review.openstack.org/116669 | 22:28 |
*** shakamunyi has joined #openstack-oslo | 22:32 | |
*** shakamunyi has quit IRC | 22:40 | |
*** celttechie has quit IRC | 22:47 | |
*** shakamunyi has joined #openstack-oslo | 22:54 | |
*** jgrimm is now known as zz_jgrimm | 22:54 | |
*** bknudson has quit IRC | 23:03 | |
*** markmcclain1 has joined #openstack-oslo | 23:04 | |
*** oomichi has joined #openstack-oslo | 23:16 | |
*** oomichi is now known as oomichi_away | 23:17 | |
*** yassine has quit IRC | 23:22 | |
openstackgerrit | lifeless proposed a change to openstack-dev/pbr: Raise an error if preversion versions are too low https://review.openstack.org/108269 | 23:27 |
openstackgerrit | lifeless proposed a change to openstack-dev/pbr: Look for and process sem-ver pseudo headers in git https://review.openstack.org/108270 | 23:27 |
openstackgerrit | lifeless proposed a change to openstack-dev/pbr: Refactor oneline changelog walking. https://review.openstack.org/108271 | 23:27 |
openstackgerrit | lifeless proposed a change to openstack-dev/pbr: Only consider tags that look like versions. https://review.openstack.org/114403 | 23:27 |
openstackgerrit | Joshua Harlow proposed a change to openstack/taskflow: Add a futures type that can contain most of our future functionality https://review.openstack.org/116489 | 23:36 |
*** dims_ has quit IRC | 23:48 | |
*** dims has joined #openstack-oslo | 23:48 | |
*** dims has quit IRC | 23:52 | |
*** dims has joined #openstack-oslo | 23:52 | |
*** ildikov_ has quit IRC | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!