Monday, 2014-09-15

*** praneshp_ has joined #openstack-oslo00:00
*** wendar has joined #openstack-oslo00:01
*** sigmavirus24b has joined #openstack-oslo00:01
*** gus_ has joined #openstack-oslo00:06
*** russellb_ has joined #openstack-oslo00:06
*** jraim_ has joined #openstack-oslo00:07
*** hartsocks has joined #openstack-oslo00:08
*** hartsocks is now known as Guest3229000:08
*** mgagne has joined #openstack-oslo00:08
*** mgagne is now known as Guest7273900:09
*** jroll|dupe has joined #openstack-oslo00:09
*** jraim has quit IRC00:13
*** jecarey has quit IRC00:13
*** praneshp has quit IRC00:13
*** AAzza_afk has quit IRC00:13
*** wendar_ has quit IRC00:13
*** sileht has quit IRC00:13
*** sigmavirus24_awa has quit IRC00:13
*** jroll has quit IRC00:13
*** hartbot has quit IRC00:13
*** Guest6936 has quit IRC00:13
*** russellb has quit IRC00:13
*** gus has quit IRC00:13
*** jroll|dupe is now known as jroll00:13
*** jraim_ is now known as jraim00:13
*** praneshp_ is now known as praneshp00:13
*** sileht has joined #openstack-oslo00:15
*** AAzza has joined #openstack-oslo00:19
*** AAzza_afk has joined #openstack-oslo00:29
*** gus_ is now known as gus00:29
*** AAzza has quit IRC00:29
*** AAzza_afk is now known as AAzza00:29
openstackgerritJoshua Harlow proposed a change to openstack/taskflow: Get the basics of a process executor working  https://review.openstack.org/12128000:29
*** AAzza_afk has joined #openstack-oslo00:32
*** AAzza has quit IRC00:37
*** AAzza_afk is now known as AAzza00:37
*** HenryG has quit IRC00:37
openstackgerritJoshua Harlow proposed a change to openstack/taskflow: Get the basics of a process executor working  https://review.openstack.org/12128000:42
*** harlowja_at_home has quit IRC00:46
*** dimsum_ has quit IRC00:57
*** dimsum_ has joined #openstack-oslo01:13
*** mriedem has left #openstack-oslo01:23
*** mriedem has quit IRC01:23
*** noelbk has joined #openstack-oslo01:43
*** dimsum_ has quit IRC01:51
*** r1chardj0n3s is now known as r1chardj0n3s_afk02:17
openstackgerritlifeless proposed a change to openstack-dev/pbr: Only consider tags that look like versions.  https://review.openstack.org/11440302:36
*** r1chardj0n3s_afk is now known as r1chardj0n3s02:39
*** harlowja_at_home has joined #openstack-oslo03:08
*** harlowja_at_home has quit IRC03:24
*** harlowja_at_home has joined #openstack-oslo03:27
openstackgerritJoshua Harlow proposed a change to openstack/taskflow: Get the basics of a process executor working  https://review.openstack.org/12128003:32
*** praneshp_ has joined #openstack-oslo04:12
*** praneshp has quit IRC04:14
*** praneshp_ is now known as praneshp04:14
*** liusheng has quit IRC04:31
*** liusheng has joined #openstack-oslo04:31
openstackgerritJoshua Harlow proposed a change to openstack/taskflow: Get the basics of a process executor working  https://review.openstack.org/12128004:42
*** jraim has quit IRC05:10
*** jraim_ has joined #openstack-oslo05:12
*** k4n0 has joined #openstack-oslo05:57
*** ildikov has joined #openstack-oslo06:21
*** palendae has quit IRC06:23
*** palendae has joined #openstack-oslo06:25
*** flaper87|afk is now known as flaper8706:26
*** vigneshvar has joined #openstack-oslo06:27
openstackgerritKevin Benton proposed a change to openstack/oslo.db: Provide better details for execution failure  https://review.openstack.org/12145206:46
*** ihrachyshka has joined #openstack-oslo07:25
openstackgerritPeng Wu proposed a change to openstack/oslo-specs: Add spec for more-gettext-support  https://review.openstack.org/12145907:25
*** ihrachyshka has quit IRC07:29
*** andreykurilin_ has joined #openstack-oslo07:31
*** vigneshvar has quit IRC07:41
*** andreykurilin_ has quit IRC07:49
*** praneshp_ has joined #openstack-oslo07:52
*** praneshp has quit IRC07:55
*** praneshp_ is now known as praneshp07:55
*** ihrachyshka has joined #openstack-oslo07:59
*** sileht has quit IRC08:05
*** jraim_ has quit IRC08:05
*** jraim_ has joined #openstack-oslo08:05
*** k4n0 has quit IRC08:05
*** k4n0 has joined #openstack-oslo08:05
*** ajo_ is now known as ajo08:07
*** pblaho has joined #openstack-oslo08:16
*** sileht has joined #openstack-oslo08:18
*** ihrachyshka_ has joined #openstack-oslo08:20
*** ihrachyshka has quit IRC08:21
*** viktors|afk is now known as viktors08:31
*** i159 has joined #openstack-oslo08:40
*** k4n0 has quit IRC08:48
*** ildikov has quit IRC08:50
*** k4n0 has joined #openstack-oslo09:07
openstackgerritJames Page proposed a change to openstack/oslo.serialization: Support 'built-in' datetime module  https://review.openstack.org/12147609:09
openstackgerritJames Page proposed a change to openstack/oslo.serialization: Support 'built-in' datetime module  https://review.openstack.org/12147609:12
*** ihrachyshka_ has quit IRC09:15
*** sileht has quit IRC09:19
i159jd__, dhellmann, noelbk, mikal, sileht, haypo, russellb_, bnemec, zyluo, markmc, flaper87: Hi, guys! You had reviewed this patch https://review.openstack.org/110058/, which I'm maintaining now. But you did not put any votes and comments. Please give me some feedback about Stan's work, I need to know how to continue this work.09:25
*** sileht has joined #openstack-oslo09:33
*** myatsenko has joined #openstack-oslo09:54
myatsenkotest09:55
*** pblaho is now known as pblaho|afk09:57
*** ihrachyshka_ has joined #openstack-oslo10:00
*** markmc has joined #openstack-oslo10:07
*** praneshp has quit IRC10:07
*** abhijeetm has joined #openstack-oslo10:15
openstackgerritA change was merged to openstack/oslo.db: Add a check for SQLite transactional state  https://review.openstack.org/12014810:18
*** vigneshvar has joined #openstack-oslo10:23
*** pcm_ has joined #openstack-oslo10:23
*** pcm_ has quit IRC10:23
*** pcm_ has joined #openstack-oslo10:24
*** Krast has joined #openstack-oslo10:34
*** Krast has quit IRC10:35
*** tsufiev_ is now known as tsufiev10:36
*** HenryG has joined #openstack-oslo10:37
*** k4n0 has quit IRC10:42
openstackgerritTim Kelsey proposed a change to openstack/oslo.messaging: Adds message security plugins  https://review.openstack.org/10980610:43
*** pblaho|afk is now known as pblaho10:49
*** k4n0 has joined #openstack-oslo11:03
*** pblaho is now known as pblaho|afk11:08
*** vigneshvar has quit IRC11:09
*** dimsum_ has joined #openstack-oslo11:12
*** pblaho|afk is now known as pblaho11:13
*** vigneshvar has joined #openstack-oslo11:20
*** dims_ has joined #openstack-oslo11:24
*** dimsum_ has quit IRC11:24
openstackgerritDavanum Srinivas (dims) proposed a change to openstack/oslo.vmware: Add a memory based shared cache  https://review.openstack.org/11629711:28
*** _amrith_ is now known as amrith11:31
*** dims_ has quit IRC11:33
*** dims has joined #openstack-oslo11:33
openstackgerritAnn Kamyshnikova proposed a change to openstack/oslo.db: ModelsMigrationsSync:add correct server_default check for Enum  https://review.openstack.org/12074611:47
*** tedross_ has joined #openstack-oslo11:50
*** jgrimm is now known as zz_jgrimm11:51
*** kgiusti has joined #openstack-oslo12:09
openstackgerritAnn Kamyshnikova proposed a change to openstack/oslo.db: ModelsMigrationsSync: Add check for foreign keys  https://review.openstack.org/11623812:13
*** pblaho is now known as pblaho|afk12:15
*** pblaho|afk is now known as pblaho12:17
*** dims has quit IRC12:18
*** dims has joined #openstack-oslo12:19
*** ajo has quit IRC12:21
*** ajo has joined #openstack-oslo12:36
*** abhijeetm has quit IRC12:40
*** zz_jgrimm is now known as jgrimm12:41
*** jeckersb_gone is now known as jeckersb12:41
*** gordc has joined #openstack-oslo12:43
ttxdhellmann: posted an oslo_release.sh utility at: https://review.openstack.org/#/c/121527/12:48
*** Guest32290 is now known as hartsocks12:49
ttxdhellmann: the idea would be to mark bugs FixReleased when you cut an alpha, but keep them in next-juno. Then when you cut a final tag, we rename the next-juno to the real version12:49
ttxthe script helps you do both12:49
*** markmc has left #openstack-oslo12:51
*** ajo has quit IRC12:52
*** ajo has joined #openstack-oslo12:53
viktorsdhellmann: hI! Please ping me, when you'll become online12:56
*** russellb_ is now known as russellb12:59
*** ajo has quit IRC13:00
*** ajo has joined #openstack-oslo13:00
*** tedross_ has quit IRC13:02
*** ajo has quit IRC13:02
*** ajo has joined #openstack-oslo13:03
*** ajo has quit IRC13:05
*** ajo has joined #openstack-oslo13:05
*** pblaho has quit IRC13:06
*** pblaho has joined #openstack-oslo13:06
*** ihrachyshka_ is now known as ihrachyshka13:11
openstackgerritJulien Danjou proposed a change to openstack/oslo-incubator: rpc, notifier: remove deprecated modules  https://review.openstack.org/10162913:11
*** k4n0 has quit IRC13:13
*** bknudson has quit IRC13:15
*** jeckersb is now known as jeckersb_gone13:17
*** tedross_ has joined #openstack-oslo13:18
*** pblaho has quit IRC13:25
*** jeckersb_gone is now known as jeckersb13:26
*** sigmavirus24b is now known as sigmavirus2413:31
*** sigmavirus24 has joined #openstack-oslo13:31
*** mriedem has joined #openstack-oslo13:32
dhellmannttx: I guess we don't want a separate milestone for each alpha?13:42
dhellmannttx: I need to think about how we're going to do planning beyond one milestone if we're only going to have a single "next" milestone for the whole cycle13:42
dhellmannttx: we did use the j1, j2, etc. milestones this cycle, for example13:43
dhellmannviktors: hi, what's up13:43
dhellmanni159: I'm a little uncomfortable introducing such a big change in behavior this late in the cycle. How critical is that bug? Can we make this a k-1 change?13:44
viktorsdhellmann: hi! I supposed to release a new version of oslo.db (finally!) and I just wanted to ensure a new version number13:46
dhellmannviktors: how much testing have you done to ensure this release won't cause issues with unit tests? I see a lot of changes ready for release13:48
viktorsdhellmann: I've tested on  cinder, glance, heat, ironic,  keystone, neutron, nova and sahara. All unittest passes ok wit oslo.db's master13:50
viktorsat least, it seems to be :)13:50
dhellmannviktors: ok, that seems promising13:51
viktorsdhellmann: :)13:51
*** bknudson has joined #openstack-oslo13:52
viktorsdhellmann: so  I wanted to clarify, should this be version 0.5.0 or 1.0.0 ?13:53
dhellmannviktors: we were planning to tag 1.0 on thursday, but if you think you're ready you can go ahead today13:54
ttxdhellmann: If you do multiple releases in one cycle, you just recreate a next-juno after tagging a release13:54
ttxor you rename after-next-juno to next-juno13:54
viktorsdhellmann: I supposed to do it tomorrow morning (by UTC+3)13:55
ttxnext-juno becomes a floating ref to "the next release of the lib"13:55
ttxat the end of a cycle there wouldn't be a next-juno, obviously13:55
viktorsdhellmann: about your documentat `Oslo Library Audit` - should I do any actions before release?13:55
dhellmannttx: right, that's how i was thinking of it working, so having the script always rename the milestone in lp would be good13:56
dhellmannttx: having it make another next-foo tag would be nice, too, if that's scriptable13:56
ttxdhellmann: the script could even optionally recreate next-juno or rename it from after-next-juno13:56
dhellmannviktors: we'll need to make sure those tasks are finished in kilo13:56
ttxyes it is13:56
viktorsdhellmann: got it, thanks13:57
ttxdhellmann: for this round we can just manually handle it, since there won't be a next-juno to recreate13:57
dhellmannttx: how about the foo-1, foo-2, etc. milestones? should we just not use those?13:57
dhellmannttx: sure, I'm thinking ahead for how we want to use this in kilo13:57
ttxdhellmann: what would you use those for ? You would create a release after each milestone ?13:58
dhellmannttx: no, just for scheduling13:58
dhellmannttx: we still want people to be thinking about those deadlines, because frequently if we don't land a feature in a lib by the right time in a cycle, it isn't going to be used that cycle13:59
ttxdhellmann: hmm13:59
ttxdhellmann: so the trick is, foo-N milestones wouldn't worrk so well if you want to be able to release mid-cycle14:00
dhellmannyeah14:00
*** jroll has quit IRC14:00
*** jroll has joined #openstack-oslo14:00
ttxI prefer the flexibility that next-SERIES gives us14:00
ttxbut if you can stick to one-lib-release-at-the-end... then sure14:00
ttxsplitting the work to get there into sub-milestones could work14:00
ttxwe would have to consolidate them at the end of cycle like we do for integrated release14:01
ttxdhellmann: it really depends if we want to be able to release mid-cycle14:01
dhellmannwe definitely need that14:01
ttxthen mixing the two systems is a bit weird14:02
dhellmannright now the only way for developer unit tests to use mid-cycle changes to the library is to have a release14:02
ttxmaybe doable, but weird14:02
dhellmannyeah14:02
ttxwe'll have to think about it14:02
ttxfor juno, that script should cover you14:02
ttxwe can test it on oslo.rootwrap14:02
ttxas I think it's ready for a new alpha tag which would be the final one14:03
dhellmannhow much do we care to have milestones in lp that use the alpha version numbers?14:03
ttxdhellmann: I don't think there is so much value in it14:03
ttxwhat you need to know is if the fix was released in an alpha (FixReleased)14:03
ttxand in which final release it ended up14:04
ttxthe proposed process conveys both pieces of information14:04
ttxdhellmann: got to jum in a meeting, ttyl14:04
dhellmannok, so then what if we modify the script to take an argument for the milestone (foo-N) and whether or not to close it (defaulting to false)14:04
dhellmannthat way during the run up to foo-N, we can release a bunch of separate times, marking bugs as fix released as we go, and at the end of foo-N we can close it14:04
dhellmannttx; ok, ^^14:05
ttxdhellmann: but what if you don't do a final release within kilo-1 ?14:06
ttxthen you end up with a milestone you need to move all stuff from14:06
dhellmannttx: then I'll just manually close the milestone14:06
ttxbut you ultimately want those BPs and bugs to appear on the milestone page for the release14:07
ttxso that means moving them14:07
dhellmannyes, true14:07
ttxwhich used to be funny, but with LP timeouts, not so much14:07
ttxi'm trying to avoid this hell14:07
dhellmannyeah14:07
dhellmannttx: I think just using next milestones is going to make that worse, because it gives us no place to put "future" work except the one open milestone14:08
ttxdhellmann: will have to think about it more14:09
ttxttyl14:09
dhellmannttx: me, too14:09
*** zzzeek has joined #openstack-oslo14:10
*** jecarey_ has quit IRC14:10
*** cfriesen_ has joined #openstack-oslo14:11
*** yamahata has joined #openstack-oslo14:18
*** jecarey has joined #openstack-oslo14:21
openstackgerritDoug Hellmann proposed a change to openstack/oslo-incubator: Do not try to show changes of non-master branches  https://review.openstack.org/12158414:25
*** beekneemech is now known as bnemec14:26
dhellmannttx: were you going to tag another rootwrap alpha today?14:29
openstackgerritJames Page proposed a change to openstack/oslo.messaging: Enable heartbeating on rabbitmq connections  https://review.openstack.org/9465614:37
*** tedross_ has quit IRC14:42
dhellmannjd__: I'm considering leaving https://review.openstack.org/#/c/105746/ out of the 1.4 release for oslo.messaging, since it's not in a published release yet and so isn't likely to be used by anyone. Thoughts?14:47
*** dims_ has joined #openstack-oslo14:56
ttxdhellmann: yes, I was considering to. The returncode patch won't be ready this week, I think, as it's non-trivial to test, and I don't really want to touch those at this point14:58
ttxso I deferred it to kilo-114:58
ttxor next-kilo14:58
*** dims__ has joined #openstack-oslo14:58
ttxso I was considering trying my script14:58
*** tsekiyama has joined #openstack-oslo14:59
*** dims has quit IRC14:59
*** dims_ has quit IRC15:01
*** jraim_ has quit IRC15:04
gordcdims, dhellmann: just an fyi, i cut the 0.1.0 release of oslo.middleware this morning15:05
gordchttps://pypi.python.org/pypi/oslo.middleware15:06
dhellmannttx: ok15:06
*** jraim has joined #openstack-oslo15:06
dhellmannttx: I did a couple of other alpha releases by hand, to get us ready for thursday15:06
dhellmanngordc: cool, when you announce that make sure it's clear we want people to be planning to adopt for kilo15:07
gordcdhellmann: ok. will do... i'll send a note to list once i update global-req15:07
*** vigneshvar has quit IRC15:08
dhellmanngordc: because of there requirements freeze, we probably won't add that until after juno is done15:09
gordcdhellmann: i see... do you recommend i send note even if not included in requirements?15:09
dhellmanngordc: yes, you've released it, so you should go ahead and announce it15:10
gordcdhellmann: sure thing.. i'll draft it up.15:10
ttxdhellmann: will tag tomorrow morning15:12
jd__dhellmann: I wouldn't mind15:13
dhellmannjd__: ok, thanks15:13
dhellmannttx: sounds good15:13
dhellmannzzzeek: can you fill me in on the status of https://bugs.launchpad.net/oslo.db/+bug/1367354 please?15:19
zzzeekdhellmann: well if https://review.openstack.org/#/c/120148/ is merged then i think that resolves15:20
dhellmannzzzeek: ok15:20
zzzeekwe also need https://review.openstack.org/#/c/120146/ for keystone15:21
zzzeekalso merged15:21
dhellmannzzzeek: I'll add those projects to the bug15:21
*** markmcclain has joined #openstack-oslo15:22
*** markmcclain has left #openstack-oslo15:23
*** praneshp has joined #openstack-oslo15:23
dhellmannharlowja_at_home: please let me know when you have a few minutes to talk about taskflow bugs on https://launchpad.net/oslo/+milestone/next-juno15:23
*** zzzeek_ has joined #openstack-oslo15:24
*** zzzeek has quit IRC15:24
*** zzzeek_ is now known as zzzeek15:24
jecareydhellmann, cinder is now hitting the mask_passwork coercion with six.text_type failure (https://bugs.launchpad.net/oslo.utils/+bug/1366189).  I added more analysis ... would like to discuss when you have time.15:25
*** viktors is now known as viktors|afk15:26
dhellmannjecarey: looking15:26
*** harlowja_at_home has quit IRC15:27
dhellmannjecarey: do you have any idea why we think we need to convert to unicode ourselves before using re?15:30
jecareyThe problem is if it is a i18n._Message object15:30
jecareythe re will be against the string it is holding that is the default translation (with replacement) ... so if subsequently translated that gets ignored.15:31
jecareyCould add a check just that particular case ... exposes i18n._Message object though.15:32
dhellmannhow about "if not isinstance()" as you propose in the bug?15:33
dhellmannif we have a message object and we convert it to unicode, we shouldn't need the encoding15:33
dhellmanntext_type() should  map to unicode() which doesn't have an encoding15:33
dhellmannjecarey: do you have a traceback in a pastebin somewhere?15:34
jecareydhellmann, cinder bug has one: https://bugs.launchpad.net/cinder/+bug/136852715:34
dhellmannugh, they're still using the incubator version of this code?15:35
dhellmannoh, it's a decode error, not an encode error15:36
dhellmannmisread that before15:36
dhellmannok, that does make more sense15:36
*** ihrachyshka has quit IRC15:37
dhellmannjecarey: so it looks like processutils is passing us a byte string instead of decoding it first15:39
jecareydhellmann, right ... should we add decoding there?15:40
dhellmannprobably, but that feels like a big change to be making this late15:40
dhellmannjecarey: how about if we make mask_password() trap the decode error and work on the byte string?15:41
dhellmannjecarey: and fix it properly in kilo, when we have more time to deal with fallout from the bigger change to process utils15:41
jecareydhellmann, ok ... so I can just eat the decode exception and use message as is.15:42
dhellmannjecarey: do you have a real case where we are passing a message to this function?15:42
dhellmannjecarey: nevermind, I thought you meant _Message but the arg name is message15:43
i159dhellmann: I don't think it is critical at all, because it has status "undecided". Actually I just want to have discussion about it to be more involved.15:43
dhellmannconfusion reigns15:43
dhellmanni159: ok, can it wait until next week? we're trying to focus on release critical bugs this week15:44
jecareydhellman, right.15:44
dhellmannour cut-off is thursday15:44
i159dhellmann: sure! thanks15:44
dhellmannjecarey: yes, then, if there's a decode error try just using the message value as it's given15:44
jecareyok ... I'll get a patch up right away.15:45
dhellmannjecarey: please include a comment that this is a temporary fix and not the best way to handle the problem and we'll be working on a better version for kilo15:45
dhellmanni159: thanks15:45
jecareydhellmann, will do.15:45
*** tedross_ has joined #openstack-oslo15:46
dhellmannjecarey: I will open a separate bug to fix processutils in kilo15:47
dhellmannjecarey: actually, I'll just use this same bug but target it for kilo for oslo.concurrency15:47
*** enykeev has joined #openstack-oslo15:48
jecareydhellmann, sounds good.15:48
*** enykeev has quit IRC15:49
dhellmannjecarey: I left a couple of comments in response to your last comment on that bug15:52
*** i159 has quit IRC15:53
*** tongli has joined #openstack-oslo16:04
*** harlowja_at_home has joined #openstack-oslo16:08
*** electrichead is now known as redrobot16:08
*** yamahata has quit IRC16:12
*** jraim has quit IRC16:17
*** jraim has joined #openstack-oslo16:18
*** vigneshvar has joined #openstack-oslo16:28
*** praneshp_ has joined #openstack-oslo16:42
*** praneshp has quit IRC16:45
*** praneshp_ is now known as praneshp16:45
*** dims__ has quit IRC16:59
zzzeekdhellmann: should we be getting kilo added to https://github.com/openstack/oslo-specs/tree/master/specs soon16:59
*** dims has joined #openstack-oslo16:59
dhellmannzzzeek: you could submit a patch to add it, but I don't think we're going to be looking at kilo specs before next week16:59
zzzeekdhellmann: OK, just wondering how to be useful til then… :)17:00
zzzeeki hve plenty of upstream work to do should proablby do that17:00
dhellmannzzzeek: I think there are some untriaged oslo.db bugs that could use some attention, too17:00
dhellmanneven just triaging them would be useful17:00
zzzeekwe hvae bugs, unbelivable17:00
*** dims has quit IRC17:04
openstackgerritDoug Hellmann proposed a change to openstack/oslo-specs: Remove specs not completed in juno  https://review.openstack.org/12009517:04
*** harlowja has joined #openstack-oslo17:04
*** dims has joined #openstack-oslo17:04
*** e0ne has joined #openstack-oslo17:06
*** vigneshvar has quit IRC17:12
openstackgerritJoshua Harlow proposed a change to openstack/taskflow: Just use the natural module name instead of aliasing to tt  https://review.openstack.org/11918617:19
*** takedakn has joined #openstack-oslo17:19
openstackgerritJames Carey  proposed a change to openstack/oslo-incubator: Enabled mask_password to handle byte code strings  https://review.openstack.org/12163217:22
*** vigneshvar has joined #openstack-oslo17:25
*** praneshp has quit IRC17:30
*** takedakn1 has joined #openstack-oslo17:31
*** takedakn has quit IRC17:33
*** bjornar_ has joined #openstack-oslo17:33
*** e0ne has quit IRC17:34
dhellmannjecarey: do you have an oslo.utils patch for that in the works, too?17:48
morganfainbergzzzeek, i keep coming back around that i greatly dislike python-memcache and want to fork it / fix it / release it from stackforge17:50
morganfainbergzzzeek, once we're past RC i think i might do that.17:50
zzzeekinteresting17:52
morganfainbergzzzeek, my thought is it would support the same interface as today (mostly) but be backed to a better interface that allowed for either thread.local or non-thread.local use, a pool construct, and py2/3 compat17:52
morganfainbergso drop-in or a better /propper setup.17:52
harlowjamorganfainberg why not use https://pypi.python.org/pypi/pymemcache ??17:53
morganfainbergharlowja, that was the fork, it's only py3 compat last i saw17:53
morganfainbergharlowja, or only 2717:53
harlowjagotcha17:53
morganfainbergharlowja, one of those. it's like python + memcache is something hard to do :(17:54
harlowjahttps://pypi.python.org/pypi/pymemcache shows 26,27,3317:54
morganfainbergharlowja, hm i'll need to take a look iirc there was some major issue with ti.17:54
harlowjahmmm k17:54
harlowjaif u figure it out maybe can just ask them to fix it :-P17:54
morganfainbergharlowja, sure. i know there has been some serious lack of interest in fixing things when it comes to memcache libs :(17:55
harlowjahmmm, well let me know if u find the issue, i'll submit a pull request :-P17:55
harlowjaas long as the issue isn't huge, lol17:55
harlowjawhich then i might defer, ha17:55
morganfainbergharlowja, it's (i think) because memcache largly was replaced in the industry by noSQL and datasets that don't fit in memcached's 1MB slab size (default)17:56
harlowjaok, so thats just an inherent problem to memcache17:56
morganfainbergyeah17:56
openstackgerritDoug Hellmann proposed a change to openstack/oslo-incubator: Enabled mask_password to handle byte code strings  https://review.openstack.org/12163217:56
morganfainbergand i think thats why development on memcache has kindof stalled17:56
morganfainbergRedis has a similar IO profile (iirc) and less limitations17:56
harlowjadepends on what its used for i guess, i've used it quite often in yahoo, although not in years17:56
morganfainbergand then people use mongo etc in the same manner17:57
harlowjaused enough of it in my c++ days17:57
morganfainbergharlowja, exactly, most people "haven't used it in years".17:57
harlowja:-P17:57
harlowjawell thats mainly cause i got sucked into openstack, lol17:57
harlowjai'm pretty sure its used elsewhere, as long as u don't try to shove > 1MB values in it (which is dumb)17:57
morganfainbergharlowja, a lot of people moved to redis (better overall)17:58
harlowjawhen u have to put ~1MB values in a cache, u not using a cache right, lol17:58
harlowjaagreed17:58
morganfainbergharlowja, eh, there are cases where it's valid to cache >1MB values17:58
harlowjameh17:58
harlowjasure, there are cases, but in majority of things u are caching, u shouldn't do that17:58
morganfainbergharlowja, when i worked on CDN tech we did block based caching for videos and mp3s for streaming17:58
morganfainbergit made a lot of sense to cache more than 1MB17:58
harlowjasure, don't use memcache for that kidn of stuff, lol17:59
morganfainberg(this was back in 2008/2009)17:59
morganfainbergwe had a bad custom event-based webserver with a weird allocator17:59
morganfainbergin c++17:59
morganfainbergi.. lets just say never again17:59
harlowja:-p17:59
morganfainberg:P17:59
harlowja+217:59
harlowjaha17:59
* morganfainberg might even have some of that code still.17:59
morganfainbergbut i hesitate to look for it cause it makes me cringe18:00
harlowjaya, sounds not so much fun18:00
harlowjahttp://trafficserver.apache.org/ was released from yahoo -> apache, and it sounds similar18:00
harlowjaevent based server (used for CDN stuf...)18:00
harlowjasupposedly crazy c++ code, lol18:00
harlowjastill runs a shit-ton of yahoo though, lol18:01
*** dims has quit IRC18:06
*** dims has joined #openstack-oslo18:11
morganfainbergzzzeek, ah maybe we are looking for pymemcache18:16
dhellmannjd__: is there anything to do for the pylockfile adoption other than the governance change?18:16
morganfainbergzzzeek, once we get through RC it should be easy to move to it (i'll submit the PR for dogpile to add it as a backend)18:17
zzzeekmorganfainberg: wow have not seen this before looks promising18:17
morganfainbergzzzeek, exactly18:17
zzzeekwow this is perfect18:18
zzzeekthe issues they lay out here are exactly the probs we hve18:18
zzzeekthe theradlocal thing, etc18:18
*** praneshp has joined #openstack-oslo18:18
morganfainbergzzzeek, one minor issue, need to specify the serializer clearly18:18
*** vigneshvar has quit IRC18:18
morganfainbergpython-memcache uses pickle. we probably need to implement something similar as the default in dogpile for that backend18:18
morganfainbergbut allow overriding it18:18
zzzeekmorganfainberg: i think we have that18:18
zzzeekmorganfainberg: its in the backend, take a look18:18
morganfainbergzzzeek, ah ok18:18
morganfainbergzzzeek, i'll 2x check but this should be easy.18:19
morganfainbergzzzeek, add in configurable pools (actually i want to make  a drop-in replacement for whatever lib is used that just layers pooling into the client) i think we'll have solved thread.local18:19
zzzeekyup18:20
zzzeeki can support any kind of pooling as long as there isnt one big scary pool actually in the lib itself :)18:20
morganfainbergzzzeek, yeah18:20
zzzeekb.c. someone else can maintain that :)18:20
morganfainberghahah18:20
morganfainbergzzzeek, so i think i'm going to be rewriting that memcache pool patch to not use the cleaner thread.18:21
morganfainbergi reallly don't like that cleaner thread.18:21
morganfainbergzzzeek, it seems like overkill under eventlet, and in apache we don't care about thread.local18:21
zzzeekmorganfainberg: yeah background threads is never something i want straight in a library, that can be built elsewhere18:22
morganfainbergzzzeek, +1billion18:22
*** openstackgerrit has quit IRC18:32
*** openstackgerrit has joined #openstack-oslo18:32
openstackgerritA change was merged to openstack/oslo-incubator: Mark middleware as obsolete  https://review.openstack.org/11821518:36
*** vigneshvar has joined #openstack-oslo18:39
*** praneshp has quit IRC18:43
*** tkelsey has joined #openstack-oslo18:43
*** tkelsey has quit IRC18:45
*** vigneshvar has quit IRC18:48
*** vigneshvar has joined #openstack-oslo18:48
*** praneshp has joined #openstack-oslo18:49
*** praneshp has quit IRC18:50
*** e0ne has joined #openstack-oslo19:04
*** e0ne has quit IRC19:05
*** praneshp has joined #openstack-oslo19:05
*** amrith is now known as _amrith_19:11
openstackgerritJames Carey  proposed a change to openstack/oslo.utils: Enable mask_password to handle byte code strings  https://review.openstack.org/12165719:14
*** harlowja has quit IRC19:14
*** harlowja_ has joined #openstack-oslo19:14
*** rpodolyaka1 has joined #openstack-oslo19:23
openstackgerritJoshua Harlow proposed a change to openstack/taskflow: Get the basics of a process executor working  https://review.openstack.org/12128019:29
*** GheRivero_pto is now known as GheRivero19:30
openstackgerritJoshua Harlow proposed a change to openstack/taskflow: Get the basics of a process executor working  https://review.openstack.org/12128019:33
openstackgerritJoshua Harlow proposed a change to openstack/taskflow: Get the basics of a process executor working  https://review.openstack.org/12128019:35
openstackgerritJoshua Harlow proposed a change to openstack/taskflow: Get the basics of a process executor working  https://review.openstack.org/12128019:47
*** jecarey has quit IRC19:47
*** harlowja_at_home has quit IRC19:57
*** jraim has quit IRC20:00
*** rpodolyaka1 has quit IRC20:00
*** jraim has joined #openstack-oslo20:00
*** rpodolyaka1 has joined #openstack-oslo20:01
*** kgiusti has quit IRC20:02
*** takedakn1 has quit IRC20:03
*** takedakn has joined #openstack-oslo20:04
*** andreykurilin_ has joined #openstack-oslo20:07
*** rpodolyaka1 has quit IRC20:11
*** noelbk has quit IRC20:12
*** rpodolyaka1 has joined #openstack-oslo20:13
*** noelbk has joined #openstack-oslo20:16
*** tongli has quit IRC20:26
*** dims has quit IRC20:34
*** dims has joined #openstack-oslo20:34
*** dims has quit IRC20:39
*** harlowja_at_home has joined #openstack-oslo20:48
*** harlowja_ is now known as harlowja_away20:49
*** jeckersb is now known as jeckersb_gone20:49
*** yamahata has joined #openstack-oslo20:58
*** yamahata has quit IRC20:58
*** yamahata has joined #openstack-oslo20:59
*** rpodolyaka1 has quit IRC21:01
*** jecarey has joined #openstack-oslo21:02
*** rpodolyaka1 has joined #openstack-oslo21:04
openstackgerritJames Carey  proposed a change to openstack/oslo.utils: Enable mask_password to handle byte code strings  https://review.openstack.org/12165721:07
openstackgerritJames Carey  proposed a change to openstack/oslo-incubator: Enabled mask_password to handle byte code strings  https://review.openstack.org/12163221:08
*** tedross_ has quit IRC21:11
*** vigneshvar has quit IRC21:14
dhellmannharlowja_at_home: you around today?21:26
*** dims has joined #openstack-oslo21:29
*** dims_ has joined #openstack-oslo21:31
*** dims has quit IRC21:34
*** pcm_ has quit IRC21:39
morganfainbergzzzeek, so here is the new(est) pool impl: https://review.openstack.org/#/c/119452/7/keystone/common/cache/_memcache_pool.py21:40
morganfainbergzzzeek, it's a lot cleaner without the dedicated thread21:40
zzzeekmorganfainberg: is that acquire/release for every get() ?21:41
morganfainbergzzzeek, yeah21:41
zzzeekmorganfainberg: ouch21:41
morganfainbergzzzeek, same thing as before, because its in a pool.21:41
morganfainbergzzzeek, it just was hidden a bit more since it wasn't a single class.21:42
morganfainbergbasically it is doing a "get a connection perform an action and drop that connection back into the pool" each time you need to do something with memcached21:42
morganfainbergit reuses the connection objects where possible.21:43
morganfainbergzzzeek, the biggest difference is we do the TTL reap on accquire instead of as a side-band process now21:44
zzzeekmorganfainberg: i see that21:44
dhellmannwe're down to 3 high or critical bugs for our final release this week21:44
zzzeekmorganfainberg: you can maybe space out that check by only running it on a modulus of the current time21:44
morganfainbergzzzeek, ++ i'm good with that21:44
*** flaper87 is now known as flaper87|afk21:46
*** andreykurilin_ has quit IRC21:48
*** andreykurilin_ has joined #openstack-oslo21:48
morganfainbergzzzeek, the ttl reap is probably light enough weight that a mod wont buy us much21:53
zzzeeki just stare at code all day where .65 sec vs 1.5 sec for 100K is a big deal…. :)21:53
morganfainbergzzzeek, right but we're only reaping if a connection is in the pool and hasn't been used recently21:54
zzzeekyou do this loop: for deaduntil, host in zip(self._server_list,9821:54
zzzeekconn.servers):21:54
zzzeekfor every acquire21:54
morganfainbergah the deaduntil stuff21:54
zzzeeka call to zip(), etc.21:54
morganfainbergthat is a different one.21:54
morganfainbergyeah, hrm. unfortunately we need to catch dead servers sooner vs later21:55
morganfainbergso we don't *ever* send traffic to them.21:55
morganfainbergzzzeek, i kinda wish we could just say "don't use memcached"21:56
*** mriedem has quit IRC22:01
*** stevemar has joined #openstack-oslo22:05
stevemardhellmann, is there going to be another release of oslotest? or does that not necessarily need to be released on thursday with the others?22:06
stevemardhellmann, was hoping to get https://review.openstack.org/#/c/120316/ in before another cut of oslotest22:06
dhellmannstevemar: I was not planning another release for juno, but that could go into the first alpha for kilo22:07
dhellmannstevemar: is it blocking you?22:08
*** harlowja_at_home has quit IRC22:12
stevemardhellmann, not really, would just be a nice to have for keystoneclient22:13
dhellmannstevemar: we can do a kilo alpha release monday, if that works for you22:15
stevemardhellmann, yep!22:15
dhellmannstevemar: ok, we might actually need more time for the review, but in principle it should be possible to release quickly22:16
*** sigmavirus24 is now known as sigmavirus24_awa22:17
*** takedakn has quit IRC22:20
*** bknudson has quit IRC22:21
openstackgerritJon Grimm proposed a change to openstack/oslo.config: Warn if new and deprecated options are both present  https://review.openstack.org/12169122:21
*** r1chardj0n3s is now known as r1chardj0n3s_afk22:23
*** harlowja_away is now known as harlowja_22:24
openstackgerritA change was merged to openstack/oslo-incubator: Enabled mask_password to handle byte code strings  https://review.openstack.org/12163222:24
*** rpodolyaka1 has quit IRC22:30
*** rpodolyaka1 has joined #openstack-oslo22:33
*** rpodolyaka1 has quit IRC22:36
*** rpodolyaka1 has joined #openstack-oslo22:36
*** gordc has quit IRC22:37
*** jgrimm is now known as zz_jgrimm22:38
*** bjornar_ has quit IRC22:39
*** r1chardj0n3s_afk is now known as r1chardj0n3s22:44
*** takedakn has joined #openstack-oslo22:50
*** andreykurilin_ has quit IRC22:59
*** harlowja_at_home has joined #openstack-oslo23:08
*** dims_ has quit IRC23:09
*** jeckersb_gone is now known as jeckersb23:16
*** rpodolyaka1 has quit IRC23:16
*** harlowja_at_home has quit IRC23:19
*** tsekiyama has quit IRC23:27
openstackgerritJoshua Harlow proposed a change to openstack/taskflow: Get the basics of a process executor working  https://review.openstack.org/12128023:34
*** myatsenko has quit IRC23:52
*** AAzza has quit IRC23:52
*** AAzza has joined #openstack-oslo23:53
*** myatsenko has joined #openstack-oslo23:53
*** takedakn has quit IRC23:55
*** dims has joined #openstack-oslo23:57
*** arnaud has joined #openstack-oslo23:58
*** 20WABJQK7 has joined #openstack-oslo23:58
*** rpodolyaka1 has joined #openstack-oslo23:59
*** zzzeek has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!