Thursday, 2013-10-03

*** malini_afk is now known as malini00:09
*** nosnos has joined #openstack-marconi01:04
*** oz_akan_ has joined #openstack-marconi01:27
*** kgriffs_afk is now known as kgriffs02:04
*** malini is now known as malini_afk02:22
*** kgriffs is now known as kgriffs_afk03:08
*** vkmc has quit IRC03:22
*** ayoung has quit IRC03:48
*** oz_akan_ has quit IRC04:07
*** oz_akan_ has joined #openstack-marconi05:18
*** oz_akan_ has quit IRC05:23
*** tvb has joined #openstack-marconi06:14
*** tvb has quit IRC06:14
*** tvb has joined #openstack-marconi06:14
*** ykaplan has joined #openstack-marconi06:28
*** flaper87|afk has quit IRC07:17
*** flaper87|afk has joined #openstack-marconi07:18
*** flaper87|afk is now known as flaper8707:18
*** flaper87 has quit IRC07:30
*** flaper87 has joined #openstack-marconi07:30
*** yassine has joined #openstack-marconi08:23
*** ykaplan has quit IRC09:15
*** ykaplan has joined #openstack-marconi09:20
*** tvb has quit IRC09:36
*** tvb has joined #openstack-marconi09:40
*** ykaplan has quit IRC09:50
*** ykaplan has joined #openstack-marconi09:55
*** tvb has quit IRC10:02
*** tvb has joined #openstack-marconi10:33
*** flaper87 is now known as flaper87|afk10:40
*** tvb has quit IRC10:41
*** tvb has joined #openstack-marconi10:45
*** ykaplan has quit IRC10:50
*** nosnos has quit IRC10:56
*** tvb has quit IRC11:19
*** ykaplan has joined #openstack-marconi11:21
*** tedross has joined #openstack-marconi11:30
*** flaper87|afk is now known as flaper8712:04
*** tvb has joined #openstack-marconi12:39
*** flaper87 is now known as flaper87|afk12:52
*** oz_akan_ has joined #openstack-marconi12:55
*** oz_akan_ has quit IRC12:56
*** oz_akan_ has joined #openstack-marconi12:56
*** flaper87|afk is now known as flaper8713:06
*** mpanetta has joined #openstack-marconi13:07
mpanettamornin13:07
flaper87mpanetta: morning13:08
mpanettaHow are things going flaper87?13:14
flaper87mpanetta: alll good, struggling with rebase hell now. You?13:15
mpanettaTrying a new test idea13:16
mpanettaThe proxy is not behaving quite as well as I had hoped, trying to nail down a good baseline to see at what point things break even.13:17
fvollerompanetta: great way to keep him quiet :)13:20
flaper87fvollero: LOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOL13:21
fvolleroflaper87: <3 <3 you know that bro13:22
flaper87you better do, you BETTER do! :P13:22
*** mpanetta has quit IRC13:22
*** mpanetta has joined #openstack-marconi13:23
fvolleroflaper87: r u going to some conf in those weeks ?13:23
mpanettahaha13:23
flaper87fvollero: PyConIE next week, MongoTorino Oct 26th and OS Summit13:25
fvolleroflaper87: cool OS Summit where it is ?13:25
*** malini_afk is now known as malini13:28
flaper87fvollero: HKG13:29
fvolleroflaper87: Awwww wanna comeee!13:29
flaper87fvollero: I'll think about you when I'm there. Does that count?13:30
flaper87:D13:30
flaper87fvollero: you can insult me now13:30
flaper87fvollero: not that you couldn't do it before, though13:31
*** ykaplan has quit IRC13:32
*** vkmc has joined #openstack-marconi13:34
*** vkmc has joined #openstack-marconi13:34
*** amitgandhi has joined #openstack-marconi13:35
*** ykaplan has joined #openstack-marconi13:35
*** mpanetta has quit IRC13:48
*** mpanetta has joined #openstack-marconi13:48
*** mpanetta_ has joined #openstack-marconi13:56
*** mpanetta has quit IRC13:56
fvolleroflaper87: ok... say good bye to the Cocosette :P13:56
flaper87:'( now you broke my heart!13:57
flaper87not cool man, not cool13:57
*** alcabrera has joined #openstack-marconi13:59
flaper87al-maisan: YOUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUU13:59
flaper87alcabrera: ^13:59
flaper87that was meant for you13:59
flaper87alcabrera: goood morning!!13:59
alcabreraflaper87: Good morning! :D13:59
flaper87alcabrera: Mr. Lets break flaper87's config refactor13:59
flaper87:D13:59
*** jcru has joined #openstack-marconi13:59
alcabrera;)13:59
alcabreraI'll break all the things - and I often do. :D14:00
flaper87alcabrera: just kidding, I had to go through rebase hell but I'm out now!14:00
flaper8730mins clean14:00
alcabrerawoot14:00
alcabreraI had to rebase so much while working on those 4 proxy patches. :P14:01
alcabreraI had it down to a science.14:01
alcabrera15 minutes to rebase 4.14:01
alcabreraI wonder what's in the review queue this morning...?14:02
flaper87I meant that I finished rebasing that stuff 30mins ago, I'm clean now :D14:02
flaper87alcabrera: all your patches got merged14:02
alcabreraflaper87: oooohhh14:03
alcabreraflaper87: also, hurray! I noticed last night while doing *one last* email check. :P14:03
alcabrerabrb14:03
fvolleroalcabrera: morning :)14:04
*** ayoung has joined #openstack-marconi14:05
* flaper87 just git rm common.config14:05
openstackgerritFlavio Percoco proposed a change to openstack/marconi: Use oslo.config directly instead of common.config  https://review.openstack.org/4955014:13
flaper87alcabrera: https://review.openstack.org/#/c/49550/14:13
flaper87:)14:13
*** mpanetta has joined #openstack-marconi14:17
*** mpanetta_ has quit IRC14:17
*** mpanetta_ has joined #openstack-marconi14:18
*** mpanetta has quit IRC14:18
openstackgerritFlavio Percoco proposed a change to openstack/marconi: Use oslo.config directly instead of common.config  https://review.openstack.org/4955014:21
*** tvb has quit IRC14:22
*** jdaggett has joined #openstack-marconi14:23
alcabreraback14:24
alcabrerafvollero: good morning!14:24
alcabreraflaper87: ooohh, migrating to oslo.config - awesome!14:24
alcabreraflaper87: also, jenkins is pleased with your patch - sweet14:25
malinio/////14:26
flaper87malini: hellooooooooooooooooooooooooooooooooooooooo14:27
* alcabrera notices malini has 5 arms - amazing!14:27
* alcabrera or maybe she's waving so fast that it creates after effects14:27
malinialcabrera: I usually just bring two..today was an exception ;)14:27
alcabrera:D14:29
alcabreraflaper87: I'm considering adding asynchronous behavior to marconi at the transport layer using eventlet. When I say marconi, I mean both at the proxy level and at the queues level. Do you have any thoughts on this?14:32
mpanetta_haha14:32
*** mpanetta_ is now known as mpanetta14:32
alcabreraAt the moment, I've got a working experimental version where I just introduce async before forwarding requests from the proxy.14:33
alcabrera(needs to benchmark a little)14:33
maliniif anybody is getting bored https://bugs.launchpad.net/marconi/+bug/123448114:35
alcabreramalini: triaged and confirmed14:37
flaper87alcabrera: mmh, not sure about that, Is there something wrong about letting gunicorn (for example) take care of that14:38
flaper87?14:38
malinithanks alcabrera!14:41
flaper87alcabrera: I'll wait for that first partch to merge before going forward with the complete removal of global instances14:42
alcabreraflaper87: I need to investigate using alternate workers, too. I've benchmarked on localhost, but that leads to (eventlet workers) great slow downs. I'm curious to see how using alternative workers works across a network.14:43
flaper87alcabrera: TBH, I'm a bit hesitant to depend on either eventlet and gevent, I'd definitely prefer leaving that to others14:44
flaper87which is the main reason why we provide a WSGI app and not a full prod-ready server14:44
alcabrerahmmm14:46
zyuanthe functional tests is not broken; there is always some issue with tox and testtools. i got the leasted version test passed14:52
zyuanmalini: ^^14:52
malinizyuan: do you mean to say that list queues with detailed=True works with the master ?14:54
zyuanall tests work with master...14:55
malinizyuan: do you have the proxy running ?14:56
zyuanno, i just run testtools14:56
zyuanyou mean you started funtional tests with proxy in front?14:57
maliniI am running the tests against an env that has proxy set up14:57
zyuanok...14:57
openstackgerritFlavio Percoco proposed a change to openstack/python-marconiclient: Create v1 package and move messages there  https://review.openstack.org/4866415:02
flaper87alcabrera: ^15:03
alcabreraflaper87: +2'd15:05
alcabrera:)15:05
alcabreraI still need to review the config patch.15:05
flaper87alcabrera: take your time, it should be fairly straightforward15:06
*** flaper87 is now known as flaper87|afk15:11
*** flaper87|afk is now known as flaper8715:11
alcabrerazyuan, malini: bug report updated: https://bugs.launchpad.net/marconi/+bug/123448115:12
alcabreraflaper87: hahaha, I realize now I should've been using "Partially-implements" all this time.15:12
alcabreraflaper87: Every single one of my patches *fully implemented* the placement service. That's kind of silly. :P15:13
flaper87alcabrera: LOOL :D15:19
flaper87well, in your defense, that's pretty new stuff15:19
alcabreraflaper87: I'm loving the config patch, and I'll have a lot of questions by the end of it.15:20
*** kgriffs_afk is now known as kgriffs15:20
flaper87alcabrera: sounds good, lemme know when you finish reviewing it!15:20
alcabreraflaper87: -1'd - full of questions, full of promise. :)15:25
kgriffsflaper87: you like hot sauce?15:27
kgriffs</random-question>15:27
flaper87kgriffs: I do15:27
flaper87A LOT!15:27
kgriffsexcellent15:27
alcabreraoohh, hot sauce...15:27
alcabreraI like the stuff. Jalapeño is my favorite. :)15:28
* flaper87 used to eat Jalapeños at his "Merienda" when he was in Venezuela15:29
flaper87I seriously think my tongue is completely bruned15:29
alcabreraflaper87: lol, that's a bit much for me, but *that* jalapeño flavor in moderation is amazing.15:30
kgriffsHeh. I'm growing Moruga Scorpion peppers at the moment in my back yard. If all goes well, I'm going to have some pretty awesome hot sauce. I'll have to send you a batch.15:30
flaper87kgriffs: wooooow, sounds goood!!! Looking forward to have some of that homemade hot sauce15:31
alcabrerakgriffs: spicy!15:31
*** tvb has joined #openstack-marconi15:32
*** tvb has quit IRC15:35
*** tvb has joined #openstack-marconi15:35
*** tvb has quit IRC15:35
*** tvb has joined #openstack-marconi15:35
alcabrerakgriffs: A little microbenchmark for you: http://paste.openstack.org/show/47915/15:41
alcabreraThe results are especially interesting on pypy-2.115:41
alcabrerakgriffs: perf bug report filed for string concatenation on hot code paths: https://bugs.launchpad.net/marconi/+bug/123478915:47
alcabreraflaper87: allow `update` to update multiple fields: https://bugs.launchpad.net/marconi/+bug/123479015:49
* alcabrera is capturing bugs from proxy patch reviews and noting them for later15:49
flaper87alcabrera: awesome, thanks for that! I've a pretty bad memory :P15:50
kgriffsthis review should only take a moment: https://review.openstack.org/#/c/49451/15:50
flaper87that also helps splitting work15:50
alcabrerathere - I captured all the bugs from the merged proxy patches.15:51
kgriffsalcabrera: ah, cool. pypy rocks15:51
alcabreraThere's the matter of a docstring missing a type and a typo (middlewarez), but those are minor enough that they can be handled eventually. :)15:52
kgriffsanyone who thinks otherwise is wrong.15:52
kgriffs:D15:52
alcabrerakgriffs: lol, yeah, pypy is pretty sweet.15:52
alcabreraSomeday, given enough time, I'd love to contribute to pypy. I really need to get deep into that to understand how it runs.15:52
kgriffsflaper87: fixed that last Py3 bug: https://review.openstack.org/#/c/48776/15:53
kgriffsoops15:53
kgriffsi meant15:53
kgriffsalcabrera: fixed that last Py3 bug:15:53
*** yassine has quit IRC15:53
kgriffs#copy-paste-fail15:53
flaper87kgriffs: small question in that review15:54
kgriffssure15:54
flaper87not big deal but it may be worth considering15:54
flaper87feel free to ignore that or to postpone it15:54
kgriffshmm15:55
alcabreralessee...15:57
alcabrerakgriffs: +2 approved!15:58
alcabrerafor the non-ascii queues deal15:58
kgriffssweet15:59
kgriffsflaper87: were you thinking to just to use the skip or skipIf decorator?16:00
alcabrerakgriffs: +2 on the other patch, as well, with flaper87's suggestion noted.16:00
kgriffsor perhaps the requires_mongodb could apply the decorator itself16:01
flaper87kgriffs: yeah, either that or make the decorator you created smart enough to skip the whole suite16:01
kgriffslet me play around with that idea16:01
flaper87kgriffs: exactly16:01
alcabrera`(marconi)$ git pull upstream master` => 87 files changed, 1238 insertions(+), 472 deletions(-)16:02
alcabreraSuch a busy week.16:02
*** oz_akan_ has quit IRC16:04
alcabrerakgriffs: https://review.openstack.org/#/c/48776/ (has merge conflicts, jenkins is displeased)16:07
*** jdaggett has quit IRC16:10
*** jdaggett has joined #openstack-marconi16:10
*** jdaggett has joined #openstack-marconi16:12
kgriffsalcabrera: allow me to cheer him up16:13
openstackgerritAlejandro Cabrera proposed a change to openstack/marconi: feat: add logging to proxy  https://review.openstack.org/4958516:14
alcabrerakgriffs, flaper87: I'm adding logging to -proxy. Whenever you can, the patch above could use some love. :D16:14
kgriffskk16:15
*** flaper87 is now known as flaper87|afk16:16
*** flaper87|afk is now known as flaper8716:17
openstackgerritAlejandro Cabrera proposed a change to openstack/marconi: feat: add logging to proxy  https://review.openstack.org/4958516:19
alcabrera^^ fixed pep8 error16:21
openstackgerritKurt Griffiths proposed a change to openstack/marconi: fix(wsgi): Non-ASCII characters in the queue name trigger 500 status  https://review.openstack.org/4877616:24
kgriffsIf that doesn't make Jenkins happy, I've got $50 somewhere that should do the trick.16:25
alcabrerakgriffs: hahaha16:26
alcabrerakgriffs: (https://review.openstack.org/#/c/48776/) -1 - could you move the before hook to marconi.common.transport.wsgi.helpers?16:48
alcabreraI'd forgotten that I started this refactoring with the proxy patches.16:48
alcabrera(jenkins is happy - now I'm complaining!) :D16:48
*** alcabrera is now known as alcabrera|afk16:51
openstackgerritKurt Griffiths proposed a change to openstack/marconi: chore: Rename MONGODB_TEST_LIVE to MARCONI_TEST_MONGODB  https://review.openstack.org/4945116:54
*** alcabrera|afk is now known as alcabrera16:57
alcabrerakgriffs: -1: name change request ^^. (almost there!)16:58
kgriffsah, good catch17:00
kgriffsname cruft17:00
kgriffs:p17:00
alcabrerayup! The little things. :D17:00
kgriffsstevedore is cool, but I really hate how it obfuscates syntax errors and missing imports and stuff.17:02
kgriffsthank goodness for pyflakes17:02
flaper87kgriffs: agreed, I've struggled with that as well17:05
flaper87it's really annoying17:05
flaper87I used to first check entry_points and then errors17:06
flaper87I do it the other way around17:06
openstackgerritKurt Griffiths proposed a change to openstack/marconi: fix(wsgi): Non-ASCII characters in the queue name trigger 500 status  https://review.openstack.org/4877617:06
flaper87which just means I am way too dumb and the probability to have an error in my code instead of the entry_points definition is higher17:07
alcabrerastevedore is awesome for creating an extensible, evolvable architecture. I agree entirely, though - parsing those error/exception logs is an art.17:09
alcabreraIt's like parsing through c++ template error logs, but slightly easier.17:09
alcabrerakgriffs: +217:11
kgriffsflaper87: last patchset just brought things in line with the refactoring the proxy patch did on the global hooks17:12
kgriffshttps://review.openstack.org/#/c/48776/17:12
flaper87kgriffs: already approved17:12
flaper87:)17:12
kgriffswow17:12
kgriffsyou were so fast, i didn't even see you move!17:12
* flaper87 is trying to beat pypy17:12
alcabrera"Those reviews were fast as lightning..."17:12
mpanettaHe is one with the matrix17:12
openstackgerritKurt Griffiths proposed a change to openstack/marconi: chore: Rename MONGODB_TEST_LIVE to MARCONI_TEST_MONGODB  https://review.openstack.org/4945117:13
kgriffsalcabrera: I've got $50 with your name on it. Just sayin'.17:14
kgriffs;)17:14
openstackgerritA change was merged to openstack/marconi: fix(wsgi): Non-ASCII characters in the queue name trigger 500 status  https://review.openstack.org/4877617:14
alcabrerakgriffs: +2 ;)17:15
* kgriffs slides bills under table17:15
Alex_Gaynoralcabrera: you should complain to dhellman if there are bad error messages, I'm sure he'd like to improve them if possible17:15
alcabreraAlex_Gaynor: Good suggestion! I'll keep a paste around in the future.17:16
alcabreraThey get pretty mighty.17:16
kgriffsmalini: ping17:18
*** flaper87 is now known as flaper87|afk17:21
kgriffsalcabrera: https://review.openstack.org/#/c/48012/4/tests/functional/wsgi/v1/test_queues.py17:22
kgriffsdo you know if malini meant to say she would submit the DRY stuff in another *patch*, not *patchset*17:22
alcabrerakgriffs: I think she meant patchset. It's already present in patch set 5 (DRYness)17:23
alcabrera'assertMessageCount' captures part of the duplicated logic.17:24
*** ykaplan has quit IRC17:26
kgriffsI think she forgot to use it17:26
kgriffsnevermind17:27
kgriffsassertQueueStats is in there17:27
alcabrerakgriffs, malini: There's a bug in my on_put logic for proxy queues. It will duplicate project/queue on each registered partition because it doesn't reference the catalogue before making a decision.17:39
* alcabrera discovered while tinkering with a personal marconi environment17:40
kgriffsoops17:40
kgriffsyou owe me $5017:40
alcabreraI'll write a bug report and fix it up very soon.17:40
alcabrerakgriffs: dang... DL17:40
alcabreraD:17:40
kgriffsLOL17:40
jdaggettHi, who can tell me what the service catalog entry will be for Marconi?17:40
jdaggett"messaging"?17:40
zyuanalcabrera: ...the "bug" i found is not the cause; _catalogue.list() is storage API, which gives you iterator...17:42
malinikgriffs: I;ll update https://review.openstack.org/#/c/48012/5/tests/functional/wsgi/v1/test_queues.py to use ddt. IS there anything else you wanted ?17:43
alcabrerazyuan: ah, okay.17:43
openstackgerritZhihao Yuan proposed a change to openstack/marconi: feat(proxy): listing opts returns lists  https://review.openstack.org/4959517:44
alcabrerajdaggett: I'm not sure that's been decided yet. kgriffs, any thoughts?17:44
kgriffsjdaggett: yeah, TBH we haven't discussed it17:46
jdaggettkgriffs: OK, it can wait, thanks!17:46
kgriffsI'll bring it up with the gang with flaper87's around17:47
alcabrerabug filed, initiating fix: https://bugs.launchpad.net/marconi/+bug/123484917:48
alcabrera^^ duplicate queues17:48
*** jergerber has joined #openstack-marconi17:49
openstackgerritMalini Kamalambal proposed a change to openstack/marconi: Add Tests for Queue Stats  https://review.openstack.org/4801218:14
malinikgriffs: The above has the ddt fix..Thanks for the feeback, wonder why I didn't do it the first time around :)18:15
openstackgerritAlejandro Cabrera proposed a change to openstack/marconi: fix: do not duplicate queues across partitions  https://review.openstack.org/4959918:22
alcabrerakgriffs, flaper87|afk, malini: bug fix - duplicate queues ^^18:22
alcabreramalini: +2 on your queue stats. Awesome!18:24
zyuanalcabrera: saw your email. thanks!18:24
alcabrerazyuan: np. :)18:24
zyuani'm playing with your env with requests...18:36
alcabrerazyuan: sweet18:45
alcabrerazyuan: the /clear command is now implemented18:45
alcabreraIt's available via port :8001 on each env18:45
zyuanadmin command?18:46
alcabreranope - separate wsgi app, made special for the test env. :P18:46
openstackgerritA change was merged to openstack/marconi: Add Tests for Queue Stats  https://review.openstack.org/4801218:47
alcabreramalini: congrats! Thanks for the test patch. :)18:48
malinialcabrera:  :D18:48
kgriffsalcabrera: self._catalogue.exists18:58
kgriffsthat utilizes the cache, right?18:58
alcabrerakgriffs: no, not yet. :/18:58
alcabreraThat pings primary storage.18:59
alcabrera(primary proxy storage)18:59
kgriffsbaaaaaad llama!18:59
alcabreralol18:59
alcabreraThat's an awesome caching point, though, Good catch.18:59
malinialcabrera: what is the external endpoint I can use to hit your env ?19:16
alcabreramalini: I set it all in an email. Did you get it? :x19:18
alcabrera*sent19:20
malinialcabrera: Sorry I missed it19:20
malinichecking19:20
alcabreramalini: no worries (lots of email!)19:22
*** ykaplan has joined #openstack-marconi19:44
*** malini has left #openstack-marconi19:49
*** vkmc has quit IRC20:09
*** tvb has quit IRC20:41
openstackgerritAlejandro Cabrera proposed a change to openstack/marconi: fix: do not duplicate queues across partitions  https://review.openstack.org/4959920:46
alcabrerakgriffs: This patch above is *awesome*. Caching added, as requested, as well as the first set of unit tests to address the proxy queues resources.20:46
kgriffsexcellent20:47
alcabrerakgriffs: oh, I also addressed some of the '{0}/{1}'.format stuff in the hot path.20:47
alcabreraI now have helper functions that perform 'p.' + project + '/' + queue20:48
alcabrerakgriffs: -1'd my own patch for lack of cache validation, heh. :P20:50
alcabrerabrb20:50
openstackgerritAlejandro Cabrera proposed a change to openstack/marconi: fix: do not duplicate queues across partitions  https://review.openstack.org/4959920:58
alcabrerakgriffs: ready for review now20:58
alcabreraflaper87|afk: ^^20:59
alcabrerazyuan: check out the unit tests in the patch above - they handle the /v1/queues/* endpoints for the proxy20:59
alcabreraI'm out for the night, guys.20:59
alcabreraTake care, fix bugs, have a great night! :D20:59
*** alcabrera has left #openstack-marconi21:01
*** jdaggett has quit IRC21:13
*** ykaplan has quit IRC21:33
*** jdaggett has joined #openstack-marconi21:37
*** jdaggett has quit IRC21:39
*** flaper87|afk is now known as flaper8721:51
*** jcru has quit IRC21:53
* flaper87 is back21:56
flaper87:D21:56
*** tedross has quit IRC22:02
*** vkmc has joined #openstack-marconi22:05
*** jdaggett has joined #openstack-marconi22:09
*** jdaggett has quit IRC22:18
*** amitgandhi has quit IRC22:31
*** jdaggett has joined #openstack-marconi22:33
*** mpanetta has quit IRC22:39
*** flaper87 is now known as flaper87|afk22:39
*** kgriffs is now known as kgriffs_afk23:06
*** vkmc has quit IRC23:06
*** jdaggett has quit IRC23:15
*** jdaggett has joined #openstack-marconi23:18
*** jdaggett has quit IRC23:44
*** ayoung has quit IRC23:46

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!