| *** oz_akan_ has joined #openstack-marconi | 00:11 | |
| *** oz_akan_ has quit IRC | 00:16 | |
| *** rongze has joined #openstack-marconi | 00:18 | |
| *** rongze has quit IRC | 00:23 | |
| *** amitgandhi has joined #openstack-marconi | 00:36 | |
| *** amitgandhi has quit IRC | 00:40 | |
| *** amitgandhi has joined #openstack-marconi | 00:46 | |
| *** amitgandhi has quit IRC | 00:51 | |
| *** oz_akan_ has joined #openstack-marconi | 01:12 | |
| *** oz_akan_ has quit IRC | 01:17 | |
| *** nosnos has joined #openstack-marconi | 01:33 | |
| *** amitgandhi has joined #openstack-marconi | 01:36 | |
| *** amitgandhi has quit IRC | 01:41 | |
| *** rongze has joined #openstack-marconi | 02:01 | |
| *** oz_akan_ has joined #openstack-marconi | 02:04 | |
| *** oz_akan_ has quit IRC | 02:08 | |
| *** adrian_otto has joined #openstack-marconi | 02:14 | |
| *** flwang has quit IRC | 02:25 | |
| *** amitgandhi has joined #openstack-marconi | 02:33 | |
| *** amitgandhi has quit IRC | 03:04 | |
| *** amitgandhi has joined #openstack-marconi | 03:04 | |
| *** amitgandhi has quit IRC | 03:08 | |
| *** flwang has joined #openstack-marconi | 03:12 | |
| *** ay has quit IRC | 04:02 | |
| *** oz_akan_ has joined #openstack-marconi | 04:05 | |
| *** oz_akan_ has quit IRC | 04:10 | |
| *** amitgandhi has joined #openstack-marconi | 04:15 | |
| *** adrian_otto has quit IRC | 04:16 | |
| *** amitgandhi has quit IRC | 04:19 | |
| *** ayoung has joined #openstack-marconi | 04:43 | |
| *** rongze has quit IRC | 04:57 | |
| *** adrian_otto has joined #openstack-marconi | 04:59 | |
| *** amitgandhi has joined #openstack-marconi | 05:05 | |
| *** oz_akan_ has joined #openstack-marconi | 05:06 | |
| *** amitgandhi has quit IRC | 05:10 | |
| *** oz_akan_ has quit IRC | 05:10 | |
| *** rongze has joined #openstack-marconi | 05:27 | |
| *** nosnos_ has joined #openstack-marconi | 05:35 | |
| *** rongze has quit IRC | 05:36 | |
| *** nosnos has quit IRC | 05:37 | |
| *** nosnos_ has quit IRC | 05:37 | |
| *** nosnos has joined #openstack-marconi | 05:38 | |
| *** adrian_otto has quit IRC | 06:00 | |
| *** rongze has joined #openstack-marconi | 06:02 | |
| *** amitgandhi has joined #openstack-marconi | 06:06 | |
| *** oz_akan_ has joined #openstack-marconi | 06:07 | |
| *** amitgandhi has quit IRC | 06:10 | |
| *** rongze has quit IRC | 06:11 | |
| *** rongze has joined #openstack-marconi | 06:11 | |
| *** oz_akan_ has quit IRC | 06:12 | |
| *** amitgandhi has joined #openstack-marconi | 06:16 | |
| *** amitgandhi has quit IRC | 06:20 | |
| *** nosnos_ has joined #openstack-marconi | 06:57 | |
| *** nosnos has quit IRC | 06:57 | |
| *** amitgandhi has joined #openstack-marconi | 07:06 | |
| *** oz_akan_ has joined #openstack-marconi | 07:08 | |
| *** amitgandhi has quit IRC | 07:10 | |
| *** oz_akan_ has quit IRC | 07:12 | |
| *** amitgandhi has joined #openstack-marconi | 08:07 | |
| *** oz_akan_ has joined #openstack-marconi | 08:09 | |
| *** amitgandhi has quit IRC | 08:11 | |
| *** oz_akan_ has quit IRC | 08:13 | |
| *** flaper87|afk is now known as flaper87 | 08:15 | |
| *** amitgandhi has joined #openstack-marconi | 08:17 | |
| *** amitgandhi has quit IRC | 08:21 | |
| *** nosnos_ has quit IRC | 08:27 | |
| *** nosnos has joined #openstack-marconi | 08:28 | |
| *** rongze has quit IRC | 08:44 | |
| *** yassine has joined #openstack-marconi | 09:00 | |
| *** amitgandhi has joined #openstack-marconi | 09:07 | |
| *** ykaplan has joined #openstack-marconi | 09:09 | |
| *** oz_akan_ has joined #openstack-marconi | 09:09 | |
| *** amitgandhi has quit IRC | 09:12 | |
| *** oz_akan_ has quit IRC | 09:13 | |
| *** flwang has quit IRC | 09:41 | |
| *** amitgandhi has joined #openstack-marconi | 10:08 | |
| *** oz_akan_ has joined #openstack-marconi | 10:10 | |
| *** oz_akan_ has quit IRC | 10:14 | |
| *** amitgandhi has quit IRC | 10:15 | |
| *** amitgandhi has joined #openstack-marconi | 10:18 | |
| *** amitgandhi has quit IRC | 10:23 | |
| *** rongze has joined #openstack-marconi | 10:55 | |
| *** ykaplan has quit IRC | 11:10 | |
| *** oz_akan_ has joined #openstack-marconi | 11:11 | |
| *** amitgandhi has joined #openstack-marconi | 11:11 | |
| *** oz_akan_ has quit IRC | 11:16 | |
| *** amitgandhi has quit IRC | 11:16 | |
| *** oz_akan_ has joined #openstack-marconi | 11:18 | |
| *** oz_akan_ has quit IRC | 11:23 | |
| *** flwang has joined #openstack-marconi | 11:28 | |
| *** ykaplan has joined #openstack-marconi | 11:34 | |
| *** yassine has quit IRC | 11:55 | |
| *** amitgandhi has joined #openstack-marconi | 12:21 | |
| *** nosnos has quit IRC | 12:22 | |
| *** rongze has quit IRC | 12:23 | |
| *** amitgandhi has quit IRC | 12:25 | |
| *** fifieldt has quit IRC | 12:47 | |
| *** oz_akan_ has joined #openstack-marconi | 12:52 | |
| *** flwang has quit IRC | 12:57 | |
| *** vkmc has joined #openstack-marconi | 13:09 | |
| *** amitgandhi has joined #openstack-marconi | 13:12 | |
| *** amitgandhi has quit IRC | 13:16 | |
| *** oz_akan_ has quit IRC | 13:23 | |
| *** oz_akan_ has joined #openstack-marconi | 13:23 | |
| *** rongze has joined #openstack-marconi | 13:25 | |
| *** mpanetta has joined #openstack-marconi | 13:43 | |
| *** flwang has joined #openstack-marconi | 13:43 | |
| *** jcru has joined #openstack-marconi | 14:04 | |
| *** jergerber has joined #openstack-marconi | 14:29 | |
| *** tedross has joined #openstack-marconi | 14:33 | |
| *** ametts has joined #openstack-marconi | 14:41 | |
| *** amitgandhi has joined #openstack-marconi | 14:42 | |
| *** amitgandhi has quit IRC | 14:46 | |
| *** amitgandhi has joined #openstack-marconi | 14:47 | |
| kgriffs | 0/ | 14:48 |
|---|---|---|
| kgriffs | I'm baaaaaack. | 14:48 |
| * kgriffs queues scary music | 14:48 | |
| mpanetta | Yo! | 14:49 |
| kgriffs | mpanetta: have a good turkey day? | 14:49 |
| mpanetta | I did, how about yourself? | 14:49 |
| kgriffs | definitely. Pie was served and there was much rejoicing! | 14:50 |
| mpanetta | Mmmm pie, apple? Pumpkin? | 14:50 |
| kgriffs | pumpkin, berry, and banana cream | 14:50 |
| flaper87 | helloooooooooooooooooooooooooooooooooooooooo | 14:50 |
| mpanetta | Oh man, sounds yummy! | 14:50 |
| mpanetta | flaper87: Mornin! | 14:51 |
| kgriffs | flaper87: hey slacker. where have you been this past week? | 14:51 |
| * kgriffs runs away | 14:51 | |
| mpanetta | kgriffs: I need to get with you about sharding in a bit. | 14:51 |
| kgriffs | mpanetta: kk | 14:51 |
| mpanetta | So no running away :P | 14:51 |
| kgriffs | we have a mtg in 9 minutes | 14:52 |
| kgriffs | after that we can dance | 14:52 |
| mpanetta | Same here actually, different meeting tho. | 14:52 |
| flaper87 | kgriffs: eating your turkey, obviously | 14:52 |
| flaper87 | :D | 14:52 |
| kgriffs | lol | 14:52 |
| *** adrian_otto has joined #openstack-marconi | 14:54 | |
| *** adrian_otto has quit IRC | 14:55 | |
| *** adrian_otto has joined #openstack-marconi | 14:56 | |
| flwang | morning, guys | 14:56 |
| kgriffs | o/ | 14:56 |
| kgriffs | flwang: how do you say good evening in your native language? | 14:56 |
| flwang | waiting for the meeting O:-) | 14:57 |
| flwang | 晚上好 | 14:57 |
| kgriffs | (and/or good morning) | 14:57 |
| kgriffs | wow | 14:57 |
| *** jcru_ has joined #openstack-marconi | 14:57 | |
| flwang | wan shang hao | 14:57 |
| * kgriffs copies to notepad | 14:57 | |
| flwang | hehe, thanks for the sweet :) | 14:57 |
| flwang | good morning = 早上好 | 14:57 |
| flwang | 好 means good | 14:57 |
| flwang | 晚上 = evening | 14:58 |
| flwang | 早上 = morning | 14:58 |
| kgriffs | flwang: I'm jealous; your script looks so much cooler than my lame latin characters | 14:58 |
| kgriffs | arabic looks cool too | 14:59 |
| flaper87 | kgriffs: agreed! | 14:59 |
| kgriffs | (farsi or whatever it is called) | 14:59 |
| flaper87 | and way cooler than my morning-hand-writing | 14:59 |
| flwang | I can teach you guys mandarin, one sentence per day :D | 14:59 |
| kgriffs | w00t | 14:59 |
| flaper87 | actually, my hand-writing in general | 14:59 |
| flwang | hello = 你好 | 14:59 |
| * kgriffs copies that | 15:00 | |
| flwang | hello = 你好 the pronunciation is ‘ni hao' | 15:00 |
| kgriffs | excellent. | 15:00 |
| *** jcru has quit IRC | 15:00 | |
| kgriffs | meeting time! | 15:00 |
| flwang | meeting time | 15:01 |
| flaper87 | MEEEEEEEEEEEEEEEEEEEEEEETING | 15:01 |
| kgriffs | see you in #openstack-meeting-alt | 15:01 |
| kgriffs | amitgandhi: mtg? | 15:02 |
| amitgandhi | on mmy way | 15:04 |
| *** alcabrera has joined #openstack-marconi | 15:10 | |
| *** rwsu has joined #openstack-marconi | 15:14 | |
| kgriffs | flwang: meet oz_akan_ | 15:21 |
| kgriffs | oz_akan_: meet flwang | 15:21 |
| kgriffs | flwang: will be working on heat templates for Marconi | 15:21 |
| kgriffs | I told him you may be able to share some lessons learned | 15:21 |
| flwang | kgriffs: got it, Sir | 15:21 |
| kgriffs | mpanetta: you too. ^^^ | 15:21 |
| *** adrian_otto has quit IRC | 15:27 | |
| kgriffs | flwang: re that bug, don't forget to add some unit tests to prove it is fixed - we wouldn't have had this problem if we'd had tests in the first place! | 15:45 |
| flwang | kgriffs: sure, i'm professional stacker :) | 15:46 |
| *** ykaplan has quit IRC | 15:57 | |
| *** briancline has quit IRC | 15:58 | |
| kgriffs | flwang: w00t! | 16:02 |
| kgriffs | thanks | 16:02 |
| flwang | kgriffs: sure | 16:02 |
| flwang | anybody can take a look at this https://review.openstack.org/#/c/58092/ and let the baby fly? | 16:03 |
| flwang | it's my first baby in Marconi :) | 16:03 |
| alcabrera | kgriffs: all set as far as the meeting minutes go. | 16:04 |
| kgriffs | flwang: yeah, I've been meaning to | 16:04 |
| kgriffs | alcabrera: thanks again! | 16:04 |
| kgriffs | flwang: I should be able to get to it today | 16:05 |
| flwang | kgriffs: thanks God :) | 16:05 |
| flwang | i'm looking the new bug you just assigned to me | 16:06 |
| alcabrera | brb | 16:07 |
| mpanetta | hi flwang :) | 16:08 |
| flwang | mpanetta: hi | 16:08 |
| mpanetta | kgriffs: I'm back | 16:08 |
| alcabrera | back | 16:09 |
| mpanetta | mornin alcabrera | 16:09 |
| alcabrera | mpanetta: yo! :D | 16:09 |
| mpanetta | How goes? | 16:09 |
| alcabrera | alright. I feel great after that 10 day break. I read so many great books while on vacation. :) | 16:10 |
| alcabrera | mpanetta: you? | 16:10 |
| mpanetta | Doing pretty well :) | 16:10 |
| *** oz_akan_ has quit IRC | 16:10 | |
| *** oz_akan_ has joined #openstack-marconi | 16:10 | |
| mpanetta | Had far too much to eat heh | 16:12 |
| alcabrera | heh :) | 16:15 |
| *** oz_akan_ has quit IRC | 16:15 | |
| *** ilgiz has quit IRC | 16:22 | |
| *** ilgiz has joined #openstack-marconi | 16:23 | |
| flwang | alcabrera: ping | 16:24 |
| alcabrera | flwang: pong | 16:26 |
| flwang | alcabrera: against my patch https://review.openstack.org/#/c/58092/2/marconi/queues/transport/wsgi/messages.py | 16:26 |
| flwang | do you think it's really deserved an unit test? | 16:26 |
| alcabrera | yeah, considering it's a subtle case, and the test would help document the expected behavior and weed out the bug in the future. | 16:27 |
| flwang | alcabrera: okay, make sense. at my initial thought, I don't think it's worth to do that. anyway, i will fix it in next PS. thanks for the reviewing, | 16:28 |
| alcabrera | flwang: if you don't mind explaining, why do you think a test is necessary? :) | 16:29 |
| alcabrera | ermmm | 16:29 |
| alcabrera | ** a test is not necessary | 16:29 |
| alcabrera | ? | 16:29 |
| flwang | I just think it's not related to a logic branch, not a specific function, not a user scenario | 16:30 |
| flwang | just a tiny and clear fix | 16:30 |
| alcabrera | I see what you're saying. I'm concerned that is a user-scenario, in the case where the user is using a CLI or a module to automate message retrieval, and then fails because of '/messages/messages...' | 16:32 |
| flwang | yep, it makes more sense | 16:34 |
| *** cpallares has joined #openstack-marconi | 16:37 | |
| flwang | alcabrera: thanks for the clarification | 16:37 |
| alcabrera | flwang: no problem! :) | 16:37 |
| alcabrera | cpallares: o/ | 16:38 |
| cpallares | alcabrera: hi! | 16:43 |
| openstackgerrit | A change was merged to openstack/marconi: feat(shard): queue listing from multiple sources https://review.openstack.org/53127 | 16:44 |
| alcabrera | cpallares: how goes? I hope your thanksgiving break was great. :D | 16:45 |
| cpallares | alcabrera: it was pretty good thank you :) how was yours? | 16:46 |
| *** haomaiwang has quit IRC | 16:46 | |
| alcabrera | very relaxing! I found a lot of time to read several books I'd queued up. :) | 16:47 |
| *** haomaiwang has joined #openstack-marconi | 16:47 | |
| cpallares | alcabrera: Very nice. What did you read? :) | 16:47 |
| alcabrera | Four books; Good Calories, Bad Calories (Gary Taubes), Grain Brain (David Perlmutter), 40 Alternatives to College (James Altucher), and Choose Yourself (James Altucher). | 16:49 |
| alcabrera | there's some pretty surprising insights in the first two, and the latter two were very motivating. I recommend the lot of them. :D | 16:50 |
| flaper87 | cpallares: hellooooooo | 16:51 |
| flaper87 | cpallares: how are you doing? | 16:51 |
| cpallares | flaper87: hello! | 16:52 |
| *** briancline has joined #openstack-marconi | 16:52 | |
| cpallares | flaper87: I'm doing good! How are you?! | 16:52 |
| flaper87 | cpallares: I'm doing well :D | 16:52 |
| flaper87 | cpallares: reviewed your patch last week | 16:52 |
| flaper87 | cpallares: you missed marconi's meeting :( | 16:52 |
| cpallares | flaper87: woooot! | 16:52 |
| cpallares | flaper87: what I thought it was in 10 minutes? | 16:53 |
| alcabrera | we moved it earlier. I almost missed it. >.> | 16:53 |
| flaper87 | cpallares: erm we changed the time last week | 16:53 |
| flaper87 | :( | 16:53 |
| flaper87 | it's 15:00 UTC now | 16:53 |
| alcabrera | It was almost two hours ago. | 16:53 |
| cpallares | alcabrera, flaper87: ah shoot. | 16:54 |
| *** adrian_otto has joined #openstack-marconi | 16:54 | |
| alcabrera | we talked about JSON homedoc, marconi documentation, and... | 16:54 |
| alcabrera | action items | 16:54 |
| alcabrera | that was the gist of it. | 16:54 |
| alcabrera | we're having another meeting tomorrow to talk about notifications support in marconi | 16:55 |
| alcabrera | same time | 16:55 |
| *** rongze has quit IRC | 16:56 | |
| alcabrera | cpallares: ^ | 16:56 |
| cpallares | alcabrera, good thing to know I won't miss that one | 16:57 |
| flaper87 | cpallares: soooo, API ? | 16:59 |
| flaper87 | cpallares: how's that mapping going? | 16:59 |
| cpallares | flaper87: I'm commiting it right now :) | 16:59 |
| flaper87 | cpallares: w000000000000000000000000000000000t | 16:59 |
| flaper87 | who wants to get some extra info about the websocket stuff? | 16:59 |
| flwang | flaper87: count me | 17:00 |
| flwang | I bet i need to know more than others | 17:00 |
| *** adrian_otto has quit IRC | 17:01 | |
| alcabrera | I'll pass on the websocket details, but I'm happy to listen and comment as you tell it. I must say... | 17:01 |
| alcabrera | I'm happy with the choice of third-party library. | 17:01 |
| alcabrera | ws4py | 17:01 |
| flaper87 | so, I was going to pick socket.io but after some research I found out that most of the browsers now support websocket and the need for long-polling (which everybody hates but everyone uses) is not that high | 17:01 |
| flaper87 | also, socket.io has it's very own way to do tings and the python implementation is tight to gevent | 17:02 |
| flaper87 | so, I dug into the protocols and libraries and found out ws4py | 17:02 |
| flaper87 | which seems to be maintained and easy to maintain - worst case scenario | 17:02 |
| *** torgomatic has joined #openstack-marconi | 17:02 | |
| flaper87 | also, some of the things currently implemented in ws4py could be ported to falcon | 17:02 |
| flaper87 | at least the wsgi part | 17:03 |
| flaper87 | that being said, it just proxies the wsgi public API for now | 17:03 |
| flaper87 | but, the goal is to integrate it with the work cpallares is doing | 17:03 |
| flaper87 | also, I took a look at zmq, nanomsg and raw tcp and thought a bit more about how those would've been implemented | 17:04 |
| flaper87 | the result is that the implementation is pretty much the same we're using for websocket | 17:04 |
| * alcabrera listens intently to this part | 17:04 | |
| alcabrera | sweet | 17:04 |
| flaper87 | and so will be the integration with the API layer | 17:04 |
| kgriffs | interesting | 17:04 |
| flaper87 | so, since websocket seems like more important right now, I bet on it | 17:05 |
| kgriffs | websocket is basically just TCP plus a low-level framing protocol, right? | 17:05 |
| flaper87 | also, websocket makes a lot of sense for the notification API | 17:05 |
| flaper87 | kgriffs: yeah | 17:05 |
| kgriffs | kewl | 17:05 |
| kgriffs | also some semantics around push/pull | 17:05 |
| kgriffs | speaking of which | 17:05 |
| flaper87 | the cool thing is that ws4py has an implementation for gevent, tornado, wsgiref and cherrypy | 17:05 |
| kgriffs | this will give us the push message stream we need for notifications | 17:05 |
| flaper87 | so, it was a good fit for us | 17:05 |
| flaper87 | kgriffs: exactly | 17:06 |
| flaper87 | :) | 17:06 |
| flaper87 | I put an example in the repo | 17:06 |
| kgriffs | flaper87: interesting. I have been hearing more about gevent on the street lately | 17:06 |
| kgriffs | I wonder if it is starting to gain some traction over eventlet | 17:06 |
| flaper87 | kgriffs: and there's some work going on gevent+Py3K | 17:06 |
| kgriffs | oooooh | 17:06 |
| alcabrera | gevent released 1.0 recently | 17:06 |
| kgriffs | that would be the nail in eventlet's coffin | 17:06 |
| kgriffs | alcabrera: w00t. no more RC? | 17:07 |
| alcabrera | fantik has maintained a py3k-friendly branch of gevent 1.0 for ages. | 17:07 |
| kgriffs | have they updated their website docs yet? | 17:07 |
| kgriffs | (for 1.0) | 17:07 |
| alcabrera | kgriffs: no more RC | 17:07 |
| flaper87 | I'm not going to say eventlet has been abandoned BUT it pretty much feels like it is | 17:07 |
| alcabrera | https://pypi.python.org/pypi/gevent | 17:07 |
| alcabrera | pip install gevent -> 1.0 | 17:07 |
| flaper87 | the guy that maintains it is way to busy | 17:07 |
| flaper87 | and AFAIK, there's no Py3K work going on for it | 17:07 |
| alcabrera | flaper87: I echo that sentiment about eventlet. :/ | 17:07 |
| kgriffs | yeah, the issue thread where py3k was mentioned has been stalled for a while | 17:08 |
| kgriffs | (eventlet issue) | 17:08 |
| flaper87 | and BTW, the 'external' transport support works like a charm | 17:08 |
| flaper87 | I almost cried | 17:08 |
| kgriffs | :D | 17:08 |
| alcabrera | :) | 17:08 |
| flaper87 | we need to improve a bit the whole public/admin implementation, but that will happen as part of the API layer implementation | 17:08 |
| alcabrera | flaper87: agreed | 17:09 |
| flaper87 | it was sooo cool to just open marconi's conf and set marconi_ws as the enabled transport | 17:09 |
| flaper87 | then marconi-server and BOOM! | 17:09 |
| kgriffs | sexy | 17:09 |
| flaper87 | there it was, running and ready to be used | 17:09 |
| alcabrera | hehe | 17:10 |
| alcabrera | that's the way it should be | 17:10 |
| alcabrera | always | 17:10 |
| alcabrera | forever | 17:10 |
| kgriffs | f****ing awesome! | 17:10 |
| alcabrera | (unless we make it even easier some how0 | 17:10 |
| alcabrera | ) | 17:10 |
| * kgriffs is practicing his startup buzzwords | 17:10 | |
| flaper87 | now, I think there's a way for us to deploy WS and the wsgi API in the same process | 17:10 |
| flaper87 | but that's something we should: 1) Decided whether we want that, 2) Tackle once the API layer is done | 17:10 |
| alcabrera | transports = wsgi, marconi_ws, [queues:....:marconi_ws] port =, ... [queues:....:wsgi] port = ... (??) | 17:11 |
| flaper87 | alcabrera: you have marconi as a dependency in the requirements.txt of marconi-redis | 17:11 |
| flaper87 | right? | 17:11 |
| alcabrera | flaper87: yup | 17:11 |
| alcabrera | I have it set as.... | 17:12 |
| alcabrera | -e git+https://github.com/openstack/marconi#egg=marconi | 17:12 |
| flaper87 | alcabrera: yeah, something like that. The question is more technical in this case. I mean, WS does something different with the socket and the wsgi request so, we may need to dig a bit more | 17:12 |
| flaper87 | alcabrera: I've done that | 17:12 |
| flaper87 | alcabrera: but that was using custom code | 17:12 |
| flaper87 | alcabrera: so, can you pip install -r requirements.txt ? | 17:13 |
| flaper87 | I've it as part of marconi-websocket but it fails to install marconi | 17:13 |
| alcabrera | flaper87: yeah, and I can also 'pip install .' (for marconi-redis) | 17:13 |
| flaper87 | if I run it manually: $ pip install git+.... it works | 17:13 |
| flaper87 | if I use the requirements file it just fails | 17:13 |
| flaper87 | mmh, kk | 17:13 |
| flaper87 | I'll double check that | 17:13 |
| alcabrera | hmm | 17:13 |
| alcabrera | weird that it fails | 17:14 |
| alcabrera | we have the same requirements file style | 17:14 |
| flaper87 | weird indeed | 17:14 |
| alcabrera | including the | 17:14 |
| alcabrera | -e git+https://github.com/openstack/marconi#egg=marconi | 17:14 |
| flaper87 | yeah | 17:14 |
| alcabrera | even the setup.py/cfg | 17:14 |
| alcabrera | ah well | 17:14 |
| alcabrera | investigations into subtle pythonitites | 17:14 |
| flaper87 | yeah | 17:15 |
| cpallares | could someone be super awesome and review this https://review.openstack.org/#/c/57536/? I'm trying to commit something but git's complaining that I can't submit to a file to a package that doesn't exist yet | 17:18 |
| alcabrera | cpallares: I'll give it a look over | 17:19 |
| cpallares | thank you alcabrera! | 17:19 |
| alcabrera | #link https://review.openstack.org/#/c/57536/ (relinked because that ? was 404-ing the URL. :P ) | 17:19 |
| flaper87 | based on that review: | 17:19 |
| * flaper87 is super-awesome | 17:19 | |
| cpallares | alcabrera, oops it's this one https://review.openstack.org/#/c/57536/ | 17:20 |
| cpallares | hahaha | 17:20 |
| alcabrera | cpallares: approved | 17:22 |
| alcabrera | :D | 17:22 |
| flaper87 | now alcabrera is more awesome than flwang | 17:22 |
| flaper87 | erm, than flaper87 | 17:22 |
| flaper87 | :( | 17:22 |
| alcabrera | lol | 17:22 |
| flwang | :( | 17:22 |
| cpallares | alcabrera: yay, thanks :D | 17:22 |
| alcabrera | everyone is awesome | 17:22 |
| alcabrera | hurray! | 17:22 |
| cpallares | lol | 17:22 |
| *** rongze has joined #openstack-marconi | 17:28 | |
| *** reed has joined #openstack-marconi | 17:28 | |
| openstackgerrit | A change was merged to openstack/marconi: Added empty packages and a test for the API v1 https://review.openstack.org/57536 | 17:28 |
| flaper87 | cpallares: great work | 17:28 |
| flaper87 | looking forward to the new patch | 17:29 |
| flwang | flaper87: how to run unit test against one case in Marconi? | 17:31 |
| kgriffs | flaper87: I can't find a bp for notifications | 17:32 |
| alcabrera | flwang: like this | 17:32 |
| kgriffs | am I missing something, or is it not there yet? | 17:32 |
| kgriffs | (i can create it, just making sure) | 17:32 |
| alcabrera | tox -e py27 -- tests.unit.queues.transport.wsgi.test_file:TestClass.test_method | 17:32 |
| flaper87 | flwang: tox -epy27 -- --tests tests.unit.queues.... | 17:32 |
| flaper87 | or what alcabrera said | 17:32 |
| flaper87 | :D | 17:32 |
| alcabrera | :D | 17:32 |
| flaper87 | kgriffs: mmh | 17:32 |
| flwang | oh, same as Glance | 17:32 |
| flaper87 | weird | 17:32 |
| * alcabrera high-fives flaper87 | 17:32 | |
| flaper87 | flwang: yup | 17:32 |
| * flaper87 can't wait to migrate to testr | 17:32 | |
| flaper87 | seriously | 17:32 |
| * flaper87 high-fives back | 17:33 | |
| flwang | flaper87: gotcha | 17:33 |
| flaper87 | :D | 17:33 |
| flaper87 | kgriffs: ah, we just have that etherpad from the design session | 17:33 |
| alcabrera | flaper87, amitgandhi, kgriffs: who wants to draft the notifications BP? | 17:35 |
| alcabrera | it's definitely a hot item, so it's surprising we don't have that written out yet. | 17:35 |
| alcabrera | It's probably one of those that should come with an associated wiki entry page. | 17:35 |
| alcabrera | e.g.. notications/api/v1 | 17:35 |
| kgriffs | flaper87: kk, I'll create a bp | 17:36 |
| alcabrera | kgriffs: thanks! | 17:36 |
| amitgandhi | i can contribute to the api schema (basically what i have in my hackday project + notification template semantics) | 17:37 |
| kgriffs | amitgandhi: cool | 17:39 |
| kgriffs | Let me register a bp and setup a wiki | 17:39 |
| *** flwang has quit IRC | 17:49 | |
| *** alcabrera has quit IRC | 17:59 | |
| *** alcabrera has joined #openstack-marconi | 17:59 | |
| ilgiz | Hello, I'm choosing theme for my master thesis and found openstack marconi interesting for me, but the problem is that I'm going to spend around 15-25 per week and project is pretty fast moving, so I'm not sure that it is possible to work on project with such effort. What do you think? | 18:05 |
| openstackgerrit | Alejandro Cabrera proposed a change to openstack/marconi: fix: cache contract for memcached backend https://review.openstack.org/59507 | 18:08 |
| openstackgerrit | Cindy Pallares proposed a change to openstack/marconi: Added schema.py which maps out the HTTP request codes in jsonschema https://review.openstack.org/59508 | 18:11 |
| alcabrera | ilgiz: hey! | 18:12 |
| alcabrera | I'm happy to hear you're considering marconi for your master's thesis - awesome! | 18:12 |
| alcabrera | ilgiz: what do you hope to accomplish for your thesis, what is the thesis area, and how could marconi play a role? I'm happy to discuss. | 18:13 |
| ilgiz | I could chose a random area, I just want to work on open source project (as for me it is the best way to working not just for diploma). As already mentioned I'm going to work on project occasionally and can not spend a lot of time on it, so I would like to chose obscure feature, with which everyone is ok if it's going to take a while to get it finish. But I'm not sure that it is possible with new projects like this | 18:17 |
| *** openstackgerrit has quit IRC | 18:18 | |
| *** openstackgerrit has joined #openstack-marconi | 18:18 | |
| alcabrera | ilgiz: hmmm.... | 18:19 |
| alcabrera | working on an open-source project does have some very awesome possibilities, but it is very different that anything I did in academia (a year ago). | 18:20 |
| alcabrera | you can certainly contribute something really cool working 15-25 hours a week | 18:20 |
| alcabrera | however, it's best if it's done in the open, and always talking with people on this channel | 18:21 |
| alcabrera | all the better if it isn't an obscure feature | 18:21 |
| alcabrera | for example | 18:21 |
| ilgiz | I'm from Russia, so it is possible to work on such projects for thesis here | 18:22 |
| alcabrera | one idea I've had in mind (and flaper87 has brought this one up, too)- what happens if you map the semantics of marconi to distributed storage, e.g., hooking up marconi to an openstack swift backend? | 18:22 |
| alcabrera | cpallares: I'll check out the new patch set soon - thanks! | 18:23 |
| alcabrera | ilgiz: cool! What kinds of projects do you find interesting? Also, what made you consider marconi? :) | 18:25 |
| cpallares | thank you alcabrera :) | 18:25 |
| kgriffs | alcabrera, flaper87: crazy thought for you | 18:26 |
| kgriffs | flaper87: ping | 18:27 |
| ilgiz | alcabrera: can you please explain a bit more? | 18:28 |
| alcabrera | kgriffs: listening. :) | 18:30 |
| alcabrera | ilgiz: sure thing, but before I do, could you answer my previous two questions? | 18:30 |
| ilgiz | I would like to work on distributed service, I understand that is too wide area. I have talked with Tomaz Muraus (He was my mentor on GSOC 2012, I have worked on Apache Libcloud project) and he recommended to me to take a look on openstack projects | 18:33 |
| openstackgerrit | Alejandro Cabrera proposed a change to openstack/marconi: opt: add hints to make delete/claim checks faster https://review.openstack.org/59511 | 18:34 |
| alcabrera | ilgiz: awesome! | 18:34 |
| alcabrera | I'm aware of Tomaz Muraus and the libcloud project. That's a great combination, and I imagine that must've been a very fruitful GSOC. | 18:35 |
| alcabrera | ilgiz: so regarding the idea I mentioned above, how much do you know about openstack swift and openstack marconi? | 18:37 |
| * flaper87 back | 18:37 | |
| flaper87 | kgriffs: shoot | 18:37 |
| flaper87 | ilgiz: there are a lot of thing syou can do on marconi that actually don't depend on the changes happening in the code base. For example, working on new transports or new backends for it | 18:38 |
| ilgiz | oh, it was awesome experience, it was pleasure to work with him | 18:38 |
| ilgiz | I know only some basics about openstack projects | 18:39 |
| alcabrera | as flaper87 said, a fun idea for working on marconi (likely a little simpler than my idea above) is to add support for a new storage backend or a new transport. | 18:40 |
| alcabrera | ilgiz: so - openstack marconi is a queuing/messaging system. You create queues, post messages to them, and read them out later. It's pretty useful for distributed worker/master setups and even for publish/subscribe. :) | 18:41 |
| *** rongze has quit IRC | 18:42 | |
| alcabrera | openstack swift is distributed storage - you create buckets and upload files/"objects" to those buckets, and swift takes care of storage placement and object lookup. | 18:42 |
| ilgiz | thank you, got it | 18:43 |
| openstackgerrit | Alejandro Cabrera proposed a change to openstack/marconi: cleanup: remove proxy cruft https://review.openstack.org/59513 | 18:43 |
| flaper87 | swift would be a good experiment | 18:43 |
| ilgiz | is idea implement queue on top of swift? | 18:44 |
| alcabrera | ilgiz: that's correct | 18:45 |
| ilgiz | like queue is buckets and items are objects? | 18:46 |
| alcabrera | swift as the storage backend | 18:46 |
| alcabrera | yeah! :) | 18:46 |
| flaper87 | alcabrera: https://review.openstack.org/#/c/59513/ <- I think there's more thing under marconi/common | 18:46 |
| flaper87 | *I think* | 18:46 |
| flaper87 | I saw it the other day | 18:46 |
| alcabrera | queue == bucket, object == messages | 18:46 |
| flaper87 | again, I THINK | 18:46 |
| flaper87 | :D | 18:46 |
| alcabrera | flaper87: lol, I'll look again. :) | 18:46 |
| ilgiz | hm, that is interesting, but I do not understand then it is useful | 18:47 |
| alcabrera | flaper87, kgriffs: one of the recent merges introduced a likely serious problem into marconi, particularly with mongodb. | 18:47 |
| alcabrera | load_storage_driver is giving me... | 18:47 |
| flaper87 | alcabrera: mmh | 18:48 |
| * alcabrera runs to utest suite again | 18:48 | |
| flaper87 | what patch? | 18:48 |
| flaper87 | and why the (unit|functional)tests didn't get that | 18:48 |
| alcabrera | it's the test_shard_catalog | 18:49 |
| alcabrera | which runs only under a mongodb contextz | 18:49 |
| alcabrera | *context | 18:49 |
| alcabrera | ilgiz: the usefulness is the possibility to support many, many queues and messages, with long TTLs, without worrying about overloading storage | 18:49 |
| alcabrera | flaper87: another issue I discovered is that test clean up seems to be failing. I've filled up my local storage 3 times in the past hour - 38GB gone in 5 test runs. :/ | 18:50 |
| flaper87 | mmh, could you try going back in the history and find which patch broke that? | 18:51 |
| flaper87 | I bet it's all related to mongodb | 18:51 |
| flaper87 | since it's not being tested in the gate | 18:51 |
| alcabrera | yup, yup | 18:51 |
| flaper87 | gosh, I want the devstack gate | 18:51 |
| alcabrera | I'll check it out | 18:51 |
| alcabrera | flaper87: here's the load_storage_driver issue: paste.openstack.org/show/54305/ | 18:52 |
| flaper87 | alcabrera: ah, that sounds like the s/queues// patch | 18:52 |
| flaper87 | that removes the config prefixes for queues and proxy | 18:53 |
| flaper87 | devstack patch is almost there: https://review.openstack.org/#/c/47999/ | 18:53 |
| alcabrera | flaper87: awesome - +1 for devstack | 18:53 |
| openstackgerrit | Alejandro Cabrera proposed a change to openstack/marconi: cleanup: remove proxy cruft https://review.openstack.org/59513 | 18:55 |
| alcabrera | flaper87: there was one more ref to the proxy in marconi.common. ;) | 18:55 |
| flaper87 | I KNEW IT! | 18:56 |
| flaper87 | :D | 18:56 |
| flaper87 | brb | 18:56 |
| mpanetta | Hmm, I am going to have to watch for the conf name change... | 18:56 |
| alcabrera | mpanetta: oh yes | 18:57 |
| alcabrera | it's changed quite a bit | 18:57 |
| ilgiz | hm, looks like this task is require a good knowledge of marconi and not hard by itself, am I right? | 18:58 |
| alcabrera | ilgiz: that's correct. With a decent knowledge of the concepts of swift, and a good understanding of how marconi works, it is very doable. | 19:00 |
| ilgiz | great :) | 19:01 |
| * kgriffs is back | 19:01 | |
| mpanetta | wb | 19:01 |
| kgriffs | flaper87, alcabrera: here is my crazy idea | 19:01 |
| kgriffs | what if we just used webhooks to implement push semantics? | 19:02 |
| ilgiz | I'm willing to learn about marconi more :) | 19:02 |
| * alcabrera needs to learn about webhooks | 19:03 | |
| alcabrera | that word keeps coming up and I'm still not aware of how it's used as an implementation mechanism. :P | 19:03 |
| kgriffs | flaper87: for example, if i have a worker pool listing to a queue they could just as soon be little web apps that we push messages to | 19:03 |
| kgriffs | https://webhooks.pbworks.com/w/page/13385128/RESTful%20WebHooks | 19:03 |
| kgriffs | alcabrera: ^^^ | 19:03 |
| ilgiz | In my mind it is good task to get familiar with codebase | 19:03 |
| alcabrera | ilgiz: feel free to ask questions here. We're all pretty helpful! also, a good starting place is the wiki: https://wiki.openstack.org/wiki/Marconi | 19:04 |
| alcabrera | kgriffs: thanks! | 19:04 |
| ilgiz | thank you :) | 19:04 |
| kgriffs | ilgiz: we would LOVE to have your help! | 19:04 |
| kgriffs | our team is pretty small and so we really appreciate your interest | 19:05 |
| ilgiz | this is great, thank you, I'm looking forward to implement something useful for project | 19:07 |
| mpanetta | kgriffs: So webhooks is just a RESTful API, not any sort of implementation? | 19:10 |
| *** rongze has joined #openstack-marconi | 19:12 | |
| kgriffs | mpanetta: it's just a concept | 19:13 |
| kgriffs | basically, post data to this URL when stuff happens | 19:13 |
| kgriffs | like, github can post to a URL when code is pushed | 19:13 |
| kgriffs | so you can have jenkins listen and do stuff, for example | 19:14 |
| mpanetta | Hmm ok thanks. | 19:14 |
| *** rongze has quit IRC | 19:20 | |
| *** rongze has joined #openstack-marconi | 19:49 | |
| *** rongze has quit IRC | 19:53 | |
| *** rwsu has quit IRC | 19:55 | |
| *** rwsu has joined #openstack-marconi | 19:56 | |
| *** notmyname has quit IRC | 20:10 | |
| alcabrera | kgriffs: ping | 20:11 |
| *** notmyname has joined #openstack-marconi | 20:14 | |
| kgriffs | alcabrera: pong | 20:24 |
| alcabrera | kgriffs: yo! | 20:24 |
| alcabrera | I was just pinging you about eom:bastion. ;) | 20:24 |
| alcabrera | that's resolved. | 20:24 |
| *** cpallares has quit IRC | 20:29 | |
| flaper87 | back | 20:46 |
| flaper87 | kgriffs: re webhooks | 20:46 |
| flaper87 | I like the idea, I'm not sure about *just* having webhooks but I think they'll play an important role in how the notifications will work in marconi | 20:48 |
| *** rongze has joined #openstack-marconi | 20:49 | |
| flaper87 | I think we wrote some notes about this in the notification session | 20:49 |
| *** cpallares has joined #openstack-marconi | 20:50 | |
| flaper87 | ah we just had 'make them secure' | 20:50 |
| kgriffs | flaper87: yeah, so I was just wanting to expand our thinking a bit | 20:51 |
| kgriffs | webhooks is a nice way to enable push without dealing with persistent connections | 20:51 |
| flaper87 | kgriffs: totally, don't get me wrong, I just have a really bad memory and always need to go back and lookup things | 20:51 |
| kgriffs | i think a websocket transport is cool for latency reasons for clients, like a web app talking directly to marconi - but there we need to make it secure again | 20:52 |
| flaper87 | yeah, I see websockets being useful for mobile integrations | 20:52 |
| flaper87 | for example | 20:52 |
| flaper87 | and easy browser integration | 20:52 |
| flaper87 | but webhooks are way better for *real apps* integration | 20:53 |
| kgriffs | kewl | 20:53 |
| kgriffs | I haven't thought about webhooks vs. websockets a lot so far, but I wanted to throw it out there for discussion | 20:53 |
| flaper87 | IMHO, most of our efforts around the notification work will go on implementing a nice plugin API | 20:53 |
| flaper87 | that will make it easy to 'listen' to queues and do something | 20:54 |
| flaper87 | kgriffs: +1 that sounds like a great topic for tomorrows meeting. I'll make sure to put some thoughts on that! | 20:54 |
| *** rongze has quit IRC | 20:54 | |
| kgriffs | flaper87: thanks! | 20:54 |
| flaper87 | kgriffs: great idea, d00d! | 20:55 |
| openstackgerrit | Alejandro Cabrera proposed a change to openstack/marconi: fix: mongodb tests consume storage like crazy https://review.openstack.org/59539 | 20:56 |
| * alcabrera catches up | 20:56 | |
| kgriffs | flaper87: https://etherpad.openstack.org/p/marconi-notifications-brainstorm | 20:57 |
| alcabrera | cool - I'm game for thinking more on how webhooks/websockets will play into our notifications plan. | 20:57 |
| flaper87 | kgriffs: and TBH, I'd just call it *remote hooks* | 20:57 |
| kgriffs | alcabrera: ^^^ feel free to add ideas to that pad | 20:57 |
| flaper87 | because they could be web but also rpc | 20:57 |
| flaper87 | or some messaging technology | 20:58 |
| flaper87 | I see them implemented as separate plugins though | 20:58 |
| alcabrera | I'm heading out. More brainstorming tomorrow! :D | 21:00 |
| flaper87 | alcabrera: take care :) | 21:00 |
| *** alcabrera has quit IRC | 21:01 | |
| openstackgerrit | Alejandro Cabrera proposed a change to openstack/marconi: fix: shard test failing https://review.openstack.org/59541 | 21:05 |
| *** oz_akan_ has joined #openstack-marconi | 21:08 | |
| *** oz_akan_ has quit IRC | 21:09 | |
| *** oz_akan_ has joined #openstack-marconi | 21:10 | |
| flaper87 | kgriffs: there are 2 reviews here that need a small push to land: https://review.openstack.org/#/dashboard/6943 | 21:17 |
| *** haomaiwang has quit IRC | 21:20 | |
| *** ilgiz has quit IRC | 21:20 | |
| *** ilgiz has joined #openstack-marconi | 21:21 | |
| kgriffs | flaper87: thanks | 21:23 |
| kgriffs | I've been trying to catch up on email all day | 21:23 |
| kgriffs | will get to reviews shortly | 21:23 |
| flaper87 | kgriffs: sure | 21:24 |
| kgriffs | flaper87: pong | 21:24 |
| *** vkmc has quit IRC | 21:40 | |
| *** rongze has joined #openstack-marconi | 21:51 | |
| *** rongze has quit IRC | 21:57 | |
| *** jamieh has joined #openstack-marconi | 22:06 | |
| *** fifieldt has joined #openstack-marconi | 22:16 | |
| *** tedross has quit IRC | 22:21 | |
| *** rwsu has quit IRC | 22:27 | |
| *** mpanetta has quit IRC | 22:34 | |
| openstackgerrit | Flavio Percoco proposed a change to openstack/marconi: Make sqlite connection lazy https://review.openstack.org/59566 | 22:42 |
| *** rwsu has joined #openstack-marconi | 22:43 | |
| openstackgerrit | A change was merged to openstack/marconi: feat(validation): verify project id length https://review.openstack.org/50496 | 22:46 |
| openstackgerrit | A change was merged to openstack/marconi: feat(health): make health API storage-aware https://review.openstack.org/53457 | 22:50 |
| * flaper87 is happy to see patches landing | 22:50 | |
| *** rongze has joined #openstack-marconi | 22:53 | |
| *** rongze has quit IRC | 22:58 | |
| *** flaper87 is now known as flaper87|afk | 23:00 | |
| openstackgerrit | A change was merged to openstack/python-marconiclient: Remove unused packages https://review.openstack.org/57223 | 23:09 |
| *** jamieh has quit IRC | 23:12 | |
| *** jergerber has quit IRC | 23:18 | |
| *** amitgandhi has quit IRC | 23:21 | |
| *** jcru_ has quit IRC | 23:21 | |
| *** oz_akan_ has quit IRC | 23:32 | |
| *** oz_akan_ has joined #openstack-marconi | 23:32 | |
| openstackgerrit | Kurt Griffiths proposed a change to openstack/marconi: chore: Pass cache into drivers https://review.openstack.org/54445 | 23:33 |
| *** oz_akan_ has quit IRC | 23:33 | |
| *** oz_akan_ has joined #openstack-marconi | 23:34 | |
| *** oz_akan_ has quit IRC | 23:38 | |
| *** kgriffs is now known as kgriffs_afk | 23:43 | |
| *** whenry has quit IRC | 23:52 | |
| *** rongze has joined #openstack-marconi | 23:55 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!