Monday, 2014-04-28

*** fifieldt has joined #openstack-marconi00:24
*** shakamunyi has joined #openstack-marconi00:50
*** shakamunyi has quit IRC00:54
*** nosnos has joined #openstack-marconi01:50
*** shakamunyi has joined #openstack-marconi02:51
*** ayoung has quit IRC02:54
*** shakamunyi has quit IRC02:56
*** ayoung has joined #openstack-marconi03:09
*** ayoung is now known as ayoung_ZZZ03:09
*** haomaiwang has joined #openstack-marconi03:52
*** shakamunyi has joined #openstack-marconi03:52
*** shakamunyi has quit IRC03:57
*** nosnos has quit IRC04:10
*** shakamunyi has joined #openstack-marconi04:53
*** shakamunyi has quit IRC04:57
*** chandan_kumar has joined #openstack-marconi05:06
*** nosnos has joined #openstack-marconi05:13
*** chandan_kumar has quit IRC05:31
*** chandan_kumar has joined #openstack-marconi05:42
*** shakamunyi has joined #openstack-marconi05:53
*** shakamunyi has quit IRC05:58
*** flaper87|afk is now known as flaper8706:42
*** chandan_kumar has quit IRC06:46
*** shakamunyi has joined #openstack-marconi06:54
*** chandan_kumar has joined #openstack-marconi06:54
*** shakamunyi has quit IRC06:58
*** shakamunyi has joined #openstack-marconi07:55
*** shakamunyi has quit IRC08:00
*** ykaplan has joined #openstack-marconi08:18
*** reed has joined #openstack-marconi08:20
*** jamie_h has joined #openstack-marconi08:23
*** chandan_kumar has quit IRC08:46
*** shakamunyi has joined #openstack-marconi08:56
*** shakamunyi has quit IRC09:01
*** chandan_kumar has joined #openstack-marconi09:04
*** nosnos has quit IRC10:05
*** ykaplan has quit IRC10:06
*** chandan_kumar has quit IRC10:32
*** jchai has joined #openstack-marconi10:38
*** chandan_kumar has joined #openstack-marconi10:49
*** fifieldt has quit IRC11:07
*** fifieldt has joined #openstack-marconi11:08
*** ykaplan has joined #openstack-marconi11:19
*** haomaiw__ has joined #openstack-marconi11:35
*** haoma____ has joined #openstack-marconi11:38
*** haomaiwang has quit IRC11:39
*** haomaiw__ has quit IRC11:40
*** chandan_kumar has quit IRC12:06
*** chandan_kumar has joined #openstack-marconi12:24
*** prashanthr_ has joined #openstack-marconi12:24
*** tedross has joined #openstack-marconi12:32
*** sriram has joined #openstack-marconi12:50
*** sriram has quit IRC12:51
*** sriram has joined #openstack-marconi12:51
*** amitgandhi has joined #openstack-marconi12:51
*** jamie_h_ has joined #openstack-marconi12:56
*** jamie_h has quit IRC12:56
*** ayoung_ZZZ is now known as ayoung13:10
*** amitgandhi has quit IRC13:10
*** amitgandhi has joined #openstack-marconi13:11
*** Obulpathi has joined #openstack-marconi13:25
*** Obulpathi has quit IRC13:35
*** Obulpathi has joined #openstack-marconi13:35
*** jmckind has joined #openstack-marconi13:42
*** alcabrera|afk is now known as alcabrera13:47
*** malini_afk is now known as malini13:48
alcabreragood morning. :)13:48
flaper87alcabrera: goood morning :)13:49
flaper87how are you doing?13:49
*** balajiiyer has joined #openstack-marconi13:49
*** vkmc has joined #openstack-marconi13:50
*** vkmc has quit IRC13:50
*** vkmc has joined #openstack-marconi13:50
alcabreraflaper87: really happy, a little on the groggy side - pretty great! :D13:50
alcabreraflaper87: you?13:50
* flaper87 gives alcabrera a cup of just-queued-out coffee \_/?13:51
flaper87I'm doing great, just went through a bunch of booking madness13:51
* alcabrera drinks and enjoys13:52
malinihello!!13:52
flaper87malini: hey hey13:52
alcabreraflaper87: I saw some of that! europython and more. ;)13:52
alcabreramalini: good morning! :D13:52
flaper87malini: btw, did you read the message I sent on Saturday (or Sunday?)?13:52
malinigood morning alcabrera!13:52
* flaper87 realizes he should get a life13:52
maliniflaper87: CLI for the client?13:52
flaper87malini: yup13:52
maliniyes!! Tht is awesome!!!!!13:53
flaper87malini: ok, now, you should watch the client gerrit project too ;)13:53
flaper87:P13:53
maliniI was trying to add CLI tests in tempest  when I realized we dont have CLI yet13:53
maliniwe do true TDD :D13:53
malinigood point flaper8713:53
flaper87malini: we did that on purpose, FWIW. We wanted to keep marconiclient as a library13:53
flaper87until the python-openstack-common CLI came out13:54
maliniaah..ok13:54
maliniis there a python-openstack-common CLI now13:54
malini?13:54
flaper87that's a nice way to add CLI support by still keeping the library nature of the project13:54
flaper87malini: that's what we're using :)13:54
flaper87it's basically a base class and a bunch of entry_points put together and loaded dynamically13:55
vkmcHi all! :)13:55
flaper87vkmc: hellooooooooooooooooooooooooooooooooooooooo13:56
malinihello vkmc!!!13:56
sriramGood Morning :)13:56
flaper87sriram: gooood morning13:56
sriram\m/13:56
maliniflaper87: I was checking a few other clients on Friday, and all of them have a shell.py -which they use in Tempesteg. https://github.com/openstack/python-glanceclient/blob/master/glanceclient/shell.py will we have the same?13:57
malinigood morning sriram!13:57
flaper87malini: yeah, I really hate that code :P13:57
flaper87FWIW, we're starting to discuss glanceclient's switch-over to the common client13:57
sriramgood morning malini,vkmc,alcabrera :)13:57
flaper87sriram: hey, no optimizations allowed. you gotta send 1 dedicated message to each one of them13:58
flaper87>.>13:58
malini:D13:58
vkmcHow is the marconi-client going? I always see you discussing about it but the truth is I don't know in which stage you are... I'll appreciate a link13:59
maliniflaper87: are there any other projects that already use the common client?13:59
flaper87vkmc: https://github.com/openstack/python-marconiclient/13:59
flaper87we've a library, it supports v1 but there's no CLI support14:00
alcabrerasriram: good morning!14:00
sriramflaper87: heh14:00
*** tedross has quit IRC14:00
vkmcflaper87, Awesome, thanks14:00
flaper87malini: mmh, I know there's support for nova, glance, keystone, cinder etc14:00
flaper87but those projects still rely on the old code14:01
flaper87malini: https://github.com/openstack/python-openstackclient/tree/master/openstackclient14:01
flaper87I see the benefit of having separate releases for the client libraries but, I still think it's kinda wrong...14:02
flaper87I'd like us to always implement things in both, the server and the client library14:02
maliniyeah..it feels wrong14:02
flaper87whoever is implementing a blueprint should make sure the client library has support for that14:03
alcabrerawe're at the point where we can follow through with that, even work in parallel14:03
alcabreraif a feature is to be added to the server14:03
alcabreraanother can tackle the analagous client-side feature14:03
*** rwsu has joined #openstack-marconi14:08
*** tedross has joined #openstack-marconi14:18
vkmcIn most projects I saw that clients are not perfectly updated with the server features... it's a bummer but that's the way most interfaces are14:23
alcabreraagreed, vkmc14:25
alcabrerait's hard to keep pace w/o making that a top priority14:25
vkmcThe library looks great, btw!14:25
vkmcalcabrera, Yeah... your proposed strategy to tackle that issue is the best we can do14:26
alcabrerayup, yup. :)14:27
alcabreravkmc: and flaper87 has done an awesome job of leading the development on the client!14:28
vkmcHe totally did!14:28
*** shakamunyi has joined #openstack-marconi14:28
vkmcI remember when I tried to work on that... so naive... haha14:29
*** tedross has left #openstack-marconi14:29
alcabrerait gets easier, vkmc. :)14:30
alcabrerafocusing on haskell in my free time reminds me that I'm still a novice in many ways, but I'm *so* happy to always have more to learn. <314:30
-openstackstatus- NOTICE: Gerrit downtime for upgrade begins in 90 minutes. See: https://wiki.openstack.org/wiki/GerritUpgrade14:31
vkmcHope so :)14:31
prashanthr_Good morning All ! :)14:39
vkmcMorning prashanthr_ o/14:39
alcabreraprashanthr_: good morning!14:40
malinihello prashanthr_!14:40
vkmcalcabrera, There are so many things to learn in our field! Time never is enough -.-14:41
alcabreraes la verdad, vkmc. :P14:42
prashanthr_vkmc: true that.14:42
*** cpallares has joined #openstack-marconi14:42
*** mwagner_lap has quit IRC14:43
*** shakamunyi has quit IRC14:44
vkmcEn fin! *sighs*14:44
flaper87alcabrera: remeber that Rust lang talk I mentioned?15:00
flaper87remember*15:00
flaper87the one scheduled for the 29th15:00
alcabrerayup!15:01
alcabrerahow'd it go, flaper87?15:01
flaper87alcabrera: well, 29 is tomorrow15:01
flaper87BUT15:01
alcabreraoh15:01
flaper87IT WAS TODAY!!!!!!!!!!!!!!!15:01
alcabrerayes15:01
alcabrerahaha15:01
flaper87T_T15:01
alcabrera@_@15:01
alcabreraoh geez15:01
*** kgriffs|afk is now known as kgriffs15:02
alcabrerawill it be okay, flaper87?15:02
alcabrerawill *you* be okay, flaper87? D:15:02
flaper87someone pinged me on IRC like: Dude, are you alive? People is waiting for you15:02
flaper87and I replied: I *was* alive (plop)15:02
flaper87anyway, just did it15:02
flaper87it went decently15:02
alcabrerahurray!15:02
alcabrera<315:02
flaper87not well,  decently15:02
flaper87I just gave a very high-level introduction to Rust15:03
alcabreradecently to me means -- information was shared, and people have a starting point. :)15:03
*** chandan_kumar has quit IRC15:03
flaper87alcabrera: exactly that15:03
flaper87it could've been better though but anyway15:03
*** shakamunyi has joined #openstack-marconi15:04
cpallaresflaper87: :D15:04
cpallaresflaper87: Where did you present? Was it recorded?15:04
kgriffsflaper87: so, about Rust15:06
kgriffsdoes it have async goodness built in or as a library?15:07
flaper87cpallares: yup, recorded, I was actually looking for you to invite you15:10
cpallaresflaper87: link?15:10
flaper87kgriffs: asyn as in, green threads with nice IO handling?15:11
kgriffsyeah15:11
flaper87kgriffs: it does, it has 2 threading models. Native threads and green threads15:11
flaper87the default is native threads15:11
flaper87(although it used to be the other way around15:11
flaper87)15:11
flaper87and green  thread's IO uses libuv under the hood15:12
flaper87(node.js IO library)15:12
kgriffsyep15:12
kgriffshmm15:12
kgriffsso, does it use promises or coroutines or ?15:12
*** jchai is now known as jchai_afk15:12
alcabrerait was a spawning method, iirc, kgriffs: http://static.rust-lang.org/doc/master/std/task/index.html15:13
alcabreraso15:13
*** jchai_afk is now known as jchai15:13
alcabreramuch like gevent.spawn, or haskell's forkIO, or golang's goroutines15:14
kgriffsinteresting15:14
kgriffsnext question - how does memory management work in Rust?15:14
flaper87kgriffs: it's user managed. That is, stack / heap allocated values that are zero'd out when they go out of scope15:17
flaper87kgriffs: there was support for GC'd values but the syntactic sugar for that was removed and the whole GC code was moved into a library15:17
alcabreraGC is therefore optional. :)15:17
flaper87so now you can have `Gc` objects that contain a GC managed value15:17
flaper87alcabrera: yup :)15:17
kgriffsflaper87: final question: is there a kick-a** HTTP client library?15:18
alcabrerahahha, I vaguely remember flaper87 working on such a thing. ;)15:18
alcabrerakgriffs: ^15:18
flaper87kgriffs: there's a fair rust-http library but a new one based on the old one and maintained by the same guy was recently announced15:18
kgriffsok15:18
kgriffsflaper87: oh, one other question - zeromq support?15:19
kgriffs(or something similar)15:19
flaper87kgriffs: https://github.com/erickt/rust-zmq15:20
alcabrerarust is pretty amazing. It's the best imperative-oriented language available to date, imo.15:20
kgriffsmmm15:20
flaper87kgriffs: http://www.rust-ci.org/projects/15:20
flaper87(there's nanomsg too)15:20
kgriffsis rustpkg any good?15:21
kgriffsI guess I should go play with all this15:21
kgriffs:p15:21
kgriffsI have been learning Go, but I'm not sure that I like it very much15:22
malinibefore you go play with rust, kgriffs15:22
malinime & sriram are planning to work on benchmarking marconi this week15:22
maliniwe have an inital plan here https://etherpad.openstack.org/p/marconi-benchmark-plans15:23
alcabrerathe lack of generics in Go is a killer downer15:23
maliniCan everybody take a look & add your comments?15:23
*** prashanthr_ has left #openstack-marconi15:23
alcabreraas well as the really obtuse separation between built-in types, maps, channels, and every data type a user might define15:23
maliniflaper87: Can you add your thoughts to https://etherpad.openstack.org/p/marconi-benchmark-plans ?15:26
flaper87kgriffs: rustpkg is dead :)15:27
flaper87kgriffs: there's a new package manager that `wycast` is working on15:27
flaper87wycast -> author of bundler15:27
flaper87and ember.js15:27
flaper87IIRC15:27
flaper87anyway, enough publicity15:27
flaper87just wanted to say that the old rustpkg was deprecated and a new one is being developed under a paid contract15:28
kgriffsflaper87: ah, ok. good to know15:28
kgriffsflaper87: so, I was thinking about writing a killer benchmarking tool for HTTP APIs.15:29
-openstackstatus- NOTICE: Gerrit downtime for upgrade begins in 30 minutes. See: https://wiki.openstack.org/wiki/GerritUpgrade15:30
alcabreraRust/Haskell/Erlang are all pretty amazing for accomplishing just that, kgriffs. ;)15:31
kgriffsI like the idea of using Rust without GC, so I don't have to worry about the runtime kicking in and skewing results15:31
kgriffsTsung is Erlang... but I'd like a tool that was more optimized for API testing vs. websites, and a tool that gives more straightforward, consistent reports15:32
kgriffsplus, I need an excuse to learn a new language, and that new language is not Erlang. :p15:33
alcabreralol15:33
*** malini is now known as malini_afk15:37
*** malini_afk is now known as malini15:39
*** jamie_h_ has quit IRC15:48
*** jamie_h has joined #openstack-marconi15:49
*** mwagner_lap has joined #openstack-marconi15:51
kgriffsmalini, alcabrera: so, it seems we have a few ways to configure the client behavior15:52
kgriffs1. a conf file and CLI options ala httperf, ab15:52
kgriffs2. XML or JSON ala Tsung (https://github.com/rackerlabs/csi-marconi/blob/master/load/tsung.xml)15:53
kgriffs3. Use the benchmarking language directly ala JMeter15:53
* alcabrera googles the JMeter15:54
kgriffs4. Host a minimal scripting language like Lua15:55
alcabrera(3) with a FP language could be beautiful. (4) is not a bad place to be at, either.15:55
kgriffs5. write a DSL which may be a subset or superset of an existing language15:56
malinimpanetta had an interesting idea recently15:56
alcabreraand by (3), I mean (5)15:56
alcabrera:D15:56
maliniam trying to find tht mail15:56
alcabreraor hmmm15:56
alcabrerayup, actually I meant (3)15:56
alcabrerabut yes15:56
alcabrerampanetta did have some very interesting ideas15:56
malinikgriffs: I just forwarded you a mail15:57
kgriffsreading16:00
kgriffsinteresting16:01
kgriffsso it seems like the heart of his idea is the ability to benchmark end-to-end scenarous16:02
kgriffswhich means the tool needs a way to trace the lifetime of a message across multiple clients.16:02
* alcabrera imagines Google Dapper; trace-based profiling16:04
*** ykaplan has quit IRC16:06
*** Obulpathi has quit IRC16:07
*** amitgandhi has quit IRC16:11
*** Obulpathi has joined #openstack-marconi16:25
-openstackstatus- NOTICE: Gerrit is unavailable until further notice for a major upgrade. See: https://wiki.openstack.org/wiki/GerritUpgrade16:36
*** ChanServ changes topic to "Gerrit is unavailable until further notice for a major upgrade. See: https://wiki.openstack.org/wiki/GerritUpgrade"16:36
kgriffsmalini: is this bp still valid? https://blueprints.launchpad.net/marconi/+spec/devstack-marconi-tests16:44
*** shakamunyi has quit IRC16:46
alcabreramalini, kgriffs: very relevant to our benchmarking discussions: https://twitter.com/SciencePorn/status/460577159929933824/photo/116:56
kgriffshehe17:01
*** jmckind has quit IRC17:06
malinikgriffs: we still need tht bp implemented17:08
kgriffsmalini: ok, should it be Juno-1, or later?17:08
malinilet me chk the timeline for Juno-117:09
maliniI cant find the timelines :(17:12
maliniwhen should we have this done , if it were Juno-1 ?17:13
malinikgriffs: ^17:13
*** shakamunyi has joined #openstack-marconi17:13
kgriffsthe juno schedule probably isn't finalized yet, so we will have to guesstimate17:16
kgriffsmalini: probably 6 weeks after the summit17:17
maliniLets make it Juno-217:17
kgriffsok17:17
kgriffshttps://bugs.launchpad.net/marconi/+bug/129213617:18
kgriffsmalini: how about this bug? Juno-1?17:18
maliniThe last I heard we'll have Trusty at the gate by June17:19
maliniSo lets keep this for Juno-117:19
kgriffsok17:19
kgriffsmalini: this one we can mark as "won't fix" right? https://bugs.launchpad.net/marconi/+bug/129406817:20
maliniare we officially moving sqlalchemy to the back burner?17:21
kgriffsyes. We won't remove it because it is handy for development not to have to spin up mongo or something, but I don't think we need to gate on MySQL, just sqlite.17:23
kgriffs(imo)17:23
maliniin tht case, we can mark it as won't fix17:23
kgriffskk, thanks!17:25
kgriffsbbl17:25
*** chandan_kumar has joined #openstack-marconi17:26
*** jamie_h has quit IRC17:27
*** balajiiyer has quit IRC17:29
*** shakamunyi has quit IRC17:35
*** kgriffs is now known as kgriffs|afk17:36
*** ayoung is now known as ayoung_rrrrmmm17:55
*** kgriffs|afk is now known as kgriffs18:02
*** tjanczuk has joined #openstack-marconi18:03
tjanczukHi folks. I was wondering who is attending the summit in Atlanta and what a best way to meet the Marconi team would be during the event?18:05
alcabreratjanczuk: I'm attending. As to the best way to meet the Marconi team, I feel that malini is more on top of this than I. :)18:07
malinitjanczuk: we are planning a team outing kinda thing in ATL18:08
maliniwill you be interested in joining us?18:08
tjanczukif you don't mind me crashing the party I would love to.18:09
malinithe more the merrier18:09
tjanczukdo you already have a pre-agreed time & place?18:09
malininot yet18:10
maliniMost probably it'll be on Sunday before the summit18:10
malinifrom the travel schedules we have seen so far18:10
maliniI have added you to the list here https://etherpad.openstack.org/p/marconi-party18:11
*** rossk has joined #openstack-marconi18:11
maliniWe have the marconi meeting tomorrow & hope to finalize the date/time then18:11
flaper87tjanczuk: I only know I'll eat A LOT!18:12
tjanczukthanks for adding me to the list (took me a while to locate it under "humans"; we can fix it later)18:13
tjanczukI am only flying in at 9pm on Sunday.18:13
malini:(18:14
tjanczukIn general how do you guys plan to stay in touch during the event for coordination?18:14
flaper87tjanczuk: the italian way. Yelling!18:14
tjanczukI am told there are 3000 attendees. That may not scale.18:15
flaper87tjanczuk: jokes apart, we did Twitter, sms and email in HKG18:15
flaper87tjanczuk: where are you flying from?18:15
maliniisn't there an app to track?18:15
tjanczukSeattle18:15
flaper87I think I'll buy a local sim card18:15
flaper87malini: that app is for pets, I'm a robot. Come on!18:15
maliniso far, we have two ppl flying in on Sunday night -including tjanczuk18:15
maliniwonder if we should just do this on a conf day evening18:16
*** amitgandhi has joined #openstack-marconi18:16
flaper87malini: that may work too18:17
flaper87however, there are *many* events during the conf week18:17
flaper87(in the evening)18:17
kgriffsyeah. Well, let's not forget we have a project pod area we can use during the day18:17
kgriffsfor unconferency stuff18:18
tjanczukWhat's that area?18:18
flaper87lets just do something on saturday / sunday and use the dev room for uncon18:18
flaper87tjanczuk: there's normally a dev room in the conf18:18
kgriffstjanczuk: every project gets a table. they are located in a few rooms at the conference center18:18
flaper87it's sort of a lounge bar with redbull and no internet access18:18
kgriffsROFL18:19
flaper87ok, I'm kidding, there's no redbull18:19
flaper87nor internet access18:19
sriramno internet access :O18:19
flaper87:D18:19
* flaper87 is full of bad / evil jokes18:19
tjanczukLack of WIFI must be intentional to foster good discussion.18:19
tjanczukIs this where folks normally hang out during the day?18:19
*** balajiiyer has joined #openstack-marconi18:20
kgriffsyep, people hang out there during breaks, when there aren't any other interesting sessions to go to, or you want to follow up on a topic that doesn't have a time slot18:20
kgriffsif we are lucky they will drop some access points in those rooms so we don't have to contend with the masses for an IP18:21
flaper87kgriffs: alcabrera malini btw, what's the cheapest / convenient phone company in ATL?18:22
flaper87I just need the sim card for a week18:23
kgriffsand if all else fails, I heard flaper87 is bringing his personal hotspot and will let everyone use it for free. ;)18:23
alcabreralol18:23
*** jchai has quit IRC18:23
flaper87kgriffs: what do you think the sim card is for?18:23
alcabreraflaper87: I've had great experiences with Ting.com on my Nexus 5. I'm looking at about $15/month18:23
flaper87:P18:23
flaper87alcabrera: you own a nexus 5?18:23
tjanczukI think I may be too late to join on Sunday if that is when you decide to meet but please keep me in the loop on that outing. Otherwise I will try to find you in the pod.18:23
* flaper87 owns one too18:23
alcabreraflaper87: oh yes - as of about... a month ago!18:23
alcabreraI purchased the ting.com SIM card for about $1018:24
flaper87alcabrera: does buying the card have an extra.... thanks18:24
flaper87:P18:24
alcabreralol18:24
alcabrerait also comes with a $25 credit on their service for getting the SIM card, iirc18:24
flaper87muahahaha, if they only knew I'll throw it away the week after18:24
flaper87:P18:24
flaper87alcabrera: do you know if there's a ting.com store at the airport ?18:26
alcabreraflaper87: I'm not sure. I'm inclined to doubt it. >.>18:27
flaper87If I get off the plain and realize I don't have internet access, I'll probably freak out...18:27
flaper87I'm a robot, that's where my food comes from18:27
flaper87anyway, I'll figure something out18:27
*** ayoung_rrrrmmm is now known as ayoung18:32
tjanczukOn a more serious note, I was following the marconi discussions on openstack-dev and this thread in particular was interesing: http://lists.openstack.org/pipermail/openstack-dev/2014-March/030367.html18:34
flaper87tjanczuk: what are your thougnts about it?18:35
flaper87tjanczuk: did you go through the whole thread?18:35
flaper87I'm really interested in knowing what your opinion is and what your doubts, if any, are18:36
tjanczukYes I went through the whole thing. By the time I was done I had 5 cups of coffee in me. It looked to me like the concerns expressed by folks in there were preventing Marconi from graduating.18:36
tjanczukI actually looked at Marconi before this thread showed up (not sure if you recall but I popped in on this IRC some time ago).18:37
kgriffsI think I remember you popping in a while back. You are with HP?18:37
tjanczukYes I am with HP. In general I get the value proposition of Marconi: to deliver a *multi-tenant* messaging system (as opposed to a mechanism to provide single-tenant deployments of existing brokers).18:38
kgriffsah, ok. Yep I remember now seeing you around.18:39
flaper87tjanczuk: thanks for taking the time for looking at marconi and reading that thread18:40
tjanczukOne piece of feedback from that thread that resonated with me was the unusual (for a messaging system) modes of accessing messages, virtually enabling random access to any messages.18:40
tjanczukDespite the fact the storage layer is extensible, having this prescriptive API shape at the transport layer in practice constraints what technology one can use at the storage layer.18:41
tjanczukThat combined with the fact there are folks who don't like Mongo for legal reasons do not leave a lot of options on the table.18:42
kgriffstjanczuk: do you have a specific backend in mind that you would like to use?18:43
flaper87tjanczuk: that's a valid concern. We're planing to discuss queues flavors at the summit which will bring a way to categorize the kind of storage driver available / enabled18:44
tjanczukGiven that most OpenStack deployments already require a RabbitMQ cluster (and the know-how of operating one), I think it would be beneficial to allow folks to re-use that expertise. In other words, I would see value in putting a multi-tenant HTTP head on top of RabbitMQ.18:44
flaper87this definitely doesn't fix your concern but it, at least, gives a nice way to organize them18:44
flaper87as of MongoDB's license issue. I keep hearing that many folks complain about it but I still haven't heard / read a *real* case where someone *can't* use mongodb because of its license18:45
flaper87I'm not a layer, so bare with me there.18:45
kgriffsas for AMQP, we are discussing ways to make that work18:46
kgriffswe have some ideas for v2.0 API that will make it easier to support an AMQP backend; flaper87 has been thinking a lot about that18:46
flaper87kgriffs: speaking of which, I've more things to share on that topic but I don't want to hijack the discussion18:47
kgriffstjanczuk: another direction we are exploring is Redis.18:47
tjanczukI am not a lawyer either and I am not judging anyone for using or not using Mongo for whatever reason. I am just observing there are folks for whom it is a turn-off.18:47
tjanczukRedis is interesting. Did you look at Kafka?18:48
kgriffstjanczuk: yes, it is a turnoff, and it will take time for people to either decide it is OK after all, or find a concrete reason why they don't want to use it.18:48
kgriffsin the meantime, we need to have more options.18:48
kgriffstjanczuk: I can't speak for others in the team, but I did look at Kafka around when it first came on the scene18:49
tjanczukI know this may sound bizzare, but I almost wish Marconi did not give people any "options" for storage18:49
flaper87tjanczuk: I think that would bring more problems that it would solve, TBH. and it wouldn't help with the "You guys are re-inventing the wheel" comments we keep getting.18:50
kgriffsit's a clever system, but we haven't thought seriously about using it because we wanted to support more semantics than kafka would make possible; I should take another look at it now that it has been baking a while.18:50
flaper87it's not a terrible idea but it has a huge impact in the community18:50
tjanczukI think some of the best technologies are so because they are opinionated: they do one thing and do it great. This also enables a lot of optimizations opportunity for which is lost once an extensibility point is in the system.18:50
kgriffsswift basically went that route18:51
kgriffsthey wrote their own storage layer18:51
notmyname?18:51
* notmyname sees "Swift"18:51
kgriffsi mean, built on top of sqlite18:51
kgriffsbut swift handles all the replication, etc. of the data18:51
flaper87I think that, as long as the Marconi team, focuses on a small set of technologies, it's fine18:52
tjanczukflapper87: I think reinventing the wheel is not necessarily a bad thing, as long as you can show it is a better wheel.18:52
* kgriffs like this tjanczuk guy18:52
flaper87tjanczuk: agreed, but we need to experiment before we can claim that18:52
tjanczukI think if Marconi could deliver the perf of, say, Rabbit, but solve the multi-tenancy problem, that would be a better wheel for me.18:52
kgriffstjanczuk: +1, that phrase is often overused and abused18:52
flaper87I think we'll get to the point where the team focus will be on 2 drivers and the rest will be left out to the community18:53
tjanczuk(That is why I keep pestering you guys about performance number on openstack-dev)18:53
flaper87tjanczuk: I like that last statement18:53
kgriffstjanczuk: fwiw, I've been pestering people too; I think we will finally get at least some basic benchmarks done and posted in the next week18:54
* kgriffs crosses fingers18:54
malinitjanczuk: On tht note, we are finally ready to do  some serious benchmarking18:54
malinitjanczuk:  this is our initial plan https://etherpad.openstack.org/p/marconi-benchmark-plans . Feel free to add your comments18:54
maliniThe last benchmark we did was 3-4 months back18:55
tjanczukI will take a look in the pm, I need to pick up my kid from school shortly.18:55
kgriffsanyway, I think at some point it wouldn't hurt to experiment with more of a domain-specific backend storage engine, but I don't think we have the bandwidth to take that on just yet18:55
flaper87tjanczuk: before you go, thanks a lot for your feedback. it's very welcome and appreciated. Keep it coming :)18:56
tjanczukI have a concern that with the current architecture of Marconi it will be hard to get decent perf #s, but I would love to be proved wrong.18:56
tjanczukThe reason I mentioned Kafka is that it is interesting not only from the perspective of a potential backend, but also the entire mindset of approaching a problem.18:57
* flaper87 read kafka's paper last week18:58
kgriffstjanczuk: totally valid concern. We need to think about some concrete goals, and then find a way to accomplish them.18:58
tjanczukThese guys are really looking at the messaging stack holistically. Having a very specific messaging semantics allows them to milk perf to the extend not possible with a more generic messaging interfaces.18:58
tjanczukOK, you will not get exactly once delivery. Worse, your consumers must keep track of which messages were consumed. But know what, it gives them 10x the perf of other messaging systems. And it very well addresses specific scenarios.19:00
tjanczukPerhaps it would make sense to apply a similar mindset to Marconi. Build a very tightly integrated stack. Perhaps some minimal extensibiloty points here and there, to plug in custom auth for example.19:00
*** amitgandhi has quit IRC19:01
*** amitgandhi has joined #openstack-marconi19:01
tjanczukI will go over the test plan for perf. Otherwise I look forward to chatting more before and during the summit.19:02
malinithanks tjanczuk19:02
kgriffsyep, let's keep thinking about this.19:02
*** openstackgerrit has quit IRC19:04
kgriffsIt will be helpful to chat in person with pen and paper and/or whiteboard in hand.19:05
*** amitgandhi has quit IRC19:06
flaper87Although I agree with the feeling about kafka, I think we're still not ready to take such decision.19:06
kgriffsalcabrera, flaper87: do we have any GNOME OPW interns, or are they all GSoC?19:06
flaper87kgriffs: Aazz is an OPW intern19:07
kgriffswait, do we have 4 interns now? Or is cpallares going to work on something different?19:07
kgriffs(4 total, across GSoC, OPW, and Red Hat)19:07
kgriffsVictoria, Prashanth are GSoC19:08
kgriffsCindy is interning directly with Red Hat, right?19:08
kgriffscpallares: ^^^ ?19:10
flaper87kgriffs: yup19:10
kgriffsok19:10
flaper87she's wearing a very nice Red Hat now :)19:10
kgriffsrock on19:10
alcabrerasweet!19:12
alcabreraI'm very happy for cpallares. :D19:12
alcabreraI didn't know!19:12
cpallaresalcabrera: thanks :)19:13
*** tjanczuk has quit IRC19:13
* cpallares is annoyed fedora doesn't have popup notifications for irc19:13
alcabreraheh19:14
alcabreraI'm been using weechat way too long. I have no notifications, short of looking at my terminal window and seeing my name highlighted. >.>19:14
cpallaresalcabrera: haha that would not work for me.19:15
cpallaresalcabrera: although IRC notifications are rather distracting19:15
* cpallares remembers all those convos about chickens and video cameras19:15
alcabrerahahaha19:16
alcabreraI participated in one discussion recently19:16
alcabrerawhere there was a mass exchange of adorable bunny pictures19:17
alcabreracpallares: :)19:17
cpallaresalcabrera: :D19:17
cpallaresalcabrera: my reaction to anything bunny related: http://x2.fjcdn.com/comments/A+_143cf603e2473c89f40a7af0c58a16e8.jpg19:18
* alcabrera clicks19:18
alcabrerahahaha19:18
alcabreracpallares: ~so kawaii~19:19
cpallaresfalcon has a pretty cute bunny picture.19:19
cpallareswith a pancake.19:19
cpallaresthat's also how I reacted to it19:19
alcabreracpallares: http://imgur.com/a/zYZvn/ -- unleash the bunnies19:19
alcabrerathat was the winning post19:20
cpallaresso cute :319:20
*** jmckind has joined #openstack-marconi19:20
cpallaresalcabrera: This is my devious hamster. He likes to escape, last time that happened he got his head stuck and I took a picture of him to shame him. https://scontent-b-ord.xx.fbcdn.net/hphotos-frc3/t1.0-9/598836_369653763109461_477964547_n.jpg19:22
*** tedross has joined #openstack-marconi19:26
*** amitgandhi has joined #openstack-marconi19:26
kgriffslol19:27
kgriffswhat kind of hamster is he?19:27
alcabreracpallares: cuuutee! Sneaky little fellow. :)19:29
cpallareskgriffs: he's a dwarf hamster and his name is Gimli :P :P :P19:30
* kgriffs gives Gimli a virtual snack19:30
alcabreracpallares: does Gimli have an awesome axe? ;)19:30
*** ChanServ changes topic to "OpenStack Queuing and Notification Service || Smile :D || Meetings every Tuesday @ 15:00 UTC || Wiki: https://wiki.openstack.org/wiki/Marconi || Paste: http://paste.openstack.org/ || Send messages and make some noise :D"19:31
-openstackstatus- NOTICE: Gerrit upgrade to 2.8 complete. See: https://wiki.openstack.org/wiki/GerritUpgrade Some cleanup tasks still ongoing; join #openstack-infra if you have any questions.19:31
cpallaresalcabrera: why yes he does, it's made of seeds.19:31
cpallares(and straw)19:32
cpallaresyay gerrit works now19:32
alcabreraw00t19:34
*** chandan_kumar has quit IRC19:40
cpallaresalcabrera: do you know what hadoop is?19:55
alcabreracpallares: yup!19:57
alcabreraI've never used it, but I'm familiar with the platform.19:57
cpallaresalcabrera: ah okay well I have a hadoop sticker, do you want it? I'm sending them your way tomorrow.19:58
cpallaresalcabrera: I thought it was a postgresql elephant, but it looks green and on something :P19:59
cpallaresbut it's cute19:59
cpallaresso maybe it could find a home on your laptop19:59
alcabreraoh!20:01
alcabreracpallares: yay! That's wonderful news. I'm looking forward to the stickers.20:01
alcabreraAnd yes - I'll take a Hadoop elephant. :)20:01
alcabreraor an elephant20:01
cpallaresalcabrera: http://cdn.dice.com/wp-content/uploads/2013/06/elephant_rgb_sq.png20:01
alcabrerathe tech-ephanter20:01
cpallaresalcabrera: but it's greenish20:02
alcabrerahahaha20:02
alcabreraI love his little face20:02
alcabreralike20:02
cpallareshaha20:02
alcabrera"I'm an elephant YEAAAHH"20:02
alcabrera";D"20:02
cpallareshaha20:03
*** amitgandhi has quit IRC20:08
*** amitgandhi has joined #openstack-marconi20:09
alcabreraI'm out for the night. Take care, all!20:16
alcabreracpallares: o/20:16
*** shakamunyi has joined #openstack-marconi20:17
*** alcabrera is now known as alcabrera|afk20:18
*** sriram has quit IRC20:20
*** mwagner_lap has quit IRC20:27
*** vkmc has quit IRC20:43
*** tedross has quit IRC20:47
*** cpallares has quit IRC20:59
*** jmckind has quit IRC21:03
*** tedross has joined #openstack-marconi21:05
*** Obulpathi has quit IRC21:24
*** amitgandhi has quit IRC21:24
*** malini is now known as malini_afk21:32
*** tjanczuk has joined #openstack-marconi21:35
*** balajiiyer has quit IRC21:44
*** openstackgerrit has joined #openstack-marconi21:54
*** flaper87 is now known as flaper87|afk22:18
*** mwagner_lap has joined #openstack-marconi22:19
*** tedross has quit IRC22:24
*** reed has quit IRC22:26
*** tjanczuk has quit IRC22:54
*** ayoung is now known as ayoung_DadMode23:01
*** ayoung_DadMode is now known as ayoung_23:56
*** ayoung_ is now known as ayoung23:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!