Thursday, 2014-11-13

« Wednesday, 2014-11-12 Index Friday, 2014-11-14 »
*** exploreshaifali has quit IRC00:12
*** echevemaster has quit IRC00:13
*** amitgandhinz has joined #openstack-zaqar00:22
*** amitgandhinz has quit IRC00:26
*** reed has quit IRC00:31
*** malini has joined #openstack-zaqar00:36
*** achanda has quit IRC00:53
*** malini has quit IRC00:54
*** achanda has joined #openstack-zaqar01:00
*** achanda has quit IRC02:17
*** vkmc has quit IRC03:04
*** vipul has quit IRC04:12
*** AAzza has quit IRC04:12
*** AAzza_afk has joined #openstack-zaqar04:12
*** AAzza_afk is now known as AAzza04:12
*** vipul has joined #openstack-zaqar04:12
*** achanda has joined #openstack-zaqar04:24
*** achanda has quit IRC04:29
*** achanda has joined #openstack-zaqar04:32
*** dagnello has quit IRC05:13
*** achanda has quit IRC06:01
*** exploreshaifali has joined #openstack-zaqar06:04
*** achanda has joined #openstack-zaqar06:04
openstackgerritOpenStack Proposal Bot proposed openstack/zaqar: Imported Translations from Transifex  https://review.openstack.org/13332706:07
*** exploreshaifali has quit IRC06:14
*** duanhf has joined #openstack-zaqar06:17
duanhfhello, everybody06:17
duanhfI have a question: does zaqar support the AMQP/kafka backend in Juno?06:18
duanhfanybody knows the status of supporting AMQP/kafka in zaqar?06:19
*** reed has joined #openstack-zaqar06:51
*** achanda has quit IRC07:07
*** dynarro has joined #openstack-zaqar07:49
*** achanda has joined #openstack-zaqar08:07
*** achanda has quit IRC08:12
*** duanhf has quit IRC08:20
*** sgotliv has quit IRC08:50
*** exploreshaifali has joined #openstack-zaqar09:05
flaper87o/09:17
flaper87boris-42: awesome, thanks09:17
flaper87I'll take a look at that09:17
*** exploreshaifali has quit IRC09:18
*** yfujioka has joined #openstack-zaqar09:19
*** exploreshaifali has joined #openstack-zaqar09:29
*** sgotliv has joined #openstack-zaqar09:39
openstackgerritMerged openstack/zaqar: Imported Translations from Transifex  https://review.openstack.org/13332709:43
openstackgerritDoraly Navarro proposed openstack/python-zaqarclient: Makes health return True or False.  https://review.openstack.org/13414909:43
exploreshaifaliflaper87, hello if you have time, please can we discuss how to start with opw project - splitting both planes09:48
exploreshaifaliflaper87, I am yet unable to make clear picture of steps that I should follow to complete this task09:50
*** reed has quit IRC09:50
flaper87exploreshaifali: hey hey09:51
flaper87exploreshaifali: sure thing09:51
flaper87exploreshaifali: does that mean you picked Zaqar ?09:51
flaper87:)09:51
exploreshaifalisince I put Zaqar as my first choice in application I am selected for it09:52
exploreshaifalihttps://wiki.gnome.org/OutreachProgramForWomen/2014/DecemberMarch#Accepted_Participants09:52
exploreshaifalibtw my name's spelling is mis-spelled there09:52
flaper87exploreshaifali: please, reach out to Anne or Marina with regards to your name09:52
exploreshaifaliok09:53
flaper87exploreshaifali: so, your task09:53
flaper87lets work on an etherpad09:53
exploreshaifaliok09:53
flaper87exploreshaifali: http://etherpad.openstack.org/p/exploreshaifali-opw-split-layers09:53
flaper87exploreshaifali: please, write there the description of the problem and what you've understoo so far about what needs to be done09:55
exploreshaifaliok09:55
*** reed has joined #openstack-zaqar10:02
flaper87exploreshaifali: that looks good10:04
flaper87exploreshaifali: lets now split it10:04
exploreshaifaliok :)10:04
flaper87exploreshaifali: btw, we had an etherpad with some things written there10:05
flaper87exploreshaifali: do you have it handy?10:05
* flaper87 can't find it10:05
exploreshaifaliyup10:06
exploreshaifaliflaper87, https://etherpad.openstack.org/p/zaqar-scratch10:07
flaper87exploreshaifali: danke10:07
exploreshaifali:)10:08
flaper87exploreshaifali: mmh, I think that's a good start10:10
flaper87exploreshaifali: I'm sure more things will come up as we go10:10
exploreshaifaliflaper87, did you asked to move this ControlDriver https://github.com/openstack/zaqar/blob/master/zaqar/queues/storage/mongodb/driver.py#L177 in management.py?10:12
flaper87exploreshaifali: yes10:12
flaper87exploreshaifali: just to make it clear they are different things10:13
flaper87what do you think?10:13
flaper87do you think it'd be better to keep everything in the same module?10:13
exploreshaifaliI was just conforming, if you was not referring it and something else10:13
exploreshaifaliabout which I am not aware, so10:13
flaper87dynarro: http://logs.openstack.org/49/134149/1/check/gate-python-zaqarclient-pep8/f038766/console.html#_2014-11-13_09_50_48_12310:13
exploreshaifalibetter to comfirm10:14
flaper87exploreshaifali: sure thing10:14
flaper87exploreshaifali: btw, not sure if you've read this but http://blog.flaper87.com/post/mentoring-others-and-yourself/10:14
flaper87exploreshaifali: I think it's worth it and I'd love to hear your opinion before and after your internship :)10:15
flaper87exploreshaifali: also, do you have a blog?10:15
exploreshaifaliflaper87, yes http://shaifali-agrawal.blogspot.in/10:15
flaper87exploreshaifali: awesome10:16
* flaper87 bookmarks it10:16
exploreshaifali:D10:16
exploreshaifaliI am also suppose to write blog every week ;)10:16
exploreshaifaliregarding my internship10:16
flaper87exploreshaifali: I know ;)10:16
openstackgerritMerged openstack/zaqar: Updated from global requirements  https://review.openstack.org/13254410:17
exploreshaifaliflaper87, okay, so I will read your post and write a blog before intership starts10:17
flaper87exploreshaifali: awesome!10:18
flaper87exploreshaifali: when does it start again?10:18
exploreshaifaliflaper87, :D I mean before 9-Dec10:18
openstackgerritDoraly Navarro proposed openstack/python-zaqarclient: Makes health return True or False  https://review.openstack.org/13414910:19
exploreshaifalithough I won't wait for that date10:19
exploreshaifalias we have discussed, I will complete decided tasks and get back to you :)10:20
flaper87exploreshaifali: awesome, please, don't isolate while you work on those :)10:20
flaper87we like having you around10:20
flaper87and it's always good to discuss things as we work on them10:21
flaper87well, s/always//10:21
flaper87;)10:21
exploreshaifalisure :)10:21
*** dynarro has quit IRC10:22
*** exploreshaifali has quit IRC10:54
*** malini has joined #openstack-zaqar11:28
*** malini has joined #openstack-zaqar11:28
*** dynarro has joined #openstack-zaqar12:01
*** vkmc has joined #openstack-zaqar12:10
*** vkmc has quit IRC12:10
*** vkmc has joined #openstack-zaqar12:10
vkmcmorning zaqars12:13
flaper87vkmc: gooooooooooooooooooood morning :)12:28
*** yfujioka has quit IRC12:28
sgotlivvkmc, I am not zaqar but still nice to see you online12:30
*** duanhf has joined #openstack-zaqar12:30
flaper87sgotliv: you could be :)12:31
sgotlivflaper87, first, I have to check in wikipedia what does it mean12:32
sgotlivflaper87, interesting http://en.wikipedia.org/wiki/Zaqar12:34
vkmcsgotliv, heeeey :)13:07
vkmcsgotliv, Zaqar has a super epic meaning13:08
openstackgerritFlavio Percoco proposed openstack/zaqar-specs: Make FIFO guarantee optional  https://review.openstack.org/12598613:14
openstackgerritFlavio Percoco proposed openstack/zaqar: Let the test client serialize request's body  https://review.openstack.org/13421013:42
*** jchai has joined #openstack-zaqar13:48
*** X019 has joined #openstack-zaqar13:50
openstackgerritFlavio Percoco proposed openstack/zaqar: Let the test client serialize request's body  https://review.openstack.org/13421013:52
openstackgerritFlavio Percoco proposed openstack/zaqar: Claim post requires a body  https://review.openstack.org/13421413:52
*** X019 has quit IRC13:52
duanhfhello, everybody, does anyone know the status about zaqar supporting the AMQP/kafka as backend? is it in Juno release? or will be in kilo release?13:59
vkmchi duanhf!14:01
vkmcduanhf, Zaqar won't support AMQP/Kafka in the short term14:02
vkmcduanhf, we are working on adding a new transport that would allow to give an initial support for those14:02
flaper87duanhf: may I ask why your interest on those specific backends?14:05
duanhfvkmc, thanks for the info. will them be supported in the next openstack release - kilo?14:05
flaper87duanhf: can I know what your use-case is ?14:05
flaper87duanhf: there are some folks that show interest in this backend (kafka) at the summit and they said they may have some time to play with that14:06
flaper87duanhf: it's also worth mentioning that zaqar has support for external storage backends. That is to say that you could have your own implementation and maintain it outside the code base14:06
vkmcduanhf, no problem14:06
vkmcduanhf, I'm also interested in knowing your need of these specific backends :)14:07
duanhfflaper87: I am studying the Messaging as a service - looking for the opportunity to evlove our existing product on top of and towards MaaS.14:07
flaper87duanhf: may I know what company you work for? Or is it pure research ?14:08
flaper87not really relevant, I'm just interested in knowing what areas we can push Zaqar towards14:09
duanhfflaper87, vkmc: and we collected some basic requirements in terms of the throughput, scaling, HA etc, and found that kafka and RabbitMQ are the two candidates that suitable for our product.14:09
*** sgotliv has quit IRC14:10
duanhfand I happened see that zaqar -as openstack project, provide the Messaging as a Service, so, I am wondering if we could use zaqar in our product.14:10
*** sriram has joined #openstack-zaqar14:11
flaper87duanhf: note that rabbitmq and kafka both have very different API's14:11
duanhfflaper87: I am working in Alcatel-Lucent.. a telecommunication company.. for IMS area..14:11
flaper87duanhf: what's your maximum latency tolerance?14:12
flaper87based on your use case14:12
*** jchai is now known as jchai_afk14:13
duanhfflaper87: if we have zaqar, will zaqar taking care of the "interaction" with rabbitMQ/kafka, and we (the application) only talks to zaqar ?14:13
flaper87duanhf: that's correct14:14
duanhfthe latency would be 100ms in average..14:14
flaper87duanhf: have you seen this page? https://wiki.openstack.org/wiki/Zaqar/Performance/Pilot14:15
flaper87there's lot of room for improvement but I'm curious to know how close those numbers are to your use case14:15
*** dynarro has quit IRC14:15
flaper87duanhf: as vkmc mentioned, we'll be working on a presistent transport that should also improve the time spent on opening/closing connections with the server14:16
flaper87this transport will also have support for faster serialization protocols like capnproto/protobuf/msgpack14:16
flaper87we still have to pick 114:16
flaper87And the protocol we're targeting now is websocket14:17
vkmc^ that's something happening in K-1~14:17
duanhfflaper87: thanks for your info.  I will take look at the above info. for zaqar with mongoDB as backend, has it ready for production environment?14:19
duanhfvkmc: thanks!14:19
flaper87duanhf: both are production ready although the mongodb backend has been tested more than redis'14:19
vkmcduanhf, it is!14:19
duanhfflaper87: is there any webpage I can refer to for packaging the zaqar? (I am new to this area)14:21
flaper87duanhf: I don't think there's an ubuntu package but there's a f21 one: https://admin.fedoraproject.org/pkgdb/package/openstack-zaqar/14:22
duanhfflaper87: thanks! I will do some investigation on this and com back with questions afterwards...14:24
flaper87duanhf: please do, any feedback is very welcome and needed. Just FYI, we'll be working on notifications and an enhanced API, it won't difer much from the previous one but it's targeting to be lighter, cleaner and it'll also have notifications (as already mentioned)14:25
flaper87duanhf: thanks for stopping by14:26
*** sgotliv has joined #openstack-zaqar14:26
duanhfflaper87: nice job! and nice to know!14:27
*** duanhf has quit IRC14:29
*** mpanetta has joined #openstack-zaqar14:33
*** dynarro has joined #openstack-zaqar14:35
*** jchai_afk is now known as jchai14:40
*** dagnello has joined #openstack-zaqar14:44
*** ametts has joined #openstack-zaqar14:45
*** amitgandhinz has joined #openstack-zaqar14:49
openstackgerritFlavio Percoco proposed openstack/zaqar: Correctly stop functional servers  https://review.openstack.org/13423614:50
openstackgerritFlavio Percoco proposed openstack/zaqar: Used a pooled config for health  https://review.openstack.org/13423714:50
vkmco_o14:51
* flaper87 is in test-fixing mode14:53
openstackgerritFlavio Percoco proposed openstack/zaqar: DO NOT MERGE!  https://review.openstack.org/13423914:56
flaper87vkmc: ^ hope that commit message is clear enough :P14:56
vkmcLOL14:57
vkmcI'm curious14:57
vkmcwhy you removed pypy?14:58
flaper87vkmc: that's a workaround for a bug in pypy14:58
flaper87I wan't to know if that's been fixed14:58
flaper87and I don't have pypy installed14:59
vkmcremoving pypy is a workaround for a bug in pypy?14:59
vkmclol14:59
flaper87:D14:59
flaper87no no, I removed the specific configs for pypy14:59
flaper87pypy is still there14:59
flaper87specifically, I wanted to get rid of the --jit off14:59
vkmcoh yes, I see what you did there14:59
vkmcok ok14:59
vkmcit was fun to think that we could fix bugs like that though :P15:00
flaper87we'll, I'm about to fix sqlalchemy like that15:00
flaper87:P15:00
vkmchahaha15:00
flaper87git rm ........../storage/sqlalchemy15:00
vkmcrm -rf15:00
vkmc...15:00
vkmcjust in case15:00
vkmcwe should super mega document that15:01
vkmcthere are some people interested in SQL backends15:01
flaper87mmhh, I'm going to move it to an external repo15:02
*** dagnello has quit IRC15:02
flaper87stackforge15:02
vkmc+1 on that15:02
vkmcwe probably want to keep MongoDB and Redis in the codebase15:03
vkmcand other storage backends in external repos15:03
vkmcSQLAlchemy and future implementations I mean15:03
flaper87yup15:04
vkmcis there some benchmark for SQLAlchemy?15:05
flaper87dynarro: https://review.openstack.org/#/q/status:open+project:openstack/zaqar+branch:master+topic:bug/1383604,n,z15:05
flaper87vkmc: no benchmark is the best benchmark for it15:05
flaper87vkmc: jokes apart, there's not15:05
vkmcflaper87, we should do some benchmark15:05
flaper87vkmc: should we?15:06
vkmcto justify the deprecation15:06
vkmcya know15:06
flaper87:/15:06
flaper87we can't justify the deprecation using benchmarks if the implementation is not good15:06
vkmchmm15:06
flaper87people may argue saying: "Yeah but that's not how you use mysql"15:06
vkmcI see15:06
flaper87vkmc: I'm still a bit hesitant because sqlite is really useful for testing15:07
vkmcflaper87, but if that is the only reason we should move it to an external repo15:08
vkmcIMO15:08
vkmctested and ready for production backends in the main repo and the rest in external ones15:09
flaper87vkmc: yeah but that means that everyone willing to work on zaqar has to have either redis/mongodb installed to run the test suite15:11
flaper87I think that's something fair to ask15:11
vkmcflaper87, we are already asking for Mongo to run the test suite15:13
flaper87nope15:14
flaper87I mean, you have to explicitly enable it15:14
vkmcyeah15:14
flaper87otherwise it'll use sqlite15:14
vkmcit makes sense15:14
vkmcwell the same happens when configuring Zaqar15:14
vkmcit defaults to sqlite15:15
vkmchttps://github.com/openstack/zaqar/blob/master/zaqar/queues/bootstrap.py#L6115:15
flaper87right, the change is not *that* subtle15:16
vkmcyeah15:18
vkmcwe will have to work to make it happen15:18
vkmcdarn15:18
openstackgerritFlavio Percoco proposed openstack/zaqar-specs: Remove sqlalchemy from the code base  https://review.openstack.org/13424815:25
flaper87vkmc: ^15:25
vkmcits happening15:26
vkmcthx flaper8715:26
openstackgerritFlavio Percoco proposed openstack/zaqar-specs: Remove sqlalchemy from the code base  https://review.openstack.org/13424816:05
*** exploreshaifali has joined #openstack-zaqar16:15
openstackgerritDoraly Navarro proposed openstack/python-zaqarclient: Added i18n support  https://review.openstack.org/13365216:17
*** sgotliv has quit IRC16:17
vkmcexploreshaifali, https://wiki.gnome.org/OutreachProgramForWomen/2014/DecemberMarch#OpenStack16:20
vkmcexploreshaifali, looks like you are going for Zaqar :D16:20
exploreshaifalivkmc, yeah :)16:21
vkmcthats so greeeeeeeeeeeeeeeeeeat16:21
exploreshaifaliI had a discussion with flaper87 after that, regarding project16:21
exploreshaifaliso working16:21
vkmcok16:22
exploreshaifalivkmc, thanks a lot, you really helped me a lot16:22
vkmclet me know if something comes up with anything16:22
vkmcexploreshaifali, not a problem, I'm really happy you made it and that you will be working in a project like Zaqar16:23
exploreshaifaliyeah! looking forwarad to learn - hack - and lots of fun16:24
vkmc+116:24
vkmcyou are starting on December 9, right?16:25
exploreshaifali:)16:25
exploreshaifaliofficially intership will start from 9-Dec16:26
exploreshaifalibut obviously I am not going to sit still till that16:26
vkmcgo exploreshaifali \o/16:27
exploreshaifali\o/16:27
*** sgotliv has joined #openstack-zaqar16:29
*** dynarro has quit IRC16:33
*** sgotliv has quit IRC16:47
*** dynarro has joined #openstack-zaqar16:50
flaper87https://hacksummit.org/16:50
vkmcHTML/CSS are cataloged as languages there ^16:53
* vkmc trolls flaper87 16:55
flaper87LOOOOOOOOOOOOOOOOOOOOOL16:57
flaper87to be fair it says: Featuring programming language creators, open-source contributors, and thought leaders16:58
vkmcso?16:58
vkmclol16:58
flaper87It's ambiguous16:58
vkmcpoor cpallares... you told her that HTML was not a language16:59
vkmcshame on you16:59
flaper87you don't know if they're cataloguing html as a programing language or as an open-source project16:59
flaper87or just leader16:59
flaper87:P16:59
vkmchahaha16:59
flaper87I'd have probably invited a different group of folks but well17:00
vkmcit looks really good, thanks for sharing17:01
*** sgotliv has joined #openstack-zaqar17:03
*** X019 has joined #openstack-zaqar17:12
exploreshaifaliyes it looks good, thanks for sharing17:18
*** sgotliv has quit IRC17:22
*** sriram has quit IRC17:29
*** openstackgerrit has quit IRC17:34
*** openstackgerrit has joined #openstack-zaqar17:34
*** exploreshaifali has quit IRC17:35
*** dynarro has quit IRC17:37
*** sriram has joined #openstack-zaqar17:37
*** achanda has joined #openstack-zaqar17:37
*** exploreshaifali has joined #openstack-zaqar17:41
*** achanda has quit IRC17:52
exploreshaifaliflaper87, awesome wrote in mentoring-others-and-yourself17:56
*** achanda has joined #openstack-zaqar17:56
*** openstackgerrit has quit IRC18:03
*** openstackgerrit has joined #openstack-zaqar18:04
*** sgotliv has joined #openstack-zaqar18:21
*** davideagnello has joined #openstack-zaqar18:25
*** X019 has quit IRC18:33
*** X019 has joined #openstack-zaqar18:46
*** openstackgerrit has quit IRC18:49
*** openstackgerrit has joined #openstack-zaqar18:49
*** davideagnello has quit IRC18:54
*** achanda has quit IRC18:58
*** achanda has joined #openstack-zaqar18:59
*** achanda has quit IRC19:07
*** openstackgerrit has quit IRC19:18
*** openstackgerrit has joined #openstack-zaqar19:18
* vkmc lurks19:23
*** exploreshaifali has quit IRC19:25
*** achanda has joined #openstack-zaqar19:26
*** dynarro has joined #openstack-zaqar20:00
*** openstackgerrit has quit IRC20:04
*** openstackgerrit has joined #openstack-zaqar20:04
*** davideagnello has joined #openstack-zaqar20:12
*** dynarro has quit IRC20:20
*** exploreshaifali has joined #openstack-zaqar20:26
*** achanda has quit IRC20:47
*** openstackgerrit has quit IRC21:19
*** openstackgerrit has joined #openstack-zaqar21:19
*** amitgandhinz has quit IRC21:46
*** achanda has joined #openstack-zaqar21:48
*** achanda has quit IRC21:52
*** achanda has joined #openstack-zaqar21:52
*** amitgandhinz has joined #openstack-zaqar21:57
*** achanda_ has joined #openstack-zaqar22:08
*** achanda has quit IRC22:12
*** amitgandhinz has quit IRC22:37
*** mpanetta has quit IRC22:40
*** sriram has quit IRC22:48
*** jchai has quit IRC22:57
*** ametts has quit IRC23:07
*** exploreshaifali has quit IRC23:46
*** amitgandhinz has joined #openstack-zaqar23:48
*** amitgandhinz has quit IRC23:52
« Wednesday, 2014-11-12 Index Friday, 2014-11-14 »

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!