Friday, 2014-06-06

*** oz_akan_ has quit IRC00:00
*** oz_akan__ has joined #openstack-marconi00:13
*** malini_afk is now known as malini00:58
peoplemergekgriffs|afk: flaper87|afk: sorry for slow uptake on x-msgpack ticket, day job demands ;)00:59
*** malini is now known as malini_afk01:06
*** oz_akan__ has quit IRC01:14
*** oz_akan_ has joined #openstack-marconi01:14
*** oz_akan_ has quit IRC01:18
*** reed has quit IRC01:36
*** rossk has quit IRC01:43
*** nosnos has joined #openstack-marconi01:46
*** oz_akan_ has joined #openstack-marconi02:15
*** oz_akan_ has quit IRC02:19
*** prashanthr_ has joined #openstack-marconi02:24
*** prashanthr_ has quit IRC03:13
*** nosnos has quit IRC03:13
*** nosnos has joined #openstack-marconi03:13
*** oz_akan_ has joined #openstack-marconi03:16
*** nosnos has quit IRC03:17
*** oz_akan_ has quit IRC03:20
*** prashanthr_ has joined #openstack-marconi03:21
*** nosnos has joined #openstack-marconi03:31
*** nosnos has quit IRC03:39
*** nosnos has joined #openstack-marconi03:40
*** nosnos has quit IRC04:00
*** haomaiwang has joined #openstack-marconi04:01
*** vkmc has quit IRC04:13
*** oz_akan_ has joined #openstack-marconi04:16
*** haomaiwang has quit IRC04:17
*** haomaiwang has joined #openstack-marconi04:18
*** oz_akan_ has quit IRC04:21
*** nosnos has joined #openstack-marconi04:21
*** prashanthr_ has quit IRC04:22
*** haomaiw__ has joined #openstack-marconi04:34
*** haomaiwang has quit IRC04:36
*** prashanthr_ has joined #openstack-marconi04:55
*** AAzza_afk has quit IRC04:56
*** flwang has quit IRC05:03
*** AAzza_afk has joined #openstack-marconi05:03
*** AAzza_afk is now known as AAzza05:03
*** flwang has joined #openstack-marconi05:05
*** torgomatic has quit IRC05:15
*** wirehead_ has quit IRC05:15
*** mwagner_lap has quit IRC05:15
*** fifieldt_ has quit IRC05:15
*** ChanServ has quit IRC05:15
*** ovorp has quit IRC05:15
*** peoplemerge has quit IRC05:15
*** rektide has quit IRC05:15
*** ekarlso has quit IRC05:15
*** flaper87|afk has quit IRC05:15
*** Alex_Gaynor has quit IRC05:15
*** malini_afk has quit IRC05:15
*** dmitryme has quit IRC05:15
*** mgibert has quit IRC05:15
*** boris-42 has quit IRC05:15
*** sebasmagri has quit IRC05:15
*** prashanthr_ has quit IRC05:15
*** AAzza has quit IRC05:15
*** mkoderer has quit IRC05:15
*** stannie has quit IRC05:15
*** tmu has quit IRC05:15
*** jay-atl has quit IRC05:15
*** jraim has quit IRC05:15
*** VeggieMeat has quit IRC05:15
*** megan_w|afk has quit IRC05:15
*** openstackgerrit has quit IRC05:15
*** oz_akan has joined #openstack-marconi05:17
*** oz_akan has quit IRC05:21
*** AAzza has joined #openstack-marconi05:28
*** prashanthr_ has joined #openstack-marconi05:28
*** ovorp has joined #openstack-marconi05:28
*** openstackgerrit has joined #openstack-marconi05:28
*** jay-atl has joined #openstack-marconi05:28
*** malini_afk has joined #openstack-marconi05:28
*** stannie has joined #openstack-marconi05:28
*** mkoderer has joined #openstack-marconi05:28
*** jraim has joined #openstack-marconi05:28
*** mwagner_lap has joined #openstack-marconi05:28
*** fifieldt_ has joined #openstack-marconi05:28
*** torgomatic has joined #openstack-marconi05:28
*** wirehead_ has joined #openstack-marconi05:28
*** peoplemerge has joined #openstack-marconi05:28
*** rektide has joined #openstack-marconi05:28
*** ekarlso has joined #openstack-marconi05:28
*** boris-42 has joined #openstack-marconi05:28
*** mgibert has joined #openstack-marconi05:28
*** flaper87|afk has joined #openstack-marconi05:28
*** sebasmagri has joined #openstack-marconi05:28
*** Alex_Gaynor has joined #openstack-marconi05:28
*** ChanServ has joined #openstack-marconi05:28
*** dmitryme has joined #openstack-marconi05:28
*** megan_w|afk has joined #openstack-marconi05:28
*** VeggieMeat has joined #openstack-marconi05:28
*** tmu has joined #openstack-marconi05:28
*** dickson.freenode.net sets mode: +oo flaper87|afk ChanServ05:28
*** torgomatic has quit IRC05:28
*** wirehead_ has quit IRC05:28
*** mwagner_lap has quit IRC05:28
*** fifieldt_ has quit IRC05:28
*** ChanServ has quit IRC05:28
*** ovorp has quit IRC05:28
*** peoplemerge has quit IRC05:28
*** rektide has quit IRC05:28
*** ekarlso has quit IRC05:28
*** flaper87|afk has quit IRC05:28
*** Alex_Gaynor has quit IRC05:28
*** malini_afk has quit IRC05:28
*** dmitryme has quit IRC05:28
*** mgibert has quit IRC05:28
*** boris-42 has quit IRC05:28
*** sebasmagri has quit IRC05:28
*** prashanthr_ has quit IRC05:28
*** AAzza has quit IRC05:28
*** mkoderer has quit IRC05:28
*** stannie has quit IRC05:28
*** tmu has quit IRC05:28
*** jay-atl has quit IRC05:28
*** jraim has quit IRC05:28
*** VeggieMeat has quit IRC05:28
*** megan_w|afk has quit IRC05:28
*** openstackgerrit has quit IRC05:28
*** AAzza has joined #openstack-marconi05:34
*** prashanthr_ has joined #openstack-marconi05:34
*** ovorp has joined #openstack-marconi05:34
*** openstackgerrit has joined #openstack-marconi05:34
*** jay-atl has joined #openstack-marconi05:34
*** malini_afk has joined #openstack-marconi05:34
*** stannie has joined #openstack-marconi05:34
*** mkoderer has joined #openstack-marconi05:34
*** jraim has joined #openstack-marconi05:34
*** mwagner_lap has joined #openstack-marconi05:34
*** fifieldt_ has joined #openstack-marconi05:34
*** torgomatic has joined #openstack-marconi05:34
*** wirehead_ has joined #openstack-marconi05:34
*** peoplemerge has joined #openstack-marconi05:34
*** rektide has joined #openstack-marconi05:34
*** ekarlso has joined #openstack-marconi05:34
*** boris-42 has joined #openstack-marconi05:34
*** mgibert has joined #openstack-marconi05:34
*** flaper87|afk has joined #openstack-marconi05:34
*** sebasmagri has joined #openstack-marconi05:34
*** Alex_Gaynor has joined #openstack-marconi05:34
*** ChanServ has joined #openstack-marconi05:34
*** dmitryme has joined #openstack-marconi05:34
*** megan_w|afk has joined #openstack-marconi05:34
*** VeggieMeat has joined #openstack-marconi05:34
*** tmu has joined #openstack-marconi05:34
*** dickson.freenode.net sets mode: +oo flaper87|afk ChanServ05:34
*** goodes has joined #openstack-marconi05:43
*** haomaiw__ has quit IRC06:07
*** haomaiwang has joined #openstack-marconi06:08
*** haomai___ has joined #openstack-marconi06:10
*** haomaiwang has quit IRC06:14
*** oz_akan_ has joined #openstack-marconi06:17
*** oz_akan_ has quit IRC06:21
*** goodes has quit IRC06:32
*** haomai___ has quit IRC07:16
*** haomaiwang has joined #openstack-marconi07:16
*** oz_akan_ has joined #openstack-marconi07:18
*** goodes has joined #openstack-marconi07:22
*** oz_akan_ has quit IRC07:23
*** haomai___ has joined #openstack-marconi07:31
*** haomaiwang has quit IRC07:34
*** goodes has quit IRC07:41
*** prashanthr_ has quit IRC08:36
*** prashanthr_ has joined #openstack-marconi08:46
*** oz_akan_ has joined #openstack-marconi09:20
*** oz_akan_ has quit IRC09:24
*** prashanthr_ has quit IRC09:37
*** flaper87|afk is now known as flaper8709:39
*** goodes has joined #openstack-marconi10:09
*** goodes has left #openstack-marconi10:26
*** flaper87 is now known as flaper87|afk10:31
*** oz_akan_ has joined #openstack-marconi10:38
*** oz_akan_ has quit IRC10:42
*** nosnos has quit IRC10:45
*** shivam_ has quit IRC11:04
*** fifieldt_ has quit IRC11:23
*** fifieldt_ has joined #openstack-marconi11:24
*** oz_akan_ has joined #openstack-marconi11:39
*** mwagner_lap has quit IRC11:42
*** oz_akan_ has quit IRC11:43
*** vkmc has joined #openstack-marconi11:48
*** vkmc has quit IRC11:48
*** vkmc has joined #openstack-marconi11:48
*** jamie_h has joined #openstack-marconi11:55
openstackgerritAlex Bettadapur proposed a change to openstack/marconi: Decoupled Unit Tests  https://review.openstack.org/9753412:00
*** haomai___ has quit IRC12:01
*** haomaiwang has joined #openstack-marconi12:01
*** haomaiw__ has joined #openstack-marconi12:07
*** haomaiwang has quit IRC12:11
*** abettadapur has joined #openstack-marconi12:32
*** sriram has joined #openstack-marconi12:39
*** oz_akan_ has joined #openstack-marconi12:40
*** shivamshukla has joined #openstack-marconi12:41
*** sriram has quit IRC12:42
*** sriram has joined #openstack-marconi12:42
*** oz_akan_ has quit IRC12:44
*** oz_akan_ has joined #openstack-marconi12:49
*** oz_akan_ has quit IRC12:56
*** oz_akan_ has joined #openstack-marconi12:57
*** jchai has joined #openstack-marconi12:58
*** malini_afk is now known as malini12:59
*** malini has left #openstack-marconi13:02
sriramgood morning :)13:02
abettadapurgood morning. how are you today?13:03
vkmcmorning sriram, abettadapur :)13:03
sriramabettadapur: meh, not enough sleep again :/13:04
sriramvkmc: good morning! :)13:04
abettadapursriram: up too late?13:04
sriramabettadapur: yeah, needed to take care of some stuff.13:04
vkmcsriram, boo, hope you can take the weekend to recover all that sleep13:06
sriramvkmc: oh yes! I definitely plan to :)13:07
*** ykaplan has joined #openstack-marconi13:15
*** Obulpathi has joined #openstack-marconi13:37
*** alcabrera|afk is now known as alcabrera13:38
*** jay-atl has quit IRC13:54
*** AAzza is now known as AAzza_afk13:58
peoplemergeg'morning all!14:00
*** ykaplan has quit IRC14:01
vkmcmorning peoplemerge14:02
vkmc!14:02
*** balajiiyer has joined #openstack-marconi14:03
alcabreragood morning, everyone. :)14:03
vkmcgood morning alcabrera :)14:05
vkmchappy friday \o/14:05
alcabrerayay!14:06
alcabreraheya, vkmc. :)14:06
peoplemergeyay14:07
alcabreraoh yeah14:08
alcabreraso this is a thing: http://dogeon.org/14:08
alcabreraapplication/dogeon14:08
alcabrera*content-type: application/dogeon14:08
peoplemergelol14:10
vkmclol14:11
vkmclet's remove json and use it instead14:11
*** AAzza_afk is now known as AAzza14:11
sriramalcabrera: hahaa14:11
alcabrerasuch "ttl" is 100 next "body" is such "implemented" is "all_in_doge" wow wow  // message envelope of the future marconi14:13
abettadapuralcabrera: http://zachbruggeman.me/dogescript/14:22
alcabreraoh my14:23
alcabreraJS what I needed, abettadapur14:23
abettadapur:d14:23
abettadapur:D14:23
abettadapurmy favorite is the for loop14:23
abettadapurmuch very i as 1 next i smaller 3 next i more 114:24
alcabrerahahaha14:24
alcabrerashh this is more succinct than JS at times, much impressed14:25
*** prashanthr_ has joined #openstack-marconi14:31
*** jamie_h has quit IRC14:51
*** jamie_h has joined #openstack-marconi14:51
*** alcabrera is now known as alcabrera|afk14:52
*** prashanthr_ has left #openstack-marconi14:55
*** jamie_h has quit IRC15:07
*** alcabrera|afk is now known as alcabrera15:09
*** jamie_h has joined #openstack-marconi15:11
AAzzaalcabrera: btw, i think i will absent next week, due to move from Norway to Ukraine and finishing all leftovers for master thesis in Ukraine. Probably will appear from time to time, but not promise to do another commit)15:17
alcabreraAAzza: thanks for letting me know, and I hope your move is a safe one!15:18
alcabrerabest of luck on the master's thesis. :)15:18
*** kgriffs|afk is now known as kgriffs15:19
AAzzaalcabrera: thanks, will do my best. if flaper87|afk will search for me, let him know)15:19
alcabrerawill do15:19
alcabreraI'll pass this along and keep it in mind for next week15:19
AAzzaalcabrera: :) anyway, I will try to tell him on Monday/Tuesday, so you can not to reserve too much space in your memory for this)15:22
AAzzaalcabrera: have nice weekends)15:22
*** openstackgerrit has quit IRC15:22
alcabreraAAzza: thanks, and you too! :D15:22
* alcabrera caches AAzza reminder -- 128 bytes consumed15:23
*** ykaplan has joined #openstack-marconi15:28
*** openstackgerrit has joined #openstack-marconi15:29
*** cpallares has joined #openstack-marconi15:31
*** jchai is now known as jchai_afk15:45
*** jay-atl has joined #openstack-marconi15:47
*** jchai_afk is now known as jchai15:47
*** openstackgerrit has quit IRC15:53
*** jchai is now known as jchai_afk15:59
*** reed has joined #openstack-marconi16:02
*** ykaplan has quit IRC16:07
*** rwsu has joined #openstack-marconi16:21
vkmchey alcabrera can I pick your brain about connection handling with a AMQP?16:25
*** jchai_afk is now known as jchai16:25
alcabreravkmc: sure thing16:26
vkmcalcabrera, current supported storage backends require a connection step to start interacting16:28
vkmcalcabrera, in this case, I'm not sure if we can control the broker status16:29
alcabrerabroker status, vkmc? What do you mean by that?16:30
vkmcalcabrera, if the broker is up and running you can send and receive messages directly, but if its not a connection error will be raised16:30
alcabreraah16:30
alcabreraso then16:31
vkmcthe broker is the server in AMQP, we only can manage the client16:31
alcabrerathat's right16:31
alcabrerawhat if we use an auto-reconnect model16:31
alcabrerawith exponential backoff16:31
alcabreramarconi-server side?16:32
vkmchow would that be?16:32
alcabreraif the broker is down, we can hope it won't be down for more than... say a minute?16:32
alcabrerawe attempt to initiate a connection16:32
alcabreraif it succeeds, we continue16:32
vkmcsounds good16:32
alcabreraif it fails, we wait and retry a few times16:32
alcabrerait's how we handle mongodb, I believe16:32
alcabrerafor all operations16:32
vkmcI think so too yeah16:33
alcabreracool, but to circle around to your initial question16:33
alcabrerawe have no control of the broker status. :)16:33
vkmcnice16:33
vkmcand regarding the client16:34
vkmcsince it's a library I not sure if it makes sense to have an is_alive function16:35
*** mwagner_lap has joined #openstack-marconi16:35
vkmcbut our API interface has one16:35
alcabrerahmmm16:36
alcabreraif it is possible to detect whether the amqp connection/broker is still there16:36
vkmchttps://github.com/openstack/marconi/blob/master/marconi/queues/storage/base.py#L6416:36
alcabreraI think it makes sense16:36
*** openstackgerrit has joined #openstack-marconi16:36
alcabrerae.g., if amqp_is_still_alive -> True else False16:36
alcabreraoperators love this functionality, if we can provide it16:36
vkmcof course16:36
vkmcI'll check that out then16:37
alcabrerawith mongodb, it's implemented by sending a ping command to the storage node16:37
alcabreraif that helps ^16:37
vkmcit does, I think that behaves similarly here16:38
alcabreracool16:40
alcabreraany other thoughts, vkmc? :)16:40
vkmcthanks alcabrera16:40
vkmcno :)16:41
alcabreraalright, thanks vkmc! :D16:42
*** balajiiyer has quit IRC17:03
*** oz_akan_ has quit IRC17:09
*** oz_akan_ has joined #openstack-marconi17:10
*** oz_akan_ has quit IRC17:14
*** balajiiyer has joined #openstack-marconi17:17
*** balajiiyer1 has joined #openstack-marconi17:19
*** balajiiyer has quit IRC17:21
kgriffsfolks, I've got to run but I'll check back in a couple hours.17:23
kgriffskeep calm and message on17:23
kgriffs:D17:23
*** stannie has quit IRC17:24
*** kgriffs is now known as kgriffs|afk17:24
*** AAzza is now known as AAzza_afk17:27
*** mwagner_lap has quit IRC17:31
vkmchaha +1 kgriffs|afk17:32
sriramalcabrera: hey, could you have a look at https://review.openstack.org/#/c/97875/2?17:54
srirammarconi-bench is blocked due to this.17:55
*** haomaiw__ has quit IRC17:59
*** haomaiwa_ has joined #openstack-marconi18:00
alcabrerasriram: sure thing!18:00
alcabreraI'll give it a review in 10m. :)18:00
sriramthanks!18:00
alcabrerasriram: +218:05
*** oz_akan_ has joined #openstack-marconi18:06
sriramthanks alcabrera! :)18:07
sriramflaper87|afk, kgriffs|afk: https://review.openstack.org/#/c/97875/218:09
*** cpallares has quit IRC18:23
*** balajiiyer1 has quit IRC18:25
*** jamie_h has quit IRC18:34
*** jamie_h has joined #openstack-marconi18:41
*** haomaiwa_ has quit IRC18:47
*** haomaiwang has joined #openstack-marconi18:47
*** jamie_h_ has joined #openstack-marconi18:48
*** oz_akan_ has quit IRC18:48
*** jamie_h has quit IRC18:48
*** oz_akan_ has joined #openstack-marconi18:49
tjanczuk_vkmc: What are you planning to do about listing queues and operations on queues in general in AMQP 1.0? As far as I know AMQP itself does not support listing queues. In case of Rabbit it has a separate HTTP-based management API that allows listing queues.18:50
vkmctjanczuk_, hi!18:55
vkmctjanczuk_, well, queues are not an entity in AMQP 1.018:56
vkmctjanczuk_, they are just message attributes18:56
vkmctjanczuk_, so queue operations shouldn't be available to the user18:57
*** balajiiyer has joined #openstack-marconi18:57
*** abettadapur has quit IRC19:03
*** jay-atl has quit IRC19:14
tjanczuk_vkmc: so the AMQP 1.0 driver would not support any of the queue HTTP APIs (create/list/delete)? I think we are getting to the point where the intersection of the HTTP APIs supported by all drivers is only going to be message publish/mesasge receive ;)19:15
*** kgriffs|afk is now known as kgriffs19:20
sriramkgriffs: ping, could you have a look at https://review.openstack.org/#/c/97875/219:26
kgriffsyep19:26
sriramthanks kgriffs!19:26
sriramI have started work on conductor, i'm launching multi-processed subprocesses from the conductor for both the consumer and the producer.19:28
kgriffssriram: ok, I only have one nit19:29
kgriffsand I blame HTTP, not you19:29
sriramoh, what is it?19:29
kgriffsor, whoever first decided to implement authentication over HTTP19:30
kgriffs:p19:30
kgriffs401 Unauthorized *actually* means unauthenticated19:30
sriramyeah..19:30
kgriffsbasically, 403 should have been "Unauthorized"19:31
kgriffsand 401 should have been "Unauthenticated"19:31
alcabreragit blame http19:31
kgriffsanyway, what do you think about renaming the UnAuthorizedError exception to UnauthenticatedError?19:32
kgriffswe'd better leave "ForbiddenError" alone in any case, since changing it would only cause more confusion19:33
sriramhmm, sure I can but wont it be non-uniform?19:33
kgriffsgood point. hmm.19:33
kgriffswait... I got it.19:33
kgriffsHow about "AuthError"19:34
kgriffshmm, but then you still have forbidden19:34
kgriffsautherror sounds more like a generalization of the two...19:34
* kgriffs continues thinking19:35
sriramyeah, I think it might be better the way it is.19:35
sriramwhatever else we do, would be some middleground between our planes of reasoning and the HTTP standard.19:36
kgriffsyep19:36
kgriffs<sigh>19:36
sriramwe should maybe have a petition for better HTTP standards soon :)19:37
kgriffssriram: what do you think about adding a human-friendly description string to each error in a followup patch?19:37
sriramkgriffs: sure19:38
sriramI'll do that. :)19:38
srirambrb19:38
kgriffsWe would need to keep the description a little generic, since these errors will eventually be used for non-HTTP transport (be it websocket or something else)19:38
*** sriram is now known as sriram_afk19:38
*** ykaplan has joined #openstack-marconi19:39
*** sriram_afk is now known as sriram19:39
sriramkgriffs: good point!19:40
kgriffsok, found one more nit19:40
sriramit makes sense for non-HTTP transport.19:40
kgriffsUnAuthorized ---> Unauthorized19:40
kgriffsotherwise, LGTM19:40
kgriffsbtw, is there a test somewhere that ensures these errors are thrown?19:41
kgriffss/thrown/raised19:41
sriramI looked around and didnt find anything that exactly verifies.19:41
sriramlet me recheck.19:41
kgriffsI guess you could mock http.Client and do a test that iterates through HttpTransport.http_to_marconi, ensuring that when the client returns each status, the corresponding error class is raised19:43
sriramalright, I'll make those changes.19:45
vkmctjanczuk_, yes it will require *a lot* of polishing19:53
vkmctjanczuk_, flaper87 proposed some time ago the concept of topics19:53
kgriffsvkmc: right. I think the central idea was that a topic would be less of a concrete resource than a queue. As far as the implementation goes, they are already very light weight and we are adding lazy queue creation (automatically creating a queue when a message is first posted to it), so not being able to "delete" queues should be OK.19:56
kgriffsexcept19:56
kgriffsin the case of the mongo/redis drivers, we need to ensure that a queue record is really just a name attached to each message, and we only keep track of a separate "queue" record if there is metadata19:57
vkmckgriffs, makes sense20:01
*** jamie_h_ has quit IRC20:03
*** balajiiyer has quit IRC20:10
*** ykaplan has quit IRC20:31
*** sriram has quit IRC20:34
*** kgriffs is now known as kgriffs|afk20:36
*** kgriffs|afk is now known as kgriffs20:41
*** alcabrera is now known as alcabrera|afk20:42
*** jchai has quit IRC20:42
*** kgriffs is now known as kgriffs|afk20:42
*** Obulpathi has quit IRC21:10
*** kgriffs|afk is now known as kgriffs21:22
* peoplemerge is hoping to write some python today21:33
*** oz_akan_ has quit IRC21:56
*** oz_akan_ has joined #openstack-marconi21:56
*** flwang has quit IRC21:59
*** haomaiwang has quit IRC22:01
*** oz_akan_ has quit IRC22:06
*** flwang has joined #openstack-marconi22:29
openstackgerritKurt Griffiths proposed a change to openstack/marconi: fix: Checking whether queue exists adds latency  https://review.openstack.org/6797823:41
*** kgriffs is now known as kgriffs|afk23:55

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!