Thursday, 2013-10-17

« Wednesday, 2013-10-16 Index Friday, 2013-10-18 »
*** nosnos has joined #openstack-marconi00:34
*** oz_akan_ has joined #openstack-marconi00:59
*** kgriffs_afk is now known as kgriffs01:09
*** reed has quit IRC01:25
*** amitgandhi has quit IRC01:26
*** kgriffs is now known as kgriffs_afk01:30
*** vkmc has quit IRC01:34
*** oz_akan_ has quit IRC01:45
*** oz_akan_ has joined #openstack-marconi01:46
*** oz_akan__ has joined #openstack-marconi03:16
*** oz_akan_ has quit IRC03:19
*** oz_akan__ has quit IRC03:20
*** oz_akan__ has joined #openstack-marconi03:22
*** oz_akan__ has quit IRC03:40
*** oz_akan_ has joined #openstack-marconi04:51
*** reed has joined #openstack-marconi04:52
*** oz_akan_ has quit IRC04:55
*** reed has quit IRC05:27
*** flaper87|afk is now known as flaper8706:38
openstackgerritFlavio Percoco proposed a change to openstack/python-marconiclient: Implement HTTP Transport  https://review.openstack.org/4978807:16
openstackgerritFlavio Percoco proposed a change to openstack/python-marconiclient: Implement queue's API methods  https://review.openstack.org/5063807:16
openstackgerritFlavio Percoco proposed a change to openstack/python-marconiclient: Pass keywords to the request initialization  https://review.openstack.org/5056707:16
openstackgerritFlavio Percoco proposed a change to openstack/python-marconiclient: Add list of required fields to the API definition  https://review.openstack.org/5185007:16
*** dafter has joined #openstack-marconi07:53
*** yassine has joined #openstack-marconi08:05
*** dafter has quit IRC09:17
*** dafter has joined #openstack-marconi09:18
*** dafter has quit IRC09:19
*** dafter has joined #openstack-marconi09:31
*** dafter has quit IRC09:52
*** dafter has joined #openstack-marconi09:53
*** dafter has quit IRC09:57
*** dafter has joined #openstack-marconi09:57
*** dafter has quit IRC10:03
*** tvb|afk has joined #openstack-marconi10:06
*** tvb|afk has quit IRC10:06
*** tvb|afk has joined #openstack-marconi10:07
*** tvb|afk has quit IRC10:07
*** tvb|afk has joined #openstack-marconi10:07
openstackgerritFlavio Percoco proposed a change to openstack/python-marconiclient: Implement queue's API methods  https://review.openstack.org/5063810:10
openstackgerritFlavio Percoco proposed a change to openstack/python-marconiclient: Add list of required fields to the API definition  https://review.openstack.org/5185010:10
*** tvb|afk has quit IRC10:11
*** dafter has joined #openstack-marconi10:26
openstackgerritA change was merged to openstack/marconi: fix(queues): Global config used everywhere  https://review.openstack.org/5170510:34
*** flaper87 is now known as flaper87|afk10:51
*** tedross has joined #openstack-marconi11:36
*** nosnos has quit IRC11:48
*** nosnos has joined #openstack-marconi11:49
*** nosnos has quit IRC11:54
*** flaper87|afk is now known as flaper8712:41
*** oz_akan_ has joined #openstack-marconi13:07
*** oz_akan_ has quit IRC13:07
*** oz_akan_ has joined #openstack-marconi13:08
*** ayoung has quit IRC13:22
openstackgerritFlavio Percoco proposed a change to openstack/python-marconiclient: Implement queue's API methods  https://review.openstack.org/5063813:34
openstackgerritFlavio Percoco proposed a change to openstack/python-marconiclient: Add list of required fields to the API definition  https://review.openstack.org/5185013:34
openstackgerritFlavio Percoco proposed a change to openstack/python-marconiclient: Bootstrap Messages support  https://review.openstack.org/5238913:39
*** kgriffs_afk is now known as kgriffs13:45
openstackgerritA change was merged to openstack/marconi: Use stevedore instead of importutils  https://review.openstack.org/5154013:51
*** jcru has joined #openstack-marconi13:53
*** jergerber has joined #openstack-marconi14:04
*** amitgandhi has joined #openstack-marconi14:06
*** amitgandhi has quit IRC14:12
flaper87kgriffs: good morning14:12
*** amitgandhi has joined #openstack-marconi14:13
fvolleroflaper87: morning to you...14:13
fvolleroflaper87: https://cloud.sugnu.eu/public.php?service=files&t=c7177b1199aa7f95380be717463b82fe14:13
kgriffsgood morning/afternoon!14:14
kgriffsLOL14:14
flaper87fvollero: you seriously don't want kids, do you?14:15
flaper87:D14:15
flaper87kgriffs: hot news, the config patch landed14:15
flaper87we should get the other 2 merged as well14:15
flaper87but there's one with a -114:15
fvolleroflaper87: LOL :) I already gave to manu the shipment... i'll take a picture just for you to see14:16
kgriffsflaper87: yeah, saw that. glad to have that monster patch wrapped up!14:16
flaper87kgriffs: also, it would be really nice if you could review the client patches as well!14:16
flaper87fvollero: :D GRAZIE!!!!14:16
kgriffsflaper87: sure thing14:17
kgriffsbtw, needs rebase: https://review.openstack.org/#/c/51541/14:17
kgriffsI'd like to get those 2 pipeline patches of yours merged in and rebase the sharding on them before addressing feedback14:18
fvolleroflaper87: check again that link14:18
flaper87kgriffs: let me do that right away14:18
*** ayoung has joined #openstack-marconi14:18
kgriffsrock on14:18
flaper87fvollero: oooook, that looks better!14:18
fvolleroflaper87: :)14:18
flaper87fvollero: thanks buddy! Seriously! :)14:18
fvolleroflaper87: you're welcome :)14:19
openstackgerritFlavio Percoco proposed a change to openstack/marconi: Return a consumer function instead of consuming  https://review.openstack.org/5154114:22
flaper87kgriffs: ^14:22
*** dafter has quit IRC14:23
*** dafter has joined #openstack-marconi14:23
*** dafter has quit IRC14:23
*** dafter has joined #openstack-marconi14:23
*** dafter has quit IRC14:28
*** dafter has joined #openstack-marconi14:41
*** dafter has quit IRC14:41
*** dafter has joined #openstack-marconi14:41
openstackgerritA change was merged to openstack/marconi: Return a consumer function instead of consuming  https://review.openstack.org/5154114:58
*** malini_afk is now known as malini15:15
*** vkmc has joined #openstack-marconi15:18
*** vkmc has quit IRC15:18
*** vkmc has joined #openstack-marconi15:18
openstackgerritMalini Kamalambal proposed a change to openstack/marconi: Validation for messages returned by queue/stats  https://review.openstack.org/5099515:24
maliniflaper87: ping15:33
flaper87malini: pong15:34
flaper87malini: gooood morning15:34
flaper87how are you doing?15:34
malinigood..how are you?15:34
*** etoews1 has joined #openstack-marconi15:34
flaper87malini: great, thanks! :D15:35
maliniI was just looking at the wrong hreg bug you reported..Between this & the negative age in stats bug, I think we need to include more validation of response bodies in our tests15:35
etoews1i'm looking at the response for get queue stats. https://wiki.openstack.org/wiki/Marconi/specs/api/v1#Get_Queue_Stats15:35
etoews1is this a complete example?15:36
etoews1could there be something else at the same level as the messages key?15:36
etoews1will messages always (in v1) be the only top level key?15:36
maliniflaper87: I am debating between adding those validations in functional tests vs unit tests15:37
maliniyou have any thoughts?15:37
kgriffsetoews1: I think that example is correct. Let me verify.15:38
malinietoews1: with the current implementation messages is the only top level key15:38
flaper87malini: I think unit tests would work in that case15:38
*** yassine has quit IRC15:39
etoews1kgriffs. by correct do you mean complete?15:39
flaper87Since it is not 'endpoint' related but API, it can be tested using unittests15:39
etoews1i'm just wondering if there could be anything else in there.15:39
kgriffsyes, correct and complete15:39
etoews1kgriffs malini: thanks for that info.15:39
kgriffsin the future there may be, but not now. extensions could also add stuff in there, of course15:40
maliniflaper87: thanks!15:40
etoews1right.15:40
flaper87malini: np :)15:40
kgriffsetoews1: rock on15:41
openstackgerritA change was merged to openstack/marconi: Validation for messages returned by queue/stats  https://review.openstack.org/5099515:41
kgriffsbtw, we are tracking feedback on the API, so please let us know if you come across anything not already listed15:41
kgriffshttps://wiki.openstack.org/wiki/Marconi/specs/api/next15:41
openstackgerritKurt Griffiths proposed a change to openstack/marconi: feat: Storage sharding foundation  https://review.openstack.org/5043715:42
openstackgerritKurt Griffiths proposed a change to openstack/marconi: fix(bootstrap): Logging CLI options don't work  https://review.openstack.org/5221615:42
kgriffsflaper87: btw, I was just thinking, it would be cool if we passed the config object to stages when they are loaded15:44
flaper87kgriffs: yeah, I thought about that too and forgot to mention it in the commit summary. The reason why I didn't go down that road is because we don't have a Stage baseclass and I stuck to YAGNI. I see how that can be useful, though.15:46
flaper87I'm making some other changes to the pipeline (backward compatible, I guess)15:47
flaper87I can add that if we agree15:47
*** kgriffs is now known as kgriffs_afk15:50
*** kgriffs1 has joined #openstack-marconi15:51
*** ChanServ sets mode: +o kgriffs115:51
kgriffs1I think it would be fine to add a base class. Seems like having conf available would encourage stages to not rely on global conf15:53
flaper87kgriffs1: +115:54
flaper87kgriffs1: man, it's weird to see your non-green nick :D15:54
*** kgriffs1 has left #openstack-marconi15:55
*** kgriffs_afk is now known as kgriffs15:55
etoews1in get queue stats, what is the unit of messages.oldest.age?15:57
*** kgriffs is now known as kgriffs_afk15:57
*** dafter has quit IRC15:58
*** kgriffs has joined #openstack-marconi15:58
*** ChanServ sets mode: +o kgriffs15:59
etoews1in get queue stats, to confirm, is messages.oldest.created the date/time of the oldest created message?16:00
*** ChanServ sets mode: +o flaper8716:00
malinietoews1: that is correct16:01
etoews1malini: what is the unit of messages.oldest.age?16:03
*** kgriffs has quit IRC16:04
*** kgriffs_afk is now known as kgriffs16:04
*** dafter has joined #openstack-marconi16:05
*** dafter has quit IRC16:05
*** dafter has joined #openstack-marconi16:05
kgriffsetoews1: age is in seconds16:05
malinietoews1: it's a timestamp like this one '"created": "2013-10-17T16:04:52Z"'16:05
kgriffsflaper87: you should be able to change the topic now16:05
malinietoews1: age is in seconds & created is the timestamp above16:06
*** dafter has quit IRC16:06
malinisorry for the confusion16:06
*** dafter has joined #openstack-marconi16:06
flaper87kgriffs: thank you, sir! :)16:07
etoews1kgriffs malini: thx.16:07
*** dafter has quit IRC16:11
kgriffsflaper87: I addressed your feedback and rebased the sharding patch: https://review.openstack.org/#/c/50437/16:13
openstackgerritFlavio Percoco proposed a change to openstack/marconi: Migrate from nosetest to testr  https://review.openstack.org/5244316:15
flaper87kgriffs: lemme take a look right away16:15
*** mpanetta has joined #openstack-marconi16:17
kgriffscool, thx!16:18
kgriffsttfn16:18
*** mpanetta has quit IRC16:21
*** mpanetta has joined #openstack-marconi16:21
*** flaper87 changes topic to "OpenStack Queuing and Notification Service || Wiki: https://wiki.openstack.org/wiki/Marconi || Paste: http://paste.openstack.org/ || Smile: :D"16:22
*** kgriffs is now known as kgriffs_afk16:43
*** flaper87 is now known as flaper87|afk16:44
*** reed has joined #openstack-marconi16:52
*** tacuddy2000 has joined #openstack-marconi17:07
*** fvollero is now known as fvollero|gone17:22
zyuankgriffs_afk: ping17:38
*** mpanetta has quit IRC17:43
*** mpanetta has joined #openstack-marconi17:44
amitgandhikgriffs_afk: meeing18:04
amitgandhi*meeting18:04
*** tacuddy2000 has quit IRC18:53
*** malini is now known as malini_afk19:03
*** malini_afk is now known as malini19:26
*** kgriffs_afk is now known as kgriffs19:35
*** malini is now known as malini_afk19:36
*** vkmc has quit IRC20:01
*** vkmc has joined #openstack-marconi20:01
*** mpanetta_ has joined #openstack-marconi20:14
*** mpanetta has quit IRC20:18
kgriffsall quiet on the western front...20:23
*** etoews1 has quit IRC21:03
*** mpanetta_ has quit IRC21:06
*** mpanetta has joined #openstack-marconi21:07
*** oz_akan_ has quit IRC21:21
*** tedross has quit IRC21:23
zyuanmerge this first? https://review.openstack.org/#/c/50437/21:25
russell_hdo I need to do something beyond just running a marconi instance to get messages GCed from mongo?21:30
russell_hit seems like there were some changes related to this recently, but I can't figure out exactly how its supposed to work now21:30
zyuanrussell_h: no, they will expire, just not "on time"21:30
zyuanTTL on messages is pretty much "minimal time to live"21:31
russell_hgotcha21:31
russell_hdoes mongo do some sort of periodic compatctions?21:31
zyuan1 min granularity iirc21:32
zyuani'm not too surprise even if it can live longer; incremental GC is modern languages can live much longer21:33
zyuanin*21:33
*** whenry has quit IRC21:33
russell_hhuh21:34
russell_hodd that mongo doesn't filter these on read21:35
russell_hzyuan: anyway, this makes sense (excepting mongo's oddities), thanks!21:35
zyuanthat'll be slow to distributed system21:35
russell_hslower than actually returning the data?21:35
zyuan(well, the sqlite driver does that, hehe)21:35
kgriffsrussell_h: we actually could filter by expired, but chose not to do it for performance21:36
zyuanprobably, because mongo itself also support sharding21:36
kgriffsFWIW, we aren't currently using mongo's sharding feature21:36
kgriffsthe performance just comes from reduced index complexity and lookup time21:37
kgriffsanyway, we are using mongo's TTL index feature21:37
russell_hkgriffs: yeah, I'm just surprised that mongo doesn't do that itself21:37
kgriffsso, on average, a message will live about 30 seconds past it's actual expiration21:37
kgriffsrussell_h: that would be nice!21:37
kgriffss/it's/its21:38
zyuanmany db with TTL support don't do it, including redis21:38
*** jergerber has quit IRC21:41
zyuankgriffs: how can i test RountingController?21:47
zyuani need to write some tests for QueueController21:47
kgriffszyuan: You could just create an instance of sharding.Driver21:50
kgriffsFWIW, there are some test configs under tests/etc21:50
kgriffse.g., wsgi_sqlite_sharded.conf21:51
kgriffsthey don't have configs for the catalog in there yet, just the sharding=true option set21:51
zyuanok21:51
*** amitgandhi has quit IRC21:56
*** amitgandhi has joined #openstack-marconi22:01
*** amitgandhi has quit IRC22:04
zyuanConfigOpts nosetests nosetests's commandline arguments.  this is an issue i solved before in the config module...22:05
*** amitgandhi has joined #openstack-marconi22:06
zyuananyway.  see you tomorrow!22:06
zyuansetenv NOSE_NOCAPTURE 122:08
*** mpanetta_ has joined #openstack-marconi22:14
*** mpanetta has quit IRC22:16
*** malini_afk is now known as malini22:19
*** amitgandhi has quit IRC22:28
*** ayoung has quit IRC22:30
*** kgriffs has left #openstack-marconi22:33
*** malini is now known as malini_afk22:40
*** reed has quit IRC22:54
*** reed has joined #openstack-marconi22:59
*** reed has quit IRC23:05
*** jergerber has joined #openstack-marconi23:07
*** reed has joined #openstack-marconi23:08
*** reed has quit IRC23:09
*** kgriffs has joined #openstack-marconi23:14
*** ChanServ sets mode: +o kgriffs23:14
*** mpanetta_ is now known as mpanetta23:19
*** reed has joined #openstack-marconi23:21
*** kgriffs is now known as kgriffs_afk23:24
*** ayoung has joined #openstack-marconi23:45
« Wednesday, 2013-10-16 Index Friday, 2013-10-18 »

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!