Tuesday, 2015-09-22

*** JAHoagie has joined #openstack-zaqar00:03
*** achanda has quit IRC00:03
*** flwang has quit IRC00:03
*** achanda_ has quit IRC00:04
*** flwang has joined #openstack-zaqar00:04
*** flwang1 has quit IRC00:05
*** Qiming has quit IRC00:19
*** JAHoagie has quit IRC00:48
*** Qiming has joined #openstack-zaqar00:57
*** Qiming has quit IRC01:05
*** Qiming has joined #openstack-zaqar01:52
*** mdnadeem_ has joined #openstack-zaqar01:53
*** achanda has joined #openstack-zaqar02:33
*** david-ly_ has joined #openstack-zaqar02:39
*** david-lyle has quit IRC02:40
*** mdnadeem_ has quit IRC02:40
*** mdnadeem_ has joined #openstack-zaqar02:53
*** csoukup has joined #openstack-zaqar03:01
*** itisha has joined #openstack-zaqar03:04
*** mdnadeem_ has quit IRC03:12
*** david-ly_ is now known as david-lyle03:17
*** mdnadeem_ has joined #openstack-zaqar03:24
*** mdnadeem_ has quit IRC03:31
openstackgerritFei Long Wang proposed openstack/zaqar: Add note for unreliable in README.rst  https://review.openstack.org/22615404:07
*** JAHoagie has joined #openstack-zaqar04:37
*** JAHoagie has quit IRC04:40
*** stanchan has joined #openstack-zaqar04:42
*** csoukup has quit IRC04:47
*** JAHoagie has joined #openstack-zaqar04:51
*** diga has joined #openstack-zaqar05:02
*** mdnadeem_ has joined #openstack-zaqar05:09
*** mdnadeem_ has quit IRC06:33
*** itisha has quit IRC06:33
*** itisha has joined #openstack-zaqar06:36
*** stanchan has quit IRC06:48
*** david-lyle has quit IRC06:58
*** stanchan has joined #openstack-zaqar06:59
*** david-lyle has joined #openstack-zaqar07:14
*** achanda has quit IRC07:17
*** itisha has quit IRC07:41
*** boris-42 has quit IRC07:41
*** sebasmagri has quit IRC07:41
*** wanghao has quit IRC07:41
*** zhiyan has quit IRC07:41
*** ameade has quit IRC07:41
*** itisha has joined #openstack-zaqar08:14
*** mdnadeem_ has joined #openstack-zaqar08:29
*** mdnadeem_ has quit IRC08:52
*** mdnadeem_ has joined #openstack-zaqar08:56
*** Nesze has joined #openstack-zaqar09:04
*** mdnadeem_ has quit IRC09:05
openstackgerritMerged openstack/zaqar: Fix 500 error when adding pool to wrong group  https://review.openstack.org/22112209:06
*** mdnadeem_ has joined #openstack-zaqar09:17
*** penchal has joined #openstack-zaqar09:19
penchalHi09:20
penchali am trying to setup zaqar with redis backend and getting some issue09:21
*** diga has quit IRC09:25
openstackgerritFlavio Percoco proposed openstack/zaqar: Update falcon requirements  https://review.openstack.org/22526909:26
*** boris-42 has joined #openstack-zaqar09:26
NeszeHi, can I list more mongo uris in the zaqar’s config, like ‘uri = mongodb://<mongo1>, mongodb://<mongo2>, mongodb://<mongo3>’?09:39
flaper87Nesze: nope, what you can do, though, is enable pooling and have different mongodb pools. A mongodb instance (URI) would be a pool09:40
flaper87Nesze: zaqar will balance the load at a topic level09:40
flaper87Nesze: unfortunately, I don't have a link pointing to docs about this09:41
flaper87:(09:41
penchalcan i use redis as a backend for zaqar ?09:50
penchalinstead of mongo db09:50
Neszethanks flaper87, so that would mean, that when I add a separate pool, pointing to another mongo, but these two mongos are in a cluster, and replication is enabled, I’d still have the same data in all the mongos.09:50
*** ameade has joined #openstack-zaqar09:53
flaper87penchal: yes you can09:54
*** zhiyan has joined #openstack-zaqar09:54
flaper87Nesze: ah, wait09:54
flaper87I do not recommend doing that09:54
flaper87If the reason you want to add multiple URLs is to provide the list of members in a replicaSet then yes, you can do that09:55
flaper87However, I'd recommend you to add one and let pymongo figure the rest out09:55
flaper87if you want to scale your data across multiple mongodb clusters, then you should use zaqar pools09:55
*** wanghao has joined #openstack-zaqar09:56
*** stack_ has joined #openstack-zaqar09:56
*** stack_ has quit IRC09:56
*** sebasmagri has joined #openstack-zaqar09:56
penchalgetting some issue while configuring redis as a backend10:00
Neszeta10:00
penchal2015-09-22 09:05:57.271 29270 WARNING oslo_config.cfg [-] Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future. 2015-09-22 09:05:57.324 29270 WARNING oslo_config.cfg [-] Option "storage" from group "drivers" is deprecated. Use option "message_store" from group "drivers". 2015-09-22 09:06:27.597 29270 ERROR stevedore.extension [-] Could not load 'message_queue_handl10:00
penchalin zaqar.conf i used 6379 port for redis10:01
penchaluri = redis://127.0.0.1:637910:02
*** flwang1 has joined #openstack-zaqar10:04
flwang1morning10:04
*** Qiming has quit IRC10:08
*** Nesze has quit IRC10:09
*** itisha has quit IRC10:23
*** mdnadeem_ has quit IRC10:24
*** penchal has quit IRC10:42
*** itisha has joined #openstack-zaqar10:43
openstackgerritOpenStack Proposal Bot proposed openstack/zaqar: Updated from global requirements  https://review.openstack.org/22624210:45
*** Qiming has joined #openstack-zaqar10:56
openstackgerritFlavio Percoco proposed openstack/zaqar: Updated from global requirements  https://review.openstack.org/22624211:38
*** Nesze has joined #openstack-zaqar11:44
*** flwang1 has quit IRC11:53
*** achanda has joined #openstack-zaqar12:41
*** achanda has quit IRC12:42
*** boris-42 has quit IRC12:49
flaper87therve: do you have 5 mins to take a look here? https://review.openstack.org/#/c/226242/12:55
therveAh cool there is only one failure12:59
therveI was wondering why https://review.openstack.org/#/c/225269/ was failing completely13:00
*** sriram has joined #openstack-zaqar13:02
therveflaper87, https://github.com/openstack/python-zaqarclient/blob/master/zaqarclient/tests/queues/queues.py#L365 ?13:03
therveLooks like the upgrade brings us some feature13:03
openstackgerritThomas Herve proposed openstack/python-zaqarclient: Fix functional test of get_many_messages  https://review.openstack.org/22631913:26
openstackgerritThomas Herve proposed openstack/python-zaqarclient: Fix functional test of get_many_messages  https://review.openstack.org/22631913:26
therveflaper87, ^^^13:27
*** Nesze has quit IRC13:28
*** Nesze has joined #openstack-zaqar13:29
vkmcflaper87, if interested, I'm chatting with mrunge in -horizon13:30
vkmcre demo13:30
flaper87vkmc: I am interested but I can't right now :(13:33
flaper87therve: thanks. That seems to be the issue13:33
openstackgerritNate Johnston proposed openstack/zaqar: Use decorator instead of request logging in responders  https://review.openstack.org/22488213:33
vkmcflaper87, k, np13:33
openstackgerritFlavio Percoco proposed openstack/zaqar: Updated from global requirements  https://review.openstack.org/22624213:37
*** amitgandhinz has joined #openstack-zaqar13:51
vkmchey guys13:58
vkmcsomeone want to help mentoring someone for the Outreachy internship?13:58
*** mpanetta has joined #openstack-zaqar13:58
vkmcit doesn't take much time and will make a difference for Zaqar and for an intern professional career13:59
vkmcpleeeeeeeeeeeease13:59
vkmcI also have a project idea if you want13:59
flaper87vkmc: I will if I'm not elected PTL for Glance14:00
*** csoukup has joined #openstack-zaqar14:00
flaper87vkmc: more info to come on Thursday14:00
flaper87:P14:00
vkmcflaper87, this Thursday finish the elections? nice14:01
vkmccrossing fingers for you14:01
*** nate_gone is now known as njohnston14:08
flaper87therve: https://review.openstack.org/#/c/226319/14:14
*** exploreshaifali has joined #openstack-zaqar14:14
flaper87py26 doesn't support {} sets14:14
openstackgerritNate Johnston proposed openstack/zaqar: Use decorator instead of request logging in responders  https://review.openstack.org/22488214:18
*** ametts has joined #openstack-zaqar14:19
NeszeI’ve built zaqar from master, how complete is the v2 API implementation, is it almost done? Does it make sense to test my use cases with v2, or at this stage it’s better to stick with v1.1?14:27
openstackgerritThierry Carrez proposed openstack/zaqar: Open Mitaka development  https://review.openstack.org/22634714:28
*** boris-42 has joined #openstack-zaqar14:30
Neszeaccording to https://wiki.openstack.org/wiki/Zaqar/specs/api/2.0 is still in progress. Are there any other useful documentation sources, or I should start look into the code at last : ) ?14:30
*** kgriffs|afk is now known as kgriffs14:35
*** exploreshaifali has quit IRC14:43
openstackgerritThomas Herve proposed openstack/python-zaqarclient: Fix functional test of get_many_messages  https://review.openstack.org/22631914:49
thervescrew python 2.6 :/14:50
*** Nesze has quit IRC15:07
njohnstonI was wondering if anyone could take a quick look at the failures for gate-tempest-dsvm-[redis|mongodb]-zaqar here; I have not seen these issues with any previous changesets, and I am trying to determine if suddenly my change is really failing those or if there is a transient gate issue or something.  I just can't tell from the error logs.  https://review.openstack.org/#/c/224882/15:17
vkmcnjohnston, checking it15:18
njohnstonvkmc: Thanks!15:19
*** mpanetta has quit IRC15:21
*** ametts has quit IRC15:25
jasondotstarvkmc, flaper87, flwang: hey15:29
jasondotstarhttp://paste.openstack.org/show/473541/15:30
jasondotstarinstalled zaqar w/ my puppet code (w00t!)15:30
jasondotstarbut after installing mongodb (manually) I'm getting this error :-(15:30
ryansb\o/ what a champ15:30
jasondotstardigging down into the weeds now....15:30
jasondotstarryansb: thanks... little more to go before it's really really ready15:32
ryansbyeah, but that's a great step15:32
*** Qiming has quit IRC15:36
vkmcjasondotstar, wohoo15:44
vkmclet see that error15:44
vkmcjasondotstar, you need to add "unreliable=True" under [DEFAULT] in the zaqar.conf15:50
*** stanchan has quit IRC15:54
*** whydidyoustealmy is now known as shakamunyi16:03
*** exploreshaifali has joined #openstack-zaqar16:12
*** JAHoagie has quit IRC16:27
exploreshaifalihow can I provide deprecation message for already existing commands?16:35
jasondotstarvkmc: ack16:38
* jasondotstar tries16:39
*** mpanetta has joined #openstack-zaqar16:42
*** david-lyle has quit IRC16:46
*** achanda has joined #openstack-zaqar16:47
therveUh devstack doesn't respect requirements :/16:50
thervenjohnston, You need https://review.openstack.org/#/c/226242/ to land16:51
therveYou can add a Depends-On16:51
*** davideagnello has quit IRC17:08
jasondotstarvkmc: how about this one: http://paste.openstack.org/show/473567/17:08
jasondotstarstevedore ext issue?17:08
*** davideagnello has joined #openstack-zaqar17:10
openstackgerritNate Johnston proposed openstack/zaqar: Use decorator instead of request logging in responders  https://review.openstack.org/22488217:12
njohnstontherve: Thanks much!17:12
*** achanda_ has joined #openstack-zaqar17:17
*** achanda has quit IRC17:17
*** diga has joined #openstack-zaqar17:21
jasondotstarvkmc: not sure what this 'WriteConcern' object has no attribute 'document' error is abt17:46
*** exploreshaifali has quit IRC17:57
*** stanchan has joined #openstack-zaqar18:01
*** stanchan has quit IRC18:01
jasondotstarflaper87, flwang ^ ne idea?18:08
*** amitgandhinz has quit IRC18:10
*** kgriffs is now known as kgriffs|afk18:13
*** kgriffs|afk is now known as kgriffs18:13
vkmcjasondotstar, could you paste me the configuration file?18:16
jasondotstarya18:21
jasondotstarthat's was going to be my next qn - a working sample from a zaqar install w/ a mongodb backend18:21
jasondotstarbut let me get the one i have18:21
*** achanda has joined #openstack-zaqar18:23
*** achanda_ has quit IRC18:24
*** diga has quit IRC18:27
*** achanda has quit IRC18:42
*** achanda has joined #openstack-zaqar18:48
jasondotstarvkmc: http://paste.openstack.org/show/473590/18:51
*** ametts has joined #openstack-zaqar18:56
*** exploreshaifali has joined #openstack-zaqar19:14
*** flwang1 has joined #openstack-zaqar19:16
*** flwang1 has quit IRC19:25
*** achanda has quit IRC19:37
*** amitgandhinz has joined #openstack-zaqar19:40
*** bradjones has joined #openstack-zaqar19:46
*** bradjones has quit IRC19:46
*** bradjones has joined #openstack-zaqar19:46
*** itisha has quit IRC19:53
*** ametts has quit IRC20:02
*** csoukup has quit IRC20:07
*** JAHoagie has joined #openstack-zaqar20:13
*** achanda has joined #openstack-zaqar20:15
*** JAHoagie has quit IRC20:19
*** JAHoagie has joined #openstack-zaqar20:19
jasondotstarvkmc: did you see the conf file yet?20:38
vkmcjasondotstar, I did, and got distracted with some other stuff :( sorry20:38
vkmcit looks fine20:38
vkmcits odd20:38
vkmcI thought it was outdated20:38
jasondotstarvkmc: no worries20:40
jasondotstareventually, I'll have to dynamically generate the params in there but20:40
jasondotstarI'm just trying to make sure a basic one works20:40
vkmcyeah20:41
jasondotstaras i said, for kicks i have a mongodb installed as the backend20:41
vkmcits the first time I see that error actually20:41
jasondotstarhmmm ok20:41
jasondotstarglad it's not something goofy that i did.20:41
vkmcwhat version of Mongo are you using?20:41
jasondotstarummm20:41
jasondotstar1 sec20:41
vkmcoh no20:41
jasondotstar2.6.10 ?20:42
jasondotstarvkmc: uh oh.... you said oh no20:42
vkmchaha20:42
vkmcits fine20:42
vkmcjasondotstar, comment out L3920:42
vkmcstorage=mongodb20:42
jasondotstarah20:42
jasondotstarok20:42
jasondotstarwell, when i do that it's complaining about the sqlite driver20:45
jasondotstaris that the default?20:45
vkmcthis is a minimum configuration file sample http://paste.openstack.org/show/473608/20:45
jasondotstarvkmc: ^20:45
vkmcno, the thing is that there are options that are deprecated20:45
vkmcand they are not properly documented20:46
jasondotstaroh ok20:46
jasondotstari c20:46
jasondotstarok20:46
jasondotstarperhaps i can help w/ that too (eventually)20:46
jasondotstarlet me try it with your sample conf20:46
vkmctry with management_store = mongodb and message_store = mongodb for the storage driver selection20:46
vkmcsure20:46
vkmcI have websocket enabled20:46
vkmcso make sure you change that for wsgi20:47
jasondotstaroh20:50
jasondotstarok20:50
vkmctransport=wsgi20:51
vkmc:)20:51
jasondotstarnope, I've got 1.8.120:54
jasondotstarvkmc: hmmmm. ran it in debug mode. saw this: http://paste.openstack.org/show/473613/21:04
jasondotstarperhaps I'm not using a id/pass for mongo?21:04
jasondotstarbbiab21:05
vkmcyeah, you should use your credentials21:05
vkmcI'm not sure if the write_concern thing is related though21:05
*** mpanetta has quit IRC21:05
*** sriram has quit IRC21:10
*** achanda has quit IRC21:21
*** JAHoagie has quit IRC22:18
*** angvp has quit IRC22:19
*** csoukup has joined #openstack-zaqar22:19
*** angvp has joined #openstack-zaqar22:20
*** angvp is now known as Guest8795022:20
*** boris-42 has quit IRC22:22
*** achanda has joined #openstack-zaqar22:22
*** boris-42 has joined #openstack-zaqar22:24
*** achanda has quit IRC22:27
*** csoukup has quit IRC22:29
*** amitgandhinz has quit IRC22:30
*** Guest87950 is now known as angvp22:35
*** angvp has quit IRC22:35
*** angvp has joined #openstack-zaqar22:35
vkmcflwang, good morning :)22:50
*** kgriffs is now known as kgriffs|afk22:53
*** kgriffs|afk is now known as kgriffs22:54
jasondotstarvkmc: yeah im not sure what that is either22:56
vkmcjasondotstar, did you try running it with your mongo creds?22:57
vkmczaqar db that is22:57
jasondotstarflwang: morning22:57
flwangmorning :)23:02
vkmcflwang, had a chat with mrunge earlier today23:04
flwangvkmc: anything i should be aware?23:06
vkmcflwang, not really, but I'll paste the log23:07
vkmcwe only discussed a few how Horizon is currently managing the status update23:07
vkmcs23:07
vkmcand he mentioned they are mostly concerned about the tables updates23:07
vkmcthe balloons notifications are not in their priorities23:08
flwangvkmc: right23:08
vkmchttp://paste.openstack.org/show/473649/23:08
vkmcfull log23:08
vkmcno, wai23:09
vkmct23:09
vkmchaha23:09
*** flwang1 has joined #openstack-zaqar23:10
vkmchttp://paste.openstack.org/show/473650/23:11
vkmcthere, that's better23:11
flwangreading...23:12
*** achanda has joined #openstack-zaqar23:12
vkmcso I assume is the same you chatted with him23:22
vkmcfor what I understand, they interact with the other services performing API calls directly23:23
vkmchttps://github.com/openstack/horizon/tree/master/openstack_dashboard/api23:23
vkmchere they have all the clients23:23
flwangyep23:25
flwangi'm thinking the pros & cons compared with the patch mrunge mentioned23:26
flwangjust had a quick review for the patch, i think we can just remove his self-cooked websocket  https://review.openstack.org/#/c/40198/4/horizon-realtime.py and let the js https://review.openstack.org/#/c/40198/4/horizon/static/horizon/js/horizon.realtime.js listen to zaqar23:30
vkmcyeah23:31
flwangit's a good start, which can save much time of us23:32
vkmcindeed23:32
vkmc:)23:32
vkmcusing websocket is straightforward with Javascript23:33
vkmcwe only need to modify this a bit https://review.openstack.org/#/c/40198/4/horizon/static/horizon/js/horizon.realtime.js23:33
vkmcas you said23:33
vkmchave it listening to Zaqar23:33
flwangand based on the patch, seems they(horizon) don't really need to know every status change23:33
vkmcnope23:34
flwangand for a demo, it should be fine as well23:34
vkmcnow, what I generating some noise for me23:34
vkmchow is the client supposed to return a request for a response generated by Horizon to Zaqar?23:34
vkmcor we put Zaqar in the middle and just pass the request through Zaqar23:35
vkmcI think I just answered myself23:35
flwangwhy there is a request?23:35
vkmca user creates an instance through Horizon23:35
vkmcthen a request for Nova is created23:36
vkmcits issued23:36
flwangno matter the request is created by horizon or not23:36
flwangit doesn't matter23:36
vkmcbut but23:36
vkmck23:36
* vkmc tends to overthink stuff23:36
flwangthe scenario maybe like this:   a user is viewing the instances page, another user create a new instance by cli23:37
*** Qiming has joined #openstack-zaqar23:37
flwangnova got the request from the nova client(cli), send notification to ceilometer, if we have a publisher to zaqar, then the notification will be forwarded to zaqar's queue,  zaqar notify horizon by websocket(therve's patch), update the table23:38
vkmcoki23:40
vkmcsounds good to me23:40
flwangthe notification path from nova(or other serivce) to zaqar depends on how we implement it23:40
flwangfor demo, you can use a tool like therve mentioned, but in openstack world, leveraging existing service would make more sense, thoughts?23:42
flwangi dunno, we can discuss when we demo it, obviously, it's not a blocker for now :)23:43
vkmccertainly yes23:43
vkmcwe only want to make sure we can show that Horizon won't need to be continuously polling n services to be aware of status changes23:43
flwangexactly23:43
vkmcso in the demo we should show how its implemented now23:43
vkmcand how it should be improved by Zaqar usage23:44
flwangvkmc: this demo can show the two new features of zaqar, your websocket and the notifications23:44
flwangit would be really cool23:44
vkmcyes :D23:45
flwangoh, btw, i will take vacation since next Monday until the summit :)23:45
flwangbut23:45
flwangi will be around23:45
flwangand my timezone will be UTC+823:46
vkmcoh oki23:46
flwangi'm so excited for this demo23:47
vkmcgoing back to your homeland for the holidays? :)23:47
vkmcyeah me too23:47
vkmcI'll try to get things done with time so we can see it in action with time23:48
flwangyes, back to Beijing to join my young brother's wedding and see my parents23:48
vkmcohh, congrats!23:48
flwangbesides, i'm also thinking another demo about notifications or the basic messaging service of zaqar, like https://aws.amazon.com/blogs/aws/auto-scaling-with-sqs/  and http://docs.aws.amazon.com/AutoScaling/latest/DeveloperGuide/as-using-sqs-queue.html23:51
*** Qiming has quit IRC23:52
vkmcoh yes, I was going through those examples the other  day23:53
flwangnow the ^only^ doc about auto scaling of openstack is this one http://techs.enovance.com/7437/autoscaling-with-heat-ceilometer-gnocchi23:53
vkmcand it caught my attention the concept of "invisibility" for messages23:53
flwangbut, it's only based on the hardware performance23:53
vkmchas that been discussed in Marconi/Zaqar in the past?23:53
flwangIMHO, it's not really reasonable23:53
flwangthe autoscaling should be based on the application workload instead hardware workload23:53
* vkmc checks the links23:54
flwangvkmc: i don't think so?23:54
vkmcwhat exaclty "hardware workload" means?23:54
flwanglike the cpu util is more than 80% or something like that23:55
flwangmemory util > 80%23:55
vkmcso how much of the available resources are being used23:55
vkmcinstead of how many processes are being executed23:56
vkmcwhich is application workload23:56
vkmcits hard to say23:56
flwangvkmc: but, for distributed application(like most of the web application), the message count in the queue(or similar) is the key part they should be aware, and which is the real workload for the application23:56
vkmcwell yes, that's true23:57
flwangbut yes, if it's not really based on message queue, then it maybe not true23:57
flwangi would like to show more user scenarios23:58
vkmcyeah, I think that's something we are missing in Zaqar right now23:59
vkmcshowing the potential Zaqar has will help us gain adoption23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!