Tuesday, 2015-10-06

Eva-iTo test zaqar-server's response I also had to install "uuid-runtime" linux package to be able to execute "uuidgen" command.00:05
Eva-iI'm on debian jessie distro.00:05
vkmccool00:08
Eva-iWhat bothers me is that the server is running under python 3: http://pastebin.com/uvp9Swpi00:08
Eva-iIs that okay?00:08
vkmcyeah its ok00:15
vkmczaqar is py3 compatible00:15
vkmc:)00:15
vkmcits not true for other OpenStack services00:15
vkmcbut in this case its ok00:15
vkmcyou succeeded creating a queue, awesome00:15
Eva-i"py3 compatible" now that's cool00:17
*** achanda has joined #openstack-zaqar00:21
mdnadeemEva-i:vkmc: for [driver] section already a fixed is proposed, Please have a look at https://review.openstack.org/#/c/229228/00:26
vkmcmdnadeem, thanks00:26
Eva-iBut I'm not able to run tests. "tox -e py27" whines about insufficient disk space. Mongodb with zaqar databases used all remaining space(about 8,6 GB). =)00:26
mdnadeemvkmc: I face a problem, please look if you can help me out00:26
vkmc:o00:27
vkmcEva-i, how is your env?00:27
vkmcmdnadeem, which problem?00:27
Eva-ivkmc: what do you mean by how is my env?00:27
*** mdnadeem_ has joined #openstack-zaqar00:28
vkmcEva-i, sorry, I meant what are the specs of your computer/if you are running things in a virtual machine00:28
mdnadeemvkmc: i created a queue sucessfully, however when i run queue list command it show me an empty list00:28
vkmcmdnadeem, are you curling to zaqar?00:29
mdnadeemI try to debug the code , however i stuck at a point00:29
mdnadeemyes00:29
vkmchm00:29
Eva-ivkmc: 25 GB for root partition, 82 GB for home partition00:30
mdnadeemvkmc: So while debugging code, i come to the file https://github.com/openstack/zaqar/blob/master/zaqar/storage/mongodb/pools.py at line #7100:30
mdnadeemit query for Collection(Database(MongoClient('localhost', 27017), u'zaqar_mgmt'), u'pools')00:31
Eva-imongodb databases reside here: /var/lib/mongodb00:31
Eva-iso root partition was filled00:31
Eva-iWhat are recommended space specs for testing zaqar?00:32
mdnadeemvkmc: i have manually checked mongodb database , zaqar_mgmt.pools is empty00:32
mdnadeemEva-i: I took 80GB for root partition, it works fine for me00:33
mdnadeemEva-i: I think you should increase the root partition, as mongodb database created at /var/lib/mongodb00:33
openstackgerritOpenStack Proposal Bot proposed openstack/zaqar: Updated from global requirements  https://review.openstack.org/23126700:34
mdnadeem_vkmc: around ?00:38
vkmcEva-i, you shouldn't need much space00:39
vkmcEva-i, maybe you can start mongo with smallfiles = true00:39
vkmcmdnadeem_, so I suppose you have pools enabled00:40
Eva-imdnadeem: nope, I will just create VM on different disk. I was trying out zaqar server directly on my home laptop. I think that was bad idea.00:41
mdnadeem_vkmc: i have used defaullt devstack created zaqar.conf, how to check if pool enable?00:41
vkmcmdnadeem, pooling = true under /etc/zaqar/zaqar.conf00:42
*** davideagnello has quit IRC00:42
vkmcI'll test that scenario though, its an odd behaviour00:42
Eva-ivkmc: okay, next time I will.00:42
mdnadeem_vkmc: in zaqar.conf , pooling = True00:42
vkmcyeah00:42
mdnadeem_[pooling:catalog]00:43
mdnadeem_enable_virtual_pool = True00:43
mdnadeem_that means pools enable rt?00:43
*** davideagnello has joined #openstack-zaqar00:44
*** davideagnello has quit IRC00:46
*** davideagnello has joined #openstack-zaqar00:47
mdnadeem_vkmc: i will check behavior   by disabling the pool and update you the same today.00:50
vkmcmdnadeem, sure, thanks for that00:50
vkmcI'll test that myself too00:50
mdnadeem_vkmc: Thank you very much. You guys are really very help full :)00:51
Eva-ivkmc: yeah, thanks for answering my newbie questions00:57
vkmcmdnadeem, Eva-i, anytime!00:57
mdnadeem_vkmc: queue list command work as expected by disabling pool.00:58
mdnadeem_vkmc: can you refer any doc or link to understand pool concept and how it work, such that i can debug first scenario more deeply01:00
*** itisha has quit IRC01:03
*** mdnadeem__ has joined #openstack-zaqar01:36
*** mdnadeem_ has quit IRC01:37
*** stanchan has joined #openstack-zaqar02:13
*** csoukup has joined #openstack-zaqar02:18
*** csoukup has quit IRC02:22
*** Qiming_ has joined #openstack-zaqar02:23
*** Qiming has quit IRC02:26
*** achanda has quit IRC02:50
*** Eva-i has quit IRC02:51
*** JAHoagie has joined #openstack-zaqar03:44
*** JAHoagie has quit IRC03:53
*** mdnadeem__ has quit IRC04:24
*** mdnadeem_ has joined #openstack-zaqar04:24
mdnadeemi am running a curl command, it say client ID is missing in header, Any idea how to get client ID04:27
mdnadeem_stack@vm2:~/devstack$ curl -i -X POST -H "X-AUTH_TOKEN:3c5c2d436f824d10b914a3ebb0e983e5" http://10.0.2.15:8888/v2/queues/firstq1/messages -d '[{"ttl":300, "body":{"event":"One"}}]'04:28
mdnadeem_HTTP/1.1 400 Bad Request04:28
mdnadeem_content-length: 9304:28
mdnadeem_content-type: application/json; charset=utf-804:28
mdnadeem_{04:28
mdnadeem_    "title": "Missing header",04:28
mdnadeem_    "description": "The \"Client-ID\" header is required."04:28
mdnadeem_ryansb:Qiming:zigo:^^04:29
*** achanda has joined #openstack-zaqar04:42
*** mdnadeem_ has quit IRC04:46
mdnadeemGot it, can create client ID by executing command >> ZQ_CLIENTID=`python -c "import uuid; print(uuid.uuid4())"`05:28
*** davideagnello has quit IRC05:30
*** davideagnello has joined #openstack-zaqar05:30
*** diga has joined #openstack-zaqar05:31
*** khushbu has joined #openstack-zaqar05:44
*** flwang1 has joined #openstack-zaqar06:13
*** khushbu has quit IRC07:05
*** achanda has quit IRC07:18
*** achanda has joined #openstack-zaqar07:22
*** flwang1 has quit IRC07:40
*** achanda has quit IRC07:57
*** achanda has joined #openstack-zaqar08:05
*** achanda has quit IRC08:16
*** achanda has joined #openstack-zaqar08:39
*** achanda has quit IRC08:50
*** exploreshaifali has joined #openstack-zaqar09:52
ryansbmdnadeem: (I'm very late to answering your question) but on linux you can also use the "uuidgen" command10:24
mdnadeemryansb: Thanks for reply , i have a query , Please have a look if you can help me out.10:53
mdnadeemryansb: I need to know at which point in the code, queue is mapped with pool?10:54
mdnadeemryansb: as while creating a queue , i dnt give any pool information , so how it mapped to a pool, Note: pool option is True in zaqar.conf10:56
exploreshaifaliI am building mockups for Zaqar UI here is first link https://app.moqups.com/shaifali.agrawal09@gmail.com/Wn5sDwMw9I/view11:00
exploreshaifalihow should I put pools and flavors?11:00
exploreshaifalibecause I think we will provide option to users for creating and destroying and updating pools and flavors both11:01
exploreshaifalialso what else should be added?11:01
exploreshaifaliryansb, ^11:01
mdnadeemexploreshaifali: Look good :}11:03
exploreshaifalimdnadeem, Thanks!11:03
exploreshaifalibut it need lot more things :)11:03
mdnadeemexploreshaifali: is messaging and notification is common for all project?11:04
exploreshaifalihmm... they are not11:04
exploreshaifaliso I should put them under project11:05
mdnadeemso it would be better if you create them under project sub heading11:05
exploreshaifaliyup, Thanks mdnadeem :D11:05
mdnadeem:)11:05
mdnadeemexploreshaifali: do you know how pool and queue mapped together?11:07
exploreshaifalimdnadeem, pool is collection of queues11:07
exploreshaifalia queue must be mapped with a pool and a pool can contain n number of queues11:07
mdnadeemyes, but i am little confused as while creating a queue we dnt mention any pool name, as per my undestanding queue should be mapped to a pool rt?11:08
exploreshaifalimdnadeem, http://blog.flaper87.org/post/zaqar-pools-explained/11:09
ryansbI agree with mdnadeem about keeping projects as a top-level heading11:09
exploreshaifaliyup yup, Thanks ryansb :)11:09
ryansbdo you plan on having basic queue interactions as well (such as adding a message, or viewing the most recent messages)11:10
ryansbin AWS you can add/read messages from SQS queues from the web UI11:10
ryansbit's clunky, but it can be handy11:10
exploreshaifaliryansb, so we will start with less features and can add more as we move forward11:11
exploreshaifalilater on definatly we will provide UI for add/read messages11:11
exploreshaifalibut for now I think pools and flavor or okay11:11
exploreshaifaliwhat you people say?11:11
exploreshaifalis/or/are11:12
ryansbyeah, I think pools/flavors are a good start11:12
ryansbsince those are the things users are most likely to want to configure by hand11:12
exploreshaifaliyes :D11:13
mdnadeemexploreshaifali: for a start it is good, however creating message is the main task that must be added in future. :)11:13
exploreshaifaliokay, mdnadeem11:13
mdnadeemexploreshaifali:ryansb: here is my queue create command: curl -i -X PUT -H "X-AUTH_TOKEN:bc314ef63c0e48adb8215c2127d3c297" http://10.0.2.15:8888/v2/queues/firstq211:14
ryansbdo you need a client ID as well?11:14
ryansbor is that only message11:15
mdnadeemno,11:15
mdnadeemyes client id is only for message creation11:15
mdnadeemi have doubt this created queue is not mapped with any pool11:15
mdnadeemso i need to know how can i attached my queue to a pool?11:16
mdnadeemryansb:exploreshaifali: ^^11:18
ryansbit will be the default pool11:18
ryansbso if you GET /v2/pools you should see the existing pools11:19
ryansb(likely only one)11:19
exploreshaifalifor pool operations you can look at https://wiki.openstack.org/wiki/Zaqar/specs/api/v1.1#Message_Store_Pools11:19
mdnadeemryansb: I have check mongodb data base, no entry is present in pool collection , and not also in catalog collection11:20
*** Eva-i has joined #openstack-zaqar11:20
mdnadeemonly created queue entry is present in db zaqar_mgmt_queues.queue collection11:21
exploreshaifalithis is flaper87 's call11:22
mdnadeemflaper87: ^^ping11:23
ryansbso the pool is linked to a queue by a flavor11:23
ryansband if you didn't specify a flavor, then it won't get a pool11:24
ryansbin the mongo backend, all a project name does is scope the query to its own collection11:24
ryansbotherwise the queue collection will just be named with the queue name, I think11:24
ryansbso you should be able to see the queue collection and its messages11:24
mdnadeemryansb: i can see the queue entry in data base manually, however queue list command return me an empty list11:25
mdnadeemryansb: If i disable the pool, then every thing work fine for me11:26
mdnadeem GET /v2/pools commands return  HTTP/1.1 404 Not Found11:27
mdnadeemcontent-length: 011:27
mdnadeemryansb: So there no default pool present11:27
mdnadeemryansb:flaper87: queue create help did not show me any option to add flavor or pool, neither i got any pointer in code where they are mapped. Please have a look at cli help option11:30
mdnadeemusage: openstack queue create [-h] [-f {html,json,shell,table,value,yaml}]11:30
mdnadeem                              [-c COLUMN] [--max-width <integer>]11:30
mdnadeem                              [--prefix PREFIX]11:30
mdnadeem                              <queue_name>11:30
exploreshaifalimdnadeem, cli for pools and flavor are not ready yet11:31
exploreshaifalias I mentioned earlier, conflict of flavor with nove11:32
exploreshaifalinova*11:32
exploreshaifalionce we reach to a common conclusion, will start implementing cli11:32
ryansbflat namespace :(11:33
mdnadeemexploreshaifali: ohk, Thanks for info11:35
exploreshaifalinp :11:36
exploreshaifali:)11:36
mdnadeem:)11:36
mdnadeemif using curl command for creating a queue, i am not getting how to specify pool  for attaching  my queue to it,11:38
mdnadeemif you guys can give me  any reference or link, i dnt find any using googly :)11:39
thervemdnadeem, You don't pass the pool directly, you pass a flavor11:53
therveI think you can do that by passing the _flavor key in the queue metadata11:53
mdnadeemtherve: Thanks for reply, How to do that , Please give an example of the command11:54
thervemdnadeem, Something like curl ... -d '{"metadata": {"_flavor": "myflavor"}}'11:55
mdnadeemok, i execute this command separately for creating a flavor or i attached it with queue create command?11:57
therveThe queue create one11:58
mdnadeemthanks, i just execute it and update you the same11:59
*** samjaro has joined #openstack-zaqar12:00
mdnadeemtherve: Same situation, queue created successfully, however list command for queue or flavor or pool is return an empty list12:06
therveAh, that's probably something else then, like you're using pooling and the default pool is not detected properly or something12:08
therveAre you using zaqar master? Maybe try to clean everything up in mongo and try again.12:08
therveYou don't need to specify a pool even if pooling is enabled in your configuration12:08
mdnadeemohk, flavor will attached the corresponding queue to a pool rt?12:09
mdnadeemyes i am using zaqar master code12:10
therveIf you want to use flavor then I don't know12:10
thervePossibly there is a bug12:10
mdnadeemhmm, i feel so12:10
mdnadeemby the way i ll try once more as you say after cleaning my mongo db12:11
mdnadeemcleaning you means, unstalled and then re install it freshly rt?12:11
therveI don't know what rt means12:12
therveBut know not uninstalling, just removing the data files12:12
mdnadeemohh rt meand right? :)12:12
mdnadeemohk, i will do it . Thanks therve :)12:13
mdnadeemgood night12:14
*** exploreshaifali has quit IRC12:17
*** Qiming_ has quit IRC12:51
*** Qiming_ has joined #openstack-zaqar12:51
*** Qiming_ is now known as Qiming13:01
*** nate_gone is now known as njohnston13:01
*** sriram has joined #openstack-zaqar13:11
*** mpanetta has joined #openstack-zaqar13:14
*** mdnadeem_ has joined #openstack-zaqar13:21
*** njohnston is now known as nate_gone13:23
*** samjaro has quit IRC13:26
*** nate_gone is now known as njohnston13:28
*** malini has joined #openstack-zaqar13:53
*** kgriffs|afk is now known as kgriffs14:12
*** davideagnello has quit IRC14:14
*** davideagnello has joined #openstack-zaqar14:15
*** Qiming_ has joined #openstack-zaqar14:15
*** Qiming has quit IRC14:15
*** stanchan has quit IRC14:15
*** dynarro has joined #openstack-zaqar14:17
*** mdnadeem_ has quit IRC14:23
openstackgerritMerged openstack/zaqar: Updated from global requirements  https://review.openstack.org/23126714:23
*** achanda has joined #openstack-zaqar14:29
*** achanda has quit IRC14:37
*** diga has quit IRC14:47
*** dynarro has quit IRC14:48
*** itisha has joined #openstack-zaqar14:55
*** achanda has joined #openstack-zaqar14:57
*** achanda has quit IRC15:01
*** csoukup has joined #openstack-zaqar15:03
*** davideagnello has quit IRC15:05
*** david-ly_ is now known as david-lyle15:06
*** davideagnello has joined #openstack-zaqar15:10
*** kgriffs is now known as kgriffs|afk15:12
*** davideagnello has quit IRC15:12
*** davideagnello has joined #openstack-zaqar15:13
*** kgriffs|afk is now known as kgriffs15:14
*** khushbu has joined #openstack-zaqar15:28
*** khushbu has quit IRC15:42
*** khushbu has joined #openstack-zaqar15:45
*** khushbu has quit IRC15:49
*** khushbu has joined #openstack-zaqar15:51
*** AAzza has quit IRC16:18
*** malini has quit IRC16:25
*** khushbu has quit IRC16:27
*** Qiming_ has quit IRC16:33
*** AAzza has joined #openstack-zaqar16:41
*** AAzza has quit IRC16:51
*** malini has joined #openstack-zaqar16:53
*** AAzza has joined #openstack-zaqar17:19
*** david-ly_ has joined #openstack-zaqar17:21
*** david-lyle has quit IRC17:21
*** david-ly_ is now known as david-lyle17:22
*** achanda has joined #openstack-zaqar17:24
*** stanchan has joined #openstack-zaqar17:29
*** exploreshaifali has joined #openstack-zaqar17:50
*** sriram has quit IRC18:04
*** sriram has joined #openstack-zaqar18:04
*** malini has quit IRC18:24
*** kgriffs is now known as kgriffs|afk18:30
*** malini has joined #openstack-zaqar18:33
*** kgriffs|afk is now known as kgriffs18:36
*** njohnston is now known as nate_gone18:52
*** nate_gone is now known as njohnston19:16
*** kgriffs is now known as kgriffs|afk19:32
*** malini has left #openstack-zaqar19:39
*** exploreshaifali has quit IRC19:40
*** njohnston is now known as nate_gone20:09
*** akanksha_ has joined #openstack-zaqar20:14
*** kgriffs|afk is now known as kgriffs20:20
*** nate_gone is now known as njohnston20:25
*** sriram has quit IRC20:43
*** flwang has quit IRC20:43
*** zigo has quit IRC20:43
*** kgriffs has quit IRC20:43
*** VeggieMeat has quit IRC20:43
*** sriram has joined #openstack-zaqar20:46
*** flwang has joined #openstack-zaqar20:46
*** zigo has joined #openstack-zaqar20:46
*** kgriffs has joined #openstack-zaqar20:46
*** VeggieMeat has joined #openstack-zaqar20:46
*** VeggieMeat has quit IRC20:46
*** VeggieMeat has joined #openstack-zaqar20:47
*** mpanetta has quit IRC21:08
*** sriram has quit IRC21:09
*** samjaro has joined #openstack-zaqar21:32
*** stanchan has quit IRC22:03
*** itisha has quit IRC22:09
*** sebasmagri has quit IRC22:09
*** boris-42 has quit IRC22:09
*** davideagnello has quit IRC22:10
*** Roachs_ has joined #openstack-zaqar22:16
*** samjaro has quit IRC22:19
*** csoukup has quit IRC22:26
*** sebasmagri has joined #openstack-zaqar22:37
*** itisha has joined #openstack-zaqar22:44
*** kgriffs is now known as kgriffs|afk22:52
*** Roachs_ has quit IRC22:53
*** boris-42 has joined #openstack-zaqar22:53
*** davideagnello has joined #openstack-zaqar22:56
*** Roachs_ has joined #openstack-zaqar23:03
*** achanda_ has joined #openstack-zaqar23:36
*** achanda has quit IRC23:40
*** achanda_ has quit IRC23:41
akanksha_Hey vkmc, did you find a solution for the missing X-Project-Id header?23:47
vkmcno, I have been busy with some other stuff23:47
vkmcsorry about that23:47
akanksha_vkmc, it seems like other people also encountered the same problem. https://bugs.launchpad.net/python-zaqarclient/+bug/149415423:48
openstackLaunchpad bug 1494154 in Python client library for Zaqar "zaqarclient failing with error header X-PROJECT-ID was missing" [Undecided,Confirmed]23:48
vkmcyeah, you mentioned this before23:48
akanksha_If you could point me in the right direction I might be able to find a solution?23:48
vkmcso basically we need to try this with a devstack deployment and try to understand why the credentials are not being post properly23:49
vkmcthe only way to do it is to follow in the code how a call is made and how a request is build23:50
vkmcthat requires you to inspect the code closely23:50
akanksha_Alright, I will get started on it.23:50
vkmcthanks akanksha_23:50

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!