flwang | vkmc: in a meeting, will check it later and let you know | 00:45 |
---|---|---|
vkmc | flwang, sure, thanks | 00:53 |
*** echevemaster has quit IRC | 01:08 | |
vkmc | I set up a new env and its working now :) dunno what happened | 01:31 |
*** flwang has quit IRC | 03:28 | |
*** echevemaster has joined #openstack-zaqar | 03:32 | |
*** flwang has joined #openstack-zaqar | 04:19 | |
*** echevemaster has quit IRC | 04:39 | |
*** sgotliv has joined #openstack-zaqar | 04:44 | |
*** fifieldt has joined #openstack-zaqar | 04:48 | |
*** vkmc has quit IRC | 05:03 | |
*** sgotliv has quit IRC | 06:52 | |
*** X019 has quit IRC | 07:02 | |
*** X019 has joined #openstack-zaqar | 07:09 | |
openstackgerrit | Peng Fei Wang proposed a change to openstack/zaqar: Add x-openstack-request-id to zaqar responses https://review.openstack.org/128815 | 07:38 |
*** sgotliv has joined #openstack-zaqar | 08:20 | |
*** sgotliv has quit IRC | 08:30 | |
*** sgotliv has joined #openstack-zaqar | 08:53 | |
*** vkmc has joined #openstack-zaqar | 09:22 | |
*** vkmc has quit IRC | 09:22 | |
*** vkmc has joined #openstack-zaqar | 09:22 | |
*** exploreshaifali has joined #openstack-zaqar | 09:33 | |
*** sgotliv has quit IRC | 10:03 | |
*** sgotliv has joined #openstack-zaqar | 10:14 | |
*** exploreshaifali has quit IRC | 10:18 | |
*** sgotliv has quit IRC | 10:43 | |
*** exploreshaifali has joined #openstack-zaqar | 10:56 | |
*** sgotliv has joined #openstack-zaqar | 11:30 | |
*** vkmc has quit IRC | 11:30 | |
*** exploreshaifali has quit IRC | 11:32 | |
*** bradjone1 has quit IRC | 12:00 | |
*** flaper87|afk is now known as flaper87 | 12:23 | |
*** sgotliv has quit IRC | 12:30 | |
*** sgotliv has joined #openstack-zaqar | 12:42 | |
*** flaper87 is now known as flaper87|afk | 12:49 | |
*** bradjones has joined #openstack-zaqar | 12:52 | |
*** jchai has joined #openstack-zaqar | 13:07 | |
*** mpanetta has joined #openstack-zaqar | 13:24 | |
*** exploreshaifali has joined #openstack-zaqar | 13:29 | |
*** ametts has joined #openstack-zaqar | 13:32 | |
*** malini has joined #openstack-zaqar | 13:34 | |
*** AAzza_afk is now known as AAzza | 13:35 | |
*** mpanetta_ has joined #openstack-zaqar | 13:38 | |
*** mpanetta has quit IRC | 13:38 | |
*** mpanetta_ is now known as mpanetta | 13:56 | |
*** itisit has joined #openstack-zaqar | 14:01 | |
*** amitgandhinz has joined #openstack-zaqar | 14:02 | |
*** ametts has quit IRC | 14:06 | |
*** AAzza is now known as AAzza_afk | 14:11 | |
*** ametts has joined #openstack-zaqar | 14:16 | |
*** cpallares has joined #openstack-zaqar | 14:31 | |
cpallares | good morning o/ | 14:32 |
*** AAzza_afk is now known as AAzza | 14:35 | |
exploreshaifali | hello | 14:58 |
exploreshaifali | I am trying to add messages to a queue | 14:59 |
exploreshaifali | but getting bad request, req body cannot be empty | 15:00 |
exploreshaifali | here is the command that I am using * curl -i -X POST http://127.0.0.1:8888/v1.1/queues/samplequeue/messages -H "Client-ID: 123e4567-e89b-12d3-a456-426655440000" -H "X-PROJECT-ID: eebc5e86db4bb4d2980afcfab9dbb1d26" "{ttl: 30, "body": {"event": "BackupStarted",}}"* | 15:00 |
exploreshaifali | cpallares, please can you help in ^ | 15:01 |
*** kgriffs|afk is now known as kgriffs | 15:03 | |
exploreshaifali | hello kgriffs | 15:05 |
exploreshaifali | I am trying to understand zaqar databases | 15:05 |
kgriffs | hi exploreshaifali | 15:11 |
exploreshaifali | kgriffs, hi | 15:12 |
exploreshaifali | I was exploring mongodb databases | 15:12 |
exploreshaifali | there are 3 for zaqar | 15:12 |
exploreshaifali | zaqar_queues, zaqar_messages_P0 and zaqaq_messages_p1 | 15:13 |
exploreshaifali | kgriffs, inside zaqar_queues there is queues database | 15:13 |
exploreshaifali | queues/s/collection | 15:13 |
exploreshaifali | queues collection there | 15:14 |
exploreshaifali | which shows details of all queues I have added | 15:14 |
kgriffs | yep | 15:15 |
exploreshaifali | inside queues collection there are *id, c, m, p_q* fields | 15:15 |
exploreshaifali | c is for claims | 15:16 |
exploreshaifali | p_q is for names | 15:16 |
kgriffs | right, it is a combination of the project ID and the queue name | 15:16 |
exploreshaifali | and m isfor what? | 15:16 |
kgriffs | message | 15:16 |
kgriffs | iirc | 15:16 |
exploreshaifali | or for queue body? | 15:17 |
kgriffs | oh, sorry | 15:17 |
kgriffs | wrong db | 15:17 |
kgriffs | actually, not db... collection | 15:17 |
* kgriffs is still waking up | 15:17 | |
kgriffs | right, the queues collection... so m is for metadata | 15:17 |
exploreshaifali | haha kgriffs good morning :P | 15:18 |
kgriffs | (see also: https://github.com/openstack/zaqar/blob/master/zaqar/queues/storage/mongodb/queues.py#L63) | 15:18 |
exploreshaifali | okay so it is for metadata | 15:19 |
kgriffs | c is a "side counter" that is used to calculate the marker value to use when enqueuing messages | 15:19 |
exploreshaifali | this marker value is autogenerated right? | 15:20 |
kgriffs | well, not exactly. | 15:20 |
kgriffs | MongoDB does not have a notion of automatically incrementing fields | 15:20 |
kgriffs | instead, it uses a timestamp-based "object-ID' | 15:21 |
kgriffs | due to zaqar's constraints, we need a monotonic, unique value for the marker | 15:21 |
kgriffs | so we use a side counter for that and use a little trick in the "post" method of the messages controller to calculate the marker at the application layer, rather than at the DB layer | 15:22 |
exploreshaifali | ok | 15:22 |
exploreshaifali | c = {t:0, v:1} | 15:23 |
exploreshaifali | t and v are for what? | 15:23 |
exploreshaifali | kgriffs, ^ | 15:25 |
kgriffs | oh, those are explained in that docstring linked above | 15:25 |
kgriffs | value is an int | 15:25 |
exploreshaifali | kgriffs, yes got it | 15:26 |
kgriffs | btw, the reason multiple dbs are used is to reduce contention for the global writer lock | 15:27 |
exploreshaifali | ok | 15:27 |
exploreshaifali | kgriffs, so basically queues collection contain details of all queues but nothing like which mssage is linked with which queue | 15:27 |
exploreshaifali | and which message is claimed | 15:28 |
exploreshaifali | that part will come under messages collections | 15:30 |
exploreshaifali | kgriffs, I am trying to add a message inside a queue using curl command but getting bad request | 15:33 |
exploreshaifali | since request body is empty and it should not | 15:33 |
exploreshaifali | http://paste.openstack.org/show/122234/ | 15:33 |
exploreshaifali | how to create and add messages using curl | 15:33 |
kgriffs | right, you need to give it a body with a JSON document | 15:34 |
kgriffs | (BTW you can check "man curl" or curl -h to list curl options) | 15:35 |
kgriffs | the option you want is "-d" | 15:35 |
kgriffs | that being said, I have been enjoying httpie lately | 15:35 |
kgriffs | a lot more user-friendly than curl | 15:35 |
riveter | httpie++ | 15:36 |
kgriffs | https://github.com/jakubroztocil/httpie | 15:36 |
exploreshaifali | kgriffs, oh, ok Thanks! | 15:36 |
exploreshaifali | I will look into it :) | 15:37 |
kgriffs | kewl | 15:37 |
*** sgotliv has quit IRC | 15:37 | |
exploreshaifali | hello riveter | 15:38 |
exploreshaifali | you are also zaqar developer? | 15:38 |
riveter | hey explore :) | 15:38 |
*** cpallares has quit IRC | 15:38 | |
riveter | not yet, but I've got a pull request under review :) | 15:39 |
riveter | you? | 15:39 |
exploreshaifali | I am also not yet | 15:39 |
exploreshaifali | applying for OPW this round with intention to work for zaqar | 15:39 |
riveter | oh, me too! | 15:40 |
exploreshaifali | haha | 15:40 |
riveter | I guess we're competitors :D | 15:40 |
exploreshaifali | yup! | 15:40 |
exploreshaifali | :) | 15:40 |
riveter | though honestly I don't know if I'm going to get my patch accepted before the deadline | 15:40 |
exploreshaifali | hmm let see | 15:40 |
exploreshaifali | have you completed your application? | 15:41 |
riveter | https://review.openstack.org/#/c/129109/1 | 15:41 |
riveter | if you're interested | 15:41 |
riveter | kinda | 15:41 |
riveter | I've written most of it but not the work plan section | 15:41 |
riveter | I haven't had much interaction with flavio | 15:41 |
exploreshaifali | hmm.. I also need to add few sections for project plan | 15:42 |
riveter | yeah, it looks like you're doing a better job of talking to people than I have | 15:42 |
riveter | I've generally been pretty shy of irc, but people in here seem really friendly | 15:43 |
exploreshaifali | zaqar channel is super awesome :D | 15:43 |
riveter | are you applying for any other projects? | 15:43 |
exploreshaifali | \o/ | 15:43 |
riveter | :D | 15:43 |
exploreshaifali | primary focus is this only | 15:44 |
exploreshaifali | and you? | 15:44 |
riveter | I've got an application in for Perl as well | 15:44 |
exploreshaifali | oh! you have another choice too :P | 15:44 |
exploreshaifali | grate! | 15:44 |
riveter | well, maybe, we'll see | 15:45 |
riveter | I'm not a super experienced programmer so I don't know what my prospects are | 15:45 |
*** AAzza is now known as AAzza_afk | 15:45 | |
exploreshaifali | okay, lets back to our zaqar project again | 15:45 |
riveter | sure :) | 15:46 |
riveter | nice meeting you! | 15:46 |
exploreshaifali | nice meeting you too :) | 15:46 |
exploreshaifali | so how much have you researched so far? | 15:46 |
riveter | kgriffs: I was actually cming on to see if you could review my patch | 15:46 |
riveter | exploreshaifaili: I've mostly only looked at the code that related to this patch | 15:47 |
exploreshaifali | hmm | 15:47 |
kgriffs | riveter: this one? https://review.openstack.org/#/c/129109/1 | 15:47 |
riveter | I have trouble understanding code from just reading it, I have to be trying to do something | 15:48 |
riveter | yeah, that's the one :) | 15:48 |
kgriffs | riveter: ok, I will take a look today | 15:49 |
riveter | thanks very much :) | 15:49 |
kgriffs | sure! | 15:49 |
kgriffs | malini: can you also help review riveter's patch? | 15:49 |
riveter | (it does have a negative review, but it's just for a word choice in a comment. I'll change it if you agree with his suggestion) | 15:50 |
malini | sure..checking now | 15:50 |
riveter | awesome :D | 15:50 |
*** exploreshaifali has quit IRC | 15:51 | |
*** fifieldt has quit IRC | 16:03 | |
*** cpallares has joined #openstack-zaqar | 16:06 | |
*** AAzza_afk is now known as AAzza | 16:10 | |
kgriffs | This looks interesting: | 16:14 |
kgriffs | http://jiffyclub.github.io/snakeviz/ | 16:14 |
kgriffs | </random> | 16:14 |
*** AAzza is now known as AAzza_afk | 16:18 | |
*** AAzza_afk is now known as AAzza | 16:29 | |
*** exploreshaifali has joined #openstack-zaqar | 16:32 | |
*** jchai is now known as jchai_afk | 16:53 | |
*** jchai_afk is now known as jchai | 16:56 | |
*** reed has joined #openstack-zaqar | 16:56 | |
*** vkmc has joined #openstack-zaqar | 16:58 | |
vkmc | hey kgriffs! around? :) | 17:00 |
kgriffs | o/ | 17:00 |
vkmc | \o | 17:00 |
vkmc | so... maybe you can help me find what I am missing | 17:01 |
vkmc | I'm hitting an error with the 'messages' param added in v1.1 | 17:01 |
*** amitgandhinz has quit IRC | 17:02 | |
vkmc | because of this change precisely https://review.openstack.org/108795 | 17:03 |
vkmc | I'm creating a dictionary with messages like this -> messages = {'messages': [{'body': {'id': idx}, 'ttl': 360} for idx in range(20)]} | 17:04 |
vkmc | and it enters this if https://github.com/openstack/zaqar/blob/master/zaqar/queues/transport/wsgi/v1_1/messages.py#L165 | 17:04 |
vkmc | because for some strange reason the dictionary is received inside a list | 17:05 |
vkmc | any ideas kgriffs ^? | 17:05 |
kgriffs | let me see | 17:09 |
kgriffs | hmmm | 17:09 |
vkmc | its odd because you do something alike in the tests | 17:10 |
kgriffs | vkmc: are you saying that your test is hitting L167? | 17:10 |
kgriffs | (raising that error) | 17:10 |
kgriffs | I would say, put use pdb and set a breakpoint after 163 | 17:11 |
kgriffs | and inspect document | 17:11 |
kgriffs | make sure that what you sending is actually what is being received, first off | 17:12 |
kgriffs | (validate assumptions) | 17:12 |
vkmc | nope, the test is just fine | 17:13 |
kgriffs | just wondering, because this: | 17:13 |
kgriffs | {'messages': [{'body': {'id': idx}, 'ttl': 360} for idx in range(20)]} | 17:13 |
kgriffs | really should work | 17:13 |
vkmc | yeah.. hmm | 17:13 |
*** bradjones has quit IRC | 17:14 | |
kgriffs | In [4]: document = {'messages': [{'body': {'id': idx}, 'ttl': 360} for idx in range(20)]} | 17:14 |
kgriffs | In [5]: 'messages' not in document | 17:14 |
kgriffs | Out[5]: False | 17:14 |
*** amitgandhinz has joined #openstack-zaqar | 17:16 | |
*** bradjones has joined #openstack-zaqar | 17:17 | |
*** amitgandhinz has quit IRC | 17:21 | |
*** amitgandhinz has joined #openstack-zaqar | 17:22 | |
*** flaper87|afk is now known as flaper87 | 17:39 | |
flaper87 | what's uuuuuuuuuuuuuuuuuuuuuuuuuupppppppppppppppppppppppppppppppppppppppppp? | 17:39 |
flaper87 | nothing, it seems.... | 17:40 |
mpanetta | I'm up | 17:40 |
* flaper87 hides again and takes his greeting back | 17:40 | |
flaper87 | >.> | 17:40 |
mpanetta | Hi flaper87 :) | 17:40 |
flaper87 | mpanetta: hey hey hey :D | 17:41 |
*** AAzza is now known as AAzza_afk | 17:41 | |
flaper87 | did you guys read my email about the meeting? | 17:41 |
flaper87 | did you have the meeting without me? | 17:41 |
flaper87 | :( :( :( :( | 17:41 |
mpanetta | Meeting? | 17:41 |
mpanetta | I don't think anyone had a meeting, nobody has been here. | 17:41 |
flaper87 | oh, mmh. | 17:41 |
*** sgotliv has joined #openstack-zaqar | 17:44 | |
vkmc | flaper87, d000000000000000000d | 17:44 |
*** cpallares has quit IRC | 17:50 | |
*** jchai is now known as jchai_afk | 17:51 | |
vkmc | no d00d | 17:52 |
*** jchai_afk is now known as jchai | 17:53 | |
*** AAzza_afk is now known as AAzza | 17:54 | |
*** AAzza is now known as AAzza_afk | 17:57 | |
*** sgotliv_ has joined #openstack-zaqar | 18:11 | |
*** AAzza_afk is now known as AAzza | 18:13 | |
*** sgotliv has quit IRC | 18:13 | |
*** amitgandhinz has quit IRC | 18:35 | |
*** amitgandhinz has joined #openstack-zaqar | 18:37 | |
exploreshaifali | flaper87, around? | 18:39 |
*** AAzza is now known as AAzza_afk | 18:39 | |
exploreshaifali | flaper87, you asked not to break storage/mongodb into messare_store and management_store | 18:40 |
exploreshaifali | rather to add only one module mongodb/management and keeping messages as it is | 18:40 |
exploreshaifali | but if we don't create separate module for message than who will we able to break mongodb/drivers.py | 18:45 |
*** AAzza_afk is now known as AAzza | 18:51 | |
*** ametts has quit IRC | 18:52 | |
*** AAzza is now known as AAzza_afk | 19:03 | |
*** itisit has quit IRC | 19:03 | |
*** vkmc has quit IRC | 19:10 | |
*** jchai is now known as jchai_afk | 19:11 | |
*** AAzza_afk is now known as AAzza | 19:11 | |
*** jchai_afk is now known as jchai | 19:12 | |
*** X019 has quit IRC | 19:30 | |
*** anna_ has joined #openstack-zaqar | 19:30 | |
*** vkmc has joined #openstack-zaqar | 19:36 | |
*** malini has left #openstack-zaqar | 19:51 | |
*** cpallares has joined #openstack-zaqar | 20:31 | |
*** AAzza is now known as AAzza_afk | 20:39 | |
*** ametts has joined #openstack-zaqar | 20:52 | |
*** AAzza_afk is now known as AAzza | 20:56 | |
exploreshaifali | flaper87, need to discuss about database spliting | 20:58 |
flaper87 | exploreshaifali: hey, sure. Can we do that tomorrow? | 20:59 |
flaper87 | I've enough energy for the meeting | 21:00 |
* flaper87 in dying mode | 21:00 | |
*** mpanetta has quit IRC | 21:01 | |
vkmc | meeeeeeting | 21:02 |
exploreshaifali | flaper87, okay, tomorrow morning because I need to submit application tomorrow | 21:03 |
exploreshaifali | and need to discuss few important stuff | 21:03 |
flaper87 | kgriffs: meeting | 21:04 |
flaper87 | exploreshaifali: meeting | 21:04 |
flaper87 | cpallares: meeeeeeeeeeeting | 21:04 |
kgriffs | ? | 21:05 |
flaper87 | malini|afk: MEEEEEEEEEETING | 21:05 |
kgriffs | i thought this week it was the earlier time? | 21:05 |
vkmc | MEEEETING | 21:05 |
kgriffs | (and it was skipped/missed) | 21:05 |
flaper87 | kgriffs: ha, I knew you didn't read my email | 21:05 |
kgriffs | nope | 21:05 |
flaper87 | :P | 21:05 |
kgriffs | never do | 21:05 |
kgriffs | ;) | 21:05 |
flaper87 | it was earlier time | 21:05 |
flaper87 | I proposed changing it since I was going to be travelling | 21:05 |
vkmc | (o/ meeting \o) | 21:05 |
flaper87 | and we need to discuss the summit sessions | 21:06 |
flaper87 | if you're busy we can move it | 21:06 |
flaper87 | tomorrow? quick chat ehre ? | 21:06 |
flaper87 | I'm sorry for all that confusion | 21:06 |
kgriffs | whatever is fine for me. | 21:07 |
vkmc | for me too | 21:07 |
flaper87 | vkmc: kgriffs since malini is not here, if you want, we can do a quick discussion tomorrow here in the channel? | 21:07 |
kgriffs | sounds good to me | 21:07 |
kgriffs | what time? | 21:08 |
flaper87 | 15 UTC ? | 21:08 |
kgriffs | same is now, just tomorrow? | 21:08 |
vkmc | sounds good! | 21:08 |
flaper87 | or 21 UTC works too | 21:08 |
vkmc | 21UTC may be better so flwang can join us | 21:08 |
flaper87 | flwang: dude, read^ | 21:09 |
flaper87 | I want you here!!!!!!!!!!!!!!!!!!!!! | 21:09 |
flaper87 | >.> | 21:09 |
flaper87 | ok, please, if you've sessions to complete and stuff, do it now :D | 21:09 |
flaper87 | https://etherpad.openstack.org/p/kilo-zaqar-summit-topics | 21:09 |
flaper87 | so we can talk about them tomorrow | 21:09 |
flaper87 | same thing applies for specs and stuff | 21:09 |
flwang | o/ | 21:09 |
flwang | just back from standup meeting | 21:09 |
flaper87 | flwang: ok, tomorrow, meeting, 21 UTC (this same time) about summit sessions | 21:10 |
flaper87 | ok? | 21:10 |
flwang | yes, sir | 21:10 |
kgriffs | kk | 21:10 |
flwang | flaper87: thanks for making the time suitable for me | 21:11 |
flaper87 | flwang: my pleasure, you're on this ship already and you ain't going anywhere, my friend. | 21:12 |
flwang | flaper87: I'm happy on board | 21:13 |
flaper87 | ok, I'm out. Take care guys and please, don't forget that this channel is fun and nice because there's people PROCRASTINATING in it | 21:13 |
flaper87 | so, stop working so much and keep our guests happy | 21:13 |
flaper87 | :) | 21:13 |
vkmc | that I can do flaper87 | 21:14 |
vkmc | good to know you are back! | 21:14 |
vkmc | ttfn! | 21:14 |
flwang | vkmc: can you send me the question you asked yesterday again? | 21:17 |
vkmc | flwang, I could solve it! it was related to my environment | 21:18 |
flwang | vkmc: cool | 21:19 |
*** flaper87 is now known as flaper87|afk | 21:20 | |
-openstackstatus- NOTICE: Zuul erroneously marked some changes as having merge conflicts. Those changes have been added to the check queue to be rechecked and will be automatically updated when complete. | 21:22 | |
*** jchai is now known as jchai_afk | 21:24 | |
*** jchai_afk is now known as jchai | 21:25 | |
*** vkmc has quit IRC | 21:35 | |
*** jchai has quit IRC | 21:35 | |
*** AAzza is now known as AAzza_afk | 21:36 | |
*** openstackgerrit has quit IRC | 21:40 | |
*** ametts has quit IRC | 21:41 | |
*** exploreshaifali has quit IRC | 22:09 | |
*** amitgandhinz has quit IRC | 22:14 | |
*** exploreshaifali has joined #openstack-zaqar | 22:16 | |
*** cpallares has quit IRC | 22:24 | |
*** anna_ has quit IRC | 22:35 | |
*** openstackgerrit has joined #openstack-zaqar | 22:42 | |
*** anna_ has joined #openstack-zaqar | 22:48 | |
*** vkmc has joined #openstack-zaqar | 22:59 | |
*** anna_ has quit IRC | 23:11 | |
*** exploreshaifali has quit IRC | 23:14 | |
*** X019 has joined #openstack-zaqar | 23:14 | |
*** kgriffs is now known as kgriffs|afk | 23:31 | |
*** yfujioka has joined #openstack-zaqar | 23:35 | |
*** sgotliv_ has quit IRC | 23:43 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!