*** toddjohn has quit IRC | 01:02 | |
*** cheneydc has joined #openstack-mistral | 01:03 | |
*** cheneydc has quit IRC | 01:04 | |
*** bobh has joined #openstack-mistral | 01:11 | |
*** FL1SK has quit IRC | 01:27 | |
*** bobh has quit IRC | 01:28 | |
*** bobh has joined #openstack-mistral | 02:50 | |
*** rakhmero_ has joined #openstack-mistral | 02:57 | |
*** bobh has quit IRC | 03:06 | |
*** rakhmero_ has quit IRC | 03:11 | |
openstackgerrit | Lingxian Kong proposed openstack/mistral: Add event engine service https://review.openstack.org/320500 | 03:47 |
---|---|---|
openstackgerrit | Lingxian Kong proposed openstack/mistral: Add functional tests for event engine functions https://review.openstack.org/336463 | 03:47 |
openstackgerrit | Lingxian Kong proposed openstack/mistral: Add event trigger REST API https://review.openstack.org/320509 | 03:47 |
*** tonytan_brb has joined #openstack-mistral | 03:57 | |
*** tonytan4ever has quit IRC | 03:59 | |
*** FL1SK has joined #openstack-mistral | 04:05 | |
*** rakhmero_ has joined #openstack-mistral | 04:24 | |
*** d0ugal has quit IRC | 04:34 | |
*** d0ugal has joined #openstack-mistral | 04:36 | |
*** harlowja has joined #openstack-mistral | 04:57 | |
hparekh | rakhmerov, hi | 05:24 |
*** rakhmero_ has quit IRC | 05:32 | |
*** harlowja has quit IRC | 05:38 | |
openstackgerrit | hardik proposed openstack/mistral: Added 'pip install -r requirements.txt' instruction https://review.openstack.org/345347 | 05:41 |
openstackgerrit | hardik proposed openstack/python-mistralclient: Added 'pip install -r requirements.txt' instruction https://review.openstack.org/345351 | 05:45 |
*** apsarshaik has quit IRC | 06:10 | |
*** apsarshaik has joined #openstack-mistral | 06:11 | |
*** cheneydc has joined #openstack-mistral | 06:17 | |
*** cheneydc has quit IRC | 06:25 | |
*** d0ugal has quit IRC | 07:20 | |
*** _achatterjee_ has joined #openstack-mistral | 07:21 | |
*** _achatterjee_ has left #openstack-mistral | 07:22 | |
*** apsarshaik has quit IRC | 07:31 | |
*** rakhmero_ has joined #openstack-mistral | 07:34 | |
*** Ravikiran_K has joined #openstack-mistral | 07:40 | |
*** jpich has joined #openstack-mistral | 07:49 | |
openstackgerrit | Merged openstack/mistral: Added 'pip install -r requirements.txt' instruction https://review.openstack.org/345347 | 07:49 |
*** rakhmero_ has quit IRC | 07:49 | |
rakhmerov | hparekh: hi | 07:50 |
rakhmerov | hparekh, akuznetsova, nmakhotkin, kong: guys, please review https://review.openstack.org/#/c/344167/, https://review.openstack.org/#/c/344228, https://review.openstack.org/#/c/344569 and https://review.openstack.org/#/c/345295/ | 07:52 |
*** d0ugal has joined #openstack-mistral | 07:52 | |
*** vgnbkr has quit IRC | 08:11 | |
*** vgnbkr has joined #openstack-mistral | 08:11 | |
*** openstackgerrit has quit IRC | 08:11 | |
*** shardy has joined #openstack-mistral | 08:13 | |
*** openstackgerrit has joined #openstack-mistral | 08:14 | |
*** d0ugal has quit IRC | 08:30 | |
openstackgerrit | Merged openstack/python-mistralclient: Added 'pip install -r requirements.txt' instruction https://review.openstack.org/345351 | 08:32 |
rakhmerov | ddeja: hi, here? | 08:34 |
ddeja | rakhmerov: hi | 08:34 |
rakhmerov | ddeja: remember you sent a patch last about the last fall that proposed a non-locking architecture for Mistral engine? | 08:35 |
rakhmerov | I can't find that patch for some reason, do have a link by any chance? | 08:35 |
rakhmerov | do you.. | 08:35 |
ddeja | rakhmerov: you mean this one? https://review.openstack.org/#/c/343791/ | 08:35 |
rakhmerov | I'd like to examine this this idea again | 08:35 |
ddeja | wait, the last fall? | 08:36 |
rakhmerov | no, it was long time ago | 08:36 |
rakhmerov | yes | 08:36 |
ddeja | you mean, like a 8 months ago? | 08:36 |
rakhmerov | it was Nov or Dec I think | 08:36 |
rakhmerov | yes | 08:36 |
rakhmerov | :) | 08:36 |
rakhmerov | you proposed to get rid of locking in engine at all | 08:36 |
ddeja | I don't remember to send any patches for this | 08:37 |
ddeja | it was rather discussed idea | 08:37 |
ddeja | but without any implementation | 08:37 |
rakhmerov | hm.. I though you did | 08:37 |
rakhmerov | or maybe it was Roman's patch | 08:37 |
ddeja | let me double check | 08:37 |
rakhmerov | yeah, please | 08:37 |
ddeja | _gryf: ^^ | 08:37 |
rakhmerov | I'm now working on improving Mistral performance and made sure that our heavy locking model doesn't perform well enough | 08:38 |
rakhmerov | in fact, it's very very slow | 08:38 |
ddeja | rakhmerov: My only patch from last fall to mistral is this: https://review.openstack.org/#/c/343791/ | 08:39 |
ddeja | sorry, wrong link | 08:39 |
ddeja | this https://review.openstack.org/#/c/251370/ | 08:39 |
rakhmerov | I run 50 parallel tasks then joined into one branch and my cluster gets broken because of DB deadlocks | 08:39 |
ddeja | not good | 08:39 |
rakhmerov | not good at all! | 08:40 |
rakhmerov | I'm observing a huge contention on executions table | 08:40 |
rakhmerov | some queries take > 1 min to complete | 08:40 |
_gryf | I don't remeber any patch by me on that area | 08:42 |
_gryf | I remeber there was a discussion | 08:43 |
rakhmerov | ddeja: yeah, it seems that patch ) | 08:43 |
ddeja | OK, good :) | 08:43 |
rakhmerov | but ok, it's a little different from what settled in my mind ) | 08:44 |
rakhmerov | ok, thanks anyway | 08:44 |
ddeja | no problem | 08:45 |
rakhmerov | ddeja: btw, it's still interesting to me, could you please comment on something? | 08:45 |
rakhmerov | https://review.openstack.org/#/c/251370/3/mistral/engine/task_handler.py | 08:45 |
rakhmerov | what did you try to do with these db_api.update_task_where() calls? | 08:46 |
rakhmerov | kind of optimistic locking? | 08:46 |
rakhmerov | because in default_engine.py you actually removed locking (that's what settled in my mind :) ) | 08:46 |
ddeja | rakhmerov: I removed locking becouse it was not working | 08:47 |
ddeja | I don't know why it wasn't working at that moment, but it was not blocking one transaction from another | 08:48 |
rakhmerov | ooh, yes | 08:48 |
rakhmerov | it was because of the wrong transaction isolation | 08:48 |
rakhmerov | but what about update_task_where()? What was the idea? | 08:48 |
ddeja | The engine as a whole was still working thanks to this https://review.openstack.org/#/c/251370/3/mistral/db/v2/sqlalchemy/api.py | 08:48 |
*** dulek has joined #openstack-mistral | 08:49 | |
* dulek to the rescue! | 08:49 | |
ddeja | It was an idea that dulek proposed | 08:49 |
ddeja | (he works in cinder and they have similar problem) | 08:50 |
dulek | Okay, let my try to find quite cool tests done by gegulieo… | 08:51 |
dulek | Here you go: https://github.com/Akrog/test-cinder-atomic-states | 08:52 |
rakhmerov | dulek: hi | 08:52 |
rakhmerov | ok | 08:52 |
rakhmerov | ddeja, dulek: problem similar to what? | 08:53 |
rakhmerov | heavy locking? | 08:53 |
dulek | Yup, we were looking into making state changes of volumes atomic., | 08:53 |
dulek | For that we've needed some kind of locking to make sure only one instance of a service can modify the row. | 08:53 |
rakhmerov | yes | 08:54 |
dulek | Link show the results - we've evaluated SELECT FOR UPDATE, UPDATE WHERE and different Tooz locks with different backends. | 08:54 |
dulek | UPDATE WHERE was based on something like: | 08:55 |
rakhmerov | in case of Mistral it's pretty hairy (dunno about Cinder details) to have optimistic locks because the whole graph of DB objects (workflow and its tasks and actions) should be accessed exclusively by one thread | 08:55 |
rakhmerov | otherwise data consistency is lost | 08:55 |
dulek | UPDATE volumes SET status="deleting" WHERE id=<id> AND status!="DELETING"; | 08:55 |
rakhmerov | yeah, it's an optimistic locking | 08:56 |
ddeja | rakhmerov: and it was similar in my patch ^ | 08:56 |
rakhmerov | one subtype of it | 08:56 |
rakhmerov | ddeja: yeah, I see now, ok | 08:56 |
rakhmerov | it's helpful | 08:56 |
rakhmerov | although for Mistral it wouldn't have worked | 08:56 |
rakhmerov | in general cas | 08:56 |
dulek | rakhmerov: Ah, so the problem is that you would need to lock multiple tables, and this locks only one? | 08:56 |
rakhmerov | case | 08:57 |
rakhmerov | dulek: yes, exactly | 08:57 |
rakhmerov | imagine the graph: any change to the graph requires reading the whole graph in general case | 08:57 |
rakhmerov | consistenly | 08:57 |
ddeja | rakhmerov, dulek: It's rather multiple rows in one table, i think | 08:57 |
rakhmerov | strong consistency is required | 08:58 |
dulek | So maybe Tooz? You may be interested in tests done by Neutron guys: http://lists.openstack.org/pipermail/openstack-dev/2016-July/099752.html | 08:58 |
rakhmerov | ddeja: in fact, yes, but it's not so important | 08:58 |
rakhmerov | the key thing here: we need to lock graph of objects | 08:58 |
rakhmerov | as long as indexes are set properly DB won't lock the whole table so having these objects in one table is the same as having them in different tables | 08:59 |
rakhmerov | dulek: thanks, I'll look at it | 08:59 |
rakhmerov | ddeja: btw, moving different kinds of executions into different tables will probably help but theoretically not too much | 09:01 |
rakhmerov | we already thought about making this change | 09:01 |
rakhmerov | I'll need to check this option too, anyway | 09:02 |
rakhmerov | I may be easily wrong | 09:02 |
*** d0ugal has joined #openstack-mistral | 09:22 | |
*** toddjohn has joined #openstack-mistral | 09:39 | |
*** toddjohn has quit IRC | 09:43 | |
*** fan has joined #openstack-mistral | 09:50 | |
fan | Hi, I | 09:51 |
fan | I use std.http to access one website, but met following issue: | 09:51 |
fan | 2016-07-21 22:38:28.135 2264 INFO mistral.engine.rpc [-] Received RPC request 'run_action'[rpc_ctx=MistralContext {u'project_name': None, u'user_id': None, u'roles': [u''], u'auth_token': None, u'is_trust_scoped': False, u'service_catalog': None, u'project_id': None, u'user_name': None}, action_ex_id=d091df28-5092-4e2b-aaca-061ffc3a9eb0, action_class=mistral.actions.std_actions.HTTPAction, attributes={}, params={u'body': Non | 09:51 |
fan | File "/usr/lib/python2.7/dist-packages/oslo_utils/encodeutils.py", line 49, in safe_decode return text.decode(incoming, errors) File "/usr/lib/python2.7/encodings/utf_8.py", line 16, in decode return codecs.utf_8_decode(input, errors, True) TypeError: don't know how to handle UnicodeDecodeError in error callback | 09:51 |
fan | Who knows how to fix it? | 09:52 |
ddeja | Hi fan | 09:53 |
fan | yes. | 09:54 |
ddeja | 1) next time please update traceback somewhere else, like https://etherpad.openstack.org/, it would be easier to read. 2) please try std.mistral_http instead and see if it helps | 09:54 |
ddeja | wrong link, it should be http://paste.openstack.org/ :) | 09:56 |
openstackgerrit | Lingxian Kong proposed openstack/mistral: Add event engine service https://review.openstack.org/320500 | 10:07 |
openstackgerrit | Lingxian Kong proposed openstack/mistral: Add functional tests for event engine functions https://review.openstack.org/336463 | 10:07 |
openstackgerrit | Lingxian Kong proposed openstack/mistral: Add event trigger REST API https://review.openstack.org/320509 | 10:07 |
kong | hparekh: seems something wrong in server side https://review.openstack.org/#/c/344052/ | 10:09 |
kong | hah, indeed, http://logs.openstack.org/95/345295/1/check/gate-mistral-devstack-dsvm/7106935/console.html | 10:10 |
kong | rakhmerov seems related to your patches | 10:10 |
kong | pagination query is affected | 10:10 |
hparekh | kong, yes I think so | 10:10 |
rakhmerov | what's up? | 10:11 |
kong | rakhmerov: http://logs.openstack.org/95/345295/1/check/gate-mistral-devstack-dsvm/7106935/console.html | 10:11 |
rakhmerov | what should I look at? | 10:12 |
rakhmerov | yes, I see but my patches are not merged yet into master | 10:13 |
kong | http://paste.openstack.org/show/539682/ | 10:13 |
*** fan has quit IRC | 10:13 | |
kong | rakhmerov: ooh, yeah | 10:13 |
rakhmerov | and they don't change the behaviour, they just remove a warning | 10:13 |
rakhmerov | it clearly says "Client-side error" :) | 10:14 |
* kong is looking | 10:14 | |
rakhmerov | so lengths of two arrays are different, I don't know why, needs to be investigated | 10:15 |
kong | because I also see this error in your patch: https://review.openstack.org/#/c/345295/ | 10:15 |
rakhmerov | kong, this means that it's not related with Hardik's and my patches | 10:16 |
rakhmerov | it's something else | 10:17 |
kong | yes | 10:17 |
rakhmerov | that's already merged | 10:17 |
rakhmerov | I guess there were some changes in server side in API after which proper client side changes were not made | 10:17 |
rakhmerov | you need to look at recently merged patches and find the first one where it crashed | 10:18 |
rakhmerov | but why am I telling you.. you know yourself.. | 10:18 |
rakhmerov | :) | 10:18 |
kong | :-) | 10:19 |
* kong is trying to digest every patch merged these days, to keep up with all you guys. | 10:20 | |
rakhmerov | :))) | 10:22 |
rakhmerov | kong: how do you do this? How do you set status in IRC? | 10:23 |
kong | slash+me | 10:23 |
kong | '/me is going to do what....' | 10:23 |
kong | get rid of tje quote | 10:24 |
kong | rakhmerov: have a try | 10:24 |
* rakhmerov wishes kong good luck with catching up and is hoping that kong wants to take more work.. | 10:25 | |
rakhmerov | :) | 10:25 |
* kong teaches renat something, so renat owes kong a beer | 10:25 | |
rakhmerov | haha :)) Sure | 10:27 |
* rakhmerov if kong decides to show up in Barcelona ) | 10:27 | |
kong | rakhmerov: I can't go for summit neither in Barcelona, unfortunately | 10:27 |
rakhmerov | ooh, that's bad | 10:27 |
kong | conflict with my plan back to china | 10:28 |
rakhmerov | whaaat? | 10:29 |
rakhmerov | you're moving back to China? | 10:29 |
kong | i mean, my vacation | 10:29 |
kong | my parents-in-law will go back China that itme | 10:30 |
rakhmerov | ooh, just for vacation | 10:30 |
rakhmerov | I see | 10:30 |
rakhmerov | ok | 10:30 |
kong | I have to go with them | 10:30 |
rakhmerov | yeah | 10:30 |
kong | rakhmerov: I left a comment in your patch https://review.openstack.org/#/c/345295 | 10:38 |
kong | rakhmerov: for more detail: http://paste.openstack.org/show/539725/ | 10:39 |
rakhmerov | ooh! I see | 10:39 |
rakhmerov | yeah, I understand | 10:39 |
rakhmerov | no need to explain | 10:39 |
kong | :-) | 10:39 |
rakhmerov | will fix it soon | 10:39 |
rakhmerov | thanks! | 10:39 |
kong | I believe you know that | 10:39 |
rakhmerov | but why does Hardik's patch fail? | 10:39 |
rakhmerov | it should take mistral server from master | 10:39 |
kong | rakhmerov: no idea, maybe another reason | 10:39 |
rakhmerov | kong: wait a minute.. | 10:40 |
rakhmerov | where exactly does this error happen? | 10:40 |
rakhmerov | in oslo_db? | 10:40 |
rakhmerov | can you show me exact place? | 10:41 |
kong | File "/usr/local/lib/python2.7/dist-packages/oslo_db/sqlalchemy/utils.py", line 119, in paginate_query | 10:41 |
kong | rakhmerov: btw, I have tested the event trigger function in my real environment, yes, real rabbitmq | 10:41 |
kong | it's a little bit tricky to add some complex functional tests because it need access to rabbitmq | 10:42 |
rakhmerov | yeah, I see | 10:43 |
rakhmerov | ok | 10:43 |
kong | except one day, we can send some notifications from inside mistral | 10:44 |
rakhmerov | one day? | 10:47 |
rakhmerov | kong: btw, can you please review https://review.openstack.org/#/c/344167/ ? | 10:47 |
rakhmerov | it's the only patch left in this series.. | 10:48 |
kong | rakhmerov: i mean, some day in future :-) | 10:48 |
rakhmerov | ok ) | 10:48 |
kong | rakhmerov: the patch is good to me. do you plan to add some functional tests | 10:49 |
rakhmerov | kong: yes, this sequence of patches is not finished yet | 10:49 |
rakhmerov | I'm not closing BP | 10:49 |
kong | rakhmerov: ok | 10:49 |
rakhmerov | I just had to switch to something else for a couple of weeks I think | 10:49 |
kong | vacation? | 10:50 |
*** d0ugal has quit IRC | 10:54 | |
rakhmerov | no, I'm now committed to improve Mistral performance | 10:55 |
rakhmerov | it works really slowly on some cases | 10:55 |
kong | rakhmerov: hah, I know | 10:55 |
rakhmerov | simple cases actually ) | 10:55 |
openstackgerrit | Merged openstack/mistral: Add the new endpoint /v2/tasks/<id>/workflow_executions https://review.openstack.org/344167 | 10:57 |
kong | rakhmerov: all my patches are green, could you please have a look? | 10:57 |
openstackgerrit | Merged openstack/mistral: Move REST resources action, action execution and task to resources.py https://review.openstack.org/344228 | 10:57 |
kong | ooh, shit, maybe I have to rebase again. | 10:58 |
kong | for resources are all leave in a single file, including event_trigger I added | 10:58 |
rakhmerov | kong: sure | 10:59 |
rakhmerov | I will look at them, don't worry | 10:59 |
kong | rakhmerov: just want to forget them, and switch to something else in mistral | 10:59 |
openstackgerrit | Merged openstack/mistral: Move the remainder of REST resources to resources.py https://review.openstack.org/344569 | 11:00 |
rakhmerov | kong: you can switch now while we're reviewing | 11:01 |
rakhmerov | not a problem | 11:01 |
kong | rakhmerov: I don't like rebasing over and over again :-) | 11:02 |
rakhmerov | yeah, I know | 11:02 |
rakhmerov | ok, I promise to review soon | 11:02 |
kong | i know these patches indeed are huge. add additional process, additional service api, etc. | 11:02 |
* kong have to look after the baby for a while | 11:03 | |
rakhmerov | kong, akuznetsova: just replied on https://review.openstack.org/#/c/344748/1 | 11:06 |
openstackgerrit | Renat Akhmerov proposed openstack/mistral: Error handling test: error in 'publish' for a task with 'on-error' https://review.openstack.org/344748 | 11:07 |
openstackgerrit | Renat Akhmerov proposed openstack/mistral: Get rid of oslo_db warning about "id" not being in "sort_keys" https://review.openstack.org/345295 | 11:07 |
openstackgerrit | Lingxian Kong proposed openstack/mistral: Add event engine service https://review.openstack.org/320500 | 11:28 |
openstackgerrit | Lingxian Kong proposed openstack/mistral: Add functional tests for event engine functions https://review.openstack.org/336463 | 11:28 |
openstackgerrit | Lingxian Kong proposed openstack/mistral: Add event trigger REST API https://review.openstack.org/320509 | 11:28 |
openstackgerrit | Renat Akhmerov proposed openstack/mistral: Remove task result for collection REST requests https://review.openstack.org/345985 | 11:37 |
rakhmerov | akuznetsova, kong, hparekh, ddeja: very nasty bug causing a lot of pain - https://review.openstack.org/#/c/345985/ | 11:40 |
*** clenimar has quit IRC | 11:44 | |
*** clenimar has joined #openstack-mistral | 11:45 | |
openstackgerrit | Renat Akhmerov proposed openstack/mistral: Remove task result for collection REST requests https://review.openstack.org/345985 | 11:57 |
openstackgerrit | Renat Akhmerov proposed openstack/mistral: Get rid of oslo_db warning about "id" not being in "sort_keys" https://review.openstack.org/345295 | 11:57 |
*** dprince has joined #openstack-mistral | 11:58 | |
rakhmerov | kong: https://review.openstack.org/#/c/345295/ is fixed now, functional tests pass | 12:32 |
rakhmerov | I had to fix them a little bit | 12:33 |
openstackgerrit | Dawid Deja proposed openstack/mistral: Use 'rpc_response_timeout' in kombu driver https://review.openstack.org/346005 | 12:35 |
*** bobh has joined #openstack-mistral | 12:41 | |
*** toddjohn has joined #openstack-mistral | 12:41 | |
*** d0ugal has joined #openstack-mistral | 12:48 | |
*** bobh has quit IRC | 13:00 | |
*** shardy is now known as shardy_mtg | 13:01 | |
*** krotscheck is now known as lolscheck | 13:12 | |
*** lolscheck is now known as krotscheck | 13:31 | |
*** Ravikiran_K has quit IRC | 13:33 | |
*** d0ugal has quit IRC | 13:33 | |
*** shardy_mtg has quit IRC | 13:34 | |
*** shardy_mtg has joined #openstack-mistral | 13:36 | |
*** shardy_mtg is now known as shardy | 13:36 | |
*** ramishra has quit IRC | 13:51 | |
*** ramishra has joined #openstack-mistral | 13:52 | |
*** jtomasek has quit IRC | 14:14 | |
*** clenimar has quit IRC | 14:21 | |
*** Kiall has joined #openstack-mistral | 14:30 | |
*** jtomasek has joined #openstack-mistral | 14:35 | |
*** rrecio has joined #openstack-mistral | 14:52 | |
*** rrecio_ has joined #openstack-mistral | 14:53 | |
*** rrecio has quit IRC | 14:56 | |
*** clenimar has joined #openstack-mistral | 15:06 | |
*** jistr is now known as jistr|mtg | 15:09 | |
*** dprince has quit IRC | 15:15 | |
*** jistr|mtg is now known as jistr | 15:17 | |
*** stevebaker has quit IRC | 15:39 | |
*** krotscheck has quit IRC | 15:39 | |
*** apsarshaik has joined #openstack-mistral | 15:40 | |
*** apsarshaik has quit IRC | 15:40 | |
*** apsarshaik has joined #openstack-mistral | 15:41 | |
*** krotscheck has joined #openstack-mistral | 15:47 | |
*** stevebaker has joined #openstack-mistral | 15:47 | |
*** dprince has joined #openstack-mistral | 15:47 | |
*** tonytan_brb is now known as tonytan4ever | 16:13 | |
*** dprince has quit IRC | 16:15 | |
*** jistr is now known as jistr|off | 16:16 | |
*** jistr|off is now known as jistr | 16:17 | |
*** apsarshaik has quit IRC | 16:25 | |
*** apsarshaik has joined #openstack-mistral | 16:27 | |
*** apsarshaik has quit IRC | 16:30 | |
*** apsarshaik has joined #openstack-mistral | 16:30 | |
*** dprince has joined #openstack-mistral | 16:49 | |
*** toddjohn has quit IRC | 16:54 | |
*** jpich has quit IRC | 16:55 | |
*** apsarshaik has quit IRC | 17:09 | |
*** apsarshaik has joined #openstack-mistral | 17:16 | |
*** toddjohn has joined #openstack-mistral | 17:54 | |
*** toddjohn has quit IRC | 17:59 | |
*** toddjohn has joined #openstack-mistral | 18:08 | |
*** apsarshaik has quit IRC | 18:09 | |
*** toddjohn has quit IRC | 18:29 | |
*** toddjohn has joined #openstack-mistral | 18:29 | |
*** toddjohn has quit IRC | 18:30 | |
*** toddjohn has joined #openstack-mistral | 18:31 | |
*** toddjohn has quit IRC | 18:35 | |
*** toddjohn has joined #openstack-mistral | 18:37 | |
*** toddjohn has quit IRC | 18:41 | |
*** gyee has joined #openstack-mistral | 18:46 | |
*** gyee has quit IRC | 18:50 | |
*** gyee has joined #openstack-mistral | 19:01 | |
*** gyee has quit IRC | 19:25 | |
*** toddjohn has joined #openstack-mistral | 19:30 | |
*** toddjohn has quit IRC | 19:45 | |
*** toddjohn has joined #openstack-mistral | 19:46 | |
*** toddjohn has quit IRC | 19:54 | |
*** toddjohn has joined #openstack-mistral | 20:18 | |
*** toddjohn has quit IRC | 20:20 | |
*** clenimar has quit IRC | 20:25 | |
*** bobh has joined #openstack-mistral | 20:28 | |
*** bobh has quit IRC | 20:31 | |
*** dprince has quit IRC | 21:26 | |
*** shardy has quit IRC | 21:50 | |
*** rrecio_ has quit IRC | 22:51 | |
*** rrecio has joined #openstack-mistral | 22:53 | |
*** rrecio has quit IRC | 23:05 | |
*** vishwanathj has quit IRC | 23:09 | |
*** bobh has joined #openstack-mistral | 23:46 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!