Monday, 2017-10-30

*** yangyapeng has quit IRC00:02
*** bobh has joined #openstack-mistral00:30
*** bobh has quit IRC01:10
*** yangyapeng has joined #openstack-mistral01:11
*** daidv has joined #openstack-mistral01:15
*** yangyapeng has quit IRC01:29
*** yangyapeng has joined #openstack-mistral01:29
*** yangyape_ has joined #openstack-mistral01:40
*** yangyapeng has quit IRC01:41
*** daidv has quit IRC01:50
*** daidv has joined #openstack-mistral01:51
*** bobh has joined #openstack-mistral02:06
*** gkadam has quit IRC02:06
*** daidv has quit IRC02:23
*** daidv has joined #openstack-mistral02:24
*** bobh has quit IRC03:08
*** daidv has quit IRC03:18
*** daidv has joined #openstack-mistral03:19
*** gkadam has joined #openstack-mistral03:32
*** gkadam has quit IRC03:32
*** gkadam has joined #openstack-mistral03:32
*** daidv has quit IRC03:40
*** daidv has joined #openstack-mistral03:41
*** rbrady is now known as rbrady-afk03:41
*** daidv has quit IRC04:13
*** daidv has joined #openstack-mistral04:14
*** Dinesh_Bhor has joined #openstack-mistral04:14
openstackgerritRenat Akhmerov proposed openstack/mistral master: 'all' parameter breaks task context  https://review.openstack.org/51038404:21
rakhmerovd0ugal: good morning, can you fix https://review.openstack.org/#/c/515749 so that we can merge it?04:31
*** jaosorior has joined #openstack-mistral04:54
*** katkapilatova has quit IRC05:15
*** katkapilatova has joined #openstack-mistral05:15
*** yangyape_ has quit IRC05:24
*** yangyapeng has joined #openstack-mistral05:25
*** zhurong has joined #openstack-mistral05:48
*** Kevin_Zheng has quit IRC06:01
*** jtomasek has joined #openstack-mistral06:26
*** ijiqiupgcp has joined #openstack-mistral07:20
*** ijiqiupgcp has quit IRC07:20
*** AlexeyAbashkin has joined #openstack-mistral07:23
d0ugalrakhmerov: I can try, but gerrit isn't loading for me now07:52
rakhmerovщл07:58
rakhmerovok07:58
rakhmerovd0ugal: I won't be able to attend the meeting today07:59
rakhmerovagain07:59
apetrichd0ugal, I thought it was just me07:59
rakhmerovhopefully next time I'll be already fine07:59
d0ugalrakhmerov: okay, that is a shame. Somebody from tripleo was hoping to come and talk about eventlet :)07:59
apetrich35 mins to post a comment07:59
d0ugalrakhmerov: no worries, I'll see if they can come in here and ask about it.07:59
rakhmerovd0ugal: eventlet? :)07:59
rakhmerovwhat's the context? I didn't get it07:59
d0ugalrakhmerov: yeah and something about our monkeypatching.08:00
rakhmerovooh08:00
d0ugalI don't remember it fully, but it is causing a problem with an aciton they are trying to write08:00
rakhmerovd0ugal: I'm really sorry, it's quite a critical situation for us now08:00
rakhmerovooh, really?08:00
rakhmerovhm...08:00
d0ugalrakhmerov: sure, that is fine. I'll see if they can come in here earlier and then maybe you'll be around08:00
rakhmerovyes08:00
rakhmerovI can spend some time discussing that, yes08:01
d0ugalthanks08:01
rakhmerovd0ugal: do you remember who it was?08:01
d0ugalrakhmerov: social in #tripleo08:01
rakhmerovok08:01
d0ugalI forget where they live, but I think somewhere in the US08:01
rakhmerovbut not Bob, right?08:02
d0ugalapetrich: did you manage to post the comment? It just fails really slowly for me08:02
rakhmerovooh, gosh...08:02
d0ugalrakhmerov: not Bob08:02
rakhmerov(I need rest)08:02
d0ugal:)08:02
rakhmerovBob is from Nokia! :)08:02
d0ugalI thought Bob was from Nokia haha08:02
rakhmerovhe is, yes!08:02
apetrichd0ugal, finally did08:02
d0ugalrakhmerov: can you remember what needs fixing in that review? I have the code locally (the mistral-lib patch, right?) but I can't see gerrit still.08:03
apetrichd0ugal, that was my comment08:03
rakhmerovd0ugal: one test is failing08:04
rakhmerovto check deprecations08:04
apetrichd0ugal, action context is still using target_id08:04
d0ugaloh really08:04
apetrichthe review didn't go in for the task_execution_id08:04
d0ugalThey pass locally!08:04
rakhmerovd0ugal: unexpected keyword argument "task_execution_id" in __init__08:04
apetrichs/target_/task_/08:04
d0ugalUnless I have a different copy than is on gerrit, but I don't know how that would happen08:05
d0ugalI guess I'll wait. I probably can't submit a change anyway08:05
rakhmerovyes08:05
* d0ugal is about to reboot08:32
d0ugal\quit08:34
d0ugalumm08:34
*** d0ugal has quit IRC08:34
*** d0ugal has joined #openstack-mistral08:35
*** d0ugal has quit IRC08:35
*** d0ugal has joined #openstack-mistral08:35
*** d0ugal has quit IRC08:35
openstackgerritDougal Matthews proposed openstack/mistral-lib master: Add deprecated context parameters to the new security context  https://review.openstack.org/51574908:35
openstackgerritDougal Matthews proposed openstack/mistral-lib master: Rename task_id to task_execution_id  https://review.openstack.org/51467508:35
*** d0ugal has joined #openstack-mistral08:40
*** d0ugal has joined #openstack-mistral08:40
*** d0ugal has quit IRC08:40
apetrichI miss d0ugal08:44
apetrichand gerrit08:44
*** oidgar has joined #openstack-mistral08:45
*** d0ugal has joined #openstack-mistral08:48
*** social has joined #openstack-mistral09:16
socialmornin09:16
d0ugalHey09:17
d0ugalrakhmerov: social joined here :)09:17
rakhmerovhi09:17
rakhmerovyes09:17
socialjust gimme sec, booting up, coffee does not work yet09:18
rakhmerovok09:18
d0ugal:)09:18
socialTLDR: https://review.openstack.org/#/c/511254/ -> ansible uses multiprocessing which fails because of eventlet monkeypatching os and threads -> https://github.com/eventlet/eventlet/issues/42509:19
socialso question a) can we not monkeypatch os and threads (I guess there will be more =[) b) should I find workaround where I add patch to mistral to save original modules and provide it to actions so I can load _multiprocessing and override the impot?09:20
socialb is long enough to know it's not really good way09:20
rakhmerovsocial: I believe "a" is hardly feasible09:21
rakhmerovat least for threads09:21
rakhmerovbut b) actually makes more sense to me09:22
rakhmerovsince generally speaking actions are supposed to run on a separate component, executor09:22
socialthe issue there is that it should work in theory but I don't have enough insides of python to be able to say where exactly I should override it09:22
rakhmerovnot engine09:22
socialhmm09:22
socialcan we monkeypatch per component?09:23
socialI mean no monekypatching on executor?09:23
rakhmerovsocial: that's what I'm thinking, yes09:23
rakhmerovyes09:23
d0ugalI think eventually we want actions to run outside the Mistral process - this would solve problems like this09:23
rakhmerovyeah, the only thing now is that actions can now run on local/embedded executor09:25
rakhmerovessentially on the engine side09:25
rakhmerovin this case it won't probably work09:25
socialrakhmerov: in that case should I just fail to run the action or still work on b)09:27
rakhmerovthinking..09:27
*** d0ugal has quit IRC09:28
rakhmerovwell, so, as an option (although I don't really like it much) we could do monkeypatching per component (skip it for remote executors) but using local executors would be just limited in this way09:28
rakhmerovand documented and so on..09:28
socialrakhmerov: how much work you think it is? I think we need this quite asap as running ansible without any feedback for user is kinda wrong09:31
socialrakhmerov: so other option except adding ansible python is to just stream the output of running ansible back09:32
rakhmerovsocial: I don't think it's too much work but we'll need someone's help, indeed09:32
rakhmerovneed to find someone who could take care of that09:32
rakhmerovsocial: I also need to read about the problem itself, I wonder what's wrong with it09:33
rakhmerovmaybe it should be just configured somehow to monkeypatch multiprocessing correctly?09:33
rakhmerovwe found a similar issue with MySQLdb driver and found that it was already fixed in some of the latest eventlet versions09:34
rakhmerovthey just have a flag for that now09:34
*** shardy has joined #openstack-mistral09:34
*** matbu has joined #openstack-mistral09:36
socialrakhmerov: so you mean closing https://github.com/eventlet/eventlet/issues/425 ? :)09:37
*** d0ugal has joined #openstack-mistral09:38
rakhmerovsorry, I just didn't read carefully yet09:38
d0ugalsocial, rakhmerov - sorry, my connection dropped. not sure if I missed anything09:39
rakhmerovsocial: I don't think it's too much work but we'll need someone's help, indeed09:40
rakhmerovrakhmerov09:40
rakhmerovneed to find someone who could take care of that09:40
rakhmerovrakhmerov09:40
rakhmerovsocial: I also need to read about the problem itself, I wonder what's wrong with it09:40
rakhmerovrakhmerov09:41
rakhmerovmaybe it should be just configured somehow to monkeypatch multiprocessing correctly?09:41
rakhmerovrakhmerov09:41
rakhmerovwe found a similar issue with MySQLdb driver and found that it was already fixed in some of the latest eventlet versions09:41
rakhmerovrakhmerov09:41
rakhmerovthey just have a flag for that now09:41
rakhmerov(last few lines is what I said before)09:41
d0ugalaha, thanks.09:41
rakhmerovnp )09:41
rakhmerovd0ugal, social: so I think b) is not that difficult to do09:41
rakhmerovhope so09:42
openstackgerritDougal Matthews proposed openstack/mistral master: Pass the new ActionContext to mistral-lib  https://review.openstack.org/50618509:42
openstackgerritDougal Matthews proposed openstack/mistral master: Use the new action context in MistralHTTPAction  https://review.openstack.org/50550809:42
openstackgerritDougal Matthews proposed openstack/mistral master: Remove the __init__ method from the test action  https://review.openstack.org/51306109:42
openstackgerritDougal Matthews proposed openstack/mistral master: Rename task_id to task_execution_id  https://review.openstack.org/51468809:42
rakhmerovsocial: can you file a bug at Launchpad?09:42
rakhmerovplease09:42
rakhmerovso that we don't lose the info09:42
socialon it09:42
rakhmerovthanks09:43
openstackgerritDougal Matthews proposed openstack/mistral master: WIP Test to demonstrate that task() doesn't work in continue-on  https://review.openstack.org/51622709:50
openstackgerritDougal Matthews proposed openstack/mistral-lib master: Rename task_id to task_execution_id  https://review.openstack.org/51467509:50
socialrakhmerov: https://bugs.launchpad.net/mistral/+bug/1728552 I hope it makes some sense09:53
openstackLaunchpad bug 1728552 in Mistral "mistral should not monkeypatch executor" [Undecided,New]09:53
d0ugalrakhmerov: are you aware of this limitation? https://review.openstack.org/#/c/516227/ (see the comments)09:53
d0ugalsocial: thanks!09:53
socialand about the ansible via python api, should we create some bug for that too and target it for qeens?09:56
socialwe kinda need it in pike but I understand it's too late09:57
d0ugalqueens seems more realistic09:57
d0ugalwhen we have a fix I guess we can evaluate how hard it would be to backport09:57
*** zhurong has quit IRC10:05
*** yangyapeng has quit IRC10:08
*** yangyapeng has joined #openstack-mistral10:09
*** yangyapeng has quit IRC10:13
rakhmerovd0ugal: nope10:14
rakhmerovinteresting..10:14
d0ugalrakhmerov: I am trying to figure out how to fix it. I managed to break tripleo CI by removing the task name in a continue-on... :(10:15
*** gkadam_ has joined #openstack-mistral10:20
*** gkadam_ has quit IRC10:20
*** zhurong has joined #openstack-mistral10:20
*** thrash|bbl is now known as thrash11:00
*** jtomasek has quit IRC11:21
*** jtomasek has joined #openstack-mistral11:51
*** dprince has joined #openstack-mistral12:16
*** yangyapeng has joined #openstack-mistral12:20
mfedosinrakhmerov: d0ugal hey folks! do you have 5 minutes to reach an agreement on https://review.openstack.org/#/c/514055/4 ?12:21
mfedosinfirst of all, I agree with rakhmerov's comment and I will update the patch12:21
mfedosinbut my main concern is the api impact12:22
mfedosinbecause after this patch we can't guarantee that the listing results will be the same all the time12:23
mfedosin(name and created_at are not unique fields)12:23
mfedosinso, we have two options:12:24
mfedosinif we are okay with the small api impact we can proceed as is12:24
mfedosinor I can append the lists of default sorting parameters with 'id'12:25
mfedosinfor example, here it will be sort_keys='created_at,id' https://github.com/openstack/mistral/blob/master/mistral/api/controllers/v2/workflow.py#L19812:26
mfedosinI suppose the second option is better12:26
mfedosintell me what you think12:26
*** gkadam has quit IRC12:37
*** shardy is now known as shardy_lunch12:42
*** zhurong has quit IRC12:50
rakhmerovmfedosin: my opinion, I'd leave it as it's in your latest patchset12:58
rakhmerovd0ugal: what do you think?12:58
*** apetrich has quit IRC13:30
*** jtomasek_ has joined #openstack-mistral13:30
*** apetrich has joined #openstack-mistral13:30
d0ugalrakhmerov: just back from lunch. Reading.13:31
*** jtomasek has quit IRC13:32
d0ugalmfedosin, rakhmerov - I am fine with how you done it in the latest patchset too13:33
mfedosinrakhmerov: d0ugal thanks! I'll update the patch in a minute13:33
*** shardy_lunch is now known as shardy13:46
*** vishwanathj has joined #openstack-mistral14:34
openstackgerritBrad P. Crochet proposed openstack/mistral master: DNM: TEST Zuul v3 jobs  https://review.openstack.org/50942814:46
openstackgerritLukas Bezdicka proposed openstack/mistral master: Don't monkeypatch the executor  https://review.openstack.org/51634515:13
*** AlexeyAbashkin has quit IRC15:30
*** AlexeyAbashkin has joined #openstack-mistral15:31
*** AlexeyAbashkin has quit IRC15:35
*** thrash is now known as thrash|biab15:42
*** harlowja has joined #openstack-mistral17:19
*** AlexeyAbashkin has joined #openstack-mistral17:30
*** thrash|biab is now known as thrash17:33
*** AlexeyAbashkin has quit IRC17:35
*** oidgar has quit IRC17:41
*** dprince has quit IRC17:50
*** social has quit IRC18:29
*** dprince has joined #openstack-mistral18:37
*** dprince has quit IRC19:01
*** dprince has joined #openstack-mistral19:01
*** AlexeyAbashkin has joined #openstack-mistral19:10
openstackgerritToure Dunnon proposed openstack/mistral master: [WIP] Running new workflow based on an existing execution.  https://review.openstack.org/50665219:12
*** shardy has quit IRC19:14
openstackgerritMike Fedosin proposed openstack/mistral master: Normalize sorting  https://review.openstack.org/51405519:17
openstackgerritToure Dunnon proposed openstack/python-mistralclient master: [WIP] Running new workflow based on existing execution.  https://review.openstack.org/50665319:52
*** toure is now known as toure_biab20:01
*** bobh has joined #openstack-mistral20:06
*** bobh has quit IRC20:18
*** bobh has joined #openstack-mistral20:22
*** AlexeyAbashkin has quit IRC20:37
*** bobh has quit IRC20:39
*** jtomasek_ has quit IRC20:58
*** thrash is now known as thrash|g0ne21:30
*** dprince has quit IRC22:02
*** AlexeyAbashkin has joined #openstack-mistral22:29
*** AlexeyAbashkin has quit IRC22:33
*** AlexeyAbashkin has joined #openstack-mistral23:29
*** AlexeyAbashkin has quit IRC23:33
*** bobh has joined #openstack-mistral23:47
*** histrio has quit IRC23:51

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!