Tuesday, 2016-05-17

*** enykeev has quit IRC00:52
*** gyee has quit IRC00:52
*** enykeev has joined #openstack-mistral00:54
*** cheneydc has joined #openstack-mistral00:55
*** toddjohn_ has joined #openstack-mistral01:20
*** bobh has quit IRC01:36
*** bobh has joined #openstack-mistral01:49
*** toddjohn_ has quit IRC01:53
*** toddjohn_ has joined #openstack-mistral01:54
*** toddjohn_ has quit IRC01:59
*** bobh has quit IRC02:44
rakhmerovkong: I'm ok with that02:51
kongrakhmerov: ok, so let's do it02:51
rakhmerovkong: I really see it as a very useful thing in Mistral02:52
rakhmerova lot of people have already asked me when this kind of trigger will be supported02:52
kongyeah, it's useful, my concern comes from the implementation02:52
rakhmerovand I think it's good that it won't require ceilometer02:52
kongbut i'm not strong against that02:53
rakhmerovusing Ceilometer though is still an option too if someone wants it02:53
rakhmerovwe just need to teach Mistral work with signed urls02:53
rakhmerovand the thing is that they've already implemented this trigger in their own fork in IBM, I saw the presentation at the summit how it works02:54
rakhmerovit is really awesome02:54
kongrakhmerov: ok, seems they are ready for it, don't want to block such feature02:55
rakhmerovok, thank you02:56
*** bobh has joined #openstack-mistral02:56
rakhmerovkong: can you also +2 https://review.openstack.org/#/c/316578/ ?02:57
rakhmerovit removes that hack for oslo.messaging usage02:57
rakhmerovwe decided yesterday that we should remove it and find a good solution02:57
rakhmerovbecause we are broken again now with the new version of oslo.messaging02:58
openstackgerritOpenStack Proposal Bot proposed openstack/mistral: Updated from global requirements  https://review.openstack.org/31694302:58
openstackgerritOpenStack Proposal Bot proposed openstack/mistral-extra: Updated from global requirements  https://review.openstack.org/31718302:58
kongi saw that, i missed Nikolay's thoughts about it.02:58
konghacking on another library is bad idea :-(02:59
*** bobh has quit IRC03:02
openstackgerritOpenStack Proposal Bot proposed openstack/python-mistralclient: Updated from global requirements  https://review.openstack.org/31719303:02
rbradygood morning rakhmerov!03:08
*** Ravikiran_K has joined #openstack-mistral03:28
rakhmerovhparekh: can you please look at https://review.openstack.org/#/c/316578/ ?04:10
rakhmerovyesterday we agreed to remove that hack04:10
hparekhrakhmerov, yeah, sure04:10
rakhmerovthanks04:10
rakhmerovhparekh: btw, https://review.openstack.org/#/c/316961/ failed but seems like it's a different issue now04:11
rakhmerovI'll try to recheck04:11
hparekhrakhmerov, I have rechecked04:11
rakhmerovooh, ok04:11
rakhmerovI see04:12
hparekhrakhmerov,  Also gate-mistral-devstack-dsvm is failed, Isuue is it is using master branch of tempest04:12
rakhmerovyeah04:12
rakhmerovbut I suggest we don't fix it04:13
rakhmerovit's stable/liberty04:13
rakhmerovwe can't spend much time to support it04:13
hparekhShould we cherry-pick  https://review.openstack.org/#/c/290995/ ?04:14
rakhmerovlet's try04:16
rakhmerovI guess you're right04:16
rakhmerovooh, merge conflict04:16
rakhmerovsomething else is missing before this patch04:16
openstackgerritMerged openstack/mistral: Remove oslo.messaging hack since it's broken with 5.0.0 version  https://review.openstack.org/31657804:23
rakhmerovnmakhotkin: hi Nikolay, just FYI: we yesterday decided to remove that hack in rpc.py and continue to work on your patches04:26
openstackgerritOpenStack Proposal Bot proposed openstack/mistral: Updated from global requirements  https://review.openstack.org/31694304:38
*** Ravikiran_K has quit IRC04:58
openstackgerritMerged openstack/mistral-extra: Updated from global requirements  https://review.openstack.org/31718304:59
*** hparekh has quit IRC05:39
*** hparekh_ has joined #openstack-mistral05:39
*** hparekh_ has quit IRC05:39
*** hparekh has joined #openstack-mistral05:39
openstackgerritMerged openstack/python-mistralclient: Updated from global requirements  https://review.openstack.org/31719306:27
*** Bhargava has joined #openstack-mistral07:21
*** Ravikiran_K has joined #openstack-mistral07:22
*** ninag has joined #openstack-mistral07:40
*** ninag has quit IRC07:44
*** Bhargava has left #openstack-mistral07:50
*** ge has joined #openstack-mistral07:52
*** Regalla has joined #openstack-mistral07:54
*** Regalla has quit IRC08:00
*** shardy has joined #openstack-mistral08:03
*** jtomasek has joined #openstack-mistral08:04
openstackgerritMerged openstack/mistral: Updated from global requirements  https://review.openstack.org/31694308:04
*** dmk0202 has joined #openstack-mistral08:12
*** ak has joined #openstack-mistral08:24
akDo we use this https://openstack.nimeyo.com/51307/openstack-messaging-acknowledge-feature-rabbitmq-messaging in mistral ?08:24
akWhat happens in mistral when executor service restarts08:25
akHi guys, need help regarding how mistral and rabbitmq work together08:28
nmakhotkinrakhmerov, yes, I saw that already :)08:51
nmakhotkinok, no problem08:52
rakhmerovok08:52
nmakhotkinrakhmerov: btw, I've found some pika-based code of rpc-client and server on my machine08:53
rakhmerovak: acknowledgements are used but it's done in a hacky way08:53
nmakhotkinwhich I didn't submit to review08:53
rakhmerovak: a hack to do that was included in Mitaka but now we removed it and want to make it properly08:53
nmakhotkinI can share that with you if you wish08:53
rakhmerovnmakhotkin: ooh, that's awesome, can you share it?08:53
rakhmerovyes08:53
rakhmerovgithub e.g.08:54
rakhmerovak: what kind of help do you need on rabbit?08:54
nmakhotkinBut I don't sure that it works :)08:54
rakhmerovnp, it can just help us understand main concepts08:57
rakhmerovnmakhotkin: btw, I'm now completely rewriting Mistral engine, another big refactoring08:57
rakhmerovtask_handler, action_handler and default_engine08:58
rakhmerovnmakhotkin: you'll like it very much, I'm sure08:58
nmakhotkinrakhmerov: oooh08:58
rakhmerovI finally understood what our problem was with all these entangled cases08:58
rakhmerovyeah, I should finish this week08:58
rakhmerovnmakhotkin: once it's done I'd like to ask you to review it08:59
rakhmerovsince you're one of the best experts in Mistral architecture08:59
rakhmerovand impl08:59
nmakhotkinrakhmerov: ok08:59
rakhmerovok08:59
nmakhotkinno problem, I will review :)08:59
*** dmk0202 has quit IRC09:31
*** Regalla has joined #openstack-mistral09:39
ak@rakhmerov Sorry I was doing something else09:41
akBasically I am running Executor api and engine on three different machines09:41
akmy concern is if one of the executors/engine which is in middle of a task and crashes what exactly happens is the question09:42
rakhmerovak, if you use Mitaka version the action which was running will be rescheduled automatically09:44
rakhmerovso it won't be lost09:44
akyeah I am using mitaka only09:44
akCan you explain how does that happen  ?09:45
akis there a doc which does i will take a look09:45
ak@rakhmerov ??09:53
rakhmerovak, no docs, sorry09:54
rakhmerovthe mechanism is pretty simple though09:54
rakhmerovit's just a standard feature of rabbit09:54
akohk09:54
rakhmerovit supports message acknowledgment09:55
akWhat i understand is engine first make a task in running state makes a rpc call to executor wait for it to complete once thats done moves the task back to sucess/error09:55
rakhmerovwhen a client polls a message from queue the message is not actually removed from the queue09:56
akohk09:56
rakhmerovit gets removed only when a client acknowledges it09:56
rakhmerovso if rabbit lost a connection with the client before an acknowledgement is received it just resubmits the message09:56
rakhmerovso that a different client can take it09:57
akohk cool09:57
akthis is solve the executor getting restarted09:57
akbut what about engine service getting restarted ?09:57
rakhmerovak: right, your logic chain is correct09:57
rakhmerovak, it's totally ok09:57
rakhmerovengine does everything in transaction09:58
akok. For example engine make a task entry to RUNNING and then crashes09:58
akwill it get stuck there ?09:58
akohk nice09:58
rakhmerovno, it shouldn't get stuck09:58
akSo Engine will do all the above that I mentioned in one transaction ?09:59
rakhmerovalmost09:59
rakhmerov:)09:59
rakhmerovas far as persistent state updates - all transactional and atomic regardless of number of engines, workflows etc.10:00
*** cheneydc has quit IRC10:01
rakhmerovthere's a small chance though that we will get into a concurrency window when DB state is say rolled back but message is not in the queue already10:01
rakhmerovwe're aware of it and we're now in a process of fixing it10:02
rakhmerovso the honest answer: yes, it can get stuck actually10:02
rakhmerovthe thing is that it can't be solved in 100% reliable manner for fundamental reasons10:03
rakhmerovthere can be some mitigation options that we are going to implement10:03
rakhmerovrecovery scenarios10:04
akok10:10
akOhk @rakhmerov thx10:12
akPlease let me know if you are tracking this via any bug or feature request10:13
rakhmerovak: https://blueprints.launchpad.net/mistral/+spec/mistral-alternative-rpc, but this is only part of it10:13
akcool10:19
akthx a lot10:19
akbtw one last question @rajhmerov message acknowledgment is default setting right . Or do i need to enable this ?10:26
rakhmerovdefault10:27
*** toddjohn_ has joined #openstack-mistral10:31
*** ak has quit IRC10:32
*** Ravikiran_K has quit IRC10:33
*** toddjohn_ has quit IRC10:35
shardyHi all, I'm looking for advice re dependencies ref https://bugs.launchpad.net/tripleo/+bug/158265110:52
openstackLaunchpad bug 1582651 in tripleo "Mistral db-sync failure in CI jobs" [High,Triaged]10:52
shardyIs there any mechanism to blacklist or disable actions, such that e.g python-designateclient isn't a hard dependency?10:52
shardywe can install the client if needed, but we faced a similar issue with Heat, and decided to have a soft-dependency model, where plugins are disabled when the required client isn't found10:53
shardyI wondered if any similar concept existed in mistral10:53
*** ak has joined #openstack-mistral10:55
rakhmerovshardy: Hi11:01
shardyrakhmerov: Hi!11:01
*** Regalla has quit IRC11:01
rakhmerovshardy: it's not yet implemented11:01
rakhmerovbut we agreed that it should be as soon as we can11:02
shardyrakhmerov: Ok, sounds good - do you have someone already working on it, or looking for volunteers?11:02
rakhmerovwe'll move all OpenStack actions to a separate repo and it will be installed separately if needed11:02
rakhmerovnot at the moment but rbrady and myself are planning to be involved11:03
rakhmerovand dprince as well11:03
shardyrakhmerov: ack, that sounds good, I'll chat with rbrady and dprince11:03
rakhmerovI think realistic estimate is Newton-211:03
shardyrakhmerov: for now we can just install the client as a workaround11:03
rakhmerovyep11:03
rakhmerovyes, please11:03
shardyrakhmerov: I'll take another look at how we do this in Heat, the requirement is very similar, perhaps we can figure out a way to reuse/share some code11:04
rakhmerovwe're aware of that issue11:04
rakhmerovthat would be perfect11:04
shardygreat, thanks for the information! :)11:04
rakhmerovshardy: no problem11:06
*** vgnbkr has quit IRC11:09
*** vgnbkr has joined #openstack-mistral11:10
ak@rakhmerov In retry count, wait-after etc presently we can only put static values is there any feature request where we can keep dynamic values of these ?11:23
rakhmerovak: all of them can be Yaql expressions11:25
rakhmerovso they are dynamic11:25
rakhmerove.g.: wait-after: <% $.my_context_value %>11:25
akoh when was this change done ? does it work fro retry count too ?11:27
*** hparekh has quit IRC11:27
akpresently we are doing some task if it failes we delay it by 5 secs11:27
akfor the next try we want to wait for around 10 secs11:28
akbasically exponential wait time instead of wait for same time again and again11:28
*** LimorStotland has joined #openstack-mistral11:28
rakhmerovak: yes, it works almost for anything11:31
akohk11:31
akwas this change made in mitaka11:31
rakhmerovit was done long ago :)11:31
rakhmerovno, long before that11:31
aklast time i tried in some older version delay only allowed numbers11:31
rakhmerovplease try, it should work11:31
rakhmerovhm, in kilo may be11:31
rakhmerovbut in Liberty it exists, I'm sure11:31
akohk11:32
akwill take a look11:32
akdoes mistral has any plan for exponential retries ?11:34
*** hparekh has joined #openstack-mistral11:36
*** hparekh has quit IRC11:36
*** hparekh has joined #openstack-mistral11:36
rakhmerovyeah, we thought about it11:37
rakhmerovbut no specific plans at the moment11:37
rakhmerovcan you file a blueprint for that?11:37
rakhmerovit's relatively easy to implement11:38
*** hparekh has quit IRC11:50
*** dmk0202 has joined #openstack-mistral11:52
ak@rakhmerov sure I will try to put, never did it, new to open source and open stack11:55
akwill ask one of my friend and will try to post one11:55
rakhmerovthat's no problem, nothing is hard here )11:56
rakhmerovit's easy11:56
rakhmerovjust go to https://blueprints.launchpad.net/mistral11:56
rakhmerovthen see if a similar BP exists11:56
rakhmerovif it doesn't then push "Register a blueprint"11:57
rakhmerovthat's it11:57
*** hparekh has joined #openstack-mistral11:58
*** bobh has joined #openstack-mistral12:06
*** dprince has joined #openstack-mistral12:08
*** hparekh has quit IRC12:10
*** hparekh has joined #openstack-mistral12:11
*** hparekh has quit IRC12:18
*** bobh has quit IRC12:24
*** hparekh has joined #openstack-mistral12:37
*** toddjohn_ has joined #openstack-mistral12:39
*** ak has quit IRC12:41
*** ninag has joined #openstack-mistral13:06
*** bobh has joined #openstack-mistral13:13
*** toddjohn_ has quit IRC13:18
*** openstackgerrit has quit IRC13:32
*** openstackgerrit has joined #openstack-mistral13:33
mfloboHi, I have a question about mistral and custom actions13:57
mfloboIs there any tutorial to learn how to define custom actions in Mistral?13:57
*** ninag has quit IRC14:00
*** ninag_ has joined #openstack-mistral14:03
*** ninag_ has quit IRC14:06
*** ninag_ has joined #openstack-mistral14:06
*** ninag_ has quit IRC14:10
*** ninag has joined #openstack-mistral14:11
*** tonytan4ever has joined #openstack-mistral14:14
*** ninag has quit IRC14:15
*** Ravikiran_K has joined #openstack-mistral14:23
*** ninag has joined #openstack-mistral14:54
*** rena9067_ has joined #openstack-mistral14:56
*** ninag has quit IRC15:02
*** Ravikiran_K has quit IRC15:02
*** ninag has joined #openstack-mistral15:03
*** ninag has quit IRC15:05
*** ninag has joined #openstack-mistral15:05
*** tonytan4ever has quit IRC15:05
*** ninag has quit IRC15:06
*** ninag has joined #openstack-mistral15:07
*** ninag has quit IRC15:11
*** rena9067_ has quit IRC15:14
*** rena9067 has joined #openstack-mistral15:14
*** toddjohn_ has joined #openstack-mistral15:24
*** toddjoh__ has joined #openstack-mistral15:26
*** toddjohn_ has quit IRC15:28
*** toddjoh__ has quit IRC15:31
*** dmk0202 has quit IRC15:33
*** gyee has joined #openstack-mistral15:36
*** toddjohn_ has joined #openstack-mistral15:36
*** toddjohn_ has quit IRC15:39
*** rlanda has joined #openstack-mistral15:40
rlandaHello all - is there a mistal users channel for simple questions and such?15:41
*** mgershen has joined #openstack-mistral15:42
*** toddjohn_ has joined #openstack-mistral15:47
*** ninag has joined #openstack-mistral15:53
*** ninag has quit IRC15:55
*** ninag has joined #openstack-mistral15:55
*** toddjohn_ has quit IRC15:57
*** gokrokve has joined #openstack-mistral15:59
*** rlanda has left #openstack-mistral16:08
*** toddjohn_ has joined #openstack-mistral16:12
*** toddjohn_ has quit IRC16:12
rena9067mflobo: http://docs.openstack.org/developer/mistral/developer/creating_custom_action.html16:19
*** toddjohn_ has joined #openstack-mistral16:20
*** jtomasek has quit IRC16:22
*** toddjohn_ has quit IRC16:24
*** ninag has quit IRC16:28
*** ninag has joined #openstack-mistral16:29
*** ninag has quit IRC16:32
*** ninag has joined #openstack-mistral16:32
*** ninag has quit IRC16:32
*** ninag has joined #openstack-mistral16:33
*** ninag has quit IRC16:37
*** gyee has quit IRC17:00
*** ninag has joined #openstack-mistral17:03
*** toddjohn_ has joined #openstack-mistral17:05
*** ninag has quit IRC17:05
*** ninag has joined #openstack-mistral17:06
*** toddjoh__ has joined #openstack-mistral17:06
*** gyee has joined #openstack-mistral17:08
*** ninag_ has joined #openstack-mistral17:09
*** ninag has quit IRC17:10
*** toddjohn_ has quit IRC17:10
*** ninag has joined #openstack-mistral17:10
*** ninag_ has quit IRC17:14
*** rena9067 has quit IRC17:14
openstackgerritMerged openstack/mistral: Updated from global requirements  https://review.openstack.org/31748717:19
*** tonytan4ever has joined #openstack-mistral17:35
*** rena9067 has joined #openstack-mistral17:37
*** ninag has quit IRC17:37
*** ninag has joined #openstack-mistral17:37
*** hparekh has quit IRC17:50
*** hparekh has joined #openstack-mistral17:52
*** toddjoh__ has quit IRC18:11
*** toddjohn_ has joined #openstack-mistral18:12
openstackgerritMerged openstack/python-mistralclient: Updated from global requirements  https://review.openstack.org/31750418:17
*** toddjohn_ has quit IRC18:53
*** toddjohn_ has joined #openstack-mistral18:55
*** gyee has quit IRC19:33
*** gokrokve has quit IRC19:36
*** dprince has quit IRC19:41
*** toddjohn_ has quit IRC19:54
*** toddjohn_ has joined #openstack-mistral19:57
*** ninag has quit IRC20:01
*** ninag has joined #openstack-mistral20:01
*** toddjohn_ has quit IRC20:02
*** toddjohn_ has joined #openstack-mistral20:02
*** ninag_ has joined #openstack-mistral20:04
*** ninag has quit IRC20:06
*** toddjohn_ has quit IRC20:08
*** toddjohn_ has joined #openstack-mistral20:08
*** ninag_ has quit IRC20:09
*** toddjohn_ has quit IRC20:12
*** ninag has joined #openstack-mistral20:15
*** ninag has quit IRC20:16
*** ninag has joined #openstack-mistral20:17
*** ninag has quit IRC20:17
*** ninag has joined #openstack-mistral20:17
*** ninag has quit IRC20:18
*** dmk0202 has joined #openstack-mistral20:29
*** gyee has joined #openstack-mistral20:40
*** tonytan_brb has joined #openstack-mistral20:46
*** tonytan4ever has quit IRC20:49
*** shardy has quit IRC20:53
*** toddjohn_ has joined #openstack-mistral20:54
*** ninag has joined #openstack-mistral20:54
*** ninag has quit IRC20:57
*** ninag has joined #openstack-mistral21:09
*** ninag has quit IRC21:09
*** toddjohn_ has quit IRC21:10
*** dmk0202 has quit IRC21:10
*** toddjohn_ has joined #openstack-mistral21:11
*** toddjohn_ has quit IRC21:15
*** bobh has quit IRC21:21
*** Ravikiran_K has joined #openstack-mistral21:24
*** tonytan_brb has quit IRC21:26
*** bobh has joined #openstack-mistral21:58
*** bobh has quit IRC22:12
*** toddjohn_ has joined #openstack-mistral22:15
*** toddjoh__ has joined #openstack-mistral22:16
*** ninag has joined #openstack-mistral22:17
*** ninag has quit IRC22:17
*** toddjo___ has joined #openstack-mistral22:17
*** toddj____ has joined #openstack-mistral22:19
*** toddjohn_ has quit IRC22:19
*** toddjoh__ has quit IRC22:20
*** ninag_ has joined #openstack-mistral22:21
*** toddjo___ has quit IRC22:21
*** Ravikiran_K has quit IRC22:23
*** toddj____ has quit IRC22:23
*** ninag_ has quit IRC22:25
*** ninag has joined #openstack-mistral22:42
*** ninag has quit IRC22:46
*** toddjohn_ has joined #openstack-mistral22:54
*** toddjohn_ has quit IRC22:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!