Wednesday, 2017-10-18

*** bobh has joined #openstack-mistral00:13
*** bobh has quit IRC00:33
*** yangyapeng has quit IRC00:51
*** yangyapeng has joined #openstack-mistral00:51
*** yangyapeng has quit IRC00:56
*** AlexeyAbashkin has joined #openstack-mistral01:23
*** AlexeyAbashkin has quit IRC01:27
*** bobh has joined #openstack-mistral01:36
*** bobh has quit IRC01:37
*** yangyapeng has joined #openstack-mistral01:48
*** yangyape_ has joined #openstack-mistral01:49
*** yangyapeng has quit IRC01:52
*** AlexeyAbashkin has joined #openstack-mistral02:23
*** AlexeyAbashkin has quit IRC02:27
*** chlong has quit IRC02:47
*** openstackgerrit has quit IRC03:22
*** AlexeyAbashkin has joined #openstack-mistral03:23
*** AlexeyAbashkin has quit IRC03:27
*** gkadam has joined #openstack-mistral03:55
*** int32bit has joined #openstack-mistral04:15
*** int32bit has quit IRC04:16
*** int32bit has joined #openstack-mistral04:17
*** int32bit has quit IRC04:18
*** int32bit has joined #openstack-mistral04:18
*** int32bit has quit IRC04:19
*** int32bit has joined #openstack-mistral04:20
*** int32bit has quit IRC04:21
*** int32bit has joined #openstack-mistral04:22
*** int32bit has quit IRC04:23
*** int32bit has joined #openstack-mistral04:23
*** int32bit has quit IRC04:24
*** int32bit has joined #openstack-mistral04:25
*** int32bit has quit IRC04:26
*** int32bit has joined #openstack-mistral04:26
*** int32bit has quit IRC04:27
*** int32bit has joined #openstack-mistral05:06
*** int32bit has quit IRC05:07
*** int32bit has joined #openstack-mistral05:08
*** int32bit has quit IRC05:09
*** int32bit has joined #openstack-mistral05:10
*** int32bit has quit IRC05:11
*** int32bit has joined #openstack-mistral05:12
*** int32bit has quit IRC05:13
*** int32bit has joined #openstack-mistral05:13
*** int32bit has quit IRC05:14
*** int32bit has joined #openstack-mistral05:15
*** int32bit has quit IRC05:16
*** int32bit has joined #openstack-mistral05:17
*** int32bit has quit IRC05:18
*** int32bit has joined #openstack-mistral05:18
*** int32bit has quit IRC05:19
*** int32bit has joined #openstack-mistral05:20
*** int32bit has quit IRC05:21
*** int32bit has joined #openstack-mistral05:22
*** int32bit has quit IRC05:23
*** shardy has quit IRC05:23
*** int32bit has joined #openstack-mistral05:23
*** int32bit has quit IRC05:24
*** int32bit has joined #openstack-mistral05:25
*** shardy has joined #openstack-mistral05:25
*** int32bit has quit IRC05:28
*** int32bit has joined #openstack-mistral05:51
*** int32bit has quit IRC05:52
*** int32bit has joined #openstack-mistral05:53
*** int32bit has quit IRC05:54
*** int32bit has joined #openstack-mistral05:55
*** int32bit has quit IRC05:56
*** jtomasek has joined #openstack-mistral06:42
*** jtomasek has quit IRC06:44
*** jtomasek has joined #openstack-mistral06:44
*** jpich has joined #openstack-mistral07:05
*** shardy is now known as shardy_afk07:26
*** AlexeyAbashkin has joined #openstack-mistral07:57
*** shardy_afk is now known as shardy08:00
*** rook has quit IRC08:07
*** weshay|ruck has quit IRC08:07
*** rook has joined #openstack-mistral08:08
*** rook is now known as Guest8382808:09
*** weshay has joined #openstack-mistral08:09
*** Qiming_ has joined #openstack-mistral08:25
*** Qiming has quit IRC08:28
*** jrist has quit IRC08:30
*** int32bit has joined #openstack-mistral08:39
*** int32bit has quit IRC08:41
*** int32bit has joined #openstack-mistral08:41
*** int32bit has quit IRC08:43
*** int32bit has joined #openstack-mistral08:43
*** int32bit has quit IRC08:44
*** int32bit has joined #openstack-mistral08:45
*** int32bit has quit IRC08:46
*** int32bit has joined #openstack-mistral08:47
*** int32bit has quit IRC08:48
*** jtomasek has quit IRC08:48
*** int32bit has joined #openstack-mistral08:49
*** jtomasek has joined #openstack-mistral08:49
*** int32bit has quit IRC08:51
*** int32bit has joined #openstack-mistral08:52
*** int32bit has quit IRC08:53
*** int32bit has joined #openstack-mistral08:54
*** int32bit has quit IRC08:55
*** int32bit has joined #openstack-mistral08:55
*** int32bit has quit IRC08:57
*** int32bit has joined #openstack-mistral08:57
*** int32bit has quit IRC08:58
*** int32bit has joined #openstack-mistral08:59
*** int32bit has quit IRC09:00
*** int32bit has joined #openstack-mistral09:01
*** int32bit has quit IRC09:02
*** int32bit has joined #openstack-mistral09:02
*** int32bit has quit IRC09:03
*** int32bit has joined #openstack-mistral09:04
*** int32bit has quit IRC09:05
*** int32bit has joined #openstack-mistral09:06
*** int32bit has quit IRC09:07
*** int32bit has joined #openstack-mistral09:07
*** int32bit has quit IRC09:08
*** openstackgerrit has joined #openstack-mistral09:17
openstackgerritDougal Matthews proposed openstack/mistral master: Allow filtering executions by their root_execution_id  https://review.openstack.org/49056209:17
openstackgerritDougal Matthews proposed openstack/mistral master: Add the Ironic wait_for_provision_state action  https://review.openstack.org/50626809:23
*** AlexeyAbashkin has quit IRC09:49
xavierhardyHi everyone10:07
xavierhardyI have the impression that "openstack_actions_mapping_path" has not been added to the DEFAULT group in the configuration in Mistral pike.10:08
*** yangyape_ has quit IRC10:09
d0ugalxavierhardy: I believe that is because it isn't intended to be used in the config file10:10
d0ugalonly on the CLI10:10
d0ugalhttps://github.com/openstack/mistral/blob/481fb31bd1d75de4d8e44aa9d3f171d9c6f51296/mistral/config.py#L354-L35510:10
*** Guest83828 is now known as rook10:18
rakhmerovyes, correct10:30
rakhmerovd0ugal: can you please review https://review.openstack.org/#/c/512520/ ?10:32
d0ugalrakhmerov: sure10:33
rakhmerovthanks10:33
d0ugalrakhmerov: "Why do we run cron triggers in the API layer?" - I have wondered this before :)10:34
rakhmerovyeah :)10:34
d0ugalI think I noticed because cron logs end up in the API log file which is strange10:34
rakhmerovyes10:34
rakhmerovso, well it was obviously a bad decision to place it there10:35
rakhmerovbut I think the rationale was "it's not part of the core functionality, it's just a triggering mechanism so let's make it outside of engine. Where? API is the only visible choice"10:35
rakhmerovI guess that was our naive logic10:36
d0ugalRight. I guess that makes sense.10:36
rakhmerovwe'll move it out10:36
d0ugalso does this mean you don't use cron triggers?10:36
rakhmerovnope10:36
rakhmerovat Nokia, no10:36
rakhmerovbtw, there are some other problems with cron triggers that I found 2 days ago10:37
rakhmerovthe bottom line is: they can't be used now in HA mode10:37
d0ugalrakhmerov: I'm aware of one problem :) one of my colleagues is going to open a bug10:37
d0ugaloh, that isn't good.10:37
rakhmerovat least with a large number of nodes (API nodes, aah.. sounds crazy)10:37
rakhmerovyeah10:37
rakhmerovit is not10:37
rakhmerovwe fixed a number of issues with Scheduler to make it more stable in HA (although we need to change its design still)10:38
rakhmerovbut cron triggers are not based on it10:38
rakhmerovit's a completely separate mechanism10:38
rakhmerov=> has similar issues10:38
d0ugalThe problem we noticed was with cron triggers that run every minute - they stop for a while for no reason. maybe for 5 mins it just wont trigger.10:38
rakhmerovyep10:39
rakhmerovprobably because of the load10:39
rakhmerovor its TX hit a DB deadlock10:39
d0ugalmaybe, but the workflow was very fast10:39
d0ugalah, maybe that10:39
d0ugalI need to do some more testing with it10:39
rakhmerovok10:39
rakhmerovso I have to admit that it's not stable now, with multiple nodes10:40
rakhmerovwith 1 node it should work ok10:40
d0ugalRight10:40
d0ugalNow we only use it for a workflow that runs every hour10:40
d0ugalbut as we are looking at more cases I'll probably have to try and find time to improve it10:41
rakhmerovok10:41
rakhmerovjust FYI: both Scheduler (which is heavily used in engine) and cron triggers now have a fundamental design problem10:41
rakhmerovthey both can't be scaled well10:42
d0ugaluh oh :)10:42
rakhmerovI'm trying to make it work more or less decently for now with the current design but we'll have to fix that in a more fundamental way10:42
rakhmerovd0ugal: sorry that I didn't ask you before and now I have to leave again (will be back in ~3 hours). So, do we know on 100% if making those migrations idempotent is all we need to backport those 2 patches?10:44
rakhmerovif it's that simple, we can do it10:44
d0ugalrakhmerov: I don't know.10:44
rakhmerov:)10:44
d0ugalI actually don't understand why making them idempotent would help10:45
d0ugalAlembic stores the migration state, so it wouldn't normally run them twice10:45
rakhmerovmy guess is that in this case it's safe to apply them more than once10:45
rakhmerovwell, true10:46
rakhmerovyes10:46
rakhmerovhm...10:46
rakhmerovok, I'll try to discuss that more with the release team10:46
rakhmerovd0ugal: one more thing, I just noticed that https://review.openstack.org/#/c/506268/ is still not approved10:46
rakhmerovdo you need it in Pike?10:47
rakhmerovsoon?10:47
d0ugalrakhmerov: no, only queens10:47
rakhmerovooh, ok10:47
d0ugalThere isn't a big rush really, but it would be nice to remove it from my queue10:47
rakhmerovyeah10:47
rakhmerovAndras is on vacation now10:47
rakhmerovI'll ask Nikolay10:48
rakhmerovor someone else10:48
d0ugalrakhmerov: it is okay, we can easily work around it10:48
d0ugalhttps://github.com/openstack/tripleo-common/blob/master/workbooks/baremetal.yaml#L79-L8610:48
d0ugal^ just like we do here :)10:48
rakhmerov:)10:48
d0ugalit would just be more efficient to use the client method10:49
rakhmerovok10:49
rakhmerovI'm off for now..10:49
d0ugalokay, cya!10:49
d0ugalrakhmerov: btw, I think the simplest solution would be to reverse the migrations in master and only backport one - I can do this if you want, it would be trivial10:50
apetrichd0ugal, after some thought I think that is a better solution10:53
*** int32bit has joined #openstack-mistral10:54
*** AlexeyAbashkin has joined #openstack-mistral10:55
d0ugalThere is only one narrow case where it will break users. If you are running master and have 23 applied but not 24. Then when you upgrade to the latest master it will try and apply 24, but it will be reversed and you will really try to apply the same one twice and be missing the other one10:56
d0ugal... but I think that is a small risk.10:56
*** int32bit has quit IRC10:59
apetrichaye11:00
*** chlong has joined #openstack-mistral11:01
*** jrist has joined #openstack-mistral11:09
*** thrash|g0ne is now known as thrash11:15
d0ugalthrash: ^ what do you think of that idea (my last 3 msgs). Just seen your email on the list.11:26
*** yangyapeng has joined #openstack-mistral11:45
*** oidgar has joined #openstack-mistral12:07
*** Dinesh_Bhor has quit IRC12:09
*** dprince has joined #openstack-mistral12:12
xavierhardyOK, you register it directly in sync_db.py12:21
xavierhardyOK12:21
*** gkadam has quit IRC12:34
*** toure_biab is now known as toure12:56
*** shardy has quit IRC13:00
*** shardy has joined #openstack-mistral13:00
*** oidgar has quit IRC13:02
*** shardy has quit IRC13:11
*** shardy has joined #openstack-mistral13:13
*** oidgar has joined #openstack-mistral13:18
*** oidgar has quit IRC13:27
openstackgerritMerged openstack/mistral master: Add the Ironic wait_for_provision_state action  https://review.openstack.org/50626813:33
*** oidgar has joined #openstack-mistral13:37
openstackgerritMike Fedosin proposed openstack/python-mistralclient master: Fix several problems in keycloak auth module  https://review.openstack.org/50726914:07
*** oidgar has quit IRC14:09
openstackgerritDougal Matthews proposed openstack/mistral-lib master: Add an empty __init__ method to the base Action class  https://review.openstack.org/51306014:52
*** chlong has quit IRC14:52
openstackgerritDougal Matthews proposed openstack/mistral master: Use the new action context in MistralHTTPAction  https://review.openstack.org/50550814:59
openstackgerritDougal Matthews proposed openstack/mistral master: Remove the __init__ method from the test action  https://review.openstack.org/51306114:59
d0ugalTIL ^15:12
*** catintheroof has joined #openstack-mistral15:13
openstackgerritDougal Matthews proposed openstack/mistral master: Pass the new ActionContext to mistral-lib  https://review.openstack.org/50618515:29
openstackgerritDougal Matthews proposed openstack/mistral master: Use the new action context in MistralHTTPAction  https://review.openstack.org/50550815:29
openstackgerritDougal Matthews proposed openstack/mistral master: Remove the __init__ method from the test action  https://review.openstack.org/51306115:29
openstackgerritDougal Matthews proposed openstack/mistral master: Allow filtering executions by their root_execution_id  https://review.openstack.org/49056215:31
*** jpich has quit IRC15:59
*** gkadam has joined #openstack-mistral16:02
*** gkadam has quit IRC16:22
*** thrash is now known as thrash|biab16:38
*** AlexeyAbashkin has quit IRC16:47
*** thrash|biab is now known as thrash17:08
*** bobh has joined #openstack-mistral17:35
*** catinthe_ has joined #openstack-mistral17:53
*** catintheroof has quit IRC17:53
*** catintheroof has joined #openstack-mistral17:59
*** catinthe_ has quit IRC18:01
*** catinthe_ has joined #openstack-mistral18:05
*** catintheroof has quit IRC18:07
*** int32bit has joined #openstack-mistral18:10
*** int32bit has quit IRC18:12
*** catintheroof has joined #openstack-mistral18:14
*** catinthe_ has quit IRC18:15
*** AlexeyAbashkin has joined #openstack-mistral18:19
*** AlexeyAbashkin has quit IRC18:24
*** rbrady is now known as rbrady-afk18:29
*** weshay is now known as weshay|ruck|brb18:30
*** dprince has quit IRC19:08
*** weshay|ruck|brb is now known as weshay|ruck19:18
*** AlexeyAbashkin has joined #openstack-mistral19:19
*** katkapilatova has quit IRC19:22
*** katkapilatova has joined #openstack-mistral19:23
*** AlexeyAbashkin has quit IRC19:24
*** katkapilatova has quit IRC19:28
*** katkapilatova has joined #openstack-mistral19:29
*** katkapilatova has quit IRC19:33
*** katkapilatova has joined #openstack-mistral19:34
*** katkapilatova has quit IRC19:38
*** katkapilatova has joined #openstack-mistral19:39
*** katkapilatova has quit IRC19:43
*** katkapilatova has joined #openstack-mistral19:44
*** katkapilatova has quit IRC19:49
*** katkapilatova has joined #openstack-mistral19:50
*** katkapilatova has quit IRC19:54
*** katkapilatova has joined #openstack-mistral19:56
*** katkapilatova has quit IRC20:01
*** katkapilatova has joined #openstack-mistral20:01
*** toure is now known as toure_biab20:03
*** katkapilatova has quit IRC20:05
*** katkapilatova has joined #openstack-mistral20:07
*** jkilpatr has quit IRC20:10
*** katkapilatova has quit IRC20:12
*** katkapilatova has joined #openstack-mistral20:13
*** katkapilatova has quit IRC20:17
*** openstackgerrit has quit IRC20:17
*** katkapilatova has joined #openstack-mistral20:18
*** jkilpatr has joined #openstack-mistral20:26
*** catintheroof has quit IRC20:53
*** catintheroof has joined #openstack-mistral20:54
*** openstackgerrit has joined #openstack-mistral20:56
openstackgerritBrad P. Crochet proposed openstack/python-mistralclient master: Migrate python-mistralclient jobs to Zuul v3  https://review.openstack.org/50918420:56
*** catintheroof has quit IRC20:58
*** int32bit has joined #openstack-mistral21:09
*** int32bit has quit IRC21:11
*** AlexeyAbashkin has joined #openstack-mistral21:19
*** AlexeyAbashkin has quit IRC21:24
*** jtomasek has quit IRC21:40
*** openstackgerrit has quit IRC21:48
*** bobh has quit IRC22:00
*** openstackgerrit has joined #openstack-mistral23:13
openstackgerritWinson Chan proposed openstack/mistral master: Implement notification of execution events  https://review.openstack.org/46779923:13
*** AlexeyAbashkin has joined #openstack-mistral23:19
openstackgerritWinson Chan proposed openstack/mistral master: Implement notification of execution events  https://review.openstack.org/46779923:19
*** AlexeyAbashkin has quit IRC23:23

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!