Monday, 2018-04-30

*** d0ugal has quit IRC02:49
*** d0ugal has joined #openstack-mistral02:50
*** gkadam has joined #openstack-mistral03:53
*** gkadam has quit IRC04:20
*** gkadam has joined #openstack-mistral04:26
*** hardikjasani has joined #openstack-mistral04:41
*** jaosorior has joined #openstack-mistral05:12
*** jaewook_oh has quit IRC05:32
*** d0ugal has quit IRC05:48
*** d0ugal has joined #openstack-mistral05:54
*** shardy has joined #openstack-mistral07:14
*** jpich has joined #openstack-mistral07:43
*** gkadam has quit IRC07:57
openstackgerritAdriano Petrich proposed openstack/mistral-tempest-plugin master: Fix todo that is not needed anymore stestr conf  https://review.openstack.org/56516408:04
*** livelace has joined #openstack-mistral08:16
*** livelace-link has quit IRC10:09
*** livelace-link has joined #openstack-mistral10:12
d0ugalapetrich: I wonder if a revert would make more sense? re: ^10:19
d0ugaloh, wait, nevermind10:20
d0ugal:)10:20
apetrichd0ugal, :)10:20
d0ugalMy brain is delayed today10:20
apetrichso say we all today10:21
*** pengdake_ has joined #openstack-mistral10:49
*** bobh has joined #openstack-mistral11:33
*** thrash|g0ne is now known as thrash11:42
*** pengdake_ has quit IRC11:53
*** bobh has quit IRC11:59
*** ninag has joined #openstack-mistral12:22
*** ninag has quit IRC12:22
*** jaosorior has quit IRC12:43
apetrichd0ugal, thanks for the recheck it worked12:48
d0ugalyay12:49
*** hardikjasani has quit IRC13:31
tourerbrady thrash scrum13:37
toure?13:37
*** toure is now known as toure|biab13:49
*** livelace has quit IRC14:02
*** livelace has joined #openstack-mistral14:05
*** bobh has joined #openstack-mistral14:14
*** toure|biab is now known as toure14:59
d0ugal#startmeeting mistral15:00
openstackMeeting started Mon Apr 30 15:00:14 2018 UTC and is due to finish in 60 minutes.  The chair is d0ugal. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
*** openstack changes topic to " (Meeting topic: mistral)"15:00
openstackThe meeting name has been set to 'mistral'15:00
d0ugalrakhmerov, apetrich, bobh, mcdoker181818: https://etherpad.openstack.org/p/mistral-office-hours15:01
d0ugalOffice hour time :)15:01
apetricho/15:01
d0ugalReminder to anyone else, if you want a ping like that at the start of the meeting, add yourself to the etherpad ^15:01
apetrichso I was reading this and was wondering if I can pick your minds?15:04
apetrichhttps://bugs.launchpad.net/tripleo/+bug/175743015:04
openstackLaunchpad bug 1757430 in tripleo "The ssh_keys and tripleo.undercloud-config Mistral environments should be move to swift" [High,Triaged]15:04
apetrichit is a bit tripleo-ish but my questions is more about the mistral side of it15:04
d0ugalapetrich: That is a tripleo bug... but maybe it is relevant here? :)15:04
d0ugaloh, okay15:04
d0ugalGo for it15:04
apetrichThe bug is store some env keys in swift. but those are done with the environment-get15:05
apetrichI was wondering if there's a way to do that in a way that is better for the community15:06
apetrichlike maybe a setting for a backend storage for environment vars15:06
d0ugal"do so that" - do what exactly?15:07
d0ugalright15:07
apetrichbecause the best way that I think is having that keep the same api that we have today15:07
d0ugalapetrich: I'd argue the Swift API is better than the Mistral Environments API - for tripleo's use anyway :)15:08
d0ugalbut having a pluggable environment backend would be interesting - it would make it easier to secure things with say a barbican backend15:08
d0ugalor the secure swift containers.15:09
bobho/15:09
apetrichor memcache if that is needed a lot15:09
d0ugalAye15:09
d0ugalbobh: Hey!15:09
d0ugalapetrich: sounds like it would be worth exploring anyway - I am not sure how easy it would be15:10
d0ugalI don't know much much of the implementation is tied to the environment database code.15:10
apetrichme neither but either doing a all in approach like a setting in the mistral.conf or a per env var15:10
apetrichfrom my quick lazy ass research seems that we store that in the database and that's it15:11
d0ugalapetrich: yeah, there is the weird mechanism for loading an environment into an execution - but I forget how that works exactly15:11
d0ugalIt isn't something we use in tripleo15:11
apetrichoh that's that15:12
apetrichyeah I forgot that15:12
d0ugalbut that should be easy to make it lookup which backend to use15:12
apetricha setting to change the backend for it would be the best in case of a memcache/elasticsomething storage is welcome15:13
apetrichbecause not hitting the database to get that is important15:13
d0ugalyeah15:13
apetrichon the other hand an extra optional json field in the database poiting to where it is is an other idea to store that15:13
d0ugallol15:14
d0ugalIndeed15:14
d0ugalI'd probably prefer a global setting, just for simplicity15:14
apetrichif that is empty just return that otherwise use the values that to get the needed value15:14
d0ugalI'm not sure I can think of a good use-case for having multiple environment backenvs.15:14
d0ugalbackends15:14
apetrich+1 for the global setting15:14
apetrichthe use case I think is you just want to store the ssh_keys var into a secured swift that might be extra slow the rest is just trivial15:15
apetrichand can be stored in the database15:15
d0ugalTrue15:16
d0ugalFor tripleo, part of the desire is to have everything stored in one place - so we want everything in Swift15:16
d0ugalbobh: Feel free to jump in if you have anything to discuss15:17
d0ugalWe are just chatting in general15:17
d0ugalThe same goes to anyone else ^15:17
bobhd0ugal: one question came up last week - would there be any value in allowing a "publish-on-error" setting in task-defaults?15:17
d0ugalbobh: yes!15:18
d0ugalI would like this :)15:18
bobhd0ugal: ok, I'll put it on my list of things to do15:18
bobhI thought it would be useful too, and was surprised it wasn't supported15:18
d0ugalIndeed - I think it makes lots of sense.15:19
d0ugalbobh: oh, actually - I don't think there is even "publish" on task-defaults?15:20
bobhd0ugal: nope15:20
bobhd0ugal: I think they both make sense, if you are doing any sort of structured workflow15:20
d0ugalYeah - I think if we add one we need both.15:20
d0ugalI wonder if there is a blueprint for this already... /me searches15:21
d0ugalbobh: I didn't find a blueprint for this, but I found this: https://blueprints.launchpad.net/mistral/+spec/mistral-task-default-context15:23
d0ugalI wonder if not having the context there might make it hard to support?15:24
d0ugalOtherwise it sounds like it should be easy.15:24
bobhI wondered the same thing, but theoretically the expressions should not be evaluated until the task context it available - never on their own15:24
d0ugalYup, good point15:24
bobhassuming it was implemented properly :-)15:25
d0ugalhaha, I'm sure it was ;)15:25
bobhone other question - I ran into a problem with DB updates failing that was caused by this line:15:26
bobhhttps://github.com/openstack/mistral/blob/master/mistral/engine/tasks.py#L37915:26
d0ugalWhat error did you get?15:27
bobhI thought it was interesting that there is an assumption of a specific field name in an output of an action15:27
bobhThe DB update failed because it was trying to set state_info to a null dict15:27
d0ugalbobh: the output from actions is always under the result key.15:27
bobhah - makes sense15:28
d0ugalsort-of :)15:28
bobhso in this case it was a null dict15:28
d0ugalYeah, that is strange. I am not sure what would cause that.15:28
bobhI had to add "or None" after the action output reference to fix the problem15:28
bobhthat works fine, but I'm trying to come up with a test to reproduce the problem and verify the fix15:29
d0ugalThat would be good15:29
d0ugalWas it a custom action?15:29
bobhI'll have to go back and look -could be, we do a lot of that15:29
bobhand we don't always do it well...15:29
bobhI think adding the or None is probably a good idea in general, just to be safe15:30
bobhbut I do want to test it15:30
d0ugalhttps://github.com/openstack/mistral-lib/blob/master/mistral_lib/actions/types.py#L58-L6015:31
d0ugalI think that is where/why there should always be a result key15:31
d0ugal(that code was moved from the mistral repo to mistral-lib, so I'm not sure why it was done like that originally)15:31
bobhmakes sense15:32
d0ugalWe had a new bug this week! https://bugs.launchpad.net/mistral/+bug/176783015:38
openstackLaunchpad bug 1767830 in Mistral "Task and execution description" [Medium,Confirmed]15:38
d0ugalWhich seems valid - we don't expost the descriptions for tasks and executions.15:38
d0ugalI am a little concerned about how much more database space this would take... since it would need to be duplicated for each exectuion.15:39
d0ugalBut maybe we store it all anyway? I'd need to check.15:39
bobhThe execution description is set when you execution-create or execution-update -d15:42
bobhit doesn't get copied from the workflow description15:42
d0ugalbobh: Good point. There are two different descriptions we need to make sure we don't confuse them :)15:44
d0ugalThere is the execution description, and the workflow description for that execution15:44
bobhseems like copying the workflow description into every execution would not make a lot of sense15:45
bobhthe workflow_id is there, so you can go get it if you need it15:45
d0ugalbobh: but it can change, I think that is the point15:45
bobhthe workflow description can change?  at runtime?15:46
d0ugalNot quite.15:46
bobhor over time15:46
d0ugalYou can upload a workflow, start an execution, update a workflow and start a new execution15:46
bobhright - but how much of the previous version of the workflow do we need to preserve?15:46
d0ugalThe two executions could have different desriptions15:46
d0ugalbobh: I think we preserve almost all of it.15:47
bobhdo we have the spec that was executed?  The description would be in there15:47
d0ugalThat is what I am not sure about.15:47
d0ugalI believe we do have it all.15:47
d0ugalbobh: https://github.com/openstack/mistral/blob/master/mistral/db/v2/sqlalchemy/models.py#L17315:48
bobhwhich should have the description, I think15:48
d0ugalyup, I think so.15:49
bobhthough its not exposed via the API for retrieval maybe?15:49
bobhspec field15:49
d0ugalI don't think so15:49
d0ugalso, then I guess the question is - do we want to expost the full spec via the API?15:50
bobhprobably makes sense to be able to tell what exactly was executed15:50
d0ugalTrue.15:50
bobhoutput will be a huge15:51
d0ugalYeah, that is my concern :)15:51
d0ugalwe don't want to add that to every request - so maybe we need to add an option or a new endpoint.15:52
bobhsimilar to get-definition15:53
d0ugalYup15:53
d0ugalI'm going to copy some of this into the bug ^15:53
d0ugalI am going to end the meeting slightly early - I gotta run and do something15:57
d0ugalThanks everyone!15:57
d0ugal#endmeeting15:57
*** openstack changes topic to " (Meeting topic: test)"15:57
openstackMeeting ended Mon Apr 30 15:57:25 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:57
openstackMinutes:        http://eavesdrop.openstack.org/meetings/mistral/2018/mistral.2018-04-30-15.00.html15:57
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/mistral/2018/mistral.2018-04-30-15.00.txt15:57
openstackLog:            http://eavesdrop.openstack.org/meetings/mistral/2018/mistral.2018-04-30-15.00.log.html15:57
*** jpich has quit IRC16:32
*** itlinux has joined #openstack-mistral16:33
*** itlinux has quit IRC17:29
*** shardy is now known as shardy_afk17:45
*** itlinux has joined #openstack-mistral18:18
*** livelace has quit IRC18:26
*** itlinux has quit IRC19:07
*** thrash is now known as thrash|biab19:08
*** livelace has joined #openstack-mistral19:12
*** livelace has quit IRC19:18
*** d0ugal has quit IRC19:45
*** d0ugal has joined #openstack-mistral19:47
*** thrash|biab is now known as thrash19:49
*** d0ugal_ has joined #openstack-mistral20:01
*** d0ugal has quit IRC20:02
*** itlinux has joined #openstack-mistral20:06
*** itlinux has quit IRC20:17
*** d0ugal_ has quit IRC20:18
*** itlinux has joined #openstack-mistral20:19
*** d0ugal_ has joined #openstack-mistral20:20
*** d0ugal_ has quit IRC20:36
*** itlinux has quit IRC20:36
*** d0ugal_ has joined #openstack-mistral20:44
*** d0ugal_ has quit IRC21:32
*** d0ugal_ has joined #openstack-mistral21:36
*** d0ugal_ has quit IRC21:38
*** d0ugal_ has joined #openstack-mistral21:39
*** d0ugal_ has quit IRC21:57
*** d0ugal_ has joined #openstack-mistral22:00
*** bobh has quit IRC22:14
*** toure has quit IRC22:54
*** toure has joined #openstack-mistral22:55
*** d0ugal__ has joined #openstack-mistral23:12
*** d0ugal_ has quit IRC23:14
*** d0ugal__ has quit IRC23:29

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!