Friday, 2018-05-04

*** jistr has quit IRC00:07
*** jistr has joined #openstack-mistral00:13
*** thrash is now known as thrash|g0ne00:25
*** d0ugal has quit IRC00:36
*** d0ugal has joined #openstack-mistral01:03
*** pengdake_ has joined #openstack-mistral01:09
*** hardikjasani has joined #openstack-mistral04:12
*** pengdake_ has quit IRC04:17
*** pengdake_ has joined #openstack-mistral04:19
*** jaosorior has joined #openstack-mistral04:42
*** pengdake_ has quit IRC05:05
*** pengdake_ has joined #openstack-mistral05:07
*** pengdake_ has quit IRC05:41
*** threestrands has quit IRC05:47
*** pengdake_ has joined #openstack-mistral05:54
*** nguyenhai has joined #openstack-mistral06:12
*** nguyenhai_ has quit IRC06:16
*** jtomasek has joined #openstack-mistral06:45
*** mcdoker1818 has joined #openstack-mistral07:07
*** openstackgerrit has joined #openstack-mistral07:08
openstackgerritQi Peng proposed openstack/mistral master: Fix error workbook example  https://review.openstack.org/56622107:08
*** jaosorior has quit IRC07:25
*** gkadam has joined #openstack-mistral07:41
*** jpich has joined #openstack-mistral07:51
*** gkadam has quit IRC07:52
*** gkadam has joined #openstack-mistral07:52
d0ugalOffice hour time :)08:01
d0ugal#startmeeting mistral08:01
openstackMeeting started Fri May  4 08:01:50 2018 UTC and is due to finish in 60 minutes.  The chair is d0ugal. Information about MeetBot at http://wiki.debian.org/MeetBot.08:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.08:01
*** openstack changes topic to " (Meeting topic: mistral)"08:01
openstackThe meeting name has been set to 'mistral'08:01
d0ugalrakhmerov, apetrich, bobh, mcdoker181818: ping! ^08:02
d0ugalHappy friday everyone :)08:02
d0ugalI just need to get a coffee, back in a few mins.08:02
rakhmerovd0ugal: hey08:02
apetricho/08:02
rakhmerovhere08:02
d0ugalI don't have anything particular for the agenda, I'd like to go through and tidy up some of the blueprints maybe08:02
d0ugalOtherwise happy to discuss anything people have!08:02
d0ugalbut first, coffee :)08:03
d0ugalhttps://blueprints.launchpad.net/mistral/08:09
d0ugalSo we have 140 blueprints, that is more than the number of bugs :)08:09
d0ugalI guess we should triage blueprints like we do with bugs. Lots of them are "New" and "Not Started"08:09
rakhmerov:)08:18
rakhmerovok08:18
rakhmerovd0ugal: I'm here08:21
d0ugalrakhmerov: Great08:21
d0ugalI'm just reading some blueprints, I have not seen many of these before :)08:21
d0ugalI am also reading https://help.launchpad.net/Blueprint - just so I can learn how blueprints should be used :)08:22
d0ugalIt might be that we don't really need to do anything with them... I am not sure08:22
rakhmerovok08:22
mcdoker1818Hi, all. I created new bug ticket yesterday https://bugs.launchpad.net/mistral/+bug/1769012 . We can discuss it after triage blueprints.08:22
openstackLaunchpad bug 1769012 in Mistral "Workflow pause with task retry policy" [Undecided,New]08:22
rakhmerovwell, in my understanding we just need to go over them and assign them to cycles and milestones according to our dev plans08:23
d0ugalrakhmerov: sure, but I don't think they should stay in "New" for design, like a bug that means they have not been triaged?08:24
rakhmerovyes08:24
d0ugalthey should either be approved or rejected I guess?08:24
rakhmerovbtw, did we clean up BPs for R-2?08:24
d0ugalrakhmerov: no, not yet.08:25
rakhmerovd0ugal: I think they can be rejected, yes. If they are nonsense )08:25
d0ugal:)08:25
d0ugalor Discussion looks like a useful status if they need to be talked about more08:25
rakhmerovyes08:26
d0ugalIt is just a task I want to do a little bit at a time - I think the bugs are much tidier now, so I'd like to do something similar with blueprints.08:26
rakhmerovI'm not sure how to reject them properly though..08:26
d0ugalGood question :)08:26
rakhmerovmaybe just mark them as "obsolete"08:26
d0ugalhttps://wiki.openstack.org/wiki/Blueprints08:27
d0ugalThat also looks useful.08:27
d0ugalFirst I think we should discuss mcdoker1818's bug.08:27
rakhmerovok08:27
rakhmerovas you wish, commandor )08:27
d0ugalhaha, I think it is something he wants to work on now. The blueprints can wait longer :)08:28
rakhmerovyes08:28
rakhmerovreading it..08:28
d0ugal#link https://bugs.launchpad.net/mistral/+bug/176901208:28
openstackLaunchpad bug 1769012 in Mistral "Workflow pause with task retry policy" [Undecided,New]08:28
d0ugalI am too :)08:28
rakhmerovwoow, so many details..08:29
rakhmerovbtw, just something I noticed immediately: the title of the bug doesn't describe the bug08:29
rakhmerov:)08:29
rakhmerovthere's a good BLUF (bottom line up front) principle that I personally try to always use08:30
rakhmerovmcdoker1818: Vitalii, can you please put a line right in the beginning of the description that reflects the matter of the bug08:31
d0ugal(or change the bug title)08:31
mcdoker1818Updated :)08:32
rakhmerovok, thanks08:32
d0ugalI wouldn't delete the details - just make sure there is an easy to understand summary at the top08:34
rakhmerovI also slightly updated it08:34
rakhmerovyep08:34
rakhmerovyou can add details after a short summary08:35
rakhmerovbut ok, I understand it now08:35
mcdoker1818Thanks!08:35
rakhmerovI guess the bug should be pretty easy to fix08:35
rakhmerovmy assumption is that retry policy doesn't take PAUSED state into account for some reason08:36
d0ugalYeah, so in summary - pausing a workflow breaks the retry policy?08:36
d0ugalright08:36
rakhmerovmaybe "Retry policy keeps iterating if the workflow is paused" :)08:36
d0ugal+108:36
mcdoker1818https://github.com/openstack/mistral/blob/master/mistral/engine/tasks.py#L23208:37
d0ugalI changed the bug to "Confirmed" - how important is this bug for you? :)08:37
rakhmerovmcdoker1818: yes, but DELAYED is not the same as PAUSED08:38
d0ugalrakhmerov: do we have a good desription of the states somewhere? I get confused with them sometimes.08:38
mcdoker1818Yep, I mean the retry executes before check the pause state08:38
rakhmerovjust to clarify: DELAYED is mostly an internal state needed to tell Mistral "this task is running but it's delayed due to some internal implementation reasons, like policy or something else"08:38
mcdoker1818d0ugal: I plan to fix it soon08:39
rakhmerovPAUSED means that a user stopped it temporarily on purpose08:39
d0ugalmcdoker1818: thanks, I added it to rocky-208:39
rakhmerovd0ugal: probably we don't, let me check08:39
rakhmerovok08:39
d0ugalrakhmerov: https://github.com/openstack/mistral/blob/master/mistral/workflow/states.py#L18 :)08:40
mcdoker1818:DD08:41
rakhmerovd0ugal: so we have some info about the states in the spec but that's definitely not full08:41
rakhmerovd0ugal: haha :))08:41
mcdoker1818rakhmerov: I guess the main problem how resume task iterations after resume execution08:42
*** gkadam has quit IRC08:42
rakhmerovmcdoker1818: it shouldn't be a problem08:43
rakhmerovwe save info about retry iteration in the task 'runtime_context' field08:43
rakhmerovunder the key 'retry' or something like that08:44
rakhmerovso we always know what the current iteration is08:44
mcdoker1818rakhmerov: As I know we resume tasks which has IDLE state08:44
rakhmerovnope08:45
rakhmerovPAUSED08:45
hardikjasaniarthur10008:45
rakhmerovIDLE is for a different purpose08:45
mcdoker1818We don't change state task to PAUSED08:46
rakhmerovwhy not?08:47
rakhmerovso the states change in this case as follows: RUNNING or RUNNING_DELAYED [we pause wf] -> PAUSED [we resume wf] ->  RUNNING or RUNNING_DELAYED08:49
rakhmerovas far as RUNNING_DELAYED, you can perceive it as a sub state of RUNNING08:50
mcdoker1818let me check08:50
rakhmerovso it's a flavor of RUNNING state08:50
rakhmerovhardikjasani: hey08:50
rakhmerovwhat is arthur100? :)08:50
hardikjasanityped it in wrong window :D08:51
hardikjasaniNothing critical of course08:51
rakhmerovok )08:52
rakhmerovhardikjasani: btw, how is it going? Progressing with your tasks?08:52
*** nguyenhai has quit IRC08:54
mcdoker1818rakhmerov: Ok, thank you for clarifying!08:55
rakhmerovnp08:55
hardikjasanirakhmerov: going great!08:58
rakhmerov)08:58
mcdoker1818d0ugal, rakhmerov: What is about this ticket https://bugs.launchpad.net/mistral/+bug/1767830 ? Should I create blueprint for new api?08:58
openstackLaunchpad bug 1767830 in Mistral "Execution and task specification can be out of date" [Medium,Confirmed]08:58
mcdoker1818Or is it a bug?08:59
d0ugalSory, I got distracted for a moment there.09:00
d0ugalmcdoker1818: Looking.09:00
mcdoker1818http://localhost:8989/v2/execution/%ex_id%/spec09:00
mcdoker1818for example09:00
d0ugalYeah, I remember now.09:00
d0ugalmcdoker1818: I am happy for you to treat it like a bug09:00
rakhmerovhm..09:00
rakhmerovwell, wait a second09:01
rakhmerovso my concern is the following09:01
rakhmerovthe 'spec' field is an internal thing and it may look much different from the initial YAML text09:02
rakhmerovthat's the thing..09:02
rakhmerovand that is why it was not exposed in the first place09:02
rakhmerovas a solution, we could keep a snapshot of the initial *YAML* chunk but that's extra space09:03
d0ugalyeah09:03
rakhmerovwe in many cases have many megs of data there09:03
d0ugalI guess the best solution is to keep old versions of a workflow while there is a related execution.09:03
rakhmerovand imagine if that is stored for every execution09:03
d0ugalThat is why I think it would be better to version the exectuion09:04
mcdoker1818> the 'spec' field is an internal thing and it may look much different from the initial YAML text09:04
rakhmerovd0ugal: yeah, the most decent solution that I can think of is workflow versioning09:04
mcdoker1818Why do you think that it is a problem?09:04
d0ugalso we just have one unique copy of every workflow - then a each execution could have a reference to the workflow and a version id (the sha of the yaml contents?)09:04
rakhmerovso that workflow definition keep versions and the reference should look like "WF id = 1-2-3-4, ver 5"09:04
d0ugalmcdoker1818: if we expose an internal data structure to users then we need to support and document it.09:05
rakhmerovyep09:05
rakhmerovI'd really hold on with this for now, honestly09:05
mcdoker1818Noop, we will not. We create a ExecutionSpec - resource09:05
mcdoker1818And we will expose it09:05
rakhmerovmcdoker1818: from user perspective it doesn't make much sense09:06
d0ugalI don't follow.09:06
rakhmerovwe already have workflows09:06
rakhmerov(i.e. workflow definitions)09:06
rakhmerovwhy would user need to deal with one more thing that's called Spec something..09:06
rakhmerov?09:06
rakhmerovfrom the user perspective they just deal with different versions of workflows09:07
rakhmerovbut we don't support it properly now09:07
rakhmerovit can be done on the user side though: just introduce the policy not to every update workflows and use special naming that includes a version09:08
rakhmerovthat's it09:08
mcdoker1818of you right, yes09:08
mcdoker1818all of you are right, yes09:08
rakhmerovyou can even forbid the corresponding operation in the policy.json file09:08
rakhmerovyeah09:08
d0ugalThat is a decent work-around for now.09:09
d0ugalOkay - so I guess we consider this bug to be invalid?09:09
mcdoker1818I'm sorry I missed what is wa?09:09
d0ugalmcdoker1818: What rakhmerov said. Don't let users update workflows via policy.json and then you can always get the original workflow.09:10
mcdoker1818hahahaah09:10
d0ugalThen instead of updating workflow you always create new workflows (and delete old ones later)09:10
mcdoker1818noop, it's not wa :)09:10
d0ugalWhy not?09:11
rakhmerovsorry, what is "wa"?09:11
mcdoker1818We use workflow by name in case of start  sub-workflow (from task)09:11
rakhmerovnot following..09:11
mcdoker1818work-around09:11
rakhmerovooh09:11
*** pengdake_ has quit IRC09:12
d0ugalGood point. That makes it harder.09:12
rakhmerovsub-workflow names can be dynamic :)09:12
rakhmerovbut I understand, ok09:12
d0ugalbut that would get ugly :)09:12
d0ugalmcdoker1818: Why do you need the original spec?09:13
mcdoker1818UI09:13
d0ugalWhat do you want to do with it?09:13
d0ugalI see09:13
d0ugalWould it fit in the workflow execution description? :)09:14
d0ugalno, I guess not.09:14
mcdoker1818Sorry, I don't understand you :)09:15
d0ugalDon't worry - the idea won't work.09:15
rakhmerovthe reason I'm arguing this much is that I don't want workarounds09:16
rakhmerovI hate them )09:16
rakhmerovthey have a trend to live there for long09:16
rakhmerovif this is so important then why not implement it in the right way?09:17
mcdoker1818:D09:17
mcdoker1818I like the idea with the version09:17
rakhmerovd0ugal: maybe we just need to write a spec and see so that it's backwards compatible and decently implement it?09:17
rakhmerovrather than ending up with workarounds09:17
d0ugalrakhmerov: Right, that is why I am trying to think of a workaround from the users perspective09:18
d0ugalI have never used namespaces - but could a new, unique namespace be used each time? do sub-workflow executions look within a namespace?09:18
d0ugalrakhmerov: sure, I just wasn't sure how easy/realistic that was09:18
d0ugalbut I am happy for workflow versioning to be added.09:18
rakhmerovok09:19
rakhmerovso yes, my suggestion is at least write a spec and see how hard it would be09:20
d0ugalmcdoker1818: is this something you can work on?09:20
rakhmerovlet's do some research within a reasonable amount of time and then make a decision, how's that sound?09:20
d0ugalSure, sounds good. I don't have the time for this, but somebody should go fot it :)09:20
d0ugalfor it*09:20
mcdoker1818It's not a blocker for me right now, but I think it will be :) Yeap, I can do it a little later09:21
d0ugalOkay, sounds good09:22
d0ugalI'll mark the bug as invalid for now and sumarise this.09:22
mcdoker1818Ok09:22
d0ugalThanks!09:25
d0ugalI am going to end the meeting bot before I forget, but I will be around for the rest of the day :) it is only 10:30am here.09:25
d0ugal#endmeeting09:25
*** openstack changes topic to " (Meeting topic: test)"09:25
openstackMeeting ended Fri May  4 09:25:08 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)09:25
openstackMinutes:        http://eavesdrop.openstack.org/meetings/mistral/2018/mistral.2018-05-04-08.01.html09:25
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/mistral/2018/mistral.2018-05-04-08.01.txt09:25
openstackLog:            http://eavesdrop.openstack.org/meetings/mistral/2018/mistral.2018-05-04-08.01.log.html09:25
mcdoker1818d0ugal: Do you have a some progress with https://blueprints.launchpad.net/mistral/+spec/mistral-action-providers and https://blueprints.launchpad.net/mistral/+spec/mistral-actions-api-separate-openstack-actions ? I have a view how implement it. Where I can describe it?09:25
*** pengdake_ has joined #openstack-mistral09:25
d0ugalmcdoker1818: I have not made progress yet, I have been busier than I expected with other things. I hope to look at it this month.09:26
d0ugalmcdoker1818: You can add to the whiteboard on the blueprint09:26
mcdoker1818Where you discuss a blueprint\specification?09:26
mcdoker1818Ok09:26
mcdoker1818Thnaks!09:26
d0ugalBlueprints in launchpad are not very good, I wish they had comments.09:26
d0ugalAt some point we should look into moving to Storyboard... :)09:26
mcdoker1818What is the Storyboard?09:27
d0ugalmcdoker1818: https://storyboard.openstack.org/09:29
d0ugalNot many projects are using it yet, but some have moved over.09:29
d0ugalI don't know if it is ready or not, we would need to do some investigation.09:29
mcdoker1818Woow, looks good)09:30
rakhmerovmcdoker1818: btw, are you considering to go to the PTG this year?09:32
rakhmerovin Sept09:32
rakhmerovin Denver09:32
rakhmerovit'd be very cool if you came09:32
rakhmerovd0ugal: may be you can help.. I'm struggling with some "pip" mess09:33
d0ugalrakhmerov: sure, I can try.09:34
rakhmerovpip stopped fetching requirements as neede09:34
d0ugal"stopped"? did you get an error?09:34
d0ugalWhich version of pip?09:34
rakhmerovsaying there's a problem with TLS verification whatever09:34
rakhmerovyeah09:34
rakhmerov8.1.209:34
d0ugalold :)09:34
rakhmerov"There was a problem confirming the ssl certificate: [SSL: TLSV1_ALERT_PROTOCOL_VERSION] tlsv1 alert protocol version (_ssl.c:646) - skipping"09:34
rakhmerovyes, I know09:35
rakhmerovbut :)09:35
rakhmerovI update it with get-pip.py09:35
rakhmerovto 10 something..09:35
d0ugalbtw you can update with "pip install -U pip"09:35
rakhmerovand when I run, for example, "tox -epy35" it gets reverted back to 8.1.2 for some reason09:35
d0ugalbut get-pip should work fine too09:35
rakhmerovok09:36
d0ugalrakhmerov: What version of virtualenv?09:36
d0ugaland tozx09:36
d0ugaltox09:36
rakhmerovhah.. one second09:36
d0ugaliirc virtualenv includes a copy of pip and setuptools.09:36
rakhmerovtox is 2.1.109:36
rakhmerovold?09:36
d0ugalNot sure. Looking.09:36
d0ugalYes, old :)09:37
rakhmerovooh, maybe updating "virtualenv" is a key really..09:37
rakhmerovok09:37
d0ugaltox 2.1.1 is from Jun 23, 2015!09:37
hardikjasanitox will use pip from virtualenv09:37
rakhmerovyep, but I remember there was a reason not to use later versions09:37
d0ugalYup09:37
rakhmerovok09:37
rakhmerovI'll try to update both09:37
rakhmerovthanks09:37
d0ugalrakhmerov: I use tox 3.009:37
hardikjasaniso just activate py35 env and then upgrade pip09:37
rakhmerovyup09:38
rakhmerovthanks to you both ) Will try09:38
mcdoker1818rakhmerov: I think it's going to be very difficult for me, but I'll think about it.09:39
mcdoker1818:)09:39
rakhmerovmcdoker1818: no worries, we'll help09:39
rakhmerovyou need to learn to do this kind of work anyway ;)09:39
mcdoker1818:)09:40
*** pengdake_ has quit IRC10:06
*** gkadam has joined #openstack-mistral12:09
*** jistr is now known as jistr|mtg12:11
*** thrash|g0ne is now known as thrash12:14
*** gkadam has quit IRC12:24
*** pengdake_ has joined #openstack-mistral12:28
*** jistr|mtg is now known as jistr12:31
*** pengdake_ has quit IRC12:48
*** bobh has joined #openstack-mistral13:14
*** hardikjasani has quit IRC13:21
*** pengdake_ has joined #openstack-mistral13:36
*** pengdake_ has quit IRC13:54
*** bobh has quit IRC14:11
*** bobh has joined #openstack-mistral14:12
*** jistr is now known as jistr|tpb14:49
*** jistr|tpb is now known as jistr15:05
*** thrash is now known as thrash|biab15:15
*** mcdoker1818 has quit IRC15:26
*** EmilienM is now known as EvilienM16:09
*** thrash|biab is now known as thrash16:29
*** jpich has quit IRC16:31
*** AlexeyAbashkin has joined #openstack-mistral16:43
*** itlinux has joined #openstack-mistral17:14
*** AlexeyAbashkin has quit IRC18:30
*** rbrady has joined #openstack-mistral19:38
*** rbrady is now known as Guest8469019:39
*** Guest84690 has quit IRC20:06
*** bobh has quit IRC20:57
*** bobh has joined #openstack-mistral20:58
*** bobh has quit IRC21:23
*** itlinux has quit IRC21:47
*** Guest84690 has joined #openstack-mistral21:54
*** Guest84690 has quit IRC21:59
*** jtomasek has quit IRC22:10
*** bobh has joined #openstack-mistral23:06
*** bobh has quit IRC23:17
*** mfedosin has quit IRC23:25

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!