Wednesday, 2017-05-03

*** catintheroof has joined #openstack-mistral00:00
*** catintheroof has quit IRC00:01
*** harlowja has quit IRC00:04
*** catintheroof has joined #openstack-mistral00:04
*** bobh has quit IRC00:09
*** bobh has joined #openstack-mistral00:13
*** bobh has quit IRC00:21
*** bobh has joined #openstack-mistral00:24
*** bobh has quit IRC00:30
*** catintheroof has quit IRC00:33
*** catintheroof has joined #openstack-mistral00:39
*** bobh has joined #openstack-mistral00:56
*** bobh has quit IRC00:58
*** catintheroof has quit IRC01:09
*** thrash is now known as thrash|g0ne01:10
*** zhurong has joined #openstack-mistral01:50
*** jamielennox is now known as jamielennox|away02:03
*** zhurong has quit IRC02:07
*** openstackgerrit has joined #openstack-mistral02:14
openstackgerritMerged openstack/mistral master: Refactor Kombu-based RPC  https://review.openstack.org/45712302:14
*** jamielennox|away is now known as jamielennox02:17
*** bobh has joined #openstack-mistral03:13
openstackgerritLingxian Kong proposed openstack/mistral master: Add "running_region" param for OpenStack actions  https://review.openstack.org/46035103:14
*** bobh has quit IRC03:16
*** bobh has joined #openstack-mistral03:21
rakhmerovrbrady: yes, sure03:29
*** zhurong has joined #openstack-mistral03:37
*** zhurong has quit IRC03:40
*** bobh has quit IRC03:41
*** chlong has joined #openstack-mistral04:23
openstackgerritRenat Akhmerov proposed openstack/mistral-lib master: Update serialization from 'mistral' repo with latest changes  https://review.openstack.org/46198604:32
*** zhurong has joined #openstack-mistral04:37
openstackgerritMerged openstack/mistral master: Add support for mistral-lib to Mistral  https://review.openstack.org/45351704:40
*** sharatss_ has joined #openstack-mistral04:55
openstackgerritSharat Sharma proposed openstack/python-mistralclient master: Use keystoneauth plugins and session instead of keystoneclient  https://review.openstack.org/45517405:21
*** jaosorior_away is now known as jaosorior06:19
*** gongysh has joined #openstack-mistral06:21
openstackgerritluong tuan proposed openstack/mistral master: Refactor mistral context using oslo_context  https://review.openstack.org/45540706:38
*** shardy has joined #openstack-mistral07:00
*** brunograz has quit IRC07:12
*** zhurong has quit IRC07:24
*** brunograz has joined #openstack-mistral07:27
*** Qiming has quit IRC07:36
*** Qiming has joined #openstack-mistral07:42
*** zhurong has joined #openstack-mistral07:43
*** gongysh has quit IRC07:55
*** zhurong has quit IRC08:47
*** zhurong has joined #openstack-mistral09:01
*** sharatss_ has quit IRC09:17
*** sharatss_ has joined #openstack-mistral09:18
kongrakhmerov, d0ugal, hi guys, please take a look at region support feature implementation https://review.openstack.org/460351 when you're available. (although I know it may not be an ideal time for the people who are preparing Boston summit)09:32
d0ugalkong: sure thing, I'll take a look this week09:33
d0ugalkong: neither I or rakhmerov are going to Boston :(09:33
kongd0ugal: thanks and sorry to here that :)09:34
kongs/here/hear09:34
d0ugalkong: are you going?09:34
kongd0ugal: nope, we have not enough budget09:34
kongmaybe next time09:34
rakhmerovkong: yes, I was going to review it within an hour09:35
d0ugalkong: Where in the world are you?09:35
kongand one possibility for developers to attend summit is we get the chance to give presentation09:35
kongd0ugal: New Zealand09:35
d0ugalkong: oh, cool - so the next summit is closer!09:36
kongd0ugal: yeah!09:36
kongthat's reason I said 'maybe next time' :-)09:36
*** zhurong has quit IRC09:41
openstackgerritluong tuan proposed openstack/mistral master: Refactor mistral context using oslo_context  https://review.openstack.org/45540709:43
openstackgerritluong tuan proposed openstack/mistral master: Add user creds trusts to db  https://review.openstack.org/46205609:43
*** zhurong has joined #openstack-mistral10:18
d0ugalrakhmerov: is there a way to have a task called for each completion of an with-items?10:30
d0ugali.e. I want on-complete for each with-items item10:30
*** zhurong has quit IRC10:30
*** jkilpatr has quit IRC10:31
*** sharat has quit IRC10:34
rakhmerovd0ugal: only if the task that has "with-items" calls workflows instead of actions10:35
rakhmerovthen in a subworkflow you can do that10:35
d0ugalrakhmerov: oh, of course!10:35
rakhmerovbut not in the parent workflow10:35
d0ugalperfect10:36
rakhmerovyeah )10:36
rakhmerovbecause from the parent workflow perspective all iterations if 'with-items' are still one task (but its result is a collection)10:36
d0ugalright, that makes sense10:37
d0ugalI had hoped for a handy trick, but calling a workflow is better.10:37
*** jkilpatr has joined #openstack-mistral10:49
d0ugalrakhmerov: how do I make sure that task().result is the same? when moving from an action call to a workflow call? if that doesn't make sense I might need to make an example :)10:59
*** thrash|g0ne is now known as thrash10:59
rakhmerovhm..11:00
* rakhmerov is trying to get an idea..11:00
d0ugal:)11:00
d0ugalbasically I want to control the "result" of a workflow11:01
rakhmerovyep11:01
d0ugalrakhmerov: https://docs.openstack.org/developer/mistral/dsl/dsl_v2.html#id111:02
d0ugalrakhmerov: in that example; output: result: <% %>11:02
d0ugalI guess that would do it?11:02
rakhmerovooh, so11:03
d0ugalI have not used "output" yet :)11:03
rakhmerovall you need to do is just to save an action result so that it's accessible as a result of the workflow?11:03
d0ugalrakhmerov: yeah11:03
rakhmerovok11:03
d0ugalrakhmerov: so I can replace an action call, with a workflow call but it work the same11:04
rakhmerovyes, so what "output" does is it just calculates an expression and saves it as a workflow result (accessible as wf_ex.output in the API), in the expression you can use any data published into the context11:04
rakhmerovalthough "context" here is slightly tricky11:05
d0ugalrakhmerov: and can I access the output with task().result? or does that need to change to task().output?11:05
rakhmerovbecause, as you know, workflow context is always bound to a workflow branch (if we're not talking about global publishing that I added recently)11:06
rakhmerovyes, you can use task(task_name).result11:06
rakhmerovabsolutely11:06
d0ugalgreat11:06
d0ugalthere shouldn't be any branching here :)11:06
d0ugalThis is going to be a very simple 2 task workflow.11:07
rakhmerovjust one thing to remember: there may be ambiguity if you have many instances (executions) of the same task11:07
d0ugalmaybe 3 tasks :)11:07
rakhmerove.g. in case of loops11:07
d0ugalrakhmerov: ambiguity? where? :)11:07
rakhmerovexample: taskA -> TaskB -> TaskC -> (on condition) TaskB11:08
rakhmerovthis may lead to creating many executions for TaskB11:08
rakhmerovbecause there's a loop here11:08
*** sharatss_ has quit IRC11:09
rakhmerovand if you use task(TaskB).result it's pretty much undefined what exact execution you will take11:09
*** sharat has joined #openstack-mistral11:09
rakhmerovmakes sense?11:09
d0ugalrakhmerov: right, I see11:09
d0ugalrakhmerov: we wont have any loops like that11:10
d0ugalonly a with-items11:10
rakhmerovok, then it's fine11:10
rakhmerovso, one more thing: getting back to the branches..11:10
d0ugalyup :)11:10
rakhmerovwhen a workflow completes it always finds so-called "end tasks", basically those tasks that led to completing the workflow11:11
rakhmerovand then it merges all contexts associated with their branches11:11
rakhmerovthat way it calculates the final workflow context11:11
rakhmerovthat is used when evaluating "output"11:11
rakhmerova little bit tricky but that's what we came up with11:12
d0ugalright11:13
rakhmerovor btw, now we can also do global publishing11:13
rakhmerovif we want to make it more explicit11:13
d0ugalrakhmerov: yeah, I'll need to try that when it is ready :)11:13
rakhmerov:)11:13
d0ugalrakhmerov: this is what I came up with, just about to test it: https://review.openstack.org/#/c/462078/1/workbooks/baremetal.yaml11:13
rakhmerovyes, but you don't even need "publish" here at all11:15
rakhmerovyou can do "result: <% task(start_introspection).result %>" in "output"11:15
d0ugaloh, good point11:15
d0ugalupdated, even neater :)11:17
d0ugalrakhmerov: thanks!11:17
rakhmerov:)11:18
rakhmerovnp11:18
d0ugalrakhmerov: btw, could you look at https://review.openstack.org/#/c/461026/11:26
d0ugalrakhmerov: thrash noticed a difference when using on-complete and on-success/on-error - does that seem correct to you?11:26
d0ugalit seems like a bug in Mistral to me11:27
rakhmerovno!11:28
rakhmerovit's not a bug11:28
d0ugalrakhmerov: haha, okay11:28
rakhmerovsec11:28
d0ugalrakhmerov: but if on-complete is like "finally" in Python, I wouldn't expect it to raise the exception :)11:28
rakhmerovwait a sec.. maybe I didn't read carefully11:29
rakhmerovso, what do you mean about "finally"?11:31
rakhmerovif you have just "finally" declared in try-except-finally block (w/o 'except') the exception will still be raised11:32
rakhmerovoutside11:32
rakhmerovit doesn't prevent from bubbling the exception11:32
d0ugalrakhmerov: true11:33
rakhmerovonly "except" does (if it's catches the right exception type)11:33
rakhmerovhttps://docs.openstack.org/developer/mistral/dsl/dsl_v2.html#direct-workflow-task-attributes11:34
rakhmerovI recently added a paragraph to explain it11:34
d0ugalright11:37
d0ugalrakhmerov: okay, I understand now I think11:37
d0ugalI'm not sure why I got confused :)11:37
rakhmerovok11:38
*** zhurong has joined #openstack-mistral12:01
rakhmerovd0ugal: just a small thing (syncing with 'mistral' changes): https://review.openstack.org/#/c/461986/12:01
d0ugalrakhmerov: thanks12:02
*** Qiming has quit IRC12:06
*** dprince has joined #openstack-mistral12:09
*** Qiming has joined #openstack-mistral12:20
*** catintheroof has joined #openstack-mistral12:30
*** dprince has quit IRC12:43
*** tung_doan has joined #openstack-mistral12:50
*** zhurong has quit IRC13:28
*** chlong has quit IRC13:28
thrashrakhmerov: I filed a bug13:30
thrashrakhmerov: so if you think the behavior is correct then we can just close it13:30
thrashrakhmerov: https://bugs.launchpad.net/mistral/+bug/168763013:31
openstackLaunchpad bug 1687630 in Mistral "Failed action with on-complete marks entire workflow as failed" [Undecided,New]13:32
d0ugalthrash: I think it is correct :) do you still not?13:34
thrashd0ugal: what I don't understand is why it is inconsistent between on-success/on-error and on-complete13:35
thrashd0ugal: I would expect the behavior to be the same regardless13:35
*** sharat has quit IRC13:38
*** sharat has joined #openstack-mistral13:38
*** jaosorior is now known as jaosorior_away13:41
thrashd0ugal: rakhmerov AAHHHHH NOW I understand. Reading that paragraph makes a LOT more sense.13:47
thrashd0ugal: rakhmerov I'll close my bug.13:47
d0ugal:)13:47
d0ugalthrash: it is confusing, but I'm not sure why it is confusing. I think we both made the same incorrect assumption13:47
thrashd0ugal: yep... on-error is essentially the same as if we added an 'ignore-errors' to on-complete13:48
*** dprince has joined #openstack-mistral13:49
thrashd0ugal: I guess the one thing I'm left wanting is not having to repeat the same task in on-success/on-error13:49
d0ugalthrash: agreed13:50
d0ugalon-anything :P13:50
thrashon-whatever13:50
thrashlol13:50
*** zhurong has joined #openstack-mistral14:02
*** sharat has quit IRC14:05
*** bobh has joined #openstack-mistral14:06
*** brunograz has quit IRC14:13
*** brunograz has joined #openstack-mistral14:17
*** openstackgerrit has quit IRC14:18
*** zhurong has quit IRC14:52
rakhmerovthrash: ok :)15:04
rakhmerovon-whatever sounds cool!15:05
rakhmerovwe may want to consider adding it )15:05
rakhmerovthrash, rbrady: so, I'm here, we can discuss something on the summit preparations15:06
rakhmerovif needed15:06
rbradyrakhmerov: which 3 pike features do you want me to highlight in the talk?  I don't know if there is any vision published in the mistral community for Queens or "R" Release, but the presentation asks for it15:08
rakhmerovrbrady: well, mostly I think we can talk about what's in the end if README (https://github.com/openstack/mistral)15:09
rakhmerovwe set up the goals for 2017, main goals15:09
rakhmerovin addition, let me see what else it is worth talking about..15:09
rakhmerov* Workflow error analysis (what toure is working on). And in general, the goal is to make Mistral more usable so that it allows to find root causes easier15:11
rakhmerov* Mistra GUI (the demo for the Mistral team will be on May 25th, I'll send out the link)15:11
rakhmerovthe main reason to implement it: GUI is crucially important if we're dealing with big workflows that run long and it's hard to see the whole picture clearly so visualization is very important, and so on and so forth15:13
*** chlong has joined #openstack-mistral15:15
rakhmerov* Reworking OpenStack actions. We need to have much better test automation for them, easier ways to install them (only those that are needed) and maintain them (e.g. delete or update them). Possibly multi-versioning (supporting OpenStack APIs of different versions at the same time)15:16
rakhmerov* Multi-region support for OpenStack actions (in progress). So that we could define in what region an OpenStack action should run15:16
rakhmerovand I think this: https://blueprints.launchpad.net/mistral/+spec/mistral-execution-event-subscription15:17
rakhmerovthis is probably even too much15:17
rakhmerovthere's also a bunch of other things but they are smaller and don't have noticeable user impact probably15:18
rakhmerovrbrady: ^15:23
rbradyrakhmerov: thanks.  has there been any discussion to Queens work yet?15:24
rakhmerovnope, but I think part of these things will be scoped to Queens15:25
rakhmerovrbrady: do you need some clarifications on some of these bullets?15:29
rakhmerovI'll be here for another 20 mins or so15:29
rbradyrakhmerov: reading/processing15:29
rakhmerov:)15:29
rakhmerovok15:29
rbradyrakhmerov: how about the "development themes" questions for the releases?  I guess I can answer pike and skipp the other two15:30
rbradyrakhmerov: or do you just want to skip those altogether?15:31
rakhmerovwell15:31
rakhmerovnot sure what that means actually15:31
rakhmerov"development themes"15:31
rakhmerovdoes it mean "important development activities that don't necessarily have serious user impact"?15:32
rbradyit's asking if specific attributes will have a major focus, minor focus, no focus or not applicable15:32
rakhmerovspecific attributes?15:32
rbradyand the attributes are Scalability, Resiliency, Manageability, Modularity, Interoperability, Security, User Experience15:33
rakhmerovok15:33
rbradyrakhmerov: you can see them towards the bottom portion of the form: https://docs.google.com/forms/d/e/1FAIpQLSdM_YsZbvUGk-4ZEeXv7KRLCiTDX2Ct8LJtzB-9ntaceFhYgg/viewform?c=0&w=115:33
rakhmerovScalability, Security, User Experience15:33
rakhmerovaah, I just saw this form in this.. form15:34
rakhmerovMajor focus on these three15:34
rakhmerovon the last two questions, I don't know, seems like we don't require anything special15:36
rbradyrakhmerov: the 2nd to last question seems to be soliciting features from users15:37
rakhmerovthe last question can be just answered with The Goals 201715:37
rbradyrakhmerov: ack15:37
rakhmerov1. Documentation 2. Actions API 3. Multi-node mode 4. Reduce execution-time (improve performance)15:37
rakhmerovyep15:38
rbradyrakhmerov: ack - from the README :)15:38
rakhmerovright15:38
rakhmerovrbrady: do you have ideas on what you could do for the "Project onboarding session"?15:38
rbradyrakhmerov: how else does mistral solicit for features from the OpenStack community at large?15:38
rakhmerovwell..15:39
rakhmerovOpenStack community I think is pretty happy with Mistral15:40
rakhmerov:)15:40
rakhmerovto be serious, I think "Much much better usability"15:40
rakhmerovwhich we're moving towards15:40
rbradyrakhmerov: is this something that you get from people pinging you directly?15:41
rakhmerovdocs, usability (GUI, Error Analysis, Actions API is also a part of it)15:41
rakhmerovooh yeah!15:41
rakhmerovespecially missing docs and not working OpenStack actions15:41
rakhmerova bunch of people are complaining on that all the time15:41
rbradyrakhmerov: maybe in the onboarding we can tell them how to queue up or send emails to the list15:42
rakhmerovdocs have become better in the last ~6 months (thanks to d0ugal and sharat), so I hear less complaints on it15:42
rakhmerovrbrady: yep, ok15:42
rakhmerovrbrady: I think a good idea would be if you could make a small change and send a patch (explain how reviewing works)15:43
rbradyrakhmerov, thrash: for the onboarding, maybe we can cover mistral IRC meeting, mailing list, mistral specific code conventions and discuss the purpose of each of the repos15:43
rakhmerovtogether with a person15:43
rakhmerovyes15:43
rakhmerovas far as code conventions, I wouldn't focus on it now because we didn't formalize them really15:44
rakhmerov(it's my technical debt still)15:44
rbradyrakhmerov: ack, guess we can surprise them on their first patch15:44
rakhmerovyeah )15:44
rakhmerovI'm usually not too picky for newcomers as far as style15:44
rakhmerovso what else...15:45
rakhmerovmaybe write a very simple workflow together with them?15:45
rakhmerov2-3 tasks15:45
thrashrakhmerov: that's a good idea.15:45
rakhmerovdemonstrate the most interesting features like: parallel branches, join, with-items15:45
rakhmerovok15:45
thrashrakhmerov: I will brush up on reverse workflows so we can got through an example of that too.15:46
rakhmerovyou can probably use some examples from mistral-extra15:46
rakhmerovnot sure though if they are up to date15:46
thrashreally depends on what people are looking for... developing workflows or patches to mistral itself.15:46
rakhmerovthrash: yeah, sure. It's kind of an important aspect too (that the system architecturally flexible to allow new workflow types)15:46
rakhmerovbut we don't mention it often15:47
rakhmerovthrash: true, we never know who comes15:47
rakhmerovif any )15:47
rakhmerovat all15:47
rakhmerovif so, that would be the simplest scenario for you though ;)15:47
thrashhaha15:48
rakhmerovkidding, hopefully someone will come15:48
thrashI'm sure we will get at least a handful15:48
rakhmerov:)15:48
rbradyrakhmerov: thanks for your help.  if we mess anything up or can't answer someone, we will point them in your direction. :)15:48
rakhmerovyeah, no problem15:48
rakhmerovbut I think you know it well enough already15:49
rakhmerovthrash, rbrady: ok, so I need to go15:49
thrashrakhmerov: ack. Thanks for the ideas.15:49
rakhmerovif you have anything else I could help with pls let me know (email, irc, whatever)15:49
rakhmerovwe still have time15:49
rakhmerovyep, see ya15:49
rbradyrakhmerov: ack, thanks.15:49
*** brunograz has quit IRC16:06
*** brunograz has joined #openstack-mistral16:23
*** shardy has quit IRC16:28
*** harlowja has joined #openstack-mistral16:48
*** dprince has quit IRC16:48
bretoni am trying to list all instainces in a project in mistral16:59
breton*instances16:59
bretonhow do i pass the project id to search_opts?16:59
*** clenimar has quit IRC17:02
bretonin python i'd do something like list(search_opts={'project_id': project_id})17:04
*** dprince has joined #openstack-mistral17:04
bretonok, figured it out17:09
bretonnext question. Why am i getting this: http://paste.openstack.org/show/608730/17:09
bretonwhy region_name is None?17:15
rakhmerovhi breton17:21
rakhmerovwell, region_name is not handled properly now, this patch should probably fix it: https://review.openstack.org/#/c/460351/17:22
rakhmerovrbrady: one more complaint about actions )17:22
rakhmerovbreton: do you have more than one region?17:22
rakhmerovkong: if you have time, can you help breton with this?17:23
bretonrakhmerov: nope, only 1 region, RegionOne20:09
*** toure is now known as toure|gone20:18
*** dprince has quit IRC20:19
*** catinthe_ has joined #openstack-mistral20:21
bretonthis seems to happen because region is not in the context20:22
*** catintheroof has quit IRC20:24
*** catinthe_ has quit IRC20:45
*** bobh has quit IRC21:15
*** chlong has quit IRC21:17
*** openstackgerrit has joined #openstack-mistral22:04
openstackgerritMerged openstack/mistral-lib master: Update serialization from 'mistral' repo with latest changes  https://review.openstack.org/46198622:04
*** jkilpatr has quit IRC22:05
konghi, breton, still here?22:05
kongbreton: i want to know how you create execution? by CLI or call rest api directly?22:06
konghow you defined you credential file?22:06
*** apetrich_ has joined #openstack-mistral22:27
*** apetrich has quit IRC22:28
*** harlowja has quit IRC22:28
*** d0ugal has quit IRC22:28
*** jkilpatr has joined #openstack-mistral22:39
*** d0ugal has joined #openstack-mistral22:53
*** bobh has joined #openstack-mistral23:04
*** bobh has quit IRC23:11
*** harlowja has joined #openstack-mistral23:31
openstackgerritLingxian Kong proposed openstack/mistral master: Add "running_region" param for OpenStack actions  https://review.openstack.org/46035123:36

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!