*** toddjohn_ has quit IRC | 00:13 | |
*** Qiming has quit IRC | 00:26 | |
*** krotscheck_dcm is now known as krotscheck | 00:39 | |
*** bobh has quit IRC | 00:45 | |
*** bobh has joined #openstack-mistral | 00:46 | |
*** cheneydc has joined #openstack-mistral | 01:00 | |
*** chlong has joined #openstack-mistral | 01:00 | |
*** Qiming has joined #openstack-mistral | 01:16 | |
*** bobh has quit IRC | 01:48 | |
*** cheneydc has quit IRC | 02:26 | |
*** cheneydc has joined #openstack-mistral | 02:28 | |
*** toddjohn_ has joined #openstack-mistral | 04:08 | |
*** toddjohn_ has quit IRC | 04:13 | |
rakhmerov | kong: hi | 04:14 |
---|---|---|
kong | rakhmerov: hi | 04:15 |
rakhmerov | I saw that your patch is now green | 04:15 |
kong | hah | 04:15 |
rakhmerov | with applying upper constraints | 04:15 |
rakhmerov | :) | 04:15 |
rakhmerov | is it considered finished? | 04:15 |
kong | i think so | 04:15 |
rakhmerov | ok | 04:16 |
rakhmerov | I reviewed it, looks ok to me | 04:16 |
rakhmerov | great job | 04:16 |
kong | and I am concerned that tripleo-common uses mistral code directly... | 04:16 |
rakhmerov | it's for actions | 04:16 |
rakhmerov | for developing new custom actions | 04:17 |
kong | the reason that your patch failed is, mistral is a 'library' in requirement.txt | 04:17 |
rakhmerov | yes, I know | 04:17 |
kong | yes, i looked at their code | 04:17 |
rakhmerov | we discussed this at the summit and even before, we'll move OpenStack actions to a separate repo | 04:17 |
kong | i am surprising when i saw that mistral is in requirement.txt | 04:17 |
kong | didn't noticed that before | 04:18 |
rakhmerov | yep | 04:18 |
kong | it's weird | 04:18 |
rakhmerov | as far as using it directly: 1) we'll move actions to a separate repo 2) we'll scope a Python package that can be used for developing new actions | 04:18 |
rakhmerov | 3) Most likely we'll have to have this package in a separate repo, too | 04:19 |
rakhmerov | don't know yet though | 04:19 |
kong | mistral-lib | 04:19 |
rakhmerov | something like that | 04:19 |
rakhmerov | kong: what about that question about tag 2.0.0-1 ? | 04:20 |
kong | ? | 04:20 |
kong | what was the question? | 04:20 |
kong | maybe i missed something here | 04:20 |
rakhmerov | (Fri May 20 2016 13:17:20) hi Mistral | 04:20 |
rakhmerov | EmilienM | 04:20 |
rakhmerov | (Fri May 20 2016 13:17:48) there is a tagging issue in your repo, 2.0.0-1 is missing, latest tag is still 2.0.0 and it causes issues for packaging | 04:20 |
rakhmerov | I'm not sure what this tag is meant to be fore | 04:21 |
kong | maybe need some other investigation | 04:22 |
rakhmerov | can you look at it? and talk to EmilienM? | 04:22 |
kong | sure | 04:23 |
rakhmerov | seems like we were supposed to release something lately | 04:23 |
rakhmerov | but anyway I guess it wasn't possible because of that issue with upper constraints | 04:23 |
rakhmerov | we need to backport that patch into stable/mitaka | 04:23 |
kong | rakhmerov: yes | 04:24 |
kong | EmilienM: hi, I don't know where '2.0.0-1' of what you said is coming from , could you please provide more details? | 04:33 |
openstackgerrit | Merged openstack/mistral: Updated from global requirements https://review.openstack.org/318859 | 04:36 |
openstackgerrit | Merged openstack/mistral: Update get_arg_list_as_str to skip func params https://review.openstack.org/319581 | 04:44 |
openstackgerrit | Merged openstack/mistral: Add baremetal.wait_for_finish action to mapping https://review.openstack.org/319582 | 04:46 |
openstackgerrit | Merged openstack/mistral-specs: Add support for mistral notification event triggers https://review.openstack.org/308664 | 05:07 |
*** chlong has quit IRC | 05:08 | |
openstackgerrit | Renat Akhmerov proposed openstack/mistral: WIP: engine refactoring https://review.openstack.org/317879 | 05:12 |
*** chlong has joined #openstack-mistral | 05:24 | |
*** Regalla has joined #openstack-mistral | 05:50 | |
*** Ravikiran_K has joined #openstack-mistral | 05:56 | |
*** toddjohn_ has joined #openstack-mistral | 06:10 | |
*** toddjohn_ has quit IRC | 06:14 | |
*** chlong has quit IRC | 06:25 | |
mflobo | good morning | 06:35 |
rakhmerov | mflobo: hi | 07:05 |
*** mgershen has joined #openstack-mistral | 07:07 | |
*** shardy has joined #openstack-mistral | 07:31 | |
mflobo | rakhmerov, I have a couple of questions about Mistral architecture, when you have some time | 07:47 |
rakhmerov | you can write them, I'll answer when I can | 07:50 |
rakhmerov | in ~ 1 hour | 07:50 |
mflobo | ok, here the architecture http://docs.openstack.org/developer/mistral/architecture.html. We see 2 queues. Correct me if I'm wrong: 1) The API server put a workflow in the "workflow queue" to be executed. 2) The Engine take the workflow from the queue and sen it to the Scheduler. 3) The scheduler puts the tasks to be executed int the "Task queue". 4) the Executor takes the actions and execute them | 08:11 |
mflobo | rakhmerov, ^ is that correct? | 08:11 |
*** toddjohn_ has joined #openstack-mistral | 08:11 | |
mflobo | rakhmerov, for the Queues, Mistral manages RabbitMQ? or it just implement its own queue system? | 08:12 |
rakhmerov | yes, generally it's still true | 08:12 |
rakhmerov | with some nuances | 08:12 |
rakhmerov | e.g. it's rather Action Queue than Task Queue, in fact | 08:12 |
mflobo | ok | 08:13 |
rakhmerov | mflobo: usually people use Rabbit but it | 08:13 |
rakhmerov | it's abstracted out with oslo.messaging | 08:13 |
rakhmerov | so it may be a different transport | 08:13 |
mflobo | rakhmerov, I see | 08:13 |
*** rwsu has joined #openstack-mistral | 08:14 | |
rakhmerov | but like I said earlier, there's a problem with oslo.messaging, we're now working to work around it using direct Rabbit access | 08:14 |
openstackgerrit | Renat Akhmerov proposed openstack/mistral: WIP: engine refactoring https://review.openstack.org/317879 | 08:15 |
*** toddjohn_ has quit IRC | 08:16 | |
*** dmk0202 has joined #openstack-mistral | 08:19 | |
mflobo | rakhmerov, but in the architecture diagram I see an arrow from Scheduler to Workflow queue... what does it mean? | 08:35 |
*** jtomasek has joined #openstack-mistral | 08:39 | |
*** hparekh_ has joined #openstack-mistral | 08:47 | |
*** hparekh_ has quit IRC | 08:47 | |
rakhmerov | yes, there's also communications Engine -> Engine, e.g. when we need to run subworkflow | 08:57 |
rakhmerov | i.e. workflow from another workflow | 08:57 |
rakhmerov | so Scheduler is needed mostly to decouple all communications between all components | 08:58 |
rakhmerov | sort of an RPC gate with the ability to do something in deferred mode | 08:58 |
rakhmerov | which is also needed in many cases (I mean deferred mode) | 08:58 |
rakhmerov | although this diagram is mostly fine we probably need to make it up to date, there are some nuances that have changed since we made it | 08:59 |
rakhmerov | mflobo: let me know if it makes sense | 09:00 |
mflobo | rakhmerov, Sorry, probably I'm missing something, but still I don't understand why "Scheduler" has access to the workflow queue :) | 09:00 |
rakhmerov | ok | 09:00 |
rakhmerov | when one Engine needs to communicate to another Engine (it may be the same one actually) via RPC it uses Scheduler | 09:01 |
rakhmerov | for example | 09:01 |
rakhmerov | wf: | 09:01 |
rakhmerov | tasks: | 09:01 |
rakhmerov | t1: | 09:01 |
rakhmerov | workflow: nested_wf | 09:02 |
rakhmerov | here one workflow calls another workflow, sometimes it should be done with some delay, if we use some policies like "wait-before" | 09:02 |
rakhmerov | in order to make that delay and avoid calling RPC from within a DB transaction we use Scheduler | 09:03 |
mflobo | rakhmerov, aahh, I see now :) thanks | 09:03 |
rakhmerov | whose only responsibility is to call certain methods scheduled to run a later time | 09:03 |
rakhmerov | yeah :) | 09:03 |
rakhmerov | its contract basically is something like "Call this method in 30 mins" | 09:04 |
rakhmerov | and it does it in a reliable manner | 09:04 |
mflobo | ok | 09:05 |
openstackgerrit | Renat Akhmerov proposed openstack/mistral: WIP: engine refactoring https://review.openstack.org/317879 | 09:09 |
*** toddjohn_ has joined #openstack-mistral | 09:12 | |
openstackgerrit | Renat Akhmerov proposed openstack/mistral: WIP: engine refactoring https://review.openstack.org/317879 | 09:16 |
*** toddjohn_ has quit IRC | 09:17 | |
*** d0ugal has quit IRC | 09:40 | |
*** d0ugal has joined #openstack-mistral | 09:41 | |
mflobo | rakhmerov, I followed your advise https://blueprints.launchpad.net/mistral/+spec/add-policy-file | 09:53 |
mflobo | :) | 09:53 |
rakhmerov | ok :) | 09:54 |
*** cheneydc has quit IRC | 09:59 | |
mflobo | Mistral guys, question about an error that I have | 10:02 |
rakhmerov | mflobo: what error and questin? | 10:03 |
mflobo | I execute a workflow, it' works but I have this error: | 10:03 |
mflobo | ERROR mistral.engine.default_executor NotFoundException: ActionExecution not found | 10:03 |
mflobo | And the execution never finish | 10:03 |
rakhmerov | what action? | 10:04 |
rakhmerov | and can you post a workflow text? | 10:04 |
mflobo | Also, the execution is created without task-execution-id | 10:04 |
mflobo | yeah, sure | 10:04 |
rakhmerov | Empty task-execution-id is fine, it's only needed to run nested workflows | 10:04 |
mflobo | this is the workflow http://paste.openstack.org/show/498043/ | 10:04 |
mflobo | ok | 10:05 |
mflobo | and this is the full error log http://paste.openstack.org/show/498044/ | 10:06 |
rakhmerov | mflobo: I'd like to ask you to file a bug at https://bugs.launchpad.net/mistral and specify all steps to reproduce this | 10:06 |
mflobo | ok, I'll do | 10:06 |
rakhmerov | that way we'll have better chances to fix it since more people could look at it | 10:06 |
rakhmerov | :) | 10:06 |
mflobo | rakhmerov, thanks | 10:07 |
rakhmerov | I don't have an immediate answer, we need to investigate, it must be something simple | 10:07 |
rakhmerov | I believe | 10:07 |
mflobo | I'd say is somtheing related with the engine. | 10:07 |
*** Regalla has quit IRC | 10:08 | |
rakhmerov | not necessary | 10:08 |
mflobo | because is intermitent: | 10:10 |
mflobo | workflow execution 1: apparently it worked, no error messages, but it didn't | 10:10 |
mflobo | workflow execution 2: it worked, the project was created, but I have this error in the log and the execution never finish | 10:10 |
mflobo | workflow execution 3: same than 1 | 10:10 |
mflobo | workflow execuition 4: same than 2 | 10:10 |
mflobo | ... | 10:10 |
mflobo | I have the full case here http://paste.openstack.org/show/497848/ and is what I'll report in the bug report | 10:11 |
rakhmerov | hm... it's actually weird | 10:12 |
mflobo | yes, I tried in a new VM, getting mistral from GIT and master branch and I have the same issue | 10:13 |
mflobo | rakhmerov, I'd bet for engine issue and some problem with sync... just wondering :) | 10:13 |
rakhmerov | this stack trace is not enough actually, there should be something in engine log | 10:14 |
rakhmerov | can you look at the log and show it? | 10:14 |
rakhmerov | mflobo: maybe, yes | 10:14 |
rakhmerov | there must be a particular place where engine gets action execution from DB and it fails | 10:14 |
mflobo | rakhmerov, I showed you the only thing than engine log display | 10:15 |
*** Qiming has quit IRC | 10:30 | |
rakhmerov | hm.. | 10:47 |
*** FL1SK has quit IRC | 11:00 | |
openstackgerrit | Merged openstack/mistral: Enforcing upper constraints for tox test jobs https://review.openstack.org/319024 | 11:07 |
*** Ravikiran_K has quit IRC | 11:08 | |
mflobo | If someone has time https://bugs.launchpad.net/mistral/+bug/1584731 :) | 11:27 |
openstack | Launchpad bug 1584731 in Mistral "Intermitent ActionExecution not found" [Undecided,New] | 11:27 |
openstackgerrit | Renat Akhmerov proposed openstack/mistral: WIP: engine refactoring https://review.openstack.org/317879 | 11:37 |
openstackgerrit | Andras Kovi proposed openstack/mistral-specs: Add support for executing workflows on any cloud without having to reconfigure the Mistral service. https://review.openstack.org/319868 | 11:47 |
*** dprince has joined #openstack-mistral | 11:57 | |
*** rbrady has joined #openstack-mistral | 12:03 | |
rakhmerov | mflobo: we'll have someone look at it | 12:12 |
*** bobh has joined #openstack-mistral | 12:15 | |
*** toddjohn_ has joined #openstack-mistral | 12:20 | |
*** Ravikiran_K has joined #openstack-mistral | 12:36 | |
*** zaneb has quit IRC | 12:38 | |
*** bobh has quit IRC | 12:40 | |
*** toddjohn_ has quit IRC | 12:41 | |
*** toddjohn_ has joined #openstack-mistral | 12:41 | |
*** toddjohn_ has quit IRC | 12:46 | |
*** FL1SK has joined #openstack-mistral | 12:59 | |
*** bobh has joined #openstack-mistral | 13:15 | |
*** toddjohn_ has joined #openstack-mistral | 13:23 | |
*** Qiming has joined #openstack-mistral | 13:27 | |
*** mgershen is now known as _mgershen | 13:56 | |
*** vishwanathj has joined #openstack-mistral | 14:12 | |
*** tonytan4ever has joined #openstack-mistral | 14:32 | |
*** rena9067 has joined #openstack-mistral | 14:57 | |
*** tonytan4ever has quit IRC | 14:59 | |
*** rbrady has quit IRC | 15:09 | |
*** rbrady_ has joined #openstack-mistral | 15:09 | |
*** rbrady_ has quit IRC | 15:11 | |
*** rbrady has joined #openstack-mistral | 15:12 | |
*** toddjohn has quit IRC | 15:14 | |
*** dmowrer has quit IRC | 15:15 | |
openstackgerrit | Bertrand Lallau proposed openstack/mistral: Remove unnecessary executable permissions https://review.openstack.org/320006 | 15:30 |
*** dmk0202 has quit IRC | 15:47 | |
*** tonytan4ever has joined #openstack-mistral | 15:48 | |
*** Qiming has quit IRC | 15:59 | |
*** toddjohn_ has quit IRC | 16:09 | |
*** toddjohn has joined #openstack-mistral | 16:09 | |
*** toddjohn has quit IRC | 16:13 | |
*** rbrady has quit IRC | 16:20 | |
*** rbrady has joined #openstack-mistral | 16:20 | |
*** gyee has joined #openstack-mistral | 16:20 | |
*** Ravikiran_K_ has joined #openstack-mistral | 16:38 | |
*** Ravikiran_K has quit IRC | 16:41 | |
*** tonytan4ever has quit IRC | 16:56 | |
rbrady | was it named after wind or a ship? | 17:00 |
rakhmerov | yeah )) | 17:01 |
rakhmerov | naming it after a ship would be cool | 17:01 |
rakhmerov | being a russian I like it very much ) | 17:01 |
*** rbrady has quit IRC | 17:02 | |
rakhmerov | I even used a picture of that battleship once in one of my presentations | 17:02 |
rakhmerov | :) People like that | 17:02 |
*** rbrady has joined #openstack-mistral | 17:02 | |
*** toddjohn has joined #openstack-mistral | 17:18 | |
*** harlowja has joined #openstack-mistral | 17:24 | |
*** Ravikiran_K_ has quit IRC | 17:30 | |
*** tonytan4ever has joined #openstack-mistral | 17:54 | |
*** tonytan4ever has quit IRC | 17:55 | |
*** tonytan4ever has joined #openstack-mistral | 18:05 | |
*** toddjohn has quit IRC | 18:13 | |
*** toddjohn has joined #openstack-mistral | 18:14 | |
*** toddjohn has quit IRC | 18:14 | |
*** toddjohn has joined #openstack-mistral | 18:14 | |
*** ig0r_ has joined #openstack-mistral | 18:15 | |
*** tonytan4ever has quit IRC | 18:33 | |
*** tonytan4ever has joined #openstack-mistral | 18:52 | |
*** dmowrer has joined #openstack-mistral | 18:55 | |
*** tonytan_brb has joined #openstack-mistral | 18:59 | |
*** tonytan4ever has quit IRC | 19:00 | |
*** toddjohn has quit IRC | 19:02 | |
*** dmowrer has quit IRC | 19:02 | |
*** toddjohn has joined #openstack-mistral | 19:04 | |
*** dmowrer has joined #openstack-mistral | 19:04 | |
*** rena9067 has quit IRC | 19:43 | |
*** rena9067 has joined #openstack-mistral | 19:43 | |
*** ig0r_ has quit IRC | 19:59 | |
*** toddjohn has quit IRC | 20:11 | |
*** dmowrer has quit IRC | 20:11 | |
*** toddjohn has joined #openstack-mistral | 20:13 | |
*** toddjohn has quit IRC | 20:17 | |
*** rena9067_ has joined #openstack-mistral | 20:24 | |
*** rena9067 has quit IRC | 20:26 | |
*** dmowrer has joined #openstack-mistral | 20:31 | |
*** dmowrer has quit IRC | 20:35 | |
*** shardy has quit IRC | 20:40 | |
*** dprince has quit IRC | 20:42 | |
*** toddjohn has joined #openstack-mistral | 21:03 | |
*** tonytan_brb has quit IRC | 21:21 | |
*** dmowrer has joined #openstack-mistral | 21:38 | |
*** bobh has quit IRC | 22:16 | |
*** toddjohn has quit IRC | 22:17 | |
*** tonytan4ever has joined #openstack-mistral | 22:25 | |
*** dmowrer has quit IRC | 22:43 | |
*** stevebak` has joined #openstack-mistral | 22:51 | |
*** d0ugal has quit IRC | 22:53 | |
*** ddeja has quit IRC | 22:53 | |
*** zhenguo_ has quit IRC | 22:53 | |
*** stevebaker has quit IRC | 22:53 | |
*** chlong has joined #openstack-mistral | 22:58 | |
*** Qiming has joined #openstack-mistral | 23:05 | |
*** tonytan4ever has quit IRC | 23:06 | |
*** bobh has joined #openstack-mistral | 23:18 | |
*** ddeja has joined #openstack-mistral | 23:30 | |
*** zhenguo_ has joined #openstack-mistral | 23:39 | |
*** toddjohn has joined #openstack-mistral | 23:48 | |
*** Qiming has quit IRC | 23:51 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!