Wednesday, 2018-07-18

*** threestrands has joined #openstack-mistral00:40
*** threestrands has quit IRC00:40
*** threestrands has joined #openstack-mistral00:40
*** harlowja has quit IRC01:13
*** mfedosin has quit IRC02:03
*** mfedosin has joined #openstack-mistral02:27
*** gkadam has joined #openstack-mistral02:55
*** gkadam has quit IRC02:59
*** hardikjasani has joined #openstack-mistral04:30
*** openstackgerrit has quit IRC05:10
*** lxkong has quit IRC05:16
*** aspiers has quit IRC05:16
*** mwhahaha has quit IRC05:16
*** portdirect has quit IRC05:16
*** lxkong has joined #openstack-mistral05:35
*** aspiers has joined #openstack-mistral05:35
*** mwhahaha has joined #openstack-mistral05:35
*** portdirect has joined #openstack-mistral05:35
*** akovi has joined #openstack-mistral05:59
*** gkadam has joined #openstack-mistral07:08
*** shardy has joined #openstack-mistral07:12
*** openstackgerrit has joined #openstack-mistral07:35
openstackgerritAndras Kovi proposed openstack/mistral master: Allow engine commands as task name  https://review.openstack.org/58296607:35
rakhmerovd0ugal, akovi, mcdoker181818: hi, I'd appreciate if you review https://review.openstack.org/58167107:44
rakhmerovmcdoker181818: see my comments about not using this option for executor and notifier07:45
*** AlexeyAbashkin has joined #openstack-mistral07:45
rakhmerovthere's no explicit testing for this because I didn't have any good idea how to do this07:45
rakhmerovit's implicitly tested though as I switched the default value to "eventlet"07:45
d0ugalrakhmerov: sure, I'll take a look soon!07:48
d0ugalI just need coffee :)07:48
rakhmerovthanks )07:48
rakhmerovand good morning!07:48
*** jtomasek has joined #openstack-mistral07:50
d0ugalMorning!07:56
d0ugalbtw everyone, I'll be releasing mistral-lib tomorrow if there are any changes08:33
d0ugalThis week if the last week for non-client libraries08:33
*** threestrands has quit IRC08:51
akovid0ugal: What do you think: should we aim to merge these https://review.openstack.org/#/q/topic:service-catalog-issue+(status:open+OR+status:merged)09:00
jlejeuneakovi: +1 :)09:00
*** nguyenhai_ has joined #openstack-mistral09:03
pgaxattejlejeune: haha you were lurking in the shadows :D09:05
pgaxattehi everyone09:06
*** nguyenhai93 has quit IRC09:06
jlejeunepgaxatte: :)09:10
*** xavierhardy has joined #openstack-mistral09:11
xavierhardyHi everyone09:11
xavierhardyIs it possible to add more executor thread/process per executor instance in Mistral?09:11
xavierhardyis it executor_thread_pool_size ?09:12
xavierhardyrakhmerov , d0ugal?09:14
mcdoker181818xavierhardy: Hi, If I understand correctly, no, you can't09:16
xavierhardywhat makes you think that?09:16
mcdoker181818executor_thread_pool_size is number of green threads, which handle a rabbitmq messages09:16
xavierhardyOK, but are those threads not handling the execution as well? Why would you need 64 (default value) threads if there's just one thread handling the execution?09:18
mcdoker181818For example, if you set 5 that executor can handle only 5 actions at a time.09:20
mcdoker181818What's problem to launch multiple instances?09:21
mcdoker18181864 (default value) threads  are green threads inside one real OS thread09:27
d0ugalakovi: It would be good to move them forward. I forget what my comments on the review were :)09:28
d0ugalakovi: we also discussed this at the PTG and I don't remember everything we said either!09:29
*** xavierhardy has quit IRC09:36
pgaxatteis there a reason why the API server is able to parse XML? does mistral accept XML anywhere? apparently it is possible to DoS the api using XML entity expansion09:38
d0ugalpgaxatte: The API just supports both JSON and XML.09:39
d0ugalI do wonder if anyone uses XML :)09:39
pgaxatteok09:39
pgaxatteyeah i guess noone uses it09:40
pgaxattethanks d0ugal, i'll report09:40
pgaxattebacl09:40
pgaxatteback09:40
pgaxatteour security team is checking mistral to see what could be exploited09:41
d0ugalInteresting. It will be good to hear of any other findings :)09:41
pgaxatteyeah absolutely09:42
pgaxatteI hope this helps everyone09:42
pgaxatted0ugal: is there a way to completely disable xml support?09:54
*** xavierhardy has joined #openstack-mistral09:55
pgaxatteapparently at least nova and cinder don't support it anymore (or we have set something in conf that I'm not aware of)09:55
d0ugalpgaxatte: Not that I know of, but I have never tried. I'll take a look.09:56
*** xavierhardy has quit IRC09:56
*** xavierhardy1 has joined #openstack-mistral09:56
pgaxatteok thanks d0ugal, i'll see on my side if I find anything09:58
d0ugalpgaxatte: I can't see anything obvious.09:58
d0ugalI guess the support comes with pecan by default?09:58
xavierhardy1mcdoker181818 => OK that was my understanding09:59
xavierhardy1so by the default, it can handle 64 actios at a time09:59
d0ugalpgaxatte: maybe it is a wsme feature actually...10:00
pgaxatted0ugal: do you know if pecan is used in other openstack products?10:01
d0ugalpgaxatte: yes, is many of them10:01
mcdoker181818xavierhardy1: if I understand correctly :)10:01
pgaxatted0ugal: i'll try to compare with cinder to see where mistral differs because cinder does not support xml10:02
xavierhardy1thanks10:03
d0ugalpgaxatte: it doesn't look like cinder uses pecan10:04
jlejeuneakovi: thanks to your patch, I can today run actions on different openstack regions using ENV variables11:02
jlejeunebut is there a way to define ENV variable directly in workflows ?11:03
jlejeuneI 've tried to play with mistral environment but it doesn't work as expected11:03
jlejeunecan I source ENV authentification variables somewhere else ?11:04
jlejeuneto be accessible in workflows ?11:04
akovijlejeune: no, currently, it is possible to run workflows against multiple regions but the auth parameters have to be passed over the API11:06
akoviand an execution can be targeted on a single region11:07
akovi:(11:07
jlejeuneI see11:07
akovirakhmerov: d0ugal: I'm trying to fix a concurrency issue in the tempest tests and have a question http://logs.openstack.org/66/582966/6/check/mistral-devstack/dd7e2ac/testr_results.html.gz11:11
akoviNow that the tempest tests are isolated from Mistral core, would it be possible to use the python-mistralclient instead of reimplementing it in tempest?11:12
akoviThere is lots of tricking with urls and json parsing and... just feels bad11:13
d0ugalrakhmerov: I think we should have a release note for https://review.openstack.org/#/c/581671/11:16
d0ugalrakhmerov: since there is a new config option11:16
d0ugalrakhmerov: but I think we can add that in a follow up patch.11:17
openstackgerritAndras Kovi proposed openstack/mistral-tempest-plugin master: Always use id of workflow instead of name  https://review.openstack.org/58355011:22
d0ugalakovi: I think tempest encourages projects to not use their own clients, but I forget why11:24
d0ugalakovi: I would be fine with using mistralclient, but I guess we want some simple rest client tests still11:24
akovid0ugal: that's my train of thoughts here as well haha11:27
d0ugalakovi: Our tempest tests are horrible. I don't really know how to improve them because I think it is a huge job.11:28
d0ugalWe also need to move the tempest tests from mistralclient11:28
pgaxatted0ugal: neutron seems to use pecan we'll try against it12:00
d0ugalGood idea12:03
openstackgerritBrad P. Crochet proposed openstack/mistral master: Install mistral-lib as a sibling for tox jobs  https://review.openstack.org/58323212:17
pgaxatted0ugal: neutron does not respond in XML ever12:20
pgaxattewhatever Accept header I put it always answers in JSON12:21
d0ugalInteresting, so we need to see how they do it :)12:21
openstackgerritBrad P. Crochet proposed openstack/mistral master: Add user creds trusts to db  https://review.openstack.org/46205612:27
pgaxatted0ugal: there does not seem to be any support for xml in pecan.... I dont understand *what* answers in XML12:50
pgaxatted0ugal: ok as you suggested it's apparently wsme12:55
pgaxattethe resources are inherited from it and it seems to be able to serialize to XML12:55
*** hardikjasani has quit IRC13:10
*** toure|gone is now known as toure13:14
openstackgerritMerged openstack/mistral master: Fix rev-id parameter in mistral-db-manage  https://review.openstack.org/58321413:15
pgaxattewell this is scary: https://docs.python.org/3/library/xml.html#xml-vulnerabilities13:22
d0ugal:)13:23
d0ugalpgaxatte: https://github.com/openstack/neutron/blob/master/neutron/api/v2/resource.py#L41-L4313:24
d0ugalI suspect that is what controls it13:24
pgaxatted0ugal: yes it is forced to answer in json13:25
d0ugalLooks a bit like a hack :)13:25
d0ugalpgaxatte: https://github.com/openstack/neutron/commit/1b4ad95758c6cff7bc9a461f445c4b4e6796443413:25
d0ugalIt was removed 4 years ago :)13:25
pgaxattewith wsme you could tweak it from here: https://github.com/openstack/wsme/blob/master/wsme/rest/protocol.py#L1813:25
d0ugals/It/XML/13:25
pgaxatteyeah they did well13:26
pgaxatted0ugal: I wonder if xml support could be removed from here: https://github.com/openstack/mistral/blob/master/mistral/api/controllers/v2/service.py13:28
d0ugalpgaxatte: possibly13:29
pgaxattei'll try that13:30
d0ugalWe need to make it optional and deprecate it first13:30
*** _Adary has quit IRC13:30
*** bobh has joined #openstack-mistral13:35
openstackgerritMerged openstack/mistral master: Add the config option for Oslo Messaging executor type  https://review.openstack.org/58167113:39
*** bobh has quit IRC13:40
*** bobh has joined #openstack-mistral13:57
*** bobh has quit IRC14:01
pgaxatted0ugal: yes that's what I had in mind14:10
d0ugalGreat14:10
*** akovi has quit IRC14:22
openstackgerritBrad P. Crochet proposed openstack/mistral master: Add user creds trusts to db  https://review.openstack.org/46205614:22
*** gkadam is now known as gkadam-afk15:59
*** gkadam-afk is now known as gkadam16:23
*** AlexeyAbashkin has quit IRC16:36
*** AlexeyAbashkin has joined #openstack-mistral16:39
*** AlexeyAbashkin has quit IRC16:43
*** xavierhardy1 has quit IRC16:49
*** shardy has quit IRC17:15
*** gkadam has quit IRC17:38
*** jtomasek has quit IRC17:50
*** xavierhardy has joined #openstack-mistral18:51
*** harlowja has joined #openstack-mistral18:54
*** xavierhardy has quit IRC18:56
*** gkadam has joined #openstack-mistral20:45
*** gkadam has quit IRC21:04
*** threestrands has joined #openstack-mistral23:50
*** threestrands has quit IRC23:50
*** threestrands has joined #openstack-mistral23:50

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!