Tuesday, 2019-04-02

*** bobh has joined #openstack-mistral02:07
*** bobh has quit IRC02:17
*** gkadam has joined #openstack-mistral02:48
*** gkadam has quit IRC02:50
*** openstackgerrit has joined #openstack-mistral04:54
openstackgerritRenat Akhmerov proposed openstack/mistral master: Add "convert_input_data" config property for YAQL expressions  https://review.openstack.org/64831604:54
*** openstackgerrit has quit IRC06:09
*** jtomasek has joined #openstack-mistral06:29
*** nguyenhai has joined #openstack-mistral06:46
*** nguyenhai_ has quit IRC06:49
*** pgaxatte has joined #openstack-mistral06:52
vgvolegomg, we tried to start about 100 engines for big process and there was a lot of07:43
vgvolegoslo_db.exception.DBDeadlock: (psycopg2.extensions.TransactionRollbackError) deadlock detected07:43
vgvolegin scheduler logic07:44
vgvolegafter process was stucked we have seen a lot of idle connections with db07:50
vgvolegHave anyone ever hit this behavior?07:52
vgvolegWas `random_delay` add because of this?07:53
*** akovi has joined #openstack-mistral08:00
*** gkadam has joined #openstack-mistral08:10
*** akovi has quit IRC09:25
*** akovi has joined #openstack-mistral09:26
*** akovi has quit IRC09:29
*** akovi has joined #openstack-mistral09:29
*** zigo has joined #openstack-mistral10:00
*** openstackgerrit has joined #openstack-mistral10:01
openstackgerritRenat Akhmerov proposed openstack/mistral master: Set the lower version of sphinxcontrib-pecanwsme to 0.10.0  https://review.openstack.org/64927010:01
*** vgvoleg has quit IRC10:04
*** vgvoleg has joined #openstack-mistral10:14
*** akovi has quit IRC10:14
*** akovi has joined #openstack-mistral10:15
rakhmerovvgvoleg: please talk to me before doing something like this :)11:04
rakhmerov100 engines is a way beyond Mistral's current scalability11:04
rakhmerov10 is about the max number for something big11:04
rakhmerovas far as scheduler, yes, it's a narrow place now, it's being fixed by adding a new implementation of scheduler (the prototype is already in the code) that doesn't hit DB so badly11:05
*** akovi has quit IRC11:50
*** akovi has joined #openstack-mistral11:51
*** nguyenhai has quit IRC12:32
vgvolegguys, are there any known memory leaks in engine and any parameters to handle it? Seems like engine don't free it's memory at all13:49
vgvolegtest case: big workflow with huge context13:50
vgvolegI'm going to retry this with 10 engines and I'll share grafana graphics13:51
*** pgaxatte has quit IRC15:44
*** akovi has quit IRC16:06
*** gkadam has quit IRC17:02

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!