Wednesday, 2018-06-13

openstackgerritsunqingliang proposed openstack/mistral master: modify grammer mistake  https://review.openstack.org/57421701:00
openstackgerritsunqingliang proposed openstack/mistral master: modify grammer mistake  https://review.openstack.org/57421701:03
openstackgerritsunqingliang proposed openstack/mistral master: modify grammer mistake  https://review.openstack.org/57421701:06
*** bobh has joined #openstack-mistral02:43
*** bobh has quit IRC02:49
rakhmerovd0ugal: hi, just FYI: I'm back04:56
rakhmerov:)04:56
openstackgerritMerged openstack/mistral-dashboard master: Ignore the .eggs directory  https://review.openstack.org/57233205:15
openstackgerritMerged openstack/mistral master: add the release note  https://review.openstack.org/57423505:27
openstackgerritMerged openstack/python-mistralclient master: Remove PyPI downloads  https://review.openstack.org/57327205:44
openstackgerritMerged openstack/mistral master: Add the restructuredtext check to the flake8 job  https://review.openstack.org/57318806:17
*** mcdoker181818 has quit IRC06:30
*** AlexeyAbashkin has joined #openstack-mistral06:54
*** nguyenhai_ has quit IRC07:17
apetrichrakhmerov, wb07:20
apetrichrakhmerov, when you have the time could have a look at this one: https://review.openstack.org/#/c/572813/07:20
apetrichthere's no hurry, I just need more reviews07:20
*** threestrands has quit IRC07:21
*** rbrady_ has joined #openstack-mistral07:26
*** rbrady_ is now known as Guest5238107:27
*** rbrady has quit IRC07:29
rakhmerovapetrich: thanks!07:32
rakhmerovapetrich: sure, I'll have a look07:32
*** jpich has joined #openstack-mistral07:39
pgaxattehello07:41
pgaxattei have a few questions on Mistral deployment strategies if anyone can help07:43
*** gkadam has joined #openstack-mistral08:20
*** s10 has joined #openstack-mistral08:22
*** s10 has quit IRC08:26
*** s10 has joined #openstack-mistral08:27
*** shardy has joined #openstack-mistral08:29
d0ugalrakhmerov: welcome back!08:29
rakhmerovthanks )08:29
d0ugalpgaxatte: deployment strategies?08:29
d0ugalapetrich: https://review.openstack.org/#/c/573189/ https://review.openstack.org/#/c/573191/ https://review.openstack.org/#/c/573187/ https://review.openstack.org/#/c/573190/08:30
d0ugalapetrich: 4 small pathces when you get a moment08:30
d0ugalrakhmerov: Did you have a good break?08:30
rakhmerovyep, it was quite good )08:31
*** AlexeyAbashkin has quit IRC08:31
*** AlexeyAbashkin has joined #openstack-mistral08:40
openstackgerritMerged openstack/mistral-lib master: Add the restructuredtext check to the flake8 job  https://review.openstack.org/57319008:42
openstackgerritMerged openstack/mistral-extra master: Add the restructuredtext check to the flake8 job  https://review.openstack.org/57318908:42
openstackgerritMerged openstack/mistral-dashboard master: Add the restructuredtext check to the flake8 job  https://review.openstack.org/57318708:58
d0ugalapetrich: thanks09:27
apetrichd0ugal, no worries09:27
openstackgerritMerged openstack/python-mistralclient master: Add the restructuredtext check to the flake8 job  https://review.openstack.org/57319109:27
apetrichI think I've reviewed and tried them before the rebase09:28
rakhmerovd0ugal, apetrich: what are you guys up to?09:40
rakhmerovI wonder if I missed anything important09:40
apetrichI'm trying and failing at getting a good base on https://blueprints.launchpad.net/mistral/+spec/sample-custom-action-project09:42
d0ugalrakhmerov: I am actually just trying to decide what to do :)09:43
rakhmerovaah! )09:43
rakhmerovinteresting09:43
d0ugalAfter milestone 2 I don't have anything I am working on now09:43
rakhmerovI need to write some docs for the internal purposes, I'll spend a few next days on that09:44
d0ugalLots of things I started before that I need to finish09:44
rakhmerovafter that I'll be working on improving Scheduler09:44
rakhmerovd0ugal: yeah, I see09:44
d0ugalToo many things to pick from :)09:44
pgaxatted0ugal: didn't see your response. I'm wondering how people deploy mistral in a multi-region environment09:49
d0ugalpgaxatte: Interesting. Sorry, I don't have any experience with that.09:50
d0ugalrakhmerov: ^ Do you?09:50
pgaxatteif they deploy one endpoint per region or a global endpoint for all regions09:50
rakhmerovd0ugal: unfortunately no09:53
pgaxatterakhmerov do you know of anyone using mistral on multiple regions?09:54
pgaxattei know CERN uses mistral but i have no idea if they use regions or not09:54
rakhmerovpgaxatte: no, not really09:54
rakhmerovI don't know that too09:55
rakhmerovwell, lots of people use Mistral but many use it w/o auth at all09:55
rakhmerovas far as regions, hm.. thinking09:55
rakhmerovif someone comes to my mind I'll let you know09:55
pgaxatterakhmerov: thanks i'm really hoping on some feedback09:56
d0ugalrakhmerov: I guess maybe kong did, because he had some patches related to it09:56
d0ugalbut he isn't in here anymore :(09:56
pgaxatteand this question comes with a second one: how do you scale out Mistral?09:57
rakhmerovd0ugal: yes! Right09:57
d0ugaloh, lxkong - maybe he is still here.09:57
rakhmerovpgaxatte: adding more engines and executors09:57
rakhmerov:)09:57
pgaxattei guess the tricky part is the cron scheduler?09:57
rakhmerovpgaxatte: well, there are two things in Mistral and they shouldn't be confused09:59
rakhmerovone is Cron Trigger09:59
rakhmerovit's the part of the user functionality that allows to run workflows on schedule (by configuring a cron pattern)09:59
rakhmerovanother is Scheduler, which is an internal component, critical for all stable work of Mistral Engine10:00
rakhmerovit's not visible from outside but yes, it's probably the worst bottleneck for scaling out that we currently have10:00
rakhmerovI'm starting to rework it actually so that it becomes more scalable10:01
pgaxattecan the scheduler be scaled out?10:01
pgaxattei saw there is an option to use zookeeper, is this related?10:01
*** AlexeyAbashkin has quit IRC10:06
*** AlexeyAbashkin has joined #openstack-mistral10:06
*** jaewook_oh has quit IRC10:07
*** AlexeyAbashkin has quit IRC10:11
*** d0ugal has quit IRC10:17
rakhmerovpgaxatte: that's the point that it doesn't scale well10:18
rakhmerovzookeeper no, not planned10:18
rakhmerovpgaxatte: so, we have Mistral stable installations with 6-7 engines10:19
rakhmerovunder high load10:20
rakhmerovif we add more we start getting lots of troubles10:20
rakhmerovif the load is not so high then you can have 10+ engines with some configuration tweaks10:20
rakhmerovspeaking about executors, they scale well, you can add as many as you need10:21
lxkongpgaxatte: hi, yes, i've only tested mistral in single region, and invoke services that belong to multi-regions. But it's a loooong time ago. Since mistral is temporarily not in our roadmap, i stopped working on that10:30
*** d0ugal has joined #openstack-mistral10:37
apetrichI didn't know that CERN used mistral.. http://openstack-in-production.blogspot.com/2018/03/expiry-of-vms-in-cern-cloud.html10:56
lxkongdo you guys has the use case that use mistral to trigger k8s jobs?10:58
*** AlexeyAbashkin has joined #openstack-mistral11:05
pgaxatterakhmerov: alright, that's very good to know11:57
pgaxattelxkong: thanks for your feedback11:58
pgaxatteapetrich: it seems they use it for internal administration so i'm not sure they provide the access to mistral to their users12:00
apetrichpgaxatte, looking at their workflows it seems so https://gitlab.cern.ch/cloud-infrastructure/mistral-workflows12:01
pgaxatterakhmerov: about zookeeper, i saw a bit of documentation mentionning it (https://docs.openstack.org/mistral/ocata/developer/webapi/v2.html), what is it used for?12:06
pgaxattehttps://docs.openstack.org/mistral/ocata/developer/webapi/v2.html#services precisely12:06
*** Guest52381 is now known as rbrady12:08
*** rbrady has joined #openstack-mistral12:08
*** Alexey_Abashkin has joined #openstack-mistral12:24
*** AlexeyAbashkin has quit IRC12:26
*** AlexeyAbashkin has joined #openstack-mistral12:27
*** Alexey_Abashkin has quit IRC12:29
*** jpich has quit IRC12:31
*** nguyenhai has joined #openstack-mistral12:39
*** shardy has quit IRC12:42
*** AlexeyAbashkin has quit IRC12:54
*** bobh has joined #openstack-mistral12:54
*** shardy has joined #openstack-mistral12:59
*** AlexeyAbashkin has joined #openstack-mistral13:04
toured0ugal ping13:11
toured0ugal I was curious to see if you managed to create a spec file for mistral-extra I have and running into odd macro issues13:12
tourebut the errors are useless13:12
d0ugaltoure: nope, I never got a moment to try. Maybe copy the mistral-lib one? should be almost the same13:15
d0ugalor ask for help in #rdo?13:15
toureyeah I have modeled my spec from mistral-lib, will ask #rdo, was just curious13:16
d0ugaltoure: what are the errors?13:20
toureok, that is odd, rpmlint stopped giving me the error13:22
tourethis was late last night, maybe the rpm ninjas fixed something while I was sleeping :)13:23
d0ugallol13:27
*** shardy has quit IRC13:30
*** hrybacki is now known as hrybacki|mtg13:31
*** AlexeyAbashkin has quit IRC13:33
toured0ugal I take it that this spec should be pushed against 6.0.1 for mistral-extra13:44
toureor will 7.0.01 release soon13:44
touresorry 7.0.013:45
d0ugaltoure: 7.0.0 will release at the end of Rocky...13:46
toureack13:47
* toure updates spec release 13:47
*** bobh has quit IRC13:56
d0ugaltoure: got a review up yet13:57
d0ugal?13:57
toureworking on it13:57
tourejust making sure that all is right13:58
tourewill push it in a few secs13:58
toured0ugal  https://review.rdoproject.org/r/1421614:03
d0ugaltoure: seen it, thanks14:04
tourenow I chase build errors14:16
*** shardy has joined #openstack-mistral14:25
*** hrybacki|mtg is now known as hrybacki15:04
*** AlexeyAbashkin has joined #openstack-mistral15:18
*** AlexeyAbashkin has quit IRC15:30
*** AlexeyAbashkin has joined #openstack-mistral15:42
*** s10 has quit IRC15:50
*** weshay is now known as weshay|ruck16:00
*** gkadam has quit IRC16:08
openstackgerritMerged openstack/mistral-extra master: Update Mistral Extra description.  https://review.openstack.org/57473716:25
*** Alexey_Abashkin has joined #openstack-mistral16:58
*** AlexeyAbashkin has quit IRC16:58
*** Alexey_Abashkin is now known as AlexeyAbashkin16:58
*** shardy has quit IRC17:05
*** AlexeyAbashkin has quit IRC17:10
*** AlexeyAbashkin has joined #openstack-mistral17:28
*** AlexeyAbashkin has quit IRC17:36
*** bobh has joined #openstack-mistral17:59
*** openstackgerrit has quit IRC18:04
*** harlowja has joined #openstack-mistral18:10
*** toure is now known as toure|brb18:38
*** openstackgerrit has joined #openstack-mistral18:41
openstackgerritDoug Hellmann proposed openstack/mistral master: fix tox python3 overrides  https://review.openstack.org/57296718:41
openstackgerritDoug Hellmann proposed openstack/mistral master: switch mysql functional tests to PyMySQL  https://review.openstack.org/57519718:41
*** bobh has quit IRC19:48
*** bobh has joined #openstack-mistral19:48
*** bobh has quit IRC19:57
*** AlexeyAbashkin has joined #openstack-mistral20:11
*** AlexeyAbashkin has quit IRC20:16
*** bobh has joined #openstack-mistral20:24
*** s10 has joined #openstack-mistral20:41
*** s10 has quit IRC21:00
*** openstackgerrit has quit IRC21:04
*** bobh has quit IRC21:32
*** harlowja has quit IRC22:11
*** harlowja has joined #openstack-mistral22:12
*** harlowja has quit IRC22:21
*** gkadam has joined #openstack-mistral22:46
*** threestrands has joined #openstack-mistral22:47

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!