Friday, 2018-01-26

*** bobh has joined #openstack-mistral00:08
*** kushalagrawal has quit IRC00:28
*** kushalagrawal has joined #openstack-mistral00:28
*** bobh has quit IRC00:39
*** zhurong has joined #openstack-mistral00:51
*** zhurong_ has joined #openstack-mistral00:52
*** apetrich has quit IRC00:55
*** kushalagrawal has quit IRC00:59
*** kushalagrawal has joined #openstack-mistral01:00
*** kushalagrawal has quit IRC01:24
*** bobh has joined #openstack-mistral01:24
*** kushalagrawal has joined #openstack-mistral01:24
*** bobh has quit IRC01:26
*** apetrich has joined #openstack-mistral01:52
*** kushalagrawal has quit IRC02:08
*** kushalagrawal has joined #openstack-mistral02:09
*** harlowja has quit IRC02:16
*** zhurong has quit IRC02:24
*** kushalagrawal has quit IRC02:32
*** kushalagrawal has joined #openstack-mistral02:33
*** kushalagrawal has quit IRC03:01
*** kushalagrawal has joined #openstack-mistral03:03
rakhmerovthrash|g0ne: hey, still here?03:41
rakhmerovapetrich, d0ugal: hi, we need this patch in the release we're about to issue: https://review.openstack.org/#/c/512021/03:42
rakhmerovplease spend some time to review it today03:42
rakhmerovd0ugal: what is it for? https://review.openstack.org/#/c/53783703:44
rakhmerov:)03:44
openstackgerritRenat Akhmerov proposed openstack/mistral master: Fix the 'params' field of the workflow execution REST resource  https://review.openstack.org/53779303:46
rakhmerovtoure|gone: hey Toure, I voted +2 on https://review.openstack.org/#/c/506652 but I left a comment there about tests, please read03:50
*** kushalagrawal has quit IRC03:57
*** kushalagrawal has joined #openstack-mistral03:58
*** zhurong_ has quit IRC04:39
rakhmerovmcdoker181818: hi, could you please rebase https://review.openstack.org/#/c/528494/ ?04:47
*** harlowja has joined #openstack-mistral04:51
openstackgerritRenat Akhmerov proposed openstack/mistral master: WIP: Fix docs to better reflect Jinja and YAQL usage  https://review.openstack.org/53814805:10
*** kushalagrawal has quit IRC05:11
*** kushalagrawal has joined #openstack-mistral05:12
*** zhurong has joined #openstack-mistral05:18
openstackgerritRenat Akhmerov proposed openstack/mistral master: Remove addition of a new task execution to task_executions collection  https://review.openstack.org/53814905:23
openstackgerritVitalii Solodilov proposed openstack/mistral master: Fixed the length of a task name  https://review.openstack.org/52849406:20
mcdoker181818rakhmerov: Hi, done06:24
rakhmerovthanks )06:24
*** zhurong has quit IRC06:52
*** gkadam has joined #openstack-mistral07:08
*** kushalagrawal has quit IRC07:20
*** kushalagrawal has joined #openstack-mistral07:21
*** harlowja has quit IRC07:23
*** mcdoker18181818 has joined #openstack-mistral07:23
*** mcdoker181818 has quit IRC07:23
openstackgerritMerged openstack/mistral master: Updated from global requirements  https://review.openstack.org/53706407:25
*** jtomasek has joined #openstack-mistral07:33
apetrichrakhmerov, that    https://review.openstack.org/#/c/53783 was a test to see if the failing sphinx job was triggering07:39
rakhmerovok07:39
apetrichrakhmerov, I will test the keystone patch today07:40
rakhmerovok07:40
rakhmerovthanks07:40
rakhmerovwe need to make a release today07:40
rakhmerovfor both server and client07:40
apetrichrakhmerov, I found this very neat way of testing patches  https://docs.openstack.org/tripleo-docs/latest/contributor/reproduce-ci.html07:40
rakhmerovthat's I'm a little in rush07:41
apetrichsure do07:41
apetrichlet me just start the day and then I will jump right into it07:41
openstackgerritAdriano Petrich proposed openstack/python-mistralclient master: Clean up keystone authentication  https://review.openstack.org/51202107:42
apetrichI'm rebasing it btw07:43
rakhmerovyes, ok07:59
*** d0ugal has quit IRC08:04
rakhmerovapetrich: I didn't quite understand what https://docs.openstack.org/tripleo-docs/latest/contributor/reproduce-ci.html is for08:08
rakhmerovit allows to reproduce CI jobs but in what way?08:08
rakhmerovwhat's the different between our regular CI and this stuff?08:09
*** kushalagrawal has quit IRC08:10
*** akazakov has quit IRC08:11
*** kushalagrawal has joined #openstack-mistral08:11
*** akazakov has joined #openstack-mistral08:13
*** jpich has joined #openstack-mistral08:14
apetrichit allows you to "rerun" the exact ci run with the same parameters08:21
apetrichin an easy way08:21
akazakovHi guys! Does anyone know why mistral api service needs this setup_db() call when starting? https://github.com/openstack/mistral/blob/master/mistral/api/app.py#L5408:23
akazakovWe have a case when mistral should start without available database. In such case api fails to start because of this call.08:23
*** d0ugal has joined #openstack-mistral08:23
rakhmerovakazakov: hi08:31
rakhmerovMistral needs a database :)08:31
rakhmerovMistral API I mean08:32
rakhmerovthat's why it needs to initialize what's needed to be able to work with DB08:32
rakhmerovhowever, Mistral executor doesn't require DB and can run w/o it08:32
rakhmerova lot of API requests don't go to Mistral Engine, they simply work based on DB access08:33
rakhmerovapetrich: ok, thanks. I may try that some day )08:33
openstackgerritRenat Akhmerov proposed openstack/mistral master: Disable the wsme Sphinx extension from the API ref docs  https://review.openstack.org/53784808:34
openstackgerritRenat Akhmerov proposed openstack/mistral master: Fixed the length of a task name  https://review.openstack.org/52849408:36
rakhmerovapetrich: our CI drives me crazy.. I don't already remember times when we could normally develop. Most of the time we struggle with CI issues08:37
rakhmerovwe need some breakthrough on that front )08:37
openstackgerritMerged openstack/mistral master: Remove any old client actions that no longer exist  https://review.openstack.org/53688608:38
*** AlexeyAbashkin has joined #openstack-mistral08:39
apetrichyeah that's why this reproducer script made me happy08:39
apetrichstill doesn't solve all or even many of the ci issues but helps with some large ones08:39
akazakovrakhmerov: of course, Mistral API needs a database to process requests. But does it require DB to _start_?08:51
akazakovThe specific behaviour I want to achieve: 1) DB is not available, Mistral API starts (but unable to process requests) 2) Then DB starts 3) Mistral API becomes able to process requests without restarting08:52
rakhmerovit's impossible now08:52
rakhmerovwell, we potentially could make it more flexible in that way08:53
rakhmerovthe thing is that our DB layer is now initialized the same way for engine and API08:54
rakhmerovand it's considered a part of startup process08:54
rakhmerovso that if it fails to init DB then the component doesn't start08:54
rakhmerovyeah, we could weaken this requirement probably but I'm not sure about all the consequences of that now08:55
rakhmerovwhat's the point of running a component if DB is unavailable, hm.. ?08:55
rakhmerovwe kinda know that we're starting something that won't be functioning properly08:56
rakhmerovwhy do we need that?08:56
rakhmerovhowever, keep in mind that if DB was up initially when say API was started then it deal with temporary outages of DB08:57
rakhmerovdisconnections etc.08:57
rakhmerovpart of that is built-in into connection pool implementation, partially in Mistral itself08:57
akazakovrakhmerov in my case it Disaster Recovery. In openshift, for example, mistral may start before DB service is available08:58
rakhmerovcan you start it after DB is available?08:58
rakhmerovin my view, it's a regular dependency between software pieces08:58
rakhmerovyou have software A (Mistral) that requires software B (DB) to be installed08:59
rakhmerovand it's a matter of proper installation order08:59
*** kushalagrawal has quit IRC09:00
*** kushalagrawal has joined #openstack-mistral09:01
csatariHi we (still) try to install and configure Mistral based on the install guide to test it.09:15
csatarihttps://docs.openstack.org/developer/mistral/guides/configuration_guide.html suggest to use oslo-config-generator, but when we execute the suggested command only a warning message is returned.09:16
*** kushalagrawal has quit IRC09:16
csatariAnd no change is visible in the config file.09:17
*** kushalagrawal has joined #openstack-mistral09:17
csatariIs this step really needed or can we remove it from the config guide.09:17
mcdoker18181818How is it possible? I don't understand )09:20
mcdoker18181818InternalError: (pymysql.err.InternalError) (1071, u'Specified key was too long; max key length is 767 bytes') [SQL: u'ALTER TABLE task_executions_v2 MODIFY unique_key VARCHAR(350) NULL']09:20
mcdoker18181818http://logs.openstack.org/94/528494/6/check/tripleo-ci-centos-7-scenario003-multinode-oooq-container/0a52cab/logs/undercloud/home/zuul/undercloud_install.log.txt.gz09:20
akazakovrakhmerov for us, it's more about order of start, not order of installation09:21
akazakovIf running API can deal with temporary DB outages, why not make it to be able to deal with outages during start?09:21
d0ugalrakhmerov: from what I understand, other openstack services will keep retrying to connect to the db - is this what you need akazakov?09:21
rakhmerovmcdoker18181818: that was probably my concern that I tried to express in your patch :)09:23
apetrichrakhmerov, I've tested and was about to +2 the keystone but d0ugal beat me to it :)09:23
rakhmerovmcdoker18181818: ooh, I think I'm starting to recall now. Mysql has a limit on the indexed fields! Or fields that has a unique constraint09:23
rakhmerovmcdoker18181818: please try to find it in the mysql docs09:24
mcdoker18181818rakhmerov: о_О09:24
rakhmerovakazakov: like I said, it can be potentially done, yes. We've never focused on that, nobody asked for it. And making it deal with outages during startup is much more complicated thing09:25
rakhmerovfor a number of reasons09:25
rakhmerovmcdoker18181818: yeah :(((09:25
rakhmerovI remember I was surprised as well ))09:25
rakhmerovd0ugal: really?09:26
rakhmerovI didn't really know that09:26
rakhmerovhm.. may then Mistral can do that too :)) I just realized I probably never tried that09:26
d0ugalI'll see if I can find out more about it.09:27
d0ugalbut it makes things much easier for installers09:27
rakhmerovI believe DB initialization is not that different in Mistral comparing to other projects09:27
d0ugalYeah, I assumed Mistral would do this already :) Maybe I can find something.09:27
rakhmerovhah.. interesting09:27
rakhmerovmcdoker18181818: can you please then mark your patch as WIP?09:28
rakhmerovso that we don't merge it by mistake09:28
d0ugaltripleo CI is blocking it :)09:29
rakhmerovok09:29
d0ugalWe should really run the migrations on another job too...09:29
d0ugalbut for now, that is the only place I think09:29
rakhmerovd0ugal, apetrich: let's merge https://review.openstack.org/#/c/538026/09:29
rakhmerovif it's ok09:29
apetrichrakhmerov, aye09:30
akazakovd0ugal "is this what you need akazakov?" yep, thanks for clarifying09:30
d0ugalakazakov: do you know which services do this? so I can look to see how they handle it. I just need an example. Heat maybe?09:31
rakhmerovakazakov: are you sure that if you run Mistral API w/o available DB it won't start?09:31
rakhmerovakazakov: we're now in doubts :)09:31
*** yangyapeng has quit IRC09:32
rakhmerovd0ugal: yep, good question..09:32
openstackgerritRenat Akhmerov proposed openstack/mistral master: Remove addition of a new task execution to task_executions collection  https://review.openstack.org/53814909:33
akazakovd0ugal sorry, no. Mistral is the first one I work with09:35
rakhmerovapetrich, d0ugal: on another topic, for some reason when I now click on nearly any CI job links (e.g. docs) I get a page with "File not found"09:35
rakhmerovany idea why?09:35
*** yangyapeng has joined #openstack-mistral09:35
d0ugalakazakov: no problem, I'll ask around :)09:35
apetrichI was wondering the same09:35
d0ugalno idea, I hadn't noticed.09:36
d0ugalrakhmerov: This is the only clue I have found so far: https://github.com/openstack/oslo.db/blob/master/oslo_db/api.py#L192-L19309:37
openstackgerritMerged openstack/python-mistralclient master: Clean up keystone authentication  https://review.openstack.org/51202109:39
d0ugalrakhmerov: btw the sphinx docbuild is different from the api-ref, so even if the link worked it wouldn't verify my patch. For the api-ref docs build we need to re-enable the CI job09:40
d0ugalWhich I can do by reverting this revert: https://review.openstack.org/53783909:40
rakhmerovooh, it was yesterday :)09:50
rakhmerovI didn't even notice it09:50
akazakovrakhmerov d0ugal here is exception example when API starts without DB https://gist.github.com/justTon/f738d69586f5fd05c8b1068e1d1f7aac09:50
d0ugalakazakov: thanks09:51
rakhmerovakazakov: are you sure it doesn't try to reconnect?09:51
rakhmerovdoes it just exit?09:52
rakhmerov"could not translate host name "postgres" to address: Try again" looks interesting..09:52
rakhmerovwhat if the host name is resolved but DB is still unavailable?09:52
rakhmerovd0ugal: so if we revert that revert, we'll again have that CI job. Will it be failing again or it was already fixed?09:53
rakhmerovI'm slightly confused09:53
d0ugalrakhmerov: the two patches I put up should mean that it doesn't fail09:53
d0ugalrakhmerov: but it doesn't really do anything either... somebody setup the api-ref documentation structure, but it is empty09:53
d0ugalrakhmerov: You can test what the job will do with "tox -e api-ref"09:54
rakhmerovok09:54
rakhmerovI just don't any CI degradation today )09:54
rakhmerovI'm in favour of dealing with this api-ref after we make a release09:55
d0ugalrakhmerov: sure09:56
rakhmerovd0ugal, apetrich: a small doc fix: https://review.openstack.org/#/c/53779309:57
rakhmerovok, I'll be off in the next few hours09:57
openstackgerritMerged openstack/python-mistralclient master: Restore devstack job for python-mistralclient  https://review.openstack.org/53802610:11
*** kushalagrawal has quit IRC10:16
*** kushalagrawal has joined #openstack-mistral10:17
*** Trpger has joined #openstack-mistral10:34
*** Trpger has left #openstack-mistral10:36
akazakovrakhmerov here is another example, with DB host resolved https://gist.github.com/justTon/a9412e7acb85830a8144f63c1bda451710:40
akazakovrakhmerov "are you sure it doesn't try to reconnect?" yes, it just exits10:40
*** daidv has quit IRC10:58
d0ugalapetrich: it seems like CI output is not being uploaded for most of the jobs :(10:59
d0ugalapetrich: try and see any of the CI output here: https://review.openstack.org/#/c/537848/11:00
d0ugalOnly the cover job works.11:00
apetrichyeah http://logs.openstack.org/48/537848/2/check/11:01
apetrichOh i'm reading back the log from ci people and they are trying to fix it11:02
apetrichas in last night11:02
d0ugalapetrich: ah, so it isn't a mistral-only issue? good :)11:05
d0ugalapetrich: makes it hard to use a reproducer script when it isn't there :(11:07
apetrichd0ugal, but of course it would disappear when I discover it :)11:11
*** jkilpatr has quit IRC11:24
*** jkilpatr has joined #openstack-mistral11:59
*** kushalagrawal has quit IRC12:00
*** kushalagrawal has joined #openstack-mistral12:01
*** thrash|g0ne is now known as thrash12:25
openstackgerritMerged openstack/mistral master: Remove the redundant word  https://review.openstack.org/53629212:27
openstackgerritMerged openstack/mistral master: Fix the 'params' field of the workflow execution REST resource  https://review.openstack.org/53779312:27
thrashrakhmerov: what's up?12:28
*** kushalagrawal has quit IRC12:46
*** kushalagrawal has joined #openstack-mistral12:46
*** thrash is now known as thrash|appt12:47
*** dprince has joined #openstack-mistral13:07
*** kushalagrawal has quit IRC13:33
*** kushalagrawal has joined #openstack-mistral13:33
*** kushalagrawal has quit IRC13:48
*** kushalagrawal has joined #openstack-mistral13:49
*** toure|gone is now known as toure13:57
tourerakhmerov saw you comment, and I will add a few more scenarios14:00
toure**your**14:00
*** thrash|appt is now known as thrash14:12
*** bobh has joined #openstack-mistral14:17
*** kushalagrawal has quit IRC14:41
*** kushalagrawal has joined #openstack-mistral14:42
*** d0ugal has quit IRC14:57
*** jaosorior has quit IRC15:04
*** d0ugal has joined #openstack-mistral15:14
*** kushalagrawal has quit IRC15:27
*** kushalagrawal has joined #openstack-mistral15:28
*** AlexeyAbashkin has quit IRC16:06
*** rbrady has joined #openstack-mistral16:33
*** rbrady is now known as rbrady-afk16:34
*** gkadam has quit IRC16:48
openstackgerritAndras Kovi proposed openstack/mistral master: Move X-Target-Service-Catalog header to request body  https://review.openstack.org/53830817:03
openstackgerritAndras Kovi proposed openstack/python-mistralclient master: Move X-Target-Service-Catalog header to request body  https://review.openstack.org/53830917:06
openstackgerritAndras Kovi proposed openstack/python-mistralclient master: Move X-Target-Service-Catalog header to request body  https://review.openstack.org/53830917:07
*** harlowja has joined #openstack-mistral17:10
*** kushalagrawal has quit IRC17:25
*** kushalagrawal has joined #openstack-mistral17:26
*** jpich has quit IRC17:34
*** AlexeyAbashkin has joined #openstack-mistral17:40
*** AlexeyAbashkin has quit IRC17:45
*** fultonj has left #openstack-mistral17:48
*** jkilpatr has quit IRC17:56
*** AlexeyAbashkin has joined #openstack-mistral18:09
*** AlexeyAbashkin has quit IRC18:14
*** kushalagrawal has quit IRC18:36
*** kushalagrawal has joined #openstack-mistral18:36
*** weshay is now known as weshay|ruck|brb18:43
*** rbrady-afk is now known as rbrady18:51
*** jtomasek has quit IRC19:09
openstackgerritHonza Pokorny proposed openstack/mistral master: Add claim_messages and delete_messages zaqar actions  https://review.openstack.org/53832519:13
*** harlowja has quit IRC19:14
*** dprince has quit IRC19:21
*** jkilpatr has joined #openstack-mistral19:26
*** weshay|ruck|brb is now known as weshay|ruck19:27
*** akazakov has quit IRC19:34
*** kushalagrawal has quit IRC19:45
*** kushalagrawal has joined #openstack-mistral19:45
*** harlowja has joined #openstack-mistral19:46
*** dprince has joined #openstack-mistral19:56
*** harlowja_ has joined #openstack-mistral19:58
*** harlowja has quit IRC20:00
*** kushalagrawal has quit IRC20:10
*** kushalagrawal has joined #openstack-mistral20:12
*** dprince has quit IRC20:47
*** bobh has quit IRC20:54
*** bobh has joined #openstack-mistral20:55
*** jkilpatr has quit IRC20:57
*** bobh has quit IRC21:00
*** bobh has joined #openstack-mistral21:25
*** kushalagrawal has quit IRC21:26
*** kushalagrawal has joined #openstack-mistral21:27
*** bobh has quit IRC21:47
*** mcdoker18181818 has quit IRC22:06
*** kushalagrawal has quit IRC22:07
*** kushalagrawal has joined #openstack-mistral22:08
*** kushalagrawal has quit IRC22:45
*** kushalagrawal has joined #openstack-mistral22:46
*** rbrady has quit IRC23:20
*** kushalagrawal has quit IRC23:20
*** kushalagrawal has joined #openstack-mistral23:21
*** bobh has joined #openstack-mistral23:28

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!