Tuesday, 2017-12-19

*** d0ugal has joined #openstack-mistral00:04
*** yangyapeng has joined #openstack-mistral00:27
*** yangyapeng has quit IRC00:31
*** bobh has joined #openstack-mistral00:39
*** d0ugal has quit IRC00:40
*** d0ugal has joined #openstack-mistral00:51
*** bobh has quit IRC01:14
*** bobh has joined #openstack-mistral01:14
*** yangyapeng has joined #openstack-mistral01:16
*** yangyapeng has quit IRC01:17
*** yangyapeng has joined #openstack-mistral01:17
openstackgerritOpenStack Proposal Bot proposed openstack/mistral master: Updated from global requirements  https://review.openstack.org/52887201:23
*** vishwanathj has joined #openstack-mistral01:30
*** bobh has quit IRC02:20
*** bobh has joined #openstack-mistral02:21
*** bobh has quit IRC02:24
*** bobh has joined #openstack-mistral02:24
*** AlexeyAbashkin has joined #openstack-mistral02:38
*** AlexeyAbashkin has quit IRC02:43
*** bobh has quit IRC02:52
*** bobh has joined #openstack-mistral02:53
*** bobh has quit IRC03:17
*** bobh has joined #openstack-mistral04:00
*** bobh has quit IRC04:04
*** {aborted} is now known as chandankumar05:43
openstackgerritMerged openstack/mistral master: Updated from global requirements  https://review.openstack.org/52887206:13
rakhmerovapetrich: hi06:32
*** gkadam has joined #openstack-mistral06:38
*** _gryf has joined #openstack-mistral06:59
*** shardy has joined #openstack-mistral07:37
*** shardy has quit IRC07:37
*** shardy has joined #openstack-mistral07:41
*** _gryf has quit IRC07:52
*** AlexeyAbashkin has joined #openstack-mistral07:52
*** d0ugal has quit IRC08:03
*** d0ugal has joined #openstack-mistral08:07
*** kushalagrawal has joined #openstack-mistral08:15
d0ugalrakhmerov: Hey08:37
rakhmerovd0ugal: hi08:37
d0ugalrakhmerov: apetrich is on vacation today and tomorrow.08:37
rakhmerovyep, ok08:37
rakhmerovhis patch is approved08:37
d0ugalI spotted :) thanks!08:37
rakhmerov:)08:37
rakhmerovwe have a failing test again in our client https://review.openstack.org/#/c/528907/08:38
rakhmerovdid you happen to look at it?08:39
d0ugalrakhmerov: no, I think the mistralclient CI has been broken for a while now08:39
rakhmerovhm..08:39
rakhmerovok08:39
*** jtomasek has joined #openstack-mistral08:39
rakhmerovyou mean it's been going on for a long time?08:39
rakhmerovhow long?08:39
d0ugalI think maybe CI is just incorrectly configured?08:39
d0ugalNot sure.08:39
rakhmerovok08:39
d0ugalWhen did something last merge? :)08:40
rakhmerovnot sure.08:40
rakhmerovneed to check08:40
d0ugalmistralclient doesn't get many patches.08:40
rakhmerovyep08:40
d0ugalhttps://review.openstack.org/52157208:40
d0ugalI think that was the last patch to pass CI08:40
d0ugal(and merge)08:40
rakhmerovyep, right08:41
rakhmerovok, I'll look at it later08:42
d0ugalThanks, I can try too08:42
d0ugalbut I'm not sure I'll have time this week - and then holidays.08:42
rakhmerovI understand08:42
rakhmerovI think in general people are not going to be active in the next ~2 weeks, right? )08:42
d0ugalright :)08:49
d0ugalboth thrash|g0ne and toure|gone have finished for the holidays already08:49
rakhmerovooh, ok08:51
openstackgerritDougal Matthews proposed openstack/mistral master: Disable unstable tempest test_run_ssh_proxied_action test  https://review.openstack.org/52899908:58
d0ugalrakhmerov: ^ that test blocked both apetrich and thrash's patches.08:59
rakhmerovyes, I know about it08:59
rakhmerovI'm actually in favor of approving it with 1 +208:59
d0ugalrakhmerov: sure, it is fairly low risk :)09:00
d0ugalI could +2 it also ;)09:00
rakhmerov:)09:00
rakhmerovas you wish, sir :)09:00
chandankumard0ugal: rakhmerov just an update tempest plugin split work block on mistral packaging change which is block on rdo cloud09:01
d0ugalchandankumar: k, thanks.09:01
d0ugalchandankumar: hopefully it is fixed soon, it also blocks me :(09:02
*** jpich has joined #openstack-mistral09:29
therved0ugal, Do you have a few mins to chat about https://review.openstack.org/527348 ?09:42
d0ugaltherve: sure09:43
therved0ugal, So I looked at the latest failure, and it looks "real"09:44
therveDo you know how users are setup for the tempest tests?09:44
therveI wonder if they have the admin role09:44
d0ugalI've been meaning to take a look, but I forgot.09:44
d0ugalNo, I've not learned how that works yet09:44
therveIf they do, there is somewhat a bug wrt to admin deleting workflow by names09:44
d0ugalInteresting.09:44
*** yangyapeng has quit IRC09:45
rakhmerovas far as I remember there are two clients in the tempest tests: one with a regular user role and another one with admin09:45
d0ugalchandankumar: ^ do you know?09:46
d0ugalOh, yeah, I seen the multiple clients.09:46
d0ugalhttps://github.com/openstack/mistral/blob/master/mistral_tempest_tests/tests/base.py#L56-L6109:47
therveRight there are 2 client instances09:47
d0ugaltherve, rakhmerov ^09:47
therveBut in theory we use the non-admin one09:47
rakhmerovyes09:47
d0ugalright09:47
therveI'm talking about that error http://logs.openstack.org/48/527348/4/check/mistral-devstack-dsvm-non-apache/f6bae24/job-output.txt.gz#_2017-12-14_07_51_20_76537909:48
therveAFAIU, it would only happen if you're first able to get the object, but then delete is protected09:48
therveWait no, not that one09:49
thervehttp://logs.openstack.org/48/527348/4/check/mistral-devstack-dsvm-non-apache/f6bae24/job-output.txt.gz#_2017-12-14_07_51_21_00704809:49
chandankumarin tempest there are two users one is admin and another is normal user starting with alt09:49
rakhmerovtherve: the last one looks like a cleanup problem in tests09:50
therveYeah I'm getting confused09:50
therverakhmerov, OK so it is http://logs.openstack.org/48/527348/4/check/mistral-devstack-dsvm-non-apache/f6bae24/job-output.txt.gz#_2017-12-14_07_51_20_76537909:50
therveAnd the second one is probably a side effect of that one09:51
rakhmerovbtw, this error with event triggers started reproducing on all of our patches09:51
therveRight, to me it would happen with an admin user09:51
rakhmerovyes, one of them is probably a consequence of another one..09:52
therveBecause it can see wfs from other projects, but can't delete them09:52
rakhmerovtherve: let me look at it..09:52
therveHum, though there is a is_admin check in check_db_obj_access as well09:53
rakhmerovyes, in Mistral DB API it should work09:53
rakhmerovmaybe there's a bug there though.09:53
rakhmerovI wonder what the difference is between these two lines:09:55
rakhmerov        self.client.delete_obj('event_triggers', trigger_id)09:55
rakhmerov        self.client.event_triggers.remove(trigger_id)09:55
therverakhmerov, I wonder if there is a race with test_delete_wf_with_trigger_associate_in_other_tenant09:57
rakhmerovhm.. strange. We seem to use the same client for creation and deletion09:57
therveThe public scope of the workflow could mess things up?09:57
rakhmerovtherve: where did you find this test?09:58
d0ugalsorry, got called away. /me reads up09:58
therverakhmerov, I looked at _secure_query, and it tests either the project id, or the scope09:58
rakhmerovyes09:58
rakhmerovso?09:59
therveThe only test that touches scope is that test09:59
therveAnd it runs just around our failures: http://logs.openstack.org/48/527348/4/check/mistral-devstack-dsvm-non-apache/f6bae24/job-output.txt.gz#_2017-12-14_07_48_54_33539309:59
rakhmerovin what module is this test?09:59
rakhmerovtrying to find it..09:59
thervemistral_tempest_tests/tests/api/v2/test_workflows.py09:59
rakhmerovok09:59
rakhmerovwell, "public" reduces the security level10:01
rakhmerovit makes it less secure10:01
d0ugalrakhmerov: in those two lines - the first calls the API, the second removes the trigger from the list "cache" on the client10:02
rakhmerovtherve: btw, in test_workflows.py I don't see where the clean up happens10:03
rakhmerovd0ugal: ok10:03
therverakhmerov, in tearDown10:03
rakhmerovooh, yeah10:03
rakhmerovmissed it10:03
rakhmerovtherve: maybe we need to reproduce something in the unit test to make sure that _secure_query works in all cases?10:04
rakhmerovwith "public" etc.10:04
rakhmerovI though we had tested it but maybe something is wrong there10:05
rakhmerovthe interesting thing is that it started happening not long ago10:05
rakhmerovmaybe there were some related changes in Keystone?10:05
rakhmerovagain10:05
therveI think it works, just the test puts in a condition that fails10:05
therveMaybe just moving tests around so that they happen more concurrently10:05
rakhmerovmaybe, yes10:05
rakhmerovyep10:06
rakhmerovyou know, maybe we really create such a workflow on behalf of admin somewhere?10:06
rakhmerovand they run concurrently then this can happen10:06
openstackgerritDougal Matthews proposed openstack/mistral master: Disable unstable tempest test_run_ssh_proxied_action test  https://review.openstack.org/52899910:09
therveHummmm10:15
therverakhmerov, Do you know about LockFixture?10:15
d0ugalI am failing to get my head around this10:15
therveI feel that the problem is that LockFixture isn't used everywhere10:16
therveThe same workflow names are used everywhere (which is a stupid idea btw)10:16
d0ugal+110:17
d0ugalI was trying to figure out how to make the workflow names dynamic - we might need to turn the workflow file into a jinja template or something10:17
therveSo either we add more locks where it's missing, or we make the workflow names dynamic10:17
therveWell10:17
therveYou don't need jinja, just use replace :)10:17
d0ugalwell, sure10:17
d0ugalsome form of template then10:18
therveI feel that adding more locks is never the answer, yes that'd be a good idea10:18
d0ugalI'll have a look into doing that10:20
d0ugaland I might use jinja :P10:20
* therve shrugs10:21
therveI don't think it's a great idea, but I don't have +2 :)10:21
d0ugalhah10:21
d0ugalIt might be overkill, but at least it has a common understanding about what is going on10:21
d0ugalanyway, i'll see how I get on10:21
rakhmerovtherve: LockFixture no :)10:24
rakhmerovnever used it10:24
rakhmerovtherve: you want +2? :)10:26
rakhmerovwe can discuss that :)10:26
therveYeah I don't have enough time to do reviews :)10:26
rakhmerovinteresting, I actually thought we used dynamic names, at least in part of the tests10:26
rakhmerovtherve: ok )10:26
rakhmerovbut if you change your mind let me know )10:27
therveThanks :)10:28
d0ugalrakhmerov: we do use dynamic names in places - but not for the workflow names in the workbook files.10:28
rakhmerovooh, I see10:28
rakhmerovyes10:28
d0ugalI am going to try and change that10:28
rakhmerovok, appreciate10:28
therveI think LockFixture is the reason the tests don't explode all the time. And as it's not used consistently, random errors happen.10:30
rakhmerovok, maybe then we need to use it everywhere?10:31
rakhmerovbut i'd like to understand first what it does exactly10:31
therveFrom what I understand it makes tests run in sequence10:33
rakhmerovok10:37
rakhmerovbut if it's for same resources then it makes sense10:37
rakhmerovwell, yes, unless we want dynamic names..10:38
rakhmerovwhich is a better option probably10:38
therveYeah I'd say so10:38
*** jtomasek has quit IRC10:38
*** jtomasek has joined #openstack-mistral10:39
*** jpich has quit IRC10:40
*** yangyapeng has joined #openstack-mistral10:47
*** yangyapeng has quit IRC10:53
rakhmerovtherve, d0ugal: also some interesting observation: I may be wrong but seems like this test fails only on "non-apache" version of devstack job10:55
*** yangyapeng has joined #openstack-mistral11:03
*** yangyapeng has quit IRC11:08
*** AlexeyAbashkin has quit IRC11:22
*** yangyapeng has joined #openstack-mistral11:24
*** jtomasek has quit IRC11:29
*** yangyapeng has quit IRC11:29
*** AlexeyAbashkin has joined #openstack-mistral11:38
*** yangyapeng has joined #openstack-mistral11:45
*** yangyapeng has quit IRC11:49
*** yangyapeng has joined #openstack-mistral12:05
*** yangyapeng has quit IRC12:11
*** katkapilatova has joined #openstack-mistral12:27
*** yangyapeng has joined #openstack-mistral12:29
*** yangyapeng has quit IRC12:34
*** weshay_pto is now known as weshay12:48
*** yangyapeng has joined #openstack-mistral12:49
*** bobh has joined #openstack-mistral12:52
*** bobh has quit IRC12:53
*** yangyapeng has quit IRC12:53
*** zhurong has joined #openstack-mistral12:59
*** zhurong has quit IRC13:02
*** zhurong has joined #openstack-mistral13:03
*** yangyapeng has joined #openstack-mistral13:10
*** d0ugal has quit IRC13:14
*** yangyapeng has quit IRC13:15
*** d0ugal has joined #openstack-mistral13:22
openstackgerritDougal Matthews proposed openstack/mistral master: Disable unstable tempest test_run_ssh_proxied_action test  https://review.openstack.org/52899913:24
*** zhurong has quit IRC13:25
*** dprince has joined #openstack-mistral13:25
*** yangyapeng has joined #openstack-mistral13:30
*** yangyapeng has quit IRC13:35
*** d0ugal has quit IRC13:37
*** yangyapeng has joined #openstack-mistral13:39
*** d0ugal has joined #openstack-mistral13:39
d0ugalthrash|g0ne: step away from the computer13:42
*** yangyapeng has quit IRC13:44
*** yangyapeng has joined #openstack-mistral14:06
openstackgerritDougal Matthews proposed openstack/mistral master: Use dynamic names for Workflows in Workbooks  https://review.openstack.org/52907814:10
*** yangyapeng has quit IRC14:12
*** katkapilatova has quit IRC14:14
*** jtomasek has joined #openstack-mistral14:24
*** yangyapeng has joined #openstack-mistral14:24
openstackgerritDougal Matthews proposed openstack/mistral master: Use dynamic names for Workflows in Workbooks  https://review.openstack.org/52907814:28
*** yangyapeng has quit IRC14:29
*** yangyapeng has joined #openstack-mistral15:01
*** livelace has joined #openstack-mistral15:23
*** bobh has joined #openstack-mistral15:26
*** jtomasek has quit IRC15:50
*** livelace has quit IRC16:06
*** apetrich has joined #openstack-mistral16:08
*** rbrady is now known as rbrady-afk16:33
*** AlexeyAbashkin has quit IRC17:01
*** gkadam has quit IRC17:22
*** jtomasek has joined #openstack-mistral17:58
*** harlowja has joined #openstack-mistral18:15
*** AlexeyAbashkin has joined #openstack-mistral18:22
*** AlexeyAbashkin has quit IRC18:27
*** bobh has quit IRC18:32
*** AlexeyAbashkin has joined #openstack-mistral18:46
*** AlexeyAbashkin has quit IRC18:58
*** gkadam has joined #openstack-mistral19:03
*** rbrady-afk is now known as rbrady19:13
*** shardy has quit IRC19:14
*** openstack has joined #openstack-mistral19:42
*** ChanServ sets mode: +o openstack19:42
*** dprince has quit IRC19:55
*** jtomasek has quit IRC20:15
*** gkadam has quit IRC20:18
*** dprince has joined #openstack-mistral20:23
*** shardy has joined #openstack-mistral20:36
*** AlexeyAbashkin has joined #openstack-mistral20:37
*** AlexeyAbashkin has quit IRC20:41
*** shardy has quit IRC22:37

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!