Thursday, 2017-04-13

jlkSpamapS: started using a box with 8 CPUs01:32
*** dkranz has quit IRC03:38
*** jamielennox is now known as jamielennox|away04:01
*** jamielennox|away is now known as jamielennox04:29
SpamapSjlk: oh that's interesting. I wonder if we need to have like   --concurrency=(($ncpu - 1)) to allow for system stuff05:32
*** jamielennox is now known as jamielennox|away06:52
*** jamielennox|away is now known as jamielennox11:18
*** jamielennox is now known as jamielennox|away12:05
*** _ari_ is now known as ari|gone12:38
*** ari|gone is now known as _ari_|gone12:38
*** hashar has joined #zuul12:56
mordredso - re: the scrollback - jlk maybe try disabling the mysql tests real quick and see if things work consistently - jesusaur is right, that was a recent add and we haven't _generally_ been having test suite flakiness issues13:55
mordredbefore we test run bisect it might be an easyish hypothesis to test to narrow things down13:56
*** dkranz has joined #zuul14:22
hasharhello! Just in case,  voluptuous got some new 0.10.x releases yesterday ( https://pypi.org/project/voluptuous/#history  )15:03
hasharand that seems to break Zuul 2.5 layout validation15:03
*** jasondotstar_ has joined #zuul15:10
*** mordred1 has joined #zuul15:10
*** jasondotstar has quit IRC15:10
*** adam_g has quit IRC15:10
*** mordred has quit IRC15:10
*** TheJulia has quit IRC15:10
*** rattboi has quit IRC15:10
*** EmilienM has quit IRC15:10
*** Shrews has quit IRC15:10
*** Shrews has joined #zuul15:11
*** adam_g has joined #zuul15:11
*** rattboi has joined #zuul15:11
*** 21WAAA2JF has joined #zuul15:12
pabelangerYa, we had the issue too15:16
pabelangerhashar: there is a fix in master15:16
hasharpabelanger: I should have looked at your repository :-]15:17
*** TheJulia has joined #zuul15:18
*** mordred1 is now known as mordred15:46
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul feature/zuulv3: WIP: Allow for prefixing job dir names  https://review.openstack.org/45668515:55
openstackgerritPaul Belanger proposed openstack-infra/nodepool master: [WIP] Add functional test for key-name and glean  https://review.openstack.org/45577016:01
*** hashar has quit IRC16:08
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul feature/zuulv3: WIP: Allow for specifying root job directory  https://review.openstack.org/45669116:09
*** hashar has joined #zuul16:21
*** openstack has joined #zuul16:36
openstackgerritPaul Belanger proposed openstack-infra/nodepool master: [WIP] Add functional test for key-name and glean  https://review.openstack.org/45577016:39
*** 21WAAA2JF is now known as EmilienM17:05
*** EmilienM has joined #zuul17:05
jlkmordred: what's the TLDR on disabling certain tests?17:18
*** hashar has quit IRC17:18
mordredjlk: well, you can just put in a self.skipTest() into the test itself ...17:20
mordredSpamapS: ^^17:20
jlkoh, right, could @skip it or whatever the decorator is.17:21
SpamapS@skipIf(os.environ.get('SKIP_THIS_TEST')) is ok if you want to be able to do it programattically at runtime without patching comments in or something.17:21
jlkso what I'm dealing with at the moment, some commits on my patch set fail in CI, but pass locally. and patches later in teh stack (which include the earlier patches) pass in CI17:21
jlkso ¯\_(ツ)_/¯17:21
SpamapSdo we push .testrepository from failed CI runs to the logs?17:22
SpamapSif not, have a test node held17:22
SpamapSand grab that, then you can use it to do a --analyze-isolation17:22
SpamapS(or just re-run with --analyze-isolation on the held node)17:22
mordredSpamapS: we also had the hypothesis that it might be the recently-added mysql related tests -so I was suggesting disabling them as an easy way to test that hypohthesis17:23
mordredSpamapS: (so if they are, we havea smaller surface are to examine)17:23
openstackgerritPaul Belanger proposed openstack-infra/nodepool master: [WIP] Add functional test for key-name and glean  https://review.openstack.org/45577017:27
jlkoh good, running with --concurrency=4 produces a failure.17:46
ShrewsThese random failures are also appearing in the gate, yeah? b/c i cannot explain the failures in my 2 reviews that i put up this morning17:56
* Shrews looks at jlk's review stack and sees the same thing, so assumes "yes"17:58
jlkby "the gate" you mean the zuul hooked up to gerrit?17:58
jlk(sorry we have a "check" pipeline and "gate" pipeline, so I get confused by some terminology"17:59
jlk)17:59
Shrewsjlk: check17:59
Shrewsgate and gerrit both start with "g", so aren't they the same person?  ;)18:02
jlkhaha18:04
jlkit's also confusing because Jenkins check has tests called "gate-zuul-*"18:05
openstackgerritPaul Belanger proposed openstack-infra/nodepool master: [WIP] Add functional test for key-name and glean  https://review.openstack.org/45577018:05
jlkthe jobs themselves are called "gate", but they're ran both during check and gate.18:05
Shrewsjlk: best not think too much about it18:06
*** dkranz has quit IRC18:09
jlkLOLOL18:15
jlkso I disabled mysql tests, re-ran, went from 2 failures to 5.18:15
jlk(this is with concurrency 4, if I let it do all 8, things work)18:15
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul feature/zuulv3: WIP: Initial code for a fingerd log streamer  https://review.openstack.org/45672118:23
openstackgerritPaul Belanger proposed openstack-infra/nodepool master: [WIP] Add functional test for key-name and glean  https://review.openstack.org/45577018:35
*** dkranz has joined #zuul18:53
openstackgerritPaul Belanger proposed openstack-infra/nodepool master: [WIP] Add functional test for key-name and glean  https://review.openstack.org/45577019:10
*** hashar has joined #zuul19:23
openstackgerritPaul Belanger proposed openstack-infra/nodepool master: [WIP] Add functional test for key-name and glean  https://review.openstack.org/45577019:37
jlkand concurrency 7 works :/19:43
openstackgerritPaul Belanger proposed openstack-infra/nodepool master: Add functional test for key-name and glean  https://review.openstack.org/45577020:18
pabelangermordred: clarkb: Shrews: ^gives us validation of keypair now20:18
SpamapSjlk: and no failures with --analyze-isolation?20:22
jlkSpamapS: trying that now, since I now have a fail state with concur 420:43
jlkIs that an option passed in like concurrency?20:43
jlktox -e py27 -- --concurrency=4 --analize-isolation ?20:43
jlkoh I see it20:45
clarkbwith analyze-isolation you don't set concurrency it runs single threaded in a bisecting manner iirc20:45
clarkbthe way it works is run the setup that fails, then run --analyze-isolation after the failre and it will attempt to bisect that failure20:45
SpamapSYeah it specifically looks at the order in which results were reported and tries to recreate that scenario, and then change orders, and see if that fixes things.20:46
SpamapSbut it won't catch deadlock problems20:46
SpamapSwhich this may very well be20:46
jlkkk, I'm letting it run20:51
*** hashar has quit IRC20:54
jlktests.unit.test_scheduler.TestScheduler.test_dependent_behind_dequeue    unknown - no conflicts21:24
jlktests.unit.test_scheduler.TestScheduler.test_two_failed_changes_at_head  unknown - no conflicts21:24
jlkthe original run had 4 failures.21:24
jlkhrm, I do have for lines of ERROR: in my original set, that are failures trying ot git merge things. Getting conflicts.21:26
jlkI thought maybe that was part of testing unmergable content21:26
jlkactually I think those are such tests, and a red herring.21:28
jlkCan somebody walk me though (2.5) how an event handles both trigger matching (of requirements perhaps) vs pipeline matching?21:49
jlkoh sure, now I think I see it21:53
clarkbI'm not sure I understand the question. Doesn't trigger matching imply pipeline matching?21:53
jlksortof. The distinction I'm after is "trigger when you get this approval" vs "this approval is required for this pipline to start"21:54
jlkbecause in the latter sense, the approval may have happened from an earlier event. It's data that belongs to the change itself, rather than data in the event.21:55
clarkbI think in 2.5 they are the same though21:55
jlkthey aren't exactly21:55
clarkbits just that the entire set of triggers is evaluated together not just those pertaining to a single event21:56
jlkhere me out21:56
jlkyou can, in 2.5, have a gerrit trigger config that has comment-added: and under it, approval:21:56
jlkwhich means, when a comment happens, only trigger _if_ the comment itself is adding an approval.21:57
jlkyou can _also_ as a pipeline requirement (outside the trigger key) require specific approvals. Zuul will gather data about the change, and evaluate if it has those approvals.21:57
clarkbyup. The requirements are evaluated regardless of trigger iirc. So it checks all the approvals on a change even if the event is a single approval vote for example.21:58
jlkright21:58
jlkI'm fixing a bug we introduced in github21:59
jesusaurI think the EventFilter decides whether or not the event triggers the pipeline, and the ChangeishFilter decides if the triggered pipeline applies to a given change in the pipeline21:59
jlkour bug is that we weren't properly doing a filter on the specific status being set in the event22:01
jlkso we'd get (potentially) triggered for _any_ status. Positive, negative, some random user.22:01
*** jamielennox|away is now known as jamielennox22:19
openstackgerritMathieu Gagné proposed openstack-infra/zuul master: Add ability to configure Zuul web interface with zuul.config.js  https://review.openstack.org/32789223:28

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!