| SpamapS | jeblair: is it possible 'timer' isn't implemented in v3's layout validator yet? | 00:03 |
|---|---|---|
| SpamapS | or rather, configloader? | 00:13 |
| SpamapS | ah, looks like we never load the timer driver | 00:22 |
| SpamapS | Shrews: I get infinite streams of this now from my test runs: | 00:22 |
| jeblair | SpamapS: cncf: cool! thanks, nice msg :) | 00:22 |
| SpamapS | 2017-02-01 16:22:25,218 kazoo.client DEBUG Sending request(xid=228): GetChildren(path='/nodepool_test/BALPatqw_2913/nodepool/requests', watcher=None) | 00:22 |
| SpamapS | 2017-02-01 16:22:25,219 kazoo.client DEBUG Received error(xid=228) NoNodeError((), {}) | 00:22 |
| jeblair | SpamapS: yeah, that's the test running until timeout | 00:23 |
| SpamapS | ah | 00:23 |
| SpamapS | noisy buger | 00:23 |
| jeblair | SpamapS: (i have current work to mask that logging) | 00:23 |
| jeblair | SpamapS: i think the configparser hands off parsing drivers such as timer to the driver itself... i *think* that's implemented | 00:24 |
| SpamapS | It does | 00:25 |
| SpamapS | and timer hasn't ever been registered | 00:25 |
| SpamapS | registering it 'splodes in .reconfigure(tenant) | 00:25 |
| SpamapS | working on that now | 00:25 |
| SpamapS | alright, now it's just failing the actual test. :) | 00:42 |
| jeblair | mordred, Spamaps: with 427946, test_dependent_behind_dequeue always fails with a stringexception/processreturncode error (that usually means some kind of timeout). but that test is skipped. when i run it locally, it skips as expected. i have no idea how to proceed. | 00:43 |
| *** openstackgerrit has quit IRC | 01:02 | |
| mordred | jeblair: uhm | 01:14 |
| SpamapS | jeblair: looking | 01:42 |
| SpamapS | jeblair: you meant some other number. :) | 01:44 |
| *** Shuo has quit IRC | 02:11 | |
| mordred | SpamapS: I think he means https://review.openstack.org/427946 | 02:13 |
| mordred | such as http://logs.openstack.org/46/427946/2/check/gate-zuul-python27-ubuntu-xenial/208c06b/testr_results.html.gz | 02:13 |
| mordred | which does not give me the pleasings | 02:14 |
| SpamapS | hm I must have typo'd it twice :-P | 02:15 |
| SpamapS | t3h weirds | 02:16 |
| *** openstackgerrit has joined #zuul | 02:17 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Re-enable test_abandoned_not_timer https://review.openstack.org/427985 | 02:17 |
| SpamapS | jeblair: ^^ I'm a bit stuck on this one... it doesn't seem to see the jobs in layout-idle. | 02:17 |
| openstackgerrit | Jamie Lennox proposed openstack-infra/zuul feature/zuulv3: Re-enable multiple gerrit connection test https://review.openstack.org/406699 | 04:06 |
| *** saneax-_-|AFK is now known as saneax | 04:16 | |
| *** saneax is now known as saneax-_-|AFK | 04:40 | |
| *** bhavik1 has joined #zuul | 05:20 | |
| *** Zara has quit IRC | 06:12 | |
| *** Zara has joined #zuul | 06:13 | |
| *** yolanda has quit IRC | 06:13 | |
| *** yolanda has joined #zuul | 06:25 | |
| *** abregman has joined #zuul | 06:41 | |
| *** yolanda has quit IRC | 06:46 | |
| *** saneax-_-|AFK is now known as saneax | 07:05 | |
| *** yolanda has joined #zuul | 08:12 | |
| *** yolanda has quit IRC | 08:52 | |
| *** yolanda has joined #zuul | 09:03 | |
| *** hashar has joined #zuul | 09:06 | |
| *** yolanda has quit IRC | 09:10 | |
| *** yolanda has joined #zuul | 09:41 | |
| *** bhavik1 has quit IRC | 10:59 | |
| *** wznoinsk has left #zuul | 11:07 | |
| openstackgerrit | Alexander Evseev proposed openstack-infra/zuul master: Use ssh-agent instead of ugly ssh-wrapper scripts https://review.openstack.org/331148 | 11:08 |
| *** openstackgerrit has quit IRC | 12:03 | |
| *** yolanda has quit IRC | 14:15 | |
| *** yolanda has joined #zuul | 14:15 | |
| *** abregman has quit IRC | 15:20 | |
| Shrews | jeblair: wow, that failure is... wow | 15:25 |
| *** saneax is now known as saneax-_-|AFK | 15:26 | |
| *** Cibo_ has joined #zuul | 15:45 | |
| jeblair | SpamapS: that change lgtm -- i don't immediately see what's wrong. i'll take a closer look after i wrestle with testtools. | 15:46 |
| *** hashar is now known as hasharAway | 16:24 | |
| *** abregman has joined #zuul | 16:38 | |
| *** abregman is now known as abregman|afk | 17:13 | |
| *** hasharAway has quit IRC | 17:29 | |
| jeblair | aaah. dependent_behind_dequeue was recently enabled, so my local branch doesn't have it (it's actually not skipped). i'm guessing its runtime is close enough to the limit that the change in how the tests are run pushed it over. | 17:33 |
| *** openstackgerrit has joined #zuul | 17:39 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Tests: store debug logs on error https://review.openstack.org/427946 | 17:39 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add SourceContext class https://review.openstack.org/427846 | 17:39 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Use playbooks defined in repos https://review.openstack.org/423550 | 17:39 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Put Zuul vars in an ansible vars file https://review.openstack.org/424367 | 17:39 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add playbooks for all test jobs https://review.openstack.org/425810 | 17:39 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Implement job aborting https://review.openstack.org/426306 | 17:39 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Move job running into own class https://review.openstack.org/385964 | 17:39 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add infrastructure for pre/post playbooks https://review.openstack.org/425989 | 17:39 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Run pre and post playbooks https://review.openstack.org/427494 | 17:39 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Fix test_live_configuration https://review.openstack.org/427838 | 17:39 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Handle multiple playbook extensions https://review.openstack.org/425450 | 17:39 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Fix nodeset return on skipped jobs https://review.openstack.org/425865 | 17:39 |
| jeblair | i rebased, increased the timeout, and switched to gentle timeouts. | 17:39 |
| mordred | jeblair: yay! | 17:40 |
| *** abregman|afk has quit IRC | 17:57 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Re-enable test_abandoned_not_timer https://review.openstack.org/427985 | 18:06 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Remove layout.projects https://review.openstack.org/428306 | 18:06 |
| jeblair | SpamapS: ^ i found the sticking point and fixed it in 428306. 427985 is now failing for new unrelated reasons. do you want to continue with that, or should i pick it up? | 18:07 |
| jeblair | i've just done a full testr run. something like 10 tests failed. they don't fail in isolation, so i can't just run one of them to see the logs. does anyone know how to extract the logs for just one test out of the subunit file? | 18:34 |
| jeblair | testr failing --subunit | subunit-filter -m tests.unit.test_scheduler.TestScheduler.test_file_head | subunit-2to1 | 18:36 |
| jeblair | that approximates what i want.... surely there's a better way? (especially the subunit-2to1 bit?) | 18:37 |
| Shrews | that stuff is all magic to me | 18:39 |
| jeblair | yeah, ttrun is my friend | 18:39 |
| Shrews | i was never certain of what advantage ttrun provides over tox. isn't 'ttrun -epy27 x.y.z' the same as 'tox -epy27 x.y.z' ? | 18:41 |
| SpamapS | IIRC there's a subunit cli | 18:42 |
| SpamapS | ah yeah you found it ;) | 18:42 |
| SpamapS | that's how I'd have done it | 18:42 |
| SpamapS | that's more or less how subunit2sql works too :-P | 18:43 |
| *** hashar has joined #zuul | 18:46 | |
| SpamapS | Shrews: ttrun runs without subunit wrapping it, so you can run a debugger | 18:48 |
| SpamapS | since tox is just feeding your args into testr | 18:48 |
| jeblair | and it streams to the console in real time, so you can diagnose hanging tests | 18:49 |
| Shrews | SpamapS: ah, that would be handy, indeed | 18:49 |
| SpamapS | Right that too | 18:49 |
| * Shrews pip installs | 18:49 | |
| SpamapS | I wonder if one could just have a --no-subunit arg added to testr | 18:50 |
| mordred | Shrews: ttrun skips the discover phase - so shaves several seconds off of a run | 18:55 |
| SpamapS | jeblair: I looked at the interdiff from my patch to yours. I'm not sure I understand why those changes were needed. | 18:55 |
| mordred | SpamapS: the thing is - all testr really is is a program that knows how to invoke subunit producing things and store their results into a database | 18:55 |
| SpamapS | mordred: in parallel | 18:56 |
| mordred | yah | 18:56 |
| SpamapS | which is the fun part :) | 18:56 |
| jeblair | SpamapS: did you look at my standalone change and the commit message? https://review.openstack.org/428306 | 18:56 |
| jeblair | SpamapS: layout.projects is empty now | 18:57 |
| mordred | jeblair: and yes - I do not think there is a 'better' way to do what you're doing with the above pipeline | 18:57 |
| SpamapS | jeblair: OH no I did not. :) | 18:58 |
| SpamapS | that 'splains it | 18:58 |
| SpamapS | jeblair: the failure still looks the same in the end... no builds. | 18:59 |
| jeblair | SpamapS: sorry, my ping probably made more sense in the context of the two-line irc patch upload notice | 19:00 |
| SpamapS | http://logs.openstack.org/85/427985/2/check/gate-zuul-python27-ubuntu-xenial/1a3ad39/console.html#_2017-02-02_18_11_22_544620 | 19:00 |
| SpamapS | actually I think it's a simple logic error | 19:00 |
| *** bhavik1 has joined #zuul | 19:09 | |
| *** bhavik1 has quit IRC | 19:22 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Tests: store debug logs on error https://review.openstack.org/427946 | 19:34 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add SourceContext class https://review.openstack.org/427846 | 19:34 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Use playbooks defined in repos https://review.openstack.org/423550 | 19:34 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Put Zuul vars in an ansible vars file https://review.openstack.org/424367 | 19:34 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add playbooks for all test jobs https://review.openstack.org/425810 | 19:35 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Implement job aborting https://review.openstack.org/426306 | 19:35 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Move job running into own class https://review.openstack.org/385964 | 19:35 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add infrastructure for pre/post playbooks https://review.openstack.org/425989 | 19:35 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Run pre and post playbooks https://review.openstack.org/427494 | 19:35 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Fix test_live_configuration https://review.openstack.org/427838 | 19:35 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Handle multiple playbook extensions https://review.openstack.org/425450 | 19:35 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Fix nodeset return on skipped jobs https://review.openstack.org/425865 | 19:35 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Increase individual test timeout https://review.openstack.org/428389 | 19:35 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Fix race in fakenodepool https://review.openstack.org/428390 | 19:35 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Set TMPDIR to ZUUL_TEST_ROOT https://review.openstack.org/428391 | 19:35 |
| jeblair | okay, i'm not ready to switch to non-gentle timeouts -- i still see problems with that in some cases, so i removed that. | 19:35 |
| jeblair | SpamapS: i added 428391 to help my ssd. i also moved my zookeeper to a tmpfs. with those changes (i don't know if both were necessary, but i think at least one was) i can actually run "tox -epy27" on my workstation. | 19:36 |
| jeblair | i also added 428390 which seems to be the cause of some spurious test failures after the test logging change (timings changed everywhere, so it brings out the race conditions) | 19:36 |
| jeblair | i put the test race related changes at the top of the stack | 19:37 |
| *** abregman|afk has joined #zuul | 19:48 | |
| *** abregman|afk has quit IRC | 19:55 | |
| *** abregman has joined #zuul | 19:56 | |
| SpamapS | jeblair: weee | 20:33 |
| *** harlowja has quit IRC | 21:00 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Fix storeNode() for updates https://review.openstack.org/428425 | 21:06 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: WIP: Assign node set to node requests https://review.openstack.org/428428 | 21:14 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: WIP: Assign node set to node requests https://review.openstack.org/428428 | 21:15 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: WIP: Assign node set to node requests https://review.openstack.org/428428 | 21:44 |
| *** harlowja has joined #zuul | 22:25 | |
| *** harlowja has quit IRC | 22:32 | |
| *** harlowja has joined #zuul | 22:33 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Tests: store debug logs on error https://review.openstack.org/427946 | 22:46 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add SourceContext class https://review.openstack.org/427846 | 22:46 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Use playbooks defined in repos https://review.openstack.org/423550 | 22:46 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Put Zuul vars in an ansible vars file https://review.openstack.org/424367 | 22:46 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add playbooks for all test jobs https://review.openstack.org/425810 | 22:46 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Implement job aborting https://review.openstack.org/426306 | 22:46 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Move job running into own class https://review.openstack.org/385964 | 22:46 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add infrastructure for pre/post playbooks https://review.openstack.org/425989 | 22:46 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Run pre and post playbooks https://review.openstack.org/427494 | 22:46 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Handle multiple playbook extensions https://review.openstack.org/425450 | 22:46 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Fix nodeset return on skipped jobs https://review.openstack.org/425865 | 22:46 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Avoid multiple build cancelations https://review.openstack.org/428477 | 22:46 |
| *** hashar has quit IRC | 22:53 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Put Zuul vars in an ansible vars file https://review.openstack.org/424367 | 22:57 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Move job running into own class https://review.openstack.org/385964 | 22:57 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add infrastructure for pre/post playbooks https://review.openstack.org/425989 | 22:57 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Fix race in fakenodepool https://review.openstack.org/428390 | 22:57 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Fix test_live_configuration https://review.openstack.org/427838 | 22:57 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Set TMPDIR to ZUUL_TEST_ROOT https://review.openstack.org/428391 | 22:57 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Handle multiple playbook extensions https://review.openstack.org/425450 | 22:57 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Increase individual test timeout https://review.openstack.org/428389 | 22:57 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Fix nodeset return on skipped jobs https://review.openstack.org/425865 | 22:57 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Tests: store debug logs on error https://review.openstack.org/427946 | 22:57 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add SourceContext class https://review.openstack.org/427846 | 22:57 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Use playbooks defined in repos https://review.openstack.org/423550 | 22:57 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add playbooks for all test jobs https://review.openstack.org/425810 | 22:57 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Implement job aborting https://review.openstack.org/426306 | 22:57 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Avoid multiple build cancelations https://review.openstack.org/428477 | 22:57 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Run pre and post playbooks https://review.openstack.org/427494 | 22:57 |
| jeblair | i'm basically just making it look like i'm really busy | 22:58 |
| jeblair | (sorry about all that, but i'm on a tear fixing up test stability) | 22:58 |
| jeblair | pabelanger, mordred: thanks for the +3s; if you can add some more to that stack, that would be nice. :) | 23:07 |
| pabelanger | jeblair: Ya, doing so now | 23:08 |
| pabelanger | jeblair: left trivial comment on 425989. And question on 427494 | 23:22 |
| jeblair | pabelanger: re 989 agreed, i'll fix. responded on 494 | 23:26 |
| pabelanger | jeblair: ack | 23:26 |
| *** abregman has quit IRC | 23:40 | |
| SpamapS | jeblair: crikey, you're so busy! | 23:50 |
| SpamapS | jeblair: If you'd like for me to pick 427985 back up I will happily do so. I've been distracted mostly by yet another winter/travel cold sapping my ability to be awake :-P | 23:54 |
| SpamapS | jeblair: in playing with it earlier, it kind of feels like this test is covering a lot of code that was previously uncovered. | 23:55 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Tests: store debug logs on error https://review.openstack.org/427946 | 23:59 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add SourceContext class https://review.openstack.org/427846 | 23:59 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Use playbooks defined in repos https://review.openstack.org/423550 | 23:59 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Put Zuul vars in an ansible vars file https://review.openstack.org/424367 | 23:59 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add playbooks for all test jobs https://review.openstack.org/425810 | 23:59 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Implement job aborting https://review.openstack.org/426306 | 23:59 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Move job running into own class https://review.openstack.org/385964 | 23:59 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add infrastructure for pre/post playbooks https://review.openstack.org/425989 | 23:59 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Avoid multiple build cancelations https://review.openstack.org/428477 | 23:59 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Run pre and post playbooks https://review.openstack.org/427494 | 23:59 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Set TMPDIR to ZUUL_TEST_ROOT https://review.openstack.org/428391 | 23:59 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Handle multiple playbook extensions https://review.openstack.org/425450 | 23:59 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Fix nodeset return on skipped jobs https://review.openstack.org/425865 | 23:59 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Report exceptions in launcher https://review.openstack.org/428499 | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!