Thursday, 2017-01-26

jeblairShrews, clarkb: i think 424863 is good enough (logs are in an extra subdirectory, but at least we have them)00:07
openstackgerritMerged openstack-infra/zuul: Rename nodepool integration script  https://review.openstack.org/42486300:11
*** ianw is now known as ianw_pto04:34
*** Guest58531 has quit IRC05:04
*** mgagne has joined #zuul05:07
*** mgagne is now known as Guest3353905:07
*** abregman has joined #zuul05:22
*** saneax has joined #zuul06:34
*** saneax is now known as saneax-_-|AFK06:46
*** isaacb has joined #zuul07:33
*** hashar has joined #zuul08:03
*** abregman is now known as abregman|mtg08:27
*** abregman|mtg is now known as abregman09:04
*** isaacb has quit IRC10:01
*** isaacb has joined #zuul10:03
*** abregman is now known as abregman|afk10:19
*** yolanda has quit IRC10:23
*** abregman|afk is now known as abregman10:25
*** abregman is now known as abregman|mtg10:25
*** yolanda has joined #zuul10:26
*** abregman|mtg is now known as abregman10:40
*** isaacb has quit IRC10:52
*** isaacb has joined #zuul10:53
*** isaacb has quit IRC11:03
*** openstackgerrit has quit IRC11:17
*** Zara has quit IRC11:30
*** Zara has joined #zuul11:35
*** isaacb has joined #zuul11:51
*** bhavik1 has joined #zuul12:15
*** bhavik1 has quit IRC12:53
*** openstackgerrit has joined #zuul13:23
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul: Add zuul->np test for invalid node type  https://review.openstack.org/42568613:23
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul: Add zuul->np test for invalid node type  https://review.openstack.org/42568613:29
Shrewsjeblair: w00t! our first integration test pass: http://logs.openstack.org/86/425686/2/experimental/gate-zuul-nodepool/a83475e/testr_results.html.gz13:39
mordredShrews: that's exciting!13:40
Shrewsmordred: i'm so excited13:40
Shrewsand i just can't hide it13:41
*** isaacb has quit IRC13:43
pabelangerthat is awesome13:44
dmsimardIntegration tests !?13:52
dmsimardAre those for Nodepool or Zuul ? or both ? Sort of hard to tell from the perspective of a noob.13:53
Shrewsdmsimard: both. it tests the v3 zuul->nodepool communication/interaction13:54
dmsimardNeat. The lack of integration tests has always scared me away from really trying to contribute anything meaningful to Zuul :)13:54
dmsimardSending things straight to production is not something I usually do but maybe I'm old school :p13:55
*** isaacb has joined #zuul13:57
mordreddmsimard: yah - I think we're all going to be much more pleased with the integration tests being there13:59
*** saneax-_-|AFK is now known as saneax14:11
*** hashar is now known as hasharAway15:15
jeblairdmsimard: zuul's tests are actually fairly reliable.  nearly all of the tests are functional with all of the systems it interacts with comprehensively faked.  so if something is tested in zuul, i'm confident about sending it into production.15:37
dmsimardjeblair: yeah but for example, in this old patch (that I'll revive one day) https://review.openstack.org/#/c/330874/ I was hoping to see the results of that patch in the gate jobs15:38
jeblairdmsimard: this zuul-nodepool integration test is very small, just covering the interaction between the two systems.  and it's mainly useful because neither system *exists* yet, so they necessarily need to evolve together.  even so, zuul has nodepool fakes still, and nodepool has a zuul fake, and both will continue to test things in their unit/functional tests.15:38
jeblairdmsimard: oh, that's the v2.5 ansible launcher.  it's an exception to what i've said because it was a dead-end bit of code.15:39
jeblairdmsimard: the v3 equivalent of that code has tests now, and even runs ansible and can now examine the results of ansible to verify correctness15:39
dmsimardcool, I'll have to check it out15:39
jeblairdmsimard: so if you proposed that to v3, even now, it would be fully testable15:40
mordred\o/ for fully testable15:45
*** openstackgerrit has quit IRC15:48
*** abregman has quit IRC16:19
*** hasharAway has quit IRC16:20
*** saneax is now known as saneax-_-|AFK16:52
*** hashar has joined #zuul16:57
*** isaacb has quit IRC16:59
*** saneax-_-|AFK is now known as saneax17:00
*** persia has quit IRC17:16
*** openstackgerrit has joined #zuul17:18
openstackgerritJames E. Blair proposed openstack-infra/nodepool: Merge branch 'master' into feature/zuulv3  https://review.openstack.org/42497417:18
*** persia has joined #zuul17:20
*** hashar is now known as hasharAway17:30
openstackgerritJames E. Blair proposed openstack-infra/zuul: Handle multiple playbook extensions  https://review.openstack.org/42545017:56
openstackgerritJames E. Blair proposed openstack-infra/zuul: Add playbooks for all test jobs  https://review.openstack.org/42581017:56
openstackgerritJames E. Blair proposed openstack-infra/zuul: Add playbooks for all test jobs  https://review.openstack.org/42581018:16
openstackgerritJames E. Blair proposed openstack-infra/zuul: Handle multiple playbook extensions  https://review.openstack.org/42545018:16
Shrewsjeblair: for a single node request that wants multiple nodes, do we want to spin up separate threads for each node that needs launched to make fulfillment quicker?18:58
jeblairShrews: i think so.18:59
jeblair(otherwise, things could be very slow)18:59
jeblairShrews: and some of those threads will fail.  so probably the main worker thread will need to keep track of those, check in on them, and see if the request is done, or if threads need to be re-launched...19:00
*** harlowja has quit IRC19:02
Shrewsyeah19:02
*** yolanda has quit IRC19:17
Shrewsjeblair: any limit on the number of re-launches we try?19:18
Shrewsi'd think we'd want to just give up after a while if there are provider issues19:18
Shrewsi don't see that the current code does that. one and done19:20
clarkbpre zk nodepool will continue to ask cloud for resources until it gets them, but it doesn't allocate resources to specific requests so that is a bit easier to sort out19:22
Shrewsclarkb: hmm. i'd think in the new world, we'd want to give up and decline the request so that it might be fulfilled by another provider19:24
Shrews(assuming another provider has the requested images)19:24
clarkbya I think with things bucketed into specific requests it would be good to be a little smarter about it and give up and let others attempt it19:25
Shrewsi suppose i could make the retry configurable, and support "never give up, never give in" mode19:26
*** saneax is now known as saneax-_-|AFK19:31
*** yolanda has joined #zuul19:34
openstackgerritJames E. Blair proposed openstack-infra/zuul: Use playbooks defined in repos  https://review.openstack.org/42355019:41
openstackgerritJames E. Blair proposed openstack-infra/zuul: Put Zuul vars in an ansible vars file  https://review.openstack.org/42436719:41
openstackgerritJames E. Blair proposed openstack-infra/zuul: Add playbooks for all test jobs  https://review.openstack.org/42581019:41
openstackgerritJames E. Blair proposed openstack-infra/zuul: Handle multiple playbook extensions  https://review.openstack.org/42545019:41
openstackgerritJames E. Blair proposed openstack-infra/zuul: Fix nodeset return on skipped jobs  https://review.openstack.org/42586519:41
jeblairgoonies never say die.  but nodepool does?19:42
jeblairShrews: yeah, i think configurable makes sense for this.  3x default maybe?19:42
Shrewssounds reasonable19:43
jeblairthose patches ^ are a restack on top of a fix (425865) which will hopefully help with our recent test instability19:43
*** Guest33539 is now known as mgagne20:01
*** mgagne has quit IRC20:01
*** mgagne has joined #zuul20:01
*** harlowja has joined #zuul20:09
*** hasharAway is now known as hashar20:10
mordredjeblair, Shrews: ++ 3x retry with configurable20:27
*** saneax-_-|AFK is now known as saneax23:02
*** hashar has quit IRC23:03
openstackgerritJames E. Blair proposed openstack-infra/zuul: Move job running into own class  https://review.openstack.org/38596423:25
jeblairjhesketh: ^ i dusted off that change because i'm looking at implementing the pre/post playbook stuff and your commit message is correct.  :)23:26

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!