Friday, 2017-01-13

*** saneax is now known as saneax-_-|AFK00:01
*** Cibo_ has joined #zuul05:01
*** bhavik1 has joined #zuul05:31
*** bhavik1 has quit IRC05:38
*** auggy has quit IRC07:28
*** TheJulia has quit IRC07:29
*** bstinson has quit IRC07:30
*** TheJulia has joined #zuul07:34
*** bstinson has joined #zuul07:34
*** auggy has joined #zuul07:34
*** Cibo_ has quit IRC08:03
*** yolanda has quit IRC08:18
*** yolanda has joined #zuul08:19
*** hashar has joined #zuul09:44
*** openstackgerrit has quit IRC10:18
*** yolanda has quit IRC10:23
*** yolanda has joined #zuul10:24
*** yolanda has quit IRC10:26
*** yolanda has joined #zuul10:27
*** yolanda has quit IRC10:39
*** yolanda has joined #zuul10:41
*** yolanda has quit IRC10:46
*** yolanda has joined #zuul10:49
*** yolanda has quit IRC10:49
*** yolanda has joined #zuul10:49
*** hashar has quit IRC13:35
*** bhavik1 has joined #zuul13:59
*** bhavik1 has quit IRC14:24
*** yolanda has quit IRC14:50
*** yolanda has joined #zuul14:50
*** yolanda has quit IRC14:54
*** yolanda has joined #zuul14:54
*** yolanda has quit IRC14:55
*** yolanda has joined #zuul14:56
*** yolanda has quit IRC14:57
*** yolanda_ has joined #zuul14:59
*** yolanda_ has quit IRC14:59
*** yolanda_ has joined #zuul14:59
*** yolanda__ has joined #zuul15:00
*** yolanda_ has quit IRC15:01
*** yolanda__ is now known as yolanda15:01
Shrewsjeblair: I'm about to put up a review that might help with that "no limit on threads" problem that you were worried about. Feedback welcome.16:18
*** openstackgerrit has joined #zuul16:18
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Add support for max_concurrency for providers  https://review.openstack.org/42005716:18
Shrews^^^16:18
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Add support for max_concurrency for providers  https://review.openstack.org/42005716:32
Shrewsugh, bugs16:32
*** yolanda has quit IRC16:35
Shrewsugh, more bugs16:39
*** yolanda has joined #zuul16:42
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Add support for max_concurrency for providers  https://review.openstack.org/42005716:45
pabelangerI know everybody loves bikeshedding, but would max-workers be a better name of the setting? max-concurrency seems a little vague16:48
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Add support for max_concurrency for providers  https://review.openstack.org/42005716:50
Shrewspabelanger: i don't care, personally. whatever folks prefer is fine with me16:51
*** yolanda has quit IRC16:51
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Add support for max_concurrency for providers  https://review.openstack.org/42005716:52
Shrewsok, that was the last patch set  :)16:52
Shrewskept finding things to clean up16:53
*** yolanda has joined #zuul16:59
*** yolanda has quit IRC17:04
*** yolanda has joined #zuul17:08
*** Shuo_ has joined #zuul17:13
Shuo_Is there a place on the dashboard seeing the average build/test time for jobs?17:14
clarkbShuo_: zuul does predicted times but that is the closest you will get from the zuul status page I think. graphite does track runtimes though so the data can be retrieved from there17:15
Shuo_clarkb: There are two numbers about the time in each status card on the dashboard (when I am looking at it now), is the 'predicted time' the one on top or the bottom?17:19
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Consume Task and TaskManager from shade  https://review.openstack.org/41475917:20
clarkbShuo_: top is prediected time remaining, bottom is total time spent in zuul17:23
Shuo_clarkb: Thanks. Could you give me a pointer (or a graphite config link), showing a concrete example? Such as 'the average test job time for a Nova commit"17:27
clarkbShuo_: I don't think such a thing exists, what we do have are graphs like the job runtime graphs at the bottom of http://grafana.openstack.org/dashboard/db/nodepool those are for specific jobs mapped onto cloud providers17:28
Shuo_clarkb: ok, good to know, thanks. What I wanted to know is 'how long a typical test job will be taking in my build farm'. If we can record such number, then we can do a lot of capacity forcast related things (e.g., combining that number with the # of job waiting in the queue, we can calculate things like 'by adding X more nodes, we can reduce the expected waiting time to Y')17:34
clarkbShuo_: yup and that data is there, you just have to ask graphite for it17:35
Shuo_clarkb: query the api directly?17:35
clarkbyes17:35
pabelangerclarkb: thanks for the additional summarize on v3 shim, I think I now understand the issue at hand.17:40
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Add support for max_concurrency for providers  https://review.openstack.org/42005717:57
*** bhavik1 has joined #zuul18:01
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Consume Task and TaskManager from shade  https://review.openstack.org/42011818:07
*** bhavik1 has quit IRC18:07
*** bhavik1 has joined #zuul18:07
*** bhavik1 has quit IRC18:33
mordredShuo_: we don't have that specific thing graphed because we have jobs with WILDLY different times (our pep8 jobs, for instance, take maybe 2 minutes, our unittest jobs between 2 and 30 and our devstack integration jobs between 30 and 60 minutes)18:48
Shuo_mordred: I was asking if the zuul pipeline has such capability to  display (and retain for long term trend analysis) such data, and it sounds like it has. Specifically, if we take a deeper look at "zuul job queue" graph, we see sometimes job-in-wait number is quite high (we'd like to know if adding more capacity would help and what's the marginal ROI for added servers)18:54
*** openstack has joined #zuul19:02
clarkbindeed. Keep in mind though that its not purely a number of resources problem19:02
clarkbslow tests will be slow regardless of how many other instances you have available19:02
clarkband that creates a lower bound on the runtimes19:03
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Consume Task and TaskManager from shade  https://review.openstack.org/41475919:05
*** jamielennox is now known as jamielennox|away19:12
Shuo_mordred: agreed, it's not pure resource problem.19:12
*** openstack has joined #zuul20:01
*** Shuo_ has quit IRC20:19
*** openstack has joined #zuul20:31
*** jamielennox|away is now known as jamielennox21:59
*** Shuo_ has joined #zuul22:05
*** Shuo_ has quit IRC22:12
openstackgerritPaul Belanger proposed openstack-infra/nodepool: Move to fedora-25 for devstack testing  https://review.openstack.org/42019722:25
openstackgerritPaul Belanger proposed openstack-infra/nodepool: Move to fedora-25 for devstack testing  https://review.openstack.org/42019722:29
openstackgerritJesse Keating proposed openstack-infra/zuul: Add trigger capability on github pr review  https://review.openstack.org/41968423:55
*** harlowja has quit IRC23:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!