Sunday, 2017-09-03

openstackgerritTristan Cacqueray proposed openstack-infra/zuul-jobs master: upload-logs: fix indentation  https://review.openstack.org/50033901:10
openstackgerritTristan Cacqueray proposed openstack-infra/zuul-jobs master: upload-logs/bindep: fix indentation  https://review.openstack.org/50033901:12
dmsimardmordred, Shrews, clarkb, jeblair: Still looking for reviews on a linters job for devstack-gate, it'd allow us to get rid of the zuul v2 bashate job too.01:54
dmsimardhttps://review.openstack.org/#/c/498140/01:54
pabelangerdmsimard: left comments02:29
dmsimardpabelanger: cool, will address tomorrow, trying to wrap up this disgusting ara patch before taking a break :D02:30
dmsimard15 files changed, 803 insertions(+), 1547 deletions(-)02:59
dmsimardall unit tests02:59
* dmsimard throws up02:59
openstackgerritTristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: WIP: web: add jobs controller  https://review.openstack.org/46656103:01
*** pabelanger has quit IRC04:14
*** pabelanger has joined #zuul04:16
jeblairi just saw an ansible-playbook segfault; afaict we're still running the patched python, so there may be another bug lurking in there.05:48
*** maxamillion has quit IRC06:09
*** maxamillion has joined #zuul06:09
*** lennyb has quit IRC06:56
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Implement a static driver for Nodepool  https://review.openstack.org/46862410:32
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Implement an OpenContainer driver  https://review.openstack.org/46875310:32
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: oci: replace paramiko with ansible playbooks  https://review.openstack.org/50035710:32
mordredjeblair: awesome12:29
*** yolanda has quit IRC13:17
*** lennyb has joined #zuul14:17
dmsimardmordred: so, somewhat of a silly question14:42
dmsimardmordred: with in-repo zuul.yaml files, what prevents me from knowingly or unknowingly DDoS'ing Zuul/Nodepool with junk jobs ?14:43
mordreddmsimard: social pressure :)14:43
mordreddmsimard: I mean, you can already DDOS the system just by submitting 10k patches to the devstack-gate repo14:44
dmsimardmordred: I guess, zuul.yaml lowers the barrier to entry that's all :p14:45
dmsimardcould make one 50 node job or something14:45
mordredyah- I believe we've tlaked about adding a control to limit the number of nodes a job can request14:45
mordredyah14:45
dmsimardI see at least three vectors that should have some amount of safeguards around: concurrency (rate limiting), size (amount of nodes/job), length (timeout). These should probably be enforced by default and then probably configurable/whitelistable at the trusted/system level14:48
dmsimardOtherwise the noisy neighbor issue is real in a multi-tenancy/multi-project environment14:49
* dmsimard has managed a multi-tenant public cloud before T_T14:50
tristanCmordred: max-nodes-per-job is actually live :-)15:00
mordredtristanC: on neat! I can't keep up with it all ;)15:00
tristanCquick question, is it needed to restart executor when the main.yaml change?15:01
mordrednot the executor - the scheduler needs to be told to re-read its config - which currently is done via SIGHUP (right jeblair?)15:01
mordredwe have a todo list item to make a "zuul-scheduler reconfigure" command like other things have15:02
tristanCit seems like the scheduler is doing reconfigure on sighup indeed15:02
mordredyah15:02
tristanCand there are "TODOv3 implement" note on the executor graceful action15:04
tristanCwell the scheduler seems to send everything the executor need, just making sure it doesn't need to be manually restarted or something15:04
jeblairmordred, tristanC: yes you're both right about everything!15:06
mordredtristanC: yah - executor only needs to be restarted on code changes15:07
dmsimardtristanC, mordred: are we deploying sql reporter and the web UI on the rollout next week or is that going to wait for a while still ?15:18
jeblairdmsimard: sql reporter yes (already done); webui no15:19
tristanCdmsimard: i actually dropped the webui part, my javascript-fu is not good...15:21
dmsimardtristanC: us both then15:21
jeblairwe'll add the webui as soon as we can :)15:21
dmsimardtristanC: people say I've done a good job with the ara web ui but really it's all copypasta from patternfly.org15:21
tristanCthough i kept the backend and the zuul cli so that sql reporter data can still be easily consumed15:22
tristanCi mean kept in the review, that is https://review.openstack.org/466561 ftr15:23
jeblairtristanC: once we get v3 running, will you help us get up to speed with the dashboard work you did so we can continue work on it?15:24
jeblairi really likedi t15:25
jeblairliked it15:25
tristanCjeblair: yes sure, I hope to gather use-cases at the ptg15:26
tristanCon a similar topic, I proposed some new route to the nodepool webapp to be able to query available labels15:27
tristanCwhich i think would be a nice addition to the zuul "dashboard", it's https://review.openstack.org/50025415:28
dmsimardjeblair, mordred: What's your top 3 request for ara ? I'll priorize them after I'm done with the current API work I can hopefully show them at the ptg.15:33
dmsimardPlaybook naming ? Playbook grouping ?15:33
tristanCi made some good progress on the zuulv3 integration in software-factory, there is now a "--upstream-zuul-jobs" option to auto configure openstack-infra/zuul-jobs as a untrusted-project15:34
jeblairdmsimard: 1) (highest priority) customized playbook name; 2) un-reverse playbook order15:36
dmsimardtristanC: huh, that reminds me.. is there anything new we should be aware of from a third party CI perspective ? I guess our zuul is connected to gerrit, not to zuul, so it should be transparent15:36
dmsimardjeblair: ah, yes, ordering.15:36
mordreddmsimard, jeblair: I'd put 'ability to indicate job/phase grouping' in there too15:38
dmsimardokay, so we got 1 2 3 :D15:39
tristanCdmsimard: yes, rdo consumes the gerrit event-stream which isn't going to change15:39
dmsimardplaybook phase/groups will be last since it will be the one involving the most work of the three15:39
dmsimardthanks.15:39
mordreddmsimard: I had half a patch written the other day when musing about grouping- I pushed it up just for the fun of it15:51
dmsimardmordred: ack, will take a look15:51
mordredit's not an exciting patch :)15:51
dmsimardjeblair: is it currently possible for a job to dynamically define a success/failure message ? Say, to highlight errors that could have occurred during the job, for example.15:52
dmsimardmordred: just looked at the patch ಠ_ಠ15:53
dmsimardmordred: the hard part is more than likely the UI/UX lol15:54
dmsimardbut I have some idas15:54
dmsimardideas*15:54
*** jkilpatr has quit IRC17:09
*** olaph has quit IRC18:09
*** olaph has joined #zuul18:11
*** olaph1 has joined #zuul18:15
*** olaph has quit IRC18:17
*** olaph1 is now known as olaph18:26
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Override tox requirments with zuul git repos  https://review.openstack.org/48971919:07
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Override tox requirments with zuul git repos  https://review.openstack.org/48971919:14
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Add UPPER_CONSTRAINTS_FILE file if it exists  https://review.openstack.org/50032019:14
*** yolanda has joined #zuul19:21
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Override tox requirments with zuul git repos  https://review.openstack.org/48971919:22
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Override tox requirments with zuul git repos  https://review.openstack.org/48971919:37
openstackgerritMonty Taylor proposed openstack-infra/nodepool feature/zuulv3: Fix nodepool's cdocs about config-drive  https://review.openstack.org/50039119:44
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Override tox requirments with zuul git repos  https://review.openstack.org/48971919:57
*** jesusaur has quit IRC20:40
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Only run zuul-stream testing on callback changes  https://review.openstack.org/50016820:40
*** jesusaur has joined #zuul20:46
dmsimardmordred: bah there's some value in your patch for groups. I hadn't considered two layers, just one. I guess it makes sense.21:25
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Override tox requirments with zuul git repos  https://review.openstack.org/48971921:29
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Override tox requirments with zuul git repos  https://review.openstack.org/48971921:39
jeblairdmsimard: https://docs.openstack.org/infra/zuul/feature/zuulv3/user/config.html#attr-job.success-message22:03
dmsimardjeblair: right, I've seen that, but that's static in the zuul.yaml file22:04
jeblairdmsimard: ah, yeah, nothing now but we can add some more dynamic stuff with zuul_return later22:05
openstackgerritPaul Belanger proposed openstack-infra/zuul feature/zuulv3: Support IPv6 with zuul_stream  https://review.openstack.org/50040122:31
openstackgerritPaul Belanger proposed openstack-infra/zuul feature/zuulv3: Support IPv6 with zuul_stream  https://review.openstack.org/50040122:55
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Move ara output generation to post playbook  https://review.openstack.org/50040323:05
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Move ara output generation to post playbook  https://review.openstack.org/50040323:12
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Only run zuul-stream testing on callback changes  https://review.openstack.org/50016823:22
openstackgerritPaul Belanger proposed openstack-infra/zuul feature/zuulv3: Use afs_publisher_target for afs-docs  https://review.openstack.org/50040623:32
openstackgerritMonty Taylor proposed openstack-infra/nodepool feature/zuulv3: Fix nodepool's docs about config-drive  https://review.openstack.org/50039123:55

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!