Tuesday, 2019-07-02

*** mattw4 has quit IRC00:10
*** jamesmcarthur has joined #zuul00:40
*** jamesmcarthur has quit IRC00:51
*** jamesmcarthur has joined #zuul00:53
*** jamesmcarthur has quit IRC01:10
*** jamesmcarthur has joined #zuul01:10
*** jamesmcarthur has quit IRC01:15
*** jamesmcarthur has joined #zuul01:37
*** jamesmcarthur has quit IRC01:41
*** bhavikdbavishi has joined #zuul02:32
*** bhavikdbavishi1 has joined #zuul02:35
*** bhavikdbavishi has quit IRC02:36
*** bhavikdbavishi1 is now known as bhavikdbavishi02:36
*** jamesmcarthur has joined #zuul02:37
*** jamesmcarthur has quit IRC03:49
*** jamesmcarthur has joined #zuul03:50
*** igordc has quit IRC03:51
*** jamesmcarthur has quit IRC03:57
*** jamesmcarthur has joined #zuul04:29
*** jamesmcarthur has quit IRC04:36
*** swest has joined #zuul04:55
*** swest has quit IRC04:57
*** swest has joined #zuul04:58
*** swest has quit IRC05:02
*** swest has joined #zuul05:03
*** jamesmcarthur has joined #zuul05:05
*** jamesmcarthur has quit IRC05:10
*** bolg has joined #zuul05:25
*** jamesmcarthur has joined #zuul05:42
*** jamesmcarthur has quit IRC05:47
*** themroc has joined #zuul06:42
*** gtema has joined #zuul06:45
*** raukadah is now known as chandankumar06:46
*** gtema has quit IRC06:50
*** gtema has joined #zuul06:50
*** gtema has quit IRC06:56
*** bhavikdbavishi has quit IRC07:01
*** saneax has joined #zuul07:06
*** tosky has joined #zuul07:22
*** bolg has quit IRC07:29
*** bolg has joined #zuul07:34
*** evrardjp is now known as evrardjp_on_holi07:40
*** evrardjp_on_holi is now known as evrardjp_away07:40
*** bolg has quit IRC07:41
*** tosky has quit IRC07:43
*** tosky has joined #zuul07:43
*** jamesmcarthur has joined #zuul07:44
*** jamesmcarthur has quit IRC07:48
*** jamesmcarthur has joined #zuul07:51
*** jamesmcarthur has quit IRC07:55
*** gtema has joined #zuul08:00
*** pcaruana has joined #zuul08:01
*** hashar has joined #zuul08:18
*** jamesmcarthur has joined #zuul08:22
*** bolg has joined #zuul08:25
*** jamesmcarthur has quit IRC08:28
*** hacklint has joined #zuul08:31
*** sshnaidm|afk is now known as sshnaidm|ruck08:36
hacklintHi folks, first time here... I'm looking for more info/examples on using shared queues (multiple-repo changes) in Zuul 2.6 (if that is significantly different from current 3.x) (About 2.6 - don't ask... ;-)08:37
*** bolg has quit IRC08:39
*** bolg has joined #zuul08:43
*** bhavikdbavishi has joined #zuul08:46
*** bolg has quit IRC08:55
*** bolg has joined #zuul08:57
*** jamesmcarthur has joined #zuul09:00
*** gtema has quit IRC09:05
*** hacklint has quit IRC09:11
*** bhavikdbavishi has quit IRC09:34
*** brett-soric has joined #zuul09:41
*** jamesmcarthur has quit IRC10:04
*** hacklint has joined #zuul10:07
*** hacklint has quit IRC10:17
*** brett-soric has left #zuul10:27
*** gtema_ has joined #zuul10:28
*** bhavikdbavishi has joined #zuul10:31
*** bhavikdbavishi has quit IRC10:40
*** saneax has quit IRC11:28
openstackgerritMonty Taylor proposed zuul/zuul master: Spec: Add a Kubernetes Operator for Zuul  https://review.opendev.org/65918011:40
mordredhi hacklint! at this point I've forgotten most of the things about 2.6 so I'm unlikely to be much help ... in general though, in 2.x they are implied by shared job name.11:42
openstackgerritGraham Hayes proposed zuul/nodepool master: Implement an Azure driver  https://review.opendev.org/55443211:44
*** gtema_ has quit IRC11:49
*** jamesmcarthur has joined #zuul12:01
*** jamesmcarthur has quit IRC12:05
mordredtobiash: https://review.opendev.org/#/c/668172 is a small patch that might (or might not) be interesting to you since you're running in openshift12:10
mordredmugsie: \o/12:14
mugsiemordred: yeah, finally got some time :)12:14
* mugsie really misses the openstack SDK though 12:15
openstackgerritMonty Taylor proposed zuul/zuul master: Spec: Add a Kubernetes Operator for Zuul  https://review.opendev.org/65918012:16
mordredmugsie: I'd offer to port it ...12:16
mugsieI already had a conversation with our internal SDK team, and pointed out the OpenStack one :)12:17
*** bhavikdbavishi has joined #zuul12:18
mordred\o/12:20
*** themroc has quit IRC12:21
*** electrofelix has joined #zuul12:22
*** saneax has joined #zuul12:27
*** jamesmcarthur has joined #zuul12:34
*** rlandy has joined #zuul12:35
*** jamesmcarthur has quit IRC12:39
*** jamesmcarthur has joined #zuul12:42
*** jamesmcarthur has quit IRC13:05
*** gtema_ has joined #zuul13:32
*** jamesmcarthur has joined #zuul13:32
*** jeliu_ has joined #zuul13:38
*** gtema_ has quit IRC13:38
*** bhavikdbavishi has quit IRC13:44
tobiashmordred: thanks for the hint, we're not using the container driver yet, but when we will this will be interesting13:46
tobiashI'll review it later today13:47
openstackgerritJames E. Blair proposed zuul/nodepool master: Update documentation for k8s in-cluster config  https://review.opendev.org/66867913:51
corvusflaper87, mordred, tobiash: ^13:52
* flaper87 clicks13:55
flaper87corvus: +113:56
flaper87thanks :)13:56
tobiashlgtm13:58
tobiashonce the doc has review (mordred?) I guess we can +3 it13:59
mordredI have +3d the doc patch13:59
corvusflaper87: re your test question -- yeah, i don't think we have an effective way to test this; the unit tests mock out _get_client so that no real k8s is needed. the functional tests *do* run with a real k8s, but not with nodepol in-cluster -- nodepool is on the vm.  we could maybe add a test where we created a fake service account file on the nodepool cluster (by reading the kube/admin file, modifying it14:01
corvusappropriately, saving it as a fake service account file, and deleting it), but i'm not sure it's worth it.  at least our functional test tells us we haven't broken the kube/admin code path.14:01
mordredcorvus, flaper87: perhaps as we get the zuul operator dev going and are testing running all the things in a k8s we'll be able to more effectively test this code path14:02
flaper87mordred: corvus: ah, thanks for clarifying!14:02
corvusmordred: yeah, we might decide this should be the default config for that case...14:02
flaper87https://review.opendev.org/#/c/668172/ is missing +A14:03
mordredyah14:03
flaper87corvus: I think this is a sane default :D14:03
*** hashar has quit IRC14:03
*** hwangbo has quit IRC14:04
*** bolg has quit IRC14:13
sshnaidm|ruckis there option in zuul to set custom time trigger for the periodic job in the job itself? For example use case: I have a bunch of jobs that should be executed in various times and various periods, I don't want to create a different periodic pipeline for each one.14:18
sshnaidm|ruckI'm talking not about openstack zuul, in general14:18
openstackgerritMerged zuul/nodepool master: Allow nodepool for using in-cluster configs  https://review.opendev.org/66817214:32
pabelangerDid anybody submit anything to OpenInfra summit for zuul? Or want to, but forget? CFP closes soon14:38
pabelangersshnaidm|ruck: you need a new pipeline for each14:38
sshnaidm|ruckpabelanger, I see.. I wanted use CI as a scheduler.14:39
sshnaidm|ruckbut seems it's impossible with zuul, creating a pipeline for each job is huge overhead14:40
*** zbr has quit IRC14:53
*** zbr has joined #zuul14:54
clarkbworth noting that even if you run on a periodic cron that the jobs will execute some time after that trigger14:54
clarkbso even if you could do what you wanted it wouldn't stick those jobs to specific time frames. Just closer to them14:54
*** evrardjp_away has quit IRC14:58
*** evrardjp has joined #zuul14:59
*** mattw4 has joined #zuul15:02
*** edmondsw_ has joined #zuul15:04
corvussshnaidm|ruck: to do what you want, we'd need job-specific project-pipeline configuration, which is something we can explore, but it would take a bit of design (might need a spec to discuss how it would apply to the different kinds of drivers -- think email addresses for smtp reporters, irc channels, etc)15:09
sshnaidm|ruckcorvus, ack, I think it would be useful, it has some use cases15:13
sshnaidm|ruckI can't abort job from the job itself, right?15:16
openstackgerritJeff Liu proposed zuul/zuul-operator master: Add playbooks folder and zuul job that installs k8s  https://review.opendev.org/66802915:17
corvussshnaidm|ruck: no; nothing outside of just failing an ansible task for that.  but depending on what you're trying to accomplish, https://zuul-ci.org/docs/zuul/user/jobs.html#var-zuul.child_jobs might help (a job can control which jobs which depend on it will run)15:19
corvussshnaidm|ruck: https://zuul-ci.org/docs/zuul/user/jobs.html#skipping-child-jobs is a better link15:19
*** hashar has joined #zuul15:20
corvussshnaidm|ruck: note that the parent job can be a zero-node job that runs on the executor, so it can quickly make decisions about whether "real" jobs on "real" nodes run.15:20
sshnaidm|ruckcorvus, nice.. so I can do a job that runs once in hour, and decides which child jobs it's time to run now.. something like that?15:21
corvussshnaidm|ruck: yep15:21
sshnaidm|ruckcorvus, cool, thanks, will check this15:22
*** bhavikdbavishi has joined #zuul15:22
corvussshnaidm|ruck: this also may be useful: https://docs.ansible.com/ansible/latest/user_guide/playbooks_templating.html#get-the-current-time15:22
*** gtema_ has joined #zuul15:23
sshnaidm|ruckyeah.. but then I need to implement my own cron.. if I want to configure cron-like trigger in the job vars15:25
sshnaidm|ruckseems like it will work for specific times only15:26
sshnaidm|rucknot like "every 15 minutes"15:26
clarkbthe cron lib that zuul runs supports those time specifications15:27
*** gtema_ has quit IRC15:29
*** bhavikdbavishi1 has joined #zuul15:29
*** bhavikdbavishi has quit IRC15:30
*** bhavikdbavishi1 is now known as bhavikdbavishi15:30
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: Move project config in-repo  https://review.opendev.org/66869815:31
SpamapSsshnaidm|ruck: Out of pure curiosity, what are you wanting to run on this schedule?15:31
SpamapSI only ask because I have found that nobody cares about periodic jobs once there are gate tests... they tend to just generate reports that slowly get forgotten.15:31
sshnaidm|ruckSpamapS, various CI related tasks, not actually jobs that test code. I thought why I need to look for scheduler system, if I have a CI actually15:32
SpamapSThe one exception is security checks where the world might change before your code does.15:32
sshnaidm|ruckSpamapS, well, if it was good interface where periodic jobs would be tracked, maybe somebody would look at them15:33
SpamapSsshnaidm|ruck: I dunno, I'd think people would ask. They don't. :-P15:37
openstackgerritMerged zuul/nodepool master: Update documentation for k8s in-cluster config  https://review.opendev.org/66867915:37
SpamapSNot saying it's a rule, or a good thing, but in the 3 zuul's I've helped build and run, nobody has cared a single bit for the periodic jobs. If you count OpenStack, that's 4, and I rarely see people reaching for the periodic reports.15:37
sshnaidm|ruckSpamapS, well, I have my own systems to track zuul jobs, but if I haven't - I'd forget about them15:38
SpamapSwhat do you mean by track?15:38
SpamapSBecause, the zuul database reporter is pretty good for that.15:39
sshnaidm|ruckSpamapS, to see in one place, to get alerts15:39
SpamapSCould you  be more clear what alerts you're looking for? (also, I really don't mean to interrogate, I just want to understand so I can fill any holes in my own CI/CD system)15:40
* SpamapS heading afk for a while15:41
sshnaidm|ruckSpamapS, well, if job starts to fail, I'd like to see it when I look at my ci dashboard15:41
sshnaidm|ruckand to ping people to fix it, if I can't15:41
pabelangerI'm currently in the process of caring less about periodic jobs, and more about pre-merge testing jobs. So far, the cost of periodic jobs now is pretty minimal, a few hours each night. But humans are paying attention more to PR failures now :)15:44
*** jamesmcarthur has quit IRC16:03
*** mattw4 has quit IRC16:06
*** bolg has joined #zuul16:15
*** jamesmcarthur has joined #zuul16:17
*** bolg has quit IRC16:18
*** egustafson has joined #zuul16:20
corvustobiash, mordred: https://review.opendev.org/667156 is ready for +316:23
corvusas is its child16:23
tobiashyay16:25
*** rlandy has quit IRC16:41
*** rlandy has joined #zuul16:42
*** rlandy has quit IRC16:43
*** rlandy has joined #zuul16:44
*** hwangbo has joined #zuul16:45
openstackgerritMerged zuul/nodepool master: Remove devstack plugin functional test jobs  https://review.opendev.org/66715616:52
openstackgerritMerged zuul/nodepool master: Reparent nodepool-functional-openstack-src  https://review.opendev.org/66799517:01
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: Move in-repo test jobs into zuul-tests.d  https://review.opendev.org/66871617:01
*** jamesmcarthur has quit IRC17:02
*** jamesmcarthur has joined #zuul17:02
dmsimardsshnaidm|ruck: fwiw visibility on the periodic pipeline has gotten better with the new interface, i.e http://zuul.openstack.org/builds?pipeline=periodic17:03
dmsimardPrior to that, yes, periodic things had very little visibility outside of openstack-health17:03
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: Move in-repo test jobs into zuul-tests.d  https://review.opendev.org/66871617:04
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: Add zuul-jobs-tox-linters  https://review.opendev.org/66805217:07
sshnaidm|ruckdmsimard, yes, but there are all jobs from all projects, not sure if I can even use regex or wildcards with job names17:11
sshnaidm|ruckdmsimard, I think it should be an interest for running periodic jobs, if there is no such and they run just "let it be, won't hurt" - of course nobody cares, and they shouldn't run at all17:13
pabelangersshnaidm|ruck: no regex, but something I also raised on ML a few weeks ago: http://lists.zuul-ci.org/pipermail/zuul-discuss/2019-June/000961.html17:13
pabelangerwould be nice to have17:13
sshnaidm|ruckbut I assume everybody that run them knows why he does it and is interested17:13
pabelangergiven mhu responded, I can only assume he is vigorously working on patches :D17:14
sshnaidm|ruckpabelanger, yeah, it's sad we don't have paging, I need to add "&skip=50" and increase it manually :)17:15
*** mattw4 has joined #zuul17:15
sshnaidm|ruckhaving a link that does it seems much improving the UX17:15
sshnaidm|ruckSpamapS, dmsimard I run them mostly to know if some job is broken, with patch jobs it's difficult to say - maybe it's breaking patches fault, with no-change job it's much more clear17:17
sshnaidm|ruckor to know about CI infra problems :D17:17
*** electrofelix has quit IRC17:26
*** sshnaidm|ruck is now known as sshnaidm|afk17:31
*** hashar has quit IRC17:34
clarkbsshnaidm|afk: in theory you can use the gate pipeline results to filter that stuff out17:49
clarkbbeacuse those have passed check (at least with openstack's clean check requirement) and been judged by a human to be good17:49
*** jamesmcarthur has quit IRC17:56
openstackgerritMerged zuul/zuul-jobs master: Move project config in-repo  https://review.opendev.org/66869817:57
*** themroc has joined #zuul17:58
openstackgerritMerged zuul/zuul-jobs master: Move in-repo test jobs into zuul-tests.d  https://review.opendev.org/66871618:03
openstackgerritMerged zuul/zuul master: Filter out unprotected branches from builds if excluded  https://review.opendev.org/66666418:05
*** igordc has joined #zuul18:13
sshnaidm|afkclarkb, yeah, but not all jobs in gate sometimes, and better to know they fail yet before it fails in gate, especially if it's not so much merging project18:15
*** bhavikdbavishi has quit IRC18:41
*** bhavikdbavishi has joined #zuul18:43
pabelangerHumble brag: We did 336 periodic jobs last week on zuul.a.c for network integration jobs (devel and stable-2.8 on ansible) with 100% success rate. First time that has happened since running them 6 weeks ago18:56
clarkbpabelanger: next achievement: no gate failures18:56
pabelangerthat is using network vendor appliances too (multi-node 1 controller, 1 appliance)18:56
pabelangerclarkb: Yup, we are now seeing random failures when we do 3pci testing against ansible/ansible PRs, about 5% right now18:57
pabelangerWith ansible SSH connection, you have the ability to setup retries for the connection, using the network_cli conneciton plugin (build on paramiko) we don't have that option right now18:58
*** tosky has quit IRC19:19
*** jamesmcarthur has joined #zuul19:21
mordredpabelanger: seems like an opportunity to improve network_cli plugin - with a nice example of why it's important19:25
mordred;)19:25
*** panda has quit IRC19:27
*** jamesmcarthur has quit IRC19:28
*** panda has joined #zuul19:30
*** bhavikdbavishi has quit IRC19:33
openstackgerritMonty Taylor proposed zuul/zuul master: Spec: Add a Kubernetes Operator for Zuul  https://review.opendev.org/65918019:46
*** jamesmcarthur has joined #zuul19:47
*** hwangbo has quit IRC19:48
*** hwangbo has joined #zuul19:49
*** jamesmcarthur has quit IRC19:50
pabelangermordred: indeed, I've raised a bug about it, as I can't imagine production users not also having this issue20:14
openstackgerritMerged zuul/zuul-jobs master: Add zuul-jobs-tox-linters  https://review.opendev.org/66805220:14
egustafsonHi folks, really new to Zuul and had a couple questions. I've been picking up what I can through the quickstart guide and exploring/tweaking things to see how they fit together. 1.) The 'build node' in the quickstart guide appears to not need authentication (based on the image used). I was looking to edit nodepool.yaml and test using external vm's (static driver). Since its using ansible, I was assuming I need to seed the20:20
egustafsonbuild vm with the pub key of the caller ( executor/nodepool-launcher? )? 2.) The docker compose used in the quickstart are all pulling latest tags from dockerhub. Are there release tags that can be used (ex 3.0.0)? I see there are nightly's on dockerhub and a pull failed when i tried a 3.0.0 tag. 3.) Is there a kubernetes deployment (or even helm chart) that is officially recognized? I found a helm chart in a simple google20:20
egustafsonsearch but appears to be using home grown images.20:20
mordredegustafson: 3) we're working on a k8s operator - so, not *yet* - but officially recognized and supported is on its way20:27
*** themroc has quit IRC20:39
egustafsonThank you for the reply and information. I have a chunk of free time next week and was looking to see where sending the compose file through 'kompose' (compose->k8s transform) would get me. I've had luck with it in the past (after a few manual adjustments). I'll add myself to the announce mailer and keep an eye out for an official deployment. Thanks again ;)20:50
*** evrardjp has quit IRC20:51
*** evrardjp has joined #zuul20:52
*** pcaruana has quit IRC20:58
*** jeliu_ has quit IRC21:03
*** sshnaidm|afk has quit IRC21:06
*** sshnaidm has joined #zuul21:08
*** sshnaidm is now known as sshnaidm|afk21:09
clarkbegustafson: re 1) yes you'll need ssh keys on the target of ansible ssh connections21:10
clarkbegustafson: the opendev CI system does that by baking in a key for the zuul user at image build time21:11
clarkbfor 2) there are releases on pypi and dockerhub in addition to the latest tags iirc. 3.7.0 was the most recent zuul reealse and 3.9.0 the most recent nodepool reelase21:11
*** mattw4 has quit IRC21:15
*** mattw4 has joined #zuul21:17
*** saneax has quit IRC21:21
*** jamesmcarthur has joined #zuul21:22
SpamapSclarkb:you sure you got those releases right?21:24
clarkbmaybe I flipped them21:24
fungifwiw, i can't find where to list older tags on dockerhub21:24
clarkbya I flipped them21:24
fungilooks like it only goes back 12 days, so all it shows are the branch tip builds21:24
*** jamesmcarthur has quit IRC21:27
egustafsonclarkb: thank you for the reply21:36
corvusclarkb: do we tag releases on dockerhub?  i know someone talked about it, but i don't remember anyone doing it yet22:22
clarkbI thought we did22:24
clarkbbut maybe I'm remembering talking about it and not the doing it22:24
corvusi don't see a post job for it22:24
corvusegustafson: to clarify re 1) the test node in the quickstart does use ssh authentication -- we bind-mount the public key in here: https://opendev.org/zuul/zuul/src/branch/master/doc/source/admin/examples/docker-compose.yaml#L9222:27
*** panda has quit IRC22:52
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: Add base integration roles  https://review.opendev.org/66806122:54
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: Shard project-pipeline config  https://review.opendev.org/66876322:54
corvusthis is fun -- that project config is not shaping up like any i've seen before :)22:55
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: Add base integration roles  https://review.opendev.org/66806122:57
*** panda has joined #zuul22:59
*** mattw4 has quit IRC23:23
egustafsonclarkb: thanks for the info. i see the pub key, in the volume, is from the executor node - got it. for dockerhub, if you happen to line up any release tags, please share. i grabbed a bunch of versions from pip and tried to line up a couple, specifically 3.0.0, and docker pulled failed on that tag.23:49

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!