Monday, 2019-07-01

*** homeski has joined #zuul00:04
homeskiis it possible to pass Ansible tags to jobs?00:14
*** michael-beaver has quit IRC00:32
*** corvus has quit IRC01:12
*** corvus has joined #zuul01:12
*** bhavikdbavishi has joined #zuul02:53
*** bhavikdbavishi1 has joined #zuul02:56
*** bhavikdbavishi has quit IRC02:58
*** bhavikdbavishi1 is now known as bhavikdbavishi02:58
*** bhavikdbavishi has quit IRC03:10
*** bhavikdbavishi has joined #zuul03:11
*** bhavikdbavishi1 has joined #zuul04:02
*** bhavikdbavishi has quit IRC04:04
*** bhavikdbavishi1 is now known as bhavikdbavishi04:04
*** swest has joined #zuul05:21
*** sshnaidm_ is now known as sshnaidm|ruck05:27
*** snapiri has joined #zuul06:08
*** AJaeger has quit IRC06:11
*** AJaeger has joined #zuul06:13
*** themroc has joined #zuul06:23
*** tosky has joined #zuul07:25
*** gtema_ has joined #zuul07:33
*** pcaruana has joined #zuul07:43
*** gtema_ has quit IRC08:04
*** gtema_ has joined #zuul08:05
*** jangutter has joined #zuul08:11
*** gtema_ has quit IRC08:14
tobiashhomeski: no, that's currently not supported08:42
*** bolg has joined #zuul08:57
*** bolg has quit IRC08:58
*** bolg has joined #zuul08:59
*** bhavikdbavishi has quit IRC09:27
*** bhavikdbavishi has joined #zuul10:36
*** bhavikdbavishi has quit IRC10:38
*** hwangbo has quit IRC10:54
*** bhavikdbavishi has joined #zuul10:57
*** themroc has quit IRC11:18
*** themroc has joined #zuul11:25
*** pcaruana has quit IRC11:36
*** bhavikdbavishi has quit IRC11:37
*** bolg has quit IRC11:40
*** bolg has joined #zuul11:42
*** bhavikdbavishi has joined #zuul11:44
*** gtema_ has joined #zuul11:48
openstackgerritSimon Westphahl proposed zuul/nodepool master: Allow proceeding with requests on quota exceeded  https://review.opendev.org/66737111:51
*** gtema_ has quit IRC12:09
*** rlandy has joined #zuul12:28
*** electrofelix has joined #zuul12:30
*** bhavikdbavishi has quit IRC13:39
openstackgerritMerged zuul/zuul-jobs master: Prepare: Use PDK to build puppet module  https://review.opendev.org/66759013:53
*** bolg has quit IRC13:56
*** swest has quit IRC14:05
*** pcaruana has joined #zuul14:06
openstackgerritMerged zuul/zuul-website master: Change git to opendev.org URLs  https://review.opendev.org/66782014:08
*** jamesmcarthur has joined #zuul14:20
openstackgerritMerged zuul/zuul-jobs master: Use PDK to build puppet module  https://review.opendev.org/62753414:28
openstackgerritMonty Taylor proposed zuul/zuul master: Spec: Add a Kubernetes Operator for Zuul  https://review.opendev.org/65918014:29
openstackgerritMonty Taylor proposed zuul/zuul master: Spec: Add a Kubernetes Operator for Zuul  https://review.opendev.org/65918014:30
mordredcorvus: ^^ new version, and then a rebase patch to deal with merge conflict14:31
corvusmordred: \o/ thanks!14:32
openstackgerritAndreas Jaeger proposed zuul/zuul-jobs master: Test install-pdk-dependencies role  https://review.opendev.org/66833714:40
AJaegercorvus: should I add a job for project-config as well - or wait for your change https://review.opendev.org/668214 etc?14:41
corvusAJaeger: let's add it to p-c for now and move it over once we're running with 66821414:42
AJaegermordred: you might be interested in https://review.opendev.org/668214 and then https://review.opendev.org/#/c/668061/ (not yet ready)14:42
AJaegercorvus: ok, will propose...14:42
*** themroc has quit IRC14:53
*** pcaruana has quit IRC14:56
openstackgerritMonty Taylor proposed zuul/zuul master: Spec: Add a Kubernetes Operator for Zuul  https://review.opendev.org/65918014:58
openstackgerritMonty Taylor proposed zuul/zuul master: Spec: Add a Kubernetes Operator for Zuul  https://review.opendev.org/65918015:01
*** hashar has joined #zuul15:19
*** hashar has quit IRC15:51
*** weshay is now known as weshay_PTO15:52
*** hashar has joined #zuul15:53
*** pcaruana has joined #zuul15:53
homeskiI have a question about provides/requires attributes for jobs16:05
homeskiI tried using them but I don't think I'm understanding how they get applied correctly ...16:05
homeskiI'm trying to achieve the following: https://gist.githubusercontent.com/homeski/18b5d4333fc7e40b602db19fa7476384/raw/900c257524b6e42c69a820039566b01160fed21c/zuul.png16:05
homeskiI want to have several jobs that "require" job-2, so that job-2 only runs once and then any jobs that require it will then run on the same node16:07
*** mattw4 has joined #zuul16:20
*** mattw4 has quit IRC16:25
*** hwangbo has joined #zuul16:29
*** rlandy is now known as rlandy|brb16:30
*** chandankumar is now known as raukadah16:34
ofososHey ho, I'm trying to run a Zuul job on a branch in repo A, but project config in the .zuul.yaml in repo A doesn't seem to match, instead I get a match for the default project config... what could be the reason? Branch protection?16:36
tobiashhomeski: zuul runs each job on a new fresh node.16:40
tobiashofosos: how does your scenario look like?16:42
*** mattw4 has joined #zuul16:43
ofososRepository A had a master branch and my changes live on sth like SYS-226816:45
corvushomeski: you can use provides/requires so that job-2 can store its artifacts somewhere and job-3 can fetch those artifacts.  but keep this in mind -- provides/requires is for connecting jobs across different *changes*. for jobs within a single change, use job dependencies and the zuul_return module to pass information between them.16:45
ofosostobiash: what exactly so you mean by scenario?16:47
tobiashofosos: and the job ran the wrong thing or didn't it run at all?16:47
ofososDidn't run at all, the default job is empty. It's in zuul config16:48
tobiashofosos: is the target branch protected? (assuming you're using github)16:49
ofososNope, I'm using bitbucket. The target branch has no .zuul.yaml16:50
openstackgerritKevin Carter (cloudnull) proposed zuul/zuul-jobs master: Fix docker install on fedora  https://review.opendev.org/66852716:52
corvusofosos: is the only project-pipeline configuration for that project in the .zuul.yaml file on the master branch of that repo?16:53
corvusofosos: https://zuul-ci.org/docs/zuul/user/config.html#configuration-loading and https://zuul-ci.org/docs/zuul/user/config.html#attr-job.branches describe the branch specific behavior and may be helpful17:00
*** hashar has quit IRC17:03
*** mattw4 has quit IRC17:10
*** mattw4 has joined #zuul17:13
corvusfbo: https://src.fedoraproject.org/rpms/python-gear/pull-request/5#_2__15 isn't the right release URL; you should still use tarballs.openstack.org.  later, we'll probably change it to tarballs.opendev.org.  but the tarball "archive" that gitea builds will never be correct; it won't have the right version info -- it's not a release, it's just an archive of the git repo at that point.17:15
corvusfbo: i would have left that as a comment, but i got some error about contributor agreements and gave up17:15
ofososNo there are probably multiple branches in zuul config17:15
clarkbcorvus: fbo: also you can download the sdist from pypi as well17:16
corvusyes, that's probably even better than tarballs.o.o17:16
fbocorvus: clarkb thanks I'll fix17:20
ofososcorvus: So, the change is in an untrusted project and from the docs I would expect that these are included.17:21
ofososcorvus: The job itself is in an untrusted repo B (distinc from repo A and from repo zuul-config), that has a branch spec that reads `^.*$'17:22
ofososThen again I get this:17:24
corvusofosos: the scheduler debug logs should contain logs regarding the decisions zuul made about what jobs to run for a change; it might be good to look at that.  also, when zuul performs a reconfiguration (ie, at startup), it logs the project-pipeline configuration for every project.  that may be useful too.17:24
ofosos2019-07-01T16:31:00.88929381Z 2019-07-01 16:31:00,889 DEBUG zuul.layout: Variant <Job cfn-lint branches: {MatchAny:{BranchMatcher:master}} source: SYS-IC/zuul-common/zuul.yaml@master#14> did not match <Change 0x7efffecfda90 IAC/puppetmaster-bootstrap 11,55ce59d3364af97e4655b017035946a5982b7d72>17:24
ofososHmm, in a untrusted-project, is the `zuul.yaml' read? Or does it need to be named `.zuul.yaml'?17:26
corvusofosos: okay, so on line 14 of zuul-common/zuul.yaml there is some zuul config object with a branch matcher of 'master' -- what is it?17:26
corvusofosos: see https://zuul-ci.org/docs/zuul/user/config.html#configuration-loading for which files are used17:27
ofososhttps://www.irccloud.com/pastebin/SfxAdKOO/17:27
ofososThat is the file.17:28
ofososPardon, it's the snippet at line 1417:28
ofososI'm a little out of luck, why this would not match/branch matcher is `master`17:29
openstackgerritMerged zuul/zuul-jobs master: Fix docker install on fedora  https://review.opendev.org/66852717:29
corvusofosos: that seems in contradiction with the debug log -- are you sure zuul is running with that configuration?  (does a config error show up in the status ui?  do you need to run "zuul full-reconfigure" or restart the scheduler?)17:30
ofososThere's no config error in the UI.17:31
corvusofosos: i'd run a "zuul full-reconfigure" and try again just to make sure it's really using that, because the debug log looks like what i would expect if the "branches: ^.*$" were not present.17:34
*** rlandy|brb is now known as rlandy17:36
*** electrofelix has quit IRC17:38
tobiashcorvus: if you have time, it would be awesome to get a gear release this week to get the server name indication feature. I've also tested it in a test environment and it works nicely :)17:39
corvustobiash: shouldn't be a problem, thanks for the reminder17:39
tobiashthanks :)17:39
*** jamesmcarthur has quit IRC17:47
openstackgerritMerged zuul/zuul-jobs master: Test install-pdk-dependencies role  https://review.opendev.org/66833717:54
homeskicorvus: thanks for the info17:55
homeskiI'll play with dependencies , I think that's where my mind is heading17:56
ofososOk that works, after some testing zuul does not pick up the changes in that to17:59
ofososRepo17:59
ofososBut a full reconfigure does it17:59
*** igordc has joined #zuul18:09
openstackgerritMerged zuul/zuul master: Add extra-config-paths tenant config option  https://review.opendev.org/66821418:09
*** igordc has quit IRC18:14
*** igordc has joined #zuul18:15
*** igordc has quit IRC18:17
*** themroc has joined #zuul18:19
*** gtema_ has joined #zuul18:21
*** jamesmcarthur has joined #zuul18:24
*** gtema_ has quit IRC18:30
corvusofosos: okay, so we may have some work to do in the bitbucket driver; we should make sure there is a unit test for that (change to zuul.yaml in untrusted repo merges and configuration is updated).  this is the bit that's supposed to cause zuul to update its config when a change like that merges: https://opendev.org/zuul/zuul/src/branch/master/zuul/scheduler.py#L1094-L110118:40
hwangboI'm seeing "Job <job> in <repo> is not permitted to shadow job <job> in <other_repo>" as an error, what's the solution to this?18:41
tobiashhwangbo: that depends on what you want to do18:41
tobiashthe error means that you defined the a job twice in different repos18:42
hwangboIf we want to run the same job in multiple repos, how would that look?18:43
openstackgerritGraham Hayes proposed zuul/nodepool master: Implement an Azure driver  https://review.opendev.org/55443218:44
tobiashhwangbo: you only need to define it once, you can just use it in a different repo18:45
AJaegerhwangbo: we have a global namespace - so, whatevery you define in one repo as job, is visible everywhere18:46
*** bolg has joined #zuul18:46
*** bolg has quit IRC18:50
hwangbotobiash AJaeger: So instead of job.run, we would specify it as a job.parent?18:51
hwangboOr would the path just be the path of the playbook in the original repo?18:52
AJaegerhwangbo: if it's exactly the same job, just use it ;)18:54
AJaegerhwangbo: see what we do with openstack-zuul-jobs...18:55
AJaegerhwangbo: I'm not understanding what your problem is so far18:55
ofososcorvus: I thought test_pull_request_with_dyn_reconf in bitbucketfunctional would make sure it is18:56
openstackgerritJames E. Blair proposed zuul/zuul master: Reload config on extra config files changes  https://review.opendev.org/66854818:58
corvusofosos: hrm, let me go look18:59
*** sshnaidm|ruck is now known as sshnaidm|afk18:59
hwangboAJaeger: Sorry, I think I figured it out. Thanks for your help!19:05
corvusofosos: hrm -- test_branch_updated_and_tenant_reconfigure should cover that case, and when i run it locally, it does look it it works.  it might be worth looking at the scheduler logs around the time that the update to add "branches: ^.*$" merged to see what the scheduler saw and why it didn't decide to reconfigure19:06
ofososcorvus: I think I disabled branch polling during debugging19:08
ofososDoh19:08
corvusofosos: doh :)19:08
corvusofosos: that's almost certainly the issue.  but since i already had this prepared -- here are the relevant log lines from the test run about reconfiguration: http://paste.openstack.org/show/753731/19:09
corvusofosos: (so you know what that looks like if there are problems in the future)19:09
openstackgerritJames E. Blair proposed zuul/zuul master: Reload config on extra config files changes  https://review.opendev.org/66854820:00
openstackgerritJames E. Blair proposed zuul/zuul master: Reload config on extra config files changes  https://review.opendev.org/66854820:22
*** themroc has quit IRC20:40
*** pcaruana has quit IRC20:41
*** jamesmcarthur has quit IRC20:45
*** jamesmcarthur has joined #zuul21:03
*** mattw4 has quit IRC21:05
*** mattw4 has joined #zuul21:06
corvusclarkb: can you +3 https://review.opendev.org/668548 ? it's a followup to the extras change we really ought to have in place before we try it out21:11
corvus(but once it merges, we can restart opendev and use it with zuul-jobs)21:12
clarkblooking21:12
clarkbcorvus: should https://review.opendev.org/#/c/668548/3/tests/fixtures/config/tenant-parser/git/org_project2/extra.yaml be removed since it is overridden by the test? or is that there for all the other tests that will end up looking for that config file? That must actually be why it is there too21:17
clarkbya ok21:18
clarkbthe actual file sets one job name, then the test sets another and we check the other was used21:18
clarkbwhich implies we dynamically updated the config properly. I've approved it21:18
corvusclarkb: yep and thx21:18
corvusand yeah, i had to add the run playbook since that job is actually run now (it wasn't before; some tests did check that it was defined, but not that it ran)21:19
*** mattw4 has quit IRC21:25
*** mattw4 has joined #zuul21:25
*** mattw4 has quit IRC21:28
openstackgerritMerged zuul/zuul master: Reload config on extra config files changes  https://review.opendev.org/66854822:00
*** mattw4 has joined #zuul22:03
*** jamesmcarthur has quit IRC22:27
*** jamesmcarthur has joined #zuul22:27
*** jamesmcarthur_ has joined #zuul22:28
*** jamesmcarthur has quit IRC22:32
*** rlandy has quit IRC22:56
*** igordc has joined #zuul23:03
*** jamesmcarthur_ has quit IRC23:05
*** igordc has quit IRC23:05
*** igordc has joined #zuul23:06
*** tosky has quit IRC23:08
*** andreaf has quit IRC23:18
*** armstrongs has joined #zuul23:29
*** andreaf has joined #zuul23:34
*** armstrongs has quit IRC23:39

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!