Tuesday, 2021-11-30

@clarkb:matrix.orgjust trying to figure out how to make pep8 linting ignore some long lines00:07
-@gerrit:opendev.org- Clark Boylan proposed on behalf of Simon Westphahl: [zuul/zuul] 815278: Add nonvoting multischeduler job https://review.opendev.org/c/zuul/zuul/+/81527800:10
@clarkb:matrix.orgThat has been rebased and swapped over to adding a new non voting job. I suspect that is mergeable even though the results may not be very clean yet :)00:10
@jim:acmegating.comClark: oh, except there are some plain "@skip"s in there which would skip the test in the main job00:19
@clarkb:matrix.orgOh they need to be updated to skipifmultischeduler00:20
@clarkb:matrix.orgI can fix that00:20
@jim:acmegating.comalso some felix-brand debug msgs00:20
@jim:acmegating.comClark: maybe it's worth separating the 'add a job' change from felix's WIP?00:21
@clarkb:matrix.orgsure00:21
@clarkb:matrix.orgI actually had it that way locally before I squashed. I wonder if I can just reflog back to the old state00:22
-@gerrit:opendev.org- Clark Boylan proposed on behalf of Simon Westphahl: [zuul/zuul] 815278: DNM: execute tests with two schedulers https://review.opendev.org/c/zuul/zuul/+/81527800:26
-@gerrit:opendev.org- Clark Boylan proposed: [zuul/zuul] 819735: Add nonvoting multischeduler job https://review.opendev.org/c/zuul/zuul/+/81973500:26
@clarkb:matrix.orgcorvus:  ^ reflog made that easy00:26
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 819745: Add a keycloak tutorial https://review.opendev.org/c/zuul/zuul/+/81974502:02
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul] 819727: Don't delete pipeline summary objects if they have a syntax error https://review.opendev.org/c/zuul/zuul/+/81972702:19
-@gerrit:opendev.org- Zuul merged on behalf of Felix Edel: [zuul/zuul] 818862: Only use a single createScheduler() helper method in tests https://review.opendev.org/c/zuul/zuul/+/81886202:19
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul] 819156: Add SOS documentation and remove spec https://review.opendev.org/c/zuul/zuul/+/81915603:48
-@gerrit:opendev.org- Ade Lee proposed on behalf of Jiri Podivin: [zuul/zuul-jobs] 807031: DNM enable_fips role for zuul jobs https://review.opendev.org/c/zuul/zuul-jobs/+/80703106:19
-@gerrit:opendev.org- Ade Lee proposed on behalf of Jiri Podivin: [zuul/zuul-jobs] 807031: DNM enable_fips role for zuul jobs https://review.opendev.org/c/zuul/zuul-jobs/+/80703107:05
-@gerrit:opendev.org- Zuul merged on behalf of Felix Edel:07:36
- [zuul/zuul] 818863: Limit scheduler_count to 1 for Scale out Scheduler tests https://review.opendev.org/c/zuul/zuul/+/818863
- [zuul/zuul] 818864: Limit scheduler_count to 1 for invalid tenant config tests https://review.opendev.org/c/zuul/zuul/+/818864
-@gerrit:opendev.org- Zuul merged on behalf of Felix Edel:07:36
- [zuul/zuul] 818867: Don't use RecordingMergeClient.history in TestNonLiveMerges https://review.opendev.org/c/zuul/zuul/+/818867
- [zuul/zuul] 818868: Combine different history approaches for merge jobs in tests https://review.opendev.org/c/zuul/zuul/+/818868
-@gerrit:opendev.org- Zuul merged on behalf of Felix Edel:07:51
- [zuul/zuul] 819270: Add helper method to allow skipping test cases for multi scheduler https://review.opendev.org/c/zuul/zuul/+/819270
- [zuul/zuul] 819271: Skip gerrit checks API scheme test on multi scheduler https://review.opendev.org/c/zuul/zuul/+/819271
-@gerrit:opendev.org- Zuul merged on behalf of Felix Edel: [zuul/zuul] 819272: Limit scheduler_count to 1 (or skip) for some repo config tests https://review.opendev.org/c/zuul/zuul/+/81927209:29
-@gerrit:opendev.org- Matthieu Huin https://matrix.to/#/@mhuin:matrix.org proposed: [zuul/zuul] 819483: GUI: make change field a substring search in builds, buildsets https://review.opendev.org/c/zuul/zuul/+/81948310:08
@avass:vassast.orgWill there be a new zuul release in the near future? Just checking since we're stuck on `4.10.1` at the moment because of the bwrap capabilities issue :)10:34
@felixedel:matrix.orgcorvus, Clark : I just noticed that the sos test stack now looks much smaller and it seems some of the changes are not included in the stack anymore, e.g. https://review.opendev.org/c/zuul/zuul/+/815787, https://review.opendev.org/c/zuul/zuul/+/818054/7 and https://review.opendev.org/c/zuul/zuul/+/818203/7. They are still approved though, but gate was failing. So we should still be able to merge those.12:05
-@gerrit:opendev.org- Ade Lee proposed on behalf of Jiri Podivin: [zuul/zuul-jobs] 807031: DNM enable_fips role for zuul jobs https://review.opendev.org/c/zuul/zuul-jobs/+/80703114:49
@caiquemello:matrix.orghi guys, can someone help me? I have added a galaxy collection in a role to perform some tasks, but I`m facing some issues trying to run the playbook that contain the role in a remote node. Apparently, the module can`t be found in the node.15:07
What I have to do in order to run the gallaxy modulo in a remote node, since job.roles.galaxy are not yet implemented according to the documentation. https://zuul-ci.org/docs/zuul/reference/job_def.html#attr-job.roles.galaxy
@caiquemello:matrix.org * hi guys, can someone help me? I have added a galaxy collection in a role to perform some tasks, but Im facing some issues trying to run the playbook that contain the role in a remote node. Apparently, the module cant be found in the node.15:07
What I have to do in order to run the gallaxy modulo in a remote node, since job.roles.galaxy are not yet implemented according to the documentation. https://zuul-ci.org/docs/zuul/reference/job_def.html#attr-job.roles.galaxy
@jpew:matrix.orgDoes anyone have an example of zuul "updating" a repository (e.g. making changes and pushing them back to the repo)? Something like automatically updating to the latest upstream versions in a python environment (not exactly what I'm doing, but close enough)15:30
@spamaps:spamaps.ems.host> <@jpew:matrix.org> Does anyone have an example of zuul "updating" a repository (e.g. making changes and pushing them back to the repo)? Something like automatically updating to the latest upstream versions in a python environment (not exactly what I'm doing, but close enough)16:02
I tried that in a past life. There should be no problem with it as something one does on a timer. But if you want, like, the check pipeline to push changes back into the PR... that could get a little circular.
@jpew:matrix.orgNo, this would be on a timer16:03
@spamaps:spamaps.ems.hostI could definitely also see a post merge pipeline that goes and opens PRs to roll out version bumps.16:03
@clarkb:matrix.org> <@caiquemello:matrix.org> hi guys, can someone help me? I have added a galaxy collection in a role to perform some tasks, but Im facing some issues trying to run the playbook that contain the role in a remote node. Apparently, the module cant be found in the node.16:03
> What I have to do in order to run the gallaxy modulo in a remote node, since job.roles.galaxy are not yet implemented according to the documentation. https://zuul-ci.org/docs/zuul/reference/job_def.html#attr-job.roles.galaxy
I think the typical suggestion is that you can run a nested ansible inside of the job rather than rely on the Zuul ansible to do it for you.
@clarkb:matrix.orgjpew: spamaps some openstack jobs push things back to update dependencies and translations. They are pushed to review and not directly to the git repo branch HEADs but the process is very similar16:04
@clarkb:matrix.orglet me see if I can find an example16:04
@spamaps:spamaps.ems.host> <@clarkb:matrix.org> jpew: spamaps some openstack jobs push things back to update dependencies and translations. They are pushed to review and not directly to the git repo branch HEADs but the process is very similar16:04
I was wondering if that would cause job cancels.
@clarkb:matrix.orgthe updates are done in periodic queues and update changes external to the running event so its fine16:05
@jpew:matrix.orgYa, that's basically what I want. The timer should just update the dependencies, and it needs to gate as normal to validate it's correct16:05
@clarkb:matrix.orgah cool then that is almost exactly what the requirements updates do. Let me see if I can find those jobs for you16:06
@clarkb:matrix.orgjpew: https://opendev.org/openstack/project-config/src/branch/master/zuul.d/jobs.yaml#L822-L844 that is the job definitions. Playbooks are in https://opendev.org/openstack/project-config/src/branch/master/playbooks/proposal16:08
@jpew:matrix.orgCool, thanks16:09
@clarkb:matrix.orgLooks like it ultimately runs a script that I'm trying to hunt down16:10
@clarkb:matrix.orgoh you know I wonder if those jobs aren't quite it either as I think we stopped syncing the updates to the individual projects. But we do sync them to the main requirements repo16:11
@clarkb:matrix.orgbut the shape of the thing should be there16:11
@clarkb:matrix.orgI think https://opendev.org/openstack/project-config/src/branch/master/playbooks/proposal/pre.yaml#L45-L47 end up getting the scripts in the right place. Anyway hopefully that gives useful hints16:12
@clarkb:matrix.orgcorvus: did you want to look into why prior rebasing abandoned https://review.opendev.org/c/zuul/zuul/+/815787 and children before approving them? I think its fine for those changes to go in even though rebasing appears to have forked the stacks16:16
@jim:acmegating.comClark: yep just getting started on that now16:16
@jim:acmegating.comi don't know how they got separated, but i think it makes sense to merge those 3 first; i'll recheck them first then the others16:25
@jim:acmegating.comactually, first i'm going to look into this failure: https://zuul.opendev.org/t/zuul/build/39f5246409544431870a07db1addd6c7/artifacts which is a brand new test16:27
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 819745: Add a keycloak tutorial https://review.opendev.org/c/zuul/zuul/+/81974516:27
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 819745: Add a keycloak tutorial https://review.opendev.org/c/zuul/zuul/+/81974516:29
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 819745: Add a keycloak tutorial https://review.opendev.org/c/zuul/zuul/+/81974516:31
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed on behalf of Simon Westphahl: [zuul/zuul] 815787: Refresh pipelines in tests when settled https://review.opendev.org/c/zuul/zuul/+/81578716:47
@jim:acmegating.comClark: can you look at my comment and new patchset there ^  cc felixedel 16:49
@clarkb:matrix.orgyup16:50
@jim:acmegating.comoh, hrm, now that i'm self-reviewing that, i think there are maybe some other places i should make the same change?16:51
@clarkb:matrix.orgThe change itself makes sense as you mention there are a few places where we dynamically add additional schedulers so the count value isn't accurate enough16:52
@clarkb:matrix.orgI guess you can grep for comparisons of scheduler_count and check if they may be evaluated after an explicit second scheduler is added?16:53
@jim:acmegating.comlooks like 2 places, and i changed 116:53
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed on behalf of Simon Westphahl: [zuul/zuul] 815787: Refresh pipelines in tests when settled https://review.opendev.org/c/zuul/zuul/+/81578716:54
@jim:acmegating.comokay, got both now16:54
@jim:acmegating.comrebasing the rest16:58
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed on behalf of Felix Edel:16:58
- [zuul/zuul] 818054: Make TestWeb.test_web_components work with multiple schedulers https://review.opendev.org/c/zuul/zuul/+/818054
- [zuul/zuul] 818203: Execute Github tests with only one scheduler https://review.opendev.org/c/zuul/zuul/+/818203
- [zuul/zuul] 819313: Skip TestGitlabDriver.test_ref_update on multi scheduler https://review.opendev.org/c/zuul/zuul/+/819313
- [zuul/zuul] 818205: Add source attribute to GitConnection https://review.opendev.org/c/zuul/zuul/+/818205
- [zuul/zuul] 819407: Limit scheduler count to 1 for other github related tests https://review.opendev.org/c/zuul/zuul/+/819407
- [zuul/zuul] 819606: Limit scheduler count to 1 for Elasticsearch connection tests https://review.opendev.org/c/zuul/zuul/+/819606
- [zuul/zuul] 819609: Copy project list in gitwatcher for iteration https://review.opendev.org/c/zuul/zuul/+/819609
- [zuul/zuul] 819408: Skip tests asserting on tenant reconfig results on multi scheduler https://review.opendev.org/c/zuul/zuul/+/819408
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed on behalf of Clark Boylan: [zuul/zuul] 819735: Add nonvoting multischeduler job https://review.opendev.org/c/zuul/zuul/+/81973516:58
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed on behalf of Simon Westphahl: [zuul/zuul] 815278: DNM: execute tests with two schedulers https://review.opendev.org/c/zuul/zuul/+/81527816:58
@fungicide:matrix.orgjpew spamaps Clark : Also, OpenStack's release management jobs include an example of pushing directly, though for tags rather than commits, but the mechanism would be similar17:06
@jpew:matrix.orgHmm, I feel like it's going to be cantankerous to get my github app to push to a branch17:12
@fungicide:matrix.orghttps://opendev.org/openstack/project-config/src/branch/master/roles/copy-release-tools-scripts/files/release-tools/release.sh17:12
@fungicide:matrix.orgbut yes, most of the time i would opt for proposing a change for a human to review rather than directly pushing something17:13
@jpew:matrix.orgSure; Ideally it would push to a branch and open a PR for it.....17:13
@fungicide:matrix.orgthe only reason openstack's tag-pushing automation even exists is to make the tags themselves reviewable by humans17:14
@fungicide:matrix.org(human proposes to create a tag, other humans review the proposal, metadata change about the requested tag merges, zuul job creates and pushes the tag)17:14
@jim:acmegating.comzuul-maint: https://review.opendev.org/802976 and https://review.opendev.org/802977 are some housekeeping changes it would be good to merge soon :)17:50
@fungicide:matrix.orgreviewed and approved both just now17:53
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul-website] 802977: Remove success-url https://review.opendev.org/c/zuul/zuul-website/+/80297717:59
-@gerrit:opendev.org- Zuul merged on behalf of Simon Westphahl: [zuul/zuul] 815787: Refresh pipelines in tests when settled https://review.opendev.org/c/zuul/zuul/+/81578718:07
-@gerrit:opendev.org- Zuul merged on behalf of Felix Edel: [zuul/zuul] 818054: Make TestWeb.test_web_components work with multiple schedulers https://review.opendev.org/c/zuul/zuul/+/81805418:07
-@gerrit:opendev.org- Zuul merged on behalf of Felix Edel: [zuul/zuul] 818203: Execute Github tests with only one scheduler https://review.opendev.org/c/zuul/zuul/+/81820318:08
-@gerrit:opendev.org- Zuul merged on behalf of Felix Edel: [zuul/zuul] 819313: Skip TestGitlabDriver.test_ref_update on multi scheduler https://review.opendev.org/c/zuul/zuul/+/81931318:08
-@gerrit:opendev.org- Zuul merged on behalf of Felix Edel:18:09
- [zuul/zuul] 818205: Add source attribute to GitConnection https://review.opendev.org/c/zuul/zuul/+/818205
- [zuul/zuul] 819407: Limit scheduler count to 1 for other github related tests https://review.opendev.org/c/zuul/zuul/+/819407
@clarkb:matrix.org> <@avass:vassast.org> Will there be a new zuul release in the near future? Just checking since we're stuck on `4.10.1` at the moment because of the bwrap capabilities issue :)18:17
I'd defer to corvus on this but I think the opendev installation has been quite stable despite some issues that have since been fixed. I suspect we should try to do an opendev restart soon, then if that is happy for a day or two cut a release at the end of this week or first thing next week?
@clarkb:matrix.orghttps://review.opendev.org/c/zuul/zuul/+/819606 failed in the gate and seems to be due to a thread leak when we check if there are extra threads running at the end of tests18:21
@clarkb:matrix.orgI'm in meetings for the next bit so can't really dig in yet but flagging if others want to look18:21
@jim:acmegating.comAlbin Vass: Clark oh sorry; yeah i think we're probably close to 4.11 and then 5.0.   both will be disruptive (will need 'zuul delete-state' run).  i'll work on a plan in just a little bit.19:07
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul] 802976: Remove success-url and failure-url https://review.opendev.org/c/zuul/zuul/+/80297619:34
-@gerrit:opendev.org- Zuul merged on behalf of Felix Edel:21:01
- [zuul/zuul] 819606: Limit scheduler count to 1 for Elasticsearch connection tests https://review.opendev.org/c/zuul/zuul/+/819606
- [zuul/zuul] 819609: Copy project list in gitwatcher for iteration https://review.opendev.org/c/zuul/zuul/+/819609
@clarkb:matrix.orgcorvus: left some thoughts on https://review.opendev.org/c/zuul/zuul/+/812410 mostly around improving the docs a bit more21:17
@clarkb:matrix.orgI'm happy to do that in a followup if you want to approve it as is21:17
@jim:acmegating.comthanks!21:17
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 812410: Add `playbook_context` zuul variable https://review.opendev.org/c/zuul/zuul/+/81241021:34
@jim:acmegating.comClark: ^ updated21:34
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul] 815207: Document (and warn about) tag job role checkouts https://review.opendev.org/c/zuul/zuul/+/81520721:36
@clarkb:matrix.orgoh huh I thought we were doing conflict management across different playbooks or something21:38
@clarkb:matrix.orgbut ya the key bit is we always stick the symlink name into role_path21:38
@clarkb:matrix.orgso that is what ansible actually "sees"21:38
@jim:acmegating.comyep21:42
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul] 812410: Add `playbook_context` zuul variable https://review.opendev.org/c/zuul/zuul/+/81241023:17

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!