Friday, 2021-08-20

opendevreviewMerged zuul/zuul master: Several merger cleanups  https://review.opendev.org/c/zuul/zuul/+/80530900:37
opendevreviewMerged zuul/zuul master: Cleanup stale locks in merger/executor API  https://review.opendev.org/c/zuul/zuul/+/80531200:41
opendevreviewIan Wienand proposed zuul/zuul master: web: Nodes: use composable table  https://review.opendev.org/c/zuul/zuul/+/80533806:24
opendevreviewIan Wienand proposed zuul/zuul master: [dnm] expand everything example for TreeView  https://review.opendev.org/c/zuul/zuul/+/80534006:35
*** rpittau|afk is now known as rpittau07:38
*** jpena|off is now known as jpena07:38
opendevreviewSimon Westphahl proposed zuul/zuul master: Fix wrong varible use when updating resource stats  https://review.opendev.org/c/zuul/zuul/+/80536109:39
swestcorvus: ^ small bug we found related to lock/unlock nodes on executor09:56
opendevreviewSorin Sbârnea proposed zuul/zuul-jobs master: Include podman installation with molecule  https://review.opendev.org/c/zuul/zuul-jobs/+/80347111:08
*** dviroel|ruck|out is now known as dviroel|ruck11:26
*** bhagyashris_ is now known as bhagyashris11:31
*** jpena is now known as jpena|lunch11:36
*** jpena|lunch is now known as jpena12:36
* AtitPatel[m] < https://matrix.org/_matrix/media/r0/download/matrix.org/LLXdECjbEBFaSneRmyTHVtJA/message.txt >12:40
* AtitPatel[m] < https://matrix.org/_matrix/media/r0/download/matrix.org/XJQdIAPwnZUjghzorsiUYKEQ/message.txt >12:40
AtitPatel[m]Would someone be able to help me out with finding and fixing the cause please?12:40
* AtitPatel[m] < https://matrix.org/_matrix/media/r0/download/matrix.org/hIEoZGtimDOkakAmqLMJAvSl/message.txt >12:41
tobiash[m]the target ref must be 'refs/for/master' instead of 'refs/changes/03/759003/13'12:43
tobiash[m]@atit12:44
tobiash[m]however it's usually easier to use the git-review tool instead12:44
AtitPatel[m]Dumb alert:12:46
AtitPatel[m]I have never used the tool.12:46
AtitPatel[m]`brew install git-review` I assume?12:46
AtitPatel[m]I think I found the way.12:47
AtitPatel[m]Let me try git-review and I will get back to you in a bit 🙂 Thanks a lot !12:47
tobiash[m]yes, that tool :)12:48
opendevreviewAtit Patel proposed zuul/zuul master: CDEC-27: changes in time out logic, addition of retry to handle slower API responses  https://review.opendev.org/c/zuul/zuul/+/80537812:54
mordredwow. it's in homebrew. TIL12:55
AtitPatel[m]Well, I guess it worked ! tobiash 🙂13:04
AtitPatel[m]Thanks again for your help.13:04
tobiash[m]no problem :)13:05
*** rpittau is now known as rpittau|afk13:55
nirmoyHow does zuul makes sure {{zuul}} variable available in all the hosts/jobs ? I am asking this because I am trying to pass a dict of {'project_name': 'git_hash_of_head'} from a base job to all the final build jobs. I am using set_fact to create the dict in  pre-run job of that base job, for some reason the dict isn't available to the final build job. What am I missing ?14:16
funginirmoy: if you want to pass information between different builds you need to use zuul-return. if you just want to make facts available to later playbooks in the same build then setting the fact as cacheable should accomplish that14:21
funginirmoy: er, sorry, it's zuul_return (underscore not hyphen): https://zuul-ci.org/docs/zuul/reference/jobs.html#return-values14:24
corvustobiash, swest: quick question on 80536114:32
nirmoyfungi: I am trying to make facts available to a later playbook in the same build. What do you mean by cacheable fact?14:36
corvusnirmoy: https://docs.ansible.com/ansible/latest/collections/ansible/builtin/set_fact_module.html#synopsis14:37
funginirmoy: if you set a fact "cacheable" when you define it, the zuul executor will make it available in subsequent playbooks14:37
corvuswell, ansible will do that14:37
fungifair, the ansible running on the executor14:38
nirmoycorvus,fungi: ah great, thanks for your time  :) 14:38
Clark[m]Isn't the git hash of head implicitly available in the git repos zuul sets up?14:43
opendevreviewAtit Patel proposed zuul/zuul master: CDEC-27: changes in time out logic, addition of retry to handle slower API responses  https://review.opendev.org/c/zuul/zuul/+/80539614:43
opendevreviewJames E. Blair proposed zuul/zuul master: Fix wrong varible use when updating resource stats  https://review.opendev.org/c/zuul/zuul/+/80536114:46
corvusswest, tobiash: ^ i didn't see that the test change actually validated the fix, so that's an update to do that.14:46
corvusclarkb: any chance you want to take a quick look at that and maybe we can get one more bugfix in before the restart? :)14:48
opendevreviewAtit Patel proposed zuul/zuul master: Update bitbucketcloudconnection.py  https://review.opendev.org/c/zuul/zuul/+/80539914:48
Clark[m]corvus: yup let me migrate to the office now that I have tea14:49
nirmoyClark[m]: git has of head isn't available for jobs trigger by timer pipeline 14:51
nirmoys/has/hash14:51
clarkbnirmoy: it should be in the actual git repo in the job14:52
corvusnirmoy: https://zuul-ci.org/docs/zuul/reference/jobs.html#git-repositories has some info14:54
nirmoyclarkb: I am  trying to make that available to bunch of timer pipeline jobs so that I don't have to to keep the same code in all the build jobs 14:54
clarkbcorvus: I've approved it14:55
fungithough if it's a lightweight job with no separate remote node, i wonder what options you have to actually read the commit id with playbooks from an untrusted repo (if it's a playbook in a config repo or running on a remote node the repository has been pushed to, you can of course just run git show-ref or similar)14:55
corvusfungi: i'm unsure off the top of my head, but there's a possibility the ansible git module could be used to read that data on the executor14:56
corvusno guarantees; just an avenue to explore14:56
fungiright, i wondered if there might be something in ansible which doesn't rely on a blocked lookup14:57
opendevreviewSorin Sbârnea proposed zuul/zuul-jobs master: Include podman installation with molecule  https://review.opendev.org/c/zuul/zuul-jobs/+/80347114:59
swestcorvus: the stats assertions that you added are fine, but they are not really validating that the autohold executed w/o exception either15:00
swestthe only way to know if the autohold was processed without exception is checking the build.hold flag15:01
corvusswest: yes, but the test already did that15:01
clarkbyup I think the test was previously checking that it ran without exception but not taht the reported data is correct. Now the test does both things15:01
corvusswest: my confusion is that the commit message said (and the actual code change was about) "updating the nodepool resource stats" but we never checked the nodepool resource stats.15:02
swestyeah, but the same stats are also emitted when using the nodeset, so you can't really determine that they came from the autohold loop if I'm not mistaken15:02
swestI was looking for a better way to assert that, but checking the stats isn't enough for that15:03
swestunless I did something completely wrong, which might be entirely possible :)15:04
corvushrm15:05
swestI didn't want to create the impression that those stats are actually validating the autohold stats15:05
swestshould have added a comment 'bout this in the commit message15:06
corvusmaybe we can isolate those resources to the held node15:07
corvusswest: basically, i'm looking for a test that will fail without the code change15:09
corvusswest: if we localize the resources so they only attach to the node for change B, then we should get an emission of 1024, followed by 0.  and without your fix, we only get 1024.15:11
corvusso i think if we check for that we'll have validated it (and that makes sense -- the change was fixing a "leak" in resource counting, so 1024 -> 0 is expected.15:12
corvusi'm working on an update15:14
clarkbdo you want me to remove my +A?15:15
corvusclarkb: let's do this one as a followup15:18
corvusit's not trivial15:18
clarkbok15:18
corvusswest: i'm confused about your assertion that we have to check the build object to know if it was held -- the existing test already checked that nodepool considered it held15:38
zbrclarkb: can you help give a hand with https://review.opendev.org/c/zuul/zuul-jobs/+/803471 ?15:39
opendevreviewJames E. Blair proposed zuul/zuul master: Adjust test_autohold to catch stats errors  https://review.opendev.org/c/zuul/zuul/+/80541615:48
corvusclarkb, swest, tobiash: ^ that fails without swest's code fix15:48
*** jpena is now known as jpena|off15:51
clarkbcorvus: why remove the build.held check? Isn't that a useful state assertion?15:52
corvusclarkb: i think it duplicates the lines that immediately follow15:53
clarkboh I guess we check for the held node after that removed build check15:53
clarkbya15:53
corvuswe could do it, but it's complex to get that object, and it seems to me that verifying that nodepool thinks it's held is the most important and is sufficient15:54
swestcorvus: the held flag on the build wasn't set because if the exception. That's why I used it to verify the fix.15:55
corvusokay, i'll look at adding it back since it tests a code path... but if there was an exception emitting stats, then we're missing an exception handler15:56
corvusi didn't know there was an exception, i just thought the numbers were wrong15:56
corvuson second thought, looking at that code, i think maybe it's okay to leave that exception unhandled15:57
corvusit's not an exception emitting stats, it's an exception maintaining an internal data structure which needs to be kept in sync15:58
opendevreviewSorin Sbârnea proposed zuul/zuul-jobs master: ensure-docker: enable centos-8-stream testing  https://review.opendev.org/c/zuul/zuul-jobs/+/80543216:06
opendevreviewJames E. Blair proposed zuul/zuul master: Adjust test_autohold to catch stats errors  https://review.opendev.org/c/zuul/zuul/+/80541616:07
corvusclarkb, swest: okay that adds back in the .held check16:07
corvusi think it's technically redundant at this point, but it has the capability of detecting more errors than just the stats16:08
corvusso it's belt and suspenders16:08
clarkbcorvus: line 1963 sets hold in queue to False then 1990 does the same. I think 1963 might need to set it to True?16:09
opendevreviewSorin Sbârnea proposed zuul/zuul-jobs master: ensure-podman: enable testing of centos-8-stream  https://review.opendev.org/c/zuul/zuul-jobs/+/80543316:09
corvusclarkb: oh neat, actually i think that means we don't need that line -- holding it in build is sufficient to keep it in the executor api memory16:10
opendevreviewJames E. Blair proposed zuul/zuul master: Adjust test_autohold to catch stats errors  https://review.opendev.org/c/zuul/zuul/+/80541616:11
corvusthat actually addresses most of my objections to complexity :)16:11
pabelanger[m]has anyone ever thought or tried to manage backports via a zuul job?  Was thinking it might be a good pipeline to create, along with job, to have a zuul job open a change / PR based on some trigger17:38
clarkbopendev does automated change pushes for translation and requirements updates. The only real different thing you'd do for backports is change the trigger mechanism17:40
clarkbthe translations and requirements updates are done in a periodic queue, they check for updates once a day and if present push them17:40
clarkbOne thing you need to be careful of is pushing a new patchset every day that will never merge. At least with gerrit it didn't like the 600 something patchset chagne that swift ended up with17:41
pabelanger[m]yah, I wrote a job like that too for when we did the ansible collections migration, but it was local. I figured it would be good to push up into zuul-jobs, document and try to support around it.17:42
*** mgoddard- is now known as mgoddard17:43
fungiif your code review system has a "create backport" mechanism integrated, then it may make more sense to just have a zuul job call that somehow rather than creating and pushing commits17:51
fungieither way, the process is going to be stopped by even the most trivial of merge conflicts, so someone's going to have to monitor it and replace or fix up the backports which can't be cleanly applied17:52
opendevreviewMerged zuul/zuul master: Fix wrong varible use when updating resource stats  https://review.opendev.org/c/zuul/zuul/+/80536117:59
JPEWDo zuul YAML files support templating (e.g. Jinja2)? I have a lot of rinse and repeat jobs I want to make20:35
y2kennyif I don't have a log_url for a job, the job link in the webui status page points to some finger:// path.  Which configuration affect this setup?20:39
corvusJPEW: no, but jobs support inheritance, so the repeating parts should be very small.  yaml anchors are supported.20:40
corvusy2kenny: the status page in the current release should always link to the build page now.20:41
y2kennycorvus: um.. ok... I am kind of behind on my upgrade because the nodepool upgrade requirement.  I need to update my Cobbler nodepool driver.20:43
y2kenny(need to find time to update it)20:43
corvusy2kenny: i think the option was something like 'report-build-page' try searching for that20:44
corvusit's a tenant config file setting20:44
y2kennycorvus: ok will do20:44
y2kennythanks20:44
clarkbAlso, I beleive you can safely update nodpool first without updating zuul20:45
clarkbwhich might simplify things if you don't feel they need to be done all at once20:45
y2kennyclarkb: oh that's good to hear20:46
y2kennyIs there a way to access older version of Zuul's documentation?20:49
y2kennylooks like zuul-ci.org/docs is always pointed to the latest?20:50
clarkbthey are in the zuul git repo history as rst files so fairly readable that way20:50
y2kennyok I will try that20:50
clarkby2kenny: look in the history of doc/source/reference/tenants.rst20:51
clarkband it is report-build-page, corvus  has a good memory20:51
corvusolder versions are publishud under their tags20:52
corvuseg https://zuul-ci.org/docs/zuul/4.8.0/20:52
corvusthose are the links i use in the release announcements20:52
corvuswhich go to zuul-announce@lists.zuul-ci.org  friendly reminder that everyone should subscribe to that :)20:53
y2kennycorvus: ooo... that's good to know20:53
y2kennyI probably should do that too... I think I subscribed to discuss but not announce20:54
y2kennyif the versioned doc can have some link on the doc site that would be great20:54
fungithe z-a archive is also available if you want to catch up: http://lists.zuul-ci.org/pipermail/zuul-announce/20:54
fungivery low-traffic ml20:55
corvusy2kenny: i agree; patches welcome :)20:56
corvusi don't think anyone has figured out an easy way to do it though; i don't think it's trivial20:57
y2kennyThe doc pages is done by Sphinx right?  I thought I have seen that kind of feature in readthedocs20:58
fungigetting it into the sidebar or a heading as a drop-down selector would likely require some theme adjustments20:58
y2kennybut I am not too familiar with the relationship20:58
fungiyeah, it might be that the alabaster theme we're using has an option you just need to turn on, or there might be an extension which does the heavy lifting20:59
corvusand potentially rebuilding old versions to add new ones?20:59
fungihard to say, depending on the implementation maybe20:59
fungior we could just have something which linked you over to the already-built old versions we have21:00
*** dviroel|ruck is now known as dviroel|out22:04
opendevreviewJames E. Blair proposed zuul/zuul master: WIP Update Matrix instructions  https://review.opendev.org/c/zuul/zuul/+/80546722:32
corvusi'm waiting for the changes to opendev to land before i re-do the screenshots, but maybe folks want to take a look at the text?22:33
clarkbthe text seems fine to me22:35
opendevreviewJames E. Blair proposed zuul/zuul-website master: Update website for Matrix  https://review.opendev.org/c/zuul/zuul-website/+/80546922:39
corvusthat one's ready22:40
clarkbI've joined the room. Not sure if I shold but I did >_>22:41
clarkbI wanted to double check ti was there before reviewing and +2ing a change for the website saying it was there :)22:41

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!