Wednesday, 2020-07-15

*** harrymichal has quit IRC00:09
*** jamesmcarthur has quit IRC00:11
*** jamesmcarthur has joined #zuul00:22
*** saneax has quit IRC00:42
*** rlandy|ruck has quit IRC00:46
*** jamesmcarthur has quit IRC01:03
*** jamesmcarthur has joined #zuul01:05
*** jamesmcarthur has quit IRC01:30
*** Goneri has quit IRC01:43
*** jamesmcarthur has joined #zuul01:51
*** sgw1 has quit IRC02:23
openstackgerritPaul Belanger proposed zuul/zuul master: Round width of change progress bar to 2 decimals  https://review.opendev.org/74107302:38
*** jamesmcarthur has quit IRC02:43
*** jamesmcarthur has joined #zuul02:43
*** jamesmcarthur has quit IRC02:47
*** sgw1 has joined #zuul02:54
*** bhavikdbavishi has joined #zuul03:04
*** bhavikdbavishi1 has joined #zuul03:11
*** bhavikdbavishi has quit IRC03:12
*** bhavikdbavishi1 is now known as bhavikdbavishi03:12
*** rfolco has quit IRC03:14
*** harrymichal has joined #zuul03:16
*** jamesmcarthur has joined #zuul03:43
*** jamesmcarthur has quit IRC03:45
*** jamesmcarthur_ has joined #zuul03:45
*** rfolco has joined #zuul03:52
*** rfolco has quit IRC03:56
*** sgw1 has quit IRC04:04
*** sgw1 has joined #zuul04:06
*** bhavikdbavishi has quit IRC04:30
*** harrymichal has quit IRC04:30
*** bhavikdbavishi has joined #zuul04:31
*** harrymichal has joined #zuul04:31
*** ysandeep|away is now known as ysandeep|rover04:32
*** evrardjp has quit IRC04:33
*** evrardjp has joined #zuul04:33
*** sgw1 has quit IRC04:48
*** vishalmanchanda has joined #zuul04:50
*** sgw1 has joined #zuul04:52
*** marios has joined #zuul05:31
openstackgerritIan Wienand proposed zuul/zuul master: Add a more conversational overview to README.rst  https://review.opendev.org/68308505:48
*** saneax has joined #zuul05:50
*** jamesmcarthur_ has quit IRC05:57
*** bhavikdbavishi has quit IRC05:59
openstackgerritIan Wienand proposed zuul/zuul master: Add a more conversational overview of Zuul concepts  https://review.opendev.org/68308506:01
*** bhavikdbavishi has joined #zuul06:16
*** bhavikdbavishi1 has joined #zuul06:21
*** bhavikdbavishi has quit IRC06:23
*** bhavikdbavishi1 is now known as bhavikdbavishi06:23
*** zbr|ruck has quit IRC07:02
*** zbr|ruck has joined #zuul07:03
*** holser has joined #zuul07:04
*** jcapitao has joined #zuul07:04
*** zbr has quit IRC07:06
*** bhavikdbavishi has quit IRC07:11
openstackgerritFelix Edel proposed zuul/zuul master: PF4: Update buildset result page (new layout and styling)  https://review.opendev.org/73801107:20
openstackgerritFelix Edel proposed zuul/zuul master: Consolidate summary, logs and console on a single build page  https://review.opendev.org/74062907:20
openstackgerritFelix Edel proposed zuul/zuul master: PF4: Update build result page layout  https://review.opendev.org/73997207:20
openstackgerritFelix Edel proposed zuul/zuul master: Fix fetching function on build result page  https://review.opendev.org/74110307:20
felixedelcorvus: I've updated my PF4 changes. I think you will like the new version ;-)07:20
*** bhavikdbavishi has joined #zuul07:39
*** zbr has joined #zuul07:41
*** tosky has joined #zuul07:46
*** ysandeep|rover has left #zuul08:08
*** nils has joined #zuul08:08
*** dmsimard has quit IRC08:25
*** dmsimard has joined #zuul08:26
*** harrymichal has quit IRC08:40
*** bhavikdbavishi has quit IRC08:42
*** bhagyashris is now known as bhagyashris|lunc08:43
*** harrymichal has joined #zuul09:03
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Deprecate default tox_envlist: venv  https://review.opendev.org/72683009:32
openstackgerritBenoît Bayszczak proposed zuul/nodepool master: [provider][aws] now performs a multi-describe at once  https://review.opendev.org/74032809:38
avassmnaser: vexxhost seem to be throwing node failures: https://review.opendev.org/#/c/726830/09:47
*** bhavikdbavishi has joined #zuul10:01
*** bhavikdbavishi1 has joined #zuul10:06
*** bhavikdbavishi has quit IRC10:08
*** bhavikdbavishi1 is now known as bhavikdbavishi10:08
*** sshnaidm is now known as sshnaidm|afk10:24
*** bhagyashris|lunc is now known as bhagyashris10:37
*** harrymichal has quit IRC10:55
*** harrymichal has joined #zuul10:56
*** tosky has quit IRC11:05
*** bhavikdbavishi has quit IRC11:07
*** jcapitao is now known as jcapitao_lunch11:09
*** tosky has joined #zuul11:10
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Deprecate default tox_envlist: venv  https://review.opendev.org/72683011:11
openstackgerritBenjamin Schanzel proposed zuul/zuul master: GitHub Reporter: Fix User Email in Merge Commit Message  https://review.opendev.org/74115711:13
*** saneax has quit IRC11:13
*** saneax has joined #zuul11:14
*** wuchunyang has joined #zuul11:22
*** bhavikdbavishi has joined #zuul11:24
*** wuchunyang has quit IRC11:44
*** bhavikdbavishi has quit IRC11:56
*** rfolco has joined #zuul11:56
*** rlandy has joined #zuul11:57
*** rlandy is now known as rlandy|ruck11:58
*** saneax has quit IRC12:00
*** saneax has joined #zuul12:01
*** bhavikdbavishi has joined #zuul12:10
*** marios has quit IRC12:14
*** jcapitao_lunch is now known as jcapitao12:27
openstackgerritMerged zuul/zuul-registry master: Prioritize returning manifest lists  https://review.opendev.org/74106212:27
mnaseravass: thanks for the warning.12:29
mnaserWell check12:29
openstackgerritSimon Westphahl proposed zuul/nodepool master: Remove default qcow2 format in diskimage config  https://review.opendev.org/74116612:30
openstackgerritSimon Westphahl proposed zuul/nodepool master: Remove default qcow2 format in diskimage config  https://review.opendev.org/74116612:31
bschanzelbschanzel12:32
*** newbie2020 has joined #zuul12:45
newbie2020Hi,I am using Zuul with GitHub.As suggested by the documentation and by you in the past,exclude-unprotected-branches is set to true to exclude"feature branches" used for the typical GitHub PR scenario.That works very well.However the Zuul jobs get triggered for any "target" branchregardless of the GitHub protection settings.Is that expected?E.g. 1.12:49
newbie2020I have a branch 'stable-branch' (not protected in the GitHub settings)2. I create a PR from a branch 'pr-branch' against 'stable-branch'3. The Zuul jobs for that project are triggeredThank you for any help or clarification you may provide12:49
newbie2020sorry for the indentation12:49
newbie2020Hi,I am using Zuul with GitHub.As suggested by the documentation and by you in the past,exclude-unprotected-branches is set to true to exclude"feature branches" used for the typical GitHub PR scenario.12:49
newbie2020That works very well.However the Zuul jobs get triggered for any "target" branchregardless of the GitHub protection settings.12:50
newbie2020Is that expected?12:50
newbie2020E.g. 1. I have a branch 'stable-branch' (not protected in the GitHub settings)12:50
newbie20202. I create a PR from a branch 'pr-branch' against 'stable-branch'12:50
newbie20203. The Zuul jobs for that project are triggered12:50
newbie2020Thank you for any help or clarification you may provide12:50
*** sshnaidm|afk is now known as sshnaidm12:53
tobiashnewbie2020: exclude-unprotected-branches only excludes loading config from there, if you attach jobs from a config project you might still be able to run jobs on arbitrary branches12:54
*** marios has joined #zuul12:56
newbie2020thanks! That matches the observed behaviour12:57
*** saneax has quit IRC12:59
*** wuchunyang has joined #zuul13:02
*** bhavikdbavishi has quit IRC13:03
*** wuchunyang has quit IRC13:06
guilhermespavass: we have found the issue with NODE_FAILURE issues. I will let you know when we have a fix asap13:09
openstackgerritTobias Henkel proposed zuul/zuul master: Fix executor stats with zoned executors  https://review.opendev.org/74044813:15
*** rlandy|ruck is now known as rlandy|ruck|mtg13:17
openstackgerritFabien Boucher proposed zuul/zuul master: Remove shebang for base/library/command.py|zuul_console.py  https://review.opendev.org/72895513:17
guilhermespavass: just rechecked https://review.opendev.org/#/c/726830/2613:22
*** bhavikdbavishi has joined #zuul13:24
*** piotrowskim has joined #zuul13:28
*** wuchunyang has joined #zuul13:41
*** bhavikdbavishi has quit IRC13:54
*** bhavikdbavishi has joined #zuul13:54
*** bhavikdbavishi has quit IRC14:06
*** Goneri has joined #zuul14:11
openstackgerritTobias Henkel proposed zuul/zuul master: Join command thread on exit  https://review.opendev.org/73983815:17
*** rlandy|ruck|mtg is now known as rlandy|ruck15:26
*** hamalq has joined #zuul15:31
*** hamalq_ has joined #zuul15:34
corvusclarkb: ^ i'm going to infer a +2 from you on 739838 (join command thread) and +3 it now15:36
*** hamalq has quit IRC15:38
openstackgerritGonéri Le Bouder proposed zuul/zuul master: zuul_stream: avoid exception in _log_streamline  https://review.opendev.org/74125715:44
clarkbcorvus: I've +2'd it now too15:48
AJaegercorvus: ianw updated the upload-afs description, want to review that one? https://review.opendev.org/#/c/741051/15:53
*** jcapitao has quit IRC15:54
corvusAJaeger: done thx15:54
*** newbie2020 has quit IRC15:54
avassguilhermesp: thanks!16:00
*** marios is now known as marios|out16:00
*** marios|out has quit IRC16:03
openstackgerritMerged zuul/zuul-jobs master: upload-afs-synchronize: expand documentation  https://review.opendev.org/74105116:07
*** bhavikdbavishi has joined #zuul16:16
mordredcorvus: unrelated to anything (other than I just noticed the patches and keep forgetting to mention them) ...16:16
mordredcorvus: a while ago I wrote https://review.opendev.org/#/c/729066/ and https://review.opendev.org/#/c/729428/16:16
mordredyou may or may not enjoy them16:16
openstackgerritMonty Taylor proposed zuul/zuul-jobs master: Add a job for publishing a site to netlify  https://review.opendev.org/73904716:18
corvusmordred: cool16:19
corvusmordred: re 726477 podmad build -- do you have any idea if that would work in k8s?  (ie, the binfmt thing seems maybe problematic, but i haven't looked into it, have you?)16:22
*** vblando has joined #zuul16:23
mordredcorvus: it should work in k8s in general - but the binfmt thing would need to be run on each k8s node16:23
mordred(it doesn't have to be run via container - that's just a convenient way to do it)16:23
mordredthe binfmt thing is basically just registering handlers with binfmt_misc on the host16:24
corvusyeah, so it's probably not going to be practical for most folks :/16:24
mordredcorvus: yeah. unless there's a way to tell k8s to run a Task on every node16:25
mordredmnaser: ^^ you know crazy k8s tricks - any thoughts?16:25
corvuswhat's a Task?16:25
mordredcorvus: oh - well, you know what you could do ...16:25
mnaserdo you have to execute something on the host, or copy some files?16:26
mordred(sorry,  Imeant Job I think)16:26
corvus(i know you can run a pod on every node)16:26
mordredcorvus: but - actually - you don't need to do it on all the nodes16:26
mnaserif you're already running a pod on every node (i.e. DaemonSet) then you can use `initContainers` on that same daemonset to copy/run/do whatever you want on the host for example16:26
mordredyou only need to do it on the same host as nodepool-builder16:26
mordredso you could make the binfmt thing an init container for the nodepool-builder pod16:26
mnaser^^^16:26
mordredmnaser: yeah. that16:27
mnaseror that, so it will always run for that specific hosts16:27
mordredand I'm pretty sure dib already means nodepool-builder has to be run as a privileged pod anyway16:27
mnaserinitContainer is largely the mechanism of 'do things on host' in k8s16:27
corvuscool, that sounds plausible :)16:27
mordredso if you're running dib in k8s in a nodepool-builder pod, the init container should be fairly easy16:27
corvusmordred: i left a minor comment about a comment16:27
mnaserwe have a zuul-helm to test that out ;p16:28
mordredspeaking of zuul-helm ... I keep thinking we need to get that updated to use tls16:28
corvusmordred: (mostly just thinking i don't want folks seeing that file and thinking they need to go install it or something)16:28
mordredcorvus: ++16:28
mnaseryeah, we should.. i think zuul-helm doesn't actually deploy zookeeper, relies on an externally deployed one, but i dont think there's option to feed in the certs and what not16:29
corvusspeaking of which: woo! new kazoo is out! https://github.com/python-zk/kazoo/issues/621   cc tobiash16:29
mordredcorvus: what do you think about:16:30
mordred# This file exists in support of using nested-podman in16:30
mordred# the nodepool-builder container image16:30
corvusso next up for us is: upgrade opendev with that, try switching opendev to tls again, when that works, issue a new 3.x release with it16:30
*** wuchunyang has quit IRC16:30
corvusmordred: yeah, and you know, it might be good to add something to the docs about this, and maybe link there in the comment?16:31
corvusmordred: cause right now, the only doc is a comment in the dockerfile16:31
mordredhrm. that would require coherent thinking16:31
corvusmordred: we have high standards :)16:32
openstackgerritMerged zuul/zuul master: Join command thread on exit  https://review.opendev.org/73983816:32
mordredhah. the matrix client interprets markdown - so those lines with leading # were rendered as H1 for me :)16:32
corvus# I'm going to use that.16:32
mordredcorvus: too bad - it doesn't seem to interpret the plaintext coming from the IRC bridge16:33
corvus> Sure16:33
openstackgerritJames E. Blair proposed zuul/zuul master: Require kazoo 2.8.0  https://review.opendev.org/74127016:34
corvusclarkb, tobiash: ^16:35
tobiash:)16:57
*** bhavikdbavishi1 has joined #zuul17:00
mordredcorvus: oh fascinating. something has changed with that zuul-preview change since I wrote it17:00
*** bhavikdbavishi has quit IRC17:01
*** bhavikdbavishi1 is now known as bhavikdbavishi17:01
openstackgerritMonty Taylor proposed zuul/zuul-preview master: Simplify build  https://review.opendev.org/72906617:03
openstackgerritMonty Taylor proposed zuul/zuul-preview master: Bump to c++17 and switch boost::optional to std::optional  https://review.opendev.org/72942817:03
mordredcorvus, tristanC: ^^ had to bump boost version17:03
openstackgerritGonéri Le Bouder proposed zuul/zuul master: zuul_stream: avoid exception in _log_streamline  https://review.opendev.org/74125717:05
*** armstrongs has joined #zuul17:09
openstackgerritMerged zuul/zuul master: Require kazoo 2.8.0  https://review.opendev.org/74127017:29
*** jamesmcarthur has joined #zuul17:36
*** jamesmcarthur has quit IRC18:02
*** jamesmcarthur has joined #zuul18:03
*** nils has quit IRC18:04
clarkbmordred: I've always found it funny that -Wall isn't all18:04
openstackgerritMerged zuul/zuul master: Round width of change progress bar to 2 decimals  https://review.opendev.org/74107318:07
*** jamesmcarthur has quit IRC18:07
clarkbmordred: see comment on https://review.opendev.org/#/c/729428/18:10
*** jamesmcarthur has joined #zuul18:17
*** vishalmanchanda has quit IRC18:20
openstackgerritMerged zuul/zuul-preview master: Simplify build  https://review.opendev.org/72906618:22
*** tosky has quit IRC18:25
*** tosky has joined #zuul18:25
mordredclarkb: I think we can't - I think they're deps of libcpprest - but now that I say that I think the debian packages should take care of the transitive deps - lemme double check18:26
mordred(like, I remember trying and it failing but I forget why)18:26
*** harrymichal has quit IRC18:27
*** harrymichal has joined #zuul18:27
mordredclarkb: hrm. removing it from runtime seemed to work. lemme see if I can remove the build dep too18:30
openstackgerritMonty Taylor proposed zuul/zuul-preview master: Remove libboost-system depends  https://review.opendev.org/74130218:34
mordredclarkb: ^^ that works18:35
clarkbcool +2 on that one and +3 on the parent18:35
mordredyay for simplifying18:36
openstackgerritMerged zuul/zuul-preview master: Bump to c++17 and switch boost::optional to std::optional  https://review.opendev.org/72942818:48
*** bhavikdbavishi has quit IRC19:01
*** bhavikdbavishi1 has joined #zuul19:01
*** bhavikdbavishi1 is now known as bhavikdbavishi19:03
openstackgerritMerged zuul/zuul-preview master: Remove libboost-system depends  https://review.opendev.org/74130219:11
*** harrymichal has quit IRC19:20
*** wuchunyang has joined #zuul19:20
*** wuchunyang has quit IRC19:45
*** wuchunyang has joined #zuul19:51
*** bhavikdbavishi has quit IRC19:58
tobiashcorvus: do you want to gather more feedback on the buildset result page (738011) or should we merge it?20:12
tobiashzuul-maint: it would be great to get reviews on some fixes around job pause and skipping: https://review.opendev.org/#/q/status:open+project:zuul/zuul+branch:master+topic:buildset-fixes20:18
clarkbtobiash: I'll take a look20:29
tobiashthanks :)20:29
clarkbtobiash: I guess the issue with pausing on a failed playbook is you want to fail early rather than have subsequent jobs start and fail too?20:32
tobiashclarkb: normally child jobs only run after a successful parent. In case of a paused job that is already failing I think we should stick to the same behavior20:33
clarkbya I'm currently trying to brainstorm if I can come up with a valid reason to pause and start jobs after a failure and so far have no good examples20:34
clarkbwhich makes me think you are right20:34
tobiashfurther many child jobs depend on results of the parent and fail in weird and hard to debug ways (which is how we found that)20:34
clarkbyup this is a good optimization for those cases20:35
clarkbmakes the error clear and fails more quickly20:35
*** wuchunyang has quit IRC20:37
corvustobiash: i think we can merge that and iterate in-tree; i doubt there are significant usability issues we need to collect more feedback on20:42
clarkbI've already approved it fwiw20:42
clarkbthe next chagne in the stack has my brain melting a bit20:43
corvusoh sorry, i was talking about the buildset result page20:43
*** wuchunyang has joined #zuul20:44
clarkbah20:44
*** jamesmcarthur_ has joined #zuul20:45
*** hamalq_ has quit IRC20:46
*** jamesmcarthur has quit IRC20:48
*** hamalq has joined #zuul20:48
openstackgerritJames E. Blair proposed zuul/nodepool master: Require kazoo 2.8.0  https://review.opendev.org/74131520:49
clarkbcorvus: tobiash what I don't undersatnd in https://review.opendev.org/#/c/739511/2/zuul/manager/__init__.py is we should only update the status if we cancel the job directly and if we do that the build isn't in the buildset which means there won;t be anything to reset later?20:50
clarkbI feel like I'm missing something fundamental there20:50
corvusclarkb: i don't think 739511 deals with canceled builds, but rather skipped ones20:51
*** hamalq has quit IRC20:52
*** hamalq has joined #zuul20:52
clarkbbut the only state change in _resetDependentBuilds is to cancel it (in the old code)20:52
clarkbI think the magic is happenign in setResult now that i look closer20:52
clarkbsetResult makes its own job graph so it isn't dependnet on the data that is in build_set which may have had entries removed20:53
tobiashit also set the result to none20:53
clarkbit will create fake builds in setResult if necessary20:53
corvus(the cancel code path isn't going to hit here because of the previous skip)20:53
tobiashAnd this is the problem in case there were skipped builds in a multi parent scenario20:53
corvus(the cancel will noop)20:53
clarkbtobiash: where does the result get set to None?20:54
clarkbalso the check is if build.result which would fail if it is None?20:54
corvusmaybe that's 1004 with removebuild?20:54
tobiashThats what this function is supposed to do (so they can run again)20:54
tobiashyes it's removebuild20:55
clarkbreading removeBuild it just removes the build from the dict20:55
clarkbI think that is why I am confused as it won't be there to iterate over (and if it is a None result we won't reset the result anyway?)20:56
clarkbI probably need to trace this out more completely to understand it20:56
tobiashWe set the result on all completed builds that didn't get reset20:56
corvusclarkb: i think setResult will recurse internally20:57
tobiashAnd they skip their child jobs if needed which fixes the issue20:57
corvusclarkb: so even though we remove the child build, we call setresult on its parent which then recreates the skipped child20:57
tobiashyepp20:57
clarkbya thats the fake build creation it does20:58
corvus(setResult walks the job graph, so all the jobs are there)20:58
clarkbok so what we are doing is starting form builds we can reach then calling setResult from all of those to walk the graph and add in any missing skips if necessary20:58
clarkband we only bother with those that have a result because something that doesn't have ar esult yet can't modify its children20:59
tobiashyes20:59
corvustobiash: while you're around, i forgot https://review.opendev.org/741315 earlier :)20:59
tobiashah the nodepool change, I first thougbt I have andeja vue :)21:00
corvusclarkb: ^ when you have a sec21:01
tobiashyou see from my spelling that I'm on mobile...21:01
corvusmy french is too bad to notice21:01
clarkbdone and done. Now to the last of tobiash's changes21:02
tobiashthe last one should be easier :)21:04
tobiashthe skip issue was quite a dwbug challenge :)21:04
clarkbyup the last one was easier. I got sniped by the changes to the test suite to handle testing of multiple schedulers but the chagne itself was fine21:10
openstackgerritMerged zuul/zuul master: Fix bug that allowed failing jobs to pause  https://review.opendev.org/73997521:29
openstackgerritMerged zuul/nodepool master: Require kazoo 2.8.0  https://review.opendev.org/74131521:51
openstackgerritMerged zuul/zuul master: Correctly handle skipped jobs on retries  https://review.opendev.org/73951122:09
openstackgerritMerged zuul/zuul master: Resume jobs after reenqueue of an item  https://review.opendev.org/73970922:09
*** fdegir has quit IRC22:16
*** fdegir has joined #zuul22:17
*** logan- has quit IRC22:17
*** logan- has joined #zuul22:19
*** rlandy|ruck is now known as rlandy|ruck|bbl22:34
*** hamalq has quit IRC22:35
*** tosky has quit IRC22:48
*** jamesmcarthur has joined #zuul23:00
*** jamesmcarthur_ has quit IRC23:04
*** piotrowskim has quit IRC23:15
*** rlandy|ruck|bbl is now known as rlandy|ruck23:55
*** jamesmcarthur has quit IRC23:58

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!