Thursday, 2021-07-08

opendevreviewMerged zuul/zuul master: Use create_all for empty databases  https://review.opendev.org/c/zuul/zuul/+/79718000:05
corvusclarkb: agreed; i left followup comments00:11
clarkbok. It seems like functionally we may be ok since we don't depend on removing tenants from abide.tenants to clean up zk and TPCs etc00:12
clarkbBut I think we'll leak the entries in there00:12
corvusyep, and layouts :)00:14
opendevreviewMerged zuul/zuul master: Add Postgres schema test  https://review.opendev.org/c/zuul/zuul/+/79836200:14
clarkbah because layouts are a tenant attribute not an abide attribute00:16
clarkbmy brain is melting a bit thinking that through. How do tpcs and layouts differ. Are tpcs the raw config and layouts the prased config?00:18
clarkbah no a tpc is generated for each tenant:project config and a layout is the aggregate of that within a tenant looks like00:19
clarkbso ya we may flush the tpcs from the abide but then we'd still have the layout pointing at abunch of stuff via the tenant I think00:19
clarkbin any case I'll try to pick this back up in the morning. Hopefully the comments I left make sense00:20
corvusclarkb: thanks!00:55
opendevreviewMerged zuul/zuul master: Move tenant validation to separate method  https://review.opendev.org/c/zuul/zuul/+/79946301:05
opendevreviewJames E. Blair proposed zuul/zuul-operator master: WIP: add static node to functional test  https://review.opendev.org/c/zuul/zuul-operator/+/79987401:15
opendevreviewJames E. Blair proposed zuul/zuul-operator master: WIP: add static node to functional test  https://review.opendev.org/c/zuul/zuul-operator/+/79987402:07
opendevreviewJames E. Blair proposed zuul/zuul-operator master: WIP: add static node to functional test  https://review.opendev.org/c/zuul/zuul-operator/+/79987402:41
opendevreviewJames E. Blair proposed zuul/zuul-operator master: WIP: add static node to functional test  https://review.opendev.org/c/zuul/zuul-operator/+/79987403:02
*** zbr is now known as Guest16405:03
opendevreviewSimon Westphahl proposed zuul/zuul master: Refactor pipeline processing in run handler  https://review.opendev.org/c/zuul/zuul/+/79598505:49
opendevreviewSimon Westphahl proposed zuul/zuul master: Refactor pipeline processing in run handler  https://review.opendev.org/c/zuul/zuul/+/79598506:18
opendevreviewSimon Westphahl proposed zuul/zuul master: Tenant, pipeline and queue locks in Zookeeper  https://review.opendev.org/c/zuul/zuul/+/79599306:24
opendevreviewSimon Westphahl proposed zuul/zuul master: Tenant, pipeline and queue locks in Zookeeper  https://review.opendev.org/c/zuul/zuul/+/79599306:30
*** rpittau|afk is now known as rpittau06:59
amar_[m]Hi team, we are migrating to zuulV3, Is there way to get the customized images (all the dependencies pre-installed) ready to run on Nodepool or any docs/steps for image customization would also be helpful07:04
opendevreviewFelix Edel proposed zuul/zuul master: Move parent provider determination to pipeline manager  https://review.opendev.org/c/zuul/zuul/+/79763107:07
opendevreviewSimon Westphahl proposed zuul/zuul master: Combine full and smart reconfiguration events  https://review.opendev.org/c/zuul/zuul/+/79946407:15
*** jpena|off is now known as jpena07:19
*** sshnaidm_ is now known as sshnaidm08:25
opendevreviewAlbin Vass proposed zuul/zuul-operator master: Mount connection sshkeys on executors and mergers  https://review.opendev.org/c/zuul/zuul-operator/+/79999809:32
avass[m]corvus: that ^ looked like it was missing, at least we didn't have any sshkeys for connections on mergers/executors09:34
opendevreviewSimon Westphahl proposed zuul/zuul master: Store tenant layout state in Zookeeper  https://review.opendev.org/c/zuul/zuul/+/77146109:42
swestclarkb: corvus: thanks! addressed your comments and updated the changes09:52
opendevreviewGuillaume Chauvel proposed zuul/zuul master: WIP gitlab quick-start  https://review.opendev.org/c/zuul/zuul/+/79554010:43
opendevreviewGuillaume Chauvel proposed zuul/zuul master: WIP gitlab quick-start HTTPS  https://review.opendev.org/c/zuul/zuul/+/80000910:43
opendevreviewSimon Westphahl proposed zuul/zuul master: Create indexed logger for test scheduler instances  https://review.opendev.org/c/zuul/zuul/+/80001611:24
*** jpena is now known as jpena|lunch11:31
*** jpena|lunch is now known as jpena12:27
*** rpittau is now known as rpittau|afk12:45
fungiamar_[m]: assuming you're using diskimage-builder, you just add custom elements to install whatever you want into your images at image build time. in opendev we use some elements defined here: https://opendev.org/openstack/project-config/src/branch/master/nodepool/elements12:45
fungiamar_[m]: and then we define an abstract base image in our nodepool config our other images inherit from, with those additional elements: https://opendev.org/openstack/project-config/src/branch/master/nodepool/nodepool.yaml#L112-L11812:47
amar__fungi:ya we were following the same, but first we went with a cloud-image rather to disk-image.13:30
amar__fungi: Could we do some tweaks(installing dependencies) to cloud-image with "guestfish" and then use it to build a vm in nodepool? Is it possible?13:32
fungii have no idea what guestfish is13:33
fungiyou could certainly manually make any changes you like to an image and upload it and then tell nodepool to use that instead of relying on a nodepool-builder to construct an image for you13:34
opendevreviewFelix Edel proposed zuul/zuul master: Move parent provider determination to pipeline manager  https://review.opendev.org/c/zuul/zuul/+/79763113:35
opendevreviewFelix Edel proposed zuul/zuul master: Switch to ZooKeeper backed NodesProvisionedEvents  https://review.opendev.org/c/zuul/zuul/+/79983313:35
amar__fungi:Sure, thanks for the info. 13:38
opendevreviewSimon Westphahl proposed zuul/zuul master: Store tenant layout state in Zookeeper  https://review.opendev.org/c/zuul/zuul/+/77146114:19
opendevreviewSimon Westphahl proposed zuul/zuul master: Don't clear connection caches during full reconfig  https://review.opendev.org/c/zuul/zuul/+/80006614:28
clarkbamar__: fungi another option in some clouds is to make your changes then take a snapshot of that image then tell nodepool to use the snapshot15:00
clarkbswest: those updates lgtm. I'll work on getting through some of the child changes today as well15:15
corvusclarkb: my -1 on https://review.opendev.org/797631 is minor; assuming felixedel is gone for the day, if you happen to look at it and +2, i'll just fix that myself and we can land it.  mostly saying don't let my -1 stop you from reviewing if you get to it.15:48
clarkbcorvus: ok15:49
*** marios is now known as marios|out16:07
*** jpena is now known as jpena|off16:22
opendevreviewJames E. Blair proposed zuul/zuul-operator master: WIP: add static node to functional test  https://review.opendev.org/c/zuul/zuul-operator/+/79987416:29
opendevreviewJames E. Blair proposed zuul/zuul master: Lock node requests in fake nodepool  https://review.opendev.org/c/zuul/zuul/+/78730116:42
opendevreviewJames E. Blair proposed zuul/zuul master: Use the nodeset build parameter instead of hosts/groups  https://review.opendev.org/c/zuul/zuul/+/79912716:45
opendevreviewJames E. Blair proposed zuul/zuul master: Move parent provider determination to pipeline manager  https://review.opendev.org/c/zuul/zuul/+/79763116:47
opendevreviewMerged zuul/zuul master: Refactor pipeline processing in run handler  https://review.opendev.org/c/zuul/zuul/+/79598516:58
opendevreviewMerged zuul/zuul master: Combine full and smart reconfiguration events  https://review.opendev.org/c/zuul/zuul/+/79946417:03
clarkbcorvus: sorry I'm sitting down to review now17:10
opendevreviewJames E. Blair proposed zuul/zuul master: Verify ZK certs can be read  https://review.opendev.org/c/zuul/zuul/+/79713517:10
corvusclarkb: no apology necessary :)  i went ahead and made my minor change to 63117:10
clarkbI have approved https://review.opendev.org/c/zuul/zuul/+/795993 with some super minor nits (we use a constant in some places and not in others)17:17
clarkband i guess its child needs to be rebased so I'll go to the next stack instead. then we can solve all the erbasing once the various stacks are erviewed17:18
corvusyeah i noticed that too... i actually kinda liked not having the constant, because it made it easier to understand...17:18
clarkbthats fine with me too then17:19
corvusi wonder if we could do constants like "ZUULLOCKS"  instead of "LOCKROOT"17:19
clarkbI was more callign out the inconsistency than a strong desire to use the constant (though my comments probably imply wanting to use teh constant)17:19
corvusyeah, constants are usually better, it just struck me that i was more likely to catch the error i did because we didn't have a constant.17:20
corvusso i'm mulling it over.  clearly not a showstopper either way :)17:21
corvusi bet if we switched to constants and had all of them bunched up nicely together at the top and in a clearly structured way, it would be just as readable.  so on balance, that's probably what we should do.17:22
fungii like constants grouped at the top of modules like that, makes them easier to reuse from other modules in a consistent way17:23
clarkbcorvus: does https://review.opendev.org/c/zuul/zuul/+/797631/ mean you cannot have duplicate jobs in a buildset? For some reason I thought you could and if so are we ok with this change in behavior?17:40
avass[m]I thought that it was already impossible to have duplicate jobs in a buildset?17:41
clarkbthat could  be too. I thought for some reason you could though, maybe with variants?17:42
corvusclarkb: i believe job names have needed to be unique in a buildset for some time (when we run "duplicate jobs" for testing, we stick numbers on the end usually)17:44
corvusso i think it's not a behavior change17:44
clarkbok17:45
corvusclarkb: example: https://opendev.org/zuul/zuul/src/branch/master/zuul/model.py#L2382  only works if there's a single job with that name17:45
clarkbI must be misremembering then17:46
clarkbcorvus: I did +2 the change but left a question on it you may be able to answer17:46
clarkbcorvus: comment on https://review.opendev.org/c/zuul/zuul/+/787301 as well17:49
clarkbNow the big change "Store tenant layout state in Zookeeper"17:49
corvusclarkb: agree on 797631 and i think that's worth changing.17:51
corvusclarkb: heh, that change isn't as big as it sounds :)17:51
clarkbcorvus: the title and line count certainly imply otherwise :)17:52
clarkbits ok I have beedle the bardcore queued up I am now ready17:54
corvusclarkb: you may be amused by my reply on 78730118:03
clarkbcorvus: oh ya maybe make that a normal non blocking request?18:05
clarkbcorvus: can you check my comments on https://review.opendev.org/c/zuul/zuul/+/77146118:11
clarkbswest: corvus  for https://review.opendev.org/c/zuul/zuul/+/800066 I guess the risk here is if we miss an event for a branch creation or deletion then we have to restart zuul?18:15
clarkbwhich probably isn't a problem 99% of the time, but I wonder if once this is running in the wild people will notice (because the internet is flaky)18:16
y2kennyI have been using Nodepool on a self hosted k8s cluster (v1.18.1).  I just tried upgrading Nodepool from 4.1.0 to 4.2.0 (by simply changing the docker image tag, no other changes were made) and I got the following errors.  Is this expected?   http://paste.openstack.org/show/807294/18:17
corvusclarkb, tristanC: ^ does y2kenny's error look familier (related to the k8s conf changes maybe?)18:18
fungiit's like the kubernetes provider driver is getting initialized before the configuration has been loaded?18:19
clarkbI know that the k8s client stuff has seen churn. Maybe you need to provide an additional file now18:20
clarkbbut no not familiar to me off the top of my head18:20
avass[m]openshift is still pinned so I don't think that's because of a package upgrade at least: https://review.opendev.org/plugins/gitiles/zuul/nodepool/+/refs/heads/master/requirements.txt#1818:20
avass[m]which has been the cause for similar errors in the past18:21
clarkbya the change that added utils_k8s didn't change any of the deps18:21
clarkbhttps://github.com/openshift/openshift-restclient-python/blob/v0.11.2/requirements.txt#L2 is the version of the k8s library we should be using via the openshift pin18:24
avass[m]maybe this should end with an `except: Exception` and error with a logmessage: https://review.opendev.org/plugins/gitiles/zuul/nodepool/+blame/refs/tags/4.2.0/nodepool/driver/utils_k8s.py#2518:24
corvusclarkb: replied on 77146118:25
clarkbnot having the exception there should raise the exception all the way up which doesn't seem to be what happened18:25
avass[m]oh, right18:25
clarkbavass[m]: instead _get_conf is returning a None value for conf18:26
clarkby2kenny: do your debug logs say "Kubernetes config file not found"?18:27
avass[m]y2kenny: do you see any debug message before that error?18:28
clarkbI suspect that it isn't finding a valid config and then is trying to get the in cluster config which returns None18:28
y2kennyclarkb: um... that's weird because all else being equal I did not have the same problem for 4.1.0.  Let me see if there are more error.18:29
corvusclarkb: re 800066 i think a scheduler restart would have the same effect as the removed code (both now and in the future), since it's a cache on the connection object.18:30
clarkbhttps://github.com/kubernetes-client/python-base/blob/8a969ee9ad2837528c19673cfb5127b47be03105/config/kube_config.py#L48 is the path that should be looked at18:30
tristanCcorvus: arg seems like it, let me check18:30
corvusy2kenny: also we have functional tests for self-hosted k8s drivers, so it's pretty surprising to see this; we must be missing something subtle.18:31
clarkbthat k8s config path list hasn't changed in years18:32
avass[m]zuul did not detect the last time the in cluster config broke so I suppose there's nothing testing that codepath?18:32
avass[m]unless someone added tests for that back then18:32
corvusavass: oh, we may be relying on an explicit config then?18:33
avass[m]yeah18:33
clarkbcorvus: re 771461 do you want me to approve it and followup on the ordering thing after or wait for input on that18:33
corvusclarkb: i think approving is fine18:34
avass[m]corvus: or at least I assume so since the nodepool.yaml fixture is setting `context: minikube`18:35
clarkbswest: please check my comment on https://review.opendev.org/c/zuul/zuul/+/771461 about the __eq__ operator and total_ordering. I've approved the change just now though so followup if necessary is fine18:36
avass[m]so I guess it's also running outside the cluster18:36
corvusavass: yep, makes sense.  this might be easier to test in the operator.18:36
opendevreviewTristan Cacqueray proposed zuul/nodepool master: kubernetes: handle situation where the configuration is empty  https://review.opendev.org/c/zuul/nodepool/+/80009618:36
corvus(currently the operator test also uses an explicit config, but i bet we could switch it to in-cluster)18:36
tristanCy2kenny: corvus: ^ should fix the issue18:37
y2kennyclark, avass[m] , corvus: my current config is in /etc/nodepool/nodepool.yaml and k8s provider/driver does not specify any config location... the nodepool is launched inside the cluster in which it can allocate resources18:37
y2kennytristanC: Ah ok.18:37
corvustristanC: and client = k8s_client.CoreV1Api(conf) is okay with conf=None?18:37
corvus(i think so, cause i think the old code did that, but just wanted to double check)18:37
clarkbI don't know that will fix it? We'll make a client with no config18:38
tristanCcorvus: the old code did that indeed18:38
clarkbin _get_conf you could check if new_client_from_config returns None then load the in cluster config from there?18:38
avass[m]yeah I don't follow either18:40
clarkbhuh the old code does do that though18:40
clarkbmaybe passing None in implies in cluster config18:41
clarkbhttps://github.com/kubernetes-client/python/blob/d8f283e7483848647804eab345645106b6fb357d/kubernetes/client/api_client.py#L71 is what it does on None I think18:43
corvusNone is the default for CoreV1Api18:44
corvusalso relevant: https://github.com/kubernetes-client/python-base/blob/b4d3aad42dc23e7a6c0e5c032691f8dc385a786c/config/incluster_config.py#L11218:46
corvusthat means we expect get_conf to return None in the case of an in-cluster config18:46
clarkbfwiw it seems the behavior around this chagnes with kubernetes library versions18:46
corvusso in short: conf=None does mean in-cluster18:47
clarkbya so we might be able to simplify this further but tristanC's change should work18:47
avass[m]we may want to add a test for that then because that sounds like it absolutely going to break again in the future :)18:48
clarkbis in cluster config basically every pod has k8s root?18:49
fungisorta like how every vm in gce has credentials for the gce api, i guess. they seem to like that trust model18:50
clarkbs/root/some level of access allowing things/18:50
clarkbhttps://kubernetes.io/docs/tasks/configure-pod-container/configure-service-account/#use-the-default-service-account-to-access-the-api-server looks like you can opt out of it at least18:51
clarkbavass[m]: for testing I agree with corvus that that is probably easiset with the operator since it already assumes running the services in k8s18:54
clarkbbut you could in theory modify the k8s integration job to do it too since that has a k8s and wants a nodepool18:54
clarkbswest: corvus: I think https://review.opendev.org/c/zuul/zuul/+/799833/ and https://review.opendev.org/c/zuul/zuul/+/796013/ needs rebases now.18:57
avass[m]I may be able to find some time and take a look at that next week, thats my last week before vacation and last week at Volvo so I don't think it's a good idea for me to start on anything super important anyway.18:57
clarkbhttps://review.opendev.org/c/zuul/zuul/+/800016 is the last change that I haven't reviewed that is in a reviewable state. I'll get to it momentarily18:57
clarkby2kenny: fwiw we'ev approved tristanC's fix and I expect we can make a 4.2.1 release once that lands19:02
clarkbcorvus: I'm happy to push a tag later today if that helps19:03
corvusyeah, if we can do in the nodepool repo, that'd be best, but if we're running running a launcher in k8s there now, it'll be a bit of work19:05
corvusclarkb, tristanC oh we should add a release note19:06
corvuscan anyone else do that real quick?19:07
clarkbI can do a release note, do we want that ina a separate change?19:07
corvusclarkb: id do it in the same change19:08
y2kennyclarkb, tristanC: thanks guys!!19:08
corvusit won't be any slower, probably a little faster19:08
clarkbok writing that now19:08
opendevreviewMerged zuul/zuul master: Log Ansible Error Lines More Lengthy  https://review.opendev.org/c/zuul/zuul/+/79070819:08
corvusy2kenny: thank you for the report19:08
opendevreviewClark Boylan proposed zuul/nodepool master: kubernetes: handle situation where the configuration is empty  https://review.opendev.org/c/zuul/nodepool/+/80009619:13
clarkbcorvus: tristanC  ^ something like that?19:13
clarkbcorvus: I'll let you hit the +A button if that looks good to you. I've been told lunch is ready. Will check back in after19:15
opendevreviewJames E. Blair proposed zuul/nodepool master: kubernetes: handle situation where the configuration is empty  https://review.opendev.org/c/zuul/nodepool/+/80009619:17
corvusclarkb: was missing word 'Kubernetes' :)19:17
tristanCclarkb: corvus: thanks!19:18
clarkbcorvus: ++19:47
clarkbthere is a pep8 issue on that change, I'm fixing it now19:51
clarkbjust running pep8 locally really quickly to be sure I fixed it all19:53
corvusoh indentation huh19:53
opendevreviewClark Boylan proposed zuul/nodepool master: kubernetes: handle situation where the configuration is empty  https://review.opendev.org/c/zuul/nodepool/+/80009619:54
clarkbcorvus: yup^19:54
opendevreviewMerged zuul/zuul master: Tenant, pipeline and queue locks in Zookeeper  https://review.opendev.org/c/zuul/zuul/+/79599320:13
clarkbhttps://review.opendev.org/c/zuul/zuul/+/771461 apparently need a reabse too20:14
clarkbI guess I should take a quick look at doing some rebases20:14
corvusif you've got time, thanks!  my working tree is dirty right now20:14
opendevreviewMerged zuul/zuul master: Create indexed logger for test scheduler instances  https://review.opendev.org/c/zuul/zuul/+/80001620:15
opendevreviewClark Boylan proposed zuul/zuul master: Store tenant layout state in Zookeeper  https://review.opendev.org/c/zuul/zuul/+/77146120:16
opendevreviewClark Boylan proposed zuul/zuul master: Don't clear connection caches during full reconfig  https://review.opendev.org/c/zuul/zuul/+/80006620:16
clarkbya I'm punting on digging int ogerrit account cleanups because thats never fun :)20:17
opendevreviewClark Boylan proposed zuul/zuul master: Move parent provider determination to pipeline manager  https://review.opendev.org/c/zuul/zuul/+/79763120:27
clarkbcorvus: ^ I cleaned up the precedence thing in that one. The child needs rebasing due to aconflict with master. I think we probably want to land ^ first to make diffs cleaner20:27
*** mgoddard- is now known as mgoddard20:50
opendevreviewClark Boylan proposed zuul/zuul master: Lock tenants and pipelines during processing  https://review.opendev.org/c/zuul/zuul/+/79601320:54
clarkbswest: corvus ^ that rebase ended up being more complicated than I expected going into it :) please review it carefully20:55
clarkbin particular want to ensure I mapped up all function calls to the new pipeline function calls and have the order correct as well as locks held at the right time. I think I got all that right but would definitely feel better if other eyeballs checked it20:55
corvusclarkb: ah, i hadn't seen that yet since it didn't have the sos hashtag :)20:57
clarkbcorvus: I found it in the gerrit relation chain.20:57
opendevreviewMerged zuul/nodepool master: kubernetes: handle situation where the configuration is empty  https://review.opendev.org/c/zuul/nodepool/+/80009620:58
corvusit looks compatible with the change we just reviewed/merged; but we should definitely check with swest on that.  some sos changes without the hashtag are best considered early drafts which may be obsoleted at any time :)20:58
clarkbya I kind of figured this one was a draft while the parent changes got finalized. But now we've finalized things and it could be updated.21:00
clarkbcorvus: ^ the nodepool change has landed21:01
opendevreviewJames E. Blair proposed zuul/zuul master: Link to the build page from the status page  https://review.opendev.org/c/zuul/zuul/+/80011121:02
opendevreviewJames E. Blair proposed zuul/zuul master: Always report the build page  https://review.opendev.org/c/zuul/zuul/+/80011221:02
corvusclarkb: i'll make a tag21:02
clarkbcorvus: for https://review.opendev.org/c/zuul/zuul/+/797631/ do you want swest to review the removal of the default precedence condition? Might be a good idea since we made those changes without swest input?21:02
corvusclarkb: you mean felixedel ?21:03
clarkber yes21:03
clarkbsorry I've been jumping around changes21:03
clarkband then the child of that doesn't really want to be rebased until 797631 lands since its conflict is with master21:03
corvusclarkb: i think it's okay to merge 797631 now (i believe that was a code move and we fully understand the original intent and why it doesn't apply)21:05
corvuszuul-maint: nodepool release okay?  commit 39ff609835cfe82fb97886f1300ecd42f601768c (HEAD -> master, tag: 4.2.1, origin/master, refs/changes/96/800096/4)21:06
clarkb39ff609835cfe82fb97886f1300ecd42f601768c as 4.2.1 lgtm21:06
clarkbok let me double check 797631 to give it a proper rereview after rebase then I can approve it21:06
clarkbcorvus: on 797631 the nodepool-zuul-functional job timed out. That job is non voting so I suspect this may be expected. Any concern with approving it given that build status?21:08
opendevreviewJames E. Blair proposed zuul/zuul master: Use an actual database in all Zuul tests  https://review.opendev.org/c/zuul/zuul/+/79718121:08
opendevreviewJames E. Blair proposed zuul/zuul master: Remove ZuulDBTestCase  https://review.opendev.org/c/zuul/zuul/+/79835021:08
opendevreviewJames E. Blair proposed zuul/zuul master: Report intermediate buildsets and builds  https://review.opendev.org/c/zuul/zuul/+/79718221:08
opendevreviewJames E. Blair proposed zuul/zuul master: Add nodeset to build table  https://review.opendev.org/c/zuul/zuul/+/79820721:08
opendevreviewJames E. Blair proposed zuul/zuul master: Link to the build page from the status page  https://review.opendev.org/c/zuul/zuul/+/80011121:08
opendevreviewJames E. Blair proposed zuul/zuul master: Always report the build page  https://review.opendev.org/c/zuul/zuul/+/80011221:08
clarkblooks like it specifically failed to connect ot zookeeper21:09
clarkbhttps://9afc2a802fc84c0c4ce8-61a5ffddd2974bf904ab38b965509754.ssl.cf1.rackcdn.com/797631/9/check/nodepool-zuul-functional/ccc1b2f/job-output.txt21:09
corvusclarkb: i think it's structurally broken since the zk changes?21:09
clarkbah ya could be21:09
clarkbI have approved 79763121:10
corvusthough i think it usually failse, not times out21:10
clarkblooking in build history the time out has happened before21:10
clarkbbut typical failure mode is failure21:11
clarkbthe zk connection issues are consistent though21:11
corvus(i love it: if you add 'registered' to a skipped task, it's still registered; so you can't use when with opposing conditionals to set a registered var in ansible)21:12
opendevreviewJames E. Blair proposed zuul/zuul-operator master: WIP: add static node to functional test  https://review.opendev.org/c/zuul/zuul-operator/+/79987421:12
clarkbyup I ran into that a few weeks ago21:13
clarkbI think in the ansible of mailman21:13
corvusclarkb: if you're up for it, topic:sql2 is a continuation of some changes you reviewed earlier21:15
corvusi'm trying to get some of the usability improvements that should be possible with more use of the database21:16
corvus(clicking status page links that dump us to the raw log server are especially bugging me now)21:16
corvuswow, "prometheus protocol" is quite the google fail21:21
clarkbdo you get results to watch the movie?21:21
corvusthat would somehow be closer.  no, i learn how to gain body mass.21:22
avass[m]corvus: you're not looking for workout instructions?21:22
avass[m]:)21:22
corvus"exposition format" is apparently what i want21:23
opendevreviewMerged zuul/zuul master: Store tenant layout state in Zookeeper  https://review.opendev.org/c/zuul/zuul/+/77146121:39
clarkbcorvus: it has occurred to me that ianw wants to update the zuul config monday morning au time. The config update will opint zuul at the gerrit backend server directly to simplify the gerrit server move later. Do we need to consider a zuul restart tomorrow to ensure we didn't just land anything problematic for that?21:40
clarkbI can help with that if so21:40
fungicorvus: 39ff609 as 4.2.1 lgtm21:40
corvusclarkb: sgtm21:41
corvusfungi: thx will push21:41
fungisorry, got sidetracked by nomnomnoms21:41
clarkbcorvus: some questions on https://review.opendev.org/c/zuul/zuul/+/79718222:11
clarkbalso as soon as I've mentioned that I think I sorted out the answer to my first question22:12
clarkbmaybe you can confirm the answer I've written on the change22:12
opendevreviewMerged zuul/zuul master: Move parent provider determination to pipeline manager  https://review.opendev.org/c/zuul/zuul/+/79763122:16
corvusclarkb: done.  want me to add to that test?  (i didn't originally because i was just testing new functionality -- the update)22:18
clarkbcorvus: no I don't think that is necessary in this change. But might be a reaonsable thing to test as we add these tests?22:20
clarkbcorvus: is createBuildEntry() in https://review.opendev.org/c/zuul/zuul/+/797182/6/zuul/driver/sql/sqlreporter.py redundant now?22:23
corvusclarkb: i think so -- i thirk there's some cleanup to do there, i'll take a look22:24
clarkbcorvus: https://review.opendev.org/c/zuul/zuul/+/798207 has some comments22:31
opendevreviewJames E. Blair proposed zuul/zuul master: Remove some unused methods in sql reporter  https://review.opendev.org/c/zuul/zuul/+/80012122:31
corvusclarkb: ^ i think we can do that cleanup22:31
opendevreviewJames E. Blair proposed zuul/zuul master: Add nodeset to build table  https://review.opendev.org/c/zuul/zuul/+/79820722:48
opendevreviewJames E. Blair proposed zuul/zuul master: Link to the build page from the status page  https://review.opendev.org/c/zuul/zuul/+/80011122:48
opendevreviewJames E. Blair proposed zuul/zuul master: Always report the build page  https://review.opendev.org/c/zuul/zuul/+/80011222:48
corvusoof, our reconfiguration change just broke the zuul-operator functional test because it's looking for a log line we just changed22:50
mordredcorvus: https://review.opendev.org/c/zuul/zuul/+/800112 question with +222:51
clarkbcorvus: I left a comment on ^ too22:51
corvusincoming patch bomb due to that log line change22:53
opendevreviewJames E. Blair proposed zuul/zuul-operator master: Use kopf operator framework  https://review.opendev.org/c/zuul/zuul-operator/+/78503922:53
opendevreviewJames E. Blair proposed zuul/zuul-operator master: Bump API version to v1alpha2  https://review.opendev.org/c/zuul/zuul-operator/+/78504722:53
opendevreviewJames E. Blair proposed zuul/zuul-operator master: Run a git server in k8s for functional tests  https://review.opendev.org/c/zuul/zuul-operator/+/78573822:53
opendevreviewJames E. Blair proposed zuul/zuul-operator master: Move ingress to functional test  https://review.opendev.org/c/zuul/zuul-operator/+/78575722:53
opendevreviewJames E. Blair proposed zuul/zuul-operator master: Support externally managed Zookeeper and DB  https://review.opendev.org/c/zuul/zuul-operator/+/78527322:53
opendevreviewJames E. Blair proposed zuul/zuul-operator master: Pass through extra scheduler config options  https://review.opendev.org/c/zuul/zuul-operator/+/78527722:53
opendevreviewJames E. Blair proposed zuul/zuul-operator master: Add merger support  https://review.opendev.org/c/zuul/zuul-operator/+/78527822:53
opendevreviewJames E. Blair proposed zuul/zuul-operator master: Add keystore password support  https://review.opendev.org/c/zuul/zuul-operator/+/79018222:53
opendevreviewJames E. Blair proposed zuul/zuul-operator master: Support imagePrefix and versions  https://review.opendev.org/c/zuul/zuul-operator/+/78527922:53
opendevreviewJames E. Blair proposed zuul/zuul-operator master: Support fingergw  https://review.opendev.org/c/zuul/zuul-operator/+/78530022:53
opendevreviewJames E. Blair proposed zuul/zuul-operator master: Add docs  https://review.opendev.org/c/zuul/zuul-operator/+/78508322:53
opendevreviewJames E. Blair proposed zuul/zuul-operator master: Support zuul-preview  https://review.opendev.org/c/zuul/zuul-operator/+/78576022:53
opendevreviewJames E. Blair proposed zuul/zuul-operator master: Add support for zuul-registry  https://review.opendev.org/c/zuul/zuul-operator/+/78576122:53
opendevreviewJames E. Blair proposed zuul/zuul-operator master: Remove extra 2 minute wait from tests  https://review.opendev.org/c/zuul/zuul-operator/+/78576222:54
opendevreviewJames E. Blair proposed zuul/zuul-operator master: Add allowUnsafeConfig database setting  https://review.opendev.org/c/zuul/zuul-operator/+/78576422:54
opendevreviewJames E. Blair proposed zuul/zuul-operator master: Pass through environment to scheduler, web and launcher  https://review.opendev.org/c/zuul/zuul-operator/+/78598822:54
opendevreviewJames E. Blair proposed zuul/zuul-operator master: Allow terminationGracePeriodSeconds to be configurable  https://review.opendev.org/c/zuul/zuul-operator/+/78598922:54
opendevreviewJames E. Blair proposed zuul/zuul-operator master: Flake8 cleanups  https://review.opendev.org/c/zuul/zuul-operator/+/78634922:54
opendevreviewJames E. Blair proposed zuul/zuul-operator master: Fix error with multiple nodepool providers  https://review.opendev.org/c/zuul/zuul-operator/+/79991722:54
opendevreviewJames E. Blair proposed zuul/zuul-operator master: Add instructions and tools for running tests with kind  https://review.opendev.org/c/zuul/zuul-operator/+/78576322:54
opendevreviewJames E. Blair proposed zuul/zuul-operator master: WIP: add static node to functional test  https://review.opendev.org/c/zuul/zuul-operator/+/79987422:54
opendevreviewJames E. Blair proposed zuul/zuul-operator master: Fix waiting for scheduler to settle in functional test  https://review.opendev.org/c/zuul/zuul-operator/+/80012322:54
mordredclarkb: https://codesearch.opendev.org/?q=success-url&i=nope&files=&excludeFiles=&repos=22:54
mordredhttps://opendev.org/inaugust/inaugust.com/src/branch/master/.zuul.yaml#L19 is an interesting example22:55
clarkbmordred: ya so instead what you need to do is return an artifact htat is that url22:56
corvusmordred: yep -- but on opendev i think we already made those defunct anyway?22:56
clarkband then the artifact url will be present on the builds page22:56
clarkbcorvus: yes I think we set the report build page flag to true22:56
corvuslike, i think if you set 'report-build-page' to true (and opendev does) than you already get this behavior, so we basically broke it for everyone using opendev a while ago22:56
mordredcool22:56
mordredyou know - for build-javascript-deployment - doing something to automatically return a zuul-preview artifact would be neat22:57
corvusya22:57
opendevreviewJames E. Blair proposed zuul/zuul master: Always report the build page  https://review.opendev.org/c/zuul/zuul/+/80011222:59
corvusclarkb, mordred: ^ revised reno22:59
clarkby2kenny: https://hub.docker.com/layers/zuul/nodepool-launcher/4.2.1/images/sha256-dc3a7c1600a959387d9a567ea924d618ac36ae242c74f1c8e65a59db9b2c2bae?context=explore exists now23:02
corvusi'll do the announce23:03
opendevreviewJames E. Blair proposed zuul/zuul master: Split optional matrix howto steps into new docs  https://review.opendev.org/c/zuul/zuul/+/80012523:18
corvusi think that makes the matrix howto doc look a lot nicer; and it's worth noting that when we drop the irc bridge part, that gets cut in ~half23:19

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!