Tuesday, 2017-02-14

jeblairjhesketh: i think that's mostly already there -- if a job definition appears in a branch of a project repo (this is not applicable to a config repo), it gets an implied branch matcher for that branch00:00
jeblair(this probably would have been a good thing to include in the email)00:00
jeblair* caveat: some of the branch-dependent logic isn't fully implemented yet (there are some todos in the configloader file)00:01
jheskethah, okay..00:02
jeblairso, iow, if nova has a special gate job defined in their repo, the definition that appears in the 'master' branch of nova will run on master changes, and mitaka on stable/mitaka changes, etc.00:03
jheskethjeblair: will that create a varient though? so where you have python27 defined in master with a branch matcher for a stable branch, and it defined again in the branch itself, will they be considered two jobs?00:04
jheskethwhat I'm leaning towards, is that other than config-repos, we should probably lean away from using branch matches and instead define the jobs in their branches (in the openstack use case)00:04
jeblairjhesketh: yeah, it would be as if you had two definitions of python27 both with stable branch matchers.00:04
jheskethokay00:05
jeblairjhesketh: and yes, i agree, i think that's the more natural way to use the feature00:05
jhesketh:-)00:05
jheskethjeblair: so if you have python27 defined in master with no branch conditions, will that also be ran against the stable branch00:05
jeblairjhesketh: if it's in a project repo, i think it won't match; so only the stable branch version will run00:06
jeblairjhesketh: (that's probably not what we want to do with the actual python27 job though -- that probably wants to be defined in project-config, with explicit branch matchers)00:07
jheskethokay, so the master branch matcher is also implied the same as a stable branch00:07
jeblairjhesketh: yep00:07
jeblairthere is probably a hole here with, for example, devstack-gate, which i suggested we might want to make a project repo, but we also may want to leave it branchless, yet, we want repos with stable branches to be able to run jobs it defines...00:08
jeblairi bet we can work it out though.  :)00:08
clarkbtempest is branchless too00:09
jeblair(maybe a fallback on master (that seems very zuulish); or maybe explicit branch:[])00:09
jheskethyeah, I suspect the flexibilty in config/project repos allows us to do some funky things00:09
jeblairyep.  we are drawing more coastline on our map, but there still be dragons.  :)00:10
jheskethfrom a project's point of view, it's still tricky to see what jobs will run for which projects against which branches in which pipelines etc. because of the matchers00:11
jeblairyeah, and "well, the version that's right there in the tree you're looking at" is pretty intuitive00:12
jheskethI wonder if defining the branches as part of the project-pipeline definition gains us simplicity there... however I'm not sure it works against cross-branch jobs or other complicated integration tests00:12
jeblairit's only weird for complex things like devstack00:12
jheskethright00:13
jheskethit gets pretty complex for any deployment projects too00:13
jheskethbut they need to test pretty complex scenarios, so that's kinda expected00:13
jeblairjhesketh: i think the project-pipeline also needs to be branch-specific (i believe that's one of the TODOs).  that certainly will have an interaction here.00:13
jeblair(it is valid to include a project-pipeline snippet in a project-repo .zuul.yaml -- it needs to be because that would be the only way to run a job you define in a project repo)00:14
jeblair(it just doesn't do any implied branch matching yet)00:14
jheskethjeblair: if we do project-pipeline-branch mapping, do we need branch matching?00:15
jeblairjhesketh: i think so, because i think we want to still be able to say "this job should run on trusty nodes when run on stable/foo" and not have to do that in the project-pipeline00:17
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Run zuul v3 launcher  https://review.openstack.org/43334700:18
jeblairit can run as a daemon!  ^00:18
jheskethjeblair: right, so we need it to define things like nodes that applies to all stable branches00:21
jheskethhmm okay00:21
*** jamielennox is now known as jamielennox|away01:09
*** jamielennox|away is now known as jamielennox01:17
*** saneax is now known as saneax-_-|AFK01:35
*** tristanC_ is now known as tristanC04:56
*** saneax-_-|AFK is now known as saneax05:26
*** abregman has joined #zuul06:25
*** isaacb has joined #zuul07:28
*** isaacb has quit IRC07:50
*** isaacb has joined #zuul07:53
*** isaacb has quit IRC09:14
*** isaacb has joined #zuul09:24
*** hashar has joined #zuul09:54
*** isaacb has quit IRC10:14
*** isaacb has joined #zuul10:49
*** Cibo has quit IRC11:18
*** Cibo has joined #zuul11:30
*** hashar is now known as hasharLunch12:22
*** hasharLunch is now known as hashar13:06
*** jamielennox is now known as jamielennox|away13:21
*** Cibo_ has quit IRC13:36
*** isaacb has quit IRC14:01
*** isaacb has joined #zuul14:09
*** saneax is now known as saneax-_-|AFK14:28
*** TheJulia has quit IRC14:41
*** patrickeast has quit IRC14:42
*** patrickeast has joined #zuul14:44
*** adam_g has quit IRC14:44
*** TheJulia has joined #zuul14:46
*** adam_g has joined #zuul14:48
*** isaacb has quit IRC15:05
*** isaacb has joined #zuul15:06
*** abregman is now known as abregman|brb15:08
*** isaacb has quit IRC15:11
*** isaacb has joined #zuul15:12
*** herlo has quit IRC15:16
*** isaacb has quit IRC15:22
*** herlo has joined #zuul15:23
*** herlo has joined #zuul15:23
*** isaacb has joined #zuul15:28
openstackgerritMerged openstack-infra/nodepool master: Make web status text/plain  https://review.openstack.org/42850115:36
*** abregman|brb is now known as abregman15:50
*** isaacb has quit IRC15:53
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: WIP: Implement node cleanup  https://review.openstack.org/43373615:53
*** abregman is now known as abregman|mtg15:54
*** abregman|mtg is now known as abregman16:06
openstackgerritJan Kundrát proposed openstack-infra/zuul master: Fix change number extraction on new enough Gerrit master  https://review.openstack.org/43374816:13
mordredjeblair: ^^16:15
jeblairmordred: thx, approved with comment.16:37
openstackgerritMerged openstack-infra/zuul master: Fix change number extraction on new enough Gerrit master  https://review.openstack.org/43374816:40
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Re-enable test_abandoned_not_timer  https://review.openstack.org/42798517:10
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Reset merger repo when performing an update  https://review.openstack.org/43379817:10
jeblairSpamapS: i know you're traveling today, but for when you get a sec: i think you found a zuul bug in your test, so i fixed the bug, rebased your test on it and updated the test ^17:20
*** abregman has quit IRC17:43
*** hashar has quit IRC17:59
SpamapSjeblair: oh fun! :)17:59
SpamapSjeblair: oh my. Glad you're paying attention. :)18:01
SpamapSjeblair: I'll go ahead and update 430568 in kind18:03
jeblairSpamapS: cool, thanks18:03
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Re-enable test_timer  https://review.openstack.org/43096818:12
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Re-enable test_timer_smtp  https://review.openstack.org/43098318:12
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Re-enable test_idle  https://review.openstack.org/43056818:12
jeblairSpamapS, mordred, jhesketh: it occurs to me that the requirement for having zuul's config in a zuul-managed repo makes the third-party ci case (as well as the "i want to run zuul locally and point it at review.o.o" case) difficult.  so i'm thinking of writing a quick 'git' driver so you can point zuul at a plain old (ie, not gerrit- or github- or whatever- managed) git repo so that it can fetch its config from there.18:25
jeblairi don't think it will need to be more more than a few lines of code18:25
mordredjeblair: that makes sense - but is there any need to have that file in git if it's not in a zuul managed repo? if we're going to let people do that, might as well let them just point at a directory and manage the file with config management?18:28
jeblairmordred: yes!  zuul has no idea how to load a config file if it's not in git :)18:29
jeblairmordred: zuul.conf and the tenant config (which points to the git repos with the rest of the config) are expected to be on disk, but everything else has to come from a git repo18:30
jeblairmordred: i mean, of course, we could add a second path through config loading to do that, but it would be much more complicated than a git driver18:30
jeblairmordred: also.. and perhaps this is more germaine -- the launchers need to be able to clone/checkout the config repos because that's where the job playbooks are18:32
jeblairmordred: so i don't think we'd get very far down that path...18:32
jeblairit's worth noting that puppet-openstackci users likely have their own project-config repos, so they are (like us) using config-management to update their zuul configs (which are kept in git).  this would allow pretty much the same kind of setup in the future.18:34
mordredjeblair: cool18:35
SpamapSIt's also pretty easy to get your config management to just commit changed files.18:37
SpamapSif that's how you want to do it.18:37
SpamapSAnd that lets zuul be efficient and just wait for changes in git.18:37
SpamapSso +1 from me for a light weight git driver18:37
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Add generator API method for node iteration  https://review.openstack.org/43325218:44
*** saneax-_-|AFK is now known as saneax19:06
*** saneax is now known as saneax-_-|AFK20:14
*** jamielennox|away is now known as jamielennox20:17
*** openstackgerrit has quit IRC20:18
*** openstackgerrit has joined #zuul20:22
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Disconnect from ZooKeeper at shutdown  https://review.openstack.org/43391920:22
ShrewsEasy review, with the added fun of #TuesdayPoemDay ^^^^20:23
pabelangerShrews: lulz20:30
pabelangernice20:30
*** hashar has joined #zuul20:31
*** abregman has joined #zuul20:39
mordredShrews: I'm not approving that - just because I think everyone should read your commit message21:06
mordredSpamapS, jeblair: at least the two of you :)21:07
ShrewsSpamapS was my inspiration, with his ode to Rust21:07
Shrewsand sometimes I get tired of writing code21:08
jeblairShrews: you've found the recipe for collecting all the code review +2s but no workflow +1s.  :)21:11
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: WIP: Implement node cleanup  https://review.openstack.org/43373621:18
Shrews~/c 221:18
Shrewsoops21:18
*** abregman has quit IRC21:22
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: WIP: Implement node cleanup  https://review.openstack.org/43373621:25
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: WIP: Implement node cleanup  https://review.openstack.org/43373621:43
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Run zuul v3 launcher  https://review.openstack.org/43334721:52
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Add Git driver  https://review.openstack.org/43394221:52
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Remove gearman settled check  https://review.openstack.org/43394321:52
jeblairSpamapS, mordred: there's the git driver21:53
SpamapSWoot21:53
mordredjeblair: you're a madman21:57
mordredjeblair: also, I know what it is - but the commit subject "Add Git driver" implies that before that zuul didn't know how to talk to git, which amuses me21:58
mordredjeblair: you'd think __ne__ on the base object class would be the exact impl you have there21:59
mordred(sorry, in the first patch of that stack)21:59
mordredjeblair: while I'm bothering you - weren't you or SpamapS working on test_dependent_behind_dequeue recently? it started failing in 'Run zuul v3 launcher'22:02
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Implement node equality  https://review.openstack.org/43049122:04
jeblairmordred: i don't think we're actively working on it, we've just identified it's a random problem.  we'll have to recheck for now.22:06
jeblair(until we make that pot of coffee)22:06
mordredjeblair: I have a pot of coffee - but I just sneezed some of it out onto the floor and counter and table and other counter and chair22:06
mordredso it's probably not the right thing22:07
jeblairwhatever it takes22:08
Shrewsjeblair: for our FakeProviderManager, should we expect cleanupServer() to throw the NotFound exception in testing?22:10
jeblairShrews: yes22:11
Shrewsjeblair: ok. so i guess i should catch that and go ahead and delete the znode if NotFound is returned?22:12
Shrewsoh, yeah. looks like that's what the old code does22:12
openstackgerritAntoine Musso proposed openstack-infra/zuul master: Gerrit trailing delay is now configurable  https://review.openstack.org/34356222:13
openstackgerritAntoine Musso proposed openstack-infra/zuul master: Status: apply default style by default  https://review.openstack.org/27648022:15
openstackgerritAntoine Musso proposed openstack-infra/zuul master: Do not import paramiko before daemonization  https://review.openstack.org/34353022:21
*** hashar has quit IRC22:24
openstackgerritMerged openstack-infra/zuul master: Status: apply default style by default  https://review.openstack.org/27648022:25
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Squelch ref-replication gerrit warnings  https://review.openstack.org/43395922:29
jeblairmordred or pabelanger: can you +3 427985 ?22:29
SpamapSmordred: I believe there's a deadlock or something looping forever due to races in that test22:31
SpamapSI will be sitting in the Reno airport looking at that in about an hour :)22:31
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Disconnect from ZooKeeper at shutdown  https://review.openstack.org/43391922:32
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Add generator API method for node iteration  https://review.openstack.org/43325222:32
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Set Node image_id and launcher attributes  https://review.openstack.org/43324222:32
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Implement node cleanup  https://review.openstack.org/43373622:32
mordredjeblair: on it22:33
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Reset merger repo when performing an update  https://review.openstack.org/43379822:34
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Remove TODO comment that seems to be done  https://review.openstack.org/43396122:36
mordredjeblair: ^^ I +A'd 427985 - but it seemed there was  amissed comment removal in it - rather than go through a review cycle, I just pushed up a patch ^^22:36
mordredjeblair: it's also possible I read things wrong and there is still a todo there22:36
jeblairmordred: i think you're right, thanks22:37
* mordred is useful22:37
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Re-enable test_abandoned_not_timer  https://review.openstack.org/42798522:40
*** _ari__ has joined #zuul22:41
*** NTolerance has joined #zuul22:41
*** jasondotstar has joined #zuul22:42
*** nt has quit IRC22:42
*** Shrews has quit IRC22:42
*** _ari_ has quit IRC22:42
*** jasondotstar_ has quit IRC22:42
*** greghaynes has quit IRC22:42
*** saneax-_-|AFK has quit IRC22:42
*** jamielennox has quit IRC22:42
*** fungi has quit IRC22:42
*** NTolerance is now known as nt22:42
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Squelch ref-replication gerrit warnings  https://review.openstack.org/43395922:44
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Add Git driver  https://review.openstack.org/43394222:44
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Remove gearman settled check  https://review.openstack.org/43394322:44
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Correct getGitwebUrl  https://review.openstack.org/43396422:44
mordredjeblair: darn. I didn't catch you before you fixed the pep8 - there's a funny typo in the commit message in https://review.openstack.org/#/c/433959/22:45
jeblairmordred: heh, i actually haven't fixed the pep8 yet, i just noticed that22:46
pabelangerjeblair: mordred: mind reviewing https://review.openstack.org/#/q/topic:enable-tests too? re-enables tests for nodepool feature/zuulv322:46
*** _ari__ has quit IRC22:46
*** TheJulia has quit IRC22:46
*** morgan has quit IRC22:46
*** mattclay has quit IRC22:46
*** auggy has quit IRC22:46
*** bstinson has quit IRC22:46
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Squelch ref-replication gerrit warnings  https://review.openstack.org/43395922:46
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Correct getGitwebUrl  https://review.openstack.org/43396422:46
*** bstinson has joined #zuul22:46
jeblairmordred: fixed both22:47
*** _ari_ has joined #zuul22:47
jeblairpabelanger: i will do so in a few mins22:48
*** Shrews has joined #zuul22:49
*** greghaynes has joined #zuul22:49
*** fungi has joined #zuul22:49
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Add (minimal) support for topic-changed event  https://review.openstack.org/43396622:50
*** mattclay has joined #zuul22:55
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Squelch ref-replication gerrit warnings  https://review.openstack.org/43395922:56
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Add Git driver  https://review.openstack.org/43394222:56
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Remove gearman settled check  https://review.openstack.org/43394322:56
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Run zuul v3 launcher  https://review.openstack.org/43334722:56
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Add (minimal) support for topic-changed event  https://review.openstack.org/43396622:56
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Correct getGitwebUrl  https://review.openstack.org/43396422:56
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Remove misleading log statements  https://review.openstack.org/43397022:56
jeblairthat was mostly a rebase22:56
jeblairhopefully votes will carry22:57
*** TheJulia has joined #zuul22:57
*** auggy has joined #zuul22:57
*** morgan_ has joined #zuul23:16
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Re-enable test_node_net_name test  https://review.openstack.org/43322723:17
jeblairpabelanger, Shrews: i left a comment on 43323523:18
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Re-enable test_node_vhd_image test  https://review.openstack.org/43323323:18
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Remove misleading log statements  https://review.openstack.org/43397023:24
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Add __repr__ to jobtree  https://review.openstack.org/43049323:24
jeblairi have a zuulv3 scheduler and launcher running locally!  (they are not running jobs or anything, but they are running and watching gerrit)23:33
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Rename zuul-server zuul-scheduler  https://review.openstack.org/43398023:36
SpamapScoffee ordered23:50
SpamapStime to debug tests in the corner of the baggage claim area. :)23:50
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Disconnect from ZooKeeper at shutdown  https://review.openstack.org/43391923:55
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Add generator API method for node iteration  https://review.openstack.org/43325223:55
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Implement node cleanup  https://review.openstack.org/43373623:55
Shrewsjeblair: I had to adjust the test in 433252 there since I can't guarantee order from the new nodeIterator() method23:56
Shrewsit could (will/did) randomly fail23:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!