Friday, 2017-07-07

openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Rename zuul-revoke-sudo to revoke-sudo  https://review.openstack.org/48133100:15
mordredjeblair: ok - that topic just got a bit longer00:15
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Rename git_host to server in github driver  https://review.openstack.org/47759400:59
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Clarify canonical_hostname documentation  https://review.openstack.org/47902000:59
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Add docs on allow-secrets  https://review.openstack.org/48072600:59
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Fix indentation error in docs  https://review.openstack.org/48074000:59
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Move status_url to webapp config section  https://review.openstack.org/48075901:00
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Pass result data back from ansible  https://review.openstack.org/47944201:05
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: remove success/failure url options  https://review.openstack.org/48134201:05
openstackgerritJamie Lennox proposed openstack-infra/zuul feature/zuulv3: Cleanup on ssh-agent failure  https://review.openstack.org/48134401:06
jeblairmordred: 481327 has an error01:07
*** jkilpatr has quit IRC01:08
jamielennoxsigned ssh keys are cool, however the infrastructure around them is a lot of effort. not just revocations but nodepool would need to reach out somehow to ask for keys to be signed and you would need to maintain that list as a service01:09
jamielennoxdeploying something like vault would give you a similar effect with per host ssh keys and the auditting built in, it's just whether it's worth the effort01:14
jamielennoxhaving the private key there in zookeeper as a one use is fairly good for this, it's just annoying that you have to actually upload this key to nova before booting the vm01:15
clarkbjamielennox: well I think we are saying that system is also too clunky01:31
clarkbjamielennox: and maybe having zuul swap out keys is best01:32
clarkband ya ldap can have ssh keys too its a matter of how much extra infrastructure and/or tooling is reasonable01:33
clarkbseems like zuul can bootstrap this itself with a minimal level of effort01:33
jamielennoxyea, so that's the process now right, there's the built in key that zuul logs in with and swaps in a per job key, which is pretty good for now01:33
mordred++01:34
jamielennoxper build would get that better, but ugh, don't want to have to maintain ldap just for zuul if i can avoid it01:36
fungijeblair: having read through both stories, i think i have a marginal preference for the required/immutable base job using the primary shared key solely for bootstrapping a secondary per-build key. this gets nodepool out of the picture and also avoids any scalability concerns around nova keypair quotas02:05
fungicatching up on the subsequent conversation, it looks like maybe others came to similar conclusions02:07
fungii also like that having zuul bootstrap the secondary key reduces the extent to which key material is being shipped around between different parts of the system. every move of that data is another risk, in the end02:10
tristanCfungi: mordred: the sql schema likely needs to be upgrade, e.g. it's not well designed for periodic/post pipeline that doesn't have change number/newrev02:26
tristanCit's also missing a tenant column02:27
tristanCthen it seems relatively easy to build a openstack-health like service, either by direct database query, or through a zuul-web controller02:29
tobiashjeblair: I'm also in favor of the zuul base job story05:14
tobiashjeblair: we just should make sure that the base job also handles nodeless jobs gracefully05:14
tobiashjeblair: I'd like to retain the ability to run lightweight local-only jobs on the executor (e.g. for mirroring jobs)05:15
tobiashjeblair: I especially like the automatic base job inheritance as this would prevent the user from adding a job without inheriting and then wondering why he doesn't get logs :)05:33
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Optionally bind /lib64  https://review.openstack.org/48143205:35
*** bhavik1 has joined #zuul05:44
*** ianw is now known as ianw_pto05:55
*** ajafo has quit IRC06:26
*** ajafo has joined #zuul06:26
*** pabelanger has quit IRC06:37
*** yolanda_ has quit IRC06:38
*** cinerama has quit IRC06:38
*** pabelanger has joined #zuul06:40
*** cinerama has joined #zuul06:40
*** yolanda_ has joined #zuul06:44
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Add status_pattern to zuul-web config  https://review.openstack.org/48147407:33
*** bhavik1 has quit IRC08:02
*** hashar has joined #zuul08:59
*** openstackgerrit has quit IRC09:48
*** hashar is now known as hasharLunch10:37
mordredtobiash: ++11:22
*** openstackgerrit has joined #zuul11:29
openstackgerritMerged openstack-infra/zuul-jobs master: Remove the old tox-linter job  https://review.openstack.org/48132211:29
tobiashtried out Shrews websocket based log streaming patch now in my v3 deployment and it works :)11:30
mordredtobiash: woot!11:30
mordredtobiash: did you try it with a command line websocket client or with an html one?11:31
tobiashmordred: I used a html one11:31
mordred\o/11:34
mordredjeblair: I think https://review.openstack.org/#/c/481586/ may be exposing a bug in job config :(11:36
mordredjeblair: that is trying to create a job in openstack-zuul-jobs that has a job in zuul-jobs as its parent11:36
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Remove old tox jobs  https://review.openstack.org/48132511:38
mordredjeblair: I have verified that zuul-tox-docs is in zuul-jobs - so I'm concerned that parent: zuul-tox-docs is not working in openstack-zuul-jobs11:39
mordredtristanC: ++ to upgrading sql schema11:48
mordredtristanC: oh my. there are no indexes in the schema either11:49
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Improve debugging at start of job  https://review.openstack.org/48076111:51
openstackgerritMerged openstack-infra/zuul feature/zuulv3: github: gracefully handle unknown event  https://review.openstack.org/47324911:53
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Add html based websocket client for console stream  https://review.openstack.org/48159911:54
tobiashmordred: this is the html based websocket client I used ^^11:55
mordredtobiash: fantastic! thank you12:01
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Add some indexes to allow efficient dashboard sql  https://review.openstack.org/48161412:37
mordredtristanC: ^^ that should allow for some better dashboard queries :)12:38
*** hasharLunch is now known as hashar12:39
mordredtristanC: also - we should think a bit about github changes + gerrit changes - change is a unique id for gerrit - but not for github - which means project+change is the unique identifier12:43
tristanCmordred: maybe the buildset table also needs a source trigger field12:46
mordredtristanC: so if we wanted a view in the dashboard which is "show me all the jobs for this change" - it would wind up needing to be something like /dashboard/#!/change/review.openstack.org/openstack-infra/zuul/481614 or /dashboard/#!/change/github.com/j2sol/z8s-sandbox/212:46
mordredtristanC: that is - if we wanted such a view to be guessable by the user12:46
mordredtristanC: if we reorged that slightly --- and did /dashboard/#!/review.openstack.org/openstack-infra/zuul/change/481614 - then /dashboard/#!/review.openstack.org/openstack-infra/zuul could be a page to show the jobs for a given project - and both could be urls a user could be expected to guess12:48
mordredtristanC: and then /dashboard/#!/jobs and /dashboard/#!/jobs/tox-py27 would make sense12:50
mordredtristanC: but jobs view by project maybe /dashboard/#!/review.openstack.org/openstack-infra/zuul/jobs ?12:51
tristanCmordred: heh I meant to ask, can a job be defined differently in two projects?12:52
mordredtristanC: a project can define different variants12:52
mordredtristanC: so a project can say "please run my tox-py27 job for the stable/mitaka branch on centos-7 instead of ubuntu-xenial"12:53
mordredtristanC: but it'll still be "the tox-py27 job"12:53
mordredtristanC: heh. we probably want to put branch in here too12:54
mordredtristanC: there's definitely a difference in "I want to see all jobs" "I want to see jobs for stable/ocata" :)12:54
tristanCwouldn't using optional query-string be easier to manage then? e.g. /jobs/?project=$name&branch=$name ... ?12:55
tristanCand similarly, /builds/?project=$name&pipeline=$name12:56
mordredtristanC: maybe? I was mostly basing those urls on my (limited) understanding of how people like to do url construction in angular-land12:56
tristanCmordred: heh, I never build a complex enough angular thing to need such construction :-)12:57
mordred:)12:57
mordredgerrit does a similar: https://review.openstack.org/#/q/status:open+project:openstack-infra/zuul+branch:feature/zuulv312:58
mordredbut that's for arbitrary searching12:58
tristanCthough I'm more thinking about the rest controller and how the route would map in aiohttp12:58
mordred++12:58
mordredyah- I think that's the more important thing to consider12:58
mordredtristanC: and in that perspective, yah - a /builds and a /jobs endpoint seem much more sane13:01
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Optionally bind /lib64  https://review.openstack.org/48143213:34
tobiashmordred: what do you think about adding empty lines before the plays in the build logs?13:57
tobiashmordred: I think that would make them more readable (maybe also for the tasks)13:58
mordredtobiash: I think it's a good idea - I actually want to run an html post-processor on the build logs before we upload them ...14:00
mordredtobiash: that would transform them into something like this: http://logs.openstack.org/82/478582/2/check/gate-shade-python35/9d193c8/console.html14:00
mordred(in fact, i just wnat to use the code that does that transform)14:00
mordredtobiash: so I think adding a blank line before a play header wouldn't be a terrible choice - or even just adding a css selector onto lines with play in them so that a local css could be provided that formats with extra padding, etc14:01
tobiashmordred: sounds also good14:01
mordredtobiash: I like your optionally-bind patch - I kind of think we should go one step further, have there be a list of dirs to ro-bind and have all of them be optional bindings only if they exist14:03
mordred(well, I think ssh_auth_sock needs to be hard-coded and not in the list of ro-binds)14:03
mordredI'm betting we'll find a few more platform-specific dirs we want to bind or not bind14:04
tobiashmordred: I also thought about that but thought the remaining ro dirs are pretty standard and don't need checking14:06
tobiashmordred: but I can change that as well (just wanted to do a minimal impact patch)14:07
jeblairmordred: i know of no reason why the zuul-tox-docs thing should not work, so i will investigate that as a bug immediately.14:10
tobiashmordred, jeblair: because of missing repo update?14:13
tobiashmordred, jeblair: noticed that the playbook repo update patch did not solve the issue of not updating to latest origin/master14:14
tobiashbut did not yet have time to investigate14:14
jeblairtobiash: oh, hrm.  i will look into that.14:14
tobiashmordred, jeblair: just guessing, but the sentence 'job should fail/notfail but doesn't' made me think that might be the same issue14:17
jeblairdid we have a story about a problem with new patchsets?14:21
tobiashjeblair: not that I know of14:26
jeblairhttp://paste.openstack.org/show/614780/14:28
jeblairi'm confused by that error which i'm seeing in our logs14:28
jeblair_executeJobs is called from executeJobs which starts with the line: "if not item.current_build_set.layout: return False"14:29
jeblairso i have no idea how item.current_build_set.layout could be None in that traceback14:30
jeblairas i'm looking into this, i notice that we perform a merge operation for every non-active item in the check pipeline.  i don't think we need to do that, i think we can do them only for active items.  i'll note that for a future optimization.15:00
jeblairs/active/live/15:01
*** hashar is now known as hasharAway15:45
openstackgerritJesse Keating proposed openstack-infra/zuul feature/zuulv3: Ensure github change body is not a NoneType  https://review.openstack.org/48168115:50
jlkjeblair: SpamapS: mordred: I have a small stack of github fixes, starting with https://review.openstack.org/481314 that could use some reviews/merges.15:51
jlkDoes it seem a little ironic that just as Zuul is walking away from it's use of jenkins job builder, there is a big push to create a JJB community and future development?  What else in openstack land uses jjb?16:06
jeblairjlk: jjb is widely used outside of openstack, so i think it's great.  :)16:08
jlkI think it's great too, but it's just odd that there won't be any consumers within the org that is hosting the project.16:09
clarkbwe host a lot of software that we don't consume16:11
jeblairjlk: we're not going to pull the rug out from under it.  we're happy to have them here as long as they want to stay.  :)16:11
mordredyah. we also wouldn't stop them if they wanted to move elsewhere - but happy to keep them16:15
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Fix AttributeError in executor client  https://review.openstack.org/48169116:26
jeblairmordred: i miss compilers ^  :(16:26
jeblairthat should be the fix for the error that currently has zuul stuck.  now i'm going to try to figure out if that, or something else, is responsible for the error you reported.16:27
mordredjeblair: mine is very reproducible - we could land that fix and restart and trigger my patch again16:46
mordredclarkb, SpamapS: wanna do a quick +3: https://review.openstack.org/#/c/481691 ?16:46
jeblairmordred: well, the fact that your changes are stuck because of the 'item' error could be affecting that behavior, and restarting could paper over tobiash's theory about not correctly updating the config, so i want to poke a bit more before doing that16:48
mordredjeblair: ah - ok16:48
jeblairmordred: okay, i don't think either of those things should be affecting your change; so i'm going to +3 my bugfix and restart with it and see if we still see your error (i expect us to).16:55
jeblairmordred: according to the logs, it parsed exactly the config i would expect16:55
mordredjeblair: *awesome*16:58
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Fix AttributeError in executor client  https://review.openstack.org/48169117:03
jeblairmordred: okay, i restarted.  i'm going to recheck some of your changes now17:16
jeblairyay, it reproduced17:17
mordredjeblair: yay!17:19
mordredjeblair: I like it when I can provide you with weird bugs17:19
jeblairi wrote a test case to mimic this and it passes17:19
jeblairmordred: aha!  it's the .zuul.yaml -> zuul.yaml rename17:28
jeblairmordred: apparently there's a place where we don't read zuul.yaml from untrusted projects17:29
mordredjeblair: oh! well then17:30
jeblairit looks like we read either from config projects, but only .zuul.yaml from untrusted projects.  if anything, that feels backwards.  but maybe we should just read either from both kinds of projects.  :)17:32
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Read config from .zuul.yaml or zuul.yaml  https://review.openstack.org/48170617:36
jeblairmordred: ^17:36
mordredjeblair: yah- I liked your narrative description in the docs17:39
mordred"they're both valid - you may want to use the hidden file for repos where it's not the primary purpose"17:40
mordredjeblair: while your head has all of that context loaded in it - https://review.openstack.org/#/c/473764/ seems like it's in good shape17:41
mordredjeblair: heh. although amusingly enough it's going to merge-conflict on your patch - and it copied the logic in that place - so the merge conflict will _actually_ show a place where the logic got fixed in HEAD and should be similarly applied to the patch17:42
jeblairmordred: do you have any idea what changed between PS3 and current on that?17:43
jeblairi've diffed 3-4 4-5 and 5-6, and there are big rebases in all of them17:43
mordredjeblair: I do not17:44
jeblairso if i'm going to review that, i'm going to need to manually interdiff17:44
jeblairi'd love to land it, but i don't have time for that now17:44
jeblairi will leave comments asking for some review help17:44
mordred++17:45
mordredjlk: gh stack lgtm - maybe SpamapS can knock those in17:53
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Read config from .zuul.yaml or zuul.yaml  https://review.openstack.org/48170617:56
mordredjeblair: I'd like to restart zuul-executor with that ^^ applied - that gonna mess you up?18:11
jeblairmordred: nope; i'll go ahead and restart now18:36
jeblairmordred: done18:37
jeblairrechecked 32718:38
jeblairmordred: +1!18:42
openstackgerritMerged openstack-infra/zuul-jobs master: Duplicate the zuul-tox jobs to just be named tox  https://review.openstack.org/48132319:09
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Consume tox instead of zuul-tox  https://review.openstack.org/48132619:50
SpamapSmordred: sorry, stomach bugged knocked me out of commission. :P19:50
SpamapSJust peeking at my IRC before I crawl back into hole.19:51
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Handle GitHub comment reviews carefully  https://review.openstack.org/48131419:58
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Remove unnecessary loop in github test  https://review.openstack.org/48131519:59
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Ensure github change body is not a NoneType  https://review.openstack.org/48168120:00
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Pass result data back from ansible  https://review.openstack.org/47944220:02
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Pass result data back from ansible  https://review.openstack.org/47944220:03
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Pass result data back from ansible  https://review.openstack.org/47944220:07
mordredjeblair: yay!20:42
mordredSpamapS: :(20:42
mordredjeblair: https://review.openstack.org/#/q/topic:rename-dance has three more patches you might reasonably have missed because WOW it's a lot of patches20:45
jeblairmordred: thanks, i hadn't missed them, but they had slipped my mind after rechecking them a little bit ago.  will +3 now20:46
mordredjeblair: :)20:46
mordredjeblair: I just - I figure zuul is the only one who can ACTUALLY understand the depends-on graph20:46
openstackgerritMerged openstack-infra/zuul-jobs master: Remove the transitionary zuul-tox jobs  https://review.openstack.org/48132420:47
openstackgerritMerged openstack-infra/zuul-jobs master: Rename zuul-revoke-sudo to revoke-sudo  https://review.openstack.org/48133120:50
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Pass result data back from ansible  https://review.openstack.org/47944220:52
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Support relative urls in success-url  https://review.openstack.org/48134220:52
jeblairmordred: heh, probably :)20:52
jeblairmordred: those 2 changes are ready, i think.  that's my attempt to make the log url stuff easy, but also keep the neat trick we do where we deep link to docs builds.20:53
jeblairthat's far from the only approach we could take there... let me know what you think20:54
mordredjeblair: reading now20:54
mordredjeblair: what's the ZUUL_JOBDIR env var in the ansible module for?20:55
mordredjeblair: oh - that works?20:55
mordredI guess since it only ever gets run on localhost ...20:55
jeblairmordred: so it knows the right place to put results.json by default.  you can set a 'path:' parameter, but i don't want folks to have to set it every time; it's only as an override.20:56
mordredyah20:56
jeblairmordred: exactly, yes.  localhost only.20:56
mordredjeblair: so - fwiw, since this is intended to only ever run on localhost - you COULD implement this as an action plugin20:56
jeblairmordred: i tried using cwd, but it seems that it ends up being the playbook directory.20:56
jeblairmordred: oh interesting.  that would give us access to facts, i assume.20:57
mordredjeblair: I'm not saying that would be better - but just more of from an fyi point of view20:57
jeblairthen we could drop the env var.20:57
jeblairhonestly, if so, i think that would be preferable.  though maybe as a followup patch.20:58
mordredjeblair: ++21:01
*** jesusaur has quit IRC21:28
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Add work_dir option to tox role  https://review.openstack.org/48176221:29
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Add a job that runs zuul's py35 unit tests  https://review.openstack.org/48176321:29
mordredjeblair: ^^ so that should be fun21:29
*** jesusaur has joined #zuul21:32
jeblairmordred: that is really exciting.  :)21:33
mordredjeblair: the error is even more exciting21:33
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Add a job that runs zuul's py35 unit tests  https://review.openstack.org/48176321:35
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Add work_dir option to tox and bindep roles  https://review.openstack.org/48176221:35
mordredjeblair: I made a param for the tox role - but not the bindep role - so bindep ran for zuul-jobs and then tox ran for zuul :)21:35
jeblairmordred: how did you deduce that from that error? :)21:37
mordredjeblair: 2017-07-07 21:30:00.047444 in http://logs.openstack.org/63/481763/1/check/f731d71/job-output.txt21:38
jeblairmordred: if pabelanger were here, he might want us to think twice about the var name -- is "work_dir" sufficiently scoped?  should it be zuul_work_dir ?21:39
jeblairmordred: also21:41
jeblair2017-07-07 21:36:32.041662 | TASK [test-setup : Run tools/test-setup.sh chdir=src/{{ zuul.project.canonical_name }}]21:41
jeblair2017-07-07 21:38:44.682497 | TASK [Find tox directories to synchrionize file_type=directory, use_regex=True, patterns=^(?!log).*$, paths=src/{{ zuul.project.canonical_name }}/.tox]21:41
mordredjeblair: both good points :)21:41
mordredjeblair: I think for _these_ roles it's not a super-big issue since it's always going to be about passing in values - but I can totally prefix with zuul_work_dir21:42
jeblairmordred: yeah, i'm still not sure the right answer.21:44
jeblairmordred: as long as we've thought about it and given our best shot given what we know now, i'm happy.  :)21:45
*** openstackgerrit has quit IRC21:47
mordredyup21:49
*** openstack has joined #zuul22:00
*** openstackgerrit has joined #zuul22:02
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Add a job that runs zuul's py35 unit tests  https://review.openstack.org/48176322:02
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Add zuul_work_dir default to one-project roles  https://review.openstack.org/48176222:02
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Permit config shadowing  https://review.openstack.org/47908422:03
mordredcrap I missed a variable name22:04
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Add a job that runs zuul's py35 unit tests  https://review.openstack.org/48176322:05
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Add zuul_work_dir default to one-project roles  https://review.openstack.org/48176222:05
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Delete run-bindep role  https://review.openstack.org/48177022:05
mordredjeblair: OH - you know what?22:12
mordredjeblair: that's trying to run py35 tests on zuul master22:12
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Delete run-bindep role  https://review.openstack.org/48177022:13
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Add a job that runs zuul's py35 unit tests  https://review.openstack.org/48176322:13
mordredjeblair: I get to play with all the fun toys on this change :)22:13
jeblairmordred: ++22:13
mordredjeblair: I think I need to port in configure_mirror next22:17
openstackgerritJames E. Blair proposed openstack-infra/zuul-jobs master: DNM: test per-build ssh key  https://review.openstack.org/48177222:17
jeblairmordred: yeah, i think pabelanger said that was hurting us22:17
jeblairmordred: https://review.openstack.org/47384522:18
mordredjeblair: cool - I can start with that22:20
mordredjeblair: finger://ze01.openstack.org/ff61c221249d4261a9b7c8d4b79c3b4a ...22:22
mordredjeblair: there's some fun kazoo output up in there that it was blocked on for a while22:22
mordredjeblair: but nevermind22:22
jeblairmordred: i didn't get there in time.  which change?22:23
mordredI thought it was zuul output- it was the test output from testing zuul22:23
mordredhttp://logs.openstack.org/63/481763/5/check/ff61c22/job-output.txt22:23
mordredjeblair: if you scroll to the end of the tests near the bottom you'll see a ton of NFO:paste.httpserver.ThreadPool:Shutting down threadpool22:23
jeblairmordred: yeah, that's normal.  the bigger bug there is that we're getting test log output at all in the console.  :(22:28
mordredyah22:28
jeblairyour stack looks green now, shall i +3 it?22:39
jeblairmordred: ^22:39
mordredjeblair: yes please22:40
openstackgerritMerged openstack-infra/zuul-jobs master: Add zuul_work_dir default to one-project roles  https://review.openstack.org/48176222:41
openstackgerritMerged openstack-infra/zuul-jobs master: Delete run-bindep role  https://review.openstack.org/48177022:41
openstackgerritMerged openstack-infra/zuul-jobs master: Add a job that runs zuul's py35 unit tests  https://review.openstack.org/48176322:41
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Permit config shadowing  https://review.openstack.org/47908422:52
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Fix test_bubblewrap_leak  https://review.openstack.org/48112323:12
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Optionally bind /lib64  https://review.openstack.org/48143223:16

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!