| *** JasonCL has quit IRC | 00:43 | |
| *** JasonCL has joined #zuul | 00:44 | |
| *** JasonCL has quit IRC | 00:51 | |
| *** JasonCL has joined #zuul | 00:52 | |
| *** JasonCL has joined #zuul | 00:53 | |
| *** JasonCL has quit IRC | 00:54 | |
| *** sshnaidm has quit IRC | 01:11 | |
| *** sshnaidm has joined #zuul | 01:12 | |
| *** JasonCL has joined #zuul | 01:32 | |
| *** JasonCL has quit IRC | 01:38 | |
| *** sshnaidm has quit IRC | 01:39 | |
| *** sshnaidm has joined #zuul | 01:40 | |
| *** dkranz has quit IRC | 01:57 | |
| *** JasonCL has joined #zuul | 02:01 | |
| *** JasonCL has quit IRC | 02:47 | |
| *** JasonCL has joined #zuul | 02:49 | |
| *** JasonCL has quit IRC | 02:54 | |
| *** JasonCL has joined #zuul | 03:29 | |
| *** JasonCL has quit IRC | 03:33 | |
| *** JasonCL has joined #zuul | 03:41 | |
| *** JasonCL has quit IRC | 03:46 | |
| *** JasonCL has joined #zuul | 04:03 | |
| *** JasonCL has quit IRC | 04:07 | |
| *** bhavik1 has joined #zuul | 04:33 | |
| *** bhavik1 has quit IRC | 04:50 | |
| *** JasonCL has joined #zuul | 04:56 | |
| *** JasonCL has quit IRC | 05:01 | |
| *** JasonCL has joined #zuul | 05:51 | |
| *** JasonCL has quit IRC | 05:56 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Don't treat finger client disconnect as exception https://review.openstack.org/531408 | 06:24 |
|---|---|---|
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Share a fake pull request database across connections https://review.openstack.org/531506 | 06:41 |
| *** JasonCL has joined #zuul | 06:45 | |
| *** JasonCL has quit IRC | 06:50 | |
| *** JasonCL has joined #zuul | 06:56 | |
| openstackgerrit | Merged openstack-infra/nodepool feature/zuulv3: Remove the default argument to secure in nodepoolcmd https://review.openstack.org/480310 | 06:58 |
| *** JasonCL has quit IRC | 07:01 | |
| *** Shrews has quit IRC | 07:13 | |
| *** Shrews has joined #zuul | 07:14 | |
| *** JasonCL has joined #zuul | 07:37 | |
| *** JasonCL has quit IRC | 07:42 | |
| *** pabelanger has quit IRC | 08:19 | |
| *** weshay has quit IRC | 08:19 | |
| *** pabelanger has joined #zuul | 08:20 | |
| *** weshay has joined #zuul | 08:20 | |
| *** mhu has quit IRC | 08:20 | |
| *** mhu has joined #zuul | 08:24 | |
| *** JasonCL has joined #zuul | 08:32 | |
| *** hashar has joined #zuul | 08:36 | |
| *** JasonCL has quit IRC | 08:36 | |
| *** jpena has joined #zuul | 08:38 | |
| *** sshnaidm is now known as sshnaidm|afk | 09:07 | |
| *** sshnaidm|afk has quit IRC | 09:08 | |
| *** sshnaidm has joined #zuul | 09:08 | |
| *** JasonCL has joined #zuul | 09:19 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/nodepool feature/zuulv3: Add a separate module for node management commands https://review.openstack.org/531703 | 09:58 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul feature/zuulv3: Set remote url on every getRepo in merger https://review.openstack.org/529293 | 10:29 |
| openstackgerrit | liusheng proposed openstack-infra/zuul feature/zuulv3: Use hotlink instead log url in github job report https://review.openstack.org/531545 | 10:34 |
| *** electrofelix has joined #zuul | 10:56 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/nodepool feature/zuulv3: [WIP] webapp: add optional admin endpoint https://review.openstack.org/531718 | 11:00 |
| openstackgerrit | Matthieu Huin proposed openstack-infra/nodepool feature/zuulv3: Refactor status functions, add web endpoints, allow params https://review.openstack.org/531390 | 11:02 |
| *** rcarrill1 has joined #zuul | 11:32 | |
| *** rcarrillocruz has quit IRC | 11:35 | |
| *** jkilpatr has quit IRC | 11:50 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/zuul-jobs master: Add roles for static web content build and publication https://review.openstack.org/531406 | 12:11 |
| openstackgerrit | Fabien Boucher proposed openstack-infra/zuul-jobs master: Add roles for static web content build and publication https://review.openstack.org/531406 | 12:14 |
| *** jkilpatr has joined #zuul | 12:22 | |
| *** rcarrill1 is now known as rcarrillocruz | 12:24 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/zuul-jobs master: Add roles for static web content build and publication https://review.openstack.org/531406 | 12:26 |
| *** jkt_ is now known as jkt | 12:30 | |
| *** jpena is now known as jpena|lunch | 12:33 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul feature/zuulv3: Also prefix the indexes if needed https://review.openstack.org/531742 | 12:55 |
| *** sshnaidm has quit IRC | 13:14 | |
| *** sshnaidm has joined #zuul | 13:15 | |
| *** dkranz has joined #zuul | 13:21 | |
| *** jpena|lunch is now known as jpena | 13:31 | |
| *** jkilpatr has quit IRC | 13:31 | |
| *** rlandy has joined #zuul | 13:38 | |
| *** jkilpatr has joined #zuul | 13:44 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/zuul-jobs master: Add roles for static web content build and publication https://review.openstack.org/531406 | 13:48 |
| *** JasonCL has quit IRC | 13:53 | |
| *** JasonCL has joined #zuul | 13:55 | |
| mrhillsman | does NODE_FAILURE mean there are no VMs to run a job? | 14:16 |
| mrhillsman | or could mean a number of different things? | 14:17 |
| dmsimard | mrhillsman: perhaps nodepool logs would have hints | 14:20 |
| dmsimard | or zuul executor | 14:20 |
| mrhillsman | really i just want to be sure that this would not be for something rudimentary as i only have 2 VMs available and 3 jobs kick off so job 3 returns NODE_FAILURE rather than waiting for a new VM | 14:21 |
| mrhillsman | my understanding is job 3 would queue and when a new VM is built that it can run on it would then run | 14:22 |
| mordred | mrhillsman: yes - job 3 *should* queue and wait | 14:23 |
| Shrews | mrhillsman: check nodepool logs for the failed request number. should be more info there as to why the request couldn't be fulfilled | 14:25 |
| mrhillsman | thx, need to go look at some logs now :) | 14:25 |
| openstackgerrit | Fabien Boucher proposed openstack-infra/zuul feature/zuulv3: Make Zuul able to start with a broken config https://review.openstack.org/529060 | 14:56 |
| *** rlandy_ has joined #zuul | 15:09 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/nodepool feature/zuulv3: [WIP] webapp: add optional admin endpoint https://review.openstack.org/531718 | 15:33 |
| rcarrillocruz | hey folks, it seems the gitdriver merged, does it mean i can consume openstack infra upstream jobs/roles? | 15:56 |
| rcarrillocruz | if so, any pointers of anyone doing that? config files, examples, etc | 15:56 |
| *** JasonCL has quit IRC | 16:05 | |
| *** JasonCL has joined #zuul | 16:12 | |
| pabelanger | rcarrillocruz: yah, leifmadsen_ and I are going to try using it this week for quickstart docs | 16:13 |
| rcarrillocruz | you don't have a branch for it yet , do you? | 16:14 |
| pabelanger | https://gist.github.com/leifmadsen/93b9283d10dfddba096e32fb172cf569 is the latest version, we need to import into RST this week | 16:14 |
| leifmadsen_ | before that, need to figure out the actual sample configuration, so probably a bunch of changes to the gtest-org | 16:15 |
| leifmadsen_ | or another repo | 16:15 |
| pabelanger | rcarrillocruz: however, we haven't tried using git driver just yet, just github | 16:15 |
| leifmadsen_ | yea, just github so far | 16:15 |
| leifmadsen_ | git didn't exist at the time :) | 16:15 |
| rcarrillocruz | right, same here | 16:16 |
| leifmadsen_ | would be easy enough to test though at the end of that set of docs though | 16:16 |
| leifmadsen_ | I suspect I'll find at least 3 bugs | 16:16 |
| leifmadsen_ | (not because I mean that the implementation is terrible, just that I'm a magnet for bugs :)) | 16:30 |
| leifmadsen_ | pabelanger: when do you want to get together again? I'm out on Wednesday, and I'm out all of next week | 16:30 |
| leifmadsen_ | honestly, today might really be my best day this week | 16:31 |
| pabelanger | leifmadsen_: tomorrow? I am on dadops today, so in and out | 16:31 |
| leifmadsen_ | tomorrow no good, too many meetings | 16:31 |
| leifmadsen_ | Maybe Thursday afternoon | 16:31 |
| leifmadsen_ | possibly tomorrow afternoon | 16:31 |
| pabelanger | Yah, today is my worst day this week | 16:31 |
| leifmadsen_ | all good, it's Monday | 16:32 |
| leifmadsen_ | actually, lots of meetings, but mostly community stuff I could skip | 16:32 |
| leifmadsen_ | so we could likely do tomorrow | 16:32 |
| leifmadsen_ | don't be at that coffee shop again :) | 16:32 |
| leifmadsen_ | it doesn't have Mr. Robot coffee shop bandwidth | 16:32 |
| pabelanger | leifmadsen_: Yah, I'll have the bandwidth :) | 16:34 |
| *** JasonCL has quit IRC | 16:34 | |
| *** kmalloc has joined #zuul | 16:38 | |
| dmsimard | Do we really want to point to the develop branch of github3 ? There's a lot of commits there on a regular basis. | 16:40 |
| corvus | dmsimard: nope, there's a story about fixing that. jlk is on it. | 16:40 |
| dmsimard | ok | 16:40 |
| *** jkilpatr has quit IRC | 16:44 | |
| *** jpena is now known as jpena|brb | 16:44 | |
| *** JasonCL has joined #zuul | 16:50 | |
| *** jkilpatr has joined #zuul | 16:59 | |
| *** bhavik1 has joined #zuul | 17:10 | |
| *** bhavik1 has quit IRC | 17:11 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: Support cross-source dependencies https://review.openstack.org/530806 | 17:23 |
| *** jpena|brb is now known as jpena | 17:24 | |
| fdegir | leifmadsen_: regarding zfs documentation - it looks pretty good and I setup zuul prototype running against opnfv by following it | 17:38 |
| leifmadsen_ | zfs docs? | 17:38 |
| fdegir | leifmadsen_: so, thanks for that and i’ll continue watching it and trying it behind the scenes | 17:38 |
| fdegir | leifmadsen_: yes, zfs gist | 17:38 |
| leifmadsen_ | I didn't write a zfs gist... | 17:39 |
| leifmadsen_ | oh wait... you created an acronym from Zuul From Scratch | 17:39 |
| fdegir | yep | 17:39 |
| leifmadsen_ | I thought you were talking about the zfs filesystem | 17:39 |
| leifmadsen_ | I was so confused | 17:39 |
| fdegir | nope | 17:39 |
| fdegir | sorry, laziness | 17:39 |
| leifmadsen_ | :) | 17:39 |
| fdegir | i also setup on ubuntu as well | 17:39 |
| leifmadsen_ | coolio | 17:39 |
| leifmadsen_ | this was Fedora only in my testing | 17:40 |
| fdegir | so both fedora and ubuntu worked for me | 17:40 |
| leifmadsen_ | awesome | 17:40 |
| leifmadsen_ | yea, other than package names, not sure much different | 17:40 |
| fdegir | there were few things i had to fix but they mght have been fixed on the latest version | 17:40 |
| leifmadsen_ | ideally I can get pabelanger to fix the GitHub package conflicts :) | 17:40 |
| leifmadsen_ | latest version is whatever is shown | 17:40 |
| fdegir | zookeeper setup is different on ub7ntu | 17:40 |
| leifmadsen_ | if you find issues, best to note them otherwise I won't find it | 17:40 |
| leifmadsen_ | ah ok | 17:41 |
| leifmadsen_ | yea, in that case, not really a high level priority for me | 17:41 |
| fdegir | and on fedora, zookeeper logging doesn’t work | 17:41 |
| fdegir | need log4j in CLASSPATH | 17:41 |
| leifmadsen_ | would be ideal to note that in the docs for me | 17:41 |
| fdegir | at least it was like that for me | 17:41 |
| leifmadsen_ | I will forget all of this in about 15 seconds | 17:41 |
| fdegir | i’m recording them on my side | 17:41 |
| fdegir | once you start moving things to official docs, i can perhaps read it, those pieces and send for review | 17:42 |
| fdegir | and also I can add ubuntu instructions as well if anyone is interested | 17:42 |
| *** JasonCL has quit IRC | 17:44 | |
| *** JasonCL has joined #zuul | 17:45 | |
| *** JasonCL has quit IRC | 17:55 | |
| *** JasonCL has joined #zuul | 17:58 | |
| *** jpena is now known as jpena|off | 18:18 | |
| *** hashar is now known as hasharDinner | 18:19 | |
| *** jkilpatr has quit IRC | 18:19 | |
| *** jkilpatr has joined #zuul | 18:33 | |
| *** JasonCL has quit IRC | 18:41 | |
| *** JasonCL has joined #zuul | 18:49 | |
| *** JasonCL has quit IRC | 18:53 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Add support for a secure ZooKeeper configuration https://review.openstack.org/531882 | 18:56 |
| Shrews | ^^^ made me realize that we (maybe just me?) have woefully neglected the secure stuff. | 18:56 |
| corvus | Shrews: i think we deferred it at the time. now is a good time to address it. :) | 18:59 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Rename _useBuilder method to useBuilder https://review.openstack.org/531883 | 18:59 |
| *** JasonCL has joined #zuul | 19:00 | |
| *** harlowja has joined #zuul | 19:19 | |
| clarkb | leifmadsen_: fdegir re zookeeper stuff like that is why I have suggested in the past it might be easiest to just use the official zookeeper docs for installing and configuring that | 19:24 |
| clarkb | rather than rely on per distro packaging and docing all those differences ourselves | 19:24 |
| *** jkilpatr has quit IRC | 19:33 | |
| SpamapS | leifmadsen_: where can I watch/review your getting started work? I've now brought up zuulv3 3 or 4 times so I'd like to help (but have found little time to "get started" on the "get started" docs myself. ;) | 19:34 |
| leifmadsen_ | https://gist.github.com/leifmadsen/93b9283d10dfddba096e32fb172cf569 | 19:34 |
| leifmadsen_ | WIP | 19:34 |
| leifmadsen_ | at this point, everything "works" on Fedora, but there isn't really much in the way of configuration for zuul itself yet | 19:35 |
| leifmadsen_ | that's what pabelanger and I are going to do tomorrow | 19:35 |
| leifmadsen_ | SpamapS: that's the issue :) everyone says they want to write docs, then real work gets in the way | 19:36 |
| SpamapS | leifmadsen_: well also I could sit down and hammer something out but it would likely duplicate what you've done. Can't birth a baby with more mommies. ;) | 19:37 |
| leifmadsen_ | :) | 19:37 |
| leifmadsen_ | yea, at this point, the docs get Zuul installed | 19:37 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: Support cross-source dependencies https://review.openstack.org/530806 | 19:37 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Move CRD tests to test_gerrit_legacy_crd https://review.openstack.org/531886 | 19:37 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add skipped CRD tests https://review.openstack.org/531887 | 19:37 |
| leifmadsen_ | but there is almost no configuration | 19:37 |
| leifmadsen_ | so it's still a thing | 19:37 |
| leifmadsen_ | just doesn't get you very far | 19:38 |
| SpamapS | Yeah that actually turns out to be a huge challenge. | 19:38 |
| SpamapS | Especially getting a good working base job. | 19:38 |
| leifmadsen_ | yep. in theory fungi is working on a new base job that can be easily consumed, and pabelanger has this gtest-org that we're probably going to make work as an example configuration | 19:38 |
| leifmadsen_ | the idea being that you can use the git module and consume a repo that will give you something "working" | 19:39 |
| SpamapS | I still kind of wish there was a way to make Zuul automatically run every single job that parents to a job you're changing. like 'check: { jobs: $children }' or something like that. | 19:39 |
| SpamapS | I have a pretty stripped down base job that works for me in single-server mode. I'm happy with it. But one thing I had to do was mount in my log target to bwrap so I didn't have to scp things back to the same server. | 19:40 |
| SpamapS | That is nice for single server but not when I make my second executor. :-P | 19:41 |
| fungi | leifmadsen_: SpamapS: the new base job exists. it's in the git.openstack.org/openstack-infra/zuul-base-jobs repo | 19:41 |
| leifmadsen_ | rock | 19:41 |
| fungi | i just need to update the zuul user guide to mention where to find it | 19:41 |
| fungi | https://docs.openstack.org/infra/zuul-base-jobs/ | 19:41 |
| *** JasonCL has quit IRC | 19:51 | |
| *** JasonCL has joined #zuul | 19:55 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Add support for a secure ZooKeeper configuration https://review.openstack.org/531882 | 19:57 |
| dmsimard | Shrews, gundalow, rcarrillocruz: how bad of an idea would it be to override/overload the ssh connection plugin ? I'd like to have a more verbose error here (with the exception stack traces) https://github.com/ansible/ansible/blob/devel/lib/ansible/plugins/connection/ssh.py#L520-L535 | 20:00 |
| dmsimard | We're getting a lot of UNREACHABLE tasks and "Make sure this host can be reached over ssh" is not super helpful | 20:00 |
| dmsimard | Working our way up the stack traces may prove helpful in seeing what kind of bottleneck or problem we're hitting | 20:01 |
| *** jkilpatr has joined #zuul | 20:11 | |
| Shrews | no idea | 20:11 |
| dmsimard | I suppose we could also be hitting https://github.com/ansible/ansible/blob/devel/lib/ansible/plugins/connection/ssh.py#L867 actually | 20:13 |
| dmsimard | exit code 255 in ssh is fairly catch all | 20:15 |
| rcarrillocruz | yup, that except is actually hiding the issues | 20:22 |
| rcarrillocruz | you could play with traceback | 20:22 |
| rcarrillocruz | or with q | 20:22 |
| rcarrillocruz | to debug what it actually is the exception | 20:22 |
| rcarrillocruz | in other news | 20:22 |
| rcarrillocruz | http://zuul-web-9000-ansible-networking-zuul-ci.38.145.34.172.nip.io/ | 20:22 |
| rcarrillocruz | mucho bonito | 20:22 |
| rcarrillocruz | i like the new dashboard | 20:22 |
| hasharDinner | hello! If there is any Gerrit review, https://review.openstack.org/#/c/162315/ "Migrate zuul timer to apscheduler version 3.0" can be abandonned. That has been done later via https://review.openstack.org/#/c/260637/ | 20:26 |
| dmsimard | rcarrillocruz: yeah the zuul dashboard is neat | 20:28 |
| *** openstack has quit IRC | 20:38 | |
| *** openstack has joined #zuul | 20:42 | |
| *** ChanServ sets mode: +o openstack | 20:42 | |
| hashar | my last comment is about making that change to bump Paramiko minimum version and move a few imports back at the top of the file | 20:43 |
| openstackgerrit | Antoine Musso proposed openstack-infra/zuul master: zuul-cloner: recognizes bare repos in cache dir https://review.openstack.org/249207 | 20:45 |
| hashar | ^^ is another example :] | 20:46 |
| fungi | that's the one i was talking about above | 20:50 |
| corvus | fungi, hashar: the only reason we haven't merged v3 onto master is that we haven't landed the puppet-openstackci changes to make it safe for people using that | 20:52 |
| corvus | other than that delay, we would have done it already | 20:52 |
| hashar | corvus: so I guess master / 2.x is under embargo utnil the merge happens isn't it ? | 20:52 |
| hashar | "until" | 20:53 |
| corvus | hashar: i feel that way -- i made what i thought would be the last 2.x release; i'm focused tightly on making a v3.0 release and don't have the bandwidth to do any more on 2.x | 20:53 |
| corvus | (we're hoping to do the 3.0 release no later than the end of feb) | 20:54 |
| hashar | and I guess most of your third parties are on (or are migrating to) Zuul v3 | 20:54 |
| corvus | hashar: more than i would have expected, actually :| | 20:54 |
| hashar | Wikimedia is probably going to stick to v2 + a few patches for most of 2018 | 20:55 |
| hashar | so that is like a v2 fork :] | 20:56 |
| hashar | fungi: corvus: I will rebase all the changes I got cherry picked against the tip of master. But if 2.x is frozen, dont bother reviewing / merging them I guess | 20:57 |
| hashar | and maybe one day I will catch up with v3! | 20:57 |
| corvus | hashar: i hope so! | 20:58 |
| fungi | cool, so just to confirm, we should consider master basically frozen until we merge the feature branch into it | 20:59 |
| corvus | fungi: let's go with 'yes' | 21:01 |
| openstackgerrit | Antoine Musso proposed openstack-infra/zuul master: Add __repr__ to a few classes https://review.openstack.org/361064 | 21:01 |
| hashar | should I mark my patches as WIP ? | 21:01 |
| corvus | and review https://review.openstack.org/523951 if folks have time | 21:01 |
| corvus | hashar: i wouldn't worry about it | 21:02 |
| hashar | OK :] | 21:03 |
| *** openstackgerrit has quit IRC | 21:03 | |
| *** openstackgerrit has joined #zuul | 21:18 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: Support cross-source dependencies https://review.openstack.org/530806 | 21:18 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Remove updateChange history from github driver https://review.openstack.org/531904 | 21:18 |
| *** JasonCL has quit IRC | 21:18 | |
| pabelanger | any suggestions on how to fake some memory values? | 21:20 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Add memory awareness to system load governor https://review.openstack.org/508960 | 21:25 |
| pabelanger | SpamapS: okay, rebase ^. going to see how we can come up with a test | 21:25 |
| hashar | pabelanger: "just" mock psutil.virtual_memory() to yields whatever you need ? :D | 21:30 |
| pabelanger | hashar: yah, that's my first guess. Wasn't sure if there was another suggestion | 21:33 |
| clarkb | pabelanger: you need to ballon your memory usage? | 21:34 |
| clarkb | you are probably better off mocking or faking whatever it is that is checking memory usage | 21:34 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Correctly use project name in getGitUrl https://review.openstack.org/528309 | 21:35 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Initialize github auth in getGitUrl if needed https://review.openstack.org/528310 | 21:35 |
| pabelanger | clarkb: okay, I can look into doing that first | 21:36 |
| clarkb | or set the check threshold so low that you'd always trip it just from the zuul test suite running | 21:36 |
| clarkb | eg 1 bte | 21:36 |
| clarkb | *1 byte | 21:36 |
| corvus | yep, this is a good use of mocks :) | 21:37 |
| hashar | pabelanger: and probably you can refactor the check of load and memory limits to a couple standalone functions. Might end up nicer than all those if elif elif :D | 21:38 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/zuul feature/zuulv3: Link to zuul-base-jobs docs from User's Guide https://review.openstack.org/531912 | 21:39 |
| fungi | corvus: i've got a conflicting engagement with the zuul meeting today, but ^ is hopefully the next bit to filling the stdlib base job gap | 21:39 |
| fungi | leifmadsen_: SpamapS: as mentioned in our earlier discussion ^ | 21:39 |
| pabelanger | hashar: agree, I was thinking of doing that after I get some tests working | 21:39 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Use configured github server in app mode https://review.openstack.org/528311 | 21:39 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Fix github app authentication in _getNeededByFromPR https://review.openstack.org/528312 | 21:39 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Add the project to GithubUser https://review.openstack.org/528313 | 21:39 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Reprime the installation map in getGitUrl if needed https://review.openstack.org/529506 | 21:39 |
| hashar | pabelanger: also you could have manageLoad be a wrapper that retrive the memory and load then invoke something like IsWithInLimits(load, mem) which would then be trivial to unit test | 21:39 |
| hashar | oh and Zuul supports Github nowadays nice | 21:40 |
| *** dkranz has quit IRC | 21:43 | |
| corvus | hashar: yeah, we're up to 3 source drivers now: github, gerrit, git (bare git is limited and is basically a read-only driver for dependencies at the moment). but the api is definitely getting fleshed out. :) | 21:44 |
| corvus | fungi: thanks! | 21:44 |
| mrhillsman | is it too farfetched of an idea for zuul to access an openstack environment via vpn? | 21:45 |
| fungi | corvus: there were several other places in the user's guide we _could_ conceivably also link to it, but wasn't sure whether they made sense, or whether we should centralize that link somewhat in the user guide and then refer back to wherever that central section is | 21:46 |
| fungi | so suggestions welcome, of course | 21:46 |
| fungi | mrhillsman: transport mode or tunnel mode? | 21:47 |
| fungi | tunnel mode is "easy" (as long as your gateways have tunnels preestablished for you) | 21:47 |
| clarkb | fungi: mrhillsman but also zuulv3 has been designed to better accomodate corporate network designs by making everything outbound connections | 21:48 |
| clarkb | so depending on why the vpn is there you may not need it? | 21:48 |
| mrhillsman | ah ok | 21:48 |
| mrhillsman | the VMs do not have public IP addresses | 21:49 |
| mrhillsman | no 4/6 address space available and zuul lives elsewhere | 21:49 |
| fungi | mrhillsman: yeah, then your zuul would need a route to those (which a vpn could provide) | 21:49 |
| clarkb | another option may be to run zuul-executor in the same network space | 21:50 |
| clarkb | then only manage that connection | 21:50 |
| fungi | true, could even multi-home the executor on internal and globally-addressed networks | 21:50 |
| clarkb | as for bouncing through a vpn it should just work though as long as the executor can route from itself to the vpn'd network | 21:50 |
| SpamapS | that then makes it so you have to have git access from the executor ;) | 21:50 |
| fungi | well, assuming egress is viable via nat/pat | 21:51 |
| mrhillsman | awesome, i need to get more VMs available and i have an openstack environment but it is behind a vpn | 21:51 |
| mrhillsman | thanks for the details | 21:51 |
| fungi | even a privately-addressed executor could still hit globally-routed git sources through egress nat | 21:51 |
| mrhillsman | will explore a few options | 21:51 |
| mrhillsman | the VMs can get out but all ingress is "blocked" | 21:52 |
| clarkb | mrhillsman: in that case running executor in that env may be easiest | 21:52 |
| mrhillsman | and nodepool? | 21:52 |
| dmsimard | zuul meeting in 7 minutes | 21:53 |
| clarkb | but I'm not sure if you can tell zuul that specific executors must be used to talk to specific test nodes | 21:53 |
| clarkb | mrhillsman: nodepool only talks to cloud apis not the test nodes | 21:53 |
| clarkb | (this assumes zuulv3) | 21:53 |
| mrhillsman | ah ok | 21:53 |
| mrhillsman | yes, using v3 | 21:53 |
| corvus | clarkb, mrhillsman: there's a story about executor affinity in storyboard. it's open for implementation if someone wants to work on it. | 21:54 |
| Shrews | clarkb: mrhillsman: nodepool will do a keyscan on the nodes | 21:55 |
| mrhillsman | maybe i can bug one of you next week to go over the architecture and get some guidanc | 21:55 |
| mordred | mrhillsman: ++ | 21:55 |
| clarkb | Shrews: hrm that does break the assumption that nodepool won't connect at all to test nodes | 21:55 |
| mrhillsman | i have a small openstack environment and there is a larger one being stood up but i think i will have limited root access but leeway to do as i please with quota | 21:56 |
| clarkb | so you may have to put the nodepool launcher in the same env | 21:56 |
| clarkb | or run both nodepool launcher and zuul executor on nodes that can route (via vpn or whatever) to the test nodes | 21:56 |
| corvus | mrhillsman, clarkb: https://storyboard.openstack.org/#!/story/2001125 | 21:56 |
| mordred | mrhillsman: I think it's a pattern that'll come up again ... and also once it's implemented it might also be useful in scale-out multi-cloud environments - so definitely useful to connect on architecture/guidance | 21:56 |
| mrhillsman | but i am sure i could have things re-architected if necessary | 21:57 |
| mrhillsman | cool | 21:57 |
| mrhillsman | agreed mordred - thinking blog mini-whitepaper for others to use | 21:57 |
| clarkb | corvus: idea is have executor register execute-job:$zone if it is configured with a zone? | 21:57 |
| corvus | clarkb: yep | 21:57 |
| corvus | clarkb: pretty sure storyboard ate some markup on bullet point #2 | 21:58 |
| clarkb | corvus: then any nodepool node sets with a zone set must uze execute-job:$zone rather than the default execute-job job | 21:58 |
| clarkb | makes sense | 21:58 |
| corvus | clarkb: yep | 21:58 |
| corvus | * Register the zuul:execute function as zuul:execute:<zone> | 21:59 |
| corvus | yep ^ | 21:59 |
| corvus | clarkb: i changed it to your metasyntactic markup :) | 21:59 |
| clarkb | the <zone> was killed by markdown | 21:59 |
| corvus | it's zuul meeting time in #openstack-meeting-alt | 22:00 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Add support for a secure ZooKeeper configuration https://review.openstack.org/531882 | 22:05 |
| corvus | jlk: are you around? can you join the zuul meeting ^ if you have a moment? | 22:08 |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool feature/zuulv3: Clarify provider manager vs provider config https://review.openstack.org/531618 | 22:11 |
| *** JasonCL has joined #zuul | 22:16 | |
| *** rlandy is now known as rlandy|bbl | 22:47 | |
| *** hashar has quit IRC | 22:58 | |
| clarkb | seriously though please take a few minutes to look over https://etherpad.openstack.org/p/zuulv3-issues and update anything you can and/or file bugs | 23:01 |
| clarkb | I've been interspersing that with other work and it does take a bit of time if you have to context switch in an entire problem to then go figure out what to do with it so if you already have some of that context it will likely go quicker for you | 23:01 |
| *** JasonCL has quit IRC | 23:04 | |
| *** JasonCL has joined #zuul | 23:05 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/nodepool feature/zuulv3: [WIP] webapp: add optional admin endpoint https://review.openstack.org/531718 | 23:06 |
| *** JasonCL has quit IRC | 23:09 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: Support cross-source dependencies https://review.openstack.org/530806 | 23:36 |
| mordred | gundalow: heads up - we're eversoslowly starting to turn on some zuul onto ansible/ansible - landing the patch that lets me update the shade job config to reference ansible/ansible now - will make sure that gets us the shade ansible-devel job set up properly, then will land the patch to start running shade's ansible functional tests on PRs to openstack modules | 23:36 |
| mordred | gundalow: so you still are currently unlikley to notice unless you just enjoy lurking on openstack patches - but thought I'd give you a heads-up anyway | 23:36 |
| clarkb | corvus: https://review.openstack.org/#/c/531618/ is refactor that I mentioned briefly when we had problems with the quota changes before we all took time off for holidays | 23:37 |
| corvus | clarkb: cool, thanks. i will look at that when my brain is not full of cross-repo-deps. :) | 23:40 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Add job for testing against devel of ansible https://review.openstack.org/531934 | 23:43 |
| *** JasonCL has joined #zuul | 23:49 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!