Thursday, 2019-03-21

openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: executor: use node python path  https://review.openstack.org/63733900:03
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool master: Add python-path option to node  https://review.openstack.org/63733800:12
tristanCcorvus: i have seen it though it's pretty low priority for me atm. should i work on it sooner?00:14
*** jamesmcarthur has quit IRC00:27
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: executor: enable zuul_return to update Ansible inventory  https://review.openstack.org/59009200:38
*** daniel2 has joined #zuul00:52
*** jamesmcarthur has joined #zuul00:58
*** jamesmcarthur has quit IRC01:15
*** jamesmcarthur has joined #zuul01:16
*** jamesmcarthur has quit IRC01:39
*** jamesmcarthur has joined #zuul01:40
*** jamesmcarthur has quit IRC01:44
*** jamesmcarthur has joined #zuul02:35
*** jamesmcarthur has quit IRC02:59
*** jamesmcarthur has joined #zuul03:04
*** jamesmcarthur has quit IRC03:18
*** jamesmcarthur has joined #zuul03:19
*** jamesmcarthur has quit IRC03:49
*** bjackman has joined #zuul04:24
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: zuul-runner: add command line interface  https://review.openstack.org/64477004:37
tristanCjhesketh: ^ fixes issues in the zuul-runner command line, it's now working as before04:38
*** bjackman has quit IRC04:39
tristanCnow i'm not sure how to rebase the remaining changes (/connections endpoint, depends-on support, --list-parameters, ...). I guess we should wait for the base of the stack review04:40
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: webtrigger: add support for parameterized trigger  https://review.openstack.org/64448404:54
jheskethtristanC: yeah, I wouldn't spend too long on keeping them up-to-date given how reviewing has been going. Lets get the base in and then rethink how we want to approach the rest04:58
tristanCjhesketh: alright, well at least that last zuul-runner patch can be used to test the code and run a job locally with the cli05:09
jhesketh+105:10
tristanCand i'll wait for review before continuing to work on that topic for now05:11
*** bjackman has joined #zuul05:24
*** pcaruana has joined #zuul06:11
*** saneax has joined #zuul06:41
tristanCthe tarball published at http://tarballs.openstack.org/zuul/zuul-3.7.0.tar.gz doesn't have symlinks, the zuul plugin code are copied to each ansible version directories. well it's not an issue, just an odd content.06:58
*** openstackgerrit has quit IRC08:17
*** jpena|off is now known as jpena08:45
*** themroc has joined #zuul08:56
*** hashar has joined #zuul08:59
*** gtema has joined #zuul09:42
*** pcaruana has quit IRC09:45
*** pcaruana has joined #zuul09:46
*** zbr has quit IRC10:08
*** zbr has joined #zuul10:09
*** zbr has quit IRC10:16
*** electrofelix has joined #zuul10:16
*** zbr has joined #zuul10:21
*** zbr has quit IRC10:22
*** Corran has joined #zuul10:41
Corranhey does zuul work with gitlab?10:42
*** zbr has joined #zuul11:38
*** panda is now known as panda|lunch11:52
*** jpena is now known as jpena|lunch12:01
mgoddardHello Zuul. I'm writing an upgrade job. Is it possible to list a required project twice with different branches - as the source and target of the upgrade?12:06
*** jamesmcarthur has joined #zuul12:11
*** rf0lc0 is now known as rfolco12:16
*** jamesmcarthur has quit IRC12:30
*** jamesmcarthur has joined #zuul12:31
*** gtema has quit IRC12:35
*** jamesmcarthur has quit IRC12:35
*** yolanda has joined #zuul12:46
*** bjackman has quit IRC12:53
*** bjackman has joined #zuul13:03
*** panda|lunch is now known as panda|sick13:07
*** irclogbot_2 has quit IRC13:07
*** swest has quit IRC13:09
*** irclogbot_3 has joined #zuul13:10
*** jamesmcarthur has joined #zuul13:10
pabelangerCorran: currently no, there is no gitlab driver. You can use the git driver, but won't get most of the features zuul offers for gating.13:19
*** gtema has joined #zuul13:19
*** jpena|lunch is now known as jpena13:20
*** altlogbot_1 has quit IRC13:23
*** altlogbot_2 has joined #zuul13:25
*** gtema has quit IRC13:35
*** altlogbot_2 has quit IRC13:39
mordredCorran: people have expressed interest in the past in writing a driver, but that hasn't materialized. also, I think the gitlab api is similar to the github api, so I imagine it would not be SUPER hard to write one copying the github driver. but so far we don't have a developer to do it13:40
*** altlogbot_3 has joined #zuul13:42
*** irclogbot_3 has quit IRC13:45
*** irclogbot_0 has joined #zuul13:47
*** bjackman has quit IRC13:54
CorranThanks for answer! :)13:55
*** gtema has joined #zuul14:08
*** gtema has quit IRC14:15
*** gtema has joined #zuul14:19
fungimgoddard: i'm not sure what you're going for exactly, but zuul preps all branches for you automatically (so if there is a change ahead in a dependent pipeline or as an explicit depends-on or git parent, that will be included in the merges which make up the tips of the respective branches)14:21
*** themroc has quit IRC14:22
fungimgoddard: so your upgrade job can checkout oldbranch in that repo, do some things, then checkout newbranch and do some other things, and the corresponding heads for those already include the expected references14:22
mgoddardfungi: interesting, that sounds like just what I want, but hadn't considered checking for other branches14:23
fungibasically zuul is already branch aware, so all branches of the repos it prepares are for the prospective future states described by the build14:23
mgoddardfungi: so a branch listed in the required-project is only the initially checked out branch?14:23
fungii'd have to see an example, but i think you're talking about a branch filter (which would claim that these are the only branches for which this should be a required project)14:24
fungithe initially checked-out branch will normally be the same name as the target branch for the change being tested, or "master" if there is no branch in a given repository by that same name14:25
mgoddardfungi: https://github.com/openstack/kayobe/blob/master/zuul.d/jobs.yaml#L3714:26
mgoddardfungi: override-checkout - the naming makes sense14:26
*** jamesmcarthur has quit IRC14:29
fungioh, yes in that case it overrides the branch zuul would have normally checked out initially, but doesn't prevent zuul from still prepping all relevant branches for you14:30
*** themroc has joined #zuul14:31
*** gtema has quit IRC14:32
*** jamesmcarthur has joined #zuul14:35
*** altlogbot_3 has quit IRC14:35
jamesmcarthurcorvus: apologies for the delayed reply. I found the meeting time here (https://wiki.openstack.org/wiki/Meetings/Zuul).14:36
jamesmcarthurI'll be sure to remove that from my schedule :)14:36
jamesmcarthurcorvus: Re: meeting - discussing over email is fine as well. I hadn't gotten too much traction on my post regarding the board slide deck.14:37
*** altlogbot_2 has joined #zuul14:37
jamesmcarthurSo mainly I wanted to see how I could help.14:37
corvusjamesmcarthur: ah thanks!  i'll clean up that page :)14:37
mgoddardfungi: great, thanks for the help14:37
*** irclogbot_0 has quit IRC14:38
fungiwow, i forgot we even had that page14:38
fungibut yeah, those meetings were primarily used to coordinate work towards the v3 release14:39
*** irclogbot_2 has joined #zuul14:40
*** saneax has quit IRC14:43
mgoddardfungi: slight hurdle, I'm not sure how to change the branch on the executor. It's not a critical issue, just makes it a little harder to generate templates (I have a workaround for that already though)14:48
mgoddardfungi: local commands are prevented14:48
mordredI think the git module should work14:50
fungimgoddard: that's getting beyond my ken, but perhaps we allow use of ansible's git module?14:50
mordredwe only prevent it from touching directory paths outside of the work_root14:50
mgoddardwith delegate_to: localhost?14:50
*** panda|sick is now known as panda|drappt14:50
fungii expect just setting host: loclahost would work, but i really don't know14:51
mordredyou can  just do a play with hosts: localhost and tasks: - git: blah14:51
mordredfungi: we're in sync today :)14:51
mgoddardok, guess I'll have to break up my mega play14:51
fungii shall endeavor to get out of sync, you seem to have a better handle on this ;)14:51
mordredmgoddard: delegate_to: localhost should also work if youv'e got a larger structure you're needing to do things in the context of14:52
mgoddardmordred: I'll try that14:53
mgoddardthanks mordred and fungi14:53
fungimy pleasure!14:53
*** themroc has quit IRC14:54
*** themroc has joined #zuul14:58
*** Corran has quit IRC15:03
*** themroc has quit IRC15:04
dmsimardIf I have patch A in project X that Depends-On patch B from project Y -- if I rebase or submit a new patchset on patch B and there were ongoing jobs for patch A, Zuul will abort everything on patch A and mention "This change depends on a change that failed to merge."15:08
dmsimardThe message is not very accurate of what just happened -- should this case be handled differently ?15:09
corvuslikely so :)15:16
clarkbThe message is incredibly accurate to the point of being misleading :P15:16
clarkbat least when using Gerrit15:16
mordredyeah.15:24
dmsimardwell, maybe we're not looking at a different message15:25
mordredwhat I'd LOVE is if the A jobs were restarted on the new version of the B15:25
dmsimardshould the jobs for the dependant patches be restarted with the new ref automatically ?15:25
dmsimardmordred: that would imply that the scheduler is able to find all depended-on patches for a single patch. Is it able to do that ?15:26
mordredwell, it cancels the relevant jobs right now, so it knows which things are relevant15:27
*** jamesmcarthur has quit IRC15:27
mordredI said relevant twice. my brain is mushy15:27
dmsimardmordred: good point15:29
dmsimardI mean, about finding the relevant things15:29
mordredthe brain mush is also a good point, I promise :)15:29
dmsimardthat's when there are ongoing jobs15:29
mordredyeah. I don't think it should automatically do anything with jobs it wouldn't otherwise cancel15:30
*** jamesmcarthur has joined #zuul15:45
*** jamesmcarthur has quit IRC15:50
*** jamesmcarthur has joined #zuul15:54
*** openstackgerrit has joined #zuul15:59
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool master: Update docs for provider removal.  https://review.openstack.org/64522015:59
corvustobiash: http://logs.openstack.org/34/645034/1/check/tox-py35/d35ee3e/testr_results.html.gz looks like a legit failure in the uri module fix... i'm puzzled16:10
corvusoh!  we're testing the 'path' attribute in that test16:12
corvuswas that ever a thing?16:12
clarkbpath was available in 2.5's normal module16:14
corvusright, but did the uri module actually use it?16:14
clarkbbut it was an internal var not set directly by the user16:14
corvusokay, i think we should update the test case to use 'dest'16:16
corvus(for all versions)16:16
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Fix Ansible 2.7 uri module  https://review.openstack.org/64503416:18
corvustobiash, clarkb: ^16:18
*** jamesmcarthur has quit IRC16:29
mgoddardfungi: mordred: just to follow up, zuul says no to git module + delegate_to: localhost: http://logs.openstack.org/40/616640/20/check/kolla-ansible-centos-source-upgrade/b103cf3/job-output.txt.gz#_2019-03-21_15_22_20_43795516:46
pabelangermgoddard: yah, you need to be trusted playbook for git on localhost16:46
mgoddardpabelanger: ah, that makes sense. Sensible not to trust my garbage playbook16:47
pabelangermgoddard: there is a topic on ML right now about removing that restriction, if you are interested in reading up more on it16:48
mgoddardIs there a trusted role available for checking out a branch of required projects?16:48
pabelangermgoddard: my first question would be why do you want to do that on the executor? The node should have a copy of everything pushed to it, that you can modify16:49
mgoddardcontext: writing an upgrade job, need to be able to change branches mid-run16:49
fungii think you could just break that out into a separate playbook and stick it in a trusted repository, then call it from the job in your untrusted repo16:49
mgoddardthat mostly works for us, but templates must be on localhost16:50
mgoddardI have a workaround to fetch the template to the executor16:50
mgoddardI'll probably just stick with that for now16:50
fungiidea being you have more oversight for playbooks added to trusted repos, and proposed changes to them won't be executed speculatively16:50
pabelangerah, so you want to change which branch ansible-playbook on executor is using for a run16:50
mgoddardpabelanger: yes16:51
mgoddardthinking about it, that could get messy16:52
fungiout of curiosity, what is the job doing on the executor such that it needs other git states there rather than on a remote job node?16:52
mgoddardgiven that the playbook being executed is in that repo16:52
mgoddardfungi: executing the template module on a file in the repo. The template source has to be on the executor16:53
fungiahh, okay. i'm unfamiliar with the template module or what you might use it for in that context16:53
pabelangerso, I think you could do nested ansible.. which kinda changes your jobs.  However, I've often thought it would be neat, for deloyment jobs, if you could some how reuse the same node for a series of jobs to run.16:53
pabelangerI can't think of a way to change brances between pre-run / run either16:54
pabelangerunless you had a trusted playbook some how modify the work_dir16:54
*** jamesmcarthur has joined #zuul16:55
mgoddardwe're doing nested ansible already - this is for testing kolla-ansible. Although that's an implementation detail here16:56
clarkbif you are doing nested ansible already why not chagne the branch on the inner ansible running on the test node?16:57
mgoddardthe inner ansible is the code under test17:00
clarkbya I think your upgrade job on the zuul size should run from a single branch17:00
clarkbthen it manipulates the branches of code under test17:00
*** jamesmcarthur has quit IRC17:01
clarkb*zuul side17:01
mgoddardI tend to agree now, having thought about it. Changing the executor code while executing it is asking for trouble17:01
mgoddardI think I have a plan, thanks all for your input17:02
openstackgerritFabien Boucher proposed openstack-infra/zuul master: wip - Elasticsearch Zuul reporter  https://review.openstack.org/64492717:10
openstackgerritFabien Boucher proposed openstack-infra/zuul master: wip - Elasticsearch Zuul reporter  https://review.openstack.org/64492717:11
openstackgerritLuigi Toscano proposed openstack-infra/zuul-jobs master: DNM Debug stage-output  https://review.openstack.org/64523917:12
*** hashar has quit IRC17:20
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool master: Update docs for provider removal.  https://review.openstack.org/64522017:21
*** gchenuet has joined #zuul17:26
gchenuetHi guys! Quick question about Nodepool and `boot-from-volume` option: Is there an option to delete volume when instances are deleted ?17:27
openstackgerritMerged openstack-infra/zuul master: Add missing Ansible invocation debug env variables  https://review.openstack.org/64503517:28
pabelangergchenuet: the volume should get deleted by default17:29
gchenuetpabelanger: thanks, i'll double check my config17:31
dmsimardgchenuet: I double checked to make sure and nodepool is supposed to set the "delete on termination" when creating VMs with boot-from-volume: https://opendev.org/openstack-infra/nodepool/src/branch/master/nodepool/driver/openstack/provider.py#L300-L30417:32
gchenuetdmsimard: i'm looking this file on the same time :)17:34
*** bjackman has joined #zuul17:36
*** gchenuet has quit IRC17:43
pabelangerit is possible you are leaking volumes, I have see that17:57
*** bjackman has quit IRC17:59
pabelangerat one point, we I know I raised the idea of having nodepool check for leaked volumes, then clean them up (like FIPs) but haven't pushed up any code for that18:00
pabelangerI think we needed to add something into shade / openstacksdk18:00
clarkbfwiw newer openstack seems to not leak volumes as much18:14
clarkbwe definitely saw leaking volumes on older openstack deployments but vexxhosts sjc1 which is rocky? doesn't seem to do it18:15
pabelangeryah, so far ansible-network tenant, haven't see any leaks in last 5 months18:15
*** jpena is now known as jpena|off18:22
openstackgerritFabien Boucher proposed openstack-infra/zuul master: wip - Elasticsearch Zuul reporter  https://review.openstack.org/64492718:39
*** electrofelix has quit IRC18:43
*** sshnaidm|rover is now known as sshnaidm|off19:03
openstackgerritFabien Boucher proposed openstack-infra/zuul master: wip - Elasticsearch Zuul reporter  https://review.openstack.org/64492719:13
openstackgerritMerged openstack-infra/zuul master: Fix Ansible 2.7 uri module  https://review.openstack.org/64503419:21
*** badboy has quit IRC20:06
openstackgerritJames E. Blair proposed openstack-infra/zuul-jobs master: Add fetch-sphinx-tarball role  https://review.openstack.org/64534620:51
openstackgerritJames E. Blair proposed openstack-infra/zuul-jobs master: DNM: test fetch-sphinx-tarball  https://review.openstack.org/64534720:51
openstackgerritJames E. Blair proposed openstack-infra/zuul-jobs master: Add fetch-sphinx-tarball role  https://review.openstack.org/64534620:52
openstackgerritJames E. Blair proposed openstack-infra/zuul-jobs master: DNM: test fetch-sphinx-tarball  https://review.openstack.org/64534720:52
openstackgerritJames E. Blair proposed openstack-infra/zuul-jobs master: Add fetch-sphinx-tarball role  https://review.openstack.org/64534621:04
openstackgerritJames E. Blair proposed openstack-infra/zuul-jobs master: DNM: test fetch-sphinx-tarball  https://review.openstack.org/64534721:04
*** pcaruana has quit IRC21:33
*** irclogbot_2 has quit IRC22:05
openstackgerritJames E. Blair proposed openstack-infra/zuul-jobs master: DNM: test fetch-sphinx-tarball and download-artifact  https://review.openstack.org/64534722:06
openstackgerritJames E. Blair proposed openstack-infra/zuul-jobs master: Add download artifact role  https://review.openstack.org/64538422:06
*** mgoddard has quit IRC22:08
*** mgoddard has joined #zuul22:09
corvustobiash: yay!  the uri fix fixed the docker promote jobs!  https://hub.docker.com/u/zuul23:24
*** jamesmcarthur has joined #zuul23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!