Monday, 2017-12-04

*** sshnaidm is now known as sshnaidm|off00:30
*** JasonCL has joined #zuul00:45
*** JasonCL has joined #zuul00:49
*** JasonCL has joined #zuul00:49
*** JasonCL has quit IRC02:02
*** JasonCL has joined #zuul02:03
*** JasonCL has joined #zuul02:03
*** JasonCL has quit IRC02:33
*** JasonCL has joined #zuul02:39
*** JasonCL has quit IRC02:41
*** JasonCL has joined #zuul02:42
*** JasonCL has quit IRC02:50
*** JasonCL has joined #zuul03:26
*** bhavik1 has joined #zuul03:57
*** JasonCL has quit IRC04:00
*** bhavik1 has quit IRC04:12
*** bhavik1 has joined #zuul04:12
*** clarkb has quit IRC06:02
*** xinliang has quit IRC06:32
*** clarkb has joined #zuul06:33
*** xinliang has joined #zuul06:44
*** xinliang has quit IRC06:44
*** xinliang has joined #zuul06:44
*** dmellado has quit IRC08:06
*** dmellado has joined #zuul08:08
*** dmellado has quit IRC08:18
*** dmellado has joined #zuul08:18
*** sshnaidm|off is now known as sshnaidm|rover08:40
*** Guest13268 is now known as zigo09:09
*** bhavik1 has quit IRC09:27
*** jaianshu has joined #zuul09:30
jaianshuHi09:43
jaianshuis this the right forum to ask issues related to nodepool?09:44
jaianshuwe are trying to set zuulv3 with nodepool...facing some issue with setup09:49
*** hashar has joined #zuul10:05
*** hashar has quit IRC10:09
*** jaianshu has quit IRC10:16
*** jaianshu has joined #zuul10:16
*** jaianshu has quit IRC10:23
*** electrofelix has joined #zuul10:24
*** jaianshu has joined #zuul10:28
*** openstackgerrit has joined #zuul11:00
openstackgerritTristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: web: add /{tenant}/jobs route  https://review.openstack.org/50327011:00
openstackgerritTristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: web: add /{tenant}/builds route  https://review.openstack.org/46656111:00
*** jaianshu_ has joined #zuul11:02
*** jaianshu has quit IRC11:06
tristanCjaianshu_: what issues are you facing?11:24
jaianshu_tristanC: in my provider i  created one nova instance and when i try to get info via 'nodepool alien-list' from host, i don't get any instance info..it shows empty.11:28
tristanCjaianshu_: does it shows when running "OS_CLOUD=provider_name openstack server list" ?11:33
*** jesusaur has quit IRC11:38
jaianshu_tristanC: yes, it shows here correctly thorough this...11:41
jaianshu_OS_CLOUD=<> --> cloud name here, not provider name11:41
jaianshu_i will paste my nodepool.yaml and clould.yaml...1 min11:42
tristanCjaianshu_: i meant when using the cloud attribute of your nodepool provider11:43
jaianshu_tristanC: yes, getting output from that11:44
*** jesusaur has joined #zuul11:45
jaianshu_here is my configuration and output : 1) ~/.config/openstack/clouds.yaml: http://paste.openstack.org/show/628069/   2)11:48
jaianshu_3) output of commands: http://paste.openstack.org/show/628071/11:48
jaianshu_2) /etc/nodepool/nodepool.yaml: http://paste.openstack.org/show/628070/11:49
*** jkilpatr has joined #zuul11:52
*** jesusaur has quit IRC11:52
tristanCjaianshu_: oh, this is nodepoolv2 right?11:52
*** jesusaur has joined #zuul11:55
jaianshu_tristanC: i installed it feature/zuulv3 branch one11:57
*** jkilpatr has quit IRC11:57
jaianshu_is this config that i followed belongs to nodepoolv2 ?11:57
tristanCjaianshu_: yes, nodepoolv3 has a slightly different format, see http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/nl01.openstack.org.yaml11:59
tristanCjaianshu_: though, not sure it explains why alien doesn't show up. do you have other issues?11:59
jaianshu_tristanC: ok..i will update the config and retry once and update12:00
*** jesusaur has quit IRC12:02
*** jesusaur has joined #zuul12:06
*** lennyb_ has quit IRC12:07
*** jkilpatr has joined #zuul12:10
ShrewsI am of the opinion now that we should just remove 'alien-list'. It's confusing. I believe it's purpose has morphed from "list leaked instances" (which is handled automatically now by the cleanup thread), to "show me all instances, whether used by nodepool or not". quite by accident, i think12:50
Shrewsshow me all *unaccounted for* instances12:51
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Remove alien_list command  https://review.openstack.org/52517712:57
*** jesusaur has quit IRC13:00
*** jesusaur has joined #zuul13:02
*** dkranz has joined #zuul13:02
*** myoung|ruck has quit IRC13:35
*** myoung has joined #zuul13:39
*** jaianshu_ has quit IRC13:43
*** myoung is now known as myoung|ruck13:48
*** jkilpatr has quit IRC13:53
*** dkranz has quit IRC14:18
*** jkilpatr has joined #zuul14:23
*** jkilpatr has quit IRC14:35
*** nguyentrihai has quit IRC14:40
*** nguyentrihai has joined #zuul14:40
*** jkilpatr has joined #zuul14:46
*** jkilpatr has quit IRC15:07
*** dkranz has joined #zuul15:25
Shrewsfyi, having major internet issues today at home. going to relocate to a nearby coffee shop.15:26
jeblairShrews: agree regarding alien-list15:39
jeblairjianghuaw_: are there any problems other than alien-list?15:39
*** jkilpatr has joined #zuul15:43
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Remove implied playbook extensions  https://review.openstack.org/52523915:44
*** hashar has joined #zuul15:46
jeblairi have a simple ansible question: can i have an ansible module (implemented in python) use multiple files in the liblary directory?  like, i want my module to be able to do something like "from . import utils"... is that possible?15:49
*** bhavik1 has joined #zuul15:49
dmsimardjeblair: question appropriate for #ansible-devel I think. I'm not aware of anyone doing that right now15:59
dmsimardopenshift-ansible tends to push these kind of boundaries but I'm not finding anything16:00
*** bhavik1 has quit IRC16:06
*** jkilpatr has quit IRC16:07
*** jkilpatr has joined #zuul16:07
mordredjeblair: there is a structure called module_utils that is what you're looking for16:15
jeblairmordred: thanks!16:15
Shrewsjeblair: cool. https://review.openstack.org/525177 removes it16:16
mordredjeblair: https://review.openstack.org/#/c/471921/ is a non-working change that uses the concept16:16
mordredjeblair: that might be useful to as a starting point16:16
gundalowjeblair: Hi. module_utils is where code that's shared between two or more modules should live. Bonus points awarded for added unit tests for such code16:17
gundalowThe __init__.py files under lib/ansible/modules/* MUST be empty.16:17
mordredgundalow: jinx ;)16:17
gundalow:D16:18
gundalowPlease note the deadlines on https://github.com/ansible/ansible/blob/devel/docs/docsite/rst/roadmap/ROADMAP_2_5.rst16:18
gundalowCore Engine Freeze and Module Freeze: 15 January 201816:18
gundalowNo more core (which includes module_utils) feature changes after 15th Jan16:18
mordredgundalow: oh, awesome, thanks. I've got a module related PR I need to finish ...16:18
gundalowPing in #ansible-devel for reviews16:19
dmsimardjeblair, mordred: I think there's a use case where zuul-cloner was convenient and the current implementation of required-projects doesn't work very well for that16:20
dmsimardIn TripleO, they currently need to have the whole planet in required-projects which leads the job preparation to take over 5 minutes: https://i.imgur.com/upYA0O1.png16:20
dmsimardwait, I think by typing that out I realized that I'm wrong16:21
mordreddmsimard: :)16:21
dmsimardEmilienM: ^ if you add a project as depends-on, it *will* be prepared, so the zuul-cloner shim will work.. But it'd be worth checking where you are still using zuul-cloner and understanding why we are using it16:22
EmilienMdmsimard: I don't care about git cloning projects, since we use delorean16:23
EmilienMI'm wondering why we git clone actually16:23
EmilienM(in tripleo ecosystem)16:23
dmsimardok, time to grep zuul-cloner and figure it out :p16:24
mordredEmilienM: for source dependencies, doesn't delorean need to build the packages from something?16:28
EmilienMyeah good question16:30
EmilienMI asked jpena to join here, he's the delorean guru16:30
*** jpena has joined #zuul16:33
jpenahi EmilienM16:34
EmilienMjpena: we're chatting about zuul and delorean - Monty asked: for source dependencies, doesn't delorean need to build the packages from something?16:34
EmilienMjpena: we're wondering if we actually need https://github.com/openstack-infra/tripleo-ci/blob/master/zuul.d/base.yaml#L1316:34
jpenaEmilienM: in the tripleo jobs, dlrn will build using the sources fetched by zuul16:36
dmsimardEmilienM: If the intent is to build a package with the patch that might be in nova if there's a depends-on involved, you need to have that patch checked out somewhere -- otherwise delorean doesn't need you to prepare anything, it's able to retrieve what it needs by itself16:36
EmilienMok16:36
EmilienMso we need https://github.com/openstack-infra/tripleo-ci/blob/master/zuul.d/base.yaml#L13 I guess16:36
EmilienMunless there is another way16:36
EmilienMto just clone what we need16:37
dmsimardEmilienM: again, you don't, because when there is a Depends-On, there's an "implied" required-projects added16:37
dmsimardEmilienM: it's not added to required-projects but it's checked out by zuul in the list of projects to prepare16:37
dmsimardEmilienM: in ara I could do a depends-on a nova patch and zuul will automatically prepare the repo with that patch16:37
EmilienMcool16:37
EmilienMso let's drop it?16:37
dmsimardEmilienM: the problem lies if you use zuul-cloner, it won't fallback to regular git clone if the project hasn't been prepared first16:38
dmsimardlet's move to #tripleo :D16:40
*** myoung|ruck is now known as myoung|ruck|bbl16:42
jeblairdmsimard: if you always want a nova git repo, whether depends-on or not, doesn't that suggest that nova should be in required-projects?16:43
*** jpena is now known as jpena|brb16:43
rcarrillocruzjeblair: heya, is there a tentative date for the feature/zuulv3 merge onto master?16:43
dmsimardjeblair: yeah, but tripleo doesn't always need nova, it only needs it if there is a depends-on16:44
jeblairrcarrillocruz: probably as soon as folks make puppet-openstackci safe for that16:44
jeblairrcarrillocruz: mmedvede is working on it16:44
dmsimardjeblair: but since zuul-cloner is used, it needs to be in required-projects still16:44
dmsimardjeblair: like, in their actual code, they use zuul-cloner16:44
dmsimard(example http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/playbooks/tripleo-buildimage/run.yaml#n24 )16:44
jeblairdmsimard: right, that suggests that it's always "needed" (in the immediate technical sense, if not in the larger abstract sense)16:45
dmsimardcorrect16:45
dmsimardonce we get rid of the zuul-cloner usage and patch holes accordingly, it will no longer necessary to have this larger list of required-projects16:45
jeblairdmsimard: do you want to make it so that jobs either use the prepared repo if it exists, or *no* git repo otherwise?16:45
dmsimard¯\_(ツ)_/¯16:46
rcarrillocruzjeblair: ack, thx16:46
dmsimardthat was pretty much the behavior of zuul-cloner in v216:46
jeblairdmsimard: zuul-cloner in v2 would have always made a git repo.  either with a dependent change or not.  it should be the same as adding something to required-projects16:47
dmsimardjeblair: right, but what I mean is that right now if the project is not in required-projects, the shim will fail. I'm torn on making the shim "fallback" to a regular clone because, while convenient, it might not incite people to move off of it16:47
jeblairdmsimard: i still don't understand the situation.  if you want to mimic the behavior of v2, add the project to required-projects.  why doesn't that work here?16:49
dmsimardMight cause bugs around the expectations of what the shim does, like getting a regular git clone when you really wanted a patch checked out16:49
dmsimardjeblair: the behavior of v2 did not force you to declare a list of projects you might need 1% of the time16:49
clarkbdmsimard: it did if you used zuul-cloner though16:49
mordredright. that's more how the base jobs / child jobs are organized16:50
jeblairdmsimard: that is, i think, where we aren't seeing eye-to-eye.  if the job *always* uses a git repo, then it requires it.  we're just moving that list from within the job itself to the job definition in zuul.  in all cases, you still needed/need to, somewhere, say "these are the git repos i need", and for projects like tripleo, it's a long list.16:50
dmsimardclarkb: right but zuul-cloner never failed, either it checked out a patch or it checked out a repo from the tip of the specified branch -- it's also used a bit everywhere in code versus in the job declaration16:51
mordreddmsimard: the same is true of required-projects - either it'll get you a patch or the tip of the branch ... the main shift/difference is using it in job definitions rather than inside of job scripts - it may require rethinking some of the job structure here16:53
dmsimardjeblair: yeah, there are some repos that we always need and where it's appropriate to always have them checked out through required-projects. For other cases (e.g, nova), they're only on a need basis and the code that is where we need to fix code (in tripleo) to make sure zuul-cloner is no longer used.16:53
mordreddmsimard: like, that playbook you pasted should be associated with a job that only lists those 8 repos in its required-projects16:54
mordredor something16:55
dmsimardI think we also have to account for the fact that, unless mistaken, the paths are slightly different between zuul-cloner and required-projects (i.e, workspace/namespace/project vs workspace/src/git.o.o/namespace/project)16:55
mordredright - workspace isn't actually a thing16:55
dmsimardbut that's on tripleo to address that16:55
jeblairdmsimard: considering a job that sometimes needs nova:  what does that job do with respect to nova in the cases where it doesn't need it?16:55
dmsimardneed to brb, picking up kids from school16:55
*** jkilpatr has quit IRC17:00
*** kmalloc has joined #zuul17:01
*** nhicher has quit IRC17:01
*** nhicher has joined #zuul17:10
*** nhicher has quit IRC17:12
*** nhicher has joined #zuul17:12
dmsimardhuh so it turns out that they no longer use zuul-cloner in that scenario already17:13
dmsimardthey use the git ansible module with a (parsed) refspec to check out17:13
dmsimardI think that's due to constraints when running third party from pure jenkins17:14
tobiashjlk: got the info today that github apps won't make it into ghe 2.12 :(17:17
tobiashjlk: but they're 'actively thinking about it'...17:17
tobiashso hopefully in 2.1317:17
SpamapSbummer17:20
SpamapSwould like to auto-subscribe installers.17:20
*** jpena|brb is now known as jpena17:25
*** jkilpatr has joined #zuul17:50
jeblairdmsimard: i strongly recommend against that approach.  preparing repos correctly is difficult, and is one of zuul's main reasons for existing.  i'm happy to discuss that further with respect to tripleo in particular in more appropriate channels, but i thought it important to mention here, lest folks get the wrong impression.17:58
dmsimardjeblair: I'm not in disagreement, however it is an approach that works if you're running from outside Zuul and want to retrieve that depends-on17:59
dmsimardall ears if there's another approach we should be taking17:59
jeblairdmsimard: let's choose a channel other than #zuul to discuss running things outside of zuul18:01
dmsimard#openstack-infra or #tripleo ?18:01
jeblaireither of those sound better, yes18:02
*** hashar is now known as hasharAway18:05
*** jpena is now known as jpena|away18:20
*** sshnaidm|rover is now known as sshnaidm|off18:23
*** jpena|away is now known as jpena|off18:48
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul feature/zuulv3: WIP: Add finger gateway  https://review.openstack.org/52527618:58
openstackgerritPaul Belanger proposed openstack-infra/zuul feature/zuulv3: Add command socket support to zuul-merger  https://review.openstack.org/52319719:17
*** myoung|ruck|bbl is now known as myoung|ruck19:21
*** jkilpatr has quit IRC19:34
*** jkilpatr has joined #zuul21:33
dmsimardjeblair: is there better documentation on how to use "start" somewhere ? https://docs.openstack.org/infra/zuul/feature/zuulv3/user/config.html#attr-pipeline.start21:35
openstackgerritSean McGinnis proposed openstack-infra/zuul-jobs master: Fix variable name in npm-publish job  https://review.openstack.org/52532621:36
*** dkranz has quit IRC21:37
dmsimardjeblair: I guess my real question is -- I'm trying to see if I can get zuul to post a message when it starts jobs in another pipeline a bit like how we do with gate jobs: http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul.d/pipelines.yaml#n8721:38
jeblairdmsimard: yeah, the detailed docs are driver dependent; i don't think we've figured out how to cross-ref them there21:43
jeblairdmsimard: so look under "reporter configuration" here for the driver that applies: https://docs.openstack.org/infra/zuul/feature/zuulv3/admin/connections.html21:44
pabelangerI think it is start_message, but cannot find it in docs21:45
jeblairhrm.  the docs for the gerrit reporter for leave something to be desired.  they should be expanded to look like the ones for github.21:45
*** hasharAway has quit IRC21:46
pabelangeryah, source says start-message, but looks like we don't document it21:46
dmsimardjeblair: an idea along those lines that I had a while back was this: https://storyboard.openstack.org/#!/story/200087321:53
dmsimardbut I know that your opinion is to keep zuul as hidden as possible :)21:53
dmsimardMeeting in 5 minutes in #openstack-meeting-alt right ?21:55
* dmsimard fixed his calendar21:55
jeblairdmsimard: i think zuul has support for that already.  it was reverted from hideci.js in openstack because no one, including its author, wanted to expend the effort to fix hideci.js.21:55
jeblairdmsimard: but the github driver uses it for its status link21:56
jeblairshould still work just as well for gerrit21:56
dmsimardinteresting, didn't know21:56
jeblairdmsimard: be aware gerrit-next has a dedicated channel for ci reporting, which changes all this substantially.21:56
dmsimardneat21:57
jeblairdmsimard: re meeting: yes21:58
jeblairmeeting now in #openstack-meeting-alt22:00
dmsimardmordred, pabelanger, Shrews, fungi, clarkb ^22:01
dmsimardSpamapS: ^22:01
*** myoung|ruck is now known as myoung|ruck|bbl22:11
*** myoung|ruck|bbl is now known as myoung|ruck22:11
openstackgerritPaul Belanger proposed openstack-infra/zuul feature/zuulv3: Move send_command() into ZuulApp  https://review.openstack.org/52321122:14
*** adam_g has quit IRC22:22
*** adam_g has joined #zuul22:24

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!