Thursday, 2017-11-09

*** dmsimard is now known as dmsimard|off00:22
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Refactor provider config to driver module  https://review.openstack.org/48838400:33
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Implement a static driver for Nodepool  https://review.openstack.org/46862400:33
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Implement an OpenContainer driver  https://review.openstack.org/46875300:33
*** fbouliane has quit IRC02:50
*** _ari_ has quit IRC02:51
*** patriciadomin has quit IRC02:51
*** dmellado has quit IRC02:51
*** leifmadsen has quit IRC02:51
*** _ari_ has joined #zuul02:56
*** fbouliane has joined #zuul02:56
*** patriciadomin has joined #zuul02:56
*** leifmadsen has joined #zuul02:57
*** dmellado has joined #zuul02:57
*** xinliang has quit IRC05:58
*** xinliang has joined #zuul06:11
*** pleia2_ has joined #zuul06:13
*** toabctl has quit IRC06:15
*** pleia2 has quit IRC06:15
*** SotK has quit IRC06:16
*** toabctl has joined #zuul06:19
*** clarkb has quit IRC06:22
*** toabctl has quit IRC06:26
*** toabctl has joined #zuul06:28
*** clarkb has joined #zuul06:30
openstackgerritIan Wienand proposed openstack-infra/zuul feature/zuulv3: More documentation for enqueue-ref  https://review.openstack.org/51866206:56
openstackgerritIan Wienand proposed openstack-infra/zuul feature/zuulv3: Make enqueue-ref <new|old>rev optional  https://review.openstack.org/51866306:56
openstackgerritIan Wienand proposed openstack-infra/zuul feature/zuulv3: Remove tools/trigger-job.py  https://review.openstack.org/51866406:56
*** EmilienM has quit IRC07:09
SpamapSmordred: we have a crapton of jenkins pipeline stuff here. It would definitely be useful if we could keep using those, but just have zuul kick them off. Especially if they were ultimately backed by the same nodepool and thus carry the same features of fast-start and image refreshing.07:34
*** EmilienM has joined #zuul09:32
*** hasharAway is now known as hashar10:00
*** electrofelix has joined #zuul10:24
*** hashar has quit IRC11:04
*** hashar has joined #zuul11:05
odyssey4memordred awesome, thank you11:10
*** jkilpatr has quit IRC11:47
*** hashar has quit IRC12:07
*** hashar has joined #zuul12:09
*** jkilpatr has joined #zuul12:22
leifmadsenhrmmm... is there functionality in v3 that lets me call an API directly rather than running an Ansible playbook?12:25
leifmadsenI guess really, the right way to do this, is call a simple playbook, and let Ansible do the triggering12:25
leifmadseninstead of building everything into Zuul...12:25
* leifmadsen needs to learn more...12:25
odyssey4meSpamapS mordred Shrews dmsimard|off I'm adding some notes for the first use-case - it'd be great if we could flesh it out a bit... perhaps even eventually build a spec12:37
*** pleia2_ is now known as pleia213:31
odyssey4meIs there a timeline on when the feature/zuulv3 branch will be merged into the master branch?14:30
jlkleifmadsen: yeah, the working model for that is to write a very simple playbook that can use an ansible module to poke at an API, or just a shell task to use curl or whatever. IF all you're doing is hitting a remote url, you can set the job up to not require a node, so that it'll run directly from the executor, super fast.15:06
leifmadsenjlk: awesome thanks, that's kind of what I got thinking after. Good to know about the executor trick too.15:30
*** patriciadomin has quit IRC15:38
*** patriciadomin has joined #zuul15:55
*** hashar is now known as hasharAway16:26
SpamapSodyssey4me: timeline no, but there's a roadmap.17:20
SpamapSodyssey4me: http://lists.openstack.org/pipermail/openstack-infra/2017-November/005657.html <-- this is the most recent statement of roadmap.17:21
odyssey4meSpamapS I guess I'm wondering what the reason is for holding back.17:22
odyssey4meI mean - zuulv3 is implemented, most openstack projects have converted their jobs and things are slowly settling there. Finding the right reference configs at the moment is somewhat confusing as one has to remember to switch to the feature branch.17:24
odyssey4meit's giving some of my colleagues the impression that it's not yet released17:24
SpamapSodyssey4me: you and I agree. jeblair is concerned we might be stuck supporting interfaces we don't want to if we release 3.0 now.17:26
pabelangeryah, I think we are catching our breath too. I know last few weeks have been pretty intense.17:27
odyssey4meok, so it's not really about the potential to have to switch back now... it's more about being confident with the interfaces17:27
odyssey4methat's fair enough17:27
odyssey4meI guess that makes us in a kind-of 3.0.0.0rc1 state then.17:28
SpamapSodyssey4me: agreed17:28
pabelangeryah, were past the rollback phase now. We're actively deleting zuulv2.5 / JJB content now.17:28
SpamapSThough I don't think it's RC yet. Specifically I think Jim would like to solidify cross-source dependencies, since that could disrupt the interface around Depends-On.17:28
odyssey4meperhaps more of a beta state then I guess17:29
pabelangeryes, he did meantion that a few time a summit this week17:29
SpamapSPersonally I'd like to just release. And let that evolve in a 3.117:29
SpamapSI'm in the same boat of like "zomg everybody look this is awesome" and hearing "um... a feature branch?"17:29
SpamapSmeanwhile OpenStack pumps thousands of jobs a day through it.17:30
odyssey4meWell, I'm looking at using nodepool and jenkins together for now and working through some things. I'm hoping to prototype a short-term hack out within the next week which will be a working implementation, but probably not the most elegant solution.17:31
SpamapSI wonder if we could release Nodepool 3.0 now.17:31
odyssey4meheh, continuous delivery... nothing is stable - everything is just one step to another17:31
SpamapSodyssey4me: yeah but semver is nice for making promises.17:32
odyssey4menodepool's docs are ok, although it'd be nice to autodoc the model somehow17:32
odyssey4mewell - not the model, actually the API17:32
SpamapSAnd 3.0 definitely has a whole new interface through ZK.. so right now we've made zero promises about that interface, even though it's unlikely to change much given Zuul's heavy use of it.17:32
odyssey4menodepool and zuul work through zookeeper, and therefore the data model in zookeeper is effectively an API - it'd be good to document which part of that model is intended as an API and which part is intended to be internal17:33
pabelangerodyssey4me: you still want jobs in jenkins? or bridge until you can get everything into zuulv317:34
odyssey4mepabelanger it is likely to be something transitional, but might last longer than we hope17:35
pabelangerodyssey4me: yah, talked with mordred about that this week. There is a good use case for sure17:35
odyssey4meyup, notes in https://etherpad.openstack.org/p/zuulv3-jenkins-integration - I added some more17:35
odyssey4meour initial integration is most likely going to be to add a daemon that monitors zookeeper for new nodes and registers them with jenkins (with labels)17:37
odyssey4methen in the jenkins jobs we'll use some groovy to feed the states back to nodepool17:37
odyssey4meonce we have something working I'll report back, given that I know there's some interest in this in a broader group17:38
SpamapSHeh..17:39
SpamapSthat daemon's written, and its name is "zuul 2.0" ;-)17:39
odyssey4meheh, yeah - I know17:40
odyssey4mealthough I though it might be better in this case to write a daemon which can execute any arbitrary command when a new node comes up17:41
odyssey4methen it could be used for any integration - jenkins, bamboo, whatever17:41
SpamapSThat's also pretty much what zuul is for. :)17:51
SpamapSReally you just need to run zuulv3 and write ansible that sets up the nodes that the zuul job gets allocated as jenkins slaves and then pokes the jenkins API to run on its jobs them.17:53
SpamapSThen the question just becomes about trigger sources.17:54
SpamapSwow.. that's quite a sentence there.. 'to run on its jobs them'18:02
SpamapSto run its jobs on them18:02
odyssey4meI'm out for the night - cheers all.18:03
*** electrofelix has quit IRC19:38
*** SotK has joined #zuul19:38
*** hasharAway is now known as hashar20:08
openstackgerritAndreas Jaeger proposed openstack-infra/zuul-jobs master: Add npm-docs job  https://review.openstack.org/51878920:32
*** jkilpatr has quit IRC20:56
*** jkilpatr has joined #zuul21:13
*** hashar has quit IRC23:24

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!