Tuesday, 2017-09-26

openstackgerritMerged openstack-infra/zuul feature/zuulv3: Merge project pipeline definitions  https://review.openstack.org/50716300:12
openstackgerritMerged openstack-infra/zuul feature/zuulv3: It's branches, not branch  https://review.openstack.org/50728500:13
*** jkilpatr has quit IRC00:16
* SpamapS is currently trying to write ansible to run ansible for a POC test where Ansible has been pinned to 2.2 for "reasons" :-P04:00
rbergeronthose reasons are not my fault04:06
rbergeron:)04:06
SpamapSIt is04:06
SpamapSall these stickers04:07
SpamapSit was bound to happen04:07
*** bhavik1 has joined #zuul04:08
*** bhavik1 has quit IRC04:46
openstackgerritTobias Henkel proposed openstack-infra/nodepool feature/zuulv3: Add username to build and upload information  https://review.openstack.org/45396805:04
openstackgerritTobias Henkel proposed openstack-infra/nodepool feature/zuulv3: Rename ssh_port to connection_port  https://review.openstack.org/50080005:04
openstackgerritTobias Henkel proposed openstack-infra/nodepool feature/zuulv3: Support username also for unmanaged cloud images  https://review.openstack.org/50080805:04
openstackgerritTobias Henkel proposed openstack-infra/nodepool feature/zuulv3: Add connection_type to build and upload information  https://review.openstack.org/50314805:04
openstackgerritTobias Henkel proposed openstack-infra/nodepool feature/zuulv3: Don't gather host keys for non ssh connections  https://review.openstack.org/50316605:04
openstackgerritTobias Henkel proposed openstack-infra/nodepool feature/zuulv3: Add connection_port to build and upload information  https://review.openstack.org/50411205:04
openstackgerritTobias Henkel proposed openstack-infra/nodepool feature/zuulv3: Improve test case node_assignment_at_quota  https://review.openstack.org/50613405:09
openstackgerritTobias Henkel proposed openstack-infra/nodepool feature/zuulv3: Honor cloud quotas before launching nodes  https://review.openstack.org/50383805:09
openstackgerritTobias Henkel proposed openstack-infra/nodepool feature/zuulv3: Don't fail on quota exceeded  https://review.openstack.org/50305105:09
openstackgerritTobias Henkel proposed openstack-infra/nodepool feature/zuulv3: Make max-servers optional  https://review.openstack.org/50428205:09
openstackgerritTobias Henkel proposed openstack-infra/nodepool feature/zuulv3: Support cores limit per pool  https://review.openstack.org/50428305:09
openstackgerritTobias Henkel proposed openstack-infra/nodepool feature/zuulv3: Support ram limit per pool  https://review.openstack.org/50428405:09
SpamapStobiash: you're busy tonight :)06:07
tobiashSpamapS: it's morning :)06:19
tobiashhad to rebase two stacks06:20
openstackgerritTobias Henkel proposed openstack-infra/nodepool feature/zuulv3: Add connection_port to build and upload information  https://review.openstack.org/50411206:35
*** hashar has joined #zuul07:11
*** xinliang has quit IRC07:55
*** timrc has quit IRC08:07
*** timrc has joined #zuul08:08
*** xinliang has joined #zuul08:08
*** xinliang has joined #zuul08:08
*** electrofelix has joined #zuul08:26
*** jkilpatr has joined #zuul10:54
*** jkilpatr has quit IRC10:59
*** jkilpatr has joined #zuul11:14
SpamapSmordred: well I figured out why zuul-web's aren't terminating. I am not getting any command streaming (I was thinking I was crazy expecting that to work.. but now I realize after seeing openstack jobs stream command output... it's just not in mine)12:02
SpamapSnow that I've spent 0300 - 0500 awake figuring that out... time for more sleep12:02
SpamapSif you have any clues as to what to check.. I'd appreciate them.12:03
* SpamapS zzzz12:03
*** timrc has quit IRC12:05
*** timrc has joined #zuul12:06
*** dkranz has joined #zuul12:24
mordredSpamapS: check your base job - is it running zuul_console?12:39
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Rename outfiles to zuul- to match rollout  https://review.openstack.org/50753513:24
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Sort list of required projects  https://review.openstack.org/50753613:24
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Set a max on timeout  https://review.openstack.org/50753713:24
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Sort fields in post playbook  https://review.openstack.org/50753813:24
dmsimard|offsorry for disappearing recently, I'm back13:39
*** dmsimard|off is now known as dmsimard13:39
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Rename outfiles to zuul- to match rollout  https://review.openstack.org/50753513:46
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Sort list of required projects  https://review.openstack.org/50753613:46
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Set a max on timeout  https://review.openstack.org/50753713:46
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Sort fields in post playbook  https://review.openstack.org/50753813:46
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Add local file copying steps  https://review.openstack.org/50754413:46
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Add local file copying steps  https://review.openstack.org/50754413:47
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Add local file copying steps  https://review.openstack.org/50754413:48
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Rename outfiles to zuul- to match rollout  https://review.openstack.org/50753515:05
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Sort list of required projects  https://review.openstack.org/50753615:05
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Set a max on timeout  https://review.openstack.org/50753715:05
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Sort fields in post playbook  https://review.openstack.org/50753815:05
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Add local file copying steps  https://review.openstack.org/50754415:05
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Add local file copying steps  https://review.openstack.org/50754415:07
*** dkranz has quit IRC15:09
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Add local file copying steps  https://review.openstack.org/50754415:17
mordreddmsimard: no worries! glad to have you back - and honestly, if I haven't said it - thanks a billion for diving in and helping with the v3 push -it's been really invaluable15:25
dmsimardmordred: sure thing, the plan is to keep helping infra and zuul :)15:29
SpamapSmordred: I use prepare-workspace, so yes15:29
dmsimardmordred: is now a good time to rebase my multi-node stacks I've been neglecting ?15:29
SpamapS2017-09-26 11:54:10.859891 | TASK [prepare-workspace : Start zuul_console daemon.]15:30
SpamapS2017-09-26 11:54:11.091048 | control | ok15:30
SpamapSmordred: and you can tell me to wait if you need to focus on infra15:30
*** hashar has quit IRC15:30
mordredSpamapS: I'll just ignore you when I need to focus on other things :)15:40
SpamapSkk15:40
SpamapSI'm trying to learn how to autohold so I can SSH into the nodes and see what's up.15:40
mordredSpamapS: so - if the zuul_console daemon is running on the remote node, the next thign to check is that you don't have 19885 on the node firewalled15:40
SpamapSFunny story: I've worked on zuul dev for a while now, but really never administered the whole end-to-end story.15:40
SpamapSmordred: OH! I likely do.15:41
mordredSpamapS: should be 'zuul autohold' on the scheduler15:41
SpamapSdurn security groups15:41
mordredSpamapS: at the moment (although I have some thoughts on how to improve this) the zuul_stream callback plugin fetches the logs from the remote node over 1988515:41
mordredSpamapS: it's one of the first things I want to dive in to post-rollout15:41
SpamapSseems like you could just get that over ssh?15:42
mordredSpamapS: as in forward a port? yes - that's one of the things I want to do15:47
mordreddmsimard: fun rebase for you ... we landed splitting openstack-zuul-jobs into a zuul.d dir15:48
SpamapShrm... how do I put nodepool nodes in a different security group? Though that would be obvious.15:54
jlkthat isn't an option in the provider config?15:56
SpamapSnot that I can find15:57
ShrewsSpamapS: it's not obvious b/c it's not supported15:57
mordredhoneslty not sure we have an option for that15:57
SpamapSweird15:57
jlkI wonder if we just altered the default security group for that tenant15:57
mordredwe don't use security groups round here, so it's never been added15:57
SpamapSwell but I have _a_ security group15:58
jlks/tenant/project/15:58
mordredyah - that's what we do - we just alter the default security group15:58
jlkyou have what OpenStack foists upon you15:58
SpamapSand that group is like, shared with all the other users I think.15:58
jlkah15:58
SpamapSI could be wrong15:58
jlkyou can alter that for the project15:58
SpamapSit could be templated and copied for each project?15:58
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Set a max on timeout  https://review.openstack.org/50753715:58
mordredSpamapS: yah - I can totally see the need for nodepool to have the option15:58
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Sort fields in post playbook  https://review.openstack.org/50753815:58
* SpamapS does some fishing15:58
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Add local file copying steps  https://review.openstack.org/50754415:58
jlkSpamapS: I believe that you can alter the "Default" security group for a project and it doesn't change any other project15:59
mordredSpamapS: yah - typically speaking each project gets its own copy of the default security-group15:59
jlk(anything else would be madness)15:59
mordredyah15:59
SpamapSOk that makes sense15:59
SpamapSI'll just zero it out :)15:59
jlkand we gave nodepool it's own project (not just a user in a shared project)15:59
SpamapSMy security group is fully inclusive.15:59
SpamapSYeah my nodepool has its own project. :)15:59
SpamapSI just didnt' realize that was a copy16:00
SpamapSMuch as I design, operate, and develop OpenStack.... using it is still kinda new for me. ;)16:00
jlkmordred: once you enable selecting a sec group, next people will want to be able to create/modify that sec group with rules, keeping them in sync across providers, and....16:00
jlkSpamapS: I hear that!16:01
pabelangerhttp://git.openstack.org/cgit/openstack/ansible-role-cloud-launcher ftw :)16:01
mordredSpamapS: you are not the only one for whom that is true :)16:04
mordredjlk: yah - that's one of the reasons we've held off on adding features like that until it's necessary :)16:04
jlkpabelanger: surely you could replace all that with a simple heat template.... :D16:05
SpamapSso 19885 is reachable now16:07
SpamapSbut no command output still16:07
SpamapShowever, no more streaming didn't exit messages! so yay16:07
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Consume project templates correctly in projects  https://review.openstack.org/50761616:08
SpamapSoh no16:08
SpamapSit's there16:08
SpamapSmordred: \o/16:08
SpamapSstreaming fully functional16:08
mordredjlk: if only heat was multi-cloud aware ...16:08
mordredSpamapS: woot!16:08
SpamapSmordred: I am almost ready to write up that 'getting started' doc :)16:08
jlkI was joking really. I have an unreasonable hatred for heat16:09
mordredjlk: I have yet to find an instance where it is the tool for the job I have at hand16:09
mordredso I don't actually have any feelings one way or the other16:09
SpamapSI do think there's something to be said for a tool which ties together cloud resources as a unit.16:09
SpamapSI just haven't ever gotten good enough at clouding to need that.16:10
jlkthere is a nicety there16:10
mordredSpamapS: jeblair and I started chatting with leifmadsen a few weeks ago giving him a walkthrough of setting things up - he was also goign to work on getting started16:10
jlkcreate a blob of resources, and wipe out a blob of resources16:10
SpamapSmordred: sweet16:10
mordredSpamapS: we havne't been able to follow up with him because rollout - but hopefully we'll do that again real soon16:10
mordredSpamapS: happy to invite you when we do16:10
jlkletting the cloud worry about the order in which resources get wiped16:10
SpamapSI think the toughest things for me were 1) understanding project-config<->zuul-jobs<->[all my repos] and 2) 19885? Is this written down somewhere? ;)16:10
mordredSpamapS: for 1) https://docs.openstack.org/infra/manual/zuulv3.html has some of that- but that's a thing that'll likely want to go into a general getting started guide16:11
mordredSpamapS: for 2 - I dunno?16:11
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Handle unknown project-template error  https://review.openstack.org/50761716:12
SpamapSmordred: I also think there's need for a "how to write zuul-ish playbooks" guide.16:14
SpamapScribbing from tox and stuff is too esoteric.16:14
leifmadsenmordred: yea all good, I've been preparing for 5 presentations at AstriCon next week. Once I get back, we could reconvene 2nd week of October16:15
leifmadsenSpamapS: and that sounds awesome16:15
leifmadsenbasically, my usage is, "how do I 'do a thing' with zuul" even if it's not immediately useful. How do I get it installed, and how do I use an event (likely from GitHub) to trigger a Hello World playbook.16:16
jeblairleifmadsen: that'll be great!  i'm sorry we got swamped, but i'm looking forward to resuming.16:16
leifmadsenFrom there, I want to run some of my own playbooks. I do no plan to use Zuul for OpenStack testing.16:16
leifmadsenintention for me is to use it as a simple platform to be triggered from GitHub events (commits, PRs, etc) and run the playbooks that we've written to spin up infrastructure, and validate they continue to deploy it16:17
leifmadsenin our particular case, it's a bunch of OpenShift and Kubernetes and CRI-O work16:17
leifmadsenI don't want to use Jenkins for that, and Prow is far too complicated for our use case16:17
mordredleifmadsen: yup. you are an excellent use case for us - and honestly can't wait to work with you on walking through stuff again16:17
leifmadsenI'm hoping Zuul fits the bill16:17
leifmadsenonce we have the technical docs on how to step through, I'll write a bunch of introduction documentation like I did for the Asterisk book16:18
leifmadsenI wrote the installation chapters for those books, so have some background on writing that kind of thing16:18
SpamapSleifmadsen: yeah let's collaborate on that. I've just gone through the process, and even for somebody who has been developing on Zuul and Ansible for a long time there were some dark corners I found myself in.16:20
jlkwoo another Github user16:20
leifmadsenyep, and I have no experience :)16:20
leifmadsenjlk: I just don't want to run Gerrit infra :)16:20
jlkindeed16:20
leifmadsenand then tie into GitHub where we're doing all our work anyways16:20
jlkthat's a huge reason why we spent time on the github driver set16:20
leifmadsen++16:20
jlkI'm very excited to have more users of that16:20
leifmadsenit's mostly just another guy and myself working on the playbooks, so there is zero reason for us to run infra like gerrit16:21
leifmadsenI've been waiting 18 months for it :)16:21
leifmadsenso thanks!16:21
jlkIs this on public gihtub?16:21
leifmadsenyes16:21
jlkoh man16:21
jlkso...16:21
leifmadsenpublic github --> zuul v3 --> RDO cloud16:21
leifmadseneventually RDO cloud == "magical machines somewhere"16:21
SpamapSjlk: hopefully we can get GH apps support in GHE and I can test the "real" driver soon. :)16:21
jlkmy team at IBM had been working on an implementation of Zuul, made available to any github.com project16:21
jlkoh16:21
leifmadsenyea, I didn't want to run a hosted service16:22
jlkI see16:22
leifmadsenI'm being pedantic on my usage for no reason other than I don't want to cheat :)16:22
jlkyou want your things touching your specific cloud16:22
leifmadsenyes16:22
pabelangerBYOC16:22
jlkthat was a "later" goal of ours, bring your own capacity16:22
leifmadsenpublic github, triggers "some CI" (zuul v3), which then runs that "somewhere":16:22
leifmadsenfor now it'll run on RDO Cloud because, hey, free cloud16:23
leifmadsenbut eventually I want this running on my own baremetal hardware in my home lab16:23
jlkwe'd run the control plane, but each tenant could bring their own capacity where the actions would run16:23
leifmadsenmy baremetal hardware will not be running OpenStack16:23
leifmadsenlikely something like Bifrost to provision it, then layer playbooks on it to build the infrastructure, then another layer to build the application and test it16:24
leifmadsenI have a vision! :)16:24
leifmadsenwe'll see where the gap analysis gets me16:24
jlkis that for ephemeral testing, or actual long lived deployment?16:25
jlklong lived deployment, would probably be more of Github -> Zuul -> ephemeral resource to run tests + deployment job -> deployment job interacts with long lived deployment resource to do the depliyment16:26
leifmadsenjlk: yea, I have kind of two use cases16:30
leifmadsenI have the long-lived which would be my RDO cloud usage16:30
leifmadsenthen there's just ephemeral testing with my baremetal hardware to know that "it still works!"16:30
jeblairjlk, clarkb: can you go ahead and review https://review.openstack.org/507617 when you get a sec?  would be nice to have that in if we restart later16:31
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Consume project templates correctly in projects  https://review.openstack.org/50761616:31
* jlk looks16:31
leifmadsenespecially since most of the work I'm doing is around infrastructure, so I want to test the deployment of said infrastructure :)16:31
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Don't emit yaml suffixes in run and post-run lines  https://review.openstack.org/50762416:37
rbergeronoh hey a leifmadsen16:42
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Handle unknown project-template error  https://review.openstack.org/50761716:51
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Don't emit yaml suffixes in run and post-run lines  https://review.openstack.org/50762416:51
leifmadsenrbergeron: pfffft just a facsimile16:56
rbergeron;)16:58
*** dkranz has joined #zuul16:59
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Print cloud location information in job header  https://review.openstack.org/50763117:21
*** jkilpatr has quit IRC18:03
*** jkilpatr has joined #zuul18:04
*** hashar has joined #zuul18:09
*** electrofelix has quit IRC18:25
dmsimardmordred, jeblair, pabelanger: in v2 we had 'trusted' nodes for executing particular jobs like signing and release.. in v3 are these no longer a thing because the keys and certificates are provided as secrets and can run on any executors ?18:45
mordreddmsimard: that is correct18:50
dmsimardokay, just making sure thanks18:50
tristanCdmsimard: hence the restricted-node-labels limit proposed here: https://review.openstack.org/#/c/506871/18:50
pabelangerdmsimard: things like upload to pypi are actually done from executor now18:56
*** ianw|pto is now known as ianw19:01
*** hashar has quit IRC19:06
dmsimardpabelanger: thanks19:06
*** hashar has joined #zuul19:23
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Multi-node: Set up connectivity with default OVS bridge  https://review.openstack.org/50455419:32
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Multi-node: Streamline multi-node-known-hosts  https://review.openstack.org/50462919:32
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Append /sbin and /usr/sbin to $PATH for 'ip' commands  https://review.openstack.org/50474319:32
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul feature/zuulv3: Return stream log message on finger client failure  https://review.openstack.org/50766319:48
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul feature/zuulv3: Return stream log message on finger client failure  https://review.openstack.org/50766319:49
*** jkilpatr has quit IRC19:50
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Don't output cat file contents during reconfig  https://review.openstack.org/50766519:54
*** jkilpatr has joined #zuul20:26
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul feature/zuulv3: We should await ws.send_str()  https://review.openstack.org/50767120:32
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Return stream log message on finger client failure  https://review.openstack.org/50766320:33
Shrews671 is a follow up to 663 ^^^20:34
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Don't output cat file contents during reconfig  https://review.openstack.org/50766520:42
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Ensure logs are readable before uploading them  https://review.openstack.org/50767320:46
openstackgerritMerged openstack-infra/zuul-jobs master: Ensure logs are readable before uploading them  https://review.openstack.org/50767321:04
*** hashar has quit IRC21:17
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Handle projets without setup.py or valid setup.cfg  https://review.openstack.org/50767821:17
*** hashar has joined #zuul21:30
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: chmod the files on the executor  https://review.openstack.org/50768621:32
openstackgerritMerged openstack-infra/zuul-jobs master: chmod the files on the executor  https://review.openstack.org/50768621:34
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Handle projects without setup.py or valid setup.cfg  https://review.openstack.org/50767821:35
*** hashar has quit IRC21:47
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Remove var override for docs publish job  https://review.openstack.org/50769021:48
*** pabelanger has quit IRC21:50
*** pabelanger_ has joined #zuul21:51
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Remove var override for docs publish job  https://review.openstack.org/50769022:09
openstackgerritMerged openstack-infra/zuul-jobs master: Handle projects without setup.py or valid setup.cfg  https://review.openstack.org/50767822:25
openstackgerritJames E. Blair proposed openstack-infra/zuul-jobs master: Always create dest dir in zuul-cloner shim  https://review.openstack.org/50770423:07
*** Parraki has joined #zuul23:28
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Fix race in test_in_repo_branch  https://review.openstack.org/50770823:36

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!