Friday, 2018-08-31

dmsimardSpamapS: +100:04
*** harlowja has quit IRC00:34
*** rlandy has quit IRC01:34
*** bhavikdbavishi has joined #zuul05:42
*** bhavikdbavishi has quit IRC05:58
openstackgerritSimon Westphahl proposed openstack-infra/nodepool master: Update static nodes in Zookeeper on config change  https://review.openstack.org/59815606:37
*** hashar has joined #zuul06:53
*** pcaruana has joined #zuul07:19
*** jpena|off is now known as jpena07:31
openstackgerritSorin Sbarnea proposed openstack-infra/zuul master: Display correct cursor when hovering over patchset header  https://review.openstack.org/59822207:41
*** electrofelix has joined #zuul08:08
*** eumel8 has joined #zuul08:30
ssbarneazuul tox-py35 seems broken, see https://review.openstack.org/#/c/598222/ -- can someone look at it?09:08
-openstackstatus- NOTICE: Jobs using devstack-gate (legacy devstack jobs) have been failing due to an ara update. We use now a newer ansible version, it's safe to recheck if you see "ImportError: No module named manager" in the logs.09:58
*** jpena is now known as jpena|lunch11:28
*** jpena|lunch is now known as jpena12:23
*** rlandy has joined #zuul12:40
*** EmilienM is now known as EvilienM12:57
*** samccann has joined #zuul12:59
*** hashar is now known as hasharAway13:38
*** jpena is now known as jpena|off14:42
*** jpena|off is now known as jpena14:43
Shrewscorvus: left you a question on 59221314:55
corvusShrews: when would it be none?14:56
Shrewscorvus: you allow for it in __init__14:57
corvusShrews: oh! keystorage.  i thought you meant the path14:57
Shrewsright14:57
corvusShrews: it's none only for the config syntax validation, in real use, it always needs to be set, so if we screw that up, bombing out is the correct thing anyway14:58
Shrewsok. i couldn't yet discern the circumstances when it would actually be None14:59
corvusShrews: yeah, there's a zuul cli command to do basic yaml validation of the tenant config; there's a test case that covers it.15:01
Shrewscorvus: it's None when called from _loadDynamicLayout() also15:02
Shrewsis that covered?15:02
Shrewsthat doesn't appear to call fromYaml(), so i think that's ok15:05
*** samccann has quit IRC15:06
corvusShrews: oh yep, forgot about that.  yeah that's got lots of coverage too.  basically, as long as we aren't adding any new projects to the system, we're fine.  that requires a full reconfiguration; it can't be done in a dynamic configuration.15:07
Shrewscorvus: stack lgtm. only +2'd to allow clarkb to have a look if he's interested15:18
Shrewsand pabelanger15:18
*** pcaruana has quit IRC15:26
*** jlvillal is now known as jlvilla-viva15:30
openstackgerritMarkus Hosch proposed openstack-infra/zuul master: Add a sanity check for all refs returned by Gerrit  https://review.openstack.org/59901115:36
pabelangerShrews: corvus: I also +2'd, left comment for request for documentation. But exciting feature15:41
corvusyeah, there's still more work to do -- but this was a good checkpoint15:42
pabelangeragree, we may want to consider different SSH key format in the future, in case users say only support ed25519.15:43
pabelangeradding, more formats15:44
*** electrofelix has quit IRC15:47
*** jpena is now known as jpena|off16:03
*** openstackgerrit has quit IRC16:06
*** dkehn has quit IRC16:25
*** dkehn_ has quit IRC16:30
*** openstackgerrit has joined #zuul16:47
openstackgerritFabien Boucher proposed openstack-infra/zuul-jobs master: ensure-sphinx: do not attempt a gettext install if exists  https://review.openstack.org/59902816:47
clarkbok finally in a spot to review those changes /me checks if they are still waiting17:11
*** samccann has joined #zuul17:20
openstackgerritFabien Boucher proposed openstack-infra/zuul-jobs master: ensure-sphinx: do not attempt a gettext install if exists  https://review.openstack.org/59902817:20
clarkb(I think I found a bug in the key migration code, so please don't merge/approve until I can finish reviewing)17:28
openstackgerritTrevor Bramwell proposed openstack-infra/zuul master: Fix typo in documentation chown commands  https://review.openstack.org/59904017:28
corvusmarked wip17:30
clarkbcorvus: ok posted, it may end up being relatively minor in the current state of things but potential problems for the future. I'll let you decide if you want to fix it in base change or in a followup17:36
clarkbI did -1 it, but feel free to approve and override if you do a followup17:37
*** sshnaidm|off has quit IRC17:37
*** sshnaidm|off has joined #zuul17:38
clarkbI love the use of recursion there btw17:39
*** sshnaidm|off has quit IRC17:41
*** sshnaidm|off has joined #zuul17:41
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Improve keystorage migration  https://review.openstack.org/59904317:48
corvusclarkb: ^ done, thx!17:49
corvusfungi: oh i didn't notice https://review.openstack.org/591870 was ready18:09
corvusSpamapS, pabelanger: ^ maybe one of you wants to review that?18:10
corvusoh, we can change the storyboard link on the website to the new project deep-link18:10
fungiahh, yep sorry i probably forgot to pester anyone about it18:12
clarkbcorvus: reading through this stack the motivation seems to be to simplify the CD use cases of Zuul (which is cool), why not leverage the secrets system for this though? Eg have a secret that contains the private ssh key?18:15
corvusclarkb: basically to close this gap: http://lists.zuul-ci.org/pipermail/zuul-discuss/2018-June/000458.html18:19
clarkbaha18:20
clarkbthanks18:20
corvus(we could also close that gap by creating a new way to add an ssh key without allowing arbitrary code execution on the executor, and maybe we should still do that.  but this seems like good convenience for an expected use case)18:20
corvusalso, uh, i guess i should reply to that mail :)18:21
clarkbcorvus: https://review.openstack.org/#/c/597727/2 minor thing on that change that I may have convinced myself to leave as is (arguments for both are inline)18:24
clarkbprobably worth a read18:24
clarkbother than that stack lgtm now18:26
*** goern has quit IRC18:42
*** goern has joined #zuul18:42
corvusclarkb: i am in 50% agreement with your ambivalence.  :)18:57
*** openstackstatus has quit IRC18:58
*** samccann has quit IRC19:07
*** openstackstatus has joined #zuul19:39
*** ChanServ sets mode: +v openstackstatus19:39
* SpamapS begins process of booking/registering for PTG19:48
SpamapShopefully we can talk zuul in some corners. ;)19:48
clarkbSpamapS: the way infra team schedule is on paper is monday and tuesday is the "help room" wednesday and thursday are the infra hacking time and friday is "free"19:49
clarkbSpamapS: I expect there will be plenty of ability to zuul monday, tuesday, and friday if people are present and interested19:49
SpamapSI am going to be doing kolla stuff Wed/Thur so that would fit well19:50
SpamapSThough I'd like to skip a day.. so maybe I'll skip Friday.19:52
*** hasharAway is now known as hashar19:53
*** openstackstatus has quit IRC19:55
corvusSpamapS: infra is going to be focused on ansible-ifying our control plane, ideally with the help of zuul as a CD-driver, so there may be some nice cross-pollination chats wed/thurs19:55
SpamapSDefinitely19:55
SpamapSI've been thinking a lot about how to CD with zuul and I have some ideas about keeping it simple.19:56
corvusrelated: this ssh key thing i'm working on isn't going to work with add-build-sshkey as written, since add-build-sshkey revokes all the existing keys in the agent19:56
SpamapSyeah I noticed that and wondered :)19:57
corvusi think i need to find a way to just revoke the nodepool key19:57
SpamapSssh-agent is pretty flexible, should be entirely doable.19:57
corvusSpamapS: heh, i just noticed it as i was sprucing up the docs to recommend the use of add-build-sshkey19:57
SpamapSSo is the idea that each repo/branch potentially has its own SSH key that it uses for ansible runs, so you can add that key to target hosts?19:58
corvusSpamapS: repo yes; hadn't thought about branches19:59
SpamapScombined with static driver.. should mean you can have a post job that zuul runs?19:59
*** openstackstatus has joined #zuul19:59
*** ChanServ sets mode: +v openstackstatus19:59
corvusSpamapS: yes -- though should also work with add_host -- that's probably what we'll try first for infra19:59
corvusSpamapS: we're actually trying to get to a point where zuul is running our infra *without* using the fact that we're also root on the zuul install19:59
SpamapSSo the reason I might care about branches is that one pattern I very much like is having deployment branches, so like master->stage->prod or master->stage->[prod-west,prod-east,prod-south] ... etc.19:59
SpamapSI very much dislike using add_host most of the time.. but I guess it makes sense in a zuul context where you don't have control over what inventory gets pushed in.20:00
corvusSpamapS: i think in principle we could expand to support branches20:00
SpamapScool20:01
corvusSpamapS: yeah; another option (aside from add_host and static inventory) is to teach zuul itself about static nodes.  so you basically just tell zuul what to put in the inventory.  that's also an unimplemented idea from the original spec.  might be worth swinging back around to that too.20:01
SpamapSI really want to explore a pattern where master commits are automatically proposed and merged into stage, and then proposed against prod branches, and then users can just approve those prod changes as a way to say "yes deploy this"20:02
corvussounds cool :)20:02
SpamapSWhich also allows the "oh crap we broke prod-south because [xyz]" where you can revert a change in one area temporarily.20:02
clarkbthat should be doable as a post job and you can make it supercedent to aggregate things if many changes are merging together20:04
clarkband as long as you never out of band to the target branch it should always be fast forwardable20:05
SpamapSsupercedent?20:06
SpamapSis that something new?20:06
clarkbSpamapS: yes, basically you can tell zuul to only queue the most recent event behind the active item20:06
clarkbSpamapS: openstack uses it in post so that we don't publish docs for every intermediate ref20:06
SpamapSYeah20:07
SpamapSI am flipping a few of my post jobs to it now :)20:07
corvushttps://zuul-ci.org/docs/zuul/user/config.html#value-pipeline.manager.supercedent20:07
SpamapScool20:07
corvushrm.  ssh-add requires, for some reason, access to the file to delete a key from the agent20:07
SpamapScan we have one that is anticdent that only merges things that Chris Dent approves?20:07
corvusthat's probably why we used -D in the first case20:08
pabelanger40999220:09
pabelanger32847020:09
clarkbchange numbers or oauth tokens?20:09
pabelanger91389520:10
corvuswe may need to talk to the ssh agent directly: https://tools.ietf.org/html/draft-miller-ssh-agent-02#section-4.320:10
SpamapScorvus: yeah maybe that's why I gave up and just purged20:10
corvusthe protocol lets you remove a key via the public key blob (which you can get by listing the keys)20:10
pabelangersorry, kids got computer20:11
*** openstackstatus has quit IRC20:11
corvuspabelanger: that's okay as long as they review some changes while they're at it20:11
*** openstackstatus has joined #zuul20:13
*** ChanServ sets mode: +v openstackstatus20:13
openstackgerritMerged openstack-infra/zuul master: Fix typo in documentation chown commands  https://review.openstack.org/59904020:16
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Serve project SSH keys and document  https://review.openstack.org/59906320:20
*** elyezer_ has joined #zuul20:26
*** elyezer has quit IRC20:29
*** openstackstatus has quit IRC20:36
corvusneat.  if you send ssh-agent an invalid message, it exits.  that will slow this down a bit :)20:36
*** openstackstatus has joined #zuul20:39
*** ChanServ sets mode: +v openstackstatus20:39
*** harlowja has joined #zuul20:46
*** cmurphy|vacation is now known as cmurphy20:58
*** hashar has quit IRC21:02
openstackgerritJames E. Blair proposed openstack-infra/zuul-jobs master: WIP: add-build-sshkey: interact with ssh agent directly  https://review.openstack.org/59907321:03
corvusclarkb, SpamapS: ^ that's the gist of it.  that will list keys and delete the first one it finds21:03
corvuswe're going to need to be able to identify the keys.  we can do that with the comment field, but ssh-add doesn't let us specify the comment (and the values it uses -- filename or "(stdin)" aren't enough for us to identify keys)21:04
corvusso i think we'll need to have the executor add the keys using the protocol rather than ssh-add as well21:05
corvusthen we can give them nice comments like "Zuul: master key"  and "Zuul: project key for ..."21:06
clarkbcorvus: ssh-add doesn't set the comment then?21:11
clarkbits in the file so it could, but I guess it doesn't21:11
corvusclarkb: it sets it to the filename21:11
corvusin the case of the master key, that's unpredictable, and all other keys (per-project, per-tenant) will be "(stdin)"21:12
clarkbya just confirmed locally with ssh-add -L21:12
corvushrm.  i guess we could just have add-build-sshkey just delete the only key with a real filename.21:12
corvusthat will probably work today; until some point in the future where someone wants to delete just the tenant key in a job or something.21:13
corvusi can't think of why you'd want that, so we can probably kick the can down the road.21:13
clarkbcould we do it based on the blob value itself? this is happening at job time so maybe we don't have that state anymore21:13
corvuswe could pass the public key through zuul.  but i don't think that gives us much over just matching the comment.21:15
openstackgerritJames E. Blair proposed openstack-infra/zuul-jobs master: add-build-sshkey: Remove only the master key  https://review.openstack.org/59907321:43
corvusclarkb, SpamapS: ^ i think that's ready21:43
clarkbcorvus: left a couple notes21:58
*** EvilienM is now known as EmilienM22:04
*** rlandy has quit IRC22:16
*** harlowja has quit IRC22:24
*** dkehn has joined #zuul22:25
SpamapScorvus: pretty cool! I left a -1 but I think a simple rename should clear it up.22:31
corvusSpamapS, clarkb: thanks; i'll do all those in the next ps22:48
openstackgerritJames E. Blair proposed openstack-infra/zuul-jobs master: add-build-sshkey: Remove only the master key  https://review.openstack.org/59907323:03
corvusclarkb, SpamapS: ^23:03
SpamapScorvus: caught a bug23:07
corvusdoh23:07
openstackgerritJames E. Blair proposed openstack-infra/zuul-jobs master: add-build-sshkey: Remove only the master key  https://review.openstack.org/59907323:08

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!