Tuesday, 2018-08-07

*** harlowja has quit IRC00:26
tristanCcorvus: nice!01:31
*** yolanda has quit IRC02:03
*** jhesketh_ is now known as jhesketh03:14
openstackgerritIan Wienand proposed openstack-infra/zuul-jobs master: [WIP] kerberos & afs client roles  https://review.openstack.org/58933404:21
openstackgerritIan Wienand proposed openstack-infra/zuul-jobs master: [WIP] kerberos & afs client roles  https://review.openstack.org/58933404:51
openstackgerritIan Wienand proposed openstack-infra/zuul-jobs master: [WIP] kerberos & afs client roles  https://review.openstack.org/58933405:38
openstackgerritIan Wienand proposed openstack-infra/zuul-jobs master: [WIP] kerberos & afs client roles  https://review.openstack.org/58933405:44
* SpamapS really wishes he'd had time to swap out the spinning disk on his new laptop for an SSD before he left for europe05:53
SpamapS:-P05:53
*** pcaruana has joined #zuul06:36
SpamapS:( and now pbrx doesn't work06:37
SpamapShttp://paste.openstack.org/show/727462/06:37
*** yolanda has joined #zuul06:41
SpamapSOH06:43
SpamapSthis doesn't work on a remote docker06:43
SpamapS:(06:43
SpamapSnaughty pbrx needs to COPY rather than -v. :-/06:44
*** quiquell has joined #zuul06:46
quiquellHello there06:46
quiquellI am checking job's 'file' and 'irrelevant-files' option06:47
quiquellIs it possible to express them in a external file, so we can reuse the lists ?06:47
SpamapSquiquell: I don't think so. I was needing something similar the other day, wanting to build the list from some rules. I think it would need to be added as a new feature.06:54
quiquellSpamapS: Ok, going to check, thanks man.06:55
SpamapSmordred: the way you've used volumes makes it impossible to use a remote docker daemon. It's pretty common to do that, in my case, trying to simplify things by using minikube's docker so I don't have to figure out pushing to minikube's registry. :-P07:23
SpamapSI think we can do it all with docker cp though.07:23
SpamapSwhich is the CLI equivalent of COPY07:24
*** jpena|off is now known as jpena07:35
*** electrofelix has joined #zuul08:33
*** panda|rover-ish is now known as panda|rover08:33
*** gtema has joined #zuul08:58
*** eumel8 has joined #zuul10:03
*** electrofelix has quit IRC10:18
*** electrofelix has joined #zuul10:26
*** goern has joined #zuul11:08
*** panda|rover is now known as panda|rover|lunc11:18
*** elyezer has quit IRC12:03
*** elyezer has joined #zuul12:06
*** chmouel has quit IRC12:15
*** jpena is now known as jpena|lunch12:15
*** panda|rover|lunc is now known as panda|rover12:16
mordredSpamapS: yes - I was explicity avoiding copy12:20
mordredSpamapS: because copying that data in is just annoyingly inefficient12:21
mordredSpamapS: however, let's see if we can't work out a solution, cause I'd like for you to be able to use a remote docker if that's important12:22
mordredSpamapS: maybe a flag that'll use cp instead of volume for cases when someone is trying to do that? that seems potentially reasonable?12:23
*** gtema has quit IRC12:47
*** sdoran_ has joined #zuul12:49
*** sdoran has quit IRC12:50
*** pbrobinson has quit IRC12:50
*** weshay has quit IRC12:50
*** sdoran_ is now known as sdoran12:50
*** samccann has joined #zuul12:51
Shrewsmorning zuulers13:01
*** jpena|lunch is now known as jpena13:30
AJaegermordred, tristanC , want to rebase https://review.openstack.org/#/c/550979/ ?13:45
*** quiquell is now known as quiquell|off13:47
*** quiquell|off has quit IRC13:51
openstackgerritMonty Taylor proposed openstack-infra/zuul master: web: add /{tenant}/projects and /{tenant}/project/{project} routes  https://review.openstack.org/55097913:56
openstackgerritMonty Taylor proposed openstack-infra/zuul master: web: add /{tenant}/pipelines route  https://review.openstack.org/54152113:56
openstackgerritMonty Taylor proposed openstack-infra/zuul master: scheduler: add job's parent name to the rpc job_list method  https://review.openstack.org/57347313:56
openstackgerritMonty Taylor proposed openstack-infra/zuul master: web: add /{tenant}/labels route  https://review.openstack.org/55397913:56
openstackgerritMonty Taylor proposed openstack-infra/zuul master: web: add /{tenant}/nodes route  https://review.openstack.org/55399813:56
mordredAJaeger: done13:56
mordredShrews: morning!13:56
AJaegergreat, mordred13:56
corvusSpamapS: re quiquell's question -- you can use yaml anchors to re-use lists14:14
*** yolanda has quit IRC14:31
openstackgerritMerged openstack-infra/nodepool master: Switch storyboard url to be by name  https://review.openstack.org/58860014:55
*** panda|rover is now known as panda|backin2h15:01
*** pcaruana has quit IRC15:11
SpamapScorvus: that's a good point, I hadn't thought of doing that. My need was to actually programmatically share a list with another system.15:24
SpamapSmordred: so, the use case is "I have git state over here in my dev workstation, and docker over there in my dev VM. I think it may be pretty common, especially for mac users.15:25
mordredSpamapS: sure - totally understand the existence of the use case15:26
SpamapSAnd in this case, I want to just build the containers in the docker that minikube uses directly to avoid a second step of pushing to the registry inside minikube.15:26
mordredSpamapS: mostly just want to make sure we solve it in a way that doesn't also make it more expensive for the other case15:26
SpamapSI wonder if there's another way though. I mean, we already have to put the source for these python programs into the container image at some point..15:27
mordredwe don't though15:27
mordredthat's just the thing15:27
SpamapSmaybe if we ship the bindep.txt we can just read it from the wheel?15:27
SpamapSoh, we don't?15:27
mordredwe need to put the unpacked wheel into the container image15:27
SpamapSalso side note.. is there a way to make all the moron random account msg spam go away?15:28
mordredthe source code itself does not need to be in the image15:28
SpamapSOk well I meant the same thing. :)15:28
mordredSpamapS: yes - /mode SpamapS +R15:28
SpamapSmordred: ty15:28
mordredSpamapS: I mean, the distinction is splitting hairs, as we DO need the source code to be in the builder image15:28
mordredor, more specifically, we need the source git repo to be in the builder image15:29
mordredbecause we need that to build the wheel15:29
mordredso copy vs. volume is a thing regardless15:29
SpamapSRight, just.. doing it with volumes instead of copies.. TBH.. I've been iterating on the aws provider and docker build using COPY and RUN ends up caching more aggressively and more efficiently than pbrx... so I'm not sure what the aversion to COPY is.15:31
mordredwell - there's two sides to the coin15:31
SpamapSMaybe there's another volume we can mount in that has a wheel cache or something?15:31
mordredthe first is just it drives me batty to have to copy an entire git repo to a second directory on my laptop to build a container image15:31
mordredit makes local iteration massively slower15:32
mordredBUT - the second is what you just mentioned ...15:32
mordredpulling out the wheel cache and the built artifacts15:32
mordredthat said - I'm sure we can make a version of that that uses copy for all of those things - it shouldn't be super hard15:33
SpamapSmordred: yeah, I'm also sort of trying to figure out why it's so hard to just login and push to this silly minikube registry, which may be a better option ultimately.15:46
mordredSpamapS: :)15:46
tristanCSpamapS: maybe configure minikube to pull the image from the host docker?15:52
SpamapStristanC: I hadn't thought of that. Seems complicated.15:55
SpamapSsince the host docker isn't a registry15:55
*** pbrobinson has joined #zuul15:59
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Use full gerrit changeid in HTTP report  https://review.openstack.org/58953016:04
corvusclarkb, mordred: could you review that with some urgency?16:05
clarkbyes16:05
clarkbcorvus: does change.project need to be urlencoded?16:07
corvusclarkb: lemme check16:07
corvusyes16:08
corvusor at least, that's what gertty sends16:09
clarkbjust noticing it is going into a path so we can't encode it later16:09
corvusyeah, gertty receives the value urlencoded and never decodes it, which is why i didn't notice that16:10
corvusbut since we're generating it, we should do that in order to match16:10
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Use full gerrit changeid in HTTP report  https://review.openstack.org/58953016:15
corvusclarkb, mordred: ^16:15
corvusfungi: ^16:15
fungioh, yeah i didn't even consider that16:16
fungigood eye!16:17
fungichange.project will certainly contain risky characters (at least / in the case of the openstack community deployment, but more generally who knows what other characters people might put in the names of their project in different gerrits)16:18
clarkbactually branches too right?16:18
clarkbstable/foo ?16:18
fungiyep!16:19
clarkbI just +2'd but now realize that branch might need the same treatment16:19
* fungi was just thinking about that as well looking at the interdiff16:19
mordredcorvus: +2 from me16:19
mordredoh - except what clarkb and fungi said16:20
*** jpena is now known as jpena|off16:21
corvusi guess we can quote the whole thing?16:22
corvusi believe ~ symbols make it through unscathed16:22
clarkbcorvus: ++16:22
corvusthough, hrm, i guess if ~ ever ended up in a project name...16:23
corvusi'll just quote each part16:23
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Use full gerrit changeid in HTTP report  https://review.openstack.org/58953016:24
corvusclarkb, fungi, mordred: third time's the charm16:24
mordredcorvus: +216:24
fungileaving the approval for clarkb16:25
* clarkb looking now16:25
clarkbapproved16:26
*** electrofelix has quit IRC16:29
openstackgerritJames E. Blair proposed openstack-infra/zuul-website master: Add BMW case study  https://review.openstack.org/58954116:37
corvustobiash: ^16:37
tobiash:)16:40
tobiashcorvus: I have a problem with a branching use case: a project has more than one branch (and the jobs need to be branched) and we want create releases in a tag triggered release pipeline16:43
tobiashbut the jobs won't execute as we have jobs with branch matchers to the branches but they don't match the tag16:44
tobiashI didn't find a possibility to realize this use case so far16:44
tobiashmy current thinking is that we might need to create a speculative config from the tag so the tag has its own set of jobs16:45
clarkbtobiash: I think you can match arbitrary refs including tags (but yo umay not know what those tags will be in advance?)16:45
tobiashclarkb: but that would require explicit branch matcher right?16:46
clarkbtobiash: yes16:46
tobiashwhich would be an overhead during every branch creation16:47
fungiwasn't there a patch to make it possible to guess an appropriate branch for a given tag?16:47
tobiashfungi: I don't know if any16:47
* fungi can't recall whether that merged, but it was a potential useful feature for openstack's deployment too16:48
fungior maybe corvus had merely outlined the logic needed for doing that mapping16:48
tobiashif we create a dynamic layout for a ref triggered pipeline that might just work as expected16:49
tobiashfungi: oh I think you mean https://review.openstack.org/578557 ?16:51
fungitobiash: yep, that's the one16:51
* tobiash overlooked that one16:52
corvustobiash: yeah, i was holding out for more user feedback on whether that was a good idea before i proceeded.  sounds like i just got some.  :)16:53
corvustobiash: let me know what you think16:54
tobiashcorvus: I'm just thinking which approach is better16:54
fungiagreed, it seemed like a less interesting addition if it was just needed because of openstack community process weirdness and nobody else actually used git that way16:55
corvustobiash: i considered the speculative config approach, but it's a *lot* of work to ask zuul to do16:56
corvus(most of which wouldn't actually end up being necessary)16:56
tobiashcorvus: ok, so you did this analysis already :)16:57
tobiashcorvus: I thought that would be an easy approach, but if not, the branch guessing is probably the easiest16:57
tobiashcorvus: the branch guessing also has the advantage of not running speculative code which is especially with github probably more secure16:58
tobiashso I like that approach16:59
*** panda|backin2h is now known as panda|rover17:08
tobiashcorvus: added a comment to 57855717:10
tobiashcorvus: but I think that looks good otherwise17:12
*** harlowja has joined #zuul17:31
*** harlowja has quit IRC17:43
openstackgerritMerged openstack-infra/zuul master: Use full gerrit changeid in HTTP report  https://review.openstack.org/58953018:01
openstackgerritMerged openstack-infra/zuul-website master: Add BMW case study  https://review.openstack.org/58954118:11
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool master: Bump minimum openstacksdk version to 0.17.2  https://review.openstack.org/58956318:15
Shrewsmordred: clarkb: ^^^18:16
Shrewsthough, hrm... will that work if the tag is only on the rocky branch?18:16
mordredShrews: yes18:17
Shrewswrt to tests, that is18:18
mordredit should - we don't follow upper-constraints18:18
mordredalthough - I think we are currently accidentally following upper-constraints in our nodepool/devstack jobs18:18
mordredso it might not18:18
Shrewsi guess we'll find out soon enough18:19
*** zxiiro has joined #zuul18:29
openstackgerritMerged openstack-infra/zuul-jobs master: Un-wip upload-logs-swift  https://review.openstack.org/58867718:34
*** samccann has quit IRC18:38
*** jimi|ansible has joined #zuul18:46
*** openstackgerrit has quit IRC18:49
*** openstackgerrit has joined #zuul20:13
openstackgerritMerged openstack-infra/zuul master: Cache decryption results  https://review.openstack.org/58279420:13
openstackgerritMerged openstack-infra/zuul master: Switch storyboard url to be by name  https://review.openstack.org/58859720:13
openstackgerritIan Wienand proposed openstack-infra/zuul-jobs master: [WIP] kerberos & afs client roles  https://review.openstack.org/58933420:27
*** jimi|ansible has quit IRC20:40
-openstackstatus- NOTICE: Due to a bug, Zuul has been unable to report on cherry-picked changes over the last 24 hours. This has now been fixed; if you encounter a cherry-picked change missing its results (or was unable to merge), please recheck now.20:44
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: WIP Extract pep8 messages for inline comments  https://review.openstack.org/58963420:55
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: WIP Extract pep8 messages for inline comments  https://review.openstack.org/58963421:10
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: WIP Extract pep8 messages for inline comments  https://review.openstack.org/58963421:15
*** goern has quit IRC21:21
openstackgerritIan Wienand proposed openstack-infra/zuul-jobs master: [WIP] kerberos & afs client roles  https://review.openstack.org/58933422:38
*** gothicmindfood has quit IRC22:42
corvustobiash, clarkb: i just attempted and gave up on 2 implementations of a fix for the branch cache problem.  i think that the best solution is going to be to have the drivers handle branch caching internally and transparently, removing any attempts at caching in the configloader or model layers.  i'll work on that tomorrow.23:07
corvustristanC: openstack is having a problem with periodic jobs not running.  i've confirmed that's because the timer trigger is never firing for them.  i suspect a bug in this change: https://review.openstack.org/581553 but i haven't had time to dig further into it.23:09
corvustristanC: just a guess: maybe we need to also look at project-templates?23:09
openstackgerritIan Wienand proposed openstack-infra/zuul-jobs master: [WIP] kerberos & afs client roles  https://review.openstack.org/58933423:22
gundalowDoes Zuul set ENV for BRANCH/COMMIT/REPO/ETC?23:23
openstackgerritIan Wienand proposed openstack-infra/zuul-jobs master: [WIP] kerberos & afs client roles  https://review.openstack.org/58933423:36
mordredgundalow: zuul doesn't set env vars - it does provide a nice pile of info in ansible vars23:58
mordredgundalow: such as: http://logs.openstack.org/53/588553/3/check/tox-linters/df37fed/zuul-info/inventory.yaml23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!