Tuesday, 2019-03-12

*** rlandy has quit IRC00:20
openstackgerritMerged openstack-infra/zuul master: Remove default user for fingergw  https://review.openstack.org/63563201:16
openstackgerritMerged openstack-infra/zuul master: Remove default zookeeper hosts  https://review.openstack.org/63563301:16
*** openstackstatus has quit IRC02:22
*** openstack has joined #zuul02:26
*** ChanServ sets mode: +o openstack02:26
*** saneax has joined #zuul03:18
openstackgerritJoshua Hesketh proposed openstack-infra/zuul master: Add API endpoint to get frozen jobs  https://review.openstack.org/60707703:50
openstackgerritJoshua Hesketh proposed openstack-infra/zuul master: Get executor job params  https://review.openstack.org/60707803:50
openstackgerritJoshua Hesketh proposed openstack-infra/zuul master: Separate out executor server from runner  https://review.openstack.org/60707903:50
*** saneax has quit IRC03:51
*** mordred has quit IRC04:14
*** Shrews has quit IRC04:14
*** mordred has joined #zuul04:21
*** Shrews has joined #zuul04:21
*** mordred has quit IRC04:37
*** Shrews has quit IRC04:37
*** bjackman has joined #zuul04:43
*** Shrews has joined #zuul04:44
*** mordred has joined #zuul04:45
openstackgerritJoshua Hesketh proposed openstack-infra/zuul master: Add API endpoint to get frozen jobs  https://review.openstack.org/60707705:07
openstackgerritJoshua Hesketh proposed openstack-infra/zuul master: Add API endpoint to get frozen jobs  https://review.openstack.org/60707705:11
bjackmanSpamapS, OK glad you agree, was mainly trying to make sure I understand correctly. I will add it to my growing list of things I would add to Zuul if I had the time!05:54
bjackmanAt the moment I cannot get the project.merge-mode to take effect at all for some reason05:54
openstackgerritJoshua Hesketh proposed openstack-infra/zuul master: Get executor job params  https://review.openstack.org/60707805:55
openstackgerritJoshua Hesketh proposed openstack-infra/zuul master: Separate out executor server from runner  https://review.openstack.org/60707905:55
*** rf0lc0 has joined #zuul06:00
*** tristanC has quit IRC06:02
*** tristanC2 has joined #zuul06:04
*** rfolco|ruck|off has quit IRC06:07
*** [GNU] has quit IRC06:07
*** pabelanger has quit IRC06:07
*** andreaf has quit IRC06:09
*** panda|rover|off has quit IRC06:10
*** andreaf has joined #zuul06:12
*** panda has joined #zuul06:12
*** saneax has joined #zuul06:49
*** hashar has joined #zuul07:08
tristanC2jhesketh_: thanks for the follow-up on the zuul-update mail, i was about to send one myself07:16
tristanC2jhesketh_: i wanted to that even if it's not necessarly the case today with the client side refactor to use a config file and such, i did was able to execute a zuul job locally with the new api provided by the patch you referenced07:17
tristanC2to add* that even07:18
*** [GNU] has joined #zuul07:18
badboyhi all07:30
badboyis there a way to check the "Expand by default" box in zuul-web?07:31
*** pcaruana has joined #zuul07:39
*** pcaruana has quit IRC07:43
*** pcaruana has joined #zuul07:43
*** AJaeger has quit IRC07:46
*** themroc has joined #zuul07:58
*** gtema has joined #zuul08:02
*** jpena|off is now known as jpena08:44
*** AJaeger has joined #zuul09:00
*** mgoddard has joined #zuul09:01
bjackmanMy zuul instance has no running jobs, the scheduler and executor seem to be "idle", but I have items in my gate queue which have some of their jobs still marked as "queued"09:18
bjackmanCould this be a bug in the nodepool driver?09:18
bjackmanCan't think of anything I can do to prod the system into continuing..09:20
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: web: prevent exception if a parent job doesn't exists  https://review.openstack.org/64270209:22
*** rf0lc0 is now known as rfolco|ruck09:34
*** hashar has quit IRC09:36
*** hashar has joined #zuul09:41
openstackgerritMerged openstack-infra/zuul master: web: switch jobs list to a tree view  https://review.openstack.org/63343710:03
openstackgerritMerged openstack-infra/zuul master: web: add jobs list filter  https://review.openstack.org/63365210:06
openstackgerritMerged openstack-infra/zuul master: web: add flatten checkbox  https://review.openstack.org/64204710:15
*** panda is now known as panda|rover10:22
openstackgerritMerged openstack-infra/zuul-sphinx master: Add type to role variables  https://review.openstack.org/64116810:32
*** electrofelix has joined #zuul10:49
*** dkehn has quit IRC10:54
*** hashar has quit IRC11:02
*** chkumar|pto is now known as chandankumar11:11
*** bjackman_ has joined #zuul11:27
*** bjackman has quit IRC11:29
*** chandankumar is now known as chkumar24611:35
*** jpena is now known as jpena|lunch11:56
*** bjackman_ has quit IRC11:58
*** rlandy has joined #zuul12:01
*** bjackman_ has joined #zuul12:03
*** gtema has quit IRC12:08
*** gtema has joined #zuul12:16
*** panda|rover is now known as panda|rover|lunc12:21
*** jpena|lunch is now known as jpena13:00
*** pabelanger has joined #zuul13:04
*** gtema has quit IRC13:05
*** panda|rover|lunc is now known as panda|rover13:12
*** irclogbot_3 has quit IRC13:26
*** jamesmcarthur has joined #zuul13:29
*** irclogbot_3 has joined #zuul13:29
*** gtema has joined #zuul13:43
*** jamesmcarthur has quit IRC13:48
*** jamesmcarthur has joined #zuul13:48
*** lennyb has quit IRC13:51
fboHi is some of you noticed that on chrome the zuul console page become sometime stuck and chrome proposes to close the unresponsible page ? I have confirmed that with two other colleagues on zuul.openstack.org.13:52
Shrewsfbo: i believe someone said something similar about chrome in this channel recently13:54
pabelangeryup, I see that a lot on sf.io zuul13:55
pabelangerseems limited to chrome13:55
fboyep also on sf deployements13:56
*** openstack has joined #zuul15:41
*** ChanServ sets mode: +o openstack15:41
Shrewshrm that zk jira ticket is interesting. /me will have to experiment with that16:04
Shrewsoh, mordred even commented on the PR16:08
mordredShrews: which PR?16:08
Shrewsmordred: https://github.com/apache/zookeeper/pull/41816:09
Shrewsi wonder what the "workaround" is...16:10
*** themroc has quit IRC16:11
clarkbShrews: mordred is that an issue if using the built in auth stuff?16:11
clarkbIf it is limited to the plugins then we may be fine to use basic auth and/or kerberos16:11
Shrewsno idea. that's the question corvus asked16:12
Shrewsin his email16:12
Shrewswe'll have to answer that16:12
mordredShrews, clarkb: I don't know what the workaround is - but I think even with builtin auth the issue, iiuc, is that a client has to say "I'd like to auth" - and if it doesn't zk lets it connect happily16:21
mordredbut maybe that's not the case16:22
mordredso this probably involves some investigation16:22
Shrewsmordred: connects happily, but r/o mode, i think.  i'm setting up some testing now16:24
mordredShrews: so it can read the contents without authing?16:24
mordredand cool16:25
clarkbya reading the docs authenticated users set perms on paths16:25
Shrewsmordred: that was my reading of it, but i'm not sure either16:25
clarkbso a client can connect without auth then in theory can't read any data16:25
clarkbor write any data16:25
clarkbcreate /mynode content digest:user:tpUq/4Pn5A64fVZyQ0gOJ8ZWqkY=:cdrwa16:26
mordredclarkb: ah - so perhaps if we wrote initial data as an auth'd user and then set perms on those paths to say "must be auth'd" - then that would potentially work16:26
clarkbmordred: ya16:26
clarkbits definitely changes to how we write the data16:26
clarkbbut I think it would work16:26
mordredclarkb: so might suck a little in terms of migration from unauth'd to auth'd16:26
clarkbits more like a filesystem in that way16:26
corvustristanC2's nodpool patch does set acls i think?16:55
tobiashcorvus: you're the provides/requires artifact handling expert. I got a bug report from a user that provides/requires doesn't work within the same buildset. Is it this expected or is this a bug?16:55
corvustobiash: it's expected16:55
Shrewscorvus: it sets a default acl when connecting, yes16:56
corvustobiash: https://zuul-ci.org/docs/zuul/user/config.html#attr-job.provides  "for other jobs for other changes"16:56
Shrewsi'm trying to understand how zk does authentication though. if you pass "user:password", what does it authenticate that against? the docs are not very helpful so far16:56
tobiashcorvus: ok, thanks, I guess the correct way for such a use case would be using zuul_return?16:58
corvustobiash: yes, and manually using dependencies between jobs16:58
tobiash(instead of provides/requires)16:58
Shrewsoh i see. those values are used to generate the acl, not for connecting16:59
Shrewsdigest uses a username:password string to generate MD5 hash which is then used as an ACL ID identity. Authentication is done by sending the username:password in clear text.17:01
Shrewsoh dear17:01
Shrewsthat's less that good17:01
corvusShrews: well, that's okay if tls is required17:01
Shrewscorvus: we'll have to be sure to point that requirement out17:03
corvustobiash: the practical issue is, imagine 2 jobs: "buildset-registry (requires)" and "image-build (provides)".  you want buildset-registry to collect all the artifacts from previous buildsets, so it "requires" images.  build-image "provides" them.  zuul creates a dependency relationship where buildset-registry for change #2 depends on build-image for change #1.17:03
corvustobiash: now imagine if we did the same within a buildset -- buildset-registry would depend on image-build, but image-build already depends on buildset-registry.17:04
tobiashcorvus: thanks, got it, sounds like misuse by the user :)17:05
tobiash(I got that as a bug report)17:05
corvuswe probably need a "..note::" in the docs saying "provides/requires are not automated ways of constructing job dependency graphs"17:05
corvustobiash: it's understandable.  no other system has an idea like "artifact dependency between multiple speculative unmerged states of different repositories".  we just need to help people think bigger.  :)17:06
tobiash:)17:06
tobiashoh, he did express the dependency and expected the variables to be there17:07
corvustobiash: ah, then yes, i think this is the same thing tristanC2 mentioned17:08
corvustobiash: i think we can/should add artifacts in that case17:08
corvusbasically, at the same place we propagate variables from zuul_return from earlier jobs to later ones, we propogate artifacts as well17:09
tobiashok, so the variable part can/should be fixed, but the depencency part (obviously) not?17:10
corvusright.  it's really a separate thing from provides/requires.17:11
tobiashk, I'll try that when I have time :)17:11
corvusthx!17:11
*** bjackman_ has quit IRC17:23
*** panda|rover is now known as panda|rover|off17:24
Shrewscorvus: mordred: clarkb: with zk 3.4.10, confirmed that an unauthed connection can connect and do CRUD ops, but cannot read any data with ACLs set appropriately. i think we're ok (tested digest scheme only)17:33
*** gtema has quit IRC17:33
mordredShrews: cool - so assuming tls is required, that sounds workable17:33
Shrewsyah17:33
mordredShrews: can we update existing zk nodes to add ACLs?17:34
Shrewsmordred: that might require deleting and recreating existing nodes after sending new creds to the client. totally guessing if that would actually work, but a reasonable assumption based on the existing api17:36
Shrewsi don't see a way to update in place17:36
Shrewsmordred: oh! there is a set_acls() api17:36
Shrewsso... maybe?17:36
mordredwoot! so we could potentialy write a $something to walk the tree and set acls on everything as part of moving from noauth to auth17:37
Shrewsseems reasonable17:37
corvusShrews, mordred: i think tristanC2's patch includes a script to update acls17:48
mordredsweet17:48
corvusand yes, it uses set_acls17:49
Shrewsoh cool17:49
corvushttps://review.openstack.org/#/c/619155/4/nodepool/cmd/update_zk_auth.py17:49
Shrewsgood job tristanC2 :)17:50
*** sshnaidm is now known as sshnaidm|afk18:11
Shrewsfyi, i have to leave in a few minutes to listen to a doctor tell me not to do stupid things. not sure how long i'll be afk18:17
*** electrofelix has quit IRC18:19
*** jamesmcarthur has quit IRC18:20
*** jamesmcarthur has joined #zuul18:21
*** jamesmcarthur has quit IRC18:27
*** electrofelix has joined #zuul18:32
*** jamesmcarthur has joined #zuul18:33
*** pcaruana has quit IRC18:39
mordredShrews: if I tell you not to do stupid things, will you pay me what you normally pay your doctor?18:42
*** jpena is now known as jpena|off18:44
*** jamesmcarthur has quit IRC18:51
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Forward artifacts to child jobs within buildset  https://review.openstack.org/64285718:52
tobiashcorvus: ^18:53
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Forward artifacts to child jobs within buildset  https://review.openstack.org/64285718:54
*** jamesmcarthur has joined #zuul19:03
tobiashcorvus: responded on 63193219:13
tobiashand thanks for review !19:14
dmsimardIt turns out there's an open source foundation for continuous delivery software now ? https://jenkins.io/blog/2019/03/12/cdf-launch/19:16
dmsimard¯\_(ツ)_/¯19:16
dmsimardA link with less Jenkins: https://www.linuxfoundation.org/press-release/2019/03/the-linux-foundation-announces-new-foundation-to-support-continuous-delivery-collaboration/19:24
Shrewsmordred: you don't have the credentials19:42
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Make ansible version configurable  https://review.openstack.org/63742219:50
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Install ansible during executor startup if needed  https://review.openstack.org/64064419:50
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Run tox remote concurrent  https://review.openstack.org/64065419:50
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Support ansible 2.6  https://review.openstack.org/63193119:50
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Support ansible 2.7  https://review.openstack.org/63193219:50
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Switch default ansible version to 2.7  https://review.openstack.org/63742419:50
tobiashcorvus: I think I hopefully addressed all your points in that stack ^19:52
*** daniel3 is now known as daniel219:55
*** electrofelix has quit IRC20:05
*** electrofelix has joined #zuul20:11
*** jamesmcarthur has quit IRC20:14
*** jamesmcarthur has joined #zuul20:15
*** electrofelix has quit IRC20:15
*** jamesmcarthur has quit IRC20:19
corvustobiash: minor error in 637422 causing docs job failure... also, tox-remote is failing consistently though i don't see why yet20:26
tobiashcorvus: tox-remote needs rebase because of the security fix :)20:26
corvustobiash: ah, yeah, i was just starting to suspect that :)20:26
tobiashcorvus: do you mind if I rebase and fix that in one go or do you prefer to separate that in this case?20:28
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Manage ansible installations within zuul  https://review.openstack.org/63193020:30
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Validate ansible installations on startup  https://review.openstack.org/63741820:30
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Make ansible version configurable  https://review.openstack.org/63742220:30
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Install ansible during executor startup if needed  https://review.openstack.org/64064420:30
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Run tox remote concurrent  https://review.openstack.org/64065420:30
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Support ansible 2.6  https://review.openstack.org/63193120:30
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Support ansible 2.7  https://review.openstack.org/63193220:30
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Switch default ansible version to 2.7  https://review.openstack.org/63742420:30
tobiashcorvus: that is a rebase to include the secfix + the doc fix20:31
tobiashhopefully I didn't miss anyfurther things that break all jobs...20:31
*** chkumar246 is now known as chandankumar20:47
pabelangerfungi: a few weeks ago we quickly discussed the issue where zuul requires our keys folder (/var/lib/zuul/keys) to be 0o700: http://git.zuul-ci.org/cgit/zuul/tree/zuul/scheduler.py#n587 I'm picking up again to see how to allow 0o750 but believe you mentioned something else to do with setuid bit?21:26
fungipabelanger: yeah, if you want to set the group ownership of the directory to a group which isn't the zuul user's default group, then you'll need the directory setgid so that other files/directories beneath it get created with the same group owner21:27
fungiit's a fairly common unix permissions solution when you're trying to share files with a group of users21:28
pabelangerokay, in this case, I think keeping it zuul:zuul works, the backup user has been added into the zuul group, so it just needs to read perms I believe21:28
fungiin that case it should work fine21:29
pabelangerokay, thanks. Let me continue my testing21:29
ianwcorvus: could you do a zuul-sphinx release?21:40
corvusianw: did that change land?  yes!21:40
corvusianw: i'll tag 6a0034ebcabc86ec60f8fbb96303840e6b503a2e as 0.4.0  sound good?21:42
ianwexcellent, thanks21:42
corvuspushed21:42
ianwthanks; just got a few tweaks i want on the testinfra bits but then letsencrypt bits should be review-able21:44
ianwi'll let you know ;)\21:44
*** jamesmcarthur has joined #zuul21:50
*** jamesmcarthur has quit IRC22:22
*** jamesmcarthur has joined #zuul22:23
*** jamesmcarthur has quit IRC22:25
*** jamesmcarthur has joined #zuul22:25
*** jamesmcarthur has quit IRC22:27
openstackgerritPaul Belanger proposed openstack-infra/zuul master: Allow group read permissions on project keys directory  https://review.openstack.org/64291322:30
pabelangercorvus: fungi: mordred: clarkb: tobiash: ^ is my first attempt to allow project keys folder to have group read permissions, so other users are also able to access the keys. In this case, for the purpose of backups.22:32
*** jamesmcarthur has joined #zuul22:43
*** ianychoi_ is now known as ianychoi22:47
*** jamesmcarthur has quit IRC22:55
*** tristanC2 is now known as tristanC23:36
*** jamesmcarthur has joined #zuul23:53

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!