Tuesday, 2018-09-04

openstackgerritIan Wienand proposed openstack-infra/zuul-sphinx master: Improve warning details  https://review.openstack.org/59946901:10
*** SpamapS has joined #zuul01:17
* SpamapS finally got past /usr/bin/python being missing01:19
SpamapS2018-09-04 01:21:47,233 DEBUG zuul.AnsibleJob: [build: 4635c79b877d42e8b5e57bf242a3987a] Ansible output: b"ERROR! the role 'remove-build-sshkey' was not found in01:22
SpamapS/tmp/tmp8iptk_kh/4635c79b877d42e8b5e57bf242a3987a/trusted/project_0/git.zuul-ci.org/zuul-base-jobs/playbooks/base/roles:/tmp/tmp8iptk_kh/4635c79b877d42e8b5e57bf242a3987a/work/.ansible/roles:/usr/share/ansible/roles:/etc/ansible/roles:/tmp/tmp8iptk_kh/4635c79b877d42e8b5e57bf242a3987a/trusted/project_0/git.zuul-ci.org/zuul-base-jobs/playbooks/base"01:22
SpamapShrmph01:23
SpamapSI do have zuul-jobs as an untrusted project.. hrm01:24
SpamapSfor whatever reason my executor hasn't pulled in zuul-jobs01:29
SpamapSdo I have to template it in as a required project for every job?01:29
SpamapSohhh.. I think I namespaced it wrong01:30
SpamapSinteresting. So.. if you set up your zuul git source as git.zuul-ci.org, zuul-base-jobs don't work, becauase the repos aren't under openstack-infra01:31
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: web: add change status page  https://review.openstack.org/59947201:37
*** jiapei has joined #zuul02:55
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Increase timeout on streaming tests  https://review.openstack.org/59949505:24
*** tobiash has joined #zuul05:25
*** eumel8 has quit IRC05:48
*** gundalow has quit IRC05:49
*** mugsie has quit IRC05:49
*** gundalow has joined #zuul05:49
*** zigo has quit IRC05:49
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Increase timeout on streaming tests  https://review.openstack.org/59949505:52
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Increase hard test timeout  https://review.openstack.org/59949505:56
*** hashar has joined #zuul06:09
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Cap cherrypy to below 18.0.0  https://review.openstack.org/59950206:34
*** snapiri has joined #zuul06:40
openstackgerritMarkus Hosch proposed openstack-infra/zuul master: Add a sanity check for all refs returned by Gerrit  https://review.openstack.org/59901106:45
*** quiquell has joined #zuul06:46
tobiashcorvus, clarkb: we have to cap cherrypy to below 18.0.0 to unbreak tests06:58
tobiashcorvus, clarkb: I also identified the commit in cherrypy that breaks us: https://github.com/cherrypy/cherrypy/commit/d3fa6b80b227069a795a15fc56129f44b910829206:58
SpamapSFYI, I have my zuul via AWS/EKS/Kubernetes working-ish now. Still need to add log storage and builds DB07:03
SpamapSalso I don't quite have the ingress/nginx config right yet07:03
tobiashcool07:12
*** quiquell has quit IRC07:24
tobiashcorvus, clarkb: I pushed up a PR that fixes the issue: https://github.com/cherrypy/cherrypy/pull/173607:33
SpamapSWondering if I can package it up with a helm chart07:34
SpamapSthis has been kind of massive as an effort. Would love to share it with anyone else who wants to run zuul on k8s07:34
*** jpena|off is now known as jpena07:45
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Cap cherrypy to below 18.0.0  https://review.openstack.org/59950207:51
*** electrofelix has joined #zuul09:14
*** panda|rover has quit IRC09:54
*** panda has joined #zuul09:59
*** panda has quit IRC10:04
*** bhavikdbavishi has joined #zuul10:48
*** mugsie has joined #zuul10:48
*** jpena is now known as jpena|lunch11:02
*** panda has joined #zuul11:34
dmsimardSpamapS: k8s operators are all the rage right now.11:42
dmsimardWith CRDs.11:43
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Use gearman client keepalive  https://review.openstack.org/59957311:57
fungiSpamapS: we should be able to patch the zuul-base-jobs repo to assume it's not using an openstack-infra namespaced zuul-jobs repo12:02
fungithe openstack community doesn't use what's in zuul-base-jobs, it's there as an example anyway12:02
*** samccann has joined #zuul12:02
*** jpena|lunch is now known as jpena12:03
*** darkwisebear has joined #zuul12:21
*** rlandy has joined #zuul12:30
*** darkwisebear has quit IRC12:30
*** darkwisebear has joined #zuul12:31
*** jbryce has joined #zuul12:38
tristanCcorvus: mordred: jhesketh: fwiw, i wrote a blog post about React from a python dev point of view: http://www.softwarefactory-project.io/react-for-python-developers.html13:11
jheskethtristanC: awesome, will read that tomorrow :-)13:17
*** bhavikdbavishi has quit IRC13:37
openstackgerritJeremy Stanley proposed openstack-infra/zuul-base-jobs master: Remove zuul-jobs namespace  https://review.openstack.org/59960713:58
fungiSpamapS: ^ would that have helped?13:58
pabelangerfungi: SpamapS: we should make that fqdn, - zuul: git.zuul-ci.org/zuul-jobs14:01
pabelangeralso, does zuul.o.o have git.zuul-ci.org connection?14:01
fungipabelanger: it does not, but zuul.o.o doesn't use the zuul-base-jobs repo14:02
fungipabelanger: also, won't relative naming work fine there if we're assuming that zuul-jobs is being consumed via the same connection as zuul-base-jobs?14:03
openstackgerritMerged openstack-infra/nodepool master: Fix node state checks after aquiring lock  https://review.openstack.org/59934314:04
fungipabelanger: also in theory it makes zuul-base-jobs more reconsumable if the user has a forked/local zuul-jobs repo?14:04
pabelangerfungi: maybe, but as you add more connections into zuul, it gets much harder to know where a repo lives.  I've found, at least in rdoproject, namespacing projects to be much easier on end users14:04
fungisince the url to zuul-jobs isn't hardcoded in the base job14:04
fungithe base and base-test jobs in the zuul-base-jobs project are almost never likely to be used by complex deployments anyway, so i think the idea is to solve for the simple case anyway14:06
*** maxamillion has joined #zuul14:10
*** jiapei has quit IRC14:34
dmsimardcorvus: Would you be okay with an iterative approach to the AWS EC2 nodepool driver ? I feel like attempting to land feature parity in a single patch might make it harder to review and land.15:16
dmsimardBy features I mean like managing leaks, quotas (I see max-cores/max-ram as different than max-servers), diskimage (especially because this touches stuff outside of nodepool-launcher), cloud-image, etc15:17
*** openstackgerrit has quit IRC15:20
*** shachar has joined #zuul15:23
ShrewsI wouldn't expect other drivers to have exact feature parity15:24
ShrewsBut we should probably establish a set of "basic things" a driver should do before we land it15:25
Shrewsi think managing leaks falls under that15:25
corvusdmsimard: how about a big patch series?15:26
dmsimardcorvus: yeah a patch series is what I had in mind15:27
corvuswe can get the whole series looking right before we land it.  you can order it by importance too, so once we hit a critical mass, we could land a chunk.15:27
*** snapiri has quit IRC15:27
*** openstackgerrit has joined #zuul15:31
openstackgerritMarkus Hosch proposed openstack-infra/nodepool master: Add metric for image build result  https://review.openstack.org/59041215:31
*** sshnaidm is now known as sshnaidm|afk15:37
fungithe osf marketing team is working on the one-pager glossy handout for zuul (e.g., to have on hand at ansiblefest) and is hoping we can give them a shorter url for https://zuul-ci.org/docs/zuul/admin/zuul-from-scratch.html15:40
fungiwould we want to add a redirect via a .htaccess file for that?15:41
clarkbI wonder if sphinx supports that functionality in a sphinxy way too15:42
clarkbbut .htaccess should work as long as vhost allows for it15:42
fungiwell, the sphinx roots are fairly far down too15:43
fungihttps://zuul-ci.org/docs/zuul/zfs wouldn't really be too much better15:43
fungii think they're wanting something easy to type with your thumb on a cell phone while you're wandering away from the booth with your flyer15:44
clarkbgood point15:44
* fungi thinks "this is what qrcodes are for"15:45
pabelangerhow has foundation done it in the past with log URLs?15:47
fungiwhat log urls?15:48
pabelangersorry, long* URLs15:49
fungithey've mostly only promoted things on https://www.openstack.org/ in the past and set up one-word redirects at the docroot level for things they want to put in print media like brochures15:50
fungii think we'd rather they use a zuul-ci.org domain in the url rather than openstack.org15:52
clarkbright so to make it more concret https://zuul-ci.org/get-started or similar would be what they are looking for15:53
clarkbin the past that has been https://openstack.org/get-started for openstack and they manage that webserver15:53
pabelangeryah, that seems user friendly15:57
*** jlvilla-viva is now known as jlvillal15:58
corvusi think a .htaccess at root sounds like a good solution16:00
*** hashar is now known as hasharAway16:21
*** darkwisebear has quit IRC16:28
*** bhavikdbavishi has joined #zuul16:47
*** bramwelt has joined #zuul16:50
*** dkehn has quit IRC16:56
bhavikdbavishi@here need help on 'nodepool', we are process of migrating existing zuul v2 to zuul v3.16:57
bhavikdbavishiexisting slaves are configured and get connect with 'jenkins' user.16:57
bhavikdbavishinow while setting up with nodepool, how do I make use of same 'jenkins' user and 'id_rsa'?16:57
bhavikdbavishiI did update '.ssh/config' with below content, but when I try to run 'ssh-keyscan -t ed25519 <slave>' it results empty.16:57
bhavikdbavishiHost *16:57
bhavikdbavishi  IdentityFile /var/lib/zuul/.ssh/jenkins_id_rsa16:57
bhavikdbavishi  User jenkins16:57
bhavikdbavishiI can specify user name to nodepool.yaml, but I couldn't find way to specify 'sshkey' info. OR do I need to specify elsewhere?16:57
*** hwoarang_ has joined #zuul16:57
*** hwoarang__ has joined #zuul16:58
*** dkehn has joined #zuul16:59
pabelangerbhavikdbavishi: nodepool no longer connected to a remote node via SSH, it just does a keyscan to validate the node is online17:00
pabelangeralso, nodepoolv3 doesn't have support for jenkins. I have seen some project that try to add support for it17:00
pabelangerIIRC: https://wiki.jenkins.io/display/JENKINS/NodePool+Agents+Plugin17:01
*** hwoarang has quit IRC17:01
*** hwoarang_ has quit IRC17:02
*** hwoarang has joined #zuul17:03
*** hwoarang__ has quit IRC17:08
*** jpena is now known as jpena|off17:16
openstackgerritJeremy Stanley proposed openstack-infra/zuul-website master: Add a get-started redirect  https://review.openstack.org/59969917:19
fungicorvus: clarkb: pabelanger: thanks. straw-man ^17:20
fungialso it might be nice to get a second review on https://review.openstack.org/591870 (promotional banner mentioning ansiblefest presence)17:20
corvusfungi: tobiash +2d,  i +3d17:21
*** openstackgerrit has quit IRC17:22
fungithanks!17:22
*** openstackgerrit has joined #zuul17:25
openstackgerritMerged openstack-infra/zuul-website master: Add a promotional message banner and events list  https://review.openstack.org/59187017:25
bhavikdbavishipabelanger: ok, thanks for the info.17:27
fungicorvus: clarkb: pabelanger: if we can at least get consensus on what the url should be, that will avoid getting in the way of print deadlines to have the materials in time for ansiblefest17:36
pabelanger+217:39
fungii chose /get-started in honor of the "get started" button it'll be backing17:40
corvusfungi: 301 and not 302?17:43
corvusfungi: mostly thinking -- if we're considering changing the target in the future, should it be 302?17:43
fungiyes, thanks! i did in fact mean temporary redirect. will fix17:43
corvusfungi: cool.  other than that, lgtm.17:44
fungias for the global url in the index page there, was there a reason we didn't make it a local link instead?17:44
funginot that it particularly helps in this case because we can't currently test the redirect via logs.o.o anyway17:44
fungioh, and the absoluteness would present a problem regardless17:45
corvusfungi: i don't recall a reason for that; probably just copy/pasted a url into the text17:46
openstackgerritJeremy Stanley proposed openstack-infra/zuul-website master: Add a get-started redirect  https://review.openstack.org/59969917:46
fungithere are a few other global urls for https://zuul-ci.org/something in there anyway (for example, docs)17:46
*** electrofelix has quit IRC17:58
clarkbfungi: minor thing on https://review.openstack.org/#/c/599699/2 wasn't sure if that is itnentional or not18:28
fungiclarkb: thanks, i'll have to test it18:33
openstackgerritDoug Hellmann proposed openstack-infra/nodepool master: uncap sphinx  https://review.openstack.org/59974218:45
openstackgerritAndreas Jaeger proposed openstack-infra/zuul master: Uncap sphinx  https://review.openstack.org/59974318:48
openstackgerritAndreas Jaeger proposed openstack-infra/zuul master: Uncap sphinx  https://review.openstack.org/59974318:52
*** bhavikdbavishi has quit IRC19:07
openstackgerritJeremy Stanley proposed openstack-infra/zuul-website master: Add a get-started redirect  https://review.openstack.org/59969919:17
openstackgerritDoug Hellmann proposed openstack-infra/nodepool master: uncap sphinx  https://review.openstack.org/59974219:19
openstackgerritAndreas Jaeger proposed openstack-infra/zuul master: Uncap sphinx  https://review.openstack.org/59974319:21
*** goern has quit IRC19:34
*** elyezer_ has joined #zuul20:27
openstackgerritJames E. Blair proposed openstack-infra/zuul-jobs master: add-build-sshkey: Remove only the master key  https://review.openstack.org/59907320:27
*** elyezer__ has quit IRC20:30
corvusi've seen two changes fail 3 TestStreaming tests on both py35 and py3620:57
corvusthat seems unusually reliable; i wonder if a dependency changed20:57
corvusthere is a new cherrypy20:58
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Add private key storage migration  https://review.openstack.org/59221320:59
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Change project.private_key to private_secrets_key  https://review.openstack.org/59730220:59
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Create per-project ssh keys  https://review.openstack.org/59771120:59
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Provide per-project ssh key to executor  https://review.openstack.org/59772720:59
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Serve project SSH keys and document  https://review.openstack.org/59906320:59
*** samccann has quit IRC21:01
corvusthere definitely seems to be a problem with the new ws4py21:30
corvuser, sorry ws4py is the same, but that's where the error is coming from21:33
clarkbcherrypy update incompatible with existing ws4py then?21:34
corvusi suspect this: https://github.com/cherrypy/cherrypy/commit/a95e619f21:36
clarkbcorvus: cherrpy changes file says the big change in 18.0.0 is dropping python2.7 support. We don't python27 so probably not related, however 17.x is an LTS supported version as a result if we want to pin to 17.021:36
corvusclarkb: yeah, ping to 17 is probably the quick fix21:36
corvusthough i think we'd have to pin to 17.3.0, not 17.4 since that ^ made it into 17.421:37
corvusws4py.exc.HandshakeError: Invalid challenge response: b"b's7t5jqfxalziz8svzckiqazs08a='" wanted b'S7t5jQFxaLzIZ8svZckiQAZS08A='21:37
corvusthat's from my local debugging ^21:37
corvusi'll try 17.4 locally and check21:38
corvusthere is no 17.4.021:39
corvushttps://pypi.org/project/CherryPy/#history21:39
corvusso i guess any 17 will work.  until they release 17.4.0 :)21:40
corvusi'm puzzled.  https://github.com/cherrypy/cherrypy/commit/a95e619f  looks exactly equivalent when running under py3, which we are and have been21:41
clarkbis it actually running under python2 somehow?21:42
corvusno, we don't work under py2 at all21:42
corvusmust be a different change21:42
corvusit's this one: https://github.com/cherrypy/cherrypy/commit/d3fa6b80b227069a795a15fc56129f44b910829221:50
corvusws4py supplies the header as bytes21:50
clarkbodd that they would use six if python3 only21:51
clarkbcorvus: so it converts the byte string to "b'foo'" then converts that to bytes again as b"b'foo'"21:51
pabelangercorvus: clarkb: https://github.com/cherrypy/cherrypy/pull/1736 is in backscoll from tobiash21:54
*** hasharAway has quit IRC21:56
corvusoh missed that :)21:58
corvusand... there's the change from tobiash to pin :)21:59
corvusthat's what i get for taking a holiday22:00
corvusclarkb, pabelanger: want to +3 https://review.openstack.org/599502 ?22:00
pabelangerha, I missed that too22:00
clarkbdone22:00
*** ianychoi has quit IRC22:22
corvusi think we're going to have to squash the cherrypy and sphinx fixes22:38
corvusi'll do that now22:38
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Cap cherrypy and uncap sphinx  https://review.openstack.org/59950222:41
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Add private key storage migration  https://review.openstack.org/59221322:42
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Change project.private_key to private_secrets_key  https://review.openstack.org/59730222:42
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Create per-project ssh keys  https://review.openstack.org/59771122:42
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Provide per-project ssh key to executor  https://review.openstack.org/59772722:42
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Serve project SSH keys and document  https://review.openstack.org/59906322:42
corvusi went ahead and rebased those on the dependency fix, so hopefully we can go ahead and approve those22:43
*** rlandy is now known as rlandy|bbl22:45
openstackgerritMerged openstack-infra/zuul-sphinx master: Improve warning details  https://review.openstack.org/59946922:46
corvusianw: i'll tag 6106a9051f393b6140fb60e452cf384cb96616fa as 0.2.422:57
*** ianychoi has joined #zuul23:16
ianwthanks!23:20
openstackgerritMerged openstack-infra/zuul master: Cap cherrypy and uncap sphinx  https://review.openstack.org/59950223:47

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!