Friday, 2018-11-02

*** ssbarnea has quit IRC00:25
ianwhave there been webui changes recently?  I've noticed that just leaving it with once change "pulled down", eventually it refreshes at some point and decides to expand out another change all together01:19
ianwit's almost like as the screen changes distance, it unrolls whatever change is at the point in the screen that my originally expanded one was, if that makes sense01:20
clarkbianw I think that ue a bug in the react rewrite01:21
clarkbya I wonder if it uses an index on thr list that it thinks will be stable01:21
ianwyeah, that would explain it quite well01:23
*** swest has quit IRC02:31
tristanCthat's the issue indeed, the 'key' property seems to be in charge of keeping track of component state, and it's currently set with list indexes02:44
*** caphrim007_ has joined #zuul02:55
caphrim007_any zuul folks around?02:55
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: web: uses queues uid to preserve state on change  https://review.openstack.org/61493302:59
*** bhavikdbavishi has joined #zuul02:59
tristanCianw: while i'm at it, are you aware of other issues/regressions with the new webui?03:05
tristanCcaphrim007_: may I help you?03:05
caphrim007_tristanC: I'm having a helluva time trying to determine why this error is popping up http://paste.openstack.org/show/733926/03:06
ianwtristanC: not that i've noticed, yet :)03:06
caphrim007_https://github.com/F5Networks/f5-ansible/tree/devel/.zuul.d03:06
caphrim007_is my zuul config that it's mentioning03:07
caphrim007_but, i clearly have names indented under my job and project so...03:07
tristanCcaphrim007_: i don't think you are supposed to keep playbooks in zuul.d directory, maybe try moving those out of the way?03:08
caphrim007_k, trying03:08
tristanCcaphrim007_: it seems like the issue is that part: https://github.com/F5Networks/f5-ansible/blob/devel/.zuul.d/playbooks/job-playbook.yaml#L3-L503:10
tristanCthat dictionary object doesn't have a single key as expected03:10
caphrim007_then so i understand03:10
caphrim007_zuul is recursively looking for all yaml files?03:11
tristanCcaphrim007_: iirc, zuul only loads files ending with '.yaml', recursively03:11
caphrim007_ok, checking03:11
tristanCcaphrim007_: perhaps you could work around this by using '.yml' extension?03:11
tristanCthough it's probably better to just move the playbook out of the zuul.d for now03:11
caphrim007_tristanC: you hit the nail on the head. that was the problem03:13
caphrim007_geez, i sat here for an hour smacking my head about that. ugh. thanks so much for the help tristanC03:14
tristanCcaphrim007_: you're welcome, glad i could help :-)03:17
tristanCianw: 614933 seems to fix the expand shifting position issue, to quickly reproduce you can filter, expand a change, and remove the filter03:18
tristanCianw: without 614933, after removing the filter, the first change of the pipelines is expanded, and with the fix, the filtered change stays expanded after removing the filter03:19
*** bhavikdbavishi1 has joined #zuul04:07
*** bhavikdbavishi has quit IRC04:09
*** bhavikdbavishi1 is now known as bhavikdbavishi04:09
*** pbrobinson has quit IRC04:09
*** toabctl has quit IRC04:13
*** toabctl has joined #zuul04:14
*** caphrim007_ has quit IRC04:54
*** threestrands has quit IRC05:40
*** pcaruana has joined #zuul07:20
*** goern has joined #zuul07:43
*** bhavikdbavishi has quit IRC08:25
*** ssbarnea has joined #zuul09:15
*** panda|off is now known as panda10:03
*** sshnaidm|off has quit IRC10:10
*** sshnaidm has joined #zuul10:14
*** sshnaidm is now known as sshnaidm|off10:24
*** EmilienM is now known as EvilienM10:25
*** electrofelix has joined #zuul11:00
frickleris there a way to do negative filtering on http://zuul.openstack.org/builds , like all builds with "Result != SUCCESS" or "Job != *tripleo*"?11:37
goernhey all, has anyone worked on using a zuul job running on openshift to build, waiting for the new image and push the image to a docker registry?!11:41
openstackgerritVieri proposed openstack-infra/zuul-base-jobs master: Update min tox version to 2.0  https://review.openstack.org/61514811:56
*** zul has quit IRC12:06
*** strigazi has joined #zuul12:07
strigaziHello, I'm trying to encrypt a secret with tools/encrypt_secret.py from openstack-infra/zuul but I can't find the zuul server url. It is not zuul.openstack.org12:07
openstackgerritVieri proposed openstack-infra/zuul-sphinx master: Update min tox version to 2.0  https://review.openstack.org/61516212:11
openstackgerritVieri proposed openstack-infra/zuul master: Update min tox version to 2.0  https://review.openstack.org/61516412:13
openstackgerritVieri proposed openstack-infra/zuul-jobs master: Update min tox version to 2.0  https://review.openstack.org/61517212:22
strigaziI tried also to fetch kolla's public key that should and it is not there: curl https://zuul.openstack.org/api/tenant/openstack/key/kolla.pub12:23
strigaziper documentation it should be found in: They can be fetched at the path /api/tenant/<tenant>/key/<project>.pub where <project> is the canonical name of a project and <tenant> is the name of a tenant with that project.12:23
strigazihttps://zuul-ci.org/docs/zuul/user/encryption.html12:24
*** zul has joined #zuul12:37
Shrewsstrigazi: tools/encrypt_secret.py --infile file_with_secret --tenant openstack https://zuul.openstack.org openstack/kolla13:02
*** panda is now known as panda|lunch13:10
*** panda|lunch is now known as panda13:48
*** rfolco is now known as rfolco|off14:11
openstackgerritMonty Taylor proposed openstack-infra/nodepool master: Consume rate limiting task manager from openstacksdk  https://review.openstack.org/61216914:27
mordredShrews: ^^ and there's an update to the nodepool patch to show consuming that14:28
*** jimi|ansible has quit IRC14:31
Shrewsmordred: yeah, but those test failures concern me14:41
Shrewsno idea what's going on14:41
mordredShrews: me either.14:48
*** j^2 has joined #zuul14:57
*** ssbarnea has quit IRC15:08
*** ssbarnea has joined #zuul15:10
*** chandankumar is now known as chkumar|off15:14
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Merger: automatically add new hosts to the known_hosts file  https://review.openstack.org/60845315:19
openstackgerritJames E. Blair proposed openstack-infra/zuul master: WIP: support foreign required-projects  https://review.openstack.org/61314315:22
mrhillsmancan someone point me to the docs where i can run a job that requires multiple nodes; is that a thing?15:35
clarkbmrhillsman: yes, you create a nodeset with multiple nodes in it15:35
clarkbmrhillsman: https://zuul-ci.org/docs/zuul/user/config.html#nodeset the docs for nodesets15:36
mrhillsmanthx15:36
mrhillsmanwas just doing a good ol docs search :)15:36
logan-https://github.com/openstack-infra/openstack-zuul-jobs/blob/master/zuul.d/nodesets.yaml#L98-L111 too15:37
mrhillsmanthx15:38
*** AJaeger has quit IRC15:46
*** AJaeger has joined #zuul15:48
*** caphrim007 has joined #zuul15:52
caphrim007morning folks. i had a question15:57
caphrim007if i have single project, then i can make many jobs for that single project15:57
caphrim007and can each of those jobs have its own nodeset?15:57
caphrim007and, do those jobs run in parallel? or sequentially?15:57
clarkbcaphrim007: each job can have its own nodeset and they will run in parallel as long as nodepool has available resources that allow it to spin up those nodesets in parallel15:58
caphrim007clarkb: cool thanks for the info15:58
caphrim007would i need to change zuul-executor to run X jobs? does it have a default limit on the number of jobs it runs at once?15:59
clarkbcaphrim007: the executor has a few governors in place where it will stop accepting new jobs once memory, cpu, and disk thresholds are met ( I forget the specific details, but the idea is you shouldn't have to tune that yourself, isntead th executor will do as much work as it can without running out of system resources)16:00
caphrim007clarkb: gotcha. thanks!16:00
clarkbcaphrim007: the openstack zuul instance has 11 executors to keep up with our demand. I think that roughly comes out to ~100 test nodes per executor and ~70 jobs per executor at any time given our average use16:02
clarkbhttp://grafana.openstack.org/d/T6vSHcSik/zuul-status?orgId=1 has specific numbers. In general though that is a function of the size of the instances too16:02
caphrim007clarkb: ok. i don't have anywhere near that much...but as I get more resources in my cloud accounts I would want to ramp it up to run my full test suite as fast as possible16:03
clarkbyup and you should be able to scale the executors horizontally as necessary to achieve that16:03
corvusclarkb: are you happy with the nodepool sha from yesterday?16:07
clarkbcorvus: yes, I haven't noticed any problems and we appear to be using our full capactiy. Let me double check that images uploaded properly though16:07
clarkb| 0000000012 | 0000000001 | rax-dfw              | ubuntu-bionic        | ubuntu-bionic-1541137033        | 7144fc56-6ba4-4a41-9f73-b11ecd3c35bc | ready     | 00:09:58:52 |16:08
clarkbthat lgtm. I am happy with nodepool as is running now16:08
corvuszuul 3.3.0 and nodepool 3.3.1 tagged16:10
*** AJaeger_ has joined #zuul16:13
*** AJaeger has quit IRC16:15
*** pcaruana has quit IRC16:17
*** AJaeger_ is now known as AJaeger16:20
*** zul has quit IRC16:53
*** panda is now known as panda|off17:36
-openstackstatus- NOTICE: OpenStack infra's mirror nodes stopped accepting connections on ports 8080, 8081, and 8082. We will notify when this is fixed and jobs can be rechecked if they failed to communicate with a mirror on these ports.18:11
*** electrofelix has quit IRC18:24
*** pcaruana has joined #zuul18:27
*** jimi|ansible has joined #zuul18:46
openstackgerritAndreas Jaeger proposed openstack/pbrx master: Use publish-to-pypi  https://review.openstack.org/61529618:49
*** EvilienM is now known as EmilienM18:53
-openstackstatus- NOTICE: The firewall situation with ports 8080, 8081, and 8082 on mirror nodes has been resolved. You can recheck jobs that have failed to communicate to the mirrors on those ports now.18:55
*** pcaruana has quit IRC19:08
*** caphrim007 has quit IRC20:12
goernheyall, its there a plan to extend the github driver to also understand checks in addition to statuses?20:57
mordredgoern: yes - as well as to support in-line comments from zuul on the PR21:03
corvusgoern: yes -- jlk was first implementing support for that in github3.py (the library zuul uses to interact with github)21:04
mordredgoern: my understanding is that each require updates to the pygithub3 library we use - and jlk, who works at github now, has been working on getting that done21:04
mordredcorvus: kinx21:04
mordredjinz21:04
mordredWOW - I cannot type jinx apparently21:04
corvusmordred: your keyboard is geenksed.21:05
mordredcorvus: clearly21:05
goerncool, thx ya. any timeframe for that?21:05
goernor something where help is needed? other than alpha testing :)21:05
corvuslemme look up the pr21:05
corvusgoern: https://github.com/sigmavirus24/github3.py/pull/88821:06
mordredgoern: once that support has landed in the library, we'll need someone to update the gh driver to use it - that hasn't started yet21:06
mordredcorvus: although, I suppose someone could start on that with a depends-on that PR :)21:07
corvusmordred: true :)21:07
goern#888 looks pretty complete and close to merge?!21:08
corvusyeah, hopefully jlk can weigh in on what else is necessary :)21:08
goernand the gh driver... any pointer and some spare time to mentor someone? :)21:09
corvusgoern: i can help a bit with general driver questions (and it closely follows the gerrit driver, so that's quite a bit actually), jlk and tobiash are more expert in github details21:13
goernnice, tobias is in my TZ, so I will give him a ping21:14
openstackgerritJames E. Blair proposed openstack-infra/zuul master: DNM: extra debugging  https://review.openstack.org/61533021:30
*** rlandy has quit IRC21:41
openstackgerritMerged openstack/pbrx master: Use publish-to-pypi  https://review.openstack.org/61529621:47
*** j^2 has quit IRC22:05
openstackgerritJames E. Blair proposed openstack-infra/zuul master: DNM: extra debugging  https://review.openstack.org/61533022:19
*** ianychoi has quit IRC23:02
openstackgerritJames E. Blair proposed openstack-infra/zuul master: WIP: Set relative priority of node requests  https://review.openstack.org/61535623:24
clarkbcorvus: what is with the ssh host key debugging? are we having problems with that again?23:30
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Merger: automatically add new hosts to the known_hosts file  https://review.openstack.org/60845323:30
corvusclarkb: nah, it's me trying to make the merger automatically add ssh keys to known hosts.   that change ^23:31
corvusclarkb: the quickstart test was failing on that and i couldn't figure out why without crazy debugging.  i figured it out.  it was because the actual username comes from the url that we give the merger.23:32
corvusclarkb: regarding the change itself -- in the scheduler, paramiko is set up to ignore unknown host keys.  but the *git* subprocess in the merger can't do that, because it relies on the openssh client.  there's a new feature in openssh to auto-add unknown keys, but it's too bleeding edge for us.  so instead, i'm trying to have the merger perform a paramiko connection solely to set up a known_hosts file before23:34
corvuswe perform our first git operation on a repo in the merger.23:34
corvusclarkb: long story short -- a new user setting up zuul shouldn't have to do anything with ssh host keys on any component of zuul23:34
corvus(it's one of the worst parts of bootstrapping a zuul right now)23:35
clarkbinteresting, and I guess if you wanted to have verification and control you could preconfigure a key?23:35
corvusalso -- makes it easier to add new connections (as long as they aren't that version of gerrit that does weird things with host keys)23:35
clarkbwoudl zuul honor a host keys file if it was already there?23:35
corvusclarkb: exactly.  yes.23:35
corvusclarkb: paramiko and openssh will still throw a fit if the ssh key is *wrong*23:35
corvusso if it changes after the first connection, you're still safe.23:36
corvusif you're paranoid about the first connection, then prepopulate known_hosts.  i'd also be happy to make an option to disable this (if you know you always want to be paranoid and don't want to accidentally accept a host key on first connect)23:37
corvusthough i think for a default, the behavior i'm proposing (accept on first connect) is good for most cases.  not everyone runs their zuul across the public internet.  :)23:38
clarkbFor myself I'm usually less paranoid about making a first connection out of the bluethat would be hard for someone to know to itnercept (of course maybe I should be more paranoid)23:38
clarkbchecking that things don't change later is my biggest concern, but I'm also sure there are individuals that would like to supply the keys themselves as well23:39
corvusyep.  we can accomodate all cases23:44
*** ianychoi has joined #zuul23:55

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!