Monday, 2017-12-11

*** jkilpatr has joined #zuul00:09
*** JasonCL has quit IRC00:49
*** JasonCL has joined #zuul00:55
Shrewspabelanger: jeblair: Has the command socket been tested with running in daemon mode? I just spent the last hour trying to make it work for the new finger gateway, unsuccessfully.00:57
Shrewshrm, in non-daemon mode, getting a "permission denied" exception after sending a command (which doesn't work) and hitting Ctrl-C00:59
Shrewsfu00:59
Shrewsfun00:59
*** JasonCL has quit IRC00:59
*** JasonCL has joined #zuul01:00
*** JasonCL has quit IRC01:05
*** JasonCL has joined #zuul01:22
*** Wei_Liu has joined #zuul01:35
*** openstackgerrit has joined #zuul02:28
openstackgerritJoshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Remove unused setup_tables  https://review.openstack.org/52697002:28
openstackgerritJoshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Fix line wrapping in github docs  https://review.openstack.org/52697102:39
openstackgerritJoshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Fix attribute syntax in docs  https://review.openstack.org/52697202:39
*** JasonCL has quit IRC02:41
*** baiyi has joined #zuul03:01
*** baiyi has left #zuul03:05
*** dkranz has quit IRC03:06
*** baiyi has joined #zuul03:18
*** baiyi1 has joined #zuul03:21
*** baiyi has quit IRC03:23
*** baiyi1 is now known as baiyi03:23
*** threestrands has quit IRC06:17
*** toabctl has joined #zuul06:41
*** baiyi1 has joined #zuul06:53
*** baiyi has quit IRC06:55
*** baiyi1 is now known as baiyi06:55
*** sshnaidm|off is now known as sshnaidm|ruck07:07
*** baiyi1 has joined #zuul07:31
*** baiyi has quit IRC07:33
*** baiyi1 is now known as baiyi07:33
*** hashar has joined #zuul08:41
*** jpena|off is now known as jpena08:45
*** Wei_Liu has quit IRC09:06
*** Wei_Liu has joined #zuul09:13
*** flepied has quit IRC09:14
*** flepied has joined #zuul09:14
*** electrofelix has joined #zuul10:19
*** baiyi has quit IRC11:16
*** baiyi has joined #zuul11:16
*** flepied_ has joined #zuul11:23
*** flepied has quit IRC11:25
*** jkilpatr has quit IRC11:37
*** hashar has quit IRC11:46
*** jkilpatr has joined #zuul12:11
*** hashar has joined #zuul12:19
*** jpena is now known as jpena|lunch12:25
*** flepied__ has joined #zuul12:31
*** flepied_ has quit IRC12:34
openstackgerritAndreas Jaeger proposed openstack-infra/zuul-jobs master: releasenotes: Remove package install  https://review.openstack.org/52685012:48
*** lennyb has quit IRC13:00
*** lennyb has joined #zuul13:02
*** ChanServ has quit IRC13:08
openstackgerritAndreas Jaeger proposed openstack-infra/zuul-jobs master: releasenotes: Remove package install  https://review.openstack.org/52685013:16
*** ChanServ has joined #zuul13:18
*** barjavel.freenode.net sets mode: +o ChanServ13:18
*** dkranz has joined #zuul13:22
*** jpena|lunch is now known as jpena13:27
*** nguyentrihai has quit IRC13:40
*** nguyentrihai has joined #zuul13:52
*** weshay|MOD is now known as weshay|sickday14:13
*** maxamillion has quit IRC14:29
*** maxamillion has joined #zuul14:48
rcarrillocruzhe folks14:51
rcarrillocruzon the new zuul v3 dashboard, howe we pull info from builds14:52
rcarrillocruzi assume is cos of the sql reporter14:52
rcarrillocruzthen the dashboard populates builds/jobs page with that data?14:52
clarkbrcarrillocruz: builds comes from the sql reporter db yes, jobs is from the internal datastructure for the jobs14:52
*** dmellado has quit IRC14:53
rcarrillocruzk, and where is the logic for those zuul dashboard tabs?14:54
rcarrillocruzlike, if i wanted to add new ones with other sql queries14:54
clarkbrcarrillocruz: under zuul/web iirc. There are angular js components and then zuul web python components14:54
rcarrillocruzah, so from the source tree of zuul i see zuul/web/static/stream.html14:56
rcarrillocruzyou folks pull that angular externally and dump it in that folder structure ?14:56
clarkbyes iirc14:58
clarkbrcarrillocruz: its a todo to have zuul express that through proper js tooling aiui14:58
rcarrillocruzgotcha, was wnodring where it all came from, assumed some zuul::web puppetry14:58
rcarrillocruzthx14:59
jeblairShrews: it works for zuul-executor in daemon mode, i don't think the others have got a lot of testing yet15:04
Shrewsjeblair: i'll look at it again after getting up to speed on sprint things today. maybe i'm just doing something really wrong in my daemon15:05
*** dmellado has joined #zuul15:05
*** dmellado has quit IRC15:10
*** dmellado has joined #zuul15:12
tristanCrcarrillocruz: you can query zuul-web/{tenant}/builds.json?filters  where filters can be one or more "project", "pipeline", "change", "patchset", "ref", "newrev", "uuid", "job_name", "voting", "node_name", "result"15:14
tristanCwith "limit" and "skip" too15:14
rcarrillocruztristanC: is node name the node label for a given build ?15:14
tristanChum, the field is actually not set atm, it should be fixed in the sqlreporter.py15:16
tristanCalso, the html bits are quite crude, though the rest controller should be good enough to build better interfaces15:17
jeblairhonestly, i'm not sure if we should store that any more15:17
jeblairit doesn't map that well to zuulv3.  if anything, it would be the nodeset name, but it may be an anonymous nodeset, so i don't think it's a great fit.  is it useful?15:18
tristanCjeblair: yep, perhaps node count instead?15:18
jeblair(usually i would think that searching by branch would be more useful)15:19
clarkbjeblair: I could see the use being "does centos no longer work"15:19
clarkbso maybe you want base image?15:19
jeblairclarkb: but you can have more than one15:19
tristanCi'll try to draft a job.json endpoint to display job information, then clicking on a job name would display all the details such as the nodeset configuration15:20
jeblairtristanC: ++15:20
clarkbjeblair: good point its not longer homogenous15:20
rcarrillocruztristanC: i'm a total web/javascript noob, how hard would be to have jobs in 'Jobs' tab to show 'Failed since BLAH'15:20
rcarrillocruzala red/green balls in Jenkins15:20
tristanCrcarrillocruz: that was actually how the first patchset work, but now the jobs.json query the scheduler through gearman, and the last failure would only be available through sql15:21
rcarrillocruzah, so diffrent datasource, gotcha15:22
tristanCto render that jenkins like view, you'll have to for each job.json, query the build.json15:22
tristanCbut openstack-health is already that kind of thing so...15:23
jeblairit's more than that too -- jobs run in context of projects, so, to use openstack as an example, you might see 'openstack-tox-py35' as failed, but it could be because it failed on nova, or glance, or any of 1800 different projects.15:23
jeblairand remember, in a gating system, unlike jenkins, jobs are expected to fail, a lot, and it's fine.15:24
tristanCjeblair: though builds.json?pipeline=periodic&pipeline=post shouldn't15:24
jeblairtristanC: yep.  i think the builds page is a good way to create specific queries for things where you need to find failures.15:25
jeblairrcarrillocruz: can you do something like that ^ to get what you need?15:25
rcarrillocruzjeblair: yeah, in my test zuul context the job is pretty specific, like 'network-integration-tests-ios'15:26
rcarrillocruzso15:26
rcarrillocruzthinking of having like a custom jobs tab15:26
rcarrillocruzwhere i have the jobs i care about15:26
rcarrillocruzand have this green/red thing, to know 'ok, we have a regression since change BLAH'15:26
jeblairrcarrillocruz: you aren't running jobs pre-merge?15:27
*** dmellado has quit IRC15:29
rcarrillocruznot yet, is very rough what i have in testing. Also, not sure I would tackle a 'gate' in github, i need some sort of bot reacting to 'approve' trigger15:29
rcarrillocruzala workflow +1 in gerrit15:29
rcarrillocruzi think mordred asked about ansibot to other ansible folks in that context15:29
jeblairrcarrillocruz: zuul supports that.  you should be able to gate.15:29
rcarrillocruzmordred ?15:29
rcarrillocruzeventually i would like to have the workflow we have in openstack infra, like it's not a human pushing the merge button, as we have now15:30
*** dmellado has joined #zuul15:30
jeblairrcarrillocruz: even if you're not gating, i'd encourage you to set up a check pipeline at least.  that's one of the main benefits of zuul.  :)15:31
tristanCrcarrillocruz: actually fbo_ wrote a blog post about gating github repository: http://rdoproject.org/blog/2017/12/gate-repositories-on-github-with-software-factory-and-zuul3/15:32
rcarrillocruzwell, in my test zuul is the only thing i have15:34
rcarrillocruza chek pipeline15:34
rcarrillocruzletm e link15:34
rcarrillocruzhttps://github.com/rcarrillocruz-org/common-config/blob/master/zuul.d/pipelines.yaml15:34
jeblairrcarrillocruz: oh, when you said finding regressions, i thought you were only running post-merge pipelines15:35
tristanCrcarrillocruz: you should check that blog post, there is a gate pipeline and some protection settings to let zuul merge github pr when they are approved15:36
rcarrillocruzwhat is puzzling to me is that in gerrit driver, there's the workflow thing, which essentially zuul can react to and move changes into the gate pipeline15:36
tristanCgithub branch protection settings*15:36
rcarrillocruzso what i thought is that maybe we could have a bot listening on the PR for something like 'approve'15:36
rcarrillocruzand then zuul would react to that and put it on gate15:36
rcarrillocruztristanC: let me read, thx15:37
jeblairrcarrillocruz: so if you had a listing of job names + latest result, it wouldn't convey the information that jenkins does when it's run post-merge.  the result would be pretty random based on whether the most recent pull request worked or not.  it might be better to use the builds page to see all the results for a given job, then you'll have links to the failed pull requests.15:37
rcarrillocruzhmm i see , good call15:37
rcarrillocruztristanC , fbo_ : that really good stuff, thanks for the blogpost!15:41
tristanCrcarrillocruz: heh, you're welcome :-)15:42
*** dmellado has quit IRC15:52
*** dmellado has joined #zuul15:55
*** dmellado has quit IRC15:58
*** dmellado has joined #zuul16:01
mrhillsmanare there any instructions on the ara integration?16:15
mrhillsmanlike, i have index.html.gz files, but not sure if that is expected, and i should be focusing on the server handling the file, or that .gz addition is in error16:16
mrhillsmanwhen i visit the logs site on o.o i see the ara output properly formatted, mine are missing the styling it seems16:16
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Debug job selection  https://review.openstack.org/52714816:17
jeblairdmsimard: ^ know the answer to mrhillsman's question off the top of your head?16:18
jeblairmrhillsman: i think we copy over an entire directory's worth of stuff for ara16:19
dmsimardmrhillsman: yes, there's expected mimetypes to be configured16:19
clarkbI do, we compress everything because storage constraints16:19
clarkbso ya we configure apache to serve css.gz html.gz etc as html or css and so on16:19
dmsimardmrhillsman: see here: http://git.openstack.org/cgit/openstack-infra/puppet-openstackci/tree/templates/logs.vhost.erb#n1616:20
dmsimardThose are not just for ara but for logs in general, we have a lot of logs and try to gzip everything we can :)16:20
*** hashar has quit IRC16:26
mrhillsmanawesome, thx gents!16:26
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Debug job selection  https://review.openstack.org/52714816:32
*** hashar has joined #zuul16:40
*** jpena is now known as jpena|brb16:41
*** flepied_ has joined #zuul16:57
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Debug job selection  https://review.openstack.org/52714816:57
*** flepied__ has quit IRC16:59
*** electrofelix has quit IRC17:02
*** electrofelix has joined #zuul17:04
*** jpena|brb is now known as jpena17:24
*** hashar has quit IRC17:34
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Debug job selection  https://review.openstack.org/52714817:38
*** dmellado has quit IRC17:40
*** dmellado has joined #zuul17:40
*** hashar has joined #zuul17:41
jeblairpabelanger: it looks like "zuul-scheduler stop" doesn't completely work -- it looks like some threads stop, but not everything17:46
jeblairpabelanger: i just ran it on zuulv3.o.o if you want to look in the debug log.  i had to manually kill the process.17:46
*** dmellado has quit IRC17:59
*** dmellado has joined #zuul18:09
*** hashar is now known as GRR_NPM_XXXXz18:14
jeblairi just had to restart zuul-web after a zuul-scheduler restart18:15
jeblairwe may need to look into what happens if gearman fails or something similar18:15
Shrewshrm, does RPCClient have reconnect logic built in?18:18
Shrewsi guess it would be in gear.Client()18:19
*** jpena is now known as jpena|brb18:20
SpamapSI'd guess we have some blocking calls in our threads that we end up trying to join.18:29
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Add more job selection debug lines  https://review.openstack.org/52720718:39
*** jpena|brb is now known as jpena18:41
jeblairoh, this may also have been an unclean shutdown of the scheduler / gearman.  it's the first one of those we've had in a long time, so that may be a factor.18:46
*** sshnaidm|ruck is now known as sshnaidm|off18:55
pabelangerjeblair: okay, anything I should look into?19:00
jeblairpabelanger: if you have time to look into why the stop didn't work that would be great19:00
pabelangerokay, I'll take a look19:00
*** jpena is now known as jpena|away19:01
*** dmellado has quit IRC19:23
*** dmellado has joined #zuul19:25
*** dmellado has quit IRC19:45
Shrewsyeah, i can't seem to have the command socket accept any commands19:51
*** dmellado has joined #zuul19:51
*** dmellado has quit IRC19:51
Shrewsoh, maybe it's a race. the first thing CommandSocket.stop() does is set self.running=False, but that is what is keeping the socket listener running19:56
Shrewspabelanger: jeblair: ^^^19:56
Shrewsoh, but it should be blocked on accept()19:56
Shrewsgrrr19:57
*** dmellado has joined #zuul19:57
*** dmellado has quit IRC19:57
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Error on duplicate YAML keys  https://review.openstack.org/52723119:57
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Error on duplicate YAML keys  https://review.openstack.org/52723120:00
*** dmellado has joined #zuul20:03
*** dmellado has quit IRC20:04
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Error on duplicate YAML keys  https://review.openstack.org/52723120:04
jeblairtobiash: feel free to -1 for typos in user-facing error messages :)20:05
tobiashok20:05
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Error on duplicate YAML keys  https://review.openstack.org/52723120:07
*** dmellado has joined #zuul20:11
*** dmellado has quit IRC20:11
Shrewsah found the command socket problem20:12
Shrews\o/20:12
*** dmellado has joined #zuul20:13
*** dmellado has quit IRC20:14
pabelangeryay20:20
*** dmellado has joined #zuul20:24
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Add more job selection debug lines  https://review.openstack.org/52720720:24
*** dmellado has quit IRC20:24
*** GRR_NPM_XXXXz is now known as hashar20:26
*** dmellado has joined #zuul20:34
*** dmellado has quit IRC20:52
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Error on duplicate YAML keys  https://review.openstack.org/52723120:58
*** jkilpatr has quit IRC20:59
*** dmellado has joined #zuul21:17
*** jkilpatr has joined #zuul21:24
*** dmellado has quit IRC21:28
*** dmellado has joined #zuul21:31
*** dkranz has quit IRC21:33
*** threestrands has joined #zuul21:41
*** hashar has quit IRC21:46
*** baiyi1 has joined #zuul21:47
*** Wei_Liu1 has joined #zuul21:48
*** hashar has joined #zuul21:50
*** max_the_penguin has joined #zuul21:52
*** bramwelt1 has joined #zuul21:52
*** pabelanger_ has joined #zuul21:55
*** maxamillion has quit IRC21:56
*** lennyb has quit IRC21:56
*** baiyi has quit IRC21:56
*** Wei_Liu has quit IRC21:56
*** EmilienM has quit IRC21:56
*** SpamapS has quit IRC21:56
*** eventingmonkey has quit IRC21:56
*** pabelanger has quit IRC21:56
*** bramwelt has quit IRC21:56
*** baiyi1 is now known as baiyi21:56
*** Wei_Liu1 is now known as Wei_Liu21:56
*** EmilienM_ has joined #zuul21:56
*** EmilienM_ is now known as EmilienM21:56
*** EmilienM has quit IRC21:56
*** EmilienM has joined #zuul21:56
*** pabelanger_ is now known as pabelanger21:57
*** eventingmonkey has joined #zuul21:58
*** dmellado has quit IRC21:58
*** SpamapS has joined #zuul21:59
*** lennyb has joined #zuul22:00
jeblairit's zuul meeting time in #openstack-meeting-alt22:00
*** dmellado has joined #zuul22:08
*** dmellado has quit IRC22:10
*** dmellado has joined #zuul22:10
*** hashar has quit IRC22:13
*** max_the_penguin is now known as maxamillion22:14
*** hashar has joined #zuul22:17
*** hashar has quit IRC22:20
*** dmellado has quit IRC22:31
*** bramwelt1 is now known as bramwelt22:32
*** bramwelt has joined #zuul22:32
*** dmellado has joined #zuul22:36
*** dmellado has quit IRC22:48
jlkjeblair: missed meeting22:56
jeblairjlk: i feel like you hit the meeting bullseye, actually :)23:01
jeblairjlk: i kind of assumed that github3.py was really complicated and directly using requests would be lots of work, but maybe that's an option?23:01
*** jesusaur has quit IRC23:03
jlkJamie didn't think that was the case, and I've already had to peel it back a bit to touch requests object directly under it a few times.23:03
jlkI put the work on hold when the GraphQL API was released, thinking we'd move to that instead, but it's not coming to apps yet, so I can pick up the work again to move off of github3.py23:04
*** threestrands_ has joined #zuul23:04
*** threestrands_ has quit IRC23:04
*** threestrands_ has joined #zuul23:04
*** myoung|rover is now known as myoung|rover|bbl23:05
*** dmellado has joined #zuul23:06
*** threestrands has quit IRC23:06
jeblairjlk: ok neat.  if that's not too hard, that could have a lot of advantages; i've certainly been happy with that approach in other projects.23:07
jlkIt _should_ be pretty straight forward to implement. I don't think we do anything specifically with github3.py in testing, so it might be easy enough to strip it out without a lot of busy work23:08
*** jesusaur has joined #zuul23:10
dmsimardbtw, if you are curious or have time to lose: https://github.com/ovh/cds/ looks like (another) suite of software to build and ship things23:13
dmsimardonly a year old and they set out to build something from scratch, would be interesting to know why perhaps23:15
mrhillsmanthx for that23:16
dmsimardhttps://ovh.github.io/cds/advanced/advanced.hatcheries/ is basically nodepool :/23:17
*** jappleii__ has joined #zuul23:20
*** jappleii__ has quit IRC23:21
mrhillsmanthe difference being targeting more than openstack clouds right?23:21
*** jappleii__ has joined #zuul23:22
fungigranted, we've discussed that some deployers are going to be interested in azure, aws or gce drivers for nodepool too23:22
*** dmellado has quit IRC23:22
*** threestrands_ has quit IRC23:22
dmsimardYeah, drivers are a big part of the upcoming changes in nodepool23:24
dmsimardThe first drivers being openstack and "static", then others like OCI, AWS etc23:24
mrhillsmannice23:25
*** jpena|away is now known as jpena|off23:28
*** dmellado has joined #zuul23:36
*** fdegir has quit IRC23:55
*** TheJulia has quit IRC23:56
*** mwhahaha has quit IRC23:57
*** TheJulia has joined #zuul23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!