*** jkilpatr has joined #zuul | 00:09 | |
*** JasonCL has quit IRC | 00:49 | |
*** JasonCL has joined #zuul | 00:55 | |
Shrews | pabelanger: jeblair: Has the command socket been tested with running in daemon mode? I just spent the last hour trying to make it work for the new finger gateway, unsuccessfully. | 00:57 |
---|---|---|
Shrews | hrm, in non-daemon mode, getting a "permission denied" exception after sending a command (which doesn't work) and hitting Ctrl-C | 00:59 |
Shrews | fu | 00:59 |
Shrews | fun | 00:59 |
*** JasonCL has quit IRC | 00:59 | |
*** JasonCL has joined #zuul | 01:00 | |
*** JasonCL has quit IRC | 01:05 | |
*** JasonCL has joined #zuul | 01:22 | |
*** Wei_Liu has joined #zuul | 01:35 | |
*** openstackgerrit has joined #zuul | 02:28 | |
openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Remove unused setup_tables https://review.openstack.org/526970 | 02:28 |
openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Fix line wrapping in github docs https://review.openstack.org/526971 | 02:39 |
openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Fix attribute syntax in docs https://review.openstack.org/526972 | 02:39 |
*** JasonCL has quit IRC | 02:41 | |
*** baiyi has joined #zuul | 03:01 | |
*** baiyi has left #zuul | 03:05 | |
*** dkranz has quit IRC | 03:06 | |
*** baiyi has joined #zuul | 03:18 | |
*** baiyi1 has joined #zuul | 03:21 | |
*** baiyi has quit IRC | 03:23 | |
*** baiyi1 is now known as baiyi | 03:23 | |
*** threestrands has quit IRC | 06:17 | |
*** toabctl has joined #zuul | 06:41 | |
*** baiyi1 has joined #zuul | 06:53 | |
*** baiyi has quit IRC | 06:55 | |
*** baiyi1 is now known as baiyi | 06:55 | |
*** sshnaidm|off is now known as sshnaidm|ruck | 07:07 | |
*** baiyi1 has joined #zuul | 07:31 | |
*** baiyi has quit IRC | 07:33 | |
*** baiyi1 is now known as baiyi | 07:33 | |
*** hashar has joined #zuul | 08:41 | |
*** jpena|off is now known as jpena | 08:45 | |
*** Wei_Liu has quit IRC | 09:06 | |
*** Wei_Liu has joined #zuul | 09:13 | |
*** flepied has quit IRC | 09:14 | |
*** flepied has joined #zuul | 09:14 | |
*** electrofelix has joined #zuul | 10:19 | |
*** baiyi has quit IRC | 11:16 | |
*** baiyi has joined #zuul | 11:16 | |
*** flepied_ has joined #zuul | 11:23 | |
*** flepied has quit IRC | 11:25 | |
*** jkilpatr has quit IRC | 11:37 | |
*** hashar has quit IRC | 11:46 | |
*** jkilpatr has joined #zuul | 12:11 | |
*** hashar has joined #zuul | 12:19 | |
*** jpena is now known as jpena|lunch | 12:25 | |
*** flepied__ has joined #zuul | 12:31 | |
*** flepied_ has quit IRC | 12:34 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/zuul-jobs master: releasenotes: Remove package install https://review.openstack.org/526850 | 12:48 |
*** lennyb has quit IRC | 13:00 | |
*** lennyb has joined #zuul | 13:02 | |
*** ChanServ has quit IRC | 13:08 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/zuul-jobs master: releasenotes: Remove package install https://review.openstack.org/526850 | 13:16 |
*** ChanServ has joined #zuul | 13:18 | |
*** barjavel.freenode.net sets mode: +o ChanServ | 13:18 | |
*** dkranz has joined #zuul | 13:22 | |
*** jpena|lunch is now known as jpena | 13:27 | |
*** nguyentrihai has quit IRC | 13:40 | |
*** nguyentrihai has joined #zuul | 13:52 | |
*** weshay|MOD is now known as weshay|sickday | 14:13 | |
*** maxamillion has quit IRC | 14:29 | |
*** maxamillion has joined #zuul | 14:48 | |
rcarrillocruz | he folks | 14:51 |
rcarrillocruz | on the new zuul v3 dashboard, howe we pull info from builds | 14:52 |
rcarrillocruz | i assume is cos of the sql reporter | 14:52 |
rcarrillocruz | then the dashboard populates builds/jobs page with that data? | 14:52 |
clarkb | rcarrillocruz: builds comes from the sql reporter db yes, jobs is from the internal datastructure for the jobs | 14:52 |
*** dmellado has quit IRC | 14:53 | |
rcarrillocruz | k, and where is the logic for those zuul dashboard tabs? | 14:54 |
rcarrillocruz | like, if i wanted to add new ones with other sql queries | 14:54 |
clarkb | rcarrillocruz: under zuul/web iirc. There are angular js components and then zuul web python components | 14:54 |
rcarrillocruz | ah, so from the source tree of zuul i see zuul/web/static/stream.html | 14:56 |
rcarrillocruz | you folks pull that angular externally and dump it in that folder structure ? | 14:56 |
clarkb | yes iirc | 14:58 |
clarkb | rcarrillocruz: its a todo to have zuul express that through proper js tooling aiui | 14:58 |
rcarrillocruz | gotcha, was wnodring where it all came from, assumed some zuul::web puppetry | 14:58 |
rcarrillocruz | thx | 14:59 |
jeblair | Shrews: it works for zuul-executor in daemon mode, i don't think the others have got a lot of testing yet | 15:04 |
Shrews | jeblair: i'll look at it again after getting up to speed on sprint things today. maybe i'm just doing something really wrong in my daemon | 15:05 |
*** dmellado has joined #zuul | 15:05 | |
*** dmellado has quit IRC | 15:10 | |
*** dmellado has joined #zuul | 15:12 | |
tristanC | rcarrillocruz: you can query zuul-web/{tenant}/builds.json?filters where filters can be one or more "project", "pipeline", "change", "patchset", "ref", "newrev", "uuid", "job_name", "voting", "node_name", "result" | 15:14 |
tristanC | with "limit" and "skip" too | 15:14 |
rcarrillocruz | tristanC: is node name the node label for a given build ? | 15:14 |
tristanC | hum, the field is actually not set atm, it should be fixed in the sqlreporter.py | 15:16 |
tristanC | also, the html bits are quite crude, though the rest controller should be good enough to build better interfaces | 15:17 |
jeblair | honestly, i'm not sure if we should store that any more | 15:17 |
jeblair | it doesn't map that well to zuulv3. if anything, it would be the nodeset name, but it may be an anonymous nodeset, so i don't think it's a great fit. is it useful? | 15:18 |
tristanC | jeblair: yep, perhaps node count instead? | 15:18 |
jeblair | (usually i would think that searching by branch would be more useful) | 15:19 |
clarkb | jeblair: I could see the use being "does centos no longer work" | 15:19 |
clarkb | so maybe you want base image? | 15:19 |
jeblair | clarkb: but you can have more than one | 15:19 |
tristanC | i'll try to draft a job.json endpoint to display job information, then clicking on a job name would display all the details such as the nodeset configuration | 15:20 |
jeblair | tristanC: ++ | 15:20 |
clarkb | jeblair: good point its not longer homogenous | 15:20 |
rcarrillocruz | tristanC: i'm a total web/javascript noob, how hard would be to have jobs in 'Jobs' tab to show 'Failed since BLAH' | 15:20 |
rcarrillocruz | ala red/green balls in Jenkins | 15:20 |
tristanC | rcarrillocruz: that was actually how the first patchset work, but now the jobs.json query the scheduler through gearman, and the last failure would only be available through sql | 15:21 |
rcarrillocruz | ah, so diffrent datasource, gotcha | 15:22 |
tristanC | to render that jenkins like view, you'll have to for each job.json, query the build.json | 15:22 |
tristanC | but openstack-health is already that kind of thing so... | 15:23 |
jeblair | it's more than that too -- jobs run in context of projects, so, to use openstack as an example, you might see 'openstack-tox-py35' as failed, but it could be because it failed on nova, or glance, or any of 1800 different projects. | 15:23 |
jeblair | and remember, in a gating system, unlike jenkins, jobs are expected to fail, a lot, and it's fine. | 15:24 |
tristanC | jeblair: though builds.json?pipeline=periodic&pipeline=post shouldn't | 15:24 |
jeblair | tristanC: yep. i think the builds page is a good way to create specific queries for things where you need to find failures. | 15:25 |
jeblair | rcarrillocruz: can you do something like that ^ to get what you need? | 15:25 |
rcarrillocruz | jeblair: yeah, in my test zuul context the job is pretty specific, like 'network-integration-tests-ios' | 15:26 |
rcarrillocruz | so | 15:26 |
rcarrillocruz | thinking of having like a custom jobs tab | 15:26 |
rcarrillocruz | where i have the jobs i care about | 15:26 |
rcarrillocruz | and have this green/red thing, to know 'ok, we have a regression since change BLAH' | 15:26 |
jeblair | rcarrillocruz: you aren't running jobs pre-merge? | 15:27 |
*** dmellado has quit IRC | 15:29 | |
rcarrillocruz | not yet, is very rough what i have in testing. Also, not sure I would tackle a 'gate' in github, i need some sort of bot reacting to 'approve' trigger | 15:29 |
rcarrillocruz | ala workflow +1 in gerrit | 15:29 |
rcarrillocruz | i think mordred asked about ansibot to other ansible folks in that context | 15:29 |
jeblair | rcarrillocruz: zuul supports that. you should be able to gate. | 15:29 |
rcarrillocruz | mordred ? | 15:29 |
rcarrillocruz | eventually i would like to have the workflow we have in openstack infra, like it's not a human pushing the merge button, as we have now | 15:30 |
*** dmellado has joined #zuul | 15:30 | |
jeblair | rcarrillocruz: even if you're not gating, i'd encourage you to set up a check pipeline at least. that's one of the main benefits of zuul. :) | 15:31 |
tristanC | rcarrillocruz: actually fbo_ wrote a blog post about gating github repository: http://rdoproject.org/blog/2017/12/gate-repositories-on-github-with-software-factory-and-zuul3/ | 15:32 |
rcarrillocruz | well, in my test zuul is the only thing i have | 15:34 |
rcarrillocruz | a chek pipeline | 15:34 |
rcarrillocruz | letm e link | 15:34 |
rcarrillocruz | https://github.com/rcarrillocruz-org/common-config/blob/master/zuul.d/pipelines.yaml | 15:34 |
jeblair | rcarrillocruz: oh, when you said finding regressions, i thought you were only running post-merge pipelines | 15:35 |
tristanC | rcarrillocruz: you should check that blog post, there is a gate pipeline and some protection settings to let zuul merge github pr when they are approved | 15:36 |
rcarrillocruz | what is puzzling to me is that in gerrit driver, there's the workflow thing, which essentially zuul can react to and move changes into the gate pipeline | 15:36 |
tristanC | github branch protection settings* | 15:36 |
rcarrillocruz | so what i thought is that maybe we could have a bot listening on the PR for something like 'approve' | 15:36 |
rcarrillocruz | and then zuul would react to that and put it on gate | 15:36 |
rcarrillocruz | tristanC: let me read, thx | 15:37 |
jeblair | rcarrillocruz: so if you had a listing of job names + latest result, it wouldn't convey the information that jenkins does when it's run post-merge. the result would be pretty random based on whether the most recent pull request worked or not. it might be better to use the builds page to see all the results for a given job, then you'll have links to the failed pull requests. | 15:37 |
rcarrillocruz | hmm i see , good call | 15:37 |
rcarrillocruz | tristanC , fbo_ : that really good stuff, thanks for the blogpost! | 15:41 |
tristanC | rcarrillocruz: heh, you're welcome :-) | 15:42 |
*** dmellado has quit IRC | 15:52 | |
*** dmellado has joined #zuul | 15:55 | |
*** dmellado has quit IRC | 15:58 | |
*** dmellado has joined #zuul | 16:01 | |
mrhillsman | are there any instructions on the ara integration? | 16:15 |
mrhillsman | like, i have index.html.gz files, but not sure if that is expected, and i should be focusing on the server handling the file, or that .gz addition is in error | 16:16 |
mrhillsman | when i visit the logs site on o.o i see the ara output properly formatted, mine are missing the styling it seems | 16:16 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Debug job selection https://review.openstack.org/527148 | 16:17 |
jeblair | dmsimard: ^ know the answer to mrhillsman's question off the top of your head? | 16:18 |
jeblair | mrhillsman: i think we copy over an entire directory's worth of stuff for ara | 16:19 |
dmsimard | mrhillsman: yes, there's expected mimetypes to be configured | 16:19 |
clarkb | I do, we compress everything because storage constraints | 16:19 |
clarkb | so ya we configure apache to serve css.gz html.gz etc as html or css and so on | 16:19 |
dmsimard | mrhillsman: see here: http://git.openstack.org/cgit/openstack-infra/puppet-openstackci/tree/templates/logs.vhost.erb#n16 | 16:20 |
dmsimard | Those are not just for ara but for logs in general, we have a lot of logs and try to gzip everything we can :) | 16:20 |
*** hashar has quit IRC | 16:26 | |
mrhillsman | awesome, thx gents! | 16:26 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Debug job selection https://review.openstack.org/527148 | 16:32 |
*** hashar has joined #zuul | 16:40 | |
*** jpena is now known as jpena|brb | 16:41 | |
*** flepied_ has joined #zuul | 16:57 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Debug job selection https://review.openstack.org/527148 | 16:57 |
*** flepied__ has quit IRC | 16:59 | |
*** electrofelix has quit IRC | 17:02 | |
*** electrofelix has joined #zuul | 17:04 | |
*** jpena|brb is now known as jpena | 17:24 | |
*** hashar has quit IRC | 17:34 | |
openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Debug job selection https://review.openstack.org/527148 | 17:38 |
*** dmellado has quit IRC | 17:40 | |
*** dmellado has joined #zuul | 17:40 | |
*** hashar has joined #zuul | 17:41 | |
jeblair | pabelanger: it looks like "zuul-scheduler stop" doesn't completely work -- it looks like some threads stop, but not everything | 17:46 |
jeblair | pabelanger: i just ran it on zuulv3.o.o if you want to look in the debug log. i had to manually kill the process. | 17:46 |
*** dmellado has quit IRC | 17:59 | |
*** dmellado has joined #zuul | 18:09 | |
*** hashar is now known as GRR_NPM_XXXXz | 18:14 | |
jeblair | i just had to restart zuul-web after a zuul-scheduler restart | 18:15 |
jeblair | we may need to look into what happens if gearman fails or something similar | 18:15 |
Shrews | hrm, does RPCClient have reconnect logic built in? | 18:18 |
Shrews | i guess it would be in gear.Client() | 18:19 |
*** jpena is now known as jpena|brb | 18:20 | |
SpamapS | I'd guess we have some blocking calls in our threads that we end up trying to join. | 18:29 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add more job selection debug lines https://review.openstack.org/527207 | 18:39 |
*** jpena|brb is now known as jpena | 18:41 | |
jeblair | oh, this may also have been an unclean shutdown of the scheduler / gearman. it's the first one of those we've had in a long time, so that may be a factor. | 18:46 |
*** sshnaidm|ruck is now known as sshnaidm|off | 18:55 | |
pabelanger | jeblair: okay, anything I should look into? | 19:00 |
jeblair | pabelanger: if you have time to look into why the stop didn't work that would be great | 19:00 |
pabelanger | okay, I'll take a look | 19:00 |
*** jpena is now known as jpena|away | 19:01 | |
*** dmellado has quit IRC | 19:23 | |
*** dmellado has joined #zuul | 19:25 | |
*** dmellado has quit IRC | 19:45 | |
Shrews | yeah, i can't seem to have the command socket accept any commands | 19:51 |
*** dmellado has joined #zuul | 19:51 | |
*** dmellado has quit IRC | 19:51 | |
Shrews | oh, maybe it's a race. the first thing CommandSocket.stop() does is set self.running=False, but that is what is keeping the socket listener running | 19:56 |
Shrews | pabelanger: jeblair: ^^^ | 19:56 |
Shrews | oh, but it should be blocked on accept() | 19:56 |
Shrews | grrr | 19:57 |
*** dmellado has joined #zuul | 19:57 | |
*** dmellado has quit IRC | 19:57 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Error on duplicate YAML keys https://review.openstack.org/527231 | 19:57 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Error on duplicate YAML keys https://review.openstack.org/527231 | 20:00 |
*** dmellado has joined #zuul | 20:03 | |
*** dmellado has quit IRC | 20:04 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Error on duplicate YAML keys https://review.openstack.org/527231 | 20:04 |
jeblair | tobiash: feel free to -1 for typos in user-facing error messages :) | 20:05 |
tobiash | ok | 20:05 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Error on duplicate YAML keys https://review.openstack.org/527231 | 20:07 |
*** dmellado has joined #zuul | 20:11 | |
*** dmellado has quit IRC | 20:11 | |
Shrews | ah found the command socket problem | 20:12 |
Shrews | \o/ | 20:12 |
*** dmellado has joined #zuul | 20:13 | |
*** dmellado has quit IRC | 20:14 | |
pabelanger | yay | 20:20 |
*** dmellado has joined #zuul | 20:24 | |
openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Add more job selection debug lines https://review.openstack.org/527207 | 20:24 |
*** dmellado has quit IRC | 20:24 | |
*** GRR_NPM_XXXXz is now known as hashar | 20:26 | |
*** dmellado has joined #zuul | 20:34 | |
*** dmellado has quit IRC | 20:52 | |
openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Error on duplicate YAML keys https://review.openstack.org/527231 | 20:58 |
*** jkilpatr has quit IRC | 20:59 | |
*** dmellado has joined #zuul | 21:17 | |
*** jkilpatr has joined #zuul | 21:24 | |
*** dmellado has quit IRC | 21:28 | |
*** dmellado has joined #zuul | 21:31 | |
*** dkranz has quit IRC | 21:33 | |
*** threestrands has joined #zuul | 21:41 | |
*** hashar has quit IRC | 21:46 | |
*** baiyi1 has joined #zuul | 21:47 | |
*** Wei_Liu1 has joined #zuul | 21:48 | |
*** hashar has joined #zuul | 21:50 | |
*** max_the_penguin has joined #zuul | 21:52 | |
*** bramwelt1 has joined #zuul | 21:52 | |
*** pabelanger_ has joined #zuul | 21:55 | |
*** maxamillion has quit IRC | 21:56 | |
*** lennyb has quit IRC | 21:56 | |
*** baiyi has quit IRC | 21:56 | |
*** Wei_Liu has quit IRC | 21:56 | |
*** EmilienM has quit IRC | 21:56 | |
*** SpamapS has quit IRC | 21:56 | |
*** eventingmonkey has quit IRC | 21:56 | |
*** pabelanger has quit IRC | 21:56 | |
*** bramwelt has quit IRC | 21:56 | |
*** baiyi1 is now known as baiyi | 21:56 | |
*** Wei_Liu1 is now known as Wei_Liu | 21:56 | |
*** EmilienM_ has joined #zuul | 21:56 | |
*** EmilienM_ is now known as EmilienM | 21:56 | |
*** EmilienM has quit IRC | 21:56 | |
*** EmilienM has joined #zuul | 21:56 | |
*** pabelanger_ is now known as pabelanger | 21:57 | |
*** eventingmonkey has joined #zuul | 21:58 | |
*** dmellado has quit IRC | 21:58 | |
*** SpamapS has joined #zuul | 21:59 | |
*** lennyb has joined #zuul | 22:00 | |
jeblair | it's zuul meeting time in #openstack-meeting-alt | 22:00 |
*** dmellado has joined #zuul | 22:08 | |
*** dmellado has quit IRC | 22:10 | |
*** dmellado has joined #zuul | 22:10 | |
*** hashar has quit IRC | 22:13 | |
*** max_the_penguin is now known as maxamillion | 22:14 | |
*** hashar has joined #zuul | 22:17 | |
*** hashar has quit IRC | 22:20 | |
*** dmellado has quit IRC | 22:31 | |
*** bramwelt1 is now known as bramwelt | 22:32 | |
*** bramwelt has joined #zuul | 22:32 | |
*** dmellado has joined #zuul | 22:36 | |
*** dmellado has quit IRC | 22:48 | |
jlk | jeblair: missed meeting | 22:56 |
jeblair | jlk: i feel like you hit the meeting bullseye, actually :) | 23:01 |
jeblair | jlk: i kind of assumed that github3.py was really complicated and directly using requests would be lots of work, but maybe that's an option? | 23:01 |
*** jesusaur has quit IRC | 23:03 | |
jlk | Jamie didn't think that was the case, and I've already had to peel it back a bit to touch requests object directly under it a few times. | 23:03 |
jlk | I put the work on hold when the GraphQL API was released, thinking we'd move to that instead, but it's not coming to apps yet, so I can pick up the work again to move off of github3.py | 23:04 |
*** threestrands_ has joined #zuul | 23:04 | |
*** threestrands_ has quit IRC | 23:04 | |
*** threestrands_ has joined #zuul | 23:04 | |
*** myoung|rover is now known as myoung|rover|bbl | 23:05 | |
*** dmellado has joined #zuul | 23:06 | |
*** threestrands has quit IRC | 23:06 | |
jeblair | jlk: ok neat. if that's not too hard, that could have a lot of advantages; i've certainly been happy with that approach in other projects. | 23:07 |
jlk | It _should_ be pretty straight forward to implement. I don't think we do anything specifically with github3.py in testing, so it might be easy enough to strip it out without a lot of busy work | 23:08 |
*** jesusaur has joined #zuul | 23:10 | |
dmsimard | btw, if you are curious or have time to lose: https://github.com/ovh/cds/ looks like (another) suite of software to build and ship things | 23:13 |
dmsimard | only a year old and they set out to build something from scratch, would be interesting to know why perhaps | 23:15 |
mrhillsman | thx for that | 23:16 |
dmsimard | https://ovh.github.io/cds/advanced/advanced.hatcheries/ is basically nodepool :/ | 23:17 |
*** jappleii__ has joined #zuul | 23:20 | |
*** jappleii__ has quit IRC | 23:21 | |
mrhillsman | the difference being targeting more than openstack clouds right? | 23:21 |
*** jappleii__ has joined #zuul | 23:22 | |
fungi | granted, we've discussed that some deployers are going to be interested in azure, aws or gce drivers for nodepool too | 23:22 |
*** dmellado has quit IRC | 23:22 | |
*** threestrands_ has quit IRC | 23:22 | |
dmsimard | Yeah, drivers are a big part of the upcoming changes in nodepool | 23:24 |
dmsimard | The first drivers being openstack and "static", then others like OCI, AWS etc | 23:24 |
mrhillsman | nice | 23:25 |
*** jpena|away is now known as jpena|off | 23:28 | |
*** dmellado has joined #zuul | 23:36 | |
*** fdegir has quit IRC | 23:55 | |
*** TheJulia has quit IRC | 23:56 | |
*** mwhahaha has quit IRC | 23:57 | |
*** TheJulia has joined #zuul | 23:58 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!