*** rlandy|bbl is now known as rlandy | 01:09 | |
*** bhavikdbavishi has joined #zuul | 03:18 | |
*** jesusaur has joined #zuul | 03:21 | |
*** nilashishc has joined #zuul | 04:08 | |
*** spsurya has joined #zuul | 04:50 | |
*** openstackgerrit has joined #zuul | 04:56 | |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul-jobs master: WIP: Add sar logging roles https://review.openstack.org/613112 | 04:57 |
---|---|---|
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul-jobs master: Pin flake8 https://review.openstack.org/613194 | 05:07 |
tobiash_ | AJaeger: unbreaks zuul-jobs linters ^ | 05:08 |
openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Prepend exception output with time, date and thread https://review.openstack.org/613196 | 05:10 |
ianw | wow that was way harder than i thought it would be. ^ fungi i think that would have helped when you were looking at nl04 logs | 05:10 |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul-jobs master: WIP: Add sar logging roles https://review.openstack.org/613112 | 05:22 |
tobiash_ | ianw: cool, I always wanted that too :) | 05:27 |
*** rlandy has quit IRC | 05:31 | |
openstackgerrit | Simon Westphahl proposed openstack-infra/zuul master: Fix issue in Github connection with large diffs https://review.openstack.org/612989 | 05:32 |
openstackgerrit | Simon Westphahl proposed openstack-infra/zuul master: Fix issue in Github connection with large diffs https://review.openstack.org/612989 | 05:49 |
tobiash_ | corvus: sar logging works now: http://logs.openstack.org/17/613117/1/check/tox-py36/67fa4c4/ | 05:52 |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul-jobs master: Add sar logging roles https://review.openstack.org/613112 | 06:01 |
AJaeger | tobiash_: I prefer to disable W504, W605 instead - and then we can enable them again... | 06:02 |
AJaeger | tobiash_: let me give it a try... | 06:02 |
tobiash_ | AJaeger: as you wish | 06:03 |
*** tobiash_ has quit IRC | 06:03 | |
*** tobiash has joined #zuul | 06:04 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/zuul-jobs master: Fix flake8 3.6.0 errors https://review.openstack.org/613205 | 06:11 |
AJaeger | tobiash: here's the alternative - let's see which one reaches consensus ;) ^ | 06:11 |
AJaeger | tobiash: I think we can wait until others are around - otherwise I suggest to merge yours and I'll base mine on top of it... | 06:12 |
tobiash | AJaeger: +2 on yours... | 06:28 |
AJaeger | thanks, tobiash. Any other config-core to review 613205, please? | 06:30 |
ianw | lgtm, thanks | 06:41 |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul-jobs master: Add sar logging roles https://review.openstack.org/613112 | 06:42 |
AJaeger | great! | 06:42 |
*** AJaeger has quit IRC | 06:43 | |
*** AJaeger has joined #zuul | 06:57 | |
*** pcaruana has joined #zuul | 07:04 | |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul-jobs master: DNM: Run tox with eatmydata https://review.openstack.org/613221 | 07:11 |
*** SpamapS has quit IRC | 07:11 | |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: DNM: Enable sar logging for unit tests https://review.openstack.org/613117 | 07:11 |
*** jpena|off is now known as jpena | 07:15 | |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: DNM: pass LD_PRELOAD and LD_LIBRARY_PATH vars https://review.openstack.org/613222 | 07:20 |
*** SpamapS has joined #zuul | 07:24 | |
*** earlgreen has joined #zuul | 07:25 | |
*** hashar has joined #zuul | 07:26 | |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul-jobs master: DNM: Run tox with eatmydata https://review.openstack.org/613221 | 07:37 |
openstackgerrit | Merged openstack-infra/zuul-jobs master: Fix flake8 3.6.0 errors https://review.openstack.org/613205 | 07:37 |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: DNM: Enable sar logging for unit tests https://review.openstack.org/613117 | 07:37 |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: DNM: pass LD_PRELOAD and LD_LIBRARY_PATH vars https://review.openstack.org/613222 | 07:37 |
*** earlgreen has quit IRC | 07:45 | |
*** goern has quit IRC | 08:00 | |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul-jobs master: DNM: Run tox with eatmydata https://review.openstack.org/613221 | 08:03 |
*** bhavikdbavishi has quit IRC | 08:11 | |
*** goern has joined #zuul | 08:37 | |
*** electrofelix has joined #zuul | 08:54 | |
*** panda|off has quit IRC | 09:35 | |
*** panda has joined #zuul | 09:38 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool master: Add tox functional testing for drivers https://review.openstack.org/609515 | 10:20 |
*** bhavikdbavishi has joined #zuul | 10:20 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool master: Implement a Kubernetes driver https://review.openstack.org/535557 | 10:25 |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool master: Add tox functional testing for drivers https://review.openstack.org/609515 | 10:25 |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul-jobs master: Add prepare-workspace-git role https://review.openstack.org/613036 | 10:31 |
openstackgerrit | Benoît Bayszczak proposed openstack-infra/zuul master: Disable Nodepool nodes lock for SKIPPED jobs https://review.openstack.org/613261 | 10:43 |
openstackgerrit | Benoît Bayszczak proposed openstack-infra/zuul master: Disable Nodepool nodes lock for SKIPPED jobs https://review.openstack.org/613261 | 10:47 |
*** jpena is now known as jpena|lunch | 11:34 | |
*** jesusaur has quit IRC | 11:43 | |
*** jesusaur has joined #zuul | 11:46 | |
*** bhavikdbavishi has quit IRC | 11:56 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool master: Add tox functional testing for drivers https://review.openstack.org/609515 | 12:05 |
fungi | thanks ianw! | 12:24 |
*** pcaruana has quit IRC | 12:26 | |
*** rlandy has joined #zuul | 12:27 | |
*** jpena|lunch is now known as jpena | 12:33 | |
*** pcaruana has joined #zuul | 12:39 | |
corvus | hs anyone seen this error? http://logs.openstack.org/61/613161/1/check/tox-py36/d343cc9/job-output.txt.gz#_2018-10-24_23_18_16_340705 | 13:04 |
corvus | something about yarn failing to build | 13:04 |
*** _ari_ has quit IRC | 13:05 | |
*** hashar is now known as hasharAway | 13:12 | |
openstackgerrit | Fabien Boucher proposed openstack-infra/zuul master: WIP - Pagure driver https://review.openstack.org/604404 | 13:20 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Filter file comments for existing files https://review.openstack.org/613161 | 13:21 |
corvus | ok, somehow the deletion of the .keep file made it into that change, maybe that was what caused the error | 13:21 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Collect docker logs after quick-start run https://review.openstack.org/613027 | 13:25 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul master: WIP: support foreign required-projects https://review.openstack.org/613143 | 13:30 |
tristanC | corvus: Shrews: k8s tests are now passing, it was actually the manual node.type = "kubernetes" that was causing issues | 13:36 |
*** pcaruana has quit IRC | 13:37 | |
Shrews | tristanC: oops. will have a look after our zk transition is over | 13:38 |
corvus | tristanC: \o/ | 13:38 |
* goern is also merging changes send in by tristanC ... you never know what happens | 13:42 | |
openstackgerrit | Simon Westphahl proposed openstack-infra/zuul master: Use branch for grouping in supercedent manager https://review.openstack.org/613335 | 14:07 |
openstackgerrit | Simon Westphahl proposed openstack-infra/zuul master: Use branch for grouping in supercedent manager https://review.openstack.org/613335 | 14:13 |
openstackgerrit | Simon Westphahl proposed openstack-infra/zuul master: Use branch for grouping in supercedent manager https://review.openstack.org/613335 | 14:15 |
-openstackstatus- NOTICE: Zuul and Nodepool services are being restarted to migrate them to a new Zookeeper cluster. THis brings us an HA database running on newer servers. | 14:41 | |
*** jpena is now known as jpena|brb | 15:04 | |
*** jpena|brb is now known as jpena | 15:15 | |
-openstackstatus- NOTICE: The Zuul and Nodepool database transition is complete. Changes updated during the Zuul outage may need to be rechecked. | 15:32 | |
*** sshnaidm|ruck is now known as sshnaidm|bbl | 15:54 | |
*** irclogbot_4 has joined #zuul | 15:55 | |
*** irclogbot_4 has quit IRC | 16:13 | |
*** bhavikdbavishi has joined #zuul | 16:15 | |
*** jhesketh has joined #zuul | 16:25 | |
*** mnaser has quit IRC | 16:26 | |
*** mnaser has joined #zuul | 16:26 | |
*** jhesketh_ has quit IRC | 16:27 | |
*** panda is now known as panda|off | 16:38 | |
*** jpena is now known as jpena|off | 16:58 | |
*** chandankumar is now known as chkumar|off | 17:02 | |
*** pcaruana has joined #zuul | 17:03 | |
*** sshnaidm|bbl is now known as sshnaidm|off | 17:15 | |
*** nilashishc has quit IRC | 17:27 | |
hogepodge | mordred: corvus: is it possible in zuul to have ordering dependencies on jobs. Like if I need job 'a' to run first because it takes a long time and produces artifacts that {b,c,d,e...} depend upon, is there a way to define that? | 17:56 |
hogepodge | Oh, looking through our code it looks like we can do that. | 17:58 |
clarkb | yup it can | 17:59 |
corvus | hogepodge: https://zuul-ci.org/docs/zuul/user/config.html#attr-job.dependencies | 18:25 |
corvus | wow that needs a lot more words :) | 18:25 |
corvus | hogepodge: a related idea is a paused job -- that can be useful if you want to, for example, run a docker image registry in job 'a' which is used by the other jobs -- https://zuul-ci.org/docs/zuul/user/jobs.html#pausing-the-job | 18:26 |
hogepodge | I'm working through our inline notes and todos, we fixed that issue and I'm removing the comment. Source code should not be treated as an issue tracker... | 18:26 |
*** electrofelix has quit IRC | 18:31 | |
openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool master: Support node caching in the nodeIterator https://review.openstack.org/604648 | 18:32 |
openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool master: Support node caching in the nodeIterator https://review.openstack.org/604648 | 18:35 |
*** bhavikdbavishi has quit IRC | 18:37 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul master: DNM: Enable sar logging for unit tests https://review.openstack.org/613117 | 18:38 |
tobiash | corvus: what do you think about the sar logging? | 18:40 |
corvus | tobiash: was just looking at it -- http://logs.openstack.org/17/613117/1/check/tox-py35/6c8e8cf/sar-logs-ubuntu-xenial/ has a bunch of 0 byte files | 18:41 |
tobiash | corvus: the 0 byte files are on xenial nodes (where sadf is too old) | 18:42 |
tobiash | corvus: check out the py36 job, that has real files | 18:42 |
corvus | oh right i'll try 36 :) | 18:42 |
corvus | http://logs.openstack.org/17/613117/1/check/tox-py36/67fa4c4/sar-logs-ubuntu-bionic/sar-all.svg looks pretty good to me <-- clarkb, Shrews | 18:44 |
tobiash | not a fancy html report, but pretty detailed | 18:44 |
clarkb | my only complaint is that some of the color contrasts are hard for me to read | 18:46 |
clarkb | but I have terrible eyes | 18:46 |
corvus | yeah, it's not beautiful, but it seems functional | 18:47 |
Shrews | lgtm | 18:47 |
tobiash | we could at any time replace the svg generation with gnuplot ;) | 18:47 |
tobiash | that was just the quickest way I found to visualize the sar data | 18:48 |
corvus | i stopped by the ansible office today to chat with the awx folks... take a look at https://github.com/ansible/awx/pull/2523 and see who merged that :) | 18:48 |
tobiash | zuul yay :) | 18:49 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul master: quick-start: add a note about github https://review.openstack.org/613398 | 19:00 |
clarkb | neat | 19:02 |
*** hasharAway is now known as hashar | 19:07 | |
mordred | corvus: it might be fun to look at combining the sar stuff with the stackviz stuff at some point maybe - I added stackviz to the openstacksdk functional test runs - and being able to see the dstat graph information along with which test was running at the same time is nice - and it turns out stackviz isn't devstack or tempest specific | 19:12 |
mordred | although ... clarkb did we ever sort out why the dstat stuff was missing? | 19:12 |
*** rlandy is now known as rlandy|brb | 19:13 | |
clarkb | mordred: ya its the .gz file not being read properly by stackviz | 19:13 |
clarkb | the should be dstat.csv instead of dstat.csv.gz | 19:13 |
mordred | ah right | 19:14 |
clarkb | or have stackviz read it as compressed. I think the way to fix that is stackviz can compress theings itself then it does the right thing | 19:14 |
clarkb | problem is we compress it then stackviz does't know what is going on. But stackviz compression code is broken iirc | 19:14 |
mordred | nod. I wonder if we could trick timothy in to fixing it | 19:15 |
corvus | mordred: 'which test was running' or 'which tests were running'? | 19:18 |
corvus | (i expect there to be about 8 random tests running at any given time for zuul and nodepol at least) | 19:19 |
clarkb | corvus: ya that is what stackviz shows you it gives you the overlapping test timeline with performance data | 19:27 |
corvus | can it be pip installed, or does it still need to be pre-installed on images? | 19:28 |
clarkb | the way it is done today with the js component we cache that so that you don't have to build it on pip install iirc. But we pip install the python bits aiui | 19:29 |
mordred | I'm confident we could apply our python+js skills from zuul to stackviz to make it easily pip installable for both if we wanted to | 19:30 |
clarkb | the things we've learned about zuul pcakging can probably be applied there to make it happier | 19:30 |
corvus | i've heard of a python app that builds its js components into it's packages :) | 19:30 |
mordred | corvus: http://logs.openstack.org/62/612162/3/check/openstacksdk-functional-devstack/cd35b75/controller/logs/stackviz/#/stdin/timeline?test=openstack.tests.functional.cloud.test_compute.TestCompute.test_create_and_delete_server | 19:30 |
mordred | corvus: there should be a dstat graph in the middle of the page | 19:31 |
corvus | anyway, sounds like it could be a candidate for zuul-jobs with a little more work | 19:31 |
*** rlandy|brb is now known as rlandy | 19:31 | |
mordred | corvus: and if there were more tests running in paralel, they'd show up too | 19:31 |
mordred | but it could be cool to not only apply it to things generally, but also to get the sar data plugged in - then it's a super cool reporting ... for anything with a subunit stream | 19:32 |
mordred | I don't think we hould block progress on the other stuff on it though | 19:33 |
corvus | mordred: yeah, there's room in zuul-jobs for both | 19:36 |
*** irclogbot_4 has joined #zuul | 19:59 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul master: WIP: support foreign required-projects https://review.openstack.org/613143 | 20:09 |
*** irclogbot_4 has quit IRC | 20:22 | |
*** hashar has quit IRC | 20:29 | |
dkehn | I’m trying to test a zuul v3 setup and looking for a few curl commands that I can use to test it with, thanks | 20:50 |
clarkb | dkehn: https://zuul-ci.org/start should have a full walkthrough | 20:50 |
clarkb | dkehn: I'd check there and see if that gives you what you are looking for? | 20:51 |
dkehn | clarkb: thanks tons | 20:51 |
*** irclogbot_3 has joined #zuul | 21:16 | |
*** edleafe_ has joined #zuul | 21:22 | |
*** edleafe_ has quit IRC | 21:23 | |
SpamapS | FYI, I am like, 10% done with helmifying our zuul install | 21:57 |
SpamapS | https://github.com/SpamapS/zuul-helm | 21:57 |
clarkb | SpamapS: as a side note corvus had to use mariadb because mysql containers were unhappy with something that he decided wasn't wroth debugging | 22:01 |
SpamapS | fun | 22:08 |
SpamapS | that whole thing.. the mess is just starting to sink in | 22:08 |
SpamapS | now that mysql 8.0 is out... they're too different | 22:08 |
SpamapS | it was fine in the beginning. | 22:08 |
SpamapS | well funny enough, the one thing I don't have in my current install that I'm using as the basis for this helm.. is sql reporting | 22:14 |
*** j^2 has joined #zuul | 22:14 | |
*** rlandy has quit IRC | 23:23 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!