Thursday, 2018-10-25

*** rlandy|bbl is now known as rlandy01:09
*** bhavikdbavishi has joined #zuul03:18
*** jesusaur has joined #zuul03:21
*** nilashishc has joined #zuul04:08
*** spsurya has joined #zuul04:50
*** openstackgerrit has joined #zuul04:56
openstackgerritTobias Henkel proposed openstack-infra/zuul-jobs master: WIP: Add sar logging roles  https://review.openstack.org/61311204:57
openstackgerritTobias Henkel proposed openstack-infra/zuul-jobs master: Pin flake8  https://review.openstack.org/61319405:07
tobiash_AJaeger: unbreaks zuul-jobs linters ^05:08
openstackgerritIan Wienand proposed openstack-infra/nodepool master: Prepend exception output with time, date and thread  https://review.openstack.org/61319605:10
ianwwow that was way harder than i thought it would be. ^ fungi i think that would have helped when you were looking at nl04 logs05:10
openstackgerritTobias Henkel proposed openstack-infra/zuul-jobs master: WIP: Add sar logging roles  https://review.openstack.org/61311205:22
tobiash_ianw: cool, I always wanted that too :)05:27
*** rlandy has quit IRC05:31
openstackgerritSimon Westphahl proposed openstack-infra/zuul master: Fix issue in Github connection with large diffs  https://review.openstack.org/61298905:32
openstackgerritSimon Westphahl proposed openstack-infra/zuul master: Fix issue in Github connection with large diffs  https://review.openstack.org/61298905:49
tobiash_corvus: sar logging works now: http://logs.openstack.org/17/613117/1/check/tox-py36/67fa4c4/05:52
openstackgerritTobias Henkel proposed openstack-infra/zuul-jobs master: Add sar logging roles  https://review.openstack.org/61311206:01
AJaegertobiash_: I prefer to disable W504, W605 instead - and then we can enable them again...06:02
AJaegertobiash_: let me give it a try...06:02
tobiash_AJaeger: as you wish06:03
*** tobiash_ has quit IRC06:03
*** tobiash has joined #zuul06:04
openstackgerritAndreas Jaeger proposed openstack-infra/zuul-jobs master: Fix flake8 3.6.0 errors  https://review.openstack.org/61320506:11
AJaegertobiash: here's the alternative - let's see which one reaches consensus ;) ^06:11
AJaegertobiash: I think we can wait until others are around - otherwise I suggest to merge yours and I'll base mine on top of it...06:12
tobiashAJaeger: +2 on yours...06:28
AJaegerthanks, tobiash. Any other config-core to review 613205, please?06:30
ianwlgtm, thanks06:41
openstackgerritTobias Henkel proposed openstack-infra/zuul-jobs master: Add sar logging roles  https://review.openstack.org/61311206:42
AJaegergreat!06:42
*** AJaeger has quit IRC06:43
*** AJaeger has joined #zuul06:57
*** pcaruana has joined #zuul07:04
openstackgerritTobias Henkel proposed openstack-infra/zuul-jobs master: DNM: Run tox with eatmydata  https://review.openstack.org/61322107:11
*** SpamapS has quit IRC07:11
openstackgerritTobias Henkel proposed openstack-infra/zuul master: DNM: Enable sar logging for unit tests  https://review.openstack.org/61311707:11
*** jpena|off is now known as jpena07:15
openstackgerritTobias Henkel proposed openstack-infra/zuul master: DNM: pass LD_PRELOAD and LD_LIBRARY_PATH vars  https://review.openstack.org/61322207:20
*** SpamapS has joined #zuul07:24
*** earlgreen has joined #zuul07:25
*** hashar has joined #zuul07:26
openstackgerritTobias Henkel proposed openstack-infra/zuul-jobs master: DNM: Run tox with eatmydata  https://review.openstack.org/61322107:37
openstackgerritMerged openstack-infra/zuul-jobs master: Fix flake8 3.6.0 errors  https://review.openstack.org/61320507:37
openstackgerritTobias Henkel proposed openstack-infra/zuul master: DNM: Enable sar logging for unit tests  https://review.openstack.org/61311707:37
openstackgerritTobias Henkel proposed openstack-infra/zuul master: DNM: pass LD_PRELOAD and LD_LIBRARY_PATH vars  https://review.openstack.org/61322207:37
*** earlgreen has quit IRC07:45
*** goern has quit IRC08:00
openstackgerritTobias Henkel proposed openstack-infra/zuul-jobs master: DNM: Run tox with eatmydata  https://review.openstack.org/61322108:03
*** bhavikdbavishi has quit IRC08:11
*** goern has joined #zuul08:37
*** electrofelix has joined #zuul08:54
*** panda|off has quit IRC09:35
*** panda has joined #zuul09:38
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool master: Add tox functional testing for drivers  https://review.openstack.org/60951510:20
*** bhavikdbavishi has joined #zuul10:20
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool master: Implement a Kubernetes driver  https://review.openstack.org/53555710:25
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool master: Add tox functional testing for drivers  https://review.openstack.org/60951510:25
openstackgerritTobias Henkel proposed openstack-infra/zuul-jobs master: Add prepare-workspace-git role  https://review.openstack.org/61303610:31
openstackgerritBenoît Bayszczak proposed openstack-infra/zuul master: Disable Nodepool nodes lock for SKIPPED jobs  https://review.openstack.org/61326110:43
openstackgerritBenoît Bayszczak proposed openstack-infra/zuul master: Disable Nodepool nodes lock for SKIPPED jobs  https://review.openstack.org/61326110:47
*** jpena is now known as jpena|lunch11:34
*** jesusaur has quit IRC11:43
*** jesusaur has joined #zuul11:46
*** bhavikdbavishi has quit IRC11:56
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool master: Add tox functional testing for drivers  https://review.openstack.org/60951512:05
fungithanks ianw!12:24
*** pcaruana has quit IRC12:26
*** rlandy has joined #zuul12:27
*** jpena|lunch is now known as jpena12:33
*** pcaruana has joined #zuul12:39
corvushs anyone seen this error?  http://logs.openstack.org/61/613161/1/check/tox-py36/d343cc9/job-output.txt.gz#_2018-10-24_23_18_16_34070513:04
corvussomething about yarn failing to build13:04
*** _ari_ has quit IRC13:05
*** hashar is now known as hasharAway13:12
openstackgerritFabien Boucher proposed openstack-infra/zuul master: WIP - Pagure driver  https://review.openstack.org/60440413:20
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Filter file comments for existing files  https://review.openstack.org/61316113:21
corvusok, somehow the deletion of the .keep file made it into that change, maybe that was what caused the error13:21
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Collect docker logs after quick-start run  https://review.openstack.org/61302713:25
openstackgerritJames E. Blair proposed openstack-infra/zuul master: WIP: support foreign required-projects  https://review.openstack.org/61314313:30
tristanCcorvus: Shrews: k8s tests are now passing, it was actually the manual node.type = "kubernetes" that was causing issues13:36
*** pcaruana has quit IRC13:37
ShrewstristanC: oops. will have a look after our zk transition is over13:38
corvustristanC: \o/13:38
* goern is also merging changes send in by tristanC ... you never know what happens13:42
openstackgerritSimon Westphahl proposed openstack-infra/zuul master: Use branch for grouping in supercedent manager  https://review.openstack.org/61333514:07
openstackgerritSimon Westphahl proposed openstack-infra/zuul master: Use branch for grouping in supercedent manager  https://review.openstack.org/61333514:13
openstackgerritSimon Westphahl proposed openstack-infra/zuul master: Use branch for grouping in supercedent manager  https://review.openstack.org/61333514:15
-openstackstatus- NOTICE: Zuul and Nodepool services are being restarted to migrate them to a new Zookeeper cluster. THis brings us an HA database running on newer servers.14:41
*** jpena is now known as jpena|brb15:04
*** jpena|brb is now known as jpena15:15
-openstackstatus- NOTICE: The Zuul and Nodepool database transition is complete. Changes updated during the Zuul outage may need to be rechecked.15:32
*** sshnaidm|ruck is now known as sshnaidm|bbl15:54
*** irclogbot_4 has joined #zuul15:55
*** irclogbot_4 has quit IRC16:13
*** bhavikdbavishi has joined #zuul16:15
*** jhesketh has joined #zuul16:25
*** mnaser has quit IRC16:26
*** mnaser has joined #zuul16:26
*** jhesketh_ has quit IRC16:27
*** panda is now known as panda|off16:38
*** jpena is now known as jpena|off16:58
*** chandankumar is now known as chkumar|off17:02
*** pcaruana has joined #zuul17:03
*** sshnaidm|bbl is now known as sshnaidm|off17:15
*** nilashishc has quit IRC17:27
hogepodgemordred: corvus: is it possible in zuul to have ordering dependencies on jobs. Like if I need job 'a' to run first because it takes a long time and produces artifacts that {b,c,d,e...} depend upon, is there a way to define that?17:56
hogepodgeOh, looking through our code it looks like we can do that.17:58
clarkbyup it can17:59
corvushogepodge: https://zuul-ci.org/docs/zuul/user/config.html#attr-job.dependencies18:25
corvuswow that needs a lot more words :)18:25
corvushogepodge: a related idea is a paused job -- that can be useful if you want to, for example, run a docker image registry in job 'a' which is used by the other jobs  --  https://zuul-ci.org/docs/zuul/user/jobs.html#pausing-the-job18:26
hogepodgeI'm working through our inline notes and todos, we fixed that issue and I'm removing the comment. Source code should not be treated as an issue tracker...18:26
*** electrofelix has quit IRC18:31
openstackgerritTobias Henkel proposed openstack-infra/nodepool master: Support node caching in the nodeIterator  https://review.openstack.org/60464818:32
openstackgerritTobias Henkel proposed openstack-infra/nodepool master: Support node caching in the nodeIterator  https://review.openstack.org/60464818:35
*** bhavikdbavishi has quit IRC18:37
openstackgerritJames E. Blair proposed openstack-infra/zuul master: DNM: Enable sar logging for unit tests  https://review.openstack.org/61311718:38
tobiashcorvus: what do you think about the sar logging?18:40
corvustobiash: was just looking at it -- http://logs.openstack.org/17/613117/1/check/tox-py35/6c8e8cf/sar-logs-ubuntu-xenial/ has a bunch of 0 byte files18:41
tobiashcorvus: the 0 byte files are on xenial nodes (where sadf is too old)18:42
tobiashcorvus: check out the py36 job, that has real files18:42
corvusoh right i'll try 36 :)18:42
corvushttp://logs.openstack.org/17/613117/1/check/tox-py36/67fa4c4/sar-logs-ubuntu-bionic/sar-all.svg looks pretty good to me <-- clarkb, Shrews18:44
tobiashnot a fancy html report, but pretty detailed18:44
clarkbmy only complaint is that some of the color contrasts are hard for me to read18:46
clarkbbut I have terrible eyes18:46
corvusyeah, it's not beautiful, but it seems functional18:47
Shrewslgtm18:47
tobiashwe could at any time replace the svg generation with gnuplot ;)18:47
tobiashthat was just the quickest way I found to visualize the sar data18:48
corvusi stopped by the ansible office today to chat with the awx folks... take a look at https://github.com/ansible/awx/pull/2523 and see who merged that :)18:48
tobiashzuul yay :)18:49
openstackgerritJames E. Blair proposed openstack-infra/zuul master: quick-start: add a note about github  https://review.openstack.org/61339819:00
clarkbneat19:02
*** hasharAway is now known as hashar19:07
mordredcorvus: it might be fun to look at combining the sar stuff with the stackviz stuff at some point maybe - I added stackviz to the openstacksdk functional test runs - and being able to see the dstat graph information along with which test was running at the same time is nice - and it turns out stackviz isn't devstack or tempest specific19:12
mordredalthough ... clarkb did we ever sort out why the dstat stuff was missing?19:12
*** rlandy is now known as rlandy|brb19:13
clarkbmordred: ya its the .gz file not being read properly by stackviz19:13
clarkbthe should be dstat.csv instead of dstat.csv.gz19:13
mordredah right19:14
clarkbor have stackviz read it as compressed. I think the way to fix that is stackviz can compress theings itself then it does the right thing19:14
clarkbproblem is we compress it then stackviz does't know what is going on. But stackviz compression code is broken iirc19:14
mordrednod. I wonder if we could trick timothy in to fixing it19:15
corvusmordred: 'which test was running' or 'which tests were running'?19:18
corvus(i expect there to be about 8 random tests running at any given time for zuul and nodepol at least)19:19
clarkbcorvus: ya that is what stackviz shows you it gives you the overlapping test timeline with performance data19:27
corvuscan it be pip installed, or does it still need to be pre-installed on images?19:28
clarkbthe way it is done today with the js component we cache that so that you don't have to build it on pip install iirc. But we pip install the python bits aiui19:29
mordredI'm confident we could apply our python+js skills from zuul to stackviz to make it easily pip installable for both if we wanted to19:30
clarkbthe things we've learned about zuul pcakging can probably be applied there to make it happier19:30
corvusi've heard of a python app that builds its js components into it's packages :)19:30
mordredcorvus: http://logs.openstack.org/62/612162/3/check/openstacksdk-functional-devstack/cd35b75/controller/logs/stackviz/#/stdin/timeline?test=openstack.tests.functional.cloud.test_compute.TestCompute.test_create_and_delete_server19:30
mordredcorvus: there should be a dstat graph in the middle of the page19:31
corvusanyway, sounds like it could be a candidate for zuul-jobs with a little more work19:31
*** rlandy|brb is now known as rlandy19:31
mordredcorvus: and if there were more tests running in paralel, they'd show up too19:31
mordredbut it could be cool to not only  apply it to things generally, but also to get the sar data plugged in - then it's a super cool reporting ... for anything with a subunit stream19:32
mordredI don't think we hould block progress on the other stuff on it though19:33
corvusmordred: yeah, there's room in zuul-jobs for both19:36
*** irclogbot_4 has joined #zuul19:59
openstackgerritJames E. Blair proposed openstack-infra/zuul master: WIP: support foreign required-projects  https://review.openstack.org/61314320:09
*** irclogbot_4 has quit IRC20:22
*** hashar has quit IRC20:29
dkehnI’m trying to test a zuul v3 setup and looking for a few curl commands that I can use to test it with, thanks20:50
clarkbdkehn: https://zuul-ci.org/start should have a full walkthrough20:50
clarkbdkehn: I'd check there and see if that gives you what you are looking for?20:51
dkehnclarkb: thanks tons20:51
*** irclogbot_3 has joined #zuul21:16
*** edleafe_ has joined #zuul21:22
*** edleafe_ has quit IRC21:23
SpamapSFYI, I am like, 10% done with helmifying our zuul install21:57
SpamapShttps://github.com/SpamapS/zuul-helm21:57
clarkbSpamapS: as a side note corvus had to use mariadb because mysql containers were unhappy with something that he decided wasn't wroth debugging22:01
SpamapSfun22:08
SpamapSthat whole thing.. the mess is just starting to sink in22:08
SpamapSnow that mysql 8.0 is out... they're too different22:08
SpamapSit was fine in the beginning.22:08
SpamapSwell funny enough, the one thing I don't have in my current install that I'm using as the basis for this helm.. is sql reporting22:14
*** j^2 has joined #zuul22:14
*** rlandy has quit IRC23:23

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!