| *** rlandy|rover is now known as rlandy|rover|bbl | 00:00 | |
| *** agopi has quit IRC | 00:38 | |
| *** agopi has joined #oooq | 00:39 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 00:40 |
|---|---|---|
| *** agopi has quit IRC | 01:26 | |
| *** rfolco_doctor is now known as rfolco | 02:00 | |
| *** agopi has joined #oooq | 02:23 | |
| *** myoung|bbl is now known as myoung | 02:28 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 02:40 |
| *** rlandy|rover|bbl is now known as rlandy|rover | 02:59 | |
| *** rlandy|rover has quit IRC | 02:59 | |
| *** agopi has quit IRC | 03:36 | |
| *** agopi has joined #oooq | 03:43 | |
| *** udesale has joined #oooq | 03:45 | |
| *** skramaja has joined #oooq | 03:48 | |
| *** agopi has quit IRC | 03:51 | |
| *** agopi has joined #oooq | 03:51 | |
| *** agopi has quit IRC | 04:00 | |
| *** links has joined #oooq | 04:24 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 04:40 |
| *** ykarel|away has joined #oooq | 04:43 | |
| *** holser__ has joined #oooq | 04:43 | |
| *** holser___ has joined #oooq | 05:01 | |
| *** holser___ has quit IRC | 05:02 | |
| *** holser__ has quit IRC | 05:05 | |
| *** ykarel|away is now known as ykarel | 05:20 | |
| *** ratailor has joined #oooq | 05:25 | |
| *** jbadiapa has joined #oooq | 05:27 | |
| *** kopecmartin has joined #oooq | 05:51 | |
| *** bogdando has joined #oooq | 06:18 | |
| *** quiquell|off is now known as quiquell | 06:29 | |
| *** holser__ has joined #oooq | 06:34 | |
| *** saneax has joined #oooq | 06:38 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 06:40 |
| *** tosky has joined #oooq | 06:40 | |
| *** sanjay__u has joined #oooq | 06:46 | |
| *** tesseract has joined #oooq | 07:07 | |
| *** ccamacho has joined #oooq | 07:31 | |
| *** amoralej|off is now known as amoralej | 07:36 | |
| *** brault has joined #oooq | 07:37 | |
| *** zoli is now known as zoli|wfh | 07:38 | |
| *** zoli|wfh is now known as zoli | 07:38 | |
| *** brault has quit IRC | 07:46 | |
| *** arxcruz|brb is now known as arxcruz|ruck | 07:59 | |
| *** jaganathan has quit IRC | 07:59 | |
| *** brault has joined #oooq | 08:03 | |
| *** brault has quit IRC | 08:06 | |
| *** brault has joined #oooq | 08:06 | |
| *** gkadam has joined #oooq | 08:20 | |
| *** udesale_ has joined #oooq | 08:21 | |
| quiquell | sshnaidm: Fixed some ut of the promoter | 08:22 |
| quiquell | https://review.rdoproject.org/r/#/c/14084/ | 08:23 |
| *** udesale has quit IRC | 08:24 | |
| quiquell | marios: Added you to the review too | 08:25 |
| quiquell | It add some unit testing to the promoter | 08:25 |
| *** udesale__ has joined #oooq | 08:26 | |
| *** udesale_ has quit IRC | 08:29 | |
| ykarel | arxcruz|ruck, https://bugs.launchpad.net/tripleo/+bug/1776596 | 08:29 |
| openstack | Launchpad bug 1776596 in tripleo "[QUEENS] Promotion Jobs failing at overcloud deployment with AttributeError: 'IronicNodeState' object has no attribute 'failed_builds'" [Undecided,Confirmed] | 08:29 |
| arxcruz|ruck | jesus christ | 08:29 |
| marios | quiquell: ack | 08:30 |
| *** ykarel is now known as ykarel|lunch | 08:31 | |
| quiquell | sshnaidm, marios: also this one https://review.openstack.org/#/c/572736/ for the sprint | 08:38 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 08:40 |
| *** dtantsur|afk is now known as dtantsur | 08:58 | |
| quiquell | arxcruz|ruck: panda's change on promoter is merged | 09:04 |
| quiquell | arxcruz|ruck: You can close this https://bugs.launchpad.net/tripleo/+bug/1768090 | 09:04 |
| openstack | Launchpad bug 1768090 in tripleo "promoter script is not comparing timestamps correctly when folding hashes" [High,In progress] - Assigned to Gabriele Cerami (gcerami) | 09:04 |
| *** sshnaidm has quit IRC | 09:06 | |
| *** links has quit IRC | 09:08 | |
| arxcruz|ruck | quiquell: /me hates pytest | 09:09 |
| quiquell | arxcruz|ruck: Why ? the fixtureis great | 09:10 |
| quiquell | arxcruz|ruck: you can express setup/teardown in the same function | 09:10 |
| quiquell | arxcruz|ruck: OOP on those test is adding complexity | 09:10 |
| arxcruz|ruck | quiquell: complexity is the openstack way :P | 09:11 |
| arxcruz|ruck | quiquell: just wanted to have it like openstack standards but again, i didn't -1 :) | 09:11 |
| quiquell | arxcruz|ruck: Thanks for the comments btw, let's get more ut on our stuff. | 09:13 |
| quiquell | marios: the other part of trown's changes https://review.openstack.org/#/c/572420 | 09:22 |
| *** links has joined #oooq | 09:25 | |
| *** udesale_ has joined #oooq | 09:26 | |
| *** ykarel|lunch is now known as ykarel | 09:26 | |
| *** udesale__ has quit IRC | 09:26 | |
| *** udesale__ has joined #oooq | 09:28 | |
| marios | thank you quiquell | 09:30 |
| *** udesale_ has quit IRC | 09:31 | |
| quiquell | marios: Let's see if we can get those merged, it's a pain with zuul's queues so big | 09:34 |
| quiquell | arxcruz|ruck: checking the r&r board, looks like promoter has still master commented out | 09:41 |
| quiquell | arxcruz|ruck: Is still broken ? | 09:41 |
| arxcruz|ruck | quiquell: oh yeah | 09:41 |
| quiquell | arxcruz|ruck: promotions looks really fucked up | 09:41 |
| arxcruz|ruck | quiquell: yup | 09:42 |
| arxcruz|ruck | master and queens | 09:42 |
| quiquell | arxcruz|ruck: just out of curiosity what's the issue ? | 09:42 |
| tosky | s/f.../not working/ | 09:42 |
| arxcruz|ruck | quiquell: on master: keystone flaskination messed with some endpoints | 09:42 |
| *** sshnaidm has joined #oooq | 09:42 | |
| arxcruz|ruck | on queens: fix was merged, but the job was killed by admin this morning, not sure why | 09:42 |
| quiquell | arxcruz|ruck: They are moving it to flask ? | 09:42 |
| arxcruz|ruck | quiquell: yes | 09:43 |
| tosky | they already moved (at least partially) | 09:43 |
| quiquell | arxcruz|ruck: What a sprint to be ruck/rover... :-/ | 09:43 |
| quiquell | tosky: I see... so we will suffer the next sprint too | 09:43 |
| arxcruz|ruck | quiquell: it was fun ronelly really makes my job easier :) | 09:43 |
| quiquell | arxcruz|ruck: Yep, rlandy is super hero too | 09:44 |
| arxcruz|ruck | quiquell: also there's the problem with error 503 on containers, that ykarel fix, but we weren't able to test yet | 09:44 |
| arxcruz|ruck | test i mean, on the promotion pipeline | 09:44 |
| quiquell | arxcruz|ruck: So we are near to mordor in promotions | 09:44 |
| *** tcw1 has joined #oooq | 09:45 | |
| ykarel | arxcruz|ruck, i asked to abort queens job, to clean up rdo zuul queue, as queens were anyway going to fail because of https://bugs.launchpad.net/tripleo/+bug/1776596 | 09:46 |
| openstack | Launchpad bug 1776596 in tripleo "[QUEENS] Promotion Jobs failing at overcloud deployment with AttributeError: 'IronicNodeState' object has no attribute 'failed_builds'" [Undecided,Confirmed] | 09:46 |
| arxcruz|ruck | ykarel: oh, yeah, sorry, it was queens | 09:47 |
| arxcruz|ruck | i only got one coffe today, and doing a lot of reviews | 09:47 |
| *** tcw has quit IRC | 09:47 | |
| ykarel | arxcruz|ruck, np. can you add triaged/critical to ^^ | 09:47 |
| ykarel | arxcruz|ruck, chandankumar is patch to tempestconf pushed? | 09:48 |
| arxcruz|ruck | ykarel: on the gates | 09:49 |
| ykarel | arxcruz|ruck, Ok good | 09:49 |
| quiquell | arxcruz|ruck: RDO's zuul does not support Depends-On between projects ? | 09:50 |
| arxcruz|ruck | quiquell: i think it does, better ask to rdo guys | 09:51 |
| quiquell | arxcruz|ruck: Cool thanks | 09:51 |
| sshnaidm | quiquell, hi | 09:51 |
| sshnaidm | quiquell, have time for sync? | 09:51 |
| quiquell | sshnaidm: What's up man | 09:51 |
| quiquell | sshnaidm: Sure | 09:51 |
| quiquell | sshnaidm: https://bluejeans.com/7891065232 | 09:52 |
| *** links has quit IRC | 10:12 | |
| *** d0ugal has quit IRC | 10:17 | |
| *** jbadiapa has quit IRC | 10:19 | |
| *** links has joined #oooq | 10:25 | |
| *** udesale_ has joined #oooq | 10:26 | |
| *** udesale__ has quit IRC | 10:29 | |
| *** udesale__ has joined #oooq | 10:30 | |
| *** jbadiapa has joined #oooq | 10:30 | |
| *** udesale_ has quit IRC | 10:33 | |
| *** zoli is now known as zoli|lunch | 10:33 | |
| *** d0ugal has joined #oooq | 10:37 | |
| *** jaganathan has joined #oooq | 10:40 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 10:41 |
| arxcruz|ruck | ykarel: tempestconf patch merged | 11:02 |
| ykarel | arxcruz|ruck, ack and we should be consistent in some time | 11:02 |
| ykarel | let's hope it's before next run | 11:03 |
| *** anande has joined #oooq | 11:03 | |
| arxcruz|ruck | yup | 11:03 |
| *** ratailor has quit IRC | 11:04 | |
| *** florianf has joined #oooq | 11:04 | |
| arxcruz|ruck | ykarel: if not, we can ask admins to kill again | 11:06 |
| ykarel | arxcruz|ruck, ack | 11:06 |
| *** udesale_ has joined #oooq | 11:07 | |
| *** quiquell is now known as quiquell|afk | 11:08 | |
| *** udesale__ has quit IRC | 11:10 | |
| *** jaganathan has quit IRC | 11:11 | |
| *** florianf has quit IRC | 11:15 | |
| *** florianf has joined #oooq | 11:16 | |
| *** atoth has joined #oooq | 11:33 | |
| ykarel | arxcruz|ruck, we are consistent, so next run should go with merged python-tempestconf | 11:35 |
| *** quiquell|afk is now known as quiquell | 11:35 | |
| *** zoli|lunch is now known as zoli|wfh | 11:47 | |
| *** rlandy has joined #oooq | 11:49 | |
| *** rlandy is now known as rlandy|rover | 11:50 | |
| quiquell | sshnaidm: To test the add release to gating repo | 11:52 |
| quiquell | sshnaidm: https://trello.com/c/CuEgOpw3/794-ci-job-create-a-new-job-that-uses-fs50-but-tests-n-n-1 | 11:52 |
| quiquell | sshnaidm: I have put there some test patches that exercise also the new job for n -> n + 1 | 11:53 |
| sshnaidm | quiquell, I'd like to start with testing backward compatibility for patches with one release without any upgrades | 11:53 |
| sshnaidm | quiquell, I'll make one.. | 11:54 |
| quiquell | sshnaidm: Ok, going to use {{ working_dir }} for your comment | 11:54 |
| weshay | arxcruz|ruck, rlandy|rover who is joining the program call? | 11:56 |
| weshay | and updating the doc? | 11:56 |
| weshay | arxcruz|ruck, ah. you did it | 11:57 |
| weshay | thanks | 11:57 |
| weshay | arxcruz|ruck, don't try to predict :) | 11:57 |
| rlandy|rover | now it's upstream with the long queues :( 21 hr 6 min | 11:58 |
| arxcruz|ruck | weshay: i don't, i have ykarel :P | 11:59 |
| weshay | arxcruz|ruck, :) | 11:59 |
| weshay | ykarel++ | 11:59 |
| hubbot | weshay: ykarel's karma is now 6 | 11:59 |
| weshay | arxcruz|ruck, we merge that tempest patch? | 11:59 |
| arxcruz|ruck | weshay: yup, next run will have it | 11:59 |
| rlandy|rover | yay - pike promoted | 12:00 |
| weshay | oh nice | 12:01 |
| *** trown|outtypewww is now known as trown | 12:04 | |
| *** amoralej is now known as amoralej|lunch | 12:04 | |
| rlandy|rover | arxcruz|ruck: ykarel: editing the card on the escalations board ... https://trello.com/c/nuMokZMf/618-cixlp1776596tripleociproa-queens-promotion-jobs-failing-at-overcloud-deployment-with-attributeerror-ironicnodestate-object-has-n | 12:05 |
| rlandy|rover | pls check that the labels etc. are correct | 12:05 |
| rlandy|rover | I set the DFG to hardware prov | 12:06 |
| rlandy|rover | because of ironic but really the bug change in on nova | 12:06 |
| ykarel | rlandy|rover, ack | 12:06 |
| weshay | arxcruz|ruck, so this fixes tempest config? https://review.openstack.org/#/c/574735/ | 12:08 |
| weshay | arxcruz|ruck, have you confirmed that locally? | 12:09 |
| *** quiquell is now known as quiquell|lunch | 12:09 | |
| arxcruz|ruck | weshay: doesn't matter, the python-tempestconf will check both endpoints if one fail, it will check the second | 12:09 |
| arxcruz|ruck | so with this patch or not, it will work | 12:09 |
| weshay | k.. and that's all merged up? | 12:10 |
| arxcruz|ruck | weshay: it was merged this morning, ykarel already confirm that is already in consistent, and next periodic run will have it | 12:10 |
| weshay | rock on | 12:10 |
| weshay | thanks guys | 12:10 |
| weshay | chandankumar, where can I see this run w/ venv? https://review.openstack.org/#/c/572347/5/roles/validate-tempest/templates/configure-tempest.sh.j2 | 12:14 |
| weshay | arxcruz|ruck, do we know why containers-build failed on master? | 12:16 |
| rlandy|rover | %gatestatus | 12:16 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 12:16 |
| weshay | arxcruz|ruck, ERROR:kolla.common.utils:qdrouterd Failed with status: error" | 12:17 |
| ykarel | weshay, https://trello.com/c/5PoOjYc3 | 12:18 |
| chandankumar | weshay: https://review.openstack.org/#/q/topic:tempestconf_200+(status:open+OR+status:merged) -> https://review.openstack.org/#/c/572094/ -> http://logs.openstack.org/94/572094/5/check/tripleo-ci-centos-7-undercloud-oooq/9cd7fda/logs/undercloud/home/zuul/tempest.log.txt.gz#_2018-06-12_06_05_11 | 12:20 |
| weshay | ykarel, why is that not on the CIX board? | 12:20 |
| *** marios has quit IRC | 12:20 | |
| *** marios has joined #oooq | 12:20 | |
| ykarel | weshay, i checked in tripleo once it was about to fix | 12:20 |
| weshay | ykarel, doesn't matter | 12:21 |
| ykarel | weshay, ok we can move there | 12:21 |
| ykarel | i thought if it takes few hours(4+) then we move there | 12:22 |
| ykarel | weshay, ^^ | 12:22 |
| weshay | ykarel, is there a lp? | 12:23 |
| ykarel | weshay, no | 12:23 |
| *** udesale__ has joined #oooq | 12:23 | |
| ykarel | i haven't seen any lp for it | 12:23 |
| weshay | ykarel, if there is something that blocks a job in the chain, once you have an understanding ensure there is a lp bug w/ promotion_blocker tag. Then let the bug handle the cix card | 12:25 |
| weshay | and the timing | 12:25 |
| weshay | the lp bug is used to inform | 12:25 |
| weshay | and also for metrics of what has impacted the chain | 12:25 |
| ykarel | weshay, sure will take care next time | 12:25 |
| weshay | ykarel, thank you sir | 12:25 |
| *** udesale_ has quit IRC | 12:25 | |
| weshay | ykarel, we're skewing the metrics to some degree by not reporting it | 12:27 |
| weshay | arxcruz|ruck, thanks for the update | 12:27 |
| ykarel | weshay, understood | 12:28 |
| ykarel | will take care now onwards | 12:28 |
| *** saneax has quit IRC | 12:28 | |
| *** saneax has joined #oooq | 12:28 | |
| *** udesale__ has quit IRC | 12:31 | |
| *** anande has quit IRC | 12:35 | |
| *** quiquell|lunch is now known as quiquell | 12:40 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 12:41 |
| weshay | myoung, let's shoot out some pings / reminders to fill out the retrospective | 12:42 |
| weshay | boad | 12:42 |
| weshay | board | 12:42 |
| *** tcw1 has quit IRC | 12:43 | |
| *** tcw has joined #oooq | 12:47 | |
| weshay | arxcruz|ruck, rlandy|rover does this card cover the container build issue in our master job? https://trello.com/c/5PoOjYc3/804-puppet-cipoi-scenario-001-tripleocontainers-buildmasterfailing-1st-puppet-run-while-installing-qpid-dispatch-router | 12:51 |
| rlandy|rover | we never use that column | 12:53 |
| rlandy|rover | I did not witness this failure - checking the jobs history | 12:55 |
| myoung | weshay: ack, prepping board now | 12:55 |
| weshay | sshnaidm, https://github.com/sshnaidm/sova/pulls | 12:55 |
| sshnaidm | weshay, +w | 12:56 |
| myoung | all squads: retrospective board is live for sprint 14 --> https://trello.com/b/0VFswmht/rdo-infra-retrospective?menu=filter&filter=label:Sprint%2014 | 12:57 |
| myoung | Let's fill out cards for first 10m | 12:58 |
| rlandy|rover | weshay: ack - looks like the same error | 12:58 |
| rlandy|rover | ykarel: hi - any reason you added the containers build card to failing jobs rather than a bug? looking if this should be on the escalations board? | 12:59 |
| rlandy|rover | because the reviews are already out there? | 13:00 |
| rlandy|rover | merged in early june | 13:01 |
| weshay | chandankumar, retro | 13:01 |
| rlandy|rover | https://review.rdoproject.org/r/#/c/14194/ merged this morning | 13:01 |
| chandankumar | weshay: bj link | 13:02 |
| sshnaidm | chandankumar, it's different channel from this in calendar | 13:03 |
| sshnaidm | myoung, can we update calendar with right blueajeans links? | 13:04 |
| chandankumar | sshnaidm: got the right link | 13:04 |
| *** Goneri has joined #oooq | 13:07 | |
| *** skramaja has quit IRC | 13:21 | |
| *** amoralej|lunch is now known as amoralej | 13:28 | |
| *** hrybacki is now known as hrybacki|mtg | 13:31 | |
| *** kopecmartin has quit IRC | 13:34 | |
| rasca | myoung, rlandy|rover, hey folks, can you help me understand why this pipeline seems stuck https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/osp-director-promote-13-puddle/ ? | 14:09 |
| rasca | what is it waiting for? | 14:09 |
| myoung | rasca: we are in retrospective | 14:10 |
| myoung | rasca: can look in a bit sorry | 14:10 |
| rasca | myoung, no worries | 14:10 |
| *** sanjay__u has quit IRC | 14:10 | |
| rlandy|rover | rasca: hey - as myoung says, a bit distracted - what do you mean by stuck? | 14:12 |
| *** dtrainor has joined #oooq | 14:13 | |
| *** florianf has quit IRC | 14:15 | |
| *** florianf has joined #oooq | 14:19 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 14:41 |
| *** kopecmartin has joined #oooq | 14:45 | |
| rasca | rlandy|rover, if you look at https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/osp-director-promote-13-puddle/13/ you'll see that the jobs seems waiting for something | 14:51 |
| rasca | myoung ^^^ | 14:52 |
| rasca | myoung, rlandy|rover, specifically https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/osp-director-promote-13-puddle/13/console | 14:53 |
| *** hrybacki|mtg is now known as hrybacki | 15:04 | |
| *** agopi has joined #oooq | 15:07 | |
| rasca | trown, hey, regarding https://review.openstack.org/#/c/553465/6/doc/source/node-configuration.rst what is a TOC link? | 15:09 |
| trown | rasca: table of contents, check the CI result that I linked | 15:09 |
| trown | rasca: the doc is kind of hard to see that there are different sections | 15:09 |
| rasca | trown, ooooh I see you mean on the left | 15:10 |
| trown | rasca: ya, the "====" formatting doesnt add any header in the text... only a table of contents entry on the left | 15:11 |
| trown | rasca: I am fine if you put a patch on top of yours to fix up doc, and we can merge and unblock you | 15:11 |
| rasca | trown, but I see it as a general problem of this doc, isn't it? Apart from the additions | 15:12 |
| rasca | trown, ok, I get it | 15:12 |
| rasca | trown, let me see if I'm able :D | 15:12 |
| trown | rasca: well the doc before your modification had just that section as "Node configuration" you split it into sections, but the sections are not actually clear | 15:13 |
| rasca | trown, Ok, the section was "Libvirt Node Configuration", so what if I turn it into "Node Configuration" as === and then all the subsections as ----? | 15:13 |
| rasca | did I get correctly what you meant? | 15:14 |
| trown | rasca: ya I think that would be great | 15:14 |
| rasca | trown, and why it could be not in this review? | 15:14 |
| trown | rasca: it can be, just feel bad blocking your work over docs | 15:14 |
| rasca | trown, no worries, I'll do in this one | 15:15 |
| *** ykarel is now known as ykarel|away | 15:33 | |
| *** links has quit IRC | 15:36 | |
| *** saneax has quit IRC | 15:39 | |
| ykarel|away | arxcruz|ruck, fs018 failed with one tempest test, Good part is tempestconf issue fixed | 15:43 |
| ykarel|away | :( | 15:43 |
| arxcruz|ruck | ykarel|away: :( do you have the log easy ? | 15:44 |
| rasca | trown, I think I fixed it | 15:44 |
| ykarel|away | arxcruz|ruck, https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset018-master/c940db4/undercloud/home/jenkins/tempest/tempest.html.gz | 15:44 |
| trown | rasca: thanks | 15:45 |
| rasca | trown, let's see what the gates tell us | 15:45 |
| arxcruz|ruck | quiquell: told you, no thanks, beer | 15:45 |
| rlandy|rover | rasca: ok - finally out of meeting - checking | 15:46 |
| rlandy|rover | arxcruz|ruck: change your nick :) | 15:46 |
| *** dtantsur is now known as dtantsur|afk | 15:46 | |
| quiquell | arxcruz|ruck: Another keg for you | 15:46 |
| quiquell | Leave now | 15:46 |
| *** quiquell is now known as quiquell|off | 15:47 | |
| rasca | rlandy|rover, ok, I'm open for suggestions | 15:47 |
| rasca | because I don't know why this is not working | 15:47 |
| rlandy|rover | ok - I'm looking at it now | 15:47 |
| rasca | or proceeding, to be precise | 15:47 |
| *** bogdando has quit IRC | 15:50 | |
| *** bogdando has joined #oooq | 15:52 | |
| *** jaganathan has joined #oooq | 15:52 | |
| rlandy|rover | taking forever to resolve | 15:54 |
| rlandy|rover | rasca: which job is stuck - the get_puddle or the ones that trigger afterwards | 15:55 |
| rlandy|rover | build 13 ran yesterday | 15:56 |
| *** myoung is now known as myoung|biaf | 15:58 | |
| rasca | rlandy|rover, myoung|biaf, https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/osp-director-promote-13-puddle/13/ | 15:59 |
| rlandy|rover | does this trigger dailY | 15:59 |
| rlandy|rover | can rekick it | 15:59 |
| rlandy|rover | looking at config | 15:59 |
| rlandy|rover | jenkins is so slow | 16:00 |
| rasca | no wait | 16:00 |
| rlandy|rover | I am on the get_puddle job | 16:00 |
| rasca | I already re kicked it and it 's almost the same | 16:00 |
| *** weshay is now known as weshay|ruck | 16:00 | |
| rasca | and this does not run each day | 16:00 |
| rasca | it just run when there's a new puddle | 16:00 |
| myoung|biaf | rasca: the virt-ha machine's slave is probably hanging again | 16:00 |
| weshay|ruck | arxcruz|ruck, rlandy|rover fyi.. we may have enough to promote master | 16:00 |
| rlandy|rover | rasca: can we bj? so I understand what you are getting at? | 16:00 |
| *** florianf has quit IRC | 16:00 | |
| weshay|ruck | depending.. on this one tempest failure | 16:00 |
| myoung|biaf | https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/osp-director-promote-13-puddle/13/console | 16:00 |
| weshay|ruck | it may be a fluke | 16:01 |
| myoung|biaf | https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/osp-rhos-13-promote-puddle-virtha-3ctlr_1comp_192gb/ | 16:01 |
| rasca | rlandy|rover, sure, but I think myoung|biaf hit the problem | 16:01 |
| rlandy|rover | weshay|ruck; it's not done yet | 16:01 |
| rasca | hit == found what this is about | 16:01 |
| arxcruz|ruck | weshay|ruck: so, even with fs018 failing ? | 16:01 |
| myoung|biaf | ^^ that slave is probably offline again, that's the one that over the past few months has been hitting intermittent freezes. in the past I've had to ssh into virthost for that slave VM and restart it via virsh | 16:01 |
| *** arxcruz|ruck is now known as arxcruz | 16:01 | |
| rlandy|rover | oh ok | 16:01 |
| rlandy|rover | fs020 and fs035 are not done yet | 16:02 |
| weshay|ruck | arxcruz, how much energy do you have left.. it's one test failing on that job... before promoting it.. I would run it by the tripleo ptls | 16:02 |
| myoung|biaf | if it's the same issue, journalctl for libvirt will show a wierd HW fault that causes the VM to freeze up. I think it's just entropy and old hardware...we should IMHO move it. For now if we disable the job and/or kill the pending instances of the virt-ha job it'll finish the multijob | 16:02 |
| myoung|biaf | rasca: I can help if you need, or if you know how to resolve you should have the perms / access | 16:03 |
| *** bogdando has quit IRC | 16:03 | |
| myoung|biaf | rasca: confirmed: https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/computer/rdo-manager-18-virt-ha/ is off in space | 16:03 |
| rlandy|rover | ok fs001 and fs035 are ok | 16:03 |
| *** myoung|biaf is now known as myoung | 16:03 | |
| rasca | myoung|biaf, who have the rights to act on that machine? | 16:04 |
| * myoung didn't actually leave yet and chuckles | 16:04 | |
| weshay|ruck | rlandy|rover, arxcruz we'll see what fs20 returns | 16:04 |
| rlandy|rover | weshay|ruck: you want to change the promotion criteria? | 16:04 |
| weshay|ruck | rlandy|rover, I may.. but will discuss w/ tripleo ptls before doing so | 16:04 |
| myoung | rasca: my BJ if you like, unless weshay|ruck you're on it already | 16:04 |
| rlandy|rover | myoung; can use mine | 16:04 |
| weshay|ruck | rlandy|rover, its not great to hold back openstack patches from tripleo for too long | 16:04 |
| rlandy|rover | was going to dicuss with rasca anyways | 16:04 |
| myoung | no i meant you folks are looking at promotion blocker stuff | 16:05 |
| rlandy|rover | weshay|ruck: ack - I agree at this point | 16:05 |
| myoung | want me to reboot the slave VM for virt-ha? | 16:05 |
| weshay|ruck | rlandy|rover, arxcruz you can renick :) | 16:05 |
| rasca | rlandy|rover, can you give me the link? | 16:05 |
| rlandy|rover | weshay|ruck: you have no rover now | 16:05 |
| weshay|ruck | rlandy|rover, arxcruz well done :) thanks for your time as ruck/rover | 16:05 |
| myoung | rlandy++ | 16:05 |
| myoung | arxcruz++ | 16:05 |
| hubbot | myoung: arxcruz's karma is now 2 | 16:05 |
| weshay|ruck | ya. it will be the same thing tomorrow afternoon | 16:05 |
| *** florianf has joined #oooq | 16:05 | |
| rlandy|rover | weshay|ruck: I'll renick but you can call on me | 16:05 |
| weshay|ruck | thanks | 16:06 |
| *** rlandy|rover is now known as rlandy | 16:06 | |
| myoung | rlandy++ | 16:06 |
| hubbot | myoung: rlandy's karma is now 4 | 16:06 |
| myoung | weshay|ruck: do you want me to sort rasca / osp13 virt-ha slave? | 16:06 |
| * myoung doesn't want to overstep | 16:06 | |
| rlandy | rasca: https://bluejeans.com/u/rlandy/ | 16:06 |
| rlandy | myoung: ^^ | 16:06 |
| myoung | ack | 16:07 |
| rlandy | we have slave options | 16:07 |
| * myoung actually fades away this time for a few | 16:07 | |
| *** myoung is now known as myoung|biaf | 16:07 | |
| *** gkadam has quit IRC | 16:08 | |
| *** ykarel|away has quit IRC | 16:12 | |
| *** kopecmartin has quit IRC | 16:17 | |
| *** ccamacho has quit IRC | 16:21 | |
| *** agopi has quit IRC | 16:23 | |
| *** florianf has quit IRC | 16:24 | |
| *** ykarel|away has joined #oooq | 16:25 | |
| *** myoung|biaf is now known as myoung|lunch | 16:29 | |
| *** brault has quit IRC | 16:31 | |
| *** tesseract has quit IRC | 16:33 | |
| *** ykarel|away has quit IRC | 16:37 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 16:41 |
| *** holser__ has quit IRC | 16:42 | |
| weshay|ruck | rlandy, slave issues? | 16:42 |
| rlandy | weshay|ruck; in which context? rasca? | 16:44 |
| *** ykarel|away has joined #oooq | 16:52 | |
| myoung|lunch | weshay|ruck: i rebooted the virt-ha slave, it was switched off (brn slave virthost) | 16:53 |
| myoung|lunch | it's the third time in a year this has happened...libvirt throws a hardware fault and the VM comes crashing down | 16:53 |
| myoung|lunch | just had to ssh in and start it. we should really relocate slaves and / or have IT ticket logged as it's now a pattern | 16:54 |
| myoung|lunch | weshay|ruck: i have some notes buried in a card on this i can dig up. back in a few...importing calories | 16:54 |
| weshay|ruck | is that our slave or rasca's? | 16:54 |
| myoung|lunch | it's the jenkins slave VM that drives jobs targeted at PIDONE 40 core + 196 gb virthost. the actual machine in PIDONE lab is fine. | 16:55 |
| myoung|lunch | https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/computer/rdo-manager-18-virt-ha | 16:55 |
| weshay|ruck | is it our slave or rascas? | 16:55 |
| myoung|lunch | ^^ that VM is the issue | 16:55 |
| myoung|lunch | our slave, located on (fetches) | 16:55 |
| myoung|lunch | hp-dl320g8-10.lab.eng.brq.rh.com | 16:56 |
| myoung|lunch | hp-dl320g8-10.lab.eng.brq.{REDACTED}.com | 16:56 |
| weshay|ruck | quiquell|off, fyi the gate job failure log links are busted | 17:05 |
| weshay|ruck | quiquell|off, the prepend http://38.145.34.131:3000/ | 17:05 |
| weshay|ruck | to the url to the log | 17:05 |
| weshay|ruck | sshnaidm, you still around? | 17:09 |
| sshnaidm | weshay|ruck, yeah | 17:09 |
| weshay|ruck | sshnaidm, RFE for sova... adding a column w/ the nodepool_provider | 17:09 |
| weshay|ruck | wdyt? | 17:10 |
| sshnaidm | weshay|ruck, what does it mean? | 17:10 |
| sshnaidm | weshay|ruck, sorting by infra clouds? | 17:12 |
| weshay|ruck | sshnaidm, so in sova I can see which cloud provider the job ran on | 17:12 |
| weshay|ruck | well next to the "Length" column | 17:12 |
| sshnaidm | weshay|ruck, I have it in grafana.. and will include it in new dashboard too | 17:12 |
| weshay|ruck | so I can detect a pattern w/ a certain cloud provider | 17:12 |
| weshay|ruck | k.. new dashboard would be good too | 17:12 |
| sshnaidm | weshay|ruck, well, about length you can check right now | 17:13 |
| weshay|ruck | grafana meaning the one in rdo-sf? | 17:13 |
| weshay|ruck | ya.. corralating the length w/ provider | 17:13 |
| sshnaidm | weshay|ruck, and one of quiquell|off too | 17:13 |
| weshay|ruck | sshnaidm, here? https://review.rdoproject.org/grafana/dashboard/db/tripleo-ci?orgId=1 | 17:14 |
| weshay|ruck | ah ya | 17:14 |
| weshay|ruck | see it | 17:14 |
| sshnaidm | weshay|ruck, go to https://review.rdoproject.org/grafana/dashboard/db/tripleo-ci?orgId=1 set there "cloud" | 17:14 |
| sshnaidm | weshay|ruck, and "duration" graph will change accordingly | 17:14 |
| weshay|ruck | ya did | 17:14 |
| weshay|ruck | not seeing a clear trend | 17:15 |
| weshay|ruck | https://review.rdoproject.org/grafana/dashboard/db/tripleo-ci?orgId=1&var-pipeline=All&var-branch=All&var-cloud=rax-iad&var-type=All&var-jobtype=All | 17:15 |
| *** amoralej is now known as amoralej|off | 17:18 | |
| *** myoung|lunch is now known as myoung | 17:19 | |
| sshnaidm | weshay|ruck, added red line for 2 h 50 min there.. | 17:19 |
| weshay|ruck | sshnaidm, thanks | 17:20 |
| weshay|ruck | sshnaidm, doesn't seem to be specific to a host | 17:20 |
| weshay|ruck | to a provider | 17:21 |
| weshay|ruck | see the same trend on vex as rax | 17:21 |
| sshnaidm | weshay|ruck,limestone and vex are the worst | 17:21 |
| sshnaidm | weshay|ruck, rax is not good too | 17:22 |
| sshnaidm | weshay|ruck, just going one by one.. | 17:22 |
| *** trown is now known as trown|lunch | 17:24 | |
| *** agopi has joined #oooq | 17:24 | |
| *** ykarel|away has quit IRC | 17:37 | |
| *** zoli|wfh is now known as zoli|gone | 17:38 | |
| *** zoli|gone is now known as zoli | 17:39 | |
| *** Goneri has quit IRC | 17:43 | |
| *** yolanda has quit IRC | 17:50 | |
| *** brault has joined #oooq | 17:55 | |
| *** brault has quit IRC | 17:59 | |
| *** yolanda has joined #oooq | 18:05 | |
| *** myoung is now known as myoung|biab | 18:08 | |
| *** jaganathan has quit IRC | 18:17 | |
| chandankumar | quiquell|off: myoung|biab sshnaidm arxcruz https://www.youtube.com/watch?v=rhMFX9dE4cw -> to learn about rpm packaging and rdo packaging | 18:17 |
| sshnaidm | chandankumar++ | 18:20 |
| hubbot | sshnaidm: chandankumar's karma is now 4 | 18:20 |
| *** Goneri has joined #oooq | 18:28 | |
| *** trown|lunch is now known as trown | 18:30 | |
| weshay|ruck | rlandy, ^ | 18:37 |
| rlandy | weshay|ruck: thanks | 18:38 |
| *** matbu has quit IRC | 18:38 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 18:41 |
| *** brault has joined #oooq | 18:54 | |
| *** brault has quit IRC | 18:59 | |
| rlandy | weshay|ruck: https://review.openstack.org/#/c/574894/ https://code.engineering.redhat.com/gerrit/#/c/141378/. afaict, browbeat and rasca use different jjb builders | 19:09 |
| rlandy | since we are not touching the full-deploy-baremetal script, we should be able to merge without impacting other jobs | 19:09 |
| *** myoung|biab is now known as myoung | 19:15 | |
| myoung | chandankumar++, bookmarked to watch it when i have some time (today is not the day :)) | 19:16 |
| rlandy | myoung: pls take a look at ^^ JJb change. I think I changed the right one for the bm pipelines | 19:27 |
| myoung | rlandy: you have, i commented on that earlier today with some suggestions (optional) | 19:27 |
| myoung | rlandy: double checking... | 19:28 |
| myoung | rlandy: ack, that's the correct builder. let me know what you think re: gerrit notes i left there | 19:29 |
| rlandy | k - cool - I'll look | 19:29 |
| weshay|ruck | rlandy, want me to merge this? https://review.openstack.org/#/c/574894/2 | 19:32 |
| weshay|ruck | it will only take two days to merge lolz | 19:32 |
| rlandy | weshay|ruck: if I am really lucky | 19:33 |
| rlandy | it need to merge on top of rasca patch | 19:33 |
| weshay|ruck | oops | 19:33 |
| rlandy | but sure - no harm addition | 19:33 |
| *** tcw has quit IRC | 19:34 | |
| *** tcw has joined #oooq | 19:35 | |
| weshay|ruck | rlandy, on second thought.. merging | 19:35 |
| weshay|ruck | so I can get on it w/ it and test | 19:35 |
| rlandy | weshay|ruck: are we talking about the same review?? | 19:36 |
| rlandy | the t-q one | 19:36 |
| weshay|ruck | rlandy,https://review.openstack.org/#/c/574894/ | 19:36 |
| rlandy | yeah ok | 19:37 |
| weshay|ruck | rlandy, re: the jjb I think it would make sense to be able to pass a featureset via jjb template variable | 19:37 |
| weshay|ruck | and the node as well | 19:37 |
| rlandy | weshay|ruck: basically, I just needed those two review to email out to other users and explain the change | 19:37 |
| weshay|ruck | rlandy, k k | 19:38 |
| rlandy | myoung had the same comment - looking at how to pass those vars rather | 19:38 |
| weshay|ruck | rlandy, so you have these two reviews, plus a job that matches this config | 19:38 |
| weshay|ruck | proof it works.. | 19:38 |
| rlandy | {functional_config} models "--config" {topology} models "--nodes" | 19:38 |
| weshay|ruck | makes sense | 19:38 |
| weshay|ruck | rook, is ignoring us :) | 19:38 |
| rlandy | I don't blame him :( | 19:38 |
| myoung | rlandy: ack, if it helps can point to other examples | 19:38 |
| rlandy | I should have had this done a while back | 19:38 |
| myoung | rlandy: but didn't want to -1 anything if yall are running fast and want to hard code configs | 19:39 |
| weshay|ruck | rlandy, jebus | 19:39 |
| weshay|ruck | rlandy, you said it | 19:39 |
| rlandy | sec updating review | 19:39 |
| rlandy | then we need to make rhos-13 work - git it as far as overcloud deploy | 19:40 |
| weshay|ruck | rlandy, oh I remember now... we do not want to initially include the fs and node config as vars | 19:40 |
| weshay|ruck | rlandy, that will end up changing the name of the jobs | 19:40 |
| weshay|ruck | and screw all that for now | 19:40 |
| myoung | rlandy: http://git.app.eng.bos.redhat.com/git/tripleo-environments.git/tree/jenkins/jobs/tripleo-quickstart/tripleo-quickstart-main.yml#n192 is example of using those variables from project section | 19:40 |
| rlandy | weshay|ruck:so I thought about that - and yes, it would change the job name | 19:41 |
| rlandy | but that is not a bad thing | 19:41 |
| weshay|ruck | rlandy, ya.. so let's not | 19:41 |
| weshay|ruck | not right now | 19:41 |
| weshay|ruck | on top of this patch later | 19:41 |
| * myoung nods at weshay|ruck and rlandy and goes back to other stuff | 19:41 | |
| rlandy | ideally we should name it like upstream | 19:41 |
| weshay|ruck | rlandy, right | 19:41 |
| weshay|ruck | how about that | 19:41 |
| rlandy | we could | 19:42 |
| weshay|ruck | we could, but later | 19:42 |
| rlandy | so we need to keep the name undre a certain number of cars | 19:42 |
| weshay|ruck | this is wes pushing off work | 19:42 |
| rlandy | chars | 19:42 |
| weshay|ruck | ya | 19:42 |
| rlandy | and we would probably stillw ant the env name | 19:42 |
| rlandy | and single-nic | 19:42 |
| weshay|ruck | rlandy, if we play our cards right.. soon only the bm jobs will be left here | 19:42 |
| rlandy | right - and I thought we trigger those from zuul as well eventually | 19:43 |
| rlandy | so I actully thought about this a bit ... | 19:43 |
| weshay|ruck | ya.. it "could" happen | 19:43 |
| rlandy | and changing the job name is not a big deal | 19:43 |
| weshay|ruck | rlandy, I just don't want to deal w/ it | 19:44 |
| rlandy | b/c we only impact ours;eves | 19:44 |
| weshay|ruck | rlandy, removing the old jobs etc | 19:44 |
| rlandy | weshay|ruck: lol - I don't blame you | 19:44 |
| weshay|ruck | loosing history | 19:44 |
| weshay|ruck | blah blah blah | 19:44 |
| rlandy | updating promote scripts etc. | 19:44 |
| rlandy | okie dokie | 19:44 |
| weshay|ruck | let's just see it work w/ upstream configs for a bit and be merry | 19:44 |
| * weshay|ruck going through the configs | 19:45 | |
| rlandy | so what do I do about myoung's comment and using the {functional_config} models "--config" {topology} models "--nodes" | 19:45 |
| rlandy | change the review or leave as is? | 19:45 |
| rlandy | weshay|ruck: we are missing C and A | 19:45 |
| rlandy | (not in use in CI atm) | 19:45 |
| rlandy | if all goes well, I can add those afterwards | 19:45 |
| rlandy | really just cut/paste work | 19:45 |
| rlandy | or I can just add them now - ugh - will take me 15 minutes | 19:46 |
| weshay|ruck | heh.. rlandy upstream zuul queue at 1.1 days | 19:46 |
| rlandy | oh dear me | 19:46 |
| weshay|ruck | lolz | 19:46 |
| rlandy | worse than rdo zuul yesterday | 19:47 |
| rlandy | weshay|ruck: it's like playing those 90's video games, when you can withstand enough pressure, you get moved to a level where it gets worse | 19:47 |
| weshay|ruck | heh | 19:48 |
| rlandy | all openstack devs - vacation tomorrow - we need to clear the queues | 19:48 |
| weshay|ruck | rlandy, heh.. Alex can shoot it in the head if he wanted to | 19:49 |
| rlandy | weshay|ruck; well if nothing is really broken, and we just have volume, and we DO want people to run tests, how will killing zuul help? | 19:50 |
| rlandy | we'd have to kill off a few contributors | 19:50 |
| weshay|ruck | rlandy, he clear the gate queue for tripleo I meant | 19:52 |
| weshay|ruck | he can | 19:52 |
| tosky | it's only two days from Friday | 19:52 |
| weshay|ruck | afaict it looks like there is some variation across nodepool providers on some jobs | 19:52 |
| rlandy | by friday, the queue will be 5 days long | 19:52 |
| myoung | I think the longer queue times absent infra issues is useful data on where we need to either add resources, optimize things, etc. Some of the ideas around how CI time can be re-used and/or restructured to be more effecient almost needs a wheel to squeak right? | 19:52 |
| weshay|ruck | 0/ tosky :) | 19:53 |
| tosky | nah, it will go down on Saturday | 19:53 |
| tosky | (unless zuul explodes) | 19:53 |
| rlandy | weshay|ruck: ack - we have seen trouble with some providers more than others | 19:53 |
| rlandy | but we don't get to pick | 19:53 |
| rlandy | or do we? | 19:53 |
| weshay|ruck | rlandy, we don't pick.. lolz no | 19:54 |
| weshay|ruck | rlandy, oh my | 19:56 |
| weshay|ruck | the change in config is not easy to follow or walk through | 19:56 |
| myoung | speaking of gate times, 11.5 hours after +w and https://review.openstack.org/#/c/574970 is into gates \o/ | 19:57 |
| rlandy | weshay|ruck: everything got deleted expect instackenv.json and 1 env_settings per hardware environment | 19:57 |
| weshay|ruck | myoung, you've only just begun the journey.. oy vey.. 1.1 more days to go for that patch | 19:57 |
| weshay|ruck | rlandy, that I get | 19:57 |
| rlandy | weshay|ruck: we can walk through it if you like | 19:57 |
| myoung | Hello darkness my old friend... | 19:58 |
| weshay|ruck | rlandy, however I'm trying to trace variables from the deleted config | 19:58 |
| myoung | weshay|ruck: {chuckle} | 19:58 |
| weshay|ruck | to the env_settings | 19:58 |
| rlandy | ok | 19:58 |
| weshay|ruck | maybe that is the wrong approach | 19:58 |
| rlandy | nothing wrong with that | 19:58 |
| rlandy | it's possible | 19:58 |
| rlandy | the single_nic_vlans.yaml file become the network_environment args | 19:59 |
| weshay|ruck | rlandy, so given that if there are failures here.. I'll probably ping you for extra eyes.. | 19:59 |
| rlandy | weshay|ruck: ack | 19:59 |
| weshay|ruck | rlandy, any other good ways to try and verify this prior to merge | 19:59 |
| rlandy | weshay|ruck: yes ... | 20:00 |
| rlandy | https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/rlandy-poc-tripleo-quickstart-master-baremetal-hp_dl360_envE-single_nic_vlans/ | 20:00 |
| rlandy | we change the env name and run | 20:00 |
| rlandy | as far as the jjb, not really | 20:00 |
| rlandy | but the command should be the same | 20:00 |
| weshay|ruck | rlandy, oh wait.. I know a way | 20:01 |
| weshay|ruck | rlandy, just following your pattern | 20:01 |
| weshay|ruck | I'll create a test job.. rlandy-poc$job for B,D | 20:02 |
| weshay|ruck | we could consider breaking this review into three | 20:02 |
| weshay|ruck | not needed really though | 20:02 |
| weshay|ruck | merge, run the rlandy-poc jobs and profit | 20:02 |
| weshay|ruck | if we needed to revert we could | 20:03 |
| rlandy | weshay|ruck: we can test w/o merge | 20:03 |
| rlandy | see te current poc | 20:03 |
| weshay|ruck | k | 20:03 |
| rlandy | just takes in the changes | 20:03 |
| rlandy | before quickstart run | 20:03 |
| weshay|ruck | ah yes | 20:04 |
| weshay|ruck | k | 20:04 |
| * weshay|ruck creates two new jobs | 20:04 | |
| rlandy | weshay|ruck: feel free to edit that job | 20:04 |
| rlandy | change the env called in the quickstart.sh run - and the virthost | 20:05 |
| weshay|ruck | rlandy, if we ran this against pike too.. that would be informative | 20:06 |
| weshay|ruck | as they all pass minus the bond_with_vlan | 20:06 |
| rlandy | weshay|ruck: sure - run one env agaist queens, one pike | 20:07 |
| rlandy | bond templates are not teste | 20:07 |
| rlandy | which is why I want to get rid of them in the gates | 20:07 |
| rlandy | and here | 20:07 |
| rlandy | the point of this stag eis not to test new templates | 20:07 |
| weshay|ruck | aye | 20:07 |
| rlandy | as with the rhos-13 gates | 20:07 |
| rlandy | they failed on overcloud deploy | 20:08 |
| rlandy | major debug to figure that template out | 20:08 |
| rlandy | move to fs001 - more streamlines | 20:08 |
| rlandy | forget the bond env | 20:08 |
| rlandy | unless someone tells us to bring it back | 20:08 |
| rlandy | weshay|ruck, ^^ I have tried to get help in debugging that template before | 20:09 |
| rlandy | little success | 20:09 |
| weshay|ruck | k | 20:09 |
| rlandy | ha - we have a problem | 20:19 |
| rlandy | the templates need to change | 20:23 |
| weshay|ruck | https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/rlandy-poc-tripleo-quickstart-master-rdo_trunk-baremetal-dell_fc430_envB-single_nic_vlans/ | 20:24 |
| weshay|ruck | https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/rlandy-poc-tripleo-quickstart-master-rdo_trunk-baremetal-hp_dl360_envD-single_nic_vlans/ | 20:25 |
| weshay|ruck | bah.. virthost | 20:25 |
| weshay|ruck | rlandy, ok.. those look good to go, not 100% sure re: the throttle but just copied what you had | 20:30 |
| rlandy | weshay|ruck: we have a problem with the templates | 20:30 |
| weshay|ruck | jjb? | 20:30 |
| rlandy | tht | 20:30 |
| rlandy | https://github.com/openstack/tripleo-heat-templates/tree/master/environments | 20:30 |
| rlandy | no longer exists | 20:31 |
| rlandy | it's a j2 file | 20:31 |
| rlandy | we had a bug reported that we are using hardcoded templates in ci - generally | 20:31 |
| rlandy | and we should be using the new j2 templates | 20:32 |
| rlandy | for ovb rdocloud, we use https://github.com/openstack/tripleo-heat-templates/tree/master/ci/environments | 20:32 |
| rlandy | ^^ status | 20:32 |
| rlandy | static | 20:32 |
| rlandy | for single_nic there are no more static templates | 20:33 |
| weshay|ruck | rlandy, that change must have just happened no? | 20:33 |
| rlandy | recently, I think | 20:34 |
| rlandy | I am trying to figure out who this worked yesterday | 20:35 |
| weshay|ruck | so this implies to me... | 20:36 |
| weshay|ruck | if we choose single-nic-vlan w/ config_download.. the templates are rendered for us | 20:37 |
| weshay|ruck | so far its in master and queens | 20:37 |
| weshay|ruck | rlandy, it's this way in pike too | 20:38 |
| weshay|ruck | rlandy, so interesting that it's working | 20:38 |
| rlandy | weshay|ruck: if I look on the undercloud | 20:38 |
| rlandy | https://thirdparty.logs.rdoproject.org/jenkins-rlandy-poc-tripleo-quickstart-master-baremetal-hp_dl360_envE-single_nic_vlans-4/undercloud/usr/share/openstack-tripleo-heat-templates/environments/ | 20:39 |
| rlandy | where are those files? | 20:39 |
| weshay|ruck | bluejeans | 20:40 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 20:41 |
| *** matbu has joined #oooq | 20:57 | |
| *** trown is now known as trown|outtypewww | 21:01 | |
| *** dtrainor has quit IRC | 21:35 | |
| *** atoth has quit IRC | 21:54 | |
| *** Goneri has quit IRC | 22:06 | |
| *** myoung is now known as myoung|off | 22:20 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 22:41 |
| *** gkadam has joined #oooq | 22:46 | |
| rlandy | pike promoting | 23:01 |
| rlandy | EmilienM: hi - do you have a moment for an 'openstack overcloud deploy' question? | 23:30 |
| EmilienM | rlandy: hey, debugging gate on #triploe | 23:31 |
| EmilienM | #tripleo | 23:31 |
| rlandy | EmilienM: I think this is unrelated - and definitely not urgent - I will paste in my question in pvt channel - for whenever you have the time to look at it. | 23:33 |
| *** dtrainor has joined #oooq | 23:38 | |
| *** tosky has quit IRC | 23:51 | |
| *** dtrainor has quit IRC | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!