| *** yolanda_ has quit IRC | 00:16 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 00:52 |
|---|---|---|
| hubbot | FAILING CHECK JOBS on master: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata-branch, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-pike-branch @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 02:52 |
| *** jaganathan has joined #oooq | 03:02 | |
| *** noama has joined #oooq | 03:06 | |
| *** hamzy has joined #oooq | 03:47 | |
| *** udesale has joined #oooq | 03:50 | |
| *** noama has quit IRC | 03:50 | |
| *** agopi has quit IRC | 03:50 | |
| *** ykarel has joined #oooq | 04:27 | |
| *** skramaja has joined #oooq | 04:34 | |
| *** noama has joined #oooq | 04:44 | |
| hubbot | FAILING CHECK JOBS on master: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata-branch, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-pike-branch @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 04:52 |
| *** ratailor has joined #oooq | 05:12 | |
| *** waleedm has joined #oooq | 05:28 | |
| *** quiquell|off is now known as quiquell|rover | 05:36 | |
| *** yolanda_ has joined #oooq | 05:47 | |
| *** saneax has joined #oooq | 05:58 | |
| *** yolanda__ has joined #oooq | 06:06 | |
| *** yolanda_ has quit IRC | 06:09 | |
| *** yolanda__ has quit IRC | 06:14 | |
| *** ccamacho has joined #oooq | 06:22 | |
| *** dmellado has joined #oooq | 06:29 | |
| *** yolanda__ has joined #oooq | 06:30 | |
| *** bogdando has joined #oooq | 06:35 | |
| quiquell|rover | Some cores to unblock promotions https://review.openstack.org/#/c/578292/ | 06:41 |
| *** quiquell|rover is now known as quique|rover|afk | 06:42 | |
| *** kopecmartin has joined #oooq | 06:42 | |
| marios | quique|rover|afk: not sure i count but voted anyway seems straight forward enough :) | 06:44 |
| ykarel | +2 always counted :) | 06:46 |
| *** yolanda__ has quit IRC | 06:50 | |
| marios | ykarel: ;) | 06:50 |
| hubbot | FAILING CHECK JOBS on master: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata-branch, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-pike-branch @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 06:52 |
| *** yolanda__ has joined #oooq | 06:53 | |
| *** yolanda__ is now known as yolanda | 06:53 | |
| *** udesale has quit IRC | 06:54 | |
| *** udesale has joined #oooq | 06:55 | |
| *** udesale has quit IRC | 06:59 | |
| *** udesale has joined #oooq | 07:00 | |
| *** tesseract has joined #oooq | 07:07 | |
| *** quique|rover|afk is now known as quiquell|rover | 07:08 | |
| quiquell|rover | Back in business | 07:08 |
| *** jaosorior has quit IRC | 07:23 | |
| *** zoli is now known as zoli|wfh | 07:28 | |
| *** zoli|wfh is now known as zoli | 07:28 | |
| *** brault has quit IRC | 07:30 | |
| *** brault has joined #oooq | 07:30 | |
| *** tosky has joined #oooq | 07:40 | |
| *** amoralej|off is now known as amoralej | 07:42 | |
| *** noama has quit IRC | 07:53 | |
| *** ykarel is now known as ykarel|lunch | 08:16 | |
| *** ykarel|lunch has quit IRC | 08:20 | |
| *** ykarel|lunch has joined #oooq | 08:21 | |
| *** dtantsur|afk is now known as dtantsur | 08:22 | |
| *** ccamacho has quit IRC | 08:27 | |
| *** ccamacho has joined #oooq | 08:27 | |
| *** holser_ has joined #oooq | 08:30 | |
| ajo | quiquell|rover: marios ykarel|lunch Do you know an easy way to bump nova::cpu_allocation_ratio from the quickstart side? | 08:38 |
| ajo | I'm investigating where I'd set that on a normal tripleo config, but, then I have to find out how to do it in quickstart | 08:40 |
| ykarel|lunch | ajo, are you looking for something similar | 08:43 |
| ykarel|lunch | ControllerExtraConfig: | 08:43 |
| *** holser_ has quit IRC | 08:44 | |
| ykarel|lunch | nova::cpu_allocation_ratio: somtihng | 08:44 |
| *** ykarel|lunch is now known as ykarel | 08:45 | |
| marios | ajo: yeah i think you need to add some env file with your extraconfig override then add that to quickstart, like add _extra_args in your config | 08:45 |
| marios | ajo: eg. here https://github.com/openstack/tripleo-quickstart/blob/98fcc9d14d5b46a3bd456c55e8bab8c48d282427/config/general_config/featureset048.yml#L29 | 08:46 |
| marios | if you were using this for -c featureset | 08:46 |
| marios | ajo: but i've only very recently shifted focus to ci :) so quiquell|rover may well know of better ways | 08:46 |
| marios | ymmv | 08:46 |
| marios | t&c apply | 08:46 |
| marios | etc | 08:46 |
| *** holser_ has joined #oooq | 08:47 | |
| * quiquell|rover is with the fireman hat now, give me a few | 08:47 | |
| marios | ajo: does it help/make sense? | 08:48 |
| ajo | marios: thanks looking :D | 08:49 |
| ajo | marios: yeah, makes sense, but I may need the extra yaml file to reference there uploaded to the undercloud, right? | 08:50 |
| marios | ajo: yeah heat needs to find it on the local host along with any other env files/templates | 08:50 |
| hubbot | FAILING CHECK JOBS on master: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata-branch, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-pike-branch @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 08:52 |
| *** d0ugal has quit IRC | 08:54 | |
| *** holser_ has quit IRC | 09:16 | |
| *** holser_ has joined #oooq | 09:17 | |
| quiquell|rover | cores: to fix linter problem | 09:23 |
| quiquell|rover | https://review.openstack.org/578336 | 09:23 |
| quiquell|rover | https://review.openstack.org/578339 | 09:24 |
| quiquell|rover | https://review.openstack.org/578340 | 09:24 |
| *** holser_ has quit IRC | 09:27 | |
| *** holser_ has joined #oooq | 09:28 | |
| *** holser_ has quit IRC | 09:30 | |
| *** holser_ has joined #oooq | 09:30 | |
| *** holser_ has quit IRC | 09:32 | |
| *** ykarel has quit IRC | 09:35 | |
| *** ykarel has joined #oooq | 09:39 | |
| *** holser_ has joined #oooq | 09:48 | |
| *** holser_ has quit IRC | 09:55 | |
| *** holser_ has joined #oooq | 09:56 | |
| sshnaidm | quiquell|rover, what does mean 'yaml upgraded'? | 10:02 |
| quiquell|rover | sshnaidm: Need to investigate | 10:07 |
| *** gkadam__ has quit IRC | 10:16 | |
| *** gkadam__ has joined #oooq | 10:16 | |
| *** jaosorior has joined #oooq | 10:18 | |
| *** zoli is now known as zoli|lunch | 10:29 | |
| *** jaganathan has quit IRC | 10:46 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 10:52 |
| quiquell|rover | sshnaidm: https://review.rdoproject.org/r/#/c/14473/ | 11:10 |
| sshnaidm | quiquell|rover, left comments there | 11:12 |
| sshnaidm | quiquell|rover, I don't understand this patch.. bluejeans? | 11:15 |
| quiquell|rover | sshnaidm: Sure give me a sec | 11:16 |
| quiquell|rover | sshnaidm: Calling you | 11:18 |
| sshnaidm | quiquell|rover, https://review.rdoproject.org/grafana/dashboard/db/tripleo-ci?orgId=1 | 11:20 |
| *** udesale has quit IRC | 11:24 | |
| *** zoli|lunch is now known as zoli | 11:26 | |
| *** zoli is now known as zoli|wfh | 11:26 | |
| *** zoli|wfh is now known as zoli | 11:26 | |
| *** amoralej is now known as amoralej|lunch | 11:37 | |
| *** jfrancoa has joined #oooq | 11:48 | |
| sshnaidm | quiquell|rover, http://38.145.34.41/ | 11:52 |
| *** atoth has joined #oooq | 11:55 | |
| *** jfrancoa has quit IRC | 12:04 | |
| *** dtantsur is now known as dtantsur|brb | 12:06 | |
| sshnaidm | rfolco, hi | 12:14 |
| rfolco | o/ | 12:14 |
| sshnaidm | rfolco, any news about dependencies in internal SF? | 12:14 |
| rfolco | sshnaidm, nhicher fixed the gerrit user account... but still not fetching code. I did a test upstream and it works well.... | 12:15 |
| rfolco | sshnaidm, there must be something missing... | 12:15 |
| sshnaidm | rfolco, ack | 12:16 |
| rfolco | I'm doing some tests sshnaidm, will ping nhicher | 12:17 |
| sshnaidm | rfolco, anything that we can help him with it..? | 12:17 |
| rfolco | sshnaidm, not sure... I'll work on it, don't worry | 12:17 |
| sshnaidm | rfolco, ok, ping me if you need help with it | 12:18 |
| rfolco | sshnaidm, I will. Thanks. | 12:18 |
| *** ratailor has quit IRC | 12:19 | |
| *** ykarel has quit IRC | 12:25 | |
| *** rlandy has joined #oooq | 12:29 | |
| *** trown|outtypewww is now known as trown | 12:30 | |
| rlandy | myoung|off: ping re: virtblade email | 12:30 |
| rlandy | weshay|ruck: ^^ I am not using any of the virtblades anymore are you? | 12:31 |
| rlandy | one still says doc server | 12:32 |
| *** ykarel has joined #oooq | 12:39 | |
| *** ykarel has quit IRC | 12:39 | |
| *** ykarel has joined #oooq | 12:40 | |
| quiquell|rover | sshnaidm ++ | 12:41 |
| quiquell|rover | ++ sshnaidm | 12:41 |
| quiquell|rover | ++sshnaidm | 12:41 |
| quiquell|rover | hubbot dumn it | 12:41 |
| hubbot | quiquell|rover: Error: "dumn" is not a valid command. | 12:41 |
| myoung|off | rlandy: aye, i'll respond to email in a bit, omw to doctor. We are using virtblade servers for at least 3 things now...doc server, an IRC bouncer used by a few folks in RelDel and myself, as well as an rdo2 symlink promoter arxcruz put in place a year ago. We will need to migrate these to $otherPlaces | 12:42 |
| *** zoli is now known as zoli|afk | 12:42 | |
| arxcruz | not my fault! | 12:42 |
| arxcruz | :) | 12:43 |
| myoung|off | rlandy: I can't help but think there's a 4th thing, was going to log in to them to ensure we are in the clear prior to responding | 12:43 |
| rlandy | myoung|off, ok - we will talk later | 12:43 |
| *** myoung|off is now known as myoung | 12:47 | |
| myoung | arxcruz: didn't mean it that way :) was part of sprint we did on internal CI | 12:48 |
| hubbot | FAILING CHECK JOBS on master: openstack-tox-linters @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 12:52 |
| weshay|ruck | sshnaidm, quiquell|rover I'm still interested in giving the full tempest run fs20 more resources than the average job.. a larger flavor | 12:54 |
| weshay|ruck | thoughts? | 12:54 |
| weshay|ruck | I was previously nacked on that | 12:55 |
| sshnaidm | weshay|ruck, it should involve te-broker | 12:55 |
| quiquell|rover | weshay|ruck: Idempotency is activated ther e? | 12:55 |
| weshay|ruck | quiquell|rover, not sure if that merged.. but we're testing it in 27 so we could turn it back off in 20 | 12:55 |
| weshay|ruck | quiquell|rover, that should only take about 5min | 12:55 |
| quiquell|rover | weshay|ruck: ack | 12:56 |
| weshay|ruck | sshnaidm, ok.. can you help me understand how to use the te-broker to do that | 12:56 |
| *** holser_ has quit IRC | 12:58 | |
| weshay|ruck | panda|off, 1-1 | 12:59 |
| panda|off | weshay|ruck: I'm in your room | 13:00 |
| *** panda|off is now known as panda | 13:00 | |
| *** quiquell|rover is now known as quique|rover|lch | 13:01 | |
| quique|rover|lch | weshay|ruck: I am testing the ARA + OC now, didn't have time at my morning | 13:01 |
| sshnaidm | weshay|ruck, if shortly, you need to hack this line: https://github.com/openstack-infra/tripleo-ci/blob/b229760043e50fbcb491cc423ed1241177f8710f/scripts/te-broker/create-env#L51 | 13:03 |
| sshnaidm | weshay|ruck, but it's not configurable, and you can pass it only with testenv-client by adding new hackish option here: https://github.com/openstack-infra/tripleo-ci/blob/6369985369e9f2ace8f47ce4f3be621cb52e9cb6/testenv-client#L179 | 13:04 |
| sshnaidm | weshay|ruck, and then passing it from there: https://github.com/openstack-infra/tripleo-ci/blob/1edb87d06888fb397ee39b2145f24d78affa7215/toci_gate_test-oooq.sh#L285 | 13:05 |
| sshnaidm | weshay|ruck, I can do a POC, but only thinking about these hacks makes my cry.. | 13:06 |
| *** agopi has joined #oooq | 13:07 | |
| rlandy | quique|rover|lch: sorry - forgot to add you to this request before ... https://redhat.service-now.com/pnt?id=ticket&table=x_redha_pnt_devops_table&sys_id=deede177db321f00a9e306e2ca961993 - for rhos-13 gates | 13:10 |
| *** holser_ has joined #oooq | 13:12 | |
| *** ykarel is now known as ykarel|afk | 13:17 | |
| *** bogdando has quit IRC | 13:18 | |
| *** amoralej|lunch is now known as amoralej | 13:18 | |
| *** bogdando has joined #oooq | 13:21 | |
| *** ykarel|afk has quit IRC | 13:23 | |
| weshay|ruck | arxcruz, will need a few minutes | 13:24 |
| arxcruz | weshay|ruck: you're the boss, boss :) | 13:24 |
| *** zoli|afk is now known as zoli|wfh | 13:32 | |
| *** zoli|wfh is now known as zoli | 13:32 | |
| *** dtantsur|brb is now known as dtantsur | 13:35 | |
| *** quique|rover|lch is now known as quiquell|rover | 13:35 | |
| quiquell|rover | rlandy: ack | 13:36 |
| rlandy | quiquell|rover: we're going nowhere without a reasonable sized node to deploy on | 13:36 |
| trown | sshnaidm: want to pull the trigger on https://review.openstack.org/558121 ... seems good to do on a wednesday :) | 13:39 |
| sshnaidm | trown, yay \o/ | 13:40 |
| *** waleedm has quit IRC | 13:40 | |
| sshnaidm | trown, nobody will mention among all other problems :D | 13:40 |
| trown | sshnaidm: haha | 13:40 |
| arxcruz | weshay|ruck: let me know when | 13:45 |
| weshay|ruck | arxcruz, ready | 13:47 |
| *** skramaja has quit IRC | 13:50 | |
| *** udesale has joined #oooq | 14:04 | |
| marios | trown: sorry binarya sounds awful :/ | 14:07 |
| trown | :P | 14:07 |
| panda | *drumroll* | 14:18 |
| trown | wait for it | 14:19 |
| quiquell|rover | what's happening ? | 14:25 |
| quiquell|rover | I am always open for a beer | 14:26 |
| panda | *drumroll* intensifies | 14:26 |
| * marios pokerface | 14:27 | |
| marios | so excited | 14:27 |
| marios | (no idea whats going on ) | 14:27 |
| quiquell|rover | marios: What are we waitting for ? | 14:27 |
| quiquell|rover | Damn... | 14:27 |
| * marios pokerface intensifies | 14:27 | |
| quiquell|rover | panda: give me a clue | 14:27 |
| panda | no, I'm superstitious | 14:30 |
| marios | so whats this ci escalation status call | 14:31 |
| marios | and should we join it? | 14:31 |
| marios | weshay|ruck: panda ? ^ | 14:31 |
| marios | myoung: ? | 14:31 |
| quiquell|rover | marios: is about ruck/rover talking about state of things | 14:31 |
| weshay|ruck | marios, no.. that is ruck/rover | 14:31 |
| marios | ack | 14:31 |
| marios | i might lurk then thanks | 14:31 |
| weshay|ruck | quiquell|rover, you on? I'm still in a meeting | 14:31 |
| quiquell|rover | I will connect now | 14:32 |
| myoung | marios: what weshay|ruck said :) | 14:34 |
| weshay|ruck | sshnaidm, panda, trown, rlandy https://review.rdoproject.org/r/#/c/14496/ | 14:34 |
| marios | thanks myoung | 14:35 |
| panda | weshay|ruck: I am not very familiar with those jobs. They seem more on the packaging, DLRN and repos side | 14:39 |
| panda | weshay|ruck: but yay, zuulv3 migration started! | 14:41 |
| weshay|ruck | :) | 14:42 |
| panda | *VICTORY TRUMPET* | 14:43 |
| panda | so, the first drumroll was when overcloud deployed correctly, second was wehn tempest passed, now the test job is green. All welcome our new parent job "multinode" | 14:44 |
| panda | *applauses* | 14:44 |
| panda | I'll rewrite the patch to test all the other job with the new configuration now | 14:45 |
| trown | nice | 14:48 |
| trown | guess we also need to split it into smaller mergable patches | 14:48 |
| panda | trown: yes, I think I'll start a new patch | 14:49 |
| *** hamzy has quit IRC | 14:49 | |
| hubbot | FAILING CHECK JOBS on master: openstack-tox-linters @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 14:52 |
| *** quiquell|rover is now known as quiquell|off | 14:52 | |
| *** hamzy has joined #oooq | 14:52 | |
| *** hamzy has quit IRC | 14:53 | |
| sshnaidm | weshay|ruck, not sure I understand what happens in this patch: https://review.rdoproject.org/r/#/c/14496 | 14:54 |
| *** hamzy has joined #oooq | 14:54 | |
| weshay|ruck | sshnaidm, ok.. paul is in #rdo | 14:55 |
| weshay|ruck | ask him | 14:55 |
| *** waleedm has joined #oooq | 15:02 | |
| *** ledo_ has joined #oooq | 15:02 | |
| marios | panda: myoung /anyone else please i have a question. say reproducer failed for me like http://pastebin.test.redhat.com/609556 looks like running this https://github.com/openstack/tripleo-quickstart/blob/master/roles/repo-setup/tasks/setup_repos.yml | 15:06 |
| * myoung looks | 15:06 | |
| marios | panda: myoung where are the logs for it so i can see more? i am on the undercloud | 15:06 |
| marios | panda: myoung like there is no repo_setup_log generated | 15:06 |
| *** waleedm has quit IRC | 15:07 | |
| myoung | marios: rlandy and I were just looking at an ovb job ironically at this same log. an example would be https://thirdparty.logs.rdoproject.org/jenkins-tq-gate-rhos-13-ci-rhos-ovb-featureset001-82/undercloud/home/stack/repo_setup.log.txt.gz | 15:08 |
| myoung | which is generated by the tee --> log file of this jinja-template-generated .sh --> https://thirdparty.logs.rdoproject.org/jenkins-tq-gate-rhos-13-ci-rhos-ovb-featureset001-82/undercloud/home/stack/repo_setup.sh.txt.gz | 15:09 |
| myoung | marios: do you have an tmate or link to job logs? HTH | 15:09 |
| marios | myoung: i see... sec (in opt/stack right?0 | 15:09 |
| rlandy | this is a diff failures | 15:09 |
| rlandy | rhos-13 failed undercloud-setup | 15:09 |
| marios | myoung: so i don't have the usual logs | 15:09 |
| myoung | marios: the actual log filename used is a variable and can be reset (https://github.com/openstack/tripleo-quickstart/blob/master/roles/repo-setup/defaults/main.yml#L4) but defaults to repo_setup.log | 15:09 |
| myoung | rlandy: diff fail, but an example of the same repo_setup.log with the details (unrelated root cause/issue) | 15:10 |
| marios | myoung: because i am running /opt/stack/tripleo-ci/toci_gate_test-oooq.sh 2>&1 | tee console.log | 15:10 |
| myoung | rlandy, marios: i just had that log open in a tab as example :) | 15:10 |
| marios | myoung: thanks much for pointers appreciated | 15:10 |
| rlandy | weshay|ruck: arxcruz: myoung: we need to respond regarding the virtblade decommissioning email. I have nothing to keep on those machines | 15:19 |
| panda | trown: one patch for the base + nodeset, one patch for the new run playbook, and I was thinking one patch per job category. One for undercloud jobs for example, to not migrate one job at a time .. | 15:19 |
| rlandy | myoung mentioned the tripleo-env doc | 15:19 |
| trown | panda: makes sense | 15:20 |
| rlandy | and the upgrades of internal links | 15:20 |
| rlandy | myoung: pls list what we need to move | 15:20 |
| myoung | rlandy: from the email it looks like "we plan to retire the virtblade chassis by the end of next month." - so we need to migrate things by end of July | 15:22 |
| *** kopecmartin has quit IRC | 15:24 | |
| myoung | sshnaidm: are we still running a sova instance on virtblade14? | 15:25 |
| *** gkadam__ has quit IRC | 15:26 | |
| myoung | rlandy: virtblade13 is set up as a squid proxy, however the jobs that used to need it (osp need_images puddles) no longer run so dont' think we need it anymore | 15:26 |
| *** gkadam__ has joined #oooq | 15:26 | |
| rlandy | myoung: will you be back by the end of JUly? | 15:26 |
| rlandy | myoung: I have a request in to reconfigure the networking of old env 1 to be independent hosts | 15:27 |
| myoung | rlandy: virtblade15 is afaik atilla's box that was running hubbot, i think that's since been migrated | 15:27 |
| rlandy | as such we will have more hardware available to us | 15:27 |
| myoung | rlandy: virtblade16 unknown, "temp test box" | 15:27 |
| rlandy | but I don;t have an ETA on that | 15:27 |
| myoung | rlandy: virtblade11 is running doc server VM, an quassel instance used by myself and RelDel folk. | 15:28 |
| weshay|ruck | sshnaidm, http://logs.openstack.org/50/578150/1/check/tripleo-ci-centos-7-containers-multinode/5c81f43/logs/ | 15:28 |
| myoung | rlandy: I'm back monday 16-July | 15:28 |
| myoung | rlandy: would prefer to migrate things then, i'm rapidly running out of time prior to PTO, hopping on a plane tonight | 15:29 |
| myoung | rlandy: I responded to Yash's email confirming the july 31 date | 15:35 |
| rlandy | thanks | 15:35 |
| rlandy | I asked the same question | 15:35 |
| rlandy | based on the outcome of this ticket: | 15:35 |
| myoung | rlandy: ahhh lol just saw | 15:35 |
| rlandy | https://redhat.service-now.com/pnt?id=ticket&table=x_redha_pnt_devops_table&sys_id=6bd1c3f3db7e5f003306abc5ca96190d | 15:36 |
| rlandy | ^^ we get that hardware, | 15:36 |
| rlandy | we can move whatever | 15:36 |
| panda | rfolco: addedd reviews to https://trello.com/c/tO42ubRD/824-create-new-base-jobs, please comment with the results of your tests | 15:38 |
| rfolco | panda, I have added a comment already with my undercloud job test | 15:39 |
| panda | rfolco: that's cheating | 15:39 |
| rfolco | panda, it works with swap | 15:39 |
| panda | rfolco: comment on the reviews, not only on the card | 15:39 |
| panda | rfolco: if youi have something to add to the changes | 15:40 |
| myoung | trown: I've only hit one issue so far with libvirt reproducer etherpad... getting "zuul-hosts.yaml did not meet yaml requirements" when attempting to load inventory using yaml.py plugin | 15:40 |
| rfolco | panda, ack | 15:40 |
| *** bogdando has quit IRC | 15:41 | |
| panda | myoung: copying an pasting the yaml file created some problems for me with wierd characters, maybe it's what's happening with your yaml | 15:42 |
| myoung | trown: I'm running ansible 2.5.5 on CentOS 7.5.1804, is that the same version you've been running? | 15:42 |
| myoung | trown: ya retracing steps, I think there's some gunk from a copy paste as well | 15:42 |
| panda | myoung: he's running 2.4.0, I already asked him once :) | 15:42 |
| trown | myoung: ya that seems more likely... but I have ansible 2.4 on my dev box | 15:42 |
| myoung | panda, trown: also some oddities around the yaml plugin and etherpad steps, got past them when the yaml inventory plugin is enabled it really doesn't like non-yaml inventories, even though extensions are set for the plugin. I'll retest on 2.4 | 15:43 |
| trown | myoung: updating it now though, so we will see | 15:43 |
| myoung | the first steps were failing, had to disable yaml plugin, then re-enable to grok the zuul inventory | 15:44 |
| trown | myoung: fwiw... I didnt have to do anything wrt the yaml plugin | 15:44 |
| myoung | trown: I started with clean/new centos 7.5, and ansible 2.5.5, i might be hitting $newAnsibleVersionFun | 15:44 |
| * marios almost hometime | 15:45 | |
| * rfolco almost lunchtime | 15:45 | |
| marios | i updated v4/5 @ https://review.openstack.org/#/c/578081/ weshay|ruck is that what you had in mind? fyi | 15:45 |
| * myoung almost ptotime | 15:46 | |
| * panda almost kickbantime | 15:46 | |
| marios | thanks trown for checking https://review.openstack.org/578366 i think i will abandon that tomorrow morning and update the commit message at https://review.openstack.org/#/c/578081 | 15:46 |
| rfolco | panda wins | 15:46 |
| marios | but imo my biggest contribution today is this http://paste.openstack.org/show/724413/ i cant stop doing it | 15:46 |
| marios | endless hours of fun | 15:47 |
| *** saneax has quit IRC | 15:47 | |
| marios | myoung: have a nice time | 15:48 |
| marios | its totally fine | 15:48 |
| marios | we'll stay here and work | 15:48 |
| marios | trown: rlandy sshnaidm thanks for checking @ https://review.openstack.org/#/c/578023/ | 15:49 |
| marios | sshnaidm: fwiw i did cycle back to your review request but i was too late i owe you one | 15:49 |
| marios | sshnaidm: for the record i'm usually in review mode in the morning, and then on request later depending on urgency (or i note it for next morning) | 15:49 |
| marios | sshnaidm: i think we have exact same TZ | 15:49 |
| marios | o/ | 15:49 |
| trown | myoung: hmm odd... I just updated centos7 and I still have ansible2.4 ... what repo are you using? | 15:49 |
| weshay|ruck | marios, that looks like a nice add to the reproducer.. yes I think that does what I was thinking but need to test.. also looking for a similiar check around https://github.com/openstack/tripleo-quickstart/blob/master/quickstart.sh#L136-L162 | 15:50 |
| sshnaidm | marios, ack :) | 15:50 |
| myoung | trown: ansible.noarch 2.5.5-1.el7 @epel | 15:50 |
| weshay|ruck | marios, let me know if you have questions around that | 15:50 |
| trown | myoung: eww... epel | 15:51 |
| panda | lol | 15:51 |
| marios | weshay|ruck: ack noted will check tomrrow grateful for any more thoughts you might have today on the review if you get chance | 15:51 |
| * myoung will retest with old(er) ansible | 15:51 | |
| weshay|ruck | k.. thank you! | 15:51 |
| weshay|ruck | rlandy, aye re: virtblades.. on my todo | 15:52 |
| marios | gimmeFeatureset 037 | 15:52 |
| marios | its fantastic | 15:52 |
| trown | with epel on centos you might as well be on fedora | 15:52 |
| myoung | trown: epel aside, should we then be targeting 2.4.1 (https://github.com/openstack/tripleo-quickstart/blob/master/requirements.txt#L3 source of truth?). | 15:56 |
| myoung | I've been doing some ansible module exploration and it's handy to be running newer things, as devenv for ansible modules is to run ansible from git. If it's "invalid" to be ahead w.r.t. ansible version makes total sense and I'll retest | 15:57 |
| trown | myoung: to me epel is a bigger deal than being "ahead" on ansible... epel is totally untested | 15:58 |
| trown | whereas base centos is just rhel | 15:59 |
| * myoung loads less bleeding edge boot and will retest | 15:59 | |
| trown | aka tested out the wazzoo | 15:59 |
| *** myoung is now known as myoung|biaf | 15:59 | |
| panda | myoung|biaf: we target what's in cento-7 without epel, epel has been scrapped out of every possible place | 15:59 |
| panda | trown: added some reviews for the reparenting | 16:00 |
| weshay|ruck | rlandy, probably makes sense to migrate those services to the dell boxes we are renicking.. they larger and we can host this stuff in vm's wdyt? | 16:01 |
| rlandy | weshay|ruck: ack - that is what I responded in the email | 16:01 |
| rlandy | the only thing is that we do not have an ETA on the renick project | 16:01 |
| rlandy | if we really have til the end of July, we will make it | 16:02 |
| rlandy | weshay|ruck - our task has been assigned to jpainter so we should be fine - no worries :) | 16:03 |
| weshay|ruck | rlandy++ | 16:03 |
| hubbot | weshay|ruck: rlandy's karma is now 8 | 16:03 |
| weshay|ruck | thanks | 16:03 |
| rlandy | panda: I was thinking about the playbooks and release vars | 16:03 |
| rlandy | as one thought, what do you think about setting release based on tag/playbook ebing executed | 16:04 |
| rlandy | being | 16:04 |
| panda | rlandy: you mean the "release" var itself ? | 16:05 |
| rlandy | yes | 16:05 |
| panda | rlandy: how do you deal with all the release-related variables ? | 16:06 |
| *** myoung|biaf is now known as myoung | 16:06 | |
| panda | rlandy: mmhh, maybe a conditional include_vars may work | 16:06 |
| rlandy | panda: well more a dict than a conditional | 16:06 |
| rlandy | panda: anyways, it's a half thought now | 16:07 |
| panda | rlandy: you mean something likle releases["queens"] = @queens.yml | 16:07 |
| rlandy | I need to experiment with that before making a formal suggestion | 16:07 |
| panda | rlandy: ok, I think you are in the right direction. | 16:08 |
| rlandy | releases["queens"]["overcloud"] | 16:08 |
| rlandy | so we pass one var but it has all the info included | 16:08 |
| *** waleedm has joined #oooq | 16:09 | |
| panda | rlandy: do we need to change all the tasks to refer to this new releases[release]['overcloud'] dict that stores all the variables needed, like repo_cmd_after ? | 16:09 |
| rlandy | I would think so | 16:10 |
| rlandy | I just wanted to know if the idea was somewhat acceptable to you | 16:10 |
| rlandy | before I proposed it | 16:10 |
| panda | rlandy: I would try to understand what's the rewrite overhead for this solution | 16:10 |
| rlandy | ack | 16:10 |
| rlandy | I just think it's safer than trying to pass vars around a list of playbooks | 16:11 |
| rlandy | passed in zuul | 16:11 |
| rlandy | where we have less control | 16:11 |
| panda | rlandy: yes, the releases dict was in my first releases overhaul design, but we put it aside because we thought it was too much rewrite | 16:11 |
| *** ledo_ has quit IRC | 16:11 | |
| rlandy | panda: I am worried about possible overrides if we rely on a single release var being passed around | 16:12 |
| panda | rlandy: override from whom ? | 16:13 |
| rlandy | as I understand, we will get to pass a variable in the job itself ... so you have the releases dict work you discarded, for comparison? | 16:17 |
| rlandy | do you | 16:17 |
| panda | rlandy: no, it was just an idea. I wanted to just crate a releases = {} in ansible then load all the releases files in the keys. So we would get releases['queens']['repo_cmd_after'] | 16:19 |
| rlandy | panda: pretty much my thought | 16:19 |
| panda | rlandy: than each task would have to call releases[current_release]['repo_cmd_after'] | 16:20 |
| rlandy | as considering we will be able to pass vars: in the job and that will apply to all playbooks | 16:20 |
| rlandy | something like that | 16:20 |
| rlandy | it's ugly but safe | 16:20 |
| panda | rlandy: maybe now we don't have to rewrite everything, the dict idea needs refinement if we would still need to change the vars usage task per task | 16:21 |
| *** apetrich has quit IRC | 16:21 | |
| *** apetrich has joined #oooq | 16:21 | |
| rlandy | panda: ok - I'll refine the usage a bit - as long as you are bot completely opposed to the idea itself, it's worth the time to investigate | 16:21 |
| panda | rlandy: maybe using a dynamic include_vars in the a pre task taht we include before any playbook could be consider | 16:22 |
| panda | rlandy: we load only the variable that we need at the start of each playbook | 16:22 |
| rlandy | we have an example of thta | 16:22 |
| rlandy | weshay|ruck and I looked at it some time back | 16:22 |
| rlandy | what I didn't like about that is that the task constantly runs | 16:22 |
| rlandy | if you add it to extras-common | 16:22 |
| rlandy | or the like | 16:22 |
| * rlandy looks to see if if we still have that review somewhere | 16:23 | |
| panda | rlandy: that's fine, maybe we can iunclude a role explicitly at the start of each playbook ... at this point I think anything woul be better than using multiple job inheritancein zuul.d | 16:24 |
| myoung | panda: re: avoiding zuul job inheritance...why? This seems to be one of the focal points of the zuul v3 design center. | 16:26 |
| myoung | panda: do you mean "anything better *now* w.r.t. easy migration of existing job collateral? or "no not ever" in a clean room implementation of new jobs? | 16:27 |
| panda | myoung: not in general, but as a workaround to be able to pass different --extra-vars to each playbook in our list of playbooks to run | 16:27 |
| rlandy | weshay|ruck: do you still have that dynamic include_vars patch somewhere? | 16:29 |
| rlandy | like from last year maybe? | 16:29 |
| weshay|ruck | lolz | 16:29 |
| *** tosky has quit IRC | 16:29 | |
| weshay|ruck | rlandy, I'll look | 16:29 |
| rlandy | I didn't find it | 16:29 |
| *** tosky has joined #oooq | 16:29 | |
| weshay|ruck | out of my 50 or so.. outgoing reviews :) | 16:30 |
| weshay|ruck | rlandy, I remember how to do it if needed | 16:31 |
| weshay|ruck | just taking advantage of include_vars and when: statements | 16:31 |
| rlandy | weshay|ruck: we may need it - see discussion with panda re: release vars passed in zuul with list of playbooks | 16:31 |
| rlandy | one idea | 16:31 |
| rlandy | testing a few possibilities | 16:31 |
| panda | rlandy: anyway, check first how many things we would need to rewrite with the raw dict | 16:31 |
| panda | rlandy: then investiate the alternatives | 16:32 |
| rlandy | panda: ack - seems the most obvious approach if the damage is low | 16:32 |
| panda | rlandy: thanks for diving into this, among all the other tasks | 16:32 |
| *** panda is now known as panda|bike | 16:33 | |
| weshay|ruck | passing vars w/ zuul would make it difficult for recreates no? | 16:33 |
| *** udesale has quit IRC | 16:33 | |
| rlandy | idk | 16:33 |
| rlandy | doing some investigation ahead of the next sprint | 16:34 |
| panda|bike | weshay|ruck: we are currently passing variables needed for the pre-run playbook. We are trying to avoid passing too many vars | 16:34 |
| *** tesseract has quit IRC | 16:34 | |
| rlandy | not necessarily if we have pass the same vars as extra-vars to recreate | 16:34 |
| rlandy | also the release var need to change per playbook run | 16:35 |
| panda|bike | we will probably add just the split jobtype vars, and a few more | 16:35 |
| rlandy | ^^ is the real issue | 16:35 |
| myoung | panda|bike: i see | 16:36 |
| weshay|ruck | ya.. I can see the jobtype being split | 16:37 |
| *** gkadam__ has quit IRC | 16:37 | |
| weshay|ruck | sshnaidm, I updated that patch | 16:43 |
| *** rlandy is now known as rlandy|brb | 16:45 | |
| hubbot | FAILING CHECK JOBS on master: openstack-tox-linters @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 16:52 |
| *** waleedm has quit IRC | 16:53 | |
| *** ssbarnea[m] has joined #oooq | 16:54 | |
| *** zoli is now known as zoli|gone | 17:02 | |
| *** zoli|gone is now known as zoli | 17:02 | |
| *** myoung is now known as myoung|lunch | 17:02 | |
| *** dtantsur is now known as dtantsur|afk | 17:04 | |
| *** rlandy|brb is now known as rlandy | 17:07 | |
| *** trown is now known as trown|lunch | 17:16 | |
| *** amoralej is now known as amoralej|off | 17:29 | |
| rlandy | weshay|ruck: panda|bike: lol - seek and you shall find ... https://review.openstack.org/#/c/494674/ | 17:45 |
| rlandy | https://review.openstack.org/#/c/494674/7/roles/common/tasks/main.yml | 17:45 |
| weshay|ruck | nice | 17:46 |
| weshay|ruck | rlandy, panda|bike ya.. I'm a fan of include_vars | 17:46 |
| rlandy | it only took reading through all weshay|ruck's reviews until last year August | 17:46 |
| rlandy | it's a reasonable idea | 17:46 |
| weshay|ruck | heh | 17:46 |
| rlandy | we will have to weigh the options up against eachother | 17:46 |
| * rlandy ran out of sprint work for prepping for next sprint | 17:47 | |
| rlandy | what I'm thinking is we get to assign release per playbook/per role based on jobtype and the playbook running | 17:51 |
| *** atoth has quit IRC | 18:00 | |
| *** yolanda_ has joined #oooq | 18:11 | |
| *** trown|lunch is now known as trown | 18:14 | |
| *** yolanda has quit IRC | 18:14 | |
| weshay|ruck | trown, panda|bike https://review.openstack.org/#/c/576597/ | 18:19 |
| *** myoung|lunch is now known as myoung | 18:21 | |
| trown | weshay|ruck: how are hammer/jewel getting installed in the first place? | 18:21 |
| weshay|ruck | I could ping kb to find out ;) | 18:22 |
| weshay|ruck | fak | 18:25 |
| weshay|ruck | the reproducer is busted | 18:25 |
| weshay|ruck | don't we have a whole team on this??? | 18:29 |
| weshay|ruck | https://review.openstack.org/#/c/576834/ | 18:29 |
| weshay|ruck | myoung, trown ? | 18:29 |
| weshay|ruck | panda|bike, ^ | 18:29 |
| weshay|ruck | panda-- | 18:34 |
| weshay|ruck | trown-- | 18:34 |
| hubbot | weshay|ruck: trown's karma is now 1 | 18:34 |
| weshay|ruck | myoung== | 18:34 |
| weshay|ruck | myoung-- | 18:34 |
| hubbot | weshay|ruck: myoung's karma is now 1 | 18:34 |
| weshay|ruck | https://bugs.launchpad.net/tripleo/+bug/1778974 | 18:34 |
| openstack | Launchpad bug 1778974 in tripleo "reproduce-quickstart.sh broken by 576834, no such file" [Critical,Triaged] | 18:34 |
| * myoung makes a note in https://trello.com/c/bLWnZcWq/781-ci-job-create-libvirt-reproducer-ci-job, which was punted from last sprint and looks at the bug | 18:35 | |
| *** rlandy is now known as rlandy|afk | 18:41 | |
| rlandy|afk | going to do airport pickup - back later | 18:42 |
| weshay|ruck | myoung, why are you reverting the change twice? | 18:51 |
| myoung | weshay|ruck, panda|bike, trown, sshnaidm, rlandy|afk: https://review.openstack.org/#/c/578520 | 18:51 |
| myoung | weshay|ruck: I didn't see your revert, sorry. | 18:52 |
| hubbot | FAILING CHECK JOBS on master: openstack-tox-linters @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 18:52 |
| myoung | disregard | 18:52 |
| sshnaidm | weshay|ruck, myoung let's not revert, but fix it | 18:53 |
| sshnaidm | weshay|ruck, myoung I don't see a point to revert the whole change instead of small fix | 18:53 |
| *** atoth has joined #oooq | 18:54 | |
| *** holser_ has quit IRC | 18:55 | |
| myoung | I think a revert is cleaner w.r.t. git history - patch broke this is an ungated dependency...IMHO step 1: revert patch, return to known state. step 2: repost updated patch. step 3: profit and have clear git history. I've updated the revert commit message with link to bug. | 18:59 |
| myoung | ^^ just my opinion | 19:00 |
| trown | revert is very heavy handed for a very simple fix | 19:03 |
| trown | I am posting said simple fix | 19:03 |
| trown | https://review.openstack.org/578530 is the only thing that is truly broken... will put up a second patch to tqe to change the script name | 19:05 |
| trown | and the rename https://review.openstack.org/578533 | 19:10 |
| myoung | sshnaidm, trown: "the point" is to have clarity and to go from a known-good state to known good state, particularly for ungated dependencies. Until we address https://trello.com/c/bLWnZcWq/781-ci-job-create-libvirt-reproducer-ci-job, it's risky. Yes a revert is heavy handed, but predictable. patch broke thing. revert patch. What if there's another small thing that we missed as part of a well intentioned review? What if there's another | 19:17 |
| myoung | mole after this one? Will we remember all of these small things a year from now? We can iterate and fix...that works too. And I understand the desire to not re-review a massive patch. {shrug} | 19:17 |
| * myoung turns his talker off and look at the patches/fixes. | 19:17 | |
| trown | fix is literally one line | 19:18 |
| trown | not reverting a huge patch for one line | 19:18 |
| myoung | i know. i'm disabling my pedantic OCD unit. | 19:18 |
| trown | I had that logs dir in my snapshot | 19:18 |
| sshnaidm | myoung, you're right, but this fix is really trivial | 19:19 |
| sshnaidm | it's good reminder tough that we need to test reproducer on every patch.. | 19:19 |
| trown | sshnaidm: can you look at https://review.openstack.org/578533 too... name of the script is also important | 19:20 |
| sshnaidm | trown, yep, thanks | 19:21 |
| weshay|ruck | https://review.openstack.org/#/c/576858/6/zuul.d/multinode-jobs.yaml | 19:45 |
| weshay|ruck | needs review | 19:45 |
| weshay|ruck | https://review.openstack.org/#/c/576957/2/zuul.d/multinode-jobs.yaml | 19:46 |
| *** yolanda_ has quit IRC | 20:43 | |
| *** yolanda_ has joined #oooq | 20:44 | |
| hubbot | FAILING CHECK JOBS on master: openstack-tox-linters @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 20:52 |
| *** yolanda has joined #oooq | 20:53 | |
| *** yolanda_ has quit IRC | 20:55 | |
| *** trown is now known as trown|outtypewww | 20:55 | |
| *** yolanda_ has joined #oooq | 20:59 | |
| *** yolanda has quit IRC | 21:02 | |
| *** jtomasek has quit IRC | 21:03 | |
| *** sanjay__u has joined #oooq | 21:34 | |
| *** jtomasek has joined #oooq | 21:36 | |
| *** myoung is now known as myoung|pto | 21:41 | |
| *** agopi has quit IRC | 21:43 | |
| *** rlandy|afk is now known as rlandy | 22:15 | |
| *** agopi has joined #oooq | 22:17 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, master: openstack-tox-linters @ https://review.openstack.org/560445 | 22:52 |
| *** jjoyce|gone has joined #oooq | 23:06 | |
| *** jjoyce has quit IRC | 23:08 | |
| *** jjoyce has joined #oooq | 23:08 | |
| *** jjoyce|gone has quit IRC | 23:09 | |
| *** yolanda__ has joined #oooq | 23:11 | |
| *** yolanda_ has quit IRC | 23:15 | |
| *** yolanda__ has quit IRC | 23:18 | |
| *** yolanda has joined #oooq | 23:20 | |
| *** yolanda_ has joined #oooq | 23:21 | |
| *** yolanda has quit IRC | 23:24 | |
| *** yolanda__ has joined #oooq | 23:25 | |
| *** yolanda_ has quit IRC | 23:29 | |
| *** yolanda has joined #oooq | 23:29 | |
| *** yolanda__ has quit IRC | 23:31 | |
| *** tosky has quit IRC | 23:35 | |
| *** brault has quit IRC | 23:54 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!