| *** rlandy is now known as rlandy|afk | 00:13 | |
| rook | weshay|ruck: not ignoring! | 00:20 |
|---|---|---|
| rook | rlandy|afk weshay|ruck we should also talk about VMBC :) | 00:21 |
| rook | and how we could look to use some of our executors to deploy a large virt cloud for regular scale testing of ooo | 00:21 |
| rook | ok, back to ignoring. | 00:21 |
| rook | :P | 00:21 |
| rook | I will be up in westford next week myoung|off beers. | 00:22 |
| *** gkadam has quit IRC | 00:23 | |
| weshay|ruck | :) | 00:24 |
| EmilienM | rlandy|afk: I hope I answered enough | 00:34 |
| EmilienM | weshay|ruck: I'll be online this evening just FYI I'll keep track on things so no worries | 00:34 |
| EmilienM | I'm preparing an email for the list now | 00:35 |
| weshay|ruck | yup yup.. 2 cold | 00:35 |
| EmilienM | weshay|ruck: so we don't have a launchpad? can we have one quickly? | 00:36 |
| EmilienM | weshay|ruck: for history | 00:36 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 00:41 |
| rlandy|afk | EmilienM: yes - thanks | 01:09 |
| *** rlandy|afk is now known as rlandy | 01:10 | |
| *** pliu_ has joined #oooq | 01:11 | |
| weshay|ruck | myoung|off, ^ | 01:24 |
| weshay|ruck | myoung|off, please make sure we get the sprint status out to EmilienM | 01:24 |
| weshay|ruck | er.. openstack-dev | 01:25 |
| weshay|ruck | EmilienM, you want a bug for the containers work we just did? | 01:25 |
| weshay|ruck | ya | 01:25 |
| weshay|ruck | ? | 01:25 |
| weshay|ruck | EmilienM, I have to go clean some trash cans, will write it up in a bit | 01:26 |
| EmilienM | weshay|ruck: please | 01:26 |
| weshay|ruck | yup yup.. word to your motha | 01:26 |
| rlandy | rook: hi- we can chat tomorrow. we have an example review | 01:34 |
| *** rlandy has quit IRC | 01:35 | |
| *** brault has joined #oooq | 02:36 | |
| *** brault has quit IRC | 02:41 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 02:41 |
| *** skramaja has joined #oooq | 03:43 | |
| *** udesale has joined #oooq | 03:56 | |
| *** ykarel|away has joined #oooq | 04:16 | |
| *** ykarel|away is now known as ykarel | 04:16 | |
| *** agopi has quit IRC | 04:31 | |
| *** saneax has joined #oooq | 04:35 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 04:41 |
| *** links has joined #oooq | 05:00 | |
| *** marios has quit IRC | 05:25 | |
| *** marios has joined #oooq | 05:25 | |
| *** leifmadsen has quit IRC | 05:27 | |
| *** leifmadsen has joined #oooq | 05:28 | |
| *** ratailor has joined #oooq | 05:36 | |
| *** jaosorior has quit IRC | 05:41 | |
| *** quiquell|off is now known as quiquell|rover | 05:45 | |
| quiquell|rover | chandankumar: Thanks for the video | 05:46 |
| quiquell|rover | arxcruz: Beer is waiting for you | 05:46 |
| *** anande has joined #oooq | 06:07 | |
| *** jaganathan has joined #oooq | 06:11 | |
| *** kopecmartin has joined #oooq | 06:20 | |
| *** bogdando has joined #oooq | 06:24 | |
| *** saneax has quit IRC | 06:27 | |
| *** sanjayu_ has joined #oooq | 06:27 | |
| *** sanjayu__ has joined #oooq | 06:30 | |
| *** sanjayu_ has quit IRC | 06:33 | |
| *** sanjayu_ has joined #oooq | 06:33 | |
| *** sanjayu__ has quit IRC | 06:34 | |
| *** sanjayu__ has joined #oooq | 06:34 | |
| *** sanjayu_ has quit IRC | 06:34 | |
| *** sanjayu_ has joined #oooq | 06:35 | |
| *** sanjayu__ has quit IRC | 06:39 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 06:42 |
| *** brault has joined #oooq | 06:44 | |
| *** quiquell|rover is now known as quiquell|rover|a | 06:45 | |
| *** quiquell|rover|a is now known as quique|rover|afk | 06:46 | |
| *** ccamacho has joined #oooq | 06:54 | |
| *** quique|rover|afk is now known as quiquell|rover | 07:05 | |
| *** amoralej|off is now known as amoralej | 07:12 | |
| *** tesseract has joined #oooq | 07:16 | |
| sshnaidm | quiquell|rover, hola | 07:18 |
| sshnaidm | quiquell|rover, made some graphs yesterday, but got stuck on promotion.. | 07:19 |
| *** gkadam has joined #oooq | 07:22 | |
| quiquell|rover | sshnaidm: Good morning sir, checking, I have make alerts into groups | 07:24 |
| quiquell|rover | sshnaidm: Let's use a pie for the CI stats | 07:24 |
| quiquell|rover | sshnaidm: Let me know whatever problem you have with promotions | 07:25 |
| quiquell|rover | sshnaidm: btw, what are the problems here ? https://review.openstack.org/#/c/572736/ | 07:25 |
| sshnaidm | quiquell|rover, well. as you see in test patches, gating repo is not installed | 07:27 |
| sshnaidm | quiquell|rover, I doubt I understand well problem we try to solve in this patch | 07:27 |
| quiquell|rover | sshnaidm: Damn, I am sure I checked it was installing | 07:27 |
| sshnaidm | quiquell|rover, can you please elaborate why we need this? | 07:28 |
| quiquell|rover | sshnaidm: Mainly n -> n + 1 | 07:28 |
| quiquell|rover | change in queens and test queens -> master | 07:28 |
| sshnaidm | quiquell|rover, yeah, but what a problem to have one repo? | 07:28 |
| quiquell|rover | sshnaidm: What we have now is change in queens and pike -> queens | 07:28 |
| quiquell|rover | sshnaidm: bj ? is gonig to be easier | 07:29 |
| sshnaidm | quiquell|rover, yep | 07:29 |
| sshnaidm | https://bluejeans.com/u/sshnaidm/ | 07:30 |
| *** kopecmartin has quit IRC | 07:30 | |
| *** tosky has joined #oooq | 07:37 | |
| *** kopecmartin has joined #oooq | 07:41 | |
| *** zoli is now known as zoli|wfh | 07:43 | |
| *** zoli|wfh is now known as zoli | 07:43 | |
| *** holser__ has joined #oooq | 07:59 | |
| *** florianf has joined #oooq | 08:00 | |
| *** anande has quit IRC | 08:02 | |
| quiquell|rover | sshnaidm: https://review.openstack.org/575360 | 08:10 |
| sshnaidm | quiquell|rover, great, which job should we look at? | 08:11 |
| quiquell|rover | sshnaidm: We need a change to tripleo-common on queens that depends on this | 08:12 |
| quiquell|rover | sshnaidm: So we can inspect the injection at upgrade in n -> n + 1 | 08:12 |
| quiquell|rover | sshnaidm: Only queens->master is supported | 08:13 |
| quiquell|rover | ykarel: Do you have some state on https://bugs.launchpad.net/tripleo/+bug/1776596? | 08:14 |
| openstack | Launchpad bug 1776596 in tripleo "[QUEENS] Promotion Jobs failing at overcloud deployment with AttributeError: 'IronicNodeState' object has no attribute 'failed_builds'" [Critical,Triaged] - Assigned to yatin (yatinkarel) | 08:14 |
| sshnaidm | quiquell|rover, I have one here: https://review.openstack.org/#/c/575244/ | 08:14 |
| ykarel | quiquell|rover, waiting for https://review.openstack.org/#/c/574997/ | 08:14 |
| quiquell|rover | sshnaidm: Add a Depends-On the other | 08:14 |
| quiquell|rover | sshnaidm: So we can inspect the from-release-upgrades job | 08:14 |
| ykarel | quiquell|rover, in case ^^ not merged, we can get Temp patch for nova https://review.rdoproject.org/r/#/c/14226/ | 08:15 |
| quiquell|rover | ykarel: ack | 08:17 |
| *** hamzy_ has joined #oooq | 08:18 | |
| *** ykarel is now known as ykarel|lunch | 08:19 | |
| *** hamzy has quit IRC | 08:20 | |
| *** anande has joined #oooq | 08:26 | |
| quiquell|rover | sshnaidm: Check r&r dashboard now, couldn't help it ;-) | 08:30 |
| quiquell|rover | arxcruz: You there ? | 08:31 |
| sshnaidm | quiquell|rover, you installed plugin! it's cheating :D | 08:31 |
| sshnaidm | quiquell|rover, that was something I wanted to talk today in #rdo.. if we can install plugins etc | 08:32 |
| quiquell|rover | sshnaidm: That's a question we have to ask if we can install plugins | 08:32 |
| sshnaidm | yeah | 08:32 |
| quiquell|rover | It's official grana plugin though | 08:32 |
| sshnaidm | quiquell|rover, yeah, I hope we can | 08:32 |
| arxcruz | quiquell|rover: hey | 08:36 |
| quiquell|rover | arxcruz: Good morning, do you have some brain cycles to sync ? | 08:36 |
| arxcruz | quiquell|rover: sure | 08:37 |
| quiquell|rover | arxcruz: https://bluejeans.com/7891065232 | 08:38 |
| arxcruz | quiquell|rover: give me 3 minutes, grab a coffee | 08:38 |
| quiquell|rover | arxcruz: sure | 08:39 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 08:42 |
| panda | oh man, a normal internet connection again | 09:00 |
| arxcruz | ykarel|lunch: https://bugs.launchpad.net/tripleo/+bug/1776596 fixed right ? | 09:03 |
| openstack | Launchpad bug 1776596 in tripleo "[QUEENS] Promotion Jobs failing at overcloud deployment with AttributeError: 'IronicNodeState' object has no attribute 'failed_builds'" [Critical,Triaged] - Assigned to yatin (yatinkarel) | 09:03 |
| ykarel|lunch | arxcruz, we need https://review.openstack.org/#/c/574997/ | 09:09 |
| *** ykarel|lunch is now known as ykarel | 09:09 | |
| arxcruz | quiquell|rover: ^ | 09:10 |
| *** jaosorior has joined #oooq | 09:15 | |
| *** anande has quit IRC | 09:21 | |
| *** anande has joined #oooq | 09:24 | |
| *** udesale_ has joined #oooq | 09:30 | |
| *** ratailor_ has joined #oooq | 09:30 | |
| *** gkadam_ has joined #oooq | 09:30 | |
| *** chkumar246 has joined #oooq | 09:30 | |
| *** dtantsur|afk is now known as dtantsur | 09:31 | |
| rasca | hey folks, I'm wondering why I'm consistently failing in RDO checks on https://review.openstack.org/#/c/553465/ link to the gate jobs is broken, what does this mean? | 09:32 |
| *** links has quit IRC | 09:33 | |
| *** ratailor has quit IRC | 09:33 | |
| *** links has joined #oooq | 09:33 | |
| *** gkadam__ has joined #oooq | 09:33 | |
| *** chandankumar has quit IRC | 09:33 | |
| *** udesale__ has joined #oooq | 09:33 | |
| *** ratailor__ has joined #oooq | 09:33 | |
| *** gkadam has quit IRC | 09:34 | |
| *** udesale has quit IRC | 09:34 | |
| *** chkumar246 has quit IRC | 09:35 | |
| *** ratailor_ has quit IRC | 09:36 | |
| *** gkadam_ has quit IRC | 09:36 | |
| *** udesale_ has quit IRC | 09:36 | |
| *** chandankumar has joined #oooq | 09:39 | |
| panda | rasca: https://ci.centos.org/job/tripleo-quickstart-gate-master-delorean-quick-basic/5968/console | 09:48 |
| panda | rasca: looks like there is some error during logs collection, and the logs are not ther, but the link is always statically generated | 09:49 |
| panda | quiquell|rover: ^ | 09:49 |
| quiquell|rover | ykarel: Your temp patch for queens promotion, merged let's see if we have a promotion, | 09:50 |
| ykarel | quiquell|rover, yeah we need the rpm for it https://trunk.rdoproject.org/centos7-queens/report.html | 09:51 |
| ykarel | should be there in few minutes | 09:51 |
| quiquell|rover | ykarel: so we have to wait for delorean and then for the periodic jobs | 09:51 |
| ykarel | quiquell|rover, yes next periodic run is in around 2.5 hours | 09:51 |
| ykarel | delorean should be ready in few minutes | 09:52 |
| *** bogdando has quit IRC | 09:52 | |
| quiquell|rover | ykarel: ack | 09:52 |
| ykarel | quiquell|rover, are u looking into fs20 master issue | 10:09 |
| quiquell|rover | arxcruz: Why is this https://bugs.launchpad.net/tripleo/+bug/1773179 a promotion blocker ? | 10:10 |
| openstack | Launchpad bug 1773179 in tripleo "Undercloud upgrades fails in ocata because nova service failure" [High,Triaged] - Assigned to Ronelle Landy (rlandy) | 10:10 |
| *** skramaja_ has joined #oooq | 10:11 | |
| quiquell|rover | arxcruz: ocata has promoted at tripleo ci | 10:12 |
| *** skramaja has quit IRC | 10:12 | |
| rasca | quiquell|rover, so the error seems to be: | 10:12 |
| rasca | 06:45:51 quickstart.sh: line 496: [: missing `]' | 10:12 |
| rasca | 06:45:51 + '[' '' = 1 ']' | 10:12 |
| rasca | 06:45:51 + VERBOSITY=vv | 10:12 |
| quiquell|rover | rasca this is for me ? | 10:12 |
| rasca | quiquell|rover, yes sir, look at the ping by panda above | 10:13 |
| quiquell|rover | rasca: sorry I missed it | 10:13 |
| panda | rasca: quiquell|rover I also saw ssh fingerprint errors in the botton of the console | 10:14 |
| quiquell|rover | panda: Do you know here are configured the links to the "RedHat RDO CI" of the reviews ? | 10:28 |
| panda | quiquell|rover: in repo rdo-infra/ci-config I think | 10:28 |
| panda | quiquell|rover: but it seems, that the link are not the problem, if the log collection fails, the link are just pointing to something non existing. | 10:29 |
| quiquell|rover | panda: the link it worngs, the artifacts exists | 10:29 |
| quiquell|rover | panda: https://ci.centos.org/job/tripleo-quickstart-gate-master-delorean-quick-basic/5968/artifact/ | 10:29 |
| quiquell|rover | panda: the problem is the link linking to https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-gate-master-delorean-quick-basic-5968/ | 10:30 |
| panda | quiquell|rover: oh, so the destination changed | 10:30 |
| quiquell|rover | panda: Yep | 10:30 |
| panda | quiquell|rover: https://github.com/rdo-infra/ci-config/blob/master/jenkins/jobs/tripleo-quickstart-triggers.yml#L56 | 10:34 |
| panda | quiquell|rover: there's a bunch of line like this. and BUILD_TAG in jenkins is $JOB_NAME-$BUILD_ID | 10:35 |
| quiquell|rover | panda: Yep found it too | 10:40 |
| quiquell|rover | $JOB_NAME/$BUILD_ID is needed instead | 10:41 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 10:42 |
| quiquell|rover | panda, rasca: to correct the gerrit link https://review.rdoproject.org/r/#/c/14229/ | 10:50 |
| *** dtantsur is now known as dtantsur|brb | 10:50 | |
| *** anande has quit IRC | 10:55 | |
| *** anande has joined #oooq | 10:56 | |
| quiquell|rover | panda: UNREACHABLE! => {"changed": false, "msg": "Failed to connect to the host via ssh: | 11:04 |
| quiquell|rover | panda: Could be beacuse the previous ansible inventory is there ? | 11:04 |
| panda | quiquell|rover: which previous ? apparently the playbook can't reach the undercloud anymore, meybe we're release the resource too soon ? | 11:06 |
| panda | quiquell|rover: ah no, the cico done command, is after this | 11:06 |
| quiquell|rover | panda: The error of missing ] if something regarding --dry-run | 11:07 |
| *** zoli is now known as zoli|lunch | 11:09 | |
| *** anande is now known as anande|brb | 11:20 | |
| quiquell|rover | panda: Have a fix | 11:28 |
| quiquell|rover | panda: Looks like is not cleaning up the ansible inventory | 11:28 |
| *** anande|brb has quit IRC | 11:28 | |
| quiquell|rover | rasca, panda: https://review.openstack.org/575407 | 11:28 |
| quiquell|rover | rasca: Try to run your review with this fix | 11:29 |
| *** sanjayu__ has joined #oooq | 11:29 | |
| *** ykarel_ has joined #oooq | 11:31 | |
| *** sanjayu_ has quit IRC | 11:32 | |
| *** ykarel has quit IRC | 11:34 | |
| *** ykarel_ is now known as ykarel | 11:34 | |
| *** udesale_ has joined #oooq | 11:42 | |
| *** udesale__ has quit IRC | 11:45 | |
| *** dtantsur|brb is now known as dtantsur | 11:46 | |
| *** anande|brb has joined #oooq | 11:47 | |
| *** udesale_ has quit IRC | 11:48 | |
| *** rlandy has joined #oooq | 12:01 | |
| quiquell|rover | ykarel: https://review.openstack.org/#/c/574997/ in the gates | 12:03 |
| *** amoralej is now known as amoralej|lunch | 12:03 | |
| *** atoth has joined #oooq | 12:04 | |
| ykarel | quiquell|rover, yes i saw i have revert temp patch in progress | 12:04 |
| ykarel | as soon as promotion job starts, i will get that merged | 12:04 |
| *** anande|brb is now known as anande | 12:04 | |
| quiquell|rover | ykarel: Cool | 12:04 |
| *** ratailor__ has quit IRC | 12:05 | |
| quiquell|rover | rlandy: Good morning, question, looking at previous RR etherpad | 12:05 |
| quiquell|rover | rlandy: Don't know why https://bugs.launchpad.net/tripleo/+bug/1773179 is a promotion blocker | 12:06 |
| openstack | Launchpad bug 1773179 in tripleo "Undercloud upgrades fails in ocata because nova service failure" [High,Triaged] - Assigned to Ronelle Landy (rlandy) | 12:06 |
| rlandy | looking | 12:08 |
| rlandy | quiquell|rover: I think we inherited from the previous ruck/rover rotations | 12:09 |
| rlandy | it's not a promotion blocker though | 12:10 |
| quiquell|rover | rlandy: Will remove it then, move it to LP | 12:10 |
| rlandy | quiquell|rover: ci upgrade are the only tags I see | 12:10 |
| rlandy | no promotion blocker | 12:10 |
| quiquell|rover | rlandy: Yep that's what didn't make sense | 12:11 |
| weshay|ruck | quiquell|rover, morning | 12:11 |
| rlandy | quiquell|rover: we should check if this is still a problem | 12:11 |
| quiquell|rover | weshay|ruck: Good morning sir | 12:12 |
| quiquell|rover | rlandy: Will do | 12:12 |
| rlandy | quiquell|rover: if so, we should assign an owner other than ruck/rover | 12:12 |
| quiquell|rover | weshay|ruck: queens blocker is in the way thanks to ykarel | 12:12 |
| weshay|ruck | beautiful, thanks ykarel | 12:12 |
| quiquell|rover | weshay|ruck: I am checking master phase 1 now | 12:13 |
| ykarel | quiquell|rover, for master phase 1, i created cards and proposed patches | 12:13 |
| ykarel | so please check those first | 12:14 |
| quiquell|rover | ykarel: I saw but tripleo-quickstart-promote-master-current-tripleo-delorean-minimal is failing too | 12:14 |
| quiquell|rover | ykarel: not only weirdo | 12:14 |
| ykarel | quiquell|rover, in master? | 12:14 |
| quiquell|rover | ykarel: yep | 12:14 |
| ykarel | quiquell|rover, i can see that passing, can you share the link? | 12:15 |
| quiquell|rover | ykarel: Humm wait it's ok, forget about it | 12:15 |
| quiquell|rover | ykarel: Following old link | 12:15 |
| ykarel | quiquell|rover, ack | 12:16 |
| ykarel | quiquell|rover, in ocata -minimal failed | 12:16 |
| ykarel | phase 1 | 12:16 |
| weshay|ruck | arxcruz, chandankumar all the object storage tests failing in tempest.. I have a storage devel on the box | 12:17 |
| weshay|ruck | but he's not very comfortable w/ tempest | 12:17 |
| weshay|ruck | arxcruz, chandankumar either have a few.. background is | 12:17 |
| weshay|ruck | https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/66bb1bf/tempest.html.gz | 12:17 |
| quiquell|rover | weshay|ruck: etherpad https://review.rdoproject.org/etherpad/p/ruckrover-sprint15 | 12:18 |
| arxcruz | weshay|ruck: do you have? let me take a look | 12:18 |
| *** anande has quit IRC | 12:18 | |
| *** anande has joined #oooq | 12:18 | |
| quiquell|rover | sshnaidm: Have a question about sova | 12:18 |
| quiquell|rover | sshnaidm: Do you have a minute ? | 12:18 |
| sshnaidm | quiquell|rover, yep | 12:18 |
| quiquell|rover | sshnaidm: Checking this http://cistatus.tripleo.org/phase1/ | 12:19 |
| quiquell|rover | sshnaidm: Says that tripleo-quickstart-promote-master-current-tripleo-delorean-minimal | 12:20 |
| quiquell|rover | sshnaidm: Has failures, but the jenkins build is green | 12:20 |
| quiquell|rover | sshnaidm: Don't know if we have something bad at jenkins or sova | 12:20 |
| sshnaidm | quiquell|rover, seems like script doesn't find the defined patterns for success, there is unclear from logs (as we don't use jenkins) | 12:22 |
| sshnaidm | quiquell|rover, need to add something to job to identify success in logs | 12:22 |
| rlandy | quiquell|rover: I am still holding some bugs which maybe we should transfer. Most of the ones I am holding is because the patches are still in flight | 12:23 |
| quiquell|rover | sshnaidm: ok, false negative will forget about it | 12:23 |
| sshnaidm | quiquell|rover, yeah, jenkins is source of truth here.. | 12:23 |
| quiquell|rover | rlandy: Let's sync after lunch | 12:24 |
| quiquell|rover | sshnaidm: found the api/builds for DDO | 12:24 |
| quiquell|rover | sshnaidm: You can integrate it in sova | 12:24 |
| sshnaidm | quiquell|rover, DDO? | 12:24 |
| quiquell|rover | s/DDO/RDO/g | 12:24 |
| quiquell|rover | sshnaidm: https://review.rdoproject.org/manage/v2/builds/ | 12:25 |
| quiquell|rover | sshnaidm: API for jobs at RDO | 12:25 |
| weshay|ruck | apetrich, be w/ you in 5min :) | 12:26 |
| *** quiquell|rover is now known as quiquell|lunch | 12:26 | |
| sshnaidm | quiquell|rover, oh, this is great | 12:26 |
| quiquell|lunch | sshnaidm: | 12:26 |
| apetrich | weshay|ruck, cool. I'm ready just ping | 12:26 |
| quiquell|lunch | sshnaidm: check job_builds_rdo.py at ruck rover dashboard | 12:26 |
| sshnaidm | quiquell|lunch, ok | 12:26 |
| *** trown|outtypewww is now known as trown | 12:27 | |
| quiquell|lunch | sshnaidm: getting the list of jobs from there is slow, i put a hack to download them from git | 12:27 |
| quiquell|lunch | sshnaidm: Maybe you can do the same to get promoter jobs from git too | 12:27 |
| quiquell|lunch | sshnaidm: To make sova always updated with promotion jobs | 12:27 |
| sshnaidm | quiquell|lunch, yeah, we need to, because we need to apply promotion criteria too | 12:27 |
| quiquell|lunch | sshnaidm: It's a matter of getting raw data from github and do a ConfigParser | 12:28 |
| sshnaidm | quiquell|lunch, yeah | 12:28 |
| quiquell|lunch | sshnaidm: Now I go for lunch | 12:28 |
| sshnaidm | quiquell|lunch, enjoy it :) | 12:28 |
| quiquell|lunch | sshnaidm, rlandy, weshay|ruck, panda: some love here ? https://review.openstack.org/#/c/575407/ | 12:28 |
| weshay|ruck | apetrich, ready | 12:30 |
| weshay|ruck | quiquell|lunch, hrm.. why is ci.centos check failing | 12:31 |
| apetrich | weshay|ruck, joining | 12:31 |
| quiquell|lunch | weshay|ruck: collect log issues at ssh | 12:31 |
| quiquell|lunch | weshay|ruck: Have to check if the review I have just paste fix it | 12:32 |
| quiquell|lunch | weshay|ruck: Silly me, it's failing again... | 12:32 |
| quiquell|lunch | weshay|ruck: also fix for the gerrit review broken links https://review.rdoproject.org/r/#/c/14229/ | 12:33 |
| quiquell|lunch | and NOW i go for lunch | 12:34 |
| rlandy | weshay|ruck: wrt bm discussion yesterday, I asked Emilien how come tripleoclient does not fail ... "EmilienM> they were templates, heat converted them into a yaml" so I think we are ok | 12:34 |
| rlandy | <EmilienM> and it's generated | 12:35 |
| rlandy | <EmilienM> the user doesn't feed it | 12:35 |
| rlandy | so I left those files in | 12:35 |
| *** zoli|lunch is now known as zoli|wfh | 12:35 | |
| *** zoli|wfh is now known as zoli | 12:35 | |
| *** myoung|off is now known as myoung | 12:36 | |
| rlandy | weshay|ruck: also - I changed the poc job names - they were too long and failing build | 12:37 |
| myoung | rook: re: westford next week...awesome! | 12:37 |
| myoung | weshay|ruck, EmilienM: re sprint 14 status for the list, I'm targeting tomorrow for that, can move up to today if needed. We had retrospective yesterday and still a number of patches working thru CI trailing today, will have better report out tomorrow. pls advise | 12:38 |
| rlandy | quiquell|lunch; downstream tenant is full - will take you through the volume situation when we meet | 12:40 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 12:42 |
| rasca | weshay|ruck, rlandy, hey folks, do you have time to clarify the status around https://review.openstack.org/#/c/574894/ and mine here https://review.openstack.org/#/c/553465/ ? | 12:52 |
| *** quiquell|lunch is now known as quiquell | 12:52 | |
| *** quiquell is now known as quiquell|rover | 12:52 | |
| quiquell|rover | rlandy: Will add an alert on that | 12:53 |
| weshay|ruck | rasca, ya.. rlandy and I are moving this forward and mentioned getting your patch merged on top of hers | 12:53 |
| rlandy | rasca: what weshay|ruck said - left your review | 12:54 |
| rlandy | rasca: going forward with this and https://code.engineering.redhat.com/gerrit/#/c/141378/ | 12:54 |
| *** florianf has quit IRC | 12:55 | |
| quiquell|rover | rlandy: Ping me when you are free to do some sync | 12:55 |
| rlandy | rasca: I am sending out an email but we can talk about converting your configs to do the same | 12:55 |
| rlandy | I add a jjb change | 12:55 |
| rlandy | but you have different jjb | 12:55 |
| rlandy | so you should not be impacted | 12:56 |
| rasca | rlandy, my configs already does the same | 12:56 |
| rasca | rlandy, at least from what I can see from codereview | 12:56 |
| rlandy | rasca: uses featureset001? | 12:56 |
| rasca | rlandy, that is the main reason why I'm trying to understand why we need baremetal topologies | 12:56 |
| rasca | rlandy, no, I'm just seeing for example https://code.engineering.redhat.com/gerrit/#/c/141378/7/hardware_environments/dell_fc430_envB/network_configs/single_nic_vlans/env_settings.yml and my env is quite the same | 12:57 |
| rlandy | rasca: ok good | 12:57 |
| rasca | (except I have static net env files) | 12:57 |
| myoung | o/ GOOD THURSDAY MORNING / AFTERNOON! Sprint 15 planning starts in 180 sec :) | 12:57 |
| rlandy | these env_settings file includes overrides for fs001 | 12:58 |
| panda | myoung: you made me deaf | 12:58 |
| rasca | rlandy, I never used any featureset | 12:58 |
| rasca | rlandy, that is the main reason why I'm not following this I think | 12:58 |
| rlandy | quiquell|rover: after meeting? | 12:58 |
| *** florianf has joined #oooq | 12:58 | |
| rlandy | rasca: ok - I can explain after our planning meeting | 12:58 |
| rasca | rlandy, sure, no worries | 12:59 |
| rlandy | we want to make bm run like upstream | 12:59 |
| myoung | panda: hehehe | 12:59 |
| rlandy | that is the point of going to featuresets | 12:59 |
| rasca | rlandy, sure | 12:59 |
| rlandy | will ping you after the planning meeting | 12:59 |
| rasca | rlandy, thanks | 12:59 |
| quiquell|rover | rlandy: Have to do some paperwork today, we can sync tomorrow | 13:00 |
| rlandy | sure | 13:00 |
| quiquell|rover | rlandy: cool thanks | 13:00 |
| *** sanjayu_ has joined #oooq | 13:01 | |
| *** brault has quit IRC | 13:02 | |
| *** brault has joined #oooq | 13:04 | |
| *** sanjayu__ has quit IRC | 13:04 | |
| quiquell|rover | rasca: Do you know how to make tripleo-quickstart-gate-master-delorean-quick-basic take my chganges at quickstart.sh ? | 13:14 |
| rasca | quiquell|rover, I was about to ask you | 13:15 |
| quiquell|rover | rasca: Have add some paranoic checks and they don't appear... | 13:15 |
| rasca | quiquell|rover, you need to start from the beginning with me man, they don't appear where? | 13:17 |
| *** holser__ has quit IRC | 13:18 | |
| *** holser___ has joined #oooq | 13:18 | |
| quiquell|rover | rasca: Change to quickstart.sh to fix your problem does not get at job executions | 13:18 |
| quiquell|rover | rasca: Have to learn what this job does | 13:18 |
| *** holser___ has quit IRC | 13:19 | |
| *** holser__ has joined #oooq | 13:20 | |
| *** Goneri has joined #oooq | 13:21 | |
| rasca | quiquell|rover, sorry, but I'm not following. We have all the RedHat RDO CI gates that are failing, reason seems to be what you fixed here https://review.openstack.org/#/c/575407/ but gates are failing also here, so what I am missing? | 13:21 |
| quiquell|rover | rasca: The change doesn't get apply to the running jobs | 13:22 |
| quiquell|rover | rasca: Looks like it's using master HEAD instead of gerrit REFSPEC | 13:22 |
| quiquell|rover | rasca: But have to figure out how the job works | 13:22 |
| rasca | quiquell|rover, uhm that's interesting, it makes no sense, is it? If you need some support I can help | 13:23 |
| quiquell|rover | rasca: Check my last patchset, it's just some paranoic echo | 13:23 |
| quiquell|rover | rasca: And it doesn't appear in the last execution in the review | 13:23 |
| quiquell|rover | rasca: I am checking RDO ci-config to see how the job is configured | 13:24 |
| *** matbu has quit IRC | 13:24 | |
| quiquell|rover | rasca: ok, I think I know the problem, ws-cleanup is failing, so it doesn't run | 13:27 |
| quiquell|rover | rasca: that means that include-gate-changes.sh is not called | 13:27 |
| quiquell|rover | rasca: Just a mental construction | 13:27 |
| *** agopi has joined #oooq | 13:27 | |
| *** amoralej|lunch is now known as amoralej | 13:29 | |
| quiquell|rover | rasca: collect-logs.sh is not doing a source $CI_SCRIPT_DIR/include-gate-changes.sh | 13:29 |
| *** matbu has joined #oooq | 13:31 | |
| quiquell|rover | rasca: We have to discover why WS-CLEANUP is not working | 13:33 |
| rasca | quiquell|rover, java.io.IOException can be this some sort of problem with the machine that is running the job? | 13:33 |
| rasca | quiquell|rover, yesterday we needed to reboot some machines because of a full disk | 13:34 |
| quiquell|rover | rasca: They are chking at #rdo | 13:36 |
| *** florianf has quit IRC | 13:40 | |
| *** florianf has joined #oooq | 13:42 | |
| *** pliu_ has quit IRC | 13:45 | |
| *** bogdando has joined #oooq | 13:49 | |
| *** ccamacho has quit IRC | 13:51 | |
| *** anande has quit IRC | 13:54 | |
| *** brault has quit IRC | 14:03 | |
| *** brault has joined #oooq | 14:04 | |
| *** ykarel is now known as ykarel|away | 14:04 | |
| sshnaidm | quiquell|rover, the data in https://review.rdoproject.org/manage/v2/builds/ is from one year before :O | 14:04 |
| quiquell|rover | sshnaidm: You have to order them with 'order_by': 'start_time', 'desc': 'true'} | 14:07 |
| quiquell|rover | sshnaidm: The code is at software factory to understand the API | 14:07 |
| quiquell|rover | sshnaidm: Let me find it for you | 14:07 |
| panda | https://trello.com/c/THLXPAqw/806-migrate-rdo-sf-jobs-to-zuulv3 | 14:07 |
| quiquell|rover | rasca: Ocata phase1 promotion is failing for the same reason | 14:08 |
| quiquell|rover | rasca, ykarel|away: https://ci.centos.org/job/tripleo-quickstart-promote-ocata-rdo_trunk-minimal/ | 14:09 |
| *** skramaja_ has quit IRC | 14:10 | |
| ykarel|away | amoralej, ^^ | 14:10 |
| quiquell|rover | ykarel|away: I mean the tq problem not the jenkins problem | 14:13 |
| ykarel|away | quiquell|rover, what's the problem? background? | 14:14 |
| ykarel|away | i thought there is only jenkins/dns problem | 14:15 |
| *** links has quit IRC | 14:15 | |
| ykarel|away | quiquell|rover, you mean: ./quickstart.sh: line 496: [: missing `]' | 14:16 |
| quiquell|rover | ykarel|away: There were a problem in quickstart.sh at collect logs, but looks like the ocata issue is different | 14:17 |
| ykarel|away | quiquell|rover, i can see: The requested operation failed as no inventory is available, so a recheck could work | 14:18 |
| quiquell|rover | ykarel|away: This can be pecause is not cleaning up the ansible inventory | 14:18 |
| quiquell|rover | ykarel|away: This is the fix for that https://review.openstack.org/575407 | 14:19 |
| rook | rlandy: this afternoon? | 14:19 |
| rook | well, this afternoon being EST. | 14:19 |
| rook | not wes afternoon :) | 14:19 |
| rlandy | rook: sure | 14:20 |
| ykarel|away | quiquell|rover, i think it's different, it's talking about cico inventory here, | 14:20 |
| quiquell|rover | ykarel|away: 11:47:10 head: cannot open â/home/jenkins/workspace/tripleo-quickstart-promote-ocata-rdo_trunk-minimal/cico_key.txtâ for reading: No such file or directory | 14:21 |
| quiquell|rover | I see now | 14:21 |
| ykarel|away | quiquell|rover, may be this is side effect of not getting a node | 14:22 |
| quiquell|rover | ykarel|away: I see now 'The requested operation failed as no inventory is available.' | 14:22 |
| ykarel|away | yup | 14:23 |
| ykarel|away | Jenkins is going to shut down | 14:23 |
| ykarel|away | i see on ci.centos | 14:23 |
| ykarel|away | so after it restarts, we can retry that job | 14:23 |
| quiquell|rover | ykarel|away: Feels like they have issues with the jenkins slaves | 14:24 |
| quiquell|rover | ykarel|away: They need to restart some agents | 14:24 |
| ykarel|away | quiquell|rover, /me no idea | 14:25 |
| ykarel|away | you can ask amoralej jpena | 14:25 |
| quiquell|rover | ykarel|away: Have to leave now | 14:25 |
| quiquell|rover | Let's restart stuff after jenkins startuyp | 14:26 |
| ykarel|away | kk | 14:26 |
| *** quiquell|rover is now known as quiquell|off | 14:26 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 14:42 |
| *** dtrainor has joined #oooq | 14:42 | |
| *** hamzy_ is now known as hamzy | 14:44 | |
| *** sanjayu_ has quit IRC | 15:06 | |
| *** holser__ has quit IRC | 15:27 | |
| *** ykarel_ has joined #oooq | 15:31 | |
| *** ykarel|away has quit IRC | 15:34 | |
| weshay|ruck | rfolco, panda we need to meet tomorrow | 15:39 |
| weshay|ruck | re: these items | 15:39 |
| panda | tomorrow ? | 15:39 |
| weshay|ruck | panda, when would you like to? | 15:40 |
| panda | all nighter marathon for me | 15:40 |
| panda | :) | 15:40 |
| weshay|ruck | panda, not to be done.. | 15:40 |
| weshay|ruck | just to progress | 15:40 |
| weshay|ruck | panda, rfolco but you two should be focused on getting background on these | 15:41 |
| myoung | weshay|ruck, rfolco, panda: are you going to create the cards etc as part of that? | 15:41 |
| weshay|ruck | aye | 15:41 |
| myoung | k | 15:41 |
| *** quiquell|off is now known as quiquell|rover | 15:41 | |
| quiquell|rover | rlandy: We can sync now if you have time | 15:41 |
| weshay|ruck | quiquell|rover, nice job on the dashboard man | 15:41 |
| weshay|ruck | quiquell|rover, want to merge it? | 15:41 |
| quiquell|rover | weshay|ruck: sshnaidm what do you think about merging ? | 15:42 |
| rfolco | weshay|ruck, ack | 15:42 |
| quiquell|rover | weshay|ruck: Tomorrow morning have to continue with the paperwork | 15:42 |
| *** bogdando has quit IRC | 15:42 | |
| weshay|ruck | paperwork? | 15:42 |
| quiquell|rover | weshay|ruck: I wilÃl not be able to do rovering at my morning | 15:43 |
| quiquell|rover | weshay|ruck: Going to do some rovering now | 15:43 |
| quiquell|rover | instead | 15:43 |
| quiquell|rover | rasca: We have a success now in the jobs :-) | 15:44 |
| panda | where will this dashboard be merged ? can we do a demo ? | 15:45 |
| weshay|ruck | panda, it's in rdo sf | 15:45 |
| *** holser__ has joined #oooq | 15:45 | |
| weshay|ruck | panda, rfolco please work together closely over the next few days | 15:48 |
| rlandy | quiquell|rover: sure | 15:48 |
| quiquell|rover | rlandy: bj ? | 15:48 |
| rlandy | yep | 15:48 |
| panda | rfolco: can you send me your address? I can spend some day in Brasil if you have a couch for me. | 15:49 |
| weshay|ruck | myoung, patches from sbaker I was refering to https://review.openstack.org/#/q/topic:bp/container-prepare-workflow | 15:49 |
| rlandy | quiquell|rover: your bj? | 15:49 |
| quiquell|rover | rlandy: https://bluejeans.com/7891065232 | 15:50 |
| *** quiquell|rover has quit IRC | 15:51 | |
| *** quiquell has joined #oooq | 15:51 | |
| *** dtantsur is now known as dtantsur|afk | 15:51 | |
| *** sshnaidm has quit IRC | 15:55 | |
| myoung | weshay|ruck: ack, is thread on openstack-dev. | 16:01 |
| *** myoung is now known as myoung|lunch | 16:04 | |
| *** panda is now known as panda|off | 16:06 | |
| *** kopecmartin has quit IRC | 16:06 | |
| rasca | quiquell, haven't verified yet | 16:10 |
| rasca | rlandy, I need to drop in 10 minutes, do you think we can discuss? | 16:11 |
| quiquell | At least in the little fix of quickstart.sh they are passing | 16:11 |
| rlandy | rasca: yes | 16:11 |
| rasca | quiquell, https://review.openstack.org/#/c/553465/ I'm waiting for this | 16:11 |
| quiquell | rlandy: Assign to me any bug that you can pass from the previous RR season | 16:15 |
| rlandy | ok | 16:15 |
| rasca | rlandy, I need to go, will be back in 1hr | 16:18 |
| rlandy | rasca: ok | 16:18 |
| *** udesale has joined #oooq | 16:20 | |
| quiquell | rlandy: https://review.rdoproject.org/jenkins/job/periodic-tripleo-centos-7-master-containers-build/ is working again | 16:22 |
| quiquell | going to close https://bugs.launchpad.net/tripleo/+bug/1771634 | 16:22 |
| openstack | Launchpad bug 1771634 in tripleo "periodic: container build jobs are failing when pushing to rdo registry (500, 504, read timeout)" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 16:22 |
| weshay|ruck | arxcruz, fs17 / scen002 | 16:22 |
| *** matbu has quit IRC | 16:22 | |
| weshay|ruck | arxcruz, has swift | 16:22 |
| arxcruz | weshay|ruck: ack | 16:23 |
| rlandy | quiquell++ | 16:23 |
| hubbot | rlandy: quiquell's karma is now 2 | 16:23 |
| arxcruz | chandankumar: we want fs15 / scen002 running on python-tempestconf since it has swift | 16:23 |
| quiquell | rlandy: \o/ | 16:23 |
| arxcruz | since we are configuring swift, we should have a job with swift running | 16:23 |
| *** udesale has quit IRC | 16:28 | |
| rlandy | arxcruz: hello - are these settings still in use for tempest? https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/overcloud-deploy/defaults/main.yml#L25 | 16:31 |
| arxcruz | rlandy: checking | 16:32 |
| rlandy | and afaict, if they are, they should match public_net_pool_start: public_net_pool_end: public_net_gateway: | 16:32 |
| rlandy | arxcruz; ^^ I think that is what is used now | 16:32 |
| arxcruz | rlandy: nope | 16:32 |
| rlandy | arxcruz: nope - no longer in use? | 16:33 |
| arxcruz | no longer in use | 16:33 |
| rlandy | because I only see it in the defaults and no actually used anyway | 16:33 |
| rlandy | anywhere | 16:33 |
| rlandy | ok - thanks | 16:33 |
| weshay|ruck | quiquell, I need this addressed or handed off https://review.openstack.org/#/c/572736/ | 16:37 |
| *** brault has quit IRC | 16:38 | |
| chandankumar | arxcruz: yup | 16:38 |
| chandankumar | arxcruz: but we want a job which runs tempest from package not from containers | 16:38 |
| *** brault has joined #oooq | 16:39 | |
| *** sshnaidm has joined #oooq | 16:40 | |
| quiquell | weshay|ruck: ssbarnea took a look to it, looks like we are missing stuff in overcloud-prep-containers | 16:40 |
| quiquell | weshay|ruck: I mean sshnaidm | 16:40 |
| quiquell | weshay|ruck: We can replace other place with the correct gating_repo name and give it a spin | 16:41 |
| ssbarnea | ahh, i was reading the CR and trying to understand... ok. | 16:41 |
| quiquell | ssbarnea: weechat do a bad subtitution :-) | 16:42 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 16:42 |
| sshnaidm | quiquell, so which job should I look at regarding repos update? | 16:42 |
| ssbarnea | i use textual, and get the same issue quite often, especially when using only two chars. | 16:43 |
| quiquell | sshnaidm: Do you have your testing commit around ? | 16:43 |
| sshnaidm | quiquell, https://review.openstack.org/#/c/575242/ | 16:43 |
| weshay|ruck | quiquell, k.. cool thanks and fyi https://review.openstack.org/#/c/575492/ | 16:43 |
| *** brault has quit IRC | 16:44 | |
| quiquell | weshay|ruck: That's the missing parts, and think there is something in libvirt | 16:45 |
| weshay|ruck | k | 16:45 |
| quiquell | sshnaidm: This review just do a Depends-On the role, but we did one with a Depends-On to the new job and not to the role | 16:46 |
| quiquell | sshnaidm: To test how it fails | 16:46 |
| quiquell | weshay|ruck: When codesearch is up again will show you | 16:46 |
| sshnaidm | quiquell, not sure I understand.. | 16:46 |
| quiquell | sshnaidm: You want to see what happend if we do a n -> n + 1 without the change on the roles | 16:47 |
| sshnaidm | quiquell, yeah | 16:47 |
| quiquell | sshnaidm: So we create a review that pointed to the n -> n + 1 job but without the role | 16:47 |
| quiquell | sshnaidm: This is the job without the Depends-On https://review.openstack.org/#/c/575360/ | 16:48 |
| quiquell | sshnaidm: Let me find your review in the history | 16:48 |
| sshnaidm | quiquell, I you have job/reproducer logs anywhere, it'd be great | 16:48 |
| sshnaidm | quiquell, otherwise please guide me which exactly patch I need to do for reproducing this.. | 16:49 |
| quiquell | sshnaidm: Going to adapt yours wait | 16:49 |
| quiquell | sshnaidm: https://review.openstack.org/575242 now points to the new job | 16:53 |
| quiquell | sshnaidm: The job is tripleo-ci-centos-7-containerized-undercloud-from-release-upgrades | 16:53 |
| sshnaidm | quiquell, cool, thanks | 16:54 |
| sshnaidm | quiquell, btw, removing cacheable from "compressed_gating_repo" could be also an option.. and much less work | 16:54 |
| quiquell | sshnaidm: It's not an option, I think overcloud playbook need it in place | 16:55 |
| quiquell | sshnaidm: but really maybe is just an optimization so we don't repeat build-test-packages | 16:55 |
| quiquell | sshnaidm: Was afraid of removing it | 16:55 |
| quiquell | sshnaidm: Let me know with whatever you find | 16:56 |
| sshnaidm | quiquell, sure | 16:56 |
| quiquell | sshnaidm: But if we are close to have the release at gating repo, is not a bad thing | 16:56 |
| quiquell | sshnaidm: And we don't have to rebuild the packages for overcloud | 16:56 |
| *** zoli is now known as zli|gone | 16:59 | |
| *** zli|gone is now known as zoli|gone | 16:59 | |
| *** zoli|gone is now known as zoli | 16:59 | |
| *** trown is now known as trown|lunch | 17:01 | |
| sshnaidm | quiquell, I'm afraid of this muuuuch more than hacking compressed_gating var :)) | 17:01 |
| quiquell | sshnaidm: Yep | 17:02 |
| quiquell | weshay|ruck, sshnaidm: hubbot is not exercising jobs like tripleo-quickstart-gate-master-delorean-quick-basic ? | 17:04 |
| weshay|ruck | quiquell, the review should trigger those jobs if ci.centos is working | 17:05 |
| weshay|ruck | if | 17:05 |
| *** holser__ has quit IRC | 17:05 | |
| quiquell | weshay|ruck: but it depends on the file it changes ? | 17:05 |
| weshay|ruck | quiquell, /me gets config | 17:06 |
| weshay|ruck | quiquell, https://github.com/rdo-infra/ci-config/blob/master/jenkins/jobs/tripleo-quickstart-triggers.yml#L130 | 17:07 |
| quiquell | weshay|ruck: I don't see any RedHat RDO CI job at https://review.openstack.org/#/c/567224 | 17:09 |
| *** gkadam__ is now known as gkadam | 17:10 | |
| weshay|ruck | cores https://review.openstack.org/#/c/574417 | 17:11 |
| *** myoung|lunch is now known as myoung | 17:12 | |
| arxcruz | weshay|ruck: https://review.openstack.org/#/c/575501/ | 17:15 |
| myoung | sshnaidm, weshay|ruck, marios - sorting the pike backports for logging | 17:15 |
| myoung | marios, sshnaidm: here's backport for recently landed master patch for updates --> https://review.openstack.org/#/c/575499 | 17:15 |
| weshay|ruck | arxcruz++ | 17:16 |
| hubbot | weshay|ruck: arxcruz's karma is now 3 | 17:16 |
| myoung | ^^ to queens | 17:16 |
| *** amoralej is now known as amoralej|off | 17:16 | |
| rlandy | weshay|ruck: do we still want https://review.openstack.org/#/c/573819/? I saw stevebaker put in a similar review yesterday | 17:17 |
| rlandy | mine adds the changes to toci_gate_test-oooq.sh | 17:18 |
| rlandy | which we may or may not want | 17:18 |
| weshay|ruck | rlandy, man I was looking for that | 17:18 |
| rlandy | lol | 17:18 |
| rlandy | I kind of figured last night you may have been debugging the same problem again | 17:18 |
| weshay|ruck | rlandy, diff issue | 17:19 |
| weshay|ruck | but ya | 17:19 |
| weshay|ruck | rlandy, I like yours better because we are getting rid of some of that extra logic | 17:19 |
| weshay|ruck | rlandy, let me see if I can reconcile the two | 17:19 |
| rlandy | weshay|ruck: well, it's a change in how toci runs | 17:20 |
| weshay|ruck | rlandy, for instance rebase your patch on top of his | 17:20 |
| rlandy | steve's patch just fixes the immediate problem | 17:20 |
| rlandy | weshay|ruck: ^ so maybe we should try just merge his | 17:20 |
| rlandy | and separate the two | 17:20 |
| myoung | weshay|ruckl, sshnaidm, cores, this needs +w https://review.openstack.org/#/c/570896 Add upgrade and update logs to logstash indexing | 17:20 |
| rlandy | toci changes require a lot more testig | 17:20 |
| *** sanjayu_ has joined #oooq | 17:23 | |
| myoung | sshnaidm: trying to sort out the remaining patches/backports for https://trello.com/c/vJwmd6SD/771-indexing-upgrade-logs-in-logstash, it looks like https://review.openstack.org/#/c/575402 is a patch directly to queens that's not a CP from master patches, was it intentional to combine patches to queens? | 17:26 |
| myoung | ^^ https://review.openstack.org/#/q/I1524efe39efc09b31ec69430832e4bb964172943 | 17:27 |
| rasca | rlandy, I'm back (and saw your +2 on the baremetal node definition review) | 17:29 |
| arxcruz | who is removing my karmas? | 17:29 |
| arxcruz | (╯°□°）╯︵ ┻━┻ | 17:29 |
| *** tesseract has quit IRC | 17:30 | |
| myoung | sshnaidm: same question for https://review.openstack.org/#/c/574969, added to the backport CP things not in the master patch...intentional? | 17:31 |
| sshnaidm | myoung, cp didn't work for me, seems like a lot of conflicts | 17:33 |
| sshnaidm | myoung, anyway I'd like to finish it asap\ | 17:34 |
| quiquell | arxcruz: Your fix is related to this https://bugs.launchpad.net/tripleo/+bug/1776729 ? | 17:35 |
| openstack | Launchpad bug 1776729 in tripleo "tempest, access denied error in object storage tests failing in rocky build" [Critical,Triaged] | 17:35 |
| arxcruz | quiquell: yes | 17:36 |
| quiquell | arxcruz: Paste me the review pleeaseee ! | 17:36 |
| rlandy | rasca: ok -let's talk in 5 minutes | 17:36 |
| myoung | sshnaidm: me too :) the queens CP's were easy, only a few conflicts, the pike ones had more. I'm going thru card, can BJ if not too late already. I'm trying to sort out what is CP from what to close down backports | 17:37 |
| * myoung can only imagine doing this for every patch to TQ/TQE | 17:37 | |
| weshay|ruck | quiquell, I don't think the failed jobs dashboard is working correctly | 17:38 |
| weshay|ruck | the gerrit review does not match the job | 17:38 |
| quiquell | weshay|ruck: Failed gate jobs ? | 17:38 |
| sshnaidm | myoung, I think we have all on the table | 17:39 |
| *** sanjayu_ has quit IRC | 17:39 | |
| myoung | sshnaidm: ok...we can do here too i guess? so for https://review.openstack.org/#/q/I184c5ebd28ae11a93a854df5dc2cafd02a5e1b6c, master and queens are merged, pike was updated to include more than master/queens (is it combining one of the other patches?) and is -1 by you...that should be ready. | 17:43 |
| *** florianf has quit IRC | 17:43 | |
| myoung | ^^ https://review.openstack.org/#/c/574969/ | 17:43 |
| sshnaidm | myoung, you need to fix issues there ^ | 17:44 |
| sshnaidm | myoung, from previous patch | 17:44 |
| sshnaidm | myoung, I just added logs there, didn't change your code | 17:45 |
| myoung | sshnaidm: do you mean the conflicts around https://review.openstack.org/#/q/Icb66a4a69bf04c30155999d374b413204df7fc82, which it looks like (back in april) were backported from master --> queens, but not to pike? | 17:46 |
| rlandy | rasca: ready to chat when you are | 17:47 |
| sshnaidm | myoung, I mean issues from https://review.openstack.org/#/c/574969/1 | 17:47 |
| rasca | rlandy, your bluejeans? | 17:48 |
| rlandy | sure | 17:49 |
| rasca | I'm in | 17:50 |
| myoung | marios, sshnaidm: ack, in the interests of time, shoudl we just ignore that https://review.openstack.org/#/c/552303 was never CP'd to pike and change the pike variant of this logging patch to work with pike as-is, or should we CP back https://review.openstack.org/#/c/552303 --> pike, and make https://review.openstack.org/#/c/574969 depend on that? I vote for door #1 - thoughts? I haven't done a lot of backporting to stable branches so not | 17:51 |
| myoung | sure what the practice is here | 17:51 |
| quiquell | Can I get some cores at https://review.openstack.org/#/c/575407/ | 17:54 |
| quiquell | quickstart.sh small fix, make collect logs works | 17:54 |
| *** ykarel_ has quit IRC | 17:58 | |
| sshnaidm | myoung, can we just merge everything in one patch to pike? | 18:00 |
| myoung | sshnaidm: that's my question - in prior lives folks generally lost their minds if backports were not clean CP's with minimal changes. at this point I'm looking for most expediant route that's within the openstack rules :) | 18:02 |
| myoung | (lol I was one of those OCD folks hahaha) | 18:02 |
| * myoung will just proceed with option #1 described above and see what happens | 18:03 | |
| *** jaganathan has quit IRC | 18:06 | |
| rasca | rlandy++ | 18:09 |
| hubbot | rasca: rlandy's karma is now 5 | 18:09 |
| myoung | sshnaidm: done --. https://review.openstack.org/#/c/574969/ | 18:09 |
| rasca | myoung, rlandy, one last thing for today, I rekicked the Ospphase0 RHOS13 pipeline, the two baremetal jobs there completed successfully, but the overall job seems still waiting for something -> https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/osp-director-promote-13-puddle/14/console what this can be? | 18:13 |
| *** trown|lunch is now known as trown | 18:19 | |
| myoung | rasca: looking | 18:20 |
| myoung | rasca: it looks like it's waiting for an executor for virt-ha | 18:22 |
| myoung | rasca: https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/osp-director-promote-13-puddle/14/console kicked 3 jobs, including the one queued here: https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/osp-rhos-13-promote-puddle-virtha-3ctlr_1comp_192gb/ | 18:23 |
| myoung | https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/osp-rhos-11-promote-puddle-virtha-3ctlr_1comp_192gb/63 is running on it now | 18:23 |
| *** sshnaidm is now known as sshnaidm|off | 18:26 | |
| *** quiquell is now known as quiquell|off | 18:26 | |
| myoung | rasca: I'm killing that job and disabling the osp11 pipeline | 18:37 |
| myoung | weshay|ruck, quiquell|off: creating a ruck/rover card to disable osp11 jobs internally - as it's EOL | 18:38 |
| *** jaganathan has joined #oooq | 18:38 | |
| myoung | ^^ s/disable/obliterate | 18:38 |
| *** jaganathan has quit IRC | 18:40 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 18:42 |
| myoung | rasca: https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/osp-rhos-13-promote-puddle-virtha-3ctlr_1comp_192gb/12 is running now | 18:46 |
| *** Goneri has quit IRC | 18:52 | |
| weshay|ruck | rlandy, what can I take off your plate re: bm? | 18:54 |
| rlandy | weshay|ruck: I think we are in progress ... | 18:54 |
| rlandy | Emilien confirmed yesterday that the templates were ok | 18:55 |
| rlandy | there are two poc jobs in progress | 18:55 |
| weshay|ruck | rlandy, which templates.. single-nic-vlan and network-isolation? | 18:55 |
| rlandy | and this ...https://code.engineering.redhat.com/gerrit/#/c/141378/ | 18:55 |
| rlandy | weshay|ruck: both - pasting conversation on pvt | 18:56 |
| *** matbu has joined #oooq | 19:06 | |
| rlandy | cores - requesting reqviews https://review.openstack.org/#/c/570694/ | 19:33 |
| rlandy | reviews | 19:33 |
| weshay|ruck | quiquell|off, dirty test, but may also just work.. ?? https://review.openstack.org/#/c/575535/ | 19:38 |
| *** brault has joined #oooq | 19:40 | |
| *** jfrancoa has joined #oooq | 19:42 | |
| *** brault has quit IRC | 19:45 | |
| *** gkadam has quit IRC | 19:48 | |
| *** agopi has quit IRC | 20:09 | |
| *** agopi has joined #oooq | 20:09 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 20:42 |
| *** jfrancoa has quit IRC | 20:47 | |
| *** trown is now known as trown|outtypewww | 21:20 | |
| *** myoung is now known as myoung|off | 21:45 | |
| rlandy | weshay|ruck: bm-wise ... pike is looking good .. master is good ... queens fails deploy as before - getting rasca's change | 21:57 |
| rlandy | https://review.openstack.org/#/c/572155/ | 22:00 |
| rlandy | fixing | 22:00 |
| *** jbadiapa_ has joined #oooq | 22:03 | |
| *** jbadiapa has quit IRC | 22:06 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 22:42 |
| *** brault has joined #oooq | 22:43 | |
| *** jbadiapa_ has quit IRC | 22:46 | |
| *** brault has quit IRC | 22:47 | |
| *** sanjay__u has joined #oooq | 22:48 | |
| *** tosky has quit IRC | 22:49 | |
| *** jbadiapa_ has joined #oooq | 23:02 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!