*** bhagyashris has joined #oooq | 00:52 | |
*** ykarel|away has joined #oooq | 02:30 | |
*** ykarel|away has quit IRC | 02:35 | |
*** rlandy|bbl has quit IRC | 03:10 | |
*** ykarel|away has joined #oooq | 03:26 | |
*** gkadam has joined #oooq | 03:29 | |
*** gkadam has quit IRC | 03:34 | |
*** gkadam has joined #oooq | 03:35 | |
*** ykarel|away is now known as ykarel | 03:43 | |
*** udesale has joined #oooq | 03:46 | |
*** skramaja has joined #oooq | 04:45 | |
*** aakarsh has joined #oooq | 04:49 | |
*** bhagyashris has quit IRC | 04:52 | |
*** raukadah is now known as chandankumar | 04:59 | |
*** ykarel is now known as ykarel|afk | 05:00 | |
*** ykarel|afk has quit IRC | 05:04 | |
*** aakarsh has quit IRC | 05:09 | |
*** ratailor has joined #oooq | 05:09 | |
*** soniya29 has joined #oooq | 05:16 | |
*** sanjayu_ has joined #oooq | 05:16 | |
*** jfrancoa has joined #oooq | 05:36 | |
*** marios|rover has joined #oooq | 05:39 | |
*** marios has joined #oooq | 05:40 | |
*** sanjayu_ has quit IRC | 05:41 | |
*** sanjayu_ has joined #oooq | 05:41 | |
*** kopecmartin|off is now known as kopecmartin | 05:46 | |
*** jaosorior has quit IRC | 05:46 | |
*** ykarel|afk has joined #oooq | 05:51 | |
*** ccamacho has quit IRC | 05:54 | |
*** ykarel|afk is now known as ykarel | 05:58 | |
*** sanjayu_ has quit IRC | 06:02 | |
*** bhagyashris_ has joined #oooq | 06:03 | |
*** jtomasek has joined #oooq | 06:22 | |
*** ccamacho has joined #oooq | 07:18 | |
*** tesseract has joined #oooq | 07:20 | |
*** jtomasek has quit IRC | 07:29 | |
*** amoralej|off is now known as amoralej | 07:33 | |
*** jpena|off is now known as jpena | 07:34 | |
*** Goneri has joined #oooq | 07:35 | |
*** dsneddon has quit IRC | 07:35 | |
*** ykarel is now known as ykarel|lunch | 07:37 | |
*** d0ugal has quit IRC | 07:47 | |
*** d0ugal has joined #oooq | 07:48 | |
*** jtomasek has joined #oooq | 07:52 | |
*** tosky has joined #oooq | 07:54 | |
*** soniya29 has quit IRC | 08:02 | |
*** jtomasek has quit IRC | 08:09 | |
*** ykarel|lunch is now known as ykarel|away | 08:21 | |
*** derekh has joined #oooq | 08:25 | |
*** ykarel|away has quit IRC | 08:27 | |
*** dsneddon has joined #oooq | 08:28 | |
*** bogdando has joined #oooq | 08:41 | |
arxcruz | sshnaidm|afk: https://review.rdoproject.org/r/#/c/21332/ just did the changes you ask, i don’t know how to handle the pip-3 I believe when you install pip3 it adds the link to pip-3, pip3 and pip-3.x | 09:37 |
---|---|---|
*** d0ugal has quit IRC | 09:38 | |
*** d0ugal has joined #oooq | 09:38 | |
*** d0ugal has quit IRC | 10:13 | |
*** d0ugal has joined #oooq | 10:13 | |
*** bhagyashris_ has quit IRC | 10:16 | |
*** sshnaidm|afk is now known as sshnaidm | 10:25 | |
sshnaidm | arxcruz, we need to collect logs | 10:28 |
*** dtantsur|afk is now known as dtantsur | 10:29 | |
arxcruz | sshnaidm: Can we do it in a splitted patch ? I don’t know honestly how to enable it | 10:29 |
sshnaidm | arxcruz, you can copy this part from reproducer post playbooks | 10:30 |
arxcruz | sshnaidm: Ok | 10:30 |
sshnaidm | arxcruz, we need something to understand why it fails if it does | 10:30 |
sshnaidm | arxcruz, why do you use buildah instead of podman? | 10:31 |
*** dsneddon has quit IRC | 10:41 | |
*** amoralej is now known as amoralej|lunch | 11:01 | |
*** panda is now known as panda|eat | 11:25 | |
arxcruz | sshnaidm: Sorry, went for lunch, I’m using buildah because o don’t know how to use podman lol | 11:28 |
*** dsneddon has joined #oooq | 11:41 | |
*** dsneddon has quit IRC | 11:47 | |
*** udesale has quit IRC | 11:49 | |
*** udesale has joined #oooq | 11:50 | |
weshay | sshnaidm when someone adds a new ansible tag to a playbook, where do we need to define in zuul jobs to ensure it runs? | 11:58 |
weshay | do we have it on the zuul job def? quickstart.sh tags still | 11:59 |
* weshay forgets | 11:59 | |
weshay | hrm.. never mind | 12:00 |
weshay | this is running w/ --tags all | 12:00 |
*** dsneddon has joined #oooq | 12:00 | |
*** dsneddon has quit IRC | 12:05 | |
marios | brb | 12:07 |
weshay | chandankumar panda|eat sshnaidm fyi.. not sure if you guys saw it.. but some of the rhel dlrn builds are coming in a full 30min after centos | 12:08 |
*** dsneddon has joined #oooq | 12:09 | |
*** gkadam has quit IRC | 12:10 | |
sshnaidm | weshay, https://github.com/openstack/tripleo-ci/blob/master/zuul.d/undercloud-jobs.yaml#L44 | 12:13 |
sshnaidm | weshay, what does mean "coming in a full"? | 12:14 |
*** dsneddon has quit IRC | 12:16 | |
*** dsneddon has joined #oooq | 12:17 | |
sshnaidm | marios, can you please include link to snapshot in commit msg? https://review.rdoproject.org/r/#/c/21640/ | 12:18 |
sshnaidm | marios, you can share dashboard to "snapshots.io" | 12:18 |
weshay | sshnaidm so the rhel8 dlrn hash is not in repo for roughly 30min after it's present in centos-7 trunk | 12:20 |
weshay | make sense? | 12:20 |
marios | sshnaidm: ack yeah i did it a little while ago was gonna add to commit message | 12:20 |
marios | sshnaidm: *=* 14:19:10 *=*=*= " " https://snapshot.raintank.io/dashboard/snapshot/CCKT6xOT1kEltOhXa2obA1UFtwvJvf70 | 12:20 |
sshnaidm | marios, cool | 12:20 |
marios | rfolco|ruck: do you want 'voting' on the list of jobs? vote for it at https://review.rdoproject.org/r/#/c/21640 https://snapshot.raintank.io/dashboard/snapshot/CCKT6xOT1kEltOhXa2obA1UFtwvJvf70 | 12:21 |
weshay | sshnaidm looking at both dlrn servers now.. the time diff is about 15min | 12:21 |
weshay | https://trunk.rdoproject.org/centos7-master/report.html vs https://trunk.rdoproject.org/rhel8-master/report.html | 12:21 |
sshnaidm | weshay, ok | 12:22 |
weshay | sshnaidm causes the update of tripleo-ci-testing in rhel8 to be skipped | 12:22 |
rfolco|ruck | marios, that would be useful indeed | 12:22 |
rfolco|ruck | marios, are you marios|rover ? | 12:22 |
*** dsneddon has quit IRC | 12:22 | |
marios|rover | rfolco|ruck: no he's an impostor | 12:22 |
rfolco|ruck | or you talking to me as marios only | 12:22 |
marios|rover | rfolco|ruck: yea its me | 12:23 |
marios | rfolco|ruck: really its me | 12:23 |
marios | :D | 12:23 |
rfolco|ruck | lol | 12:23 |
weshay | sshnaidm 2019-07-31 18:22:37.811308 | rdo-centos-7 | commit 348374f5d244990b3db6825c7d388339a3e0294f / distro 23df87739b135962420d319d6dce3fe46f9d752f combination not found in RHEL | 12:23 |
weshay | http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-7-master-promote-consistent-to-tripleo-ci-testing/85730c3/job-output.txt.gz | 12:23 |
*** amoralej|lunch is now known as amoralej | 12:24 | |
sshnaidm | weshay, that's bad | 12:25 |
sshnaidm | weshay, it shouldn't publish for centos untill all are built | 12:26 |
rfolco|ruck | marios, did you fix the broken link 'FAILURE' too? | 12:26 |
weshay | sshnaidm it's bad sure.. but for now we have to account for it.. I think rlandy has a patch up adjust the timeout/retry on that task | 12:26 |
weshay | but I don't see it atm | 12:26 |
marios | rfolco|ruck: i did not. please comment there and i can include it | 12:26 |
sshnaidm | weshay, retry for 30 min? | 12:27 |
marios | rfolco|ruck: i fixed and added some more links though, under the descriptions... | 12:27 |
weshay | sshnaidm panda|eat take a look at review.rdoproject.org/config/playbooks/tripleo-ci-base-promote-consistent-to-tripleo-ci-testing/run.yaml@master | 12:27 |
rfolco|ruck | marios, I tried to fix it once... its not that easy I guess | 12:27 |
sshnaidm | weshay, do prodchain know about this problem? | 12:27 |
rfolco|ruck | marios, ok will comment there | 12:27 |
weshay | you find the retries for fedora/rhel there... we can remove fedora.. but we'll want to adjust rhel to get the ball moving.. and yes we can lean on prodchain but I'm not sure if they will be able to fix that | 12:28 |
weshay | so first thing to-do is adjust our wait to be 30min | 12:28 |
weshay | wish rlandy was on | 12:28 |
sshnaidm | weshay, she added 20*30=600 seconds delay | 12:30 |
weshay | ah k | 12:30 |
weshay | thanks | 12:30 |
weshay | the job has not run since last night | 12:30 |
sshnaidm | weshay, so how many to add? | 12:30 |
marios | sshnaidm: rfolco|ruck: links don't show in the snapshot though unfortunately it said they are ommitted when generating it | 12:30 |
*** jdennis has quit IRC | 12:31 | |
sshnaidm | weshay, she added 9 days ago | 12:31 |
weshay | sshnaidm 1800 for now | 12:31 |
weshay | 30 min | 12:31 |
sshnaidm | marios, that's fine | 12:31 |
*** rlandy has joined #oooq | 12:31 | |
sshnaidm | weshay, oh, I see she added yesterday, just updated.. | 12:33 |
sshnaidm | jobs should run since then | 12:33 |
*** panda|eat is now known as panda | 12:34 | |
panda | wow, delays of up to 30 minutes in the promotion pipeline :( | 12:34 |
*** jpena is now known as jpena|off | 12:34 | |
weshay | panda ya.. so we'll work on it.. better to get it running first | 12:35 |
weshay | panda why are images not getting uploaded? | 12:35 |
* weshay jumps on a node to check the rcm server | 12:35 | |
weshay | overcloud images | 12:35 |
panda | weshay: mhhh, the upload part is not running, will post a fix. | 12:40 |
rlandy | sshnaidm: hey - guess you found my patches from yesterday | 12:43 |
sshnaidm | rlandy, hi, thanks, running it now with all deps | 12:44 |
rlandy | sshnaidm: do we need the duplicate image definitions in the ovb settings file? | 12:44 |
weshay | rlandy and others... I had a situation yesterday about a 3rd party ansible role for tls | 12:44 |
weshay | sshnaidm marios panda ^ | 12:45 |
marios | weshay: which bit | 12:45 |
rlandy | situation? | 12:45 |
sshnaidm | for tls? | 12:45 |
weshay | it led me down a different kind of path to get this role in w/o violating upstream policy or impacting unrelated jobs | 12:45 |
weshay | sshnaidm ya | 12:45 |
rlandy | can we discuss at meeting? | 12:45 |
weshay | sure | 12:45 |
weshay | will raise it briefly there | 12:45 |
sshnaidm | weshay, do you have a link? | 12:46 |
marios | rlandy: +1 yeah its only few mins now | 12:46 |
rlandy | "situation" never equals good :( | 12:46 |
zbr | sshnaidm: re extra_node: 1 -- do you want me to also call it with 0, so we cover both cases? | 12:46 |
sshnaidm | zbr, no, when 0 it's just skipped | 12:46 |
zbr | sshnaidm: ok. but ideally we should test import of role with default params (default is 0). anyway, it can be added later. | 12:47 |
sshnaidm | zbr, we need verifiers also, but it's for followups | 12:47 |
zbr | sshnaidm++ better with smaller steps. | 12:47 |
*** ratailor has quit IRC | 12:48 | |
panda | is this a duplicate ? https://review.rdoproject.org/r/21677 | 12:50 |
weshay | rfolco|ruck need anything from me? | 12:51 |
weshay | rfolco|ruck I suspect gate failures are related to ovh cloud | 12:51 |
weshay | rfolco|ruck actually not gate failures for 8/1 thus far | 12:52 |
*** dsneddon has joined #oooq | 12:52 | |
*** jdennis has joined #oooq | 12:53 | |
rfolco|ruck | weshay, yeah gate is clean but rdo has multiple bugs | 12:54 |
rfolco|ruck | weshay, just filed 2 | 12:54 |
rfolco|ruck | NEW! bug https://bugs.launchpad.net/tripleo/+bug/1838631 - overcloud deploy: Error in 38 output role_data | 12:54 |
openstack | Launchpad bug 1838631 in tripleo "overcloud deploy: Error in 38 output role_data" [Critical,Triaged] | 12:54 |
rfolco|ruck | NEW! bug https://bugs.launchpad.net/tripleo/+bug/1838633 - [nova placement] no version was discoverable | 12:54 |
weshay | rfolco|ruck k.. fyi.. you can let queens bleed red a little .. | 12:54 |
openstack | Launchpad bug 1838633 in tripleo "[nova placement] no version was discoverable" [Undecided,Triaged] | 12:54 |
rfolco|ruck | https://bugs.launchpad.net/tripleo/+bug/1838633 is critical | 12:55 |
openstack | Launchpad bug 1838633 in tripleo "[nova placement] no version was discoverable" [Critical,Triaged] | 12:55 |
*** jaosorior has joined #oooq | 12:58 | |
*** tosky has quit IRC | 13:10 | |
*** skramaja has quit IRC | 13:10 | |
*** tosky has joined #oooq | 13:10 | |
*** jpena|off is now known as jpena | 13:16 | |
*** jrist has joined #oooq | 13:17 | |
*** dsneddon has quit IRC | 13:59 | |
rfolco|ruck | marios, rlandy arxcruz sshnaidm panda weshay zbr: ruck begging review time | 14:17 |
rfolco|ruck | disable fedora in all pipelines: | 14:17 |
rfolco|ruck | https://review.rdoproject.org/r/21668 Disable fedora jobs in all pipelines (config) | 14:17 |
rfolco|ruck | https://review.rdoproject.org/r/21667 Disable fedora jobs in all pipelines (rdo-jobs) | 14:17 |
rfolco|ruck | fix voting gating jobs: | 14:17 |
rfolco|ruck | https://review.opendev.org/673842 Vote and gate on containers-multinode-branchful jobs | 14:17 |
rfolco|ruck | https://review.rdoproject.org/r/21663 Make fs053 job vote again | 14:17 |
rfolco|ruck | https://review.opendev.org/673886 Remove scen009 (non-voting) from gate | 14:17 |
rfolco|ruck | review please ^^ | 14:17 |
sshnaidm | rfolco|ruck, please rebase patches that need rebase | 14:17 |
rfolco|ruck | sshnaidm, oh I thought I've had done | 14:18 |
rfolco|ruck | will do thx | 14:18 |
rlandy | rfolco|ruck: why depricated jobs? | 14:19 |
rfolco|ruck | rlandy, just not to delete all job definitions... we disable and keep them in a separate file for now | 14:20 |
rfolco|ruck | rlandy, safer | 14:20 |
rlandy | rfolco|ruck: yeah - so requires rebase so we can merge | 14:24 |
rlandy | any merge order here? | 14:24 |
rlandy | no deps | 14:24 |
rfolco|ruck | no deps but I'd first merge https://review.rdoproject.org/r/#/c/21668/ that removed from pipeline | 14:24 |
rfolco|ruck | than the one in rdo-jobs | 14:24 |
rfolco|ruck | rebased https://review.rdoproject.org/r/21668 rlandy sshnaidm | 14:25 |
rfolco|ruck | it won't break if we merge https://review.rdoproject.org/r/#/c/21667/ first, but disabling in pipeline is more critical | 14:27 |
sshnaidm | marios, rfolco|ruck do you know why periodic master jobs didn't run today? | 14:28 |
sshnaidm | weshay, ^ | 14:28 |
*** vinaykns has joined #oooq | 14:28 | |
rlandy | sshnaidm: let's just merge | 14:28 |
rlandy | and deal with the damage | 14:29 |
sshnaidm | rlandy, merge what? | 14:29 |
weshay | sshnaidm not yet | 14:29 |
rlandy | https://review.rdoproject.org/r/21668 and https://review.rdoproject.org/r/21667 | 14:29 |
*** dsneddon has joined #oooq | 14:29 | |
rfolco|ruck | rlandy, do you forecast any damage? | 14:30 |
rlandy | rfolco|ruck: idk | 14:30 |
rfolco|ruck | ah ok | 14:30 |
rlandy | I approved both of them' | 14:30 |
rfolco|ruck | got it | 14:30 |
rfolco|ruck | cool thx | 14:30 |
rlandy | I want to w+ | 14:30 |
rlandy | if sshnaidm has no objection | 14:31 |
rfolco|ruck | sshnaidm, oh crap skipped all periodic today.... | 14:31 |
sshnaidm | rlandy, I did | 14:31 |
sshnaidm | rfolco|ruck, how? | 14:31 |
*** jfrancoa has quit IRC | 14:31 | |
rlandy | cool | 14:31 |
rfolco|ruck | sshnaidm, idk | 14:31 |
sshnaidm | rfolco|ruck, we talk in #sf-ops | 14:32 |
*** Vorrtex has joined #oooq | 14:33 | |
*** dsneddon has quit IRC | 14:34 | |
marios | sshnaidm: wut.. no i do not.. is it stuck again/ sorry was on call checking | 14:38 |
marios | sshnaidm: i see some runs in https://review.rdoproject.org/zuul/builds | 14:40 |
marios | sshnaidm: openstackperiodic-latest-released | 14:40 |
sshnaidm | marios, not master though | 14:41 |
marios | sshnaidm: right... but it isn't stuck either so not sure whats going on https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-master | 14:42 |
*** ykarel has joined #oooq | 14:43 | |
*** jaosorior has quit IRC | 14:46 | |
sshnaidm | rfolco, better to rename existing job to periodic-tripleo-rhel-8-containers-build-push-master | 14:51 |
panda | rfolco|ruck: you have a +2 and a -1 from me in opendev | 14:53 |
panda | #roastme https://review.rdoproject.org/r/#/c/21592/ https://review.rdoproject.org/r/#/c/21535/ https://review.rdoproject.org/r/#/c/21579/ | 14:53 |
ykarel | rfolco|ruck, marios is this known why openstack-periodic-master didn't kicked in last run at 12:10 UTC? | 14:53 |
sshnaidm | rfolco|ruck, ah, no, we have the same pattern for periodic-tripleo-centos-7-master-containers-build-push | 14:54 |
sshnaidm | ykarel, yeah, error in config repo | 14:54 |
marios | ykarel: no i don't know... it isn't stuck... rfolco|ruck are you on this yet? | 14:54 |
rfolco|ruck | we are fixing | 14:54 |
ykarel | sshnaidm, okk are u seeing error somewherre? | 14:54 |
rfolco|ruck | zuul logs only | 14:54 |
ykarel | i see https://review.rdoproject.org/zuul/api/config-errors | 14:54 |
sshnaidm | ykarel, jpena checked in zuul logs | 14:54 |
marios | ack thanks rfolco|ruck | 14:54 |
ykarel | rfolco|ruck, sshnaidm, okk Thanks | 14:55 |
sshnaidm | ykarel, it's dependency on non-existing job and seems like config check doesn't check it | 14:55 |
ykarel | :( | 14:55 |
rfolco|ruck | sshnaidm, please clarify this comment ... forgive my limitation to understand it | 14:55 |
rfolco|ruck | <sshnaidm> rfolco|ruck, ah, no, we have the same pattern for periodic-tripleo-centos-7-master-containers-build-push | 14:55 |
sshnaidm | rfolco|ruck, I mean we need the same name pattern as we have in centos | 14:56 |
sshnaidm | periodic-tripleo-centos-7-master-containers-build-push -> periodic-tripleo-rhel-8-master-containers-build-push | 14:56 |
rfolco|ruck | sshnaidm, periodic-tripleo-rhel-8-master-containers-build-push | 14:57 |
rfolco|ruck | ok | 14:57 |
rfolco|ruck | I thought you were saying "hell no! we don't have this job defined (periodic-tripleo-rhel-8-master-containers-build-push)" | 14:57 |
rfolco|ruck | ok got it, just adding extra master to job name in dependencies | 14:57 |
*** aakarsh has joined #oooq | 15:01 | |
*** dsneddon has joined #oooq | 15:03 | |
*** aakarsh|2 has joined #oooq | 15:03 | |
*** ratailor has joined #oooq | 15:05 | |
*** aakarsh has quit IRC | 15:06 | |
*** ykarel is now known as ykarel|away | 15:08 | |
*** dsneddon has quit IRC | 15:10 | |
*** Vorrtex has quit IRC | 15:12 | |
rlandy | arxcruz: any concern if we merge https://review.rdoproject.org/r/#/c/21659/? | 15:16 |
*** ykarel|away has quit IRC | 15:17 | |
rlandy | zbr: ^^? | 15:17 |
*** ykarel|away has joined #oooq | 15:17 | |
*** ykarel|away has quit IRC | 15:18 | |
*** ykarel|away has joined #oooq | 15:19 | |
*** ykarel|away has quit IRC | 15:20 | |
*** ykarel|away has joined #oooq | 15:20 | |
*** Goneri has quit IRC | 15:23 | |
rlandy | panda; you around? | 15:25 |
rlandy | https://review.rdoproject.org/r/#/c/21677/ | 15:25 |
*** Vorrtex has joined #oooq | 15:25 | |
rlandy | rebasing this - ok to merge? | 15:25 |
panda | rlandy: yes | 15:29 |
*** dsneddon has joined #oooq | 15:33 | |
*** jpena is now known as jpena|off | 15:36 | |
*** ykarel|away has quit IRC | 15:36 | |
*** bogdando has quit IRC | 15:40 | |
*** dsneddon has quit IRC | 15:42 | |
*** ccamacho has quit IRC | 15:43 | |
chandankumar | weshay: rlandy I was travelling with yatin to blr | 15:48 |
zbr | rlandy: i do have some concerns. i am working on doing some testing on it. | 15:49 |
*** jtomasek has joined #oooq | 15:51 | |
*** amoralej is now known as amoralej|off | 15:52 | |
*** gkadam has joined #oooq | 15:57 | |
marios|rover | panda: arxcruz weshay i've added my questions in that doc (meeting we had couple hours ago) fyi thanks | 15:57 |
rlandy | panda: wanted to merge https://review.rdoproject.org/r/#/c/21677/ | 15:58 |
rlandy | rebasing | 15:58 |
*** gkadam has quit IRC | 16:01 | |
rlandy | rebased | 16:01 |
rlandy | panda: ok to merge? | 16:01 |
panda | rlandy: yes | 16:03 |
rlandy | k - will w+ once zuul votes | 16:03 |
*** jpena|off is now known as jpena | 16:05 | |
*** jpena is now known as jpena|off | 16:07 | |
*** ratailor has quit IRC | 16:11 | |
*** dsneddon has joined #oooq | 16:17 | |
*** marios has quit IRC | 16:18 | |
*** marios|rover has quit IRC | 16:18 | |
*** dsneddon has quit IRC | 16:25 | |
*** dtantsur is now known as dtantsur|afk | 16:38 | |
zbr | sshnaidm: is https://review.rdoproject.org/r/#/c/21589 ok now? | 16:39 |
sshnaidm | zbr, +2 and commented | 16:43 |
*** sshnaidm is now known as sshnaidm|afk | 16:46 | |
zbr | sshnaidm|afk: what kind of error are you getting locally? | 16:55 |
rlandy | panda: these jobs? | 16:56 |
rlandy | https://review.rdoproject.org/r/#/c/21592/ Split periodic buildimage definition | 16:56 |
rlandy | https://review.rdoproject.org/r/#/c/21535/ add buildimage rhel8 check jobs | 16:56 |
rlandy | https://review.rdoproject.org/r/#/c/21579/ Tripleo: add triggers for 3rd party build images jobs | 16:56 |
*** derekh has quit IRC | 17:01 | |
*** dsneddon has joined #oooq | 17:07 | |
rlandy | ugh - need to know if I am rebasing these jobs correctly | 17:09 |
*** dsneddon has quit IRC | 17:12 | |
*** udesale has quit IRC | 17:14 | |
rfolco|ruck | weshay, zbr arxcruz rlandy panda: pls review https://review.opendev.org/#/c/673842/ and https://review.opendev.org/#/c/673886/ | 17:17 |
panda | rlandy: small fix in 21592 | 17:18 |
rlandy | panda: I merged that job incorrectly | 17:18 |
panda | rlandy: merged ? | 17:19 |
rlandy | sorry rebased | 17:20 |
rlandy | but you fixed it | 17:20 |
rlandy | great | 17:20 |
rlandy | can those jobs go? | 17:20 |
rlandy | so many jobs - I have no idea what order these need to go in | 17:20 |
panda | rlandy: where's the etherpad with the tree of dependencies :) | 17:21 |
panda | rlandy: anyway 21592 goes first | 17:21 |
panda | rlandy: should be a noop, just a different reparenting | 17:21 |
panda | rlandy: 21535 can go next, just adding definitons for jobs | 17:22 |
panda | rlandy: /21579 is what should trigger the check jobs in upstream repos | 17:22 |
rlandy | panda: https://etherpad.openstack.org/p/rhel8-reviews | 17:22 |
rlandy | trying to just get the reviews on there first | 17:22 |
rlandy | unmerged reviews | 17:23 |
panda | rlandy: they could pollute a bit the gerrit resutls, if they are configured correctly, but none of them is voting, and non of them could gate anyway | 17:23 |
rlandy | panda: ok - so mergeable | 17:23 |
rlandy | let's start here https://review.rdoproject.org/r/#/c/21592/ | 17:24 |
*** kopecmartin is now known as kopecmartin|off | 17:24 | |
rlandy | zbr: pls leave a note on https://etherpad.openstack.org/p/rhel8-reviews when you are ok with merging https://review.rdoproject.org/r/#/c/21659/ | 17:25 |
panda | ooh see that change / watch that jobs / dig in the merging queen | 17:28 |
weshay | rlandy no need check it now.. but that way of injecting a role is working :) I list out all the roles in the path and it shows up | 17:32 |
weshay | in ci | 17:32 |
rlandy | weshay++ | 17:32 |
weshay | rlandy using line 36 https://review.opendev.org/#/c/673926/3/playbooks/third_party_clone_keycloak.yml | 17:33 |
rlandy | I agree with that methodology | 17:33 |
weshay | er.. 33 | 17:33 |
rlandy | panda: https://review.rdoproject.org/r/#/c/21535/ is merging | 17:33 |
weshay | seems to be pretty pin point.. | 17:33 |
rlandy | or forever hold your peace | 17:33 |
rlandy | weshay: will look in a bit - too busy trying to do merge damage all over the repos | 17:34 |
weshay | rlandy np np | 17:34 |
* rlandy is armed with +2 and dangerous | 17:36 | |
*** dsneddon has joined #oooq | 17:37 | |
*** dsneddon has quit IRC | 17:42 | |
rlandy | panda: templates definition? see failure https://review.rdoproject.org/r/#/c/21579/ | 17:45 |
rlandy | where is that? | 17:45 |
*** dsneddon has joined #oooq | 17:45 | |
rlandy | panda: also can cards 1171 and 1172 go to done? | 17:45 |
panda | rlandy: right, there's no template, must have lost it in the last change | 17:47 |
rlandy | last change? | 17:47 |
rlandy | it's usually in a diff file | 17:47 |
panda | rlandy: 1171 and 1171 done only when we see overcloud images uploaded | 17:50 |
rlandy | panda: k - you adding the template or am I? | 17:50 |
*** dsneddon has quit IRC | 17:51 | |
sshnaidm|afk | rlandy, we reached step of introspection with rhel8 where it fails: http://logs.rdoproject.org/49/21649/15/check/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-master/f605946/logs/undercloud/home/zuul/overcloud_prep_images.log.txt.gz | 17:52 |
panda | rlandy: just a minute, I have a puppet in my left hand. | 17:52 |
sshnaidm|afk | rlandy, can you please take a look tomorrow what are issues there? | 17:52 |
panda | and writing asible with the right hand | 17:53 |
rlandy | sshnaidm|afk: yep - will check it out | 17:54 |
rlandy | Failure caused by error in tasks: send_message\n\n send_message [task_ex_id=65e87114-8afb-45ee-bdf1-1a6124c486f3] -> Workflow failed due to message status. Status:FAILED Message:({\'result\': \'Node dee7ce4b-be65-4e68-9482-d76cb9555cee did not reach state "manageable", the state is "enroll", error: Failed to get power state for node dee7ce4b-be65-4e68-9482-d76cb9555cee. Error: IPMI call failed: power status. | 17:54 |
rlandy | no IPMI | 17:54 |
*** dsneddon has joined #oooq | 17:55 | |
*** tosky has quit IRC | 18:01 | |
panda | rlandy: https://review.rdoproject.org/r/21680 | 18:01 |
panda | rlandy: removed "master" from the names, as check this jobs are branchless | 18:02 |
rlandy | looking | 18:02 |
rlandy | https://review.rdoproject.org/r/#/c/21680/1/zuul.d/buildimage.yaml - the parent is master though | 18:04 |
panda | rlandy: yes, we would need an additioanl correction, in config, we can do it later | 18:05 |
rlandy | panda: ok - let's go with this | 18:09 |
rlandy | noted the additional change | 18:09 |
rlandy | panda: holding off merging https://review.rdoproject.org/r/#/c/21579/ - want to see the job run once | 18:16 |
rlandy | ugh - config - never mind | 18:17 |
rlandy | zbr: abandon this? https://review.rdoproject.org/r/#/c/21463/ | 18:18 |
*** Vorrtex has quit IRC | 18:27 | |
rlandy | panda: ok - etherpad complete afaict ... https://etherpad.openstack.org/p/rhel8-reviews | 18:29 |
rlandy | rebasing https://review.rdoproject.org/r/#/c/21593/ | 18:30 |
rlandy | master periodic is running | 18:31 |
rlandy | rfolco|ruck: panda: weshay: ^^ | 18:31 |
rlandy | let's see if we get updated rhel artifacts | 18:32 |
weshay | :) | 18:32 |
rlandy | 2019-08-01 18:22:35.872409 | rdo-centos-7 | Checking existence of commit c10329fc0e6846b9b387a977a366bf28ab8bfe5a / distro 23df87739b135962420d319d6dce3fe46f9d752f in RHEL | 18:40 |
rlandy | 2019-08-01 18:22:38.195321 | rdo-centos-7 | commit c10329fc0e6846b9b387a977a366bf28ab8bfe5a / distro 23df87739b135962420d319d6dce3fe46f9d752f combination not found in RHEL | 18:40 |
*** Vorrtex has joined #oooq | 18:43 | |
rlandy | panda: ping - still around? | 18:52 |
rlandy | 2019-08-01 18:44:29.943092 | TASK [Create SSH private key from secret] | 19:00 |
rlandy | 2019-08-01 18:44:29.993271 | primary | ERROR | 19:00 |
rlandy | 2019-08-01 18:44:29.993600 | primary | { | 19:00 |
rlandy | 2019-08-01 18:44:29.993671 | primary | "msg": "The task includes an option with an undefined variable. The error was: 'uploader_ssh_key' is undefined\n\nThe error appears to have been in '/tmp/tmplvic8e00/56bd74619c6c41b280595a6cd9156774/trusted/project_0/review.rdoproject.org/config/playbooks/tripleo-ci-periodic-base-upload/post.yaml': line 14, column 9, but may\nbe elsewhere in the file depending on the exact syntax | 19:00 |
rlandy | problem.\n\nThe offending line appears to be:\n\n\n - name: Create SSH private key from secret\n ^ here\n" | 19:00 |
rlandy | 2019-08-01 18:44:29.993740 | primary | } | 19:00 |
weshay | is that for the login? | 19:01 |
weshay | to the registry | 19:01 |
rlandy | weshay: bj? | 19:03 |
weshay | rlandy sure | 19:03 |
rlandy | joining | 19:03 |
*** jtomasek has quit IRC | 19:05 | |
*** dsneddon has quit IRC | 19:08 | |
*** jschluet has joined #oooq | 19:21 | |
*** jschlueter has quit IRC | 19:21 | |
*** tesseract has quit IRC | 19:23 | |
*** pipr has quit IRC | 19:23 | |
rlandy | weshay: https://review.rdoproject.org/r/#/c/21682/ | 19:34 |
rlandy | panda: ^^ if you are around | 19:35 |
panda | rlandy: ack | 19:37 |
zbr | rlandy: thanks for abandoning the obsolete one on ovb. we only need to merge https://review.rdoproject.org/r/#/c/21589/ now to close the subject. | 19:38 |
panda | rlandy: ok to merge ? | 19:39 |
rlandy | pnad: we will have to merge it | 19:39 |
rlandy | panda: | 19:39 |
rlandy | putting in a testproject job to try test after merge | 19:39 |
panda | rlandy: ok, merging then | 19:40 |
*** dsneddon has joined #oooq | 19:41 | |
rlandy | panda: thanks | 19:42 |
rlandy | https://review.rdoproject.org/r/21683 | 19:44 |
rlandy | panda: test job ^^ | 19:44 |
*** jtomasek has joined #oooq | 19:57 | |
*** radez has quit IRC | 20:03 | |
rlandy | 2019-08-01 20:02:11.567169 | primary | "msg": "The task includes an option with an undefined variable. The error was: 'site_logs' is undefined\n\nThe error appears to have been in '/tmp/tmp9_x_7sup/d7d9437b678f4aca9f904bbf303c9f62/trusted/project_0/review.rdoproject.org/config/playbooks/tripleo-ci-periodic-base-upload/post.yaml': line 14, column 9, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe | 20:04 |
rlandy | offending line appears to be:\n\n\n - name: Create SSH private key from secret\n ^ here\n" | 20:04 |
rlandy | 2019-08-01 20:02:11.567227 | primary | } | 20:04 |
rlandy | weshay: ^^ | 20:04 |
*** amoralej|off has quit IRC | 20:04 | |
weshay | looking | 20:04 |
weshay | oh | 20:05 |
rlandy | it's defined | 20:05 |
rlandy | secrets: | 20:05 |
rlandy | - site_logs | 20:05 |
rlandy | - dlrnapi | 20:05 |
*** jtomasek has quit IRC | 20:06 | |
rlandy | ? | 20:06 |
weshay | ya.. do you need to add that to test_project version? | 20:06 |
weshay | rlandy oh.. maybe parent the test_project job to the abstract-base? | 20:07 |
weshay | I'm guessing | 20:07 |
rlandy | it is | 20:09 |
weshay | rlandy so for shit's and giggles redefine it in test project one | 20:11 |
* rlandy is thinking | 20:11 | |
rlandy | oh | 20:12 |
rlandy | oh | 20:12 |
rlandy | oh | 20:12 |
rlandy | maybe it needs to be defined with the playbook | 20:12 |
rlandy | weshay: bj again or 5 mins? | 20:16 |
weshay | sure | 20:16 |
rlandy | sorry - but I want to get this right | 20:16 |
rlandy | joined | 20:16 |
*** tosky has joined #oooq | 20:17 | |
rlandy | weshay: https://review.rdoproject.org/r/21684 | 20:22 |
*** Vorrtex has quit IRC | 20:40 | |
rlandy | weshay: ping | 20:56 |
rlandy | periodic-tripleo-rhel-8-buildimage-overcloud-full-masterSUCCESS in 19m 24s | 20:57 |
rlandy | checking image | 20:57 |
rlandy | 2019-08-01 16:51:26.979970 | primary | Error loading key "/tmp/ansible.glkyesh2": invalid format | 20:57 |
rlandy | 2019-08-01 16:51:27.013445 | primary | + export FULL_HASH=65570a311e1303d8084d12ee82868e6d0f411e8a_41250740 | 20:58 |
rlandy | 2019-08-01 16:51:27.013468 | primary | + FULL_HASH=65570a311e1303d8084d12ee82868e6d0f411e8a_41250740 | 20:58 |
rlandy | same old hash | 20:58 |
rlandy | http://logs.rdoproject.org/83/21683/4/check/periodic-tripleo-rhel-8-buildimage-overcloud-full-master/143ccfb/job-output.txt.gz | 20:58 |
weshay | ok.. still running? | 20:59 |
weshay | did it upload? | 20:59 |
weshay | oh I see | 21:02 |
weshay | 2019-08-01 16:51:26.979970 | primary | Error loading key "/tmp/ansible.glkyesh2": invalid format | 21:02 |
rlandy | weshay: trying to check upload | 21:02 |
weshay | right | 21:02 |
rlandy | om promoter server | 21:03 |
weshay | looks like it didn't build | 21:03 |
weshay | 2019-08-01 16:51:27.009811 | primary | ls: cannot access '*.tar': No such file or directory | 21:03 |
rlandy | http://logs.rdoproject.org/83/21683/4/check/periodic-tripleo-rhel-8-buildimage-overcloud-full-master/143ccfb/logs/script_build.log' | 21:03 |
rlandy | it did build | 21:03 |
weshay | into /home/zuul | 21:03 |
weshay | ? | 21:03 |
rlandy | and it doesn't say undefined key | 21:03 |
rlandy | http://logs.rdoproject.org/83/21683/4/check/periodic-tripleo-rhel-8-buildimage-overcloud-full-master/143ccfb/overcloud-full.log | 21:04 |
rlandy | 2019-08-01 20:51:21.452 | Image file ./overcloud-full.qcow2 created... | 21:04 |
rlandy | 2019-08-01 20:51:21.699 | Build completed successfully | 21:04 |
weshay | rlandy maybe it didn't tar | 21:04 |
rlandy | | primary | ls: cannot access '*.tar': No such file or directory | 21:05 |
weshay | ya | 21:06 |
weshay | rlandy at this point... we have to check the old w/ the new | 21:06 |
weshay | I thought this might happen | 21:06 |
*** vinaykns has quit IRC | 21:06 | |
weshay | rlandy blue? | 21:06 |
rlandy | k | 21:06 |
rlandy | already a when on that playbook - thinking | 21:28 |
*** aakarsh|2 has quit IRC | 21:35 | |
rlandy | weshay: https://review.rdoproject.org/r/21686 Add tar and md5 sums required for upload | 21:39 |
rlandy | thoughts? | 21:39 |
weshay | rlandy give it a go :) | 22:03 |
rlandy | linter failure | 22:03 |
rlandy | need to fix | 22:04 |
rlandy | sec | 22:04 |
rlandy | tar used in place of unarchive module | 22:07 |
*** tosky has quit IRC | 22:07 | |
rlandy | weshay: linters want me to use ansible archive https://docs.ansible.com/ansible/2.4/archive_module.html but I just want .tar extension | 22:09 |
rlandy | https://docs.ansible.com/ansible/latest/modules/archive_module.html | 22:10 |
rlandy | ah | 22:10 |
rlandy | ok | 22:10 |
rlandy | weshay: k - linters are happy | 22:18 |
rlandy | let's try it | 22:18 |
rlandy | self-merge party going on here | 22:19 |
rlandy | testproject job running | 22:20 |
weshay | k | 22:29 |
*** jpenag has joined #oooq | 22:36 | |
*** aakarsh has joined #oooq | 22:36 | |
*** jpena|off has quit IRC | 22:37 | |
*** dtantsur|afk has quit IRC | 22:37 | |
*** panda has quit IRC | 22:41 | |
*** panda has joined #oooq | 22:42 | |
rlandy | ugh | 22:42 |
rlandy | fixing | 22:42 |
rlandy | weshay: https://review.rdoproject.org/r/#/c/21687/ | 22:54 |
rlandy | maybe you have a better idea? | 22:54 |
* rlandy brb | 23:00 | |
rlandy | weshay: you there? | 23:26 |
weshay | rlandy sorry was on kid duty | 23:52 |
weshay | let's pick it up tomorrow | 23:55 |
rlandy | weshay: no worries | 23:57 |
rlandy | trying another path | 23:57 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!