Thursday, 2019-08-01

*** bhagyashris has joined #oooq00:52
*** ykarel|away has joined #oooq02:30
*** ykarel|away has quit IRC02:35
*** rlandy|bbl has quit IRC03:10
*** ykarel|away has joined #oooq03:26
*** gkadam has joined #oooq03:29
*** gkadam has quit IRC03:34
*** gkadam has joined #oooq03:35
*** ykarel|away is now known as ykarel03:43
*** udesale has joined #oooq03:46
*** skramaja has joined #oooq04:45
*** aakarsh has joined #oooq04:49
*** bhagyashris has quit IRC04:52
*** raukadah is now known as chandankumar04:59
*** ykarel is now known as ykarel|afk05:00
*** ykarel|afk has quit IRC05:04
*** aakarsh has quit IRC05:09
*** ratailor has joined #oooq05:09
*** soniya29 has joined #oooq05:16
*** sanjayu_ has joined #oooq05:16
*** jfrancoa has joined #oooq05:36
*** marios|rover has joined #oooq05:39
*** marios has joined #oooq05:40
*** sanjayu_ has quit IRC05:41
*** sanjayu_ has joined #oooq05:41
*** kopecmartin|off is now known as kopecmartin05:46
*** jaosorior has quit IRC05:46
*** ykarel|afk has joined #oooq05:51
*** ccamacho has quit IRC05:54
*** ykarel|afk is now known as ykarel05:58
*** sanjayu_ has quit IRC06:02
*** bhagyashris_ has joined #oooq06:03
*** jtomasek has joined #oooq06:22
*** ccamacho has joined #oooq07:18
*** tesseract has joined #oooq07:20
*** jtomasek has quit IRC07:29
*** amoralej|off is now known as amoralej07:33
*** jpena|off is now known as jpena07:34
*** Goneri has joined #oooq07:35
*** dsneddon has quit IRC07:35
*** ykarel is now known as ykarel|lunch07:37
*** d0ugal has quit IRC07:47
*** d0ugal has joined #oooq07:48
*** jtomasek has joined #oooq07:52
*** tosky has joined #oooq07:54
*** soniya29 has quit IRC08:02
*** jtomasek has quit IRC08:09
*** ykarel|lunch is now known as ykarel|away08:21
*** derekh has joined #oooq08:25
*** ykarel|away has quit IRC08:27
*** dsneddon has joined #oooq08:28
*** bogdando has joined #oooq08:41
arxcruzsshnaidm|afk: https://review.rdoproject.org/r/#/c/21332/ just did the changes you ask, i don’t know how to handle the pip-3 I believe when you install pip3 it adds the link to pip-3, pip3 and pip-3.x09:37
*** d0ugal has quit IRC09:38
*** d0ugal has joined #oooq09:38
*** d0ugal has quit IRC10:13
*** d0ugal has joined #oooq10:13
*** bhagyashris_ has quit IRC10:16
*** sshnaidm|afk is now known as sshnaidm10:25
sshnaidmarxcruz, we need to collect logs10:28
*** dtantsur|afk is now known as dtantsur10:29
arxcruzsshnaidm: Can we do it in a splitted patch ? I don’t know honestly how to enable it10:29
sshnaidmarxcruz, you can copy this part from reproducer post playbooks10:30
arxcruzsshnaidm: Ok10:30
sshnaidmarxcruz, we need something to understand why it fails if it does10:30
sshnaidmarxcruz, why do you use buildah instead of podman?10:31
*** dsneddon has quit IRC10:41
*** amoralej is now known as amoralej|lunch11:01
*** panda is now known as panda|eat11:25
arxcruzsshnaidm: Sorry, went for lunch, I’m using buildah because o don’t know how to use podman lol11:28
*** dsneddon has joined #oooq11:41
*** dsneddon has quit IRC11:47
*** udesale has quit IRC11:49
*** udesale has joined #oooq11:50
weshaysshnaidm when someone adds a new ansible tag to a playbook, where do we need to define in zuul jobs to ensure it runs?11:58
weshaydo we have it on the zuul job def? quickstart.sh tags still11:59
* weshay forgets11:59
weshayhrm.. never mind12:00
weshaythis is running w/ --tags all12:00
*** dsneddon has joined #oooq12:00
*** dsneddon has quit IRC12:05
mariosbrb12:07
weshaychandankumar panda|eat sshnaidm fyi.. not sure if you guys saw it.. but some of the rhel dlrn builds are coming in a full 30min after centos12:08
*** dsneddon has joined #oooq12:09
*** gkadam has quit IRC12:10
sshnaidmweshay, https://github.com/openstack/tripleo-ci/blob/master/zuul.d/undercloud-jobs.yaml#L4412:13
sshnaidmweshay, what does mean "coming in a full"?12:14
*** dsneddon has quit IRC12:16
*** dsneddon has joined #oooq12:17
sshnaidmmarios, can you please include link to snapshot in commit msg? https://review.rdoproject.org/r/#/c/21640/12:18
sshnaidmmarios, you can share dashboard to "snapshots.io"12:18
weshaysshnaidm so the rhel8 dlrn hash is not in repo for roughly 30min after it's present in centos-7 trunk12:20
weshaymake sense?12:20
mariossshnaidm: ack yeah i did it a little while ago was gonna add to commit message12:20
mariossshnaidm: *=* 14:19:10 *=*=*= " " https://snapshot.raintank.io/dashboard/snapshot/CCKT6xOT1kEltOhXa2obA1UFtwvJvf7012:20
sshnaidmmarios, cool12:20
mariosrfolco|ruck: do you want 'voting' on the list of jobs? vote for it at https://review.rdoproject.org/r/#/c/21640 https://snapshot.raintank.io/dashboard/snapshot/CCKT6xOT1kEltOhXa2obA1UFtwvJvf7012:21
weshaysshnaidm looking at both dlrn servers now.. the time diff is about 15min12:21
weshayhttps://trunk.rdoproject.org/centos7-master/report.html vs https://trunk.rdoproject.org/rhel8-master/report.html12:21
sshnaidmweshay, ok12:22
weshaysshnaidm causes the update of tripleo-ci-testing in rhel8 to be skipped12:22
rfolco|ruckmarios, that would be useful indeed12:22
rfolco|ruckmarios, are you marios|rover ?12:22
*** dsneddon has quit IRC12:22
marios|roverrfolco|ruck: no he's an impostor12:22
rfolco|ruckor you talking to me as marios only12:22
marios|roverrfolco|ruck: yea its me12:23
mariosrfolco|ruck: really its me12:23
marios:D12:23
rfolco|rucklol12:23
weshaysshnaidm 2019-07-31 18:22:37.811308 | rdo-centos-7 | commit 348374f5d244990b3db6825c7d388339a3e0294f / distro 23df87739b135962420d319d6dce3fe46f9d752f combination not found in RHEL12:23
weshayhttp://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-7-master-promote-consistent-to-tripleo-ci-testing/85730c3/job-output.txt.gz12:23
*** amoralej|lunch is now known as amoralej12:24
sshnaidmweshay, that's bad12:25
sshnaidmweshay, it shouldn't publish for centos untill all are built12:26
rfolco|ruckmarios, did you fix the broken link 'FAILURE' too?12:26
weshaysshnaidm it's bad sure.. but for now we have to account for it.. I think rlandy has a patch up adjust the timeout/retry on that task12:26
weshaybut I don't see it atm12:26
mariosrfolco|ruck: i did not. please comment there and i can include it12:26
sshnaidmweshay, retry for 30 min?12:27
mariosrfolco|ruck: i fixed and added some more links though, under the descriptions...12:27
weshaysshnaidm panda|eat take a look at review.rdoproject.org/config/playbooks/tripleo-ci-base-promote-consistent-to-tripleo-ci-testing/run.yaml@master12:27
rfolco|ruckmarios, I tried to fix it once... its not that easy I guess12:27
sshnaidmweshay, do prodchain know about this problem?12:27
rfolco|ruckmarios, ok will comment there12:27
weshayyou find the retries for fedora/rhel there...  we can remove fedora.. but we'll want to adjust rhel to get the ball moving..   and yes we can lean on prodchain but I'm not sure if they will be able to fix that12:28
weshayso first thing to-do is adjust our wait to be 30min12:28
weshaywish rlandy was on12:28
sshnaidmweshay, she added 20*30=600 seconds delay12:30
weshayah k12:30
weshaythanks12:30
weshaythe job has not run since last night12:30
sshnaidmweshay, so how many to add?12:30
mariossshnaidm: rfolco|ruck: links don't show in the snapshot though unfortunately it said they are ommitted when generating it12:30
*** jdennis has quit IRC12:31
sshnaidmweshay, she added 9 days ago12:31
weshaysshnaidm 1800 for now12:31
weshay30 min12:31
sshnaidmmarios, that's fine12:31
*** rlandy has joined #oooq12:31
sshnaidmweshay, oh, I see she added yesterday, just updated..12:33
sshnaidmjobs should run since then12:33
*** panda|eat is now known as panda12:34
pandawow, delays of up to 30 minutes in the promotion pipeline :(12:34
*** jpena is now known as jpena|off12:34
weshaypanda ya.. so we'll work on it.. better to get it running first12:35
weshaypanda why are images not getting uploaded?12:35
* weshay jumps on a node to check the rcm server12:35
weshayovercloud images12:35
pandaweshay: mhhh, the upload part is not running, will post a fix.12:40
rlandysshnaidm: hey - guess you found my patches from yesterday12:43
sshnaidmrlandy, hi, thanks, running it now with all deps12:44
rlandysshnaidm: do we need the duplicate image definitions in the ovb settings file?12:44
weshayrlandy and others... I had a situation yesterday about a 3rd party ansible role for tls12:44
weshaysshnaidm marios panda ^12:45
mariosweshay: which bit12:45
rlandysituation?12:45
sshnaidmfor tls?12:45
weshayit led me down a different kind of path to get this role in w/o violating upstream policy or impacting unrelated jobs12:45
weshaysshnaidm ya12:45
rlandycan we discuss at meeting?12:45
weshaysure12:45
weshaywill raise it briefly there12:45
sshnaidmweshay, do you have a link?12:46
mariosrlandy: +1 yeah its only few mins now12:46
rlandy"situation" never equals good :(12:46
zbrsshnaidm: re extra_node: 1 -- do you want me to also call it with 0, so we cover both cases?12:46
sshnaidmzbr, no, when 0 it's just skipped12:46
zbrsshnaidm: ok. but ideally we should test import of role with default params (default is 0). anyway, it can be added later.12:47
sshnaidmzbr, we need verifiers also, but it's for followups12:47
zbrsshnaidm++ better with smaller steps.12:47
*** ratailor has quit IRC12:48
pandais this a duplicate  ? https://review.rdoproject.org/r/2167712:50
weshayrfolco|ruck need anything from me?12:51
weshayrfolco|ruck I suspect gate failures are related to ovh cloud12:51
weshayrfolco|ruck actually not gate failures for 8/1 thus far12:52
*** dsneddon has joined #oooq12:52
*** jdennis has joined #oooq12:53
rfolco|ruckweshay, yeah gate is clean but rdo has multiple bugs12:54
rfolco|ruckweshay, just filed 212:54
rfolco|ruckNEW! bug https://bugs.launchpad.net/tripleo/+bug/1838631 - overcloud deploy: Error in 38 output role_data12:54
openstackLaunchpad bug 1838631 in tripleo "overcloud deploy: Error in 38 output role_data" [Critical,Triaged]12:54
rfolco|ruckNEW! bug https://bugs.launchpad.net/tripleo/+bug/1838633 - [nova placement] no version was discoverable12:54
weshayrfolco|ruck k.. fyi.. you can let queens bleed red a little ..12:54
openstackLaunchpad bug 1838633 in tripleo "[nova placement] no version was discoverable" [Undecided,Triaged]12:54
rfolco|ruckhttps://bugs.launchpad.net/tripleo/+bug/1838633 is critical12:55
openstackLaunchpad bug 1838633 in tripleo "[nova placement] no version was discoverable" [Critical,Triaged]12:55
*** jaosorior has joined #oooq12:58
*** tosky has quit IRC13:10
*** skramaja has quit IRC13:10
*** tosky has joined #oooq13:10
*** jpena|off is now known as jpena13:16
*** jrist has joined #oooq13:17
*** dsneddon has quit IRC13:59
rfolco|ruckmarios, rlandy arxcruz sshnaidm panda weshay zbr: ruck begging review time14:17
rfolco|ruckdisable fedora in all pipelines:14:17
rfolco|ruckhttps://review.rdoproject.org/r/21668 Disable fedora jobs in all pipelines (config)14:17
rfolco|ruckhttps://review.rdoproject.org/r/21667 Disable fedora jobs in all pipelines (rdo-jobs)14:17
rfolco|ruckfix voting gating jobs:14:17
rfolco|ruckhttps://review.opendev.org/673842 Vote and gate on containers-multinode-branchful jobs14:17
rfolco|ruckhttps://review.rdoproject.org/r/21663 Make fs053 job vote again14:17
rfolco|ruckhttps://review.opendev.org/673886 Remove scen009 (non-voting) from gate14:17
rfolco|ruckreview please ^^14:17
sshnaidmrfolco|ruck, please rebase patches that need rebase14:17
rfolco|rucksshnaidm, oh I thought I've had done14:18
rfolco|ruckwill do thx14:18
rlandyrfolco|ruck: why depricated jobs?14:19
rfolco|ruckrlandy, just not to delete all job definitions... we disable and keep them in a separate file for now14:20
rfolco|ruckrlandy, safer14:20
rlandyrfolco|ruck: yeah - so requires rebase so we can merge14:24
rlandyany merge order here?14:24
rlandyno deps14:24
rfolco|ruckno deps but I'd first merge https://review.rdoproject.org/r/#/c/21668/ that removed from pipeline14:24
rfolco|ruckthan the one in rdo-jobs14:24
rfolco|ruckrebased https://review.rdoproject.org/r/21668 rlandy sshnaidm14:25
rfolco|ruckit won't break if we merge https://review.rdoproject.org/r/#/c/21667/ first, but disabling in pipeline is more critical14:27
sshnaidmmarios, rfolco|ruck do you know why periodic master jobs didn't run today?14:28
sshnaidmweshay, ^14:28
*** vinaykns has joined #oooq14:28
rlandysshnaidm: let's just merge14:28
rlandyand deal with the damage14:29
sshnaidmrlandy, merge what?14:29
weshaysshnaidm not yet14:29
rlandyhttps://review.rdoproject.org/r/21668 and https://review.rdoproject.org/r/2166714:29
*** dsneddon has joined #oooq14:29
rfolco|ruckrlandy, do you forecast any damage?14:30
rlandyrfolco|ruck: idk14:30
rfolco|ruckah ok14:30
rlandyI approved both of them'14:30
rfolco|ruckgot it14:30
rfolco|ruckcool thx14:30
rlandyI want to w+14:30
rlandyif sshnaidm has no objection14:31
rfolco|rucksshnaidm, oh crap skipped all periodic today....14:31
sshnaidmrlandy, I did14:31
sshnaidmrfolco|ruck, how?14:31
*** jfrancoa has quit IRC14:31
rlandycool14:31
rfolco|rucksshnaidm, idk14:31
sshnaidmrfolco|ruck, we talk in #sf-ops14:32
*** Vorrtex has joined #oooq14:33
*** dsneddon has quit IRC14:34
mariossshnaidm: wut.. no i do not.. is it stuck again/ sorry was on call checking14:38
mariossshnaidm: i see some runs in https://review.rdoproject.org/zuul/builds14:40
mariossshnaidm: openstackperiodic-latest-released14:40
sshnaidmmarios, not master though14:41
mariossshnaidm: right... but it isn't stuck either so not sure whats going on https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-master14:42
*** ykarel has joined #oooq14:43
*** jaosorior has quit IRC14:46
sshnaidmrfolco, better to rename existing job to  periodic-tripleo-rhel-8-containers-build-push-master14:51
pandarfolco|ruck: you have a +2 and a -1 from me in opendev14:53
panda#roastme https://review.rdoproject.org/r/#/c/21592/ https://review.rdoproject.org/r/#/c/21535/ https://review.rdoproject.org/r/#/c/21579/14:53
ykarelrfolco|ruck, marios is this known why openstack-periodic-master didn't kicked in last run at 12:10 UTC?14:53
sshnaidmrfolco|ruck, ah, no,  we have the same pattern for periodic-tripleo-centos-7-master-containers-build-push14:54
sshnaidmykarel, yeah, error in config repo14:54
mariosykarel: no i don't know... it isn't stuck... rfolco|ruck are you on this yet?14:54
rfolco|ruckwe are fixing14:54
ykarelsshnaidm, okk are u seeing error somewherre?14:54
rfolco|ruckzuul logs only14:54
ykareli see https://review.rdoproject.org/zuul/api/config-errors14:54
sshnaidmykarel, jpena checked in zuul logs14:54
mariosack thanks rfolco|ruck14:54
ykarelrfolco|ruck, sshnaidm, okk Thanks14:55
sshnaidmykarel, it's dependency on non-existing job and seems like config check doesn't check it14:55
ykarel:(14:55
rfolco|rucksshnaidm, please clarify this comment ... forgive my limitation to understand it14:55
rfolco|ruck<sshnaidm> rfolco|ruck, ah, no,  we have the same pattern for periodic-tripleo-centos-7-master-containers-build-push14:55
sshnaidmrfolco|ruck, I mean we need the same name pattern as we have in centos14:56
sshnaidmperiodic-tripleo-centos-7-master-containers-build-push -> periodic-tripleo-rhel-8-master-containers-build-push14:56
rfolco|rucksshnaidm, periodic-tripleo-rhel-8-master-containers-build-push14:57
rfolco|ruckok14:57
rfolco|ruckI thought you were saying "hell no! we don't have this job defined (periodic-tripleo-rhel-8-master-containers-build-push)"14:57
rfolco|ruckok got it, just adding extra master to job name in dependencies14:57
*** aakarsh has joined #oooq15:01
*** dsneddon has joined #oooq15:03
*** aakarsh|2 has joined #oooq15:03
*** ratailor has joined #oooq15:05
*** aakarsh has quit IRC15:06
*** ykarel is now known as ykarel|away15:08
*** dsneddon has quit IRC15:10
*** Vorrtex has quit IRC15:12
rlandyarxcruz: any concern if we merge https://review.rdoproject.org/r/#/c/21659/?15:16
*** ykarel|away has quit IRC15:17
rlandyzbr: ^^?15:17
*** ykarel|away has joined #oooq15:17
*** ykarel|away has quit IRC15:18
*** ykarel|away has joined #oooq15:19
*** ykarel|away has quit IRC15:20
*** ykarel|away has joined #oooq15:20
*** Goneri has quit IRC15:23
rlandypanda; you around?15:25
rlandyhttps://review.rdoproject.org/r/#/c/21677/15:25
*** Vorrtex has joined #oooq15:25
rlandyrebasing this - ok to merge?15:25
pandarlandy: yes15:29
*** dsneddon has joined #oooq15:33
*** jpena is now known as jpena|off15:36
*** ykarel|away has quit IRC15:36
*** bogdando has quit IRC15:40
*** dsneddon has quit IRC15:42
*** ccamacho has quit IRC15:43
chandankumarweshay: rlandy I was travelling with yatin to blr15:48
zbrrlandy: i do have some concerns.  i am working on doing some testing on it.15:49
*** jtomasek has joined #oooq15:51
*** amoralej is now known as amoralej|off15:52
*** gkadam has joined #oooq15:57
marios|roverpanda: arxcruz weshay i've added my questions in that doc (meeting we had couple hours ago) fyi thanks15:57
rlandypanda: wanted to merge https://review.rdoproject.org/r/#/c/21677/15:58
rlandyrebasing15:58
*** gkadam has quit IRC16:01
rlandyrebased16:01
rlandypanda: ok to merge?16:01
pandarlandy: yes16:03
rlandyk - will w+ once zuul votes16:03
*** jpena|off is now known as jpena16:05
*** jpena is now known as jpena|off16:07
*** ratailor has quit IRC16:11
*** dsneddon has joined #oooq16:17
*** marios has quit IRC16:18
*** marios|rover has quit IRC16:18
*** dsneddon has quit IRC16:25
*** dtantsur is now known as dtantsur|afk16:38
zbrsshnaidm: is https://review.rdoproject.org/r/#/c/21589 ok now?16:39
sshnaidmzbr, +2 and commented16:43
*** sshnaidm is now known as sshnaidm|afk16:46
zbrsshnaidm|afk: what kind of error are you getting locally?16:55
rlandypanda: these jobs?16:56
rlandy    https://review.rdoproject.org/r/#/c/21592/  Split periodic buildimage definition16:56
rlandy    https://review.rdoproject.org/r/#/c/21535/ add buildimage rhel8 check jobs16:56
rlandy    https://review.rdoproject.org/r/#/c/21579/ Tripleo: add triggers for 3rd party build images jobs16:56
*** derekh has quit IRC17:01
*** dsneddon has joined #oooq17:07
rlandyugh - need to know if I am rebasing these jobs correctly17:09
*** dsneddon has quit IRC17:12
*** udesale has quit IRC17:14
rfolco|ruckweshay, zbr arxcruz rlandy panda: pls review https://review.opendev.org/#/c/673842/ and https://review.opendev.org/#/c/673886/17:17
pandarlandy: small fix in 2159217:18
rlandypanda: I merged that job incorrectly17:18
pandarlandy: merged ?17:19
rlandysorry rebased17:20
rlandybut you fixed it17:20
rlandygreat17:20
rlandycan those jobs go?17:20
rlandyso many jobs - I have no idea what order these need to go in17:20
pandarlandy: where's the etherpad with the tree of dependencies :)17:21
pandarlandy: anyway 21592 goes first17:21
pandarlandy: should be a noop, just a different reparenting17:21
pandarlandy: 21535 can go next, just adding definitons for jobs17:22
pandarlandy: /21579 is what should trigger the check jobs in upstream repos17:22
rlandypanda: https://etherpad.openstack.org/p/rhel8-reviews17:22
rlandytrying to just get the reviews on there first17:22
rlandyunmerged reviews17:23
pandarlandy: they could pollute a bit the gerrit resutls, if they are configured correctly, but none of them is voting, and non of them could gate anyway17:23
rlandypanda: ok - so mergeable17:23
rlandylet's start here https://review.rdoproject.org/r/#/c/21592/17:24
*** kopecmartin is now known as kopecmartin|off17:24
rlandyzbr: pls leave a note on https://etherpad.openstack.org/p/rhel8-reviews when you are ok with merging https://review.rdoproject.org/r/#/c/21659/17:25
pandaooh see that change / watch that jobs / dig in the merging queen17:28
weshayrlandy no need check it now.. but that way of injecting a role is working :)  I list out all the roles in the path and it shows up17:32
weshayin ci17:32
rlandyweshay++17:32
weshayrlandy using line 36 https://review.opendev.org/#/c/673926/3/playbooks/third_party_clone_keycloak.yml17:33
rlandyI agree with that methodology17:33
weshayer.. 3317:33
rlandypanda: https://review.rdoproject.org/r/#/c/21535/ is merging17:33
weshayseems to be pretty pin point..17:33
rlandyor forever hold your peace17:33
rlandyweshay: will look in a bit - too busy trying to do merge damage all over the repos17:34
weshayrlandy np np17:34
* rlandy is armed with +2 and dangerous17:36
*** dsneddon has joined #oooq17:37
*** dsneddon has quit IRC17:42
rlandypanda: templates definition? see failure https://review.rdoproject.org/r/#/c/21579/17:45
rlandywhere is that?17:45
*** dsneddon has joined #oooq17:45
rlandypanda: also can cards 1171 and 1172 go to done?17:45
pandarlandy: right, there's no template, must have lost it in the last change17:47
rlandylast change?17:47
rlandyit's usually in a diff file17:47
pandarlandy: 1171 and 1171 done only when we see overcloud images uploaded17:50
rlandypanda: k - you adding the template or am I?17:50
*** dsneddon has quit IRC17:51
sshnaidm|afkrlandy, we reached step of introspection with rhel8 where it fails: http://logs.rdoproject.org/49/21649/15/check/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-master/f605946/logs/undercloud/home/zuul/overcloud_prep_images.log.txt.gz17:52
pandarlandy: just a minute, I have a puppet in my left hand.17:52
sshnaidm|afkrlandy, can you please take a look tomorrow what are issues there?17:52
pandaand writing asible with the right hand17:53
rlandysshnaidm|afk: yep - will check it out17:54
rlandyFailure caused by error in tasks: send_message\n\n  send_message [task_ex_id=65e87114-8afb-45ee-bdf1-1a6124c486f3] -> Workflow failed due to message status. Status:FAILED Message:({\'result\': \'Node dee7ce4b-be65-4e68-9482-d76cb9555cee did not reach state "manageable", the state is "enroll", error: Failed to get power state for node dee7ce4b-be65-4e68-9482-d76cb9555cee. Error: IPMI call failed: power status.17:54
rlandyno IPMI17:54
*** dsneddon has joined #oooq17:55
*** tosky has quit IRC18:01
pandarlandy: https://review.rdoproject.org/r/2168018:01
pandarlandy: removed "master" from the names, as check this jobs are branchless18:02
rlandylooking18:02
rlandyhttps://review.rdoproject.org/r/#/c/21680/1/zuul.d/buildimage.yaml - the parent is master though18:04
pandarlandy: yes, we would need an additioanl correction, in config, we can do it later18:05
rlandypanda: ok - let's go with this18:09
rlandynoted the additional change18:09
rlandypanda: holding off merging https://review.rdoproject.org/r/#/c/21579/  - want to see the job run once18:16
rlandyugh - config - never mind18:17
rlandyzbr: abandon this? https://review.rdoproject.org/r/#/c/21463/18:18
*** Vorrtex has quit IRC18:27
rlandypanda: ok - etherpad complete afaict ... https://etherpad.openstack.org/p/rhel8-reviews18:29
rlandyrebasing https://review.rdoproject.org/r/#/c/21593/18:30
rlandymaster periodic is running18:31
rlandyrfolco|ruck: panda: weshay: ^^18:31
rlandylet's see if we get updated rhel artifacts18:32
weshay:)18:32
rlandy2019-08-01 18:22:35.872409 | rdo-centos-7 | Checking existence of commit c10329fc0e6846b9b387a977a366bf28ab8bfe5a / distro 23df87739b135962420d319d6dce3fe46f9d752f in RHEL18:40
rlandy2019-08-01 18:22:38.195321 | rdo-centos-7 | commit c10329fc0e6846b9b387a977a366bf28ab8bfe5a / distro 23df87739b135962420d319d6dce3fe46f9d752f combination not found in RHEL18:40
*** Vorrtex has joined #oooq18:43
rlandypanda: ping - still around?18:52
rlandy2019-08-01 18:44:29.943092 | TASK [Create SSH private key from secret]19:00
rlandy2019-08-01 18:44:29.993271 | primary | ERROR19:00
rlandy2019-08-01 18:44:29.993600 | primary | {19:00
rlandy2019-08-01 18:44:29.993671 | primary |   "msg": "The task includes an option with an undefined variable. The error was: 'uploader_ssh_key' is undefined\n\nThe error appears to have been in '/tmp/tmplvic8e00/56bd74619c6c41b280595a6cd9156774/trusted/project_0/review.rdoproject.org/config/playbooks/tripleo-ci-periodic-base-upload/post.yaml': line 14, column 9, but may\nbe elsewhere in the file depending on the exact syntax19:00
rlandyproblem.\n\nThe offending line appears to be:\n\n\n      - name: Create SSH private key from secret\n        ^ here\n"19:00
rlandy2019-08-01 18:44:29.993740 | primary | }19:00
weshayis that for the login?19:01
weshayto the registry19:01
rlandyweshay: bj?19:03
weshayrlandy sure19:03
rlandyjoining19:03
*** jtomasek has quit IRC19:05
*** dsneddon has quit IRC19:08
*** jschluet has joined #oooq19:21
*** jschlueter has quit IRC19:21
*** tesseract has quit IRC19:23
*** pipr has quit IRC19:23
rlandyweshay: https://review.rdoproject.org/r/#/c/21682/19:34
rlandypanda: ^^ if you are around19:35
pandarlandy: ack19:37
zbrrlandy: thanks for abandoning the obsolete one on ovb. we only need to merge https://review.rdoproject.org/r/#/c/21589/ now to close the subject.19:38
pandarlandy: ok to merge ?19:39
rlandypnad: we will have to merge it19:39
rlandypanda:19:39
rlandyputting in a testproject job to try test after merge19:39
pandarlandy: ok, merging then19:40
*** dsneddon has joined #oooq19:41
rlandypanda: thanks19:42
rlandyhttps://review.rdoproject.org/r/2168319:44
rlandypanda: test job ^^19:44
*** jtomasek has joined #oooq19:57
*** radez has quit IRC20:03
rlandy2019-08-01 20:02:11.567169 | primary |   "msg": "The task includes an option with an undefined variable. The error was: 'site_logs' is undefined\n\nThe error appears to have been in '/tmp/tmp9_x_7sup/d7d9437b678f4aca9f904bbf303c9f62/trusted/project_0/review.rdoproject.org/config/playbooks/tripleo-ci-periodic-base-upload/post.yaml': line 14, column 9, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe20:04
rlandyoffending line appears to be:\n\n\n      - name: Create SSH private key from secret\n        ^ here\n"20:04
rlandy2019-08-01 20:02:11.567227 | primary | }20:04
rlandyweshay: ^^20:04
*** amoralej|off has quit IRC20:04
weshaylooking20:04
weshayoh20:05
rlandyit's defined20:05
rlandy    secrets:20:05
rlandy      - site_logs20:05
rlandy      - dlrnapi20:05
*** jtomasek has quit IRC20:06
rlandy?20:06
weshayya..  do you need to add that to test_project version?20:06
weshayrlandy oh..  maybe parent the test_project job to the abstract-base?20:07
weshayI'm guessing20:07
rlandyit is20:09
weshayrlandy so for shit's and giggles redefine it in test project one20:11
* rlandy is thinking20:11
rlandyoh20:12
rlandyoh20:12
rlandyoh20:12
rlandymaybe it needs to be defined with the playbook20:12
rlandyweshay: bj again or 5 mins?20:16
weshaysure20:16
rlandysorry - but I want to get this right20:16
rlandyjoined20:16
*** tosky has joined #oooq20:17
rlandyweshay:  https://review.rdoproject.org/r/2168420:22
*** Vorrtex has quit IRC20:40
rlandyweshay: ping20:56
rlandyperiodic-tripleo-rhel-8-buildimage-overcloud-full-masterSUCCESS in 19m 24s20:57
rlandychecking image20:57
rlandy2019-08-01 16:51:26.979970 | primary | Error loading key "/tmp/ansible.glkyesh2": invalid format20:57
rlandy2019-08-01 16:51:27.013445 | primary | + export FULL_HASH=65570a311e1303d8084d12ee82868e6d0f411e8a_4125074020:58
rlandy2019-08-01 16:51:27.013468 | primary | + FULL_HASH=65570a311e1303d8084d12ee82868e6d0f411e8a_4125074020:58
rlandysame old hash20:58
rlandyhttp://logs.rdoproject.org/83/21683/4/check/periodic-tripleo-rhel-8-buildimage-overcloud-full-master/143ccfb/job-output.txt.gz20:58
weshayok..  still running?20:59
weshaydid it upload?20:59
weshayoh I see21:02
weshay2019-08-01 16:51:26.979970 | primary | Error loading key "/tmp/ansible.glkyesh2": invalid format21:02
rlandyweshay: trying to check upload21:02
weshayright21:02
rlandyom promoter server21:03
weshaylooks like it didn't build21:03
weshay2019-08-01 16:51:27.009811 | primary | ls: cannot access '*.tar': No such file or directory21:03
rlandyhttp://logs.rdoproject.org/83/21683/4/check/periodic-tripleo-rhel-8-buildimage-overcloud-full-master/143ccfb/logs/script_build.log'21:03
rlandyit did build21:03
weshayinto /home/zuul21:03
weshay?21:03
rlandyand it doesn't say undefined key21:03
rlandyhttp://logs.rdoproject.org/83/21683/4/check/periodic-tripleo-rhel-8-buildimage-overcloud-full-master/143ccfb/overcloud-full.log21:04
rlandy2019-08-01 20:51:21.452 | Image file ./overcloud-full.qcow2 created...21:04
rlandy2019-08-01 20:51:21.699 | Build completed successfully21:04
weshayrlandy maybe it didn't tar21:04
rlandy | primary | ls: cannot access '*.tar': No such file or directory21:05
weshayya21:06
weshayrlandy at this point... we have to check the old w/ the new21:06
weshayI thought this might happen21:06
*** vinaykns has quit IRC21:06
weshayrlandy blue?21:06
rlandyk21:06
rlandyalready a when on that playbook - thinking21:28
*** aakarsh|2 has quit IRC21:35
rlandyweshay: https://review.rdoproject.org/r/21686 Add tar and md5 sums required for upload21:39
rlandythoughts?21:39
weshayrlandy give it a go :)22:03
rlandylinter failure22:03
rlandyneed to fix22:04
rlandysec22:04
rlandytar used in place of unarchive module22:07
*** tosky has quit IRC22:07
rlandyweshay: linters want me to use ansible archive https://docs.ansible.com/ansible/2.4/archive_module.html but I just want .tar extension22:09
rlandyhttps://docs.ansible.com/ansible/latest/modules/archive_module.html22:10
rlandyah22:10
rlandyok22:10
rlandyweshay: k - linters are happy22:18
rlandylet's try it22:18
rlandyself-merge party going on here22:19
rlandytestproject job running22:20
weshayk22:29
*** jpenag has joined #oooq22:36
*** aakarsh has joined #oooq22:36
*** jpena|off has quit IRC22:37
*** dtantsur|afk has quit IRC22:37
*** panda has quit IRC22:41
*** panda has joined #oooq22:42
rlandyugh22:42
rlandyfixing22:42
rlandyweshay: https://review.rdoproject.org/r/#/c/21687/22:54
rlandymaybe you have a better idea?22:54
* rlandy brb23:00
rlandyweshay: you there?23:26
weshayrlandy sorry was on kid duty23:52
weshaylet's pick it up tomorrow23:55
rlandyweshay: no worries23:57
rlandytrying another path23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!