| *** sanjayu__ has quit IRC | 00:19 | |
| *** udesale has joined #oooq | 03:12 | |
| *** jmasud has quit IRC | 03:21 | |
| *** jmasud has joined #oooq | 03:23 | |
| *** skramaja has joined #oooq | 03:42 | |
| *** ykarel|away has joined #oooq | 03:54 | |
| *** udesale has quit IRC | 04:13 | |
| *** ratailor has joined #oooq | 04:18 | |
| *** ysandeep|away is now known as ysandeep | 04:24 | |
| *** ykarel|away is now known as ykarel | 04:38 | |
| *** skramaja has quit IRC | 04:38 | |
| *** skramaja has joined #oooq | 04:39 | |
| *** ratailor has quit IRC | 05:06 | |
| *** ratailor has joined #oooq | 05:07 | |
| *** marios has joined #oooq | 05:08 | |
| *** ratailor has quit IRC | 05:11 | |
| *** udesale has joined #oooq | 06:24 | |
| *** apetrich has joined #oooq | 06:53 | |
| *** apetrich has quit IRC | 06:55 | |
| *** apetrich has joined #oooq | 06:56 | |
| *** jtomasek has joined #oooq | 07:02 | |
| *** amoralej|off is now known as amoralej | 07:07 | |
| *** saneax has joined #oooq | 07:24 | |
| *** bogdando has joined #oooq | 07:28 | |
| *** ysandeep is now known as ysandeep|lunch | 07:34 | |
| *** saneax has quit IRC | 07:44 | |
| *** jpena|off is now known as jpena | 07:44 | |
| matbu | jpena: o/ morning can we merged this cherry pick ? https://review.rdoproject.org/r/#/c/29131/ | 07:52 |
|---|---|---|
| matbu | marios: o/ hey dude, another CI expertise question... do we build master branches somewhere with delorean ? I wanted to check something | 07:53 |
| matbu | jpena: thank you | 07:53 |
| marios | matbu: yeah maybe you are referring to 'current' ? | 07:55 |
| marios | sec will fetch link | 07:56 |
| marios | matbu: so e.g. https://trunk.rdoproject.org/centos8-master/ ... 'current' is the latest commits from the projects | 07:56 |
| marios | matbu: https://trunk.rdoproject.org/centos8-master/current/delorean.repo | 07:56 |
| matbu | marios: from all of us ? i'm surprised because the delorean.repo contains per component path | 07:57 |
| marios | matbu: yeah for centos8 it is all 'component' based... you want the tripleo component then ? | 07:57 |
| marios | https://trunk.rdoproject.org/centos8/component/tripleo/05/04/0504cf2dbff1003ecd27744ce2555cda257effc2_2dfb8295/ | 07:58 |
| marios | matbu: that ^ | 07:58 |
| matbu | marios: actually i wanted validation component (i'm looking for validation package) | 07:58 |
| marios | openstack-tripleo-validations-12.4.1-0.20200910204932.928fcb0.el8.noarch.rpm | 07:58 |
| marios | matbu: ^^? | 07:58 |
| matbu | marios: https://trunk.rdoproject.org/centos8/component/validation/94/6e/946e3a858686564c9c2c2e5cf5b479655a9adfc4_d9a985ba/ | 07:58 |
| marios | matbu: ack i was going to ask... if you want openstack-tripleo-validations then tripleo component | 07:59 |
| matbu | marios: but it pin the tag | 07:59 |
| marios | matbu: but if you want python3-validations then the one you pointed | 07:59 |
| marios | ah also validations-common in there ... k | 07:59 |
| matbu | marios: yep and not sure if it's the latest master commit | 08:00 |
| matbu | i will check that | 08:00 |
| matbu | ha nop it's pinning the latest version | 08:01 |
| matbu | marios: do you know where this component pipeline is defined and where i can play with it ? (modify thing, adding test and so on) | 08:02 |
| matbu | sorry for bugging you about that on a friday morning :D | 08:02 |
| marios | matbu: np but what do you want? e.g. to run a job? | 08:02 |
| matbu | marios: well i want to see why it's not building last master commit and see how we can add job to test things | 08:03 |
| matbu | eventually run a job yes | 08:03 |
| matbu | few years ago all of that was in centos ci but i guess it has changed | 08:03 |
| marios | matbu: yeah let me fetch you something for validation component | 08:03 |
| marios | matbu: https://review.rdoproject.org/r/gitweb?p=config.git;a=blob;f=zuul.d/upstream.yaml#l493 https://review.rdoproject.org/r/gitweb?p=rdo-jobs.git;a=blob;f=zuul.d/project-templates-components.yaml#l425 https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/component-jobs.yaml#L1134 | 08:05 |
| matbu | marios: hmm thank you | 08:08 |
| matbu | marios: i will look into that, for example i see validation-ussuri which is not relevant since we are branchless in VF | 08:09 |
| matbu | just the branch ussuri remain on the repos, but we need to drop it | 08:09 |
| *** ysandeep|lunch is now known as ysandeep | 08:36 | |
| *** ssbarnea has joined #oooq | 08:38 | |
| *** derekh has joined #oooq | 08:42 | |
| *** tosky has joined #oooq | 08:47 | |
| *** pojadhav is now known as pojadhav|afk | 08:55 | |
| akahat | marios, bhagyashri|rover i'm updating panda's patch (Promoter new configuration engine: stage environment).. hoping that it will fix the log file issue. | 08:56 |
| marios | akahat: which log file issue? I am working on the py36 test specifically test_promoter_functional.py::test_promote_qcows[qcow_legacyconf_single] (I know what the problem is now and trying to fix it) | 08:57 |
| marios | akahat: are you working on tripleo-ci-promotion-staging-single-pipeline-centos-8 ? | 08:58 |
| akahat | marios, yes. that's right. | 09:00 |
| marios | akahat: ack ok cool well, lets see if we can work around each other, i am focusing on the py36. i will check with you before updating again working locally for now | 09:01 |
| akahat | marios, okay. | 09:01 |
| *** ssbarnea has quit IRC | 09:06 | |
| marios | akahat: please be careful otherwise we can't work at the same time https://review.rdoproject.org/r/#/c/28081/61..62/ci-scripts/dlrnapi_promoter/test_ini_files_validation.py | 09:10 |
| marios | akahat: looks like you didn't have the latest version before pushing your updates | 09:11 |
| marios | akahat: https://review.rdoproject.org/r/#/c/28081/61..62/ci-scripts/dlrnapi_promoter/test_ini_files_validation.py | 09:11 |
| akahat | marios, oops.. | 09:11 |
| akahat | let me fix it.. | 09:11 |
| marios | akahat: ack | 09:12 |
| akahat | marios, fixed it.. thanks.. i'll take care next time :) | 09:15 |
| marios | akahat: ack | 09:15 |
| *** ratailor has joined #oooq | 09:16 | |
| marios | akahat: i'll wait for the run and i will update something minor for the py36 tests | 09:16 |
| marios | akahat: k? | 09:16 |
| akahat | marios, yes. sure | 09:16 |
| *** chem has joined #oooq | 09:18 | |
| *** jtomasek has quit IRC | 09:28 | |
| marios | akahat: going to update | 09:31 |
| akahat | marios, okay.. i think i need to add expanduser.. i'll update in next run. | 09:31 |
| marios | akahat: ack gimme couple mins grabbing v63 to update | 09:31 |
| akahat | sure. | 09:32 |
| marios | akahat: k done please wait for the run before updating again | 09:33 |
| marios | akahat: oops nit updating again sec | 09:34 |
| marios | akahat: k now done ;) | 09:34 |
| *** saneax has joined #oooq | 09:35 | |
| akahat | marios, i like promoter jobs.. it's not taking too much time :) | 09:36 |
| *** ykarel is now known as ykarel|lunch | 09:36 | |
| marios | akahat: ;) | 09:39 |
| *** sanjayu_ has joined #oooq | 09:41 | |
| *** saneax has quit IRC | 09:42 | |
| akahat | marios, you and me are on same page :) | 09:42 |
| bhagyashri|rover | akahat, ack | 09:47 |
| marios | akahat: looks like it breaks the py36 test I mean the update you made ... ERROR promoter:common.py:164 Invalid Log file: /home/zuul/web/promoter_logs/centos8_master.log https://logserver.rdoproject.org/81/28081/65/check/tox-py36-ci-config/9d7161d/tox/reports.html | 09:48 |
| marios | akahat: does it fix what you were chasing? | 09:48 |
| akahat | marios, yes.. | 09:50 |
| akahat | marios, sending review.. | 09:53 |
| akahat | marios, i messed up.. fixing. | 09:54 |
| marios | akahat: ack | 09:56 |
| marios | akahat: no akahat please be careful you are overwriting my changes again | 09:57 |
| marios | https://review.rdoproject.org/r/#/c/28081/65..66/ci-scripts/dlrnapi_promoter/qcow_client.py | 09:57 |
| marios | akahat: T^ | 09:57 |
| marios | https://review.rdoproject.org/r/#/c/28081/65..66/ci-scripts/dlrnapi_promoter/test_promoter_functional.py | 09:57 |
| marios | ! | 09:57 |
| akahat | marios, yes.. i fetched your patch first.. then updated the changes.. don't know how it got override. | 09:58 |
| akahat | :( | 09:58 |
| marios | akahat: k please restore | 09:58 |
| marios | akahat: thanks | 10:04 |
| *** ratailor_ has joined #oooq | 10:09 | |
| akahat | marios, quick question: why there are two os.stat https://review.rdoproject.org/r/#/c/28081/67/ci-scripts/dlrnapi_promoter/promoter_integration_checks.py@257 and 251 | 10:10 |
| *** ratailor has quit IRC | 10:11 | |
| marios | akahat: i don't know i didn't touch that code... looks like there are chained exceptions though maybe panda can tell us more later | 10:14 |
| marios | akahat: well... the extra one looks like an addition 'not from panda' https://review.rdoproject.org/r/#/c/28081/10..67/ci-scripts/dlrnapi_promoter/promoter_integration_checks.py | 10:14 |
| marios | akahat: added note for later | 10:15 |
| akahat | marios, okay.. sending review patch with some minor linting issues fixed. | 10:16 |
| marios | akahat: but still breaks the py36 tests https://logserver.rdoproject.org/81/28081/67/check/tox-py36-ci-config/ebc59aa/tox/reports.html ERROR promoter:common.py:164 Invalid Log file: /home/zuul/web/promoter_logs/centos8_master.log | 10:16 |
| marios | akahat: and we had the same discussion with bhagyashri|rover and panda but lets see on the call today | 10:16 |
| *** ykarel|lunch is now known as ykarel | 10:16 | |
| marios | akahat: imo we should leave the linting last but sure | 10:17 |
| marios | akahat: are you done with the single-pipeline stuff still failing | 10:17 |
| akahat | marios, let me test this one patch.. | 10:18 |
| bhagyashri|rover | marios, yes that day my concern was where exactly that file has been created i know the setup_logging() method. but afaik that method logs the content in the logfile which we passed to this method but before passing log_filr to setup_logging() method the file should be created | 10:19 |
| bhagyashri|rover | akahat, ^ | 10:19 |
| *** jmasud has quit IRC | 10:20 | |
| akahat | bhagyashri|rover, i think file is created by setup_logging() method.. we need to crate directory. | 10:22 |
| *** jmasud has joined #oooq | 10:22 | |
| bhagyashri|rover | akahat, we dont need to create directory that is been created here | 10:24 |
| bhagyashri|rover | 2020-09-11 10:04:50.228359 | LOOP [promoter : Create a directory for the promoter logs] | 10:24 |
| bhagyashri|rover | 2020-09-11 10:04:50.516537 | rdo-centos-8 | changed: "~/web/promoter_logs" | 10:24 |
| bhagyashri|rover | 2020-09-11 10:04:50.516972 | rdo-centos-8 | changed: All items complete | 10:24 |
| bhagyashri|rover | 2020-09-11 10:04:50.517058 | | 10:24 |
| akahat | bhagyashri|rover, oh.. okay.. | 10:32 |
| akahat | marios, you need to remove "\n" from ssh key otherwise it will fail. | 10:35 |
| akahat | https://logserver.rdoproject.org/81/28081/68/check/tox-py36-ci-config/3093def/job-output.txt | 10:35 |
| marios | akahat: thanks was switching to that one next, it should be the only failing test left (apart from the logfile stuffs but we can discuss those) | 10:38 |
| marios | akahat: well for py36 anyway | 10:38 |
| *** chem has quit IRC | 10:50 | |
| *** chem has joined #oooq | 10:53 | |
| akahat | marios, good news.. 1 job is remaining to fix. :) | 10:57 |
| marios | akahat: thanks i saw the update | 10:58 |
| marios | did it report already? | 10:58 |
| *** sanjayu__ has joined #oooq | 11:03 | |
| marios | akahat: looks like it still hit it | 11:04 |
| marios | https://logserver.rdoproject.org/81/28081/69/check/tox-py36-ci-config/b7c3929/tox/reports.html ERROR promoter:common.py:164 Invalid Log file: /home/zuul/web/promoter_logs/centos8_master.log | 11:04 |
| *** sanjayu_ has quit IRC | 11:05 | |
| marios | * Passed ci-scripts/dlrnapi_promoter/test_qcow_client_unit.py::TestQcowConnectionClient::test_instance_sftp_connect_close | 11:07 |
| marios | akahat: i am going to update now? is that OK or are you updating again for the logfile | 11:07 |
| akahat | marios, give me few mins.. i'm updating remaining places. | 11:08 |
| marios | akahat: ack let me know then np | 11:09 |
| marios | akahat: take yr time | 11:09 |
| akahat | marios, thanks :) | 11:09 |
| * chandankumar is stepiing out for an hour | 11:11 | |
| * zbr anyone up for a virtual coffee? | 11:14 | |
| marios | zbr: you stood me up 2x @ the watercooler so i'm gonna ghost you for a while | 11:15 |
| marios | zbr: instead i'm gonna do some cardio | 11:15 |
| zbr | good idea with cardio, true, we need to move it a little bit later. | 11:15 |
| marios | zbr: ;) | 11:15 |
| zbr | arx also requested that, and i observed that I do not always start the day at 8am | 11:16 |
| zbr | i am not sure how we can find good times for these | 11:17 |
| bhagyashri|rover | akahat, ahh i never thought on os.path.expanduser() great! | 11:17 |
| zbr | there is also an expandvars | 11:18 |
| *** jtomasek has joined #oooq | 11:28 | |
| *** sanjayu__ has quit IRC | 11:28 | |
| *** chem has quit IRC | 11:29 | |
| *** chem has joined #oooq | 11:31 | |
| * zbr out for lunch | 11:40 | |
| *** jpena is now known as jpena|lunch | 11:42 | |
| weshay|ruck | matbu, 0/ | 11:47 |
| weshay|ruck | need to check tags for validation rpms? | 11:48 |
| weshay|ruck | bhagyashri|rover, rfolco need some eyes on http://dashboard-ci.tripleo.org/d/wb8HBhrWk/cockpit?orgId=1 "upstream periodic jobs" | 11:58 |
| akahat | marios, hey.. i'm done with the patch... you can push your code. | 11:58 |
| akahat | marios, one more thing before you push.. when last time you tested that ssh key??? | 11:59 |
| marios | akahat: ack yes i changed the key i did not add it it was addd in v13 | 11:59 |
| marios | akahat: when i changed it locally it worked OK | 11:59 |
| akahat | marios, i mean this ssh key is not valid.. https://review.rdoproject.org/r/#/c/28081/70/ci-scripts/dlrnapi_promoter/test_unit_fixtures.py@44 one character is missing. | 12:00 |
| akahat | so it might not work.. you need to change the key. | 12:00 |
| marios | akahat: yes | 12:00 |
| marios | akahat: exactly i did and it works | 12:00 |
| marios | akahat: it should make py36 green, checking latest run | 12:00 |
| marios | akahat: i will update in a sec | 12:00 |
| marios | akahat: still one more on the log file issue? https://logserver.rdoproject.org/81/28081/70/check/tox-py36-ci-config/cf128ab/tox/reports.html | 12:01 |
| marios | ERROR promoter:common.py:164 Invalid Log file: /home/zuul/web/promoter_logs/centos8_master.log | 12:01 |
| *** rfolco|ruck has joined #oooq | 12:01 | |
| marios | akahat: are you done updating or will you do that one too ? | 12:01 |
| bhagyashri|rover | weshay|ruck, ack looking | 12:01 |
| *** rlandy has joined #oooq | 12:01 | |
| marios | akahat: holding on updating for now can do it after the call go ahead ... | 12:03 |
| * marios brb | 12:03 | |
| weshay|ruck | bhagyashri|rover, mark this.. "promotion-blocker" https://bugs.launchpad.net/tripleo/+bug/1895288 | 12:06 |
| openstack | Launchpad bug 1895288 in tripleo "[train] MemoryError: [tripleotraincentos8/centos-binary-nova-libvirt] Memory Error failing on few jobs" [High,Triaged] | 12:06 |
| weshay|ruck | https://bugs.launchpad.net/tripleo/+bug/1895248 same here | 12:06 |
| openstack | Launchpad bug 1895248 in tripleo "[stein] (LoadBalancerScenarioTest:test_load_balancer_ipv4_CRUD) show_loadbalancer provisioning_status updated to an invalid state of ERROR is failing on fs038" [High,Triaged] | 12:06 |
| bhagyashri|rover | weshay|ruck, done | 12:06 |
| bhagyashri|rover | sorry i forgot to add that | 12:07 |
| bhagyashri|rover | there is one more issue on train but waiting for testproject result | 12:07 |
| weshay|ruck | k | 12:08 |
| weshay|ruck | thanks | 12:08 |
| matbu | weshay|ruck: o/ | 12:09 |
| weshay|ruck | matbu, hey | 12:09 |
| matbu | weshay|ruck: i reverted one patch from tripleo-validations | 12:09 |
| matbu | if you are talking about the promotion blocker | 12:10 |
| weshay|ruck | see it | 12:10 |
| weshay|ruck | matbu, https://review.opendev.org/#/c/751244/ | 12:10 |
| weshay|ruck | right? | 12:10 |
| matbu | we are pinning validations-libs in rdoinfo, i think we need to track master instead | 12:10 |
| weshay|ruck | how does that impact packaging? | 12:10 |
| * weshay|ruck looks | 12:11 | |
| weshay|ruck | at rdoinfo | 12:11 |
| matbu | weshay|ruck: it override path between validation-common and tripleo-validations | 12:12 |
| matbu | weshay|ruck: it's a long story, but we split roles between v-common and tripleo-v | 12:12 |
| weshay|ruck | k. | 12:13 |
| matbu | weshay|ruck: but the review that was doing the clean in tripleo-v wasn't merged, so rpm is not happy | 12:13 |
| weshay|ruck | want me to test it in periodic? | 12:13 |
| matbu | the revert ? | 12:14 |
| matbu | if it's possible it would be nice | 12:15 |
| *** Goneri has joined #oooq | 12:16 | |
| *** amoralej is now known as amoralej|lunch | 12:17 | |
| bhagyashri|rover | weshay|ruck, matbu fyi i have tested the master job https://review.rdoproject.org/r/#/c/29224/ depends on: https://review.opendev.org/#/c/751244/ but it's still failing | 12:19 |
| *** pojadhav|afk is now known as pojadhav | 12:34 | |
| rfolco|ruck | bhagyashri|rover, pls see last comment in https://review.opendev.org/#/c/751244/ | 12:40 |
| bhagyashri|rover | rfolco|ruck, ok thanks | 12:41 |
| *** ratailor_ has quit IRC | 12:42 | |
| *** skramaja has quit IRC | 12:43 | |
| *** jpena|lunch is now known as jpena | 12:44 | |
| rfolco|ruck | bhagyashri|rover, too many issue looks like, where do you want me to help with | 12:45 |
| bhagyashri|rover | rfolco|ruck, actually i just reported train issue after 2nd run result | 12:48 |
| bhagyashri|rover | so probably train | 12:48 |
| bhagyashri|rover | will need more focus | 12:48 |
| rfolco|ruck | bhagyashri|rover, ignore the comment in https://review.opendev.org/#/c/751244/, see ykarel response. Maybe he has some other ideas on what is missing... | 12:50 |
| ykarel | rfolco|ruck, missing in what? | 12:50 |
| rfolco|ruck | ykarel, bhagyashri|rover is applying that patch to see if the validation bug is gone. But still failing. Right, bhagyashri|rover ? | 12:51 |
| bhagyashri|rover | rfolco|ruck, yes it's still failing with conflict error | 12:51 |
| bhagyashri|rover | https://review.opendev.org/#/c/751244/ | 12:52 |
| ykarel | okk ^, there patch is not being tested | 12:52 |
| ykarel | it fails early then patch actually get's applied | 12:52 |
| bhagyashri|rover | ykarel, how? i see you put recheck on the patch after that also it failed | 12:58 |
| ykarel | bhagyashri|rover, repo-setup <- install packages <- dlrn builds <- install build packages | 12:59 |
| ykarel | it failed at instal packages | 13:00 |
| bhagyashri|rover | ok | 13:03 |
| marios | akahat: ok... going to update now? | 13:06 |
| marios | akahat: (i am going to update) then its yours gimme couple mins just finished phone | 13:07 |
| akahat | marios, yes. please update.. it will take some time to debug for me. | 13:07 |
| marios | akahat: thanks | 13:07 |
| *** matbu has quit IRC | 13:09 | |
| *** matbu has joined #oooq | 13:10 | |
| marios | akahat: k done at v71 https://review.rdoproject.org/r/#/c/28081/71/ci-scripts/dlrnapi_promoter/test_unit_fixtures.py | 13:10 |
| marios | akahat: all yours | 13:10 |
| akahat | marios, cool.. thanks :) | 13:11 |
| rlandy | ysandeep: hey ... we didn't promote 16.2 or 17 yesterday as I wanted to go through the process with you | 13:13 |
| ysandeep | rlandy, sure, please let me know whenever you are free | 13:14 |
| rlandy | https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/builds?pipeline=openstack-periodic-rhos-17 | 13:14 |
| rlandy | ysandeep: ^^ 17 looked better yesterday :( | 13:14 |
| ysandeep | :( | 13:15 |
| rlandy | https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-rhos-17/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-scenario001-standalone-rhos-17/e189bcf/logs/undercloud/var/log/tempest/stestr_results.html | 13:15 |
| rlandy | ysandeep: ^^ tempest failures | 13:15 |
| rlandy | wonder if it's at all related to the upgraded dep from yesterday? | 13:16 |
| rlandy | periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-internal-rhos-16.2openstack/tripleo-cimasteropenstack-periodic-integration-rhos-16.2master4 hrs 8 mins 25 secs2020-09-10 13:01:09FAILURE | 13:16 |
| rlandy | ysandeep: ovb has been failing in 16.2 | 13:16 |
| rlandy | and it's running now | 13:16 |
| rlandy | https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-16.2/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-internal-rhos-16.2/c33181e/logs/undercloud/var/log/tempest/stestr_results.html.gz | 13:17 |
| rlandy | ysandeep: ^^ tempest issues there as well | 13:17 |
| rlandy | ysandeep: possibly because we increased the node numbers??? | 13:17 |
| ysandeep | rlandy, need to check.. | 13:18 |
| weshay|ruck | ysandeep, https://review.opendev.org/#/c/751273/ | 13:19 |
| rlandy | ysandeep: ok - let me know what you find - I need to work on getting the container builds modified for rel del import | 13:19 |
| *** amoralej|lunch is now known as amoralej | 13:19 | |
| ysandeep | rlandy, i am able to proceed with envC - using Ironic root disk hints - https://code.engineering.redhat.com/gerrit/#/c/211472/ | 13:19 |
| rlandy | great | 13:20 |
| weshay|ruck | ysandeep, was it chrony? | 13:20 |
| ysandeep | we can add root disk hint in instack.json to tell which root disk to use.. i will close the pnt ticket | 13:21 |
| ysandeep | no need to pull pendrive as we have a workaround | 13:21 |
| *** TrevorV has joined #oooq | 13:27 | |
| weshay|ruck | bhagyashri|rover, rfolco|ruck need anything? | 13:32 |
| rfolco|ruck | weshay|ruck, just unsure what to do with validation bug | 13:32 |
| rfolco|ruck | weshay|ruck, https://review.opendev.org/#/c/751244/ isn't enough looks like | 13:33 |
| weshay|ruck | rfolco|ruck, get w/ matbu | 13:33 |
| weshay|ruck | matbu, can you debrief rfolco|ruck please | 13:34 |
| rfolco|ruck | matbu, anything we can help with ? maybe some testproject test to ensure fixes are in place ? | 13:34 |
| matbu | rfolco|ruck: hey, why do you think it's not enough ? | 13:37 |
| *** udesale_ has joined #oooq | 13:37 | |
| matbu | rfolco|ruck: we want to revert this one in order to be able to merge .. (let me find the link) | 13:37 |
| matbu | rfolco|ruck: this https://review.opendev.org/#/c/713204/ | 13:37 |
| rfolco|ruck | matbu, ok, so revert https://review.opendev.org/#/c/751244/ and merge https://review.opendev.org/#/c/713204/ | 13:38 |
| weshay|ruck | zbr, 0/ | 13:38 |
| zbr | o/ | 13:38 |
| matbu | rfolco|ruck: right and then re-revert :D | 13:38 |
| *** udesale has quit IRC | 13:39 | |
| rfolco|ruck | bhagyashri|rover, can I borrow your testproject to test what matbu just said? | 13:39 |
| rfolco|ruck | matbu, thx for clarifying | 13:39 |
| bhagyashri|rover | rfolco|ruck, sure | 13:40 |
| rfolco|ruck | bhagyashri|rover, could you paste the link pls | 13:40 |
| *** saneax has joined #oooq | 13:40 | |
| bhagyashri|rover | rfolco|ruck, https://review.rdoproject.org/r/#/c/29224/ | 13:41 |
| rfolco|ruck | bhagyashri|rover, thx | 13:41 |
| weshay|ruck | zbr, let's chat early so I can get you out of here | 13:41 |
| zbr | sure, joining now. | 13:42 |
| weshay|ruck | zbr, https://github.com/weshayutin/gri | 13:44 |
| ysandeep | rlandy, do we need to add list all of internal projects here - https://code.engineering.redhat.com/gerrit/#/c/210870/7/zuul.d/component-jobs.yaml@1288 , or only these few (for now i copied your ovb job required-projects list). | 13:50 |
| *** matbu has quit IRC | 13:51 | |
| *** matbu has joined #oooq | 13:53 | |
| weshay|ruck | rfolco|ruck, zbr we need zbr's work properly in jira | 13:58 |
| rfolco|ruck | zbr, talk to me boy | 13:58 |
| rfolco|ruck | zbr, if you want, send me a list of tasks and i create them for you ok | 13:59 |
| rlandy | ysandeep: you can skip name | 14:07 |
| rlandy | just add the project | 14:07 |
| rlandy | as far as repos, walk the parenting scheme | 14:08 |
| rlandy | as long as you are not getting any upstream repos, it's fine | 14:08 |
| ysandeep | rlandy, I am just wondering why we added only these.. and not all internal projects.. like openstack-tripleo-heat-templates | 14:09 |
| akahat | ready to merge: https://review.rdoproject.org/r/#/c/28081/ | 14:11 |
| akahat | marios, bhagyashri|rover weshay|ruck ^^ | 14:11 |
| bhagyashri|rover | akahat, ack | 14:12 |
| marios | akahat: bhagyashri|rover: rfolco|ruck: arxcruz|pto: \o/ | 14:13 |
| marios | nice work all | 14:13 |
| marios | akahat: nicely done just in time for friday ;) | 14:13 |
| marios | linters too! | 14:13 |
| bhagyashri|rover | \0/ | 14:14 |
| rfolco|ruck | marios, akahat good job, will review it by the end of the day | 14:15 |
| marios | rfolco|ruck: no rush | 14:15 |
| marios | rfolco|ruck: i don't think we should merge this before monday | 14:15 |
| rfolco|ruck | marios, yes, I'll kill who does that | 14:15 |
| rfolco|ruck | marios, patches like that should disable merge button on fridays automatically | 14:16 |
| weshay|ruck | akahat, sec | 14:16 |
| rfolco|ruck | topic: new_config_engine-patch71 | 14:17 |
| rfolco|ruck | lol | 14:17 |
| akahat | :) | 14:17 |
| akahat | git automated naming system ' | 14:18 |
| marios | akahat: rfolco|ruck: i rebased the two patches on top of that let's see if their jobs are green too | 14:18 |
| marios | https://review.rdoproject.org/r/28019 https://review.rdoproject.org/r/28020 | 14:18 |
| marios | hmm 'functional tests' i expect those will fail | 14:18 |
| rfolco|ruck | nice | 14:20 |
| weshay|ruck | zbr, https://gitlab.cee.redhat.com/whayutin/gerrit-tools | 14:21 |
| akahat | marios, okay... looking in to it. | 14:23 |
| marios | akahat: wait it didn't report yet | 14:23 |
| marios | akahat: monday :) | 14:23 |
| marios | akahat: surely it must be end of day at 1954 ? | 14:24 |
| marios | :) | 14:24 |
| marios | akahat: or do you shift your hours? | 14:24 |
| rlandy | ysandeep: probably should be | 14:25 |
| rlandy | just working on containers - will review in a bit | 14:25 |
| akahat | marios, yes.. it's end of day.. my shift my hours.. :P | 14:26 |
| ysandeep | rlandy, thanks!, nw please take your time | 14:26 |
| rlandy | sorry - just trying to spring rel del free with dockerfile imports | 14:26 |
| marios | akahat: "the bugs *never* end" ... that's the problem ;) | 14:26 |
| ysandeep | rlandy, I have some bad news too.. we now need podman >= 1.6.4-15 , so have to unwind the stuff we did earlier :( | 14:28 |
| ysandeep | after https://review.opendev.org/#/c/739481/ i hit some issue with bm baremetal.. tengu said we need >= 1.6.4-15 | 14:28 |
| ysandeep | podman* >= 1.6.4-15 | 14:29 |
| ysandeep | i am checking what we are getting from rhosp-rhel-8.3-appstream currently, earlier we had issues with 1.6.4-13 | 14:29 |
| Tengu | ysandeep: can you check what streams you have for container-tools ? | 14:30 |
| Tengu | for instance, on osp-16.1, we must switch to 2.0 (default is rhel8) - maybe that's the same trick on osp-16.2? | 14:30 |
| ysandeep | Tengu, we actually pinned last to last week as earlier we had some issues with podman 1.6.4-13.. | 14:30 |
| Tengu | meh... | 14:30 |
| Tengu | podman, that never-ending story. | 14:31 |
| rlandy | ysandeep: Tengu: so we did two things ... | 14:33 |
| ysandeep | tengu - 1.6.4-14 is what we are getting from rhosp-rhel-8.3-appstream currently, so its still not >= 1.6.4-15 :( | 14:34 |
| Tengu | damned... | 14:34 |
| ysandeep | podman x86_64 1.6.4-14.module+el8.3.0+7660+b7198318 rhosp-rhel-8.3-appstream | 14:34 |
| rlandy | we disabled the module_hotfixes=1 option so we would not get the podman version from http://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp16-2/osptrunk-deps.repo | 14:34 |
| rlandy | and then we locked podman to the beta version of rhel 8.3 | 14:34 |
| rlandy | we are pull beta on podman | 14:35 |
| rlandy | but rhos-release is on a diff version | 14:35 |
| rlandy | so we could take podman from there | 14:35 |
| rlandy | getting ... | 14:35 |
| zbr | rfolco|ruck: are you switching accounts or something like that? i tried to reply you on privated and got an error | 14:36 |
| zbr | i wonder if this has anything to do with ruck rovering and nick change. | 14:36 |
| rlandy | toplink/vol/rhel-8/packages/podman/1.9.3/2.module+el8.2.1+6867+366c07d6/x86_64/podman-tests-1.9.3-2.module+el8.2.1+6867+366c07d6.x86_64.rpm | 14:38 |
| rlandy | ^^ is in osp-trunk-deps | 14:38 |
| ysandeep | rlandy yes http://download.eng.bos.redhat.com/brewroot/repos/rhos-16.2-rhel-8-trunk-build/latest/x86_64/pkglist have podman-1.9.3 , switching to that probably we good idea.. | 14:38 |
| rlandy | 1.9 | 14:38 |
| rlandy | ysandeep: we need to check the next cut of appstream | 14:38 |
| ysandeep | rlandy, some chatter ongoing on rel-del regarding this.. reading | 14:39 |
| rlandy | podman-1.6.4-20.module+el8.3.0+7842+fbbcd85c.x86_64.rpm 27-Aug-2020 14:00 12M | 14:40 |
| rlandy | ysandeep: Tengu: if we get snapshot 3 of rhel 8.3 you will get ^^ | 14:41 |
| rlandy | so request to update rhos-release to the new snapshot | 14:41 |
| rlandy | or add that as an additional repo and pull podman from there | 14:41 |
| Tengu | ah. that would be better. Probably not without any error, but..... | 14:41 |
| Tengu | rlandy, ysandeep in //: https://bugzilla.redhat.com/show_bug.cgi?id=1878187 (and I'll create the same for 16.2 now, with just the lower-constraint on 1.6.4-15) | 14:42 |
| openstack | bugzilla.redhat.com bug 1878187 in rhosp-release "Add upper and lower contraint for podman version" [High,New] - Assigned to jjoyce | 14:42 |
| ysandeep | Tengu, thanks! | 14:42 |
| Tengu | np | 14:43 |
| zbr | what field are we supposed to use for qe on jira? "QA Contacts" or "QE Contacts",... not sure which jira admin allowed this to happen. | 14:43 |
| Tengu | ysandeep: https://bugzilla.redhat.com/show_bug.cgi?id=1878189 for 16.2 | 14:46 |
| openstack | bugzilla.redhat.com bug 1878189 in rhosp-release "Add lower contraint for podman version" [High,New] - Assigned to jjoyce | 14:46 |
| Tengu | guess that should help a lot. | 14:46 |
| ysandeep | Tengu, ack o/ | 14:47 |
| Tengu | ysandeep: and Alex is adding that new package to tripleo-ansible/bootstrap now. | 14:48 |
| Tengu | meaning we should be clear soon :). | 14:48 |
| *** jtomasek has quit IRC | 14:49 | |
| rfolco|ruck | zbr, I received and replied your msg | 14:55 |
| rfolco|ruck | zbr, I see your story on jira, are you ok with jira ? | 14:55 |
| zbr | rfolco|ruck: no idea where to add someone as QE | 14:57 |
| rfolco|ruck | zbr, there isn't a field like we had in ++ taiga ++ ... but I just added in your task as QA contacts .... edit the task, show all fields... | 15:00 |
| zbr | there are two fields "QA .." and "QE ..." hidden by default, but you can enable them in edit. | 15:00 |
| zbr | i was not sure about QA vs QE, ... like spaces vs tabs kind of subject. | 15:01 |
| rfolco|ruck | zbr, qe contact | 15:02 |
| rfolco|ruck | zbr, look again in the board, now I show it in the card | 15:02 |
| ykarel | rfolco|ruck, bhagyashri|rover is the issue with stein promotions known? | 15:02 |
| ykarel | i see last promotion was 10 days ago | 15:02 |
| rfolco|ruck | ykarel, yes :( let me get the bug | 15:02 |
| rfolco|ruck | ykarel, octavia plugin issue: https://bugs.launchpad.net/tripleo/+bug/1895248 | 15:03 |
| openstack | Launchpad bug 1895248 in tripleo "[stein] (LoadBalancerScenarioTest:test_load_balancer_ipv4_CRUD) show_loadbalancer provisioning_status updated to an invalid state of ERROR is failing on fs038" [High,Triaged] | 15:03 |
| ykarel | rfolco|ruck, but this is not in promotion criteria | 15:03 |
| ykarel | so promotion is not blocked atleast due to this | 15:04 |
| rfolco|ruck | will double check last promotion log | 15:04 |
| bhagyashri|rover | ykarel, this is http://promoter.rdoproject.org/config/CentOS-7/stein.ini | 15:04 |
| rfolco|ruck | bhagyashri|rover, weshay|ruck if you know stein blocker at the top of your head please speak up | 15:04 |
| weshay|ruck | rfolco|ruck, ya.. went through it bhagyashri|rover yesterday.. we accounted for all the errors and she's driving stein | 15:05 |
| weshay|ruck | bhagyashri|rover, you should probably add a few notes re: stein to the hackmd when you have time | 15:06 |
| bhagyashri|rover | weshay|ruck, added for fs038 | 15:07 |
| ykarel | bhagyashri|rover, stein promotion likely not running ^ | 15:07 |
| weshay|ruck | ykarel, why? | 15:07 |
| weshay|ruck | ykarel, V | 15:08 |
| weshay|ruck | http://38.102.83.109/promoter_logs/centos7_stein.log | 15:08 |
| ykarel | weshay|ruck, yes here it's running but not in what bhagyashri|rover shared | 15:08 |
| ysandeep | rlandy, i am out now, see you on monday, when you get time.. please review below changes, these are ready to be merged:- | 15:08 |
| ysandeep | https://code.engineering.redhat.com/gerrit/#/c/210870/ - envb had green run already(will deal with podman isssue sepately) | 15:08 |
| ysandeep | https://code.engineering.redhat.com/gerrit/#/c/211472/ - envc root disk hint | 15:08 |
| rlandy | sure | 15:09 |
| weshay|ruck | ysandeep, btw.. you have my 100% approval if you want to pull baremetal from 17 to augment anything in 16.2 | 15:09 |
| bhagyashri|rover | ykarel, weshay|ruck periodic-tripleo-ci-centos-7-standalone-upgrade-stein is failing earlier because of some tempest test failure but recently on testproject tempest test are passing here https://review.rdoproject.org/r/#/c/29231/ but failing with some different issue | 15:10 |
| weshay|ruck | ysandeep, not that you have thought about that yet.. but totally fine by me as you move forward | 15:10 |
| rlandy | ugh linters .... | 15:10 |
| ykarel | i also see https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset037-updates-stein# failing since 1st | 15:11 |
| ykarel | and is in criteria | 15:11 |
| bhagyashri|rover | ykarel, ohh i was referring wrong criteria | 15:12 |
| rlandy | zbr: hey - can you use yaml anchors in in var1.var2 variables like in https://code.engineering.redhat.com/gerrit/#/c/211525/1/zuul.d/tripleo-build-containers.yaml | 15:12 |
| rlandy | line 372 | 15:12 |
| ysandeep | weshay|ruck, thanks.. i was able to pull envc from last error with a workaround patch - https://code.engineering.redhat.com/gerrit/#/c/211472/ but tripleo component failing to start mysql container(will continue debug on monday).. | 15:13 |
| rfolco|ruck | bhagyashri|rover, stein promotion log is huge, still loading for me | 15:13 |
| weshay|ruck | ysandeep, k.. thank you .. have a good weekend | 15:13 |
| rlandy | 2020-09-11 15:01:13.521765 | upstream-centos-7 | zuul.d/tripleo-build-containers.yaml:372:20: [error] too many spaces after colon (colons) | 15:13 |
| bhagyashri|rover | rfolco|ruck, ykarel this is the criteria list http://38.102.83.109/config/CentOS-7/stein.ini right? | 15:13 |
| weshay|ruck | rlandy, did you folks promote 16/17 | 15:14 |
| ykarel | bhagyashri|rover, yes | 15:14 |
| rlandy | weshay|ruck: no - 16.2 was still running - so tripleo-ci-testing was not tests | 15:14 |
| rlandy | tested | 15:14 |
| rlandy | and 17 failed in the last run | 15:14 |
| rlandy | tempest errors | 15:14 |
| rlandy | which I have not investigated yet | 15:14 |
| rlandy | busy helping get dockerfiles in shape for rel del imports | 15:15 |
| *** ysandeep is now known as ysandeep|away | 15:15 | |
| weshay|ruck | k.. rlandy bhagyashri|rover arx has a little patch to add to be able to skip tests on specific jobs | 15:15 |
| weshay|ruck | ping him monday | 15:15 |
| rlandy | weshay|ruck; ack | 15:16 |
| rlandy | but we nmay have a real problem | 15:16 |
| bhagyashri|rover | ykarel, currently upgrade-stein and featureset037-updates-stein is blocking | 15:17 |
| rlandy | I can promote without passing | 15:17 |
| bhagyashri|rover | weshay|ruck, ack | 15:17 |
| rlandy | idk if we want to | 15:17 |
| ykarel | bhagyashri|rover, ok is there any bug for those? | 15:18 |
| rlandy | zbr: nvm - fixed | 15:18 |
| rfolco|ruck | ykarel, bhagyashri|rover I can file a bug for stein... | 15:20 |
| rfolco|ruck | CommandError: Error: The following files were not found: /home/zuul/containers-default-parameters.yaml | 15:20 |
| rfolco|ruck | https://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset037-updates-stein/9b5a301/logs/undercloud/home/zuul/overcloud_update_prepare.log.txt.gz | 15:20 |
| bhagyashri|rover | ykarel, no. tbh the failures are inconsistent for upgrade-stein | 15:20 |
| ykarel | inconsistent also need to be root caused/solved :) | 15:21 |
| bhagyashri|rover | ykarel, here tempest test are failing https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-integration-stable3&job_name=periodic-tripleo-ci-centos-7-standalone-upgrade-stein | 15:22 |
| bhagyashri|rover | and on testproject patch https://review.rdoproject.org/r/#/c/29231/ tempest test are passing and failing with some different error | 15:23 |
| bhagyashri|rover | ykarel, will check in detail | 15:23 |
| bhagyashri|rover | rfolco|ruck, ack, i think we should re run the upgrade-stein job on testproject https://review.rdoproject.org/r/#/c/29231/ wdyt? | 15:26 |
| weshay|ruck | ykarel, bhagyashri|rover we're talking about the tempest failures? | 15:27 |
| rfolco|ruck | bhagyashri|rover, ykarel weshay|ruck inconsistent or not, the bug is created https://bugs.launchpad.net/tripleo/+bug/1895314 | 15:27 |
| openstack | Launchpad bug 1895314 in tripleo "[stein] overcloud_update missing files" [Critical,Triaged] | 15:27 |
| weshay|ruck | re: inconsistent | 15:27 |
| weshay|ruck | bhagyashri|rover, did you testproject a change to cp container-preppare-params to containers-default-para? | 15:28 |
| weshay|ruck | don't see one | 15:29 |
| bhagyashri|rover | weshay|ruck, nope i dont have patch for that yesterday we try to search but havent found that | 15:29 |
| weshay|ruck | rfolco|ruck, ^ | 15:29 |
| rfolco|ruck | weshay|ruck, ok let me find where to rename this | 15:29 |
| bhagyashri|rover | and today also i tried to search but havent found that | 15:29 |
| weshay|ruck | bhagyashri|rover, in tqe.. after we finish writing the containers-prepare-param file | 15:30 |
| weshay|ruck | cp it to /home/zuul/containers-default-parameters.yaml | 15:30 |
| rfolco|ruck | bhagyashri|rover, you want to have the honor ? | 15:30 |
| ykarel | bhagyashri|rover, rfolco|ruck, ack | 15:31 |
| rfolco|ruck | bhagyashri|rover, working on it, speak up if you are too | 15:32 |
| weshay|ruck | bhagyashri|rover, http://codesearch.openstack.org/?q=containers-prepare-parameter.yaml&i=nope&files=&repos= | 15:32 |
| weshay|ruck | not sure why tripleo-upgrade is not respecting https://opendev.org/openstack/tripleo-upgrade/src/branch/master/defaults/main.yml#L101 | 15:32 |
| weshay|ruck | ah.. now I see | 15:33 |
| weshay|ruck | http://codesearch.openstack.org/?q=containers-default-parameters.yaml&i=nope&files=&repos= | 15:33 |
| weshay|ruck | bhagyashri|rover, rfolco|ruck see the issue? | 15:34 |
| rfolco|ruck | yep, just don't see why stein | 15:34 |
| weshay|ruck | code search is your friend | 15:34 |
| rfolco|ruck | aaah | 15:34 |
| rfolco|ruck | fs37 does not have the condition | 15:35 |
| rfolco|ruck | like others | 15:35 |
| rfolco|ruck | https://opendev.org/openstack/tripleo-quickstart/src/branch/master/config/general_config/featureset037.yml#L18 | 15:35 |
| bhagyashri|rover | rfolco|ruck, weshay|ruck hey sorry i was little way from keyboard. reading ... | 15:36 |
| weshay|ruck | imho... it should all be switch to a single file name | 15:36 |
| rfolco|ruck | weshay|ruck, but others have this https://opendev.org/openstack/tripleo-quickstart/src/branch/master/config/general_config/featureset026.yml#L22-L26 | 15:36 |
| weshay|ruck | bhagyashri|rover, please ask for help if something is not making sense. | 15:36 |
| bhagyashri|rover | weshay|ruck, ack | 15:37 |
| weshay|ruck | rfolco|ruck, so.. the only reason default-params | 15:37 |
| weshay|ruck | is used was because upgrades were not using the option to specify a file | 15:37 |
| weshay|ruck | which is wrong | 15:37 |
| weshay|ruck | so upgrades would just use the default from tc | 15:38 |
| weshay|ruck | https://opendev.org/openstack/tripleo-common/src/branch/master/tripleo_common/constants.py#L184 | 15:38 |
| weshay|ruck | jose luis is the guy to sync w/ | 15:38 |
| weshay|ruck | I tried to find his patch yesterday | 15:38 |
| weshay|ruck | but didn't see it | 15:38 |
| weshay|ruck | meh.. he's not here | 15:38 |
| rfolco|ruck | can't we just patch this https://opendev.org/openstack/tripleo-quickstart/src/branch/master/config/general_config/featureset037.yml#L18 | 15:39 |
| weshay|ruck | rfolco|ruck, I think so yes.. specify the file that exists :) | 15:39 |
| weshay|ruck | would like to see tripleo-upgrades make a backup of the file before it's updated for update/upgrade | 15:40 |
| rfolco|ruck | container_registry_file is used pre-rocky, after rocky | 15:40 |
| rfolco|ruck | # is uc_containers_prepare_file the one used to identify | 15:40 |
| rfolco|ruck | # the containers file (defaults to: containers-prepare-parameter.yaml) | 15:40 |
| weshay|ruck | rfolco|ruck, or https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/overcloud-deploy/tasks/pre-deploy.yml#L216 | 15:41 |
| *** ykarel is now known as ykarel|away | 15:42 | |
| chandankumar | bhagyashri|rover: rfolco|ruck https://review.opendev.org/#/c/751162/ regarding this , please check the job definition or fs related to amphora image | 15:42 |
| *** udesale_ has quit IRC | 15:45 | |
| *** marios is now known as marios|out | 15:50 | |
| bhagyashri|rover | rfolco|ruck, weshay|ruck https://review.opendev.org/#/c/748664/2/config/general_config/featureset037.yml | 15:53 |
| *** bogdando has quit IRC | 15:58 | |
| *** marios|out has quit IRC | 16:00 | |
| *** ykarel|away has quit IRC | 16:06 | |
| weshay|ruck | bhagyashri|rover, ah.. there it is | 16:09 |
| weshay|ruck | bhagyashri|rover, right.. so he fixed it exactly backwards | 16:10 |
| weshay|ruck | and I +2'd it | 16:10 |
| bhagyashri|rover | i see | 16:11 |
| weshay|ruck | bhagyashri|rover, rfolco|ruck to be 100% safe.. I don't see the issue with having two files with the same content... w/ two different names | 16:16 |
| weshay|ruck | just to see what happens | 16:16 |
| weshay|ruck | and let's take it from there | 16:16 |
| weshay|ruck | bhagyashri|rover, rfolco|ruck revert in validations just merged.. will trigger the validations component now | 16:23 |
| weshay|ruck | then master | 16:23 |
| *** derekh has quit IRC | 16:23 | |
| bhagyashri|rover | ok | 16:24 |
| weshay|ruck | I'm not confident this will fix it | 16:25 |
| weshay|ruck | ah maybe it will | 16:25 |
| weshay|ruck | it was caught here https://logserver.rdoproject.org/openstack-component-validation/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-standalone-validation-master/166ed8d/job-output.txt | 16:25 |
| weshay|ruck | rfolco|ruck, check this out | 16:27 |
| weshay|ruck | https://logserver.rdoproject.org/openstack-component-validation/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-standalone-validation-master/166ed8d/job-output.txt | 16:27 |
| weshay|ruck | 946e3a858686564c9c2c2e5cf5b479655a9adfc4 | 16:27 |
| weshay|ruck | 2020-09-10 22:32:30.299817 | primary | + dlrnapi --url https://trunk.rdoproject.org/api-centos8-master-uc --username review_rdoproject_org repo-promote --commit-hash 946e3a858686564c9c2c2e5cf5b479655a9adfc4 --distro-hash d9a985baccfaa1c0d1112c5b39d0ae8f51ea97c4 --promote-name component-ci-testing | 16:27 |
| weshay|ruck | oh.. promote to component-ci-testing | 16:28 |
| weshay|ruck | k | 16:28 |
| weshay|ruck | https://trunk.rdoproject.org/centos8-master/component/validation/promoted-components/commit.yaml | 16:29 |
| weshay|ruck | so that build was promoted.. | 16:29 |
| weshay|ruck | https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/dlrnapi_promoter/config/CentOS-8/component/master.yaml#L78 | 16:30 |
| *** saneax has quit IRC | 16:31 | |
| weshay|ruck | https://review.rdoproject.org/zuul/builds?pipeline=openstack-promote-component&job_name=periodic-tripleo-centos-8-train-component-validation-promote-to-promoted-components | 16:32 |
| weshay|ruck | I need to bring up monitoring on validations | 16:32 |
| weshay|ruck | rfolco|ruck, that looks like it validations was promoted w/ the job failing | 16:33 |
| weshay|ruck | https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-standalone-validation-master | 16:34 |
| *** rfolco|ruck is now known as rfolco|ruck|brb | 16:39 | |
| bhagyashri|rover | weshay|ruck, leaving for the day :) | 16:48 |
| weshay|ruck | bhagyashri|rover, have a nice weekend | 16:48 |
| bhagyashri|rover | Bye have a nice weekend | 16:48 |
| bhagyashri|rover | rfolco|ruck|brb, ^ | 16:48 |
| *** jpena is now known as jpena|off | 17:34 | |
| *** apetrich has quit IRC | 17:44 | |
| *** rfolco|ruck|brb is now known as rfolco|ruck | 17:46 | |
| rfolco|ruck | weshay|ruck, how the component promoted if job failed ? did you find out ? | 17:51 |
| weshay|ruck | rfolco|ruck, no not yet | 18:08 |
| weshay|ruck | rfolco|ruck, I started trolling through logs.. didn't find the job run where it promoted | 18:08 |
| weshay|ruck | bringing up the monitoring for validations now | 18:08 |
| rfolco|ruck | weshay|ruck, ok, I am trying a new fix for stein. Will help with that in a bi | 18:09 |
| rfolco|ruck | bit | 18:09 |
| weshay|ruck | k | 18:09 |
| rfolco|ruck | and did not forget scen12, will do it, be patient | 18:09 |
| weshay|ruck | no review.. just fyi https://review.rdoproject.org/r/29298 | 18:09 |
| weshay|ruck | k | 18:09 |
| rfolco|ruck | weshay|ruck, fyi https://review.rdoproject.org/r/29299 | 18:17 |
| weshay|ruck | perfect. +2 | 18:18 |
| rfolco|ruck | weshay|ruck, jira guy replied, I replied back, hopefully he'll add us to next list | 18:28 |
| weshay|ruck | saw | 18:28 |
| weshay|ruck | +1 | 18:28 |
| weshay|ruck | rfolco|ruck, ok.. so validatoins added | 18:31 |
| weshay|ruck | scroll to the bottom | 18:32 |
| weshay|ruck | http://dashboard-ci.tripleo.org/d/FE8Hf29Wz/component-pipeline?orgId=1&from=now-30d&to=now | 18:32 |
| weshay|ruck | it failed on the same error 2020-09-02 22:58:09masterNoneperiodic-tripleo-ci-centos-8-standalone-validation-master | 18:32 |
| weshay|ruck | and then passed | 18:32 |
| rfolco|ruck | last 2 runs failed | 18:33 |
| weshay|ruck | ah wait | 18:33 |
| weshay|ruck | rfolco|ruck, ya.. the last two runs failed on what the integration is seeing | 18:36 |
| *** chem has quit IRC | 18:36 | |
| weshay|ruck | rfolco|ruck, the question is why didn | 18:37 |
| weshay|ruck | didn't the component line fail first | 18:38 |
| *** chem has joined #oooq | 18:38 | |
| weshay|ruck | they failed at the same time | 18:38 |
| rfolco|ruck | weshay|ruck, last fail is 09-10 | 18:39 |
| weshay|ruck | rfolco|ruck, https://trunk.rdoproject.org/centos8/component/validation/94/6e/946e3a858686564c9c2c2e5cf5b479655a9adfc4_d9a985ba/ | 18:42 |
| weshay|ruck | so.. validations-lib fd1bd | 18:42 |
| rfolco|ruck | yes this is the last one promoted ok | 18:42 |
| weshay|ruck | https://opendev.org/openstack/validations-libs/commits/branch/master | 18:42 |
| weshay|ruck | and https://opendev.org/openstack/validations-common/commits/branch/master 946e3 latest | 18:43 |
| weshay|ruck | rfolco|ruck, I think it's coming from the tripleo compnent | 18:44 |
| weshay|ruck | https://opendev.org/openstack/tripleo-validations/commits/branch/master https://trunk.rdoproject.org/centos8-master/component/tripleo/promoted-components/ | 18:45 |
| weshay|ruck | tripleo-validatoins | 18:45 |
| weshay|ruck | and tripleo never failed on it | 18:45 |
| weshay|ruck | it's some f.. up w/ how some validations code is in tripleo and some is in validations | 18:46 |
| weshay|ruck | I have a meeting about validations ci on monday | 18:46 |
| weshay|ruck | probably need to get tripleo-validations removed from master | 18:47 |
| rfolco|ruck | this is weird, component=validations... not tripleo... if the job reported failure, it should not pass on this task | 18:48 |
| rfolco|ruck | TASK [promote-hash : Check reports from DLRN] | 18:48 |
| rfolco|ruck | this is reporting false positive | 18:48 |
| rfolco|ruck | https://logserver.rdoproject.org/openstack-promote-component/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-8-train-component-validation-promote-to-promoted-components/7d80dc8/job-output.txt | 18:48 |
| rfolco|ruck | wait weshay|ruck | 18:49 |
| rfolco|ruck | train??? | 18:49 |
| rfolco|ruck | export RELEASE=train | 18:49 |
| rfolco|ruck | ah yeah its train | 18:50 |
| rfolco|ruck | no it should be master, isn't ? | 18:50 |
| rfolco|ruck | it sounds like there is some branch confusion in the config for these component jobs | 18:52 |
| rfolco|ruck | nah, just... nevermind. Still looking. | 18:54 |
| rfolco|ruck | clear | 18:54 |
| rfolco|ruck | delete | 18:54 |
| rfolco|ruck | start over | 18:54 |
| rfolco|ruck | weshay|ruck, actually it is correct. It promotes with latest good hash, which is 946e3a858686564c9c2c2e5cf5b479655a9adfc4_d9a985ba | 18:59 |
| rfolco|ruck | no matter last 2 failed, it just ignores it | 18:59 |
| rfolco|ruck | weshay|ruck, if you want to change this behavior, make it fail if already promoted that hash, its another story | 19:00 |
| weshay|ruck | rfolco|ruck, back | 19:01 |
| weshay|ruck | rfolco|ruck, aye... so component pipeline is fine | 19:01 |
| weshay|ruck | rfolco|ruck, it's some weird combination of the old validations and new | 19:02 |
| * weshay|ruck sends an email | 19:02 | |
| rfolco|ruck | k | 19:02 |
| weshay|ruck | rfolco|ruck, sent.. see if that email makes sense | 19:07 |
| rfolco|ruck | weshay|ruck, I don't know how these components are combined together, but yeah, it seems to be valid question | 19:09 |
| weshay|ruck | rfolco|ruck, they are defined in rdoinfo | 19:10 |
| weshay|ruck | you know where that is? | 19:10 |
| rfolco|ruck | weshay|ruck, nope | 19:11 |
| weshay|ruck | rfolco|ruck, https://docs.google.com/presentation/d/1kmUsRwUzs02ZPAFfpq0uqpXCtXFDrhFeFDWmXooMvdY/edit#slide=id.g87db96c7e8_0_42 | 19:12 |
| weshay|ruck | oops | 19:12 |
| weshay|ruck | rfolco|ruck, https://docs.google.com/presentation/d/11bmasGIldG6rGswhbZH5iGkpyJuLuF58gKpPUWBQM4w/edit#slide=id.g86140b98d3_0_5 | 19:13 |
| rfolco|ruck | I see, package-config defines ow they are grouped and built together | 19:14 |
| weshay|ruck | rfolco|ruck, aye | 19:16 |
| *** TrevorV has quit IRC | 20:37 | |
| *** rlandy is now known as rlandy|afk | 21:09 | |
| *** rfolco|ruck has quit IRC | 21:20 | |
| *** rlandy|afk is now known as rlandy | 21:53 | |
| *** tosky has quit IRC | 23:20 | |
| *** chem has quit IRC | 23:39 | |
| *** chem has joined #oooq | 23:41 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!