*** rlandy|ruck|bbl is now known as rlandy|ruck | 02:02 | |
*** ysandeep|out is now known as ysandeep | 02:07 | |
ysandeep | rlandy|ruck, looks like jobs still failing in post_failure, I will debug that today | 02:08 |
---|---|---|
rlandy|ruck | ysandeep: ack - I was just comparing | 02:08 |
rlandy|ruck | the passing jobs have user as --username tripleo-ci-internal | 02:08 |
rlandy|ruck | ysandeep: even the kvm jobs are failing | 02:09 |
rlandy|ruck | to report now | 02:09 |
rlandy|ruck | to rdo dlrn | 02:09 |
ysandeep | errr.. | 02:09 |
rlandy|ruck | unauth access | 02:10 |
rlandy|ruck | if you look at the role | 02:10 |
rlandy|ruck | https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/roles/dlrn-report/tasks/dlrn-report-results.yml#L10 | 02:10 |
rlandy|ruck | idk what username it is taking | 02:11 |
rlandy|ruck | 'review_rdoproject_org' | 02:11 |
rlandy|ruck | upstream | 02:11 |
rlandy|ruck | ysandeep: alternative ... | 02:11 |
rlandy|ruck | set the verifyto 0 | 02:12 |
ysandeep | rlandy|ruck, yes, let me debug for sometime otherwise we will set verify=0 for the timebeing | 02:13 |
rlandy|ruck | export SSL_VERIFY=0 | 02:14 |
rlandy|ruck | ysandeep: ^^ | 02:14 |
rlandy|ruck | desperate | 02:14 |
rlandy|ruck | we hosed the KVM jobs as well | 02:14 |
rlandy|ruck | and this is stopping promotions upstream | 02:14 |
* rlandy|ruck leaving note for marios | 02:15 | |
ysandeep | ack, lets do that now then so that upstream can go through | 02:15 |
rlandy|ruck | can try it | 02:15 |
ysandeep | rlandy|ruck, pushing patch | 02:15 |
* ysandeep preparing patch, sec | 02:15 | |
rlandy|ruck | ysandeep: going afk | 02:16 |
rlandy|ruck | just leaving rr notes | 02:16 |
rlandy|ruck | see you later | 02:16 |
ysandeep | o/ | 02:16 |
*** rlandy|ruck is now known as rlandy|out | 02:16 | |
rlandy|out | ysandeep: oh ... | 02:16 |
rlandy|out | ysandeep: OVB UEFI | 02:16 |
rlandy|out | I know what we need to do | 02:17 |
rlandy|out | see hardware prov chat | 02:17 |
rlandy|out | we need to upload ipxe-uefi image | 02:17 |
rlandy|out | see vexx | 02:17 |
ysandeep | ack | 02:17 |
rlandy|out | to psi | 02:17 |
rlandy|out | will explain more later | 02:17 |
rlandy|out | metadata update | 02:17 |
rlandy|out | ok - now I am done | 02:17 |
ysandeep | okay, see you tomorrow o/ | 02:17 |
*** ysandeep is now known as ysandeep|away | 03:52 | |
anbanerj | hey folks, pls add to your review list: https://review.rdoproject.org/r/c/rdo-jobs/+/38475, https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/38479, https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/38537 | 05:41 |
*** anbanerj is now known as frenzyfriday | 05:42 | |
*** marios is now known as marios|ruck | 06:15 | |
*** amoralej|off is now known as amoralej | 07:48 | |
*** bhagyashris_ is now known as bhagyashris | 08:01 | |
bhagyashris | marios|ruck, https://review.rdoproject.org/r/c/testproject/+/32107 | 08:07 |
*** jpena|off is now known as jpena | 08:13 | |
*** bhagyashris_ is now known as bhagyashris | 08:53 | |
*** ysandeep|away is now known as ysandeep | 09:29 | |
marios|ruck | frenzyfriday: o/ can you please include examples of the failing tests in the bug (https://bugs.launchpad.net/tripleo/+bug/1958531/comments/5) | 09:35 |
frenzyfriday | marios|ruck, ack, checking | 09:36 |
marios|ruck | thanks | 09:36 |
marios|ruck | rlandy|out: dviroel_: o/ i moved this one fix-released https://bugs.launchpad.net/tripleo/+bug/1957789/comments/3 (doug you have at least one testproject with wallaby ipa buildimage and it looks OK) - please let me know ifyou are aware of something further there | 09:49 |
frenzyfriday | hey marios|ruck, I have added some background to the bug. But the logs are from https://sf.hosted.upshift.rdu2.redhat.com/logs/27/301027/8/check/periodic-tripleo-ci-centos-9-scenario010-kvm-internal-standalone-master/829f56a/logs/undercloud/var/log/tempest/ Should we post links accessed only vis VPN on launchpad? | 09:54 |
marios|ruck | thank you frenzyfriday ... yeah its a tough one since it is an internal job so yeah we can't really add them | 09:58 |
marios|ruck | frenzyfriday: the info you added helps though at least we have the job name, ruck|rover can find it | 09:59 |
frenzyfriday | cool :) | 10:06 |
* bhagyashris out | 10:13 | |
jm1 | o/ | 10:20 |
jm1 | do we know someone in IBM's PowerVM that could merge this patch? https://github.com/powervm/pypowervm/pull/17 | 10:21 |
*** dviroel_ is now known as dviroel | 11:03 | |
*** rlandy|out is now known as rlandy|ruck | 11:12 | |
rlandy|ruck | jm1: hmmm we know who https://rover.redhat.com/people/profile/ralonsoh is though | 11:16 |
ysandeep | marios|ruck, rlandy|ruck I will miss review call today, debugging downstream with ykarel_ 's help | 11:16 |
rlandy|ruck | k - will join with marios | 11:17 |
marios|ruck | ysandeep: k | 11:17 |
rlandy|ruck | https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-9-standalone-on-multinode-ipa-master | 11:24 |
marios|ruck | slaweq: o/ hey are you around? if you have a couple mins would be great if you can join us we are on https://meet.google.com/vzm-nrah-qqf | 11:25 |
marios|ruck | slaweq: need to discusss about https://bugs.launchpad.net/tripleo/+bug/1958955 | 11:25 |
slaweq | marios|ruck: sure, joining | 11:26 |
marios|ruck | slaweq: oooci-jobs.sh: *** ZUUL BUILDS *** https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset002-master | 11:37 |
marios|ruck | arxcruz: o/ hey man can you please update your go patch there are some comments | 11:52 |
rlandy|ruck | arxcruz: pls, pls address the comments on https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/38469 | 11:52 |
arxcruz | rlandy|ruck marios|ruck yes, I'm working on that | 11:52 |
rlandy|ruck | arxcruz: we need to merge this - pls, thank you, for me | 11:52 |
marios|ruck | arxcruz: thanks (we were discussing just now on the status/reviews call) | 11:53 |
rlandy|ruck | bhagyashris: akahat: pls see comments on https://review.rdoproject.org/r/q/topic:cs9_w_comp_jobs | 11:54 |
rlandy|ruck | missing on step | 11:54 |
rlandy|ruck | one | 11:54 |
dviroel | https://review.rdoproject.org/r/c/rdo-jobs/+/36726 | 11:55 |
arxcruz | marios|ruck dviroel rlandy|ruck done | 12:01 |
slaweq | marios|ruck: rlandy|ruck dviroel hi, I checked logs from that failed job, compared it with working centos8 job and I wrote my findings in comment https://bugs.launchpad.net/tripleo/+bug/1958955/comments/8 | 12:12 |
slaweq | I hope it will be helpful to resolve that issue | 12:12 |
slaweq | if You would need anything else, please ping me | 12:12 |
marios|ruck | rlandy|ruck: https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/826764 | 12:15 |
rlandy|ruck | rcastillo|rover: https://trello.com/c/2yVMqXuG/2297-cixlp1957789tripleociproa-centos-stream-9-wallaby-overcloud-ipa-image-build-blocker | 12:26 |
rlandy|ruck | looks fix - can we add build image jobs to wallaby c9 pipeline? | 12:26 |
rlandy|ruck | if yes, please comment and close out card | 12:26 |
dviroel | slaweq: thanks, i will take a look | 12:28 |
rlandy|ruck | slaweq: thanks - looking | 12:33 |
rlandy|ruck | marios|ruck: dviroel: time to ping harold? | 12:34 |
akahat | rlandy|ruck, ack. i'll take care of it. | 12:38 |
rlandy|ruck | akahat: thank you | 12:39 |
dviroel | rlandy|ruck: yeah, I can't find any other issue looking at the logs atm | 12:40 |
rlandy|ruck | dviroel: k - pinging on #tripleo | 12:42 |
marios|ruck | ack rlandy|ruck thanks | 12:43 |
rlandy|ruck | ysandeep: hey - still debugging? | 12:46 |
rlandy|ruck | ysandeep: let me know when you can sync | 12:46 |
ysandeep | rlandy|ruck, still debugging but I am debugging alone now, give me 5 mins - consolidating my findings | 12:46 |
rlandy|ruck | ok | 12:49 |
ysandeep | rlandy|ruck, lets chat meet.google.com/apk-musz-pks | 12:55 |
marios|ruck | rlandy|ruck: dviroel: arxcruz: frenzyfriday: please vote when you have a minute this is good to merge info/links @ https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/825506/4#message-47d1b14a495d622e1f4eed7675329564459f8b00 | 13:15 |
* dviroel looks | 13:18 | |
ysandeep | rlandy|ruck, https://review.rdoproject.org/r/c/testproject/+/38348/3/zuul.yaml,edit | 13:28 |
ysandeep | rlandy|ruck, periodic-tripleo-centos-8-ussuri-component-ui-promote-to-promoted-components | 13:29 |
frenzyfriday | marios|ruck, thanks for the patch ! | 13:30 |
*** dasm|off is now known as dasm | 13:30 | |
dasm | o/ | 13:30 |
*** dasm is now known as dasm|rover | 13:31 | |
marios|ruck | frenzyfriday: ;) | 13:31 |
dviroel | dasm|rover: happy first ruck/rover day o/ | 13:34 |
dasm|rover | dviroel: \o/ | 13:34 |
jm1 | rlandy|ruck: Looks like my comment to the github pull request triggered some response from Stephen Finucane on openstack-discuss and on Github🙈 He is going to deprecate powervm in Nova and drop the dependency on powervm | 13:36 |
rlandy|ruck | jm1: wow - quite the influencer already | 13:39 |
jm1 | rlandy|ruck: haha no. Just trying to get DevStack working... | 13:43 |
jm1 | anyone tried to install cs 9 lately? | 13:43 |
marios|ruck | rcastillo|rover: o/ hey - can you please remember to include Related-Bug: in the commit message on your skiplist patches (or anywhere else for that matter) - e.g. this one https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/826314 i had to go looking for it as there was no info on the bug https://bugs.launchpad.net/tripleo/+bug/1959014 | 13:46 |
marios|ruck | rcastillo|rover: another example there (I updated it this morning) https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/826764 | 13:47 |
marios|ruck | rcastillo|rover: for future reference please thank you ;) | 13:47 |
rcastillo|rover | marios|ruck: sorry about that, will keep in mind for the future | 13:59 |
*** amoralej is now known as amoralej|lunch | 14:02 | |
*** rcastillo|rover is now known as rcastillo | 14:13 | |
marios|ruck | rcastillo: ack thanks | 14:13 |
rlandy|ruck | ysandeep: https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/285576 updated | 14:15 |
ysandeep | rlandy|ruck, thanks! looking | 14:15 |
ysandeep | rlandy|ruck, lets see how check job standalone job goes (which failed in post failure last time) | 14:18 |
ysandeep | if it works - we will remove depends-on upstream job for now and make image/container build non-voting for now | 14:19 |
ysandeep | depends-on upstream patch* | 14:19 |
rlandy|ruck | ysandeep: ack - here's hoping | 14:20 |
*** amoralej|lunch is now known as amoralej | 14:30 | |
*** ysandeep is now known as ysandeep|dinner | 14:34 | |
rlandy|ruck | rcastillo: dviroel: akahat: bhagyashris: dasm|rover: arxcruz: frenzyfriday: jm1: pl join meet for a few ... https://meet.google.com/axp-etcu-iod?pli=1&authuser=0 | 14:39 |
rlandy|ruck | ysandeep|dinner: marios|ruck: ^^ optional for you guys | 14:39 |
rlandy|ruck | since we already spoke | 14:39 |
rlandy|ruck | akahat: jm1: if you guys are around ^^ | 14:41 |
frenzyfriday | hey folks, happy friday moved to: https://meet.google.com/axp-etcu-iod?pli=1&authuser=0 | 15:18 |
frenzyfriday | because we are lazy :D | 15:18 |
*** dviroel is now known as dviroel|lunch | 15:31 | |
rlandy|ruck | ysandeep|dinner: think we are good to go now | 15:31 |
rlandy|ruck | trying integration line job | 15:32 |
rlandy|ruck | marios|ruck: dasm|rover: want to ruck/rover sync to hand over work? | 15:37 |
rlandy|ruck | marios|ruck is probably EoD soon | 15:37 |
marios|ruck | rlandy|ruck: o/ | 15:39 |
marios|ruck | rlandy|ruck: around for an hour ish | 15:39 |
rlandy|ruck | dasm|rover: you around? | 15:39 |
dasm|rover | rlandy|ruck: yeah. i'm back | 15:43 |
*** ysandeep|dinner is now known as ysandeep | 15:44 | |
dasm|rover | marios|ruck: are you in a meeting with rlandy|ruck ? | 15:45 |
marios|ruck | dasm|rover: no not yet | 15:45 |
dasm|rover | k | 15:45 |
ysandeep | rlandy|ruck, wohooo, nice! | 15:45 |
marios|ruck | dasm|rover: i guess rlandy|ruck may be briefly afk | 15:45 |
dasm|rover | probably | 15:45 |
ysandeep | rlandy|ruck, lets remove depends-on and mark image/container build non-voting(to merge this patch). | 15:46 |
rlandy|ruck | ysandeep: I need to ruck rover sync | 15:46 |
rlandy|ruck | pls go ahead and do whatever is needed | 15:46 |
ysandeep | rlandy|ruck, nw, I am updating patch | 15:46 |
rlandy|ruck | marios|ruck: dasm|rover: ok - let's rr work transfer ... https://meet.google.com/uca-rxwo-ewq?pli=1&authuser=0 | 15:47 |
*** ykarel_ is now known as ykarel | 15:54 | |
marios|ruck | rlandy|ruck: we have an issue with victoria ... you still in the call? | 16:16 |
rlandy|ruck | marios|ruck: we just dropped | 16:16 |
rlandy|ruck | you want to chat? | 16:16 |
rlandy|ruck | can join again | 16:16 |
marios|ruck | rlandy|ruck: k, let me tell you here | 16:16 |
marios|ruck | rlandy|ruck: looks like issue with images.rdoproject.org | 16:17 |
marios|ruck | rlandy|ruck: space | 16:17 |
marios|ruck | rlandy|ruck: no overcloud-full @ https://images.rdoproject.org/centos8/victoria/rdo_trunk/tripleo-ci-testing/ | 16:17 |
marios|ruck | rlandy|ruck: because in the periodic job that was meant to push it 2022-01-28 05:01:38.839060 | primary | rsync: write failed on "/var/www/html/images/centos8/victoria/rdo_trunk/e5348cc9e5142070052c6402a2459f76/overcloud-full.tar": No space left on device (28) | 16:17 |
marios|ruck | rlandy|ruck: there https://logserver.rdoproject.org/openstack-periodic-integration-stable2/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-8-buildimage-overcloud-full-victoria/2fe177c/job-output.txt | 16:17 |
ade_lee__ | dviroel|lunch, rlandy|ruck , dasm|rover -- so the only major thing blocking us now on fips side is a fix to the python-9 bug with fips | 16:17 |
rlandy|ruck | marios|ruck: ah - dpawlik mentioned that yesterday | 16:17 |
marios|ruck | rlandy|ruck: noticed it looking at latest builds there for the bug you asked me to checkout (https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-victoria ) | 16:18 |
marios|ruck | rlandy|ruck: top fail there is because of missing image | 16:18 |
rlandy|ruck | pls ping him on rhos-ops | 16:18 |
marios|ruck | rlandy|ruck: k | 16:18 |
rlandy|ruck | I think wallaby is failing with the same problem | 16:18 |
rlandy|ruck | marios|ruck: ^^ | 16:18 |
marios|ruck | rlandy|ruck: nice .. :/ | 16:18 |
rlandy|ruck | failed image build | 16:18 |
marios|ruck | rlandy|ruck: i think dpawlik is out for the day though | 16:18 |
ade_lee__ | rlandy|ruck, jpodivin , dasm|rover , dviroel|lunch -- is it possible to start testing with a mock build as described in https://bugzilla.redhat.com/show_bug.cgi?id=1942527#c28 ? | 16:19 |
rlandy|ruck | marios|ruck: tristan? | 16:19 |
rlandy|ruck | someone on us time? | 16:20 |
*** dviroel|lunch is now known as dviroel | 16:23 | |
marios|ruck | rlandy|ruck: dasm|rover: fyi ... https://review.rdoproject.org/r/c/testproject/+/38737 lets see if it can push the image now | 16:24 |
marios|ruck | rlandy|ruck: after that completes dasm|rover can you please check the result and you should see the image appear (overcloud-full) @ https://images.rdoproject.org/centos8/victoria/rdo_trunk/tripleo-ci-testing/ | 16:24 |
marios|ruck | dasm|rover: dpawlik cleared some space for us so it should be better now but let's see | 16:25 |
dviroel | ade_lee__: o/ - yeah, I think that is possible | 16:25 |
ade_lee__ | dviroel, jpodivin , rlandy|ruck , dasm|rover - would save some time -- I don't know how to do this though. | 16:27 |
dviroel | ade_lee__: since it is python installation, we might need this hack at very beginning of everything - we will need to setup something in zuul-jobs | 16:27 |
dviroel | ade_lee__: because c9 fips jobs fail there, after rebooting | 16:28 |
ade_lee__ | yes | 16:28 |
dviroel | ade_lee__: would be a hack like you did for c8 then | 16:29 |
ade_lee__ | dviroel, jpodivin yeah - something like https://review.opendev.org/c/zuul/zuul-jobs/+/807031 | 16:29 |
ade_lee__ | but it will likely have to be earlier .. | 16:30 |
ade_lee__ | or maybe not -- as long as it happens before the reboot | 16:30 |
dviroel | ade_lee__: yes | 16:31 |
dviroel | ade_lee__: reboot is at the end of this file | 16:31 |
ade_lee__ | dviroel, jpodivin so -- I need to copy that repo to my people page or something accessible externally, and add it where we did this here and update python3 I guess - or maybe just do an update | 16:32 |
ade_lee__ | dviroel, jpodivin - ok - my experiment for today :/ | 16:34 |
jpodivin | seems like the easiest approach, I wish you good luck. :) | 16:34 |
rlandy|ruck | marios|ruck: great - thanks | 16:47 |
rlandy|ruck | ysandeep: we can't get https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/285576 through w/o depends ons | 16:57 |
rlandy|ruck | we need to make those test on-voting in the patch | 16:57 |
rlandy|ruck | let me know if you want me to do that | 16:57 |
marios|ruck | rlandy|ruck: so... wrt kashyap request - commented there https://bugs.launchpad.net/tripleo/+bug/1959014/comments/6 - we*should* already have those but it isn't being collected... maybe you or dasm|rover can dig a bit on that if you have time later | 16:57 |
ysandeep | rlandy|ruck, i removed the depends-on and marked those jobs voting - standalone running right now | 16:58 |
ysandeep | marked those jobs non* voting | 16:58 |
ysandeep | lets merge that patch as soon as standalone reports back | 16:59 |
rlandy|ruck | ysandeep: ack | 17:02 |
rlandy|ruck | marios|ruck: ack - will look at it with dasm|rover this afternoon | 17:02 |
*** jpena is now known as jpena|off | 17:06 | |
*** marios|ruck is now known as marios|out | 17:08 | |
ysandeep | rlandy|ruck, lets merge this https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/285576 | 17:35 |
rlandy|ruck | ysandeep: voted | 17:37 |
rlandy|ruck | pls merge | 17:37 |
rlandy|ruck | it's my patch - so better if someone else votes/merges | 17:37 |
ysandeep | rlandy|ruck, merging | 17:37 |
ysandeep | rlandy|ruck: see you on Monday o/ | 17:42 |
*** ysandeep is now known as ysandeep|out | 17:42 | |
ysandeep|out | Happy weekend everyone! | 17:43 |
rlandy|ruck | ysandeep|out: thank - have a good weekend | 17:47 |
rlandy|ruck | periodic-tripleo-ci-centos-8-scenario010-kvm-internal-standalone-wallabytripleo-downstream-trigger-nested-virtmastercheck-rdo38736,1 | 17:57 |
rlandy|ruck | 1 hr 27 mins 19 secs2022-01-28 16:19:18SUCCESS | 17:57 |
rlandy|ruck | woohoo kvm is baaaaaccckkk | 17:57 |
dasm|rover | rlandy|ruck: fyi, i commented on and moved back to triaged the bug with kmod.rb: https://bugs.launchpad.net/tripleo/+bug/1958240/comments/9 | 18:12 |
rlandy|ruck | dasm|rover: great - thanks | 18:19 |
rlandy|ruck | looking at bug marios referenced about kashap's comments | 18:20 |
dasm|rover | k | 18:22 |
dasm|rover | just started a downstream job to verify https://review.opendev.org/c/openstack/octavia-tempest-plugin/+/816369 and https://review.opendev.org/c/openstack/octavia/+/816370 | 18:29 |
dasm|rover | will see if that fixes issue | 18:29 |
rlandy|ruck | ok | 18:43 |
dviroel | rlandy|ruck: o/ - do you remember any related bug with this error: https://logserver.rdoproject.org/46/38646/2/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset064-wallaby/3e62dd8/logs/undercloud/home/zuul/overcloud1_deploy.log.txt.gz | 18:53 |
dviroel | rlandy|ruck: same issue on c9-wallaby-fs039 | 18:53 |
dviroel | rlandy|ruck: i was looking int LP, didn't spot anything - /me searching for possible backports | 18:54 |
dviroel | FATAL | Create containers managed by Podman for /var/lib/tripleo-config/container-puppet-config/step_1 | overcloud1-novacompute-0 | error={"changed": false, "msg": "Failed containers: container-puppet-nova_libvirt"} | 18:54 |
rlandy|ruck | yeah | 18:55 |
dviroel | "exit 6" above | 18:55 |
rlandy|ruck | that was the one we looked at | 18:55 |
rlandy|ruck | getting | 18:55 |
rlandy|ruck | hmmm ... | 18:56 |
rlandy|ruck | https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-standalone-on-multinode-ipa-master/84e06be/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 18:57 |
rlandy|ruck | {"changed": false, "msg": "Failed containers: container-puppet-nova_libvirt"} | 18:57 |
dviroel | oh | 18:57 |
rlandy|ruck | <13>Jan 27 17:58:53 puppet-user: Error: Facter: error while resolving custom facts in /usr/share/openstack-puppet/modules/kmod/lib/facter/kmod.rb: expected argument to be a String, Symbol, or Hash | 18:58 |
rlandy|ruck | <13>Jan 27 17:58:55 puppet-user: Warning: /etc/puppet/hiera.yaml: Use of 'hiera.yaml' version 3 is deprecated. It should be converted to version 5 | 18:58 |
rlandy|ruck | https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-standalone-on-multinode-ipa-master/84e06be/logs/undercloud/var/log/extra/podman/containers/container-puppet-nova_libvirt/stdout.log.txt.gz | 18:58 |
rlandy|ruck | https://bugs.launchpad.net/tripleo/+bug/1958240 | 18:58 |
rlandy|ruck | dasm|rover: the bug you pinged Takashi about | 18:58 |
dasm|rover | yes? | 18:59 |
dviroel | yeah, seems similar | 18:59 |
dasm|rover | versions seem to align with what is released. but the fix doesn't seem to be working | 19:00 |
* dviroel looks multione-ipa on wallaby | 19:00 | |
rlandy|ruck | dviroel: see ping on #tripleo | 19:00 |
rlandy|ruck | we are waiting on takashi to respond here | 19:01 |
dviroel | fyi, same issue in wallaby - https://logserver.rdoproject.org/35/35235/6/check/periodic-tripleo-ci-centos-9-standalone-on-multinode-ipa-wallaby/27db72d/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 19:01 |
rlandy|ruck | ugh ,,, | 19:02 |
rlandy|ruck | 2022-01-28 18:34:51.568 | Error: | 19:02 |
rlandy|ruck | 2022-01-28 18:34:51.568 | Problem 1: cannot install the best candidate for the job | 19:02 |
rlandy|ruck | 2022-01-28 18:34:51.568 | - nothing provides pacemaker-libs(x86-64) = 2.1.2-3.el8 needed by pacemaker-remote-2.1.2-3.el8.x86_64 | 19:02 |
rlandy|ruck | 2022-01-28 18:34:51.568 | Problem 2: cannot install the best candidate for the job | 19:02 |
rlandy|ruck | 2022-01-28 18:34:51.568 | - nothing provides pacemaker-libs(x86-64) = 2.1.2-3.el8 needed by pacemaker-2.1.2-3.el8.x86_64 | 19:02 |
rlandy|ruck | 2022-01-28 18:34:51.568 | - nothing provides pacemaker-cluster-libs(x86-64) = 2.1.2-3.el8 needed by pacemaker-2.1.2-3.el8.x86_64 | 19:02 |
rlandy|ruck | train | 19:02 |
rlandy|ruck | build image problem | 19:02 |
rlandy|ruck | maybe it will go away | 19:02 |
rlandy|ruck | wishful | 19:02 |
dviroel | yeah, maybe a sync will fix it soon :) | 19:02 |
dasm|rover | dviroel: https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-9-standalone-on-multinode-ipa-master | 19:03 |
dasm|rover | all failures are caused by the same thing | 19:03 |
dviroel | dasm|rover: ack, tks | 19:03 |
*** amoralej is now known as amoralej|off | 19:07 | |
dasm|rover | echo 'Playbook run of multinode-standalone.yml passed successfully' | 19:55 |
dasm|rover | https://code.engineering.redhat.com/gerrit/c/testproject/+/307244 | 19:56 |
rlandy|ruck | 2022-01-28 19:06:52.617349 | primary | fatal: [undercloud]: FAILED! => {"attempts": 5, "changed": false, "failures": [], "msg": "Depsolve Error occured: \n Problem: cannot install both gcc-8.5.0-7.el8.x86_64 and gcc-8.5.0-8.el8.x86_64\n - package gcc-c++-8.5.0-7.el8.x86_64 requires gcc = 8.5.0-7.el8, but none of the providers can be installed\n - cannot install the best update candidate for package gcc-8.5.0-8.el8.x86_64\n | 19:59 |
rlandy|ruck | - cannot install the best candidate for the job", "rc": 1, "results": []} | 19:59 |
rlandy|ruck | dasm|rover: ^^ all tempest line tests are failing with that | 19:59 |
rlandy|ruck | may be a mirror thing | 19:59 |
rlandy|ruck | idk | 19:59 |
rlandy|ruck | we should keep an eye on it | 19:59 |
dasm|rover | k | 20:01 |
rlandy|ruck | dasm|rover: victoria and train both hit image upload error - hoping they will clear the next run | 20:06 |
dasm|rover | rlandy|ruck: do you want me to look at this? | 20:13 |
rlandy|ruck | dasm|rover: you know how to rekick lines, right? | 20:14 |
rlandy|ruck | pls try rekick the train line | 20:14 |
rlandy|ruck | and see if it clears | 20:14 |
dasm|rover | k, i'll do my best. | 20:15 |
* dasm|rover diving into notes | 20:15 | |
dasm|rover | i **think** i did it right. | 20:28 |
dasm|rover | > podman run --rm --name zc_container -v /home/dasm/.config/zuul/:/config:Z zuul/zuul-client:latest -c /config/client.conf --use-config rdoproject.org enqueue-ref --pipeline openstack-periodic-integration-stable4 --project openstack/tripleo-ci --ref 622ec67e51f85e0d64c4f77e6e3d3858e15ca36e | 20:28 |
dviroel | dasm|rover++ | 20:41 |
dasm|rover | ;) | 20:42 |
*** dviroel is now known as dviroel|brb | 20:46 | |
dasm|rover | it failed on buildimage-overcloud-hardened-full-train: https://logserver.rdoproject.org/openstack-periodic-integration-stable4/opendev.org/openstack/tripleo-ci/622ec67e51f85e0d64c4f77e6e3d3858e15ca36e/periodic-tripleo-centos-8-buildimage-overcloud-hardened-full-train/b40e5d1/ | 20:57 |
dasm|rover | > TASK [oooci-build-images : Run build-images.sh] | 20:57 |
rlandy|ruck | 2022-01-28 20:54:01.485 | INFO:root:Mapping for overcloud-base : openssl-perl | 20:58 |
rlandy|ruck | 2022-01-28 20:54:01.485 | ERROR:root:overcloud-base has no valid mapping for package openssl-perl | 20:58 |
rlandy|ruck | 2022-01-28 20:54:01.489 | + map_pkg= | 20:58 |
rlandy|ruck | 2022-01-28 20:54:05.483 | Error: | 20:58 |
rlandy|ruck | 2022-01-28 20:54:05.483 | Problem 1: cannot install the best candidate for the job | 20:58 |
rlandy|ruck | 2022-01-28 20:54:05.483 | - nothing provides pacemaker-libs(x86-64) = 2.1.2-3.el8 needed by pacemaker-remote-2.1.2-3.el8.x86_64 | 20:58 |
rlandy|ruck | 2022-01-28 20:54:05.483 | Problem 2: cannot install the best candidate for the job | 20:58 |
rlandy|ruck | 2022-01-28 20:54:05.483 | - nothing provides pacemaker-libs(x86-64) = 2.1.2-3.el8 needed by pacemaker-2.1.2-3.el8.x86_64 | 20:58 |
rlandy|ruck | 2022-01-28 20:54:05.483 | - nothing provides pacemaker-cluster-libs(x86-64) = 2.1.2-3.el8 needed by pacemaker-2.1.2-3.el8.x86_64 | 20:58 |
rlandy|ruck | ^^ error | 20:59 |
rlandy|ruck | dasm|rover: ugh - let's give the weekend | 21:05 |
rlandy|ruck | and bug if it's still failing then | 21:05 |
rlandy|ruck | commented on https://bugs.launchpad.net/tripleo/+bug/1959014 | 21:05 |
dasm|rover | k | 21:08 |
rlandy|ruck | rcastillo: https://review.opendev.org/c/openstack/tripleo-ci/+/826124/ - https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-9-standalone-on-multinode-ipa&skip=0 is killing it | 21:35 |
rlandy|ruck | bug above is logged in integration line | 21:35 |
dasm|rover | rlandy|ruck: i'm wrapping up for today. have a wonderful weekend! | 21:46 |
dasm|rover | see you on monday | 21:46 |
*** dasm|rover is now known as dasm|off | 21:47 | |
rlandy|ruck | dasm|off: thanks - you too | 21:47 |
rlandy|ruck | see you monday | 21:47 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!