| *** ysandeep|out is now known as ysandeep | 05:41 | |
| Tengu | rlandy|out: hello there! testing my custom image now ! | 06:12 |
|---|---|---|
| Tengu | wooohooooooo | 07:21 |
| Tengu | I have a provisioned Controller node! | 07:21 |
| Tengu | or, at least, second boot passed and ansible is running! | 07:22 |
| Tengu | "Nodes deployed successfully, add overcloud-baremetal-deployed-0.yaml to your deployment environment" | 07:22 |
| Tengu | I'll test Steve latest patch against tripleo-common later today, have to go afk for ~1h30 | 07:22 |
| frenzy_friday | What is the equivalent centos 9 nodeset for three-centos-8-nodes? | 07:27 |
| ysandeep | Tengu++ woot \o/ thanks for testing | 07:30 |
| ysandeep | frenzy_friday, checking | 07:31 |
| bhagyashris|ruck | ysandeep, some c9 master component jobs that were in criteria were not yet merged into the pipeline, which was causing them to never promote. Probably a good idea to keep an eye on the c9 component lines to make sure tey move forward. | 07:34 |
| bhagyashris|ruck | sp should we removed the job which is not in the integration line | 07:34 |
| bhagyashris|ruck | but present in the criteria | 07:34 |
| ysandeep | omg, why we added jobs in criteria if they are not running :D? | 07:35 |
| frenzy_friday | ysandeep, thanks. | 07:35 |
| frenzy_friday | bhagyashris|ruck, checking which jobs are not merged | 07:36 |
| ysandeep | frenzy_friday, you need to define a new nodeset for three-centos-9-nodes in this file https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/nodesets.yaml , following other c9 nodeset examples | 07:37 |
| bhagyashris|ruck | frenzy_friday, ack thanks :) | 07:37 |
| * ysandeep checking promotion criteria vs jobs for master | 07:39 | |
| bhagyashris|ruck | ysandeep, frenzy_friday is checking | 07:47 |
| bhagyashris|ruck | ysandeep, fs064 is failing on cs9 master due to overcloud node provision failed https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-ovb-1ctlr_1comp-featureset002-master/9027cac/job-output.txt | 07:49 |
| bhagyashris|ruck | is this a know issue ? | 07:49 |
| bhagyashris|ruck | some times it's failing due to undercloud install and some times due to overcloud node provision | 07:50 |
| bhagyashris|ruck | not sure | 07:50 |
| ysandeep | bhagyashris|ruck, looks like issue started on thursday - https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-9-ovb-1ctlr_1comp-featureset002-master , I have not seen any bug related to this on cix board | 07:51 |
| bhagyashris|ruck | ysandeep, yeah me too | 07:51 |
| bhagyashris|ruck | frenzy_friday, is this know issue ^ | 07:51 |
| frenzy_friday | bhagyashris|ruck, nope, didnt see this | 07:53 |
| frenzy_friday | bhagyashris|ruck, https://raw.githubusercontent.com/rdo-infra/ci-config/master/ci-scripts/dlrnapi_promoter/config/CentOS-9/component/master.yaml and https://raw.githubusercontent.com/rdo-infra/rdo-jobs/master/zuul.d/component-pipeline-main-centos9.yaml - I didnt fing any missing jobs. | 07:56 |
| bhagyashris|ruck | frenzy_friday, ack thanks not sure rcastillo|rover just leave the note will check with him | 07:57 |
| frenzy_friday | But some jobs like periodic-tripleo-ci-centos-9-standalone-full-tempest-api-network-master: *cs9_comp_network_to_ci_testing_master are defined in component-pipeline-main-centos9.yaml twice I think | 07:57 |
| bhagyashris|ruck | i think repeated definition should not caused any issue | 07:58 |
| ysandeep | I couldn't find any job that is not running but in promotion criteria i.e, left a note for rcastillo|rover on tripleo-ci chat channel | 08:04 |
| *** amoralej|off is now known as amoralej | 08:04 | |
| ysandeep | folks: hello o/ bhagyashris|ruck and rcastillo|rover are ruck/rovering this week, We need someone to pick wallaby component line work - https://issues.redhat.com/browse/TRIPLEOCI-756 (Some patches are already up - details in card). I am looking for some volunteer to pick this work, If you have bandwidth please feel free to take over this card. | 08:22 |
| ysandeep | akahat, ^^ may you have b.w to pick this up for this week :) | 08:22 |
| akahat | ysandeep, yeah. sure.. i'll help. | 08:23 |
| ysandeep | akahat++ thanks! I just posted release file few mins ago: https://review.opendev.org/c/openstack/tripleo-quickstart/+/826245 which you can use as depends-on for testing, we did our first current-tripleo promotion for wallaby last night - so we can start with this work now. | 08:24 |
| ysandeep | akahat, assigning this card https://issues.redhat.com/browse/TRIPLEOCI-756 to you for the time being. | 08:26 |
| akahat | ysandeep, ack | 08:26 |
| soniya29 | ysandeep, marios, arxcruz, can we get this merged:- https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/815654? | 08:26 |
| marios | soniya29: adding to my next reviews | 08:27 |
| soniya29 | marios, thanks :) | 08:27 |
| ysandeep | soniya29: ack, adding to review list | 08:27 |
| soniya29 | ysandeep, thanks | 08:27 |
| soniya29 | arxcruz, kopecmartin, can you revote on this patch please - https://review.opendev.org/c/openinfra/python-tempestconf/+/820169 ? | 08:32 |
| *** jpena|off is now known as jpena | 08:35 | |
| Tengu | ysandeep: ^^ at least, I'm a bit ahead of CI, uncovering some fun issues :) | 09:08 |
| Tengu | let's see how I can patch tripleo-common in my build container now... | 09:08 |
| *** ysandeep is now known as ysandeep|lunch | 09:27 | |
| Tengu | ah. there's a "patch" module in ansible.posix :D | 09:37 |
| Tengu | nice | 09:37 |
| Tengu | that, plus the fact gerrit provides the whole patch as a b64 encoded thing, it makes the trick easier. | 09:38 |
| Tengu | ysandeep|lunch: testing https://review.opendev.org/c/openstack/tripleo-common/+/826205 right now | 09:41 |
| bhagyashris|ruck | folks kindly add into your review list https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/38519 thanks :) | 09:48 |
| amoralej | hi, iirc there was some way to test tripleo jobs adding a new temporary repository, what's the best way? | 09:52 |
| amoralej | it's related to https://review.rdoproject.org/r/c/rdoinfo/+/38388 | 09:52 |
| Tengu | amoralej: the testproject thing iirc? | 09:52 |
| amoralej | mmm | 09:52 |
| Tengu | dang. and it's a fail... | 09:57 |
| Tengu | pfff. | 09:57 |
| Tengu | hmm. and this fails during the IPA build. that's weird. | 10:04 |
| *** ysandeep|lunch is now known as ysandeep | 10:28 | |
| * bhagyashris|ruck brb | 10:38 | |
| Tengu | hmmm. I may have something working. at least, images are built. let's test them. | 10:41 |
| amoralej | rlandy|out, we have added puppet-promotion pipeline to openstack-periodic-daily https://review.rdoproject.org/r/c/config/+/38444 | 10:42 |
| amoralej | also we are adding it for wallaby in openstack-periodic-integration-stable2 https://review.rdoproject.org/r/c/rdo-jobs/+/37379 | 10:44 |
| *** rlandy|out is now known as rlandy|ruck | 11:14 | |
| *** dviroel|out is now known as dviroel | 11:20 | |
| rlandy|ruck | Tengu: is this the same bug you were hitting? https://bugs.launchpad.net/tripleo/+bug/1958955 | 11:22 |
| rlandy|ruck | bhagyashris|ruck: hi - thank you for posting https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/38519 | 11:47 |
| rlandy|ruck | why is there https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/38519/3/ci-scripts/infra-setup/roles/rrcockpit/files/telegraf_py3/tests/data/gerrit-test-data.json included? | 11:48 |
| rlandy|ruck | ysandeep: marios: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/826153 | 11:51 |
| rlandy|ruck | ysandeep: marios: https://review.rdoproject.org/r/c/rdo-jobs/+/36726 | 11:52 |
| rlandy|ruck | https://review.rdoproject.org/r/c/testproject/+/36976 | 11:53 |
| soniya29 | rlandy|ruck, bhagyashris|ruck, i need to step out for 1-2 hr, i may not be able to join the UA/tc meeting | 11:54 |
| soniya29 | rlandy|ruck, bhagyashris|ruck, i will add the tempest stuff as I am back | 11:54 |
| marios | arxcruz: do we have a patch for the container tagging to quay? | 11:55 |
| arxcruz | marios https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/38469 | 11:55 |
| marios | thanks arxcruz | 11:56 |
| *** soniya29 is now known as soniya29|afk | 11:56 | |
| frenzy_friday | hey ysandeep , these jobs were also missing right? https://review.rdoproject.org/r/c/rdo-jobs/+/38533/2/zuul.d/component-jobs-master-centos9.yaml | 12:00 |
| ysandeep | frenzy_friday, looking | 12:07 |
| rlandy|ruck | frenzy_friday: dviroel: ysandeep: marios: https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/826061 merging that to add back octavia tests | 12:07 |
| dviroel | ack | 12:07 |
| rlandy|ruck | https://review.opendev.org/c/openstack/tripleo-ci/+/826133 merged | 12:07 |
| bhagyashris|ruck | rlandy|ruck, unit test were failing | 12:08 |
| rlandy|ruck | bhagyashris|ruck: ack - marios said that may be the issue | 12:08 |
| bhagyashris|ruck | rlandy|ruck, https://logserver.rdoproject.org/19/38519/2/check/tox-py36-ci-config/2119fa1/tox/reports.html | 12:09 |
| rlandy|ruck | dviroel: ysandeep: ok - pls review that change to fix the tests and then we can merge the wallaby container push | 12:09 |
| rlandy|ruck | https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/38519 | 12:09 |
| ysandeep | +2 - lgtm | 12:10 |
| rlandy|ruck | bhagyashris|ruck; let's sync | 12:11 |
| bhagyashris|ruck | rlandy|ruck, sure | 12:11 |
| rlandy|ruck | https://meet.google.com/uqj-amsi-amv?pli=1&authuser=0 | 12:11 |
| Tengu | rlandy|ruck: 2s, lemme read. | 12:21 |
| rlandy|ruck | marios: ysandeep: testproject on image build is green: | 12:21 |
| Tengu | hmmm. nope. not the same | 12:21 |
| rlandy|ruck | periodic-tripleo-centos-9-buildimage-ironic-python-agent-mastertestprojectmastercheck36140,32 | 12:21 |
| rlandy|ruck | 20 mins 12 secs2022-01-25 11:44:10SUCCESS | 12:21 |
| rlandy|ruck | periodic-tripleo-centos-9-buildimage-overcloud-full-mastertestprojectmastercheck36140,32 | 12:21 |
| rlandy|ruck | 30 mins 43 secs2022-01-25 11:44:00SUCCESS | 12:21 |
| rlandy|ruck | periodic-tripleo-centos-9-buildimage-overcloud-hardened-uefi-full-mastertestprojectmastercheck36140,32 | 12:21 |
| rlandy|ruck | 33 mins 16 secs2022-01-25 11:46:53SUCCESS | 12:21 |
| ysandeep | for move to 8-stream for dib_release patch? | 12:22 |
| ysandeep | 9-stream* | 12:23 |
| Tengu | hmmm ok. grumpf. that grub2-switch-to-blscfg command is really, really sad. | 12:23 |
| Tengu | grumpf. ok. so I'm back to day-1, with the wrong partition UUID in place. | 12:24 |
| Tengu | "great". options root=UUID=6b7d86ad-e82a-423b-a071-6052836747a1 ro console=ttyS0,115200n8 no_timer_check net.ifnames=0 crashkernel=auto | 12:25 |
| Tengu | that's plain wrong. | 12:25 |
| Tengu | should be the LABEL | 12:25 |
| rlandy|ruck | Tengu: commenting on your failures or our failure? | 12:25 |
| Tengu | mine | 12:25 |
| Tengu | testing Steve latest patch https://review.opendev.org/c/openstack/tripleo-common/+/826205 | 12:25 |
| Tengu | for me, it's not improving anything :/. | 12:26 |
| marios | rlandy|ruck: ysandeep: please also have a look in your own time ... what am i missing https://review.rdoproject.org/r/c/config/+/38298/13#message-0c46abd375db29e1ef0e6b6ca43d6630b573910e | 12:27 |
| marios | sshnaidm|afk: ^^ | 12:28 |
| *** sshnaidm|afk is now known as sshnaidm | 12:28 | |
| ysandeep | marios, ack | 12:28 |
| sshnaidm | marios, it requires some more work, probably better to change repositories one by one | 12:32 |
| sshnaidm | too much changes in one patch | 12:32 |
| marios | sshnaidm: yea we were trying to decide in the call earlier... we said if we don't find some big error in the next 24 hours (lets stare at it one more time kind of thing) then we can try go with it | 12:33 |
| marios | sshnaidm: otherwise we may just split ... cc rlandy|ruck ^^ | 12:33 |
| sshnaidm | I'd vote for splitting and revisiting of old jobs as well | 12:34 |
| sshnaidm | it's a mix of new, redundant, eol and old jobs there | 12:35 |
| marios | sshnaidm: agree ... and split is the right way but it should have been done earlier... hesitation is don't know if it will make it better or worse to split it at this point... | 12:35 |
| marios | sshnaidm: but if my comment is correct then i think we will just go ahead and split it | 12:36 |
| marios | (plus anything else we might find in review) | 12:36 |
| ysandeep | frenzy_friday, looks okay, lets wait for testproject results. | 12:36 |
| sshnaidm | marios, lemme submit an example patch and we can see | 12:36 |
| marios | sshnaidm: thanks | 12:36 |
| rlandy|ruck | marios: sshnaidm: ysandeep: I think splitting is the sane way atm | 12:36 |
| ysandeep | +1 | 12:37 |
| marios | rlandy|ruck: yeah i agree now that i've found an actual error/nit | 12:37 |
| * marios coffee brb | 12:37 | |
| rlandy|ruck | marios: ok - so let me know where you leave it at your eod | 12:37 |
| rlandy|ruck | and I'll try do something in my afternoon | 12:37 |
| rlandy|ruck | Tengu: we w+ two tripleo-ci patches for stream-9 | 12:39 |
| Tengu | rlandy|ruck: ah, cool! | 12:41 |
| marios | rlandy|ruck: k | 12:43 |
| rlandy|ruck | dviroel: not sure how this worked ... but here we go https://hub.docker.com/orgs/tripleowallabycentos9 | 12:44 |
| Tengu | marios: thanks for the review on https://review.opendev.org/c/openstack/tripleo-ci/+/825752 - you're right, we should be consistent for the "workspace" usage :). | 12:51 |
| Tengu | updated the patchset. | 12:51 |
| marios | Tengu: thanks i will revisit | 12:51 |
| dviroel | rlandy|ruck: yep, maybe the deletion of old ones took sometimes to conclude (no idea) | 12:52 |
| Tengu | brb, coffee is highly needed. | 12:52 |
| *** ysandeep is now known as ysandeep|mtg | 12:59 | |
| ysandeep|mtg | rlandy|ruck, bhagyashris|ruck tc/ua/pm sync | 13:00 |
| bhagyashris|ruck | rlandy|ruck, https://hackmd.io/P5sTPMSBREe5kBS_4jDhIg#2022-01-25-tcuapm-planning-for-sprint-57 | 13:01 |
| rlandy|ruck | bhagyashris|ruck: looks like ussuri failed again | 13:21 |
| bhagyashris|ruck | yeah | 13:23 |
| rlandy|ruck | checking ovb failures | 13:24 |
| rlandy|ruck | on master | 13:24 |
| rcastillo|rover | o/ | 13:24 |
| rlandy|ruck | rcastillo|rover: let's sync with bhagyashris|ruck after the community call | 13:24 |
| rlandy|ruck | rcastillo|rover: victoria, ussuri - both tracking one failure there | 13:24 |
| rlandy|ruck | biggest issue now | 13:24 |
| rlandy|ruck | ovb on master c9 | 13:25 |
| bhagyashris|ruck | rlandy|ruck, looks like this is failing consistently https://logserver.rdoproject.org/50/29250/29/check/periodic-tripleo-ci-centos-8-standalone-full-tempest-api-ussuri/2bf901d/logs/undercloud/var/log/tempest/stestr_results.html.gz | 13:25 |
| rlandy|ruck | rcastillo|rover: ^^ fails consistently but with different tests :( | 13:26 |
| rlandy|ruck | bhagyashris|ruck: rcastillo|rover: ok - let's sync to pass that info after community call | 13:26 |
| rcastillo|rover | weird | 13:26 |
| * rlandy|ruck needs to test out ovb | 13:26 | |
| bhagyashris|ruck | rlandy|ruck, sure | 13:26 |
| marios | rlandy|ruck: to add to the fun, seems to be inconsistent... fs35 had a green run today on my testproject https://bugs.launchpad.net/tripleo/+bug/1958955/comments/1 | 13:27 |
| bhagyashris|ruck | arxcruz, sshnaidm, rlandy, rlandy|ruck, marios, ysandeep, bhagyashris, svyas, soniya29, pojadhav, akahat, chandankumar, frenzy_friday, anbanerj, dviroel, rcastillo, dasm, jm1, rlandy|ruck rcastillo|rover | 13:27 |
| marios | rlandy|ruck: am digging a bit there see what i can find | 13:27 |
| bhagyashris|ruck | TripleO CI community call in 3 mins | 13:27 |
| rlandy|ruck | marios: ok - I'm looking into the ovb integration line failures | 13:28 |
| bhagyashris|ruck | https://hackmd.io/MMg4WDbYSqOQUhU2Kj8zNg?both#2022-01-25-Community-Call @ line 30 | 13:28 |
| bhagyashris|ruck | https://meet.google.com/bqx-xwht-wky?authuser=0 | 13:29 |
| marios | rlandy|ruck: is there another failure other then https://bugs.launchpad.net/tripleo/+bug/1958955 you mean? | 13:29 |
| rlandy|ruck | rcastillo|rover: can you rekick the failing lines here: https://jenkins-cloudsig-ci.apps.ocp.ci.centos.org/view/phase-1-pipelines/ | 13:29 |
| rlandy|ruck | all except master c9 | 13:29 |
| *** amoralej is now known as amoralej|lunch | 13:31 | |
| rcastillo|rover | rlandy|ruck: done | 13:48 |
| rlandy|ruck | thank you | 13:52 |
| rlandy|ruck | marios: https://review.rdoproject.org/r/c/testproject/+/36140 | 13:58 |
| *** amoralej|lunch is now known as amoralej | 14:02 | |
| bhagyashris|ruck | rlandy|ruck, rcastillo|rover can we meet? | 14:06 |
| rlandy|ruck | yep | 14:06 |
| rcastillo|rover | sure | 14:06 |
| rlandy|ruck | let's meet at 10 past the hour | 14:06 |
| rlandy|ruck | need a few minutes | 14:06 |
| bhagyashris|ruck | rlandy|ruck, ok np | 14:07 |
| rlandy|ruck | ysandeep|mtg: pls update status for EL9 meeting | 14:09 |
| rlandy|ruck | marios: dviroel: ^^ if you have anything | 14:09 |
| rlandy|ruck | I will attend | 14:09 |
| ysandeep|mtg | rlandy|ruck, ack | 14:09 |
| marios | rlandy|ruck: ack | 14:09 |
| rlandy|ruck | and discuss resources | 14:09 |
| dviroel | ack | 14:09 |
| frenzy_friday | Hey folks, when you get some time pl add tp your review list: | 14:13 |
| frenzy_friday | sc0-multinode-oooq-container-updates-...-master | 14:13 |
| frenzy_friday | job def: https://review.rdoproject.org/r/c/rdo-jobs/+/38533 | 14:13 |
| frenzy_friday | testproj: https://review.rdoproject.org/r/c/testproject/+/38535/ | 14:13 |
| frenzy_friday | criteria: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/38537 | 14:13 |
| frenzy_friday | standalone-network-master-validation: | 14:13 |
| frenzy_friday | job def: https://review.rdoproject.org/r/c/rdo-jobs/+/38475 | 14:13 |
| frenzy_friday | testP: https://review.rdoproject.org/r/c/testproject/+/38476 | 14:13 |
| frenzy_friday | criteria: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/38479 | 14:13 |
| rlandy|ruck | bhagyashris|ruck: rcastillo|rover: https://meet.google.com/xgx-yqzs-swb?pli=1&authuser=0 | 14:15 |
| rlandy|ruck | frenzy_friday: nice | 14:15 |
| * frenzy_friday is suspicious that the testprojs passed on the first try | 14:16 | |
| *** ysandeep|mtg is now known as ysandeep | 14:17 | |
| bhagyashris|ruck | rcastillo|rover, https://logserver.rdoproject.org/40/36140/30/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-victoria/fee1c48/logs/undercloud/var/log/tempest/stestr_results.html.gz | 14:18 |
| bhagyashris|ruck | https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-victoria | 14:19 |
| rcastillo|rover | rlandy|ruck: https://review.opendev.org/c/openstack/tripleo-ci/+/826124 | 14:23 |
| bhagyashris|ruck | https://review.opendev.org/c/openstack/tripleo-ci/+/826124 | 14:23 |
| ysandeep | rlandy|ruck, added status on EL9 doc - https://issues.redhat.com/browse/OSPPRODCH-229 , please feel free to update if I missed something | 14:28 |
| * bhagyashris|ruck cooking and dinner brb | 14:44 | |
| rlandy|ruck | thank you | 14:49 |
| marios | ysandeep: rlandy|ruck: sshnaidm: https://review.rdoproject.org/r/c/config/+/38544/1#message-57e8656cec2440035f520b2ef3ccb841523c722b ... i think we want to keep c8 master for now there? | 14:52 |
| marios | i thought we would do the removal of those after we add the c9 | 14:52 |
| sshnaidm | marios, iirc we limit c8 to run only on train/wallaby branches? | 14:53 |
| sshnaidm | in their definitions | 14:53 |
| marios | sshnaidm: yeah we will.. but we add c9 first, see them run, then after remove c8 from master (like current situation in upstream check/gate) | 14:54 |
| marios | sshnaidm: we will start teardown from upstream check/gate end this week for example | 14:54 |
| rlandy|ruck | marios: ack- keep definition | 14:55 |
| marios | sshnaidm: we could decide to do it in one patch like you have there 'cos 3rd party' so it won't block like upstream check/gate does for example | 14:55 |
| marios | sshnaidm: but i want to clarify if everyone is happy with that | 14:56 |
| marios | sshnaidm: i think cleaner if we add first with this patch series and then teardown later | 14:56 |
| sshnaidm | marios, it means we will run on master duplicate c8 and c9 jobs? | 14:56 |
| sshnaidm | marios, I wonder if there is a capacity | 14:57 |
| marios | sshnaidm: right this could be a concern since we have issue for the integration line wrt 8 and 9 together | 14:57 |
| rlandy|ruck | ysandeep: status looks good thanks | 14:57 |
| sshnaidm | marios, check jobs on master are most of our load I think | 15:00 |
| sshnaidm | they run on every patch | 15:00 |
| sshnaidm | I'm fine to leave c8 while it makes sense, but if we don't support c8 in master I'm not sure we need them anyway.. | 15:01 |
| *** sshnaidm is now known as sshnaidm|afk | 15:01 | |
| marios | sshnaidm: no argument... they *will* be removed... just not before adding c9, it is different to how we did it for upstream hence my comment and this discussion | 15:02 |
| marios | sshnaidm|afk: there is no question about us leaving c8 on master after we add c9 | 15:02 |
| dviroel | rlandy|ruck: o/ - question: we need to skip some specific test(s) for FIPS, and we were thiking on using tempest-skiplist to do so, instead building a regex for it | 15:11 |
| dviroel | rlandy|ruck: this is the tmp skip that will not merge: https://review.opendev.org/c/openstack/barbican-tempest-plugin/+/810782/7/barbican_tempest_plugin/tests/scenario/test_volume_encryption.py | 15:11 |
| rlandy|ruck | dviroel: sec ... will look | 15:12 |
| dviroel | rlandy|ruck: would be an appropriate use of the tool? | 15:12 |
| dviroel | rlandy|ruck: sure, when you have time | 15:12 |
| dviroel | ade_lee__: ^ | 15:13 |
| rlandy|ruck | dviroel: short answer: I think so | 15:13 |
| rlandy|ruck | the more we can reuse the tools and keep things in one place, the better | 15:13 |
| rlandy|ruck | whether you'll hit any technical difficulties, arxcruz is better to answer that | 15:14 |
| rlandy|ruck | amoralej: hi - re: puppet promotion - looks good - thank you | 15:17 |
| dviroel | rlandy|ruck: yeah, that was my guess - thanks | 15:18 |
| rlandy|ruck | dviroel: yep - if there are no tech blockers, go forth and conquer | 15:20 |
| dviroel | rlandy|ruck: yep, ade_lee__ will create a patch and test it | 15:21 |
| ade_lee__ | dviroel, rlandy|ruck cool - creating the lp/patch now | 15:23 |
| arxcruz | dviroel chora coração, que houve? | 15:23 |
| *** ysandeep is now known as ysandeep|out | 15:23 | |
| dviroel | arxcruz: everything is fine, we are just using the amazing skiplist tool to make our life easier on FIPS jobs | 15:24 |
| arxcruz | dviroel :D | 15:24 |
| rlandy|ruck | ade_lee__: dviroel: suggestion ... | 15:25 |
| rlandy|ruck | try keep all the fips stuff together | 15:25 |
| rlandy|ruck | maybe in one commented section | 15:25 |
| dviroel | ++ | 15:25 |
| ade_lee__ | ack - will do | 15:26 |
| rcastillo|rover | rlandy|ruck: periodic-tripleo-ci-centos-8-standalone-full-tempest-scenario-victoria failed on a different tempest test now. Rerruning atm | 15:30 |
| rlandy|ruck | rcastillo|rover: charming | 15:30 |
| rlandy|ruck | marios: ovb testproject is a mixed bad | 15:31 |
| rlandy|ruck | bag | 15:31 |
| rlandy|ruck | fs002 will pass | 15:31 |
| rlandy|ruck | fs039 failed undercloud install | 15:32 |
| rlandy|ruck | 64 and 1 failed node provision | 15:32 |
| marios | rlandy|ruck: so seems confirmed some kind of race/inconsistent fail on the provisioning :/ | 15:33 |
| rlandy|ruck | I guess | 15:34 |
| rlandy|ruck | still looking into it | 15:34 |
| rlandy|ruck | Tengu: to confirm, this is the patch that fails build for you? https://review.opendev.org/c/openstack/tripleo-common/+/826205 | 15:34 |
| rlandy|ruck | on IPA image? | 15:34 |
| ade_lee__ | rlandy|ruck, dviroel so not sure if it will be possible to keep all the fips things together, because this file is organized by test to be skipped | 15:35 |
| ade_lee__ | rlandy|ruck, dviroel for instance - it turns out that one of the tests I want to skip -- barbican_tempest_plugin.tests.scenario.test_volume_encryption.VolumeEncryptionTest.test_encrypted_cinder_volumes_cryptsetup is already being skipped in wallaby :/ | 15:36 |
| rlandy|ruck | ade_lee__; ok - pls put in your review and dviroel and I will look at how best to organize | 15:37 |
| * dviroel lunch | 15:37 | |
| ade_lee__ | rlandy|ruck, dviroel but I can make sure to add FIPS to the reason field for sure to easily identify | 15:37 |
| ade_lee__ | ok | 15:37 |
| *** dviroel is now known as dviroel|lunch | 15:37 | |
| ade_lee__ | arxcruz, hey -- so on the tempest test skip tool -- can I add multiple lp bugs for a reason to skip a release? | 15:40 |
| ade_lee__ | arxcruz, reason I'm asking is - I want to skip barbican_tempest_plugin.tests.scenario.test_volume_encryption.VolumeEncryptionTest.test because of not working under fips -- and will want to do it for both master and wallaby | 15:41 |
| ade_lee__ | but there is already a skip for an lp in wallaby | 15:41 |
| ade_lee__ | if that lp ever gets fixed, I want to make sure it stays skipped because of fips | 15:41 |
| ade_lee__ | rlandy|ruck, ^^ | 15:42 |
| arxcruz | ade_lee__ let me check | 15:44 |
| Tengu | rlandy|ruck: yep | 15:45 |
| Tengu | thing is, it's not in the grub2 element, but in centos. | 15:45 |
| rlandy|ruck | Tengu:ok - I'll try it out | 15:45 |
| arxcruz | ade_lee__ right now only one lp, or bz | 15:45 |
| arxcruz | but you can have different bug per release | 15:45 |
| ade_lee__ | arxcruz, right -- I guess for now, I'll add comment. That way someone will pause before removing the skip | 15:46 |
| arxcruz | yup | 15:46 |
| ade_lee__ | cool thanks | 15:47 |
| rlandy|ruck | ha- guess what we have ... | 15:48 |
| rlandy|ruck | https://hub.docker.com/orgs/tripleowallabycentos9/repositories | 15:48 |
| rlandy|ruck | arxcruz: dviroel|lunch: there we go | 15:48 |
| rcastillo|rover | skiplist for victoria fs035 https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/826314 | 15:52 |
| *** sshnaidm|afk is now known as sshnaidm | 15:55 | |
| bhagyashris|ruck | rlandy|ruck, rcastillo|rover leaving for the day | 16:10 |
| rlandy|ruck | bhagyashris|ruck: thanks - have a good night | 16:16 |
| rcastillo|rover | bhagyashris|ruck: have a good one | 16:16 |
| rlandy|ruck | ysandeep|out: hey | 16:16 |
| rlandy|ruck | ysandeep|out: let me know if we need anything for downstream | 16:16 |
| rlandy|ruck | other than reported cert issue | 16:17 |
| ysandeep|out | rlandy|ruck, ack, that's the main one, replied in pm about downstream promotion status | 16:18 |
| rlandy|ruck | ysandeep|out: ack - thank you | 16:18 |
| rcastillo|rover | running an errand. biab | 16:20 |
| ysandeep|out | rlandy|ruck, request for review: https://review.opendev.org/c/openstack/tripleo-quickstart/+/826245, when you have free slot - not urgent | 16:21 |
| marios | rlandy|ruck: so this we are going to kill alltogether https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-integration-main-centos8 right? (sanity check the answer must be yes) | 16:21 |
| rlandy|ruck | marios: yep | 16:22 |
| marios | rlandy|ruck: tx | 16:22 |
| rlandy|ruck | we'll shoot ourselves trying to figure out what is happening there | 16:22 |
| rlandy|ruck | safer to go incremental | 16:22 |
| rlandy|ruck | ysandeep|out: w+ing | 16:24 |
| rlandy|ruck | let's start with that file | 16:25 |
| rlandy|ruck | we can edit going forward | 16:25 |
| *** dviroel|lunch is now known as dviroel | 16:38 | |
| *** marios is now known as marios|out | 16:50 | |
| dviroel | ade_lee__: try a rebase on tripleo-ci | 17:06 |
| dviroel | ade_lee__: nevermindo, just rdo is failing due to new nodeset | 17:07 |
| dviroel | huumm, where puppet-openstack-integration-6-scenario000-tempest-centos-8-stream is defined? | 17:09 |
| *** jpena is now known as jpena|off | 17:34 | |
| *** amoralej is now known as amoralej|off | 17:44 | |
| dviroel | rlandy|ruck: was job def "puppet-openstack-integration-6-scenario000-tempest-centos-8-stream" deleted? | 18:24 |
| dviroel | can't find | 18:24 |
| rlandy|ruck | https://review.rdoproject.org/codesearch/?q=puppet-openstack-integration-6-scenario000-tempest-centos-8-stream&i=nope&files=&repos= | 18:25 |
| rlandy|ruck | only trace | 18:26 |
| rlandy|ruck | we took that from amoralej|off I think | 18:26 |
| rlandy|ruck | on meeting - will check | 18:26 |
| dviroel | rlandy|ruck: found https://opendev.org/openstack/puppet-openstack-integration/commit/d45f560d8ed1125f3b81b4afdb71114117c94667 | 18:30 |
| rlandy|ruck | may have moved to 7 | 18:30 |
| dviroel | rlandy|ruck: yep, will provide an update on rdo-jobs, one sec | 18:34 |
| rlandy|ruck | ok - out of meeting | 19:05 |
| dviroel | rlandy|ruck: updating here https://review.rdoproject.org/r/c/rdo-jobs/+/38564 | 19:05 |
| rlandy|ruck | dviroel: mot even sure what those jobs are doing anymore :) | 19:06 |
| dviroel | me neither | 19:06 |
| rlandy|ruck | back to ovb | 19:07 |
| rlandy|ruck | rcastillo|rover: bhagyashris|ruck is out tomorrow | 19:19 |
| rlandy|ruck | I'll report at program call | 19:19 |
| rlandy|ruck | way early for you | 19:19 |
| rlandy|ruck | Tengu: testing IPA image build https://review.rdoproject.org/r/c/testproject/+/24995 | 19:22 |
| rlandy|ruck | periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset064-masteropenstack/tripleo-cimasteropenstack-periodic-integration-main1 hr 42 mins 37 secs2022-01-25 17:14:38FAILURE | 19:27 |
| rlandy|ruck | periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset039-masteropenstack/tripleo-cimasteropenstack-periodic-integration-main1 hr 59 mins 49 secs2022-01-25 17:14:38FAILURE | 19:27 |
| rlandy|ruck | periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset035-masteropenstack/tripleo-cimasteropenstack-periodic-integration-main1 hr 40 mins 15 secs2022-01-25 17:14:38FAILURE | 19:27 |
| rlandy|ruck | periodic-tripleo-ci-centos-9-ovb-1ctlr_2comp-featureset020-masteropenstack/tripleo-cimasteropenstack-periodic-integration-main1 hr 34 mins 50 secs2022-01-25 17:14:38FAILURE | 19:27 |
| rlandy|ruck | periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-masteropenstack/tripleo-cimasteropenstack-periodic-integration-main1 hr 44 mins 35 secs2022-01-25 17:14:38FAILURE | 19:27 |
| rlandy|ruck | periodic-tripleo-ci-centos-9-ovb-1ctlr_1comp-featureset002-masteropenstack/tripleo-cimasteropenstack-periodic-integration-main1 hr 42 mins 21 secs2022-01-25 17:14:38FAILURE | 19:27 |
| rlandy|ruck | at least we're consistent now | 19:27 |
| rlandy|ruck | all dead | 19:27 |
| dviroel | RIP ovb | 19:28 |
| dviroel | node provision | 19:28 |
| dviroel | hard to debug | 19:28 |
| dviroel | rlandy|ruck: trying to debug ovb | 19:54 |
| dviroel | https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset035-master/e719c1a/logs/undercloud/var/log/extra/big-errors.txt.gz | 19:55 |
| rlandy|ruck | dviroel: yep - pinged steve on it | 19:55 |
| dviroel | has lot of new neutron rpc errors | 19:55 |
| rlandy|ruck | NameError: free variable 'host' referenced before assignment in enclosing scope | 19:56 |
| dviroel | https://review.opendev.org/c/openstack/neutron/+/820190/7/neutron/api/rpc/handlers/dhcp_rpc.py#216 | 19:56 |
| rlandy|ruck | adding to bug ... | 19:56 |
| dviroel | merged Jan 20th | 19:56 |
| dviroel | node provisioning is failing waiting on an RPC callback that never came | 19:57 |
| rlandy|ruck | dviroel: pls comment on bug | 19:58 |
| rlandy|ruck | so we keep it together | 19:58 |
| dviroel | rlandy|ruck: i will, getting more info here | 19:58 |
| dviroel | lol, look at the size of errors file: 3.9M | 20:00 |
| rlandy|ruck | Tengu: https://review.rdoproject.org/r/c/testproject/+/24995 - IPA image build works ok with that patch for us | 20:03 |
| rlandy|ruck | dviroel: go big or go home, right? | 20:03 |
| Tengu | rlandy|ruck: with Steve latest patch? | 20:03 |
| rlandy|ruck | Tengu: https://review.opendev.org/c/openstack/tripleo-common/+/826205 | 20:04 |
| rlandy|ruck | Tengu: steve responded to you on chat now | 20:04 |
| Tengu | rlandy|ruck: really weird.... guess something is missing somwhere in my container then. | 20:04 |
| Tengu | ok, I'll check tomorrow - not on my laptop, no access to rh things | 20:04 |
| rlandy|ruck | see hardware prov chat | 20:04 |
| Tengu | was just checking in before going for a good sleep :) | 20:05 |
| rlandy|ruck | rcastillo|rover: we're still failing on u, v? | 20:14 |
| rlandy|ruck | periodic-tripleo-ci-centos-9-scenario007-multinode-oooq-container-master - ugh - that one as well | 20:15 |
| * rlandy|ruck retests that | 20:15 | |
| rlandy|ruck | https://review.opendev.org/c/openstack/tripleo-ci/+/826086/ - not merged yet | 20:19 |
| rlandy|ruck | dviroel: you talking about https://opendev.org/openstack/ironic-python-agent/commit/e06dd22e7862a6bbb4ea97499d64d6de576f2836? | 20:30 |
| rlandy|ruck | merged Jan 20th | 20:30 |
| dviroel | rlandy|ruck: no | 20:33 |
| dviroel | rlandy|ruck: https://review.opendev.org/q/topic:bug%252F1950662 | 20:33 |
| rlandy|ruck | dviroel: ^^ does not resolve | 20:33 |
| dviroel | https://review.opendev.org/c/openstack/neutron/+/816850 | 20:34 |
| dviroel | added a comment to the bug, but not sure if is the cause or is the consequence | 20:36 |
| rlandy|ruck | dviroel: thanks will have to pass this to slaweq in his morning https://bugs.launchpad.net/tripleo/+bug/1958955 | 20:47 |
| dviroel | ack | 20:47 |
| rlandy|ruck | and see if this is networking or back to hardware prov | 20:47 |
| * dviroel brb | 20:55 | |
| dviroel | hum, see nodes failing on DHCP discover | 21:19 |
| dviroel | no DHCPOFFER | 21:20 |
| dviroel | will add this info to LP bug | 21:21 |
| rlandy|ruck | dviroel: thanks - updating program doc | 21:21 |
| rlandy|ruck | will look more in a few | 21:22 |
| rlandy|ruck | dviroel: if you get a chance, please take a look at https://review.rdoproject.org/r/q/topic:c9o as well | 21:22 |
| rlandy|ruck | we need to look into merging tomorrow | 21:22 |
| * rlandy|ruck collecting review for c9 to merge | 21:22 | |
| dviroel | rlandy|ruck: ack, i will try | 21:38 |
| * dviroel needs to go afk | 21:38 | |
| *** dviroel is now known as dviroel|afk | 21:38 | |
| rlandy|ruck | thank you | 21:39 |
| rlandy|ruck | woohoo we are reporting on wallaby c9 for the first time | 21:47 |
| rlandy|ruck | dviroel|afk: rcastillo|rover: let's make a time (maybe friday) to go through all the compose pinning review with marios and ysandeep|out and get those through | 22:06 |
| rlandy|ruck | rcastillo|rover: any reviews to add to review list for tomorrow? | 22:19 |
| rlandy|ruck | https://hackmd.io/FGMoCiRfSNa8puA1BpTQ-Q | 22:35 |
| rlandy|ruck | pls add what's missing | 22:35 |
| *** rlandy|ruck is now known as rlandy|out | 23:48 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!