| *** frenzyfriday|PTO is now known as frenzyfriday | 05:20 | |
| *** ysandeep|out is now known as ysandeep | 06:01 | |
| *** ysandeep is now known as ysandeep|lunch | 07:20 | |
| *** amoralej|off is now known as amoralej | 07:22 | |
| *** ykarel is now known as ykarel|LUNCH | 08:16 | |
| *** jpena|off is now known as jpena | 08:38 | |
| *** ysandeep|lunch is now known as ysandeep | 08:47 | |
| pdeore | arxcruz, chkumar|rover, even after adding the support of glance tempest plugin in tripleo-quickstart & openstack-ansible-os_tempest, seems he plugin tests are not getting consumed https://review.rdoproject.org/r/c/rdo-jobs/+/40004/6/zuul.d/layout.yaml | 08:51 |
|---|---|---|
| pdeore | https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/831649 & https://review.opendev.org/c/openstack/tripleo-quickstart/+/831650, | 08:51 |
| pdeore | ^ these 2 patches I've submitted | 08:51 |
| pdeore | s/he/the plugin tests | 08:53 |
| arxcruz | pdeore i'll take a look later, i'm finishing some documentation I need today | 08:54 |
| pdeore | arxcruz, yeah np, take your time | 08:55 |
| ysandeep | jm1: ++ thanks for idrac update! | 09:02 |
| ysandeep | console working for me, now. | 09:02 |
| jm1 | ysandeep: np :) | 09:07 |
| ysandeep | jm1, you had to reseat the idrac from chassis side to get its access back? | 09:11 |
| jm1 | ysandeep: yes, reset did not work. took a while till it came back | 09:16 |
| ysandeep | jm1: oh okay, after getting back console - firmware update from 2.15 to 2.70, and 2.70 -> 2.82 ? | 09:18 |
| jm1 | ysandeep: yes. atm i am evaluating a different path using cmc. this would allow us to update 8 idracs at once. not working yet because they changed update hashes from sha1 to sha256 but working on it | 09:30 |
| ysandeep | jm1: ack, yeah updating all the servers using cmc would be cool and way faster(if it works), I am not blocked atleast for now, ++ thanks! | 09:33 |
| ysandeep | I might need to access console of other machines in that env to change boot option from bios to uefi - but i haven't tried connecting to console of other machines yet. | 09:34 |
| *** ykarel|LUNCH is now known as ykarel | 09:36 | |
| arxcruz | pdeore I comment on your patch, i think that was the problem :) | 09:52 |
| pdeore | arxcruz, yeah I've updated the commit msg as per you comment :) Thanks again ! | 09:53 |
| jbadiapa | gm! | 10:00 |
| jbadiapa | does anybody have a problem deploying centos9 master on the "openstack overcloud node provision"? | 10:01 |
| jbadiapa | the error I got "grub2-install: error: this utility cannot be used for EFI platforms because it does not support UEFI Secure Boot." | 10:01 |
| jbadiapa | http://pastebin.test.redhat.com/1036713 | 10:01 |
| jbadiapa | I think I read something last week about this | 10:02 |
| jbadiapa | BTW, it's using the overcloud-full.qcow2 image | 10:06 |
| *** jbadiapa is now known as jbadiapa|afk | 10:23 | |
| ysandeep | jbadiapa, we do have one known issue: https://bugs.launchpad.net/tripleo/+bug/1962783 but traceback is different from what you are facing but in ci we use overcloud-hardened-uefi-full.qcow2 image now. | 10:23 |
| rlandy | dviroel: hello ... | 10:29 |
| rlandy | we can sync at review time | 10:30 |
| rlandy | akahat: hello - pls attend review time today with any parenting reviews | 10:44 |
| akahat | rlandy, ack | 10:45 |
| *** arxcruz is now known as arxcruz|lunch | 11:04 | |
| dviroel | rlandy: okay - will joing | 11:12 |
| *** dviroel is now known as dviroel|ruck | 11:14 | |
| * chkumar|rover is back | 11:16 | |
| chkumar|rover | dviroel|ruck: rlandy \o | 11:16 |
| marios | rlandy: joining us ? | 11:18 |
| *** jbadiapa|afk is now known as jbadiapa | 11:35 | |
| jbadiapa | ysandeep let me add the whole_disk_images=true | 11:37 |
| marios | chkumar|rover: :) | 11:40 |
| rlandy | chkumar|rover: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/832116/4/roles/ipa-multinode/tasks/ipaserver-subnode-install.yml | 11:56 |
| dviroel|ruck | chkumar|rover: will rerun c8-wallaby - previous hash - only 2 jobs missing | 11:59 |
| dviroel|ruck | previous ussuri hash also missing 1 job - rerunning | 12:01 |
| chkumar|rover | dviroel|ruck: sounds good, if passes, we can promote | 12:02 |
| *** arxcruz|lunch is now known as arxcruz | 12:04 | |
| chkumar|rover | rlandy: openssl-3.0.1-17 has not landed yet in cs9 stream production compose | 12:08 |
| rlandy | chkumar|rover: k | 12:12 |
| dviroel|ruck | chkumar|rover: master will not promote with fs035 failing - https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset035-master | 12:33 |
| rlandy | ysandeep: hey - available to chat? re: mixed rhel versions | 12:33 |
| rlandy | spec you sent | 12:33 |
| dviroel|ruck | chkumar|rover: and we have many jobs failing https://logserver.rdoproject.org/45/40445/1/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset035-master/911324b/logs/undercloud/var/log/tempest/failing_tests.log.txt.gz | 12:33 |
| ysandeep | rlandy: I think better to discuss in our group once DFGs select a alternative mentioned in https://gist.github.com/slagle/88292032a248a49364562ff6a3cf584c | 12:35 |
| chkumar|rover | dviroel|ruck: in each run, tempest tests failure are different | 12:47 |
| chkumar|rover | for fs035 | 12:47 |
| chkumar|rover | I have taken a look at last 3 runs with timing > 3 hrs | 12:47 |
| rlandy | dviroel|ruck: chkumar|rover: https://review.opendev.org/c/openstack/tripleo-quickstart/+/831763 - to close out CIX https://trello.com/c/uyHM159M/2373-cixlp1962405tripleociproa-periodic-tripleo-ci-centos-9-scenario001-standalone-master-is-failing-deploy-with-cant-run-container-c | 12:48 |
| rlandy | pls review ... w+ | 12:48 |
| rlandy | dviroel|ruck: chkumar|rover: tempest component for rhos-17 should promote now | 12:49 |
| chkumar|rover | rlandy: we can add the closes-bug in the above review https://review.opendev.org/c/openstack/tripleo-quickstart/+/831763/3#message-061a1510eb2900ee23b923b761b6cdd5907eb32c | 12:51 |
| rlandy | chkumar|rover: ack - will do | 12:51 |
| rlandy | chkumar|rover: good catch - thank you - done | 12:52 |
| chkumar|rover | dviroel|ruck: can you pass me the fs035 second tempest fix link? | 12:53 |
| chkumar|rover | wanted to see how we can test if periodic job if unit tests are passing | 12:53 |
| dviroel|ruck | one sec | 12:56 |
| dviroel|ruck | chkumar|rover: https://review.opendev.org/c/openstack/tempest/+/831608 - same topic | 12:57 |
| chkumar|rover | dviroel|ruck: thanks, :-) | 12:59 |
| dviroel|ruck | chkumar|rover: last fs035-master now has Security Group failures in logs - same happening in this tempest change | 13:01 |
| *** amoralej is now known as amoralej|lunch | 13:05 | |
| *** dasm|off is now known as dasm | 13:07 | |
| dasm | o/ | 13:07 |
| rlandy | pojadhav: hello ... pls will you check the audit of the wallaby c9 component lines and the criteria | 13:11 |
| rlandy | there were some jobs missing in criteria when I last checked | 13:11 |
| pojadhav | rlandy, sure and let you know | 13:12 |
| rlandy | dasm: hello - any progress on uefi boot? with wallaby c8 or train c8? | 13:12 |
| rlandy | pojadhav: pls just put in a review for any missing jobs - thanks | 13:12 |
| pojadhav | rlandy, yep | 13:12 |
| *** ysandeep is now known as ysandeep|break | 13:20 | |
| dasm | rlandy: o/ no progress. i ran cross check with legacy boot to see if the issue is isolated. | 13:23 |
| dasm | second uefi boot test was still running when i left. i'm checking that right how | 13:24 |
| rlandy | dasm: ok - let's touch base this afternoon and see where we are | 13:24 |
| rlandy | and write up the progress | 13:24 |
| rlandy | so we can get some bugs sorted | 13:24 |
| dasm | ack | 13:24 |
| rlandy | dasm: also looks like you reran some of the tempest skiplist stuff | 13:24 |
| rlandy | any updates there before CIX? | 13:24 |
| dasm | rlandy: i didn't run them recently. last time i did, i left comments. | 13:25 |
| rlandy | ok - saw some trello updates - maybe that was someone else | 13:25 |
| chkumar|rover | dviroel|ruck: testing tempest patch here: https://review.rdoproject.org/r/c/testproject/+/40461 | 13:31 |
| dviroel|ruck | chkumar|rover: rlandy cix meeting now | 13:32 |
| *** ysandeep|break is now known as ysandeep | 13:58 | |
| rlandy | dasm: chkumar|rover: dviroel|ruck: soniya: scrum time | 14:01 |
| rlandy | akahat: ^^ | 14:02 |
| soniya | rlandy, in secure-rbac meeting | 14:02 |
| soniya | will join later | 14:02 |
| dasm | rlandy: will join after rbac meeting. Thanks | 14:02 |
| rlandy | https://review.opendev.org/c/openstack/tripleo-ci/+/830987 | 14:04 |
| dasm | rlandy, fyi ovb with uefi boot: https://bugs.launchpad.net/tripleo/+bug/1964783 | 14:05 |
| *** amoralej|lunch is now known as amroalej | 14:06 | |
| *** amroalej is now known as amoralej | 14:06 | |
| rlandy | https://review.rdoproject.org/r/c/rdo-jobs/+/40339 | 14:07 |
| ysandeep | rlandy, https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/316383 | 14:14 |
| dviroel|ruck | chkumar|rover: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/40469 we forgot to update criteria :P | 14:17 |
| chkumar|rover | dviroel|ruck: ++ thanks :-) | 14:18 |
| rlandy | https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/40311 | 14:23 |
| frenzy_friday | bot pls add to review list https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/40311 | 14:24 |
| soniya | tosky, we are testing this patch: https://review.opendev.org/c/openinfra/python-tempestconf/+/820169 here:- https://review.rdoproject.org/r/c/testproject/+/37159 | 14:27 |
| soniya | tosky, also abhishekh is fine with it ^^ | 14:28 |
| rlandy | https://review.rdoproject.org/r/c/config/+/39444 | 14:29 |
| tosky | soniya: as the reviews are public, can you please answer the question in the review if you haven't done yet (I haven't checked yet) | 14:33 |
| tosky | ? | 14:33 |
| soniya | tosky, comments are on gerrit | 14:33 |
| rlandy | https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/39665 | 14:34 |
| chkumar|rover | dviroel|ruck: regarding mirror issue on stable1 pipeline, it happened due to vexxhost network issue | 14:38 |
| dviroel|ruck | chkumar|rover: oh ok, good to know | 14:39 |
| chkumar|rover | ysandeep: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/40469 please +w | 14:41 |
| ysandeep | chkumar|rover, looking | 14:42 |
| ysandeep | +wed | 14:44 |
| chkumar|rover | ysandeep: thanks! | 14:52 |
| dasm | dviroel|ruck: chkumar|rover Ronelle mentioned to test ovb on c8-wallaby. I don't see the job for that. Do you know which one she meant? | 14:53 |
| chkumar|rover | dasm: periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-wallaby | 14:56 |
| chkumar|rover | dasm: job definition https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/integration-jobs-wallaby.yaml#L192 | 14:56 |
| dasm | thank you chkumar|rover++ | 14:56 |
| dasm | i searched for "periodic-tripleo-centos-8-wallaby" | 14:57 |
| dasm | no strange i couldn't find it | 14:57 |
| chkumar|rover | dasm: all the jobs are defined here https://github.com/rdo-infra/rdo-jobs/tree/master/zuul.d | 14:58 |
| chkumar|rover | which runs in rdo | 14:58 |
| dasm | every day learning more things. | 14:59 |
| dasm | even though probably someone showed that to me already | 14:59 |
| chkumar|rover | rlandy: dviroel|ruck tomorrow morning, I am going to test, try and merge container build zuul parenting | 15:02 |
| chkumar|rover | since traffic is low that time | 15:02 |
| dviroel|ruck | chkumar|rover: ok | 15:03 |
| chkumar|rover | rlandy: dviroel|ruck if this passes https://review.rdoproject.org/r/c/testproject/+/40340 please merge https://review.rdoproject.org/r/c/rdo-jobs/+/40339 | 15:05 |
| chkumar|rover | thanks! | 15:05 |
| dviroel|ruck | chkumar|rover: ack | 15:07 |
| *** pojadhav is now known as pojadhav|afk | 15:08 | |
| chkumar|rover | dviroel|ruck: loggout out now, please leave the notes regarding this fs035 test https://review.rdoproject.org/r/c/testproject/+/40461 and see ya tomorrow! | 15:09 |
| dviroel|ruck | chkumar|rover: see ya o/ | 15:10 |
| dasm | chkumar|rover: good night o/ | 15:11 |
| *** marios is now known as marios|call | 15:31 | |
| rlandy | chkumar|rover: thanks - have a good night | 15:31 |
| *** dviroel|ruck is now known as dviroel|ruck|lunch | 15:36 | |
| *** marios|call is now known as marios | 16:02 | |
| ysandeep | rlandy: review request when time allows (we got a green run)- https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/316383 and https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/316382 , If no objections I will merge tomorrow in my morning | 16:07 |
| ysandeep | I have added in review hackmd as well | 16:07 |
| ysandeep | We might need to add similiar fix for 17 on rhel-9 content-provider job - but lets deal it with later. | 16:10 |
| rlandy | k | 16:11 |
| *** ysandeep is now known as ysandeep|out | 16:12 | |
| * dasm is afk. Dropping family at an airport. Will be back later | 16:15 | |
| *** dasm is now known as dasm|afk | 16:15 | |
| *** dviroel|ruck|lunch is now known as dviroel|ruck | 16:22 | |
| dviroel|ruck | https://zuul.opendev.org/t/openstack/status - not working here | 16:33 |
| *** marios is now known as marios|out | 16:54 | |
| * rcastillo running an errand, back in 1hr | 16:56 | |
| *** jpena is now known as jpena|off | 17:35 | |
| dviroel|ruck | https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset035-master | 17:38 |
| dviroel|ruck | really hard to find a pattern - every run is a different issue | 17:39 |
| rlandy | dviroel|ruck: need help with anything? | 17:42 |
| dviroel|ruck | rlandy: yeah, hard to promoted any line today - every rerun shows a different issue | 17:51 |
| rlandy | dviroel|ruck: k - let's meet | 17:51 |
| rlandy | https://meet.google.com/mxd-cxhe-kcc?pli=1&authuser=0 | 17:51 |
| rlandy | dviroel|ruck: ^^ | 17:52 |
| *** arxcruz is now known as arxcruz|off | 17:54 | |
| * dviroel|ruck coffee | 18:24 | |
| *** amoralej is now known as amoralej|off | 18:33 | |
| rlandy | https://review.rdoproject.org/r/c/config/+/40509 Remove ussuri component /integration lines | 18:42 |
| rlandy | dviroel|ruck: ^^ starting here | 18:42 |
| dviroel|ruck | :-) | 18:50 |
| rlandy | dviroel|ruck; dasm|afk: pls review https://review.opendev.org/c/openstack/tripleo-quickstart/+/831763 | 18:55 |
| rlandy | dasm|afk: pls ping when you are back | 18:55 |
| rlandy | so we can look at uefi boot | 18:55 |
| rlandy | note testproject comment | 18:58 |
| dviroel|ruck | voted | 18:59 |
| rlandy | ha - 17 just died | 19:00 |
| rlandy | rekicking | 19:00 |
| rlandy | ysandeep|out: reviewed | 19:40 |
| rlandy | dviroel|ruck: suggestion - takd fs035 out if master and promote it | 19:53 |
| rlandy | then revert that | 19:53 |
| rlandy | let's clean up where we can | 19:53 |
| dviroel|ruck | yep - thats the last thing to try | 19:56 |
| rlandy | rcastillo: hey - any progress on wallaby c8 on virt? | 19:56 |
| rlandy | <chkumar|rover> rlandy: dviroel|ruck if this passes https://review.rdoproject.org/r/c/testproject/+/40340 please merge https://review.rdoproject.org/r/c/rdo-jobs/+/40339 | 19:57 |
| rlandy | that didn't pass | 19:57 |
| dviroel|ruck | no | 19:57 |
| rcastillo | rlandy: still running | 19:58 |
| rlandy | k | 19:58 |
| rlandy | akahat: can we review the triple-ci patch now? | 19:58 |
| rlandy | dviroel|ruck: ok - putting fs012 and 001 master into rerun in case that fs035 passes | 20:02 |
| dviroel|ruck | rlandy: ack - they failed due to mirror issues too | 20:03 |
| dviroel|ruck | lets see how fs* goes | 20:03 |
| rlandy | dviroel|ruck: sorry it's such a pain for you this week | 20:08 |
| rlandy | still trying to get 17 to kick w/o node failures | 20:08 |
| dviroel|ruck | rlandy: don't worry - just a rainy day in RR week - we will have some promtions soon | 20:12 |
| rlandy | I'm not worried :) | 20:14 |
| * dviroel|ruck gate failure - victoria-upgrade failed on a tempest test, adding to RR notes | 20:14 | |
| rlandy | dasm|afk: k - guess missed you- pls prep wallaby c8 uefi for tomorrow - we can look at it then | 20:20 |
| * rlandy fixing 16.2 and 17 triggers now | 20:20 | |
| dviroel|ruck | rlandy: going out - planning to come back after dinner just to trigger some testproject for failed jobs | 20:37 |
| dviroel|ruck | rlandy: openstack-periodic-integration-main is not bad so far | 20:37 |
| *** dviroel|ruck is now known as dviroel|ruck|afjk | 20:50 | |
| *** dviroel|ruck|afjk is now known as dviroel|ruck|afk | 20:50 | |
| rlandy | dviroel|ruck|afk: sure | 20:51 |
| rcastillo | rlandy: wallaby c8 libvirt undercloud install failing - ntp sync issue | 21:37 |
| rlandy | rcastillo: on psi? | 22:09 |
| rlandy | we need to set the right nto serever there | 22:09 |
| rcastillo | rlandy: yeah | 22:09 |
| rlandy | rcastillo: see downstream settings | 22:09 |
| rlandy | there are ntp servers and dns servers for downstream | 22:10 |
| rlandy | rcastillo: https://code.engineering.redhat.com/gerrit/gitweb?p=tripleo-environments.git;a=blob;f=config/environments/ovb-internal.yml;h=1e6c506a2afb95d7adc4fcd1f4c74853aee8459e;hb=HEAD | 22:12 |
| rcastillo | I was looking for that, thanks | 22:13 |
| rlandy | 2 undercloud_undercloud_nameservers: | 22:13 |
| rlandy | 3 - 10.11.5.19 | 22:13 |
| rlandy | 4 - 10.5.30.45 | 22:13 |
| rlandy | dviroel|ruck|afk: need to go out for now - 17 finally kicked w/o node failure | 22:14 |
| rlandy | will bbl | 22:14 |
| *** rlandy is now known as rlandy|bbl | 22:14 | |
| *** dviroel|ruck|afk is now known as dviroel|ruck | 23:49 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!