ysandeep|out | rlandy|out, :) rcastillo|rover already created revert of fs035 skip patch, looks like you created revert of revert | 03:13 |
---|---|---|
ysandeep|out | rlandy|out, rcastillo|rover https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/43682 | 03:13 |
ysandeep|out | or was that intentional? | 03:13 |
*** ysandeep|out is now known as ysandeep|ruck | 04:32 | |
ysandeep|ruck | bhagyashris, fyi.. psi is unstable currently | 04:39 |
ysandeep|ruck | incase you hit node_failure in downstream | 04:39 |
bhagyashris | ysandeep|ruck, ack | 04:40 |
bhagyashris | thanks | 04:40 |
*** ysandeep|ruck is now known as ysandeep|ruck|afk | 04:47 | |
*** ysandeep|ruck|afk is now known as ysandeep|ruck | 05:35 | |
ysandeep|ruck | hah, this is interesting:- | 05:50 |
ysandeep|ruck | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_b16/848733/3/check/tripleo-ci-centos-9-content-provider/b16b062/logs/delorean_logs/component/tripleo/c8/07/c807e163361f3d100df4933d8e951574efcbb2c0_dev/rpmbuild.log.txt.gz | 05:50 |
ysandeep|ruck | - Curl error (28): Timeout was reached for http://mirror.stream.centos.org/SIGs/9-stream/messaging/x86_64/rabbitmq-38/repodata/repomd.xml [Failed to connect to mirror.stream.centos.org port 80: Connection timed out] | 05:50 |
ysandeep|ruck | but the repo which we were using: | 05:50 |
ysandeep|ruck | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_b16/848733/3/check/tripleo-ci-centos-9-content-provider/b16b062/logs/undercloud/etc/yum.repos.d/delorean-wallaby-deps.repo | 05:50 |
ysandeep|ruck | baseurl=http://mirror.mtl01.iweb.opendev.org/centos-stream/SIGs/9-stream/messaging/$basearch/rabbitmq-38/ | 05:50 |
ysandeep|ruck | why its still using mirror.stream.centos.org as baseurl | 05:51 |
ysandeep|ruck | may be cache is not cleared | 05:52 |
pojadhav | hey folks, need reviews and approval on this https://review.opendev.org/c/openstack/tripleo-quickstart/+/843840 | 05:59 |
chandankumar | pojadhav: commented | 06:15 |
chandankumar | can you do the same for standalone upgrade fs also | 06:15 |
pojadhav | chandankumar, checking | 06:21 |
jm1 | moin :) | 06:41 |
pojadhav | chandankumar, marios : kindly have a look when free - updated patch https://review.opendev.org/q/topic:tempest_allow_list+owner:pojadhav%2540redhat.com+status:open | 06:49 |
ysandeep|ruck | vexxhost low performance/network issues are back - random issues all over - going crazy as ruck/rovers :D and PSI is completely dead - time to take a break | 06:56 |
marios | pojadhav: ack adding to list (just finished a round of reviews ) | 06:58 |
pojadhav | marios, np thank you :) | 07:01 |
*** amoralej|off is now known as amoralej | 07:04 | |
*** ysandeep|ruck is now known as ysandeep|ruck|afk | 07:05 | |
*** ysandeep|ruck|afk is now known as ysandeep|ruck | 08:37 | |
*** AndroUser is now known as Pooja_Jadhav | 09:36 | |
ysandeep|ruck | wohoo finally psi is back | 09:55 |
*** ysandeep|ruck is now known as ysandeep|ruck|brb | 10:06 | |
*** ysandeep|ruck|brb is now known as ysandeep|ruck | 10:27 | |
*** rlandy|out is now known as rlandy | 10:28 | |
rlandy | ysandeep|ruck: hi - want to sync? | 10:29 |
ysandeep|ruck | good morning rlandy o/ | 10:29 |
ysandeep|ruck | sure | 10:29 |
rlandy | ysandeep|ruck: https://meet.google.com/xcp-gcsw-kvj | 10:30 |
rlandy | ysandeep|ruck: can y make that meeting half an hour? | 10:56 |
rlandy | cuts into scrum | 10:56 |
ysandeep|ruck | sry I intend to mark that as half an hout | 10:57 |
ysandeep|ruck | rlandy, okay its half an hour mtg now, start time works for you? | 10:58 |
rlandy | ysandeep|ruck: ack | 11:00 |
ysandeep|ruck | great | 11:00 |
*** ysandeep|ruck is now known as ysandeep|ruck|afk | 11:01 | |
*** pojadhav is now known as pojadhav|afk | 11:16 | |
*** dviroel|out is now known as dviroel | 11:27 | |
ysandeep|ruck|afk | rlandy, network promoted.. .me triggering 17/9 line as well | 11:48 |
*** ysandeep|ruck|afk is now known as ysandeep|ruck | 11:50 | |
rlandy | ysandeep|ruck: ack - I added a component promote job | 11:58 |
ysandeep|ruck | oh thanks for doing that - I thought it promoted via scheduled run | 11:59 |
ysandeep|ruck | rlandy++ | 11:59 |
rlandy | chandankumar: 1-1? | 12:01 |
*** amoralej is now known as amoralej|lunch | 12:13 | |
ysandeep|ruck | rcastillo|rover, hey o/ you around? | 12:29 |
*** pojadhav|afk is now known as pojadhav | 12:30 | |
ysandeep|ruck | rlandy, dviroel https://sf.hosted.upshift.rdu2.redhat.com/logs/aa/aa2924a3fca31b90e24dd1623f549538da2910f5/openstack-periodic-integration-rhos-17/periodic-tripleo-ci-rhel-8-scenario001-standalone-rhos-17/0d657cc/logs/undercloud/home/zuul/tripleo-deploy/standalone-ansible-wbn_or3c/cephadm/cephadm_command.log | 12:56 |
rcastillo|rover | ysandeep|ruck: just got in | 12:57 |
*** dasm|off is now known as dasm | 12:58 | |
dasm | o/ | 12:58 |
bhagyashris | folks scrum time | 13:00 |
dasm | marios: thanks for reviow on: https://review.rdoproject.org/r/c/config/+/43904 I was informed you can't run testproject against "config". Can I do it somehow? | 13:04 |
*** amoralej|lunch is now known as amoralej | 13:14 | |
ysandeep|ruck | marios, also saw same in upstream today: https://review.opendev.org/c/openstack/puppet-tripleo/+/848733/3#message-b8a44d79982074120be1fdc0652de3217f755c90 | 13:23 |
bhagyashris | https://review.rdoproject.org/r/q/topic:ooo_c7_teardown+owner:pojadhav%2540redhat.com | 13:26 |
marios | thanks ysandeep|ruck | 13:26 |
bhagyashris | https://review.opendev.org/q/topic:tempest_allow_list+owner:pojadhav%2540redhat.com+status:open | 13:26 |
bhagyashris | https://review.opendev.org/c/openstack/tripleo-ci/+/848260 | 13:29 |
bhagyashris | https://review.rdoproject.org/r/c/rdo-jobs/+/43897 | 13:30 |
bhagyashris | https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/411458 | 13:30 |
rcastillo|rover | rlandy: we're getting rid of the virthost jobs? did I get this right? | 13:36 |
rlandy | rcastillo|rover: ? where? | 13:37 |
rcastillo|rover | alan's latest email in that chain | 13:37 |
rlandy | we need to add virthost jobs in vexx | 13:37 |
rlandy | we are getting rid of them in ci,centos | 13:37 |
rcastillo|rover | oh, ok, must've misread | 13:38 |
rlandy | responded | 13:39 |
dasm | arxcruz: o/ did you have an opportunity to review https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/43815 again? | 13:47 |
ysandeep|ruck | dviroel, rlandy rcastillo|rover fyi.. 16.2 full tempest seems legit: https://bugzilla.redhat.com/show_bug.cgi?id=2104931 and cixed. | 13:50 |
dviroel | ysandeep|ruck: ack, thanks | 13:51 |
rlandy | ysandeep|ruck: ack - thanks | 13:54 |
ysandeep|ruck | spoke with neutron ralonsoh already - we need newer ovsdbapp version to fix this | 13:54 |
ysandeep|ruck | let me ping delivery | 13:54 |
marios | ysandeep|ruck: o/ will you join us | 14:33 |
marios | ysandeep|ruck: (operator call) | 14:33 |
ysandeep|ruck | marios: thanks for reminder, I lost track of time | 14:33 |
marios | np | 14:48 |
rlandy | ysandeep|ruck: you EoD? | 15:41 |
ysandeep|ruck | yeah but trying to figure out sc01/rhel-8 before leaving | 15:42 |
rlandy | PSI still looks out | 15:42 |
rlandy | ok - let me know | 15:42 |
rlandy | still need to promote master, right? | 15:42 |
rlandy | ysandeep|ruck: ^^? | 15:42 |
ysandeep|ruck | rlandy, https://review.rdoproject.org/r/c/testproject/+/38348 | 15:43 |
ysandeep|ruck | we still need fs035/20/sc010-kvm internal | 15:43 |
rlandy | ok - 20 and 35 need rerun | 15:43 |
rlandy | ok - modifying that patch to rerun | 15:44 |
rlandy | rcastillo|rover: ^^ | 15:44 |
rcastillo|rover | rlandy: ack | 15:44 |
rlandy | PSI is dead- not sure about internal | 15:45 |
rlandy | may nedd to skip it to promote | 15:45 |
rlandy | wallaby c8 just promoted | 15:47 |
ysandeep|ruck | rlandy, rhel8/sc01 is weird - my patch which fixed 17/9 issue is not there in rhel-8 tht rpm | 15:47 |
ysandeep|ruck | checking with john | 15:47 |
rlandy | ysandeep|ruck: stuck in a component line? | 15:47 |
rlandy | or not on dlrn at all? | 15:47 |
ysandeep|ruck | i am checking current(its even not here) | 15:48 |
rlandy | ysandeep|ruck: sounds like dlrn | 15:50 |
rlandy | delivery | 15:50 |
*** marios is now known as marios|out | 15:52 | |
ysandeep|ruck | rlandy, sry should have written full name, I mean checking with jschlueter | 15:52 |
rlandy | lol - too many jon/john people | 15:53 |
ysandeep|ruck | rlandy, do you see my ping in delivery channel? | 15:53 |
ysandeep|ruck | looks like many people disconnected | 15:53 |
ysandeep|ruck | looks like some irc issue | 15:53 |
rlandy | yep | 15:54 |
rlandy | ysandeep|ruck; I can ping again later | 15:54 |
rlandy | in case jon got disconnected | 15:54 |
rlandy | let me know when you are out | 15:54 |
rlandy | will follow up | 15:54 |
ysandeep|ruck | rlandy, I am out.. you know the drill.. once dlrn enables back for 17/rhel8 - we promote tripleo and then rerun integration line | 16:18 |
rlandy | ysandeep|ruck; ack | 16:19 |
ysandeep|ruck | rcastillo|rover, notes for you .. psi is down atm | 16:22 |
*** amoralej is now known as amoralej|off | 16:22 | |
ysandeep|ruck | rcastillo|rover, once its back 1) we need to promote integration 17/9 and we are good | 16:23 |
rcastillo|rover | ysandeep|ruck: ack, good night | 16:24 |
dviroel | ysandeep|ruck: o/ | 16:25 |
ysandeep|ruck | 17/8 once dlrn is running again(its stopped right now) -> we need to promote tripleo -> then intgration line -> again promote all the component -> again integation line | 16:25 |
rlandy | lunch quickly | 16:25 |
rlandy | biab | 16:25 |
ysandeep|ruck | good night guys thanks! | 16:26 |
ysandeep|ruck | dviroel, rcastillo|rover you can check delivery channel for 17/8 dlrn discussion | 16:27 |
rcastillo|rover | ysandeep|ruck: yeah, following there | 16:27 |
*** ysandeep|ruck is now known as ysandeep|out | 16:28 | |
*** dviroel is now known as dviroel|lunch | 17:13 | |
rlandy | rcastillo|rover: dviroel|lunch: psi looks back | 17:35 |
rcastillo|rover | rlandy: nice | 17:35 |
rlandy | rerunning failed rhel-9jobs | 17:36 |
rlandy | rekicking line - should be easiest | 17:36 |
*** dviroel|lunch is now known as dviroel | 18:11 | |
dviroel | I will start deleting all volumes "available" in dev-stage tenant | 18:33 |
rlandy | dviroel++ | 18:40 |
dviroel | rlandy: dasm: review meeting :) | 19:01 |
rlandy | dviroel: talking to dasm - pls start - we will join shortly | 19:03 |
dasm | in a sec | 19:03 |
rlandy | rcastillo|rover: master fs020 passed - if fs035 is not a consistent failure, you cam skip that and kvm internal (psi not deploying centos 9 nodes) and promote | 19:08 |
rcastillo|rover | rlandy: what hash is that? rr script is giving me different failures | 19:28 |
rlandy | rcastillo|rover: https://review.rdoproject.org/r/c/testproject/+/38348 - was the rerun ... | 19:29 |
rcastillo|rover | rlandy: nvm just saw | 19:29 |
rlandy | e8b18652b6c4d5d4b407b9c8bc14063b | 19:29 |
rlandy | so ... | 19:29 |
rlandy | rcastillo|rover: python3 roles/rrcockpit/files/telegraf_py3/ruck_rover.py --release master --distro centos-9 --aggregate_hash tripleo-ci-testing/e8/b1/e8b18652b6c4d5d4b407b9c8bc14063b | 19:30 |
rlandy | ┃ Jobs in promotion criteria required to promo the hash: ┃ PASSED History ┃ FAILURE History ┃ Other History ┃ | 19:30 |
rlandy | ┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━┩ | 19:30 |
rlandy | │ periodic-tripleo-ci-centos-9-scenario010-kvm-internal-standalone-master │ 0 │ 0 │ 0 │ | 19:30 |
rlandy | │ periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset035-master │ 0 │ 4 │ 1 │ | 19:30 |
rcastillo|rover | rlandy: k, thanks, just rerran fs035 | 19:31 |
rcastillo|rover | let's see if it lets me run kvm | 19:31 |
rlandy | rcastillo|rover: afaict, kvm job won't start | 19:32 |
rlandy | see comment on #rhos-ops | 19:32 |
rlandy | also fs035 does not have a great history | 19:32 |
rlandy | if your failures are not consistent ok to skip promote | 19:33 |
rlandy | aster is 3 days out now | 19:33 |
rlandy | master | 19:33 |
rcastillo|rover | rlandy: k, tentative patch here https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/43918 | 19:37 |
rcastillo|rover | waiting on fs035 | 19:37 |
rlandy | rcastillo|rover: k - let me know when you want me to w+ | 19:37 |
rcastillo|rover | ack | 19:38 |
* dviroel out | 20:42 | |
*** dviroel is now known as dviroel|out | 20:42 | |
* dasm => off | 21:02 | |
*** dasm is now known as dasm|off | 21:02 | |
rlandy | rcastillo|rover: f035 just reported | 22:22 |
rcastillo|rover | indeed, let me add it to the patch as well | 22:23 |
rcastillo|rover | rlandy: pls workflow when you can https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/43918 | 22:24 |
rlandy | rcastillo|rover: checking the tempest results | 22:24 |
rlandy | to see if there is not a real issue | 22:25 |
rcastillo|rover | lots of tests failed both, but not the same | 22:26 |
rlandy | rcastillo|rover: not exact;y | 22:29 |
rcastillo|rover | hard to ignore so many failures | 22:29 |
rlandy | rcastillo|rover; ok ... so these two are on the same hash ... | 22:31 |
rlandy | https://logserver.rdoproject.org/48/38348/26/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset035-master/a92feb0/logs/undercloud/var/log/tempest/stestr_results.html.gz | 22:31 |
rlandy | https://logserver.rdoproject.org/48/38348/26/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset035-master/a92feb0/logs/undercloud/var/log/tempest/stestr_results.html.gz | 22:31 |
rlandy | ^^ cleanest | 22:31 |
rlandy | so merging patch | 22:31 |
rlandy | rcastillo|rover: just fyi - easier to comment out for next time | 22:32 |
rlandy | rcastillo|rover: I +2'ed and w+ | 22:32 |
rlandy | pls revert once promotion | 22:33 |
rlandy | also rerunning one failed rho-17 on rhel-9 job | 22:33 |
rcastillo|rover | rlandy: k sure | 22:35 |
*** rlandy is now known as rlandy|bbl | 22:44 | |
rcastillo|rover | not sure why master promotion hasn't gone through | 23:43 |
rcastillo|rover | put in the revert anyway | 23:43 |
rcastillo|rover | https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/43684 | 23:43 |
* rcastillo|rover out | 23:43 | |
*** rcastillo|rover is now known as rcastillo | 23:43 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!