| *** ysandeep|away is now known as ysandeep | 05:45 | |
| pojadhav | ysandeep, 0/ good morning ! | 06:20 |
|---|---|---|
| ysandeep | pojadhav: good morning o/ | 06:20 |
| pojadhav | ysandeep, when you will free, can we sync up for downstream..? | 06:21 |
| ysandeep | pojadhav: I am currently debugging vgscan issue (lvm-2 rpm missing), We can sync afterwards.. Could you please check if we have any other new issues in the meantime for 16.2/17 | 06:22 |
| pojadhav | ysandeep, sure | 06:23 |
| *** ykarel_ is now known as ykarel|afk | 06:54 | |
| *** amoralej|off is now known as amoralej | 07:00 | |
| *** jpena|off is now known as jpena | 07:27 | |
| erbot | Required files not ready after 301.44387698173523s for distgit-cbs-validate-centos8-stream 35626,1,64d0d40826024232ac7bc599621d1549 | 07:29 |
| *** ykarel|afk is now known as ykarel | 07:58 | |
| *** ykarel_ is now known as ykarel | 08:09 | |
| bhagyashris | fo;ks, plz add into your review list https://review.rdoproject.org/r/c/rdo-jobs/+/35433 thanks :) | 08:41 |
| bhagyashris | folks* | 08:42 |
| *** ysandeep is now known as ysandeep|lunch | 08:53 | |
| *** ykarel_ is now known as ykarel|lunch | 10:10 | |
| *** ysandeep|lunch is now known as ysandeep | 10:35 | |
| *** rlandy is now known as rlandy|rover | 10:56 | |
| rlandy|rover | anbanerj|ruck: hey - pls vote https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/809962 | 10:58 |
| rlandy|rover | to spring master free | 10:58 |
| rlandy|rover | fs020 | 10:58 |
| anbanerj|ruck | rlandy|rover, done | 10:59 |
| rlandy|rover | anbanerj|ruck: periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-master │ 0 │ 4 │ 1 | 11:00 |
| anbanerj|ruck | https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/809962 and https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/809283 are the same right? | 11:00 |
| rlandy|rover | chandankumar: review time ? | 11:02 |
| rlandy|rover | anbanerj|ruck: I abandoned the first patch | 11:03 |
| rlandy|rover | nobody voted on it | 11:03 |
| anbanerj|ruck | ok, got it | 11:03 |
| *** chem is now known as Guest396 | 11:03 | |
| rlandy|rover | anbanerj|ruck: pls testproject fs020 with last hash and this skiplist review | 11:04 |
| rlandy|rover | master is 4 days old - we can promlte | 11:04 |
| rlandy|rover | anbanerj|ruck: is this still an issue? https://trello.com/c/jHjjvqiF/2101-cixlp1943856tripleociproa-requested-access-to-the-resource-is-denied-in-pull-failed-containers-from-dockerhub | 11:05 |
| rlandy|rover | pls comment on card | 11:06 |
| anbanerj|ruck | rlandy|rover, no I iploaded daemon:v4.0.19-stable-4.0-nautilus-centos-7-x86_64, It should work now | 11:06 |
| anbanerj|ruck | I'll add ceph to the registry sync script | 11:06 |
| rlandy|rover | anbanerj|ruck: thanks - pls add your patch to the card | 11:09 |
| rlandy|rover | anbanerj|ruck: I'm checking on train - c7 - ... anything from daniel re: health? | 11:10 |
| anbanerj|ruck | rlandy|rover, the patch is not up yet, I uploaded the docker image directly to the registry. but I think we can close the card | 11:10 |
| rlandy|rover | anbanerj|ruck: yep - but you added a mitigating factor | 11:11 |
| rlandy|rover | we want to capture that | 11:11 |
| rlandy|rover | you are doing something to prevent future error | 11:11 |
| anbanerj|ruck | oh, got it | 11:12 |
| *** ykarel|lunch is now known as ykarel | 11:12 | |
| rlandy|rover | bhagyashris: thanks for organizing TC/UA/PM sync today | 11:12 |
| rlandy|rover | marios: hello ... you have the retro this wednesday - you all set to run that? | 11:13 |
| rlandy|rover | I will be out that day | 11:13 |
| rlandy|rover | ykarel: thanks for the update on https://review.rdoproject.org/r/c/testproject/+/35646 | 11:17 |
| rlandy|rover | good to know we can use psi there | 11:17 |
| *** pojadhav is now known as pojadhav|brb | 11:18 | |
| ysandeep | rlandy|rover: when you get settled I have replied on that lvm2 issue, I have posted a patch to add lvm2 in downstream nodepool image. | 11:21 |
| rlandy|rover | ysandeep: ok - I responded to your question on the difference in nodepool image builds | 11:22 |
| *** amoralej is now known as amoralej|lunch | 11:25 | |
| rlandy|rover | ysandeep: looks goods to me | 11:25 |
| ysandeep | rlandy|rover: thanks! | 11:25 |
| marios | rlandy|rover: ack thanks for reminder | 11:26 |
| rlandy|rover | ysandeep: w+'ed | 11:29 |
| rlandy|rover | will have to wait until that image is in use | 11:29 |
| ysandeep | rlandy|rover, ++ thanks!, lets see.. I will keep an eye | 11:29 |
| *** jpena is now known as jpena|lunch | 11:29 | |
| *** dviroel|out is now known as dviroel | 11:36 | |
| *** ysandeep is now known as ysandeep|afk | 11:37 | |
| rlandy|rover | anbanerj|ruck: need help with anything ruck/rover-wise? | 11:39 |
| rlandy|rover | ysandeep|afk: pojadhav|brb: re: the compute component in 17 ... | 11:40 |
| rlandy|rover | https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-component-compute/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-standalone-full-tempest-scenario-compute-rhos-17/781e497/logs/undercloud/var/log/tempest/stestr_results.html | 11:40 |
| rlandy|rover | bug on this? | 11:40 |
| rlandy|rover | known issue/workaround? | 11:40 |
| rlandy|rover | ysandeep|afk++ pojadhav|brb++ on keeping all the other components clean | 11:41 |
| rlandy|rover | anbanerj|ruck: ^^ any issues in the upstream components? | 11:41 |
| rlandy|rover | anything lagging there? | 11:41 |
| anbanerj|ruck | that is wallaby, right? | 11:42 |
| rlandy|rover | anbanerj|ruck: all of them :) | 11:45 |
| rlandy|rover | let's take today to check all the line | 11:46 |
| rlandy|rover | anbanerj|ruck: and see if any component is old | 11:46 |
| anbanerj|ruck | rlandy|rover, I am not sure what this error is - https://7e0affbd464b261bcc2a-f8803ca7587e43f6b66c9edae98e760b.ssl.cf5.rackcdn.com/809427/2/gate/tripleo-ci-centos-7-containers-multinode/cd5b7bd/job-output.txt | 11:47 |
| *** pojadhav|brb is now known as pojadhav | 11:47 | |
| anbanerj|ruck | "No module named yaml", | 11:47 |
| pojadhav | rlandy|rover, I also noticed compute component in 17. will report a bug. | 11:47 |
| rlandy|rover | anbanerj|ruck: marios is working on that | 11:49 |
| anbanerj|ruck | rlandy|rover, ack | 11:49 |
| rlandy|rover | there is an open bug | 11:49 |
| rlandy|rover | https://bugs.launchpad.net/tripleo/+bug/1943968 | 11:50 |
| anbanerj|ruck | the rest of the promotions look ok | 11:50 |
| rlandy|rover | anbanerj|ruck: ^^ | 11:51 |
| rlandy|rover | and associated review https://review.opendev.org/c/openstack/tripleo-quickstart/+/809670 | 11:51 |
| marios | rlandy|rover: anbanerj|ruck: waiting on test to report but i think it is good https://zuul.openstack.org/status#809687 | 11:51 |
| rlandy|rover | marios: yeah - all good ... that bug was never marked promotion-blocker | 11:52 |
| rlandy|rover | but if the fix is imminent, ok | 11:52 |
| rlandy|rover | marios: if we're a no go on the test - will raise it | 11:52 |
| rlandy|rover | anbanerj|ruck: thanks for checking - we just should keep an eye on manilla in ususri | 11:57 |
| pojadhav | rlandy|rover, ysandeep|afk : https://bugzilla.redhat.com/show_bug.cgi?id=2005879 | 11:57 |
| rlandy|rover | 9 days agotempestpromoted-components2 days ago | 11:58 |
| rlandy|rover | anbanerj|ruck: can you checkout tempest component in master? | 11:59 |
| rlandy|rover | anbanerj|ruck: ^^ scenario test failing there | 11:59 |
| rlandy|rover | add to skiplist if need be pls | 11:59 |
| dviroel | bhagyashris: hi, hope you don't mind that I updated your patch last friday :) | 11:59 |
| anbanerj|ruck | rlandy|rover, manilla on ussuri doesnt show a failure till now https://trunk.rdoproject.org/api-centos8-ussuri/api/civotes_detail.html?commit_hash=5115f348d455a602d43f70ad4467b8eaa637a845&distro_hash=58ff860dbc7140ac5f5d8201afc1fdc4f42f8955 - there is a new build 6 hrs ago. maybe it is still running? | 12:00 |
| bhagyashris | dviroel, np thanks :) | 12:00 |
| rlandy|rover | anbanerj|ruck: no worries we can watch that | 12:00 |
| rlandy|rover | anbanerj|ruck: only concern is tempest in master | 12:00 |
| rlandy|rover | rest are all good | 12:00 |
| rlandy|rover | pojadhav: thanks | 12:00 |
| rlandy|rover | let's check that out | 12:00 |
| anbanerj|ruck | me checks | 12:01 |
| anbanerj|ruck | rlandy|rover, are periodic-tripleo-ci-centos-8-standalone-full-tempest-scenario-tempest-master and periodic-tripleo-ci-centos-8-standalone-full-tempest-scenario-master different jobs? | 12:07 |
| rlandy|rover | anbanerj|ruck: yep :) | 12:17 |
| rlandy|rover | anbanerj|ruck: https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-standalone-full-tempest-scenario-tempest-master | 12:19 |
| anbanerj|ruck | rlandy|rover, oh, periodic-tripleo-ci-centos-8-standalone-full-tempest-scenario-tempest-master is failing neutron_tempest_plugin.scenario.test_trunk.TrunkTest as well. Creating a new bug and add to skiplist. | 12:19 |
| rlandy|rover | component pipeline job | 12:19 |
| rlandy|rover | anbanerj|ruck: do you need a new bug? | 12:20 |
| rlandy|rover | same error just add to list | 12:20 |
| anbanerj|ruck | rlandy|rover, ok | 12:20 |
| *** amoralej|lunch is now known as amoralej | 12:21 | |
| *** jpena|lunch is now known as jpena | 12:22 | |
| rlandy|rover | pojadhav: pls send email to rhos-dev to get that raised to CIX | 12:39 |
| pojadhav | rlandy|rover, yup | 12:40 |
| anbanerj|ruck | rlandy|rover, I cant find a testproject for https://trello.com/c/l7eE26DW/2097-cixbz2003921osp162rhel8periodic-tripleo-ci-rhel-8-standalone-full-tempest-api-rhos-162-is-failing-on-neutron-tempest-tests-with | 12:44 |
| * rlandy|rover looks | 12:45 | |
| rlandy|rover | pretty sure we had something there for 16.2 | 12:45 |
| weshay|ruck | rlandy|rover, ysandeep|afk is this the tp job? https://code.engineering.redhat.com/gerrit/c/testproject/+/211643 for https://trello.com/c/l7eE26DW/2097-cixbz2003921osp162rhel8periodic-tripleo-ci-rhel-8-standalone-full-tempest-api-rhos-162-is-failing-on-neutron-tempest-tests-with | 12:46 |
| *** ysandeep|afk is now known as ysandeep | 12:47 | |
| rlandy|rover | ysandeep: ^^ yep | 12:47 |
| rlandy|rover | Fix https://review.opendev.org/c/openstack/neutron/+/809191 seems to be working. All tempest tests on the reproducer env prepared by @sandeepyadav36 passed with that patch. | 12:48 |
| ysandeep | weshay|ruck: yes, but I think slaweq monkey patch his fix on that env.. Its still awaiting merge in master | 12:48 |
| * rlandy|rover looking for that env | 12:48 | |
| ysandeep | this is the fix: https://review.opendev.org/c/openstack/neutron/+/809191 which we tested locally in the node i have provided to slaweq | 12:49 |
| weshay|ruck | I'll be a few min late to scrum bhagyashris | 12:59 |
| bhagyashris | weshay|ruck, ok np | 12:59 |
| ysandeep | ykarel++ thanks for your comment on that lvm2 review, fyi.. https://bugs.launchpad.net/tripleo/+bug/1944175, I will propose a fix to modify-image role soon | 12:59 |
| ykarel | ack | 13:00 |
| bhagyashris | rlandy|rover, scrum time | 13:01 |
| bhagyashris | https://review.opendev.org/c/openstack/tripleo-repos/+/804306 | 13:05 |
| dviroel | https://review.opendev.org/c/openstack/tripleo-quickstart/+/808408 | 13:14 |
| bhagyashris | https://review.rdoproject.org/r/c/rdo-jobs/+/35392 | 13:15 |
| bhagyashris | https://review.opendev.org/c/openstack/tripleo-quickstart/+/807936 | 13:15 |
| bhagyashris | https://review.opendev.org/c/openstack/tripleo-ci/+/807937 | 13:15 |
| bhagyashris | https://review.rdoproject.org/r/c/rdo-jobs/+/35433 | 13:16 |
| bhagyashris | https://review.opendev.org/c/openstack/tripleo-ci/+/808059 | 13:18 |
| ysandeep | ykarel: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/810011 | 13:19 |
| rlandy|rover | http://rhos.op.redhat.com/roster | 13:20 |
| ykarel | ysandeep, ack | 13:30 |
| bhagyashris | https://softwarefactory-project.io/r/c/config/+/22670/ | 13:39 |
| bhagyashris | https://review.opendev.org/c/opendev/base-jobs/+/809765 | 13:39 |
| bhagyashris | https://softwarefactory-project.io/r/c/config/+/22670 | 13:39 |
| bhagyashris | https://review.opendev.org/c/openstack/tripleo-ci/+/808577 | 13:41 |
| bhagyashris | https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/808748 | 13:41 |
| bhagyashris | https://www.openstack.org/ptg/ | 13:44 |
| bhagyashris | https://etherpad.opendev.org/p/tripleo-ci-yoga-topics | 13:44 |
| ysandeep | chandankumar, rlandy|rover reviews please: https://review.rdoproject.org/r/c/rdo-jobs/+/35392 | 14:12 |
| *** poojajadhav is now known as pojadhav | 14:13 | |
| *** ykarel is now known as ykarel|away | 14:39 | |
| marios | bhagyashris: rlandy|rover: weshay|ruck: let's move the retro up by half hour i.e. 1200 UTC instead of 1230. it would give us an hour before the open forum | 14:50 |
| marios | bhagyashris: can you do that on the invite please if there are no objections | 14:50 |
| rlandy|rover | marios: bhagyashris: fine by me | 14:50 |
| bhagyashris | marios, yeah but we have tempest meeting that time | 14:50 |
| marios | bhagyashris: hm i see ok then no good | 14:50 |
| bhagyashris | let m check with soniya | 14:50 |
| bhagyashris | soniya29, hey is it possible to shift tempest meeting hr earlier than the regular time | 14:51 |
| * dviroel lunch | 14:56 | |
| ysandeep | rlandy|rover: Reran 17 jobs with a fix, We promote 17 today if https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/status#810011 testprojects passes | 15:18 |
| ysandeep | rlandy|rover: fyi.. https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/810011 added fix in tqe modify-image role as well. | 15:19 |
| rlandy|rover | ysandeep: thanks | 15:20 |
| rlandy|rover | +2'ed modify image | 15:20 |
| Tengu | rlandy|rover: ... the patch still has issues to get through zuul, hitting random things at random time now -.-. hopefully the last recheck will make it green and ready for the +w | 15:21 |
| rlandy|rover | Tengu: k - here's hoping - if not we need to cut down the test checks there | 15:21 |
| rlandy|rover | ysandeep: ok if we get a clean pass on both those testprojects? | 15:22 |
| rlandy|rover | to promote 17 | 15:23 |
| ysandeep | rlandy|rover, yes, Only these 4 jobs are awaiting pass on current hash in testing | 15:23 |
| rlandy|rover | ok | 15:24 |
| Tengu | rlandy|rover: is that patch needed to cut that "non-xena" tag? | 15:24 |
| rlandy|rover | Tengu: "that patch"? your tripleo-ansible patch? | 15:25 |
| rlandy|rover | probably not | 15:26 |
| rlandy|rover | but would be good | 15:26 |
| Tengu | rlandy|rover: yep, and ok :). | 15:26 |
| rlandy|rover | anbanerj|ruck: ussuri is red | 15:48 |
| rlandy|rover | and wallaby | 15:48 |
| rlandy|rover | can you check in to what's breaking there? | 15:48 |
| anbanerj|ruck | yes, test projecting those | 15:48 |
| rlandy|rover | anbanerj|ruck: systemib failure | 15:51 |
| rlandy|rover | testproject may not help | 15:51 |
| rlandy|rover | will chat with you in a few | 15:51 |
| anbanerj|ruck | a lot of jobs failed in ussuri | 15:51 |
| jbadiapa | Not sure whether it has anything to do with the issues on the jobs, but I started getting issues when downloading repos | 16:01 |
| jbadiapa | https://paste.opendev.org/show/809439/ | 16:01 |
| rlandy|rover | anbanerj|ruck: https://meet.google.com/ceg-jtgz-bos?pli=1&authuser=0 | 16:02 |
| rlandy|rover | let's look at all those failures | 16:02 |
| rlandy|rover | jbadiapa: looking into all of those now | 16:03 |
| jbadiapa | rlandy|rover, thx | 16:03 |
| ysandeep | rlandy|rover, I am putting 2 testprojects:- 1) with your change to enable_keystone to true, 2) One for fs020/sc007 with depends-on my patch to convert to ephermalheat | 16:04 |
| rlandy|rover | ysandeep++ you rock | 16:06 |
| rlandy|rover | thank you | 16:06 |
| rlandy|rover | let's see what works | 16:06 |
| *** marios is now known as marios|out | 16:09 | |
| rlandy|rover | ysandeep: going to put in a patch to ci-config to promote previous master hahs so we have time | 16:15 |
| rlandy|rover | hash | 16:15 |
| ysandeep | https://review.rdoproject.org/r/c/testproject/+/28537 and https://review.rdoproject.org/r/c/testproject/+/32054 | 16:16 |
| *** jbadiapa is now known as jbadiapa|off | 16:18 | |
| ysandeep | ack o/ | 16:20 |
| rlandy|rover | arxcruz: hey can you also follow I paste conversation to the task https://issues.redhat.com/browse/RHOSZUUL-595 | 16:20 |
| anbanerj|ruck | rlandy|rover, https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/35661 | 16:20 |
| rlandy|rover | arxcruz: see conversation on rhos-ops | 16:20 |
| rlandy|rover | dpawlik has a new approach there | 16:20 |
| rlandy|rover | anbanerj|ruck i son ruck -rover craziness | 16:20 |
| *** ysandeep is now known as ysandeep|dinner | 16:25 | |
| anbanerj|ruck | rlandy|rover, https://logserver.rdoproject.org/openstack-periodic-integration-stable4-centos7/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-scenario004-standalone-train/399e4ac/job-output.txt | 16:25 |
| anbanerj|ruck | rlandy|rover, https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/35661 we can merge this now | 16:52 |
| rlandy|rover | https://review.rdoproject.org/zuul/stream/dec1ed31e299419bbde2d8afbdc4587b?logfile=console.log | 17:01 |
| rlandy|rover | anbanerj|ruck: ^^ think we are ok on c7 can you vote on https://review.opendev.org/c/openstack/tripleo-quickstart/+/810084? | 17:03 |
| *** ysandeep|dinner is now known as ysandeep | 17:05 | |
| rlandy|rover | anbanerj|ruck: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/35661 merged | 17:11 |
| rlandy|rover | proposing revert | 17:11 |
| rlandy|rover | for afterwards | 17:11 |
| anbanerj|ruck | rlandy|rover, ++ thanks | 17:11 |
| rlandy|rover | https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/35673 | 17:11 |
| rlandy|rover | anbanerj|ruck: ^^ | 17:12 |
| rlandy|rover | also merging https://review.opendev.org/c/openstack/tripleo-quickstart/+/810084 | 17:12 |
| rlandy|rover | anbanerj|ruck: ^^ based on testproject | 17:12 |
| soniya29 | bhagyashris, okay, no problem | 17:15 |
| *** amoralej is now known as amoralej|off | 17:16 | |
| *** jpena is now known as jpena|off | 17:19 | |
| ysandeep | rlandy|rover, ack thanks, testing ramishra patch here: https://review.rdoproject.org/r/c/testproject/+/28537 , I will work with him tomorrow incase this fails.. i think it might. | 18:02 |
| * ysandeep out | 18:04 | |
| *** ysandeep is now known as ysandeep|away | 18:04 | |
| rlandy|rover | ysandeep|away: thank you - have a good night | 18:09 |
| ysandeep|away | rlandy|rover, fixed rabi's patch: https://review.opendev.org/c/openstack/tripleo-quickstart/+/810083 | 18:17 |
| * ysandeep|away out now | 18:17 | |
| ysandeep|away | rechecked https://review.rdoproject.org/r/c/testproject/+/28537 | 18:17 |
| rlandy|rover | ysandeep|away: thanks - will watch that | 18:17 |
| rlandy|rover | anbanerj|ruck: promotion failed container push | 18:19 |
| rlandy|rover | running again | 18:20 |
| rlandy|rover | will see if itworks | 18:20 |
| weshay|ruck | rlandy|rover, right.. SELECT "branch", "change", "log_link", "duration", "cloud", "region", "result", "voting", "sova_reason" as "Failure Cause" FROM "autogen"."build" WHERE ("passed" = 'False' AND "pipeline" = 'gate' AND "result" != 'NODE_FAILURE' AND "result" != 'RETRY' AND "result" != 'CANCELED') AND $timeFilter | 18:48 |
| weshay|ruck | counter on left | 18:48 |
| weshay|ruck | SELECT count("result_num") FROM "build" WHERE ("pipeline" = 'gate' AND "passed" = 'False' AND "voting" = 'True' AND "result" != 'NODE_FAILURE' AND "result" != 'SKIPPED' AND "result" != 'CANCELED') AND $timeFilter | 18:48 |
| rlandy|rover | https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/35668 Gate failures should not include RETRY status | 19:15 |
| rlandy|rover | weshay|ruck: ^^ | 19:15 |
| rlandy|rover | weshay|ruck: thanks - going to try pull into cocpit | 19:38 |
| rlandy|rover | cockpit | 19:38 |
| rlandy|rover | merged | 19:38 |
| rlandy|rover | done | 19:42 |
| *** dviroel is now known as dviroel|out | 21:09 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!