Tuesday, 2021-09-14

« Monday, 2021-09-13 Index Wednesday, 2021-09-15 »
erbotRequired files not ready after 301.0517191886902s for tripleo-ci-centos-8-containers-multinode-wallaby 804272,1,d6da69a4c2cf44028d01e0ab6c2a59b301:39
rlandy|roverweshay|ruck: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3552801:56
*** rlandy is now known as rlandy|testbox01:57
rlandy|roverysandeep|out: no luck on 16.2 http://osp-trunk.hosted.upshift.rdu2.redhat.com/api-rhel8-osp16-2/api/civotes_agg_detail.html?ref_hash=af8d9e9a3fba6113ebcdeeebbc5a54a902:32
rlandy|roverapi and fs035 still failing02:32
rlandy|roverwe can skip tempest and promote w/o fs035 if need be02:33
*** ysandeep|out is now known as ysandeep05:11
pojadhavysandeep, 0/ good morning !05:30
pojadhavysandeep, I have checked 16.2 and 17 integration lines, and posted 2 testruns. for 16.2 tempest api job is blocking and for 17 fs35 is blocking now. https://code.engineering.redhat.com/gerrit/c/testproject/+/272710 and https://code.engineering.redhat.com/gerrit/c/testproject/+/27294305:32
pojadhavbecause failures are not consistent ones.05:33
erbotRequired files not ready after 301.9779462814331s for tripleo-ci-centos-8-containers-multinode 803911,12,bb89e501b71a4d7585b5291be6d955d006:01
bhagyashrisrlandy|testbox, ack06:01
ysandeeppojadhav: thanks!06:08
bhagyashrisysandeep, as we discussed on yesterday i am removing all the tripleo related jobs from master to pike branch from aodh and celiometer project06:51
bhagyashrisfolks kindly add this patch into your review list https://review.rdoproject.org/r/c/config/+/3543606:53
bhagyashristhanks :)06:53
erbotRequired files not ready after 301.7890121936798s for openstack-tox-docs 808833,1,5949ff92a8a240a1be68ce45463219f407:16
*** jpena|off is now known as jpena07:23
*** ykarel is now known as ykarel|lunch08:05
*** ysandeep is now known as ysandeep|lunch08:14
erbotRequired files not ready after 300.99303245544434s for openstack-tox-cover 804392,8,50cb93d2deb84d9bb88c42ee98e8e64f08:15
erbotRequired files not ready after 300.63845682144165s for ironic-standalone-ipa-src 808214,1,a8c4ba94b53b4b5d886244d81c4ca26909:01
arxcruzsshnaidm|off: hey, can you help me with this molecule job here https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/808603 09:16
arxcruznot sure what exactly is failing 09:16
*** ykarel|lunch is now known as ykarel09:24
erbotRequired files not ready after 301.5233850479126s for tripleo-ci-centos-8-containers-multinode 808748,4,1b751099fae24183971abdbc4bdb5f2809:54
erbotRequired files not ready after 301.00524854660034s for openstack-tox-cover 796271,6,4cb0e786e7454e55b1d0cfca101992ef10:04
*** ysandeep|lunch is now known as ysandeep10:08
bhagyashrisarxcruz, sshnaidm|off is on long PTO10:49
arxcruzthen zbr https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/80860310:49
arxcruz:d 10:49
arxcruz:d10:49
arxcruz:D 10:49
zbr@arxcruz please make a request to add an A record for health on rdo domain. it deserves a better domain than mine. not that i have any plans to repurpose that dns entry.10:52
zbrbut the dasboard is cool, people will trust it more with better domain10:52
*** dviroel|out is now known as dviroel11:10
arxcruzzbr: yeah, i know, but from now, can you help me with that molecule issue ?11:10
*** rlandy is now known as rlandy|rover11:17
rlandy|roverysandeep: hey11:18
rlandy|roverysandeep: 16.2 - never got a pass on fs035 or tempest-api11:18
ysandeeprlandy|rover: https://bugzilla.redhat.com/show_bug.cgi?id=2003921 I am working with slawew for full-tempest=api11:19
*** jpena is now known as jpena|lunch11:24
rlandy|roveranbanerj|ruck: hi - how are things today?11:29
rlandy|roverpojadhav: hi ... https://code.engineering.redhat.com/gerrit/q/topic:%22rename_fs10%22+(status:open%20OR%20status:merged)11:30
anbanerj|ruckgate is good. reruning victoria and train. I'll checking master11:30
rlandy|roveris that ready to go or waiting on somethings11:30
rlandy|rovermerge conflict there11:30
rlandy|roverotherwise could merge those for you11:30
rlandy|roveranbanerj|ruck: k - mater still 4 days out11:31
rlandy|rovertried to chase that yesterday11:31
rlandy|roverwill have to look11:31
rlandy|roveralso we have tox failures in the gate11:31
rlandy|roverthat patch might need a rebase11:31
rlandy|roveror we have a real issue11:31
rlandy|roveranbanerj|ruck: good run https://review.rdoproject.org/zuul/buildset/bdc27756661c41438fb1683d66a2d55f11:33
anbanerj|ruckchecking11:33
rlandy|roveron master11:33
rlandy|roverbut fs020 and fs035 are failing11:33
rlandy|roveranbanerj|ruck: ^^11:33
rlandy|roverchecking if those are consistent11:33
rlandy|roverhttps://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-master11:34
rlandy|roveranbanerj|ruck: ^^ 11:34
rlandy|roverfailures these11:34
rlandy|roveranbanerj|ruck: tripleo component promoted11:35
rlandy|roverso may have changes in there11:35
rlandy|roveralso fs02011:35
rlandy|rover2021-09-14 02:18:02 | 2021-09-14 02:18:02.001 159389 ERROR openstack [-] ERROR: Protected resource registry overrides detected! These entries are used in internal environments and should not be overridden in the user environment. Please remove these overrides from the environment files.11:36
rlandy|roveranbanerj|ruck: ^^ we need a LP bug there pls11:37
rlandy|roverhttps://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-master/5177268/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz11:37
anbanerj|ruckrlandy|rover, ack. adding11:37
* rlandy|rover checks fs02011:37
rlandy|roverhttps://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-master/e42975a/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz11:38
rlandy|roveranbanerj|ruck: ^^ same on fs02011:38
rlandy|roverpromotion-blocker11:38
rlandy|rovermarios: hello ... re: https://review.opendev.org/c/openstack/tripleo-quickstart/+/801703/11:41
rlandy|roverhitting tox failures there11:41
rlandy|rovercould be legit11:42
mariosrlandy|rover: where? 11:42
rlandy|rovergoing to rebase that and give it a second run through the queues11:42
rlandy|rovermarios: ^^11:42
mariosit ran openstack-tox-molecule https://zuul.opendev.org/t/openstack/build/10493bf5b8274c5caf297d7ccb5eac6d : SUCCESS in 9m 45s 11:42
mariosrlandy|rover: ^11:42
marioshttps://review.opendev.org/c/openstack/tripleo-quickstart/+/801703/4#message-b49fe20f2599055bced10f70b83c2826ba4b2687 11:42
mariosrlandy|rover: ^11:42
rlandy|rovermarios: yea - could be just a hitch11:42
mariosrlandy|rover: you mean in the gate right now? looking11:43
rlandy|rovergoing to fail gate anyways11:43
rlandy|roveryep11:43
rlandy|roverjuts and fyi 11:43
rlandy|roverjust11:43
mariosrlandy|rover: ack see it11:43
rlandy|rovermarios: yep so rebasing11:43
mariosrlandy|rover: sure11:43
rlandy|roverw+'ed again11:43
*** ysandeep is now known as ysandeep|brb11:46
anbanerj|ruckrlandy|rover, https://bugs.launchpad.net/tripleo/+bug/1943579 for fs35 and 20. fs20 might have another issue with undercloud instal. checking11:46
*** pojadhav is now known as pojadhav|afk11:47
*** ysandeep|brb is now known as ysandeep11:54
mariosrlandy|rover: call? 12:00
rlandy|roverdviroel: ^^12:01
erbotRequired files not ready after 301.9143376350403s for openstack-tox-linters 801703,5,d2caa88b91c542d4834a910815225ef612:04
anbanerj|rucklast two runs of fs020 also timed out in Container image prepare12:05
*** pojadhav|afk is now known as pojadhav12:16
*** jpena|lunch is now known as jpena12:20
ysandeeprlandy|rover, pojadhav please review when time permits: https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/27305112:31
rlandy|roverysandeep: merging12:33
ysandeeprlandy|rover: thanks!12:34
*** amoralej is now known as amoralej|lunch12:34
ysandeeprlandy|rover: fyi.. I have promoted 17 today.12:35
rlandy|roverysandeep++ yay12:35
ysandeeprlandy|rover: 16.2 hash changed, imho.. lets hold 16.2 promotion till full-tempest-api issue is under investigation..  slaweq is helping us with debug.12:37
rlandy|roverysandeep: np12:37
ysandeeprlandy|rover, pojadhav is debugging 17 fs035 tempest failures, You mentioned some bug about fs035 in wallaby, Is it on cix?12:38
rlandy|roverysandeep: timeout ...12:39
rlandy|roverhttps://trello.com/c/U1bKNUuu/2051-cixlp1939023tripleociproa-periodic-featureset-35-wallaby-times-out-running-tempest-2-hours12:39
pojadhavysandeep, rlandy|rover ack12:40
ysandeeprlandy|rover, thanks, pojadhav fyi ^^ we need to cross check if its same12:40
pojadhavysandeep, looking12:40
rlandy|rovermarios: anbanerj|ruck: tox failures look like juts a hitch - https://review.opendev.org/c/openstack/tripleo-quickstart/+/801703 passing in rerun12:48
anbanerj|ruckack12:49
rlandy|roveranbanerj|ruck; if fs020 got to overcloud deploy - undercloud install is ok12:51
rlandy|roverwe can try revert harold's patch and see if it fixes the problem12:52
rlandy|roverwaiting on him to respond12:52
anbanerj|rucklast 2 times it didnt get to overcloud deploy. It timed out in  Container image prepare12:52
rlandy|roverhttps://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-master/e42975a/job-output.txt12:53
rlandy|rover2021-09-14 10:46:04.641845 | primary | TASK [did the deployment pass or fail?] ****************************************12:53
rlandy|rover^^ what am I missing?12:53
anbanerj|ruckhttps://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-master/0dbb3ab/job-output.txt12:54
rlandy|roverprevious run12:54
rlandy|roveranbanerj|ruck: ok - so the last run got to overcloud deploy12:55
rlandy|roverso it must have passed undercloud deploy12:55
rlandy|roverbut good to keep an eye on that as well :)12:55
anbanerj|ruckoh, yes right. I didnt refresh the page and the last run didnt show up :D Undercloud fail was probably one time12:56
anbanerj|ruckanything I should update here https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/35519 ?12:57
mariosack thanks rlandy|rover 12:59
ysandeepReview request: https://review.rdoproject.org/r/c/config/+/35530 , removing fs039 c7 job12:59
erbotRequired files not ready after 301.8205602169037s for tripleo-ansible-centos-8-molecule-tripleo_sshd 759057,11,31eba5604ee745faba171f5aca84280c13:04
weshay|ruckanbanerj|ruck++13:08
weshay|ruckthanks for catching https://bugs.launchpad.net/tripleo/+bug/194357913:08
weshay|ruckstandalone-master full tempest failing one test https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-standalone-full-tempest-scenario-master/007584e/logs/undercloud/var/log/tempest/stestr_results.html.gz13:11
rlandy|roverweshay|ruck: that has a spotty history13:11
* rlandy|rover gets13:11
rlandy|roverhttps://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-standalone-full-tempest-scenario-master13:13
erbotRequired files not ready after 300.35973024368286s for tripleo-validations-centos-8-molecule-undercloud_debug 805852,10,7b946b1d03204612af5a862c4164f3d513:13
rlandy|roverrechecking tempest13:14
*** amoralej|lunch is now known as amoralej13:20
bhagyashrisarxcruz, zbr, sshnaidm, rlandy|rover , marios, ysandeep, bhagyashris, svyas, soniya29, pojadhav, akahat, weshay|ruck , chandankumar, frenzy_friday, dviroel anbanerj|ruck 13:23
bhagyashrisTripleO CI community call in 7 mins13:23
weshay|ruckfyi.. I have a conflict.. may be short13:23
bhagyashrisfeel free to add agenda here **line number 32** https://hackmd.io/MMg4WDbYSqOQUhU2Kj8zNg?both#2021-09-14-Community-Call13:24
bhagyashrisweshay|ruck, np13:24
bhagyashrishttps://meet.google.com/bqx-xwht-wky?authuser=013:24
bhagyashrisakahat, ^13:31
bhagyashrisdviroel, ^13:31
erbotRequired files not ready after 300.78069257736206s for tripleo-ci-centos-8-standalone-validation-libs 808926,1,659ba6229d104e0a9403a3ec8c01611b13:32
erbotRequired files not ready after 300.71125650405884s for octavia-v2-dsvm-tls-barbican 808654,3,6a2c53b8ea5743039ad2d4a1ff139c9313:45
ysandeepReview request: https://review.rdoproject.org/r/c/config/+/35530 , removing fs039 c7 job13:50
mariosdviroel: rlandy|rover: ysandeep: weshay|ruck: please add to reviews https://review.opendev.org/c/openstack/tripleo-repos/+/808217 13:50
ysandeepmarios, ack o/ 13:50
dviroelsure13:50
rlandy|roverack13:51
erbotRequired files not ready after 301.62541484832764s for puppet-openstack-lint-ubuntu-focal 807851,3,22dc97f63a7b4e2da0e5cdd12e6a94de14:06
erbotRequired files not ready after 301.03056502342224s for barbican-grenade-devstack 808655,3,cae25bb1f05d4165aa060e5d9c637da214:31
pojadhavReview Request : https://code.engineering.redhat.com/gerrit/q/topic:%22rename_fs10%22+(status:open%20OR%20status:merged)14:46
bhagyashrisrlandy|rover, akahat patch merged 14:53
bhagyashrisakahat,  plz rejoin14:53
bhagyashrishttps://meet.google.com/edd-nwpn-psk?authuser=014:53
akahatbhagyashris, ack14:54
ysandeeppojadhav: thanks, +w 1 patch but this one need some rework: https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/270901/2/ci-scripts/dlrnapi_promoter/config_environments/rdo/RedHat-8/rhos-17.yaml 14:59
*** ykarel is now known as ykarel|away15:02
ysandeepReview request: https://review.rdoproject.org/r/c/config/+/35530 , removing fs039 c7 job15:03
* dviroel lunch15:06
*** ysandeep is now known as ysandeep|dinner15:11
rlandy|roverbhagyashris++ akahat++ promoter has git pull on15:16
rlandy|roverweshay|ruck: ^^ fyi15:16
weshay|ruck\0/15:16
rlandy|roverwatching for today's results15:16
rlandy|roveranbanerj|ruck++ for config changes15:16
erbotRequired files not ready after 300.97911500930786s for ironic-standalone-ipa-src 776507,5,2ad2ac564607499394ca2fd93021ed1c15:26
rlandy|roverhttps://logserver.rdoproject.org/21/35121/14/check/periodic-tripleo-ci-centos-8-standalone-full-tempest-scenario-master/582665e/logs/undercloud/var/log/tempest/stestr_results.html.gz stil dying15:34
* rlandy|rover will see if we can skip anything here15:34
rlandy|roveranbanerj|ruck: ^^15:34
pojadhavysandeep|dinner, looking15:40
pojadhavysandeep|dinner, done : https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/27090115:50
rlandy|roverlunch - back in a few16:03
*** ysandeep|dinner is now known as ysandeep16:08
ysandeeppojadhav, thanks! added a suggestion16:14
ysandeepweshay|ruck, rlandy|rover please review when time permits:  https://review.rdoproject.org/r/c/config/+/3553016:16
rlandy|roveron review list16:20
*** jpena is now known as jpena|off16:26
erbotRequired files not ready after 302.2022247314453s for tripleo-ci-centos-8-undercloud-containers 807587,1,d44f09a442724fe09e303e03552660f016:28
*** pojadhav is now known as pojadhav|out16:30
ysandeepfolks review please: https://review.rdoproject.org/r/c/rdo-jobs/+/35392 : Remove jobs that uses obselete fs b/w 31 - 9916:39
*** ysandeep is now known as ysandeep|out16:42
erbotRequired files not ready after 300.89945006370544s for openstack-tox-pep8 806907,1,bb75c019a1154273b70f2074c3a95cfd16:50
* anbanerj|ruck leaving for the day17:25
rlandy|roveranbanerj|ruck: program cal doc updated20:06
anbanerj|ruckrlandy|rover, thanks21:25
anbanerj|ruckrlandy|rover, is there a job that is almost sure to fail that I can test project?21:26
anbanerj|ruck* and that would take a short time to fail21:26
anbanerj|ruckI tried fs035 and fs020 but they both take a lot of time to fail21:27
*** dviroel is now known as dviroel|out21:36
rlandy|roveranbanerj|ruck: sure21:37
rlandy|roversorry - on call21:37
rlandy|roverweshay|ruck: https://review.opendev.org/c/openstack/tripleo-quickstart/+/80770321:58
rlandy|roverweshay|ruck: ^^ updated22:10
*** rlandy|rover is now known as rlandy|rover|bbl22:30
« Monday, 2021-09-13 Index Wednesday, 2021-09-15 »

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!