Wednesday, 2021-04-21

« Tuesday, 2021-04-20 Index Thursday, 2021-04-22 »
*** anbanerj|ruck has quit IRC00:14
*** jmasud has joined #oooq01:30
*** jmasud has quit IRC01:47
*** jmasud has joined #oooq01:54
*** jmasud has quit IRC01:57
*** rlandy|rover has quit IRC03:34
*** amoralej|off has quit IRC03:37
*** jmasud has joined #oooq03:58
*** ykarel|away has joined #oooq04:06
*** ykarel_ has joined #oooq04:10
*** ykarel|away has quit IRC04:12
*** radez has quit IRC05:12
*** jfrancoa has quit IRC05:39
*** jfrancoa has joined #oooq05:39
*** ykarel_ has quit IRC05:55
*** ykarel__ has joined #oooq05:55
*** marios has joined #oooq06:03
*** udesale has joined #oooq06:06
*** jpodivin has joined #oooq06:14
*** skramaja has joined #oooq06:18
*** saneax has joined #oooq06:25
*** ykarel_ has joined #oooq06:38
*** ykarel__ has quit IRC06:40
*** slaweq has joined #oooq07:02
*** jpodivin is now known as _jpodivin07:10
*** apetrich has joined #oooq07:13
*** amoralej has joined #oooq07:29
*** tosky has joined #oooq07:46
*** ysandeep|away is now known as ysandeep07:49
*** _jpodivin has quit IRC07:49
*** jpodivin has joined #oooq07:50
*** ykarel_ has quit IRC07:52
*** jpena|off is now known as jpena07:56
*** frenzy_friday has joined #oooq07:57
*** frenzy_friday is now known as anbanerj|ruck07:58
*** derekh has joined #oooq08:02
*** ysandeep is now known as ysandeep|lunch08:15
*** ykarel_ has joined #oooq08:27
*** jmasud has quit IRC08:32
matbuo/ morning oooq, is there someone to A+ this https://review.opendev.org/c/openstack/tripleo-quickstart/+/785843 ?08:54
matbuthx by advance08:54
matbuchandankumar: thx09:06
*** ysandeep|lunch is now known as ysandeep09:23
*** ykarel_ has quit IRC09:34
kopecmartinzbr: btw, molecule thing seems to be broken (or providers of the images) .. see my last comment - https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/78646209:40
kopecmartinit's weird, i'm not exactly sure what's happening there09:41
zbrkopecmartin: for start those docker images are very old, clearly not a stream release.09:42
zbri will be looking now09:42
zbrkopecmartin: does two month old count as maintained? https://quay.io/repository/centos/centos?tab=tags09:47
*** holser has joined #oooq09:52
kopecmartinif it was maintained it would work, it doesn't so it's not10:00
zbrkopecmartin: multiple issues, one major one is related to pbr and another typo in tox.ini, both with ugly side effects10:07
zbri need to remove pbr from that repo, it never manage to install10:11
*** slaweq_ has joined #oooq10:14
*** slaweq has quit IRC10:18
*** slaweq_ is now known as slaweq10:18
*** apetrich has quit IRC10:34
*** apetrich has joined #oooq10:37
*** dviroel_ has quit IRC11:19
*** jpena is now known as jpena|lunch11:32
*** rlandy has joined #oooq11:48
*** rlandy is now known as rlandy|rover11:49
rlandy|roveranbanerj|ruck: pls join me on the platform call today11:49
rlandy|roverwe say two lines11:49
rlandy|roverbut it's one experience11:49
anbanerj|ruckrlandy|rover, sure11:50
*** rlandy|rover has quit IRC11:54
*** radez has joined #oooq11:54
*** sshnaidm has quit IRC12:00
*** amoralej is now known as amoralej|lunch12:07
*** sshnaidm has joined #oooq12:07
*** rlandy has joined #oooq12:08
*** rlandy is now known as rlandy|rover12:08
rlandy|roverbhagyashris: where is the queens promoter config file?12:09
rlandy|roverneed to update the criteria to match https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/integration-pipeline-queens.yaml12:09
rlandy|roverbhagyashris: nvm12:10
rlandy|roverpermission denied12:12
bhagyashris10.0.148.59 is promoter server12:13
bhagyashrisfor c7 release promotions12:13
bhagyashrisrlandy|rover, ^12:13
rlandy|roverbhagyashris: yeah - I am permission denied there12:13
bhagyashrisrlandy|rover, send me you ssh key i will add on that server12:13
rlandy|roverbhagyashris: weshay|ruck is adding my key12:17
bhagyashrisrlandy|rover, ack12:18
bhagyashrisweshay|ruck, rlandy|rover jfyi on c8 release promoter i have disabled all the other branches except master12:19
bhagyashrisfor mainifest_push testing12:19
rlandy|roverok12:20
bhagyashrisbut looks like on master fs035 and fs002 is failing and it's failed to promote the master12:20
bhagyashrisso currently on master fs035 and fs002 is blocker right ?12:21
weshay|ruckbhagyashris, test project12:21
bhagyashrisrlandy|rover, ^12:21
rlandy|roverit should pass12:22
bhagyashrisweshay|ruck, you mean hit the test project patch for fs002 and fs035?12:22
bhagyashrishttp://10.0.148.74/promoter_logs/centos8_master.log12:22
bhagyashrislooks like in the recent run fs002 and fs039 failed https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-integration-main12:23
weshay|ruckbhagyashris, ya..12:23
weshay|rucksucks we only can do this w/ master12:23
weshay|ruckbhagyashris, akahat /me wonders if you ping mjturek if we could create 1-2 rocky ppc containers for us... that we could retag12:24
weshay|ruckbhagyashris, akahat then you could go crazy and test your hearts out w/ rocky12:24
rlandy|roverhttps://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset002-master12:24
rlandy|roversorry - just dropped from program call12:25
bhagyashrisweshay|ruck, but we removed the rocky jobs12:25
bhagyashrisweshay|ruck, should test with stein ?12:25
rlandy|roverweshay|ruck: bhagyashris: yeah = ok we hve some OVB failures12:26
rlandy|rover39 there is a patch12:26
rlandy|roveralso was chatting with ade about that12:26
rlandy|roverfs002 has an issue12:26
rlandy|roverchecking that12:26
bhagyashrisand weshay|ruck manifest_push came after train c812:26
bhagyashrisrlandy|rover, ack12:26
rlandy|rovercan we hold promotions until we fix those?12:26
rlandy|roverie: not remove from criteria12:27
rlandy|roverjust updating queen criteria12:27
bhagyashrisrlandy|rover, yes we can. just my plan was to test manifest_push and for that i need the promoted hash12:27
weshay|ruckbhagyashris, we could also create a test namespace in docker.io12:30
weshay|ruckand only enable the container push12:30
weshay|ruckso you can promote at will12:30
weshay|ruckbhagyashris, akahat that seems like the best way to unblock u12:30
bhagyashrisweshay|ruck, yes that we can do,12:31
weshay|ruckbhagyashris, akahat what would you like the namespace to be called12:31
bhagyashrisweshay|ruck, tripleomastermanifest :) it's too long :(12:31
rlandy|roverdoes someone want o check my queens edits on the criteria file? before I save and close out12:32
*** jpena|lunch is now known as jpena12:32
ysandeeprlandy|rover, fyi.. i got some progress with content-provider for downstream.. just facing an issues with one non-tripleo container.. push to local registry is having issues.. https://sf.hosted.upshift.rdu2.redhat.com/logs/88/232088/11/check/tripleo-ci-rhel-8-content-provider-rhos-16.2/9ea0d2e/job-output.txt12:33
weshay|ruckrlandy|rover, should just be the two jobs :) no worries12:33
ysandeeprlandy|rover, facing same issue locally.. http://pastebin.test.redhat.com/957601 may be issue with that container12:33
rlandy|roverweshay|ruck: and container builds?12:33
rlandy|roveror we skip that12:33
rlandy|roverwe run three jobs12:33
weshay|ruckrlandy|rover, doesn't matter.. because the other two wont pass w/o it12:33
rlandy|roverok - two it is12:34
rlandy|roverdone - promoter restarted12:35
*** skramaja has quit IRC12:40
weshay|ruckrlandy|rover, marios /me looking at12:41
weshay|ruckhttps://releases.openstack.org/12:41
weshay|ruckQueens12:41
weshay|ruckExtended Maintenance (see note below)12:41
weshay|ruck2018-02-2812:41
weshay|ruckUnmaintained TBD12:41
rlandy|roverhmmm... didn't promote anything12:41
weshay|ruckUnmaintained12:41
weshay|ruck0 - 6 months12:41
weshay|ruckThe branch is under Extended Maintenance rules, but there are no maintainers.12:41
weshay|ruckso just FYI.. our commitment can remain VERY low12:42
rlandy|roverweshay|ruck; it's two jobs low at htis point12:42
weshay|ruckaye12:42
rlandy|roverwhich didn't even promote12:42
weshay|ruckrlandy|rover, well.. containers-multinode is a pretty good test12:42
rlandy|rovercan we rekick line?12:42
weshay|ruckI'll note osp-17 can't pass containers-multinode12:43
weshay|ruckrlandy|rover, ya12:43
rlandy|rovermaybe hashes were missed?12:43
rlandy|roverthanks12:43
rlandy|roverthen I will stop bothering with queens12:43
* rlandy|rover is a check list type person - things bother me until they come off the check list12:43
weshay|ruckcan we nuke the ovb jobs?12:44
weshay|rucktripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens-branch12:44
rlandy|roverweshay|ruck: yep - will take care of that after I look into master OVB failing12:46
rlandy|roverysandeep: sorry - will look after rover stuff12:46
rlandy|roverthanks for keeping this going12:46
chandankumarweshay|ruck: what about getting rid of the queens pipeline? since no updates are coming so?12:50
weshay|ruckchandankumar, if we have upstream voting jobs.. and we do12:50
weshay|ruckwe need the pipeline12:51
chandankumarweshay|ruck: yes, got it.12:52
rlandy|roverzbr: weshay|ruck: https://zuul.opendev.org/t/openstack/build/2595847f328041289b64a35ed6a1ebdf failing tox job because it's not running on stream ...12:53
rlandy|roverhttps://opendev.org/openstack/tripleo-ci/src/branch/master/zuul.d/base.yaml#L64612:53
rlandy|roverjobis defined here12:53
rlandy|roverchanging nodeset12:53
rlandy|roverFYI12:53
ysandeeprlandy|rover, nw.. not urgent at all, thanks!12:53
rlandy|roverparent: tox-molecule12:53
zbrrlandy|rover: i am working to fix those in artcl role now but TBH, that does not look as related to molecule itself.12:55
bhagyashrisweshay|ruck, could you please create namespace "tripleomastermanifest" on docker.io for me? Thank you :)12:55
zbrtripleo_repos.main.InvalidArguments: --stream provided, but OS is not the Stream version. Please ensure the host is Stream.[0m12:55
zbrif that is running inside a container, switching container to quay.io/centos/centos:stream8 should work.12:56
zbrand addressing the issue of using docker.io12:56
rlandy|roverzbr:localhost | Distro: CentOS 812:56
rlandy|roverLabel: centos-8-stream12:56
rlandy|roverah12:56
rlandy|roverzbr: the line that it is failing on was changes 6 weeks ago12:57
rlandy|rovermaybe the node did change12:58
rlandy|roverit's picking up stream from the node12:58
zbrthere is one problem related to used of centos-* images for testing, we need ones with python preinstalled almost in all cases, otherwise we waste a serious amount of time/networking installing python on them.12:58
* weshay|ruck in ansible ptg room12:59
rlandy|roverzbr: this started failing yesterday12:59
rlandy|roverit was passing until then12:59
rlandy|roverzbr: blocking a change we need to get in for scenrio00413:00
zbrweshay|ruck: do I need to join? send me link. i got lost in ptg webpages13:01
rlandy|roverzbr: will you fix help the tripleo tox job or do I need to try make an additional fix?13:02
weshay|ruckzbr, it's for the openstack ansible collection.. so don't think so13:02
zbrok, thanks. in that case i will try to help rlandy|rover13:03
rlandy|roverzbr++ thank you13:04
*** amoralej|lunch is now known as amoralej13:05
rlandy|rovermjturek: hi - sent you email wrt job triggering ... pls let us know if you want to make any changes there13:21
rlandy|roverugh - 16.2 image build mess13:26
rlandy|rover2021-04-21 13:00:44.133 | + /home/zuul/workspace/dib_build.EUV7F1nQ/hooks/extra-data.d/99-yum-repo-conf:main:19 :   echo 'You should assign a list of proper yum repo configuration'13:27
rlandy|rover2021-04-21 13:00:44.134 | You should assign a list of proper yum repo configuration13:27
rlandy|rover2021-04-21 13:00:44.137 | + /home/zuul/workspace/dib_build.EUV7F1nQ/hooks/extra-data.d/99-yum-repo-conf:main:20 :   echo 'files in DIB_YUM_REPO_CONF.'13:27
rlandy|rover2021-04-21 13:00:44.137 | files in DIB_YUM_REPO_CONF.13:27
rlandy|rover2021-04-21 13:00:44.140 | + /home/zuul/workspace/dib_build.EUV7F1nQ/hooks/extra-data.d/99-yum-repo-conf:main:21 :   exit 113:27
rlandy|roverysandeep: ^^ did we merge the node change for 8.4?13:28
rlandy|rover16.s is blog red13:29
rlandy|roverblood red13:30
rlandy|roverhttp://git.app.eng.bos.redhat.com/git/openstack/sf-config.git/commit/ yep13:31
weshay|rucksshnaidm, if you have an email from paulb re: support can you forward so I can check it out13:32
rlandy|roveretc/yum.repos.d/redhat.repo is not a valid yum repo configuration file.'13:37
rlandy|rover2021-04-21 09:12:30.545500 | primary | ERROR: Could not find a version that satisfies the requirement osc-lib>=2.3.0 (from tripleo-validations)13:38
rlandy|rover2021-04-21 09:12:30.545549 | primary | ERROR: No matching distribution found for osc-lib>=2.3.013:38
* rlandy|rover fixes image builds13:38
ysandeeprlandy|rover, sry was focusing on ptg, yes we merged new rhel-guest-image yesterday13:39
ysandeeprlandy|rover, what broke.. checking..13:40
rlandy|roverysandeep: fixing image builds13:40
rlandy|roverredhat.repo13:40
ysandeeprlandy++ thanks!13:43
zbrrlandy|rover: i managed to publish a prebuild stream8 image on https://quay.io/repository/pycontribs/centos?tab=tags now doing the same for centos713:43
rlandy|rovernice13:44
zbrdone, with c7 too.13:45
zbrnote the naming difference, is because is matching the source repo from https://quay.io/repository/centos/centos?tab=tags13:46
zbrbut images with python are 350mb instead of 70mb13:46
zbrstill, downloading fat image is much faster than installing deps manually on each test13:47
rlandy|roverysandeep: https://code.engineering.redhat.com/gerrit/237441 - if that works, we will have to update the env/config files as well13:49
ysandeeprlandy|rover, ++ thanks!13:51
rlandy|roverysandeep: one more ... 2021-04-21 09:49:48.460668 | primary | INFO: pip is looking at multiple versions of ansible-collections-openstack-cloud to determine which version is compatible with other requirements. This could take a while.13:52
rlandy|rover2021-04-21 09:49:48.460673 | primary | ERROR: Could not find a version that satisfies the requirement osc-lib>=2.3.0 (from tripleo-validations)13:52
rlandy|rover2021-04-21 09:49:48.460678 | primary | ERROR: No matching distribution found for osc-lib>=2.3.013:52
rlandy|rovermy be unrelated to image13:52
rlandy|roverlogging that13:52
jbadiapacould someone give me a hand? I'm trying to create a job tripleo-ansible-centos-8-stream-base for tripleo-ansible@stable/train at https://review.opendev.org/c/openstack/tripleo-ansible/+/78640814:07
jbadiapabut I'm getting the error at "RDO Third Party CI" saying 'The nodeset "centos-8-stream" was not found.'14:07
jbadiapaI dont reall know how to continue TBH14:08
jbadiapaThe point is that the rest of the gate seems to be ok, https://zuul.openstack.org/status/change/786408,1214:10
* zbr thinks that the new github badged made most of us rocket believe we are rocket scientists...14:10
rlandy|roverjbadiapa: we switched all centos-8 nodes to be stream by default14:10
rlandy|roverso we have ...14:11
zbrjbadiapa: remove the stream part, everything is stream now.14:11
weshay|ruckI AM STREAM14:11
rlandy|roverhttps://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/nodesets.yaml14:11
rlandy|rovernote the labels there14:12
rlandy|roveryou should be fine w/o specifying stream14:12
rlandy|roverif you absolutely need the nodeset, we could add it back - but you should not14:13
zbrrlandy|rover: https://review.opendev.org/c/openstack/tripleo-ci/+/787372 -- fixed, already passed on zuul (check)14:13
jbadiapait's not needed, everything boils down to the --stream anoying flag14:13
zbrbut the f... content provider job is running even if it was not supposed to.14:14
zbrkopecmartin: can you copy/pasta from https://review.opendev.org/c/openstack/tripleo-ci/+/787372/1/roles/tripleo-repos/molecule/default/molecule.yml to fix the problem you had earlier?14:14
ysandeeprlandy|rover, ipa worked :)14:15
zbrshortly switching from outdated centos8 image from docker, to a stream pre-build image from quay.14:15
rlandy|rovernice14:16
*** saneax has quit IRC14:16
rlandy|roverwill rebase my job on yours14:16
jbadiapazbr, thanks14:20
rlandy|roverysandeep: pls vote on https://code.engineering.redhat.com/gerrit/#/c/237441/14:26
kopecmartinzbr:14:29
kopecmartintesting that14:29
rlandy|roverweshay|ruck: ysandeep: ok .. two patches ... https://code.engineering.redhat.com/gerrit/#/c/237441/ https://code.engineering.redhat.com/gerrit/#/c/237454/14:31
rlandy|roverweshay|ruck: ysandeep: CIX logged for https://bugzilla.redhat.com/show_bug.cgi?id=195211314:31
openstackbugzilla.redhat.com bug 1952113 in distribution "[RHOS16.2 RHEL 8.4] No matching distribution found for osc-lib>=2.3.0" [Unspecified,New] - Assigned to rhos-maint14:31
rlandy|rovermaybe on us14:31
rlandy|roverwill go back to it after OVB master14:31
weshay|ruckanbanerj|ruck, have you been able to get the merged sova queries into http://38.102.83.141/14:37
weshay|ruckanbanerj|ruck, what does private bug mean btw?14:38
chandankumarrlandy|rover: anbanerj|ruck just wanted to check does all sc10 are passing now?14:40
rlandy|roverI think that was a made up query - no bug?14:40
chandankumarexcept kvm one14:40
rlandy|roverchandankumar: checking14:40
rlandy|roverchandankumar: ack - minus the kvm one14:42
chandankumarrlandy|rover: cool14:42
jbadiapazbr, I guess that the stream image is not being used on the tests yet? as I got the "tripleo_repos.main.InvalidArguments: --stream provided, but OS is not the Stream version" error on the test14:42
anbanerj|ruckweshay|ruck, three of sova queries are on health dashboard now. The queries are being taken from here "/home/centos/queries" now (on .141 vm). I think private bug is because I didn't add the bug id or url in the yaml, not sure, checking it14:42
rlandy|roverperiodic-tripleo-ci-centos-8-scenario010-ovn-provider-standalone-ussuri14:44
rlandy|roverfailed14:44
chandankumarrlandy|rover: ussuri might be failing on standalone installation14:44
rlandy|rovermaybe once off14:44
rlandy|roverok14:44
rlandy|roverchandankumar: let's assume we're good for now14:44
rlandy|roverwill ping if not14:44
chandankumarrlandy|rover: sure14:44
chandankumarrlandy|rover: weshay|ruck https://review.rdoproject.org/r/c/rdo-jobs/+/33063 please merge this14:45
rlandy|roverdone14:47
weshay|ruckamoralej, it's hard for me to tell what queries are getting pulled over from sova14:50
rlandy|rover:) .. think that was for anbanerj|ruck: ^^14:50
amoralejweshay|ruck, was ^ for me?14:50
amoralejah, :)14:50
rlandy|roveramoralej: you're off the hook this time :)14:51
anbanerj|ruckweshay|ruck, trying to fix the unknown private bug thingy, lets have a call if that gets fixed14:54
*** dsneddon has quit IRC15:01
rlandy|roverzbr: rebased https://review.opendev.org/c/openstack/tripleo-ci/+/785254 on your job - thanks15:04
*** saneax has joined #oooq15:05
zbrrlandy|rover: kopecmartin had a similar issue this morning on another repo, i am updating his fix now to use the newer image.15:05
rlandy|roverk15:05
zbrtomorrow i will setup a pipeline to keep the image updated, that one was done manually because YOLO15:06
rlandy|rovergreat15:08
weshay|ruckfolks as you have time.. please poke at my centos-stream-9 etherpad for https://etherpad.opendev.org/p/centos-stream-9-upstream15:10
zbrweshay|ruck: basically artcl is blocked because infrared molecule scenario is failing, unrelated to us.15:13
zbrinfrared no longer works on centos715:13
weshay|ruckreally?15:21
weshay|ruckkopecmartin, ^15:21
kopecmartininfrared doesn't support py2 anymore , it's not that much related to centos7 as to the fact that py2 is used to install infrared15:22
weshay|ruckwhy is the job running w/ py215:23
rlandy|roverhttps://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset002-master/3e34109/job-output.txt15:23
rlandy|roverweirs - no real failure here15:24
kopecmartinweshay|ruck: my guess was that py2 is somehow default in the centos7 (or more specifically in the image used) and therefore the ansible task (pip module) chooses py215:24
rlandy|rover2021-04-20 12:26:15.131966 | primary | /usr/lib/python3.6/site-packages/barbicanclient/__init__.py:61: UserWarning: The secrets module is moved to barbicanclient/v1 directory, direct import of barbicanclient.secrets will be deprecated. Please import barbicanclient.v1.secrets instead.15:25
weshay|ruckzbr, why is the job running w/ c7 vs.. c8?15:25
zbrthat the way it was written to collect logs from a single container, can easily be made to run with both in parallel (same job)15:26
zbrhint: is not about the nodeset, is about the test container15:26
weshay|ruckk.. lets get it moved to a c8 container15:26
zbrwe already have a change that does this, hopefully it will pass.15:27
rlandy|roverok - we definitely have a fs002 problem15:28
rlandy|roverlogging15:28
kopecmartinweshay|ruck: zbr this passed molecule job (let me just fix linters ...) https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/78646215:28
rlandy|roverbhagyashris: ^^ fyi - fs002 is a real issue15:29
rlandy|roverlooking into it15:29
rlandy|roverimpacting wallaby as well15:29
bhagyashrisrlandy|rover, ack15:29
zbrkopecmartin: wait, i will fix it the right way (i need to remove the yamllint)15:30
kopecmartinzbr: ok15:30
zbransible-lint does include yamllint now and with a smarter config that does not generate errors like that15:30
zbr comment not indented like content (comments-indentation) is stupid rule, but yamllint maintainer is very stubborn in his views.15:31
*** dviroel is now known as dviroel|lunch15:34
zbrkopecmartin: weshay|ruck: not sure which editors you are using but the ones I know do add comments like this, not like yamllint expects them to be, so you can user shortcuts to comment/uncoment.15:35
zbransible-lint does use a tuned default yamllint config that does not produce errors like kopecmartin observed.15:36
zbrweshay|ruck: rlandy|rover kopecmartin: please review and +W 786462 -- while zuul did not report yet, it already passed the jobs we care about.15:49
rlandy|roverdone15:51
zbri will go offline now, hoping that tomorrow i will be able to help anbanerj|ruck on queries change.15:52
anbanerj|ruckzbr, In the patch urls is missing, I'll update that now and send you the patch for review  for tomorrow if it passes15:53
rlandy|roversshnaidm: hey ... https://bugs.launchpad.net/tripleo/+bug/1925367 stack delete fail - any idea why fs002 is different in this regard?15:54
openstackLaunchpad bug 1925367 in tripleo "Master/Wallaby: Failure deleting stack in fs002 - "One or more ports have an IP allocation from this subnet." [Critical,Triaged]15:54
sshnaidmrlandy|rover, 002 jobs is only one that deletes overcloud stack16:00
sshnaidmrlandy|rover, if it fails - something is broken in overcloud deletion16:01
sshnaidmrlandy|rover, probably os_tempest had some leftovers that block stack deletion16:02
*** dsneddon has joined #oooq16:05
*** dsneddon has quit IRC16:06
rlandy|roversshnaidm: ah ok - so there is a main difference16:07
weshay|ruckysandeep, is the tenant cleanup script deployment for vex and internal?16:11
ysandeepweshay|ruck, yes..16:11
weshay|ruckk cool16:11
ysandeepweshay|ruck, I was running script so far in internal.. noticed a corner case.. Will add that soon..16:13
weshay|ruckysandeep, k.. cool let's review this stuff next week :)16:13
*** saneax has quit IRC16:16
*** jmasud has joined #oooq16:18
sshnaidmso we have --stream as default now in tripleo-repos?16:19
rlandy|roverweshay|ruck: bhagyashris: we have a problem with queens promotion16:19
rlandy|rover2021-04-21 15:37:56,119 20512 ERROR    promoter Qcow promote 'commit: 3e818718b67ef8c9f23f2673e35df9fc6a6b65a5, distro: 5fce6f98d3d099915f6a32acb3b103de60d42e7e, component: None, timestamp: 1619009409' to current-tripleo: images dir for hash commit: 3e818718b67ef8c9f23f2673e35df9fc6a6b65a5, distro: 5fce6f98d3d099915f6a32acb3b103de60d42e7e, component: None, timestamp: 1619009409 not present or not accessible16:20
rlandy|rover2021-04-21 15:37:56,120 20512 ERROR    promoter [Errno 2] No such file16:20
rlandy|rover^^ correct16:20
rlandy|roverwe no longer run fs00216:20
rlandy|roverthere are no images16:20
rlandy|roverremove the qcow client??16:20
rlandy|roverfrom the queens promoter config16:20
weshay|ruckah.. ya.. turn off the module for overcloud images16:20
rlandy|roverok16:21
weshay|ruckand we'll have to ask bhagyashris and akahat to move that variable to the release16:21
weshay|ruckor let the release files override16:21
* rlandy|rover though it was per release16:21
weshay|ruckno.. it's currently global16:21
weshay|ruckin default16:21
weshay|ruckyou know where?16:21
weshay|ruckor want me to jump on16:21
chandankumarweshay|ruck: rlandy|rover marios ysandeep I will be on pto from tomorrow till monday.16:21
rlandy|roverlet me check16:22
rlandy|roverchandankumar: k - enjoy16:22
weshay|ruckchandankumar, FINE.. just leave us then :P16:22
ysandeepchandankumar, o/ enjoy your PTO16:22
chandankumarthanks :-)16:22
*** chandankumar is now known as raukadah16:22
bhagyashrisweshay|ruck, ack16:22
rlandy|roverbhagyashris: weshay|ruck: in order not to mess with train ...16:23
rlandy|rovermaybe we remove the qcow client16:23
rlandy|roverjust enable queens16:23
rlandy|roverand then re-enable16:23
bhagyashrisyes16:23
* rlandy|rover stops the promoter service to investidate16:23
bhagyashrisrlandy|rover, you want to remove the qcow client ?16:25
rlandy|roverbhagyashris: yes16:25
rlandy|roverqueens no longer promotes imahes16:25
rlandy|roverimages16:25
bhagyashrisshould i point out16:25
rlandy|roverbut we need to override it per release16:25
rlandy|rovertrain still needs it16:25
rlandy|roverbhagyashris: ok - now let's change to just run queens relesae16:26
bhagyashrisrlandy|rover, ok16:26
rlandy|roverbhagyashris:after promotion - will reverse both16:27
bhagyashrisrlandy|rover, ack16:27
bhagyashrisrlandy|rover, wait16:27
bhagyashriswill need space16:27
rlandy|roverk16:27
rlandy|roverholding16:27
bhagyashrisgo head16:28
bhagyashrisrlandy|rover, ^16:28
rlandy|roverbhagyashris: k- restarting promoter service16:28
bhagyashrisrlandy|rover, that's it now will restart16:28
bhagyashrisyes16:28
rlandy|roverbhagyashris: k- go ahead16:28
bhagyashrisDone16:29
rlandy|roverok  -let's  see16:29
rlandy|roverwill revert both afterwards16:29
bhagyashrisok16:30
*** dviroel|lunch is now known as dviroel16:30
*** amoralej is now known as amoralej|off16:51
weshay|ruckrlandy|rover, fyi.. infra just took out all our centos-7 jobs16:56
*** ysandeep is now known as ysandeep|away16:57
*** marios is now known as marios|out16:57
* rlandy|rover looks16:59
rlandy|rover2021-04-21 07:53:54.322088 | primary | ERROR16:59
rlandy|rover2021-04-21 07:53:54.322563 | primary | {16:59
rlandy|rover2021-04-21 07:53:54.322897 | primary |   "msg": "dict2items requires a dictionary, got <class 'ansible.template.AnsibleUndefined'> instead."16:59
rlandy|rover2021-04-21 07:53:54.323026 | primary | }16:59
rlandy|rover2021-04-21 07:53:54.323119 | primary | ERROR: Ignoring Errors16:59
rlandy|roverweshay|ruck: ^^ that thing16:59
weshay|ruckno16:59
weshay|ruckhttps://bugs.launchpad.net/tripleo/+bug/192537216:59
openstackLaunchpad bug 1925372 in tripleo "centos-7 content provider failing to install and start docker" [Critical,Triaged]16:59
rlandy|roverk - I see it17:01
*** jpena is now known as jpena|off17:03
rlandy|roverweshay|ruck: you proposing a revert?17:03
weshay|ruckha.. would never happen17:03
weshay|ruckIMHO17:03
weshay|rucktalking in rhos-ops17:03
rlandy|rover2021-04-21 17:05:43,704 4799 INFO     promoter Summary: Promoted 1 hashes this round17:09
rlandy|rover2021-04-21 17:05:43,704 4799 INFO     promoter ------- -------- Promoter terminated normally17:09
rlandy|rover2021-04-21 17:05:34,509 4799 INFO     promoter Dlrn promote 'commit: 3e818718b67ef8c9f23f2673e35df9fc6a6b65a5, distro: 5fce6f98d3d099915f6a32acb3b103de60d42e7e, component: None, timestamp: 1619009409' from tripleo-ci-testing to current-tripleo: (subhash commit: 8c6af33cde0ec3dbc51ee43f3e66c979247e0106, distro: 5fce6f98d3d099915f6a32acb3b103de60d42e7e, component: None, timestamp: None) Successfully promoted17:13
rlandy|roverbhagyashris: ^^ moving promoter settings back17:14
rlandy|roverrestarted promoter17:15
*** udesale has quit IRC17:17
*** jpodivin has quit IRC17:19
sshnaidmrlandy|rover, what is nodeset for centos8 stream in upstream - centos-8-stream ?17:19
rlandy|roversshnaidm: https://github.com/openstack/tripleo-ci/commit/3457e53ebda286f8174a43d7617e312072aaeefb - all centos-8 should be stream17:20
sshnaidmyeah, so it's centos-8-stream17:21
*** marios|out has quit IRC17:21
rlandy|roversshnaidm: yeah - but regular centos-8 nodes should get you stream anyways17:23
*** jmasud has quit IRC17:54
*** chem has quit IRC18:20
*** dsneddon has joined #oooq18:21
*** jfrancoa has quit IRC18:50
anbanerj|ruckweshay|ruck, rlandy|rover, zbr - https://review.opendev.org/c/openstack/tripleo-ci-health-queries/+/786656 . Pls lemme know what you think when you have some time.19:44
anbanerj|ruck^ this is the converter. Users will update only queries.yml (and run the converters to convert to sova and er and push the changes - like in rrcockpit). As a next step we will update collect-logs and elastic-recheck repos to read their input files from this repo (from tripleo-ci-health and not from their own folders)19:47
rlandy|rovercool19:47
rlandy|roverthanks19:47
anbanerj|ruckTill that is done to see graphs of an error pls update directly in queries dir of .141 vm. If you name the .yml after a bug ER will display details of the bug, else it will say Private bug19:49
rlandy|roverarxcruz: http://download.cirros-cloud.net/0.4.0/cirros-0.4.0-x86_64-disk.img20:00
rlandy|rover^^ is that the right image -or we don't care?20:01
*** derekh has quit IRC20:27
*** jfrancoa has joined #oooq20:40
*** jfrancoa has quit IRC20:40
*** slaweq has quit IRC20:46
*** jfrancoa has joined #oooq20:48
*** jfrancoa has quit IRC20:49
rlandy|roverarxcruz: hey ... you around?20:55
rlandy|roverknow it's late20:55
*** ksambor has quit IRC22:01
*** jmasud has joined #oooq22:05
*** jmasud has quit IRC22:13
*** jmasud has joined #oooq22:24
*** rlandy|rover is now known as rlandy|rover|bbl22:24
*** jmasud has quit IRC22:35
*** jmasud has joined #oooq22:40
*** jmasud has quit IRC22:53
*** jmasud has joined #oooq22:58
*** jmasud has quit IRC23:05
*** jmasud has joined #oooq23:07
*** jmasud has quit IRC23:12
*** jmasud has joined #oooq23:23
*** jmasud has quit IRC23:32
*** tosky has quit IRC23:42
« Tuesday, 2021-04-20 Index Thursday, 2021-04-22 »

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!