Thursday, 2021-08-19

« Wednesday, 2021-08-18 Index Friday, 2021-08-20 »
*** pojadhav- is now known as pojadhav04:42
*** ysandeep|away is now known as ysandeep05:06
*** jpodivin_ is now known as jpodivin05:24
*** pojadhav- is now known as pojadhav07:05
*** jpena|off is now known as jpena07:35
chandankumarI will be away for 2 hours, need to visit government office08:16
pojadhavchandankumar, ack08:19
*** pojadhav is now known as pojadhav|lunch09:01
*** arxcruz is now known as arxcruz|off09:05
zbrunless you want to get stuck with docker forever, i will need some support on https://review.opendev.org/c/zuul/zuul-jobs/+/803471 - to enable podman for molecule jobs.10:35
*** dviroel|ruck|out is now known as dviroel|ruck11:08
ysandeeppojadhav, around?11:12
pojadhavysandeep, yes11:12
ysandeepI was about to open a internal bugzilla, thought you might be interested meet.google.com/mim-smov-mgx 11:13
pojadhavjoining11:13
ysandeeppojadhav, https://bugzilla.redhat.com/show_bug.cgi?id=199554111:20
bhagyashrisdviroel|ruck, hi Good morning !11:23
dviroel|ruckhi bhagyashris 11:24
bhagyashristanks for your review. i have address your review comments https://review.rdoproject.org/r/c/config/+/34709 plz have a look when you have free time 11:25
*** jpena is now known as jpena|lunch11:31
bhagyashrisdviroel|ruck, until and unless we don't merge the config patch ^ we can't hit testproject patch :(11:34
bhagyashrisi will take care to merge this patch as soon as possible 11:34
dviroel|ruckoh, so we need to merge without knowing that will work?11:35
ysandeepdviroel|ruck, you can define same job in testproject patch itself.. 11:37
bhagyashrisyeah may be or we can also do one thing like keep the base job in config this one https://review.rdoproject.org/r/c/config/+/34709/5/zuul.d/tripleo-rdo-base.yaml and move the job def https://review.rdoproject.org/r/c/config/+/34709/5/zuul.d/tripleoci.yaml into the rdo-jobs 11:38
bhagyashrisysandeep, but in that case also we will need to merge the base job first right ? base job def is in config11:39
bhagyashrishere : https://review.rdoproject.org/r/c/config/+/34709/5/zuul.d/tripleo-rdo-base.yaml11:40
ysandeepbhagyashris, for testing only you have define both your base job tripleo-ci-compose-promote-base and  periodic-tripleo-centos-8-promote-latest-compose in testproject itself11:40
bhagyashrisysandeep, okay 11:41
bhagyashrislet me try that 11:41
dviroel|ruck++11:41
dviroel|ruckbut you will not have access to the secret there, right?11:42
bhagyashrisdviroel|ruck, yeah exactly11:42
dviroel|ruckdo you know if this is going to work https://review.rdoproject.org/r/c/config/+/34709/5/zuul.d/tripleo-rdo-base.yaml#574 ?11:43
*** rlandy is now known as rlandy|rover11:44
bhagyashrisdviroel|ruck, i think it should because we have define the required-projects there https://review.rdoproject.org/r/c/config/+/34709/5/zuul.d/tripleo-rdo-base.yaml#57511:44
ysandeepbhagyashris, dviroel|ruck it might not work because of secrets(but you can try in testproject), you are just adding job definition.. i don't see any harm if you wish to merge the patch and iterate over it if any issues11:46
dviroel|ruckyeah11:46
rlandy|roverdviroel|ruck: hey - how are things?11:46
dviroel|ruckrlandy|rover: hi, train promoted11:47
dviroel|ruckrlandy|rover: still waiting fmount patch merge to fix wallaby11:47
rlandy|roverdviroel|ruck: great - I edited the criteria11:47
dviroel|ruckwas already rechecked11:47
rlandy|roverput back all the ovb jobs11:47
rlandy|rovertook out fake one11:47
dviroel|ruckgreat :)11:48
ysandeepkopecmartin, soniya29 chandankumar appreciate your pointers on https://bugzilla.redhat.com/show_bug.cgi?id=1995541 11:48
dviroel|ruckrlandy|rover: victoria has ovbs failing, single failure so far11:48
rlandy|roverdviroel|ruck: testproject rerun?11:48
rlandy|roveror more consistent?11:49
rlandy|roverysandeep: hello!11:49
dviroel|ruckrlandy|rover: yeah, we need to rerun to see the outputs11:49
rlandy|roverysandeep: how do you feel about replacing baremetal with ovb on 16.2 as well11:49
dviroel|ruckrlandy|rover: will do11:49
rlandy|roveruntil we sort all BM out11:50
rlandy|roverpatch there 11:50
ysandeeprlandy|rover: fine by me, i saw tempest timing out on bm, i already merged that patch11:50
dviroel|ruckbhagyashris: add a comment in the config patch11:50
bhagyashrisdviroel|ruck, ok checking 11:51
ysandeeprlandy|rover, we will need some help from tempest folks to debug https://bugzilla.redhat.com/show_bug.cgi?id=1995541 11:51
rlandy|roverysandeep: ack - I noticed you logged that bug on 1711:52
rlandy|roverand then the updated network component fixed it11:53
ysandeeprlandy|rover, yeah seems similiar 11:53
rlandy|roverI assume you already pinged kopecmartin?11:53
rlandy|roverand friends11:53
ysandeepyeah, just pinged few mins back.. lets wait 11:54
kopecmartinysandeep: rlandy|rover, hmm, again? we have dealt with that already , a few months back .. when i think about it maybe it was an upstream package back then and now it's hitting downstream? 11:56
rlandy|roverkopecmartin: different release11:56
rlandy|rover16.2 this time11:56
ysandeepkopecmartin, that was earlier in 17 and now in 16.2 (both downstream - upstream train seems working)11:56
rlandy|roverdviroel|ruck: on wallaby, we are still sitting on the fs035 backport11:57
chandankumarysandeep: kopecmartin https://github.com/openstack/neutron-tempest-plugin/commit/dd96e9a6aeffd2181ad70248aab0dc02403fe2c411:57
rlandy|roverneed to follow that up11:57
rlandy|rovergetting11:57
chandankumaris in 1.4.011:58
chandankumarbut in rdoinfo train https://github.com/redhat-openstack/rdoinfo/blob/master/tags/train.yml#L42311:58
chandankumarsource-branch: 0.9.011:58
dviroel|ruckrlandy|rover: ack11:58
chandankumarkopecmartin: ysandeep we might need to cherry pick that commit to neutron tempest plugin dist-git downstream http://pkgs.devel.redhat.com/cgit/rpms/python-neutron-tests-tempest/tree/?h=rhos-16.2-rhel-8-trunk12:00
chandankumarit is missing from here12:00
ysandeepchandankumar, https://github.com/redhat-openstack/rdoinfo/blob/master/tags/train.yml#L423 was merged in decemeber12:01
ysandeepbut failure started recently: https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/builds?job_name=periodic-tripleo-ci-rhel-8-standalone-full-tempest-scenario-tempest-rhos-16.2 12:01
ysandeepstarted from 04th aug12:01
chandankumarkopecmartin: Did we recently bumped the tempest version downstream for rhos-16.2?12:02
chandankumarto 26.1.012:02
kopecmartinchandankumar: we did that on RDO side in May .. so not recently .. but maybe downstream pulled the changes from RDO only now?12:04
kopecmartinchandankumar: https://review.rdoproject.org/r/c/rdoinfo/+/3342012:04
chandankumarpassed one https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-component-tempest/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-standalone-full-tempest-scenario-tempest-rhos-16.2/3095a8b/logs/undercloud/var/log/extra/rpm-list.txt and failed one12:06
chandankumarhttps://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-component-tempest/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-standalone-full-tempest-scenario-tempest-rhos-16.2/9478234/logs/undercloud/var/log/extra/rpm-list.txt12:06
chandankumarBoth have same tempest and neutron tempest plugin12:06
chandankumarso May be something else is causing it12:06
soniya29ysandeep, yes, change was proposed long ago 12:09
ysandeepchandankumar, nvr of rpm is different 12:10
ysandeepopenstack-tempest-26.1.0-2.20210803204809.271f820.el8osttrunk.noarch vs openstack-tempest-26.1.0-2.20210729124810.271f820.el8osttrunk.noarch12:11
chandankumarkopecmartin: yes, it pull from the rbo and then rebase it with downstream12:14
chandankumar*RDO12:14
chandankumarysandeep: 271f820 - commit from tempest-26.1.012:15
chandankumarand we have backported two patches and then rebuilt downstream tempest on 04th http://pkgs.devel.redhat.com/cgit/rpms/openstack-tempest/log/?h=rhos-16.2-rhel-8-trunk12:16
chandankumarhttp://pkgs.devel.redhat.com/cgit/rpms/openstack-tempest/commit/?h=rhos-16.2-rhel-8-trunk&id=1ccebc936a562dcae3238e3a51263ddf6fdb495d12:17
chandankumarand on 3rd we merged this https://review.rdoproject.org/r/c/openstack/tempest-distgit/+/3481312:18
ysandeepyes.. upstream and downstream distgit changed when noticing dlrn hash: http://osp-trunk.hosted.upshift.rdu2.redhat.com/api-rhel8-osp16-2/api/report.html?package=openstack-tempest 12:22
chandankumarysandeep: on 3rd aug, all of a sudden few files got missing from DLRN12:23
chandankumarlet me pull the bug12:23
chandankumar*from tempest12:23
chandankumarkopecmartin: ysandeep https://bugzilla.redhat.com/show_bug.cgi?id=198662012:25
chandankumarafter this we made changes in RDO train tempest distgit then it started happening12:27
kopecmartinchandankumar: so let's patch neutron plugin in all releases so that it doesn't use deprecated manager anywhere 12:29
*** jpena|lunch is now known as jpena12:31
* ysandeep scratching brain on why only downstream is impacted not upstream train12:31
soniya29kopecmartin, lets patch means?12:32
chandankumarkopecmartin: do we want to take a look at tempest tarball https://brewweb.engineering.redhat.com/brew/buildinfo?buildID=1684847 12:32
bhagyashrisdviroel|ruck, i have replied yo your comment thanks for review https://review.rdoproject.org/r/c/config/+/34709/5/zuul.d/tripleo-rdo-base.yaml#57512:34
kopecmartinchandankumar: wait a second, the removal of the manager is reverted in the tempest's spec file - https://review.rdoproject.org/r/c/openstack/tempest-distgit/+/3346712:36
kopecmartinah, but downstream has a different spec 12:36
*** poojajadhav is now known as poojadhav12:39
*** poojadhav is now known as poojajadhav12:39
*** poojajadhav is now known as pojadhav12:40
dviroel|ruckbhagyashris: ok, i think that I already answered too :)12:40
dviroel|ruckbhagyashris: forget, just saw your new PS12:41
bhagyashrisyeah done 12:41
bhagyashristhanks12:41
bhagyashrisakahat, chandankumar rlandy|rover zbr dviroel|ruck scrum time13:01
chandankumarkopecmartin: so we lost that change13:01
chandankumarkopecmartin: may be we need add that back in downstream 13:01
kopecmartini don't understand how we could lost it, i'll finish what i'm doing right now and I'll dive deeper into that13:02
chandankumarkopecmartin: sure, now we know the issue13:03
chandankumarysandeep: May be we can change the component https://bugzilla.redhat.com/show_bug.cgi?id=1995541 to openstack-tempest.13:12
*** frenzy_friday is now known as erbot13:13
ysandeepchandankumar, done13:13
bhagyashrishttps://review.rdoproject.org/r/c/config/+/3470913:13
bhagyashrisrlandy|rover, ^13:13
*** erbot is now known as frenzy_friday13:15
toskychandankumar, ysandeep : given the last comment, that seems to be a neutron-tempest-plugin bug, not tempest13:15
toskyand there is a component for that13:15
bhagyashrishttps://review.opendev.org/c/opendev/elastic-recheck/+/803897/13:16
akahatReview request: https://review.opendev.org/q/topic:%22utilize-tripleo-operator%22+(status:open%20OR%20status:merged)13:17
bhagyashrishttps://review.opendev.org/q/topic:%22utilize-tripleo-operator%22+(status:open%20OR%20status:merged)13:17
rlandy|roverdviroel|ruck: fyi ... https://ci.centos.org/view/rdo/view/promotion-pipeline/ we need to recheck some of these jobs13:19
rlandy|roverwill show you how13:19
rlandy|roversee pvt - lots of instructions there13:24
akahatReview Request: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3499513:27
akahatReview Request: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3433413:27
chandankumartosky: after digging we found that https://review.rdoproject.org/r/c/openstack/tempest-distgit/+/33467 is missing from tempest downstream RHOS 16.2 distgit, So I was suggesting it to move it to tempest component13:32
zbrsshnaidm: https://review.opendev.org/c/zuul/zuul-jobs/+/80347113:38
zbrmigration from docker to podman will likely take 6mo or so, so we cannot remove docker, we need both.13:39
chandankumarsshnaidm: please have a look at this one https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/80497113:42
chandankumarit is a special case 13:42
chandankumarsshnaidm: more info is here: https://bugzilla.redhat.com/show_bug.cgi?id=199484813:43
rlandy|roverchandankumar: pojadhav: rechecking https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/80497113:46
rlandy|roverchandankumar: pojadhav: attila is asking when we can promote 1713:47
rlandy|roverso if this is the right fix, it would be good if we can move on it13:48
Tenguzbr: heya! would it be possible to get a "clear" view on the locales snafu in tox-py36 jobs? In order to know what is left to do and, maybe, try to pull some strings and push some levers...13:48
chandankumarrlandy|rover: yes, I am not basically not sure about putting freeipa_internal_ip as a conditional13:49
Tenguthough I'm not sure this is the right channel to talk about this issue -.-13:49
chandankumarrlandy|rover: https://code.engineering.redhat.com/gerrit/c/testproject/+/266024 and results https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/build/ce470b12d38543f59d629e375d468d5d13:49
rlandy|roversshnaidm: any idea of the approx eta on ansible 2.11 rpm?13:49
* rlandy|rover panicking already13:49
chandankumarrlandy|rover: we are good to go with rhos-1713:49
rlandy|roverchandankumar: awesome - thanks13:50
rlandy|roverchandankumar: I saw your comment though13:50
rlandy|roverdo you want that fixed first?13:50
zbrchandankumar: Tengu: https://review.opendev.org/q/topic:%22encodingfix%22+(status:open%20OR%20status:merged) should be enough13:51
chandankumarrlandy|rover: getting the fix would be good first if rhos-17 promotion is not urgent13:51
rlandy|roverchandankumar: simple fix - let's do it13:52
Tenguzbr: ok, so just pushing for those, and we're good? nice.13:52
rlandy|roverpojadhav: ^^ can you make that change? if not - will do it later13:52
chandankumarzbr: Tengu :-) hope it clears the mess.13:53
chandankumarzbr, Tengu thank you for working on this :-)13:53
zbri am really curious who added LC_ALL=C in the first place, that is a very weird decision to make as it would definetly break unicode sorting at best.13:53
zbrpossible even display13:54
Tengujust a matter of getting a couple more votes and we should be fine.13:54
Tenguzbr: no idea.... C is always a wrong value for locales imho13:54
Tengu..... we should even get a linter somewhere in order to track that down :)13:54
Tenguchandankumar: https://review.opendev.org/c/openstack/tripleo-ansible/+/805116 + https://review.opendev.org/c/openstack/tripleo-validations/+/805015  please? :)13:55
chandankumarTengu: zbr is super fast13:55
chandankumardone13:55
Tengu:))13:56
Tenguthanks!13:56
Tenguperfect. so we SHOULD be fine.13:56
* Tengu spots some fire in a corner13:56
* Tengu drinks some coffee13:56
Tenguit's allll fine.13:56
pojadhavrlandy|rover, fixing chandankumar's comment.13:57
pojadhavon that patch13:57
zbrsshnaidm: WDYT about https://github.com/ansible-community/molecule-podman/discussions/52#discussioncomment-1206232 - Should I tag 1.0.0 ? - if so add a comment there.13:57
ysandeeprlandy|rover, chandankumar mtg time14:01
rlandy|roverchandankumar: ping14:03
rlandy|roverwaiting for you14:03
pojadhavrlandy|rover, chandankumar, ysandeep : fixed chandan's comment on this patch https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/804971  and also updated testproject patch : https://code.engineering.redhat.com/gerrit/c/testproject/+/26602414:07
zbrchandankumar: why toci_gate_test.sh does not make use of qs install-deps.sh? I see it failed to find collection on https://review.rdoproject.org/zuul/build/4b0f2814c7084c6db0665778df8d976c - do you know where to fix it?14:07
* pojadhav brb14:23
ysandeeppojadhav, patch ^^ need more work, zuul is complaining - commented14:35
sshnaidmzbr, what are major changes to release it as 1.0.0?14:35
ysandeeprlandy|rover chandankumar: pojadhav had a green run yesterday on ipa job, imho.. lets not hold 17 promotion for ipa job. https://code.engineering.redhat.com/gerrit/c/testproject/+/26602414:35
pojadhavysandeep, fixing14:37
rlandy|roverysandeep: scenario010 failure14:38
rlandy|roveris that one thing holding it back14:38
rlandy|roverthe tempest failure seem sporadic14:38
rlandy|roverasked pojadhav to testproject rerun that14:38
rlandy|roverdviroel|ruck is watching for the wallaby fix for scenario010 14:39
rlandy|roverthat should also address 1714:39
rlandy|roverso if  that fix comes in today14:39
rlandy|roverand we can get it through the component line14:39
rlandy|roverto hit 1714:39
rlandy|roverwe can promote tomorrow14:39
rlandy|roverif by tomorrow we are still w/o that fix14:39
rlandy|roverlet's go ahes14:39
rlandy|roverahead14:40
ysandeeprlandy|rover, fs035 tempest is also failing.. let me take a look - https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-17/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset035-internal-rhos-17/c4135ad/logs/undercloud/var/log/tempest/stestr_results.html.gz 14:41
pojadhavysandeep, pls check https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/804971/5/roles/undercloud-setup/tasks/main.yml14:42
pojadhavrlandy|rover, ysandeep : testproject rerun for tempest-api-rhos17 https://code.engineering.redhat.com/gerrit/c/testproject/+/26649314:43
rlandy|roverysandeep: we have a bug for wallaby fs03514:43
rlandy|rovertiming out and failing14:44
rlandy|rovercould be the same14:44
ysandeeprlandy|rover, thanks checking if its the same14:44
ysandeeppojadhav: thanks will surely check in next review run14:45
rlandy|roverpojadhav: is it the same tempest test that fails?14:45
pojadhavrlandy|rover, looking in the same14:45
pojadhavwill update you in some time14:45
rlandy|rover++14:45
pojadhavrlandy|rover, yes same test is failing for all intermitent failures "tempest.api.compute.volumes.test_attach_volume_negative.AttachVolumeNegativeTest"14:48
pojadhavhttps://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-17/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-standalone-full-tempest-api-rhos-17/0b3ef51/logs/undercloud/var/log/tempest/stestr_results.html 14:48
pojadhavhttps://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-17/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-standalone-full-tempest-api-rhos-17/bf791f5/logs/undercloud/var/log/tempest/stestr_results.html14:48
pojadhavhttps://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-17/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-standalone-full-tempest-api-rhos-17/d20f8cc/logs/undercloud/var/log/tempest/stestr_results.html14:48
chandankumarrlandy|rover: ysandeep sorry I missed the meeting14:56
ysandeepchandankumar: no worries, rlandy|rover have plans to sync with you and arxcruz|off 14:57
chandankumarzbr: hello, install-deps is called as apart of here https://opendev.org/openstack/tripleo-ci/src/branch/master/roles/run-test/templates/toci_quickstart.sh.j2#L2815:01
rlandy|roverchandankumar: will ping you after df meeting15:01
rlandy|roverpojadhav; will look after meeting15:01
pojadhavrlandy|rover, sure15:02
chandankumarzbr: may be we should call collection installation here https://opendev.org/openstack/tripleo-quickstart/src/branch/master/quickstart.sh#L114 and https://opendev.org/openstack/tripleo-quickstart/src/branch/master/quickstart.sh#L48515:02
chandankumarrlandy|rover: may be let's sync tomorrow once arx is back?15:04
rlandy|roverchandankumar: ack15:09
* dviroel|ruck lunch - brb15:10
rlandy|roverakahat: you're probably EoD soon - will send an invite for tomorrow so we can sync on scenario01015:10
rlandy|roverysandeep: pojadhav; chandankumar: if this run on the integration line goes well, will promote 16.2 to try clear network component15:25
ysandeeprlandy|rover: sounds good!15:25
rlandy|roverthat should just leave tempest15:26
zbrchandankumar: i am afraid that we cannot do it so soon in qs.sh as we need ansible to be installed. That is why we install it at line 171 instead of 113. Still, i bet bootstrap() does not run at all on that job.15:26
zbrprobably we fail to call it with --bootstrap?15:27
akahatrlandy|rover, okay.. i'm still here if you need me. i'll work on marios comment on: https://review.opendev.org/c/openstack/tripleo-ci/+/80386715:28
rlandy|roverakahat: up to you15:28
rlandy|roverwe can meet now or tomorrow15:28
rlandy|roveras you wish15:28
akahatrlandy|rover, okay.. we can meet now.15:28
rlandy|roverakahat: https://meet.google.com/tab-qptp-mkm?pli=1&authuser=015:29
chandankumarzbr: https://opendev.org/openstack/tripleo-ci/src/branch/master/roles/run-test/templates/toci_quickstart.sh.j2#L3315:33
chandankumarzbr: bootstrap always run in the ci job15:34
zbrchandankumar: thanks you for pointing to the bug, look few lines above for QUICKSTART_PREPARE_CMD command which is missing bootstrap argument only, QUICKSTART_VENV_CMD has one.15:37
zbrbased on their name i am inclined to believe that maybe that could be the cause15:37
zbror we could move the collection installation to "install-deps" logic branch, if possible.15:38
zbraparently i have ~250GB of temp python files on disk :(15:39
*** jpena is now known as jpena|off15:41
rlandy|roverlunch - brb15:42
*** ysandeep is now known as ysandeep|away15:42
*** pojadhav is now known as pojadhav|out15:49
*** sshnaidm is now known as sshnaidm|afk16:09
dviroel|ruckrlandy|rover: https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset002-victoria17:20
dviroel|ruckhttps://logserver.rdoproject.org/83/34983/2/check/periodic-tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset002-victoria/7204d4e/logs/quickstart_install.log17:21
dviroel|ruckseems related with https://opendev.org/openstack/tripleo-quickstart-extras/commit/9172e8483a7cc7e184fe0018006902560120843f17:21
dviroel|ruckakahat ^17:22
dviroel|ruckhum, missing 'stack_name'17:23
akahatdviroel|ruck, looking17:23
dviroel|rucktks Amol17:36
weshay|ruckakahat, FYI.. fs002 is the only job that runs a delete17:39
weshay|ruckyou can use it to testproject :)17:39
akahatdviroel|ruck, hey.. i've posted patch: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/80526017:49
akahattestproject: https://review.rdoproject.org/r/c/testproject/+/3357517:49
akahatweshay|ruck, thanks :)17:49
dviroel|ruckthanks akahat17:49
akahatfolks imp patches for promoter, please review whenever you are free. https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/35008, https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3499517:59
akahathttps://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3433418:03
rlandy|roverdviroel|ruck: sorry meeting18:12
rlandy|roverlooks like you are sorted??18:12
dviroel|ruckrlandy|rover: np, akahat already propose a fix :)18:14
dviroel|rucklooking at this atm https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-ussuri18:14
dviroel|rucksame tempest test failing in both18:15
rlandy|roverchecking18:15
rlandy|roverdviroel|ruck: you can bug that, and add the test to the skiplist 18:16
rlandy|roverlet's check if there is not entry already18:16
rlandy|roverhttps://opendev.org/openstack/openstack-tempest-skiplist/src/branch/master/roles/validate-tempest/vars/tempest_skip.yml18:17
rlandy|roverok - I don;t see anything there18:17
rlandy|roverDetails: {'type': 'IpAddressAlreadyAllocated', 'message': 'IP address 10.0.0.151 already allocated in subnet 920a15e8-9bf5-404d-b518-e0b6c6f12c7e', 'detail': ''}18:18
rlandy|roverlet me see if the cloud needs a clean up 18:18
rlandy|roversec18:18
rlandy|roverdviroel|ruck: side question - we're still waiting on the scenario010 wallaby fix?18:18
rlandy|roveror is that in?18:19
dviroel|ruckno, we are still eaiting18:19
dviroel|ruckhttps://review.opendev.org/c/openstack/tripleo-heat-templates/+/80503418:19
dviroel|ruckthere was a new PS today18:19
dviroel|ruckscenario010 failed in tempest this time, not sure if is related18:19
dviroel|ruckthe previos PS has both green18:20
rlandy|roverdviroel|ruck: cloud looks ok18:23
rlandy|roverno stacks older than 3.5 hours18:23
rlandy|roverdviroel|ruck: I'd run one more testproject on featureset020-ussuri18:25
rlandy|roverif it fails again18:25
dviroel|ruck+118:25
rlandy|rovercreate LP bug18:25
rlandy|roverand skip it18:25
dviroel|ruckack18:25
rlandy|roverdviroel|ruck: used the skiplist before?18:25
dviroel|ruckrlandy|rover: no, not yet18:25
rlandy|roverdviroel|ruck: ok ...18:26
dviroel|ruckrlandy|rover: ping you if I need help18:26
rlandy|roversimple18:26
rlandy|rovercreate bug18:26
rlandy|roverand then there is a tool to add an entry so you don't mess up format18:27
rlandy|roverbut manual is ok if needed18:27
dviroel|ruck^ didn't know about that18:27
* rlandy|rover will send link18:27
weshay|ruckrlandy|rover, dviroel|ruck ooff https://162e1dfe7f47964e5661-683a7552884dd9f6d3ce4d60ef3f3a04.ssl.cf1.rackcdn.com/805034/2/check/tripleo-ci-centos-8-scenario010-standalone/a3c584c/logs/undercloud/var/log/tempest/stestr_results.html18:27
rlandy|roverthat's why it's still non-voting18:28
weshay|ruckok18:28
dviroel|rucklol18:28
rlandy|roverhttps://opendev.org/openstack/openstack-tempest-skiplist18:28
rlandy|roverdviroel|ruck: ^^ see readme stuff18:28
weshay|ruckrlandy|rover, you want to skip all of that?18:29
rlandy|rover tempest-skip validate --file file.yaml18:29
rlandy|roverno18:29
rlandy|rovertalking about fs02018:29
rlandy|roveron ussuri18:29
weshay|ruckOH sorry18:29
rlandy|roverone failure18:29
dviroel|ruckhttps://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-ussuri/8fb38e9/logs/undercloud/var/log/tempest/stestr_results.html.gz18:29
dviroel|ruckthis one ^18:29
rlandy|roverit failed twice18:29
rlandy|rovercloud is not in a bad state18:29
rlandy|roverasked dviroel|ruck to testproject one more time18:30
rlandy|roverif we have a consistent failure18:30
rlandy|roverto bug and skip18:30
rlandy|roverdviroel|ruck: I find the validate part to be the most useful before submitting18:30
rlandy|roverto check for errors18:30
weshay|ruckya.. two hits in a row https://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-ussuri/75667d0/logs/undercloud/var/log/tempest/stestr_results.html.gz18:30
weshay|ruckappropriate to bug/skip/cix18:31
rlandy|rovertempest-skip --help18:31
rlandy|roveryou'll see options to add18:31
rlandy|rovermanual is ok as long as you validate18:31
weshay|ruckthree hits.. https://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-ussuri/02871d5/logs/undercloud/var/log/tempest/stestr_results.html.gz18:31
rlandy|roverthree times is the winner18:31
rlandy|roverthat is threshold break18:31
weshay|ruckrlandy|rover, well and let's check non-ovb job18:31
* weshay|ruck looks18:32
weshay|ruckrlandy|rover, passes here: https://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-standalone-full-tempest-scenario-ussuri/09cc1c2/logs/undercloud/var/log/tempest/stestr_results.html.gz18:32
weshay|ruckprobably want to note that.. on a single node.. works.. on multiple nodes fails18:33
weshay|ruckIP address 10.0.0.151 already allocated in subnet 920a15e8-9bf5-404d-b518-e0b6c6f12c7e seems like a legit tempest FAIL18:34
weshay|ruckassign to Network DFG18:34
weshay|ruckgive to arie :)18:34
rlandy|roverdviroel|ruck: ^^ arie bregman18:35
dviroel|ruckack18:35
dviroel|ruckcreating LP18:35
weshay|ruckwinner winner chicken dinner18:36
weshay|ruckrlandy|rover, we have one for migi and now one for arie18:40
weshay|rucklet's go find a storage bug18:40
weshay|ruckand get a hat trick18:41
rlandy|rovertake them all down18:42
weshay|ruckopenstack gangsta's18:47
rlandy|roverweshay|ruck: dviroel|ruck: https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/buildset/78adeb34c88e4ac09b1eecda001f89c218:54
rlandy|roverlooks good18:55
rlandy|roverrerunning multinode18:55
rlandy|roverand if passes will promote 16.218:55
rlandy|roverwhich will hopefully clear the network component18:55
rlandy|roverthen we will be following tempest and glance that have issues18:55
rlandy|roverthe rest should be clear on 16.218:55
dviroel|ruckhttps://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/80526719:13
* dviroel|ruck ☕19:13
rlandy|roverdviroel|ruck: looks good19:16
rlandy|roverthanks19:16
dviroel|ruck:)19:36
dviroel|ruckrlandy|rover: waiting results of https://review.rdoproject.org/zuul/status#33575 to merge https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/80526020:17
dviroel|ruckshould unblock fs002 jobs in these 3 branches20:17
rlandy|rovercool20:19
rlandy|roverperiodic-tripleo-ci-rhel-8-multinode-1ctlr-featureset010-rhos-16.2testprojectmastercheck195884,12820:19
rlandy|rover2 hrs 13 mins 0 secs2021-08-19 17:03:21SUCCESS20:19
rlandy|rovercleared20:19
rlandy|roverhttp://osp-trunk.hosted.upshift.rdu2.redhat.com/api-rhel8-osp16-2/api/civotes_agg_detail.html?ref_hash=d2969b63b0fbc4e17ec1cfb0f674b29220:20
rlandy|roverand QE tests cleared20:21
rlandy|roverpromoting20:21
dviroel|ruck\o/20:21
rlandy|roverBM needs work20:21
rlandy|roverbut ysandeep|away is on it20:22
rlandy|roverwe need to promote to clear network component - so here we go20:22
weshay|ruckoh now we have queue20:34
rlandy|rovergoing to rekick network line20:41
*** dviroel|ruck is now known as dviroel|ruck|out21:08
rlandy|roverweshay|ruck; hey21:11
rlandy|roverfor the centos compose id21:11
weshay|ruckaye21:11
rlandy|roverwe'ere qualifying per release, right? 21:11
rlandy|roverhttps://review.rdoproject.org/r/c/config/+/34709/6/zuul.d/tripleoci.yaml#321:12
rlandy|roverconfirming vars: master21:12
rlandy|roverie: we agreed we'd have a line that runs master jobs and then accept that for all master21:13
* weshay|ruck looks21:13
rlandy|roverif not, that does not make sense21:13
weshay|ruckya.. unfortunately.. I think per/release is the only way21:13
weshay|ruckthere will be overlap breakage often21:14
rlandy|roverok - then will merge this21:14
* rlandy|rover checking on what we agreed on21:14
weshay|ruckbut some times.. just a release.. crystal ball says.. sometimes.. 21:14
weshay|ruckgood to start per release though imho21:14
weshay|ruckand not assume it for all21:14
rlandy|roverwill merge and they can test tomorrow21:14
weshay|ruckmanaging different centos builds per release is tricky.. and we may want to chat that up21:14
weshay|ruck++21:14
rlandy|roverwow  - we almost made it to friday21:15
weshay|rucksrsly21:16
rlandy|roveralright - now the node for standalone21:16
weshay|ruckhttps://www.youtube.com/watch?v=sjZQ_AO5zGc21:16
weshay|ruckSchnider lolz21:17
rlandy|roverweshay|ruck: hey21:49
rlandy|roverlooking at infra-tripleo on vexx21:50
rlandy|roverwe're short on storage21:50
rlandy|roversee old-promoter storage21:50
rlandy|roveretc. can we get rid of those?21:50
« Wednesday, 2021-08-18 Index Friday, 2021-08-20 »

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!