Wednesday, 2021-04-07

*** tosky has quit IRC00:17
weshay|ruckchkumar|ruck, ok.. ur ovb patches re: container-tools got through00:57
weshay|ruckTakashi Kajinami is attacking the scenario001/002 issues00:57
*** jmasud has quit IRC01:40
*** rlandy|bbl has quit IRC01:41
*** jmasud has joined #oooq02:47
*** apetrich has quit IRC03:11
*** skramaja has joined #oooq03:26
chkumar|ruckweshay|ruck: https://review.opendev.org/c/openstack/tripleo-ci/+/785087 quick merge if around03:43
*** jmasud has quit IRC03:54
*** jmasud has joined #oooq03:59
*** ykarel has joined #oooq04:11
*** saneax has joined #oooq04:47
*** ratailor has joined #oooq04:48
*** jmasud has quit IRC04:52
*** jmasud has joined #oooq04:53
*** ysandeep|away is now known as ysandeep04:59
*** marios has joined #oooq05:09
*** udesale has joined #oooq05:17
*** jmasud has quit IRC05:28
*** saneax has quit IRC05:40
*** jpodivin has joined #oooq05:58
*** saneax has joined #oooq06:16
*** jmasud has joined #oooq06:17
*** ykarel_ has joined #oooq06:18
*** ykarel has quit IRC06:21
*** jbadiapa has joined #oooq06:25
*** ykarel_ is now known as ykarel06:32
*** slaweq has joined #oooq06:37
*** amoralej|off is now known as amoralej06:56
*** ratailor_ has joined #oooq07:24
*** ratailor has quit IRC07:27
*** jfrancoa has joined #oooq07:28
*** tosky has joined #oooq07:37
*** ratailor__ has joined #oooq07:38
*** jmasud has quit IRC07:39
*** jmasud has joined #oooq07:40
*** ratailor_ has quit IRC07:41
*** ykarel has quit IRC07:56
*** jpena|off is now known as jpena07:57
*** apetrich has joined #oooq08:16
*** ykarel has joined #oooq08:20
*** derekh has joined #oooq08:40
zbrchkumar|ruck: apparently people still love writing bash scripts w/o set -e08:51
zbri would really add a set -e to https://review.opendev.org/c/openstack/tripleo-ci/+/785087/1/roles/oooci-build-images/templates/build-images.sh.j208:52
chkumar|ruckzbr: added in the upcomign patchset08:55
zbri guess there is no need to explain why. the last part of the script should be updated too, no longer needing the exit.08:55
zbrchkumar|ruck: marios: maybe you can review this oneliner https://review.opendev.org/c/openstack/tripleo-quickstart/+/784970/1/install-deps.sh08:58
zbrignoring return codes, always a bad idea. we missed the sudo there.08:58
*** ratailor_ has joined #oooq09:03
*** ratailor__ has quit IRC09:06
chkumar|ruckzbr: commented09:06
*** jmasud has quit IRC09:13
*** derekh has quit IRC09:15
*** derekh has joined #oooq09:15
marioszbr: adding to list09:28
zbrchkumar|ruck: i updated it, fully rewrite to make it idempotent09:28
zbrif epel exists and disbled, enable it, run update after.09:28
zbrbit ugly, but that's bash09:29
zbrchkumar|ruck: was https://review.rdoproject.org/r/c/rdo-jobs/+/32967 needed for train promotion?09:31
*** ratailor__ has joined #oooq09:31
*** jfrancoa has quit IRC09:34
*** ratailor_ has quit IRC09:34
*** frenzy_friday has quit IRC09:38
*** frenzy_friday has joined #oooq09:39
chkumar|ruckzbr: nope09:43
*** ratailor has joined #oooq09:59
*** ratailor__ has quit IRC10:00
chkumar|ruckzbr: you might want to take a look at this https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_f53/784970/4/check/tripleo-ci-centos-8-content-provider/f53e406/job-output.txt10:02
chkumar|ruckgcc: fatal error: no input files10:02
zbrlol, where does this come from, it looks out of context10:04
zbri see rpm installs before, nothing else. and after that an error from git10:05
soniya29kopecmartin, weshay|ruck, Since akahat and arxcruz are not available and chkumar|ruck is busy with ruck/rovering, I think we can cancel the meeting. Do you have anything to discuss?10:12
arxcruzsoniya29: sure, we also have the retro today10:12
kopecmartinsoniya29: nothing special10:12
soniya29arxcruz, kopecmartin okay10:12
*** ykarel has quit IRC10:41
*** ykarel has joined #oooq10:48
chkumar|ruckzbr: weshay|ruck sc1 and sc2 is cleared now for master integration line10:49
chkumar|ruckpodman ovb changes is going to take time10:49
zbrchkumar|ruck: anything i can help you with?11:36
chkumar|ruckzbr: currently nothing, if we want we can promote master without ovb11:37
chkumar|ruckzbr: https://2b9c3acc2f2fe4180781-3849b03cfcb04d12316556dd4e593ed3.ssl.cf1.rackcdn.com/784197/1/gate/openstack-tox-linters/3c69524/job-output.txt11:39
chkumar|ruckzbr: RROR! Unknown error when attempting to call Galaxy at 'https://galaxy.ansible.com/api/v2/collections/ansible/netcommon/versions/?page=12': The read operation timed out11:40
*** dpawlik4 has joined #oooq11:40
chkumar|ruckone of the gate failure on this https://review.opendev.org/c/openstack/tripleo-ansible/+/784197/11:40
zbrchkumar|ruck: that is my speciality, how often it happens?11:40
zbrgalaxy unstability11:40
chkumar|ruckseening currently11:40
zbrbut i know how to mitigate it, by adding some retries.11:41
zbrsomething i already wanted to do anyway,11:41
chkumar|rucklet;s take a stab then11:41
*** dpawlik4 is now known as dpawlik11:42
*** rlandy has joined #oooq11:43
rlandychkumar|ruck: zbr; het - h is presenting at the program call?11:45
rlandyhey - who11:45
chkumar|ruckrlandy: I think zbr can take care of that11:45
rlandyok11:46
zbryep, wes asked me to do the CI call (in 2h+ from now)11:47
chkumar|ruckzbr: program call in another 12 mins11:48
zbroops, that was not in my calendar.11:48
rlandyzbr: info for our section is updated on the doc11:49
rlandyyou can just read it off there11:49
zbrnow it is11:49
rlandybhagyashris: hi - is the retrospective board available?11:49
chkumar|ruckzbr: pmed you the details11:50
chkumar|ruckrlandy: sorry, I have taken a stab at dib https://review.opendev.org/c/openstack/diskimage-builder/+/78513811:50
rlandychkumar|ruck: n worries - was busy with wallaby branching11:50
*** kopecmartin has quit IRC11:51
*** kopecmartin has joined #oooq11:52
rlandybhagyashris: nvm - I see it ... https://trello.com/b/0VFswmht/pcci-retrospective?menu=filter&filter=label:UniSprint4211:52
bhagyashrisrlandy, yes11:54
bhagyashrishttps://trello.com/b/0VFswmht/pcci-retrospective?menu=filter&filter=label:UniSprint4211:54
bhagyashrisweshay|ruck, arxcruz akahat marios frenzy_friday pojadhav zbr chkumar|ruck soniya29 sshnaidm ysandeep ^11:54
zbri am in program call, will join after12:10
*** sanjayu_ has joined #oooq12:10
*** saneax has quit IRC12:12
*** amoralej is now known as amoralej|lunch12:15
rlandyhttps://bugs.launchpad.net/tripleo/+bug/192167912:24
openstackLaunchpad bug 1921679 in tripleo "openstack: 'undercloud install' is not an openstack command. See 'openstack --help'." [Critical,Triaged]12:24
zbrchkumar|ruck: https://github.com/ansible-community/ansible-lint/pull/151712:28
zbrFYI, that may not fix our issue, only adds retries. It is likely to address it based on my experience12:29
zbreveryone reported random errors with galaxy, especially in the recent weeks.12:29
zbrbut at least we will see in the logs if retries were performed.12:29
chkumar|ruckzbr: yes, sounds good to me12:34
*** sanjayu_ has quit IRC12:42
*** amoralej|lunch is now known as amoralej12:59
weshay|ruckchkumar|ruck, woot13:06
weshay|ruckhttps://trello.com/c/xG38kCYe/1898-cixlp1922282tripleociproa-master-gnocchiclientexceptionsresourcetypenotfound-resource-type-image-does-not-exist-http-40413:06
chkumar|ruckzbr: weshay|ruck: rlandy frenzy_friday want to do a rr handoff?13:07
rlandychkumar|ruck: yes - pls13:07
chkumar|rucknow?13:07
rlandynow ok?13:07
chkumar|ruckyes13:07
frenzy_fridayyep13:07
zbrsame meet id?13:08
weshay|ruckhttps://meet.google.com/jpe-zayn-fhx13:08
weshay|ruckya13:08
chkumar|ruckhttps://review.rdoproject.org/r/c/testproject/+/3313813:18
chkumar|ruckhttps://review.rdoproject.org/r/c/testproject/+/3312213:21
chkumar|ruckhttps://2b9c3acc2f2fe4180781-3849b03cfcb04d12316556dd4e593ed3.ssl.cf1.rackcdn.com/784197/1/gate/openstack-tox-linters/3c69524/job-output.txt13:23
chkumar|ruckhttps://github.com/ansible-community/ansible-lint/pull/151713:24
chkumar|ruckrlandy: https://review.rdoproject.org/r/c/testproject/+/3313813:24
*** ratailor has quit IRC13:41
chkumar|ruckrlandy: frenzy_friday feel free to change the nicks13:52
*** chkumar|ruck is now known as raukadah13:52
rlandyyes13:52
*** rlandy is now known as rlandy|rover13:52
raukadahrlandy: I am going to pick up extended hash work13:52
rlandy|roverchoosing rover since weshay|ruck is on my timezone13:52
rlandy|roverraukadah: yeah - left some comments there13:53
rlandy|roverwe can chat about what was there13:53
*** frenzy_friday is now known as anbanerj|ruck13:53
rlandy|roversome confusion on what you are defining as the extended_hash vs full_hash13:53
raukadahrlandy|rover: I need to take a fresh look on that13:53
rlandy|roverk- we ca chat tomorrow13:53
raukadahlet's chat on friday on this13:53
raukadahor tomorrow after planning13:54
rlandy|roverraukadah: ack - thanks14:01
weshay|ruckraukadah, rlandy|rover ok.. fs001 is in tempest14:06
weshay|ruckWELL DONE14:06
rlandy|rovernice14:06
weshay|ruckrlandy|rover, I'm going to kill integration jobs...14:06
weshay|ruckand trigger main/master14:06
rlandy|roverweshay|ruck: ack14:06
rlandy|roverweshay|ruck: worth to kick victoria as well?14:06
weshay|ruckafter master14:07
rlandy|roverack14:07
raukadahrlandy|rover: i need to update this patch https://review.opendev.org/c/openstack/tripleo-ci/+/785087 but once ovb finishes then14:14
raukadahcgoncalves: please have a look at this patch https://review.opendev.org/c/openstack/diskimage-builder/+/78513814:15
rlandy|roverraukadah: is https://review.opendev.org/c/openstack/tripleo-ci/+/785087 and the DIB chnange required for ovb to pass or just the better solution?14:15
rlandy|roverweshay|ruck, not yet - we sad only after check switches14:17
rlandy|roversaid14:17
raukadahweshay|ruck: yes14:17
raukadahrlandy|rover: yes14:17
rlandy|roverraukadah: yes - as in ovb will fail until we merge https://review.opendev.org/c/openstack/tripleo-ci/+/78508714:18
weshay|ruckrlandy|rover, roger https://logserver.rdoproject.org/openstack-dependencies-containertools/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-standalone-container-tools-container-build-master/8e53654/logs/undercloud/etc/dnf/modules.d/container-tools.module.gz14:21
weshay|ruckgets me every time14:21
rlandy|roverweshay|ruck: putting in change to move the pipelibe14:21
rlandy|roverwe can merge that at any point14:21
rlandy|roverweshay|ruck: ^^ iiuc, from above  ovb will only pass with raukadah's two unmerged patches - so you plan to promote master w/o ovb?14:22
weshay|ruckrlandy|rover, I may it's OLD14:24
rlandy|roverweshay|ruck: ack ok14:24
weshay|ruckrlandy|rover, let's see what happens in this run14:24
rlandy|roverack14:25
weshay|ruckrlandy|rover, at any rate.. any reason not to flip container-tools back to rhel8?14:26
rlandy|roverweshay|ruck: well at the moment, w/o check switching 3.0, https://review.opendev.org/c/openstack/tripleo-quickstart/+/785185/1/config/release/dependency_ci/container-tools/repo_config.yaml would do the following14:32
rlandy|roversudo dnf module enable container-tools:2.0 -y;14:32
rlandy|roversudo dnf module enable container-tools:3.0 -y; (which was NEVER enabled)14:32
rlandy|roversorry disable14:33
rlandy|roverand the enable rhel814:33
rlandy|roverso your patch is ok - once we switch check14:33
rlandy|rover^^ make sense?14:33
rlandy|roverso hence I added the revert14:33
* rlandy|rover leaves comment14:34
weshay|ruckrlandy|rover, I think we merge the 3.0 to check as well.. but let's do that later today14:35
rlandy|roverweshay|ruck: fine - once we merge that, we can merge your change14:36
raukadahrlandy|rover: please update this review https://review.opendev.org/c/openstack/tripleo-ci/+/785087 once ovb jobs gives a green light14:37
raukadahrlandy|rover: https://review.opendev.org/c/openstack/tripleo-ci/+/785087/4/roles/oooci-build-images/vars/centos-7.yaml14:38
rlandy|roverraukadah: sure - removing that14:38
raukadahrlandy|rover: https://opendev.org/openstack/tripleo-ci/src/branch/master/roles/oooci-build-images/templates/build-images.sh.j2#L61 condoitional needs to be fixed14:38
raukadahotherwise it will break c7 part14:38
rlandy|roverraukadah: just remove https://review.opendev.org/c/openstack/tripleo-ci/+/785087/4/roles/oooci-build-images/vars/centos-7.yaml#714:39
raukadahit is defined always now but value should be null or empty14:39
raukadahit will break c714:39
raukadahas it is now in default14:40
rlandy|roverraukadah: why not just remove that?14:40
raukadahrlandy|rover: https://review.opendev.org/c/openstack/tripleo-ci/+/785087/4/roles/oooci-build-images/defaults/main.yaml14:41
rlandy|roveroh14:41
rlandy|roverdefaults always get taken14:41
rlandy|rovergot it14:41
rlandy|roverupdating14:42
raukadahrlandy|rover: may be using |length > 014:42
raukadahwill fix the issue in the .sh script14:43
rlandy|roverraukadah: ack - got that change ... {% if dib_dnf_module_streams is defined and dib_dnf_module_streams|length > 0 %}14:46
rlandy|roverwill commit when results come in14:46
ysandeepweshay|ruck, sshnaidm: hey o/ When you have time, Ovb cleanup script looks in good shape now: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/31410 , fyi.. After multiple tries in local system, I gave a shot at cleaning OVB resources in psi internal with dry-run first(for safety) and then without, Results are good  http://pastebin.test.redhat.com/953563, Created one ticket for infra as well.14:49
ysandeepweshay|ruck: if you okay with this change, I would like to run this for internal first for couple of days before running this for vexx cloud.14:49
zbrweshay|ruck: rlandy|rover: do you know why a change that modifies only a file mentioned in irrelevant-files does still run deployments? https://review.opendev.org/c/openstack/tripleo-ansible/+/a14:50
zbrhttps://opendev.org/openstack/tripleo-ci/src/branch/master/zuul.d/base.yaml#L14314:50
zbri checked the chain and that is the only place where these are defined, but still i see job being run.14:51
rlandy|roverraukadah: this is ready to merge? (with reviews) https://review.opendev.org/c/openstack/diskimage-builder/+/78513814:53
raukadahrlandy|rover: yes14:56
*** ysandeep is now known as ysandeep|dinner15:00
*** kopecmartin has quit IRC15:01
*** kopecmartin has joined #oooq15:01
*** skramaja has quit IRC15:02
weshay|ruckysandeep|dinner, comments15:02
raukadahovb passed, waiting to log collection15:22
rlandy|roverraukadah: ack - submitting patch and rerunning15:25
raukadahrlandy|rover: few mins please15:25
rlandy|roveryep - collecting logs15:26
*** jpodivin has quit IRC15:28
rlandy|roverweshay|ruck: ysandeep|dinner: depending on how ovb goes, looking to promote 16.215:33
rlandy|roververy old15:33
weshay|ruckrlandy|rover, that line is stuck15:34
weshay|ruckoh maybe not15:34
weshay|ruck17 is stuck15:34
weshay|ruck16.2 looks ok15:34
rlandy|rover3h26 mins15:35
rlandy|roverlooks ok15:35
rlandy|rover19 hr 36 min is stuck15:36
raukadahrlandy|rover: weshay|ruck https://review.rdoproject.org/zuul/build/6582fb8afa2a44c6a806bb2545a9fadf15:36
rlandy|roveryep15:36
raukadahovb fs01 passed15:36
raukadahrlandy|rover: please update the patch and get all merged15:36
weshay|ruckraukadah, rock15:36
raukadahmake ovb green again15:36
rlandy|roverraukadah: new patch submitted15:36
rlandy|roverhttps://review.opendev.org/c/openstack/tripleo-ci/+/78508715:36
raukadahrlandy|rover: https://review.opendev.org/c/openstack/diskimage-builder/+/785138 this also15:37
rlandy|roverraukadah: ack - I only have +1 there15:37
rlandy|rovercgoncalves: ^^ do you have +2 permissions on DIB?15:38
rlandy|roverian w is on pto15:39
raukadahclark might be rights there15:39
weshay|ruckraukadah, ian is pto15:39
rlandy|roverlon submitted the original change15:39
rlandy|roverwill see if he has permissions15:40
*** ykarel is now known as ykarel|away15:41
raukadahweshay|ruck: https://review.opendev.org/admin/groups/5a043d844578a5be3e3024fb3f7becca64c60a74,members15:41
raukadahweshay|ruck: we can ask infra-core to merge it15:41
rlandy|rovercgoncalves is core15:42
* cgoncalves feels under pressure15:43
rlandy|roversorry15:43
rlandy|roverraukadah: rekicked testproject15:47
*** ykarel|away has quit IRC16:02
*** sshnaidm is now known as sshnaidm|afk16:06
*** udesale has quit IRC16:17
*** ysandeep|dinner is now known as ysandeep16:28
*** jmasud has joined #oooq16:31
*** marios is now known as marios|out16:31
*** jbadiapa has quit IRC16:34
weshay|ruckrlandy|rover, for wallaby+16:36
weshay|ruckWe need to remove these two lines in the tripleo-ci job definition  [1]16:36
weshay|ruckbut only for Wallaby and newer.16:36
weshay|ruck[1] https://github.com/openstack/tripleo-ci/blob/master/zuul.d16:36
weshay|rucklp: 192278416:36
openstackLaunchpad bug 1922784 in tripleo "Wallaby: periodic-tripleo-ci-centos-8-scenario004-standalone-wallaby is failing manila_tempest_tests.tests.api.test_shares.SharesNFSTest setup" [Critical,Triaged] https://launchpad.net/bugs/192278416:36
rlandy|roverweshay|ruck: ack - will do16:37
weshay|ruckdanka16:37
rlandy|roverjust creating previous-current-tripleo for wallaby16:37
rlandy|roverta da ... https://trunk.rdoproject.org/centos8-wallaby/previous-current-tripleo/delorean.repo.md516:39
rlandy|roverrepo-promote-batch16:39
rlandy|roverweshay|ruck: http://pastebin.test.redhat.com/953652 lots of typing but it works16:40
weshay|ruckrlandy|rover, we need to write a script to write that out for us.. and throw it into ci-config/ci-scripts16:46
rlandy|roverweshay|ruck: yeah - the dlrn repo file holds commit_{part of ditro}16:47
rlandy|roverso you have to reference the repo per component to get the rest16:47
rlandy|roverwill think on it after scen004 fix16:48
rlandy|roverbtw container-tools:3.0 in check was w+'ed16:48
rlandy|rovernot by us16:48
rlandy|roverso it's merging anyways16:48
rlandy|roverthen we can merge your dpe line change16:48
*** marios|out has quit IRC16:49
rlandy|roverlunch - back in 1016:51
weshay|ruckmaster is a bust16:51
rlandy|roverweshay|ruck: we need the two patch raukadah was working on16:54
rlandy|rovertestproject rekicked with lastest change16:54
weshay|ruckoh.. I'll need to force promote a few components in master16:54
weshay|ruckrlandy|rover, that's ovb https://review.rdoproject.org/r/c/testproject/+/3313816:55
rlandy|roveryep16:55
rlandy|roverweshay|ruck: made an update to raukadah patch16:55
rlandy|roverthe DIB patch should be ready16:56
rlandy|roverweshay|ruck: wallaby is actually ahead of master at this point16:56
rlandy|roveras we only added component criteria yesterday16:56
rlandy|roverwas just promoting all components16:56
weshay|ruckI'm going to promote masters, tripleo and cloud-ops16:57
*** rlandy|rover is now known as rlandy|rover|lch16:58
rlandy|rover|lchok16:58
rlandy|rover|lchnothing to lose atm16:58
rlandy|rover|lchbrb16:58
*** derekh has quit IRC17:00
weshay|ruckkilling the master line17:07
*** jpena is now known as jpena|off17:08
ysandeepweshay|ruck sshnaidm|afk ++ thank you for reviewing and merging ovb cleanup script , I will work next on deployment of this script using infra-setup role.17:13
weshay|ruckysandeep, perfect17:13
*** amoralej is now known as amoralej|off17:14
ysandeeprlandy|rover|lch, 16.2 ovb jobs hits infra issue.. baremetal failed due to tempest17:15
*** ysandeep is now known as ysandeep|away17:16
*** rlandy|rover|lch is now known as rlandy|rover17:19
rlandy|roverysandeep|away: thanks - will take care of that later17:19
rlandy|roverweshay|ruck: hmm - we have two job definitions by the same name :(17:25
rlandy|roverhttps://github.com/openstack/tripleo-ci/blob/master/zuul.d/standalone-jobs.yaml#L62917:25
rlandy|roverhttps://github.com/openstack/tripleo-ci/blob/master/zuul.d/standalone-jobs.yaml#L65817:25
* rlandy|rover fixes periodic17:26
rlandy|roverfirst easier17:26
weshay|ruckok.. had to rev from consistent.. but we have the patches now https://trunk.rdoproject.org/centos8-master/component/tripleo/promoted-components/17:36
weshay|ruckrequeued master17:37
weshay|ruckso we'll get https://review.opendev.org/c/openstack/tripleo-heat-templates/+/784969 https://review.opendev.org/c/openstack/tripleo-heat-templates/+/784971 https://review.opendev.org/c/openstack/puppet-tripleo/+/785076/17:37
weshay|ruckand we should see..17:37
weshay|ruckperiodic-tripleo-ci-centos-8-scenario001-standalone-masterSUCCESS 1h 33m 12s17:37
weshay|ruckperiodic-tripleo-ci-centos-8-scenario002-standalone-masterSUCCESS 1h 28m 02s17:37
weshay|ruckrlandy|rover, we'll need to at least rerun https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-16.2/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-bm_envD-3ctlr_1comp-featureset035-rhos-16.2/6d3a7ee/17:42
weshay|ruckfor 16.217:42
rlandy|roverack17:42
rlandy|roverhmmm - we never sorted the same job definition on diff branches?17:43
weshay|ruckrlandy|rover, w/ regards to scenario007?17:43
rlandy|roverscen00417:43
weshay|ruckoh 4.. right17:43
rlandy|roverso we need either a new naming scheme17:44
rlandy|roverthere is no wat in zuul to switch case var usage17:44
rlandy|roverwe have to parent one level more17:44
weshay|ruckya.. this sucks17:44
rlandy|roverwhich is ok of we are only relying on templates17:44
rlandy|roverbut ...17:44
rlandy|roverperiodic is easier to fix17:45
rlandy|roverhttps://codesearch.opendev.org/?q=tripleo-ci-centos-8-scenario004-standalone&i=nope&files=&excludeFiles=&repos=17:45
rlandy|roverweshay|ruck: ^^ called in other places17:45
rlandy|roverplus https://github.com/rdo-infra/rdo-jobs/search?q=tripleo-ci-centos-8-scenario004-standalone17:46
rlandy|roverso I can fix this with another level of parenting and a new name adding to templates17:46
rlandy|roverbut those outside of templates will also have to be fixed17:46
*** slaweq has quit IRC17:47
rlandy|roverweshay|ruck: hey - have a moment to chat abut the scenario004 design options18:12
weshay|ruckin a min.. talking to kevin atm18:12
*** jmasud has quit IRC18:39
weshay|ruckrlandy|rover, ok.. that took longer than I thought19:13
weshay|ruckrlandy|rover, available19:13
rlandy|roverweshay|ruck: k ...19:13
rlandy|rovermeet.google.com/ukv-hdko-cyj19:13
*** jmasud has joined #oooq19:26
weshay|ruckrlandy|rover, https://logserver.rdoproject.org/openstack-component-manila/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario004-standalone-manila-master/2c85452/logs/undercloud/var/log/tempest/tempest_run.log.txt.gz19:27
*** matbu has quit IRC19:27
*** jmasud has quit IRC19:40
rlandy|roverweshay|ruck: email sent o openstack-discuss19:48
*** slaweq has joined #oooq19:53
anbanerj|ruckrlandy|rover, we didnt push any patch for wallaby periodic jobs (https://opendev.org/openstack/tripleo-ci/src/branch/master/zuul.d/periodic.yaml) yet, right? I didnt find any on scrum board.19:57
rlandy|roveranbanerj|ruck: no - none existed19:57
anbanerj|ruckthanks. adding now19:57
weshay|ruckrlandy|rover, ok.. scenario01/02 passes in master.. I'll check wallaby20:16
rlandy|roverweshay|ruck: nice20:16
weshay|ruckmissing20:18
weshay|ruckpromoting tripleo component20:18
rlandy|roverhttps://review.opendev.org/c/openstack/manila/+/785270 WIP: Set snapshot_support capabilties to false - t->u->v [NEW]20:21
rlandy|roverlet's see if this works20:21
rlandy|rovertest projecting20:21
weshay|ruckrlandy|rover, wallaby dlrn api endpoint is down20:22
weshay|ruckor not api_url: https://trunk.rdoproject.org/api-centos8-wallaby20:22
weshay|ruckdid you use something else?20:22
rlandy|rovergetting ...20:22
rlandy|roverdlrnapi --url https://trunk.rdoproject.org/api-centos8-wallaby20:22
weshay|ruckya.. not up20:22
rlandy|roverworked earlier20:22
rlandy|roverhow I created previous-current-tripleo20:23
rlandy|rovercan you paste the failure?20:23
weshay|ruck40420:23
rlandy|roverlol20:23
rlandy|roverthe command that got you the 40420:24
rlandy|rovercan't do much with the number20:24
* rlandy|rover checks20:24
gouthamrrlandy|rover: https://review.opendev.org/c/openstack/manila/+/785270 touches a post_test_hook that's for devstack gate - is that invoked in tripleo jobs?20:24
rlandy|rovergouthamr: ah - no20:25
rlandy|roverI was just looking where that was defined20:25
rlandy|roverlet me rework that20:25
rlandy|rovergouthamr: there is no neat way to exclude tempest options in a job that runs on multiple branches20:26
*** jmasud has joined #oooq20:27
*** dmellado has quit IRC20:27
gouthamrah, https://github.com/openstack/manila-tempest-plugin/blob/b3089a7ee3da99cc249e4d5bf3e4bad353116877/manila_tempest_tests/config.py#L111-L117 is where that config opt is defined, and it defaults to the value of snapshot_support for legacy reasons: https://github.com/openstack/manila-tempest-plugin/blob/369391a8a4996a310a52f5d5939a27acc875d8c1/manila_tempest_tests/plugin.py#L39-L5320:27
gouthamrrlandy|rover: oh :( not even with job variants?20:27
rlandy|roverhttps://opendev.org/openstack/manila-tempest-plugin/src/branch/master/manila_tempest_tests/config.py#L10620:28
rlandy|rover^^ file20:28
rlandy|roverno defaults there20:28
*** dmellado has joined #oooq20:29
rlandy|roverwe could add defaults per branch20:29
gouthamrin the test config? manila-tempest-plugin is also branch agnostic20:29
rlandy|rovergouthamr: if we want to keep the job name and run with diff options in diff branches, we don't have a clean zuul-only solution20:30
rlandy|roverzuul vars do not take conditionals20:31
rlandy|roverwe would have to utilize another settings file20:31
gouthamrrlandy|rover: i see, i was thinking job variants can solve this20:31
rlandy|roverso was I20:31
dmelladowell, in theory you could add tempest plugin features at any given branch, thus the branchless thing, just my 2 cents20:32
rlandy|rovergouthamr: the periodic jobs are easy enough to fix20:33
rlandy|rovertheir inheritance is clear on a per branch basis20:33
rlandy|roverthe check jobs run across branches20:33
gouthamrrlandy|rover: noob question, where are these periodic jobs defined?20:33
rlandy|roverhttps://github.com/rdo-infra/rdo-jobs20:34
gouthamrthank you ^20:34
rlandy|roverdmellado: what are you proposing?20:34
dmelladoprobably missed some part of the conversation but just was stating that if you need to enable/disable specific tests per branch20:35
dmelladoI would just set those features per branch/job over configuring the plugin20:35
rlandy|roverwe can skip tests per branch20:37
rlandy|roverso if the features are disabled, just skip the tests on those branches?20:37
dmelladoyep, those tests just won't be running20:38
*** spotz has quit IRC20:38
dmelladothat's the idea behind tempest being branchless20:38
rlandy|roverhttps://review.opendev.org/c/openstack/tripleo-ci/+/785254/5/zuul.d/standalone-jobs.yaml - re-enables the snapshot capabilties20:38
*** anbanerj|ruck is now known as anbanerj20:39
*** anbanerj is now known as anbanerj|ruck20:39
*** tbarron has joined #oooq20:40
tbarronrlandy|rover: hi20:40
rlandy|rovertbarron: hi ...20:40
* tbarron didn't have enuf channels20:41
rlandy|roverso  - per https://bugs.launchpad.net/tripleo/+bug/1922784/comments/4,20:41
openstackLaunchpad bug 1922784 in tripleo "Wallaby: periodic-tripleo-ci-centos-8-scenario004-standalone-wallaby is failing manila_tempest_tests.tests.api.test_shares.SharesNFSTest setup" [Critical,Triaged]20:41
dmelladorlandy|rover: that'd be making it run such tests again20:41
rlandy|roverhttps://review.opendev.org/c/openstack/tripleo-ci/+/785254/5/zuul.d/standalone-jobs.yaml20:41
tbarronsomebody put dmellado under house arrest20:41
dmelladohey tbarron20:41
dmelladoxD20:41
dmelladocovid did xD20:41
rlandy|roversets the capability_snapshot_support tempest options to true20:42
rlandy|roveras is the default20:42
rlandy|roverthere is no clean zuul way to separate those te,pest options per branch20:42
rlandy|roverw/o changing the job name or parenting20:42
tbarroncan we make two jobs, etc.20:42
tbarronhmm20:42
rlandy|roverwe can - not with the same name20:42
rlandy|roverso20:42
rlandy|roverlooking at other options,20:43
rlandy|roverdmellado suggests we just add failing tests in releases t->v to the tempest skiplist20:43
rlandy|roverthat way we keep the naming and parenting nice and clean20:43
tbarrongouthamr: ^^ you may already be following?  I just joined.20:43
gouthamr^ we only have one test, so that would be futile20:43
rlandy|rover(periodic jobs are a much smaller issue - we can change the options there)20:44
rlandy|roveror20:44
rlandy|roverif that is not a soltion,20:44
rlandy|roverwe can add the tempest option to another settings file20:44
rlandy|rover(not ideal)20:44
rlandy|rovertbarron: gouthamr: so the question revolves around if there is any value in the tests that would run with the snapshot options disabled in releases t->v20:45
tbarronrlandy|rover: the problem is in the setup class, really affects all tests20:46
gouthamrtbarron: yep, trying to read through the tripleo-ci code; the tempest options are nested under something here unlike devstack-jobs, so that *may* be one problem with using a job variant like rlandy|rover attempted20:46
tbarronand we're just running one test here, but whichever one we pick as a "ping" test would likely be affected20:46
rlandy|roverwell, let me start by fixing the periodic jobs - those are easy enough20:47
gouthamrirony is that the test case that's being executed isn't testing snapshots (or clones) at all20:47
gouthamrrlandy|rover: would that resolve the CiX issue?20:47
rlandy|rovergouthamr: it would as the CIX is logged against periodics ... BUT20:48
gouthamrrlandy|rover: so we can take some time to think about the scenario004 job?20:48
rlandy|roveras soon as we promote, the issue will hit tripleo-ci jobs in check20:48
gouthamroh, thanks that makes sense20:49
rlandy|rovergouthamr: k - putting up those changes and we can rethink this tomorrow20:49
rlandy|roverto be clear, there are CI solutions20:49
rlandy|roverthey are just not so pretty20:49
gouthamrack, ty for working on this and explaining this rlandy|rover20:50
tbarronrlandy|rover: yes, thanks much20:50
rlandy|roverhttps://review.opendev.org/c/openstack/tripleo-ci/+/78525420:50
rlandy|rover^^ leaving that in -1 until we re-discuss20:50
rlandy|roverwill add you both to the periodics review20:51
rlandy|roverthanks for joining in this dicussion20:51
gouthamrtbarron: lkuchlan started a patch to rid ourselves of some forced extra-specs (snapshot_support and create_share_from_snapshot_support) - i thought we could wait until PTG to work on those, but i think we can go back to investigating that and seeing if that will fix this issue20:51
gouthamrrlandy|rover ++20:51
tbarrongouthamr: +120:52
*** dsneddon has quit IRC20:53
*** matbu has joined #oooq20:56
*** jmasud has quit IRC21:29
rlandy|roverweshay|ruck: ha - master is much cleaner21:37
rlandy|roverother than ovb21:37
rlandy|rovertry promote wallaby components again?21:37
rlandy|rovertbarron: gouthamr: so adding the failing test to the skip list will be an option ... see https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario004-standalone-wallaby/0f491bc/logs/undercloud/var/log/tempest/tempest_results.xml.gz21:40
rlandy|roveronly the tempest.scenario.test_network_basic_ops.TestNetworkBasicOps test will run21:40
rlandy|roveron periodic, https://review.rdoproject.org/r/c/rdo-jobs/+/33151, manila_tempest_tests.tests.api.test_shares.SharesNFSTest will run on all branches21:40
rlandy|roverthe test will fail and could be skipped in check only on t-> v21:41
rlandy|rovernot a great solution but a workable one21:41
tbarronrlandy|rover: long run we want to run manila tests in scenario004 though21:41
rlandy|roverI get that21:41
tbarronrlandy|rover: but as a band aid, cool21:41
tbarronrlandy|rover: just getting on record :)21:41
rlandy|roverwe have a day or so to work it out21:41
rlandy|roverrunning testproject job on the periodics to confirm21:42
tbarronrlandy|rover: skipping is fine as a stopgap21:42
rlandy|roveralways21:43
rlandy|roveragreed21:43
*** jmasud has joined #oooq21:44
*** slaweq has quit IRC21:57
*** rlandy|rover is now known as rlandy|rover|bbl22:34
*** jmasud has quit IRC22:53
*** jmasud has joined #oooq23:01
*** tosky has quit IRC23:11
*** jmasud has quit IRC23:42

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!