*** tosky has quit IRC | 00:17 | |
weshay|ruck | chkumar|ruck, ok.. ur ovb patches re: container-tools got through | 00:57 |
---|---|---|
weshay|ruck | Takashi Kajinami is attacking the scenario001/002 issues | 00:57 |
*** jmasud has quit IRC | 01:40 | |
*** rlandy|bbl has quit IRC | 01:41 | |
*** jmasud has joined #oooq | 02:47 | |
*** apetrich has quit IRC | 03:11 | |
*** skramaja has joined #oooq | 03:26 | |
chkumar|ruck | weshay|ruck: https://review.opendev.org/c/openstack/tripleo-ci/+/785087 quick merge if around | 03:43 |
*** jmasud has quit IRC | 03:54 | |
*** jmasud has joined #oooq | 03:59 | |
*** ykarel has joined #oooq | 04:11 | |
*** saneax has joined #oooq | 04:47 | |
*** ratailor has joined #oooq | 04:48 | |
*** jmasud has quit IRC | 04:52 | |
*** jmasud has joined #oooq | 04:53 | |
*** ysandeep|away is now known as ysandeep | 04:59 | |
*** marios has joined #oooq | 05:09 | |
*** udesale has joined #oooq | 05:17 | |
*** jmasud has quit IRC | 05:28 | |
*** saneax has quit IRC | 05:40 | |
*** jpodivin has joined #oooq | 05:58 | |
*** saneax has joined #oooq | 06:16 | |
*** jmasud has joined #oooq | 06:17 | |
*** ykarel_ has joined #oooq | 06:18 | |
*** ykarel has quit IRC | 06:21 | |
*** jbadiapa has joined #oooq | 06:25 | |
*** ykarel_ is now known as ykarel | 06:32 | |
*** slaweq has joined #oooq | 06:37 | |
*** amoralej|off is now known as amoralej | 06:56 | |
*** ratailor_ has joined #oooq | 07:24 | |
*** ratailor has quit IRC | 07:27 | |
*** jfrancoa has joined #oooq | 07:28 | |
*** tosky has joined #oooq | 07:37 | |
*** ratailor__ has joined #oooq | 07:38 | |
*** jmasud has quit IRC | 07:39 | |
*** jmasud has joined #oooq | 07:40 | |
*** ratailor_ has quit IRC | 07:41 | |
*** ykarel has quit IRC | 07:56 | |
*** jpena|off is now known as jpena | 07:57 | |
*** apetrich has joined #oooq | 08:16 | |
*** ykarel has joined #oooq | 08:20 | |
*** derekh has joined #oooq | 08:40 | |
zbr | chkumar|ruck: apparently people still love writing bash scripts w/o set -e | 08:51 |
zbr | i would really add a set -e to https://review.opendev.org/c/openstack/tripleo-ci/+/785087/1/roles/oooci-build-images/templates/build-images.sh.j2 | 08:52 |
chkumar|ruck | zbr: added in the upcomign patchset | 08:55 |
zbr | i guess there is no need to explain why. the last part of the script should be updated too, no longer needing the exit. | 08:55 |
zbr | chkumar|ruck: marios: maybe you can review this oneliner https://review.opendev.org/c/openstack/tripleo-quickstart/+/784970/1/install-deps.sh | 08:58 |
zbr | ignoring return codes, always a bad idea. we missed the sudo there. | 08:58 |
*** ratailor_ has joined #oooq | 09:03 | |
*** ratailor__ has quit IRC | 09:06 | |
chkumar|ruck | zbr: commented | 09:06 |
*** jmasud has quit IRC | 09:13 | |
*** derekh has quit IRC | 09:15 | |
*** derekh has joined #oooq | 09:15 | |
marios | zbr: adding to list | 09:28 |
zbr | chkumar|ruck: i updated it, fully rewrite to make it idempotent | 09:28 |
zbr | if epel exists and disbled, enable it, run update after. | 09:28 |
zbr | bit ugly, but that's bash | 09:29 |
zbr | chkumar|ruck: was https://review.rdoproject.org/r/c/rdo-jobs/+/32967 needed for train promotion? | 09:31 |
*** ratailor__ has joined #oooq | 09:31 | |
*** jfrancoa has quit IRC | 09:34 | |
*** ratailor_ has quit IRC | 09:34 | |
*** frenzy_friday has quit IRC | 09:38 | |
*** frenzy_friday has joined #oooq | 09:39 | |
chkumar|ruck | zbr: nope | 09:43 |
*** ratailor has joined #oooq | 09:59 | |
*** ratailor__ has quit IRC | 10:00 | |
chkumar|ruck | zbr: you might want to take a look at this https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_f53/784970/4/check/tripleo-ci-centos-8-content-provider/f53e406/job-output.txt | 10:02 |
chkumar|ruck | gcc: fatal error: no input files | 10:02 |
zbr | lol, where does this come from, it looks out of context | 10:04 |
zbr | i see rpm installs before, nothing else. and after that an error from git | 10:05 |
soniya29 | kopecmartin, weshay|ruck, Since akahat and arxcruz are not available and chkumar|ruck is busy with ruck/rovering, I think we can cancel the meeting. Do you have anything to discuss? | 10:12 |
arxcruz | soniya29: sure, we also have the retro today | 10:12 |
kopecmartin | soniya29: nothing special | 10:12 |
soniya29 | arxcruz, kopecmartin okay | 10:12 |
*** ykarel has quit IRC | 10:41 | |
*** ykarel has joined #oooq | 10:48 | |
chkumar|ruck | zbr: weshay|ruck sc1 and sc2 is cleared now for master integration line | 10:49 |
chkumar|ruck | podman ovb changes is going to take time | 10:49 |
zbr | chkumar|ruck: anything i can help you with? | 11:36 |
chkumar|ruck | zbr: currently nothing, if we want we can promote master without ovb | 11:37 |
chkumar|ruck | zbr: https://2b9c3acc2f2fe4180781-3849b03cfcb04d12316556dd4e593ed3.ssl.cf1.rackcdn.com/784197/1/gate/openstack-tox-linters/3c69524/job-output.txt | 11:39 |
chkumar|ruck | zbr: RROR! Unknown error when attempting to call Galaxy at 'https://galaxy.ansible.com/api/v2/collections/ansible/netcommon/versions/?page=12': The read operation timed out | 11:40 |
*** dpawlik4 has joined #oooq | 11:40 | |
chkumar|ruck | one of the gate failure on this https://review.opendev.org/c/openstack/tripleo-ansible/+/784197/ | 11:40 |
zbr | chkumar|ruck: that is my speciality, how often it happens? | 11:40 |
zbr | galaxy unstability | 11:40 |
chkumar|ruck | seening currently | 11:40 |
zbr | but i know how to mitigate it, by adding some retries. | 11:41 |
zbr | something i already wanted to do anyway, | 11:41 |
chkumar|ruck | let;s take a stab then | 11:41 |
*** dpawlik4 is now known as dpawlik | 11:42 | |
*** rlandy has joined #oooq | 11:43 | |
rlandy | chkumar|ruck: zbr; het - h is presenting at the program call? | 11:45 |
rlandy | hey - who | 11:45 |
chkumar|ruck | rlandy: I think zbr can take care of that | 11:45 |
rlandy | ok | 11:46 |
zbr | yep, wes asked me to do the CI call (in 2h+ from now) | 11:47 |
chkumar|ruck | zbr: program call in another 12 mins | 11:48 |
zbr | oops, that was not in my calendar. | 11:48 |
rlandy | zbr: info for our section is updated on the doc | 11:49 |
rlandy | you can just read it off there | 11:49 |
zbr | now it is | 11:49 |
rlandy | bhagyashris: hi - is the retrospective board available? | 11:49 |
chkumar|ruck | zbr: pmed you the details | 11:50 |
chkumar|ruck | rlandy: sorry, I have taken a stab at dib https://review.opendev.org/c/openstack/diskimage-builder/+/785138 | 11:50 |
rlandy | chkumar|ruck: n worries - was busy with wallaby branching | 11:50 |
*** kopecmartin has quit IRC | 11:51 | |
*** kopecmartin has joined #oooq | 11:52 | |
rlandy | bhagyashris: nvm - I see it ... https://trello.com/b/0VFswmht/pcci-retrospective?menu=filter&filter=label:UniSprint42 | 11:52 |
bhagyashris | rlandy, yes | 11:54 |
bhagyashris | https://trello.com/b/0VFswmht/pcci-retrospective?menu=filter&filter=label:UniSprint42 | 11:54 |
bhagyashris | weshay|ruck, arxcruz akahat marios frenzy_friday pojadhav zbr chkumar|ruck soniya29 sshnaidm ysandeep ^ | 11:54 |
zbr | i am in program call, will join after | 12:10 |
*** sanjayu_ has joined #oooq | 12:10 | |
*** saneax has quit IRC | 12:12 | |
*** amoralej is now known as amoralej|lunch | 12:15 | |
rlandy | https://bugs.launchpad.net/tripleo/+bug/1921679 | 12:24 |
openstack | Launchpad bug 1921679 in tripleo "openstack: 'undercloud install' is not an openstack command. See 'openstack --help'." [Critical,Triaged] | 12:24 |
zbr | chkumar|ruck: https://github.com/ansible-community/ansible-lint/pull/1517 | 12:28 |
zbr | FYI, that may not fix our issue, only adds retries. It is likely to address it based on my experience | 12:29 |
zbr | everyone reported random errors with galaxy, especially in the recent weeks. | 12:29 |
zbr | but at least we will see in the logs if retries were performed. | 12:29 |
chkumar|ruck | zbr: yes, sounds good to me | 12:34 |
*** sanjayu_ has quit IRC | 12:42 | |
*** amoralej|lunch is now known as amoralej | 12:59 | |
weshay|ruck | chkumar|ruck, woot | 13:06 |
weshay|ruck | https://trello.com/c/xG38kCYe/1898-cixlp1922282tripleociproa-master-gnocchiclientexceptionsresourcetypenotfound-resource-type-image-does-not-exist-http-404 | 13:06 |
chkumar|ruck | zbr: weshay|ruck: rlandy frenzy_friday want to do a rr handoff? | 13:07 |
rlandy | chkumar|ruck: yes - pls | 13:07 |
chkumar|ruck | now? | 13:07 |
rlandy | now ok? | 13:07 |
chkumar|ruck | yes | 13:07 |
frenzy_friday | yep | 13:07 |
zbr | same meet id? | 13:08 |
weshay|ruck | https://meet.google.com/jpe-zayn-fhx | 13:08 |
weshay|ruck | ya | 13:08 |
chkumar|ruck | https://review.rdoproject.org/r/c/testproject/+/33138 | 13:18 |
chkumar|ruck | https://review.rdoproject.org/r/c/testproject/+/33122 | 13:21 |
chkumar|ruck | https://2b9c3acc2f2fe4180781-3849b03cfcb04d12316556dd4e593ed3.ssl.cf1.rackcdn.com/784197/1/gate/openstack-tox-linters/3c69524/job-output.txt | 13:23 |
chkumar|ruck | https://github.com/ansible-community/ansible-lint/pull/1517 | 13:24 |
chkumar|ruck | rlandy: https://review.rdoproject.org/r/c/testproject/+/33138 | 13:24 |
*** ratailor has quit IRC | 13:41 | |
chkumar|ruck | rlandy: frenzy_friday feel free to change the nicks | 13:52 |
*** chkumar|ruck is now known as raukadah | 13:52 | |
rlandy | yes | 13:52 |
*** rlandy is now known as rlandy|rover | 13:52 | |
raukadah | rlandy: I am going to pick up extended hash work | 13:52 |
rlandy|rover | choosing rover since weshay|ruck is on my timezone | 13:52 |
rlandy|rover | raukadah: yeah - left some comments there | 13:53 |
rlandy|rover | we can chat about what was there | 13:53 |
*** frenzy_friday is now known as anbanerj|ruck | 13:53 | |
rlandy|rover | some confusion on what you are defining as the extended_hash vs full_hash | 13:53 |
raukadah | rlandy|rover: I need to take a fresh look on that | 13:53 |
rlandy|rover | k- we ca chat tomorrow | 13:53 |
raukadah | let's chat on friday on this | 13:53 |
raukadah | or tomorrow after planning | 13:54 |
rlandy|rover | raukadah: ack - thanks | 14:01 |
weshay|ruck | raukadah, rlandy|rover ok.. fs001 is in tempest | 14:06 |
weshay|ruck | WELL DONE | 14:06 |
rlandy|rover | nice | 14:06 |
weshay|ruck | rlandy|rover, I'm going to kill integration jobs... | 14:06 |
weshay|ruck | and trigger main/master | 14:06 |
rlandy|rover | weshay|ruck: ack | 14:06 |
rlandy|rover | weshay|ruck: worth to kick victoria as well? | 14:06 |
weshay|ruck | after master | 14:07 |
rlandy|rover | ack | 14:07 |
raukadah | rlandy|rover: i need to update this patch https://review.opendev.org/c/openstack/tripleo-ci/+/785087 but once ovb finishes then | 14:14 |
raukadah | cgoncalves: please have a look at this patch https://review.opendev.org/c/openstack/diskimage-builder/+/785138 | 14:15 |
rlandy|rover | raukadah: is https://review.opendev.org/c/openstack/tripleo-ci/+/785087 and the DIB chnange required for ovb to pass or just the better solution? | 14:15 |
rlandy|rover | weshay|ruck, not yet - we sad only after check switches | 14:17 |
rlandy|rover | said | 14:17 |
raukadah | weshay|ruck: yes | 14:17 |
raukadah | rlandy|rover: yes | 14:17 |
rlandy|rover | raukadah: yes - as in ovb will fail until we merge https://review.opendev.org/c/openstack/tripleo-ci/+/785087 | 14:18 |
weshay|ruck | rlandy|rover, roger https://logserver.rdoproject.org/openstack-dependencies-containertools/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-standalone-container-tools-container-build-master/8e53654/logs/undercloud/etc/dnf/modules.d/container-tools.module.gz | 14:21 |
weshay|ruck | gets me every time | 14:21 |
rlandy|rover | weshay|ruck: putting in change to move the pipelibe | 14:21 |
rlandy|rover | we can merge that at any point | 14:21 |
rlandy|rover | weshay|ruck: ^^ iiuc, from above ovb will only pass with raukadah's two unmerged patches - so you plan to promote master w/o ovb? | 14:22 |
weshay|ruck | rlandy|rover, I may it's OLD | 14:24 |
rlandy|rover | weshay|ruck: ack ok | 14:24 |
weshay|ruck | rlandy|rover, let's see what happens in this run | 14:24 |
rlandy|rover | ack | 14:25 |
weshay|ruck | rlandy|rover, at any rate.. any reason not to flip container-tools back to rhel8? | 14:26 |
rlandy|rover | weshay|ruck: well at the moment, w/o check switching 3.0, https://review.opendev.org/c/openstack/tripleo-quickstart/+/785185/1/config/release/dependency_ci/container-tools/repo_config.yaml would do the following | 14:32 |
rlandy|rover | sudo dnf module enable container-tools:2.0 -y; | 14:32 |
rlandy|rover | sudo dnf module enable container-tools:3.0 -y; (which was NEVER enabled) | 14:32 |
rlandy|rover | sorry disable | 14:33 |
rlandy|rover | and the enable rhel8 | 14:33 |
rlandy|rover | so your patch is ok - once we switch check | 14:33 |
rlandy|rover | ^^ make sense? | 14:33 |
rlandy|rover | so hence I added the revert | 14:33 |
* rlandy|rover leaves comment | 14:34 | |
weshay|ruck | rlandy|rover, I think we merge the 3.0 to check as well.. but let's do that later today | 14:35 |
rlandy|rover | weshay|ruck: fine - once we merge that, we can merge your change | 14:36 |
raukadah | rlandy|rover: please update this review https://review.opendev.org/c/openstack/tripleo-ci/+/785087 once ovb jobs gives a green light | 14:37 |
raukadah | rlandy|rover: https://review.opendev.org/c/openstack/tripleo-ci/+/785087/4/roles/oooci-build-images/vars/centos-7.yaml | 14:38 |
rlandy|rover | raukadah: sure - removing that | 14:38 |
raukadah | rlandy|rover: https://opendev.org/openstack/tripleo-ci/src/branch/master/roles/oooci-build-images/templates/build-images.sh.j2#L61 condoitional needs to be fixed | 14:38 |
raukadah | otherwise it will break c7 part | 14:38 |
rlandy|rover | raukadah: just remove https://review.opendev.org/c/openstack/tripleo-ci/+/785087/4/roles/oooci-build-images/vars/centos-7.yaml#7 | 14:39 |
raukadah | it is defined always now but value should be null or empty | 14:39 |
raukadah | it will break c7 | 14:39 |
raukadah | as it is now in default | 14:40 |
rlandy|rover | raukadah: why not just remove that? | 14:40 |
raukadah | rlandy|rover: https://review.opendev.org/c/openstack/tripleo-ci/+/785087/4/roles/oooci-build-images/defaults/main.yaml | 14:41 |
rlandy|rover | oh | 14:41 |
rlandy|rover | defaults always get taken | 14:41 |
rlandy|rover | got it | 14:41 |
rlandy|rover | updating | 14:42 |
raukadah | rlandy|rover: may be using |length > 0 | 14:42 |
raukadah | will fix the issue in the .sh script | 14:43 |
rlandy|rover | raukadah: ack - got that change ... {% if dib_dnf_module_streams is defined and dib_dnf_module_streams|length > 0 %} | 14:46 |
rlandy|rover | will commit when results come in | 14:46 |
ysandeep | weshay|ruck, sshnaidm: hey o/ When you have time, Ovb cleanup script looks in good shape now: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/31410 , fyi.. After multiple tries in local system, I gave a shot at cleaning OVB resources in psi internal with dry-run first(for safety) and then without, Results are good http://pastebin.test.redhat.com/953563, Created one ticket for infra as well. | 14:49 |
ysandeep | weshay|ruck: if you okay with this change, I would like to run this for internal first for couple of days before running this for vexx cloud. | 14:49 |
zbr | weshay|ruck: rlandy|rover: do you know why a change that modifies only a file mentioned in irrelevant-files does still run deployments? https://review.opendev.org/c/openstack/tripleo-ansible/+/a | 14:50 |
zbr | https://opendev.org/openstack/tripleo-ci/src/branch/master/zuul.d/base.yaml#L143 | 14:50 |
zbr | i checked the chain and that is the only place where these are defined, but still i see job being run. | 14:51 |
rlandy|rover | raukadah: this is ready to merge? (with reviews) https://review.opendev.org/c/openstack/diskimage-builder/+/785138 | 14:53 |
raukadah | rlandy|rover: yes | 14:56 |
*** ysandeep is now known as ysandeep|dinner | 15:00 | |
*** kopecmartin has quit IRC | 15:01 | |
*** kopecmartin has joined #oooq | 15:01 | |
*** skramaja has quit IRC | 15:02 | |
weshay|ruck | ysandeep|dinner, comments | 15:02 |
raukadah | ovb passed, waiting to log collection | 15:22 |
rlandy|rover | raukadah: ack - submitting patch and rerunning | 15:25 |
raukadah | rlandy|rover: few mins please | 15:25 |
rlandy|rover | yep - collecting logs | 15:26 |
*** jpodivin has quit IRC | 15:28 | |
rlandy|rover | weshay|ruck: ysandeep|dinner: depending on how ovb goes, looking to promote 16.2 | 15:33 |
rlandy|rover | very old | 15:33 |
weshay|ruck | rlandy|rover, that line is stuck | 15:34 |
weshay|ruck | oh maybe not | 15:34 |
weshay|ruck | 17 is stuck | 15:34 |
weshay|ruck | 16.2 looks ok | 15:34 |
rlandy|rover | 3h26 mins | 15:35 |
rlandy|rover | looks ok | 15:35 |
rlandy|rover | 19 hr 36 min is stuck | 15:36 |
raukadah | rlandy|rover: weshay|ruck https://review.rdoproject.org/zuul/build/6582fb8afa2a44c6a806bb2545a9fadf | 15:36 |
rlandy|rover | yep | 15:36 |
raukadah | ovb fs01 passed | 15:36 |
raukadah | rlandy|rover: please update the patch and get all merged | 15:36 |
weshay|ruck | raukadah, rock | 15:36 |
raukadah | make ovb green again | 15:36 |
rlandy|rover | raukadah: new patch submitted | 15:36 |
rlandy|rover | https://review.opendev.org/c/openstack/tripleo-ci/+/785087 | 15:36 |
raukadah | rlandy|rover: https://review.opendev.org/c/openstack/diskimage-builder/+/785138 this also | 15:37 |
rlandy|rover | raukadah: ack - I only have +1 there | 15:37 |
rlandy|rover | cgoncalves: ^^ do you have +2 permissions on DIB? | 15:38 |
rlandy|rover | ian w is on pto | 15:39 |
raukadah | clark might be rights there | 15:39 |
weshay|ruck | raukadah, ian is pto | 15:39 |
rlandy|rover | lon submitted the original change | 15:39 |
rlandy|rover | will see if he has permissions | 15:40 |
*** ykarel is now known as ykarel|away | 15:41 | |
raukadah | weshay|ruck: https://review.opendev.org/admin/groups/5a043d844578a5be3e3024fb3f7becca64c60a74,members | 15:41 |
raukadah | weshay|ruck: we can ask infra-core to merge it | 15:41 |
rlandy|rover | cgoncalves is core | 15:42 |
* cgoncalves feels under pressure | 15:43 | |
rlandy|rover | sorry | 15:43 |
rlandy|rover | raukadah: rekicked testproject | 15:47 |
*** ykarel|away has quit IRC | 16:02 | |
*** sshnaidm is now known as sshnaidm|afk | 16:06 | |
*** udesale has quit IRC | 16:17 | |
*** ysandeep|dinner is now known as ysandeep | 16:28 | |
*** jmasud has joined #oooq | 16:31 | |
*** marios is now known as marios|out | 16:31 | |
*** jbadiapa has quit IRC | 16:34 | |
weshay|ruck | rlandy|rover, for wallaby+ | 16:36 |
weshay|ruck | We need to remove these two lines in the tripleo-ci job definition [1] | 16:36 |
weshay|ruck | but only for Wallaby and newer. | 16:36 |
weshay|ruck | [1] https://github.com/openstack/tripleo-ci/blob/master/zuul.d | 16:36 |
weshay|ruck | lp: 1922784 | 16:36 |
openstack | Launchpad bug 1922784 in tripleo "Wallaby: periodic-tripleo-ci-centos-8-scenario004-standalone-wallaby is failing manila_tempest_tests.tests.api.test_shares.SharesNFSTest setup" [Critical,Triaged] https://launchpad.net/bugs/1922784 | 16:36 |
rlandy|rover | weshay|ruck: ack - will do | 16:37 |
weshay|ruck | danka | 16:37 |
rlandy|rover | just creating previous-current-tripleo for wallaby | 16:37 |
rlandy|rover | ta da ... https://trunk.rdoproject.org/centos8-wallaby/previous-current-tripleo/delorean.repo.md5 | 16:39 |
rlandy|rover | repo-promote-batch | 16:39 |
rlandy|rover | weshay|ruck: http://pastebin.test.redhat.com/953652 lots of typing but it works | 16:40 |
weshay|ruck | rlandy|rover, we need to write a script to write that out for us.. and throw it into ci-config/ci-scripts | 16:46 |
rlandy|rover | weshay|ruck: yeah - the dlrn repo file holds commit_{part of ditro} | 16:47 |
rlandy|rover | so you have to reference the repo per component to get the rest | 16:47 |
rlandy|rover | will think on it after scen004 fix | 16:48 |
rlandy|rover | btw container-tools:3.0 in check was w+'ed | 16:48 |
rlandy|rover | not by us | 16:48 |
rlandy|rover | so it's merging anyways | 16:48 |
rlandy|rover | then we can merge your dpe line change | 16:48 |
*** marios|out has quit IRC | 16:49 | |
rlandy|rover | lunch - back in 10 | 16:51 |
weshay|ruck | master is a bust | 16:51 |
rlandy|rover | weshay|ruck: we need the two patch raukadah was working on | 16:54 |
rlandy|rover | testproject rekicked with lastest change | 16:54 |
weshay|ruck | oh.. I'll need to force promote a few components in master | 16:54 |
weshay|ruck | rlandy|rover, that's ovb https://review.rdoproject.org/r/c/testproject/+/33138 | 16:55 |
rlandy|rover | yep | 16:55 |
rlandy|rover | weshay|ruck: made an update to raukadah patch | 16:55 |
rlandy|rover | the DIB patch should be ready | 16:56 |
rlandy|rover | weshay|ruck: wallaby is actually ahead of master at this point | 16:56 |
rlandy|rover | as we only added component criteria yesterday | 16:56 |
rlandy|rover | was just promoting all components | 16:56 |
weshay|ruck | I'm going to promote masters, tripleo and cloud-ops | 16:57 |
*** rlandy|rover is now known as rlandy|rover|lch | 16:58 | |
rlandy|rover|lch | ok | 16:58 |
rlandy|rover|lch | nothing to lose atm | 16:58 |
rlandy|rover|lch | brb | 16:58 |
*** derekh has quit IRC | 17:00 | |
weshay|ruck | killing the master line | 17:07 |
*** jpena is now known as jpena|off | 17:08 | |
ysandeep | weshay|ruck sshnaidm|afk ++ thank you for reviewing and merging ovb cleanup script , I will work next on deployment of this script using infra-setup role. | 17:13 |
weshay|ruck | ysandeep, perfect | 17:13 |
*** amoralej is now known as amoralej|off | 17:14 | |
ysandeep | rlandy|rover|lch, 16.2 ovb jobs hits infra issue.. baremetal failed due to tempest | 17:15 |
*** ysandeep is now known as ysandeep|away | 17:16 | |
*** rlandy|rover|lch is now known as rlandy|rover | 17:19 | |
rlandy|rover | ysandeep|away: thanks - will take care of that later | 17:19 |
rlandy|rover | weshay|ruck: hmm - we have two job definitions by the same name :( | 17:25 |
rlandy|rover | https://github.com/openstack/tripleo-ci/blob/master/zuul.d/standalone-jobs.yaml#L629 | 17:25 |
rlandy|rover | https://github.com/openstack/tripleo-ci/blob/master/zuul.d/standalone-jobs.yaml#L658 | 17:25 |
* rlandy|rover fixes periodic | 17:26 | |
rlandy|rover | first easier | 17:26 |
weshay|ruck | ok.. had to rev from consistent.. but we have the patches now https://trunk.rdoproject.org/centos8-master/component/tripleo/promoted-components/ | 17:36 |
weshay|ruck | requeued master | 17:37 |
weshay|ruck | so we'll get https://review.opendev.org/c/openstack/tripleo-heat-templates/+/784969 https://review.opendev.org/c/openstack/tripleo-heat-templates/+/784971 https://review.opendev.org/c/openstack/puppet-tripleo/+/785076/ | 17:37 |
weshay|ruck | and we should see.. | 17:37 |
weshay|ruck | periodic-tripleo-ci-centos-8-scenario001-standalone-masterSUCCESS 1h 33m 12s | 17:37 |
weshay|ruck | periodic-tripleo-ci-centos-8-scenario002-standalone-masterSUCCESS 1h 28m 02s | 17:37 |
weshay|ruck | rlandy|rover, we'll need to at least rerun https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-16.2/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-bm_envD-3ctlr_1comp-featureset035-rhos-16.2/6d3a7ee/ | 17:42 |
weshay|ruck | for 16.2 | 17:42 |
rlandy|rover | ack | 17:42 |
rlandy|rover | hmmm - we never sorted the same job definition on diff branches? | 17:43 |
weshay|ruck | rlandy|rover, w/ regards to scenario007? | 17:43 |
rlandy|rover | scen004 | 17:43 |
weshay|ruck | oh 4.. right | 17:43 |
rlandy|rover | so we need either a new naming scheme | 17:44 |
rlandy|rover | there is no wat in zuul to switch case var usage | 17:44 |
rlandy|rover | we have to parent one level more | 17:44 |
weshay|ruck | ya.. this sucks | 17:44 |
rlandy|rover | which is ok of we are only relying on templates | 17:44 |
rlandy|rover | but ... | 17:44 |
rlandy|rover | periodic is easier to fix | 17:45 |
rlandy|rover | https://codesearch.opendev.org/?q=tripleo-ci-centos-8-scenario004-standalone&i=nope&files=&excludeFiles=&repos= | 17:45 |
rlandy|rover | weshay|ruck: ^^ called in other places | 17:45 |
rlandy|rover | plus https://github.com/rdo-infra/rdo-jobs/search?q=tripleo-ci-centos-8-scenario004-standalone | 17:46 |
rlandy|rover | so I can fix this with another level of parenting and a new name adding to templates | 17:46 |
rlandy|rover | but those outside of templates will also have to be fixed | 17:46 |
*** slaweq has quit IRC | 17:47 | |
rlandy|rover | weshay|ruck: hey - have a moment to chat abut the scenario004 design options | 18:12 |
weshay|ruck | in a min.. talking to kevin atm | 18:12 |
*** jmasud has quit IRC | 18:39 | |
weshay|ruck | rlandy|rover, ok.. that took longer than I thought | 19:13 |
weshay|ruck | rlandy|rover, available | 19:13 |
rlandy|rover | weshay|ruck: k ... | 19:13 |
rlandy|rover | meet.google.com/ukv-hdko-cyj | 19:13 |
*** jmasud has joined #oooq | 19:26 | |
weshay|ruck | rlandy|rover, https://logserver.rdoproject.org/openstack-component-manila/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario004-standalone-manila-master/2c85452/logs/undercloud/var/log/tempest/tempest_run.log.txt.gz | 19:27 |
*** matbu has quit IRC | 19:27 | |
*** jmasud has quit IRC | 19:40 | |
rlandy|rover | weshay|ruck: email sent o openstack-discuss | 19:48 |
*** slaweq has joined #oooq | 19:53 | |
anbanerj|ruck | rlandy|rover, we didnt push any patch for wallaby periodic jobs (https://opendev.org/openstack/tripleo-ci/src/branch/master/zuul.d/periodic.yaml) yet, right? I didnt find any on scrum board. | 19:57 |
rlandy|rover | anbanerj|ruck: no - none existed | 19:57 |
anbanerj|ruck | thanks. adding now | 19:57 |
weshay|ruck | rlandy|rover, ok.. scenario01/02 passes in master.. I'll check wallaby | 20:16 |
rlandy|rover | weshay|ruck: nice | 20:16 |
weshay|ruck | missing | 20:18 |
weshay|ruck | promoting tripleo component | 20:18 |
rlandy|rover | https://review.opendev.org/c/openstack/manila/+/785270 WIP: Set snapshot_support capabilties to false - t->u->v [NEW] | 20:21 |
rlandy|rover | let's see if this works | 20:21 |
rlandy|rover | test projecting | 20:21 |
weshay|ruck | rlandy|rover, wallaby dlrn api endpoint is down | 20:22 |
weshay|ruck | or not api_url: https://trunk.rdoproject.org/api-centos8-wallaby | 20:22 |
weshay|ruck | did you use something else? | 20:22 |
rlandy|rover | getting ... | 20:22 |
rlandy|rover | dlrnapi --url https://trunk.rdoproject.org/api-centos8-wallaby | 20:22 |
weshay|ruck | ya.. not up | 20:22 |
rlandy|rover | worked earlier | 20:22 |
rlandy|rover | how I created previous-current-tripleo | 20:23 |
rlandy|rover | can you paste the failure? | 20:23 |
weshay|ruck | 404 | 20:23 |
rlandy|rover | lol | 20:23 |
rlandy|rover | the command that got you the 404 | 20:24 |
rlandy|rover | can't do much with the number | 20:24 |
* rlandy|rover checks | 20:24 | |
gouthamr | rlandy|rover: https://review.opendev.org/c/openstack/manila/+/785270 touches a post_test_hook that's for devstack gate - is that invoked in tripleo jobs? | 20:24 |
rlandy|rover | gouthamr: ah - no | 20:25 |
rlandy|rover | I was just looking where that was defined | 20:25 |
rlandy|rover | let me rework that | 20:25 |
rlandy|rover | gouthamr: there is no neat way to exclude tempest options in a job that runs on multiple branches | 20:26 |
*** jmasud has joined #oooq | 20:27 | |
*** dmellado has quit IRC | 20:27 | |
gouthamr | ah, https://github.com/openstack/manila-tempest-plugin/blob/b3089a7ee3da99cc249e4d5bf3e4bad353116877/manila_tempest_tests/config.py#L111-L117 is where that config opt is defined, and it defaults to the value of snapshot_support for legacy reasons: https://github.com/openstack/manila-tempest-plugin/blob/369391a8a4996a310a52f5d5939a27acc875d8c1/manila_tempest_tests/plugin.py#L39-L53 | 20:27 |
gouthamr | rlandy|rover: oh :( not even with job variants? | 20:27 |
rlandy|rover | https://opendev.org/openstack/manila-tempest-plugin/src/branch/master/manila_tempest_tests/config.py#L106 | 20:28 |
rlandy|rover | ^^ file | 20:28 |
rlandy|rover | no defaults there | 20:28 |
*** dmellado has joined #oooq | 20:29 | |
rlandy|rover | we could add defaults per branch | 20:29 |
gouthamr | in the test config? manila-tempest-plugin is also branch agnostic | 20:29 |
rlandy|rover | gouthamr: if we want to keep the job name and run with diff options in diff branches, we don't have a clean zuul-only solution | 20:30 |
rlandy|rover | zuul vars do not take conditionals | 20:31 |
rlandy|rover | we would have to utilize another settings file | 20:31 |
gouthamr | rlandy|rover: i see, i was thinking job variants can solve this | 20:31 |
rlandy|rover | so was I | 20:31 |
dmellado | well, in theory you could add tempest plugin features at any given branch, thus the branchless thing, just my 2 cents | 20:32 |
rlandy|rover | gouthamr: the periodic jobs are easy enough to fix | 20:33 |
rlandy|rover | their inheritance is clear on a per branch basis | 20:33 |
rlandy|rover | the check jobs run across branches | 20:33 |
gouthamr | rlandy|rover: noob question, where are these periodic jobs defined? | 20:33 |
rlandy|rover | https://github.com/rdo-infra/rdo-jobs | 20:34 |
gouthamr | thank you ^ | 20:34 |
rlandy|rover | dmellado: what are you proposing? | 20:34 |
dmellado | probably missed some part of the conversation but just was stating that if you need to enable/disable specific tests per branch | 20:35 |
dmellado | I would just set those features per branch/job over configuring the plugin | 20:35 |
rlandy|rover | we can skip tests per branch | 20:37 |
rlandy|rover | so if the features are disabled, just skip the tests on those branches? | 20:37 |
dmellado | yep, those tests just won't be running | 20:38 |
*** spotz has quit IRC | 20:38 | |
dmellado | that's the idea behind tempest being branchless | 20:38 |
rlandy|rover | https://review.opendev.org/c/openstack/tripleo-ci/+/785254/5/zuul.d/standalone-jobs.yaml - re-enables the snapshot capabilties | 20:38 |
*** anbanerj|ruck is now known as anbanerj | 20:39 | |
*** anbanerj is now known as anbanerj|ruck | 20:39 | |
*** tbarron has joined #oooq | 20:40 | |
tbarron | rlandy|rover: hi | 20:40 |
rlandy|rover | tbarron: hi ... | 20:40 |
* tbarron didn't have enuf channels | 20:41 | |
rlandy|rover | so - per https://bugs.launchpad.net/tripleo/+bug/1922784/comments/4, | 20:41 |
openstack | Launchpad bug 1922784 in tripleo "Wallaby: periodic-tripleo-ci-centos-8-scenario004-standalone-wallaby is failing manila_tempest_tests.tests.api.test_shares.SharesNFSTest setup" [Critical,Triaged] | 20:41 |
dmellado | rlandy|rover: that'd be making it run such tests again | 20:41 |
rlandy|rover | https://review.opendev.org/c/openstack/tripleo-ci/+/785254/5/zuul.d/standalone-jobs.yaml | 20:41 |
tbarron | somebody put dmellado under house arrest | 20:41 |
dmellado | hey tbarron | 20:41 |
dmellado | xD | 20:41 |
dmellado | covid did xD | 20:41 |
rlandy|rover | sets the capability_snapshot_support tempest options to true | 20:42 |
rlandy|rover | as is the default | 20:42 |
rlandy|rover | there is no clean zuul way to separate those te,pest options per branch | 20:42 |
rlandy|rover | w/o changing the job name or parenting | 20:42 |
tbarron | can we make two jobs, etc. | 20:42 |
tbarron | hmm | 20:42 |
rlandy|rover | we can - not with the same name | 20:42 |
rlandy|rover | so | 20:42 |
rlandy|rover | looking at other options, | 20:43 |
rlandy|rover | dmellado suggests we just add failing tests in releases t->v to the tempest skiplist | 20:43 |
rlandy|rover | that way we keep the naming and parenting nice and clean | 20:43 |
tbarron | gouthamr: ^^ you may already be following? I just joined. | 20:43 |
gouthamr | ^ we only have one test, so that would be futile | 20:43 |
rlandy|rover | (periodic jobs are a much smaller issue - we can change the options there) | 20:44 |
rlandy|rover | or | 20:44 |
rlandy|rover | if that is not a soltion, | 20:44 |
rlandy|rover | we can add the tempest option to another settings file | 20:44 |
rlandy|rover | (not ideal) | 20:44 |
rlandy|rover | tbarron: gouthamr: so the question revolves around if there is any value in the tests that would run with the snapshot options disabled in releases t->v | 20:45 |
tbarron | rlandy|rover: the problem is in the setup class, really affects all tests | 20:46 |
gouthamr | tbarron: yep, trying to read through the tripleo-ci code; the tempest options are nested under something here unlike devstack-jobs, so that *may* be one problem with using a job variant like rlandy|rover attempted | 20:46 |
tbarron | and we're just running one test here, but whichever one we pick as a "ping" test would likely be affected | 20:46 |
rlandy|rover | well, let me start by fixing the periodic jobs - those are easy enough | 20:47 |
gouthamr | irony is that the test case that's being executed isn't testing snapshots (or clones) at all | 20:47 |
gouthamr | rlandy|rover: would that resolve the CiX issue? | 20:47 |
rlandy|rover | gouthamr: it would as the CIX is logged against periodics ... BUT | 20:48 |
gouthamr | rlandy|rover: so we can take some time to think about the scenario004 job? | 20:48 |
rlandy|rover | as soon as we promote, the issue will hit tripleo-ci jobs in check | 20:48 |
gouthamr | oh, thanks that makes sense | 20:49 |
rlandy|rover | gouthamr: k - putting up those changes and we can rethink this tomorrow | 20:49 |
rlandy|rover | to be clear, there are CI solutions | 20:49 |
rlandy|rover | they are just not so pretty | 20:49 |
gouthamr | ack, ty for working on this and explaining this rlandy|rover | 20:50 |
tbarron | rlandy|rover: yes, thanks much | 20:50 |
rlandy|rover | https://review.opendev.org/c/openstack/tripleo-ci/+/785254 | 20:50 |
rlandy|rover | ^^ leaving that in -1 until we re-discuss | 20:50 |
rlandy|rover | will add you both to the periodics review | 20:51 |
rlandy|rover | thanks for joining in this dicussion | 20:51 |
gouthamr | tbarron: lkuchlan started a patch to rid ourselves of some forced extra-specs (snapshot_support and create_share_from_snapshot_support) - i thought we could wait until PTG to work on those, but i think we can go back to investigating that and seeing if that will fix this issue | 20:51 |
gouthamr | rlandy|rover ++ | 20:51 |
tbarron | gouthamr: +1 | 20:52 |
*** dsneddon has quit IRC | 20:53 | |
*** matbu has joined #oooq | 20:56 | |
*** jmasud has quit IRC | 21:29 | |
rlandy|rover | weshay|ruck: ha - master is much cleaner | 21:37 |
rlandy|rover | other than ovb | 21:37 |
rlandy|rover | try promote wallaby components again? | 21:37 |
rlandy|rover | tbarron: gouthamr: so adding the failing test to the skip list will be an option ... see https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario004-standalone-wallaby/0f491bc/logs/undercloud/var/log/tempest/tempest_results.xml.gz | 21:40 |
rlandy|rover | only the tempest.scenario.test_network_basic_ops.TestNetworkBasicOps test will run | 21:40 |
rlandy|rover | on periodic, https://review.rdoproject.org/r/c/rdo-jobs/+/33151, manila_tempest_tests.tests.api.test_shares.SharesNFSTest will run on all branches | 21:40 |
rlandy|rover | the test will fail and could be skipped in check only on t-> v | 21:41 |
rlandy|rover | not a great solution but a workable one | 21:41 |
tbarron | rlandy|rover: long run we want to run manila tests in scenario004 though | 21:41 |
rlandy|rover | I get that | 21:41 |
tbarron | rlandy|rover: but as a band aid, cool | 21:41 |
tbarron | rlandy|rover: just getting on record :) | 21:41 |
rlandy|rover | we have a day or so to work it out | 21:41 |
rlandy|rover | running testproject job on the periodics to confirm | 21:42 |
tbarron | rlandy|rover: skipping is fine as a stopgap | 21:42 |
rlandy|rover | always | 21:43 |
rlandy|rover | agreed | 21:43 |
*** jmasud has joined #oooq | 21:44 | |
*** slaweq has quit IRC | 21:57 | |
*** rlandy|rover is now known as rlandy|rover|bbl | 22:34 | |
*** jmasud has quit IRC | 22:53 | |
*** jmasud has joined #oooq | 23:01 | |
*** tosky has quit IRC | 23:11 | |
*** jmasud has quit IRC | 23:42 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!