Monday, 2022-01-10

*** ysandeep|out is now known as ysandeep05:35
*** amoralej|off is now known as amoralej06:59
*** ysandeep is now known as ysandeep|afk07:05
sshnaidmrlandy|out rcastillo|rover arxcruz|ruck fyi https://github.com/ansible-community/ansible-lint/issues/179507:34
*** ysandeep|afk is now known as ysandeep08:36
*** jpena|off is now known as jpena08:51
arxcruz|rucksshnaidm: ack, thanks 08:57
chandankumarsshnaidm: marios https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/822783 and https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/822897 please have a look, when free, thanks!10:33
marioschandankumar: o/ adding to my list for next reviews 10:35
*** ysandeep is now known as ysandeep|coffee11:08
*** rlandy|out is now known as rlandy|ruck11:16
rlandy|rucksshnaidm: thanks - zbr still responding to our linter issues11:17
arxcruz|ruckbrb11:17
rlandy|ruckarxcruz|ruck: when you are back - how are things today?11:17
rlandy|ruckchandankumar: joined review time11:18
sshnaidmrlandy|ruck, yeah? where?11:18
*** dviroel|afk is now known as dviroel11:22
arxcruz|ruckrlandy|ruck: want to sync?11:30
rlandy|ruckarxcruz|ruck: talking with chandankumar - will ping you in a few11:30
rlandy|ruckbhagyashris: can you check on why victoria has not promoted11:30
bhagyashrisrlandy|ruck, fs002 is failing 11:31
arxcruz|ruckrlandy|ruck: ok, i'll just throw the garbage and brb 11:31
rlandy|ruckbhagyashris: how many hashes are you checking11:31
rlandy|ruckwe had a good run yesterday11:31
bhagyashrisrlandy|ruck, 100 hashes11:32
bhagyashrisrlandy|ruck, i have checked the hash that you point out in an email 11:33
bhagyashrisand it's saying fs002 is missing11:33
bhagyashrisi have changed the criteria file as well11:34
arxcruz|ruckrlandy|ruck: i'm back 11:53
*** ysandeep|coffee is now known as ysandeep11:54
rlandy|ruckysandeep: hey 11:54
ysandeeprlandy|ruck, hello o/11:54
rlandy|ruckysandeep: updated train tripleo component should have reached downstream11:54
rlandy|ruckysandeep: so glance is still outstanding?11:55
rlandy|rucklast of them?11:55
rlandy|ruckarxcruz|ruck: yeah - let's meet11:55
ysandeeprlandy|ruck, yes only glance is outstanding one11:55
rlandy|ruckysandeep: k - still one patch outstanding11:56
ysandeeprlandy|ruck, storage team is trying to merge those patches - downstream check ci is unstable right now, they didn't have green run on those patches yet.11:56
rlandy|ruckbhagyashris: k - I see arxcruz|ruck rerun a newer hash11:57
bhagyashrisrlandy|ruck, ack11:57
rlandy|ruckarxcruz|ruck: https://meet.google.com/wcv-cdmr-nvs?pli=1&authuser=011:57
rlandy|ruckarxcruz|ruck: https://bugzilla.redhat.com/show_bug.cgi?id=203099312:01
chandankumardviroel: rcastillo|rover fyi! https://bugs.launchpad.net/tripleo/+bug/1956946 cc rlandy|ruck sshnaidm 12:01
chandankumarproposing a fix12:01
*** akahat_ is now known as akahat12:02
dviroelchandankumar: oh, I was looking at it on friday, we need dlrn update on pip12:04
dviroelamoralej: hi o/12:04
amoralejhi dviroel 12:04
dviroelamoralej: can you help us providing an update to dlrn on pypi?12:04
dviroelamoralej: https://pypi.org/project/DLRN/#history12:04
dviroelamoralej: doesn't have centos9 updates that you provided in repo12:05
amoralejmmmm, i don't think so12:05
chandankumardviroel: oh, is it, I was proposing to making it execlusive for compose repo12:05
amoraleji mean, i can't12:05
dviroelchandankumar: centos9.cfg is missing, so thats why it fails, no config file12:06
rlandy|rucksshnaidm: https://review.opendev.org/c/openstack/tripleo-ci/+/823937 - mergeable?12:07
sshnaidmrlandy|ruck, yes12:10
rlandy|ruckarxcruz|ruck: https://trello.com/c/3fTSmfNp/2275-cixlp1956233tripleociproa-master-neutrontempestpluginscenariotesttrunktrunktesttesttrunksubportlifecycle-is-failing-runtimeerror12:15
arxcruz|ruckrlandy|ruck: https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/82397412:21
chandankumardviroel: temp fix https://review.opendev.org/c/openstack/tripleo-quickstart/+/82397512:24
dviroelchandankumar: ack12:25
soniya29chandankumar, rlandy|ruck, can we workflow this patch:- https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/815654 ?12:28
rlandy|rucksoniya29: ack - I already voted - chandankumar pls be core number two on that12:29
soniya29rlandy|ruck, thanks!12:30
chandankumarsoniya29: check comments https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/815654/4#message-19840fb1a65859fb91c9c008efa883ddb5bf2f3812:36
jfrancoarlandy|ruck: hey, good morning and happy new year!  I was wondering, as you are ruck...has anybody reported this failure in linters/pep8 http://pastebin.test.redhat.com/1019957 ?12:43
jfrancoarlandy|ruck: it's the second time I see it today12:43
jfrancoain different patches and different jobs...12:44
rlandy|ruckjfrancoa: hey  - happy new year12:53
rlandy|ruckjfrancoa: https://github.com/ansible-community/ansible-lint/pull/179712:53
rlandy|ruckjfrancoa: and then https://review.opendev.org/c/openstack/tripleo-ci/+/82393712:54
ysandeepjfrancoa, rlandy|ruck https://bugs.launchpad.net/tripleo/+bug/1956902 12:55
jfrancoarlandy|ruck: ysandeep thanks a lot folks!12:56
rlandy|rucksshnaidm; https://bugs.launchpad.net/tripleo/+bug/1956902/comments/212:56
sshnaidmrlandy|ruck, oh, finally..12:57
sshnaidmseems like in ansible-lint didn't hear about pinning versions12:57
jfrancoaif it has been released? is it safe to recheck? or better to wait?12:58
rcastillo|rovergood morning #oooq!12:59
sshnaidmjfrancoa, we have ansible-lint pinned in repos, so now need to update all to 5.3.2 version :/13:00
jfrancoasshnaidm: ouch...I see. I'll wait for recheck then. let me know if you need help with the reviews 13:01
arxcruz|ruckrlandy|ruck: rcastillo|rover https://hackmd.io/OeHukWRuSSuRTtq3Fb7akw13:01
rlandy|ruckrcastillo|rover: hey - pls see list of failing component jobs: ^^13:02
rcastillo|roverarxcruz|ruck: rlandy|ruck looking13:02
rlandy|rucktrain ipa13:02
rlandy|ruckand standalone upgrade in master we know are failing 13:02
rlandy|ruckrcastillo|rover: ^^13:03
arxcruz|ruckrlandy|ruck: removing 13:03
arxcruz|ruckrcastillo|rover: rlandy|ruck is testing the kvm network 13:04
*** amoralej is now known as amoralej|lunch13:04
sshnaidmrlandy|ruck, https://review.rdoproject.org/r/q/topic:%22a-lint%22+(status:open%20OR%20status:merged) and https://review.opendev.org/q/topic:%22a-lint%22+(status:open%20OR%20status:merged)13:08
rlandy|ruckrcastillo|rover: arxcruz|ruck: https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/status ussuri component internal is still failing13:16
rlandy|ruckwe need some investigation there13:16
rlandy|rucksshnaidm: let's review all of those at scrum13:17
rlandy|ruckbhagyashris: ^^ pls add to beginning of scrum13:17
*** pojadhav is now known as pojadhav|dr_appt13:17
rlandy|ruckjm1: hey - if you want to join the DF meeting today - will introduce you 3pm UTC13:18
rlandy|ruckarxcruz|ruck: you ok to present at the CIX call?13:19
rlandy|ruckwill join as well13:19
rlandy|ruckrcastillo|rover: https://meet.google.com/zmr-mhnz-cmu?pli=1&authuser=0  - can chat with you for a few13:19
rcastillo|roverrlandy|ruck: joining13:20
jm1rlandy|ruck: sure :)13:20
arxcruz|ruckrlandy|ruck: sure 13:23
rlandy|ruckrcastillo|rover: https://github.com/rdo-infra/ci-config/tree/master/ci-scripts/dlrnapi_promoter/config/CentOS-8/component13:25
arxcruz|ruckrlandy|ruck: the twwo victoria jobs passes 13:25
arxcruz|rucknow waiting the pending ones 13:25
rlandy|ruckarxcruz|ruck: great13:25
chandankumarsoniya29: thank you for filing this bug https://bugs.launchpad.net/tripleo/+bug/1956959 we are seeing this on cs9 full tempest api13:38
chandankumarI am waiting for the current to finish to confrim it still exists or not13:39
soniya29chandankumar, thanks, who can be a good contact person for this bug?13:39
chandankumarsoniya29: check with cinder team13:40
chandankumarmay be rajat13:40
soniya29chandankumar, okay, i will check with him13:40
chandankumaror abishop13:40
chandankumaron tripleo channel13:40
frenzy_fridayrlandy|ruck, hey. periodic-tripleo-ci-centos-9-scenario010-kvm-internal-standalone-master is still timing out in tempest tests. I could not see any errors in tempest run log13:41
rlandy|ruckfrenzy_friday: hey let's look after DF call13:42
rlandy|ruckfrenzy_friday: otherwise, I'll look in my afternoon and comment13:42
frenzy_fridaycool, thanks13:43
bhagyashrisrlandy|ruck, ack13:44
soniya29rlandy|ruck, ovb job failure over centos-8 is a known issue right?13:44
rlandy|rucksoniya29: which ovb failure?13:44
rlandy|rucksoniya29: that error should be fixed on all branches except victoria13:56
soniya29rlandy|ruck, which one?13:58
dasmo/14:00
bhagyashrisakahat, arxcruz|ruck rlandy|ruck rcastillo|rover dviroel chandankumar pojadhav|dr_appt soniya29 ysandeep 14:00
bhagyashrisscrum time14:00
rlandy|rucksoniya29: https://bugs.launchpad.net/tripleo/+bug/195644114:00
bhagyashrisrlandy|ruck, chandankumar ^14:01
bhagyashrissoniya29, ^14:01
*** amoralej|lunch is now known as amoralej14:01
soniya29bhagyashris, i am in secure-rbac meeting14:01
soniya29i will join late14:01
bhagyashrisreview list14:03
bhagyashrishttps://review.opendev.org/q/topic:%22a-lint%22+(status:open%20OR%20status:merged)14:03
bhagyashrishttps://review.rdoproject.org/r/q/topic:%22a-lint%22+(status:open%20OR%20status:merged)14:03
akahathttps://review.opendev.org/c/openstack/tripleo-ci/+/82085214:14
marioschandankumar: sorry if i missed it mate but did you update status for fs2? is it good now or are we still timing out for tempest? do we have a bug for it ?14:19
chandankumarmarios: Yes, I have updated the status on fs02, fs02 is failing at different tempest tests, and I am working on getting dib patch in14:20
chandankumarthere is no bug filed yet14:20
marioschandankumar: ack thanks14:22
marioschandankumar: fs1 from last wednesday https://logserver.rdoproject.org/67/36267/44/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-master/a1a7959/logs/undercloud/var/log/tempest/stestr_results.html.gz (https://review.rdoproject.org/r/c/testproject/+/36267/44#message-60ec0010011625dd3a2d5ea3a5349b6030f88968 )14:22
mariosfyi 14:22
chandankumarmarios: this bug https://bugs.launchpad.net/tripleo/+bug/1956959 has some similar tempest failure14:25
chandankumarwhich are coming in fs01 failures also14:25
chandankumarVolume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots or be disassociated from snapshots after volume transfer.14:26
chandankumarsoniya29: is looking into that14:26
bhagyashrishttps://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/81565414:31
*** rlandy|ruck is now known as rlandy|ruck|brb14:36
rcastillo|roverarxcruz|ruck: do you know what quay registry we're using for ussuri? Jobs are failing at prepare containers stage14:39
rcastillo|roverhttps://sf.hosted.upshift.rdu2.redhat.com/logs/28/37928/1/check-rdo/periodic-tripleo-ci-centos-8-scenario010-kvm-internal-standalone-network-ussuri/f38b8d9/logs/undercloud/var/log/tripleo-container-image-prepare.log14:39
rcastillo|rover2022-01-10 13:00:49,066 68056 ERROR root [  ] Image prepare failed: 401 Client Error: UNAUTHORIZED for url: https://quay.io/v2/tripleou/centos-binary-iscsid/manifests/81dccfed7083fd30c1ff80e98d6c1ee514:40
arxcruz|ruckrcastillo|rover: hmmm that's weird, we don't have tripleou in quay, chandankumar ^14:42
marioschandankumar: thanks14:43
chandankumararxcruz|ruck: it's tripleoussuri14:43
chandankumarhttps://opendev.org/openstack/tripleo-quickstart/src/branch/master/config/release/tripleo-ci/CentOS-8/ussuri.yml#L3014:44
chandankumarAre upstream jobs failing?14:44
chandankumarin upstream, we pull containers from content provider14:44
arxcruz|ruckchandankumar: no, it's internal14:45
chandankumararxcruz|ruck: for internal kvm?14:45
arxcruz|ruckchandankumar: the tripleou exists, but i don't have access 14:45
arxcruz|ruckchandankumar: yes, internal-standalone-network-ussuri job 14:46
chandankumararxcruz|ruck: for internal I suggested frenzy_friday to use alt_container_registry to trunk.registry.rdoproject.org in job definition14:47
chandankumarit will fix the issue14:47
arxcruz|ruckrcastillo|rover: ^14:47
arxcruz|rucki need to bring my daughter from school brb14:47
rcastillo|roverchandankumar: ack14:48
*** ykarel is now known as ykarel|away14:56
*** rlandy|ruck|brb is now known as rlandy|ruck14:59
*** dviroel is now known as dviroel|lunch15:02
rlandy|ruckrcastillo|rover: hey periodic-tripleo-ci-centos-8-scenario010-kvm-internal-standalone-ussuri is passing 15:19
rlandy|ruckif you check the inheritance ...15:19
rlandy|ruckhttps://code.engineering.redhat.com/gerrit/gitweb?p=openstack/tripleo-ci-internal-jobs.git;a=blob;f=zuul.d/scenario010-kvm-rdo.yaml;h=d7ddf0452ccf9c2d484aa98366edc90887a44512;hb=HEAD15:19
rlandy|ruckyou may want that patch on https://code.engineering.redhat.com/gerrit/gitweb?p=openstack/tripleo-ci-internal-jobs.git;a=blob;f=zuul.d/scenario010-kvm-rdo.yaml;h=d7ddf0452ccf9c2d484aa98366edc90887a44512;hb=HEAD#l12515:20
rcastillo|roverrlandy|ruck: oops, read the inheritance wrong. Fixing15:24
marioschandankumar: re fs1 & https://bugs.launchpad.net/tripleo/+bug/1956959 - the c8 feautureset1 isn't hitting the same issue i dont see timeouts/5 hour fails on https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-master 15:25
marioschandankumar: but seems to be network and volume tests failing mainly 15:25
marioschandankumar: everything else green 15:25
mariosah some compute fail too 15:26
mariosship it ;) 15:26
chandankumarmarios: will add it to skip list and ship it15:26
mariosDetails: {'code': 400, 'message': 'Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots or be disassociated from snapshots after volume transfer.'}, <traceback object at 0x7f409bc79840>), (<class 'tempest.lib.exceptions.TimeoutException'>, Request timed out15:26
marioschandankumar: not sure we should do that yet i mean skip list ... probably we will end up doing that but lets do it proper way lets get a bug and cix then we can track the skip on the cix15:27
marioschandankumar: we can file a bug tomorrow gonna stare a bit at the logs see if i can spot something 15:27
marioschandankumar: sound ok? 15:27
chandankumaryes sur15:27
chandankumaryes sir15:27
marioschandankumar: unless you really want to file it then i will not stand in your way ;)15:27
marioschandankumar: ack 15:27
chandankumarrlandy|ruck: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/822783 +w please15:28
arxcruz|ruckand im back 15:28
chandankumarrlandy|ruck: and this also https://review.rdoproject.org/r/c/rdo-jobs/+/3775915:37
ysandeepchandankumar, are you around? could you please join https://meet.google.com/dht-zggp-mwd for few mins15:40
ysandeepchandankumar, rlandy|ruck and me want to discuss about downstream registry15:40
rlandy|ruckdasm: https://review.rdoproject.org/r/c/rdo-jobs/+/3775915:41
rlandy|ruck'ok if I merge that?15:41
rlandy|ruckdo you have another competing patch15:41
dasmrlandy|ruck: +1ed it. LGTM15:41
dasmI don't have anything competing by now.15:42
sshnaidmrlandy|ruck, I think we need to discuss ansible-lint usage and its value for CI in the call tomorrow15:44
rlandy|rucksshnaidm: community call?15:44
sshnaidmrlandy|ruck, yep15:44
rlandy|rucksshnaidm:sure15:44
rlandy|ruckbhagyashris: ^^ pls add topic15:44
sshnaidmrlandy|ruck, it can break CI in any moment like today and it doesn't seem it has any way to avoid it15:44
bhagyashrisrlandy|ruck, sure15:52
rlandy|rucksshnaidm: ack - let's get some options out on this15:52
*** dviroel|lunch is now known as dviroel16:07
*** amoralej is now known as amoralej|off16:12
rlandy|ruckfrenzy_friday: hey - want to look at your kvm jobs>16:17
*** ysandeep is now known as ysandeep|out16:17
* ysandeep|out out for the day, see you tomorrow o/ 16:18
rlandy|ruckarxcruz|ruck: hey16:18
frenzy_fridayrlandy|ruck, hey, yep sure https://meet.google.com/wfc-bhbt-goa16:18
rlandy|ruckarxcruz|ruck: do we need to sync before your EoD?16:18
arxcruz|ruckrlandy|ruck: not really, i already talked with rcastillo|rover 16:19
arxcruz|ruckletm e check victoria again16:19
rlandy|ruckarxcruz|ruck: k - thanks16:19
arxcruz|ruckyup, victoria seems to be going 16:19
arxcruz|ruckthe two failing jobs passes 16:20
rlandy|ruckcan chat with rcastillo|rover later16:20
rcastillo|roverchandankumar: arxcruz|ruck rlandy|ruck setting alt_container_registry didn't fix ussuri jobs16:32
rcastillo|rover2022-01-10 15:59:24,462 68169 DEBUG urllib3.connectionpool [  ] https://trunk.registry.rdoproject.org:443 "GET /v2/tripleou/centos-binary-ovn-sb-db-server/manifests/81dccfed7083fd30c1ff80e98d6c1ee5 HTTP/1.1" 404 8716:32
rcastillo|rover2022-01-10 15:59:24,463 68169 INFO tripleo_common.image.image_uploader [  ] Non-2xx: id 482b0e628397fb270b30a4d5cf4650a0d289fa60, status 404, reason Not Found, text {"errors":[{"code":"NAME_UNKNOWN","message":"repository name not known to registry"}]}y16:32
arxcruz|ruckrcastillo|rover: where's the patch ?16:32
rcastillo|roverarxcruz|ruck: https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/30268116:33
rlandy|ruckchandankumar: hey - do you still have c9 tempest tests timing out?16:38
rlandy|ruckor just failing16:38
arxcruz|ruckrcastillo|rover: it seems there's a problem with tripleoussuri because it was taken from another person16:38
arxcruz|ruckso we were using tripleou 16:39
arxcruz|ruckbut only for docker16:39
arxcruz|ruckrcastillo|rover: try set docker_registry_namespace to tripleoussuri as well on your patch 16:39
rcastillo|roverI see16:40
arxcruz|ruckrcastillo|rover: https://opendev.org/openstack/tripleo-quickstart/src/branch/master/config/release/tripleo-ci/CentOS-8/ussuri.yml#L22 for example 16:40
chandankumarrcastillo|rover: yes 16:45
chandankumarrlandy|ruck: yes16:45
chandankumarrlandy|ruck:  https://logserver.rdoproject.org/openstack-periodic-integration-main-cs9/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-standalone-full-tempest-api-master/1dc7580/logs/undercloud/var/log/tempest/tempest_run.log.txt.gz16:45
rlandy|ruckfrenzy_friday: ^^16:45
chandankumarfeel free to open a bug16:45
chandankumarand one more issue16:46
chandankumarhttps://logserver.rdoproject.org/openstack-periodic-integration-main-cs9/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-containers-multinode-master/32d1eac/logs/undercloud/home/zuul/undercloud_install.log.txt.gz16:46
chandankumarFileExistsError: [Errno 17] File exists: '/home/zuul/tripleo-deploy/undercloud/heat_launcher/tripleo_deploy-1641822423.7144172'16:46
chandankumarwill take a look tomorrow16:48
chandankumarsee ya16:48
rlandy|ruckchandankumar: have a good night16:50
rlandy|ruckarxcruz|ruck: rcastillo|rover: ah - in downstream the cloud env is diff16:59
rlandy|ruck tripleoussuri16:59
rlandy|ruckbut should still be ^^16:59
rlandy|ruckfor component jobs16:59
frenzy_fridaychandankumar, thanks, checking tomorrow16:59
rlandy|ruckmoving car - brb17:07
*** jpena is now known as jpena|off17:53
dviroelrlandy|ruck: o/18:02
rlandy|ruckdviroel: hey18:03
dviroelthere was a cleanup on https://images.rdoproject.org/stein/rdo_trunk/ ?18:03
dviroelhttps://3fb1e4bace4a10a4c91f-b6631615bf9035ccf374ffb9cb335ff2.ssl.cf5.rackcdn.com/824037/1/check/openstack-tox-molecule/c70b19f/tox/reports.html 18:03
rlandy|ruckdviroel: those images should have been deleted18:03
dviroelmolecule jobs is failing to fetch images from there18:03
rlandy|ruckdviroel: ugh  - that needs an update18:03
dviroelcan we delete those queens and stein release files?18:03
rlandy|ruckdviroel: we need to update that to a later release18:04
dviroelthe tox-molecule tests all files inside config dir18:04
rlandy|ruckdviroel: move them to a deprecated dir18:04
dviroelack, but must be outside config/18:04
* dviroel testing locally18:05
rlandy|ruckdviroel: then delete them18:05
rlandy|ruckdviroel: we can always revert18:05
dviroelack18:09
rlandy|ruckrcastillo|rover: how are you doing?18:15
rcastillo|roverrlandy|ruck: still looking at ussuri jobs. Seems I also have to set docker_registry_host to get the registry overriden18:16
rcastillo|roverhttps://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/standalone/tasks/containers.yml#L9918:16
rlandy|ruckarxcruz|ruck: what is the story with the victoria promotion?18:17
* rlandy|ruck looks18:17
rlandy|ruckrcastillo|rover: ugh - yeah18:18
rlandy|ruckthis diff name thing is a pain18:18
rlandy|ruckrcastillo|rover: the alternative is to edit https://opendev.org/openstack/tripleo-quickstart/src/branch/master/config/release/tripleo-ci/CentOS-8/ussuri.yml#L2818:18
rlandy|ruckand add the downstream cloudenv18:18
rlandy|ruckwhich idk if we have defined18:19
rlandy|rucklooking18:19
rcastillo|roverit's not, I did see that18:19
rcastillo|roverovb jobs set the cloudenv to internal, but nothing for standalone afaik18:20
rlandy|ruckrcastillo|rover: yeah - probably never needed it before18:21
* rlandy|ruck check downstream OVB18:22
rcastillo|roversetting it might be a neater fix than adding all these vars, idk18:22
rlandy|ruckrcastillo|rover: https://code.engineering.redhat.com/gerrit/gitweb?p=openstack/tripleo-ci-internal-jobs.git;a=blob;f=zuul.d/ovb.yaml;h=e340bc23316a4e583e64c656a01026885d030fbb;hb=HEAD#l5318:24
rlandy|ruckidk if that will work in this case18:25
rlandy|ruckcloudenv: internal18:25
rlandy|ruckrcastillo|rover; and then you'd need a change to release file to add that env18:26
rlandy|ruckrcastillo|rover: we may need that var passed in quickstart18:26
rlandy|ruckhttps://codesearch.opendev.org/?q=cloudenv&i=nope&literal=nope&files=&excludeFiles=&repos=18:27
rlandy|rucklet me see how ovb does it18:27
rlandy|ruckI think we copy that over18:27
rlandy|ruckhold on18:27
rlandy|ruckhttps://code.engineering.redhat.com/gerrit/gitweb?p=openstack/tripleo-ci-internal-jobs.git;a=blob;f=playbooks/setup-rhel-ovb.yaml;h=de1d9632c826398a0de8dd6a861ace0deefe73de;hb=HEAD18:29
rlandy|ruckrcastillo|rover: ^^ that is how we get that passed18:29
rlandy|ruckhttp://git.app.eng.bos.redhat.com/git/tripleo-environments.git/tree/config/environments/ovb-internal.yml#n318:29
rlandy|ruckwe would need that var passed to something quickstart picks up18:30
rlandy|ruckrcastillo|rover: where is your patch?18:37
rcastillo|roverhttps://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/30268118:38
rcastillo|roverrlandy|ruck: ^^18:38
rlandy|ruckrcastillo|rover: my guess is that these settings are not working, right?18:40
rcastillo|roverrlandy|ruck: only alt_container_registry seemed to18:41
rcastillo|roverbut I haven't tested with both docker_container_host and namespace18:41
rlandy|ruckhttps://opendev.org/openstack/tripleo-quickstart/src/branch/master/config/release/tripleo-ci/CentOS-8/ussuri.yml#L2018:41
rlandy|ruck^^ here is why18:41
rlandy|ruckit's a job. var18:41
rlandy|rucklet me see where this is clouenv is being passed to standalone18:43
rcastillo|roverhmm, so setting cloudenv might be our best shot at getting the namespace set?18:43
rlandy|ruck @/home/zuul/src/opendev.org/openstack/tripleo-ci/toci-quickstart/config/testenv/standalone-vexxhost.yml18:50
rlandy|ruckok - so we need to see how that is passed18:50
rcastillo|roverrlandy|ruck: https://opendev.org/openstack/tripleo-ci/src/branch/master/roles/run-test/templates/toci_quickstart.sh.j2#L10718:51
rcastillo|roveris it this here?18:51
rlandy|ruckrcastillo|rover: yeah - but you'll need this playbook before18:52
rlandy|ruckhttps://code.engineering.redhat.com/gerrit/gitweb?p=openstack/tripleo-ci-internal-jobs.git;a=blob;f=playbooks/setup-rhel-ovb.yaml;h=de1d9632c826398a0de8dd6a861ace0deefe73de;hb=HEAD18:52
rcastillo|roverthe one ovb uses?18:52
rlandy|ruckyep and then you'll need the var defined18:53
rcastillo|roveryeah ok, got it. A bit more complex than I thought it'd be but it'll have to do18:53
rcastillo|roverrlandy|ruck: should I add a new config file to the internal tripleo-environments?18:55
rlandy|ruckrcastillo|rover: hold on ...18:56
rlandy|ruckrcastillo|rover": ok - here we go ...19:02
rlandy|ruckhttps://github.com/openstack/tripleo-ci/blob/master/roles/ci-common-vars/vars/main.yaml19:02
rlandy|ruckhttps://opendev.org/openstack/tripleo-ci/src/branch/master/roles/ci-common-vars/vars/main.yaml#L5819:02
rlandy|ruckso easiest way would be to add other standalone_custom_env_files19:06
rlandy|ruckand tripleo-environments as a required project19:06
rlandy|ruckor follow the OVB workflow19:06
dasmrlandy|ruck: i wanna check with you. this is a new wallaby c9 standalone job: https://review.rdoproject.org/r/c/rdo-jobs/+/37860 which failed when running testproject: https://review.rdoproject.org/r/c/testproject/+/37861 the error is the same like on Friday: https://paste.opendev.org/show/812004/ (amoralej didn't get back to me with "known issues").19:09
dasmrlandy|ruck: i remember we talked about gathering other jobs under one umbrella (or depends-on). i have some notes, but i can't decipher what was really needed.19:10
dasmrlandy|ruck: is there any place where i could get an idea about MVP for this integration line?19:11
rlandy|ruckdasm: k - will meet with you in a bit19:11
dasmk, no worries19:11
rlandy|ruckjust trying to sort the component job19:11
rlandy|ruckrcastillo|rover: k - let's talk options19:11
rlandy|ruckrcastillo|rover: https://meet.google.com/azm-xjve-ipc?pli=1&authuser=019:12
dviroelrlandy|ruck: https://review.opendev.org/c/openstack/tripleo-quickstart/+/824037/ - passing on tox-linters and tox-molecule now (still running remaining jobs)19:16
dviroelrlandy|ruck: ^ need both fixes to have a Zuul +1, otherwise we need to make one of them non-voting (if we want to create different changes)19:17
rlandy|ruckdviroel: sec19:17
rlandy|ruckdviroel" let's look at your two patches19:36
rlandy|ruckdviroel: I see https://review.opendev.org/c/openstack/tripleo-quickstart/+/824037/19:37
rlandy|ruckwhere is the other patch?19:37
dviroelrlandy|ruck: i mean, both fixes in the same patch19:46
dviroelrlandy|ruck: linter + tox-molecule19:46
rlandy|ruckdviroel: so I am ok with merging this19:49
dviroelrlandy|ruck: ok, we need this one to merge chandan's workaround on DLRN issue with centos919:49
rlandy|ruckdviroel: added amoralej|off to get the community ok on this19:50
rlandy|ruckdasm: sorry - let's chat19:50
dasmrlandy|ruck: no worries19:50
rlandy|ruckdasm: https://meet.google.com/uni-awgo-wdg?pli=1&authuser=019:51
rlandy|ruckamoralej|off: hey ... can you take a look at https://logserver.rdoproject.org/61/37861/2/check/periodic-tripleo-ci-centos-9-standalone-wallaby/8305441/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz19:58
rlandy|ruckamoralej|off: wallaby c919:58
rlandy|ruckamoralej|off: you should have an email from dasm (dariusz) with the log linkes19:59
rlandy|ruckamoralej|off: you mentioned some puppet issues on wallaby - so checking with you19:59
rlandy|ruckError: Could not autoload puppet/provider/service/pacemaker: cannot load such file -- rexml/document20:00
dasmhttps://paste.opendev.org/show/812004/20:00
dasm^20:00
dasmhttps://review.rdoproject.org/zuul/build/6e08c6aa1335449382cdf93c41d04902/log/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz?severity=020:01
rlandy|ruckhttps://bugs.launchpad.net/tripleo/+bug/194932720:05
rlandy|ruckdasm: https://github.com/openstack/tripleo-ci/blob/master/zuul.d/standalone-jobs.yaml#L6720:10
rlandy|ruck   vars:20:10
rlandy|ruck      build_container_images: true20:10
dasmhttps://review.rdoproject.org/r/c/testproject/+/3786120:16
dasmrlandy|ruck: ^20:16
rlandy|ruckhttps://trunk.rdoproject.org/centos9-wallaby/20:18
rlandy|ruckhttps://github.com/openstack/puppet-pacemaker20:22
rcastillo|roverrlandy|ruck: https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/302681 https://review.opendev.org/c/openstack/tripleo-quickstart/+/824056 ussuri fix patches20:54
rlandy|rucklooking20:58
rlandy|ruckrcastillo|rover: looks good to me20:58
rlandy|ruckdoes testproject agree?20:59
*** dviroel is now known as dviroel|out21:28
rlandy|ruckperiodic-tripleo-ci-centos-8-scenario010-kvm-internal-standalone-network-ussuri21:42
rlandy|rucksuccess21:42
rlandy|ruckrcastillo|rover++ nice21:43
*** rlandy|ruck is now known as rlandy|dentist21:52
rlandy|dentistrcastillo|rover; ^^ will check in later or tomorrow21:53
* dasm off23:19

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!