| *** rlandy has quit IRC | 00:36 | |
| *** saneax has joined #oooq | 00:50 | |
| *** jmasud has quit IRC | 00:55 | |
| *** jmasud has joined #oooq | 00:56 | |
| *** dsneddon has quit IRC | 01:21 | |
| *** rfolco has quit IRC | 01:47 | |
| *** ysandeep|away is now known as ysandeep|rover | 02:31 | |
| ysandeep|rover | weshay, o/ | 03:28 |
|---|---|---|
| weshay | ysandeep|rover, howdy sir | 03:28 |
| weshay | so I got pulled into a bunch of crap today.. didn't make a ton of progress | 03:29 |
| ysandeep|rover | weshay, no no you did .. thanks for https://review.opendev.org/#/c/716373/1 and https://review.opendev.org/#/c/716475/ | 03:29 |
| weshay | ysandeep|rover, afaict... master SHOULD not be failing in ovb | 03:29 |
| weshay | http://dashboard-ci.tripleo.org/d/FE8Hf29Wz/component-pipeline?orgId=1 | 03:29 |
| weshay | ysandeep|rover, I probably will end up pulling containers from docker.io and pushing them to rdo ... to unblock upgrades | 03:30 |
| ysandeep|rover | weshay, okay | 03:32 |
| weshay | any insight into stein ovb? | 03:33 |
| weshay | maybe by tomorrow.. | 03:33 |
| weshay | you just got here :) | 03:33 |
| ysandeep|rover | weshay, yes :) | 03:33 |
| ysandeep|rover | weshay, anything else came up today to worry about? | 03:34 |
| *** Tengu has quit IRC | 03:34 | |
| *** Tengu has joined #oooq | 03:36 | |
| weshay | ysandeep|rover, let's work backwards from queens | 03:37 |
| weshay | https://logserver.rdoproject.org/openstack-periodic-wednesday-weekend/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-7-queens-containers-build/9a7cc8e/logs/ is a working queens container build | 03:37 |
| weshay | poke at the last two failures https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-wednesday-weekend&job_name=periodic-tripleo-centos-7-queens-containers-build | 03:37 |
| weshay | https://logserver.rdoproject.org/openstack-periodic-wednesday-weekend/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-7-queens-containers-build/5609a55/logs/undercloud/home/zuul/undercloud_install.log.txt.gz | 03:39 |
| weshay | odd | 03:39 |
| weshay | working build has br-ex https://logserver.rdoproject.org/openstack-periodic-wednesday-weekend/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-7-queens-containers-build/9a7cc8e/logs/undercloud/var/log/extra/network.txt.gz | 03:39 |
| ysandeep|rover | yeah failed with FailedValidation: Invalid local_interface specified. br-ex is not available. | 03:39 |
| weshay | and the failing one does not | 03:40 |
| weshay | https://logserver.rdoproject.org/openstack-periodic-wednesday-weekend/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-7-queens-containers-build/5609a55/logs/undercloud/var/log/extra/network.txt.gz | 03:40 |
| ysandeep|rover | weshay, wondering why undercloud need br-ex here.. generally it only have br-ctl bridge | 03:42 |
| weshay | both are there.. in the working version | 03:43 |
| weshay | https://logserver.rdoproject.org/openstack-periodic-wednesday-weekend/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-7-queens-containers-build/9a7cc8e/logs/undercloud/var/log/extra/network.txt.gz | 03:43 |
| ysandeep|rover | weshay, ahh.. it is mentioned in undercloud.conf to use local_interface = br-ex.. that's why its getting created | 03:45 |
| weshay | ysandeep|rover, the pre-playbooks changed | 03:46 |
| weshay | maybe by us.. maybe not | 03:46 |
| weshay | https://logserver.rdoproject.org/openstack-periodic-wednesday-weekend/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-7-queens-containers-build/9a7cc8e/job-output.txt | 03:46 |
| weshay | search for multi-node-bridge | 03:46 |
| weshay | that is where br-ex is created | 03:47 |
| weshay | and it's not created here https://logserver.rdoproject.org/openstack-periodic-wednesday-weekend/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-7-queens-containers-build/5609a55/job-output.txt | 03:47 |
| weshay | ysandeep|rover, this role is not getting called https://opendev.org/zuul/zuul-jobs/src/commit/7755ef1b8d4d7803c9ad330a1bd9599715e06c60/roles/multi-node-bridge | 03:50 |
| weshay | nothing has changed here https://opendev.org/zuul/zuul-jobs/src/branch/master/playbooks/multinode/pre.yaml | 03:51 |
| weshay | ysandeep|rover, run this one by chandankumar | 03:52 |
| ysandeep|rover | weshay, yeah sure.. will take his help if i can't figure this out in sometime | 03:53 |
| *** skramaja has joined #oooq | 04:01 | |
| *** ykarel|away is now known as ykarel | 04:10 | |
| weshay | ysandeep|rover, we need to add fs001 to the clients component pipeline https://review.opendev.org/#/c/716277/ | 04:19 |
| weshay | chandankumar, ^ | 04:19 |
| chandankumar | weshay, aye | 04:22 |
| weshay | chatter on #tripleo about it now | 04:22 |
| ysandeep|rover | weshay, o/ ack | 04:27 |
| *** ratailor has joined #oooq | 04:49 | |
| *** jmasud has quit IRC | 04:54 | |
| *** jmasud has joined #oooq | 04:56 | |
| *** udesale has joined #oooq | 05:12 | |
| *** udesale has quit IRC | 05:14 | |
| weshay | chandankumar, made some progress on rhel8 osp container builds | 05:14 |
| *** udesale has joined #oooq | 05:14 | |
| chandankumar | weshay, will check notes | 05:14 |
| weshay | chandankumar, haven't posted yet | 05:14 |
| weshay | lolz | 05:14 |
| chandankumar | weshay, please go and take rest, will take care of rest | 05:14 |
| weshay | :) | 05:15 |
| chandankumar | weshay, I will start working on image build then | 05:15 |
| weshay | chandankumar, I can post a review .. basically I think we can squash the openstack-base docker file and the our base template into the same docker file | 05:17 |
| chandankumar | weshay, ok | 05:18 |
| weshay | needs to be sanitized of the ubi internal path.. I'll post it tomorrow morning | 05:19 |
| chandankumar | ok | 05:20 |
| *** marios has joined #oooq | 05:50 | |
| *** bogdando has joined #oooq | 06:21 | |
| *** jfrancoa has joined #oooq | 06:39 | |
| *** irclogbot_0 has quit IRC | 06:49 | |
| *** irclogbot_0 has joined #oooq | 06:51 | |
| *** irclogbot_0 has quit IRC | 06:53 | |
| *** irclogbot_1 has joined #oooq | 06:53 | |
| *** ysandeep|rover is now known as ysandeep|brb | 07:03 | |
| *** jbadiapa has joined #oooq | 07:08 | |
| *** amoralej has joined #oooq | 07:27 | |
| chandankumar | ysandeep|brb, include this also https://bugs.launchpad.net/tripleo/+bug/1870026 | 07:28 |
| openstack | Launchpad bug 1870026 in tripleo "'current' repo is being used instead of 'current-tripleo' for non tripleo packages during rpmbuild in tripleo jobs" [High,Triaged] - Assigned to yatin (yatinkarel) | 07:28 |
| chandankumar | ysandeep|brb, you need help on centos-7 queens containers build promotion job? | 07:28 |
| *** matbu has joined #oooq | 07:32 | |
| *** tosky has joined #oooq | 07:32 | |
| *** pojadhav is now known as pojadhav|lunch | 07:45 | |
| *** ysandeep|brb is now known as ysandeep | 07:52 | |
| ysandeep | chandankumar, yes, thank you :) | 07:54 |
| ysandeep | i just started looking too, i was troubleshooting fs0001 stein issue in the morning | 07:55 |
| *** jpena|off is now known as jpena | 07:56 | |
| *** ysandeep is now known as ysandeep|rover | 07:57 | |
| chandankumar | ysandeep|rover, as per this https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-centos-7-queens-containers-build in test project it got fixed, i think we can ignore that | 08:01 |
| ysandeep|rover | chandankumar, ack o/ | 08:03 |
| ysandeep|rover | chandankumar++ | 08:03 |
| ysandeep|rover | i will keep an eye on periodic job incase it fails again | 08:03 |
| chandankumar | ysandeep|rover, sure, thanks :-) | 08:04 |
| *** dtantsur|afk is now known as dtantsur | 08:04 | |
| arxcruz | kopecmartin: chandankumar soniya29 https://review.opendev.org/#/c/716289/ | 08:04 |
| arxcruz | appreciate review in the english :) | 08:05 |
| ykarel | ysandeep|rover, i see https://bugs.launchpad.net/tripleo/+bug/1869842 is closed | 08:05 |
| openstack | Launchpad bug 1869842 in tripleo "tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001 failed with NTP error" [Medium,Fix released] - Assigned to wes hayutin (weshayutin) | 08:05 |
| ykarel | without being fixed | 08:06 |
| ykarel | seems like it was wrongly understood | 08:06 |
| ykarel | good to open it and close it with all the known improvements | 08:06 |
| ysandeep|rover | ykarel, yes wes proposed https://review.opendev.org/716373 last night.. partial-bug could be used | 08:07 |
| ykarel | ysandeep|rover, yup exactly | 08:08 |
| ykarel | that is not closing | 08:08 |
| ykarel | actually not doing anythin | 08:08 |
| ykarel | as rpm -e epel-release is already there | 08:08 |
| ykarel | atleast for this bug | 08:08 |
| ysandeep|rover | epel repo stil present? how? | 08:10 |
| ykarel | ysandeep|rover, actual issue was transient and hit due to deployment moved forward even if repo setup failed in image build | 08:11 |
| ykarel | epel never was present, but for ^^ case it was | 08:11 |
| ysandeep|rover | ykarel, i will reopen the bugzilla.. | 08:12 |
| ykarel | ysandeep|rover, ack Thanks and assign to yourself as u already know some of those improvements | 08:13 |
| ykarel | i can help wherever needed | 08:13 |
| ysandeep|rover | ykarel, o/ | 08:13 |
| ysandeep|rover | ykarel, from commit msg of https://review.opendev.org/#/c/716373/ , seems like there are some plans already to get mock and deps avail in dlrn-deps.. So i think i just need to take care of part to stop execution of all-nodes.sh if repo_setup fails. | 08:15 |
| ykarel | ysandeep|rover, there are multiple things to do, and yes dlrn-deps is an option | 08:16 |
| ykarel | we are currently discussing that | 08:16 |
| panda | marios: can you add this to your queue ? https://review.rdoproject.org/r/25931 | 08:22 |
| marios | panda: ack will do but maybe not right now just done a bunch | 08:22 |
| panda | marios: I called a reviews.enqueue() on marios server, not a reviews.flush() | 08:24 |
| panda | marios: I expected it to be async. | 08:25 |
| marios | panda: :D | 08:27 |
| *** pojadhav|lunch is now known as pojadhav | 08:30 | |
| *** ykarel is now known as ykarel|lunch | 08:30 | |
| chandankumar | marios, does upshift vm is freezing for you? | 09:03 |
| marios | chandankumar: not yet... but as i said yesterday i fought for a long time tryign to install tripleoclient and coudln't (pypi connection issues)... this morning that worked though | 09:06 |
| sshnaidm | chandankumar, can we maybe use script in our repo to build podman? It takes too much time to get fixes in | 09:07 |
| chandankumar | sshnaidm, need to take a look how to do that | 09:14 |
| *** chem has quit IRC | 09:21 | |
| *** chem has joined #oooq | 09:23 | |
| sshnaidm | chandankumar, just running our script in run.yml | 09:26 |
| sshnaidm | chandankumar, how do you recheck jobs there? github-check? | 09:26 |
| chandankumar | sshnaidm, yes github-check | 09:26 |
| *** jbadiapa is now known as jbadiapa|away | 09:27 | |
| chandankumar | sshnaidm, sorry it is check-github | 09:28 |
| chandankumar | like check-rdo | 09:28 |
| sshnaidm | ok | 09:28 |
| chandankumar | sshnaidm, when you say about script you mean custom build_rpm.sh script? | 09:28 |
| sshnaidm | chandankumar, we use now script from libpod repo | 09:29 |
| sshnaidm | chandankumar, just to copy it to our repo instead | 09:29 |
| chandankumar | yes | 09:29 |
| sshnaidm | tripleo-podman-integration-centos-8-scenario000-standalone seems broken: https://review.rdoproject.org/r/#/c/26178/ | 09:31 |
| *** ratailor has quit IRC | 09:32 | |
| chandankumar | sshnaidm, yes, at tripleo-ansible part where file not found https://logserver.rdoproject.org/78/26178/6/check/tripleo-podman-integration-centos-8-scenario000-standalone/ec65143/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 09:32 |
| *** ratailor has joined #oooq | 09:33 | |
| chandankumar | sshnaidm, https://opendev.org/openstack/tripleo-heat-templates/src/branch/master/deployment/tripleo-firewall/tripleo-firewall-baremetal-ansible.yaml#L75 | 09:33 |
| chandankumar | I am not sure wes filed the bug or not last night let me open that | 09:33 |
| chandankumar | sshnaidm, https://bugs.launchpad.net/tripleo/+bug/1870095 | 09:42 |
| openstack | Launchpad bug 1870095 in tripleo "keystone based standalone deployment failed with No such file or directory: ''/usr/sbin/nft'" [Critical,Triaged] | 09:42 |
| chandankumar | ysandeep|rover, ^^ please add it to queue | 09:43 |
| ysandeep|rover | chandankumar, is this related https://e091e77704466e767fd4-17e674d76e68d3db9dd8198f990ea88d.ssl.cf1.rackcdn.com/periodic/opendev.org/openstack/tripleo-ci/master/tripleo-ci-centos-8-scenario002-standalone/a9f211b/logs/undercloud/home/zuul/standalone_deploy.log ? | 09:44 |
| ysandeep|rover | checking bz ^^ | 09:45 |
| chandankumar | ysandeep|rover, nope different issue all together | 09:46 |
| *** owalsh has quit IRC | 09:50 | |
| *** owalsh has joined #oooq | 09:50 | |
| *** ykarel|lunch is now known as ykarel | 09:59 | |
| *** derekh has joined #oooq | 10:49 | |
| *** ysandeep|rover is now known as ysandeep|afk | 10:56 | |
| *** ysandeep|afk is now known as ysandeep|rover | 11:22 | |
| *** blueDuckRandom has joined #oooq | 11:23 | |
| chandankumar | marios, for downstream image build from where we get the RHEL image ? is it from access.redhat.com? | 11:26 |
| marios | chandankumar: last time we used a hosted one from weshay https://code.engineering.redhat.com/gerrit/gitweb?p=openstack/tripleo-ci-internal-jobs.git;a=blob;f=zuul.d/build-image.yaml#l20 | 11:29 |
| marios | chandankumar: maybe that is still there (line 20) ^^^ otherwise don't know | 11:30 |
| *** migi has joined #oooq | 11:30 | |
| marios | chandankumar: fyi this story might be useful for you https://tree.taiga.io/project/tripleo-ci-board/us/1100 (see tasks within ) | 11:30 |
| chandankumar | marios, ah thanks, that will be helpful | 11:33 |
| ykarel | panda, hi | 11:34 |
| ykarel | panda, do u know why promotion criteria is not updated on centos8 master 38.145.34.55/ | 11:34 |
| ykarel | i see [u'periodic-tripleo-ci-centos-8-singlenode-featureset027-master'] | 11:34 |
| ykarel | but ^^ was changed with https://review.rdoproject.org/r/#/c/25835/ | 11:35 |
| ykarel | seeing http://38.145.34.55/centos8_master.log | 11:37 |
| panda | ykarel: because automatic updates are disabled in the server | 11:41 |
| *** jpena is now known as jpena|lunch | 11:42 | |
| panda | ykarel: manually updated. | 11:44 |
| ykarel | panda, Thanks | 11:44 |
| ykarel | panda, in promotion logs i am seeing unauthorized: authentication required, is it known issue? | 11:56 |
| ykarel | http://38.145.34.55/centos8_master.log | 11:56 |
| panda | ykarel: that's new to me | 11:58 |
| arxcruz | zbr: chandankumar sshnaidm I'm having a problem with collect-logs | 11:58 |
| ykarel | panda, can u get that fixed? likely it's due to registry migration to vexxhost | 11:59 |
| arxcruz | zbr: chandankumar sshnaidm it's under untrusted projects, and so, it is failing because of the inline filter plugin | 11:59 |
| ykarel | so may be new token needs to be added in promoter server | 11:59 |
| *** jbadiapa|away is now known as jbadiapa | 11:59 | |
| panda | ykarel: of course it is .... | 12:02 |
| panda | ykarel: who's the point of contact ? | 12:02 |
| ykarel | dpawlik, ^^ | 12:02 |
| * dpawlik reading | 12:03 | |
| zbr | not sure how the role is installed but maybe it is the time to make it a collection and install it as a collection | 12:03 |
| zbr | this would assure that the modules/filters are available after. | 12:03 |
| panda | dpawlik: essentially if you migrated the rdo registry to vexxhost changing the credentials, we need to update the credentials | 12:04 |
| panda | dpawlik: in the places where it was used before. | 12:05 |
| dpawlik | panda, secret was updated AFAIR | 12:06 |
| *** jmasud has quit IRC | 12:06 | |
| *** skramaja has quit IRC | 12:07 | |
| dpawlik | panda, https://review.rdoproject.org/r/#/c/26106/ | 12:07 |
| *** jmasud has joined #oooq | 12:08 | |
| *** skramaja has joined #oooq | 12:08 | |
| dpawlik | panda, the issiue is on RDO infra, right? | 12:08 |
| panda | dpawlik: the promoter uses plain text password stored in a file in the server | 12:09 |
| dpawlik | panda, ehh. | 12:09 |
| panda | dpawlik: the plain text cred is usually shared with us in the document I pasted in the query | 12:09 |
| dpawlik | panda, new token is in the doc | 12:10 |
| *** dsneddon has joined #oooq | 12:10 | |
| panda | dpawlik: the one at the bottom right ? | 12:10 |
| *** rlandy has joined #oooq | 12:11 | |
| dpawlik | ending with 'AWU8oA' | 12:12 |
| panda | dpawlik: ykarel promoter updated thanks. | 12:12 |
| ykarel | panda, dpawlik THanks, hope it moves forward now, will keep an eye | 12:12 |
| panda | dpawlik: now a potential attacker knows 10% of the password. | 12:12 |
| ykarel | :D | 12:13 |
| dpawlik | panda, ups :D | 12:13 |
| ykarel | panda, so need to updated in new promoter 38.102.83.109 also | 12:14 |
| ykarel | or already did | 12:14 |
| panda | ykarel: sshnaidm probably already did that | 12:14 |
| chandankumar | weshay, morning | 12:14 |
| ykarel | panda, okk good then, but in new one i see it's using trunk.registry-vexxhost.rdoproject.org | 12:14 |
| chandankumar | weshay, please have a look at new schema https://review.opendev.org/#/c/716289/7/doc/source/yaml/formatting.rst for skip list | 12:15 |
| panda | ykarel: the old is still using the old .... | 12:15 |
| ykarel | panda, that's good as i see containers are being exist there | 12:15 |
| ykarel | but vexxhost looks wrong as containers do not exist there | 12:15 |
| *** dmellado has quit IRC | 12:15 | |
| ykarel | skopeo inspect docker://trunk.registry-vexxhost.rdoproject.org/tripleorocky/centos-binary-manila-share:a6939dde9e861d14784a4c239e9c910fe2ce5e91_4af5e5fe | 12:16 |
| ykarel | vs skopeo inspect docker://trunk.registry.rdoproject.org/tripleorocky/centos-binary-manila-share:a6939dde9e861d14784a4c239e9c910fe2ce5e91_4af5e5fe | 12:16 |
| *** Goneri has joined #oooq | 12:16 | |
| weshay | chandankumar, 0/ | 12:16 |
| ykarel | was checking recentl rocky promotion logs http://38.102.83.109/centos7_rocky.log | 12:16 |
| *** amoralej is now known as amoralej|lunch | 12:20 | |
| *** rfolco has joined #oooq | 12:23 | |
| *** dmellado has joined #oooq | 12:23 | |
| *** derekh has quit IRC | 12:25 | |
| matbu | hey folks, do you why there is no update jobs triggered here: https://review.opendev.org/#/c/712102/ ? | 12:26 |
| matbu | holser: ^ | 12:27 |
| matbu | weshay: maybe you know ^ | 12:31 |
| sshnaidm | ykarel, checking | 12:32 |
| chandankumar | matbu, I can take care of that, the new fs got missed while c8 porting | 12:33 |
| dpawlik | registry-vexxhost is a old name | 12:33 |
| chandankumar | matbu, give me a min reviews coming | 12:33 |
| matbu | chandankumar: no pb thank you very much | 12:33 |
| dpawlik | and it can be problematic for docker to trust the repo, because SSL is set for different domain | 12:33 |
| dpawlik | chandankumar, ykarel so if somewhere is set registry-vexxhost please change that just for registry, like it was earlier | 12:34 |
| chandankumar | matbu, one more thing sorry which upgrade job | 12:34 |
| chandankumar | *update job | 12:35 |
| ykarel | sshnaidm, as dpawlik said ^^ | 12:35 |
| sshnaidm | ykarel, there was -vexxhost in some places on a new promoter, fixed that | 12:35 |
| rlandy | pojadhav: https://unix.stackexchange.com/questions/326942/not-able-to-share-entire-desktop-while-using-google-hangouts-or-appear-in | 12:35 |
| ykarel | sshnaidm, Thanks, and new token already exist on new promoter, right? | 12:35 |
| sshnaidm | ykarel, yes | 12:35 |
| chandankumar | matbu, is it featureset 37? | 12:35 |
| ykarel | sshnaidm, cool | 12:36 |
| pojadhav | rlandy, https://pastebin.com/0AgRqz6Q | 12:36 |
| * dpawlik editing the doc | 12:37 | |
| pojadhav | rlandy, https://my1.fr/blog/developer-workflow-with-tripleo/ | 12:37 |
| matbu | chandankumar: hmm let me check | 12:37 |
| matbu | chandankumar: yep | 12:38 |
| ykarel | panda, 8 minute ago run failed again with authentication required http://38.145.34.55/centos8_master.log | 12:38 |
| matbu | chandankumar: looks like the job is not present in tht master as well | 12:38 |
| chandankumar | matbu, ah, ok let me get that added | 12:38 |
| dpawlik | panda, doc updated. I remove the content related to registry-vexxhost.rdoproject.org because it can be confusing for others | 12:41 |
| panda | dpawlik: ok | 12:42 |
| panda | ykarel: yep still failing | 12:42 |
| ykarel | panda, wrong token? or token not applied correctly? | 12:44 |
| *** derekh has joined #oooq | 12:45 | |
| panda | ykarel: nope and nope | 12:45 |
| panda | ykarel: investigating | 12:45 |
| matbu | chandankumar: thx | 12:45 |
| ykarel | panda, ack Thanks | 12:45 |
| chandankumar | matbu, tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates is there need to figure out why it does not get triggered | 12:45 |
| *** jpena|lunch is now known as jpena | 12:46 | |
| weshay | chandankumar, I killed it | 12:46 |
| weshay | chandankumar, for master | 12:46 |
| weshay | should be centos-8 | 12:46 |
| chandankumar | weshay, it needs to be triggered against https://review.opendev.org/#/c/712102/ tht stable/train | 12:47 |
| weshay | https://review.opendev.org/#/q/branch:master+topic:remove-centos7-master-upgrade | 12:47 |
| panda | dpawlik: if I try the login command from the promoter it does not work | 12:47 |
| panda | dpawlik: unuthaorized | 12:47 |
| weshay | chandankumar, ah.. unrelated then | 12:47 |
| panda | dpawlik: disregard my last statement, it works. | 12:49 |
| chandankumar | matbu, https://opendev.org/openstack/tripleo-heat-templates/src/branch/stable/train/zuul.d/layout.yaml#L28 common file regex missing here so not get triggered | 12:56 |
| holser | weshay thanks for https://review.opendev.org/#/q/7359ddc98986708e0aad311952b8e5465116cd82 | 13:00 |
| marios | rlandy: chandankumar: o/ | 13:00 |
| *** amoralej|lunch is now known as amoralej | 13:01 | |
| *** jbadiapa has quit IRC | 13:02 | |
| chandankumar | matbu, https://review.opendev.org/#/q/I87f8970556f8450be23f37276db0b8227e2b35a6 will fix it | 13:03 |
| *** jbadiapa has joined #oooq | 13:04 | |
| panda | ykarel: seems to be working now | 13:05 |
| panda | ykarel: it needed more time ? | 13:05 |
| ykarel | panda, okk good, no idea | 13:07 |
| ykarel | so u didn't changed anything this time? | 13:07 |
| *** udesale_ has joined #oooq | 13:09 | |
| panda | ykarel: I used my mind control technique | 13:09 |
| ykarel | :) | 13:09 |
| panda | ykarel: I kneel, and start thinking "please work, please work" | 13:09 |
| ykarel | That's great if it works :) | 13:10 |
| panda | ykarel: 1 out of 17,342 tries, I think it's an absolute victory. | 13:11 |
| *** ratailor has quit IRC | 13:11 | |
| ykarel | yeap | 13:11 |
| *** udesale has quit IRC | 13:11 | |
| marios | ['/usr/share/tripleo-common/container-images/overcloud_containers.yaml.j2'] | 13:13 |
| panda | rfolco: molecule-provision-promoter-delegated-centos-8 PASSED the provisioner is migrated. We can begin with step 2 | 13:23 |
| rfolco | panda, \o/ | 13:23 |
| panda | rfolco: as soon as I understand why linters are complaining ... | 13:24 |
| zbr | panda: \o/ did you replace the job with a simple "true" ?:) | 13:28 |
| dpawlik | panda, ykarel let me know when the promotion works after changing the token | 13:29 |
| * beagles realizes this is likely a centos 7 vs 8 issue | 13:33 | |
| beagles | whoops wrong channel | 13:33 |
| panda | beagles: wrong channel but that statement is universally true. We feel less alone in the universe. | 13:37 |
| beagles | LOL | 13:37 |
| panda | zbr: ssssshhhh | 13:37 |
| ykarel | dpawlik, sure, looks good till now, promoter is still running, will share once it's succeed | 13:38 |
| panda | zbr: how do I make ansible-list skip a task ? it fails to analyze a to_nice_yaml filter and crashes | 13:38 |
| zbr | no idea | 13:39 |
| zbr | link to error? | 13:40 |
| panda | zbr: ok, nuking ansible-lint from orbit | 13:40 |
| panda | zbr: https://review.rdoproject.org/zuul/build/4631aa3fecdb427393ce2ede2bae4de4 | 13:40 |
| panda | zbr: the breaking line is https://review.rdoproject.org/r/#/c/26022/33/playbooks/molecule-pre.yaml@10 | 13:41 |
| panda | zbr: it took a while to find what was happening ... | 13:42 |
| zbr | i was fixed 9 days ago via https://github.com/ansible/ansible-lint/pull/518 | 13:43 |
| zbr | probably master works | 13:43 |
| zbr | let me try to convince them to make a pre-release | 13:43 |
| *** ykarel is now known as ykarel|afk | 13:43 | |
| dpawlik | ykarel, thanks | 13:43 |
| panda | zbr: ok, preparing the orbital cannon. | 13:44 |
| zbr | i just asked on #ansible-galaxy, better if you would also support my claim | 13:45 |
| chandankumar | weshay, mock card https://trello.com/c/OmeqSzC8/734-use-mock-from-non-epel-repo | 13:45 |
| zbr | there was a huge number of merged changes on ansible-lint recently, but not release made. | 13:45 |
| zbr | i wonder if we can use a sha256 as version, probably we can, let me try. | 13:46 |
| zbr | one of the benefits of using pre-commit is that we do not need a published wheel | 13:46 |
| *** PagliaccisCloud has joined #oooq | 13:52 | |
| marios | rlandy: can you please fpaste the bit about openstack-dependencies from your overcloud_containers.yaml.j2 | 13:53 |
| rlandy | marios: http://pastebin.test.redhat.com/850773 | 13:55 |
| marios | rlandy: ty | 13:55 |
| *** ykarel|afk is now known as ykarel | 14:02 | |
| panda | zbr: https://review.rdoproject.org/r/26030 | 14:07 |
| zbr | panda: brilliant, did it work? | 14:09 |
| zbr | there where lots of discussions upstream regarding revoke-sudo but w/o any conclusions | 14:10 |
| zbr | in the end most people agreed that revoke-sudo was not an effective security measure, more of a fool-proof protection than anything else | 14:11 |
| panda | zbr: yes, the cento8 promoter conversion is based on this | 14:12 |
| *** TrevorV has joined #oooq | 14:14 | |
| panda | zbr: any luck with the linters ? cah we use a sha ? | 14:14 |
| zbr | bad news there sha works but, that crash is fixed and replaced by another one | 14:14 |
| * panda fires the orbital cannon | 14:15 | |
| panda | zbr: bye bye ansible-lint | 14:15 |
| zbr | i proposed patch: https://github.com/ansible/ansible-lint/pull/709 | 14:15 |
| panda | zbr: can we use your pull request in precommit ? | 14:16 |
| marios | finally green fs 39 centos8 with os-tempest https://logserver.rdoproject.org/96/25796/13/check/tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039/8339b12/logs/undercloud/var/log/tempest/stestr_results.html.gz | 14:23 |
| marios | cc weshay chandankumar ^^ | 14:23 |
| weshay | WOW | 14:28 |
| weshay | marios++ | 14:29 |
| marios | weshay: well ... its not a corona vaccine... but yeah nice to see ;) i think the periodic should pass too ... it failed on image fetch (must have been a promotion during the run ) https://review.rdoproject.org/r/#/c/25796/ | 14:34 |
| rlandy | marios: ever seen this error: http://pastebin.test.redhat.com/850812 | 14:39 |
| ykarel | panda, dpawlik promoter worked with new token, master centos8 promoter | 14:40 |
| marios | rlandy: not that one.. but yesterday i was having lots of trouble with network issues on psi (couldn't install tripleoclient from pypi) | 14:41 |
| *** ratailor has joined #oooq | 14:41 | |
| weshay | panda, you avail to sync for a few today? | 14:46 |
| panda | weshay: yes | 14:47 |
| *** ysandeep|rover is now known as ysandeep|away | 14:50 | |
| weshay | panda, k.. can go early if you want | 14:53 |
| panda | weshay: I'm there | 14:55 |
| dpawlik | ykarel, thanks for info | 15:01 |
| *** bogdando has quit IRC | 15:03 | |
| zbr | panda: good news for you! i updated https://review.rdoproject.org/r/26022 | 15:13 |
| zbr | mainly my hotfix was merged to ansible-lint and i configure pre-commit to use the last commit, until we get a release made. | 15:13 |
| zbr | is cool that we can make use of this feature. | 15:14 |
| zbr | i also offerted to add zuul jobs to prevent regressions, directly on ansible-lint, i will probably list 4-5 openstack repos. | 15:14 |
| *** ykarel is now known as ykarel|away | 15:22 | |
| panda | weshay: https://review.rdoproject.org/r/25931 | 15:28 |
| panda | weshay: ^ batch promotion | 15:32 |
| panda | zbr: on which PS did you base PS38 ? | 15:33 |
| zbr | panda: git-review did not complain which means it was updated, but it would make sense to double check | 15:34 |
| zbr | it has a cool feature of warning you if the review was updated | 15:34 |
| *** blueDuckRandom has quit IRC | 15:35 | |
| rlandy | weshay, when running openstack overcloud containers build, we run that as non-root user. for podman, do we need to permission the user in some way? | 15:35 |
| zbr | panda: infra is preparing something interesting, take a look at https://review.opendev.org/#/c/610744/2/openstack/cloud/openstackcloud.py@9488 | 15:36 |
| zbr | it will be an email soon. | 15:37 |
| panda | zbr: I'm about to drool | 15:37 |
| zbr | but clearly it will make errors/warnings more visible to the users. | 15:37 |
| panda | zbr: I'll have to overwite your PS | 15:37 |
| panda | zbr: it was based on an old one | 15:38 |
| zbr | panda: sure feel free, only get the sha manually | 15:38 |
| panda | zbr: old commit message too | 15:38 |
| zbr | is one liner | 15:38 |
| panda | zbr: ok | 15:38 |
| *** blueDuckRandom has joined #oooq | 15:49 | |
| *** jmasud has quit IRC | 15:50 | |
| weshay | rlandy, I think it needs sudo | 15:52 |
| weshay | rlandy, scheduled some extra 1-1 time this afternoon to review your latest changes and ci bits I'm working on | 15:52 |
| dpawlik | plain | 15:52 |
| rlandy | k | 15:53 |
| marios | sshnaidm: fyi (you said you were also going to look there ) started that one https://review.opendev.org/716639 - still just skeleton cos end of day but pointing it out so we avoid any duplication | 15:57 |
| rfolco | panda, https://hackmd.io/06K4wRKaT42axGljoDKtjQ | 15:57 |
| sshnaidm | marios, ack | 15:57 |
| sshnaidm | marios, if need any guidance about operators feel free to ping me | 15:58 |
| marios | sshnaidm: thanks will do | 15:59 |
| akahat | I'm facing issue while installing tripleo standalone: http://pastebin.test.redhat.com/850781, any guess? | 16:02 |
| chandankumar | weshay, Hello | 16:03 |
| chandankumar | weshay, rlandy does the new tempest skip list format https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_e98/716289/7/gate/openstack-tox-docs/e98844d/docs/yaml/formatting.html looks good | 16:03 |
| chandankumar | ? | 16:03 |
| weshay | look at you w/ upstream DOC.. nice chandankumar | 16:04 |
| chandankumar | weshay, can you upload a new rhel qcow2 image on file server so that I can use in image build? | 16:05 |
| chandankumar | downstream | 16:05 |
| weshay | chandankumar, | 16:05 |
| weshay | - test: 'full.tempest.test' | 16:05 |
| weshay | bz: 'bugzilla bug' | 16:05 |
| weshay | lp: 'launchpad bug' | 16:05 |
| weshay | deployment: 'undercloud or overcloud' | 16:05 |
| weshay | jobs: | 16:05 |
| weshay | - job1 | 16:05 |
| weshay | - job2 | 16:05 |
| weshay | releases: | 16:05 |
| weshay | - master | 16:06 |
| weshay | lp: 'master launchpad' | 16:06 |
| weshay | - train | 16:06 |
| weshay | bz: 'train bugzilla' | 16:06 |
| weshay | - ussuri | 16:06 |
| weshay | we lost the summary of the skip | 16:06 |
| weshay | by design | 16:06 |
| weshay | chandankumar, right.. what we have today | 16:06 |
| weshay | perhaps it's not useful or needed? | 16:06 |
| chandankumar | arxcruz, ^^ | 16:06 |
| chandankumar | weshay, not all fields are mandatory | 16:07 |
| weshay | aye | 16:07 |
| arxcruz | chandankumar: weshay adding it | 16:07 |
| weshay | https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/validate-tempest/vars/tempest_skip_master.yml#L12 | 16:08 |
| weshay | e.g. reason: | 16:08 |
| weshay | arxcruz, k.. thanks | 16:08 |
| weshay | other than that.. looks great.. well done arxcruz chandankumar | 16:08 |
| chandankumar | weshay, all work is done by soniya29 arxcruz and kopecmartin | 16:10 |
| arxcruz | chandankumar: weshay done | 16:11 |
| *** marios has quit IRC | 16:11 | |
| chandankumar | arxcruz, can we enable gerrit review notification on tripleo for this project? | 16:12 |
| arxcruz | oh, nevermind, it got merged, let me add a new review :) | 16:12 |
| weshay | lolz | 16:12 |
| weshay | rfolco, so are we saying this is sprint 25? | 16:12 |
| weshay | yup | 16:13 |
| *** skramaja has quit IRC | 16:16 | |
| *** PagliaccisCloud has quit IRC | 16:16 | |
| rfolco | weshay, yes | 16:16 |
| arxcruz | chandankumar: kopecmartin weshay https://review.opendev.org/#/c/716650/ | 16:16 |
| rfolco | weshay, chandankumar pointed out that we are out of sync with rhos sprint calendar | 16:17 |
| rfolco | https://docs.google.com/spreadsheets/u/1/d/14df0Yvf7IPDjJy6dns9UDTpos7iEOs7PWtrAJV-kLHc/edit#gid=1549411639 | 16:17 |
| chandankumar | rfolco, apevec pointed out to me | 16:17 |
| rfolco | weshay, this happened at the end of the year... they moved sprint lengths back and forth and we didn't adjust it | 16:17 |
| weshay | ya.. thanks for spring forwarding us | 16:18 |
| * weshay updated ruck-rover pads | 16:18 | |
| chandankumar | weshay, first good bug from third party https://bugs.launchpad.net/tripleo/+bug/1870095 | 16:23 |
| openstack | Launchpad bug 1870095 in tripleo "keystone based standalone deployment failed with No such file or directory: ''/usr/sbin/nft'" [Critical,In progress] - Assigned to Michele Baldessari (michele) | 16:23 |
| chandankumar | i mean podman | 16:23 |
| *** jmasud has joined #oooq | 16:29 | |
| *** holser has quit IRC | 16:32 | |
| rlandy | weshay: holy cow!! localhost/tripleo-ci-rhosp17/rhel-binary-openstack-dependencies 1234 84151a8465cf 2 minutes ago 714 MB | 16:37 |
| weshay | WAHOOOO! | 16:50 |
| weshay | rlandy++ | 16:50 |
| weshay | chandankumar++ I see a patch is up too :) | 16:51 |
| weshay | YOU FOLKS ARE KILLIN IT | 16:51 |
| weshay | psi is SLOW | 16:52 |
| *** jmasud has quit IRC | 16:53 | |
| *** jmasud has joined #oooq | 16:56 | |
| panda | rfolco: https://review.rdoproject.org/r/26022 is green again, and with the new patch, also the linters are fixed | 17:03 |
| rfolco | great panda | 17:03 |
| panda | rfolco: about to leave, wanna sync up on the next steps again ? | 17:04 |
| rfolco | panda, yes | 17:06 |
| rfolco | panda, oiv geho mai | 17:06 |
| panda | rfolco: how dare you | 17:07 |
| *** dtantsur is now known as dtantsur|afk | 17:07 | |
| *** jpena is now known as jpena|off | 17:10 | |
| dpawlik | weshay, on both registry there is no images with hash starting with c1c1 | 17:16 |
| weshay | it's there I looked yesterday | 17:16 |
| * weshay gets | 17:16 | |
| *** ratailor has quit IRC | 17:16 | |
| dpawlik | weshay, old registry or new one? | 17:18 |
| weshay | dpawlik, https://hub.docker.com/layers/tripleostein/centos-binary-cinder-api/c1c1d6ca8c2e4187286a61c960a47335bb21357f_dabe06cc/images/sha256-7f16958c6da761fe9719034c30479b9f4a3c81d052237b12f6754016c630cb83?context=explore | 17:18 |
| weshay | dpawlik, it's not in rdo registries.. you guys deleted it.. that's the issue | 17:19 |
| dpawlik | weshay, not deleted, but sshnaidm was saing that images will be rebuilt | 17:19 |
| sshnaidm | dpawlik, weshay what will be rebuilt..? | 17:20 |
| dpawlik | sshnaidm, stein images | 17:21 |
| weshay | ya.. they will be.. I think that was a mistake.. and now it's blocking promotions.. so here we are | 17:21 |
| sshnaidm | weshay, you mean promoted stein images..? | 17:22 |
| weshay | the promoted images should not have been removed.. and should have been migrated | 17:22 |
| weshay | sshnaidm, aye | 17:22 |
| dpawlik | weshay, can we rebuild it or should I pull from dockerhub? | 17:23 |
| sshnaidm | weshay, checking.. | 17:24 |
| weshay | if we could pull current-tripleo for each branch from docker.io and push into the rdo registry.. that would fix this | 17:24 |
| weshay | and be awesome | 17:24 |
| dpawlik | weshay, checking | 17:24 |
| weshay | and the tag should be current-tripleo hash.. sshnaidm can help there | 17:24 |
| sshnaidm | weshay, let me see if I can promote stein now.. | 17:26 |
| weshay | sshnaidm, did you promote queens and rocky today manually? | 17:28 |
| weshay | I saw them both flip | 17:29 |
| sshnaidm | weshay, nope, automatically | 17:29 |
| weshay | woot | 17:29 |
| sshnaidm | weshay, there were problems with registry passwords and addresses, now it's fine | 17:29 |
| *** udesale_ has quit IRC | 17:29 | |
| weshay | dpawlik, ok.. so queens and rocky are not required :) | 17:29 |
| dpawlik | dpawlik, I will clean up tomorrow | 17:30 |
| dpawlik | weshay, so Sagi you will run promotion for stein one more time, right? | 17:30 |
| sshnaidm | dpawlik, checking | 17:30 |
| dpawlik | weshay, there is a slight misunderstanding. Now I see that it was better to migrate these images, not to rebuild them... As long as the old server is running, we can do it. | 17:32 |
| sshnaidm | dpawlik, weshay ok, so I'll promote stein today w/o upgrade jobs, and then will get them back to criteria so tonight it will try to promote automatically | 17:32 |
| sshnaidm | weshay, is it ok? ^ | 17:34 |
| weshay | sshnaidm, you are going to break upstream jobs | 17:34 |
| weshay | potentially | 17:34 |
| sshnaidm | stein jobs | 17:34 |
| weshay | sshnaidm, it's safer to pull from docker.io | 17:35 |
| sshnaidm | weshay, so we need c1c1d6ca8c2e4187286a61c960a47335bb21357f_df8abf35 containers? | 17:35 |
| dpawlik | yes | 17:35 |
| dpawlik | sshnaidm, ^^ | 17:35 |
| chandankumar | sshnaidm, https://pagure.io/zuul-distro-jobs/issue/61 will solve our use case | 17:35 |
| chandankumar | pull the code from somewhere and then pull spec from distgit and then build it | 17:36 |
| sshnaidm | dpawlik, ok, so "docker pull, docker tag, docker push rdo..."? | 17:36 |
| dpawlik | sshnaidm, no, this hash :) | 17:36 |
| dpawlik | sshnaidm, I also vote to rebuild instead of pull and push | 17:36 |
| sshnaidm | dpawlik, yeah, I mean this hash | 17:36 |
| weshay | rlandy, # yum module install virt | 17:36 |
| sshnaidm | dpawlik, I don't think it's possible to rebuild them now | 17:37 |
| sshnaidm | dpawlik, they're already built, it's simpler just copy them | 17:37 |
| sshnaidm | dpawlik, wanna me do it? | 17:37 |
| weshay | rlandy, dnf module list --enabled | 17:37 |
| *** amoralej is now known as amoralej|off | 17:40 | |
| sshnaidm | dpawlik, http://paste.openstack.org/show/791478/ | 17:40 |
| dpawlik | sshnaidm, https://softwarefactory-project.io/paste/show/1772/ | 17:41 |
| dpawlik | sshnaidm, yes, please | 17:41 |
| dpawlik | I can do the loop | 17:42 |
| *** jmasud has quit IRC | 17:42 | |
| dpawlik | sshnaidm, I'm login to the local vm, so I can perform the command | 17:42 |
| dpawlik | if you want | 17:42 |
| weshay | rlandy, https://github.com/rlandy.keys | 17:43 |
| *** jmasud has joined #oooq | 17:43 | |
| sshnaidm | dpawlik, I'm on it | 17:44 |
| *** jmasud has quit IRC | 17:44 | |
| *** jmasud has joined #oooq | 17:46 | |
| dpawlik | upgraded pull http://paste.openstack.org/show/791479/ | 17:46 |
| *** jbadiapa has quit IRC | 17:49 | |
| *** jbadiapa has joined #oooq | 17:50 | |
| dpawlik | sshnaidm, I will go on afk. Let me know on priv if all is fine | 17:50 |
| sshnaidm | dpawlik, ok, it's in progress | 17:51 |
| dpawlik | sshnaidm, and if I should execute the for loop to pull and push all images, just write me | 17:51 |
| sshnaidm | dpawlik, no need, it's going on | 17:52 |
| *** blueDuckRandom has quit IRC | 18:07 | |
| *** blueDuckRandom has joined #oooq | 18:23 | |
| bhagyashris | weshay, i would like your insights on https://review.rdoproject.org/r/#/c/26197/ | 18:43 |
| weshay | k | 18:43 |
| weshay | bhagyashris, very well done :) | 18:45 |
| bhagyashris | weshay, thank you :) | 18:45 |
| *** blueDuckRandom has quit IRC | 18:52 | |
| sshnaidm | dpawlik, weshay containers pushed, running upgrade jobs https://review.rdoproject.org/r/#/c/25814/ | 18:59 |
| *** jfrancoa has quit IRC | 19:29 | |
| *** derekh has quit IRC | 19:40 | |
| rlandy | weshay: ok - ready for CI ... | 19:49 |
| rlandy | localhost/tripleo-ci-rhosp17/rhel-binary-openstack-glance-api 1234 f4adcb85d331 17 seconds ago 1.02 GB | 19:50 |
| rlandy | localhost/tripleo-ci-rhosp17/rhel-binary-openstack-glance-base 1234 a991533919f7 About a minute ago 976 MB | 19:50 |
| rlandy | localhost/tripleo-ci-rhosp17/rhel-binary-openstack-dependencies 1234 6a83930fdefd 2 minutes ago 714 MB | 19:50 |
| weshay | rlandy++ | 19:59 |
| weshay | rlandy, I have to go sign a few docs w/ a notary | 19:59 |
| weshay | rlandy, I can do the ci stuff w/ you later tonight or tomorrow morning | 20:00 |
| *** weshay is now known as weshay|ruck | 20:00 | |
| rlandy | weshay|ruck: no worries - still going through your hackmd | 20:00 |
| rlandy | rfolco: hey | 20:01 |
| rfolco | rlandy, o/ | 20:01 |
| rlandy | I need to reschedule my training session | 20:01 |
| rlandy | I thought I was on April 30 | 20:01 |
| rlandy | but when I checked the list I am on April 7th | 20:01 |
| rfolco | rlandy, when you are avail? | 20:02 |
| rlandy | looking at the list | 20:02 |
| weshay|ruck | rlandy, you have access to my rig.. so you can verify your setup there as well | 20:04 |
| rlandy | rfolco: can you switch me with anyone from the 20th ->? | 20:04 |
| rlandy | sorry for late notice | 20:05 |
| *** jbadiapa has quit IRC | 20:07 | |
| *** jbadiapa has joined #oooq | 20:08 | |
| rfolco | rlandy, we can try switching w/ 04/23 or 05/21 | 20:09 |
| rfolco | what you prefer | 20:09 |
| rlandy | rfolco: I'll take 04/23 but either one works | 20:11 |
| rlandy | thank you | 20:11 |
| rfolco | ok thx | 20:11 |
| *** jmasud has quit IRC | 20:54 | |
| *** jmasud has joined #oooq | 20:56 | |
| *** jbadiapa has quit IRC | 21:14 | |
| *** rlandy is now known as rlandy|brb | 22:12 | |
| *** TrevorV has quit IRC | 22:31 | |
| *** rlandy|brb is now known as rlandy | 22:58 | |
| *** tosky has quit IRC | 23:03 | |
| rlandy | weshay|ruck: fyi ... left all my notes/hacks in the HackMD if you want to follow them | 23:27 |
| *** rlandy has quit IRC | 23:58 | |
| *** sshnaidm is now known as sshnaidm|afk | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!