*** rlandy|bbl is now known as rlandy | 00:32 | |
*** Goneri has quit IRC | 00:39 | |
*** rfolco has quit IRC | 00:58 | |
*** rlandy has quit IRC | 01:50 | |
*** ykarel has joined #oooq | 04:28 | |
*** ratailor has joined #oooq | 04:37 | |
*** ysandeep|away is now known as ysandeep|rover | 04:38 | |
*** ykarel has quit IRC | 05:16 | |
*** udesale has joined #oooq | 05:27 | |
*** ykarel has joined #oooq | 05:31 | |
ysandeep|rover | chandankumar, ykarel fyi.. ci is red.. too many failure because of https://bugs.launchpad.net/tripleo/+bug/1889122 | 05:32 |
---|---|---|
openstack | Launchpad bug 1889122 in tripleo "mirror timeouts in upstream causing undercloud and standalone failures" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 05:32 |
*** ykarel is now known as ykarel|mtg | 05:33 | |
*** ykarel_ has joined #oooq | 05:36 | |
*** ykarel|mtg has quit IRC | 05:39 | |
*** bhagyashris|away is now known as bhagyashris | 06:01 | |
chandankumar | ysandeep|rover: looking | 06:01 |
*** marios has joined #oooq | 06:03 | |
ysandeep|rover | chandankumar, thanks!, fyi.. weshay|ruck also send a mail of openstack-discuss with more info, Sub: [tripleo][ci] container pulls failing | 06:03 |
ysandeep|rover | s/of/on | 06:03 |
chandankumar | yup saw that | 06:05 |
ykarel_ | ysandeep|rover, ack hmm i saw wes mail | 06:08 |
*** ykarel_ is now known as ykarel | 06:08 | |
ysandeep|rover | thanks o/ | 06:09 |
chandankumar | ysandeep|rover: Do we want to move impacted job to nv? | 06:10 |
chandankumar | till we get a solution | 06:10 |
chandankumar | especially minions one? | 06:10 |
chandankumar | sorry ignore the minion one message | 06:11 |
ysandeep|rover | chandankumar, ack, yes multiple jobs are affected not only minion job | 06:15 |
chandankumar | http://paste.openstack.org/show/796359/ jobs from bz | 06:15 |
ysandeep|rover | weshay|ruck proposed https://review.opendev.org/#/c/743432/3 to locally build containers but it failed, I am checking logs of it | 06:15 |
chandankumar | https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-7-standalone-upgrade-train&job_name=tripleo-ci-centos-7-scenario007-multinode-oooq-container&job_name=tripleo-ci-centos-8-containers-undercloud-minion&job_name=tripleo-ci-centos-7-standalone&job_name=tripleo-ci-centos-8-containerized-undercloud-upgrades | 06:16 |
chandankumar | ysandeep|rover: sure | 06:16 |
*** jfrancoa has joined #oooq | 06:30 | |
*** yolanda has quit IRC | 06:52 | |
*** yolanda has joined #oooq | 06:52 | |
*** amoralej|off is now known as amoralej | 07:05 | |
*** bogdando has joined #oooq | 07:34 | |
ysandeep|rover | chandankumar, In wes patch https://review.opendev.org/#/c/743432/, Jobs are failing because they are trying to pull container image with prefix "centos-binary-" but the images uploaded in local registry have prefix "openstack-" | 07:37 |
ysandeep|rover | https://657b14bfa6092f8bf722-e48c4084f6218ce55719e5f9f078d786.ssl.cf1.rackcdn.com/743432/3/check/tripleo-ci-centos-8-scenario001-standalone/94b90a5/logs/undercloud/home/zuul/standalone_deploy.log | 07:37 |
ysandeep|rover | ~~~ | 07:37 |
ysandeep|rover | 404 Client Error: Not Found for url: http://127.0.0.1:5001/v2/tripleomaster/centos-binary-aodh-api/tags/list | 07:37 |
ysandeep|rover | ~~~ | 07:37 |
ysandeep|rover | https://657b14bfa6092f8bf722-e48c4084f6218ce55719e5f9f078d786.ssl.cf1.rackcdn.com/743432/3/check/tripleo-ci-centos-8-scenario001-standalone/94b90a5/logs/undercloud/var/log/extra/podman/podman_allinfo.log | 07:37 |
ysandeep|rover | ~~~ | 07:37 |
ysandeep|rover | 127.0.0.1:5001/tripleomaster/openstack-aodh-api b3a5811a74de3042cee6b45042d81fec bc4a267fdb4a 21 minutes ago 674 MB | 07:37 |
ysandeep|rover | ~~~ | 07:37 |
ysandeep|rover | May be https://review.opendev.org/#/c/729465/47/roles/extras-common/defaults/main.yml@43 need an update to get centos-binary prefix | 07:38 |
chandankumar | ysandeep|rover: checking | 07:39 |
*** tosky has joined #oooq | 07:42 | |
*** jbadiapa has joined #oooq | 07:42 | |
chandankumar | ysandeep|rover: yes, because of this https://review.opendev.org/#/c/743432/3/roles/extras-common/defaults/main.yml@42 | 07:43 |
chandankumar | sorry | 07:44 |
chandankumar | ysandeep|rover: may be we can move the https://review.opendev.org/#/c/743432/3/roles/extras-common/defaults/main.yml@65 | 07:44 |
chandankumar | condition just above line 43 | 07:44 |
chandankumar | then it will work fine | 07:44 |
chandankumar | ysandeep|rover: Do you want me to update the patch? | 07:44 |
ysandeep|rover | chandankumar, yes please | 07:45 |
ysandeep|rover | chandankumar, I can do it if its just about moving line 65 before line 43.. | 07:49 |
chandankumar | ysandeep|rover: done | 07:49 |
ysandeep|rover | chandankumar, :) thanks! | 07:49 |
*** jpena|off is now known as jpena | 07:54 | |
*** bhagyashris is now known as bhagyashris|lunc | 08:10 | |
*** ysandeep|rover is now known as ysandeep|lunch | 08:11 | |
*** derekh has joined #oooq | 08:41 | |
arxcruz | odyssey4me: did not work the workaround, basically, it's different the way tripleo installs os_tempest :/ | 08:48 |
odyssey4me | arxcruz: what do you mean? | 08:58 |
odyssey4me | arxcruz: if that didn't work, then there are always other ways ;) | 08:59 |
arxcruz | odyssey4me: the venv_build_global_constraints have no effect, it wasn't even being called, probably in o-a works because the way os_tempest is installed in those jobs | 08:59 |
arxcruz | odyssey4me: yes, i'm trying other ways now | 08:59 |
arxcruz | but i was so hopeful | 09:00 |
odyssey4me | arxcruz: hmm, that makes no sense - do you have a job result I can look at? | 09:00 |
odyssey4me | (sorry, I'm still working through morning emails) | 09:00 |
arxcruz | odyssey4me: need to check, probably not, i did some rechecks already | 09:01 |
arxcruz | odyssey4me: https://536f9c61966afc49eab1-3f411ee28045e7c41608c6d36a93ae2a.ssl.cf5.rackcdn.com/740662/6/check/tripleo-ci-centos-7-containers-multinode-queens/00374b9/job-output.txt | 09:02 |
odyssey4me | arxcruz: well, it looks like the source build parts are being skipped because source-build is disabled... so none of that is used | 09:03 |
odyssey4me | arxcruz: it's all coming from packages then | 09:03 |
arxcruz | odyssey4me: yeah :/ | 09:04 |
odyssey4me | arxcruz: right, so trying to adjust u-c was a waste of time... can the package spec not be updated? if not, then you'd have to use a source-based test instead | 09:04 |
arxcruz | odyssey4me: package can't be upgraded without change upper-constraints | 09:05 |
*** ysandeep|lunch is now known as ysandeep | 09:05 | |
odyssey4me | arxcruz: ok, I see where the failures are - this can be solved in another way... hang on a bit | 09:05 |
*** ysandeep is now known as ysandeep|rover | 09:11 | |
*** dtantsur|afk is now known as dtantsur | 09:12 | |
odyssey4me | arxcruz: ok, I see you're trying to install openstacksdk into the system - that's one approach... but it's failing because pyyaml on the system isn't new enough... this is a deep hole to climb into | 09:15 |
arxcruz | odyssey4me: yeah ;/ | 09:15 |
odyssey4me | arxcruz: there is another way to do this which will be properly constrained and therefore safer | 09:15 |
arxcruz | odyssey4me enlight me | 09:15 |
odyssey4me | arxcruz: effectively you'll be wanting to use the venv create role to create a new venv to install openstacksdk into, then you give os_tempest the path to that venv ion the variable https://opendev.org/openstack/openstack-ansible-os_tempest/src/branch/master/defaults/main.yml#L38 which tells it which python interpreter to use for the resource setup tasks | 09:16 |
odyssey4me | arxcruz: does that make sense? | 09:17 |
arxcruz | odyssey4me: then i need to also install ansible right ? | 09:18 |
arxcruz | or venv create role do it as well | 09:18 |
odyssey4me | arxcruz: no, it won't need ansible - only the openstacksdk | 09:18 |
arxcruz | odyssey4me: ok, let me try that | 09:19 |
odyssey4me | arxcruz: the trick is to give the venv create role the openstacksdk requirement, and the constraints to use to ensure that they're pinned | 09:19 |
odyssey4me | they being openstacksdk and all its requirements | 09:20 |
arxcruz | odyssey4me: http://paste.openstack.org/show/796362/ something like this? | 09:23 |
odyssey4me | arxcruz: a little different - hang a sec | 09:28 |
*** bhagyashris|lunc is now known as bhagyashris | 09:41 | |
odyssey4me | arxcruz: something like this should do it - https://gist.github.com/odyssey4me/e4f2be1bc6dfd5c8745a4c5e9b96196f | 09:41 |
odyssey4me | arxcruz: although I still have to ask = what's causing the failure with the older sdk version? | 09:42 |
arxcruz | odyssey4me: the os_xyz ansible modules requires at least sdk >= 0.12 | 09:42 |
arxcruz | odyssey4me: rocky constraint? | 09:42 |
odyssey4me | arxcruz: yeah, so you get a newer openstacksdk than queens, but you also have constraints to ensure everything stays at a specific version set | 09:43 |
odyssey4me | arxcruz: it's the simplest maintainable way to do it - the alternative is to supply a set of constraints which has the minimum versions of all openstacksdk deps | 09:44 |
odyssey4me | arxcruz: to me, that's more work | 09:44 |
arxcruz | odyssey4me: thanks, let's see if it will work | 09:48 |
*** udesale_ has joined #oooq | 09:58 | |
*** udesale has quit IRC | 10:01 | |
arxcruz | chandankumar: #openstack-ansible please | 10:36 |
sshnaidm | arxcruz, why just not install openstacksdk with another pip call without PIP_CONSTRAINTS? | 10:38 |
arxcruz | sshnaidm: on quickstart env? | 10:40 |
arxcruz | that also a good idea :) | 10:40 |
sshnaidm | arxcruz, yes | 10:40 |
akahat | chandankumar, ysandeep|rover when you are free | 10:49 |
akahat | https://review.opendev.org/#/c/743171/ | 10:49 |
*** saneax has joined #oooq | 10:53 | |
ysandeep|rover | akahat, o/ You mentioned Older tooz versions are breaking openstack baremetal command in tripleO - You mean periodic component jobs? | 10:58 |
akahat | ysandeep|rover, no. actually there are some changes on ironic side. to run openstack baremetal cli you needed updated tooz. | 10:59 |
akahat | i don't think we are running any openstack baremetal command in periodic job. | 10:59 |
ysandeep|rover | akahat, ack | 10:59 |
ysandeep|rover | akahat, ack | 11:03 |
*** bhagyashris is now known as bhagyashris|away | 11:06 | |
*** jpena is now known as jpena|lunch | 11:28 | |
*** bhagyashris|away is now known as bhagyashris | 11:36 | |
ysandeep|rover | chandankumar, I just noticed https://review.opendev.org/#/c/743433/ is rebased on https://review.opendev.org/#/c/743325/(which is now abandoned state). This need correction as well. | 11:37 |
chandankumar | ysandeep|rover: want me to fix that one? | 11:38 |
ysandeep|rover | chandankumar, I will do that, Just rebase on master is okay? | 11:39 |
chandankumar | ysandeep|rover: i think so | 11:39 |
ysandeep|rover | chandankumar, ack doing, weshay|ruck will also be in soon | 11:39 |
chandankumar | ysandeep|rover: parent is this https://review.opendev.org/gitweb?p=openstack%2Ftripleo-quickstart.git;a=commitdiff;h=27d233eb3c674fa1928eb5c1685aa093c85de6e0 | 11:40 |
chandankumar | yes, that is abandoned | 11:40 |
chandankumar | go head with master rebase | 11:40 |
ysandeep|rover | chandankumar, ack | 11:40 |
chandankumar | i have just one query, may be rlandy commit might stay there while rebasing | 11:41 |
ysandeep|rover | chandankumar, which commit? | 11:42 |
chandankumar | ysandeep|rover: https://review.opendev.org/#/c/743325/ | 11:44 |
chandankumar | ysandeep|rover: while rebasing drop the above change it will work | 11:44 |
weshay|ruck | chandankumar, ysandeep|rover thanks for driving that :) | 11:45 |
weshay|ruck | how's it going? | 11:45 |
*** ratailor has quit IRC | 11:45 | |
ysandeep|rover | weshay|ruck, the patch you proposed last night https://review.opendev.org/#/c/743432/ - jobs were failing because they are trying to pull jobs with container image name with prefix “centos-binary-” but the images uploaded in local registry have prefix “openstack-” | 11:48 |
ysandeep|rover | weshay|ruck, chandankumar helped us trying to correct the prefix there | 11:48 |
weshay|ruck | ah.. thanks for jumping on it | 11:48 |
weshay|ruck | aye | 11:48 |
ysandeep|rover | chandankumar, https://review.opendev.org/#/c/743433/ rebased | 11:49 |
ysandeep|rover | weshay|ruck, I saw master promotion is blocked because of sc01/02 - and later found last night chatter that emilien proposed a wip patch. I have opened a bz for reference - https://bugs.launchpad.net/tripleo/+bug/1889192 | 11:53 |
openstack | Launchpad bug 1889192 in tripleo "Master Periodic jobs: Sc001/002 failing with Error: \", \" Problem: package rdma-core-26.0-8.el8.x86_64 requires dracut, but none of the providers can be installed" [Critical,Triaged] | 11:53 |
ysandeep|rover | weshay|ruck, also trying to promote rockly(pending from 9 days) with testpatch https://review.rdoproject.org/r/#/c/28437/ - jobs are running currently | 11:54 |
weshay|ruck | ysandeep|rover, ya.. I just pinged Evilien... I think we may want to update that patch ourselves | 11:54 |
weshay|ruck | ysandeep|rover, ah.. thanks | 11:55 |
ysandeep|rover | weshay|ruck, yatin tested that patch it worked.. so may we just have to just remove wip from there? | 11:56 |
ysandeep|rover | https://review.rdoproject.org/r/#/c/28723/ - testpatch | 11:56 |
weshay|ruck | sshnaidm, ysandeep|rover chandankumar Sagi has a good idea how to further mitigate docker.io issues | 11:56 |
weshay|ruck | if we have the opportunity, we should all chat | 11:56 |
ysandeep|rover | I am free for call o/ | 11:57 |
*** chem has joined #oooq | 11:57 | |
weshay|ruck | ysandeep|rover, ya.. I have one as well.. worked.. Emiliens patch is good to go | 11:57 |
weshay|ruck | ysandeep|rover, ack from Evilien.. update the msg and MERGE baby MERGE | 11:58 |
ysandeep|rover | weshay|ruck, on it | 11:58 |
chem | weshay|ruck: hey, I'm bumping into that issue https://bugs.launchpad.net/tripleo/+bug/1889209 , so now I'm wondering what I'm missing about tht patch that depends on a tripleo-ansible module | 11:58 |
openstack | Launchpad bug 1889209 in tripleo "tox-tht in tht doesn't take into accout depends-on on tripleo-ansible." [Critical,Triaged] | 11:58 |
weshay|ruck | chandankumar, https://review.opendev.org/#/c/743263/ | 11:59 |
chandankumar | ysandeep|rover: sure | 11:59 |
weshay|ruck | chem, /me looks | 12:00 |
chem | weshay|ruck: ack | 12:01 |
*** rfolco has joined #oooq | 12:02 | |
*** amoralej is now known as amoralej|lunch | 12:05 | |
weshay|ruck | chem, let me bring in my tox guy.. zbr can you help w/ this? We have a tox job that is not behaving w/ depends-on | 12:07 |
chem | weshay|ruck: zbr problem here is that we pull in tripleo-ansible master from some ansible code: we would need to be able to check that the depends-on is on tripleo-ansible and then pull it in from the ansible task | 12:08 |
chem | weshay|ruck: zbr but, hey, ... it's only code :) | 12:08 |
weshay|ruck | ya.. should just use what zuul lays down in /home/zuul/src | 12:08 |
zbr | looking now | 12:09 |
weshay|ruck | thanks | 12:09 |
chem | weshay|ruck: zbr oh ... right if it's already there somewhere then we just change the role path and we're done | 12:09 |
*** rlandy has joined #oooq | 12:10 | |
zbr | weshay|ruck: is right. just use code from zuul w/o trying to reimplement what it does | 12:10 |
zbr | we already know how well this worked with quickstart | 12:10 |
zbr | this means: do not clone code that is expected to be part of the tested change | 12:10 |
zbr | only copy (sync) from zuul node , git should not be involved | 12:11 |
rlandy | zbr: did you ever update the internal promoter? | 12:13 |
rlandy | it was working fine a while back but now it needs the updates we have done on rdocloud | 12:14 |
zbr | rlandy: nope. only the one running master/train | 12:14 |
weshay|ruck | zbr, chem here's https://opendev.org/openstack/tripleo-heat-templates/src/branch/master/tripleo_heat_templates/tests/test_tht_ansible_syntax.py#L20 | 12:19 |
weshay|ruck | seems odd.. have to try this locally | 12:20 |
chem | zbr: this resolve into https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_f9d/742632/8/check/tripleo-ci-centos-8-scenario000-multinode-oooq-container-upgrades/f9db271/logs/undercloud/home/zuul/overcloud_upgrade_run_Controller.log | 12:20 |
zbr | weshay|ruck: re cross repo testing, I am not sure what we should do | 12:20 |
chem | zbr: sorry wrong paste | 12:20 |
chem | zbr: this resolve in /home/chem/src/openstack/tripleo-heat-templates/tripleo_heat_templates/tests/tripleo-ansible/tripleo-ansible/tripleo_ansible/roles | 12:21 |
chem | zbr: ie the one downloaded there https://opendev.org/openstack/tripleo-heat-templates/src/branch/master/tripleo_heat_templates/tests/tht-role-requirements.yml#L17 | 12:21 |
weshay|ruck | zbr, I think we just respect the src that zuul pulls | 12:21 |
weshay|ruck | has to be in required-projects.. | 12:22 |
zbr | it is impossible to make cross repo testing in all cases | 12:22 |
weshay|ruck | all cases? let's focus on tripleo-ansible and tht | 12:22 |
zbr | if you do this, you break the installation logic for production use case, or local testing | 12:22 |
chem | zbr: weshay|ruck if https://opendev.org/openstack/tripleo-heat-templates/src/branch/master/tripleo_heat_templates/tests/tht-role-requirements.yml#L19 was pointing to the local zuul triplea-ansible that would work | 12:22 |
zbr | zuul knows to clone multiple repos alongsite tested repo, but is up to our code to decide where to get the dependency from | 12:23 |
zbr | on zuul we want to use the already cloned copy, but for other cases we do not have this | 12:24 |
weshay|ruck | chem, agree | 12:24 |
rlandy | rfolco: do we have anything on the agenda for the community meeting? | 12:25 |
weshay|ruck | zbr, see that? https://opendev.org/openstack/tripleo-heat-templates/blame/branch/master/tripleo_heat_templates/tests/tht-role-requirements.yml | 12:25 |
rfolco | rlandy, none | 12:25 |
weshay|ruck | chem, we could probably do both | 12:25 |
rfolco | rlandy, feel free to add https://hackmd.io/IhMCTNMBSF6xtqiEd9Z0Kw#2020-07-28-Community-call | 12:26 |
weshay|ruck | chem, when: /home/zuul/src exists... do foo | 12:26 |
weshay|ruck | else what's there | 12:26 |
*** ysandeep|rover is now known as ysandeep|brb | 12:26 | |
rlandy | rfolco: ok - then I'd like to discuss the internal promoter | 12:26 |
rlandy | will add | 12:26 |
zbr | i guess https://opendev.org/openstack/tripleo-heat-templates/src/branch/master/tripleo_heat_templates/tests/test_tht_ansible_syntax.yml#L55-L60 can be improived | 12:26 |
weshay|ruck | also needs to come from zuul | 12:26 |
chem | weshay|ruck: zbr always fun like seemingly "easy" changes become a maze in less than 2 min :) | 12:28 |
weshay|ruck | these tests need to reviewed and reworked | 12:28 |
zbr | and takes 2 months to (fail to) implement | 12:29 |
weshay|ruck | to account for things like upstream and things like depends-on | 12:29 |
zbr | weshay|ruck: do not take depends-on as granted, is far harder to make it work than it seems | 12:29 |
*** holser has quit IRC | 12:30 | |
*** holser has joined #oooq | 12:31 | |
weshay|ruck | who's going to start a patch? | 12:31 |
zbr | weshay|ruck: read https://github.com/ansible/galaxy/issues/2030 | 12:32 |
zbr | my impression is that it was sorted, but i am not sure, clearly installing from local git is not documented | 12:33 |
*** jpena|lunch is now known as jpena | 12:34 | |
*** ysandeep|brb is now known as ysandeep|rover | 12:37 | |
*** holser has quit IRC | 12:39 | |
*** holser has joined #oooq | 12:40 | |
weshay|ruck | zbr, let's chat | 12:42 |
weshay|ruck | zbr, https://meet.google.com/iyy-svfo-fyw | 12:42 |
ykarel | arxcruz, weshay|ruck skiplist thing still failing tripleo quickstart https://ci.centos.org/job/tripleo-quickstart-promote-master-current-tripleo-delorean-minimal/782/consoleText | 12:52 |
weshay|ruck | ykarel, talk to arx | 12:52 |
ykarel | ohhk pinged him too | 12:53 |
weshay|ruck | arxcruz, ^^^ | 12:53 |
arxcruz | ykarel: checking | 12:53 |
weshay|ruck | chandankumar, 1 sec .. getting more go juice | 12:59 |
arxcruz | ykarel: python path is wrong there, i'll see how to fix it :) | 13:04 |
ykarel | arxcruz, what should be python path? | 13:06 |
*** amoralej|lunch is now known as amoralej | 13:07 | |
arxcruz | ykarel: the one quickstart.sh create | 13:07 |
arxcruz | the virtualenv | 13:07 |
ykarel | arxcruz, that's correct than | 13:07 |
ykarel | issue is the task is runnin on undercloud | 13:07 |
ykarel | and venv is created on different host | 13:07 |
weshay|ruck | https://bugs.launchpad.net/tripleo/+bug/1889122 | 13:08 |
openstack | Launchpad bug 1889122 in tripleo "mirror timeouts in upstream causing undercloud and standalone failures" [Critical,In progress] - Assigned to Sandeep Yadav (sandeepyadav93) | 13:08 |
*** Goneri has joined #oooq | 13:13 | |
chandankumar | weshay|ruck: https://zuul-ci.org/docs/zuul-jobs/docker-image.html#run-an-intermediate-container-registry | 13:21 |
arxcruz | ykarel: i see, damn... this is a problem :/ | 13:27 |
*** TrevorV has joined #oooq | 13:36 | |
arxcruz | weshay|ruck: need your help when you're available to test the tripleo-quickstart-promote-master-current-tripleo-delorean-minimal on my box | 13:37 |
ykarel | arxcruz, it should be reproducable by just running quickstart.sh for release where os-tempest is used | 13:42 |
ykarel | i hit that issue when i was using it locally | 13:43 |
*** ysandeep|rover is now known as ysandeep|away | 14:05 | |
chandankumar | weshay|ruck: rlandy sorry my internet went down | 14:07 |
*** rlandy is now known as rlandy|training | 14:07 | |
rlandy|training | np | 14:07 |
ysandeep|away | weshay|ruck, https://review.rdoproject.org/r/#/c/28437/ (rocky promotion testpatch)- still running but some ovb job already failed there :( | 14:09 |
ysandeep|away | "Message: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures | 14:09 |
ysandeep|away | https://logserver.rdoproject.org/37/28437/1/check/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-rocky-upload/c64133f/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 14:09 |
ysandeep|away | What should we do - rerun ovb job on rdocloud instead on vexxhost? | 14:10 |
weshay|ruck | ysandeep|away, sorry.. trying to figure out who is fixing a tht issue | 14:18 |
weshay|ruck | zbr, can you follow ur pull-requests up w/ the change in tht? | 14:18 |
weshay|ruck | ysandeep|away, don't worry about rocky atm | 14:18 |
weshay|ruck | sshnaidm, is now a decent time to outline a design | 14:19 |
weshay|ruck | for parent/child? | 14:19 |
sshnaidm | weshay|ruck, yeah | 14:19 |
ysandeep|away | weshay|ruck, ack thanks, see you tomorrow bye o/ | 14:19 |
weshay|ruck | ysandeep|away, 0/ I'll take of rocky | 14:20 |
weshay|ruck | sshnaidm, https://meet.google.com/xfz-eiet-ngj | 14:20 |
*** ykarel is now known as ykarel|away | 14:28 | |
weshay|ruck | chandankumar, hey.. do you want to work on a poc for parent / child w/ sshnaidm ? | 14:42 |
chandankumar | weshay|ruck: yes sure | 14:49 |
chandankumar | weshay|ruck: I will work on that | 14:49 |
zbr | chem: weshay|ruck : not sure if it will work, but https://review.opendev.org/#/c/743562/1 is how it should look like | 14:54 |
zbr | chem: if you can takeover ^ it would be great. if it does not work is because path is wrong or a typo in bash snippet | 14:55 |
weshay|ruck | chandankumar, please review https://hackmd.io/ermQSlQ-Q-mDtZkNN2oihQ | 14:55 |
weshay|ruck | chandankumar, and get up w/ Sagi as you can.. thank you very much!! | 14:55 |
chem | zbr++ thanks for bootstraping it. Currently, I have like 0 time for this as I'm in a middle of blocker bug. | 14:57 |
*** TrevorV has quit IRC | 15:06 | |
*** TrevorV has joined #oooq | 15:13 | |
*** ykarel|away has quit IRC | 15:13 | |
chandankumar | weshay|ruck: thanks, will take a look | 15:28 |
arxcruz | odyssey4me: https://16e6823b82e0702839ed-f5f9db48cece18129c95e0f012823810.ssl.cf2.rackcdn.com/742624/9/check/tripleo-ci-centos-7-containers-multinode-queens/08bc608/job-output.txt | 15:34 |
arxcruz | odyssey4me: is it fine to use become true here? | 15:34 |
*** udesale_ has quit IRC | 15:40 | |
odyssey4me | arxcruz: looking | 15:55 |
*** bogdando has quit IRC | 15:58 | |
*** marios has quit IRC | 15:58 | |
odyssey4me | arxcruz: https://review.opendev.org/743573 | 16:00 |
chandankumar | weshay|ruck: rlandy|training https://review.opendev.org/743433 and https://review.opendev.org/#/c/743432/ when free | 16:07 |
*** amoralej is now known as amoralej|off | 16:19 | |
*** saneax has quit IRC | 16:21 | |
chandankumar | weshay|ruck: Need some help on this review https://review.opendev.org/743258 | 16:25 |
chandankumar | weshay|ruck: and please +w this one https://review.opendev.org/742662 | 16:26 |
arxcruz | odyssey4me: thanks, i'll add a depends on | 16:26 |
*** dtantsur is now known as dtantsur|afk | 16:32 | |
*** rlandy|training is now known as rlandy | 16:35 | |
*** chem has quit IRC | 16:37 | |
chandankumar | rlandy: free for sometime? | 16:53 |
chandankumar | rlandy: we still need to keep overcloud-containers.yaml.j2 file for queens as there is no image source defined there | 16:54 |
*** derekh has quit IRC | 17:00 | |
*** ykarel|away has joined #oooq | 17:03 | |
rlandy | chandankumar: hey - back | 17:12 |
* rlandy looks at review | 17:13 | |
rlandy | chandankumar: for promoter - ok then | 17:14 |
rlandy | weshay|ruck: wrt https://review.opendev.org/#/c/743432/11/roles/extras-common/defaults/main.yml - docker_prep_prefix | 17:15 |
*** jpena is now known as jpena|off | 17:16 | |
rlandy | Emilien thought that we would always use openstack- | 17:16 |
* weshay|ruck looks | 17:16 | |
weshay|ruck | aye | 17:16 |
weshay|ruck | rlandy, concerns? | 17:17 |
rlandy | weshay|ruck: we've always used binary- | 17:19 |
rlandy | I +2'ed your patch | 17:19 |
rlandy | works for me | 17:19 |
rlandy | downstream uses openstack- | 17:19 |
rlandy | because they build all sorts of containers | 17:19 |
chandankumar | rlandy: https://review.opendev.org/742662 | 17:20 |
weshay|ruck | ah nice | 17:21 |
chandankumar | rlandy: and https://review.rdoproject.org/r/28673 (merging this will not hurt) | 17:21 |
rlandy | ok - merging | 17:22 |
*** ykarel|away has quit IRC | 17:41 | |
rlandy | panda: hi - sorry to disturb you (in the new role) ... quick question ... for downstream, it is safe to just use allowed_clients: dlrn_client,qcow_client. will that rev the dockerfiles link? | 17:54 |
rlandy | weshay|ruck: ok if I merge https://review.rdoproject.org/r/#/c/28730/? can't test any 16.2 pormotion jobs w/o it being merged. config does not take depends-on testing | 18:08 |
rlandy | rfolco: ^^ | 18:09 |
rlandy | pls review | 18:09 |
rfolco | +2 rlandy | 18:10 |
rlandy | rfolco: thanks - may need to change that but it's my first best guess | 18:10 |
arxcruz | weshay|ruck: around? | 18:32 |
weshay|ruck | arxcruz, aye | 18:32 |
arxcruz | weshay|ruck: i've ooo deployed on my bm, how can i run only the tempest there? | 18:32 |
arxcruz | i mean, do a change in the code, and run the playbook | 18:33 |
* weshay|ruck gets doc | 18:33 | |
* arxcruz don't remember | 18:33 | |
weshay|ruck | arxcruz, https://docs.openstack.org/tripleo-quickstart/latest/getting-started.html#validate-the-tripleo-overcloud-is-functional | 18:33 |
weshay|ruck | arxcruz, -I --teardown none and tags all are the key | 18:34 |
weshay|ruck | arxcruz, https://hackmd.io/UZPFdivCSAm18jTLDBSdfg | 18:36 |
arxcruz | weshay|ruck: ./quickstart.sh -R master-tripleo-ci --tags validate --no-clone -I --teardown none --playbook quickstart-extras.yml | 18:38 |
arxcruz | shoud do the trick ? | 18:38 |
arxcruz | i mean, not quickstart-extras.yml | 18:38 |
arxcruz | let me check the right playbook | 18:38 |
weshay|ruck | ya | 18:38 |
weshay|ruck | you need to use the playbook.. that's it | 18:38 |
weshay|ruck | arxcruz, thanks for the late night effort :) | 18:38 |
arxcruz | weshay|ruck: this from .quickstart directory right ? | 18:38 |
rlandy | close - but not cigar - will need jpena|off - unauthorized | 18:40 |
weshay|ruck | the invocation of quickstart.sh? it can be yes.. | 18:40 |
panda | rlandy: dockerfiles ? you can specify --allowed-clients in the command line, and the clients will be run in the same order you put them, but I'm not sure about the dockerfiles. | 18:48 |
rlandy | panda: in downstream we upload dockerfiles - we would need the promoter to move that link to current-triple- just like images | 18:55 |
rlandy | panda: we can discus more at tomorrow's sync | 18:55 |
panda | rlandy: ok | 18:56 |
rlandy | dowbnstream was doing just fine but now it clearly needs the updates | 18:56 |
*** tosky has quit IRC | 19:25 | |
rlandy | weshay|ruck: https://review.rdoproject.org/r/#/q/topic:validation-component+(status:open+OR+status:merged) - let me know if I missed anything there | 19:48 |
rlandy | also maybe we want to delay adding the cockpit entries? | 19:48 |
* weshay|ruck looks | 19:48 | |
weshay|ruck | rlandy, sure.. I can do it tomorrow if needed /me looks at patches | 19:48 |
rlandy | weshay|ruck: I added entries in ci-scripts/infra-setup/roles/rrcockpit/files/telegraf/telegraf.d/last_promotions.conf - no idea if that is all that is needed | 19:49 |
weshay|ruck | rlandy, ya. .we're going to keep as you guessed.. just a basic standalone.. they will add a job or variables to do some basic validation of core validations-lib and validations-common | 19:50 |
weshay|ruck | but it's not quite ready yet | 19:50 |
weshay|ruck | I'll explain on a public call | 19:50 |
weshay|ruck | so far what I see is perfect | 19:50 |
rlandy | weshay|ruck: ok - so there is a merge order ... | 19:51 |
rlandy | https://review.rdoproject.org/r/#/c/28758/ first | 19:51 |
rlandy | then https://review.rdoproject.org/r/#/c/28757/ | 19:52 |
rlandy | pls vote and I'll merge | 19:52 |
rlandy | or we wait until public call? | 19:52 |
rlandy | either fine by me | 19:52 |
rlandy | weshay|ruck: how are things with docker.io rate limiting? | 19:56 |
weshay|ruck | rlandy, better much better.. see my email on openstack discuss | 19:59 |
weshay|ruck | rlandy, was just a fluke afaict and not rate limiting | 19:59 |
rlandy | not rate limiting?? | 20:01 |
rlandy | ok - we have a validation pipeline: | 20:02 |
rlandy | openstack-component-validation 0 | 20:02 |
rlandy | Validation component-ci jobs triggered to run periodically. | 20:02 |
weshay|ruck | so from follow up conv in infra.. perhaps rate limiting on the auth through the proxy to docker.io | 20:02 |
weshay|ruck | they are discussing it still | 20:02 |
weshay|ruck | but mitigating it still seems like a valuable excercise for us .. worth discussing and evaluting | 20:03 |
rlandy | ok - merge job definitions | 20:04 |
rlandy | hopefully won't mess anything up | 20:04 |
*** TrevorV has quit IRC | 20:20 | |
weshay|ruck | rlandy, no worries.. what will we have to do tomorrow if something doesn't break | 20:20 |
rlandy | we will know in 3 hours | 20:33 |
rlandy | weshay|ruck: anything need to picked up ruck/rover wise? | 20:34 |
* rlandy waiting to talk with jpena re: 16.2 | 20:34 | |
weshay|ruck | oh dang he's on late | 20:35 |
rlandy | no - will catch him tomorrow | 20:35 |
weshay|ruck | rlandy, ah.. | 20:35 |
rlandy | permission denied on 16-2 endpoint | 20:35 |
weshay|ruck | good | 20:35 |
weshay|ruck | meh | 20:35 |
rlandy | so available to help with anything if needed | 20:36 |
weshay|ruck | rlandy, we ok for ruck rover.. | 20:36 |
weshay|ruck | thank you | 20:36 |
rlandy | k - I guess promoter than | 20:36 |
*** rlandy is now known as rlandy|brb | 20:45 | |
*** jfrancoa has quit IRC | 20:50 | |
*** jfrancoa has joined #oooq | 20:50 | |
*** rlandy|brb is now known as rlandy | 21:02 | |
*** rlandy has quit IRC | 21:28 | |
sshnaidm | weshay|ruck, fyi, for ussuri ovb jobs: https://logserver.rdoproject.org/87/28387/2/check/periodic-tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset002-ussuri/79b816e/logs/undercloud/home/zuul/install_packages.sh.log.txt.gz | 22:04 |
*** jfrancoa has quit IRC | 22:13 | |
weshay|ruck | meh | 22:54 |
weshay|ruck | tomorrow :) | 22:55 |
*** saneax has joined #oooq | 23:13 | |
*** chem has joined #oooq | 23:55 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!