*** ysandeep|away is now known as ysandeep | 00:04 | |
ysandeep | rlandy|ruck|afk, around ? | 00:04 |
---|---|---|
ysandeep | rlandy|ruck|afk, tripleo component was expected to fail, I added a reference in RR notes about it yesterday | 00:05 |
ysandeep | rlandy|ruck|afk, To fix we need stevedore3.1.0(which is in client component), Because stevedore and heat are in different components, so need to trick the promotions to get both component promotion (clients/tripleo)together (may be by manual promotion/relax criteria of these component) | 00:06 |
*** saneax has quit IRC | 00:08 | |
rlandy|ruck|afk | ysandeep: sec - on phone | 00:21 |
rlandy|ruck|afk | ok - I'll take care of it | 00:21 |
*** saneax has joined #oooq | 00:38 | |
*** rlandy|ruck|afk is now known as rlandy|ruck | 01:13 | |
rlandy|ruck | ysandeep: hi - back | 01:13 |
rlandy|ruck | ysandeep: let me see what's blocking the client promotion | 01:14 |
rlandy|ruck | or maybe it's juts a time thing until clients up and down promotes | 01:14 |
rlandy|ruck | ysandeep: I'll assign the bug to me to make sure we get the right versions in | 01:15 |
rlandy|ruck | thanks for looking into it | 01:15 |
ysandeep | rlandy|ruck, thanks! | 01:15 |
ysandeep | rlandy|ruck, mmmm.. i still see stevedore.2.0.1 in client consistent https://trunk.rdoproject.org/centos8-master/component/clients/consistent/ | 01:16 |
rlandy|ruck | ysandeep: rhos-17 promoted today | 01:16 |
rlandy|ruck | with octavia | 01:16 |
ysandeep | rlandy|ruck, thanks! great news | 01:17 |
ysandeep | about stevedore.3.0.1 , yatin mentioned this about 3.0.1 :_ | 01:17 |
ysandeep | ~~~~ | 01:17 |
ysandeep | <ykarel> ysandeep|rover, yes, so once heat patch merges, tripleo component will start failing | 01:17 |
ysandeep | <ykarel> for that we need to build stevedore3.1.0 | 01:17 |
ysandeep | <ykarel> after building it will be in clients component | 01:17 |
ysandeep | <ykarel> would need https://review.rdoproject.org/r/#/c/28529/3..4/tags/victoria-uc.yml included | 01:17 |
ysandeep | <ykarel> it will fail without heat, so need to get it merged to get build | 01:17 |
ysandeep | ~~~ | 01:17 |
rlandy|ruck | http://rhos-release.virt.bos.redhat.com:3030/rhosp - that cleaned up | 01:18 |
ysandeep | rlandy|ruck, wow all green :) | 01:18 |
rlandy|ruck | ysandeep: ok - so let's keep watching clients | 01:19 |
rlandy|ruck | when we see the right version, we make sure to promote | 01:19 |
rlandy|ruck | also scenario010 failed in the master line | 01:19 |
ysandeep | rlandy|ruck, yup | 01:19 |
rlandy|ruck | so the python-tempestconf fix has not gotten in yet | 01:19 |
ysandeep | rlandy|ruck, let me see where its stuck | 01:20 |
rlandy|ruck | ysandeep: so you still have access to the tmate? in case you need to restart promoter? | 01:20 |
rlandy|ruck | do | 01:20 |
ysandeep | rlandy|ruck, i have one tmate.. but i am not sure its the old one or new one | 01:21 |
rlandy|ruck | probably the old one | 01:21 |
rlandy|ruck | new one is going fine | 01:22 |
ysandeep | okay | 01:22 |
rlandy|ruck | I just need to rerun fs001 so there is a hash on master to promote when chandan wants to test his changes | 01:29 |
rlandy|ruck | I may just run it on rdocloud | 01:29 |
rlandy|ruck | vexxhost still fails a ton | 01:29 |
rlandy|ruck | oh -k - master kicked again ... | 01:36 |
rlandy|ruck | ysandeep: if fs001 fails, pls rerun ( even if you have to use rdocloud) for ^^ | 01:37 |
ysandeep | rlandy|ruck, testproject ? | 01:38 |
rlandy|ruck | ysandeep: yep - it may pass | 01:40 |
rlandy|ruck | you never know | 01:40 |
rlandy|ruck | miracles happen | 01:40 |
rlandy|ruck | still running | 01:40 |
ysandeep | rlandy|ruck, could you please pass me your test patch, i will keep an eye | 01:40 |
rlandy|ruck | ysandeep: I was going to kick a test patch but then the hash rev'ed because master kicked again ... | 01:41 |
rlandy|ruck | if you need to rekick fs001 ... https://review.rdoproject.org/r/#/c/21683/ | 01:42 |
ysandeep | rlandy|ruck, thanks! will keep an eye on main line for now | 01:42 |
rlandy|ruck | ysandeep++ thanks | 01:43 |
ysandeep | rlandy|ruck, could you please merge https://code.engineering.redhat.com/gerrit/#/c/206448/ | 01:43 |
ysandeep | testrun was green yesterday | 01:43 |
ysandeep | periodic-tripleo-ci-rhel-8-multinode-1ctlr-featureset010-rhos-17 https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/build/f5942977eae6429dabdafabb0f54dc6b : SUCCESS in 1h 38m 48s | 01:44 |
rlandy|ruck | yep | 01:44 |
rlandy|ruck | surprise! | 01:44 |
ysandeep | rlandy++ thanks! | 01:44 |
rlandy|ruck | ysandeep: need anything else before I log off? | 01:45 |
ysandeep | rlandy|ruck, no I think I am good, thanks! | 01:46 |
ysandeep | rlandy|ruck, have a great evening | 01:46 |
rlandy|ruck | ysandeep: thanks - see you later | 01:46 |
*** rlandy|ruck has quit IRC | 01:46 | |
*** ysandeep is now known as ysandeep|away | 01:49 | |
*** apetrich has quit IRC | 02:14 | |
*** Goneri has quit IRC | 02:41 | |
*** rfolco has quit IRC | 02:41 | |
*** saneax has quit IRC | 03:18 | |
*** skramaja has joined #oooq | 03:58 | |
*** ykarel has joined #oooq | 04:52 | |
*** udesale has joined #oooq | 04:57 | |
*** ratailor has joined #oooq | 05:29 | |
*** soniya29 has joined #oooq | 05:36 | |
*** ysandeep|away is now known as ysandeep | 06:09 | |
*** amoralej|off is now known as amoralej | 06:19 | |
*** ysandeep is now known as ysandeep|rover | 06:24 | |
*** marios has joined #oooq | 06:47 | |
ysandeep|rover | bhagyashris, I have left a comment on https://review.rdoproject.org/r/#/c/28282/ | 06:47 |
bhagyashris | ysandeep|rover, ack | 06:48 |
bhagyashris | thanks earlier you point out me but i forgot | 06:49 |
bhagyashris | ysandeep|rover, i will do the needful | 06:49 |
ysandeep|rover | bhagyashris, thank you :) | 06:49 |
ysandeep|rover | bhagyashris, we can -w till you make cherrypick that patch | 06:50 |
ysandeep|rover | ohh you already did, sry | 06:50 |
bhagyashris | ysandeep|rover, yup :) | 06:53 |
zbr|ruck | panda: if you can have a brief look at https://review.rdoproject.org/r/#/c/28553/ it would be great, just to confirm/infirm my comments. | 07:13 |
*** udesale has quit IRC | 07:17 | |
chandankumar | zbr|ruck: marios https://review.rdoproject.org/r/28549 and https://review.rdoproject.org/r/28565 when free | 07:19 |
marios | ack chandankumar | 07:20 |
*** ykarel_ has joined #oooq | 07:31 | |
*** ykarel has quit IRC | 07:33 | |
*** tosky has joined #oooq | 07:33 | |
*** ykarel_ is now known as ykarel | 07:43 | |
*** udesale has joined #oooq | 07:57 | |
*** jbadiapa has joined #oooq | 08:18 | |
*** derekh has joined #oooq | 08:30 | |
panda | zbr|ruck: commented | 08:31 |
panda | marios: would you do the honors ? https://review.rdoproject.org/r/27626 | 08:31 |
*** apetrich has joined #oooq | 08:33 | |
marios | panda: make me | 08:38 |
panda | marios: don't make me go there punk | 08:38 |
*** ysandeep|rover is now known as ysandeep|lunch | 08:41 | |
marios | o/ folks please I need votes on a cherrypick when you have time thank you https://review.opendev.org/#/c/741383/ | 09:13 |
*** dtantsur|afk is now known as dtantsur | 09:19 | |
*** apetrich has quit IRC | 09:26 | |
*** ysandeep|lunch is now known as ysandeep|rover | 09:27 | |
*** bogdando has joined #oooq | 09:28 | |
*** marios has quit IRC | 09:38 | |
ysandeep|rover | zbr|ruck, fyi.. I will push a test patch to try to get tripleo/clients components promoted to fix https://bugs.launchpad.net/tripleo/+bug/1887856. Details are here http://paste.openstack.org/show/796040/ | 09:50 |
openstack | Launchpad bug 1887856 in tripleo "centos-8 master tripleo component tests are failing with "ModuleNotFoundError: No module named 'blazarclient'"" [Critical,In progress] - Assigned to Ronelle Landy (rlandy) | 09:50 |
akahat | ysandeep|rover, ping, something wrong with fs39-train job. | 09:59 |
akahat | https://review.rdoproject.org/r/#/c/27523/ | 09:59 |
akahat | https://logserver.rdoproject.org/23/27523/2/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-train/1321dd7/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 09:59 |
ysandeep|rover | akahat, master failing too? | 10:00 |
akahat | ysandeep|rover, not sure about master. | 10:00 |
ysandeep|rover | yes master failing too https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-master | 10:01 |
*** udesale_ has joined #oooq | 10:01 | |
akahat | ysandeep|rover, yes.. same errors. | 10:02 |
ysandeep|rover | akahat, lately there were some issues with ovb jobs.. I will run this through ronelle(she will be in a few hours), will open a new bz if required | 10:03 |
akahat | ysandeep|rover, great. thanks :) | 10:04 |
*** udesale has quit IRC | 10:04 | |
ysandeep|rover | akahat, you can separate minion and ovb job in different patchs.. and get the minion job merged if you want | 10:04 |
akahat | ysandeep|rover, ack. | 10:05 |
chandankumar | arxcruz: \o/ | 10:07 |
*** dtantsur is now known as dtantsur|brb | 10:07 | |
chandankumar | arxcruz: please have a look at this patch https://review.rdoproject.org/r/#/c/28543/ | 10:08 |
chandankumar | not sure why skip tests jobs are passing and it is not picking the skiplist | 10:08 |
chandankumar | zbr|ruck: https://review.rdoproject.org/r/#/c/28565/ | 10:10 |
zbr|ruck | done | 10:11 |
chandankumar | zbr|ruck: -w, for cherry picking on promoter? | 10:15 |
*** sshnaidm|afk is now known as sshnaidm|off | 10:16 | |
zbr|ruck | tbh,... i am kinda tired of cherry picking stuff on the promoter | 10:16 |
zbr|ruck | how about making a small change that allows custom local config, so we can avoid cherry picks? | 10:16 |
zbr|ruck | like looking for custom config in ~/.config/promoter before using in-repo values? so we avoid the need to have a dirty-git on it? | 10:17 |
*** apetrich has joined #oooq | 10:18 | |
chandankumar | zbr|ruck: nice idea, but what about new panda's work on new config change to yaml? | 10:20 |
zbr|ruck | s*** | 10:20 |
zbr|ruck | chandankumar: go do the change, i have a tmate still open anyway. | 10:21 |
chandankumar | zbr|ruck: let's wait for rlandy to come, in another 1 h and 30 mins | 10:21 |
chandankumar | we have two changes to cherry-pick | 10:21 |
zbr|ruck | chandankumar: give https://review.rdoproject.org/r/#/c/28571/ a kick | 10:23 |
panda | ..... | 10:24 |
chandankumar | ysandeep|rover: fyi https://review.rdoproject.org/r/#/c/28571/ merging this, if see any breakage let zbr|ruck, me and rfolco know | 10:27 |
arxcruz | chandankumar: i'll check, give me a few minutes, i'm not feeling well since yesterday :/ | 10:27 |
ysandeep|rover | ykarel, ^^ | 10:27 |
chandankumar | arxcruz: oh, get well soon & take rest man | 10:27 |
ysandeep|rover | chandankumar, ack | 10:28 |
chandankumar | arxcruz: kopecmartin soniya29 akahat https://hackmd.io/fIOKlEBHQfeTZjZmrUaEYQ?view#2020-07-17 feel free to add or remove | 10:29 |
*** ykarel_ has joined #oooq | 10:31 | |
ykarel_ | ysandeep|rover, ? | 10:32 |
ykarel_ | 28571 ? | 10:32 |
*** ykarel has quit IRC | 10:32 | |
ysandeep|rover | ykarel_, yes fyi.. | 10:34 |
ykarel_ | ack | 10:34 |
*** ykarel_ is now known as ykarel | 10:38 | |
*** marios has joined #oooq | 10:42 | |
ysandeep|rover | chandankumar, thanks for your review on my patch, regarding can we also propose a patch to remove c7 train based container build jobs? --> i will but I heard wes said he want to convey by ML to announce the removal of c7 and introduction of c8 jobs first.. will check with him on monday. | 10:55 |
chandankumar | ysandeep|rover: sure, thanks for the ML part :-) | 10:56 |
ysandeep|rover | :) | 10:57 |
chandankumar | zbr|ruck: boom new failure https://logserver.rdoproject.org/49/28549/6/check/tripleo-ci-promotion-staging-single-pipeline-centos-7/fddc028/job-output.txt | 11:04 |
chandankumar | zbr|ruck: http://paste.openstack.org/show/796042/ looks like a connection issue | 11:05 |
chandankumar | marios: https://review.rdoproject.org/r/#/c/28549/ I have updated the commit msg I hope now it is clear | 11:05 |
marios | chandankumar: ack will you add to master.ini and train here? I don't see in in latest https://review.rdoproject.org/r/#/c/28549/7/ci-scripts/dlrnapi_promoter/config/CentOS-8/master.ini | 11:07 |
*** ysandeep|rover is now known as ysandeep|afk | 11:11 | |
chandankumar | marios: added for c8, for RHEL-8 it is not needed, as we have no promotion pipeline for RHEL-8 | 11:12 |
marios | chandankumar: well, we will have internal rhel pipeline ... but ok for now | 11:13 |
marios | chandankumar: but no openstack-base for master? | 11:13 |
chandankumar | marios: yes, there is no openstack-base for master | 11:13 |
marios | chandankumar: ack | 11:14 |
chandankumar | marios: do you want to join the promoter cherry -pick code call? | 11:14 |
chandankumar | sent the invite, if free, feel free to join that | 11:15 |
marios | chandankumar: sure | 11:18 |
marios | chandankumar: checking the invite | 11:18 |
marios | thanks chandankumar | 11:19 |
chandankumar | marios: :-) | 11:19 |
*** soniya29 has quit IRC | 11:30 | |
*** ysandeep|afk is now known as ysandeep | 11:31 | |
*** ysandeep is now known as ysandeep|rover | 11:34 | |
*** apetrich has quit IRC | 11:34 | |
*** soniya29 has joined #oooq | 11:45 | |
*** Tengu has quit IRC | 11:48 | |
*** Tengu has joined #oooq | 11:50 | |
*** rlandy has joined #oooq | 11:56 | |
*** rlandy is now known as rlandy|ruck | 11:56 | |
rlandy|ruck | chandankumar: hey ... | 11:56 |
chandankumar | rlandy|ruck: Hello | 11:56 |
rlandy|ruck | accepted your meeting | 11:57 |
chandankumar | rlandy|ruck: cool, thanks! | 11:57 |
rlandy|ruck | but I'm here now if you want to start earlier | 11:57 |
chandankumar | rlandy|ruck: let's do it after an hour | 11:57 |
rlandy|ruck | chandankumar: sure ... | 11:57 |
rlandy|ruck | do you know if there a hash to promote? | 11:57 |
chandankumar | zbr|ruck: marios do we also need https://review.rdoproject.org/r/27626 to cherry pick? | 11:58 |
chandankumar | rlandy|ruck: may be ysandeep|rover and zbr|ruck knows | 11:58 |
rlandy|ruck | chandankumar: last run looks good | 11:58 |
rlandy|ruck | we're fine | 11:58 |
rlandy|ruck | ysandeep|rover: zbr|ruck: ^^ no worries | 11:58 |
marios | chandankumar: so i am out of context... i don't know what we are cherrypicking to where? rdo promoter? | 11:59 |
rlandy|ruck | https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-integration-main | 11:59 |
marios | chandankumar: but that is switching to using the new qcow image promotion | 11:59 |
zbr|ruck | as the cherry pick list keeps growing, i am going to ask panda: what is the impact of making config file overridable? | 11:59 |
chandankumar | marios: yes rdo promoter | 11:59 |
marios | chandankumar: so yes i think we should have it why not | 11:59 |
marios | chandankumar: if it is broken we should find out about it now :D | 11:59 |
chandankumar | marios: sure :-) | 11:59 |
ysandeep|rover | rlandy|ruck, To fix https://bugs.launchpad.net/tripleo/+bug/1887856 - With help of test patch we tried to get tripleo/clients components promoted - https://review.rdoproject.org/r/28586 | 12:00 |
openstack | Launchpad bug 1887856 in tripleo "centos-8 master tripleo component tests are failing with "ModuleNotFoundError: No module named 'blazarclient'"" [Critical,In progress] - Assigned to Ronelle Landy (rlandy) | 12:00 |
ysandeep|rover | rlandy|ruck, stevedore3.1 reached tripleo-ci-testing | 12:01 |
ysandeep|rover | rlandy|ruck, we triggered main line to get promotion | 12:01 |
rlandy|ruck | ysandeep|rover: that's great - will save us a headache | 12:01 |
rlandy|ruck | periodic-tripleo-ci-centos-8-scenario010-standalone-master | 12:01 |
zbr|ruck | chandankumar: rlandy|ruck: small bit https://review.rdoproject.org/r/#/c/28590/ | 12:02 |
rlandy|ruck | ysandeep|rover: hmm scenario010 still failing | 12:02 |
ysandeep|rover | rlandy|ruck, ^^ periodic-tripleo-ci-centos-8-scenario010-standalone-master will solve once tempestconf reaches current tripleo right? | 12:02 |
rlandy|ruck | ysandeep|rover: tripleo-ci-testing | 12:03 |
rlandy|ruck | I'm looking at main-line | 12:03 |
* rlandy|ruck checks gates | 12:03 | |
rlandy|ruck | any disasters there? | 12:03 |
* rlandy|ruck breathes - ok | 12:03 | |
ysandeep|rover | rlandy|ruck, then we need to take help from ocatavia guys.. its may be the original bug on which carlos patches are pending then | 12:06 |
ysandeep|rover | sc10 not in promotion criteria, should not block promotion for now | 12:06 |
rlandy|ruck | ysandeep|rover: it's not ... but its should be :) | 12:07 |
* rlandy|ruck wants to put it back | 12:07 | |
rlandy|ruck | let's check patch status | 12:07 |
ysandeep|rover | rlandy|ruck, agree | 12:07 |
chandankumar | dpawlik2: https://review.rdoproject.org/r/#/c/28590/ please have a look at this patch | 12:07 |
*** rfolco has joined #oooq | 12:08 | |
*** dtantsur|brb is now known as dtantsur | 12:10 | |
rlandy|ruck | ysandeep|rover: anything else burning? | 12:12 |
rlandy|ruck | restarted ci,centos queens | 12:12 |
rlandy|ruck | that should clear | 12:12 |
ysandeep|rover | rlandy|ruck, nah all good, just fyi.. https://review.rdoproject.org/r/#/c/28571/ incase it break something | 12:13 |
rlandy|ruck | oh dear | 12:14 |
rlandy|ruck | ysandeep|rover: ok we'll have to watch downstream on impact from that change | 12:15 |
rlandy|ruck | release is osp_release there | 12:15 |
rlandy|ruck | but we may get by | 12:16 |
ysandeep|rover | rlandy|ruck, fyi.. in downstream tripleo component seems also busted because of that stevedore3.1 thing .. we need to do the trick there as well once stevedore3.1 reaches clients | 12:18 |
*** ysandeep|rover is now known as ysandeep|coffee | 12:19 | |
rfolco | zbr|ruck, o/ | 12:19 |
*** ratailor has quit IRC | 12:20 | |
rfolco | zbr|ruck, can I work on the other scenarios now ? promote_images, container_push, tripleo-common-integration ? | 12:20 |
rlandy|ruck | ysandeep|coffee: np - the changes will get imported downstream and yes we can rerun/bypass criteria if need be | 12:21 |
rfolco | zbr|ruck, there is still some work to be done on promoter mol.. | 12:21 |
zbr|ruck | rfolco: i am sure there is, but now we are in much better shape. | 12:22 |
rfolco | zbr|ruck, yep, thanks for your great help | 12:23 |
rfolco | zbr|ruck, for example, provisioning playbook is not idempotent... I can list in hackmd all the improvements required in promoter mol | 12:24 |
zbr|ruck | sure, add them there and start fixing them, one at a time | 12:25 |
rfolco | zbr|ruck, ok | 12:25 |
chandankumar | zbr|ruck: do we also need to cherry pick rsync fix also? | 12:28 |
zbr|ruck | nope | 12:29 |
chandankumar | ok | 12:29 |
chandankumar | arxcruz: kopecmartin akahat soniya29 tempest meeting time | 12:30 |
zbr|ruck | chandankumar: https://review.rdoproject.org/r/#/c/28549/8/ci-scripts/dlrnapi_promoter/config/CentOS-8/master.ini | 12:34 |
chandankumar | marios: https://review.opendev.org/#/c/726773/ please have a look | 12:34 |
zbr|ruck | if is ok, add +W and we will only pull master | 12:35 |
marios | chandankumar: will do middle rebase conflict right now | 12:35 |
zbr|ruck | i need vote on https://review.rdoproject.org/r/#/c/28587/ to workflow it. | 12:36 |
*** ysandeep|coffee is now known as ysandeep|rover | 12:40 | |
chandankumar | arxcruz: https://f8c6a5addd2917e07fe1-e912075c69482e8155cd5ddb4c09699c.ssl.cf1.rackcdn.com/726773/10/check/tripleo-ci-centos-8-undercloud-containers/dcba488/logs/reproducer-quickstart/reproducer-fresh-box-setup.sh | 12:41 |
chandankumar | zbr|ruck: openstack-base is not needed | 12:44 |
chandankumar | marios: np, :-) | 12:45 |
chandankumar | akahat: use this https://review.opendev.org/#/c/738488/ as a depends on fs062 patch | 12:48 |
chandankumar | and other also | 12:48 |
akahat | chandankumar, ack | 12:49 |
*** amoralej is now known as amoralej|lunch | 12:55 | |
*** pojadhav is now known as pojadhav|brb | 12:59 | |
chandankumar | rlandy|ruck: meeting for cherry picking | 13:01 |
dpawlik2 | rlandy|ruck, chandankumar: could you check https://review.rdoproject.org/r/#/c/28550/ ? | 13:07 |
*** TrevorV has joined #oooq | 13:12 | |
*** amoralej|lunch is now known as amoralej | 13:21 | |
*** pojadhav|brb is now known as pojadhav | 13:26 | |
*** skramaja has quit IRC | 13:29 | |
chandankumar | rlandy|ruck: marios zbr|ruck ysandeep|rover thank you :-) | 13:43 |
marios | chandankumar: heh beat me to it | 13:44 |
marios | thanks rlandy|ruck zbr|ruck chandankumar ysandeep|rover | 13:44 |
rlandy|ruck | chandankumar: marios: thanks for your help | 13:44 |
ysandeep|rover | marios, chandankumar rlandy|ruck zbr|ruck thank you, and happy weekend! bye o/ | 13:44 |
rlandy|ruck | ysandeep|rover: bye - see you monday | 13:45 |
marios | rlandy|ruck: thanks for driving | 13:45 |
marios | ysandeep|rover: have a nice w/e | 13:45 |
marios | ok i think we're done with thanks now | 13:45 |
marios | :D | 13:45 |
chandankumar | ysandeep|rover: happy weekend, see ya on monday! | 13:45 |
chandankumar | we finally deployed in production on Friday :D | 13:46 |
marios | chandankumar: careful now | 13:47 |
marios | chandankumar: we only *ran* it so far | 13:48 |
marios | chandankumar: we don't know if it will stay running :D | 13:48 |
marios | let's see how that promotion goes | 13:48 |
chandankumar | marios: let's see :-) | 13:48 |
* rlandy|ruck runs away ... | 13:48 | |
rlandy|ruck | let's hope Friday afternoon we don't regret this | 13:48 |
chandankumar | rlandy|ruck: marios https://review.rdoproject.org/r/#/c/28593/ paramiko change | 13:49 |
rlandy|ruck | thanks | 13:49 |
chandankumar | thanks zbr|ruck :-) | 13:50 |
*** marios has quit IRC | 13:53 | |
*** marios has joined #oooq | 13:57 | |
*** Goneri has joined #oooq | 13:57 | |
*** ysandeep|rover is now known as ysandeep|away | 13:58 | |
*** apetrich has joined #oooq | 14:08 | |
rlandy|ruck | 2020-07-17 14:07:44,632 p=2024 u=centos n=ansible | localhost : ok=14 changed=8 unreachable=0 failed=1 | 14:09 |
rlandy|ruck | we have a failuer | 14:09 |
rlandy|ruck | failure | 14:10 |
rlandy|ruck | zbr|ruck: ^^ | 14:10 |
rlandy|ruck | chandankumar: hmmm ... 2020-07-17 14:05:24,472 p=2024 u=centos n=ansible | failed: [localhost] (item=openstack-base) => {"ansible_loop_var": "item", "changed": false, "item": "openstack-base", "msg": "Error pulling image trunk.registry.rdoproject.org/tripleomaster/centos-binary-openstack-base:405d4eb1b2f7cb39424978225a9bacfc - 404 Client Error: Not Found (\"manifest for trunk.registry.rdoproject.org/tripleomaster/centos-binar | 14:10 |
rlandy|ruck | y-openstack-base:405d4eb1b2f7cb39424978225a9bacfc not found: manifest unknown: manifest unknown\")"} | 14:10 |
rlandy|ruck | still picking up | 14:10 |
zbr|ruck | clueless | 14:11 |
* rlandy|ruck checks | 14:11 | |
chandankumar | rlandy|ruck: it means var from criteria file donot picked up | 14:11 |
chandankumar | let me check | 14:11 |
rlandy|ruck | chandankumar: I'll put back the old change | 14:11 |
chandankumar | rlandy|ruck: let me see | 14:12 |
chandankumar | ok | 14:12 |
rlandy|ruck | chandankumar: k - let me know | 14:12 |
rlandy|ruck | otherwise we can go back to the other change | 14:12 |
bogdando | hola, PTAL https://review.opendev.org/#/c/696306/ | 14:18 |
bogdando | since 11/2019 it's almost ready I hope! :D | 14:18 |
rlandy|ruck | chandankumar: hey ... | 14:35 |
rlandy|ruck | why don;t we just set https://review.rdoproject.org/r/#/c/28549/9/ci-scripts/container-push/roles/containers-promote/defaults/main.yml with releases? | 14:35 |
chandankumar | rlandy|ruck: change coming | 14:36 |
rlandy|ruck | chandankumar: ok | 14:36 |
* rlandy|ruck waits | 14:36 | |
chandankumar | rlandy|ruck: zbr|ruck https://review.rdoproject.org/r/#/c/28594/ | 14:39 |
* rlandy|ruck looks | 14:40 | |
rlandy|ruck | chandankumar: left one comment on https://review.rdoproject.org/r/#/c/28594/ | 14:43 |
rlandy|ruck | since newworkflow will go forward | 14:43 |
chandankumar | ok | 14:44 |
chandankumar | update coming | 14:44 |
rlandy|ruck | chandankumar: then we can cherry-pick again :) | 14:45 |
chandankumar | rlandy|ruck: done | 14:46 |
chandankumar | rlandy|ruck: let the zuul gives +1 | 14:48 |
rlandy|ruck | looking | 14:49 |
rlandy|ruck | chandankumar: it will take a bit to get zuul +1 - but agree to wait of you have the time | 14:51 |
chandankumar | rlandy|ruck: I am still around for 1 hr approx | 14:52 |
rlandy|ruck | ok | 14:52 |
ykarel | rlandy|ruck, zbr|ruck is https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario002-standalone-master/db18d83/job-output.txt known? | 15:01 |
ykarel | i see similar failure in other job | 15:01 |
chandankumar | ykarel: I think we need to pin heat tempest plugin to a good known hash | 15:02 |
chandankumar | ? | 15:02 |
ykarel | chandankumar, which commit broke it? | 15:02 |
* rlandy|ruck looks | 15:03 | |
chandankumar | there is no change from ladt one month in heat tempest plugin | 15:03 |
chandankumar | let me try to reproduce it locally | 15:04 |
ykarel | https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario002-standalone-master/db18d83/logs/undercloud/var/log/containers/heat/heat_api.log.txt.gz | 15:05 |
chandankumar | https://opendev.org/openstack/tripleo-ci/src/branch/master/zuul.d/standalone-jobs.yaml#L520 -> sc02 - heat tempest plugin is coming telemetry tempest plugin | 15:07 |
chandankumar | it broke at while listing tests | 15:08 |
chandankumar | ykarel: can you check did something got changed on heat client? | 15:12 |
ykarel | chandankumar, ack looking | 15:14 |
chandankumar | ykarel: it is working fine on local system | 15:15 |
ykarel | chandankumar, heatclient not changed | 15:15 |
ykarel | it's 2.2.0 in currenttripleo https://trunk.rdoproject.org/centos8-master/component/clients/current-tripleo/ | 15:15 |
ykarel | and same in promotion | 15:15 |
ykarel | u seen above logs? heat-api | 15:16 |
chandankumar | let me check heat-api log | 15:16 |
ykarel | and heat engine https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario002-standalone-master/db18d83/logs/undercloud/var/log/containers/heat/heat-engine.log.txt.gz | 15:16 |
chandankumar | ykarel: oslo messageing ampqdriver | 15:17 |
ykarel | also see heat engine ^ | 15:17 |
rlandy|ruck | chandankumar: zuul -1'ed - we need to exclude staging | 15:18 |
chandankumar | ykarel: yes I think ysandeep|away filed abbug | 15:18 |
ykarel | with stevedore-3.1.0 and latest heat it should be there | 15:18 |
ykarel | chandankumar, yes, but ^ it should have solved | 15:18 |
rlandy|ruck | chandankumar: https://bugs.launchpad.net/tripleo/+bug/1887856 | 15:18 |
openstack | Launchpad bug 1887856 in tripleo "centos-8 master tripleo component tests are failing with "ModuleNotFoundError: No module named 'blazarclient'"" [Critical,In progress] - Assigned to Ronelle Landy (rlandy) | 15:18 |
chandankumar | ykarel: https://bugs.launchpad.net/tripleo/+bug/1887856 | 15:18 |
ykarel | chandankumar, yes this one | 15:18 |
rlandy|ruck | we need to promote the component line | 15:18 |
ykarel | rlandy|ruck, it was promoted, and still issue is coming ^ | 15:19 |
rlandy|ruck | ykarel: if it's failing in tripleo-ci-testing then yes - current tripleo hasn't promoted yet | 15:19 |
rlandy|ruck | that's what we are working on now | 15:20 |
rlandy|ruck | promoting master | 15:20 |
ykarel | without getting jobs pass? | 15:20 |
ykarel | those jobs should pass for promotion current-tripleo | 15:20 |
rlandy|ruck | ykarel: I assigned the bug to me so I can check the versions after promotion | 15:20 |
chandankumar | rlandy|ruck: let me go back to my patch | 15:20 |
rlandy|ruck | ykarel: there is a problem on the promoter itself | 15:20 |
rlandy|ruck | there is a hash to promote | 15:21 |
ykarel | promotion will block gates too if failures are ignored i think | 15:21 |
rlandy|ruck | ykarel: scenario002 where you picked up the bug is in criteria | 15:21 |
*** amoralej is now known as amoralej|off | 15:21 | |
ykarel | https://trunk.rdoproject.org/api-centos8-master-uc/api/civotes_agg_detail.html?ref_hash=4eb890a0003fd6ee429cbda0f20cd818 | 15:22 |
ykarel | hmm i meant don't adjust criteria to promote | 15:23 |
rlandy|ruck | ykarel: if anthiny I'll adjust the criteria up - not down | 15:24 |
rlandy|ruck | anything | 15:24 |
ykarel | ack good | 15:24 |
rlandy|ruck | chandankumar: I think release is the wrong way to go here | 15:24 |
chandankumar | rlandy|ruck: then ? | 15:24 |
rlandy|ruck | chandankumar: does the promoter know about release?? | 15:24 |
chandankumar | rlandy|ruck: yes, it knows above env | 15:25 |
rlandy|ruck | it knows about the release to promote | 15:25 |
rlandy|ruck | release: "{{ lookup('env','RELEASE') }}" | 15:26 |
rlandy|ruck | where is that set? | 15:26 |
rlandy|ruck | chandankumar: https://meet.google.com/?hs=197&pli=1&authuser=0 | 15:27 |
chandankumar | joingin | 15:29 |
*** ykarel is now known as ykarel|away | 15:29 | |
chandankumar | rlandy|ruck: url wrong i think | 15:30 |
* marios out | 15:30 | |
rlandy|ruck | https://meet.google.com/owp-izmc-ufj | 15:30 |
rlandy|ruck | chandankumar: ^^ | 15:30 |
marios | rlandy|ruck: need me to join? | 15:30 |
rlandy|ruck | that work for you? | 15:30 |
marios | rlandy|ruck: i can stay few more mins if need? | 15:30 |
chandankumar | rlandy|ruck: rejoined | 15:32 |
*** udesale_ has quit IRC | 15:37 | |
*** bogdando has quit IRC | 15:49 | |
*** derekh has quit IRC | 15:55 | |
chandankumar | rlandy|ruck: https://review.rdoproject.org/r/#/c/27626/ | 15:59 |
*** ykarel|away has quit IRC | 16:07 | |
*** marios is now known as marios|out | 16:12 | |
*** dtantsur is now known as dtantsur|afk | 16:13 | |
*** jbadiapa has quit IRC | 16:21 | |
*** marios|out has quit IRC | 16:23 | |
*** yolanda has quit IRC | 16:39 | |
*** soniya29 has quit IRC | 17:18 | |
*** owalsh has quit IRC | 17:21 | |
rlandy|ruck | "ceilometer-ipmi"], "msg": "Error pushing image docker.io/tripleomaster/centos-binary-ceilometer-ipmi: received unexpected HTTP status: 525 Origin SSL Handshake Error"} | 17:27 |
rlandy|ruck | 2020-07-17 16:26:40,586 p=18006 u=centos n=ansible | changed: [localhost] => (item=[u'405d4eb1b2f7cb39424978225a9bacfc', u'ceilometer-central']) => {"actions": ["Tagged ima | 17:27 |
*** owalsh has joined #oooq | 17:42 | |
chandankumar | rlandy|ruck: Does the container promotion worked? | 17:49 |
rlandy|ruck | chandankumar: hey ... | 17:58 |
rlandy|ruck | so yes and no | 17:58 |
rlandy|ruck | we got one container push failure | 17:58 |
rlandy|ruck | which I think was juts a timeout | 17:58 |
rlandy|ruck | train is promoting now | 17:58 |
rlandy|ruck | and I didn;t want to stop it | 17:58 |
chandankumar | rlandy|ruck: ah ok | 17:59 |
rlandy|ruck | chandankumar: I am going to restart the promoter after train is done | 17:59 |
rlandy|ruck | so we don;t wait | 17:59 |
chandankumar | rlandy|ruck: sure | 17:59 |
rlandy|ruck | and try again | 17:59 |
rlandy|ruck | "ceilometer-ipmi"], "msg": "Error pushing image docker.io/tripleomaster/centos-binary-ceilometer-ipmi: received unexpected HTTP status: 525 Origin SSL Handshake Error"} | 17:59 |
rlandy|ruck | looks like a regular timeout | 18:00 |
rlandy|ruck | I checked - the container is there ... | 18:00 |
rlandy|ruck | https://trunk.registry.rdoproject.org:8443/oapi/v1/namespaces/tripleomaster/imagestreamtags/ | 18:00 |
rlandy|ruck | so I think it will work on the next run | 18:00 |
chandankumar | rlandy|ruck: ok | 18:02 |
chandankumar | just drop me a message, if more needed | 18:02 |
chandankumar | rlandy|ruck: Happy weekend, see ya :-) | 18:02 |
rlandy|ruck | chandankumar: thanks but you've done so much | 18:02 |
*** chandankumar is now known as raukadah | 18:02 | |
rlandy|ruck | take some time off :) | 18:02 |
rlandy|ruck | promoter Containers promote 'aggregate: 9ddf21901cfc43a2995e5ee1583a0296, commit: 304866417dd09bb9d3da238c4305d05b56a9bc56, distro: 9083591c4d8909e14d4339c47bd8e981169fd370, component: ui, timestamp: 1594958594' to current-tripleo: Successful promotion | 18:23 |
*** johnsom has quit IRC | 18:24 | |
*** johnsom has joined #oooq | 18:25 | |
rlandy|ruck | zbr|ruck: you around? | 18:34 |
rlandy|ruck | we got a image promotion issue | 18:34 |
rlandy|ruck | nvm - think fixed it | 18:52 |
*** owalsh has quit IRC | 19:20 | |
*** owalsh has joined #oooq | 19:29 | |
*** TrevorV has quit IRC | 19:35 | |
*** rlandy|ruck is now known as rlandy|ruck|mtg | 19:36 | |
*** rlandy|ruck|mtg is now known as rlandy|ruck | 20:29 | |
*** rlandy|ruck has quit IRC | 22:45 | |
*** tosky_ has joined #oooq | 22:52 | |
*** tosky has quit IRC | 22:53 | |
*** tosky_ is now known as tosky | 23:01 | |
*** rfolco has quit IRC | 23:16 | |
*** tosky has quit IRC | 23:38 | |
*** rfolco has joined #oooq | 23:41 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!