Wednesday, 2021-09-08

erbotRequired files not ready after 301.74165296554565s for tripleo-ci-centos-8-scenario000-multinode-oooq-container-updates 798642,17,b9735059f1404d58ab04d2bd316043bb00:23
erbotRequired files not ready after 300.73471307754517s for tripleo-ci-centos-8-content-provider 798948,9,ec31fd277a534249a42178034d26751500:30
erbotRequired files not ready after 300.74532675743103s for tripleo-ci-centos-8-containers-multinode-wallaby 807704,2,7d51dee29db24ba3bc13a6a34c6b72a701:15
erbotRequired files not ready after 300.7372076511383s for tripleo-ci-centos-8-standalone-on-multinode-ipa 807268,1,0f9f616e9c2b48feae7c3933987eb30301:53
weshay|ruckerbot, anbanerj|ruck can that list the lp it's talking about?02:04
weshay|ruckanbanerj|ruck, assuming it's refering to https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_ec3/798948/9/check/tripleo-ci-centos-8-content-provider/ec31fd2/logs/index.html02:05
weshay|ruckdoesn't match https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_ec3/798948/9/check/tripleo-ci-centos-8-content-provider/ec31fd2/logs/_refresh_FAIL.log02:05
weshay|ruckanbanerj|ruck, lets chat about it tomorrow, I'd like some more insight into what you are going after w/ the bot02:05
weshay|ruckysandeep|out, https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-16.2/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-build-containers-ubi-8-internal-rhel-8-build-push-upload-rhos-16.2/42fb636/ 02:07
weshay|ruck:)02:07
*** pojadhav- is now known as pojadhav05:28
*** ysandeep|out is now known as ysandeep05:54
marioszbr: seems like no pushback on your proposal about tox https://review.opendev.org/c/zuul/zuul-jobs/+/80770206:01
marios(was in my list from yesterday to check you said you may need support there)06:02
*** amoralej|off is now known as amoralej06:04
pojadhavysandeep, 0/06:26
pojadhavysandeep, I have a doubt, baremetal jenkins job https://rhos-ci-jenkins.lab.eng.tlv2.redhat.com/view/pipeline/job/pipeline_component-baremetal-pcci-16.2_dlrn-rhel-8.4-virthost-3cont_2comp_3ceph-ipv4-geneve-ceph/ is green in its last run but still it is showing in our pending running jobs . why this is so any idea..?06:28
pojadhavsame like for other components as well..06:30
ysandeeppojadhav: checking06:36
ysandeeppojadhav: do you have few mins: meet.google.com/rtg-rhcz-baa06:40
pojadhavysandeep, yup06:45
*** slaweq_ is now known as slaweq07:06
*** jpena|off is now known as jpena07:38
erbotRequired files not ready after 301.3904318809509s for openstack-tox-linters 807828,1,5a5db6608c104c3481d116117bcff01307:39
erbotRequired files not ready after 301.2427315711975s for tripleo-tox-molecule 804306,20,5ac296d31387457a83350a3dda829b1007:57
marioszbr: https://review.opendev.org/c/openstack/tripleo-repos/+/807700/2#message-0a6094f7c87a9f93eb35450f21802780bef1021108:14
zbrmarios: welcomed to cherry pick whatever you want from it and abandon it once is redundant.08:22
zbrpind me to review your change, maybe i can help you ship that very useful fix08:22
zbrevery corner cut on testing has great costs, just remember the time we spent investigating the nodes08:23
anbanerj|ruckHey chandankumar, in master promotions upstream glance baremetal and tripleo  promoted few days ago while the last build is few hours ago. How can I check what has gone wrong and if there are any bugs raised?08:29
marioszbr: please review that https://review.opendev.org/c/openstack/tripleo-repos/+/807709 08:44
chandankumarmarios: \o want to remove -2 from here: https://review.opendev.org/c/openstack/tripleo-quickstart/+/79148609:00
marioschandankumar: no not yet09:03
marioschandankumar: we need the depends-on to merge first 09:03
chandankumarmarios: aye sir09:03
marioschandankumar: thanks can explain later on scrum too if you like09:03
chandankumarmarios: would love to know that, config issue09:04
chandankumarpojadhav: marios: ysandeep https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/805951 please have a look, thanks!09:04
chandankumarwhen free09:05
marioschandankumar: ack but not config, problem is we need tripleo-repos before build-test-packages so cant test it with depends-on 09:05
marioschandankumar: https://review.opendev.org/c/openstack/tripleo-quickstart/+/791486/52#message-53a74e717fe83e58501c206897ac900bb0022206 09:05
marioschandankumar: actually :) re-reading that comment ^^^ this time it may work since the tripleo-repos should pass... i will recheck the d/stream patch and if it is green can remove -2 :)09:09
chandankumarmarios: sure :-)09:12
marioschandankumar: no i am confusing myself it wont work for the same reason ... tripleo-repos (and get-hash) is used before b-t-p so the change wont be applied :/09:13
mariosso we wait for it to merge 09:13
chandankumaranbanerj|ruck: http://dashboard-ci.tripleo.org/d/M1DYSidGz/component-pipeline?orgId=1 it gives clear picture of component promotion09:15
chandankumaranbanerj|ruck: if there is any bugs raised and promotion blocker tag was needed, then it will land on cix board09:16
chandankumarhttps://trello.com/b/j4IcIomh/production-chain-escalation09:16
pojadhavchandankumar, ack09:43
erbotRequired files not ready after 301.1448040008545s for 21-centos-8-stream 807816,1,3987a2f628b34d42bcd69c465bef7cd509:49
soniya29kopecmartin, arxcruz, ysandeep, chandankumar, please add/edit the today's agenda for tempest meeting - https://hackmd.io/fIOKlEBHQfeTZjZmrUaEYQ09:57
chandankumarsoniya29: congratulations :-) Thank you for all the work you do on Patrole :-) http://lists.openstack.org/pipermail/openstack-discuss/2021-September/024728.html10:01
soniya29chandankumar, thank you so much :)10:02
pojadhavsoniya29, congratulations :)10:02
chandankumarakahat: please have a look at this https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/805260 when free10:03
soniya29pojadhav, thanks :)10:03
akahatchandankumar, ack. i've added comments.10:39
marioscongrats soniya29 10:44
* anbanerj|ruck lunch11:08
chandankumarmarios: ysandeep https://review.opendev.org/c/openstack/tripleo-quickstart/+/807491 gate blocker for TQ add to queue when  free, thanks!11:12
* ysandeep checking11:12
marioschandankumar: ack i checked this morning but it was still beign updated 11:16
akahatsoniya29, congratulations!!11:19
pojadhavysandeep, chandankumar, marios : kindly review when free https://code.engineering.redhat.com/gerrit/q/topic:%22cleanup_eol_code%22+(status:open%20OR%20status:merged)11:22
pojadhavysandeep, chandankumar :  I posted a patch https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/271270.. due to cross dependancy its in merge conflict.. posted another patch to remove occurance from config : https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-config/+/27127211:23
erbotRequired files not ready after 301.3745017051697s for tripleo-validations-centos-8-molecule-check_uc_hostname 806896,1,be9cba3b1642489db5ec7f955c9e35e411:26
mariosack pojadhav 11:27
soniya29marios, thanks11:27
soniya29akahat, thanks :)11:27
arxcruzsoniya29: congratulations!11:29
*** jpena is now known as jpena|lunch11:30
ysandeepchandankumar: I have a quick query on https://review.opendev.org/c/openstack/tripleo-quickstart/+/807491, I will revote soon.11:31
ysandeeppojadhav: ack11:31
ysandeepchandankumar, anbanerj|ruck fyi.. 16.2/17 container build bug was resolved last night, lines are running currently.. we will see how the current run goes.11:42
anbanerj|ruckysandeep, https://trello.com/c/C1TRrqmP/2078-cixbz2001395osp17rhel8rhos-17rabbitmq-container-build-is-failing-looking-for-rabbitmq-server-3816-2el8osttrunk-x8664-rabbitmq-se this one right?11:44
ysandeepanbanerj|ruck: correct 11:44
anbanerj|ruckysandeep, thanks, I'll update the program call doc11:44
ysandeepanbanerj|ruck: 16.2 one as well https://bugzilla.redhat.com/show_bug.cgi?id=2001436 11:44
soniya29arxcruz, thank you :)11:45
kopecmartinsoniya29: can't join the meeting, i'm sorry, i have a different call I need to attend 11:50
soniya29kopecmartin, no problem11:50
chandankumarysandeep: thanks!11:54
soniya29chandankumar, ysandeep, rlandy, weshay|ruck, tempest meeting?12:00
chandankumarsoniya29: rlandy is on pto12:00
soniya29chandankumar, okay12:00
erbotRequired files not ready after 301.04663157463074s for tripleo-ci-centos-8-content-provider 800580,28,0cff00f6455a4162a7ebcd812ba553e512:03
*** pojadhav is now known as pojadhav|brb12:06
erbotRequired files not ready after 301.137407541275s for puppet-openstack-lint-ubuntu-focal 807851,1,c303f21a55584e1ea31e26ce7adeb6a912:09
*** amoralej is now known as amoralej|lunch12:09
weshay|rucksoniya29, sorry.. I have to skip today12:10
weshay|ruckysandeep, ok.. so we're good on container builds on 16.2 && 17 right?12:16
ysandeepweshay|ruck: yes we are good with container build for both  16.2 && 1712:18
ysandeepWe have some other jobs failure, checking if that's consistent or legit issue because of new dependencies..12:19
soniya29weshay|ruck, no problem12:19
weshay|ruckysandeep, aye12:19
weshay|ruckakahat, you have a handle on stack delete?12:22
weshay|ruckanbanerj|ruck, everything go ok w/ the program call?12:28
anbanerj|ruckweshay|ruck, yep, its still in progress12:29
chandankumaranbanerj|ruck: great job on program call :-)12:30
weshay|ruckanbanerj|ruck, you don't have to hang on for the whole thing unless you see something interesting12:30
anbanerj|ruckchandankumar, thanks :)12:31
*** jpena|lunch is now known as jpena12:34
ysandeepweshay|ruck, chandankumar pojadhav|brb release files were left: https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/27129512:45
pojadhav|brbysandeep, ack12:46
*** pojadhav|brb is now known as pojadhav12:46
chandankumarysandeep: looking12:46
ysandeeppojadhav: after merge of ^^, I think you will have better results with 16.2/17 failing jobs, Sometime different rpm on container vs host can cause different issues.12:51
pojadhavysandeep, ack12:53
erbotRequired files not ready after 301.29487323760986s for tripleo-ci-centos-8-containers-multinode-wallaby 807704,3,7b8c3408cc374e8eb3680cac25f1413813:06
chandankumaranbanerj|ruck: weshay|ruck stepping out for a bit13:11
anbanerj|ruckchandankumar, ack13:11
*** chem is now known as Guest668813:13
chandankumarysandeep: https://review.opendev.org/c/openstack/tripleo-quickstart/+/807491 commented , thanks !13:15
ysandeepchandankumar, ack o/ 13:18
*** amoralej|lunch is now known as amoralej13:20
akahatweshay|ruck, yes. 13:20
erbotRequired files not ready after 301.40383291244507s for tripleo-ci-centos-8-scenario000-multinode-oooq-container-updates 798642,17,aea885e765b6423fae8ee0613370b99713:31
marioszbr: chandankumar: 2021-09-08 09:32:59.365821 | primary | TASK [repo-setup : tripleo-get-hash tripleo-ci-testing for osp17 on rhel8 from http://osp-trunk.hosted.upshift.rdu2.redhat.com] *** ok: [undercloud] @ https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/stream/1f82bfe75c47419db4424e7e82fd0d33?logfile=console.log (https://code.engineering.redhat.com/gerrit/c/testproject/+/262629 )13:44
chandankumarmarios: I think we need to use this path /usr/share/ansible/collections13:53
chandankumarfor installing collections13:53
marioschandankumar: the .ansible one works for the upstream and dstream jobs so seems OK 13:53
marioschandankumar: if we need to update we can followup ? (we can also adjust the paths in https://opendev.org/openstack/tripleo-quickstart/src/branch/master/ansible.cfg 13:54
chandankumarmarios: I am basically looking at how to skip build-test-packages and pick the changes during tripleo-repos installation13:54
marioschandankumar: ah right. i am wondering if we can move build-test-packages before repo-setup ? 13:55
marioschandankumar: in https://opendev.org/openstack/tripleo-quickstart-extras/src/commit/5fa649b5e9ae54578fa2fb04b1975a853b3a6717/roles/undercloud-setup/tasks/main.yml#L29-L35 i mean 13:55
marioschandankumar: but for sure that is a followup/unrelated to https://review.opendev.org/c/openstack/tripleo-quickstart/+/791486 13:56
chandankumarmarios: but we need repos to run build-test-packages13:57
chandankumarwhich is provided by repo-setup13:57
marioschandankumar: do we? i thought we might but i assumed we've already cloned the repos we need to build at that point? or we need the tripleo repos in the b-t-p explicitly for some reason?13:58
chandankumarmarios: https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/build-test-packages/tasks/main.yml#L14114:05
chandankumarmarios: we need repos before running btp14:05
chandankumarmarios: Once current run finishes, can we try with -p /usr/share/ansible/collections path14:05
chandankumarit will pick the changes 14:06
erbotRequired files not ready after 303.2883005142212s for tripleo-ci-centos-8-undercloud-upgrade-ussuri 807385,1,e6707b16afad479990f726766c8fc01114:07
marioschandankumar: no if it is green i would rather merge asap and then followup. perhaps we can discuss in tomorrow scrum some more ? 14:07
chandankumarmarios: yes sure14:07
marioschandankumar: or we can have a call tomorrow morning about it14:07
marioschandankumar: thanks14:07
chandankumarmarios: will ping you tomorrow on this14:07
weshay|ruckmarios, need you for 5min14:11
weshay|ruckmarios, https://meet.google.com/nev-qone-ooh?authuser=114:11
mariosweshay|ruck: o/ sure gimme sec joining (was fetching coffee )14:15
erbotRequired files not ready after 301.11478185653687s for tripleo-ci-centos-8-content-provider 798948,11,e31b557d5f494fd4a6fbb26f73a0a5ba14:32
erbotRequired files not ready after 589.0191352367401s for tripleo-upgrade-centos-8-molecule 807879,1,4de4ed9c4494422690536e3075f616c414:37
weshay|ruckmarios, so the upgrade should run the release file for victoria.. right.. I bet this is just in the wrong spot there too.. /me still trolling logs..14:38
weshay|ruck2021-09-03T20:03:20+0000 DEBUG Installed: network-scripts-openvswitch2.13-2.13.0-122.el8.x86_6414:38
weshay|ruck2021-09-03T20:03:20+0000 DEBUG Installed: openvswitch-selinux-extra-policy-1.0-28.el8.noarch14:38
weshay|ruck2021-09-03T20:03:20+0000 DEBUG Installed: openvswitch2.13-2.13.0-122.el8.x86_6414:38
weshay|ruckhttps://logserver.rdoproject.org/11/35111/15/check/periodic-tripleo-ci-centos-8-standalone-upgrade-ussuri/b658743/logs/undercloud/var/log/dnf.log.txt.gz14:38
marios17:38 < weshay|ruck> marios, so the upgrade should run the release file for victoria.. right.. I bet this is 14:41
mariosweshay|ruck: for ussuri you mean but what is the question here 14:41
* weshay|ruck just kind of thinking outloud in irc.14:42
weshay|ruckI'll catch you tomorrow am14:42
mariosack 14:42
weshay|ruckand run what I find by you14:42
weshay|ruckanbanerj|ruck, /me working the upgrade issue14:42
anbanerj|ruckweshay|ruck, thanks14:44
weshay|ruckhttps://logserver.rdoproject.org/11/35111/15/check/periodic-tripleo-ci-centos-8-standalone-upgrade-ussuri/b658743/logs/quickstart_files/playbook_executions.log14:47
* ysandeep notes we missed paunch repo when we were doing c7->c8 porting for train branch14:54
* dviroel lunch15:11
*** tosky is now known as Guest670215:22
*** tosky_ is now known as tosky15:22
erbotRequired files not ready after 301.76556277275085s for kolla-ansible-centos-source 802356,2,bdd4aad4371e442abf9fb14dc6b5aa4a15:25
weshay|ruckanbanerj|ruck, https://review.opendev.org/c/openstack/tripleo-quickstart/+/80695515:30
*** amoralej is now known as amoralej|off15:30
anbanerj|ruckweshay|ruck, ack, thanks15:31
weshay|ruckmarios, fyi https://review.opendev.org/c/openstack/tripleo-quickstart/+/80695515:38
mariosweshay|ruck: ack adding to list - but good if we can keep it in tq/tqe instead of tht/etc 15:39
mariosweshay|ruck: waiting on testing etc there is there a testproject i can check tomorrow when i vote? 15:40
weshay|ruckhttps://review.rdoproject.org/r/c/testproject/+/3511115:41
mariosack15:46
weshay|ruckanbanerj|ruck, can I answer any questions?  15:53
weshay|ruckanbanerj|ruck, perhaps walk through why those upstream zuul openvswitch roles exist. and why we're doing what we're doing?15:54
anbanerj|ruckweshay|ruck, yes.. what is repo_setup_upgrade.sh in patch https://review.opendev.org/c/openstack/tripleo-quickstart/+/806955/3/config/release/tripleo-ci/CentOS-8/promotion-testing-hash-ussuri.yml#18815:55
weshay|ruckanbanerj|ruck, meet.google.com/qhh-zvah-cvz15:55
weshay|ruckeasier to show you15:55
*** marios is now known as marios|out15:58
weshay|ruckanbanerj|ruck, https://wiki.centos.org/SpecialInterestGroup16:09
weshay|ruckanbanerj|ruck, https://review.rdoproject.org/zuul/stream/8fee72b3395943068b32497e08ab8060?logfile=console.log16:18
weshay|ruckanbanerj|ruck, +216:34
anbanerj|ruckweshay|ruck, I am leaving for the day in a few mins16:51
weshay|ruckanbanerj|ruck, 0/16:51
pojadhavweshay|ruck, help me to merge this https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/27093217:01
* weshay|ruck looks17:01
pojadhavweshay|ruck, https://code.engineering.redhat.com/gerrit/q/topic:%22cleanup_eol_code%22+(status:open%20OR%20status:merged)17:02
pojadhavthanks!17:02
weshay|ruckpojadhav, done17:02
pojadhavthanks.. 2 more there.. kindly review when you free :)17:03
erbotRequired files not ready after 302.28409695625305s for tripleo-ci-centos-8-content-provider 807054,1,e48800817e804f40914ab92e51cb5cd217:07
*** jpena is now known as jpena|off17:09
ysandeeppojadhav: hey o/ michal pryc added those jobs, lets wait for him on review to ack those jobs removal17:16
ysandeepI left a comment for him on review17:16
erbotRequired files not ready after 300.53389143943787s for tripleo-ci-centos-8-containers-multinode-wallaby 807872,2,57ad0451e9a248529a562c8492621c2617:23
erbotRequired files not ready after 300.97050070762634s for tripleo-ci-centos-8-undercloud-upgrade 798642,18,f817a79f31174bce959b08948af9755e17:29
ysandeepReview request: Remove Centos7 ovb jobs from rdo check | https://review.rdoproject.org/r/c/config/+/3539417:41
erbotRequired files not ready after 301.26505398750305s for tripleo-ci-centos-8-containers-multinode-victoria 807491,9,d3e4a2be6d8f4235ab61f29b82d2944417:42
erbotRequired files not ready after 300.79830741882324s for neutron-tempest-plugin-scenario-linuxbridge-ussuri 807765,2,efed3a1ce1f542bf88405ca4f1ec285a17:54
erbotRequired files not ready after 382.821058511734s for tripleo-ci-centos-8-scenario000-multinode-oooq-container-updates-wallaby 807861,1,547114cc3ce84ecbba593ec73364773817:59
erbotRequired files not ready after 301.4245789051056s for tripleo-ci-centos-8-undercloud-containers 807587,1,32d6549c46cb48e28c6316e03e8a6a7c18:14
erbotRequired files not ready after 300.82398200035095s for tripleo-build-containers-centos-7-buildah-train 800577,44,7f874dafcde64a0e8602d0ebc320680518:38
erbotRequired files not ready after 311.2873868942261s for openstack-tox-pep8 803915,20,1fd1667be50845c0988ca0eff9499c5c18:43
ysandeepweshay|ruck: when you have time, could you please review and +w this one if looks okay:- https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/806724 19:10
weshay|ruckysandeep, yup.. few min19:11
*** ysandeep is now known as ysandeep|out19:24
ysandeep|outweshay|ruck: thanks! see you tomorrow o/ 19:25
* ysandeep|out out 19:26
weshay|ruck0/19:26
erbotRequired files not ready after 302.1303346157074s for tripleo-ci-centos-8-standalone-upgrade-ussuri 807649,2,2db3ae0884e3493a8792d06dab45d3a119:32
erbotRequired files not ready after 370.93140053749084s for tripleo-ci-centos-8-content-provider-ussuri 807750,2,2b2f1e0f169549d7be8e332ffe77822919:37
erbotRequired files not ready after 301.04937863349915s for tripleo-ci-centos-8-undercloud-containers 807747,2,9a4a54d0e5914df997151e9015a2768720:19
erbotRequired files not ready after 301.5979800224304s for tripleo-ci-centos-8-content-provider 807054,1,ea77ba2b10e44d2da8e64cdcdc94559420:44
-opendevstatus- NOTICE: The Gerrit service on review.opendev.org is going offline momentarily for a host migration and zuul upgrade, downtime should be only a few minutes.21:04

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!