Monday, 2020-08-31

*** saneax has joined #oooq01:17
*** saneax has quit IRC01:29
*** rfolco has joined #oooq03:31
*** ratailor has joined #oooq03:48
*** saneax has joined #oooq04:34
*** ykarel|away has joined #oooq04:52
*** ykarel|away is now known as ykarel04:52
*** pojadhav|away is now known as pojadhav05:00
*** ykarel_ has joined #oooq05:33
*** ykarel has quit IRC05:35
*** ykarel__ has joined #oooq05:36
*** ykarel_ has quit IRC05:38
*** ykarel__ is now known as ykarel05:48
*** ysandeep|away is now known as ysandeep06:08
*** jfrancoa has joined #oooq06:10
*** sshnaidm|afk is now known as sshnaidm06:17
*** jtomasek has joined #oooq06:58
*** amoralej has joined #oooq07:03
*** ykarel has quit IRC07:04
*** ykarel has joined #oooq07:05
*** apetrich has joined #oooq07:18
*** ysandeep is now known as ysandeep|lunch07:32
*** tosky has joined #oooq07:39
*** jbadiapa has joined #oooq07:50
ykarelarxcruz|ruck, akahat is issue with compute component known? https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-standalone-full-tempest-api-compute-master07:51
ykareli see it's not promoted from around 2 weeks07:51
arxcruz|ruckykarel: checking07:52
arxcruz|ruckykarel: no, I'll open a lp and add this test on skiplist07:53
ykarelarxcruz|ruck, ack, likely skipping tests will promote bad contents07:56
ykarelso need to find why it's happening07:56
arxcruz|ruckykarel: usually we report the bug, skip it while the right team works to fix it07:56
ykarelhmm but don't know how will it will work with components promotion07:57
ykarellike skip test, promote component, in integration there might be more configuration tested, any may result in some different tests failures07:58
*** tosky has quit IRC08:00
*** jtomasek has quit IRC08:00
*** Tengu has quit IRC08:00
*** irclogbot_1 has quit IRC08:02
*** tosky has joined #oooq08:05
*** jtomasek has joined #oooq08:05
*** Tengu has joined #oooq08:05
*** irclogbot_1 has joined #oooq08:07
*** derekh has joined #oooq08:32
arxcruz|rucksshnaidm: I think your patch needs to be backported to ussuri08:32
*** holser has joined #oooq08:32
arxcruz|ruckhttps://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-ussuri/fa045d5/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz08:32
*** ysandeep|lunch is now known as ysandeep08:45
arxcruz|ruckchandankumar: hey man, around?08:52
sshnaidmarxcruz|ruck, which patch?09:01
arxcruz|rucksshnaidm: the one related to race condition, it seems to be happening in ussuri as well09:03
sshnaidmarxcruz|ruck, ok09:04
arxcruz|rucksshnaidm: it happened only once though09:04
arxcruz|rucknot sure if might worth wait next run09:05
*** dtantsur|afk is now known as dtantsur09:11
ysandeeparxcruz|ruck, i think chandankumar is on PTO today09:12
arxcruz|ruck:/09:13
arxcruz|ruckysandeep: is it holiday in india?09:13
ysandeeparxcruz|ruck, tommorow we have holiday in india , i think chandan took today's off to make it a long weekend :)09:13
arxcruz|ruckohhh, clever09:14
-openstackstatus- NOTICE: due to a new release of setuptools (50.0.0), a lot of jobs are currently broken, please do not recheck blindly. see http://lists.openstack.org/pipermail/openstack-discuss/2020-August/016905.html09:15
*** jfrancoa has quit IRC09:24
*** jfrancoa has joined #oooq09:25
*** jtomasek has quit IRC09:33
*** jtomasek has joined #oooq09:45
arxcruz|ruckykarel: thanks for the patch, I wanted to ping chandankumar to confirm if he had worked on thiss :)10:11
ykarelack10:12
*** tosky has quit IRC10:13
*** tosky has joined #oooq10:13
zbrtoday is bank holiday in uk, so do not wait for me. 🍿11:35
*** saneax has quit IRC11:40
*** weshay is now known as weshay|ruck11:44
bhagyashrisweshay|ruck, hi can you +w on https://review.rdoproject.org/r/#/c/29078/11:55
*** sshnaidm has quit IRC11:57
weshay|ruckbhagyashris, looking12:00
*** rlandy has joined #oooq12:01
*** sshnaidm has joined #oooq12:07
weshay|ruckbhagyashris, chandankumar do you know if the promoter tests run on any branch other than master12:08
weshay|ruck?12:08
weshay|ruckbhagyashris, to truly test our changes there.. we'd want a duplicate job say against centos-7 train12:08
weshay|ruckcentos-7-train and centos-8-master12:08
arxcruz|ruckweshay|ruck: chandankumar is on pto today12:09
arxcruz|rucknot sure about bhagyashris12:09
arxcruz|ruckweshay|ruck: let me know if you want to sync before the cix12:10
rlandyweshay|ruck: ysandeep: for rhos-17, baremetal, tripleo and computer are very old. computer has one tempest error and baremetal and tripleo are both failing ovb and baremetal. I think one component may need the other.12:11
bhagyashrisweshay|ruck, it will run only for c8 master and this test cases https://review.rdoproject.org/r/#/c/29078/6/ci-scripts/dlrnapi_promoter/test_repo_client_unit.py@139 will take care for other scenarios12:11
rlandyweshay|ruck: ysandeep: what do you think if we changed criteria and promoted all those to see if they clear each other?12:12
rlandyalso with the container name switch, we need to promote 17 and 16.2 this afternoon12:12
rlandyweshay|ruck: ^^ will ping you for that12:12
weshay|ruckarxcruz|ruck, k I'll look12:13
weshay|ruckrlandy, /me looks12:13
weshay|ruckrlandy, compute is old in master, but not tripleo12:14
* weshay|ruck looks at 1712:14
rlandya month ago12:15
rlandybaremetal12:15
rlandy4 days ago12:15
rlandy5f43794cc1dbcc7224a4d592f3d5acbc725fb14b_b90918fb12:15
rlandy22 days agocompute4 days ago64980bd78cba04e011ea78ed229b60e95204d60f_3ef9c31212:15
rlandy17 days agotripleo9 days agocd427883bb9190c5200bff95373747ef41bf3949_f3a6eb0412:15
rlandy^^ all old12:15
rlandyrather than debug individually12:15
ysandeeprlandy, I agree to promote12:15
rlandyysandeep: we may still have a problem12:16
rlandybut then at leats we will know it's not con component blocking the other12:16
weshay|ruckysandeep, rlandy osp-17 looks like issues w/ tempest12:16
ysandeepsure12:16
weshay|ruckrhos-17 compute is failing on empest.api.compute.servers.test_server_actions.ServerActionsTestJSON12:17
weshay|ruckwhich we may have a cix on12:17
weshay|ruckrlandy, arxcruz|ruck https://trello.com/c/Da1Rrv7H/1652-cixlp1893618tripleociproa-periodic-tripleo-ci-centos-8-scenario000-multinode-oooq-container-updates-ussuri-tempest-testshelveuns12:18
weshay|ruckmatches computes issue on rhos-17 https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-component-compute/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-standalone-full-tempest-api-compute-rhos-17/24916a9/logs/undercloud/var/log/tempest/stestr_results.html12:19
rlandyysandeep: OVB doesn't deploy12:19
arxcruz|ruckweshay|ruck: yes, and if you check the bug, it seems ykarel already found the issue12:20
arxcruz|ruckat least the root cause, it's...12:20
arxcruz|rucknova12:20
rlandyysandeep: weshay|ruck: either way we have the new 8.3 node to integrate12:21
rlandyso we need to clear the decks here12:21
ysandeeprlandy, looks like one run failed on tempest12:21
weshay|ruckk.. updated the cix card rlandy arxcruz|ruck12:22
rlandyFATAL | Create plan if does not exist | localhost | error={"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true}12:22
weshay|ruckysandeep, arxcruz|ruck can help figure out why tempest is not running on fs001/baremetal12:22
arxcruz|rucksure, where's the logs?12:23
rlandyysandeep: on 16.2, yes it's tempest on 17, FATAL | Create plan if does not exist | localhost | error={"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true}12:23
rlandyhttps://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-component-tripleo/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-internal-tripleo-rhos-17/a8940eb/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz12:23
rlandychange in the deployment plan12:23
weshay|ruckarxcruz|ruck, you have a skip list started for https://bugs.launchpad.net/tripleo/+bug/189362112:26
openstackLaunchpad bug 1893621 in tripleo "[train] Jobs are failing with Could not establish a connection to the Zaqar websocket" [Critical,In progress] - Assigned to Harald Jensås (harald-jensas)12:26
arxcruz|ruckweshay|ruck: no, there's already a patch to fix the problem12:26
weshay|ruckarxcruz|ruck, from rabi?12:27
arxcruz|ruckfrom hjensas12:27
arxcruz|ruckweshay|ruck: https://review.opendev.org/#/c/748673/12:27
arxcruz|ruckweshay|ruck: sorry, he added Related-Bug in his patch, but lp didn't update it12:28
weshay|ruckI got it12:29
ysandeeprlandy, hmm, never seen this one before, no_log:true may have hidden some relevant logs here12:29
arxcruz|ruckweshay|ruck: and it's not tempest related though :)12:29
weshay|ruckarxcruz|ruck, fs001/baremetal in osp-17?12:29
arxcruz|ruckweshay|ruck: no the zaqar12:30
arxcruz|ruckweshay|ruck: on the baremetal, i don't see any validation playbook being invoked12:31
weshay|ruckarxcruz|ruck, ya.. sure.. that makes sense12:31
*** radez has joined #oooq12:31
weshay|ruckrlandy, ysandeep arxcruz|ruck rhos-17 tripleo fs001/bm looked like it failed in tempest setup when I quickly looked.. could be wrong12:31
weshay|ruckbut we need validation there12:31
arxcruz|ruckweshay|ruck: can you point me the log ?12:32
ysandeepweshay|ruck, looking12:34
rlandyhttps://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-component-tripleo/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-bm_envE-3ctlr_1comp-featureset001-tripleo-rhos-17/025c891/logs/undercloud/home/zuul/overcloud_deploy.log12:36
rlandy^^ tempest issue? doesn't deploy12:36
*** ysandeep is now known as ysandeep|brb12:49
*** amoralej is now known as amoralej|lunch12:49
*** ratailor has quit IRC12:49
weshay|ruckzbr, hola12:53
arxcruz|ruckweshay|ruck: I'll be back in approx. 1 hour, need to handle some stuff in my daughter kindergarden12:54
weshay|ruckarxcruz|ruck, np12:54
*** ysandeep|brb is now known as ysandeep12:57
sshnaidmweshay|ruck, mtg?13:00
weshay|ruckysandeep, name=delorean-openstack-ironic-python-agent-builder-11bb1098a39c905b3ac54fe5b657d31d0b56f2a113:17
ysandeepweshay|ruck, https://review.opendev.org/#/c/741228/13:19
*** TrevorV has joined #oooq13:28
ysandeepweshay|ruck, rlandy https://code.engineering.redhat.com/gerrit/#/c/209796/ and https://code.engineering.redhat.com/gerrit/#/c/209357/13:35
ysandeephttps://sf.hosted.upshift.rdu2.redhat.com/logs/85/209585/12/check/periodic-tripleo-ci-rhel-8-bm_envA-3ctlr_1comp-featureset001-rhos-16.2/0579493/logs/undercloud/home/zuul/build-err.log13:36
arxcruz|ruckweshay|ruck: back13:36
weshay|ruckarxcruz|ruck, 0/13:36
arxcruz|ruckweshay|ruck: we should have rocky and stein once https://review.opendev.org/#/c/748955/ get merged13:36
weshay|ruckarxcruz|ruck, demo'ing https://github.com/weshayutin/gri13:37
weshay|ruckarxcruz|ruck, cool tool sorin wrote13:37
ysandeeprlandy, weshay|ruck https://review.opendev.org/#/c/748449/13:37
ysandeepsshnaidm, ^^13:38
*** amoralej|lunch is now known as amoralej13:49
*** rlandy is now known as rlandy|training13:51
*** pojadhav is now known as pojadhav|away13:51
*** rlandy|training has quit IRC13:52
*** ratailor has joined #oooq13:52
*** rlandy has joined #oooq13:59
*** rlandy is now known as rlandy|training13:59
*** ykarel is now known as ykarel|mtg14:02
*** matbu has joined #oooq14:05
*** ysandeep is now known as ysandeep|afk14:05
*** jfrancoa has quit IRC14:11
*** jfrancoa has joined #oooq14:14
*** jfrancoa has quit IRC14:18
*** jfrancoa has joined #oooq14:31
*** ykarel|mtg is now known as ykarel14:32
*** ratailor has quit IRC14:40
*** ysandeep|afk is now known as ysandeep14:47
ysandeepweshay|ruck, fyi.. test run on ovb-fs001 train https://review.rdoproject.org/r/#/c/28458/  using rdocloud to possiblly get train component promotion14:49
*** mjturek1 has joined #oooq15:06
*** sshnaidm is now known as sshnaidm|bbl15:11
*** ykarel is now known as ykarel|away15:20
*** ysandeep is now known as ysandeep|away15:24
*** Goneri has joined #oooq15:25
*** rlandy|training is now known as rlandy16:12
*** amoralej is now known as amoralej|off16:18
*** ykarel|away has quit IRC16:27
*** Tengu has quit IRC16:35
*** Tengu has joined #oooq17:03
*** dtantsur is now known as dtantsur|afk17:13
*** tosky has quit IRC17:14
rlandyweshay|ruck: hey - pls ping me when you have time to work on the promotions17:17
*** derekh has quit IRC17:20
rlandyweshay|ruck:  https://code.engineering.redhat.com/gerrit/210254 Temp remove criteria to promote old rhos-17 components17:26
* weshay|ruck looks17:26
rlandyTIMING | Set facts from environment | 0:00:00.238 | 0.06s17:27
rlandy2020-08-31 12:42:43 | 2020-08-31 12:42:43.005095 | fa163e6f-a29c-e201-8028-00000000000c |      FATAL | Create plan if does not exist | localhost | error={"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true}17:27
rlandy2020-08-31 12:42:43 |17:27
weshay|ruckrlandy, k.. when it's done.. lets https://code.engineering.redhat.com/gerrit/#/c/210255/17:27
rlandyweshay|ruck: ack17:27
rlandyweshay|ruck: I just want to see if that clears the plan error17:27
rlandybefore we debug17:28
weshay|ruckrlandy, k.. let's promote in 10min?17:28
weshay|rucksound ok?17:28
rlandyweshay|ruck: sure17:28
weshay|ruckk17:28
weshay|ruckrlandy, when ever you are ready https://meet.google.com/ikh-zotm-vfz?authuser=117:51
weshay|ruckhrm.. that was more then 10 min17:52
weshay|ruckjeez17:52
rlandyjoining17:52
*** rfolco has quit IRC17:54
*** rfolco has joined #oooq18:08
*** rfolco has quit IRC18:14
*** dsneddon has joined #oooq18:25
weshay|ruckrlandy, http://dashboard-ci.tripleo.org/d/3sUHfh9Wz/jobs-exploration?orgId=1&var-influxdb_filter=job_name%7C%3D%7Ctripleo-ci-centos-8-standalone-on-multinode-ipa&var-influxdb_filter=branch%7C%3D%7Cmaster18:33
rlandyweshay|ruck: actually https://review.opendev.org/#/c/748609/3/roles/extras-common/defaults/main.yml should work after promotion18:45
rlandychange to release file not needed18:46
weshay|ruckk18:46
weshay|ruckthanks18:46
*** jfrancoa has quit IRC19:15
*** jmasud has quit IRC19:22
rlandyysandeep|away: hey - can you update the component criteria file for 16.2 - to add the jobs you added? ci-scripts/dlrnapi_promoter/config/RedHat-8/component/rhos-16.2.yaml19:24
*** TrevorV has quit IRC19:41
*** tosky has joined #oooq20:15
weshay|ruckrlandy, the ansible dep-jobs you are trying out are internal right?20:26
*** apetrich has quit IRC20:29
rlandyweshay|ruck: ack - running now20:29
rlandyperiodic-tripleo-ci-rhel-8-standalone-latest-ansible-container-build-rhos-16.220:29
rlandyperiodic-tripleo-ci-rhel-8-standalone-latest-ansible-rhos-16.220:29
rlandycontainer-tools rhel8 is also internal20:30
weshay|ruckk20:30
weshay|ruckthanks20:30
*** jtomasek has quit IRC21:12
*** jmasud has joined #oooq21:21
*** rlandy is now known as rlandy|bbl21:39
*** tosky has quit IRC23:03
*** Goneri has quit IRC23:33

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!