Wednesday, 2021-04-14

« Tuesday, 2021-04-13 Index Thursday, 2021-04-15 »
*** gchamoul has quit IRC00:06
*** gchamoul has joined #oooq00:08
*** dviroel has quit IRC00:32
rlandy|roverweshay|ruck: k - watching it00:41
*** jmasud has joined #oooq01:36
*** beagles has quit IRC02:15
*** jmasud has quit IRC03:05
*** jmasud has joined #oooq03:47
*** skramaja has joined #oooq03:52
*** sanjayu__ has joined #oooq04:13
*** jmasud has quit IRC04:14
*** ykarel has joined #oooq04:14
*** sanjayu_ has joined #oooq04:15
*** sanjayu__ has quit IRC04:18
*** sanjayu__ has joined #oooq04:25
*** sanjayu_ has quit IRC04:27
*** rlandy|rover has quit IRC04:33
*** ratailor has joined #oooq04:39
*** marios has joined #oooq04:59
*** jpodivin has joined #oooq06:02
*** udesale has joined #oooq06:06
*** sanjayu__ has quit IRC06:08
*** ysandeep|holiday is now known as ysandeep06:24
*** saneax has joined #oooq06:24
*** zbr has quit IRC06:30
*** zbr has joined #oooq06:31
chandankumararxcruz: kopecmartin calling today's tempest meeting as soniya is sick and we have interviews today06:54
chandankumar*cancelling06:54
kopecmartinchandankumar: ack06:54
*** amoralej|off is now known as amoralej06:59
*** amoralej is now known as amoralej|off06:59
*** marios has quit IRC07:21
*** tosky has joined #oooq07:50
*** derekh has joined #oooq07:54
*** jpena|off is now known as jpena07:57
*** apetrich has joined #oooq07:59
*** slaweq_ has joined #oooq08:19
*** slaweq has quit IRC08:19
*** marios has joined #oooq08:21
zbris anyone willing to review a new feature proposed for tox-ansible, to ease molecule scenario exposure to tox?08:21
*** jmasud has joined #oooq08:31
*** slaweq_ is now known as slaweq08:51
*** amoralej|off is now known as amoralej09:20
arxcruzchandankumar: https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/78225309:43
arxcruzas I said yesterday, there's a --release option09:43
chandankumarlet me try that09:45
chandankumararxcruz: commented there09:54
chandankumararxcruz: Error: zip argument #1 must support iteration09:54
* zbr giggles every time he reads "Jenkins Support terminated" in his inbox :D10:10
arxcruzchandankumar: https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/782253 fixed10:56
arxcruzkopecmartin: ^10:56
*** jmasud has quit IRC11:04
zbrwhere was one place where that hit us often with surprises from updated pypi packages? i want to show you an easy pinning solution11:15
*** ratailor has quit IRC11:17
*** dviroel_ has joined #oooq11:21
*** jpena is now known as jpena|lunch11:32
*** dviroel_ is now known as dviroel__11:35
*** rlandy has joined #oooq11:35
*** dviroel__ is now known as dviroel11:36
*** rlandy is now known as rlandy|rover11:36
*** ykarel_ has joined #oooq11:37
*** ykarel has quit IRC11:40
*** ykarel_ is now known as ykarel11:47
rlandy|roverarxcruz: interview12:00
weshay|ruckysandeep, is https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/ down?12:12
ysandeepweshay|ruck, nope.. working for me12:13
weshay|ruckdang it12:13
ysandeepweshay|ruck, rlandy|rover fyi.. image build for 16.2 was failing.. disk-image-builder issue .. i just posted a patch https://code.engineering.redhat.com/gerrit/#/c/235942/12:13
rlandy|roverysandeep: thanks12:14
*** rlandy|rover is now known as rlandy|rover|mtg12:14
*** amoralej is now known as amoralej|lunch12:21
weshay|ruckmarios, I'm seeing puppet starting to branch.. https://review.opendev.org/q/tripleo+branch:stable/wallaby12:22
mariosweshay|ruck: will check after call12:23
*** marios is now known as marios|call12:23
*** jpena|lunch is now known as jpena12:29
*** ysandeep is now known as ysandeep|afk12:46
*** amoralej|lunch is now known as amoralej13:02
*** ysandeep|afk is now known as ysandeep13:25
*** skramaja has quit IRC13:34
*** rlandy|rover|mtg is now known as rlandy|rover13:35
*** marios|call is now known as marios13:36
ysandeeprlandy|rover, fyi.. 16.2 image build works with diskimage-builder fix.. periodic-tripleo-rhel-8-buildimage-ironic-python-agent-rhos-16.2 https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/build/ee220fae48cb4204a15099e8e9a4c9fa : SUCCESS in 20m 35s13:44
ysandeepdo you know any cores for diskimage-builder to merge this https://code.engineering.redhat.com/gerrit/#/c/235942/?13:44
rlandy|roverysandeep: is that a fix that should go upstream first?13:44
rlandy|roverysandeep: I get the downstream only patch for testing13:45
rlandy|roverbut we get push back for downstream only13:45
ysandeeprlandy|rover, no only for downstream, it was caused by downstream only patch https://code.engineering.redhat.com/gerrit/#/c/233891/13:45
rlandy|roverysandeep: ok - ianw usually approves upstream13:46
rlandy|roverI have yet to get downstream reviews through on image builder13:46
rlandy|roverysandeep: ask lon what to do here13:46
rlandy|roverysandeep: I can ask steve baker when he comes on line13:47
rlandy|roveraustralia13:47
ysandeeprlandy|rover, yes that will be great.. its midnight for him right now13:47
rlandy|roverack13:47
rlandy|roverysandeep: he comes on line at about 5pm my time13:47
ysandeepi already added him on review as well13:47
*** arxcruz has quit IRC13:57
*** arxcruz has joined #oooq13:59
rlandy|roverysandeep: want to merge your patches to update rhel 8.4?14:06
rlandy|roveryou had a -1 on those14:06
rlandy|roverso I didn't want to merge that14:06
ysandeeprlandy|rover, i have removed my -1s today, we can merge them14:07
*** baha has joined #oooq14:13
*** slaweq has quit IRC14:16
*** slaweq has joined #oooq14:20
*** ykarel_ has joined #oooq14:20
*** ykarel has quit IRC14:22
weshay|ruckrlandy|rover, I see images still failing in 16.214:26
rlandy|roverweshay|ruck: ysandeep has a patch14:26
weshay|ruck++14:27
rlandy|roverwe need a +2 from steve or someone who can approve DIB downstream14:27
weshay|rucklink?14:27
rlandy|roverplan to ping steve when he comes on line14:27
ysandeepweshay|ruck, https://code.engineering.redhat.com/gerrit/#/c/235942/14:27
rlandy|roverweshay|ruck: 17 should work14:27
rlandy|roverbt the patch relies on 16.2 to get through14:27
rlandy|roveror we remove those tests14:28
rlandy|roverand get 17 moving14:28
weshay|ruckrlandy|rover, ysandeep merged14:28
ysandeepweshay|ruck, you are core there .. ++14:28
*** ykarel_ is now known as ykarel14:29
rlandy|roverysandeep: ok - should be abl eto rerun my fix now for image builds14:30
rlandy|roverrestored14:32
ysandeeprlandy|rover, thanks i just noticed.. tox and linter jobs hit some infra issue..14:32
ysandeepthey were in error state.. i haven't seen error state before tbh.. :D14:33
* ysandeep keeping an eye, check jobs haven't started after restore.. 14:36
chandankumararxcruz: bhagyashris please post the interview feedback when free, thanks!14:36
chandankumarrlandy|rover: does wallaby branching is clear now?14:42
rlandy|roverchandankumar: we need to promote network component14:42
rlandy|roverwill look at it after CIX call14:42
chandankumarack14:44
weshay|ruckrlandy|rover, let's chat for a sec14:50
rlandy|roverweshay|ruck: k - 5 mins?14:50
*** haleyb has quit IRC14:50
weshay|ruckrlandy|rover, meet.google.com/iba-zzpk-uuq14:51
weshay|ruck  sure14:51
weshay|ruckdviroel, doing ok?14:51
dviroelweshay|ruck: o/, yep14:52
rlandy|roverjoining14:54
weshay|ruckchandankumar, are you still working https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario010-kvm-standalone-master/903608c/logs/stackviz/#/testrepository.subunit14:54
weshay|ruckor should I get a diff owner14:54
*** saneax has quit IRC14:56
rlandy|roverarxcruz: chandankumar: bhagyashris: pls leave your notes from today's interview14:58
chandankumarrlandy|rover: done that already15:01
rlandy|roverchandankumar: thanks15:01
chandankumarweshay|ruck: we enabled it yesterday15:01
chandankumarweshay|ruck: it needs more tweak to make it green15:02
weshay|ruckrlandy|rover, https://opendev.org/openstack/puppet-openstack-integration/src/branch/master/zuul.d/layout.yaml#L4515:05
weshay|ruckrlandy|rover, https://docs.google.com/document/d/1HqQsi9WD_Z2C8-em2BUmTH0lYbsuAKKXF_YeKMXjiVM/edit#15:07
*** dviroel is now known as dviroel|lunch15:07
*** jpodivin has quit IRC15:09
weshay|ruckbhagyashris, you have any updates on the container push/check bits of the promoter15:16
weshay|ruckpojadhav, can you check to see why we're not seeing any history of promotions here http://dashboard-ci.tripleo.org/d/TWhcr9_Mk/component-pipeline-wallaby?orgId=115:17
pojadhavweshay|ruck, ack15:17
pojadhavweshay|ruck, because here wallaby is not added yet https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/infra-setup/roles/rrcockpit/files/telegraf_py3/last_promotions.py#L81-L8715:22
pojadhavI am posting patch for the same15:22
*** ysandeep is now known as ysandeep|away15:25
weshay|ruckah.. nice catch15:31
pojadhavweshay|ruck, but now I am getting KeyError: 'extended_hash'15:33
pojadhavis extended_hash is already implemented..?15:33
pojadhavI set it to None.. just to check whether last_promotions.py is working fine or not for wallaby. and Its working fine..15:35
rlandy|roverpojadhav: hi - weshay|ruck pointed out that we are missing some validation jobs in component for wallaby15:41
pojadhavrlandy|rover, ack.. checking15:44
*** dviroel|lunch is now known as dviroel15:45
rlandy|roverwoohoo ... we have our first 16.2 image build pass15:53
rlandy|roverysandeep|away: weshay|ruck: ^^15:53
rlandy|rovershould clear 17 and 16.2 when this patch merges15:53
weshay|rucknice15:57
*** rlandy|rover is now known as rlandy|rover|mtg16:01
weshay|ruckrlandy|rover|mtg, as time permits https://review.rdoproject.org/r/c/rdo-jobs/+/33343 https://review.rdoproject.org/r/c/config/+/3334216:05
pojadhavweshay|ruck, chandankumar : https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3334116:13
pojadhavbrb in sometime*16:14
weshay|ruckpojadhav++16:14
*** jmasud has joined #oooq16:26
*** marios is now known as marios|out16:32
*** marios|out has quit IRC16:37
pojadhavweshay|ruck, sorry linter error :( could you pls again review it - https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3334116:39
weshay|ruckstein will promote today16:47
weshay|ruck\0/ I FOUND WHERE THE PROMOTE_BLOCKER SCRIPTS ARE RUNNING16:57
*** udesale has quit IRC16:57
rlandy|rover|mtggood for you!!17:05
*** rlandy|rover|mtg is now known as rlandy|rover17:05
*** derekh has quit IRC17:05
*** jpena is now known as jpena|off17:10
*** amoralej is now known as amoralej|off17:24
*** ykarel has quit IRC17:35
*** jmasud has quit IRC18:17
*** jmasud has joined #oooq18:19
rlandy|roverlunch - back in a few18:20
weshay|ruckrlandy|rover, rocky killed https://review.rdoproject.org/r/c/rdo-jobs/+/3334318:43
rlandy|rovergood18:46
rlandy|rovermay he rest in peace18:46
akahatweshay|ruck, rlandy|rover can you tell me why containers are not coming up?18:52
akahatI'm sure this is not firewall issue.18:52
akahathttps://logserver.rdoproject.org/79/32679/10/check/mol-promote_images/2633686/job-output.txt18:52
rlandy|roverlooking in a sec18:53
weshay|ruckakahat, looks like dlrn is not up18:54
akahatyeah.. dlrn18:55
akahatdlrn is up but it is not connecting to it.18:56
weshay|ruckakahat, I think it's hard to see in logging18:58
weshay|ruckI don't see18:58
weshay|ruck DEBUG:promoter:Running constructor for attribute components_mode[0m18:58
weshay|ruck2021-04-14 10:21:08.504491 | rdo-centos-8 | [32m    DEBUG:promoter:Running constructor for attribute components_mode[0m18:58
weshay|ruck2021-04-14 10:21:08.505251 | rdo-centos-8 | [32m    INFO:promoter-staging:Creating stage root dir in /tmp/promoter-staging/[0m18:58
weshay|rucklike I do in another job18:58
weshay|ruckhttps://logserver.rdoproject.org/35/32135/6/check/mol-promote_images/bf0bcc1/job-output.txt18:58
weshay|ruckI think it's actually failing here: 2021-04-14 09:57:50.087155 | rdo-centos-8 | [31m    DEBUG:promoter:Promoter DLRN client: API URL: http://localhost:58080, user: ciuser[0m18:58
weshay|ruckit def.. was up18:59
weshay|ruckakahat, it did fail earlier in the log too19:01
weshay|ruck2021-04-14 09:57:18.698179 | rdo-centos-8 | TASK [Run the image promotion script promote-images.sh] ************************19:01
weshay|ruck2021-04-14 09:57:19.849981 | rdo-centos-8 | [1;30mFAILED - RETRYING: Run the image promotion script promote-images.sh (5 retries left).[0m19:01
weshay|ruck2021-04-14 09:57:25.867073 | rdo-centos-8 | [1;30mFAILED - RETRYING: Run the image promotion script promote-images.sh (4 retries left).[0m19:01
weshay|ruck2021-04-14 09:57:31.888779 | rdo-centos-8 | [1;30mFAILED - RETRYING: Run the image promotion script promote-images.sh (3 retries left).[0m19:01
weshay|ruck2021-04-14 09:57:37.934031 | rdo-centos-8 | [1;30mFAILED - RETRYING: Run the image promotion script promote-images.sh (2 retries left).[0m19:01
weshay|ruck2021-04-14 09:57:43.908605 | rdo-centos-8 | [1;30mFAILED - RETRYING: Run the image promotion script promote-images.sh (1 retries left).[0m19:01
weshay|ruck2021-04-14 09:57:50.066213 | rdo-centos-8 | [31mfatal: [instance]: FAILED! => changed=false [0m19:01
akahatyeah..19:01
akahatbut why it is going down.. i didn't get it.19:02
akahatwell i've removed firewall ports form here but in previous jobs it is failing on the same place.19:07
akahathttps://review.rdoproject.org/r/c/rdo-infra/ci-config/+/32679/7..10/molecule/promote_images/prepare.yml19:07
weshay|ruckakahat, if the script fails19:07
weshay|ruckdoes that trigger a shutdown?19:07
akahatno19:07
weshay|ruckk19:08
weshay|ruckakahat, can you run "firewall-cmd --list-all-zones" in the job.. so we can look at the zones19:09
akahatokay.19:10
*** jmasud has quit IRC19:22
akahatweshay|ruck, i update patch let's see: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/32679/11/molecule/promote_images/prepare.yml19:23
weshay|ruckakahat, listing the zones will help us understand what line 23 should be19:25
weshay|ruckperhaps.. in one patch.. we open those ports on all zones19:25
weshay|ruckif ur coming from localhost.. I doubt the zone is public19:25
weshay|ruckbut tbh.. not sure19:25
rlandy|roverweshay|ruck: hmmm ... puppet inheritance from upstream is a bit complicated19:27
rlandy|roverneed to talk to infra about that19:27
*** jmasud has joined #oooq19:32
*** jfrancoa has joined #oooq19:54
weshay|ruckrlandy|rover, every seen this "not allowed to shadow error" https://review.opendev.org/c/openstack/tripleo-validations/+/78627920:01
rlandy|roveryep20:01
weshay|ruckwhat is that?20:02
rlandy|rovershadow is a job by the same name in a diff repo20:02
rlandy|roverwe use that to get diff repos in the downstream20:02
rlandy|roversee the required-repos jobs20:02
* rlandy|rover looks at this case20:02
rlandy|rovermust have the same job defined elsewhere20:03
rlandy|rover Job tripleo-ci-centos-8-standalone-validation in openstack/validations-libs is not permitted to shadow job tripleo-ci-centos-8-standalone-validation in openstack/tripleo-validations20:03
rlandy|rover^^ same jobs defined in two places20:03
rlandy|roverit thinks you ar trying to shadow20:03
rlandy|roverif you do need to shadow, that had to be set up20:04
weshay|ruckya.. once I see this working.. I'll probably just define it in tripoleo-ci as a template20:05
rlandy|roverweshay|ruck: periodic-tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset002-wallaby SUCCESS - progress people20:19
weshay|ruckaye20:19
weshay|ruckrlandy|rover, we should have seen scen04 pass though too right?20:19
weshay|rucknew issue on 001 wallaby and master, not sure what20:19
weshay|ruckyet20:19
rlandy|roverscenario004 passed on all the other branches20:21
rlandy|roverhttps://review.rdoproject.org/r/c/testproject/+/3158620:22
rlandy|rovernot on check20:22
rlandy|roverlooking at that before we merge that20:22
rlandy|roverarxcruz: hmmm ... https://review.rdoproject.org/r/c/testproject/+/31586 still fails scneraio004 check with  https://review.opendev.org/c/openstack/tripleo-ci/+/785254/ depends on20:30
rlandy|roverperiodics pass though20:30
rlandy|roveris something else needed?20:30
rlandy|roverall python-tempestconf should be merged20:30
weshay|ruckrlandy|rover, we need to promote tempest component https://trunk.rdoproject.org/centos8-master/component/tempest/18/bc/18bc878270e6828598e372b0a753519fa60f28e0_b0751578/rpmbuild.log20:34
weshay|ruckto get https://review.opendev.org/c/openstack/tripleo-ci/+/785254/ to pass20:34
weshay|ruckI think20:35
rlandy|roverweshay|ruck: the change was in python-tempestconf20:35
rlandy|roverinteresting all the periodics pass20:35
rlandy|rovermaybe we do need to promote master20:36
* rlandy|rover comares definitions20:37
weshay|ruckrlandy|rover, yes.. python-tempestconf is in the tempest component20:38
rlandy|roverweshay|ruck: - ok so maybe we do need to promote20:39
rlandy|rovermess20:39
rlandy|roverperiodic-tripleo-build-containers-ubi-8-internal-rhel-8-build-push-upload-rhos-17success20:39
rlandy|roverperiodic-tripleo-rhel-8-buildimage-overcloud-full-rhos-17success20:39
rlandy|roverperiodic-tripleo-rhel-8-buildimage-ironic-python-agent-rhos-17success20:39
rlandy|roverperiodic-tripleo-rhel-8-rhos-17-promote-promoted-components-to-tripleo-ci-testing-internal20:39
rlandy|roverweshay|ruck: ^^ 17 is back20:39
rlandy|roverwe can recheck failures20:39
weshay|ruckrlandy|rover, tempest promoted yesterday.. can probably just force20:40
rlandy|roverforce to promoted-components?20:41
rlandy|roverwhatever is in tripleo-ci-testing is fine20:41
rlandy|roverunless we are promoting to current-tripleo20:41
rlandy|roverprobably if we started the promoter it would work20:41
rlandy|roveror we pull wallaby out of scebario004 check20:41
rlandy|roverfor the moment20:42
rlandy|roverif in the next run scenario004 is our only failure, we will be in good shape20:42
rlandy|roverhttps://review.opendev.org/c/openstack/tripleo-quickstart/+/78541020:46
rlandy|roverfailed all the content providers20:46
rlandy|roverceph20:46
rlandy|roveronly rev'ed wallaby20:46
rlandy|roveranbanerj|ruck: why is the victoria content provider non-voting - not the wallaby one?20:48
*** jmasud has quit IRC20:55
*** jfrancoa has quit IRC21:05
*** jmasud has joined #oooq21:12
anbanerj|ruckrlandy|rover, checking21:15
rlandy|roverthanks21:17
anbanerj|ruckThere was an error in this patch 785888 sorry! updated here https://review.opendev.org/c/openstack/tripleo-ci/+/78632721:21
rlandy|rovervoted - thank you22:15
*** jmasud has quit IRC22:31
*** rlandy|rover is now known as rlandy|rover|bbl22:32
*** jmasud has joined #oooq22:32
*** jmasud has quit IRC22:51
*** jmasud has joined #oooq23:02
*** tosky has quit IRC23:29
*** jmasud has quit IRC23:45
*** irclogbot_0 has quit IRC23:50
*** irclogbot_0 has joined #oooq23:55
« Tuesday, 2021-04-13 Index Thursday, 2021-04-15 »

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!