Thursday, 2020-11-05

*** holser has quit IRC00:10
*** tosky has quit IRC00:14
*** jmasud has joined #oooq00:41
*** jmasud has quit IRC00:42
*** holser has joined #oooq01:08
*** holser has quit IRC01:31
*** rlandy|bbl is now known as rlandy01:53
*** apetrich has quit IRC03:19
*** rh-jelabarre has quit IRC03:19
*** skramaja has joined #oooq03:22
*** ykarel has joined #oooq03:49
*** ratailor has joined #oooq03:56
*** udesale has joined #oooq04:04
*** saneax has joined #oooq05:03
*** jmasud has joined #oooq05:18
*** ratailor has quit IRC06:33
*** ysandeep|away is now known as ysandeep|ruck06:36
*** jbadiapa has quit IRC06:49
*** ksambor has joined #oooq06:54
*** Tengu has quit IRC06:58
*** Tengu has joined #oooq07:05
*** marios has joined #oooq07:09
ysandeep|rucksshnaidm|rover, Fyi.. https://review.opendev.org/761463 failed in check queue on tripleo-ci-centos-8-content-provider job with known issue - 'error checking if cached image exists from a previous build: error getting history of', Want to abandon/restore to save time?07:15
*** ykarel_ has joined #oooq07:21
*** ykarel has quit IRC07:24
*** jpena|off is now known as jpena07:35
*** ykarel_ is now known as ykarel07:39
*** jmasud has quit IRC07:45
*** jfrancoa has joined #oooq07:51
*** amoralej|off is now known as amoralej08:05
*** saneax has quit IRC08:09
*** tosky has joined #oooq08:13
ysandeep|rucksshnaidm|rover, good news we got c7 train/ stein/ rocky / queen promotions yesterday08:16
sshnaidm|roverysandeep|ruck, wow08:16
sshnaidm|roverysandeep|ruck, all c7?08:16
ysandeep|rucksshnaidm|rover, yes , c8s are just blocked on ipa failing job.. will pass once your adee patch lands08:17
ysandeep|ruckyours/adee08:17
ysandeep|ruckhttps://review.opendev.org/#/c/760994/ - we need some reviews on this again08:19
ysandeep|ruck+ content provider jobs (ubi8) issue need to clear first08:19
sshnaidm|roveryeah, ubi8 is blocking everything08:22
*** ysandeep|ruck is now known as ysandeep|lunch08:22
*** frenzy_friday has joined #oooq08:33
*** sshnaidm|rover has quit IRC08:36
*** sshnaidm|rover has joined #oooq08:38
*** sshnaidm|rover has quit IRC08:43
*** apetrich has joined #oooq08:57
*** jbadiapa has joined #oooq09:02
*** saneax has joined #oooq09:04
*** ysandeep|lunch is now known as ysandeep|ruck09:20
*** udesale_ has joined #oooq09:44
*** derekh has joined #oooq09:45
*** udesale has quit IRC09:47
*** sshnaidm has joined #oooq09:49
*** ratailor has joined #oooq10:00
*** arxcruz has quit IRC10:04
*** holser has joined #oooq10:07
*** arxcruz has joined #oooq10:09
ysandeep|ruckchandankumar, Hi o/ some octavia related tempest tests are failing - https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_9ed/760375/1/check/tripleo-ci-centos-8-scenario010-standalone/9ed34cf/logs/undercloud/var/log/tempest/tempest_run.log , To me looks like its an issue with octavia service itself, Do you know who can help us with octavia related issues? or may be octavia channel?10:20
ysandeep|rucksshnaidm, ^^ , this is regarding https://bugs.launchpad.net/tripleo/+bug/190199610:23
openstackLaunchpad bug 1901996 in tripleo "tripleo-ci-centos-8-scenario010-standalone is failing on tempest test with error 'Load Balancer is immutable and cannot be updated.'" [Critical,New]10:23
*** ysandeep|ruck is now known as ysandeep|brb10:35
sshnaidmack10:38
chandankumarysandeep|brb: carlos is the our man10:43
*** ysandeep|brb is now known as ysandeep|ruck10:51
ysandeep|ruckchandankumar, thanks!10:51
*** ratailor_ has joined #oooq10:58
*** ratailor has quit IRC11:01
*** ratailor__ has joined #oooq11:08
*** ratailor_ has quit IRC11:11
chandankumarsshnaidm: Hello11:14
chandankumarsshnaidm: in this review https://review.opendev.org/#/c/759985/29/zuul.d/multinode-jobs.yaml@261 c7 multinode job is added in tripleo-multinode-container-minimal-pipeline template11:14
chandankumarsshnaidm: I putted it as a depends-on here https://review.opendev.org/#/c/760089/1/zuul.d/layout.yaml but c7 multinode job is not getting triggered11:15
chandankumarfor queens branch11:15
chandankumari checked the job definition and branches all looks good11:15
chandankumarbut not sure why it is not getting triggered11:16
chandankumarsorry I think i got it https://review.opendev.org/#/c/759985/29/zuul.d/multinode-jobs.yaml@34 as layout.yaml in irrelevant files let me remove and re-run again11:17
*** ratailor__ has quit IRC11:17
*** ratailor has joined #oooq11:17
*** ratailor has quit IRC11:18
*** ratailor has joined #oooq11:21
*** ratailor has quit IRC11:21
*** skramaja has quit IRC11:23
*** skramaja has joined #oooq11:23
akahatchandankumar, sshnaidm there are few reviews from rfolco, please +w it: https://review.opendev.org/#/q/topic:new-ci-job+(status:open%20OR%20status:closed)+branch:stable/ussuri11:24
*** ratailor has joined #oooq11:26
*** dtantsur|afk is now known as dtantsur11:26
*** ratailor has quit IRC11:27
*** ratailor has joined #oooq11:27
sshnaidmakahat, chandankumar don't +w please until we solve ubi8 issue11:27
sshnaidmit won't pass anyway11:28
chandankumarack11:28
*** ratailor has quit IRC11:31
*** ratailor has joined #oooq11:31
*** ratailor_ has joined #oooq11:40
*** ratailor has quit IRC11:43
*** ratailor__ has joined #oooq11:47
*** ksambor has quit IRC11:49
*** ratailor_ has quit IRC11:50
ysandeep|rucksshnaidm: fyi.. just opened https://bugs.launchpad.net/tripleo/+bug/190303311:50
openstackLaunchpad bug 1903033 in tripleo "periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-master is failing while executing cold migration & resize tempest tests with Stderr: 'mkdir: cannot create directory ‘/var/lib/nova/instances/<uuid>’: Permission denied\n'" [Critical,Triaged]11:50
sshnaidmarxcruz, chandankumar can you please take a look in your time? ^11:58
sshnaidmysandeep|ruck, did it happen once?11:58
ysandeep|rucksshnaidm, continous issue11:59
ysandeep|rucksshnaidm, looks like real issue... i am checking audit log incase its selinux related12:00
*** ratailor_ has joined #oooq12:00
sshnaidmselinux should be off in our jobs12:00
*** ratailor_ has quit IRC12:01
sshnaidmarxcruz, chandankumar we can add it to skiplist if happens continuously, right? ^12:01
*** ratailor has joined #oooq12:01
chandankumarsshnaidm: yes sure12:01
ysandeep|rucksshnaidm, ohh i missed that... side effects of working downstream12:01
ysandeep|ruckfyi.. #periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-master is not in criteria12:02
*** rfolco has joined #oooq12:02
*** ratailor__ has quit IRC12:03
*** skramaja has quit IRC12:05
*** ksambor has joined #oooq12:11
mariosbrb12:17
*** marios has quit IRC12:17
*** marios has joined #oooq12:21
*** ratailor has quit IRC12:25
*** skramaja has joined #oooq12:29
marioschandankumar: akahat: rlandy: rfolco: sync?12:30
rlandymarios: ack12:31
*** jpena is now known as jpena|lunch12:32
akahatmarios, joining12:32
mariosblocked on https://bugs.launchpad.net/tripleo/+bug/1902846 fixed by either https://review.opendev.org/#/c/761463/3 or  https://review.opendev.org/#/c/761402/ whichever wins the race to merge first12:32
openstackLaunchpad bug 1902846 in tripleo "Container build job: periodic-tripleo-ci-build-containers-ubi-8-push is failing with dependencies issues cannot install crypto-policies/cyrus-sasl-lib and cyrus-sasl-lib" [Critical,New]12:32
chandankumarrlandy: marios https://review.opendev.org/#/c/760089/12:41
*** amoralej is now known as amoralej|lunch12:59
*** marios has quit IRC13:00
rfolcoscrum time13:01
rfolcoIf you have strong reservations about how your manager will react, share those concerns with the recruiter.13:01
*** rfolco has quit IRC13:01
*** rfolco has joined #oooq13:01
rlandychandankumar: hey ... when you have a moment, pls look at https://code.engineering.redhat.com/gerrit/#/q/topic:rename-rhos-15-test+(status:open+OR+status:merged) - let me know if I am using the right rhos-release command here13:02
rlandyin place of -P 1513:02
rfolcoarxcruz, rfolco, zbr, sshnaidm, rlandy, marios, ysandeep, bhagyashris, svyas, pojadhav, akahat, weshay, chandankumar13:02
rfolcoscrum time13:02
rfolcohttps://projects.engineering.redhat.com/secure/RapidBoard.jspa?rapidView=428513:02
*** marios has joined #oooq13:02
rlandyweshay|ruck: https://review.rdoproject.org/r/#/c/30489/13:06
*** rh-jelabarre has joined #oooq13:07
*** Goneri has joined #oooq13:11
rfolcoaaah dammn build report failed13:22
rfolco2020-11-05 13:13:25.924422 | TASK [build-containers : Execute build-report]13:22
rfolco2020-11-05 13:13:26.539056 | primary | Traceback (most recent call last):13:22
rfolco2020-11-05 13:13:26.539255 | primary |   File "build-report.py", line 5, in <module>13:22
rfolco2020-11-05 13:13:26.539276 | primary |     with open('containers-expected-to-build.log', encoding='utf8') as f:13:22
rfolco2020-11-05 13:13:26.539294 | primary | FileNotFoundError: [Errno 2] No such file or directory: 'containers-expected-to-build.log'13:22
rfolco2020-11-05 13:13:27.050720 | primary | ERROR13:22
rfolco2020-11-05 13:13:27.051126 | primary | {13:22
rfolco2020-11-05 13:13:27.051233 | primary |   "delta": "0:00:00.209711",13:22
rfolco2020-11-05 13:13:27.051331 | primary |   "end": "2020-11-05 13:13:26.549191",13:22
rfolco2020-11-05 13:13:27.051426 | primary |   "msg": "non-zero return code",13:22
rfolco2020-11-05 13:13:27.051521 | primary |   "rc": 1,13:22
rfolco2020-11-05 13:13:27.051636 | primary |   "start": "2020-11-05 13:13:26.339480"13:22
rfolco2020-11-05 13:13:27.051732 | primary | }13:22
mariosrfolco: * nit this needs to go https://opendev.org/openstack/tripleo-heat-templates/src/commit/3ef2fb1bf5c8b157a1118badf0a67d8d3bb341f6/zuul.d/layout.yaml#L21 (i.e. no dependency non consumer job here)13:22
rfolco2020-11-05 13:13:27.051838 | primary | ERROR: Ignoring Errors13:22
rfolcomarios, hmmm let me look13:23
mariosrfolco: we spoke13:24
mariosrfolco: about it on the13:24
mariosrfolco: call earlier13:24
mariosrfolco: just reminder like rlandy said better to13:24
rfolcomarios, strange13:24
mariosrfolco: use the opportunity to make them all clean13:24
mariosrfolco: lik13:24
mariosrlandy: like13:24
rfolcoI thought I had addressed that13:24
rfolcosuper weird13:24
mariosrfolco: that13:24
mariosrfolco: https://opendev.org/openstack/tripleo-heat-templates/src/branch/master/zuul.d/layout.yaml13:24
rfolcomarios, the job isn't there anymore13:29
*** jpena|lunch is now known as jpena13:31
*** saneax has quit IRC13:37
chandankumarakahat: https://review.opendev.org/#/c/760426/2 commented on ubi813:48
*** derekh has quit IRC13:49
*** derekh has joined #oooq13:50
mariosrfolco: not on master13:53
akahatchandankumar, thanks :)13:53
mariosrfolco: i posted you link to victoria one13:53
mariosrfolco: check victoria13:53
rfolcomarios, ah13:54
rfolcomarios, ok I thought somebody else was taking care of victoria13:54
rfolcoI'll cherry pick master one13:54
rfolcomarios, if that is ok with you13:54
rfolcomarios, ok13:54
rfolcomarios, for13:55
rfolcomarios, you13:55
rfolcomarios, ?13:55
*** amoralej|lunch is now known as amoralej13:56
mariosrfolco: no not yet13:57
mariosrfolco: actually fine go ahead why not13:57
rlandyweshay|ruck: joining downstream ci meeting14:01
*** pojadhav is now known as pojadhav|brb14:02
*** dmellado has quit IRC14:16
*** dtantsur has quit IRC14:16
weshay|ruckrlandy, waste of time14:18
*** dmellado has joined #oooq14:20
*** Goneri has quit IRC14:22
mjturekrfolco: rechecking https://review.opendev.org/#/c/761446/ but it seems like the tag is working on the x86_64 side, won't know on the ppc side until it merges14:34
*** dtantsur has joined #oooq14:37
*** dtantsur has quit IRC14:37
*** Goneri has joined #oooq14:38
zbrweshay|ruck: how about using tomorrow "Production Chain Open Office Hours" as an opportunity to reopen the dependency issue.14:38
*** dtantsur has joined #oooq14:38
weshay|ruckthere is a mtg w/ that name?14:39
weshay|rucksec14:39
rlandyweshay|ruck: just got an invite to "Production Chain Open Office Hours"14:43
rlandyfriday's day or learning topic14:44
weshay|ruckrlandy, do I have to fast for this holiday?14:45
rlandyweshay|ruck: it's post biblical - so no ... just make sure to bring your tulmud14:48
weshay|ruckchandankumar, ping14:55
*** dtantsur has quit IRC14:56
*** dtantsur has joined #oooq14:56
*** TrevorV has joined #oooq15:00
*** skramaja has quit IRC15:03
ysandeep|rucksshnaidm, weshay|ruck Weird.. Looks like dlrn is not building latest package for python-octavia-tests-tempest..15:45
ysandeep|ruckhttps://trunk.rdoproject.org/centos8-master/component/octavia/consistent/ have python-octavia-tests-tempest-1.4.1-0.20201020083552.a80a185.el8.src.rpm have hash of patch(a80a185) merged in sept 17 - https://github.com/openstack/octavia-tempest-plugin/commits/master15:45
ysandeep|ruckwe need https://review.opendev.org/#/c/755777/ hash 3bc1f4d (merged 6 days ago)to be in to fix - https://bugs.launchpad.net/tripleo/+bug/190199615:47
openstackLaunchpad bug 1901996 in tripleo "tripleo-ci-centos-8-scenario010-standalone is failing on tempest test with error 'Load Balancer is immutable and cannot be updated.'" [Critical,Triaged]15:47
weshay|ruckysandeep|ruck, k.. promotion-blocker tag.. so we can get the rdo folks to look15:47
weshay|ruckthank you15:47
ysandeep|ruckweshay|ruck, ack thanks for pointer i will check with rdo folks15:48
weshay|ruckthanks amoralej looking15:52
amoralejanyway pinning ubi8 to 8.2 should also work, i'm not sure what's better15:53
sshnaidmamoralej, if we'll use both repos, won't it be still conflicts?15:53
amoralejit shouldn't15:54
amoralejas ubi is self-resolving15:54
amoralejand migration from 8.2 to 8.3 should be clean15:54
amoralejbut... can't be 100% sure15:54
amoralejmix ubi and centos can lead to issues in one or other way16:01
amoralejhttps://developers.redhat.com/articles/ubi-faq#legal_and_licensing16:01
amoralej"Also, don’t add CentOS packages (because they will remove supportability). Adding CentOS packages turns the image into a Frankenstein. Neither Red Hat, nor the community will want to support it. You are better off with all UBI or CentOS content. Don’t mix and match. "16:01
amoralejin most cases it should work, but there may be corner cases when not in sync16:02
*** ysandeep|ruck is now known as ysandeep|away16:06
*** dmellado has quit IRC16:11
ysandeep|awayweshay|ruck, promotion-blocker tag added on that bug, fyi.. its pinned in rdo due to some missing httpx deps https://review.rdoproject.org/etherpad/p/httpx-centos8-octavia16:12
*** dmellado has joined #oooq16:13
*** jmasud has joined #oooq16:16
*** pojadhav|brb is now known as pojadhav16:17
*** ksambor has quit IRC16:25
*** udesale_ has quit IRC16:27
*** jpena is now known as jpena|off16:43
*** marios is now known as marios|out17:01
*** ykarel has quit IRC17:04
*** ykarel has joined #oooq17:05
*** marios|out has quit IRC17:14
*** jmasud has quit IRC17:17
*** jmasud has joined #oooq17:29
mjturekrfolco: just got +1 from zuul on the tag patch17:46
rfolcosshnaidm, chandankumar weshay|ruck https://review.opendev.org/#/c/761446/17:48
rfolcothis fixes ppc64 tagging for tcib ^17:48
rfolcoplease review17:49
rfolcomjturek, thanks for the patch17:49
*** amoralej is now known as amoralej|off17:51
*** ykarel is now known as ykarel|away17:56
*** derekh has quit IRC18:00
*** frenzy_friday has quit IRC18:08
*** frenzy_friday has joined #oooq18:09
*** ykarel|away has quit IRC18:11
*** jmasud has quit IRC18:31
*** sshnaidm is now known as sshnaidm|afk18:44
*** dtantsur is now known as dtantsur|afk18:53
rlandywoohoo - https://review.opendev.org/#/c/761463/ going to merge18:56
weshay|ruckyup19:00
weshay|ruckrlandy, it's my understanding.. we'll be back in biz after that merges correct?19:00
rlandyweshay|ruck: ack  - we can change the default if needed19:28
rlandyalso downstream is back19:29
*** Tengu has quit IRC19:31
rlandyshoot ... tripleo-build-containers-centos-7-buildah-train FAILURE in 1h 31m 41s20:03
rlandyweshay|ruck: hey - you around?20:09
weshay|ruckrlandy, aye20:09
rlandylooking at patch priority ...20:10
weshay|ruckk20:10
rlandyhttps://review.opendev.org/#/c/761402/320:10
rlandyfailed20:10
rlandybut20:10
rlandyhttps://review.opendev.org/#/c/761463/ merged20:10
weshay|ruckya.. so it has a default in there.20:10
rlandyso do we need https://review.opendev.org/#/c/761402/3/zuul.d/standalone-jobs.yaml?20:11
weshay|ruckrlandy, 402 failed on c7 so just a ... dang it.. hiccup20:11
rlandyI rechecked20:11
rlandybut that will take a good couple hours20:11
weshay|ruckya20:11
rlandyrechecked https://review.opendev.org/#/c/76113720:11
weshay|ruckrlandy, I think the gate is unblocked but ya.. I think we want that20:12
rlandyweshay|ruck: anything else burning?20:12
rlandy16.2 is looking good20:12
rlandyhttps://review.opendev.org/#/c/760929/ need sto wait for w+20:13
rlandyhttps://d807ec31bfb7941a1c85-03f42126c517788a07591a7a0ae2007c.ssl.cf1.rackcdn.com/757943/20/check/tripleo-ci-centos-8-standalone-on-multinode-ipa/f7f2a80/job-output.txt20:14
rlandywhat is that?20:14
rlandy2020-11-05 19:57:15.039688 | primary | 2020-11-05 19:57:14 | Error: No matching repo to modify: gating-repo.20:15
weshay|ruckhrm20:19
weshay|ruckrlandy, that's one way to check https://opendev.org/openstack/tripleo-ci/src/branch/master/playbooks/tripleo-ci/install-built-repo.yml#L820:21
rlandyI think we just need a rebase there20:52
*** jmasud has joined #oooq20:53
*** jmasud has quit IRC20:59
*** jmasud has joined #oooq21:02
*** jfrancoa has quit IRC21:04
weshay|ruckls21:17
*** jmasud has quit IRC21:17
*** jmasud has joined #oooq21:21
*** matbu has quit IRC21:25
*** jmasud has quit IRC21:26
*** matbu has joined #oooq21:26
*** jmasud has joined #oooq21:50
*** jmasud has quit IRC22:04
*** rh-jelabarre has quit IRC22:22
*** rh-jelabarre has joined #oooq22:22
*** rlandy has quit IRC22:25
*** jmasud has joined #oooq22:30
*** rh-jelabarre has quit IRC23:03
*** jmasud has quit IRC23:16
*** jmasud has joined #oooq23:21
*** TrevorV has quit IRC23:41
*** tosky has quit IRC23:55
*** rfolco has quit IRC23:55

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!