Tuesday, 2021-01-12

*** tosky has quit IRC00:15
*** rlandy has quit IRC00:21
*** jmasud has quit IRC01:57
*** jmasud has joined #oooq02:48
*** dsneddon has quit IRC02:57
*** skramaja has joined #oooq03:13
*** jmasud has quit IRC03:35
*** udesale has joined #oooq04:50
*** pojadhav|away is now known as pojadhav04:51
*** saneax has joined #oooq05:09
*** ykarel has joined #oooq05:23
*** ykarel_ has joined #oooq05:26
*** ykarel has quit IRC05:29
*** jmasud has joined #oooq05:55
*** ratailor has joined #oooq05:56
*** ykarel_ has quit IRC06:01
*** ksambor has quit IRC06:15
*** ykarel has joined #oooq06:20
*** ksambor has joined #oooq06:31
*** marios has joined #oooq06:44
*** jmasud has quit IRC06:55
*** jmasud has joined #oooq06:58
*** amoralej|off is now known as amoralej07:05
*** ykarel_ has joined #oooq07:11
*** ykarel has quit IRC07:12
*** saneax has quit IRC07:37
*** jpena|off is now known as jpena07:46
*** ykarel_ has quit IRC07:55
zbrsshnaidm|ruck: are tripleo-ci-centos-8-undercloud-upgrade-ussuri failures known or fixed?07:55
zbrhttps://review.opendev.org/c/openstack/tripleo-common/+/76959507:55
*** ykarel_ has joined #oooq07:56
zbrthey seem to now have a "stable-failure"07:56
zbri got bored of doing recheck07:56
*** ratailor has quit IRC07:56
*** ratailor has joined #oooq07:56
*** ykarel__ has joined #oooq07:58
*** ykarel__ is now known as ykarel08:01
*** ykarel_ has quit IRC08:01
zbrmarios: sshnaidm|ruck: low hanging: https://review.opendev.org/c/openstack/tripleo-common/+/76954008:02
*** slaweq has joined #oooq08:03
marioszbr: will do08:14
*** tosky has joined #oooq08:22
*** apetrich has joined #oooq08:27
*** jfrancoa has quit IRC08:38
*** jfrancoa has joined #oooq08:41
akahat|roverzbr, hey.. it's not fixed yet.. i'm working on it.08:47
zbrakahat|rover: ahh, good. just ping me when it should work.08:48
zbri wanted to know when is safe to recheck it08:48
*** jfrancoa has quit IRC08:54
*** ysandeep is now known as ysandeep|lunch08:55
*** jfrancoa has joined #oooq08:57
*** jlarriba has joined #oooq09:07
*** jlopezgu has joined #oooq09:08
*** jmasud has quit IRC09:29
*** derekh has joined #oooq09:30
*** amoralej is now known as amoralej|off09:31
*** dtantsur|afk is now known as dtantsur09:42
*** saneax has joined #oooq10:30
*** udesale_ has joined #oooq10:33
*** udesale has quit IRC10:36
*** ysandeep|lunch is now known as ysandeep10:43
*** udesale_ has quit IRC11:42
*** udesale has joined #oooq12:19
*** jlopezgu has quit IRC12:20
*** jpena is now known as jpena|lunch12:25
chandankumarakahat|rover: bhagyashris can we sit today for discussing promoter work?12:36
bhagyashrischandankumar, sure12:36
chandankumarbhagyashris: akahat|rover what about 9 PM IST?12:37
*** ratailor has quit IRC12:40
akahat|roverchandankumar, okay.. that will work.12:48
*** rlandy has joined #oooq12:50
rlandychandankumar: quick review pls https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/77020012:53
*** amoralej|off is now known as amoralej12:54
*** udesale_ has joined #oooq13:01
*** udesale has quit IRC13:04
rlandychandankumar: bhagyashris: pojadhav: marios: ysandeep: weshay|ruck: set out invite for twice weekly dependency pipeline sync meeting13:10
rlandy1/2 hour13:10
rlandyfeel free to propose a new time if that one does not work13:10
chandankumarrlandy: thanks :-)13:10
bhagyashrisrlandy, ack13:10
ysandeeprlandy, this time works for me, thanks!13:11
rlandychandankumar: bhagyashris: also going to send a meeting invite for one hour next week to start on tripleo repos design ...13:11
rlandywill definitely want you guys there13:11
mariosthanks rlandy checking13:11
rlandypls respond if the time does work13:11
rlandymarios: ^^ also fyi wrt tripleo repos design13:12
mariosrlandy: thanks wfm13:12
rlandyPTL requested13:12
mariosrlandy: which patch? 15:12 < rlandy> PTL requested13:12
rlandymarios: on the tripleo repos design meeting13:12
mariosrlandy: ahk13:13
rlandyfrenzy_friday: ^^ fyi - you should also have gotten invite for dependency pipeline sync13:13
rlandyysandeep: hey - are you all set with accessing downstream gerrit?13:14
ysandeeprlandy, yes13:14
rlandywe had some fun working through that last night13:14
sshnaidm|ruckweshay|ruck, do we have a bug about featureset050 failing in periodic? https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-singlenode-featureset050-upgrades-master#13:15
frenzy_fridayrlandy, yep, got it13:15
rlandysshnaidm|ruck: think weshay|ruck is on pto13:15
sshnaidm|ruckrlandy, oh,ok13:15
rlandysshnaidm|ruck: ping me if you want coverage in afternoon13:16
rlandysshnaidm|ruck: there is a bug for fs05013:16
rlandyidk if it's periodic13:16
rlandyhttps://bugs.launchpad.net/tripleo/+bug/191104813:17
openstackLaunchpad bug 1911048 in tripleo "centos-8-scenario000-multinode-oooq-container-upgrades is not using emit releases" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)13:17
rlandy^^ I think that's all that was logged last night13:19
sshnaidm|ruckhmm.. ok, maybe it's the reason13:19
pojadhavrlandy, ack !!13:20
rlandysshnaidm|ruck: yeah - marios -1'ed that review13:20
*** jpena|lunch is now known as jpena13:21
rlandysshnaidm|ruck: but fs050 was nt using emit release before and passing13:21
rlandyso failing is a diff problem13:21
rlandyhttps://bugs.launchpad.net/tripleo/+bug/191102013:21
openstackLaunchpad bug 1911020 in tripleo "Ugrades ussuri jobs fail in CI" [Critical,Triaged]13:21
rlandysshnaidm|ruck: ^^ so I guess just the one you logged13:22
bhagyashrisarxcruz, zbr, sshnaidm|ruck , rlandy, marios, ysandeep, bhagyashris, svyas, soniya29, pojadhav, akahat|rover , weshay|ruck , chandankumar, frenzy_friday13:22
bhagyashrisCommunity call in 8 mins13:22
bhagyashrishttps://hackmd.io/IhMCTNMBSF6xtqiEd9Z0Kw?both#2021-01-12-Community-call13:22
sshnaidm|ruckakahat|rover, https://bugs.launchpad.net/tripleo/+bug/191119413:22
openstackLaunchpad bug 1911194 in tripleo "scenario000 (featureset050) periodic job fails in master because no cloud 'overcloud'" [Critical,Triaged]13:22
bhagyashrishttps://meet.google.com/bqx-xwht-wky?authuser=013:23
akahat|roversshnaidm|ruck, ack13:23
*** rfolco has joined #oooq13:41
ysandeeprlandy, i have a conflict on monday for tripleo-repos mtg with df call(wes/marios also joins that call) , finding a slot which works for all is getting difficult these days except friday..13:56
rlandyysandeep: yep - friday counts sshnaidm|ruck out13:57
rlandyysandeep: how late is not too late for the pune people?13:58
rlandyI can move the meeting - just don't want to keep you all too late13:58
ysandeeprlandy, depends on person to person.. but i am okay till 21:00 local time.. currently its 19:3013:59
ysandeeprlandy, may be we can find a slot on wednesday14:00
rlandyysandeep: k- will look for another slot14:00
*** udesale_ has quit IRC14:10
*** udesale has joined #oooq14:10
rlandyysandeep: looks like we have a scenario004 breakage on 16.2 in component14:28
rlandysee it in tripleo and cinder14:28
rlandywaiting on those two components to promote14:29
ysandeeprlandy, ack, need force promote?14:29
rlandyysandeep: idk - scenario004 failure seems legit - lookinf into it14:29
ysandeepi will check that too after mtg14:31
rlandyysandeep: yeah - also listening now :)14:31
rlandy"Unable to start service ceph-mds@standalone: Job for ceph-mds@standalone.service failed because the control process exited with error code.\\nSee \\\"systemctl status ceph-mds@standalone.service\\\" and \\\"journalctl -xe\\\" for details.\\n\"}",14:33
rlandyceph failure14:33
rlandychecking tripleo one14:33
rlandyperiodic-tripleo-ci-rhel-8-scenario004-standalone-rhos-16.2 passes14:34
rlandyysandeep: ^^ so it's only component14:34
ysandeepdifferent failure on cinder - "Error ENOENT: filesystem 'cephfs' not found\"14:40
ysandeepfailure started today only and sc04 job failed in each component with different failures.14:41
*** TrevorV has joined #oooq14:52
zbrsome reviews on https://github.com/rdo-infra/queries/pull/3 would be appreciated14:58
zbrmarios: sshnaidm|ruck arxcruz ^14:59
akahat|roversshnaidm|ruck, https://meet.google.com/crj-deri-fqn15:06
rlandyysandeep: I am rerunning the tripleo one t see if its reproducible15:06
ysandeeprlandy, ack15:07
rlandythink the cinder one is legit15:07
marioszbr: ack noting15:22
ysandeeprlandy, i will debug that cinder issue.15:38
ysandeepwill check first thing tomorrow's morning.. getting late here15:39
rlandyysandeep: k thanks - the tripleo one is running now15:40
rlandywill see if the rerun reproduces the problem15:40
rlandyneed the upgraded tripleo-ansible in that hash15:40
ysandeepany particular patch you want to see to go through the promotion line15:42
rlandythe one I want is in consistent now15:43
ysandeepk15:43
rlandyoh dear15:43
rlandyhttps://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/stream/2847b5ece88343a7a643cc10b2cc4f87?logfile=console.log15:43
rlandyansible incompatibility15:43
rlandyysandeep: sshnaidm|ruck: akahat|rover: weshay|ruck: just fyi ... hit ansible 2.9.16 incompatibility http://pastebin.test.redhat.com/93068615:46
rlandyjust showed up downstream15:46
rlandy2021-01-12 10:30:17.452095 | primary | + pip_cmd=/usr/bin/pip315:48
rlandy2021-01-12 10:30:17.452108 | primary | + /usr/bin/pip3 install --user dlrnapi-client shyaml15:48
rlandy2021-01-12 10:30:18.126476 | primary | Collecting dlrnapi-client15:48
rlandy2021-01-12 10:30:18.206818 | primary |   Could not find a version that satisfies the requirement dlrnapi-client (from versions: )15:48
rlandy2021-01-12 10:30:18.208747 | primary | No matching distribution found for dlrnapi-client15:48
rlandyand promoted components is dead15:48
*** skramaja has quit IRC15:49
*** udesale has quit IRC16:15
rlandyysandeep: ^^ ok seems like just a hitch - jobs looking better now16:27
ysandeepgreat16:27
rlandyysandeep: yep say a little prayer for the tripleo pipeline16:31
ysandeeprlandy, I will do same for cinder then :D16:32
ysandeeplolz16:32
*** amoralej is now known as amoralej|off16:33
rlandyysandeep: weshay|ruck: if 16.2 pipeline passes, I'd like to promote ... checking jenkins16:35
ysandeepjenkins had issue till yesterday16:35
ysandeepi pinged attila.. he had a patch which looks like fixed the issue16:36
rlandywhich channel16:36
rlandyfollowing16:36
ysandeeprlandy, fixed merged today - https://code.engineering.redhat.com/gerrit/22326816:37
ysandeepwe should be good now16:38
*** sshnaidm|ruck is now known as sshnaidm|afk16:47
rlandyysandeep: thanks - last run looked good - watching this run16:49
*** jfrancoa has quit IRC16:57
*** marios is now known as marios|out16:59
*** jpena is now known as jpena|off17:01
*** ysandeep is now known as ysandeep|away17:01
*** marios|out has quit IRC17:05
*** slaweq has quit IRC17:10
*** jmasud has joined #oooq17:22
rlandyprimary |   "success": true, woohoo17:29
rlandycan promote tripleo component17:29
*** dtantsur is now known as dtantsur|afk17:51
weshay|ruckrfolco, ping17:51
rfolcoweshay|ruck, o/17:52
weshay|ruckrfolco, I also do not have the manage sprints auth17:52
weshay|ruckcan you start sprint 39 for us17:52
weshay|ruckrfolco, any can we see if we can fix this ourselves17:52
rfolcoweshay|ruck, should I start now ?17:52
weshay|ruckrfolco, should we chat real quick?17:53
weshay|ruckbecause I'm not 100% sure17:53
rfolcoweshay|ruck, yep sure17:53
weshay|ruckhttps://meet.google.com/tyo-rdqv-enp17:53
weshay|ruckrfolco, ^17:54
weshay|ruckrfolco, https://projects.engineering.redhat.com/secure/RapidBoard.jspa?rapidView=4285&projectKey=TRIPLEOCI&view=planning&selectedIssue=TRIPLEOCI-277&epics=visible&issueLimit=100&selectedEpic=TRIPLEOCI-26017:56
*** ykarel has quit IRC18:00
weshay|ruckrlandy, fyi https://redhat.service-now.com/surl.do?n=INC158985718:08
rlandyweshay|ruck: ack - thanks18:09
rlandyweshay|ruck: holding 16.2 promotion for attila's job18:11
rlandyfailure on current hash18:11
*** holser has quit IRC19:31
*** holser has joined #oooq19:35
rlandyweshay|ruck: sshnaidm|afk: akahat|rover: I updated the 16.2 info for the program call. will join tomorrow to address any questions there19:35
*** holser has quit IRC19:39
*** holser has joined #oooq19:40
*** jmasud has quit IRC19:41
*** holser has quit IRC19:43
*** holser has joined #oooq19:43
*** slaweq has joined #oooq19:44
*** dsneddon has joined #oooq19:48
*** slaweq has quit IRC20:03
*** arxcruz has quit IRC20:14
*** jmasud has joined #oooq20:35
*** dsneddon has quit IRC20:37
*** dsneddon has joined #oooq20:38
*** derekh has quit IRC20:56
*** TrevorV has quit IRC20:56
*** derekh has joined #oooq20:56
*** jmasud has quit IRC20:57
*** derekh has quit IRC21:05
*** rfolco has quit IRC21:25
*** derekh has joined #oooq21:50
*** derekh has quit IRC21:50
rlandyysandeep|away: hi - when you get in - pls review https://code.engineering.redhat.com/gerrit/#/q/topic:rhel-u-next-pipeline+(status:open+OR+status:merged)22:23
*** jmasud has joined #oooq23:02
*** arxcruz has joined #oooq23:09
*** ChanServ sets mode: +o arxcruz23:11
*** rlandy has quit IRC23:19
*** jmasud has quit IRC23:50

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!