Wednesday, 2021-01-06

*** holser has joined #oooq00:00
*** jmasud has joined #oooq00:06
*** jmasud has quit IRC00:16
*** jmasud has joined #oooq00:16
*** jmasud has quit IRC00:20
*** tosky has quit IRC00:23
*** jmasud has joined #oooq00:48
*** holser has quit IRC00:56
*** holser has joined #oooq00:57
*** holser has quit IRC01:08
*** sanjayu_ has joined #oooq01:08
*** jmasud has quit IRC01:21
*** jmasud has joined #oooq01:21
*** jmasud has quit IRC01:29
*** jmasud has joined #oooq01:30
*** rlandy has quit IRC01:31
*** jmasud has joined #oooq01:53
*** jmasud has quit IRC02:05
*** jmasud has joined #oooq02:10
*** sanjayu_ has quit IRC02:35
*** jmasud has quit IRC02:36
*** ysandeep|away is now known as ysandeep03:47
*** skramaja has joined #oooq04:37
*** ratailor has joined #oooq04:40
*** ykarel has joined #oooq04:53
*** udesale has joined #oooq05:00
*** jmasud has joined #oooq05:31
*** sanjayu_ has joined #oooq06:32
*** skramaja has quit IRC06:37
*** skramaja_ has joined #oooq06:37
*** marios has joined #oooq06:57
*** jmasud has quit IRC07:02
marioszuul.openstack down looks like08:11
mariosaaaand its back08:15
*** skramaja_ is now known as skramaja08:19
soniya29kopecmartin, arxcruz, bhagyashris, pojadhav, Do you anything to discuss in today's tempest meeting?08:45
*** ysandeep is now known as ysandeep|lunch08:46
*** ysandeep|lunch is now known as ysandeep09:40
pojadhav|roversoniya29, nope :)09:43
arxcruzsoniya29: nope09:43
*** derekh has joined #oooq09:48
ysandeepbhagyashris, do we have retro today?10:23
bhagyashrisysandeep, no10:23
bhagyashrissoniya29, nope10:24
ysandeepbhagyashris, is retro planned for tomorrow ?10:24
ysandeepor its next week?10:25
bhagyashrisysandeep, no, there will be no retro meeting this sprint . we will have direct planing meeting10:25
ysandeepbhagyashris, ack thank you!10:25
mariosbhagyashris: planning meeting today or tomorrow?10:28
mariosbhagyashris: can't see a calendar event10:28
mariosysandeep: we had a retro before christmas10:29
ysandeepmarios: thanks, now i recall :D10:33
*** dtantsur|afk is now known as dtantsur10:35
bhagyashrismarios, tomorrow10:36
mariosbhagyashris: thanks10:37
bhagyashrismarios, i will send invite to all by EOD10:38
mariosthanks bhagyashris10:41
*** rfolco has joined #oooq10:43
soniya29kopecmartin, arxcruz, bhagyashris, pojadhav, chandankumar, weshay|ruck, akahat, so let's cancel the meeting for today10:44
pojadhav|roversoniya29, ack10:45
* pojadhav|rover brb10:45
chandankumarsoniya29: ack10:46
*** jmasud has joined #oooq10:46
*** udesale_ has joined #oooq10:54
*** udesale has quit IRC10:57
ysandeepzbr, Hi, I am trying to setup gri tool.. but i am hitting an authentication issue.11:21
ysandeep~~~11:21
ysandeepERROR    401 Client Error: Unauthorized for url: https://review.rdoproject.org/r/a/changes/?q=reviewer:self+status:open&o=LABELS&o=COMMIT_FOOTERS11:21
ysandeep~~~11:21
ysandeepI don't have direct login credentials for review.rdoproject.org, I login in with github.. Is there a way to login redirecting with github when using gri/.netrc file?11:21
arxcruzysandeep: sec, i know the problem11:42
arxcruzysandeep: https://review.rdoproject.org/sf/user_settings.html11:42
arxcruzysandeep: there's an API key11:43
arxcruzuse that11:43
ysandeeparxcruz++ savior11:43
arxcruz;)11:44
zbrysandeep: yes, a line that looks like: machine api.github.com login ssbarnea password <TOKEN>11:46
zbrthere is no real password, only tokens, for both gerrit and github.11:47
ysandeeparxcruz, zbr, thank you! it worked :D11:47
zbri am glad to see others than weshay|ruck trying the tool.11:48
ysandeepzbr, thanks for the great effort in writing this tool :D11:49
zbrusually I disable the github integration as it is much slower than gerrit, but for gerrit is f... fast.11:49
bhagyashriszbr, i have added the enable pylint stuff here https://hackmd.io/8339lqSwSEeXxuk0LfxCwA#Other-items-discussed-and-in-the-background plz update if you have more updates on it11:50
* ysandeep looking where we can generate token in opendev11:53
* ysandeep found it - HTTP Credentials - "GENERATE NEW PASSWORD"12:01
*** ratailor has quit IRC12:14
*** tosky has joined #oooq12:15
*** jmasud has quit IRC12:17
*** rlandy has joined #oooq12:53
rlandybhagyashris: hi - do we have a sprint/planning meeting today? I see one for tomorrow12:54
bhagyashrisrlandy, no we dont have planning meeting today we have tomorrow and fllow up meeting on 11th Jan12:55
rlandybhagyashris: k - thanks12:55
bhagyashrisi will sent meeting invite soon by my EOD12:55
*** ysandeep is now known as ysandeep|afk12:57
pojadhav|rover weshay|ruck, 0/12:58
weshay|ruckhey pojadhav|rover how you feeling12:58
pojadhav|roverfeeling good now12:58
pojadhav|roverweshay|ruck, want discuss about the yatin's comment : https://review.opendev.org/c/openstack/tripleo-ci/+/765297/1/zuul.d/multinode-jobs.yaml12:59
pojadhav|roverHe is asking about the plan for this change12:59
rlandyweshay|ruck: we had the first run of the train/ussuri/victoria branches on centos8 stream: https://review.rdoproject.org/zuul/builds?pipeline=openstack-dependencies-centos8stream13:00
weshay|ruckpojadhav|rover, /me reads13:00
pojadhav|roverweshay|ruck, ack13:00
weshay|ruckrlandy, aye.. so train/ussuri .. let's highlight it at prod-chain and see how folks want us to handle that.. I suspect missing backports13:01
weshay|ruckzbr, what are you doing on this call?13:01
weshay|ruckit's the worst mtg ever13:02
weshay|ruckrlandy, 2021-01-05 20:08:03.583109 | primary | time="2021-01-05T20:08:03Z" level=error msg="CNI network \"podman\" not found"13:03
weshay|ruck ?13:03
weshay|ruckthat's odd13:03
mariosrfolco: zbr: rlandy: weshay|ruck: please check when you have time and let's merge? https://review.opendev.org/c/openstack/tripleo-ci/+/76118813:03
rlandyweshay|ruck: we've seen that before13:03
weshay|ruckmarios, ack to merge from me13:04
rlandymarios: ack - merging that13:04
mariosthanks rlandy weshay|ruck13:04
rlandyweshay|ruck: need to look back at where we dealt with that error before13:04
weshay|ruckpojadhav|rover, /me reading13:08
pojadhav|roverok13:08
*** ysandeep|afk is now known as ysandeep13:33
rlandysshnaidm: what happened with the 16.1 tempest error?13:48
sshnaidmrlandy, I think it's the same..?13:48
sshnaidmLast run failed bc of same error13:49
rlandysshnaidm: yep - we were going to escalate13:49
rlandyerror happened even with selinux set to permissive13:49
arxcruzchandankumar: weshay|ruck i'm taking a look now on https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/74650913:50
arxcruzthe os_tempest everywhere13:50
chandankumararxcruz: ok thanks!13:50
sshnaidmrlandy, yep13:51
sshnaidmrlandy, how do we escalate it?13:51
rlandysshnaidm: BZ13:52
rlandywe can run it by QE also and see how their jobs are working13:53
sshnaidmacl13:56
sshnaidmack13:56
weshay|ruckakahat, can start early.. I'm in13:57
akahatweshay|ruck, joining.13:57
weshay|ruckrfolco, can you add ur awesome report to internal container builds.. rlandy can point you at the jobs14:28
rlandyack14:28
*** TrevorV has joined #oooq14:37
*** holser has joined #oooq14:41
sshnaidmweshay|ruck, logstash: http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22at%20destination%3A%20failed%20to%20read%20from%20destination%20repository%5C%2214:46
*** skramaja has quit IRC15:19
*** derekh has quit IRC15:27
*** spotz has quit IRC15:44
weshay|rucksshnaidm, 0/ hey you have a quick second.. /me needs to run something by you re: sova15:52
sshnaidmweshay|ruck, 5 min15:55
weshay|ruckk15:55
sshnaidmweshay|ruck, ready15:59
weshay|rucksshnaidm, https://meet.google.com/nhh-ojad-sqq?authuser=115:59
rlandysshnaidm: this is the train backport we need for container builds in standalone? https://review.opendev.org/c/openstack/tripleo-ansible/+/76936416:18
rlandyI checked the version of tripleo-ansible16:18
rlandyit's correct16:18
sshnaidmrlandy, yep16:18
sshnaidmrlandy, then I don't understand how the master code got there.. ¯\_(ツ)_/¯16:19
rlandysneaky master16:21
rlandysshnaidm: ok - so I need a downstream backport of that when it merges in train16:22
sshnaidmrlandy, yeah, there is a dependency on https://review.opendev.org/c/openstack/tripleo-ansible/+/76947816:23
sshnaidmit fixes some job in train to get the backport in16:24
weshay|ruckrfolco, you there?16:26
*** ykarel has quit IRC16:30
rfolcoweshay|ruck, sorry, was on meeting when you pinged me earlier, still out on lunch prep as my wife is nursing in-law at the hospital.16:38
weshay|ruckrfolco, np.. oy16:39
rfolcoweshay|ruck, I can try adding to internal jobs, but still did not fix the log issue for ussuri and train16:39
weshay|ruckrfolco, would it be possible to get the container build reports added to the internal container builds for 16.2 and 17?16:39
rfolcoweshay|ruck, will try16:40
weshay|ruckrfolco, k.. ping if you want extra eyes on the log issue16:40
rfolcoweshay|ruck, k will ping you soon16:40
weshay|ruckthanks16:46
*** ysandeep is now known as ysandeep|away16:56
*** marios is now known as marios|out16:57
*** marios|out has quit IRC17:00
*** udesale_ has quit IRC17:04
*** jmasud has joined #oooq17:26
rlandyweshay|ruck: 1-on1?17:31
weshay|ruckaye17:31
*** holser has quit IRC18:12
rfolcoweshay|ruck, need more eyes on the log issue18:15
weshay|ruckk.. chatting w/ rlandy .. will be there soon18:19
*** dtantsur is now known as dtantsur|afk18:27
weshay|ruckrfolco, ok18:47
weshay|rucklet's have a look18:48
weshay|ruckrfolco, https://meet.google.com/zsp-cuhe-eku?authuser=118:48
rfolcohttps://review.opendev.org/c/openstack/tripleo-ci/+/76759118:49
weshay|ruckrfolco,  http://git.app.eng.bos.redhat.com/git/openstack/tripleo-ci-internal-config.git/ http://git.app.eng.bos.redhat.com/git/openstack/tripleo-ci-internal-jobs.git/19:18
weshay|ruckrfolco, http://git.app.eng.bos.redhat.com/git/openstack/tripleo-ci-internal-jobs.git/tree/zuul.d/tripleo-build-containers.yaml19:20
*** holser has joined #oooq19:27
*** sanjayu_ has quit IRC19:33
*** holser has quit IRC19:46
rfolcoweshay|ruck, I have tested build-report w/ 16.2 already --> https://sf.hosted.upshift.rdu2.redhat.com/logs/52/221752/1/check/tripleo-build-containers-ubi-8-internal-rhel-8-rhos-16.2/364933a/logs/report.html20:05
rfolcowill see why 17 did not run, but it should work (no effort needed)20:05
rfolcoweshay|ruck, my memory is a POS20:05
weshay|ruckrfolco, hey20:21
* weshay|ruck reads20:21
rfolcoweshay|ruck, report should be working without any change... I am running a test here https://code.engineering.redhat.com/gerrit/#/c/221752/20:23
weshay|ruckOH.. maybe I was just looking in the wrong place20:23
weshay|ruckrfolco, duh.. ya20:24
weshay|ruckhttps://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-rhos-17/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-build-containers-ubi-8-internal-rhel-8-build-push-upload-rhos-17/a4f785a/logs/report.html20:24
weshay|ruckrfolco++20:24
weshay|ruckdone and done20:24
rfolconutz20:24
weshay|rucklog?20:24
rfolcothe log ... yeah...20:25
rfolcoworking on it20:25
weshay|ruck:)20:26
rfolcoweshay|ruck, do you know which role is that https://github.com/openstack/tripleo-quickstart-extras/blob/master/playbooks/collect-logs.yml#L2120:36
weshay|rucksec.. at the car shop.. I think they block some sites20:37
weshay|ruckjebus20:37
weshay|ruckrfolco, that's ansible-role-collect-logs20:39
rfolcoweshay|ruck, hmm iof I just could blacklist worskpace/logs/container-builds from that role, I think it would fix it20:40
weshay|ruckrfolco, go for it20:41
weshay|ruckrfolco, add me, sagi as a reviewer20:41
rfolcook ... its an idea, I don't know how to do it lol20:41
rfolcok20:41
weshay|ruckrfolco, so when the container fails.. is ther ALWAYS a log.. there may not be...20:43
weshay|ruckhttps://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-rhos-17/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-build-containers-ubi-8-internal-rhel-8-build-push-upload-rhos-17/a4f785a/logs/report.html20:43
weshay|ruckand that's master equiv20:44
*** jmasud has quit IRC20:45
rfolcoweshay|ruck, it's a bug :(20:46
weshay|ruckrfolco, in containers-build or ci?20:46
rfolcoweshay|ruck, in the report code20:46
rfolcoweshay|ruck, the logs are there I assume? let me check20:46
weshay|ruckno20:46
weshay|ruckI don't think so20:46
weshay|ruckcheck it out20:47
rfolcooh no20:47
rfolcoits working as designed20:47
rfolcono logs for failed ones20:47
rfolco\o/20:47
rfolcobuild.log is not very verbose20:50
rfolconeeds improvements long term I guess20:50
weshay|ruckright20:54
weshay|ruck:)20:54
weshay|ruckrfolco, /me wonders what stops the build attempt20:55
weshay|ruckwould think it would come up as skipped20:55
weshay|ruckif there is no log20:55
weshay|ruckmeh20:55
weshay|ruckrlandy, you still around by chance?20:55
rfolcodon't hide crime evidences20:56
weshay|ruckheh20:56
rlandyweshay|ruck: ack - around until 6:30pm20:56
rlandynot protesting at the capital if that if what you are asking20:56
weshay|ruckrlandy, bah.. I'm at the car shop.. my email is blocked...  can you cix / email rhos-dev w/ https://bugzilla.redhat.com/show_bug.cgi?id=1913475 https://bugzilla.redhat.com/show_bug.cgi?id=1913476 please20:56
openstackbugzilla.redhat.com bug 1913475 in openstack-dashboard-theme "openstack-dashboard fails to install and build horizon container" [Urgent,New] - Assigned to rhos-maint20:56
openstackbugzilla.redhat.com bug 1913476 in ceph "cephadm is not built for osp-17" [Urgent,New] - Assigned to gfidente20:56
rlandyweshay|ruck: ack20:57
weshay|ruckthank you!!20:57
*** jmasud has joined #oooq20:58
weshay|ruckrlandy, btw.. pita here.. it's possible we could promote 16.2 we have 1 tempest failure in integration.. fs020 but standalone passed.. and 1 tempest failure in infrared  both in 16.2 integration21:00
weshay|ruckmay be worth emailing ysandeep, attila to see if they would like to waive and promote vs... hold21:01
weshay|ruckman.. a manager w/ blocked email is useless21:01
rlandyweshay|ruck: CIX email sent21:02
weshay|ruckthank you :)21:02
rlandyweshay|ruck: emailing sandeep and attila21:03
rlandylooks close to promoting21:03
weshay|ruckdang.. drive is blocked too... I'm on the vpn.. this is weird21:03
weshay|ruckrlandy, ya.. just 1 tempest test.. in tripleo-ci / infrared each21:04
weshay|ruckprobably worth promoting21:04
rlandyweshay|ruck: ok- we can promote it tomorrow21:04
weshay|ruck++21:04
rlandyworth rerunning?21:04
rlandyfs02021:04
weshay|ruckperhaps..21:05
weshay|ruckrlandy, it worked here https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-16.2/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-standalone-full-tempest-scenario-rhos-16.2/5f5ae09/logs/undercloud/var/log/tempest/stestr_results.html21:06
weshay|ruckbut failed in 02021:06
weshay|ruckso... meh21:06
rlandyweshay|ruck: k - so I'll rerun21:07
weshay|ruckI think we can just waive.. more concenred w/ the one failing test in the infrared job21:07
rlandyif no joy by eod, will email21:07
weshay|ruckactually21:07
rlandyor we can waive21:07
weshay|rucklet me look at criteria21:07
rlandyweshay|ruck: can you reach the criteria?21:07
* rlandy can copy21:07
weshay|ruckrlandy, http://git.app.eng.bos.redhat.com/git/tripleo-environments.git/tree/ci-scripts/dlrnapi_promoter/config/RedHat-8/rhos-16.2.ini#n2121:08
weshay|ruckrlandy, they only have the one job21:08
weshay|ruckso..21:08
weshay|ruckheh.. and fs020 is not in it21:08
rlandyweshay|ruck: right21:08
weshay|rucklet's promote.. and then i'll adjust critiera21:08
rlandybut that is just the last time we update21:08
rlandyweshay|ruck: k - I'll promote21:08
rlandyand rerun21:09
weshay|ruckk21:09
*** holser has joined #oooq21:09
weshay|ruckthanks21:09
rlandynp - how's the car?21:09
weshay|ruckmeh.. cars are expensive21:11
rlandyweshay|ruck: k - on your tmux on the promoter21:11
weshay|ruck++21:11
rlandybash -x wes-promote-rhos-16.2.sh in action21:11
weshay|ruckdon't tell everyone our secrets :)21:11
weshay|ruckwes_rlandy_promoter.sh21:11
rlandyI don't think anyone else cares21:12
weshay|ruckTRUE21:12
rlandybut we care21:12
rlandyand that's important :)21:12
weshay|ruckWE CARE ABOUT THIS WORLD!!!21:12
* rlandy reruns fs020 in case21:13
weshay|ruckthat test can be flaky21:13
weshay|ruckthey do have the BEST cheesy music here21:13
weshay|ruckhuey lewis rockin21:14
rlandyhttps://code.engineering.redhat.com/gerrit/#/c/207510/21:14
rlandyrerun21:14
rlandyweshay|ruck: k - all done - need anything else?21:15
weshay|ruckI have coffee, hewie lewis.. I'm great :)21:16
weshay|rucklolz21:16
* weshay|ruck runs21:16
weshay|ruckthanks for the help21:16
rlandysure21:16
*** jmasud has quit IRC21:19
*** jmasud has joined #oooq21:21
*** TrevorV has quit IRC21:50
rlandyweshay|ruck: still at car shop?22:17
rlandyhttps://review.opendev.org/c/openstack/tripleo-ansible/+/76958122:17
rlandytripleo-ansible-centos-8-molecule-tripleo_podman https://zuul.opendev.org/t/openstack/build/4bff2d7ada6149e88b8f3f50eca984e3 : FAILURE in 10m 13s22:17
rlandythat test hasn't passed in ages22:18
rlandydo we own it?22:18
*** holser has quit IRC22:18
rlandysshnaidm: ^^ ci owns this or df?22:19
sshnaidmdf22:20
rlandyok - will ping tomorrow22:22
rlandylate for everyone22:22
*** jmasud has quit IRC22:41
*** holser has joined #oooq22:44
*** rfolco has quit IRC22:50
weshay|ruckrlandy, ya22:56
*** jmasud has joined #oooq22:57
*** rlandy has quit IRC23:20
*** jmasud has quit IRC23:49
*** jmasud has joined #oooq23:51
*** tosky has quit IRC23:51

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!