Thursday, 2022-07-28

*** rlandy|bbl is now known as rlandy01:39
*** rlandy is now known as rlandy|out01:39
*** ysandeep|out is now known as ysandeep05:28
*** pojadhav- is now known as pojadhav05:30
bhagyashrisysandeep, hey we need +W on https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/41145805:56
ysandeepbhagyashris, yes its on top of my review list for today.05:57
bhagyashrisysandeep, and one more https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/402101 :)06:02
ysandeepbhagyashris, there are few comments from rlandy|out on that, Have you already checked those?06:03
*** ysandeep is now known as ysandeep|brb06:03
bhagyashrisyes rlandy|out just replied to chandankumar comment06:03
bhagyashrisysandeep|brb, we can't separate out the required-projects:06:06
bhagyashris and roles from job def. because if we separate out from job def then it's giving me the zuul config error if you remembered i pinged you for the same and you said keep the require_project in job def06:06
*** ysandeep|brb is now known as ysandeep06:36
ysandeepmarios: fyi.. https://bugs.launchpad.net/tripleo/+bug/198300406:46
mariosysandeep: thanks will check.. .far as i can see it is only on that review though 06:46
mariosah there are more now... 06:47
jm1o/06:54
jm1hey ysandeep, we could do a virtual ptg in the street right in front of your house 😁 https://www.nasdaq.com/articles/google-maps-launches-street-view-in-india-after-11-year-wait06:55
ysandeepjm1: good morning o/ Nice06:59
*** amoralej|off is now known as amoralej07:11
*** pojadhav- is now known as pojadhav07:15
marioslaunchpad slow for others too or just here? 07:15
ysandeepmarios, launchpad is slow for me as well07:22
ysandeepbhagyashris, merged sc10/12 patch, left comment on the other patch: https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/402101/37#message-dc45ee231606d6617d5516cefbf960ad3a957912 07:22
bhagyashrisack07:24
mariosthanks ysandeep 07:31
*** jpena|off is now known as jpena07:38
frenzy_fridayhey, are there known tempest failures in periodic-tripleo-ci-rhel-9-ovb-3ctlr_1comp-featureset035-internal-rhos-17 ?07:38
bhagyashrisysandeep, Done https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/40210107:40
ysandeepbhagyashris, lets recheck testproject for ipa jobs as we made changes in vars - to confirm all okay now.07:42
bhagyashrisok let me change the .zuul.yzml currently it contains only the ipa jobs07:43
ysandeepbhagyashris++ thanks, I can revisit in my next review cycle.07:44
*** jpodivin_ is now known as jpodivin08:37
*** ysandeep is now known as ysandeep|lunch10:21
chandankumarcan anyone access this content? https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/roles/ovb-manage/tasks/find_undercloud_uuid.yml#L1410:29
chandankumarcurl http://169.254.169.254/openstack/latest/meta_data.json 2>/dev/null10:29
marioschandankumar: yea opens here fine10:30
marioschandankumar: please vote? https://review.opendev.org/c/openstack/python-tripleoclient/+/851350 10:30
chandankumarmarios: 169.254.169.254/openstack/latest/meta_data.json this one?10:30
marioschandankumar: ah i thought you meant did the url open :) 10:31
chandankumarI am trying to run ovb-manage role locally to reproduce stack creation issue on ibm cloud10:31
chandankumarcurl is returning 28 exit status10:33
marioschandankumar: that would be from the metadata service so dont have locally 10:34
chandankumarah you are correct, nver thought about that10:34
chandankumarmarios: thank you :-)10:34
*** rlandy|out is now known as rlandy10:38
rlandyarxcruz|rover: akahat|ruck: hey - how are things10:41
rlandyarxcruz|rover: akahat|ruck: let's sync when you are around10:41
arxcruz|roverrlandy stable i would say 10:41
arxcruz|roveri'm around 10:41
arxcruz|roverjust need to grab a coffee 10:41
rlandyarxcruz|rover: k - pls ping when ready - also waiting for akahat|ruck 10:42
akahat|ruckrlandy, o/ 10:42
akahat|ruckrlandy, CI is good10:43
rlandyakahat|ruck: hi!10:43
akahat|ruckI'm here.. waiting for arxcruz|rover 10:43
rlandyok - arxcruz|rover pls ping when ready10:43
rlandyand we'll meet10:43
rlandychandankumar: hello .. pls check ci-config10:43
rlandyyour keys in our krys file there got messed up10:44
rlandyI need to add your keys to the ibm cloud executor10:44
arxcruz|roverrlandy akahat|ruck i'm10:45
arxcruz|roveri'm ready 10:45
chandankumarrlandy: yes, thanks for adding my github keys10:46
chandankumarrlandy: I will clean that up10:46
rlandyhttps://meet.google.com/dkt-hbvu-pkj?pli=1&authuser=010:46
rlandyarxcruz|rover: akahat|ruck: ^^10:46
*** ysandeep|lunch is now known as ysandeep10:58
* ysandeep may be in/out on network - Heavy rainfall in my area.10:58
arxcruz|roverrlandy https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/4425611:10
rlandyarxcruz|rover: thanks - w+'ed11:11
arxcruz|roverrlandy ops, wrong patch11:11
arxcruz|rovermy bad11:11
rlandyhttps://review.rdoproject.org/r/c/rdo-infra/ci-config/+/44256?11:11
rlandyarxcruz|rover: why?11:11
rlandyshould I un'w+?11:11
arxcruz|roverrlandy yes, i'll write a new patch, i mess with the branches 11:11
arxcruz|roveron my side :)11:11
arxcruz|roverrlandy https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/4425711:13
akahat|ruckhttps://code.engineering.redhat.com/gerrit/c/testproject/+/30091311:16
akahat|ruckrlandy, jobs are re-running ^^11:16
rlandyakahat|ruck: thank you11:18
rlandyarxcruz|rover: thanks11:18
* akahat|ruck offline11:22
*** dviroel|afk is now known as dviroel11:31
rlandyysandeep: dviroel: do you want the friday operator CI meeting this week?12:18
rlandyneed to connect with someone on a topic?12:18
ysandeeprlandy, I don't think so we need another mtg this week, dviroel and me are in sync.. chatting regularly via irc/gmeet12:19
dviroelrlandy: I don't think so12:19
rlandyysandeep: dviroel: great - we'll skip12:20
dviroelack - tks12:22
soniya29marios, can you have a look over this patch:- https://review.opendev.org/c/openstack/tripleo-quickstart/+/844453?12:43
soniya29whenever you have time12:43
mariossoniya29: o/ hi i already voted on that earlier 12:44
marioslooking 12:44
*** amoralej is now known as amoralej|lunch12:45
rlandyfrenzy_friday: bhagyashris; hey12:45
mariossoniya29: oh i checked the depends-on but... it has workflow so what do you need? the zuul error?12:45
rlandyfrenzy_friday: bhagyashris: iiuc, you are not getting any new content to 17.112:46
soniya29marios, yeah12:46
rlandyfrenzy_friday: bhagyashris: pls add the promote jobs to the component line12:46
rlandyand empty criteria12:46
rlandyand the promote jobs to the promote-component line12:46
rlandywe can meet with CRE team next week 12:46
frenzy_fridayrlandy, ack12:47
bhagyashrisrlandy, ack12:48
mariossoniya29: https://review.opendev.org/c/openstack/tripleo-quickstart/+/844453/4#message-72eb3dec6cf49e73591768f72f761a44a0d49e4212:48
mariossoniya29: so maybe doing the depends-on 'manually' will workf12:49
rlandyfrenzy_friday: bhagyashris: thanks - pls pass me those reviews once you have them12:49
reviewbotDo you want me to add your patch to the Review list? Please type something like add to review list <your_patch> so that I can understand. Thanks.12:49
mariossoniya29: not sure you want to change the zuul queue in openstack-tempest-skiplist to be tripleo since in theory could be used by others... however in practice it will be only tripleo really so that way may also work 12:49
rlandyyou may fail on ceph12:49
rlandytrying to figure that out now with the storage team12:49
*** ysandeep is now known as ysandeep|afk12:53
soniya29marios, i will try doing manually12:55
*** dasm|off is now known as dasm12:57
dasmo/12:57
rlandyarxcruz|rover: bunch of post failures in gate13:00
bhagyashrisfrenzy_friday, rlandy jm1 chandankumar soniya29 13:00
bhagyashrisscrum time13:00
soniya29bhagyashris, i am in13:01
arxcruz|roverrlandy i'll check with infra, because it's not only our tripleo jobs, but python jobs as well13:03
rlandyarxcruz|rover: ack - pls ask on #opendev13:03
rlandyit's all over13:03
dasmysandeep|afk: I ran test with arguments provided by you:  https://paste.openstack.org/show/bMyxGXtssP5HAb3kaxgH/13:14
dasmit took real 0m17.226s13:14
*** ysandeep|afk is now known as ysandeep13:15
ysandeepdasm, true it depends on local machine/network.. may be you are closer to logserver.rdoproject.org13:16
ysandeepfor me it was never less than 1 min 10 s - I did more than 5 tests13:17
dasmysandeep: probably that's the case. I see I'm fetching logs with reason, starting: 2022-07-28 06:10:30 and ending 2022-07-28 06:10:3613:17
dasmwhich was 6 secs, about 1s per job13:17
dasmysandeep: i tried to use zuul for fetching failure reason. Do you have an idea how those are created?13:18
dasmysandeep: that would allow us to completely ditch fetching logs from the server13:18
ysandeepsova queries13:18
dasmysandeep: i noticed when we have "Tempest failure" in log, there is "N/A" in zuul13:19
dasmi did that just for couple jobs13:19
ysandeepdasm, frenzy_friday can probably give you more details on how we create https://logserver.rdoproject.org/openstack-component-common/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-undercloud-upgrade-common-master/627b998/logs/_No_failure_reason_found.log 13:20
ysandeepdasm, but afaik.. these are not populated back to zuul but I may be wrong.13:20
dasmysandeep: atm all jobs return "null" for error_reason: curl https://review.rdoproject.org/zuul/api/builds?pipeline=openstack-periodic-integration-stable1-cs8 | jq .[].error_detail13:24
ysandeepYes zuul error and the error file we create via sova are different things, I am not sure what zuul error_detail meant for .. May be someone from infra can give details13:26
rlandyarxcruz|rover: train promoted - master not so much??13:26
arxcruz|roverrlandy yeah, i think it ran before the merge because i'm running rr script and it's saying it's ready to promote 13:27
rlandyok13:27
arxcruz|roverrlandy the post_failure infra is already aware and working on that, it was a ssl certificate issue 13:27
rlandyyep - thanks13:27
dasmftr, ovb master patch: https://review.rdoproject.org/r/c/rdo-jobs/+/4415313:29
dasmysandeep: btw, what's sova?13:30
*** amoralej|lunch is now known as amoralej13:37
arxcruz|roverdasm tool that check the root cause of the failure and generate some report for us13:39
arxcruz|roveriirc 13:39
arxcruz|roverit also works together with openstack-health (tripleo one)13:39
dasmarxcruz|rover: i tried searching for it, it returned me bunch of self-tests for psychology13:40
dasmso i assumed, those are not the same ^^13:40
arxcruz|roverdasm well, sometimes it can affect your psych xD13:40
dasm:P13:40
bhagyashrishttps://review.opendev.org/c/opendev/base-jobs/+/85140413:49
ysandeepdasm: basically somes regex that check in logs what issues we hit.. 13:51
ysandeepdasm, https://opendev.org/openstack/tripleo-ci-health-queries/src/branch/master/output/sova-pattern-generated.json13:52
dasmack13:52
jm1chandankumar, rlandy: this patch cleaned up the ssh keys. but it looks as if chandankumar has not ben there before?!? https://github.com/rdo-infra/ci-config/commit/d45ad36583f0852b7ce7e8c43f830b79a651fef013:57
frenzy_fridaybhagyashris, I will ping you when I am back tomorrow. dviroel thanks for covering tomorrow14:05
bhagyashrisfrenzy_friday, ack14:05
jm1chandankumar: i removed your key on 01.03. 😬 https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3997114:05
jm1chandankumar: will add it again14:05
chandankumarjm1: thanks, I am updating the keys14:06
chandankumarwill send the patch soon14:06
chandankumarjm1: thank you for finding that :-)14:07
chandankumarbhagyashris: frenzy_friday can you check <odyssey4me> question regarding rhos-17.1 line14:07
chandankumaron #rhos-ops14:07
chandankumarwhen free, thanks :-)14:07
frenzy_fridayrlandy, yep periodic-tripleo-build-containers-ubi-9-internal-rhel-9-build-push-upload-rhos-17.1is failing in RUN dnf -y install cephadm14:12
frenzy_fridayit is using "ceph-5.1 -r 9.0" What should I change it to?14:12
rlandyfrenzy_friday: hold on that pls14:14
rlandygetting confirmation from fultonj14:14
frenzy_fridayack14:14
* frenzy_friday lunch14:14
jm1chandankumar: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/4426114:37
jm1rlandy: ^14:38
chandankumarjm1++ thank you mate :-)14:42
rlandyjm1: thanks14:42
rlandychandankumar: pls check your keys and I will w+14:42
chandankumarlooks good14:43
chandankumarjust checked14:43
jm1chandankumar: at the next opportunity you have to tell us the story how you got to your rh nick raukadah ^^14:44
*** ysandeep is now known as ysandeep|out14:50
chandankumarjm1: sure14:53
chandankumarsee ya!14:54
jm1chandankumar: have a nice evening :)14:54
* ysandeep|out out, see you all tomorrow o/14:56
chandankumar#oooq, If you want to try ansible-runner on cs9, here is the images I have built https://quay.io/organization/tripleoansible 15:05
chandankumarofficial images are based on cs815:05
rlandyarxcruz|rover: hmm - still no master promo 15:14
* jm1 bbl15:16
arxcruz|roverrlandy it says         - periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-master: is missing 15:16
arxcruz|roverrlandy i put it to run now on testproject, weirdly, rr script doesn't show this on the testproject output 15:17
rlandybc it15:24
rlandyis skipped15:24
rlandyno in crietria15:24
frenzy_fridaypls add to review list https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/42187615:51
reviewbotI have added your review to the Review list15:51
frenzy_fridaypls add to review list https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/42187715:56
reviewbotI have added your review to the Review list15:56
*** marios is now known as marios|out16:00
frenzy_fridayrlandy, I added the ceph 5.2 for 17.1 patches to reviewlist16:05
arxcruz|roverrlandy master is promoting 16:21
rlandyarxcruz|rover++ thank you16:21
arxcruz|rover\o/16:21
arxcruz|roverfrenzy_friday you're welcome :P16:21
arxcruz|roverrlandy https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/44104 the revert patch16:22
arxcruz|roveronce it finishes promoting16:22
rlandyok16:27
*** amoralej is now known as amoralej|off16:37
rlandyfrenzy_friday: arxcruz|rover: akahat|ruck: bhagyashris: ttps://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/851438 Skip swift tests - failing with latest ceph 16:52
frenzy_fridayarxcruz|rover, :D less work for me, thank you :D16:55
rlandylunch brb17:06
arxcruz|roverrlandy https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/44104 can be merged17:28
* dasm is going stretch his legs17:29
*** jpena is now known as jpena|off17:31
rlandyarxcruz|rover++ thanks - merged17:49
rlandyarxcruz|rover: https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-8-9-multinode-mixed-os&skip=017:52
rlandypls ping marios about that tomorrow17:52
rlandyfailing gate17:52
arxcruz|roverrlandy https://bugs.launchpad.net/tripleo/+bug/198300417:52
rlandyok - I see18:02
rcastillolunch brb18:04
dasmback18:58
rlandyrcastillo: dviroel: review time?19:00
dviroelyeah19:01
rlandyarxcruz|rover: bhagyashris: pls see all failing check ovb jobs: https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001&skip=019:24
rlandyfailing node provision19:25
dviroelrlandy: https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/851438/3/roles/validate-tempest/vars/tempest_skip.yml#129020:15
dviroelfailing on validate20:15
*** dviroel is now known as dviroel|afk20:24
rcastilloif I'm holding a node on downstream, should it have my key?21:21
rlandyrcastillo: a periodic job, yes21:30
rlandydviroel|afk: thanks  - updated21:31
rcastillorlandy: ack21:33
* dasm => offline21:47
dasmo/21:47
*** dasm is now known as dasm|off21:47
*** rlandy is now known as rlandy|out21:51

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!