Monday, 2022-10-31

*** khomesh|away is now known as khomesh04:27
*** ysandeep|PTO is now known as ysandeep05:17
*** amoralej|off is now known as amoralej06:59
marioso/07:16
ysandeephello marios \o07:32
marioso/ ysandeep 07:33
ysandeepChannel was quite this morning maybe because daylight saving ended and emea folks will join late.07:40
mariosysandeep: ah so time didn't change for you ?07:42
mariosysandeep: to be fair, i was also a bit late today (had to pickup kids passports/renew)07:42
chandankumarmarios: o/ hello mate :-)07:42
marios\o chandankumar 07:43
chandankumarwe merged all standalone-roles-testing patches on last friday.07:43
marioscool07:43
chandankumarthank you for consistently reviewing it :-)07:43
mariosnp chandankumar you are always reviewing my stuff too 07:43
ysandeepmarios: Yes it didn't change for us, We don't use daylight saving in India07:44
mariosi see07:44
mariosok so now we only have 2.5 hours between us07:44
ysandeepmarios, currently 13:15 for me.07:45
ysandeepso 3.5 hr diff07:46
mariosah actually 4.5 (it was 3.5 for me before) ysandeep 07:46
mariosnow here 094607:46
mariosysandeep: i am 1 hour ahead of central europe time here07:47
ysandeepah, okay :) 13:15 - 09:45 - Isn't diff is 3.5 hr.. But I am still waking up after a long vacation07:54
*** jpena|off is now known as jpena08:12
arxcruz|ruckmarios, rlandy|out asked me to ping you on monday to merge https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/86169008:14
mariosarxcruz|ruck: ack 08:18
*** amoralej is now known as amoralej|off08:19
mariosarxcruz|ruck: dviroel|out: ack on https://bugzilla.redhat.com/show_bug.cgi?id=2138436 will dig we had similar issue for upstream i will post fix 08:19
*** kopecmartin|pto is now known as kopecmartin08:26
mariosarxcruz|ruck: obviously you're aware of that https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/861690 please keep an eye today it has the potential to break a lot of things ;)08:32
arxcruz|ruckmarios, yes08:56
*** ysandeep is now known as ysandeep|lunch08:56
mariosarxcruz|ruck: ok as discussed let me know if you wana discuss anything or need any other kind of support/reviews etc09:04
arxcruz|ruckok09:05
marios:D09:05
marioso/ tripleo-ci please add to reviews  https://review.rdoproject.org/r/c/config/+/45865 "Add task to generate hash_info with distro override - dlrn-report"09:22
reviewbotDo you want me to add your patch to the Review list? Please type something like add to review list <your_patch> so that I can understand. Thanks.09:22
mariosarxcruz|ruck: dviroel|out: ^^^ for https://bugzilla.redhat.com/show_bug.cgi?id=2138436#c109:22
* marios biab09:46
*** amoralej|off is now known as amoralej09:49
*** ysandeep|lunch is now known as ysandeep10:02
*** ysandeep is now known as ysandeep|afk10:20
*** rlandy|out is now known as rlandy10:33
rlandyarxcruz|ruck: hey - how are things?10:34
arxcruz|ruckrlandy, calm 10:34
arxcruz|ruckrlandy, train is finishing, wallaby i'm reruning, master is pending to run 10:34
rlandyarxcruz|ruck: 17 on rhel-9 needs a promo10:35
arxcruz|ruckrlandy, i'll check it10:36
arxcruz|ruckrlandy, 10:36
mariosso clocks didn't change in the US then i guess?10:40
rlandymarios: next week10:42
rlandyysandeep|afk: welcome back ... pls add this to your review list ... https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/45783 Added alternative criteria to integration10:42
reviewbotI have added your review to the Review list10:42
rlandyarxcruz|ruck: I have a bunch of meetings ... time to sync now so we can run through cix? also wanted to point out dashboard10:43
arxcruz|ruckrlandy, ok10:43
rlandyarxcruz|ruck: https://meet.google.com/sdq-udmh-hgi?pli=1&authuser=010:44
*** ysandeep|afk is now known as ysandeep10:59
ysandeeprlandy: thanks, looking11:01
ysandeepreview time11:16
*** dviroel|out is now known as dviroel|rover11:20
* dviroel|rover o/11:20
rlandydviroel|rover: hey - can you review https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/45783 before we merge?11:21
dviroel|roverlooking11:23
chandankumardviroel|rover: can you join the podified ci meeting now? I got a clash with other meeting with earlier timing11:28
dviroel|roverchandankumar: yes11:28
chandankumardviroel|rover:  https://meet.google.com/vzm-nrah-qqf?authuser=011:28
ysandeepchandankumar, I have few pointer how you can do your testing, if you can join: meet.google.com/gcs-xcsx-ygc12:01
rlandyarxcruz|ruck: dviroel|rover logged real bug in scen 00312:05
rlandymaster12:05
rlandyarxcruz|ruck: can you look at: https://bugs.launchpad.net/tripleo/+bug/1995169?12:06
rlandytempest conf thing12:06
arxcruz|ruckok12:06
rlandydviroel|rover: we need to merge: https://review.rdoproject.org/r/c/config/+/45865/2/roles/dlrn-report/tasks/dlrn-vars-setup.yml12:08
* soniya will be back in hr12:08
*** soniya is now known as soniya|afk12:08
ysandeepchandankumar, I am dropping, please feel free to ping me when you are back12:09
rlandymarios: dviroel|rover and I are looking at https://review.rdoproject.org/r/c/config/+/4586512:10
rlandyleft one question and then we can merge and try12:11
mariosrlandy: ok looking12:12
marioswant me to join (you still in call?12:12
mariosrlandy: sure let me add some links i meant to but forgot (courtesy links for reviewers sorry)12:13
mariosrlandy: dviroel|rover: thanks for checking i need to update something (not the job. thing but sthing else commenting on review in a couple mins)12:16
rlandyok12:16
rlandymarios: we are - but droppig12:16
rlandywe'll look again after your comments12:16
rlandypls ping when ready for us to review again12:17
mariosrlandy: ack updating review and adding links12:19
rlandychandankumar++ nice work on ee operator testing12:23
chandankumarrlandy: sorry I have not worked on ee operator, it is basically done by juan from upgrade team, I have just added ansible ee container image12:36
rlandychandankumar: I mean the whole workflow discussion12:36
chandankumarrlandy: ok, thank you :-)12:36
mariosdviroel|rover: rlandy: please revisit when you next have time https://review.rdoproject.org/r/c/config/+/45865/3#message-fec5849d276e72b3e4add2e03d09af4d51c8c49f 12:40
dviroel|rovermarios: done, added a question12:49
mariosthanks dviroel|rover i replied when you get a chance 12:55
rlandylooking12:59
*** amoralej is now known as amoralej|lunch13:00
rlandymarios: dviroel|rover: ok - I'm +2 on https://review.rdoproject.org/r/c/config/+/45865 now13:02
mariosthanks for reviewing properly rlandy dviroel|rover o/ 13:07
marioshelped me avoid a mistake like upstream 13:07
dviroel|rovermarios: rlandy: lets merge and see if fixes our side13:09
rlandydviroel|rover: ok - w+ing13:13
rlandyarxcruz|ruck: chandankumar: akahat: dviroel|rover: frenzy_friday: marios: ysandeep: soniya|afk: dasm|off: rcastillo_: scrum in 12 mins13:18
rlandypooja is out today13:18
mariosthanks rlandy 13:21
rlandychandankumar: scrum13:32
arxcruz|ruckrlandy, dviroel|rover while i'm investigating the designate, i added it on the skiplist just for the scen003 that is failing https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/86305913:35
*** dasm|off is now known as dasm13:36
dasmo/13:36
frenzy_fridaypls add to review list https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/433399 (zed sc10 internal job def)13:39
reviewbotI have added your review to the Review list13:39
arxcruz|ruckdviroel|rover, rlandy zed should promote, fs064 just passes 13:40
dviroel|roverarxcruz|ruck: ~o~13:41
arxcruz|rucktrain should promote as well13:41
arxcruz|ruckwallaby promote 13:41
arxcruz|rucknow only master 13:41
dviroel|rovermarios:  TASK [get_hash : print out dlrn_api url]13:41
dviroel|rover2022-10-31 13:31:33.440185 | dlrnapi_url: https://osp-trunk.***.com/api-rhel8-osp17-113:41
dviroel|roverlooks correct now13:42
dviroel|rover:)13:42
dasmarxcruz|ruck: i'm gonna need your help wrt tempest cards to our board. I tried adding some, but I'm not sure what actually needs to be worked on.13:46
arxcruz|ruckdasm, ok13:46
dasmchandankumar: i recall you wanted some ovb job in current spring. i didn't know how to add them, so i'm gonna need your help as well13:46
chandankumardasm: I will put up the cards13:46
dasmchandankumar: thanks. it was here: https://hackmd.io/P5sTPMSBREe5kBS_4jDhIg#New-work-item-discovered-by-the-team13:47
dasmfrenzy_friday: wrt designate component. Should I add subtasks to your card based on: https://hackmd.io/7__qGIxKRdC6D6St6OTNHA ?13:54
dasmDo you want to do that for yourself?13:54
dasmOr would you prefer keeping just one card on the board?13:54
frenzy_fridaydasm, I'll add the subtasks myself. In the hackmd I have only the overview - I need to find out if we need any more steps from the existing components13:54
dasmfrenzy_friday: sounds good!14:00
*** amoralej|lunch is now known as amoralej14:04
ysandeeprlandy, thanks to frenzy_friday - she provided a hash where main ovb jobs were failing and internal one were passing - your patch looks good as per tests. +2ed, We can +w whenever you are ready.14:15
ysandeepfrenzy_friday++ thanks!14:15
rlandydviroel|rover: ^^ pls w+ when you have reviewed14:15
frenzy_fridayysandeep, np :)14:15
dviroel|roverfrenzy_friday: tks for testing, I will merge it14:16
mariosdviroel|rover: k got a hold on the new issue digging and will post something before i leave 14:46
dviroel|rovermarios: tks14:50
arxcruz|ruckrlandy, dviroel|rover https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/863072 14:59
arxcruz|ruckrlandy, is it okay if i run scenario003 to promote master, with the tempest conf setting the nameserver ?15:08
arxcruz|ruckif pass we promote, if don't need to bo back to the board 15:08
rlandyarxcruz|ruck: ack - as long as check won't break15:08
rlandyif check will break, we need to do something about that15:09
rlandyarxcruz|ruck: if that works, you can add a var to the job - with a default like custom_nameserver| default('1.1.1.1')15:09
rlandyshould cover all cases15:10
dviroel|roverarxcruz|ruck: you may want to run with with "report_dlrn": "false", so we don't promote before merging the fix15:13
arxcruz|ruckdviroel|rover, i don't think it will impact, the tempest test is already failing, i'm just passing the proper config 15:13
arxcruz|ruckthe next periodic will fail with the same issue15:13
arxcruz|rucksince the problem is with the designate plugin 15:13
mariosrlandy: dviroel|rover: https://review.rdoproject.org/r/c/config/+/45873 there instead https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-config/+/43348415:17
mariossorry folks :/ its a tricky one15:17
mariosthanks for staying ontop of it dviroel|rover 15:17
rlandymarios; oops15:19
rlandydviroel|rover: marios: should we just merge?15:20
rlandyno way to test it otherwise15:20
mariosrlandy: yeah but check it first 15:20
mariosyeah another config repo 15:20
marios:/15:20
rlandylooking at it now15:20
rlandychecking the when conditions15:20
mariosrlandy: ack previous one worked OK/as intended just looks like we use that hash_info file to fetch containers (which is different upstream)15:23
mariosrlandy: so i moved the tasks to just before we dlrn report essentially recreating the hash_info file there 15:23
rlandymarios: dviroel|rover; merging the revert15:24
rlandysince we know that one doesn't impact15:24
dviroel|roverack15:25
dviroel|rovervoted on both15:25
rlandyok - let's try them15:25
rlandydviroel|rover: merged15:25
rlandywe can revert if needed15:26
mariosthanks15:27
mariosyeah lets see 15:27
mariosdviroel|rover: can you re-run test? 15:27
mariosor if you don't want to interrupt i can post one dviroel|rover 15:27
dviroel|rovermarios: i can create a new testproject, that one is still running15:28
mariosdviroel|rover: its ok i'll do it if you don't have one sec 15:30
arxcruz|ruckdviroel|rover, i'll be out for ~40 min 15:30
marioss/don't have/its running15:30
dviroel|rovermarios: all merged, triggering a testproject now15:31
mariosdviroel|rover: resurrected one there https://code.engineering.redhat.com/gerrit/c/testproject/+/427472/8#message-147f43b13df1b53baeeef5d88daf03b51faf3df815:32
mariosdviroel|rover: up to you ^^ 15:32
dviroel|rovermarios: ack, i will abadon mine15:32
mariosdviroel|rover: you can follow that or post new one15:32
dviroel|rovermarios: lets see how both goes, my patch sets "dlrn_hash_tag", not sure if it affects the job15:35
chandankumarsee ya people!15:35
dviroel|roverchandankumar: o/15:35
mariosdviroel|rover: well it just overrides... in this case it will fetch tripleo-ci-testing/current-tripleo accordingly 15:35
mariosdviroel|rover: in your case it tries to fetch particular hash 15:35
marioso/ chandankumar 15:35
dviroel|roverarxcruz|ruck: before you go, pls let some notes on hackmd wrt scn003 tests, so I can follow up15:37
* dviroel|rover lunch15:37
arxcruz|rucki'll be back, don't worry 15:38
*** dviroel|rover is now known as dviroel|rover|lunch15:38
rlandydviroel|rover|lunch: arxcruz|ruck: need to follow through on some docs here - pls ping if you need help with anything15:42
arxcruz|ruckok15:42
jpodivinplease add to review list https://review.opendev.org/c/openstack/tripleo-ci/+/86307815:44
reviewbotI have added your review to the Review list15:44
mariosdviroel|rover|lunch: rlandy: ongoing @ https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/status#42747216:38
mariosif there is something further i'll have to pickup in my morning16:38
mariosthanks again for staying ontop of that dviroel|rover|lunch o/16:38
rlandyshould be fine16:39
rlandythanks16:40
*** marios is now known as marios|out16:43
*** rcastillo_ is now known as rcastillo16:44
*** dviroel|rover|lunch is now known as dviroel|rover16:46
* dasm => doc's appt. be back later16:58
*** jpena is now known as jpena|off17:11
rlandydviroel|rover: hey 17:14
rlandydviroel|rover: want to rekick bm job here : https://code.engineering.redhat.com/gerrit/c/testproject/+/310670/48/.zuul.yaml17:14
dviroel|roverrlandy: let me rekick, i will remove the mixed one too17:16
dviroel|roverdone17:16
dviroel|roverdidn't have a good result with marios patch17:17
dviroel|roverrlandy: if marios' patch don't work at the end, we may want to skip mixed-os on osp17-1 rhel8, the criteria was added last Thursday, we didn't promote with this job yet17:19
dviroel|roverhttps://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/42999417:19
rlandydviroel|rover: ok - let's see how it goes17:23
*** amoralej is now known as amoralej|off17:24
dviroel|roverarxcruz|ruck: do you have a fix/workaroung for scenario003?17:26
arxcruz|ruckdviroel|rover, kind of17:26
arxcruz|ruckdviroel|rover, i ran in testproject and it works 17:26
arxcruz|ruckmaster should promote 17:26
dviroel|roverpromoted already17:27
arxcruz|rucknow i'll work to add this in the job definition 17:27
arxcruz|ruckdviroel|rover, oh, just come back, didn't check :)17:27
dviroel|roveran hour ago17:27
dviroel|roverarxcruz|ruck: it is good to have it, in case check/gate start to fail in the same way17:28
arxcruz|ruckrlandy, dviroel|rover who should we ping to check if train is promoting properly or not? 17:54
rlandyarxcruz|ruck: what is the problem?17:54
arxcruz|ruckrlandy, it's running the same hash again, just want to make sure :) 17:54
rlandycurrent-tripleo/2022-10-30 11:23 17:54
rlandyah to see if dlrn is stuck17:55
arxcruz|ruckrlandy, yup 17:55
rlandyarxcruz|ruck: jjoyce17:55
arxcruz|ruckk17:55
rlandyhttps://trunk.rdoproject.org/centos8-train/consistent/17:55
arxcruz|rucktripleo component should promote soon, if the hash doesn't change i'll ping him 17:55
rlandyhttps://trunk.rdoproject.org/centos8-train/report.html17:55
rlandyarxcruz|ruck: ^^ has new content17:55
rlandyso I think it's ok17:55
arxcruz|ruckok17:55
rlandyugh - this fs039 thing is killing me18:07
dviroel|roverrlandy: mixed_os will need further work18:11
dviroel|roverhttps://code.engineering.redhat.com/gerrit/c/testproject/+/42747218:11
dviroel|roverhttps://code.engineering.redhat.com/gerrit/c/testproject/+/427472/8#message-5ccec01e66a825eb9aaef2eb0a5b4dd190a3117018:11
dviroel|roverrlandy: to skip and promote https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/43351218:11
arxcruz|ruckdviroel|rover, rlandy https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/863072 for the transfer encoding test 18:28
dviroel|roverarxcruz|ruck: is there a link to a test that shows them passing now?18:30
arxcruz|ruckdviroel|rover, 18:33
arxcruz|ruckone sec18:33
arxcruz|ruckdviroel|rover, https://logserver.rdoproject.org/06/45706/3/check/periodic-tripleo-ci-centos-9-standalone-full-tempest-api-tempest-master/c4e411c/logs/undercloud/var/log/tempest/stestr_results.html.gz18:35
dviroel|roverarxcruz|ruck: thanks18:37
rlandychecking18:39
rlandyarxcruz|ruck: ^^ merged18:40
rlandydviroel|rover: checking18:40
rlandydviroel|rover: do we need to revert?18:47
rlandydviroel|rover: ah .. 18:50
dviroel|roverrlandy: yeah, now affects periodic-tripleo-ci-rhel-9-8-multinode-mixed-os-rhos-17.1 too, not sure if should revert now, or if we can wait until marios tomorrow, so he can continue working on this18:52
rlandydviroel|rover: let's revert this18:53
rlandyhe needs to export the vars18:53
dviroel|roverok18:53
rlandyone sec18:54
rlandy418:54
rlandylet me see if I can get the vars right18:55
rlandydviroel|rover: think we can fix this18:58
rlandydviroel|rover: have a minute - will share18:59
rlandydviroel|rover: putting in patch19:01
rlandy- pls hold revert19:01
dviroel|roverk19:02
dviroel|rover17-1 rhel-9 should promote19:03
dviroel|roveryesterday's hash19:04
* dviroel|rover coffee19:04
rlandydviroel|rover: https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-config/+/433514 Define vars needed for get-hash19:09
rlandydviroel|rover: ^^ need to go into meeting in a few19:09
rlandypls review19:09
rlandyper https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/playbooks/tripleo-ci-periodic-base/pre.yaml19:10
dviroel|roverrlandy: ack, lets try that19:22
frenzy_fridayreviewbot, add to review list https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/4586919:24
reviewbotI have added your review to the Review list19:24
rlandydviroel|rover: ok - I'll w+19:30
rlandyif it fails, we can ditch it all19:30
rlandydviroel|rover: pls let me know if that works19:33
dviroel|roverrlandy: ack19:33
dviroel|rover17-1 rhel-9 promoted20:22
dviroel|rover17 rhel-9 still failing on bm job, 2 different errors: node_provision and timeout on lookup20:24
rlandydviroel|rover: ok - let's see what it does now20:32
rlandydviroel|rover: otherwise we may need to skip promote20:33
dviroel|roverack20:33
rlandydviroel|rover: I had ipa working  - 20:33
rlandynow it's falling over on cert20:33
rlandythat's life :)20:33
dviroel|rover=/20:33
dviroel|roverrlandy: will be back later to check job results21:10
*** dviroel|rover is now known as dviroel|rover|brb21:11
rlandydviroel|rover|brb: ack - ok21:18
rlandydviroel|rover|brb: hmmm ... one success - one failure22:09
rlandynot sure if it's legit22:09
rlandyrekicking22:09
rlandy 4b7be0761298bb2fe18ba080b86b3f1822:10
rlandyhttps://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp17-1/tripleo-ci-testing/delorean.repo.md522:10
rlandywrong hash22:10
rlandytried to report on the 9 hash22:14
rlandydviroel|rover|brb: he's made the change in the wrong role22:31
* rlandy puts in patch22:31
rlandyfixing 22:31
rlandydviroel|rover|brb: https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-config/+/433551 Set DLRN vars for mixed RHEL in pre DLRN22:36
* dasm => off22:56
*** dasm is now known as dasm|off22:56
*** dviroel|rover|brb is now known as dviroel|rover22:58
dviroel|roverhey22:58
dviroel|roverrlandy: looking23:02
rcastilloleaving for today o/23:07
dasm|offrcastillo: o/23:08
dviroel|roverrlandy: i don't know, looking at both solution, this one and the previous one from marios, both ended writing hashes info to "hash_info.sh"23:09
dviroel|roverso, without looking at details, I think that both will endup in same way23:09
dviroel|rovermy guess23:09
dviroel|roverrlandy: if you want to try, we can merge23:10
*** dviroel|rover is now known as dviroel|rover|dinner23:17
rlandydviroel|rover|dinner: we cab leave it for marios23:46
rlandybut my guess is that the hash_info is written in pre23:46
*** rlandy is now known as rlandy|out23:47

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!