Thursday, 2022-12-08

pojadhavrlandy|out, dasm|off : done02:00
*** yadnesh|away is now known as yadnesh03:41
*** marios is now known as marios|ruck06:05
marios|ruck\o06:06
ysandeepo/06:20
*** ysandeep is now known as ysandeep|afk06:20
ysandeepchandankumar, hey o/ I don't know if you get my message yesterday but znc bouncer again went down for me.07:45
chandankumarysandeep: hello08:00
chandankumarysandeep: we are still seeing the same issue after hard reboot08:00
chandankumarI stopped znc from there08:00
chandankumarI will migrate it to new box in weekend08:01
ysandeepchandankumar++ ack, thanks! 08:01
*** ysandeep is now known as ysandeep|lunch09:03
*** ysandeep|lunch is now known as ysandeep10:31
marios|ruckfoooood10:46
ysandeepmarios|ruck, enjoy your meal :D10:47
marios|ruckysandeep: not yet :) in a minute but thanks10:50
*** dviroel|afk is now known as dviroel10:51
*** chandankumar is now known as chkumar|afk11:00
*** rlandy|out is now known as rlandy|rover11:18
rlandy|rovermarios|ruck: hey - pls ping if we need to sync11:20
rlandy|rovermarios|ruck: hmmm content provider seems ok11:21
marios|ruckrlandy|rover: o/ was just getting some food - let me add some more info on hack md sec (chasing)11:24
rlandy|roverk11:24
marios|ruckrlandy|rover: for content provider, hope it is transient, at least looks that way. we had 2 examples on master and another i found on zed so far but then it goes green again 11:27
marios|ruckrlandy|rover: if so will close the new bug11:27
rlandy|roverk - let's hope11:27
marios|ruckrlandy|rover: going to try kick train again (already tried once, noted on hackmd) NODE_FAILURE11:29
frenzy_fridayreviewbot, pls add to review list https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/43590411:31
reviewbotI have added your review to the Review list11:31
* rlandy|rover looks at node failure11:32
marios|ruckrlandy|rover: unfortunately we cant even see node_id ... maybe only from console if we can find while it is running11:34
rlandy|rovermarios|ruck: https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-integration-stable1-cs8&skip=011:38
* bhagyashris tea brb11:40
*** pojadhav is now known as pojadhav|afk12:00
rlandy|rovermarios|ruck: https://review.rdoproject.org/r/c/rdo-jobs/+/46377 Temp remove ibm while under investigation12:00
rlandy|rovercan add bug number when you have ir12:01
rlandy|roverit12:01
rlandy|rovermarios|ruck: also putting in testproject to run component jobs from  lines that have already kicked today12:02
*** chkumar|afk is now known as chandankumar12:03
marios|ruckrlandy|rover: https://bugs.launchpad.net/tripleo/+bug/199914012:05
marios|ruckrlandy|rover: not for the commit message but patch needs update zuul says you mised something (must be nit in syntax)12:07
rlandy|rovermarios|ruck: ack - busy fixing12:07
marios|ruckthx12:07
rlandy|rovermarios|ruck: https://review.rdoproject.org/r/c/testproject/+/25325 - train components until network in rerun12:17
rlandy|roverhopefully we can merge before the others kick12:18
marios|ruckrlandy|rover: ack i'll workflow once zuul votes12:20
rlandy|rovermarios|ruck: putting up wallaby component tp now12:21
rlandy|roverdviroel: can I close https://issues.redhat.com/browse/OSP-20021 out - you have comments there12:42
dviroelrlandy|rover: yes, you can close this one12:43
*** dasm|off is now known as dasm13:00
dasmpojadhav|afk: thanks13:00
rlandy|roverdasm: dviroel: will miss review time today - have dr's appt13:07
rlandy|roverdasm: ok if I move your 1-1 earlier or friday if you prefer13:08
dasmrlandy|rover: either works for me. probably earlier is better13:09
*** ysandeep is now known as ysandeep|afk13:11
chandankumarrlandy|rover: Do we still https://review.rdoproject.org/r/c/rdo-jobs/+/46377 want to merge it?13:18
*** pojadhav|afk is now known as pojadhav13:23
rlandy|roverchandankumar: anandoned that13:25
rlandy|roverwaiting on next component line to kick to confimr13:25
rlandy|roverconfirm13:25
chandankumarmarios|ruck: rlandy|rover we can sync tomorrow for rr handover13:29
chandankumar?13:29
rlandy|roverchandankumar: sure13:29
chandankumarmay be in evening when dviroel will be around13:29
rlandy|rovercan touch base with dviroel ack13:29
marios|ruckchandankumar: sure i already suggested that to rlandy|rover earlier. you and me can sync in our morning and we can check with dviroel when he comes in13:29
chandankumarok sure :-)13:30
dviroelack - works for me too13:31
*** ysandeep|afk is now known as ysandeep14:03
dasmjm1[m]: o/ i submitted patch for CI rework: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/4637814:04
rlandy|rovermarios|ruck: so it looks like octavia on c8 is working14:07
rlandy|rovernetwork failed14:07
rlandy|roverbut I have those in rerun 14:07
marios|ruckrlandy|rover: thx ... but we don't know what/why for the node-failure right far as i could see nicolas didn't change anything? 14:08
rlandy|rovermarios|ruck: zero idea14:09
rlandy|rovermarios|ruck: I'd leave the bug open for a bit14:09
rlandy|roverin case mystery returns14:09
rlandy|roverI think nhicher scared it back into shape14:09
rlandy|roversometime the infra guys can do that14:09
rlandy|rovermarios|ruck: so hoping to clear the components today - then dviroel and chandankumar can promote up content tomorrow14:10
rlandy|roverfor c814:10
pojadhavfolks planning meeting in 10 mins : arxcruz, rlandy, marios|ruck , ysandeep, bhagyashris, svyas, soniya29, pojadhav, akahat, chandankumar, frenzy_friday, dviroel, rcastillo, jm1, rlandy|rover , dasm14:20
dasmbrb14:25
pojadhavdasm, planning meeting14:32
dasmback14:32
marios|ruckrlandy|rover: fs 64 :/ https://review.rdoproject.org/r/c/testproject/+/46376/1#message-603cdaa219f2e2e5402b4e816a237aa7d38e6de814:52
marios|ruckchem: sofergonewild love it15:02
chemhehe15:02
chemmarios|ruck: send you a bunch of comment privately 15:04
chemmarios|ruck: would like you opinion ...15:05
marios|ruckchem: where don't see them 15:05
marios|ruckchem: (marios|ruck not marios)15:05
*** pojadhav is now known as pojadhav|dinner15:06
ysandeepfolks o/ fyi.. I am out tomorrow and Monday 15:14
ysandeepdasm: thanks for preparing rr sheet for next year, I can imagine how much efforts it takes to consider local Ptos.15:17
ysandeeppublic holidays*15:17
*** ysandeep is now known as ysandeep|out15:25
*** ykarel_ is now known as ykarel|away15:47
dasmysandeep|out: no worries. thanks, have a good night15:47
*** pojadhav|dinner is now known as pojadhav16:10
*** dviroel is now known as dviroel|lunch16:10
* pojadhav out16:19
dasmpojadhav: have a good night16:21
rlandy|roverdasm: addressing the 17.0.1 card now for jon16:22
rlandy|roverwill update card when I have the patch16:22
dasmrlandy|rover: thank you16:23
marios|ruckrlandy|rover: off in a minute - no handoff this side... need something? 16:31
rlandy|rovermarios|ruck: no - did a sync with dviroel|lunch 16:31
rlandy|rovermarios|ruck: just watching wallaby and train components16:32
marios|ruckrlandy|rover: ok, me and chandankumar will catchup in our morning 16:32
rlandy|rovermarios|ruck: nice rr'ing with you16:32
marios|rucksame rlandy|rover :) 16:32
marios|ruckrlandy|rover: did you see we got zed too (fs64 grumble grumble... lets see about that one over next few days )16:33
rlandy|roveryep16:33
rlandy|roversorry - just doing container update for jon16:33
marios|ruckack o/ 16:34
rlandy|roverwe can chat about 64 tomorrow16:34
marios|rucksure16:34
marios|ruckdasm: should we schedule a call for tomorrow to catchup on upgrades progress/next steps?16:35
marios|ruckdasm: if you are available send me an invite for your morning? i'll see it when i start tomorrow16:35
*** marios|ruck is now known as marios|out16:39
*** dviroel|lunch is now known as dviroel17:06
dasmmarios|out: sure17:08
*** yadnesh is now known as yadnesh|away17:16
*** rlandy|rover is now known as rlandy|dr_appt18:39
*** dviroel_ is now known as dviroel19:17
*** rlandy|dr_appt is now known as rlandy|rover19:55
*** dviroel is now known as dviroel|afk20:20
*** anbanerj is now known as frenzy_friday20:44
rlandy|roverpojadhav: frenzy_friday: know what is going on with v1_registry issue21:04
rlandy|roverthe build job w/o push has this error21:04
rlandy|roveryou can use the periodic build/push job to test - just set  push_containers: false as in https://code.engineering.redhat.com/gerrit/c/testproject/+/431128/29/.zuul.yaml#721:05
* frenzy_friday looks21:05
frenzy_fridayokay, trying that. We tried setting configure_registries_v1: false in the job def, but the registry.conf still had the wrong syntax21:06
rlandy|roverfrenzy_friday: what are you still doing here???21:06
rlandy|rovergo to sleep21:07
frenzy_fridayI was out in the afternoon for sometime :D so trying to debug the container build thing now21:08
rlandy|roverfrenzy_friday: I have my suspicions21:08
rlandy|roverbut as far as testing - I hit the same thing updating 17 version for jon21:08
rlandy|roveryou can use periodic push with push set to false21:09
rlandy|rover16.2 build job works21:09
rlandy|roverso I just need to trace the vars there21:09
rlandy|roverbut using the push one w/o push will spring you and pojadhav free21:09
frenzy_fridayhttps://code.engineering.redhat.com/gerrit/c/testproject/+/436199/10/.zuul.yaml trying without push here21:10
frenzy_fridayBut finally we need the job to run with push right?21:11
frenzy_fridayDo you know which task creates the registry.conf? Couldnt find on hound21:11
rlandy|roverfrenzy_friday, so that looks like two jobs21:23
rlandy|roverbuild with keys and periodic that will pusj21:23
frenzy_fridaythe tp? Yes, i am trying to check what is happenning with the periodic job as well21:23
rlandy|rovermy suggestion is the periodic21:24
rlandy|roverwith var: push_containers: false21:24
rlandy|roverthe diff is the registry login21:24
rlandy|roverI just need 15 mins to finish something21:24
rlandy|roverthen will help debug the build job21:25
frenzy_fridayack, thanks21:26
rlandy|roverfrenzy_friday: k ... so ... configure_registries_v1 should have helped - checking that21:34
frenzy_fridayrlandy|rover, do you have time for a quick call? 21:34
rlandy|roverfrenzy_friday: ooohhhh21:37
rlandy|roverone sec21:37
rlandy|roverlet me try one more thing21:38
rlandy|roverwrong playbook :)21:38
frenzy_fridayhttps://code.engineering.redhat.com/gerrit/plugins/gitiles/openstack/tripleo-ci-internal-jobs/+/refs/heads/master/playbooks/configure-rhel.yaml#148 - this is the task setting v1 syntax of registries21:39
rlandy|roverfrenzy_friday: in the case of conatiner build jobs ... https://code.engineering.redhat.com/gerrit/gitweb?p=openstack/tripleo-ci-internal-jobs.git;a=blob;f=playbooks/tripleo-buildcontainers/pre_minimal.yaml;h=67336371b478ab827b0b30ba3ff5a13fb55d47de;hb=HEAD#l13521:40
rlandy|roversame tasks - diff playbook21:41
frenzy_fridayoh, not configure-rhel.yaml#14821:41
rlandy|roverno var to switch21:41
frenzy_friday pre_minimal.yaml does not have the v1 option21:41
rlandy|roverfrenzy_friday: putting in a patch to add the when condition and var21:41
rlandy|roverand seeing if we can skip that21:41
frenzy_fridaynp, I'll do it21:41
rlandy|roveralready on it21:41
rlandy|roverfrenzy_friday: ^^ give me 521:41
frenzy_fridaycool, thanks :)21:41
rlandy|roverwill commit the patch to try21:41
rlandy|roverfrenzy_friday: testing in https://code.engineering.redhat.com/gerrit/c/testproject/+/43112821:46
rlandy|roverhttps://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/437370 WIP: Add a switch condition to registry setup21:46
rlandy|roverchecking if it works21:46
frenzy_fridayack 21:46
* dasm => offline21:50
dasmo/21:50
*** dasm is now known as dasm|off21:50
rlandy|roverfrenzy_friday: actually - let me update that patch - I want to put the when slightly further down21:53
frenzy_fridayrlandy|rover, ack21:54
frenzy_fridayIf your TP works I'll recheck the 17.1 container build21:54
* frenzy_friday removes held node and leaves for the day21:55
rlandy|roverfrenzy_friday: k - will leave you notes for your morning21:56
frenzy_fridayrlandy|rover, thanks. I updated the events till now here: https://hackmd.io/0ZqodGQsTACAG7ptetSrIg#Debugging21:57
rlandy|roverhave a good night21:57
rlandy|roverfrenzy_friday: woohoo  - works now22:39
rlandy|roverhttps://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/build/ce603716848f49c09694d9f94968873622:39
rlandy|roverfrenzy_friday: pojadhav: you'll need https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/43737022:40
rlandy|roverand configure_registries_v1: false22:40
*** rlandy|rover is now known as rlandy|out22:47

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!