Tuesday, 2021-10-05

*** dviroel is now known as dviroel|out00:15
*** rlandy|ruck|bbl is now known as rlandy|ruck01:33
*** ykarel|away is now known as ykarel05:18
*** ysandeep|out is now known as ysandeep05:37
ysandeepbhagyashris|rover, need any help with reviews for any promotion blocking issue?05:41
ysandeepykarel, Good morning, Could you please add these two in your review list: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/812278 and https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/81107905:48
ykarelysandeep, looking05:57
bhagyashris|roverysandeep, not atm 05:58
ysandeepykarel: thank you!06:05
ysandeepbhagyashris|rover, ack o/06:05
*** amoralej|off is now known as amoralej07:27
ysandeepykarel: Is it possible to trigger https://jenkins-cloudsig-ci.apps.ocp.ci.centos.org/job/tripleo-quickstart-promote-master-current-tripleo-delorean-minimal/ with depends-on a upstream patch?07:27
ysandeepwant to test https://review.opendev.org/c/openstack/tripleo-quickstart/+/81242307:28
ykarelysandeep, ^ job don't work with upstream patches07:32
ykarelbut if want can modify that to apply ^ patch and post test revert07:32
ykarelor other option is to create a custom job that work with quickstart patches07:33
*** jpena|off is now known as jpena07:33
ysandeepykarel: great! do you have few mins(may be on a gmeet) to discuss how can we go ahead with these approaches. 07:37
ykarelysandeep, sure can do before going for lunch07:37
ysandeepykarel: thanks meet.google.com/tmu-prtm-itw07:39
*** ykarel is now known as ykarel|lunch08:18
frenzy_fridayMorning arxcruz|ruck , when you get some time can we merge https://review.opendev.org/c/openstack/tripleo-ci-health-queries/+/812341 pls?08:26
arxcruz|ruckfrenzy_friday: the rename is ok right ?08:29
frenzy_fridayarxcruz|ruck, 1943170.yaml right? Yes, I updated the bug number so the filename changed to the new bug number08:29
arxcruz|ruckfrenzy_friday: ok 08:30
frenzy_fridayvielen Dank08:30
ysandeepykarel++08:47
*** ysandeep is now known as ysandeep|lunch09:00
*** ysandeep|lunch is now known as ysandeep09:48
bhagyashris|roverykarel|lunch, zuul is +1 on https://review.opendev.org/c/openstack/diskimage-builder/+/812453 thanks :)10:02
bhagyashris|roverysandeep, plz add in your review list https://review.opendev.org/c/openstack/puppet-tripleo/+/812457 https://review.opendev.org/c/openstack/diskimage-builder/+/81245310:08
ysandeepbhagyashris|rover, ack o/ i was already checking the disk-image builder patch10:09
ysandeepbhagyashris|rover: Could we please run a testproject with https://review.opendev.org/c/openstack/puppet-tripleo/+/812457 to confirm it fixes the failing job10:12
bhagyashris|roverysandeep, yup doing ...10:13
ysandeepbhagyashris|rover, ++ thanks!10:13
bhagyashris|roverysandeep, https://review.rdoproject.org/r/c/testproject/+/3437310:14
bhagyashris|roverarxcruz|ruck, these two patches will unblock master and train promotion  https://review.opendev.org/c/openstack/puppet-tripleo/+/812457 https://review.opendev.org/c/openstack/diskimage-builder/+/812453 10:17
*** ykarel|lunch is now known as ykarel10:24
*** rlandy is now known as rlandy|ruck10:24
rlandy|ruckfrenzy_friday: hey - congrats on your one year anniversary10:25
rlandy|ruckbhagyashris|rover: arxcruz|ruck: hello - how are things today?10:26
frenzy_fridayrlandy|ruck, thank you :D It is officially on 19th, but linkedin says 1st Oct10:26
rlandy|ruckneed help with anything?10:26
arxcruz|ruckrlandy|ruck: fine10:26
arxcruz|ruckfrenzy_friday: waht?!10:26
arxcruz|ruckwhat*10:26
arxcruz|ruckone year already ?10:26
bhagyashris|roverrlandy|ruck, we have fixes for blockers plz review those when you have free time10:26
frenzy_friday\o/10:27
bhagyashris|roverthese two patches will unblock master and train promotion  https://review.opendev.org/c/openstack/puppet-tripleo/+/812457 https://review.opendev.org/c/openstack/diskimage-builder/+/81245310:27
rlandy|ruckbhagyashris|rover: thank you - looking10:27
bhagyashris|roverhit the testproject patch master one  https://review.rdoproject.org/r/c/testproject/+/3437310:27
rlandy|ruckbhagyashris|rover: thanks for taking care of that10:30
rlandy|ruckykarel: thanks for https://review.opendev.org/c/openstack/diskimage-builder/+/81245310:30
rlandy|ruckdo you have merge rights there? diskimage-builder?10:31
frenzy_fridayrlandy|ruck, if https://review.opendev.org/c/openstack/tripleo-ci-health-queries/+/812341 looks ok can we merge it?10:33
*** erbot_ is now known as erbot__10:33
*** erbot__ is now known as erbot___10:33
*** erbot___ is now known as erbot____10:33
*** erbot____ is now known as erbot_____10:34
*** erbot_____ is now known as erbot______10:34
rlandy|ruckfrenzy_friday: done - thanks10:34
rlandy|ruckfrenzy_friday: ^^ what happened to your bot??10:34
ykarelrlandy|ruck, no /me don't have +2 there10:34
frenzy_fridayI tried running multiple copies, and it went crazy :D 10:34
rlandy|ruckbhagyashris|rover: have we tetsproject tested that the train fix works?10:37
rlandy|ruckhttps://review.opendev.org/c/openstack/diskimage-builder/+/81245310:38
rlandy|ruckif so, will ping julia to merge10:38
bhagyashris|roverrlandy|ruck, doing ...10:38
rlandy|ruckbhagyashris|rover: thank you10:38
* rlandy|ruck has dr's appt shortly10:38
rlandy|ruckwe can check after that10:38
bhagyashris|roverrlandy|ruck, arxcruz|ruck fyi, https://review.rdoproject.org/r/c/testproject/+/3210710:41
rlandy|ruckykarel: unrelated question ... been working with ade_lee on the fips work ...10:42
ykarelrlandy|ruck, yes ?10:43
rlandy|ruckhttps://review.opendev.org/c/openstack/barbican-tempest-plugin/+/810782 review - when added as a depends-on10:43
rlandy|ruckgives 'This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.' errors10:43
rlandy|rucksee errors in https://review.opendev.org/c/openstack/tripleo-ci/+/80821510:43
ykarellooking10:43
rlandy|ruckanything particular about barbican-tempest-plugin?10:43
rlandy|ruckykarel: the  cross-repo dependencies error only show up in rdo zuul  - not upstream zuul10:44
rlandy|ruckbhagyashris|rover: to testproject - we need to run the buildimage jobs periodic-tripleo-centos-8-buildimage-overcloud-hardened-full-train10:55
rlandy|ruckbhagyashris|rover: nvm - I see you have it now10:56
* rlandy|ruck looked at previous results10:56
bhagyashris|roverrlandy|ruck, ok10:57
rlandy|ruckbhagyashris|rover: arxcruz|ruck: quick sync - gmeet is easier :)11:00
rlandy|ruckhttps://meet.google.com/sgi-cwjv-voi?pli=1&authuser=011:00
bhagyashris|roverhttps://bugs.launchpad.net/tripleo/+bug/1946045/comments/311:02
*** rlandy|ruck is now known as rlandy|dr_appt11:16
*** jpena is now known as jpena|lunch11:24
bhagyashris|roverrlandy|dr_appt, fyi sc003 is SUCCESS on testproject patch https://review.rdoproject.org/zuul/status/change/34373,7 depends on this change https://review.opendev.org/c/openstack/puppet-tripleo/+/81245711:28
bhagyashris|roveri think we dont need to report separate bug for sc00311:29
bhagyashris|roverthe one we discussed in the sync11:29
bhagyashris|roverreported one bug https://bugs.launchpad.net/tripleo/+bug/1946091 for sc001 and sc00411:29
*** amoralej is now known as amoralej|lunch11:30
bhagyashris|roverlooks like this change https://review.opendev.org/c/openstack/puppet-tripleo/+/812457 fix the sc003 failure as well 11:31
ykarelrlandy|dr_appt, got side tracked, but from dep chain doesn't look anything wrong11:44
ykarelwill readd depends-on and see what's wron11:44
bhagyashris|roverrlandy|dr_appt, sc002 is also passing with this fix https://review.opendev.org/c/openstack/puppet-tripleo/+/812457 ...12:03
*** dviroel|out is now known as dviroel12:07
bhagyashris|roverykarel, ysandeep rlandy|dr_appt arxcruz|ruck c8 train image build is passing with this fix https://review.opendev.org/c/openstack/diskimage-builder/+/812453 testproject patch: https://review.rdoproject.org/r/c/testproject/+/3210712:07
ykarelokk good12:08
ysandeepbhagyashris|rover, ack.. great! 12:10
bhagyashris|roverykarel, thanks :)12:10
*** jpena|lunch is now known as jpena12:22
*** ysandeep is now known as ysandeep|afk12:34
arxcruz|ruckbhagyashris|rover: rlandy|dr_appt sorry, I'm having connection issues here with vodafone, was offline until now 13:02
bhagyashris|roverrlandy|dr_appt, arxcruz|ruck now master blocked on https://bugs.launchpad.net/tripleo/+bug/1946091 i discussed this on #tripleo13:02
bhagyashris|roverarxcruz|ruck, np13:02
*** amoralej|lunch is now known as amoralej13:03
*** ysandeep|afk is now known as ysandeep13:26
bhagyashris|roverarxcruz|ruck, , sshnaidm, rlandy|dr_appt , marios, ysandeep, bhagyashris, svyas, soniya29, pojadhav, akahat, weshay, chandankumar, frenzy_friday, anbanerj, dviroel13:29
bhagyashris|roverTripleo CI community meeting in 1 min13:29
*** dpawlik2 is now known as dpawlik13:31
*** rlandy|dr_appt is now known as rlandy|ruck13:32
frenzy_fridayhttps://docs.google.com/presentation/d/1CavlDKCEXc2LdXTYDNwDot4X9wbehXkAcdUvHyeKt8Q/edit?usp=sharing - tripleo health ppt13:59
ysandeepfrenzy_friday: could you please allow access to ^^ 14:00
dviroelfrenzy_friday: great job on that :)14:00
frenzy_fridayysandeep, yep done14:01
frenzy_fridaydviroel, thank you :)14:02
rlandy|ruckbhagyashris|rover: https://review.opendev.org/c/openstack/tripleo-quickstart/+/81242314:03
*** ykarel is now known as ykarel|away14:03
rlandy|ruckbhagyashris|rover: https://bugs.launchpad.net/tripleo/+bug/194608714:03
ysandeepfrenzy_friday ++ thanks! nicely presented 14:03
frenzy_fridaythank you :)14:04
bhagyashris|roverarxcruz|ruck, https://review.opendev.org/c/openstack/diskimage-builder/+/81104814:07
* frenzy_friday lunch14:12
bhagyashris|roverhttps://logserver.rdoproject.org/49/35949/3/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-ussuri/2e90b8c/job-output.txt14:18
bhagyashris|roverhttps://review.rdoproject.org/r/c/testproject/+/3594914:18
bhagyashris|roverrlandy|ruck, rerunning here https://review.rdoproject.org/r/c/testproject/+/35949 14:22
rlandy|ruckbhagyashris|rover++ thanks14:22
rlandy|ruckjust rekicked train c714:26
bhagyashris|roverrlandy|ruck, arxcruz|ruck leaving for the day ...14:43
arxcruz|ruckbhagyashris|rover: \o14:43
rlandy|ruckbhagyashris|rover: sure - thanks for all your hard work today14:43
sshnaidmfrenzy_friday, hey, so what are dns names that we need for "health"?14:54
ade_leeslaweq, hey -- do you have a few minutes to troubleshoot a failed ooo install?14:59
slaweqade_lee: hi, actually I'm in the meetings now until EOD14:59
ade_leeslaweq, we're seeing a case where it looks like the networking is not set up on a fips enabled system14:59
slaweqade_lee: please give me link to the setup if You have15:00
slaweqI will try to check it in the evening15:00
ade_leeslaweq, I can provide you some links I guess, and maybe you can see something in your spare time :)15:00
ade_leeslaweq, thanks - will provide shortly -- as a note, I think snmpd is not up -- not sure if that would cause things to fail ..15:00
slaweqade_lee: I actually got back to my old patches like https://review.opendev.org/c/openstack/neutron/+/799625 to make finally working neutron-functional-fips job: https://review.opendev.org/c/openstack/neutron/+/79753715:01
slaweqso good timing :)15:01
ade_leeslaweq, thats great -- serendipity indeed15:01
ade_leeslaweq, https://review.rdoproject.org/zuul/build/7bba53b7e0bd4cceafdc0b955ef83826/logs#15:02
slaweqade_lee: I will check it in the evening and will ping You if I will find anything15:02
ade_leeslaweq, this is fips enabled multinode system.  it fails when trying to ssh keys to the other nodes -- well to 192.168.24.315:03
ade_leeand I have a node that is reserved , so being on the box, I see that I cannot ping this box15:03
ade_leeslaweq, ack - if you point me to your keys, I can put them on the box as well.15:04
ade_leeslaweq, snmpd is failing to start because we're trying to create a user with an md5 password15:04
ade_leenot sure if that would cause things to fail.15:05
frenzy_fridayhey sshnaidm, maybe something like ci-health.tripleo.org and ci-health-rdo.tripleo.org ?15:25
frenzy_fridayrlandy|ruck, arxcruz|ruck what do you think ^ ?15:25
slaweqade_lee: https://paste.opendev.org/show/809798/ this is my pubkey15:26
ade_leeslaweq, ack - will add it to the reserved node and send you email with details15:27
ade_leethanks15:27
slaweqade_lee++ thx15:27
arxcruz|ruckfrenzy_friday: health.tripleo.org ?15:50
frenzy_fridayarxcruz|ruck, yep sounds good15:51
rlandy|ruckfrenzy_friday: sounds good - ci-health.tripleo.org and ci-health-rdo.tripleo.org16:09
rlandy|ruckfrenzy_friday: and one day we can get ci-health-osp.tripleo.org :)16:10
rlandy|ruckwhen we track downstream 16:10
frenzy_fridayack, lets do arx's health.tripleo.org, shorter :D16:11
rlandy|ruckfrenzy_friday: I like ci-health16:12
rlandy|ruckbut either is fine16:12
*** amoralej is now known as amoralej|off16:20
*** ysandeep is now known as ysandeep|dinner16:30
*** jpena is now known as jpena|off16:32
*** ysandeep|dinner is now known as ysandeep17:33
rlandy|ruckarxcruz|ruck: you around? https://review.rdoproject.org/r/c/config/+/3596917:37
rlandy|rucktrying this to fix c717:38
rlandy|ruckit's config 17:38
rlandy|ruckso I have to merge to test17:38
arxcruz|ruckrlandy|ruck: ack but i don't have permission on ci-config 17:39
rlandy|ruckarxcruz|ruck: I do 17:40
rlandy|ruckcan you vote so I don't just self merge17:40
rlandy|ruckI may have to revert that17:40
arxcruz|ruckrlandy|ruck: done 17:40
rlandy|ruckno good way to tell if it will work17:40
rlandy|ruckarxcruz|ruck: fyi - we're quota exceeded on vexxhost atm17:54
rlandy|ruckchecking stacks17:54
rlandy|ruckha - and the cert solution did not work17:56
arxcruz|ruckrlandy|ruck: can't we ignore the cert ?17:57
ysandeeprlandy|ruck, Only 2 old stack stuck on deletion from many months.. apart from that looks okay17:58
rlandy|ruckarxcruz|ruck: https://softwarefactory-project.io/r/c/DLRN/+/22806/3/playbooks/tripleo-ci-oooq.yaml17:58
rlandy|ruck^^ followed that pattern17:58
rlandy|ruckysandeep: thanks for checking17:58
rlandy|ruckarxcruz|ruck: or that cert does not exist on that node17:59
rlandy|ruckno logs so hard to tell17:59
arxcruz|ruckrlandy|ruck: 2021-10-05 17:45:45,447:Script ran successfully: No Heat stack in failed state17:59
arxcruz|ruckthe clean script run a few hours ago 18:00
rlandy|ruckk - maybe we are just overloading the system atm18:00
rlandy|ruckhttps://review.rdoproject.org/r/c/config/+/35973  reverting18:11
rlandy|ruckwill try one more thing18:12
erbotRequired files not ready after 301.9283781051636s for distgit-cbs-validate-centos8-stream 35970,1,b44f1fae7e5845f2b0df7c98f534594918:20
erbotRequired files not ready after 301.58669352531433s for distgit-cbs-validate-centos8-stream 35971,1,5931ad7d8aac4015ac3dc43e668a20ee18:20
rlandy|ruckarxcruz|ruck: trying this one more time ... https://review.rdoproject.org/r/c/config/+/35993/1/roles/promote-hash/tasks/promote-primary-distro.yaml18:27
rlandy|ruckysandeep: ^^ fyi18:56
rlandy|ruckgoing to try this18:56
rlandy|ruckmay revert again18:56
ysandeepack18:56
ysandeeprlandy|ruck: Out for the day, I might be late for scrum tomorrow.. Need to take my daughter for vaccination in the evening.. 19:10
rlandy|ruckysandeep: there is no scrum tomorrow19:11
rlandy|ruckit's on thursday19:11
rlandy|ruckysandeep: no worries if you are in late either day19:12
ysandeepOmg... I was looking at my calendar and its wednesday already ... ~1.00 am for me 19:12
*** ysandeep is now known as ysandeep|out19:20
rlandy|ruckbhagyashris|rover: hey ... 2021-10-05 15:38:27.276490 | primary | Unable to establish connection to https://openstack.prod.psi.phx2.redhat.com:13000/v3/auth/tokens: HTTPSConnectionPool(host='openstack.prod.psi.phx2.redhat.com', port=13000): Max retries exceeded with url: /v3/auth/tokens (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7fa68d832518>: Failed to establish a new connection: 19:46
rlandy|ruck[Errno -2] Name or service not known',))19:46
rlandy|ruckfs039 change19:46
rlandy|ruckwe have some work there19:46
rlandy|ruckdviroel: https://review.opendev.org/c/openstack/tripleo-quickstart/+/80840819:58
rlandy|ruckis that ready to merge and check?19:58
rlandy|ruckif so, we should try that tomorrow and see the damage 19:59
dviroelrlandy|ruck: waiting ci outputs, no sure yet20:10
rlandy|ruckdviroel: sure - when you are ready20:11
rlandy|ruckjust didn't want you waiting on reviews20:12
dviroelok20:17
*** dviroel is now known as dviroel|out20:55
*** rlandy is now known as rlandy|ruck23:30

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!