Thursday, 2021-12-16

*** rlandy|ruck|bbl is now known as rlandy|ruck02:30
rlandy|ruckwoohoo victoria promoting02:32
*** rlandy|ruck is now known as rlandy|out02:38
*** pojadhav|afk is now known as pojadhav04:30
*** ysandeep|out is now known as ysandeep06:22
dpawlikanbanerj|ruck: hey, I need to upgrade Opensearch to new version that fixes cve-2021-4422807:07
anbanerj|ruckdpawlik, sure, pls go ahead. Do you have an approx timeline for the downtime?07:08
dpawlik40 min07:09
anbanerj|ruckcool, thanks07:10
pojadhavfolks, kindly review when free : https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3701307:16
*** ysandeep is now known as ysandeep|lunch07:38
dpawlikanbanerj|ruck should be ok now07:39
*** jpena|off is now known as jpena08:01
*** amoralej|off is now known as amoralej08:16
anbanerj|ruckdpawlik, cool, thanks!08:16
*** ysandeep|lunch is now known as ysandeep08:17
*** ysandeep is now known as ysandeep|afk10:32
chandankumarmarios: \o based on this https://bugs.launchpad.net/tripleo/+bug/1954456/comments/12 I am trying with https://review.opendev.org/c/openstack/diskimage-builder/+/821772 review on fs0210:40
marioschandankumar: i see thanks ok thanks lets see how it goes then ... i am mainly interested to see if it hits the same tempest issues in fs1 right now 10:42
*** sshnaidm|afk is now known as sshnaidm10:54
anbanerj|ruckhey sshnaidm, rlandy|out would you have time today to join the openstack health colab call? It is at 16:30 utc11:02
chandankumarysandeep|afk: can you hold this job for this review https://review.rdoproject.org/r/c/testproject/+/37242 and pub key https://github.com/raukadah.keys11:16
*** ysandeep|afk is now known as ysandeep11:16
ysandeepchandankumar, ack11:16
chandankumarysandeep|afk: sshnaidm is already on it, thanks!11:16
ysandeepchandankumar, done:-11:17
ysandeep~~~11:17
ysandeep./ci-scripts/node_holder/node_holder.py -a https://review.rdoproject.org/r/c/testproject/+/37242/1/.zuul.yaml -c11:17
ysandeepAdding job: periodic-tripleo-ci-centos-9-standalone-master on hold for project: testproject and change: 37242 in rdo11:17
ysandeep~~~11:17
*** rlandy|out is now known as rlandy|ruck11:17
chandankumarysandeep ++11:17
rlandy|ruckanbanerj|ruck: ack11:18
sshnaidmysandeep, maybe worth to add to the holder script username to the reason, so we know who exactly is holding the node11:19
ysandeepsshnaidm, yes we have a cli option --reason , do you mean pass  $USERNAME as default?11:22
ysandeephere: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/37025/8/ci-scripts/node_holder/node_holder.py#111:22
sshnaidmysandeep, yep11:22
ysandeepsshnaidm, nice idea.. i will add that in next patchset11:22
sshnaidmysandeep++11:22
*** dviroel|out is now known as dviroel|rover11:26
rlandy|ruckbhagyashris: pls rebase https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/37148 so we can merged11:36
rlandy|rucksoniya29: hello ... chandankumar and I want to merge your patch  - pls, pls rebase it so we can get it in https://review.rdoproject.org/r/c/rdo-jobs/+/3687511:38
rlandy|ruckrcastillo: hello ... pls rebase your patches: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/37147 and the scenario003 one as well11:40
soniya29rlandy|ruck, yeah11:44
rlandy|ruckanbanerj|ruck: dviroel|rover: how are things in ruck/rover land?11:49
dviroel|roverrlandy|ruck: looks stable, didn't anything to worry so far11:51
rlandy|ruckysandeep: hey - have time to sync re:trigger scenario010?11:51
dviroel|roverdidn't see*11:51
rlandy|ruckdviroel|rover: looks ok - I didn't recheck your component line stuff11:51
rlandy|ruckdviroel|rover: reran victoria and wallaby11:51
anbanerj|ruckrlandy|ruck, promotions good -testprojected ussuri. Gates mostly good11:52
rlandy|ruckanbanerj|ruck: can you take a look at the downstream component lines11:52
rlandy|ruckpojadhav can help you there11:52
dviroel|rovertwo patches only in gates, good time to merge stuff11:52
pojadhavrlandy|ruck, yep11:52
anbanerj|ruckrlandy|ruck, ack, checking11:53
ysandeeprlandy|ruck, sure can chat11:53
rlandy|ruckysandeep: https://meet.google.com/wsp-xfqh-fgy?pli=1&authuser=011:53
pojadhavanbanerj|ruck, you have time now? 11:53
anbanerj|ruckpojadhav, yep, shall we gmeet?11:54
pojadhavanbanerj|ruck, yep https://meet.google.com/cqp-qutz-yxm11:54
bhagyashrisrlandy|ruck, ack11:55
*** amoralej is now known as amoralej|lunch11:59
soniya29rlandy|ruck, i have rebased the patch - https://review.rdoproject.org/r/c/rdo-jobs/+/3687512:06
sshnaidmchandankumar, periodic seems passing this step with rabbitmq12:07
chandankumarsshnaidm: so I think It might be a blip in ci12:10
chandankumarsshnaidm: once it finishes, we can close the bug12:11
sshnaidmchandankumar, ack, it was weird, but it's gone.12:11
rlandy|rucksoniya29: thanks - merging12:15
rlandy|ruckanbanerj|ruck: ack - pls ping with the meeting invite link (health collab)12:17
pojadhavrlandy|ruck, downstream component lines are good, no promotion blockers.. 12:22
rlandy|ruckpojadhav++ thanks12:22
pojadhavonly one job having node failure, anbanerj|ruck will do testrun of it. it is mostly green till now. hope it will pass in testrun as well.12:23
pojadhavthis one : periodic-tripleo-ci-rhel-8-scenario001-standalone-glance-rhos-16.212:23
anbanerj|ruckthanks pojadhav for explaining the downstream to me :) /me testprojects ^12:24
pojadhavanbanerj|ruck, you're welcome ;)12:25
*** pojadhav is now known as pojadhav|brb12:30
chandankumarmarios: sshnaidm what a beauty https://review.opendev.org/c/openstack/tripleo-ci/+/821698/5#message-4f4cb14d1abac063f841ac22eeb212d75fea46df :-)12:39
marioschandankumar: :D12:39
sshnaidmchandankumar, so green! :)12:40
dviroel|rover\o/12:40
chandankumarlet's get that merged12:40
chandankumarpojadhav|brb: anbanerj|ruck bhagyashris dviroel|rover soniya29 ysandeep please have a look when free https://review.opendev.org/c/openstack/tripleo-ci/+/821698 thanks :-)12:42
mariosdviroel|rover: thanks for catching that before it merged - looks ok now https://review.opendev.org/c/openstack/tripleo-ci/+/816991/17#message-9a3cc5ecfd05525df9fe447e88f089a88e3e3d74 12:43
mariosysandeep: sshnaidm: rlandy|ruck: chandankumar: please revisit when you have time https://review.opendev.org/c/openstack/tripleo-ci/+/816991/17#message-9a3cc5ecfd05525df9fe447e88f089a88e3e3d74 12:43
rlandy|ruckchandankumar++ nice!!12:44
* anbanerj|ruck cant login to https://code.engineering.redhat.com/ - fizing that first12:46
marioschandankumar: can you remove the stein stuff from branches 12:46
chandankumarmarios: will take a look, sure will remove :-)12:46
rlandy|ruckchandankumar: marios: sshnaidm: dviroel|rover: anbanerj|ruck: pojadhav|brb: akahat: ysandeep: bhagyashris: rcastillo: arxcruz: you guys rock!! you all should be so proud that you got c9 in check by the end of the year12:47
rlandy|ruckthis is way awesome12:47
rlandy|ruckthank you all12:47
mariostripleo-ci++12:47
rlandy|ruckwill send out message to weekly openstack updates12:47
soniya29chandankumar: kopecmartin, any idea from where do python-tempestconf pull the clients?12:50
dviroel|rover++12:50
soniya29i mean when we say ImageClient with reference to python-tempestconf, are we hinting towards this - https://github.com/openstack/python-glanceclient/blob/master/glanceclient/v2/images.py12:51
*** pojadhav|brb is now known as pojadhav12:52
pojadhavteam++++ :)12:52
soniya29++12:52
Tengurlandy|ruck: heya! fyi, I've added a new "tool" in LADA's toolbox, allowing to follow a patch [just in git branches yet] via the CLI. thought you might love it, especially since you can pass a list of Change-Ids.12:58
kopecmartinsoniya29: https://opendev.org/openinfra/python-tempestconf/src/branch/master/config_tempest/clients.py#L3013:04
pojadhavchandankumar, ack13:05
ysandeeprlandy|ruck, anbanerj|ruck dviroel|rover tripleo component is 2 weeks behind on wallaby 13:08
ysandeepwaiting for https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-standalone-upgrade-tripleo-wallaby 13:08
ysandeepdo we have any bug, want to check status - what's the latest there.13:09
dviroel|roverysandeep: testproject should be running13:10
dviroel|roverysandeep: there is the pcs issue, that is also affecting it13:10
dviroel|roverysandeep: https://review.rdoproject.org/zuul/status#3517413:12
*** amoralej|lunch is now known as amoralej13:12
ysandeepdviroel|rover, thanks your patch pointed me to https://bugs.launchpad.net/tripleo/+bug/1953326 13:12
dviroel|roveranbanerj|ruck: rlandy|ruck https://review.rdoproject.org/zuul/buildsets?pipeline=openstack-component-security13:15
dviroel|rover^ should be triggered everyday but last time was 12/1213:15
rcastillorebased promotion criteria jobs https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/37147 https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3714813:15
dviroel|roverrcastillo: ++13:16
ysandeepdviroel|rover, rlandy|ruck do we run standalone upgrade in wallaby check/gate?13:17
ysandeepi didn't find any run on wallaby: https://zuul.openstack.org/builds?job_name=tripleo-ci-centos-8-standalone-upgrade&branch=stable%2Fwallaby 13:18
dviroel|roverysandeep: don't think so13:19
ysandeeprlandy|ruck, dviroel|rover imho.. if it don't run stanalone-upgrade in check/gate in wallaby- i don't see any reason to block tripleo component on that13:20
ysandeepimho.. we should remove that from wallaby tripleo component criteria 13:20
dviroel|rovermake sense too13:21
* ysandeep will leave to ruck/rovers to decide, just noticed that while checking downstream that we don't have any new build since last two weeks.13:24
rlandy|ruckrcastillo: thank you13:24
rlandy|ruckreading back13:24
rlandy|ruckysandeep: dviroel|rover: ryep - remove it13:25
rlandy|ruckysandeep: dviroel|rover: not  in integration line criteria13:25
rlandy|ruckdviroel|rover: what's up with the security line?13:26
dviroel|roverrlandy|ruck: i'll create the patch to remove from criteria13:27
dviroel|roverrlandy|ruck: not sure, seems that was not triggered13:27
rlandy|ruckdviroel|rover: for tripleo13:27
rlandy|ruckdviroel|rover: let me check13:27
dviroel|roverrlandy|ruck: ack13:27
rlandy|ruckTengu: sounds awesome - will look after meetings13:27
Tengurlandy|ruck: sure - lemme know if you see potential improvements, or maybe some other tool needs :).13:28
rlandy|ruckdviroel|rover: https://review.rdoproject.org/zuul/builds?pipeline=openstack-component-swift - kicked 12/1313:28
rlandy|rucklast kick13:28
rlandy|ruckdviroel|rover: I think it has to do with the rdo instabilities 13:29
rlandy|ruckkeeps getting restarted at that time13:29
rlandy|rucklet me try retrigger13:29
rlandy|ruckwe need to see if they trigger today13:29
rlandy|ruckdviroel|rover: security and swift should trigger next13:31
rlandy|rucklet's keep an eye on if they do13:31
dviroel|rovertime: '0 15 * * *'13:31
dviroel|roversecurity ^13:31
dviroel|roveryeah, i think that we had those zuul restart around that time13:32
rlandy|ruckdviroel|rover: k - let's see what today does13:33
rlandy|ruckchandankumar: hey - are you using the old rhel-9 nodes to run jobs on?13:40
rlandy|ruckworking?13:40
rlandy|ruckLabel: upstream-rhel-9-013:41
rlandy|ruckha13:41
rlandy|ruckstill works13:41
soniya29kopecmartin, thanks13:41
dviroel|roverysandeep: sanity check pls https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3724613:43
chandankumarrlandy|ruck: yes13:44
rlandy|ruckchandankumar: pls review/merge https://review.rdoproject.org/r/q/owner:rafael%2540trfs.me - rcastillo two open changes - I already +2'ed them13:45
ysandeepdviroel|rover: looks good, minor comments there13:48
dviroel|roverysandeep: didn't get the idea, do we plan to bring it back after promotion?13:51
dviroel|roverysandeep: i thought that was to remove forever since it is not running in check/gate13:51
ysandeepdviroel|rover, I was under impression that we want to bring it back once that bug is solved. 13:52
dviroel|roverif we would like to bring it back, then I need to do the changes you mention13:52
ysandeepmarios, Do we want to add standalone upgrade job in wallaby check/gate in future?13:53
ysandeepdviroel|rover, lets check with marios about the plans. 13:53
mariosysandeep: no13:53
mariosysandeep: not for wallaby or master.. we just left that where it was i.e. up to victoria13:54
mariosysandeep: master/wallaby we only have undercloud upgrade and minor update in the gate13:54
rlandy|ruckdviroel|rover: anbanerj|ruck: pls book a sync meeting tomorrow with next week's ruck/rovers to transfer info 13:54
ysandeepmarios: thanks, in that case i think we can remove standalone upgrade from tripleo component criteria permanently, right?13:55
dviroel|roverrlandy|ruck: ack13:55
ysandeepmarios, for wallaby branch13:55
ysandeepmarios: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/37246 13:55
rlandy|ruckdviroel|rover: anbanerj|ruck: * December 20 - December 26:Amol, soniya13:55
dviroel|rovermarios: yes, please add yout thoughts in this patch, tks13:55
bhagyashrisarxcruz, sshnaidm, rlandy, marios, ysandeep, bhagyashris, svyas, soniya29, pojadhav, akahat, chandankumar, frenzy_friday, dviroel, dasm rcastillo 13:57
bhagyashrisTripleo CI planning meeting in 5 mins13:57
* dviroel|rover coffee13:57
bhagyashrishttps://meet.google.com/ync-kcvd-wvz?authuser=013:57
* dviroel|rover back in 513:57
bhagyashrishttps://hackmd.io/P5sTPMSBREe5kBS_4jDhIg#2021-12-16-Unified-Sprint-55-Planning13:57
bhagyashrishttps://hackmd.io/gONRxsVRTFGw2pZIWLxTPA?both13:57
bhagyashrisrlandy|ruck, anbanerj|ruck dviroel|rover ^13:58
anbanerj|ruckrlandy|ruck, ack. dviroel|rover akahat soniya29 is UTC 14:30 tomorrow good for you?13:58
akahatanbanerj|ruck, yup will work for me.13:59
mariosdviroel|rover: ysandeep: replied there we can discuss more after call if you like https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/37246/1#message-f915a871bf685a90bee511da12a3723fa5ed43ba 14:00
bhagyashrischandankumar, akahat dasm rcastillo 14:00
dasmo/14:40
soniya29anbanerj|ruck, I will be out for next week. I am swapping my ruck/rovering with chandankumar14:52
anbanerj|rucksoniya29, cool, chandankumar: sending you the rr invite for tomorrow14:52
ysandeepsshnaidm, just want to confirm all the tasks that are mentioned in that trello are for https://github.com/directord/ansible2dd ?14:58
sshnaidmysandeep, yes14:59
ysandeepsshnaidm, thanks! I will take a look and try to pick some items from there.14:59
sshnaidmysandeep++14:59
ade_leejpodivin, hey - I noticed you abandoned https://review.opendev.org/c/openstack/tripleo-ci/+/82180415:01
ade_leejparker, is there a replacement?  or am I looking at the wrong one15:01
jparkerade_lee: I think you meant jpodivin15:02
jpodivinade_lee: that was a testing patch. original is still there15:02
jpodivinhttps://review.opendev.org/c/openstack/tripleo-ci/+/80821515:03
ade_leejparker, sorry - yeah (auto complete!)15:03
jparkerade_lee: nw!15:03
ade_leejpodivin, ok - just checking15:03
jpodivinade_lee: I didn't want to mess up the code so I've regenerated the hash and submitted again.15:04
ade_leejpodivin, did you figure out the issue you with train builds?15:04
jpodivinade_lee: :( not yet. I can tell for sure it's not the patch itself. So I'll have to disable the dependencies one by one over here https://review.opendev.org/c/openstack/tripleo-ci/+/821942 to see which one is breaking it. 15:05
jpodivinade_lee: tempest patch is the most likely culprit, but I want to be methodical. 15:07
ade_leejpodivin, ok15:09
dviroel|roverysandeep: https://review.rdoproject.org/zuul/build/5b4cbbff16dd4fcd8278a81b8f84522f15:29
dviroel|roverperiodic-tripleo-ci-centos-8-standalone-upgrade-tripleo-wallaby 15:29
dviroel|roverSUCCESS15:29
dviroel|roverso we will have a promotion, lets abandon the criteria patch15:30
ysandeepdviroel|rover, ack, you rock!15:32
rlandy|ruckchandankumar: you out or you want to look at the registry?15:50
chandankumarrlandy|ruck: out now15:50
chandankumarrlandy|ruck: you can left the notes15:50
rlandy|ruckchandankumar: k - will leave you links15:50
chandankumarrlandy|ruck: I will work on container build tomorrow with push false15:50
*** dviroel|rover is now known as dviroel|rover|lunch15:51
chandankumarrlandy|ruck: for fs02 notes are here https://bugs.launchpad.net/tripleo/+bug/1954456/comments/1415:51
chandankumarsee ya!15:51
rlandy|ruckchandankumar: have a good night15:52
mariosysandeep: sshnaidm: rlandy|ruck: chandankumar: please revisit when you have time https://review.opendev.org/c/openstack/tripleo-ci/+/816991/17#message-9a3cc5ecfd05525df9fe447e88f089a88e3e3d74 16:27
mariostripleo-ci please add to your review list ^^^ 16:27
rlandy|ruckack - will do after meetings16:28
mariosthx16:28
ysandeepmarios, first thing in my morning 16:32
mariosysandeep: nice breakfast ;) thanks16:32
*** ysandeep is now known as ysandeep|out16:34
marioslooks like there may be a new issue for uefi c9 image build - seen 2 segmentation faults today https://logserver.rdoproject.org/67/36267/43/check/periodic-tripleo-centos-9-buildimage-overcloud-hardened-uefi-full-master/c979b45/build.log https://logserver.rdoproject.org/67/36267/43/check/periodic-tripleo-centos-9-buildimage-overcloud-hardened-uefi-full-master/b940f59/build.log with a green build in between so 16:41
mariosnot consistent...16:41
marioswill file it if it continues tomorrow fyi rlandy|ruck ^^ dviroel|rover|lunch chandankumar 16:42
*** dviroel|rover|lunch is now known as dviroel|rover16:42
*** marios is now known as marios|out16:45
dviroel|rovercomponent-tripleo-wallaby promoted an hour ago16:52
*** jpena is now known as jpena|off16:58
dviroel|roverswift and security component lines running17:02
* anbanerj|ruck dinner17:08
rlandy|ruckdviroel|rover: good :)17:10
rlandy|ruckmust have been the multiple zuul restarts17:10
*** amoralej is now known as amoralej|off17:15
dviroel|roveryeah17:17
rlandy|rucklunch - brb17:29
dviroel|rovertestproject on ussuri, 7 jobs failed on retry_limite20:57
dviroel|roverrlandy|ruck: component lines are good20:57
rlandy|ruckdviroel|rover: yay on component lines20:58
* rlandy|ruck looks at ussuri20:58
rlandy|ruckmain also has a bunch of failures21:00
rlandy|ruckhmm - yeah - not sure - we can just rekick them21:01
dviroel|roveryep21:09
dviroel|rovermain will run again in 3h (i think)21:09
dviroel|rover"10 0,8,16 * * *"21:10
dviroel|roverok, going out, see you all tomorrow21:21
dviroel|rovero/21:21
*** dviroel|rover is now known as dviroel|out21:21
rlandy|ruckdviroel|out: thanks22:25

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!