Thursday, 2022-04-07

ysandeep|outrlandy|out: registry cleaned up for 16.2 namespace wohoo, I will do cleanup for 17 namespace now.00:20
*** soniya is now known as soniya2904:00
*** pojadhav- is now known as pojadhav04:40
*** ysandeep|out is now known as ysandeep05:12
ysandeepbhagyashris_, good morning o/ around?05:50
bhagyashris_ysandeep, gm! yes05:52
*** bhagyashris_ is now known as bhagyashris05:52
ysandeepbhagyashris, please check messages from last night about moving scrum: https://meetings.opendev.org/irclogs/%23oooq/%23oooq.2022-04-06.log.html#t2022-04-06T15:19:48 05:52
ysandeep>> rlandy, bhagyashris hey looks like jm1 have ptg topic tomorrow for Ansible collection: https://etherpad.opendev.org/p/aom-zed-ptg , Timing conflicts with our scrum mtg time, Since many of our team members are contributing there including rcastillo frenzy_friday arxcruz - I think its worth for them to join the session as well, Do you want to cancel tomorrow's scrum?05:53
ysandeep>> rlandy| bhagyashris: can we move scrum to friday?05:53
bhagyashrisyeah saw the discussion 05:54
bhagyashristhanks05:54
bhagyashrisDone05:55
ysandeepbhagyashris: thanks!05:56
ysandeepmarios, minor nit here: https://review.opendev.org/c/openstack/tripleo-ci/+/834186/6/zuul.d/build-image.yaml#28906:29
mariosysandeep: thanks done06:34
ysandeepthanks, left a comment on https://review.opendev.org/c/openstack/tripleo-ci/+/836803/2#message-2955780cb5e180bc56095f3434a448d541d3d008 when you have time.06:37
ysandeepbhagyashris, you want to chat now about downstream baremetal jobs reparenting?06:46
bhagyashrisysandeep, i think pooja assign this task 06:48
bhagyashrisif she is not doing then i will take care 06:48
bhagyashrisi can also join 06:48
bhagyashrisysandeep, you mean "Rework Downstream Baremetal environment"06:49
bhagyashrisor downstream baremetal jobs reparenting06:49
ysandeepbhagyashris: you pinged me yesterday that you wanted to discuss some reparenting thing, was that for some different task?06:49
bhagyashrisi was asked about "Rework Downstream Baremetal environment"06:50
bhagyashrisok let's meet :D06:50
bhagyashristhen will decide 06:50
ysandeepmeet.google.com/xte-povm-cxt06:50
jpodivinakahat|rover: I'm seeing an error during overcloud deployment, "os-net-config: command not found" . I have a feeling we were doing something about it already but I'm not sure. 06:59
jpodivinlogs: https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_d4f/835837/1/check/tripleo-ci-centos-8-containers-multinode/d4fe634/logs/undercloud/home/zuul/overcloud_deploy.log06:59
*** jpena|off is now known as jpena07:02
pojadhavysandeep, baremetal reparenting I picked up.07:05
*** amoralej|off is now known as amoralej07:21
jpodivinakahat|rover: bug filed https://bugs.launchpad.net/tripleo/+bug/196813207:27
*** pojadhav is now known as pojadhav|lunch07:35
ysandeeppojadhav|lunch: ack, thanks!07:49
*** pojadhav|lunch is now known as pojadhav08:08
* akahat|rover reading back08:18
akahat|roverjpodivin, o/ looking in to bug.08:34
ysandeepchandankumar: content-provider failed on https://sf.hosted.upshift.rdu2.redhat.com/logs/25/317225/4/check/tripleo-ci-rhel-8-content-provider-rhos-16.2/d697912/logs/undercloud/home/zuul/container_image_build.log , not sure if related to reparenting08:37
chandankumarysandeep: will take a look, thanks!08:41
ysandeepmay be because of neutron-base container -> as per logs -> base/os/neutron-base" returned: 108:41
chandankumarysandeep: as per neutron base log , it is fine08:46
ysandeepyes, it retries later, passed in second run08:46
ysandeephttps://sf.hosted.upshift.rdu2.redhat.com/logs/25/317225/4/check/tripleo-ci-rhel-8-content-provider-rhos-16.2/d2cd53a/logs/undercloud/home/zuul/container_image_build.log08:46
ysandeepbase:538be64188487bbe7fbdabcca7d10e8d /home/zuul/container-builds/bdbc6568-406f-4d09-b1af-52f524b859fa/base/os/neutron-base" returned: 0 in 295.661s08:46
ysandeepSystemError: The following jobs were incomplete:08:47
ysandeepI think i have seen that somewhere in upstream earlier, checking bugs08:47
chandankumarin current logs , it failed at base/keepalived" returned: 1 08:48
ysandeepchandankumar, search base/keepalived" returned: 0 in same file08:49
ysandeepchandankumar, same happened in my logs - where neutron failed.. I was looking at different log where neutron is failing..08:49
chandankumarysandeep: yes08:50
ysandeepchandankumar, fyi.. another example I am looking at: https://sf.hosted.upshift.rdu2.redhat.com/logs/25/317225/4/check/tripleo-ci-rhel-8-content-provider-rhos-16.2/d2cd53a/logs/undercloud/home/zuul/container_image_build.log 08:50
chandankumarthen something else is causing it08:50
akahat|roverjpodivin, o/ looks like os-net-config is not getting installed on overcloud. I couldn't see that package installed in overcloud node: 08:51
akahat|roverhttps://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_d4f/835837/1/check/tripleo-ci-centos-8-containers-multinode/d4fe634/logs/subnode-1/var/log/extra/package-list-installed.txt08:51
akahat|roverthis is old success job where os-net-config is getting installed: https://e09fc8988ef3a7f5d12b-01a80a447b6e4e9a4734ae7a7e6b5d1e.ssl.cf2.rackcdn.com/835837/1/check/tripleo-ci-centos-8-containers-multinode/422b9d1/logs/subnode-1/var/log/extra/package-list-installed.txt08:52
jpodivinakahat|rover: I see. I'm running a recheck, as it only happened once so far. 08:57
jpodivinBut I'm bit at loss at what could be causing this.08:57
akahat|roveryeah.. i'm also looking for it.08:58
jpodivinI suppose a repo might have been to blame. 08:58
jpodivinIf it didn't provide it for some reason.08:58
jpodivinI'll have to drop now, laptop is giving me trouble, but I'll be back soon. 08:59
chandankumarysandeep: can we revert the patch and try with old parent and see how it looks?08:59
chandankumarthere is no logs available from previous parent09:00
ysandeepchandankumar, let me hold a node and see if I can debug it, otherwise we can go that route.09:00
chandankumarok09:00
*** ysandeep is now known as ysandeep|lunch09:07
*** rlandy|out is now known as rlandy10:24
rlandybhagyashris: hello ... reading back on scrum10:25
rlandybhagyashris: is it on friday now?10:25
rlandyjm1: hello 10:27
rlandypls post a link and the time to your PTG session10:27
rlandyso everyone one the team can join10:27
rlandyysandeep|lunch: hello - are we all set with container deletes?10:29
rlandyakahat|rover: let's sync10:29
*** ysandeep|lunch is now known as ysandeep10:31
mariosrlandy: you can find everything there https://ptg.opendev.org/ptg.html10:32
ysandeeprlandy, yes we have deleted all the old containers in all the 3 downstream namespaces.10:32
mariosrlandy: click on the topic and it gives you link to zoom 10:32
rlandymarios: ack - would like everyone to see the session10:32
mariosrlandy: 1300 UTC in now+2.5 hours 10:33
rlandyysandeep: 16.2 promoted yesterday10:33
rlandyysandeep: going to try clear all components again today10:33
chandankumarysandeep: i donot know something magic happened, content provider passed10:33
rlandyand then promote again on friday10:33
rlandyysandeep: will try promote 17 on rhel 9 today10:34
ysandeepchandankumar, nice, One less issue to worry about10:34
rlandyysandeep: left you the BZ link for failing network10:34
ysandeeprlandy, yes saw that.. fix is merged, I am waiting for new tripleo-ansible to promote10:34
ysandeeprlandy, container build in integration line is passing now10:35
rlandyysandeep: yep = that is a good thing10:35
rlandywill update cix10:35
rlandyhttps://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-7-content-provider&skip=010:35
rlandythought we cleared this10:35
rlandyysandeep: can you add the container prune to toolbox before you are on vacation?10:36
ysandeeprlandy, Is it okay if I left my c7 test box running, add script in cron for the timebeing.. 10:37
ysandeepthat role was written for c7.. Need some changes for c8.. I will try to do that tomorrow.. if it takes time - I will let it run from c7 test box - will add details in infra-doc.10:38
ysandeepand migrate to our internal toolbox - once I am back10:38
rlandyysandeep: ack - ok10:39
ysandeeprlandy, have a quick question regarding containers, if you have a minute: meet.google.com/wfb-pgwq-orh 10:40
rlandyone sec10:40
rlandychandankumar: jm1: akahat|rover: when do you want to ruck rover sync?10:40
rlandyafter jm1's session?10:40
chandankumaryes10:41
rlandyok10:41
rlandyakahat|rover: let's look into the two failing victoria jobs so we can promote10:41
marioschandankumar: ysandeep: rlandy: in your own time please check https://review.opendev.org/c/openstack/tripleo-ci/+/836803 10:41
rlandyakahat|rover, : pls ping when you are around10:41
rlandyysandeep: joining10:41
bhagyashrisrlandy, yes10:58
rlandybhagyashris: I see the invite - thank you11:00
ysandeepmarios, ack11:01
rlandychandankumar: what was up with the content-provider?11:02
chandankumarrlandy: downstream content provider was failing with random error returning exit status 1 11:03
chandankumarnow it is working fine11:04
chandankumarrlandy: ysandeep may be we can add a periodic job for downstream content provider, just to keep an eye11:04
chandankumaras rhos-release does not receive much patches, so we might not have much idea when it will stop working11:05
ysandeepchandankumar: that's a nice suggestion,  just content-provider or do you want us to add other check jobs as well?11:06
chandankumarysandeep: any other dependent check job running against rhos-release11:06
ysandeepchandankumar: frequency - weekly?11:07
chandankumarysandeep: weekly would be fine11:07
chandankumaror do we have a pipeline where we run twice or thrice a week11:07
chandankumarwe can put it there11:08
ysandeepchandankumar, I am out after tomorrow for a week, I will do that once I am back/or I will add in new sprint planning.11:08
chandankumarysandeep: please add it in sprint planning, someone can take care11:08
ysandeepchandankumar, current sprint?11:09
chandankumarysandeep: yes11:09
chandankumarmay be as a other issues11:10
chandankumarif someone is free, they will pick it11:10
ysandeepchandankumar, we have one story: Update coverage against rhos-release -> let me add there11:11
chandankumarsure!11:11
chandankumarthanks :-)11:11
*** dviroel|afk is now known as dviroel\11:13
*** dviroel\ is now known as dviroel11:13
ysandeepchandankumar: fyi.. https://issues.redhat.com/browse/TRIPLEOCI-97311:16
ysandeepanyone knows what happened with http://dashboard-ci.tripleo.org/ ?11:20
chandankumarysandeep: it is working on my end11:21
chandankumarysandeep: any specific issue you are seeing?11:21
ysandeepseeing this:_11:21
ysandeep~~~11:21
ysandeepIf you're seeing this Grafana has failed to load its application files11:21
ysandeep1. This could be caused by your reverse proxy settings.11:21
ysandeep~~~11:21
chandankumarysandeep: found this on internet https://community.grafana.com/t/https-reverse-proxy-in-nginx/5865411:24
chandankumaryou are running devel cockpit instance locally also?11:24
chandankumari am not sure local setup has anything to do with above url11:25
ysandeepnot running locally11:26
ysandeepchandankumar: if its working for you, may be some local issue on my side.. I will check that.11:26
rlandyworks for me11:26
ysandeepfyi.. I am hitting something like this https://image.psi.redhat.com/view/Cg7xfMUng - I will debug that.. thanks for checking chandankumar rlandy 11:28
akahat|roverrlandy, o/11:45
akahat|roverrlandy, you want me to promote victoria?11:45
rlandyakahat|rover: let's chat11:45
rlandyI was looking into the errors - but got distracted11:45
rlandyakahat|rover: https://meet.google.com/zkm-unvt-fqj?pli=1&authuser=011:46
jpodivinakahat|rover: I'm closing the https://bugs.launchpad.net/tripleo/+bug/1968132 Job is now passing and the bug is no longer present. Whatever it may have originally been. 12:10
*** amoralej is now known as amoralej|lunch12:11
akahat|roverjpodivin, ack.12:15
rlandyakahat|rover: master has another case of the sporadic container update12:16
* rlandy updates CIX12:16
*** ysandeep is now known as ysandeep|afk12:17
dviroelmarios: i was about to ask you about freeze graph in scenario004 - but I found your patch already12:18
dviroelmarios: hitting experimental on manila too - https://review.opendev.org/c/openstack/manila/+/810953/60#message-c83a39b5172a6d95ed5b5a64bc1cbedc8190d8d312:18
mariosdviroel: ack yeah i noticed it on code search ... should fix if you add depends on can you try? 12:21
mariosdviroel: oh its experimental so no block there thanks12:22
marioshttps://codesearch.opendev.org/?q=tripleo-ci-centos-8-scenario004-standalone&i=nope&literal=nope&files=&excludeFiles=&repos=12:23
mariosalso networking-bgpn12:23
dviroelack, will try on a DNM change12:23
mariosdviroel: thanks12:25
rlandyarxcruz: hey  pls join internal IRC12:25
arxcruzrlandy sec12:27
rlandymarios: https://bugs.launchpad.net/tripleo/+bug/1967788 - are we good here now?12:28
mariosrlandy: yes should be done12:29
rlandygreat - thanks12:29
rlandyhttps://bugs.launchpad.net/tripleo/+bug/1967788 - still open12:29
mariosrlandy: done12:29
rlandythanks12:30
dviroel@team, when you have some time, pls check these notes about ceph promotion pipeline - we can discuss about that in a meeting afterwards.12:36
dviroelhttps://hackmd.io/9piYrKSwSTGe35XdzCnZ1w12:36
*** chem is now known as Guest140112:40
rlandydviroel: ++ nice - pls present at tomorrow's scrum12:43
dviroelrlandy: ok, good idea12:44
rlandybhagyashris: hey - need to coordinate with you and pooja re: teardown12:47
rlandyI have some patches that are w-112:47
bhagyashrisrlandy, sure12:53
bhagyashrisrlandy, should we meet now?12:55
rlandybhagyashris: maybe after scrum on friday 12:55
rlandywe might cover it then12:55
bhagyashrisrlandy, sure 12:55
rlandynow is jm1's session12:55
rlandyarxcruz: rcastillo: frenzy_friday: ^^ pls join session12:56
mariosarxcruz: https://ptg.opendev.org/ptg.html13:02
mariosclick on the session 13:02
mariosit opens zoom13:02
marios??13:02
mariosprofit13:02
rlandylol13:02
arxcruznot working :/13:03
*** amoralej|lunch is now known as amoralej13:04
marios        * https://etherpad.opendev.org/p/aom-zed-ptg 13:05
mariosarxcruz: fyi ^^ 13:06
mariosarxcruz: also, mute13:06
mariosi hear the ping13:06
mariosk now i don't13:06
marios:D13:06
*** ysandeep|afk is now known as ysandeep13:06
* dviroel another ptg session13:46
rlandyysandeep: I don;t see FTBFS on CIX anymore14:04
ysandeeprlandy, its solved now14:04
ysandeeprlandy: I was about to recheck jobs but I noticed some jobs failing in downstream zuul14:05
rlandyyep14:05
ysandeeprlandy, checkout this https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/build/7d17bf13c16940a9aabf03dfe310b5be14:05
ysandeepError: Failed to update project ansible-collections/ansible.utils14:05
ysandeepfor different projects:-14:05
ysandeepError: Failed to update project openstack/tripleo-ci14:05
ysandeepeach job is failing on different project.14:05
chandankumarysandeep: we have seen this error in the upstream few times, it comes and goes14:10
ysandeepchandankumar: thanks, I have pinged on internal channel if infra can find something.14:13
dviroelrlandy: akahat|rover - dasm will be out for the next hours, I will cover him during this period14:14
*** dviroel is now known as dviroel|ruck14:14
rlandydviroel|ruck: thanks - pls see tristan is EoD today for infra14:15
akahat|roverdviroel|ruck, thanks. i'll be around if you need anything.14:15
ysandeepjm1++ sshnaidm++ 14:18
chandankumarjm1++ sshnaidm++ nice done , thank you :-)14:18
chandankumar*nicely14:18
mariosgood session thanks folks 14:18
jm1team, thank you all for joining, was a nice ptg :)14:19
chandankumarakahat|rover: rlandy do we want to do a handover? or I will take the stuff from hackmd as we spoke earlier14:20
rlandychandankumar: ack  if you want to14:20
rlandydasm|off is out14:20
rlandyso I think you pretty much have the info14:21
chandankumarrlandy: yes, I do14:21
rlandychandankumar: I will update the hakcmd at my EoD14:21
chandankumarok let's skip it14:21
rlandychandankumar: you can start a new hackmd tomorrow14:21
chandankumarif anything needed I will ping akahat|rover tomorrow, get it rolling14:21
akahat|roverchandankumar, dviroel|ruck validation rpm is not getting build: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_380/834872/3/gate/tripleo-ci-centos-8-content-provider/38028a9/logs/undercloud/home/zuul/dlrn.log14:23
akahat|roverhttps://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_9ad/834873/4/gate/tripleo-ci-centos-8-content-provider/9ade3ff/logs/undercloud/home/zuul/dlrn.log14:23
akahat|roverhttps://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-8-content-provider&skip=014:23
chandankumarakahat|rover: let me check14:24
dviroel|ruckakahat|rover: chandankumar http://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_380/834872/3/gate/tripleo-ci-centos-8-content-provider/38028a9/logs/undercloud/home/zuul/DLRN/data/repos/component/validation/f4/5d/f45d9e1d8f02249cfa4be735006e83229131b491_dev/rpmbuild.log14:24
dviroel|ruck"No matching package to install: 'python3-setuptools >= 50.3.0'"14:24
chandankumarpython3-setuptools-39.2.0-6.el8.noarch.rpm is available in c814:25
chandankumarfrom where this version is coming14:25
chandankumarhttps://pkgs.org/download/python3-setuptools14:25
chandankumarakahat|rover: branch?14:26
akahat|roverchandankumar, stable/victoria14:26
chandankumaras per spec file https://github.com/rdo-packages/validations-common-distgit/blob/victoria-rdo/validations-common.spec14:30
chandankumarthat version is not defined14:30
dviroel|ruckyep14:31
chandankumarhttps://zuul.openstack.org/status#83487214:31
chandankumarif you seen the chain14:31
chandankumaron this patch https://review.opendev.org/c/openstack/python-tripleoclient/+/835837/ why https://review.opendev.org/c/openstack/validations-common/+/834700/ is getting included14:31
chandankumaron sorry there was a depend son14:32
*** abregman is now known as abregman|afk14:36
chandankumarhttp://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_380/834872/3/gate/tripleo-ci-centos-8-content-provider/38028a9/logs/undercloud/home/zuul/dlrn.log14:37
chandankumar2022-04-07 13:19:47 | 2022-04-07 13:19:47,831 INFO:dlrn-repositories:Falling back to rpm-master14:38
dviroel|ruckhuuuum14:38
chandankumarhttps://github.com/rdo-packages/validations-common-distgit/blob/rpm-master/validations-common.spec#L3414:38
chandankumarBuildRequires:  python3-setuptools >= 50.3.014:38
chandankumarhttps://github.com/rdo-packages/validations-common-distgit/commit/3ce363a0378c2b96cb487ca4a59499ec9e31fd3114:38
chandankumar2022-04-07 13:19:47 | 2022-04-07 13:19:47,167 INFO:dlrn-repositories:Getting https://github.com/rdo-packages/validations-common-distgit.git to ./data/validations-common_distro (1.6-rdo)14:40
chandankumarIt looks for (1.6-rdo)14:40
chandankumarwhich does not exists14:40
chandankumarin rdo distgit14:40
chandankumarthere are two solutions14:40
akahat|rover1.6 is exists in validations-libs repo: https://opendev.org/openstack/validations-libs/commits/branch/stable/1.614:41
chandankumar1. propose a change to python3-setuptools >= 50.3.0 to >= 39.2.014:41
chandankumaror we need to fix it in our side 14:41
rlandyakahat|rover: pls raise a LP for this14:41
rlandyso we can log the fix14:41
akahat|roverrlandy, okay14:42
chandankumarakahat|rover: i know the issue https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/build-test-packages/tasks/dlrn-build.yml#L2514:47
chandankumarproposing a fix14:47
akahat|roverdviroel|ruck, chandankumar https://bugs.launchpad.net/tripleo/+bug/196818414:48
rlandyakahat|rover: https://bugs.launchpad.net/tripleo/+bug/1968184 pls add release milestone, importance14:49
rlandycritical 14:49
rlandyotherwise it won't raise a CIX14:49
chandankumarakahat|rover: rlandy dviroel|ruck https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/83698815:10
chandankumarplease put it as a depends on python-tripleoclient patch15:10
rlandychandankumar: thanks looking15:11
rlandydviroel|ruck: ^^ you ok with that? if so we can +2 and merge to clear gates15:14
chandankumarjpodivin: if ok, can I update this patch https://review.opendev.org/c/openstack/python-tripleoclient/+/835837/ with depends-on https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/836988 ?15:15
chandankumargate job has failed anyway15:15
dviroel|ruckrlandy: i we can go with chandankumar approach and add as depends-on15:16
rlandylet see if we get rebase15:16
jpodivinchandankumar: sure, if you want to that would be great.15:17
chandankumarjpodivin: thanks!15:18
chandankumarrlandy: dviroel|ruck done!15:18
dviroel|rucktks!15:18
rlandynice15:18
rlandychandankumar++15:19
jpodivinchandankumar: nope, it's I who should be grateful :) 15:19
chandankumarjpodivin: :-)15:19
chandankumarsee ya people!15:27
dviroel|rucko/15:27
rcastilloo/15:27
* dviroel|ruck lunch brbr15:28
*** dviroel|ruck is now known as dviroel|ruck|lunch15:28
*** ysandeep is now known as ysandeep|out15:34
*** jpena is now known as jpena|off16:05
*** dviroel|ruck|lunch is now known as dviroel|ruck16:13
rlandydviroel|ruck: hey 16:37
rlandydviroel|ruck: concentrating on some downstream stuff now16:37
rlandyupstream promotions are fine16:37
rlandyjust wanted to get master promoted16:37
rlandylooking at what16:37
rlandys missing there16:38
dviroel|ruckrlandy: rerunning previous failed jobs16:38
rlandydviroel|ruck: lots of sporadic container updates failures16:39
rlandycommented on the open CIX16:39
rlandyjust kicked again16:40
rlandyso we'll see16:40
dviroel|ruckwill try fs029 again16:40
dviroel|ruck39*16:40
rlandytripleo component on wallaby c8 is lagging - should also rekick shortly16:41
dviroel|ruckwill go through upstream component lines then16:43
dviroel|rucknot bad17:06
*** amoralej is now known as amoralej|off17:08
* dviroel|ruck coffee18:30
*** dasm|off is now known as dasm18:42
dasmdviroel|ruck: o/ i'm here!18:42
dviroel|ruckdasm: o/18:51
dasmdviroel|ruck: do you need any immediate help? 18:51
dasmif not, i'll devote my time to rr script for some improvements18:52
dviroel|ruckdasm: don't think so, we have a new bug (stable/victoria) with a proposed fix https://bugs.launchpad.net/tripleo/+bug/196818418:53
dasmack18:54
dviroel|ruckdasm: downstream failing to build containers18:54
dasmagain?18:54
dasmi thought we're past that18:54
dasmor is it still the same thing?18:54
dviroel|rucknot aware of previous issues, but the current fix is to replace container base image, but just saw that failed to login into registry18:55
dviroel|ruckrlandy: containers build failed to login into that registry18:56
dviroel|ruckrlandy: not sure if we have a token/secret for that one18:57
dasmack19:00
rlandydviroel|ruck: no19:03
rlandywe need to switch it19:03
rlandyit is not needed for the 16.2 promotion right away19:04
rlandywill work on it more tomorrow19:04
rlandychandankumar: fyi ... if you are ok with https://review.opendev.org/c/openstack/tripleo-quickstart/+/836104, pls merge in your morning19:13
rlandyand we can follow the fallout19:13
rlandymarios and I both +2'ed this19:13
rlandytestprojects look good19:13
rlandyjpodivin: ^^ pls also review19:14
rlandydviroel|ruck: dequeueing and re starting stable 419:28
dviroel|ruckrlandy: ack - will try again previous hash, missing two jobs19:32
rlandydviroel|ruck: train promoted earlier this morning19:33
rlandyso not too bad19:33
rlandyas long as components are clean we're good19:33
rlandyfocused on downstream components right now19:33
dviroel|ruckack - train components are clear19:34
*** rlandy is now known as rlandy|mtg19:53
dviroel|ruck"did not get container create message from subprocess: read |0: i/o timeout"20:05
dviroel|ruckhttps://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-scenario007-standalone-master/8d5ca73/logs/undercloud/var/log/tripleo-container-image-prepare.log.txt.gz20:05
dviroel|ruckrlandy|mtg: take a look afterwards https://github.com/containers/podman/issues/1332720:26
rlandy|mtgdviroel|ruck: just joining next meeting - will look afterwards20:27
dviroel|ruckrlandy|mtg: fix on buildah merged https://github.com/containers/buildah/commit/bc5080ccdd742f7e24535ba2fc3fbf2acd3ba6b920:27
dviroel|ruckrlandy|mtg: sure20:28
dviroel|ruckwill add this to LP Bug20:28
rlandy|mtgcool - will read back20:28
dviroel|ruckhere: https://bugs.launchpad.net/tripleo/+bug/1964129/comments/1120:37
dviroel|ruckadded a comment on CIX card20:37
* dviroel|ruck need to go afk, my turn on dinner today20:38
*** dviroel|ruck is now known as dviroel|afk20:39
rlandy|mtgnp21:10
*** rlandy|mtg is now known as rlandy21:17
* dasm signs off for today! Have a good one!22:44
*** dasm is now known as dasm|off22:44
rcastilloheading out for the day o/23:50

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!