| *** dviroel|out is now known as dviroel | 00:21 | |
| rcastillo | rlandy: fix didn't work :/ I'll poke around a bit more | 00:23 |
|---|---|---|
| rlandy | rcastillo: jakob will need to revert his patch then - ls comment on the bug | 00:31 |
| rlandy | I'm out | 00:31 |
| *** rlandy is now known as rlandy|out | 00:31 | |
| rcastillo | rlandy: talk to you tomorrow | 00:31 |
| rlandy|out | ysandeep|out: ^^ pls ask jakob to revert his patch ASAP | 00:34 |
| rlandy|out | we are broken everywhere with no ability to revert | 00:34 |
| rlandy|out | rcastillo: I am putting in a revert in the mean time | 00:45 |
| rlandy|out | https://review.opendev.org/c/openstack/ansible-collections-openstack/+/843192 | 00:46 |
| rlandy|out | sshnaidm: ^^ if any any chance you are around | 00:47 |
| rlandy|out | this is a break change | 00:47 |
| rlandy|out | we need it out now | 00:47 |
| rcastillo | rlandy|out: ack | 00:47 |
| dviroel | no powers there :( | 00:47 |
| rlandy|out | rcastillo: also - w need tripleo testing on these patches | 00:47 |
| rlandy|out | dviroel: me neither | 00:47 |
| * rlandy|out getting rcastillo powers ASAP | 00:47 | |
| dviroel | :) | 00:47 |
| rlandy|out | not really out | 00:48 |
| rlandy|out | nothing I can do to help here | 00:48 |
| *** dviroel is now known as dviroel|out | 01:24 | |
| *** rcastillo_ is now known as rcastillo | 02:56 | |
| *** ysandeep|out is now known as ysandeep|rover | 04:35 | |
| ysandeep|rover | folks o/ please hold recheck/+w today looks like everything is on fire because of https://bugs.launchpad.net/tripleo/+bug/1975646 | 04:51 |
| *** ysandeep|rover is now known as ysandeep|rover|brb | 05:25 | |
| *** ysandeep|rover|brb is now known as ysandeep|rover | 05:32 | |
| jm1 | ysandeep|rover, marios: hey hey :) | 06:21 |
| ysandeep|rover | jm1, hey o/ | 06:21 |
| ysandeep|rover | I was waiting for you :D | 06:21 |
| jm1 | looks like tripleo is not safe from sdk update ;) | 06:21 |
| ysandeep|rover | yeah we broke everything: https://bugs.launchpad.net/tripleo/+bug/1975646 | 06:22 |
| jm1 | ysandeep|rover: saw it | 06:22 |
| jm1 | ysandeep|rover: will revert it for now but we have to think about a solution | 06:22 |
| jm1 | ysandeep|rover: funny thing is, our tripleo related jobs passed. else i would not have merged that one | 06:23 |
| ysandeep|rover | +1 for revert while we investigate why we not using correct branch for aoc in our jobs | 06:24 |
| ysandeep|rover | hmmm that's interesting.. we have some difference in testing then between what we run in aoc check vs what actually run in tripleo jobs elsewhere | 06:25 |
| marios | o/ jm1 rcastillo posted some patches to pin to stable 1 but probably we need both revert first then the pin or similar can merge then you can remerge your patch | 06:25 |
| jm1 | ysandeep|rover, marios: revert is +w'ed | 06:36 |
| ysandeep|rover | jm1++ great, thanks! | 06:37 |
| jm1 | marios, ysandeep|rover: did downstream ship code that pulled in master branch of aoc or is this only related to tripleo ci? | 06:37 |
| ysandeep|rover | https://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel9-osp17/component/clients/current/ - ansible-collections-openstack-1.8.0-0.20220513060934.5bb8312.el9osttrunk.noarch.rpm is the latest what we have in downstream | 06:39 |
| jm1 | ysandeep|rover: this issue right now is unrelated to rpm's, because we fixed rpm's, didn't we? | 06:40 |
| ysandeep|rover | yeah, we added a pin for aoc | 06:40 |
| jm1 | ysandeep|rover: so this issue is only in tripleo ci, right? | 06:40 |
| ysandeep|rover | jm1, customer's only use rpm, so iiuc. this issue is in ci only because we use galaxy install in quickstart.sh | 06:42 |
| ysandeep|rover | customers* | 06:42 |
| jm1 | ysandeep|rover: ack. once Rafael's patch has landed, can we reapply my patch? | 06:46 |
| jm1 | ysandeep|rover: we already started applying backward incompatible patches to master branch so tripleo had luck not to be hit by this earlier. but hey, at least you knew pretty fast who cased that.looks like my warning worked as intended 🙈 | 06:48 |
| * jm1 ducks and runs | 06:48 | |
| jm1 | *caused | 06:48 |
| ysandeep|rover | yeah I think so but before merging back, imho.. it would be good that we confirm we are actually using correct version of aoc - may be depending on rafael's patch we can run some testproject/hold node and see we are using correct branch of aoc | 06:51 |
| jm1 | ysandeep|rover: sure, we need some test first | 06:51 |
| jm1 | ysandeep|rover, marios: btw we probably hit this issue again faster than expected. saw some discussion yesterday about new sdk being released with zed :/ | 06:52 |
| marios | jm1: is the plan for the new sdk to be only for master right? (i.e. we should be OK to pin to stable/1 for now?) | 06:54 |
| jm1 | marios: sdk follows openstack releases (for now), so new sdk wont hit older openstack releases like wallaby. but it will (might) be in zed and later releases | 06:56 |
| ysandeep|rover | frenzyfriday, when you are in could you please check why master containers are missing all of sudden : https://bugs.launchpad.net/tripleo/+bug/1975671 | 07:00 |
| *** jpena|off is now known as jpena | 07:33 | |
| *** ysandeep|rover is now known as ysandeep|rover|lunch | 07:44 | |
| jm1 | ysandeep|rover|lunch, marios: will send you a link via pm which might need to be fixed as well | 07:51 |
| jm1 | ysandeep|rover|lunch, marios: looks like aoc is used more places than initially thought. the issue of today shows that it is used in openstack-ansible-os_tempest although this role does not indicate its dependency on aoc as far as i can see | 08:07 |
| jm1 | ysandeep|rover|lunch, marios, rlandy|out: added a jira card to do a survey where aoc is used in tripleo etc. for a start perhaps arx can have a look at os_tempest because he knows tempest best | 08:29 |
| jm1 | https://issues.redhat.com/browse/TRIPLEOCI-1064 | 08:29 |
| *** ysandeep|rover|lunch is now known as ysandeep|rover | 08:33 | |
| marios | jm1: ack | 08:39 |
| jm1 | ysandeep|rover, marios: aoc patch reverted, go and fix tripleo ;) | 09:11 |
| ysandeep|rover | patch reverted - nice | 09:12 |
| ysandeep|rover | jm1, go and fix tripleo - i think it will be autofixed soon, do we need anything else on our side? | 09:12 |
| marios | ysandeep|rover: jm1: i think we will want to go with rcastillo patches and pin to stable/1.0? | 09:13 |
| jm1 | ysandeep|rover: no idea, added a couple of jira cards to look at several tripleo related repos. the reverted patch was the safest approach to discover issues because it highlights all uses. | 09:14 |
| marios | ysandeep|rover: jm1: since you aoc will want to revert revert soon right? | 09:14 |
| marios | re 11:29 < jm1> ysandeep|rover|lunch, marios, rlandy|out: added a jira card to do a survey where aoc is used in tripleo etc. for a start perhaps arx can have a look at os_tempest because he knows tempest best | 09:14 |
| ysandeep|rover | marios, ahh you mean to revert the revert .. | 09:14 |
| marios | i thought we already had a handle on that but if not then we should do it for sure | 09:14 |
| marios | ysandeep|rover: yeah i think they will want to re merge that and update the sdk for master branch | 09:15 |
| ysandeep|rover | ack | 09:15 |
| ysandeep|rover | jm1, we can chat with rcastillo once he is here and thanks for adding those jira cards | 09:16 |
| ysandeep|rover | frenzyfriday, let's sync meet.google.com/fkh-dqdp-qbm | 09:16 |
| ysandeep|rover | frenzyfriday|ruck, ^^ | 09:18 |
| ysandeep|rover | marios, chandankumar do you recall for how long we used to retain our containers in registry? | 10:03 |
| ysandeep|rover | I recall we had some logic to retain human readable hash containers(like for current-tripleo) indefinitely - but not sure on this. | 10:04 |
| jm1 | ysandeep|rover: Ronelle send a mail about openstacksdk and holding rechecks to openstack-discuss ml yesterday. not sure what the tripleo ci status is atm but since we reverted the patch, you might want to send a response to that mail? | 10:07 |
| ysandeep|rover | jm1, I will but waiting for one green run - we have a tripleo-ci job in rerun | 10:08 |
| jm1 | ysandeep|rover: okay great, thanks! | 10:10 |
| frenzyfriday|ruck | hey dpawlik 0/ good morning, need some help with an issue in the quay registry when you get some time | 10:13 |
| ysandeep|rover | jm1: wohoo we are back to green ... one of scheduled beat our testproject - we are back to green | 10:13 |
| ysandeep|rover | https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-9-scenario007-standalone-master&skip=0 | 10:13 |
| * ysandeep|rover updating email thread on discuss list | 10:13 | |
| frenzyfriday|ruck | dpawlik: The check and component jobs are failing because hash 14ee273e8565960cf6d5b6e26ae92ade is missing. This is an old hash from may16 (there was no promotion after this so this is the hash picked up by the jobs) This was deleted today morning by the pruner I think. But in trunk.registry.rdoproject i stull see the hash. is the pruner logic different in quay? | 10:15 |
| frenzyfriday|ruck | ysandeep|rover, the hash is still there in trunk.registry.rdoproject. I am trying to copy back to quay | 10:16 |
| marios | ysandeep|rover: o/ not off hand i don't recall | 10:17 |
| marios | ysandeep|rover: but that script (cleanup) has been changed a few times so probably dpawlik is the best person to ask about it | 10:17 |
| ysandeep|rover | marios: okay, thank you, yeah frenzyfriday|ruck just pinged daniel about the issue | 10:18 |
| * dpawlik reading | 10:19 | |
| ysandeep|rover | dpawlik, basically somehow current-tripleo hash containers got purged | 10:20 |
| ysandeep|rover | I am not 100% sure but I recall if we had some logic to retain human readable hash containers(like for current-tripleo) indefinitely | 10:21 |
| dpawlik | ack. Will check that issue after lunch, ok? | 10:21 |
| ysandeep|rover | dpawlik: sure, thank you | 10:22 |
| *** rlandy|out is now known as rlandy | 10:23 | |
| rlandy | jm1: frenzyfriday|ruck: arxcruz: need to chat with you guys | 10:26 |
| rlandy | https://meet.google.com/neg-cfyx-upy?pli=1&authuser=0 | 10:26 |
| rlandy | ysandeep|rover: ^^ | 10:26 |
| jm1 | rlandy: ack, will join, but only have ten minutes (can chat longer later) | 10:28 |
| rlandy | it's fine | 10:28 |
| rlandy | we only need 10 mins | 10:28 |
| *** arxcruz is now known as arxcruz|off | 10:52 | |
| * frenzyfriday|ruck rechecking fence and openstacksdk gate failures | 11:09 | |
| dpawlik | frenzyfriday|ruck: the missing hash in quay is for which project? | 11:13 |
| frenzyfriday|ruck | dpawlik, tripleomastercentos9 | 11:14 |
| rlandy | dpawlik: hey - per ysandeep|rover's suggestion, can we keep the the hash the human-readable hash resolves to as well? | 11:16 |
| rlandy | frenzyfriday|ruck: ysandeep|rover: https://bugzilla.redhat.com/show_bug.cgi?id=2089724 is on tripleo-ansible | 11:20 |
| rlandy | moving to openvswitch | 11:20 |
| dpawlik | rlandy: what does it mean? | 11:20 |
| rlandy | dpawlik: sorry - should have explained that better .... | 11:21 |
| ysandeep|rover | rlandy, +1 to moving to openvswitch | 11:21 |
| rlandy | dpawlik: https://trunk.rdoproject.org/centos9-master/current-tripleo/delorean.repo.md5 | 11:21 |
| rlandy | every release has a hash that resolves to current-tripleo, tripleo-ci-testing etc. | 11:22 |
| rlandy | human readable hashes | 11:22 |
| rlandy | we lost the master hash since we have not promoted in 9 days | 11:22 |
| rlandy | iiuc, we keep the human readable hashes | 11:22 |
| rlandy | ie: current-tripleo | 11:22 |
| rlandy | but not the containers that have the hash referenced by that human-readable hash? | 11:23 |
| rlandy | ie: https://trunk.rdoproject.org/centos9-master/current-tripleo/delorean.repo.md5 | 11:23 |
| dpawlik | hmm | 11:24 |
| frenzyfriday|ruck | rlandy, oh right! thanks | 11:25 |
| dpawlik | rlandy: so if I understand correctly, you want for example that image: quay.rdoproject.org/tripleomaster9/openstack:14ee273e8565960cf6d5b6e26ae92ade will also be pointed to quay.rdoproject.org/tripleomaster9/openstack:current-tripleo right? | 11:27 |
| rlandy | dpawlik: exactly - is that possible? | 11:29 |
| dpawlik | rlandy: it is, but best way is to tag same image and push once again | 11:29 |
| dpawlik | I mean, when you are doing container iamge with podman built -t quay.rdoproject.org/tripleomaster9/openstack:14ee273e8565960cf6d5b6e26ae92ade -f Dockerfile | 11:30 |
| dpawlik | then do podman tag quay.rdoproject.org/tripleomaster9/openstack:14ee273e8565960cf6d5b6e26ae92ade quay.rdoproject.org/tripleomaster9/openstack:current-tripleo | 11:30 |
| *** dviroel|out is now known as dviroel | 11:30 | |
| dpawlik | IMHO | 11:30 |
| dpawlik | but I will check if it can be done via Quay API | 11:30 |
| dpawlik | about the deleted hash, I don't see such information in the quay pruner | 11:31 |
| dpawlik | that this image should be deleted... so it is strange | 11:31 |
| dpawlik | I can restore the hash | 11:31 |
| dpawlik | Quay keep few days deleted images in the history | 11:31 |
| rlandy | dpawlik: awesome - if you can restore it will save frenzyfriday|ruck from copying it back | 11:32 |
| frenzyfriday|ruck | dpawlik, yeah, i saw a restore button, I was not sure if I am supposed to use that | 11:32 |
| ysandeep|rover | >> Quay keep few days deleted images in the history - that's a nice feature | 11:32 |
| ysandeep|rover | but will next run of pruner script not delete that hash again? | 11:33 |
| dpawlik | ah, I see in the repo history: | 11:33 |
| dpawlik | Tag 14ee273e8565960cf6d5b6e26ae92ade set to expire on May 25, 2022 3:00 AM , Tue, May 24, 2022 3:00 AM by pruner on behalf of tripleo | 11:33 |
| dpawlik | frenzyfriday|ruck: you can | 11:33 |
| dpawlik | frenzyfriday|ruck but it will be a lot clicking | 11:34 |
| * dpawlik checking if I can do it via API | 11:34 | |
| frenzyfriday|ruck | yeah :D better to do it with the api | 11:34 |
| dpawlik | ysandeep|rover: normally it should be skipped | 11:34 |
| dpawlik | now I know when to check in pruner logs | 11:35 |
| dpawlik | and I see that it was not whitelisted | 11:35 |
| rlandy | ysandeep|rover: here we go again ... 16.2.4 June 22 | 12:02 |
| ysandeep|rover | rlandy: :D | 12:08 |
| rlandy | frenzyfriday|ruck: hey - looks like you rechecked failed gate patches - thank you | 12:19 |
| frenzyfriday|ruck | yep, fence and openstacksdk rechecked, will keep an eye on them if they fail again | 12:19 |
| rcastillo | o/ hi team | 12:25 |
| ysandeep|rover | rcastillo: hello o/ and congrats to new aoc core :D | 12:26 |
| rcastillo | :o | 12:29 |
| rcastillo | seems like https://review.opendev.org/c/openstack/tripleo-ci/+/843220/ passed | 12:30 |
| rcastillo | needed https://review.opendev.org/c/openstack/tripleo-ci/+/843220/ because galaxy is weird | 12:30 |
| ysandeep|rover | frenzyfriday|ruck: ++ nicely done | 12:35 |
| frenzyfriday|ruck | :) | 12:35 |
| rlandy | frenzyfriday|ruck++ great reporting | 12:35 |
| rlandy | ysandeep|rover: frenzyfriday|ruck: need to run to complex maintenance office for a few - brb | 12:36 |
| *** rlandy is now known as rlandy|biab | 12:36 | |
| ysandeep|rover | rlandy|biab: sure, thanks for notifying | 12:36 |
| ysandeep|rover | rlandy|biab, frenzyfriday|ruck running master ovb jobs here with my revert patch as depend-on to get master promotion: https://review.rdoproject.org/r/c/testproject/+/43113 | 12:39 |
| ysandeep|rover | sc10 passed - we just need ovbs | 12:40 |
| frenzyfriday|ruck | cool, thanks! | 12:40 |
| * ysandeep|rover going on a break | 12:41 | |
| *** ysandeep|rover is now known as ysandeep|rover|afk | 12:41 | |
| dpawlik | frenzyfriday|ruck: trying to restore... | 12:50 |
| dpawlik | 0% ###### 50% 100% | 12:50 |
| frenzyfriday|ruck | dpawlik, thank you :) | 12:51 |
| *** rlandy|biab is now known as rlandy | 12:53 | |
| dpawlik | rlandy: let me know when you will have a patch set for changing the image tag to be more human readable | 12:56 |
| rlandy | ysandeep|rover|afk: thanks | 12:58 |
| rlandy | dpawlik: will discuss with frenzyfriday|ruck | 12:58 |
| frenzyfriday|ruck | ack | 13:06 |
| * frenzyfriday|ruck lunch | 13:06 | |
| dasm | o/ | 13:17 |
| dpawlik | frenzyfriday|ruck: tags restored | 13:17 |
| dpawlik | frenzyfriday|ruck: feel free to review https://softwarefactory-project.io/r/c/software-factory/python-quay-tool/+/25114 | 13:18 |
| frenzyfriday|ruck | dpawlik, thank you :D :D | 13:18 |
| dpawlik | please let me know, when you got similar issue. Hope it will be one time | 13:20 |
| dpawlik | but normally, something is not ok when it's not white listed | 13:20 |
| dasm | ysandeep|rover|afk: marios thank you for your +2s on patches. I submitted them in series, and one which got +W relies on https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/43118 | 13:22 |
| dasm | Could you check that as well to unblock the other one? Thank you! | 13:23 |
| marios | dasm: o/ will revisit on next reviews time | 13:30 |
| reviewbot | Do you want me to add your patch to the Review list? Please type something like add to review list <your_patch> so that I can understand. Thanks. | 13:30 |
| dasm | ack, thx | 13:31 |
| *** ysandeep|rover|afk is now known as ysandeep|rover | 13:31 | |
| ysandeep|rover | dasm: thanks for putting those patches, I can check them on Friday - rr keeping me busy | 13:32 |
| ysandeep|rover | dasm: +wed https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/43118 | 13:35 |
| dasm | ysandeep|rover: ack, thx | 13:36 |
| rlandy | ysandeep|rover: hi - pls see #rhos-ops | 13:48 |
| rlandy | asked to do the max servers change later | 13:48 |
| rlandy | so you can finish the master rerun | 13:48 |
| rlandy | https://review.rdoproject.org/zuul/buildset/cc0be9ce2e12457fade128a8805e9b84 | 13:51 |
| rlandy | frenzyfriday|ruck: ysandeep|rover: ^^ decent run | 13:51 |
| rlandy | worth rerunning the failed jobs there? | 13:51 |
| ysandeep|rover | rlandy, ack I will check failures and rerun if they seems transient | 13:52 |
| frenzyfriday|ruck | I might be a little late to cix | 14:11 |
| ysandeep|rover | frenzyfriday|ruck: nw, I will cover you. | 14:12 |
| ysandeep|rover | rlandy, do you have few mins to chat about vexx situation: https://meet.google.com/ovz-ewsf-ocq?authuser=0&hl=en | 14:16 |
| rlandy | ysandeep|rover: yep - joining | 14:17 |
| dviroel | @team - these are now ready to be reviewed, thanks! | 14:21 |
| dviroel | 1. https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/43126 | 14:21 |
| dviroel | 2. https://review.rdoproject.org/r/c/rdo-jobs/+/42956 | 14:21 |
| * frenzyfriday|ruck is back | 14:28 | |
| ysandeep|rover | rlandy, i can investigate https://bugzilla.redhat.com/show_bug.cgi?id=2089724 tomorrow | 14:41 |
| ysandeep|rover | rlandy, what's the use of rhos-release check jobs if they change things in background | 14:46 |
| rlandy | ysandeep|rover; have another meeting in 25 mins | 15:05 |
| rlandy | let me know if you're ok with my merging https://review.rdoproject.org/r/c/config/+/43155 | 15:05 |
| rlandy | and what you want me to pick up | 15:05 |
| ysandeep|rover | rlandy, checking right away | 15:05 |
| rlandy | ysandeep|rover: frenzyfriday|ruck'; we also need a decision on train promo | 15:05 |
| ysandeep|rover | rlandy, +wed https://review.rdoproject.org/r/c/config/+/43155 | 15:09 |
| *** dviroel is now known as dviroel|lunch | 15:09 | |
| rcastillo | brb | 15:18 |
| *** rlandy is now known as rlandy|mtg | 15:25 | |
| frenzyfriday|ruck | rlandy|mtg, ysandeep|rover did you already run the component jobs for master which failed due to missing container hash? | 15:34 |
| ysandeep|rover | frenzyfriday|ruck, will be tested here: https://review.rdoproject.org/zuul/status#836372 | 15:42 |
| ysandeep|rover | I mean to confirm if we have all the containers now - in check jobs | 15:42 |
| frenzyfriday|ruck | ysandeep|rover, ack. I am creating a testproj for the failed components. I'll run it if yours pass | 15:43 |
| ysandeep|rover | frenzyfriday|ruck, only run the components that are really lagging like security - because we are not doing great on resources | 15:43 |
| frenzyfriday|ruck | right, thats true | 15:44 |
| ysandeep|rover | frenzyfriday|ruck, lets see how this goes: https://review.rdoproject.org/r/c/testproject/+/43135/3/.zuul.yaml | 15:54 |
| ysandeep|rover | frenzyfriday|ruck, running simple standalone to get early results | 15:54 |
| ysandeep|rover | frenzyfriday|ruck, that check job failed but maybe that started earlier | 15:55 |
| ysandeep|rover | frenzyfriday|ruck, https://logserver.rdoproject.org/72/836372/3/openstack-check/tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001/f674635/logs/undercloud/home/zuul/undercloud_install.log.txt.gz | 15:55 |
| ysandeep|rover | let me try pulling that container manually in my laptop | 15:56 |
| ysandeep|rover | on* | 15:56 |
| rcastillo | back | 15:56 |
| ysandeep|rover | frenzyfriday|ruck, dpawlik looks like all the containers are not back | 15:59 |
| ysandeep|rover | http://pastebin.test.redhat.com/1054139 | 15:59 |
| * ysandeep|rover brb | 15:59 | |
| frenzyfriday|ruck | ysandeep|rover, hm.. for some repos 14ee273e8565960cf6d5b6e26ae92ade is called 14ee273e8565960cf6d5b6e26ae92ade_x86_64 | 16:00 |
| frenzyfriday|ruck | oh, that is a different tag altogether | 16:03 |
| rlandy|mtg | frenzyfriday|ruck: sorry meeting run over | 16:05 |
| rlandy|mtg | will join in 5 | 16:05 |
| frenzyfriday|ruck | sure, np | 16:05 |
| ysandeep|rover | frenzyfriday|ruck, we create both 14ee273e8565960cf6d5b6e26ae92ade_x86_64 and 14ee273e8565960cf6d5b6e26ae92ade | 16:07 |
| ysandeep|rover | frenzyfriday|ruck, but look at my test i am pulling 14ee273e8565960cf6d5b6e26ae92ade without any suffix | 16:08 |
| *** marios is now known as marios|out | 16:08 | |
| ysandeep|rover | frenzyfriday|ruck, fyi.. an example: https://logserver.rdoproject.org/openstack-periodic-integration-stable1-cs8/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-build-containers-centos-8-quay-push-wallaby/f0a7951/logs/containers-built.log | 16:09 |
| frenzyfriday|ruck | yeah, it is missing | 16:13 |
| ysandeep|rover | frenzyfriday|ruck, rlandy|mtg I will be out soon, missing container is the most redherring issue now.. patch to fix master ovb jobs merged few mins back | 16:14 |
| *** dviroel|lunch is now known as dviroel | 16:16 | |
| rlandy|mtg | ysandeep|rover: so train yes or no? | 16:16 |
| ysandeep|rover | rlandy|mtg, :) I ran the job with old hash and it failed on node_failure.. | 16:16 |
| rlandy|mtg | ok | 16:16 |
| ysandeep|rover | rlandy|mtg, have you kicked master line? | 16:17 |
| rlandy|mtg | no | 16:17 |
| rlandy|mtg | will do after meetings | 16:17 |
| ysandeep|rover | oh that's the scheduled run and failed on node_failures | 16:18 |
| ysandeep|rover | rlandy|mtg, frenzyfriday|ruck do you know since when these weirdo jobs start triggering with our lines? | 16:22 |
| ysandeep|rover | https://review.rdoproject.org/zuul/status#openstack-periodic-integration-main | 16:22 |
| ysandeep|rover | rdoinfo pipeline i mean.. it starts when our integration line triggers | 16:23 |
| ysandeep|rover | 18 jobs in that line | 16:24 |
| dpawlik | ysandeep|rover: I rerun the script | 16:28 |
| dpawlik | if those will not restore, means that it has been removed | 16:28 |
| dpawlik | I was doing the script base on quay.rdoproject.org/tripleomastercentos9/openstack-mariadb | 16:29 |
| dpawlik | and in that repository I have done restore manually via web page | 16:29 |
| dpawlik | do you have somewhere a copy of it? | 16:29 |
| dpawlik | need to go... will read tomorrow | 16:30 |
| ysandeep|rover | frenzyfriday|ruck, ^^ we have that in rdo registry right? | 16:30 |
| ysandeep|rover | rlandy|mtg, frenzyfriday|ruck let's chat for 2 mins before I eod to decide what we can do for ^^ ? | 16:31 |
| ysandeep|rover | if we don't get rdo promotion - that means rdo third part check/component lines will be hosed till then | 16:32 |
| rlandy|mtg | ysandeep|rover: sorry - off meeting | 16:33 |
| *** rlandy|mtg is now known as rlandy | 16:34 | |
| ysandeep|rover | meet.google.com/hqx-ttui-yfn | 16:34 |
| rlandy | ysandeep|rover: weird jobs sarted running when alfredo switched off ci,centos | 16:34 |
| ysandeep|rover | rlandy, https://review.rdoproject.org/r/c/testproject/+/43113 | 16:40 |
| frenzyfriday|ruck | ysandeep|rover, yeah, should be in trunk.registry.. checking | 16:41 |
| ysandeep|rover | rlandy, https://review.rdoproject.org/zuul/buildset/cc0be9ce2e12457fade128a8805e9b84 | 16:48 |
| ysandeep|rover | rlandy, https://bugs.launchpad.net/tripleo/+bug/1975588 | 16:51 |
| frenzyfriday|ruck | i'll try to copy back the containers in case we dont promote master | 16:54 |
| ysandeep|rover | frenzyfriday++ | 16:59 |
| ysandeep|rover | frenzyfriday|ruck, rlandy good luck with master promotion, see you tomorrow o/ | 16:59 |
| *** ysandeep|rover is now known as ysandeep|out | 16:59 | |
| rlandy | ysandeep|out: have a good night | 17:03 |
| frenzyfriday|ruck | hey rlandy , how do I pull example openstack-mariadb from https://trunk.registry.rdoproject.org:8443/oapi/v1/namespaces/tripleomastercentos9/imagestreamtags ? | 17:26 |
| frenzyfriday|ruck | I tried docker pull trunk.registry.rdoproject.org:8443/v1/tripleomastercentos9/openstack-mariadb:14ee273e8565960cf6d5b6e26ae92ade | 17:26 |
| frenzyfriday|ruck | Says Error response from daemon: Get https://trunk.registry.rdoproject.org:8443/v2/: x509: certificate is valid for internal.registry.rdoproject.org, kubernetes, kubernetes.default, kubernetes.default.svc, kubernetes.default.svc.cluster.local, openshift, openshift.default, openshift.default.svc, openshift.default.svc.cluster.local, registry.rdoproject.org, 172.30.0.1, 192.168.240.230, not trunk.registry.rdoproject.org | 17:26 |
| frenzyfriday|ruck | looks like only 4 image/repos have missing hash | 17:28 |
| frenzyfriday|ruck | quay.rdoproject.org/tripleomastercentos9/openstack-mariadb | 17:28 |
| frenzyfriday|ruck | quay.rdoproject.org/tripleomastercentos9/openstack-mariadb | 17:28 |
| frenzyfriday|ruck | quay.rdoproject.org/tripleomastercentos9/openstack-base | 17:28 |
| frenzyfriday|ruck | quay.rdoproject.org/tripleomastercentos9/openstack-base | 17:28 |
| frenzyfriday|ruck | quay.rdoproject.org/tripleomastercentos9/openstack-base | 17:28 |
| frenzyfriday|ruck | sorry, only 2 (script added twice) | 17:28 |
| ysandeep|out | frenzyfriday|ruck, try podman pull trunk.registry.rdoproject.org/tripleomastercentos9/openstack-mariadb:14ee273e8565960cf6d5b6e26ae92ade | 17:31 |
| frenzyfriday|ruck | ysandeep|out, thanks, it worked | 17:32 |
| frenzyfriday|ruck | This looks ok right? | 17:33 |
| frenzyfriday|ruck | docker tag trunk.registry.rdoproject.org/tripleomastercentos9/openstack-mariadb:14ee273e8565960cf6d5b6e26ae92ade quay.rdoproject.org/tripleomastercentos9/openstack-mariadb:14ee273e8565960cf6d5b6e26ae92ade | 17:33 |
| ysandeep|out | yup.. retag and push | 17:35 |
| frenzyfriday|ruck | hope I dont break other tags and stuff | 17:35 |
| ysandeep|out | frenzyfriday|ruck, go ahead.. you are mentioning particular hash | 17:35 |
| rlandy | yep | 17:35 |
| rlandy | it's missing anyway | 17:36 |
| frenzyfriday|ruck | pushing | 17:36 |
| frenzyfriday|ruck | done | 17:39 |
| ysandeep|out | let me try pulling from here | 17:40 |
| ysandeep|out | frenzyfriday|ruck, wohoo it worked | 17:41 |
| frenzyfriday|ruck | checked with http://pastebin.test.redhat.com/1054165 | 17:41 |
| ysandeep|out | frenzyfriday|ruck, let me run also run a testjob to confirm if we have all the containers | 17:41 |
| ysandeep|out | frenzyfriday|ruck, https://review.rdoproject.org/r/c/testproject/+/43135 | 17:42 |
| frenzyfriday|ruck | ysandeep|out, ack, will keep an eye on it | 17:43 |
| frenzyfriday|ruck | will keep both eyes on it XD | 17:43 |
| ysandeep|out | victoria is also good on promotion - we don't have any new hash | 17:44 |
| ysandeep|out | c9 wallaby promoted today | 17:44 |
| ysandeep|out | so if we can get master/train promotion before tomorrow - we will give marios an ideal handover :D | 17:45 |
| rlandy | frenzyfriday|ruck++ nicely done | 17:45 |
| ysandeep|out | fingers crossed for master /o\ preparing a sacrifice for zuul | 17:46 |
| * frenzyfriday|ruck goes to make food, will be back later to check the testproj | 17:46 | |
| ysandeep|out | fs064 failed in master testproject because of mirror issues:- | 17:53 |
| ysandeep|out | net-snmp-agent-libs-1:5.9.1-7.el9.x86_64: Cannot download, all mirrors were already tried without success | 17:53 |
| rlandy | ugh | 17:54 |
| rlandy | ysandeep|out: you can go - I am watching it | 17:55 |
| ysandeep|out | just running that and will leave.. all the other fs seems to be going good so far | 17:56 |
| ysandeep|out | rerunning here: https://review.rdoproject.org/r/c/testproject/+/42657/5/zuul.yaml | 17:57 |
| ysandeep|out | err. fs035 also failed with random thing | 17:59 |
| ysandeep|out | essage queue for ephemeral heat not created in time.^[[00m | 17:59 |
| rlandy | the others have not gotten there | 18:00 |
| ysandeep|out | added fs035 in https://review.rdoproject.org/r/c/testproject/+/42657 as well.. | 18:00 |
| ysandeep|out | its good that frenzyfriday|ruck managed to push the missing container, we don't have to hurry for the promotion | 18:03 |
| * ysandeep|out out for real | 18:03 | |
| rlandy | correct | 18:03 |
| rlandy | dasm: need to move your 1-1 | 18:52 |
| rlandy | phil scheduled meeting | 18:52 |
| rlandy | sending updated invite | 18:52 |
| dasm | rlandy: ack | 19:19 |
| frenzyfriday|ruck | https://review.rdoproject.org/r/c/testproject/+/43135 - passed ^_^ It can pull the hash now | 19:20 |
| frenzyfriday|ruck | rlandy, I am leaving for the day | 19:20 |
| rlandy | frenzyfriday|ruck: thanks - have a good night | 19:31 |
| *** dviroel is now known as dviroel|afk | 20:07 | |
| *** jpena is now known as jpena|off | 20:17 | |
| * dasm calls it a day | 21:32 | |
| dasm | o/ team! | 21:32 |
| *** tosky_ is now known as tosky | 21:49 | |
| *** rlandy is now known as rlandy|bbl | 21:58 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!