| *** ykarel|away is now known as ykarel | 04:18 | |
| *** pojadhav- is now known as pojadhav | 04:43 | |
| *** ysandeep|out is now known as ysandeep | 05:27 | |
| ysandeep | ykarel: good morning o/ please let me know when you have some time today to work on ci.centos jenkins job. | 05:30 |
|---|---|---|
| ykarel | ysandeep, after half hour will be available | 05:31 |
| ysandeep | ykarel: ack, thanks! | 05:32 |
| arxcruz|ruck | bhagyashris: good morning | 06:41 |
| bhagyashris | arxcruz|ruck, good morning | 06:55 |
| *** jpena|off is now known as jpena | 07:29 | |
| *** amoralej|off is now known as amoralej | 07:42 | |
| *** ykarel is now known as ykarel|lunch | 08:15 | |
| *** ysandeep is now known as ysandeep|lunch | 08:28 | |
| soniya29 | kopecmartin, arxcruz|ruck, ysandeep|lunch, raukadah, Please add/edit the today's agenda for tempest meeting - https://hackmd.io/fIOKlEBHQfeTZjZmrUaEYQ | 09:16 |
| tosky | arxcruz|ruck: hi, any update on that molecule issue on the collect-logs role? | 09:31 |
| arxcruz|ruck | tosky: no, sorry, i'll merge the change from frenzy_friday to free up while i'm working on that, the main problem is that the collect-logs tries to download the raw code, so i need to create a solution that not only don't download, but also, allow us to have depends on | 09:32 |
| arxcruz|ruck | frenzy_friday: can you update https://review.opendev.org/c/openstack/tripleo-ci-health-queries/+/809577 ? | 09:33 |
| frenzy_friday | arxcruz|ruck, should we merge https://review.opendev.org/c/openstack/tripleo-ci-health-queries/+/809577 for this sprint and revert when you get some time to fix the depends on? | 09:34 |
| arxcruz|ruck | frenzy_friday: yes | 09:35 |
| frenzy_friday | ok, I rebased 809577 on master. Anything else I should add? | 09:35 |
| *** ykarel|lunch is now known as ykarel | 09:45 | |
| *** ysandeep|lunch is now known as ysandeep | 09:46 | |
| ysandeep | soniya29: i won't be able to attend today's tempest mtg.. I have some personal work at that time. | 10:24 |
| soniya29 | ysandeep, no problem :) | 10:25 |
| *** rlandy is now known as rlandy|ruck | 10:31 | |
| rlandy|ruck | bhagyashris: arxcruz|ruck: hey - how are things in ruck/rover land today? | 10:32 |
| rlandy|ruck | marios: welcome back | 10:38 |
| frenzy_friday | hey arxcruz|ruck, https://review.opendev.org/c/openstack/tripleo-ci-health-queries/+/809577 passed check jobs, can we merge it? Should I make some other changes to it? | 10:38 |
| marios | rlandy|ruck: thanks | 10:39 |
| rlandy|ruck | ysandeep++ ... | 10:40 |
| rlandy|ruck | the stream pinning idea got a lot of approval in the c9 meeting | 10:41 |
| rlandy|ruck | was your idea to start with | 10:41 |
| ysandeep | rlandy|ruck awesome! | 10:41 |
| ysandeep | rlandy|ruck: Is c9 mtg open for all, I would like to join to have regular updates. | 10:43 |
| rlandy|ruck | yep - on everyone's calendar | 10:43 |
| rlandy|ruck | from next sprint we'll all be in on it | 10:43 |
| ysandeep | great! | 10:46 |
| ysandeep | rlandy|ruck: patches to fix downstream content-provider jobs are now merged. we can merge this one https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/241605 , succesfully tested here: https://code.engineering.redhat.com/gerrit/c/rhos-release/+/277009 | 10:49 |
| rlandy|ruck | ysandeep: looks good - thanks | 10:51 |
| rlandy|ruck | ysandeep: voted - can merge that when ready | 10:52 |
| rlandy|ruck | ysandeep: where are we with https://review.opendev.org/c/openstack/tripleo-quickstart/+/812423? | 10:53 |
| rlandy|ruck | ready to merge here? need more work? | 10:54 |
| ysandeep | rlandy|ruck, testing rabi latest patch here: testing your latest patchset here: https://jenkins-cloudsig-ci.apps.ocp.ci.centos.org/job/tripleo-quickstart-promote-master-current-tripleo-delorean-minimal/45/console | 10:54 |
| ysandeep | rlandy|ruck: testing these jobs was a pain, need to manually change scm in jobs, using ykarel I have created a check version of this job | 10:55 |
| ysandeep | https://jenkins-cloudsig-ci.apps.ocp.ci.centos.org/job/tripleo-quickstart-gate-master-tripleo-ci-delorean-ruck-rover-test-featureset-minimal/ | 10:55 |
| ysandeep | could be triggered with check-ci-minimal if need be | 10:55 |
| rlandy|ruck | ysandeep: great new addition | 10:56 |
| ysandeep | rlandy|ruck: jenkins need a fix first: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/812639 , fs052 hitting same issue | 10:56 |
| rlandy|ruck | we need to add that info somewhere | 10:56 |
| rlandy|ruck | tripleo info doc maybe | 10:56 |
| ysandeep | ack.. I will add that in tripleo-doc, Will present in community call | 10:57 |
| * ysandeep away for few hours.. doc appointment | 10:58 | |
| rlandy|ruck | ysandeep: added to tripleo-ci-infra | 10:58 |
| rlandy|ruck | sure | 10:58 |
| ysandeep | ^^ above was for tq, created this for tqe: https://jenkins-cloudsig-ci.apps.ocp.ci.centos.org/job/tripleo-quickstart-extras-gate-master-tripleo-ci-delorean-ruck-rover-test-featureset-minimal/ | 10:59 |
| ysandeep | I still need to fix some config on tqe one. | 10:59 |
| *** ysandeep is now known as ysandeep|away | 11:00 | |
| rlandy|ruck | ysandeep|away: ack - pinged joe about that | 11:00 |
| rlandy|ruck | ysandeep|away: merging https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/812639 | 11:01 |
| rlandy|ruck | arxcruz|ruck: bhagyashris: https://review.rdoproject.org/r/c/config/+/35997 Remove using SSl cert with dlrn - until fixed | 11:06 |
| rlandy|ruck | marios: pojadhav: hey - looked at the updates component jobs: https://review.rdoproject.org/r/c/rdo-jobs/+/34851 and https://review.rdoproject.org/r/c/rdo-jobs/+/35953 | 11:08 |
| rlandy|ruck | looks ok to me ( now in merge conflict though) | 11:08 |
| rlandy|ruck | marios: pojadhav: just checking if we need those jobs in every component | 11:08 |
| marios | rlandy|ruck: ack i didn't review those but will do | 11:09 |
| rlandy|ruck | marios: also chandan will be back tomorow | 11:09 |
| rlandy|ruck | tomorrow | 11:09 |
| rlandy|ruck | will check his c9 patches today | 11:09 |
| pojadhav | rlandy|ruck, thanks for review :) | 11:09 |
| pojadhav | will resolve merge conflict | 11:10 |
| *** pojadhav is now known as pojadhav|brb | 11:11 | |
| marios | sshnaidm: o/ hey can you please look into that when you have some time ... maybe we can discuss after you have a look if needed (or you can comment on the reviews?) https://review.opendev.org/q/topic:tripleo-repos-release | 11:13 |
| bhagyashris | rlandy|ruck, hi, going ok ok. waiting for some patches to merge | 11:15 |
| rlandy|ruck | bhagyashris: we have another master issue :( | 11:16 |
| rlandy|ruck | on OVB | 11:16 |
| rlandy|ruck | logging that one | 11:16 |
| bhagyashris | rlandy|ruck, which one fs039? | 11:16 |
| rlandy|ruck | bhagyashris: also the fs039 issue on PSI is legit | 11:16 |
| rlandy|ruck | we need to talk to ade_lee about that | 11:16 |
| rlandy|ruck | bhagyashris: master failure ... see fs001 and fs035 | 11:17 |
| rlandy|ruck | Prepare the SSL Configuration for the overcloud deployment | 11:17 |
| rlandy|ruck | AttributeError: 'Base' object has no attribute '_conf' | 11:17 |
| rlandy|ruck | may be same as other conf issue | 11:17 |
| rlandy|ruck | https://bugs.launchpad.net/tripleo/+bug/1946091 | 11:19 |
| bhagyashris | rlandy|ruck, i think we hit this issue before as well | 11:19 |
| rlandy|ruck | I guess we can testproject check that | 11:19 |
| bhagyashris | rlandy|ruck, i did that | 11:20 |
| bhagyashris | rlandy|ruck, fyi https://review.rdoproject.org/r/c/testproject/+/29351 | 11:20 |
| rlandy|ruck | ok - let's see | 11:21 |
| *** pojadhav|brb is now known as pojadhav | 11:21 | |
| rlandy|ruck | bhagyashris: wrt fs039 failure on PSI ... | 11:21 |
| * rlandy|ruck gets | 11:21 | |
| rlandy|ruck | 2021-10-06 08:54:22.513903 | primary | Unable to establish connection to https://openstack.prod.psi.phx2.redhat.com:13000/v3/auth/tokens: HTTPSConnectionPool(host='openstack.prod.psi.phx2.redhat.com', port=13000): Max retries exceeded with url: /v3/auth/tokens (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7efdc24f0518>: Failed to establish a new connection: [Errno -2] Name or service | 11:23 |
| rlandy|ruck | not known',)) | 11:23 |
| rlandy|ruck | ^^ last error | 11:23 |
| bhagyashris | rlandy|ruck, i haven't check in detail | 11:23 |
| rlandy|ruck | Create a key in case of extranode | 11:24 |
| rlandy|ruck | bhagyashris: we will need to ping nhicher about that when he gets in | 11:24 |
| rlandy|ruck | bhagyashris: one more attempt to fix c7 ... https://review.rdoproject.org/r/c/config/+/35997 Remove using SSl cert with dlrn - until fixed | 11:25 |
| bhagyashris | rlandy|ruck, ack | 11:25 |
| rlandy|ruck | going to merge and try again | 11:25 |
| rlandy|ruck | bhagyashris, - you ok to speak at the program call | 11:26 |
| rlandy|ruck | I updated the doc | 11:26 |
| arxcruz|ruck | rlandy|ruck: I'm thinking in a fallback plan for the ceph containers, this morning some failures was related to not being able to pull ceph containers | 11:26 |
| bhagyashris | rlandy|ruck, yup | 11:26 |
| arxcruz|ruck | i think we are reaching quay.io limit | 11:27 |
| arxcruz|ruck | like in docker.io | 11:27 |
| rlandy|ruck | arxcruz|ruck: ugh - what can we do there? | 11:27 |
| arxcruz|ruck | rlandy|ruck: have those containers also in rdocloud and quay, and have a backup when those fail | 11:28 |
| rlandy|ruck | arxcruz|ruck: is rdocloud an option to pull ceph containers? | 11:29 |
| rlandy|ruck | when we are not in periodic? | 11:29 |
| rlandy|ruck | are those containers also in docker? | 11:29 |
| sshnaidm | marios, hey, commented on https://review.opendev.org/c/openstack/tripleo-ci/+/810261 | 11:30 |
| rlandy|ruck | bhagyashris: do we know if container/image build jobs work from PSI? | 11:30 |
| rlandy|ruck | we would have to check upload permissions | 11:30 |
| sshnaidm | marios, I think it's a good idea to have base release job in tripleo-ci, but repos release job should be defined in each repo | 11:30 |
| marios | sshnaidm: ack you mean *defined* or just wired up? thanks for looking, i will check your comments and we can take it from there. i was thinking to have them defined in ci (so they can use the common playbook & secret) and then just wired up in each repo layout | 11:31 |
| bhagyashris | rlandy|ruck, hey totally forgot to test that part. will push the patch in sec | 11:31 |
| rlandy|ruck | bhagyashris: np | 11:31 |
| rlandy|ruck | when you have a moment | 11:31 |
| sshnaidm | marios, I don't think it should be wired tbh, it's too specific | 11:32 |
| sshnaidm | marios, in best case it should be in zuul-jobs at all... | 11:32 |
| sshnaidm | but I gave up merge there something :D | 11:32 |
| marios | sshnaidm: k i will check your comments then maybe we can have quick chat tomorrow morning on phone | 11:32 |
| sshnaidm | marios, sure | 11:33 |
| marios | sshnaidm: thanks | 11:33 |
| arxcruz|ruck | rlandy|ruck: not sure if they are in docker, i can check | 11:34 |
| rlandy|ruck | arxcruz|ruck: I don't even know if that is in the fall back for ceph containers | 11:35 |
| arxcruz|ruck | we can copy to our quay, because ceph uses quay.ceph.io | 11:35 |
| arxcruz|ruck | i assume is different from quay.io | 11:35 |
| arxcruz|ruck | rlandy|ruck: it's not in the fall back | 11:36 |
| arxcruz|ruck | https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/container-build/tasks/non_tripleo_containers.yml | 11:36 |
| *** dviroel|out is now known as dviroel | 11:41 | |
| bhagyashris | rlandy|ruck, fyi, https://review.rdoproject.org/r/c/testproject/+/35949 | 11:41 |
| rlandy|ruck | bhagyashris: thanks - let's see how we go there | 11:42 |
| bhagyashris | yup | 11:47 |
| dviroel | mornings | 11:48 |
| rlandy|ruck | woohho - c7 returns | 11:51 |
| rlandy|ruck | soniya29: will miss tempest call - in program call | 11:52 |
| soniya29 | rlandy|ruck, sure | 11:52 |
| marios | if someone has time needs reviews please https://review.opendev.org/c/openstack/tripleo-puppet-elements/+/811712 | 11:52 |
| rlandy|ruck | woohoo - fix to https://bugs.launchpad.net/tripleo/+bug/1946045 merged | 11:53 |
| rlandy|ruck | looking | 11:53 |
| rlandy|ruck | looks good | 11:53 |
| bhagyashris | c8 train fix also got merged :) | 11:54 |
| bhagyashris | Hope next run will be clear | 11:55 |
| *** amoralej is now known as amoralej|lunch | 11:55 | |
| rlandy|ruck | nice | 11:58 |
| soniya29 | arxcruz|ruck, kopecmartin, tempest meeting in 2 mins | 11:58 |
| arxcruz|ruck | soniya29: i m in the program meeting call, and i'm ruckrovering | 11:59 |
| soniya29 | arxcruz|ruck, okay, no problem :) | 11:59 |
| *** jpena is now known as jpena|lunch | 12:00 | |
| arxcruz|ruck | rlandy|ruck: will you report, or me or bhagyashris ? | 12:03 |
| rlandy|ruck | arxcruz|ruck: you or bhagyashris can | 12:03 |
| rlandy|ruck | you guys pick | 12:04 |
| rlandy|ruck | I am on the call | 12:04 |
| rlandy|ruck | but it's better if the ruck/rovers report | 12:04 |
| rlandy|ruck | I updated the doc | 12:04 |
| arxcruz|ruck | bhagyashris: up to you | 12:04 |
| bhagyashris | arxcruz|ruck, i will, may be next one you can report. | 12:07 |
| arxcruz|ruck | bhagyashris: no problems :) you're the star | 12:07 |
| bhagyashris | hahaha | 12:07 |
| rlandy|ruck | ykarel: thank you for your work with ysandeep|away to get the jenkins check jobs for t-q and t-q-e working | 12:08 |
| ykarel | yes good to see those working | 12:09 |
| rlandy|ruck | merging the cert fix | 12:10 |
| ykarel | ack | 12:10 |
| sshnaidm | frenzy_friday, where are repos that hold dockerfiles for er-web-opensearch, er-web etc? | 12:15 |
| frenzy_friday | sshnaidm, https://opendev.org/opendev/elastic-recheck/src/branch/rdo/Dockerfile | 12:16 |
| dviroel | team, kid is still sick, we I'll take him again to the doctor, at 15h utc | 12:17 |
| sshnaidm | frenzy_friday, do you have playbooks to build and deploy all those containers on 38.102.83.141? | 12:19 |
| frenzy_friday | sshnaidm, can we point ci-health-rdo.tripleo.org to 38.102.83.141:5001? Or that has to be configured on the server? | 12:19 |
| sshnaidm | frenzy_friday, that will be done on the server | 12:19 |
| frenzy_friday | sshnaidm, no, at the moment I am using a makefile running docker compose up | 12:20 |
| frenzy_friday | https://opendev.org/opendev/elastic-recheck/src/branch/rdo/Makefile | 12:20 |
| dviroel | rlandy|ruck: hi, wrt the yum-config wire-up, the only way that i found to enable releases in different changes was to add a flag to switch between the current code and the new yum-config | 12:22 |
| dviroel | rlandy|ruck: https://review.opendev.org/c/openstack/tripleo-quickstart/+/808408/15/config/release/tripleo-ci/CentOS-8/wallaby.yml#100 | 12:22 |
| rlandy|ruck | dviroel: I think that is fine for the moment | 12:22 |
| rlandy|ruck | it's just temp until we qualify | 12:22 |
| rlandy|ruck | I agree with marios about splitting the reviews | 12:23 |
| dviroel | so, it shouldn't impact any other release that don't turn the flag on (downstream) | 12:23 |
| sshnaidm | frenzy_friday, ack, we'll need to make a setup for a server in ci-config repo here: https://github.com/rdo-infra/ci-config/tree/master/ci-scripts/infra-setup/roles | 12:23 |
| sshnaidm | frenzy_friday, after it works of course | 12:23 |
| dviroel | rlandy|ruck: ack, doing it now | 12:23 |
| rlandy|ruck | dviroel: perfect - thanks | 12:23 |
| frenzy_friday | sshnaidm, ack, thanks | 12:23 |
| sshnaidm | frenzy_friday, so we'll have a full deploy & update process there | 12:23 |
| rlandy|ruck | bhagyashris: for 17 question - you can say we have had 17 component and integration lines running and we will continue to support those | 12:25 |
| rlandy|ruck | bhagyashris: nvm :) | 12:26 |
| rlandy|ruck | all good | 12:26 |
| sshnaidm | frenzy_friday, and then we'll do something like this, with redirect to various ports: https://github.com/rdo-infra/ci-config/blob/0ce33c32ecf54f4df2834e6e147989129d380b15/ci-scripts/infra-setup/roles/rrcockpit/templates/nginx.conf.j2 | 12:26 |
| rlandy|ruck | dviroel; hope kid feels better - no worries on the time - take what you need | 12:26 |
| bhagyashris | rlandy|ruck, may be next time we can say | 12:27 |
| bhagyashris | :) | 12:27 |
| rlandy|ruck | no worries - you did great | 12:27 |
| arxcruz|ruck | i'll pick up my daughter at school, brb in 15 min | 12:29 |
| arxcruz|ruck | nevermind, it will be in half hour :) | 12:32 |
| bhagyashris | rlandy|ruck, image build and container builds are green on PSI https://review.rdoproject.org/r/c/testproject/+/35949 | 12:38 |
| rlandy|ruck | bhagyashris: very cool | 12:39 |
| rlandy|ruck | bhagyashris: you can start preparing the review to change the line | 12:39 |
| bhagyashris | rlandy|ruck, ack | 12:40 |
| rlandy|ruck | let's edit the template file itself to start with | 12:40 |
| rlandy|ruck | so it is one revert | 12:40 |
| bhagyashris | ok | 12:40 |
| rlandy|ruck | bhagyashris: will touch base with nhicher re: fs039 in the afternoon | 12:40 |
| rlandy|ruck | bhagyashris: last thing to check would be moving the hash ( bottom job) | 12:40 |
| bhagyashris | rlandy|ruck, ack thanks | 12:40 |
| rlandy|ruck | only way to test that would be when we are ready to move the line | 12:41 |
| rlandy|ruck | it will be the first failure | 12:41 |
| rlandy|ruck | so we will know if it doesn't work | 12:41 |
| rlandy|ruck | we can prep one last testproject to do the fisrt promote job - but no run it | 12:41 |
| bhagyashris | rlandy|ruck, so you mean first prepare testproject patch for promote job and then move the integration line | 12:43 |
| rlandy|ruck | bhagyashris: no sorry ... | 12:44 |
| rlandy|ruck | prep the job to move the integration line | 12:44 |
| rlandy|ruck | when that is ready | 12:44 |
| *** ysandeep|away is now known as ysandeep | 12:44 | |
| rlandy|ruck | and we are ready to merge that, we can build one testproject to test the promotion jon | 12:45 |
| rlandy|ruck | job | 12:45 |
| rlandy|ruck | don;t worry about that one | 12:45 |
| bhagyashris | ok | 12:45 |
| bhagyashris | got it | 12:45 |
| rlandy|ruck | let's just start with the line prep | 12:45 |
| rlandy|ruck | thank you | 12:45 |
| bhagyashris | ack | 12:45 |
| rlandy|ruck | bhagyashris: arxcruz|ruck: pls review https://review.rdoproject.org/r/c/rdo-jobs/+/35770 | 12:50 |
| rlandy|ruck | kvm jobs are failing outright on vexx | 12:50 |
| rlandy|ruck | https://review.rdoproject.org/r/c/testproject/+/35646 shows that on PSI we get three releases to pass | 12:51 |
| rlandy|ruck | better stats | 12:51 |
| rlandy|ruck | let's try the PSI approach there | 12:51 |
| bhagyashris | rlandy|ruck, ack | 12:51 |
| rlandy|ruck | pls vote and I'll merge | 12:51 |
| rlandy|ruck | all - anyone waiting on reviews? | 12:54 |
| rlandy|ruck | frenzy_friday: pojadhav: marios: arxcruz|ruck: ^^? | 12:55 |
| marios | rlandy|ruck: we need to start merging the depends-on @ https://review.rdoproject.org/r/c/testproject/+/35465 - not all are ready ("wip" in commit) but good to add comments if you have some please | 12:57 |
| bhagyashris | rlandy|ruck, https://review.rdoproject.org/r/c/rdo-jobs/+/35999 usuri PSI work | 12:57 |
| frenzy_friday | rlandy|ruck, saw your comments on the c9 patches, I'll update them | 12:58 |
| rlandy|ruck | frenzy_friday: yeah - we can chat about those | 12:59 |
| rlandy|ruck | frenzy_friday: tbh, I'd have to look carefully about whether we care about the node it's run on | 12:59 |
| rlandy|ruck | usually we run the promote job on the matching node | 12:59 |
| rlandy|ruck | frenzy_friday: we can look at that together later | 13:00 |
| frenzy_friday | rlandy|ruck, yep sure, in ~30 mins? | 13:00 |
| rlandy|ruck | marios: ack- on all those reviews today - thanks | 13:00 |
| rlandy|ruck | frenzy_friday: go the prod chain meeting then | 13:01 |
| frenzy_friday | rlandy|ruck, do you hav time now? | 13:01 |
| rlandy|ruck | frenzy_friday: ack | 13:02 |
| rlandy|ruck | give ne 5 mins | 13:02 |
| frenzy_friday | cool | 13:02 |
| frenzy_friday | https://meet.google.com/wfa-xezn-bkm | 13:02 |
| rlandy|ruck | frenzy_friday: joining | 13:09 |
| erbot | Required files not ready after 301.1624507904053s for deps-cbs-validate 36001,1,5c4ceda6e0cc4413a262d6c52e6273ca | 13:15 |
| *** amoralej|lunch is now known as amoralej | 13:17 | |
| *** jpena|lunch is now known as jpena | 13:24 | |
| rlandy|ruck | frenzy_friday: https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/roles/promote-hash/tasks/get-hash.yaml#L15 | 13:30 |
| ysandeep | rlandy|ruck, fyi.. Rabi latest patchset fixes the minimal job.. result shared on https://review.opendev.org/c/openstack/tripleo-quickstart/+/812423 .. We can +w it once zuul reports back. | 13:34 |
| rlandy|ruck | ysandeep: amazing | 13:34 |
| rlandy|ruck | voted | 13:34 |
| rlandy|ruck | one more for c7 ... https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/playbooks/tripleo-ci-periodic-base/post.yaml | 13:44 |
| erbot | Required files not ready after 301.55645275115967s for deps-cbs-validate 36004,1,3fb8c429cb8540d190eb5c4a83e0c4a2 | 13:52 |
| rlandy|ruck | https://review.rdoproject.org/r/c/config/+/36006 Remove SSL usage for dlrn-report | 13:57 |
| ysandeep | rlandy|ruck: when you have time zuul reported back, could you please merge https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/241605 , I don't want to self merge it. | 14:00 |
| rlandy|ruck | w+'ed | 14:00 |
| marios | arxcruz|ruck: please check pvt chat when you have a moment thank you | 14:08 |
| *** pojadhav is now known as pojadhav|afk | 14:13 | |
| rlandy|ruck | https://review.rdoproject.org/r/c/config/+/36006 | 14:15 |
| rlandy|ruck | bhagyashris: ^^ can I get a review there befiremerging | 14:15 |
| rlandy|ruck | before merging | 14:15 |
| rlandy|ruck | ysandeep: ^^ anybody - 1 review pls | 14:16 |
| erbot | Required files not ready after 301.7953851222992s for periodic-tripleo-ci-centos-8-scenario010-kvm-standalone-victoria 35646,4,3f1ac887325d463f99fe03be16e76bce | 14:16 |
| ysandeep | rlandy|ruck, ack | 14:17 |
| rlandy|ruck | temp change | 14:17 |
| ysandeep | Added my +1 :) | 14:17 |
| sshnaidm | rlandy|ruck, do you know what is the latest container tag for tripleomastercentos9? | 14:19 |
| bhagyashris | rlandy|ruck, which one | 14:22 |
| bhagyashris | i see this one got merge https://review.rdoproject.org/r/c/config/+/36006 | 14:23 |
| sshnaidm | ysandeep, need to ensure tripleo_generate_scripts is always true when we run operators in CI | 14:26 |
| ysandeep | sshnaidm: ack, thanks! We can cross check that.. akahat ^^ fyi.. | 14:28 |
| arxcruz|ruck | marios: done | 14:30 |
| ysandeep | sshnaidm: https://opendev.org/openstack/tripleo-ci/src/branch/master/roles/run-test/templates/toci_quickstart.sh.j2#L20 | 14:31 |
| sshnaidm | ysandeep, nice | 14:31 |
| *** dviroel is now known as dviroel|afk | 14:41 | |
| marios | arxcruz|ruck: thanks | 14:51 |
| erbot | Required files not ready after 300.7478528022766s for distgit-cbs-validate-centos8-stream 36037,1,feaaec227ba949bab6d5263a3b19b6dc | 15:01 |
| ysandeep | rlandy|ruck: Hey o/ mtg reminder | 15:02 |
| ysandeep | We can reschedule if you are occupied. | 15:02 |
| rlandy|ruck | ysandeep: sorry - just got off meeting | 15:02 |
| rlandy|ruck | joining | 15:03 |
| ysandeep | no worries, thanks! | 15:03 |
| marios | http://lists.openstack.org/pipermail/openstack-discuss/2021-October/025214.html xena is a thing | 15:07 |
| jbadiapa | is there a problem with ephemeral heat? | 15:18 |
| jbadiapa | I'm getting the error 2021-10-06 14:06:34.603 118732 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud [-] Exception occured while running the command: heatclient.exc.HTTPBadRequest: ERROR: Internal Error | 15:19 |
| jbadiapa | and checking the heat-logs something like | 15:19 |
| jbadiapa | 2021-10-06 14:06:33.398 1 ERROR heat.common.wsgi ValueError: environment has empty section "resource_registry" | 15:19 |
| jbadiapa | I created a launchpad just in case https://bugs.launchpad.net/tripleo/+bug/1946240 | 15:31 |
| rlandy|ruck | marios: woohoo | 15:35 |
| rlandy|ruck | jbadiapa: looking at bug | 15:35 |
| rlandy|ruck | there have been multiple change in CI to support ephemeral heat | 15:36 |
| erbot | Required files not ready after 301.05976009368896s for config-check 36060,1,b7e0f29a4cec413883f04650620f2cc3 | 15:36 |
| rlandy|ruck | jbadiapa: it would help to know what the setup was | 15:36 |
| rlandy|ruck | -e /usr/share/openstack-tripleo-heat-templates/environments/net-single-nic-with-vlans.yaml | 15:37 |
| jbadiapa | sure....let me update the bz | 15:37 |
| rlandy|ruck | you can look at the https://review.opendev.org/c/openstack/tripleo-quickstart/+/812423/4/config/general_config/minimal.yml | 15:37 |
| jbadiapa | launchpad | 15:38 |
| *** ykarel is now known as ykarel|away | 15:38 | |
| rlandy|ruck | jbadiapa: ^^ note the changes made there to support single-nic-vlans with ephemeral heat | 15:38 |
| rlandy|ruck | we had the same issue | 15:38 |
| * rlandy|ruck gets launchpad bug | 15:39 | |
| jbadiapa | o great....thx | 15:39 |
| rlandy|ruck | https://bugs.launchpad.net/tripleo/+bug/1946087 | 15:40 |
| rlandy|ruck | jbadiapa: ^^ | 15:40 |
| rlandy|ruck | note two fixes were made in the config file to support it | 15:40 |
| rlandy|ruck | you can follow that change | 15:40 |
| * rlandy|ruck goes back into meeting | 15:41 | |
| jbadiapa | rlandy|ruck thx a lot | 15:41 |
| rlandy|ruck | thank rabi - he fixed it :) | 15:41 |
| erbot | Required files not ready after 594.9238421916962s for config-check 36059,1,8fdcff00724147f7be099ae2d5a88750 | 15:41 |
| *** jpena is now known as jpena|off | 15:43 | |
| *** jpena|off is now known as jpena | 15:44 | |
| erbot | Required files not ready after 363.8882532119751s for distgit-cbs-validate-centos8-stream 36037,1,17a15399fd95456ab2233d03a1ccdc02 | 15:46 |
| marios | anyone else have unresponsive upshift dashboard? | 15:47 |
| marios | rlandy|ruck: working for you? ^ | 15:50 |
| marios | arxcruz|ruck: maybe? ^ | 15:50 |
| rlandy|ruck | upshift? | 15:50 |
| marios | rlandy|ruck: pvt sec | 15:50 |
| marios | rlandy|ruck: psi | 15:51 |
| *** chem is now known as Guest2000 | 15:51 | |
| marios | thanks for checkinkg rlandy|ruck | 15:52 |
| marios | i got kicked off my vm and cant get back to it or the dash must be service issue | 15:52 |
| erbot | Required files not ready after 300.63451170921326s for deps-cbs-validate 36061,1,bc817a8364ec4832baa11a0b0940803b | 15:54 |
| ade_lee | dviroel|afk, did you see slaweq comment on that node we are trying to debug? | 15:56 |
| ade_lee | now to try and figure out why the node isn't being set up with a 192. address .. | 15:56 |
| ysandeep | marios, there is an outage in psi | 15:58 |
| marios | thank you ysandeep | 15:58 |
| ysandeep | marios: you are welcome :), details shared in a pm. | 16:01 |
| marios | ysandeep: thanks mate | 16:03 |
| *** ysandeep is now known as ysandeep|out | 16:15 | |
| ade_lee | slaweq, hey - how did you get onto the secondary node? | 16:16 |
| * ysandeep|out out for the day | 16:17 | |
| ade_lee | slaweq, I do see this -- https://review.rdoproject.org/zuul/build/7bba53b7e0bd4cceafdc0b955ef83826/log/logs/subnode-1/var/log/extra/journal.txt.gz#1484 | 16:19 |
| erbot | Required files not ready after 301.1045837402344s for config-check 36059,3,1ad441600016435a834efb58c0b8a8bd | 16:26 |
| rlandy|ruck | arxcruz|ruck: hey - can you check the wallaby containers | 16:46 |
| rlandy|ruck | the error is probably just because wallaby just promoted | 16:47 |
| *** jpena is now known as jpena|off | 17:00 | |
| *** amoralej is now known as amoralej|off | 17:01 | |
| *** dviroel|afk is now known as dviroel | 17:41 | |
| dviroel | ade_lee: hi, i was away, reading now email + messages | 17:46 |
| *** ysandeep|out is now known as ysandeep | 18:03 | |
| ade_lee | dviroel, yeah - not sure where to go from here -- I'll add patches for the snmpd thing - but I doubt thats the main issue | 18:06 |
| rlandy|ruck | wooho c7 is baaaaack | 19:15 |
| rlandy|ruck | https://review.rdoproject.org/zuul/buildset/f05e992d883b49ff886b2a8a49289199 | 19:15 |
| *** ysandeep is now known as ysandeep|out | 19:24 | |
| dviroel | \o/ | 19:36 |
| slaweq | ade_lee: hi, I asked dpawlik, he added my ssh key to second node | 19:45 |
| slaweq | and I checked it there | 19:45 |
| slaweq | :) | 19:45 |
| slaweq | ade_lee: wasn't that line which You linked before node reboot? | 19:46 |
| dviroel | slaweq: yeah, it is rebooting after network configuration https://review.rdoproject.org/zuul/build/7bba53b7e0bd4cceafdc0b955ef83826/log/logs/subnode-1/var/log/extra/journal.txt.gz#4264 | 20:00 |
| slaweq | dviroel: so I guess this is an issue, that this config of the bridges and additional IPs on the subnode isn't persistent after reboot | 20:17 |
| slaweq | but tbh, I'm not good in that infra stuff so I don't know exactly how to fix it really | 20:17 |
| rlandy|ruck | in general, we don't reboot nodepool nodes so we don't come across the problem | 20:18 |
| dviroel | slaweq: yeah, but this can be one of many issues that we might face if we continue to reboot nodes | 20:18 |
| slaweq | dviroel: AFAIU it's required to have fips enabled, right? | 20:19 |
| dviroel | slaweq: another way would be to have nodepool images with fips enabled by default | 20:20 |
| slaweq | dviroel: that would be for sure easier from the ci nodes provisioning pov :) | 20:20 |
| dviroel | ++ | 20:20 |
| rlandy|ruck | ^^ that would be a much easier way to test | 20:20 |
| rlandy|ruck | to build the nodepool image with fips enabled | 20:20 |
| rlandy|ruck | we would get by the reboot issues | 20:20 |
| rlandy|ruck | idk if infra will help us much with reboots | 20:21 |
| slaweq | and jobs would be faster :) | 20:21 |
| rlandy|ruck | getting a new nodepool node in rdo (to test) is not hard | 20:21 |
| arxcruz|ruck | rlandy|ruck: on quay the current-tripleo is pointing to the proper hash f8bcbcbeff17e2b90a4e9102ab47c658 | 20:29 |
| arxcruz|ruck | and current-tripleo-rdo as well | 20:29 |
| rlandy|ruck | arxcruz|ruck: hey - thanks - that was while back | 20:30 |
| rlandy|ruck | probably fixed by now | 20:30 |
| arxcruz|ruck | rlandy|ruck: but yeah, the container was coppied 22 minutes ago | 20:30 |
| arxcruz|ruck | rlandy|ruck: sorry, it was already almost 7pm here, i didn't saw your message | 20:30 |
| rlandy|ruck | ack - we're promoting often now | 20:30 |
| rlandy|ruck | arxcruz|ruck: no worries - I forgot all about it :) | 20:30 |
| slaweq | dviroel: ade_lee: I will go afk in few minutes, please send me an email if You would need any more help with that :) | 20:31 |
| slaweq | I will then check it tomorrow morning my time | 20:31 |
| dviroel | slaweq: ack, thanks for the help | 20:31 |
| slaweq | dviroel: np at all | 20:31 |
| *** rlandy|ruck is now known as rlandy|ruck|bbl | 22:20 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!