| *** dasm is now known as Guest1466 | 01:41 | |
| * pojadhav|ruck brb | 06:55 | |
| *** jm1|ruck is now known as jm1|rover | 07:12 | |
| jm1 | good morning #oooq pojadhav|ruck :) | 07:13 |
|---|---|---|
| pojadhav|ruck | jm1, morning! | 07:14 |
| jm1 | pojadhav|ruck: our upstream cockpit is working again 🥳 | 07:14 |
| pojadhav|ruck | jm1, great :) | 07:15 |
| * pojadhav|ruck lunch | 07:38 | |
| *** jpena|off is now known as jpena | 07:38 | |
| *** akahat_ is now known as akahat | 07:48 | |
| *** ysandeep is now known as ysandeep|lunch | 08:53 | |
| jm1 | reviewbot: add to review list https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/44675 | 09:06 |
| reviewbot | I could not add the review to Review List | 09:06 |
| *** pojadhav is now known as pojadhav|ruck | 09:30 | |
| jpodivin | pojadhav|ruck: hi. I see a failure on the most recent run of periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-component-master-validation | 10:00 |
| jpodivin | During "Discovering nova hosts" the deployment fails with "Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code." | 10:00 |
| jpodivin | pojadhav|ruck: I've just seen it once so far. But given how ... well not exactly stable the job has been, I'm not sure if there isn't a bug already. | 10:01 |
| jm1 | reviewbot: add to review list https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/44679 | 10:02 |
| reviewbot | I could not add the review to Review List | 10:02 |
| jm1 | reviewbot: add to review list https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/44680 | 10:03 |
| reviewbot | I could not add the review to Review List | 10:03 |
| jpodivin | pojadhav|ruck: wait. The same warning showed up during the previous failure of the job. Although it didn't reach the "Discovering nova hosts" | 10:03 |
| jpodivin | https://logserver.rdoproject.org/openstack-component-validation/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-component-master-validation/d57c5be/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 10:03 |
| jm1 | chandankumar, ysandeep: o/ could you please have a look when you have some time? ☺️ https://review.rdoproject.org/r/q/project:rdo-infra/ci-config+owner:code%2540jakobmeng.de+status:open | 10:07 |
| jm1 | reviewbot: add to review list https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/44681 | 10:20 |
| reviewbot | I could not add the review to Review List | 10:20 |
| jpodivin | reviewbot: add to review list https://review.rdoproject.org/r/c/rdo-jobs/+/44605 | 10:24 |
| reviewbot | I could not add the review to Review List | 10:25 |
| pojadhav|ruck | jpodivin, checking | 10:29 |
| *** rlandy_ is now known as rlandy | 10:31 | |
| rlandy | jm1|rover: pojadhav|ruck: hi - how are things? | 10:32 |
| rlandy | jm1|rover: pojadhav|ruck: we need to work on wallaby c9 | 10:33 |
| rlandy | pls ping when you are around | 10:33 |
| rlandy | promoted wallaby c8 | 10:33 |
| pojadhav|ruck | rlandy, hi.. I am around | 10:34 |
| pojadhav|ruck | osp17 rhel9 also promoted | 10:35 |
| rlandy | pojadhav|ruck: ok - let's wait for jm1 | 10:35 |
| jm1 | rlandy, pojadhav|ruck: here | 10:39 |
| rlandy | let's sync: https://meet.google.com/osq-wbpd-jwa?pli=1&authuser=0 | 10:40 |
| *** ysandeep|lunch is now known as ysandeep | 11:02 | |
| chandankumar | Anyone wants to discuss anything on review call? | 11:16 |
| rlandy__ | chandankumar: busy with rr | 11:17 |
| chandankumar | ack | 11:17 |
| pojadhav|ruck | rlandy__, rerunning 16.2 failed jobs https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/status#276230 | 11:24 |
| * pojadhav|ruck need a coffeee.. brb | 11:24 | |
| *** dviroel_ is now known as dviroel | 11:31 | |
| dviroel | o/ | 11:34 |
| rlandy__ | akahat: hello | 11:35 |
| rlandy__ | akahat: pls can you bug https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-9-multinode-mixed-os&pipeline=openstack-periodic-integration-stable1-cs8&skip=0 and look into why it is failing | 11:35 |
| rlandy__ | dviroel: hello ... | 11:35 |
| rlandy__ | dviroel: following https://trello.com/c/C2ScJZwT/2674-cixlp1986755tripleociproa-master-wallaby-security-component-standalone-with-ipa-and-fs039-job-are-failing-with-error-couldnt-res | 11:36 |
| rlandy__ | wallaby c9 security component still has not promoted | 11:36 |
| *** rlandy__ is now known as rlandy | 11:36 | |
| * rlandy thought we were going to skip promote that | 11:36 | |
| rlandy | what happened there? | 11:36 |
| akahat | rlandy, https://review.rdoproject.org/r/c/config/+/44678 | 11:37 |
| akahat | It's fix is proposed. | 11:37 |
| dviroel | rlandy: it was promoted to 1c47cb9 | 11:38 |
| dviroel | https://trunk.rdoproject.org/centos9-wallaby/component/security/promoted-components/ | 11:38 |
| dviroel | https://opendev.org/x/tripleo-ipa/commits/branch/stable/wallaby | 11:38 |
| rlandy | dviroel: thatsays 08/21 | 11:39 |
| rlandy | the last comment we have there is 08/26 | 11:39 |
| rlandy | is that new enough? | 11:39 |
| rlandy | can we close this out? | 11:39 |
| dviroel | rlandy: yeah, i don't know why it got promted with this date | 11:39 |
| rlandy | akahat: let's chat bout what's missing | 11:39 |
| dviroel | rlandy: we were waiting integration line | 11:39 |
| rlandy | dviroel: ok - so when we promote the c9 wallaby line? | 11:40 |
| rlandy | akahat: https://meet.google.com/wre-uaig-dzj?pli=1&authuser=0 | 11:40 |
| rlandy | I don't think you want to default all to ibm cloud | 11:41 |
| dviroel | rlandy: rr tool output: security component status=Red last_promotion=2022-08-25 20:31:47" | 11:41 |
| akahat | rlandy, rlandy https://opendev.org/openstack/tripleo-ci/src/branch/master/zuul.d/multinode-jobs.yaml#L66 | 11:44 |
| rlandy | dviroel: do we need to promote the sec component again? | 11:51 |
| rlandy | since 08/21? | 11:51 |
| rlandy | pojadhav|ruck; ok - what happened with container builds> | 11:53 |
| pojadhav|ruck | rlandy, reporting a bug | 11:54 |
| dviroel | rlandy: the fix related to that card is on integration line already: https://trunk.rdoproject.org/centos9-wallaby/tripleo-ci-testing/delorean.repo (1c47cb95) | 11:54 |
| rlandy | pojadhav|ruck: ok - we need to clean up baremetal | 11:54 |
| pojadhav|ruck | should I rerun them to check whether it is consistent ? | 11:54 |
| rlandy | 2022-08-29 07:35:13.836576 | primary | fatal: [rdoci-hp-01.v100.rdoci.lab.eng.rdu2.redhat.com]: UNREACHABLE! => {"changed": false, "msg": "mkdir: cannot create directory ‘/root/.ansible/tmp/ansible-tmp-1661772913.4928293-11599-72331602038977’: No space left on device\n", "unreachable": true} | 11:54 |
| pojadhav|ruck | rlandy, ack | 11:54 |
| rlandy | pojadhav|ruck: ^^ that is a real issue | 11:54 |
| rlandy | checking the trigger job | 11:55 |
| rlandy | trigger job passed | 11:56 |
| akahat | rlandy, https://review.rdoproject.org/r/c/rdo-jobs/+/44683 | 12:03 |
| rlandy | akahat: pls testproject that and then we can merge - thank you | 12:04 |
| rlandy | ysandeep: hey - you around? | 12:11 |
| ysandeep | rlandy, yes | 12:11 |
| rlandy | ysandeep: looking at bm boxes and what images are there - have a few minutes to review that with me? | 12:12 |
| rlandy | all bm jobs are full - no space | 12:12 |
| jpodivin | pojadhav|ruck: so ... do you think I should file it? Or is it already tracked? | 12:13 |
| rlandy | hel_rdoci--hp--01-root 50G 50G 2.8M 100% | 12:13 |
| pojadhav|ruck | jpodivin, it is already tracked on cix card : https://trello.com/c/fMby586x/2679-cixlp1987092tripleociproa-periodic-tripleo-ci-centos-9-standalone-validation-master-fails-on-check-keystone-public-endpoint-stat | 12:13 |
| ysandeep | rlandy, meet.google.com/tyh-tywh-uyo | 12:13 |
| pojadhav|ruck | jpodivin, please update here whatever status is for that validation job. | 12:14 |
| jpodivin | pojadhav|ruck: well, that card is tracking slightly different failure mode. It's still some sort of database but galera. | 12:14 |
| pojadhav|ruck | jpodivin, I will check above ^^ mentioned logs in few mins, then will decide ok ? | 12:18 |
| jpodivin | awesome, thanks pojadhav|ruck | 12:19 |
| pojadhav|ruck | rlandy, bug reported for build_containers issue https://bugzilla.redhat.com/show_bug.cgi?id=2122167 | 12:20 |
| * dviroel biab | 12:24 | |
| jpodivin | pojadhav|ruck: done. I've checked the logs on controller, it really seems to be the same galera issue. But given how much I know about galera it could also be only very similar. | 12:28 |
| pojadhav|ruck | jpodivin, thank you! | 12:28 |
| jm1 | chandankumar, ysandeep: thank you for your votes and comments ☺️ I tried to answer your questions, maybe it is better now? | 12:31 |
| ysandeep | rlandy, https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/844837 | 12:31 |
| rlandy | ysandeep: rdoci-hp-01.v100.rdoci.lab.eng.rdu2.redhat.com | 12:33 |
| chandankumar | jm1: checking now | 12:35 |
| ysandeep | rlandy, https://opendev.org/openstack/tripleo-quickstart/src/branch/master/playbooks/teardown-provision.yml#L4 | 12:36 |
| rlandy | ysandeep: rdo-ci-fx2-05-s7.v103.rdoci.lab.eng.rdu2.redhat.com | 12:41 |
| rlandy | ysandeep++ on finding the dstat issue | 12:49 |
| * dviroel back | 12:50 | |
| jm1 | rlandy, pojadhav|ruck: upstream cockpit working again, patches posted, updating rr notes now with current rdo status | 12:51 |
| pojadhav|ruck | rlandy, periodic-tripleo-build-containers-ubi-9-internal-rhel-9-build-push-upload-rhos-17.1 got passed in the current run.. | 12:52 |
| rlandy | pojadhav|ruck: nic | 12:53 |
| rlandy | nice | 12:53 |
| rlandy | can you try the 16.2 one again | 12:53 |
| pojadhav|ruck | rlandy, already did.. it is also running | 12:53 |
| pojadhav|ruck | rlandy, here https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/status#286307 | 12:54 |
| ysandeep | rlandy, https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-17-rhel9/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-9-bm_envB-3ctlr_1comp-featureset001-rhos-17/58f0b4d/logs/quickstart_files/hosts - [virthost] should work | 12:56 |
| rlandy | ysandeep: ok - patch coming up | 12:56 |
| rlandy | https://code.engineering.redhat.com/gerrit/c/testproject/+/276230 | 12:59 |
| rlandy | let's see what that does | 12:59 |
| rlandy | jm1: thank you for working on that | 13:01 |
| rlandy | jm1: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/854814 merged | 13:02 |
| rlandy | that was blocking master | 13:02 |
| jm1 | rlandy: great. ok to rerun jobs? | 13:04 |
| rlandy | for master, ack | 13:05 |
| rlandy | that fix should come through current | 13:05 |
| rlandy | as long as the change has made it to current, you can try | 13:06 |
| rlandy | ugh - for fs064 failed again diff issue | 13:06 |
| rlandy | 2022-08-29 08:56:00.677595 | primary | TASK [os_tempest : Get router admin state and ip address for older collection versions] *** | 13:06 |
| rlandy | 2022-08-29 08:56:00.677681 | primary | Monday 29 August 2022 12:56:00 +0000 (0:00:00.049) 0:08:10.116 ********* | 13:06 |
| rlandy | 2022-08-29 08:56:00.704720 | primary | fatal: [undercloud -> {{ tempest_service_setup_host }}]: FAILED! => {"msg": "The task includes an option with an undefined variable. The error was: list object has no element 0\n\nThe error appears to be in '/home/zuul/workspace/.quickstart/share/ansible/roles/os_tempest/tasks/tempest_resources.yml': line 288, column 7, but may\nbe elsewhere in the file depending on the exact syntax | 13:06 |
| rlandy | problem.\n\nThe offending line appears to be:\n\n\n - name: Get router admin state and ip address for older collection versions\n ^ here\n"} | 13:07 |
| rlandy | 2022-08-29 08:56:00.704760 | primary | | 13:07 |
| rlandy | jm1: ^^ | 13:07 |
| rlandy | that was the last fs064 failure | 13:07 |
| rlandy | doubt it's job related | 13:07 |
| jm1 | rlandy: that is again completely different from what we saw so far | 13:07 |
| jm1 | rlandy: want to force promote or rerun again just to be sure? | 13:09 |
| jm1 | rlandy: i will rerun to ensure this is really nothing which came up during last 4 days | 13:11 |
| rlandy | jm1: yep - yo can rekcik that patch one last time ... | 13:11 |
| ysandeep | rlandy, okay.. So I can confirm issue started after https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/844837 merges.. because the first log in dstat is from 23 june and this patch merged on 22 june. | 13:11 |
| ysandeep | 23-06 02:25:51| | 31G 554M 4096B 32G| | | | |1.39 1.37 1.49|4.0 0 | | 13:11 |
| rlandy | then we need to skip promote | 13:11 |
| rlandy | ysandeep: ack - nice catch | 13:11 |
| ysandeep | rlandy, chandankumar ^^ another issue is /var/log/extra/dstat.txt is appending and not rewriting | 13:11 |
| rlandy | jm1: fs001 is not a problem - we saw the internal one pass | 13:12 |
| ysandeep | so it now contains 3 months dstat logs | 13:12 |
| rlandy | so 64 would be the only real issue | 13:12 |
| rlandy | chandankumar: ysandeep: we may want to re-evaulate the benefit of dstat | 13:12 |
| rlandy | and target it more closely | 13:12 |
| ysandeep | rlandy, chandankumar https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/validate-perf/tasks/main.yml#L23 changing to > should also fix the issue. | 13:13 |
| ysandeep | +1 to target it more closely though | 13:13 |
| jm1 | ysandeep, rlandy: this dstat issue is the reason for fs64 or am i am missing some context? | 13:13 |
| ysandeep | jm1, different issue | 13:13 |
| jm1 | ysandeep: ah ok, thanks! | 13:13 |
| rlandy | jm1: no, it's the baremetal issue pojadhav|ruck mentioned | 13:14 |
| rlandy | dviroel: ^^ that was the real 'disk_full' fix | 13:15 |
| chandankumar | rlandy: ysandeep thank you for digging into that | 13:15 |
| rlandy | jm1: after this last 064 run - we promo one way or another :) | 13:15 |
| chandankumar | I will revisit the dstat target some day | 13:15 |
| ysandeep | chandankumar, https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/855021 | 13:17 |
| rlandy | akahat: going to merge https://review.rdoproject.org/r/c/rdo-jobs/+/44683 - needs the fix | 13:17 |
| ysandeep | chandankumar, testing currently | 13:17 |
| chandankumar | ack, let me know the results! | 13:17 |
| dviroel | rlandy: oh, interesting | 13:17 |
| jm1 | rlandy: yeah, btw fs39 is also failing, but this is probably intermittent. last failure was because ntp time was not synced 😱🙄 https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset039-wallaby/d0bca30/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 13:20 |
| jm1 | rlandy: ^ was talking about c9 wallaby | 13:20 |
| ysandeep | rlandy: fyi.. I have cleaned older dstat files on all baremetal nodes | 13:21 |
| rlandy | jm1: passed on last run on my patch | 13:21 |
| rlandy | ysandeep: awesome - thanks | 13:21 |
| rlandy | jm1: you need to run the right hash | 13:21 |
| rlandy | jm1: that hash is also missing fs035 | 13:22 |
| rlandy | so can you add that? | 13:22 |
| rlandy | I'll rerun my patch with the previous hash | 13:23 |
| rlandy | hopefully one of those will pass | 13:23 |
| rlandy | just rekciked mine | 13:24 |
| rlandy | so yours will be fin with fs035 | 13:24 |
| jm1 | rlandy: which hash do you want to promote? | 13:25 |
| jm1 | rlandy: probably 4e233ad84bc9f1a0788729d4e0cc279d | 13:27 |
| rlandy | jm1: I am not fussy - any one recent enough that passes | 13:29 |
| rlandy | jm1: your patch is fine with that latest hash | 13:29 |
| rlandy | it just need fs035 as well | 13:29 |
| * pojadhav|ruck back in 10 mins | 13:30 | |
| rlandy | jm1: hopefully after we promote wallaby c9, it will clean up baremetal and clients components - both failing fs001 | 13:32 |
| jm1 | rlandy: still checking promotions, components will come next | 13:32 |
| rlandy | jm1: ack - thanks - know you had the cockpit work | 13:35 |
| pojadhav|ruck | folks, based on previous discussion I am taking monday scrum half hr earlier to avoid clash with CIX call. due to RR stuff I missed it for this week, but from next week monday's scrum will be at 1.30 PM UTC. | 13:45 |
| ysandeep | rlandy, fyi.. invited you to https://github.com/tripleo-ci org | 13:51 |
| ysandeep | dviroel, made you owner of that org as well | 13:52 |
| dviroel | thanks | 13:52 |
| jm1 | rlandy, pojadhav|ruck: filed a new bug for c9 master tripleo component https://bugs.launchpad.net/tripleo/+bug/1988053 | 13:56 |
| pojadhav|ruck | Scrum in 4 mins : arxcruz, rlandy, marios, ysandeep, bhagyashris, svyas, soniya29, pojadhav, akahat, chandankumar, frenzy_friday, dviroel, rcastillo, jm1|rover, rlandy, dasm | 13:56 |
| soniya29 | pojadhav|ruck, ack | 13:56 |
| pojadhav|ruck | rlandy, 16.2 build container also got green run https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/build/d23ba1d72ad141e18c012da3d1d2422c | 13:56 |
| rlandy | pojadhav|ruck: ok - so was probably just a hitch then | 13:57 |
| pojadhav|ruck | rlandy, yeah | 13:58 |
| pojadhav|ruck | updated CIX with above result | 13:58 |
| *** dasm_ is now known as dasm | 14:03 | |
| dasm | pojadhav|ruck: scrum time is OK. it's how it was presented on my end. It looked like it moved from 7am to 5:30am. but in reality it's just 30 minutes move. | 14:04 |
| dasm | sorry for the noise. i got confused. | 14:05 |
| pojadhav|ruck | dasm, 30 mins earlier | 14:05 |
| pojadhav|ruck | dasm, np | 14:05 |
| arxcruz | /msg dasm i'm very happy things are moving foward with you as TC/UA, I hope things get more quickly and simple | 14:09 |
| arxcruz | well, it wasn't some secret anyway :) | 14:09 |
| rlandy | ysandeep: https://github.com/tripleo-ci - so we are all pushing our patches here? | 14:14 |
| rlandy | ysandeep: what is the workflow? who keeps the branch up to date? | 14:15 |
| rlandy | dviroel and I were talking about this on friday | 14:15 |
| ysandeep | rlandy, ^^ we use this as a source to push patch from, to different repos. We created this org so that incase we want to update each other patches we can do that. | 14:16 |
| ysandeep | rlandy, we just creates forks on tripleo-ci repos and each one of us create our own branches to our PRs | 14:17 |
| ysandeep | to create* our PRs | 14:17 |
| rlandy | so git clone this repo | 14:18 |
| rlandy | create branch | 14:18 |
| rlandy | push to tripleo-c repo | 14:18 |
| rlandy | the propose PR to orig releases? | 14:18 |
| rlandy | ysandeep: ^^ correct? | 14:18 |
| ysandeep | correct | 14:18 |
| dviroel | rlandy: correct | 14:18 |
| rlandy | got it | 14:19 |
| rlandy | ty | 14:19 |
| ysandeep | gerrit workflow was so easy - we can "git review -d <>" anyone's patch and push a new Patchset :) | 14:20 |
| chandankumar | ysandeep: you can try this https://cli.github.com/ | 14:20 |
| chandankumar | for github workflow | 14:21 |
| ysandeep | chandankumar: thanks! | 14:24 |
| dasm | arxcruz: thanks :) | 14:28 |
| rlandy | jm1: sc001 still failed - idk - maybe needs container rebuild? | 14:36 |
| jm1 | rlandy: wanted to taslk to you about that after cix call | 14:42 |
| rlandy | you can try container rebuild - or we don't have it fixed | 14:43 |
| dasm | I'm going to an auto shop. I'll be back later. | 14:50 |
| chandankumar | see ya! | 14:50 |
| *** ysandeep is now known as ysandeep|out | 14:52 | |
| ysandeep|out | rlandy, fyi.. this could be expanded as well to delete other file during cleanup - dstat.html and dstat.txt https://opendev.org/openstack/tripleo-quickstart/src/branch/master/roles/environment/teardown/tasks/main.yml#L55 | 14:55 |
| ysandeep|out | We deleted dstat-csv.log in each run and never deleted dstat.html and dstat.txt in months | 14:56 |
| ysandeep|out | anyway the current patch should hopefully work and we really don't need dstat on BM VIRTHOST , but incase that doesn't work we can do cleanup at ^^ | 14:57 |
| * ysandeep|out out | 14:57 | |
| *** dviroel is now known as dviroel|lunch | 15:08 | |
| jm1 | rlandy: c9 master jobs running again. having a break now | 15:10 |
| rlandy | jm1: sure - thanks | 15:10 |
| rlandy | ysandeep|out: ack - let's consider that with chandankumar tomorrow | 15:10 |
| pojadhav|ruck | rlandy, I just closed out this one : https://bugzilla.redhat.com/show_bug.cgi?id=2122167 | 15:10 |
| pojadhav|ruck | jm1, rlandy: leaving for the day | 15:14 |
| rlandy | ok | 15:14 |
| pojadhav|ruck | please left a notes if any on RR hackmd, will pick up | 15:15 |
| pojadhav|ruck | good night! | 15:15 |
| jm1 | pojadhav|ruck: thank you, have a nice evening :) | 15:15 |
| *** pojadhav|ruck is now known as pojadhav|out | 15:15 | |
| rlandy | dviroel|lunch: ysandeep|out: alan approved the quota increase | 15:48 |
| rlandy | will put in that ticket shortly | 15:49 |
| rlandy | jm1: this should be promotable: python3 roles/rrcockpit/files/telegraf_py3/ruck_rover.py --release wallaby --distro centos-9 --aggregate_hash tripleo-ci-testing/4e/23/4e233ad84bc9f1a0788729d4e0cc279d | 15:58 |
| *** dviroel|lunch is now known as dviroel | 16:07 | |
| dviroel | rlandy: ack - thanks | 16:07 |
| rlandy | woohoo wallaby c9 promoting | 16:15 |
| *** jpena is now known as jpena|off | 16:31 | |
| * dasm is back | 16:35 | |
| rlandy | periodic-tripleo-ci-centos-9-scenario001-standalone-mastertestprojectmastercheck44656,3 | 17:08 |
| rlandy | 1 hr 19 mins 40 secs2022-08-29 15:13:17SUCCESS | 17:08 |
| rlandy | jm1: ^^ nice | 17:08 |
| rlandy | dasm: hi ... should periodic-tripleo-ci-rhel-9-ovb-3ctlr_1comp-featureset035-internal-rhos-17.1 still be out of criteria? ananya said you had a patch for it? | 17:17 |
| rlandy | maybe? | 17:17 |
| rlandy | https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/builds?job_name=periodic-tripleo-ci-rhel-9-ovb-3ctlr_1comp-featureset035-internal-rhos-17.1&pipeline=openstack-periodic-integration-rhos-17.1-rhel9&skip=0 | 17:18 |
| rlandy | wallaby c9 promoted - current-tripleo/2022-08-29 16:43 | 17:22 |
| rlandy | jm1: ^^ | 17:22 |
| rlandy | jm1: master only short of fs35 - in rerun now | 17:23 |
| rlandy | 17.1 missng jobs in rerun | 17:23 |
| rlandy | as well as 16.2 | 17:24 |
| rlandy | bm | 17:24 |
| rlandy | pojadhav|out: ^^ | 17:24 |
| rlandy | tripleowallabycentos8 promoting again | 17:27 |
| rlandy | dviroel: hi ... pls see pvt re: vexx flavors ... | 17:32 |
| dasm | rlandy: i did not have a patch for rhos 17.1 to place it in criteria. it should be out | 17:40 |
| dasm | rlandy: wait a sec. it's just regular fs035, not rbac. | 17:41 |
| dasm | i believe it's just normal thing to have it there. | 17:41 |
| rlandy | dasm: regular fs035 | 17:42 |
| rlandy | ok - will have to look into that | 17:42 |
| jm1 | rlandy: good, so wallaby c9 promoted and master is missing fs035 only. then i will raise https://bugs.launchpad.net/tripleo/+bug/1988053 to cix now | 18:42 |
| rlandy | jm1: in rerun now | 18:43 |
| jm1 | rlandy: saw it, thanks! | 18:43 |
| rlandy | otherwise will skip promote | 18:43 |
| jm1 | rlandy: what am i missing for cix here? https://bugs.launchpad.net/tripleo/+bug/1988053 | 18:53 |
| rlandy | looking | 19:11 |
| rlandy | jm1: idk - looks like all component jobs | 19:19 |
| rlandy | I really want to promote master | 19:19 |
| rlandy | so we can freshen the runs and see if these are legit | 19:19 |
| rlandy | jm1: let me check if fs035is skippable or not | 19:23 |
| jm1 | rlandy: i am wondering what i am missing for our cix bot to pick this lp bug https://bugs.launchpad.net/tripleo/+bug/1988053 up? | 19:24 |
| rlandy | oh ... | 19:24 |
| rlandy | checking | 19:24 |
| rlandy | jm1: add tag promotion-blocker | 19:25 |
| rlandy | see the 'add tags' link? | 19:25 |
| jm1 | rlandy: ah damn... found it. thanks! | 19:27 |
| rlandy | sorry - thought you were asking a more complicated question | 19:28 |
| jm1 | rlandy: btw fs35 on c8 train is also the only job missing for promotion. it seems to be an intermittent error though, which actually was reported first more than one year ago https://bugs.launchpad.net/tripleo/+bug/1938987 | 19:30 |
| rlandy | jm1: ha - master will promote :) | 19:31 |
| rlandy | hash rerun in current line | 19:32 |
| rlandy | jm1: have train fs035 i run now | 19:32 |
| rlandy | it's on tempest | 19:32 |
| rlandy | we cam decide what to do when that promotes | 19:33 |
| rlandy | ugh reports | 19:33 |
| jm1 | rlandy: oh ok i have c8 train fs35 in rerun as well. then lets hope that one of those jobs passes ;) | 19:33 |
| rlandy | 16.2 should also promote | 19:33 |
| rlandy | you're having a productive day :) | 19:33 |
| rlandy | and 17.1 is missing 1 job in rerun now | 19:34 |
| rlandy | master is promoting | 19:36 |
| rlandy | no skipping | 19:36 |
| jm1 | rlandy: rerunning c9 master components jobs because https://bugs.launchpad.net/tripleo/+bug/1987641 is fixed and my previous rerun were still using the old tripleo-heat-templates package | 19:40 |
| rlandy | ok | 19:41 |
| rlandy | you may have better luck also when master finishes promoting | 19:41 |
| rlandy | jm1: late for you | 19:41 |
| rlandy | tomorrow is also fine | 19:41 |
| jm1 | rlandy: c9 master tripleo component will not promote anyway because of LP#1988053 | 19:42 |
| rlandy | ok | 19:43 |
| rlandy | jm1: go to sleep :) - I'll leave you notes on rr hackmd | 19:55 |
| jm1 | rlandy: found something interesting in jiri's validation bug report.. | 19:59 |
| jm1 | rlandy: ok i will not solve that today. i am eod now | 20:06 |
| * jm1 have a nice evening #oooq | 20:06 | |
| rlandy | have a good night | 20:07 |
| dasm | jm1: o/ | 20:07 |
| rlandy | ysandeep|out++ ... periodic-tripleo-ci-rhel-8-bm_envD-3ctlr_1comp-featureset035-rhos-16.2testprojectmastercheck276230,72 | 20:19 |
| rlandy | 6 hrs 1 min 12 secs2022-08-29 13:14:31SUCCESS | 20:19 |
| * rlandy checks box | 20:19 | |
| rlandy | hp--01-root 50G 6.3G 44G 13% / | 20:20 |
| rlandy | better | 20:20 |
| rlandy | dasm: dviroel: ysandeep|out: chandankumar: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/855021 - reviews pls | 20:21 |
| reviewbot | Do you want me to add your patch to the Review list? Please type something like add to review list <your_patch> so that I can understand. Thanks. | 20:21 |
| rlandy | to clear BM | 20:21 |
| rlandy | jm1[m]: pojadhav|out; pls note program call doc template is changing - we are reporting with prod chain | 20:25 |
| rlandy | will give you more details tomorrow | 20:26 |
| dasm | rlandy: lgtm | 20:27 |
| rcastillo | lunch brb | 20:44 |
| rlandy | dviroel: vexx project quotas should have been updated | 20:46 |
| rlandy | dviroel: can you confirm? | 20:46 |
| * dviroel looks | 20:48 | |
| dviroel | rlandy: confirmed, everything is ok | 20:51 |
| * dasm is going to pick up his car from an auto shop. bbl | 21:04 | |
| *** rlandy is now known as rlandy|bbl | 21:59 | |
| * dviroel out | 22:42 | |
| *** dviroel is now known as dviroel|out | 22:42 | |
| dasm | broken cs9 ipxe triaging process [xxx...] | 23:34 |
| dasm | few more tests prepared, we might know tomorrow/the day after tomorrow what's actually happening. | 23:35 |
| dasm | atm, last working one: CentOS-Stream-GenericCloud-9-20220613.0, first failing one: CentOS-Stream-GenericCloud-9-20220617.d.0 | 23:35 |
| dasm | more tests needed | 23:35 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!