| *** ysandeep|out is now known as ysandeep | 00:08 | |
| ysandeep | good morning/evening folks o/ | 00:10 |
|---|---|---|
| rcastillo | good morning ysandeep | 00:22 |
| rcastillo | early for you | 00:23 |
| ysandeep | Hey Rafael o/ yes comparatively earlier today | 00:24 |
| rcastillo | indeed | 00:25 |
| rcastillo | I was actually about to log off | 00:25 |
| rcastillo | have a great day o/ | 00:25 |
| ysandeep | Have a great evening! | 00:25 |
| *** rlandy|bbl is now known as rlandy | 02:03 | |
| *** rlandy is now known as rlandy|out | 02:06 | |
| *** ysandeep is now known as ysandeep|out | 03:42 | |
| * ysandeep|out will be back in evening | 03:42 | |
| *** ykarel|away is now known as ykarel | 05:01 | |
| *** pojadhav|out is now known as pojadhav | 06:00 | |
| marios | o/ bhagyashris jm1[m] | 06:00 |
| bhagyashris | marios, 0/ | 06:19 |
| *** chkumar|ruck is now known as chandankumar | 06:29 | |
| *** ysandeep|out is now known as ysandeep | 06:49 | |
| marios | bhagyashris: once you and jm1[m] have a chance to sync/decide who is doing what we can talk after to see what i can help with | 07:05 |
| *** jm1|ruck is now known as jm1|rover | 07:06 | |
| jm1 | marios, bhagyashris, oooci: good morning :) | 07:07 |
| marios | o/ | 07:07 |
| jm1 | marios: bhagyashris chose downstream | 07:08 |
| marios | jm1: ack cool i didn't know if you had a chance to discuss who is doing what already | 07:08 |
| jm1 | marios: i will go through our upstream integration and component lines, rerun jobs with intermittent failere and update our rr notes | 07:09 |
| marios | jm1: k mainly just ping me if you want to talk about something or need me to pick something up | 07:10 |
| marios | bhagyashris: same ^^ | 07:10 |
| jm1 | marios: ok, thank you! | 07:10 |
| marios | jm1: bhagyashris: i'll let you catch up and we can sync in an hour or two as needed but ping me any time | 07:10 |
| marios | jm1: 10:09 < jm1> marios: i will go through our upstream integration and component lines, rerun jobs with intermittent failere and update | 07:12 |
| chandankumar | jm1: o/ | 07:12 |
| marios | jm1: sounds good but don't forget to keep eye on the gate too | 07:12 |
| chandankumar | jm1: let me know where can I help. | 07:12 |
| marios | jm1: like checking periodically if all ok (seems fine now) things like cockpit there http://tripleo-cockpit.lab4.eng.bos.redhat.com/d/9DmvErfZz/cockpit?orgId=1 (Upstream gate jobs 1 fails/24 hours sounds ok) | 07:13 |
| marios | jm1: or just at https://zuul.openstack.org/status#tripleo | 07:13 |
| marios | rlandy|out: regarding https://bugs.launchpad.net/tripleo/+bug/1988810 (we discussed last night in handover) it looks like the card was created ok @ trello /production-chain-escalation | 07:15 |
| marios | o/ chandankumar happy friday \o/ | 07:16 |
| chandankumar | marios: o/ | 07:16 |
| chandankumar | ah it's friday | 07:16 |
| marios | :D | 07:16 |
| marios | i see.. its been one of *those* weeks chandankumar well... you made it congrats ;) | 07:17 |
| chandankumar | thank you thank you :-) | 07:17 |
| chandankumar | jm1: I have kicked the wallaby failing jobs in the morning via tp https://review.rdoproject.org/zuul/status#44840 | 07:20 |
| chandankumar | on master, there were different failures on different ovb jobs | 07:20 |
| jm1 | chandankumar: hello :) thank you very much | 07:24 |
| jm1 | marios: yep will do | 07:24 |
| marios | akahat: can you please add the mixed rhel reviews to reviews list? maybe we can merge today | 07:32 |
| reviewbot | Do you want me to add your patch to the Review list? Please type something like add to review list <your_patch> so that I can understand. Thanks. | 07:32 |
| marios | tonyb: let me know if you need more info for https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/426545/7/zuul.d/component-jobs-rhos-17.1-rhel-9.yaml (I set -1 on the criteria patch and pointed at that ) | 07:32 |
| *** jpena|off is now known as jpena | 07:35 | |
| bhagyashris | marios, sure | 07:36 |
| marios | jm1: bhagyashris: please update your irc nick we need to be visible in #tripleo so folks know who to ping | 07:40 |
| marios | 10:32 < marios> tonyb: let me know if you need more info for | 07:45 |
| marios | https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/426545/7/zuul.d/component-jobs-rhos-17.1-rhel-9.yaml (I set -1 on the criteria patch and pointed at that ) | 07:45 |
| marios | sorry bad paste :) | 07:46 |
| marios | jm1: bhagyashris: you'll need to be a bit more responsive to irc as ruck rover though ... :) please renick asap | 07:55 |
| *** bhagyashris is now known as bhagyashris|ruck | 07:57 | |
| bhagyashris|ruck | marios, thanks :) due to network issue it reconnect with original name | 07:58 |
| jm1 | marios: wtf? | 07:58 |
| marios | jm1: which bit | 07:58 |
| jm1 | marios: ? | 07:58 |
| marios | jm1: ? not sure whats going on right now what do you mean by 10:58 < jm1> marios: wtf? | 07:59 |
| marios | bhagyashris|ruck: ack | 07:59 |
| jm1 | marios: "<marios> jm1: bhagyashris: you'll need to be a bit more responsive to irc as ruck rover though ... :) please renick asap" << ? | 07:59 |
| marios | jm1: k ? | 08:00 |
| marios | jm1: i see you already have another nick here jm1 jm1|rover and jm1[m] .. i missed that (you could have just said ?) | 08:01 |
| jm1 | marios: ah.. you are wondering why i have three nicks here. one is regular registered username, next one is for rr, last one is matrix client | 08:03 |
| marios | jm1: no i was mainly wanting to make sure we have a nick|ruck and nick|rover in the channel (and #tripleo) | 08:04 |
| marios | jm1: i thought you didn't already renick and missed you had already a jm1|rover here but we didn't have a |ruck ... anyway | 08:04 |
| jm1 | marios: ack ok, sorry for the confusion | 08:04 |
| marios | jm1: ack on the 3 nicks np as long as we have |ruck |rover | 08:04 |
| ysandeep | jm1|rover, bhagyashris|ruck hey I pinged arxcruz|rover yesterday around your rr handover time about df complaning about rdo third party check jobs not stable, just want to repost to new ruck/rover so that that is not lost in handover transition | 08:08 |
| ysandeep | jm1|rover, bhagyashris|ruck https://meetings.opendev.org/irclogs/%23tripleo/%23tripleo.2022-09-08.log.html#t2022-09-08T14:19:57 | 08:08 |
| ysandeep | Rabi shared two example apart from mirror issues:- | 08:09 |
| ysandeep | ramishra> ysandeep: https://logserver.rdoproject.org/07/856407/1/openstack-check/tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001/bd5b588/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 08:09 |
| ysandeep | ramishra> ysandeep: A different one https://logserver.rdoproject.org/07/856407/1/openstack-check/tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001/abe19a6/logs/overcloud-controller-0/var/log/extra/pcs.txt.gz | 08:09 |
| ysandeep | Could you please check if these intermittent failure are hitting happening and if we have a bug for these issues? | 08:10 |
| *** arxcruz|rover is now known as arxcruz | 08:10 | |
| arxcruz | ysandeep i saw a card on trello, but i didn't check again yesterday | 08:10 |
| arxcruz | give me a few minutes and i'll | 08:10 |
| ysandeep | arxcruz: no worries, i think it was late for late when I pinged(you were near your eod), new ruck/rover can take a look. | 08:11 |
| * ysandeep also checking cix board to pass bug ref. to Rabi | 08:12 | |
| ysandeep | hmm, I didn't find an exact bug but i wonder if https://bugs.launchpad.net/tripleo/+bug/1987092 is because of the same cause. | 08:17 |
| *** ysandeep is now known as ysandeep|lunch | 08:29 | |
| dpawlik | hello folks, how many RAM can be used inside the VM for job periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-master ? | 09:04 |
| dpawlik | I would like to change the multipliers in nova on IBM host | 09:05 |
| jm1 | marios, chandankumar: wow upstream ci jobs are really in a shit state | 09:19 |
| marios | dpawlik: don't have a simple answer but you can see meminfo for current jobs there : controller @ https://logserver.rdoproject.org/50/44150/19/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-master/8bf4a58/logs/overcloud-controller-0/var/log/extra/meminfo.txt.gz | 09:20 |
| dpawlik | thanks marios++ | 09:20 |
| marios | dpawlik: and compute @ is at https://logserver.rdoproject.org/50/44150/19/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-master/8bf4a58/logs/overcloud-novacompute-0/var/log/extra/meminfo.txt.gz | 09:21 |
| marios | dpawlik: glad it was useful | 09:21 |
| marios | jm1: o/ looking.. where you mean gate? | 09:21 |
| jm1 | marios: did my first round on integration lines and component lines. listed all red stuff in rr notes. a looooot of jobs are failing | 09:22 |
| marios | jm1: ack ok 'periodic' then not 'upstream' wrt 12:19 < jm1> marios, chandankumar: wow upstream ci jobs are really in a shit state | 09:24 |
| jm1 | marios: non-periodic jobs are also affected by intermittent issues, so upstream (:= tripleo ci jobs) in general is unstable | 09:26 |
| chandankumar | jm1: fs01 check jobs are failing on node provisioning | 09:27 |
| marios | jm1: i don't see anything failing in gate (this is what i assumed for upstream) . do you mean rdo/3rd party is unstable? | 09:27 |
| chandankumar | jm1: I am trying to exclude the latest kernel to see if it fixes the issue | 09:27 |
| jm1 | marios: let me go through the current failures in integration lines, then it will be easier to talk about | 09:28 |
| jm1 | chandankumar: cool, thank you! | 09:28 |
| marios | jm1: sure | 09:28 |
| chandankumar | jm1: on master line, fs01 passed on ibm cloud and internal psi cloud | 09:29 |
| chandankumar | fs01 failure might be cloud issue | 09:29 |
| chandankumar | periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-internal-master │ | 09:29 |
| chandankumar | │ periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-master-ibm-3 │ | 09:29 |
| chandankumar | │ periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset035-internal-master | 09:29 |
| chandankumar | ibm-3 job got picked from daniel stress testing | 09:30 |
| jm1 | chandankumar: sync mirror issue on fs1? | 09:35 |
| jm1 | chandankumar: nevermind, lets wait for reruns | 09:35 |
| chandankumar | gnutls issue | 09:36 |
| chandankumar | time for revert | 09:36 |
| marios | oooci o/ please add these to your reviews list https://review.rdoproject.org/r/c/rdo-jobs/+/44415 and depends-on https://review.opendev.org/c/openstack/tripleo-quickstart/+/853860 (testproject in commit message) thanks | 09:42 |
| reviewbot | Do you want me to add your patch to the Review list? Please type something like add to review list <your_patch> so that I can understand. Thanks. | 09:42 |
| marios | reviewbot: please add to the review list https://review.rdoproject.org/r/c/rdo-jobs/+/44415 and depends-on https://review.opendev.org/c/openstack/tripleo-quickstart/+/853860 | 09:42 |
| reviewbot | I could not add the review to Review List | 09:42 |
| reviewbot | I could not add the review to Review List | 09:42 |
| marios | reviewbot: but you did. thanks then | 09:42 |
| reviewbot | You are welcome :) | 09:42 |
| marios | akahat: ^^ | 09:43 |
| chandankumar | jm1: for gnutls issue https://review.opendev.org/c/openstack/tripleo-quickstart/+/856582 revert patch, will keep you posted based on results | 09:43 |
| frenzyfriday | someone finally used the thanks option on the bot XD | 09:43 |
| marios | :) | 09:43 |
| akahat | marios, thank you. | 09:45 |
| marios | akahat: welcome | 09:46 |
| *** ysandeep|lunch is now known as ysandeep | 09:48 | |
| akahat | chandankumar, ysandeep|lunch bhagyashris|ruck rlandy|out please review https://review.rdoproject.org/r/c/rdo-jobs/+/44415 and https://review.opendev.org/c/openstack/tripleo-quickstart/+/853860 | 09:48 |
| akahat | if you are rechecking some projects please add this as depends-on so we can merge it by EOF. | 09:49 |
| chandankumar | akahat: https://review.rdoproject.org/r/c/rdo-jobs/+/44415 can you add these jobs to pipleine also in same patch | 09:49 |
| akahat | chandankumar, ok | 09:50 |
| jm1 | chandankumar: thanks for the gnutls update :) | 09:50 |
| jm1 | ysandeep: tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001 is a disaster. our periodic jobs for that fail a lot, e.g. https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-master&skip=0 | 09:54 |
| jm1 | ysandeep: or https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-wallaby&skip=0 | 09:54 |
| jm1 | ysandeep: maybe ramishra's issue is related to https://bugs.launchpad.net/tripleo/+bug/1987092 ? | 09:58 |
| ysandeep | jm1, yes ^^ seems same issue | 09:59 |
| jm1 | ysandeep: we have a cix card for that, its haunting us a lot | 10:00 |
| jm1 | ysandeep: but lucky us its not affecting our integration lines today | 10:00 |
| ysandeep | ack, good that we have a bug for this.. looks this this performance issue can fail on lot of different steps. | 10:00 |
| jm1 | ysandeep: ooooh yes | 10:01 |
| * bhagyashris|ruck brb | 10:04 | |
| akahat | reviewbot, please add to the review list https://review.rdoproject.org/r/c/rdo-jobs/+/44859 | 10:15 |
| reviewbot | I could not add the review to Review List | 10:15 |
| jm1 | hah, hello arecord error. glad to see you again this rr shift https://logserver.rdoproject.org/openstack-component-security/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset039-security-master/6146852/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 10:16 |
| *** rlandy|out is now known as rlandy | 10:34 | |
| rlandy | marios: jm1: bhagyashris|ruck: hi - reading back | 10:36 |
| marios | o/ | 10:37 |
| jm1 | rlandy: o/ | 10:38 |
| jm1 | rlandy: have to check 3 more logs then we can sync | 10:38 |
| rlandy | marios: jm1: bhagyashris|ruck: yeah ... ok - we will needto pick up on check jobs for OVB | 10:38 |
| rlandy | marios: jm1: bhagyashris|ruck: pls ping when ready | 10:39 |
| rlandy | marios: sending you info on trello keys | 10:39 |
| marios | rlandy: k | 10:40 |
| jm1 | rlandy: ready | 10:41 |
| rlandy | bhagyashris|ruck: around? | 10:41 |
| rlandy | marios: jm1: ok let's start with upstream https://meet.google.com/tbt-vcmd-njn?pli=1&authuser=0 | 10:42 |
| marios | rlandy: i will skip let me know if you need me | 10:43 |
| arxcruz | bhagyashris|ruck jm1 https://logserver.rdoproject.org/50/44150/20/check/periodic-tripleo-ci-centos-9-standalone-full-tempest-api-master/455b029/logs/undercloud/var/log/tempest/stestr_results.html.gz | 10:44 |
| arxcruz | This is a real bug, it's failing constantly, need to open a bug, and add it on skiplist | 10:44 |
| rlandy | 3edefe9728ecab11e979d22a0d03263d | 10:57 |
| rlandy | arxcruz: we're talking about that | 10:57 |
| chandankumar | arxcruz: it is a known failure something from network component caused that | 11:02 |
| rlandy | chandankumar: so we promoted that up from network? | 11:03 |
| rlandy | was there a bug on that? | 11:03 |
| rlandy | I assume that is what we skip promoted? | 11:03 |
| chandankumar | rlandy: yes we skipped the job, we have not filed the bug | 11:04 |
| rlandy | dasm|off; hi - when you are in - let's talk about the cockpit scripts | 11:04 |
| chandankumar | arxcruz: you are opening the bug? | 11:05 |
| *** pojadhav is now known as pojadhav|sick | 11:05 | |
| marios | anyone wants to discuss reviews? | 11:15 |
| reviewbot | Do you want me to add your patch to the Review list? Please type something like add to review list <your_patch> so that I can understand. Thanks. | 11:15 |
| chandankumar | just pinged steve on hardprov gchat regarding fs01 check job https://bugs.launchpad.net/tripleo/+bug/1987632 | 11:17 |
| frenzyfriday | Shutting down the bot for a while to test | 11:25 |
| marios | frenzyfriday: ysandeep: rlandy: i re-added yesterday from the history | 11:36 |
| ysandeep | marios++ nice! | 11:37 |
| frenzyfriday | marios, thanks. Checking logs from the bot at 7:25 on sept 8 | 11:37 |
| marios | ysandeep: k not that big a deal but thanks :) | 11:39 |
| dviroel | op/ | 11:44 |
| ysandeep | o/ | 11:47 |
| Tengu | chandankumar: heya! seems there's still an issue with the image signature in molecule tests for tripleo-ansible ? https://zuul.opendev.org/t/openstack/build/13cbaf7cecda4815a213b153912d0564 though I did rebase it onto HEAD... | 11:52 |
| chandankumar | Tengu: wil take a look soon | 12:02 |
| chandankumar | rlandy: bug updated https://bugs.launchpad.net/tripleo/+bug/1987632 | 12:02 |
| chandankumar | proposing a workaround | 12:02 |
| chandankumar | till we switch to dib based image | 12:02 |
| Tengu | chandankumar: ah. the downgrade happens BEFORE the package is actually installed... | 12:03 |
| Tengu | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_13c/853481/41/check/tripleo-ansible-centos-stream-molecule-tripleo_httpd_vhost/13cbaf7/job-output.txt | 12:03 |
| Tengu | guess that may explain. | 12:03 |
| Tengu | chandankumar: so we have to ensure it's downgraded in the pre.yaml as well. | 12:04 |
| Tengu | the directories.yml comes too early. | 12:04 |
| chandankumar | Tengu: please propose the fix thank you :-) | 12:06 |
| Tengu | chandankumar: on it! | 12:06 |
| chandankumar | sorry fixing node provisioning issue | 12:06 |
| Tengu | np problem, the patch was already almost done :) | 12:07 |
| chandankumar | jm1: rlandy if rdo check jobs passes, merge it https://review.opendev.org/c/openstack/tripleo-quickstart/+/856603 | 12:19 |
| jm1 | chandankumar: thank you very much, will have a look | 12:44 |
| rlandy | chandankumar: jm1: pojadhav|sick: bhagyashris|ruck: akahat: marios: arxcruz: Tengu: dviroel: rcastillo: frenzyfriday: soniya29: ysandeep: pls see https://lists.openstack.org/pipermail/openstack-discuss/2022-September/030405.html | 12:48 |
| rlandy | ACTION REQUIRED to receive the voting ballot from CIVS: opting in to receiving email communications from CIVS. | 12:48 |
| chandankumar | brb | 12:48 |
| rlandy | note: ^^ you will need to opt in for emails to vote | 12:49 |
| rlandy | chandankumar: jm1: pojadhav|sick: bhagyashris|ruck: akahat: marios: arxcruz: Tengu: dviroel: rcastillo: frenzyfriday: soniya29: ysandeep: please do this - we have a candidate on the ballot :) | 12:49 |
| rlandy | https://governance.openstack.org/election/#antelope-tc-candidates | 12:50 |
| marios | rlandy: dont think that one applies to us rlandy | 12:50 |
| marios | rlandy: or what do you mean by please do this - we have a candidate on the ballot :) | 12:51 |
| marios | rlandy: which candidate | 12:51 |
| marios | ah tc probably | 12:51 |
| marios | i thought it was just about teams | 12:51 |
| rlandy | marios: see tc candidates | 12:51 |
| marios | chandankumar: :D | 12:51 |
| marios | rlandy: ack | 12:52 |
| arxcruz | rlandy just to request the civs right? | 12:53 |
| Tengu | let's see | 12:53 |
| Tengu | ah, I have activated my thingy. | 12:54 |
| marios | Email address successfully activated. | 12:55 |
| chandankumar | thank you rlandy for sharing it :) | 13:06 |
| chandankumar | Thank you everyone :-) | 13:06 |
| jm1 | rlandy: for c9 master promotion (hash 3edefe9728ecab11e979d22a0d03263d) we need 3 jobs: full-tempest, fs35 and kvm-internal. arxcruz suggested to simply temporarily remove those three jobs from criteria instead of creating a skiplist for tempest and rerunning the other two jobs again and again and again.. what do you think? | 13:15 |
| arxcruz | jm1 rlandy yes, since we are skipping the kvm, and the full api we know the two tests should be skipped for now | 13:16 |
| arxcruz | only miss the fs035 that is a pain to success | 13:16 |
| rlandy | arxcruz: jm1: at nine days out - we will probably land up skipping fs035 | 13:17 |
| arxcruz | my though exactly | 13:18 |
| rlandy | the kvm job just passed | 13:18 |
| rlandy | oh no | 13:18 |
| rlandy | sorry | 13:18 |
| rlandy | it didn't | 13:18 |
| rlandy | we need the skiplist patch | 13:18 |
| rlandy | jm1: arxcruz: ok - so do this ... add skiplist patch | 13:19 |
| chandankumar | jm1: does downstream fs035 on that hash does not passed? | 13:19 |
| *** ysandeep is now known as ysandeep|brb | 13:19 | |
| rlandy | periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset035-internal-master | 13:19 |
| rlandy | yes | 13:19 |
| rlandy | that is what I just checked | 13:19 |
| jm1 | rlandy, chandankumar: periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset035-master | 13:19 |
| chandankumar | we can skip it from upstream and promote it | 13:19 |
| rlandy | yep ok | 13:20 |
| *** dasm|off is now known as dasm | 13:20 | |
| dasm | rlandy: \o | 13:20 |
| rlandy | jm1: ok - so onec you have the skiplist patch | 13:20 |
| rlandy | then submit the ci-config patch to comment out those tests | 13:21 |
| rlandy | and we'll merge | 13:21 |
| rlandy | ok? | 13:21 |
| rlandy | dasm: hello ... | 13:21 |
| dasm | rlandy: you wanted to talk about cockpit scripts, right? | 13:21 |
| rlandy | dasm: yeah - rdo zuul seemed super slow today | 13:21 |
| rlandy | are we still struggling with the scripts? | 13:22 |
| dasm | rlandy: it depends. if it's slow every 30 minutes, then yes. | 13:22 |
| rlandy | hmmm ... ok | 13:22 |
| dasm | dpawlik mentioned yesterday that's better now, but he suggested to stop querying zuul, and go straight to opensearch | 13:23 |
| rlandy | dasm: ^^ would that be workable | 13:23 |
| dasm | or even completely bypass opensearch and push logs straigt to influx. | 13:23 |
| dasm | i'm checking both routes atm. | 13:23 |
| dasm | probably it' | 13:23 |
| dasm | it's gonna be quick fix with opensearch, and later i'm gonna change ci-collector | 13:24 |
| dasm | yes, it is workable. everything is workable, it just depends how much time we have | 13:24 |
| *** ysandeep|brb is now known as ysandeep | 13:30 | |
| ysandeep | dviroel, rlandy, hey o/ podified mtg time | 13:30 |
| jm1 | rlandy, arxcruz: okeee, lets see if c9 master wants to promote now.. https://review.rdoproject.org/r/c/testproject/+/44656 | 13:34 |
| rlandy | jm1: sorry - I think I confused you | 13:35 |
| rlandy | I agreed with arx | 13:35 |
| rlandy | you can submit the ci-config file to comment out those jobs and not rerun | 13:36 |
| rlandy | the skiplist patch we need | 13:36 |
| rlandy | ack | 13:36 |
| rlandy | periodic-tripleo-ci-centos-9-scenario010-kvm-internal-standalone-master won;t kick on rdo | 13:36 |
| jm1 | rlandy: omg yeah of course... | 13:36 |
| jm1 | rlandy: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/44863 | 13:44 |
| jm1 | rlandy: do we want to skip internal kvm job, too? | 13:45 |
| chandankumar | if it is not passing then yes we need to remove that also from criteria | 13:45 |
| chandankumar | otherwise it will not promote | 13:45 |
| jm1 | chandankumar: last time it passed was 2022-08-31 | 13:49 |
| rlandy | jm1: yes pls | 13:49 |
| jm1 | rlandy: ack, updated patch https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/44863 | 13:51 |
| jm1 | chandankumar: ^ | 13:58 |
| chandankumar | rlandy: done | 13:58 |
| chandankumar | jm1: done | 13:58 |
| jm1 | chandankumar: thank you sir :) | 13:58 |
| chandankumar | jm1: rlandy for cs9 wallaby fs01 internal has passed | 13:59 |
| chandankumar | if we skip fs01 and fs039, it can also promote | 13:59 |
| chandankumar | it will clear one cix | 13:59 |
| rlandy | jm1: thank you | 13:59 |
| jm1 | chandankumar: which hash? | 14:00 |
| chandankumar | jm1: it is the latest one a29104cf0a2a21bb5b863335b204ba1f | 14:00 |
| rlandy | let's try this one first | 14:00 |
| chandankumar | ruck rover tool give that | 14:00 |
| jm1 | rlandy, chandankumar: checked latest failures of c9 wallaby fs01 and fs39, both failed on intermittent failures twice | 14:06 |
| jm1 | rlandy, chandankumar: rr notes updated with details | 14:07 |
| jm1 | rlandy, chandankumar: will rerun them again anyway | 14:08 |
| chandankumar | jm1: ok | 14:09 |
| chandankumar | see ya! | 14:12 |
| chandankumar | jm1: rlandy marios thank you, have a nice weekend :-) | 14:12 |
| jm1 | chandankumar: have a nice weekend as well :) | 14:12 |
| jm1 | chandankumar: and thanks again for helping out! | 14:13 |
| marios | have a good one chandankumar o/ | 14:17 |
| bhagyashris|ruck | rhos17.1 on rhel9 promoted | 14:24 |
| rlandy | jm1: sorry - reading back | 14:30 |
| jm1 | rlandy: np, jobs are still running | 14:31 |
| rlandy | rotating meetings :) | 14:31 |
| ysandeep | happy weekend everyone o/ | 14:37 |
| *** ysandeep is now known as ysandeep|out | 14:37 | |
| jm1 | ysandeep|out: have a nice weekend o/ | 14:37 |
| jm1 | rlandy, bhagyashris|ruck, marios: c9 master jobs are still running, links to skiplist patch and criteria removal patch in rr notes. c9 wallaby is missing fs39 and fs01 only, both fail on intermittent errors. reruns for c9 wallaby jobs still in progress. having a break now. | 14:38 |
| * jm1 bbl | 14:38 | |
| rlandy | jm1: ok - will check in on the wallaby failures next | 14:41 |
| *** dviroel is now known as dviroel|lunch | 14:52 | |
| rlandy | dasm: hey - have a few minutes now to to finish jira board discussion | 15:04 |
| dasm | rlandy: sure | 15:04 |
| rlandy | dasm: https://meet.google.com/tok-qmpi-zgx?pli=1&authuser=0 | 15:05 |
| *** dviroel|lunch is now known as dviroel | 15:53 | |
| rlandy | jm1; wrt wallaby - we have a pass on periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-internal-wallaby | 15:55 |
| rlandy | so if fs039 gets by - you can skop fs001 and promote | 15:55 |
| marios | o/ have a good weekend oooci | 15:56 |
| rlandy | marios: have a good weekend | 15:56 |
| marios | rlandy: need any votes/something else before i go? | 15:56 |
| rlandy | marios: ok for now, thanks | 15:56 |
| marios | k | 15:57 |
| *** marios is now known as marios|out | 15:59 | |
| *** jpena is now known as jpena|off | 16:35 | |
| rlandy | "tripleowallabycentos8" is promoting | 17:04 |
| rlandy | jm1: ^^ | 17:04 |
| rlandy | master should promote | 17:05 |
| jm1 | rlandy: oh wow | 17:08 |
| rlandy | jm1: wrt wallaby | 17:08 |
| rlandy | fs039 passed | 17:08 |
| rlandy | gave fs001 one more try | 17:08 |
| rlandy | but if not, will skip promote there | 17:08 |
| rlandy | internal fs001 passed | 17:09 |
| rlandy | jm1: also ... bless chandankumar for this one https://review.opendev.org/c/openstack/tripleo-quickstart/+/856603 | 17:10 |
| rlandy | master ovb check passed | 17:10 |
| rlandy | rerunning to see if wallaby will pass | 17:10 |
| jm1 | rlandy: did you rerun c9 master full-tempest-api? it failed on my run | 17:11 |
| rlandy | jm1; I did | 17:11 |
| rlandy | passed | 17:11 |
| rlandy | periodic-tripleo-ci-centos-9-standalone-full-tempest-api-mastersuccess | 17:11 |
| rlandy | jm1: so you can have a restful weekend | 17:11 |
| jm1 | rlandy: ah i see, your testproject is still runnign | 17:11 |
| rlandy | fs035 | 17:12 |
| rlandy | tempest-api passed | 17:12 |
| jm1 | rlandy: yeah | 17:12 |
| jm1 | rlandy: a little bit of cheating and.. voila.. c9 wallaby and c9 master promote 😆 | 17:14 |
| rlandy | at this point???? | 17:14 |
| rlandy | whatever works | 17:14 |
| jm1 | rlandy: 😎 | 17:15 |
| jm1 | rlandy: lets cover our cheating up... https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/44756 | 17:16 |
| rlandy | jm1: totally - will merge that after master promotes | 17:16 |
| rlandy | woohoo - here goes master | 17:25 |
| rlandy | 16.2 and 17 are one job away - rerun there | 17:37 |
| jm1 | rlandy: cool! | 17:44 |
| jm1 | rlandy: did some debugging on this lp bug and imho we can close it https://trello.com/c/hnJQvjNb/2691-cixlp1988347tripleociproa-fs064-tests-are-failing-on-master-and-wallaby-fatal-try-modifying-forward-dns-record-undercloud-errorc#comment-631b7b5bcee00c01e2c07c17 | 17:44 |
| jm1 | rlandy: all jobs failed for different reasons than this arecord msg | 17:45 |
| bhagyashris|ruck | rlandy, 16.2 passed here but not sure why not promoted | 17:47 |
| bhagyashris|ruck | may be the hash is different | 17:47 |
| rlandy | bhagyashris|ruck: hey - I rerun hash ... 5e940a6b412ccfb8d996eda15d5aeda9 | 17:47 |
| rlandy | it was only one job | 17:47 |
| bhagyashris|ruck | https://code.engineering.redhat.com/gerrit/c/testproject/+/422400/6#message-6cbb5bed7c2899f2829003368e8b9c2175d85001 | 17:47 |
| rlandy | hopefully wil pass | 17:47 |
| rlandy | jm1: nice | 17:47 |
| bhagyashris|ruck | ack | 17:47 |
| rlandy | jm1; after wallaby c9 promotes, we should be able to close https://trello.com/c/7xp7x4hZ/2630-cixlp1982195tripleociproa-cic9master-python-sqlalchemy-addition-in-cs9-base-broke-container-barbicanapidbsync | 17:48 |
| rlandy | https://review.opendev.org/c/openstack/tripleo-quickstart/+/850568 withstanding | 17:48 |
| rlandy | so we can check that on monday | 17:49 |
| jm1 | rlandy: ack | 17:49 |
| jm1 | rlandy: is there anything which needs immediate attention? else i would be eod | 17:49 |
| rlandy | bhagyashris|ruck: here's one for you on monday :) ... https://trello.com/c/8tGYExhe/2603-cixlp1980255tripleociproa-tripleo-ci-centos-9-standalone-and-multinode-ipa-are-failing-the-testminimumbasicinstancehardrebootaft | 17:49 |
| rlandy | fs020 on master and wallaby could probably be removed there | 17:50 |
| rlandy | if we remove from skiplist and retest | 17:50 |
| rlandy | jm1: you're fine | 17:50 |
| rlandy | have a great weekend | 17:50 |
| rlandy | you too bhagyashris|ruck | 17:50 |
| rlandy | laste for your both | 17:50 |
| jm1 | rlandy: ack, thank you | 17:50 |
| rlandy | see you monday | 17:50 |
| jm1 | have a nice weekend bhagyashris|ruck rlandy #oooq :) | 17:51 |
| rlandy | thanks | 17:51 |
| rlandy | lunch - brb | 17:51 |
| bhagyashris|ruck | rlandy, jm1 have a nice weekend :) | 17:51 |
| rlandy | dasm++ for sending out reminder to read robert's info | 17:51 |
| rlandy | bhagyashris|ruck: thanks - you too | 17:51 |
| rlandy | current-tripleo/2022-09-09 17:57 - wooho master | 18:34 |
| rlandy | woohoo - wallaby will promote - no skipping required | 19:34 |
| dviroel | have a great weekend team o/ | 19:57 |
| *** dviroel is now known as dviroel|out | 20:02 | |
| dasm | dviroel|out: o/ | 20:06 |
| * rcastillo leaving as well o/ | 22:41 | |
| dasm | rcastillo: o/ | 23:12 |
| dasm | i'm calling it a day too | 23:13 |
| *** dasm is now known as dasm|off | 23:13 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!