| dasm | ok, here we go again: https://review.rdoproject.org/r/c/testproject/+/42319 | 00:37 |
|---|---|---|
| *** rlandy|bbl is now known as rlandy | 00:54 | |
| *** rlandy is now known as rlandy|out | 01:09 | |
| *** dasm is now known as dasm|off | 02:00 | |
| *** ysandeep|out is now known as ysandeep | 04:52 | |
| *** pojadhav|out is now known as pojadhav|ruck | 04:59 | |
| ysandeep | rlandy|out, good to see patch to fix bm worked :) | 05:14 |
| *** ysandeep is now known as ysandeep|afk | 05:41 | |
| *** ysandeep|afk is now known as ysandeep | 06:02 | |
| *** jm1|ruck is now known as jm1|rover | 06:30 | |
| jm1 | o/ #oooq | 06:30 |
| akahat | o/ | 06:33 |
| ysandeep | hello everyone and good morning/afternoon folks o/ | 06:44 |
| *** ysandeep is now known as ysandeep|afk | 07:36 | |
| *** jpena|off is now known as jpena | 07:36 | |
| jm1 | jpodivin: found your bug in another non-validation job as well https://bugs.launchpad.net/tripleo/+bug/1987092/comments/18 | 08:02 |
| jpodivin | jm1: I see | 08:12 |
| jpodivin | So it's not just us. | 08:12 |
| jpodivin | Thanks. | 08:12 |
| jm1 | pojadhav|ruck: hello :) did you manage do check downstream component jobs or shall i have a look? | 08:21 |
| pojadhav|ruck | jm1, I am checking components as well for d/stream | 08:23 |
| jm1 | pojadhav|ruck: ok cool! upstream is done :) | 08:26 |
| jm1 | pojadhav|ruck: lets hope our ci keeps calm for another day, then reporting to os program call will be easy: all green ;) | 08:36 |
| pojadhav|ruck | jm1, yep :) | 09:06 |
| jm1 | pojadhav|ruck: do you need help with anything? | 09:08 |
| pojadhav|ruck | jm1, nope thank you | 09:09 |
| pojadhav|ruck | will let you if anything | 09:09 |
| jm1 | pojadhav|ruck: ack | 09:10 |
| *** ysandeep|afk is now known as ysandeep | 09:12 | |
| jpodivin | jm1: about renaming the bug ... I'd do it myself but I don't want to create unnecessary confusion. | 09:46 |
| jpodivin | wouldn't automation pick it up again? | 09:46 |
| jm1 | jpodivin: no idea, we could discuss that on cix call | 09:48 |
| jpodivin | jm1: ok. | 09:49 |
| jm1 | jpodivin: thanks for bringing up this issue and debugging it. we have a lot of intermittent failures which force us to rerun jobs. this one could be one of the root causes | 09:50 |
| jpodivin | jm1: np. It's a common pipeline/asset, we should all take care of it in our way. | 09:53 |
| * soniya29 stepping out for 1 hr | 10:26 | |
| *** soniya29 is now known as soniya29|afk | 10:26 | |
| * jm1 lunch | 10:32 | |
| *** rlandy|out is now known as rlandy | 10:38 | |
| rlandy | pojadhav|ruck: jm1: hi - anything we need to sync about today? | 10:39 |
| rlandy | pojadhav|ruck; how are the internal components? | 10:40 |
| rlandy | jm1: thank you for the notes on upstream components | 10:41 |
| rlandy | also - we should see what CIXs we can close out with master and wallaby promotions | 10:41 |
| rlandy | pojadhav|ruck; are we still seeing the node provision error? | 10:41 |
| rlandy | what happened with contacting steve? | 10:41 |
| rlandy | arxcruz: soniya29|afk: pojadhav|ruck: chandankumar: moving the tempst allow list meeting to thurs | 10:42 |
| chandankumar | rlandy: ack | 10:42 |
| arxcruz | ok | 10:42 |
| soniya29|afk | rlandy, ack | 10:47 |
| pojadhav|ruck | rlandy, this is having node provision periodic-tripleo-ci-rhel-9-ovb-3ctlr_1comp-featureset035-internal-rhos-17.1 but not promotion blocker | 10:48 |
| pojadhav|ruck | ^^ job is failing since long time, I cant see any green run | 10:48 |
| pojadhav|ruck | rlandy, ok for thurs allow list meeting | 10:49 |
| pojadhav|ruck | rlandy, will ping steve now, havent talked yet | 10:49 |
| rlandy | pojadhav|ruck: that job has been failing for a while and we need to investigate what the failure is and why it is still failing | 10:55 |
| rlandy | pojadhav|ruck: pls collect some data on that job | 10:55 |
| rlandy | will touch base with you in a bit | 10:55 |
| pojadhav|ruck | rlandy, ack | 10:55 |
| pojadhav|ruck | rlandy, pinged steve about node_provision issue for fs001 | 11:02 |
| rlandy | checking if that issue is still going on | 11:03 |
| rlandy | is rdo zuul slow to resolve for anyone? | 11:03 |
| pojadhav|ruck | rlandy, yes | 11:04 |
| pojadhav|ruck | its alow | 11:04 |
| pojadhav|ruck | slow* | 11:04 |
| rlandy | https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001+&skip=0 | 11:04 |
| rlandy | pojadhav|ruck: ^^ looking better | 11:04 |
| rlandy | we had no passes before | 11:04 |
| pojadhav|ruck | rlandy, yeah.. | 11:05 |
| jm1 | rlandy, pojadhav|ruck: wanna sync? need to sync? | 11:08 |
| pojadhav|ruck | rlandy, sure | 11:09 |
| rlandy | jm1: pojadhav|ruck: we can quickly https://meet.google.com/mou-aptt-jxp?pli=1&authuser=0 | 11:09 |
| * bhagyashris stepping out for hr | 11:16 | |
| *** ysandeep is now known as ysandeep|break | 11:27 | |
| *** dviroel|out is now known as dviroel | 11:30 | |
| *** soniya29|afk is now known as soniya29 | 11:31 | |
| dviroel | o; | 11:32 |
| jm1 | dviroel: o/ | 11:32 |
| dviroel | o/ | 11:32 |
| rlandy | soniya29: hello - sorry I need to move your 1-1 | 11:38 |
| rlandy | I have a manager meeting | 11:38 |
| rlandy | soniya29: is 2pm UTC too late? | 11:38 |
| rlandy | otherwise we can meet on friday | 11:38 |
| rlandy | we have the allow list meeting on thurs | 11:39 |
| rlandy | jm1: pojadhav|ruck: so ... I opened https://trello.com/c/8tGYExhe/2603-cixlp1980255tripleociproa-tripleo-ci-centos-9-standalone-and-multinode-ipa-are-failing-the-testminimumbasicinstancehardrebootaft fortuitously | 11:45 |
| rlandy | it's probably something we should look at | 11:45 |
| rlandy | pretty basic test we are skipping | 11:45 |
| rlandy | jm1: ^^ if you have a quiet day tomorrow - pls try unskip this and see if it's still an issue | 11:46 |
| rlandy | if you don;t get to it, np - let me know | 11:46 |
| rlandy | soniya29: moved your 1-1 to next week tuesday | 11:49 |
| soniya29 | rlandy, nope | 11:50 |
| soniya29 | rlandy, ack | 11:50 |
| pojadhav|ruck | rlandy, skiplist patch : https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/855191 | 12:05 |
| pojadhav|ruck | rlandy, criteria change patch : https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/426532 | 12:05 |
| pojadhav|ruck | rlandy, testing fs035 with skiplist depends-on : https://code.engineering.redhat.com/gerrit/c/testproject/+/286307 | 12:06 |
| rlandy | pojadhav|ruck: thanks - pls see comment in line https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/855191 | 12:07 |
| rlandy | ysandeep|break: dviroel: going to miss both podified meetings - manager stuff | 12:09 |
| dviroel | rlandy: ok | 12:09 |
| pojadhav|ruck | rlandy, change done | 12:09 |
| rlandy | pojadhav|ruck: thanks - merging | 12:10 |
| * pojadhav|ruck taking short break | 12:18 | |
| *** ysandeep|break is now known as ysandeep | 12:20 | |
| chandankumar | rlandy: https://review.opendev.org/c/openstack/tripleo-quickstart/+/855115 good to go | 12:39 |
| chandankumar | thanks! | 12:39 |
| rlandy | bhagyashris: hi - can you check 17.1 on 8 line | 12:45 |
| rlandy | last promo was 08/26 | 12:45 |
| rlandy | https://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp17-1/ | 12:45 |
| bhagyashris | rlandy, ok | 12:45 |
| rlandy | we should be promoting daily | 12:45 |
| rlandy | rel delivery asked for it | 12:46 |
| bhagyashris | rlandy, let me check with component jobs | 12:46 |
| rlandy | bhagyashris: k - let me know - the line atm should just be containers and images, right? | 12:47 |
| bhagyashris | rlandy, yes | 12:47 |
| rlandy | pojadhav|ruck: merged criteria patch | 12:47 |
| rlandy | can you rerun fs035 on 17.1 | 12:47 |
| rlandy | let's see the damage there | 12:47 |
| rlandy | jm1++ pojadhav|ruck++ for rocking out as ruck/rovers | 12:48 |
| rlandy | all: pls note all hands meeting at 3pm UTC | 12:49 |
| pojadhav|ruck | rlandy, \o/ | 12:50 |
| pojadhav|ruck | rlandy, sure | 12:50 |
| pojadhav|ruck | rlandy, https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/status#286307 | 12:52 |
| rlandy | pojadhav|ruck; actually - my mistake 17.1 line just kicked | 12:54 |
| rlandy | so you can kill your job | 12:54 |
| rlandy | I'll run it if fs035 fails | 12:54 |
| pojadhav|ruck | rlandy, ack | 12:54 |
| rlandy | sorry about that | 12:55 |
| pojadhav|ruck | np | 12:56 |
| jm1 | rlandy, pojadhav|ruck: after community call and aoc meeting i will need a break. dunno how many lines i wrote in rr notes today 🤯 | 12:59 |
| pojadhav|ruck | jm1, hey yeah sure but just try to have updates in short, dont need in detail everything. if the bug is there then logs are already present in the bug. | 13:01 |
| rlandy | jm1: np - things are fine today | 13:02 |
| jm1 | pojadhav|ruck: i need the notes to be able to quickly check whether this is a known (intermittent) bug or something new | 13:11 |
| jm1 | pojadhav|ruck: ..and to know how often i rechecked a job etc | 13:12 |
| pojadhav|ruck | jm1, ack np | 13:12 |
| pojadhav|ruck | community call in 6 mins : arxcruz, rlandy, marios, ysandeep, bhagyashris, svyas, soniya29, pojadhav, akahat, chandankumar, frenzy_friday, anbanerj, dviroel, rcastillo, dasm, jm1, marios | 13:24 |
| pojadhav|ruck | kindly add agenda if any : https://hackmd.io/MMg4WDbYSqOQUhU2Kj8zNg | 13:25 |
| arxcruz | pojadhav|ruck i might be late, need to get my daugther at school | 13:25 |
| pojadhav|ruck | arxcruz, ack | 13:26 |
| *** dasm|off is now known as dasm | 13:46 | |
| dasm | o/ | 13:46 |
| * pojadhav|ruck afk for few mins | 13:59 | |
| jm1 | rlandy, pojadhav|ruck: we might have a blocker on c9 master and c9 wallaby. tempest is failing three times on same errors on periodic-tripleo-ci-centos-9-scenario010-kvm-internal-standalone-{master,wallaby} | 13:59 |
| ysandeep | rlandy++ thanks for the local holiday reminder, I forgot about that :D | 13:59 |
| rlandy | ysandeep: thank pojadhav|ruck - she reminded me | 14:01 |
| rlandy | jm1: is that the same as the card dviroel is working on? | 14:01 |
| rlandy | nested virt issue? | 14:01 |
| rlandy | failing octavia tests? | 14:02 |
| rlandy | pojadhav|ruck: jm1: got some manager- type stuff that is near due I need to take care of - pls ping if you need help and when you are EoD with anything to watch | 14:16 |
| dviroel | rlandy: jm1: yes, same issue | 14:28 |
| dviroel | looking into periodic-tripleo-ci-centos-9-scenario010-kvm-internal-standalone-master/e31bce2/logs/undercloud/var/log/containers/libvirt/qemu/instance-00000001.log | 14:28 |
| dviroel | KVM: entry failed, hardware error 0x8 | 14:28 |
| jm1 | dviroel: oh wow, thanks for figuring that out! | 14:35 |
| jm1 | rlandy: will update rr notes about failing jobs later, need a break first | 14:36 |
| rlandy | jm1: sure - no burning emergency | 14:37 |
| jm1 | rlandy: dviroel's bug is in bugzilla and for osp while we are facing that on c9 master/wallaby. i guess we dont need a new lp bug since its failing on internal job only? | 14:39 |
| rlandy | jm1: it's the same problem | 14:39 |
| rlandy | the fix is related to the cloud itself | 14:39 |
| *** ysandeep is now known as ysandeep|dinner | 14:39 | |
| rlandy | they all run nested virt | 14:39 |
| jm1 | rlandy: yeah, ok we do not create a lp bug since bz bug is enough to track both osp and rdo jobs | 14:43 |
| *** dviroel is now known as dviroel|mtg | 14:43 | |
| rlandy | jm1: I think it depends where the fix needs to go | 14:43 |
| * dviroel|mtg sorry, fips meeting | 14:43 | |
| rlandy | in this case, it would land with rhel/virt | 14:43 |
| rlandy | so BZ is probably the right address | 14:44 |
| rlandy | depends on on what dviroel|mtg concludes is the real issue and fix/workaround | 14:44 |
| jm1 | rlandy: oh we actually have a bug report for this bug on c8 train https://bugs.launchpad.net/tripleo/+bug/1979546 | 14:47 |
| jm1 | rlandy: updated rr notes and now i am having a longer break | 14:48 |
| rlandy | thanks | 14:58 |
| *** ysandeep|dinner is now known as ysandeep | 15:00 | |
| pojadhav|ruck | jm1, rlandy : ack | 15:00 |
| *** dviroel|mtg is now known as dviroel | 15:18 | |
| ysandeep | rlandy, we need some karmas for dviroel++ , first successfull OCP deploy: https://prow.ci.openshift.org/view/gs/origin-ci-test/pr-logs/pull/openshift_release/30976/rehearse-30976-pull-ci-openstack-k8s-operators-mariadb-operator-master-e2e-openstack/1564606240032559104 | 15:35 |
| dviroel | •‿• | 15:37 |
| * dviroel lunch | 15:40 | |
| *** dviroel is now known as dviroel|lunch | 15:40 | |
| chandankumar | dviroel|lunch: rlandy w00t, great :-) | 15:49 |
| chandankumar | see ya! | 15:49 |
| *** ysandeep is now known as ysandeep|out | 15:56 | |
| rlandy | dviroel|lunch: awesomeness!!!!! | 16:00 |
| rlandy | dviroel++++++++++++++++++++ | 16:00 |
| rlandy | this is so cool | 16:00 |
| rlandy | lunch - brb | 16:01 |
| *** dviroel|lunch is now known as dviroel | 16:33 | |
| *** jpena is now known as jpena|off | 16:42 | |
| dviroel | reviewbot pls add to the review list https://softwarefactory-project.io/r/c/config/+/25973 | 16:45 |
| reviewbot | I could not add the review to Review List | 16:45 |
| dviroel | oh :( | 16:45 |
| dviroel | reviewbot: but you just added :) | 16:46 |
| rlandy | dviroel: you're arguing with a bot???? | 16:59 |
| pojadhav|ruck | :D | 17:00 |
| dviroel | rlandy: yeah, it is ignoring me now, but at least, did its part of the job | 17:03 |
| pojadhav|ruck | rlandy, I have updated hackmd with notes.. please watch https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/status#209874 and https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/status#276230 | 17:52 |
| pojadhav|ruck | rlandy, leaving for the day | 17:52 |
| * pojadhav|ruck see you on thursday. bye good night..! | 17:53 | |
| *** pojadhav|ruck is now known as pojadhav|out | 17:53 | |
| rlandy | dviroel: want to join review time? | 19:02 |
| rlandy | for your review | 19:03 |
| dviroel | rlandy: on #rhos-dev, talking with artom, maybe you can help us with previous configuration on ocativa tests | 19:04 |
| dviroel | will join in a min | 19:04 |
| rlandy | on review call | 19:04 |
| dviroel | rlandy: btw, have to go through some manila patches, since it is feature freezer week =/ | 19:20 |
| * dasm => doc's appt | 19:21 | |
| *** dasm is now known as dasm|off | 19:21 | |
| rlandy | dviroel: you need to or you want us to? | 19:23 |
| rlandy | if it's just you, sure - go4it | 19:23 |
| dviroel | rlandy: just me, review time reminded me that | 19:27 |
| jm1 | rlandy: retriggered c9 wallaby promotion jobs (except for internal) to check whether we have intermittent errors here. will be eod now | 19:58 |
| * jm1 have a nice evening folks :) | 19:59 | |
| rlandy | jm1[m]: thanks | 20:00 |
| rlandy | jm1[m]: updated new prog call doc - will run through with you in the morning | 20:44 |
| *** dviroel is now known as dviroel|out | 22:37 | |
| *** rlandy is now known as rlandy|out | 23:57 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!