| dasm|rover | rhel9 osp17: > last_promotion=2022-10-26 21:31:38 | 00:15 |
|---|---|---|
| dasm|rover | \( ﾟヮﾟ)/ | 00:15 |
| *** rlandy|bbl is now known as rlandy|out | 01:25 | |
| *** dasm|rover is now known as dasm|off | 03:50 | |
| *** marios is now known as marios|ruck | 04:57 | |
| marios|ruck | o/ | 04:57 |
| *** amoralej|off is now known as amoralej | 06:54 | |
| *** jpena|off is now known as jpena | 06:58 | |
| akahat | marios|ruck, o/ | 08:30 |
| marios|ruck | \o | 08:31 |
| akahat | I'm trying to run mixed os compute component job for downstream. | 08:31 |
| akahat | i'm seeing this error " Could not find or access '.../rhos-17.1.yml' on the Ansible controller. | 08:31 |
| akahat | https://sf.hosted.upshift.rdu2.redhat.com/logs/72/432772/5/check/periodic-tripleo-rhel-9-8-rhos-17.1-mixed-os-compute-internal/0409006/job-output.txt | 08:31 |
| akahat | marios|ruck, can you please tell me what's wrong here? https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/432774 | 08:32 |
| marios|ruck | akahat: ok will have a look in a bit | 08:32 |
| akahat | marios|ruck, sure. | 08:32 |
| marios|ruck | akahat: checking (sending links in pvt cos internal sec) | 10:04 |
| marios|ruck | akahat: you are getting that play via inheritance | 10:05 |
| marios|ruck | akahat: will dig a bit more but the problem comes from there | 10:05 |
| frenzy_friday | pls add to review list https://review.opendev.org/c/openstack/tripleo-ci/+/862791 | 10:09 |
| reviewbot | I have added your review to the Review list | 10:09 |
| marios|ruck | akahat: maybe get a hold on the job so you can see what is copied where (lets talk more when i am not ruck|rover i will also be working on mixed rhel again soon) | 10:09 |
| akahat | marios|ruck, ok. thanks for links. I'll hold node and see what's copied there. | 10:12 |
| *** rlandy|out is now known as rlandy | 10:34 | |
| rlandy | marios|ruck: hi - everything ok? anything you want me to work on? | 10:39 |
| marios|ruck | rlandy: o/ nothing new - still chasing the promotions (dstream 17.1/9 still unrelated fails & others) | 10:43 |
| rlandy | ok - see sc001 is also missing there - adding tp job for that | 10:44 |
| marios|ruck | rlandy: we have one https://code.engineering.redhat.com/gerrit/c/testproject/+/432677/4#message-0a01fae9ec8f6d5aece302df39b654cba48e7341 | 10:44 |
| marios|ruck | rlandy: oh scenario1? | 10:45 |
| rlandy | yep - added | 10:45 |
| rlandy | ┃ ┃ ┃ ┃ ┃ Upstream ┃ Upstream ┃ Upstream ┃ | 10:45 |
| rlandy | ┃ Jobs in promotion criteria required to promo the hash: ┃ Pass ┃ Failure ┃ Others ┃ Pass ┃ Failure ┃ Others ┃ | 10:45 |
| rlandy | ┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━ | 10:45 |
| rlandy | ┩ | 10:45 |
| rlandy | │ periodic-tripleo-ci-rhel-9-ovb-3ctlr_1comp-featureset001-internal-rhos-17… │ 0 │ 4 │ 1 │ - │ - │ - │ | 10:45 |
| rlandy | │ periodic-tripleo-ci-rhel-9-scenario001-standalone-rhos-17.1 │ 2 │ 2 │ 1 │ - │ - │ - │ | 10:45 |
| rlandy | └────────────────────────────────────────────────────────────────────────────┴───────────┴──────────┴───────────┴──────────┴───────────┴─────── | 10:45 |
| rlandy | oops | 10:45 |
| marios|ruck | rlandy: ack i didn't check http://10.0.110.143/promoter_logs/redhat9_osp17-1.log (but indeed that is also missing for the 79bb74899029f8525d30bd5d0f205dc7 | 10:47 |
| rlandy | marios|ruck: did we merge the job to remove fs001 check in wallaby c8? | 10:48 |
| rlandy | https://review.rdoproject.org/r/q/topic:remove_wallaby_8_fs1 merged | 10:48 |
| rlandy | https://review.rdoproject.org/r/c/rdo-jobs/+/45831/4/zuul.d/ovb-jobs.yaml | 10:48 |
| rlandy | oh there | 10:48 |
| rlandy | ok | 10:48 |
| marios|ruck | yeah | 10:48 |
| marios|ruck | rlandy: i rekicked the 8 line manually | 10:48 |
| marios|ruck | rlandy: (also to check/confirm if https://bugs.launchpad.net/tripleo/+bug/1994730 still a thing) | 10:49 |
| marios|ruck | rlandy: its running now | 10:49 |
| rlandy | k | 10:49 |
| rlandy | frenzy_friday: looking at your sc010 patches | 10:49 |
| rlandy | chandankumar: could we get a second core vote on: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/45779 | 10:52 |
| rlandy | and w+ | 10:52 |
| rlandy | see https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-9-scenario010-kvm-standalone-wallaby&skip=0 | 10:52 |
| rlandy | chandankumar: https://review.rdoproject.org/r/c/rdo-jobs/+/45848 as well pls | 10:55 |
| rlandy | frenzy_friday: is this depends right? https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/45826 | 10:56 |
| frenzy_friday | checking | 10:56 |
| frenzy_friday | rlandy, sorry that was the vexx one. Updated it to the IBM patch | 10:58 |
| chandankumar | frenzy_friday: https://review.rdoproject.org/r/c/rdo-jobs/+/45848 | 10:59 |
| chandankumar | can we define the nodeset in zuul.d/integration-pipeline-train.yaml just like other jobs | 10:59 |
| chandankumar | ? | 10:59 |
| frenzy_friday | chandankumar, checking | 10:59 |
| rlandy | akahat: around? | 10:59 |
| frenzy_friday | chandankumar, ack, updated | 11:04 |
| chandankumar | rlandy: please have a look at following patches https://review.opendev.org/q/topic:standalone-roles-testing when free, thank you! | 11:07 |
| rlandy | ok - doing reviews | 11:09 |
| reviewbot | Do you want me to add your patch to the Review list? Please type something like add to review list <your_patch> so that I can understand. Thanks. | 11:09 |
| rlandy | akahat: chandankumar: dviroel_: frenzy_friday: jm1: marios|ruck: rcastillo: dasm|off: soniya29: arxcruz: reminder - we are having a planning meeting at 2:30pm UTC | 11:17 |
| rlandy | will be short | 11:17 |
| arxcruz | ok | 11:17 |
| jm1 | rlandy: yes, ma'am 💂 | 11:18 |
| rlandy | jm1: :) | 11:18 |
| marios|ruck | rlandy: ack - i have multi rhel meet starting half hour before that so will join as soon as i can | 11:18 |
| rlandy | ok | 11:18 |
| rlandy | https://hackmd.io/P5sTPMSBREe5kBS_4jDhIg - line 257 has team availability | 11:19 |
| rlandy | marios|ruck: ^^ pls fill in - if you miss that part | 11:19 |
| marios|ruck | rlandy: k | 11:21 |
| rlandy | chandankumar: dviroel_: reviewing https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/861690 now - pls take a look as well | 11:22 |
| rlandy | marios|ruck has reviewed | 11:22 |
| rlandy | but has possible impact | 11:22 |
| rlandy | and takashi is waiting on merge here | 11:22 |
| marios|ruck | rlandy: chandankumar: can we merge that please when you have a chance https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/429994 | 11:23 |
| chandankumar | marios|ruck: checking | 11:23 |
| rlandy | checking success rates | 11:23 |
| marios|ruck | thx | 11:23 |
| marios|ruck | rlandy: there are links there in comments fyi | 11:24 |
| rlandy | marios|ruck: double checking :) | 11:24 |
| rlandy | as I miss stuff | 11:24 |
| marios|ruck | rlandy: https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/429994/4#message-763febfdd81cfdc6154d1fbc48794cf26a34c5a9 | 11:24 |
| akahat | rlandy, o/ | 11:24 |
| akahat | rlandy, I'm here we can sync wehen you are free. | 11:25 |
| rlandy | ok - +2'ed | 11:25 |
| akahat | when * | 11:25 |
| rlandy | akahat: ok - give me 5 | 11:25 |
| akahat | ok | 11:26 |
| marios|ruck | akahat: can you please update https://issues.redhat.com/browse/TRIPLEOCI-1206 put yr face on it and patch links etc? (move in progress etc) | 11:28 |
| marios|ruck | akahat: will mention it on multi rhel status so folks may look there | 11:28 |
| akahat | marios|ruck, ack | 11:28 |
| *** dviroel_ is now known as dviroel | 11:30 | |
| rlandy | akahat: https://meet.google.com/ydq-utwy-ddi?pli=1&authuser=0 | 11:33 |
| rlandy | arxcruz; hey wrt https://trello.com/c/3p8i2YdZ/2639-cixlp1982874tripleociproa-testcreateobjectwithtransferencoding-is-failing-on-tripleo-jobs - tempest master component promoted - are we done here? | 11:42 |
| rlandy | pls comment on card - ty | 11:43 |
| arxcruz | rlandy i'm going to check the patch was merged yesterday i'll do a dnm to test it | 11:43 |
| rlandy | arxcruz: thanks | 11:45 |
| soniya29 | rlandy, ack | 12:12 |
| *** amoralej is now known as amoralej|lunch | 12:31 | |
| * jm1 stepping out for a bit | 12:38 | |
| frenzy_friday | I need some help with this error: https://logserver.rdoproject.org/26/45826/2/check/mol-tripleo_common_integration/ef91e4d/job-output.txt I cannot figure out what is wrong | 12:44 |
| *** amoralej|lunch is now known as amoralej | 13:05 | |
| dasm|off | nick dasm|rover | 13:10 |
| dasm|off | o/ | 13:10 |
| *** dasm|off is now known as dasm|rover | 13:10 | |
| rlandy | frenzy_friday: hey - pls see rhos-ops | 13:12 |
| rlandy | dasm|rover: good morning | 13:13 |
| rlandy | current-tripleo/2022-10-27 08:34 17.1 on 9 promoted | 13:13 |
| dasm|rover | i see. it just reported back on my job | 13:14 |
| dasm|rover | similar for cs8 wallaby | 13:14 |
| dasm|rover | i updated hackmd with info | 13:14 |
| marios|ruck | o/ | 13:14 |
| dasm|rover | marios|ruck: \o | 13:15 |
| dasm|rover | marios|ruck: keeping the lignts on? | 13:15 |
| marios|ruck | dasm|rover: cool i was worried that was a real thing https://review.rdoproject.org/r/c/testproject/+/45850/2#message-43c97caa88223da4fd7e87cf9e5910b7fd89600c | 13:16 |
| dasm|rover | nope. it went through. in that case we have one more score :) | 13:16 |
| marios|ruck | barely keeping myself on dasm|rover ;) | 13:16 |
| marios|ruck | which lights? | 13:16 |
| marios|ruck | we have lights? | 13:17 |
| dasm|rover | marios|ruck: lights? where we're going, we don't need no lights! | 13:18 |
| dasm|rover | these lights: https://www.parkersoftware.com/blog/keeping-the-lights-on-ktlo-what-it-means-in-it-and-why-it-matters/ | 13:18 |
| marios|ruck | ;) | 13:19 |
| rlandy | marios|ruck: I reviewed takashi'd patch ... I think we should w+ it early on monday morning so we can watch for damage | 13:21 |
| marios|ruck | rlandy: sure sounds good | 13:22 |
| dasm|rover | marios|ruck: if i'm reading it right, we're golden on all promos? | 13:27 |
| dasm|rover | and I don't see any new blockers/issues | 13:28 |
| * dasm|rover likes it | 13:28 | |
| marios|ruck | dasm|rover: should be now | 13:38 |
| marios|ruck | dasm|rover: well upstream couple days out but we are chasing | 13:39 |
| marios|ruck | checks again | 13:39 |
| dasm|rover | marios|ruck: not really. upstream is 10/24 the oldest - train | 13:40 |
| dasm|rover | marios|ruck: https://hackmd.io/wtT4lbOSSeuLcRS2aPTQAQ#Promotions | 13:40 |
| marios|ruck | yeah couple days out | 13:40 |
| dasm|rover | yesterday it was the latest change | 13:41 |
| marios|ruck | dasm|rover: if we get that one we should be great https://review.rdoproject.org/r/c/testproject/+/45834/7#message-eb38383b1f624b27150121810550b516440d8b43 | 13:43 |
| marios|ruck | golden ;) | 13:43 |
| dasm|rover | ah, indeed. this one | 13:44 |
| * marios|ruck prepares sacrifices for zuul | 13:44 | |
| dasm|rover | if not this one, there is another hash worth checking, with 2 jobs failed | 13:44 |
| dasm|rover | marios|ruck: if you're on it, i'd like pepsi and burger as well | 13:44 |
| dasm|rover | ;) | 13:44 |
| marios|ruck | :) | 13:45 |
| marios|ruck | dwa big-mac -e tobakovanie proshe | 13:45 |
| dasm|rover | xD | 13:45 |
| *** amoralej is now known as amoralej|brb | 14:24 | |
| rlandy | soniya29: dasm|rover: chandankumar: planning meeting | 14:30 |
| soniya29 | rlandy, joining | 14:30 |
| *** amoralej|brb is now known as amoralej | 14:46 | |
| dasm|rover | ysandeep|PTO: o/ we're thinking about closing nftables story. If we're gonna have more work, we can create another story. It looks like it's done atm. | 15:32 |
| marios|ruck | arxcruz: https://hackmd.io/wtT4lbOSSeuLcRS2aPTQAQ | 15:49 |
| rlandy | frenzy_friday: want to join planning meeting again? | 15:49 |
| dviroel | marios|ruck++ dasm|rover++ great job as ruck-rover :) | 15:50 |
| * dviroel lunch | 15:50 | |
| *** dviroel is now known as dviroel|lunch | 15:50 | |
| frenzy_friday | rlandy, yep, joining | 15:50 |
| *** amoralej is now known as amoralej|off | 16:01 | |
| marios|ruck | dasm|rover: need something before i go? | 16:06 |
| marios|ruck | rlandy: need sthing? | 16:06 |
| rlandy | marios|ruck: should be fine - enjoy your day off | 16:06 |
| marios|ruck | thx | 16:06 |
| *** marios|ruck is now known as marios|out | 16:09 | |
| *** jpena is now known as jpena|off | 16:32 | |
| dasm|rover | we have cs9 wallaby. promoter should pick it up soon | 16:34 |
| *** dviroel|lunch is now known as dviroel | 16:45 | |
| dasm|rover | cs9 wallaby: > last_promotion=2022-10-27 16:33:31 | 16:58 |
| dasm|rover | cs8 wallaby had 2 promos today! we are on fire! | 16:58 |
| artom | o/ So, more rhex questions! | 17:05 |
| artom | It's actually running stuff now, which is good! | 17:05 |
| artom | But not enough to pass, which is bad :( | 17:05 |
| artom | So it's based on the tripleo-ci-centos-9-containers-multinode job | 17:05 |
| artom | And the failure seems to be: | 17:06 |
| artom | fatal: [subnode-1]: FAILED! => {"changed": true, "cmd": "set -o pipefail && /home/zuul/install-built-repo.sh 2>&1 | awk '{ print strftime(\"%Y-%m-%d %H:%M:%S |\"), $0; fflush(); }' > /home/zuul/install_built_repo.log\n", "delta": "0:00:00.285405", "end": "2022-10-27 12:34:47.210889", "msg": "non-zero return code", "rc": 1, "start": "2022-10-27 12:34:46.925484", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} | 17:06 |
| artom | My question is, what's this `subnode-1` node? The Zuul nodeset only has `primary` and `secondary` | 17:06 |
| artom | And `switch`, `peers` and `subnodes` in the groups | 17:06 |
| artom | FWIW, if there's an actually error, I'd have expected /home/zuul/install_built_repo.log to show it, but it's fine | 17:14 |
| artom | End with Nothing to do! Complete. | 17:14 |
| artom | I don't have a 'subnode-1' directory in my logs, so I suspect that's the real problem | 17:17 |
| dasm|rover | artom: o/ i'm not in a loop, but do you have a link to test project? | 18:09 |
| dasm|rover | cs8 train is about to being promoted due to alternative criteria fs035 | 18:09 |
| rlandy | artom: subnode-1 comes from the inventory | 18:49 |
| rlandy | example: https://zuul.opendev.org/t/openstack/build/0a4040ab21a9490580bcd0b79f05346d | 18:49 |
| rlandy | zuul knows about primary and secondary nodes | 18:50 |
| rlandy | as in: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_0a4/862535/1/gate/tripleo-ci-centos-9-containers-multinode/0a4040a/zuul-info/inventory.yaml | 18:51 |
| rlandy | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_0a4/862535/1/gate/tripleo-ci-centos-9-containers-multinode/0a4040a/logs/index.html | 18:51 |
| rlandy | ^^ there you will see subnode-1 referenced | 18:51 |
| rlandy | how ansible references the nodes | 18:52 |
| rlandy | subnode-1 in this case is your secondary node | 18:52 |
| rlandy | so need to check your log in: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_0a4/862535/1/gate/tripleo-ci-centos-9-containers-multinode/0a4040a/logs/subnode-1/home/zuul/index.html | 18:53 |
| rlandy | dviroel: rcastillo: are either of you guys coming to review time? dasm|rover will miss it | 18:54 |
| rlandy | if not, pls review ananya's patch: tps://review.opendev.org/c/openstack/tripleo-ci-health-queries/+/862734 | 18:54 |
| rlandy | I am looking at chandankumar's patches | 18:55 |
| rlandy | we can skip if nobody will be there | 18:55 |
| rlandy | pls ping if you plan on joining | 18:55 |
| dviroel | rlandy: ack, reviewing chandan's patch too | 18:57 |
| rcastillo | I'm ok with skipping | 18:57 |
| rlandy | dviroel: ok - let's review off line unless any questions | 18:58 |
| rlandy | rcastillo: pls will you look at frenzy_friday's patch above | 18:58 |
| rcastillo | rlandy: yeah looking | 19:00 |
| rlandy | thank you | 19:00 |
| artom | rlandy, so I've looked into it a bit more... subnode-1 is a red herring, downstream it's executing a task that isn't executed at all upstream | 19:18 |
| artom | A playbook, I should say: `install-built-repo` | 19:18 |
| artom | A step in that fails | 19:18 |
| rlandy | is it expecting a gating repo? | 19:19 |
| rlandy | what repo is it trying to build? | 19:19 |
| rlandy | you can avoid that by excluding | 19:20 |
| rlandy | periodic jobs will also not build | 19:20 |
| * rlandy gets | 19:20 | |
| rlandy | https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/build-test-packages/defaults/main.yml | 19:20 |
| rlandy | https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/build-test-packages/defaults/main.yml#L64 don't build | 19:21 |
| * dasm|rover leaves for today! take care team. see you tomorrow | 19:21 | |
| *** dasm|rover is now known as dasm|off | 19:21 | |
| * dviroel run an errand | 19:39 | |
| *** dviroel is now known as dviroel|afk | 19:39 | |
| * jm1 out for today, have a nice evening folks :) | 19:44 | |
| *** dviroel|afk is now known as dviroel | 20:46 | |
| *** rlandy is now known as rlandy|bbl | 21:12 | |
| *** dviroel is now known as dviroel|out | 22:10 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!