| *** rlandy|ruck is now known as rlandy|out | 02:03 | |
| *** pojadhav|afk is now known as pojadhav | 02:36 | |
| *** ysandeep|out is now known as ysandeep | 03:57 | |
| ysandeep | pojadhav, bhagyashris please hold your recheck for 17 testing, rhel-9 zuul node pool image, needs to be fixed first | 03:57 |
|---|---|---|
| bhagyashris | ysandeep, ack | 03:57 |
| pojadhav | ysandeep, sure | 04:38 |
| *** ysandeep is now known as ysandeep|afk | 07:11 | |
| *** amoralej|off is now known as amoralej | 07:33 | |
| *** jpena|off is now known as jpena | 08:03 | |
| *** ysandeep|afk is now known as ysandeep | 08:45 | |
| ysandeep | pojadhav, bhagyashris do you have few mins for wallaby/17 discussion? | 09:32 |
| bhagyashris | sure | 09:32 |
| bhagyashris | give 5 - 10 mins | 09:32 |
| pojadhav | ysandeep, yep | 09:33 |
| ysandeep | sure | 09:33 |
| bhagyashris | ysandeep, i am back | 09:38 |
| ysandeep | bhagyashris, pojadhav meet.google.com/muk-uzxo-qca | 09:41 |
| bhagyashris | ysandeep, https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/309447 | 10:01 |
| *** dviroel|out is now known as dviroel|ruck | 10:05 | |
| pojadhav | bhagyashris, ysandeep : https://review.opendev.org/q/topic:c8_teardown_master | 10:10 |
| dviroel|ruck | marios: hi o/ | 10:11 |
| dviroel|ruck | marios: can you just confirm what was the fix for this LP: https://bugs.launchpad.net/tripleo/+bug/1957031 ? - I was seing this issue yesterday again | 10:13 |
| marios | dviroel|ruck: o /looking | 10:14 |
| marios | dviroel|ruck: not clear what the fix was for me - but there was at least one more bug (and bugzilla ) sec let me find | 10:15 |
| dviroel|ruck | marios: https://bugzilla.redhat.com/show_bug.cgi?id=2007129 | 10:15 |
| marios | dviroel|ruck: yeah but there https://bugs.launchpad.net/tripleo/+bug/1957060 | 10:17 |
| marios | dviroel|ruck: e.g. comment 8 has | 10:17 |
| marios | Yeah, this is looking identical to [1], which itself is a duplicate of [2]. | 10:17 |
| marios | [1] https://bugzilla.redhat.com/show_bug.cgi?id=2024662 | 10:17 |
| marios | [2] https://bugzilla.redhat.com/show_bug.cgi?id=2007129 | 10:17 |
| marios | dviroel|ruck: [2] is the one you pointed at | 10:18 |
| marios | dviroel|ruck: maybe you can find something useful in those comments ;) or the other bz | 10:18 |
| marios | dviroel|ruck: especially that looks likely https://gitlab.com/qemu-project/qemu/-/commit/64b4529a432507ee84a924be69a03432639e87ba | 10:18 |
| marios | dviroel|ruck: see comments #11 #12 on https://bugs.launchpad.net/tripleo/+bug/1957060 | 10:19 |
| dviroel|ruck | marios: yeah, i was trying to find which package and version was fixed - BZ says qemu-kvm - but i didn't find in pkg list | 10:21 |
| dviroel|ruck | marios: ok, tks, it was just to confirm that we didn't create any fix for that | 10:22 |
| dviroel|ruck | marios: was only external dep | 10:22 |
| marios | dviroel|ruck: yeah i think so at least i didn't catch any other fixes | 10:27 |
| *** rlandy|out is now known as rlandy|ruck | 11:11 | |
| rlandy|ruck | marios: ysandeep: need to meet with ruck/rovers re: master | 11:13 |
| rlandy|ruck | marios: ysandeep: skip review time? or meet later? | 11:13 |
| rlandy|ruck | you can join the promote discussion if you want | 11:13 |
| marios | rlandy|ruck: sure np for me... | 11:13 |
| marios | rlandy|ruck: i can join and we can get to it after? whatever | 11:13 |
| ysandeep | okay with me to join now and get the current promotion status for c9 | 11:14 |
| rlandy|ruck | dviroel|ruck: akaha|rover: hey - let's sync re: master https://meet.google.com/vzm-nrah-qqf?authuser=0 | 11:14 |
| rlandy|ruck | ack it's a party | 11:14 |
| rlandy|ruck | you can all join | 11:14 |
| marios | rlandy|ruck: no worries (sorry i hit exit as you were saying sorry :D) | 11:27 |
| marios | rlandy|ruck: just ping when ready | 11:27 |
| rlandy|ruck | np - will be back in a few | 11:27 |
| rlandy|ruck | akaha|rover: dviroel|ruck: https://review.rdoproject.org/r/c/testproject/+/21853 | 11:34 |
| rlandy|ruck | here's the damage | 11:34 |
| rlandy|ruck | periodic-tripleo-centos-9-master-component-security-promote-to-promoted-componentstestprojectmastercheck21853,45 | 11:40 |
| rlandy|ruck | 3 mins 38 secs2022-02-08 11:35:45SUCCESS | 11:40 |
| rlandy|ruck | periodic-tripleo-centos-9-master-component-network-promote-to-promoted-componentstestprojectmastercheck21853,45 | 11:40 |
| rlandy|ruck | 3 mins 42 secs2022-02-08 11:35:34SUCCESS | 11:40 |
| ysandeep | dviroel|ruck, new failure https://review.rdoproject.org/zuul/builds?job_name=tox-py36-ci-config if not already known | 11:40 |
| rlandy|ruck | akaha|rover: ^^ pls check into that | 11:42 |
| dviroel|ruck | rlandy|ruck: ack | 11:42 |
| rlandy|ruck | 2022-02-08 11:34:52.269657 | rdo-centos-stream | FAILED ci-scripts/infra-setup/roles/rrcockpit/files/telegraf_py3/tests/test_gerrit_changes.py::TestGerritChanges::test_gerrit_changes | 11:42 |
| rlandy|ruck | 2022-02-08 11:34:52.269662 | rdo-centos-stream | FAILED roles/rrcockpit/files/telegraf_py3/tests/test_gerrit_changes.py::TestGerritChanges::test_gerrit_changes | 11:42 |
| dviroel|ruck | ysandeep: thanks o/ | 11:42 |
| dviroel|ruck | rlandy|ruck: creating skiplist for https://bugs.launchpad.net/tripleo/+bug/1960310 | 11:43 |
| rlandy|ruck | dviroel|ruck: sure - thank you | 11:43 |
| rlandy|ruck | we will need to get that merged and then rekick the line | 11:43 |
| rlandy|ruck | marios: ysandeep: joining again | 11:52 |
| ysandeep | ack | 11:52 |
| marios | rlandy|ruck: on my way 2 mins | 11:52 |
| marios | rlandy|ruck: please start | 11:52 |
| akaha|rover | rlandy|ruck, o/ | 11:57 |
| * akaha|rover looking | 11:57 | |
| *** ysandeep is now known as ysandeep|mtg | 12:01 | |
| rlandy|ruck | akaha|rover: the linter issue is taking out ci-config ... can you check it | 12:07 |
| akaha|rover | rlandy|ruck, looking in it | 12:08 |
| rlandy|ruck | arxcruz: hi ... https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/815654 - pls see comments | 12:15 |
| rlandy|ruck | there is agreement on the nohub thing | 12:16 |
| rlandy|ruck | soniya29: ^^ | 12:16 |
| rlandy|ruck | pls confirm | 12:16 |
| arxcruz | rlandy|ruck is soniya29 back? | 12:16 |
| arxcruz | should i handle it or her ? | 12:16 |
| rlandy|ruck | marios: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/828223 | 12:17 |
| rlandy|ruck | arxcruz: either | 12:21 |
| soniya29 | arxcruz, yeah, i am | 12:22 |
| soniya29 | rlandy|ruck, we don't require nohup since earlier issue what we were facing with the above patch was just because we have set timeout to 60 | 12:24 |
| soniya29 | rlandy|ruck, i am updating it | 12:24 |
| * pojadhav will be back in an hour | 12:33 | |
| *** pojadhav is now known as pojadhav|afk | 12:33 | |
| dviroel|ruck | rlandy|ruck: ysandeep|mtg https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/828285 | 12:37 |
| rlandy|ruck | looking | 12:37 |
| rlandy|ruck | dviroel|ruck: looks good | 12:38 |
| rlandy|ruck | ysandeep|mtg: ^^ merging above | 12:39 |
| ysandeep|mtg | rlandy|ruck, voted | 12:39 |
| ysandeep|mtg | lgtm | 12:39 |
| rlandy|ruck | dviroel|ruck: thanks - when that merges, will rekick master line | 12:39 |
| dviroel|ruck | rlandy|ruck: ack | 12:40 |
| dviroel|ruck | rlandy|ruck: i guess that everything is merged now (https://trello.com/c/IKHQQFTu/2334-cixlp1959582tripleociproa-centos-9-scenario007-standalone-wallaby-ostempest-failing-on-ping-router-ip-address) | 12:44 |
| rlandy|ruck | k - great - you can close out that card | 12:45 |
| dviroel|ruck | \o/ | 12:46 |
| rlandy|ruck | dviroel|ruck: akaha|rover: rekicked main line | 12:52 |
| rlandy|ruck | here's hoping | 12:52 |
| rlandy|ruck | waiting for https://trunk.rdoproject.org/centos8-master/queue.html to clear | 12:53 |
| rlandy|ruck | to repromote c8 components | 12:53 |
| *** ysandeep|mtg is now known as ysandeep | 12:55 | |
| rlandy|ruck | https://trunk.rdoproject.org/centos8-master/queue.html - lol this queue just got one patch shorter | 13:00 |
| dviroel|ruck | rlandy|ruck: not sure, but looks like the build ratio is 1 at every 5 min | 13:00 |
| rlandy|ruck | 124 left | 13:00 |
| rlandy|ruck | like watching a pot boil | 13:01 |
| rlandy|ruck | dviroel|ruck: we need to stop watching dlrn obsessively :) | 13:01 |
| dviroel|ruck | lol | 13:02 |
| rlandy|ruck | https://logserver.rdoproject.org/openstack-component-network/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-standalone-network-master/e11d1a8/logs/undercloud/var/log/tripleo-container-image-prepare.log.txt.gz | 13:03 |
| rlandy|ruck | ugh - think containers got pruned again | 13:03 |
| rlandy|ruck | arxcruz: hey - can you do your copy magic again, pls? | 13:03 |
| rlandy|ruck | master c9 back to rdo registry | 13:04 |
| arxcruz | rlandy|ruck sure, the current-tripleo ? | 13:04 |
| rlandy|ruck | pls | 13:04 |
| rlandy|ruck | 2022-02-08 12:55:58,730 59228 WARNING tripleo_common.image.image_uploader [ ] [192.168.24.1:8787/tripleomastercentos9/openstack-nova-compute:82142cdf4dd511032b48543abbec9229-updated-20220208073756] Failed to check if the target image exists | 13:04 |
| *** ysandeep is now known as ysandeep|coffee | 13:04 | |
| rlandy|ruck | arxcruz: ^^ yeah - I think we are missing those | 13:05 |
| rlandy|ruck | frenzy_friday: hey | 13:07 |
| rlandy|ruck | not sure if I answered your question | 13:07 |
| rlandy|ruck | need to meet? | 13:07 |
| rlandy|ruck | pojadhav|afk: hey https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/39207 stil failing | 13:08 |
| rlandy|ruck | can you recheck pls | 13:08 |
| rlandy|ruck | akaha|rover: hey - can you recheck jobs failing train, ussuri, vic, wallaby promotions | 13:10 |
| rlandy|ruck | 2 days out - we can try get those clean | 13:10 |
| rlandy|ruck | wallaby is running now | 13:10 |
| rlandy|ruck | fs039 failed | 13:10 |
| rlandy|ruck | checking wallaby c9 | 13:10 |
| dviroel|ruck | rlandy|ruck: i am working in https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/39207 | 13:14 |
| dviroel|ruck | rlandy|ruck: pojadhav|afk was automatically added reviewer | 13:14 |
| dviroel|ruck | rlandy|ruck: did the recheck, not sure what is the new issue | 13:15 |
| rlandy|ruck | dviroel|ruck++ thanks for picking that up | 13:15 |
| dviroel|ruck | rlandy|ruck: yep, asked akaha|rover to take this issue since I already fixed another one that is similar | 13:16 |
| dviroel|ruck | rlandy|ruck: to take it for me | 13:16 |
| frenzy_friday | rlandy|ruck, hey, yeah sorry I still had some questions. Is it ok if I book some time on wednesday? | 13:17 |
| *** amoralej is now known as amoralej|lunch | 13:18 | |
| bhagyashris | arxcruz, sshnaidm, rlandy, rlandy|ruck, marios, ysandeep, bhagyashris, svyas, soniya29, pojadhav, akahat, chandankumar, frenzy_friday, anbanerj, dviroel, rcastillo, dasm, jm1, rlandy|ruck dviroel|ruck akaha|rover | 13:18 |
| bhagyashris | Tripleo CI community meeting in 10 mins | 13:19 |
| rlandy|ruck | frenzy_friday: sure | 13:19 |
| bhagyashris | feel free to add topic here https://hackmd.io/MMg4WDbYSqOQUhU2Kj8zNg?both#2022-02-08-Community-Call @line 34 | 13:19 |
| bhagyashris | https://meet.google.com/bqx-xwht-wky | 13:20 |
| rlandy|ruck | python3 roles/rrcockpit/files/telegraf_py3/ruck_rover.py --release wallaby --distro centos-9 - gives me an error | 13:20 |
| rlandy|ruck | work for anyone?? | 13:20 |
| dviroel|ruck | rlandy|ruck: you need ruck_rover_config file updates | 13:21 |
| dviroel|ruck | rlandy|ruck: probably is not in repo yet | 13:22 |
| rlandy|ruck | dviroel|ruck: the option to run wallaby with c9? | 13:26 |
| rlandy|ruck | is not yet in the repo? | 13:26 |
| rlandy|ruck | will have to try add it | 13:26 |
| dviroel|ruck | rlandy|ruck: https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/infra-setup/roles/rrcockpit/files/telegraf_py3/conf_ruck_rover.yaml#L29-L31 | 13:29 |
| dviroel|ruck | rlandy|ruck: you need to add config for wallabu | 13:29 |
| dviroel|ruck | rlandy|ruck: and should work | 13:29 |
| rlandy|ruck | dviroel|ruck: thanks - adding review | 13:29 |
| dviroel|ruck | ++ | 13:29 |
| bhagyashris | arxcruz, rlandy|ruck rcastillo dasm|off marios ysandeep|coffee | 13:30 |
| bhagyashris | community call | 13:30 |
| bhagyashris | pojadhav|afk, | 13:30 |
| bhagyashris | soniya29, ^ | 13:30 |
| bhagyashris | dviroel|ruck, | 13:30 |
| *** pojadhav|afk is now known as pojadhav | 13:31 | |
| pojadhav | rlandy|ruck, dviroel|ruck : looking | 13:31 |
| dviroel|ruck | pojadhav: ok, we are trying to fix some unit tests - waiting ci results again | 13:33 |
| dviroel|ruck | rlandy|ruck: ysandeep|coffee - https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/39207 - passing now - please paya attention to commit msg and se if make sense | 13:39 |
| *** ysandeep|coffee is now known as ysandeep | 13:39 | |
| ysandeep | dviroel|ruck, ack will look after community call | 13:41 |
| marios | jfrancoa: oooci-jobs.sh: *** DEFINITION *** https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/standalone-jobs.yaml#L412 | 13:45 |
| rlandy|ruck | ysandeep: dviroel|ruck: Add wallaby c9 config for ruck/rover tool https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/39214 | 13:52 |
| rlandy|ruck | wfm now | 13:52 |
| ysandeep | voted ^^ | 13:53 |
| jfrancoa | marios: thanks for the link and the info folks! | 13:55 |
| *** dasm|off is now known as dasm | 13:55 | |
| marios | jfrancoa: o/ np | 13:55 |
| dasm | o/ | 13:55 |
| marios | \o | 13:55 |
| rlandy|ruck | dasm: hey | 13:55 |
| rlandy|ruck | any response on your uefi boot? | 13:55 |
| rlandy|ruck | if not, let's look at it later today | 13:56 |
| ysandeep | dviroel|ruck, checking now | 13:56 |
| dasm | rlandy|ruck: just started checking, but i don't think so. | 13:56 |
| dasm | rlandy|ruck: i'm gonna see again today. | 13:57 |
| * bhagyashris cooking and dinner brb | 13:57 | |
| pojadhav | dviroel|ruck, thanks for fixing :) | 13:59 |
| dviroel|ruck | pojadhav: anytime | 14:02 |
| rlandy|ruck | dviroel|ruck: thanks for https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/39207 - merging | 14:05 |
| arxcruz | rlandy|ruck: my internet is down, I'm checking what's going on. I'm using my 3g connection | 14:06 |
| rlandy|ruck | ok | 14:06 |
| rlandy|ruck | only 117 to go https://trunk.rdoproject.org/centos8-master/queue.html | 14:06 |
| dviroel|ruck | arxcruz: 3g? isn't 5g there already? | 14:07 |
| rlandy|ruck | supposedly openstack won 4g | 14:07 |
| rlandy|ruck | so that exists | 14:07 |
| rlandy|ruck | 5g - depends on arae | 14:07 |
| rlandy|ruck | area | 14:07 |
| dviroel|ruck | t-mobile has a good 4g+ and 5g coverage | 14:13 |
| dviroel|ruck | https://www.nperf.com/pt/map/DE/2950159.Berlin/187895.T-Mobile/signal/?ll=52.42587274336118&lg=13.450012207031252&zoom=9 | 14:13 |
| rlandy|ruck | akaha|rover: dviroel|ruck: who wants to present at the program call this week? I'll update the doc before my EoD | 14:18 |
| dviroel|ruck | rlandy|ruck: i will | 14:18 |
| rlandy|ruck | thank you, sir | 14:19 |
| akaha|rover | rlandy|ruck, i can | 14:19 |
| rlandy|ruck | you can fight it out :) | 14:19 |
| akaha|rover | :) | 14:20 |
| dviroel|ruck | akaha|rover: i will take cix too, since it will be late for you right | 14:20 |
| dviroel|ruck | akaha|rover: don't worry | 14:20 |
| akaha|rover | dviroel|ruck, then let me attend program call. | 14:21 |
| dviroel|ruck | akaha|rover: k, i will be the backup then ;) | 14:21 |
| akaha|rover | dviroel|ruck, thanks man!! :) | 14:21 |
| *** amoralej|lunch is now known as amoralej | 14:22 | |
| ysandeep | guys /me updating el9 status, please remind me what was blocking c9 wallaby promotion? | 14:36 |
| ysandeep | dviroel|ruck, ^^ | 14:37 |
| rlandy|ruck | what dviroel|ruck bugged this morning | 14:40 |
| rlandy|ruck | but in skiplist | 14:40 |
| dviroel|ruck | ysandeep: this one is blocking https://bugs.launchpad.net/tripleo/+bug/1960310 - but we just merged the skiplist - will rerun again | 14:40 |
| rlandy|ruck | wallaby c9 line is running now | 14:40 |
| dviroel|ruck | oh, lets wait then | 14:40 |
| rlandy|ruck | ysandeep: master c9 line is also running now | 14:41 |
| ysandeep | dviroel|ruck, thanks! same bug hitting fs064 and fs039 on wallaby c9? | 14:41 |
| rlandy|ruck | so we'll see if that clears | 14:41 |
| ysandeep | rlandy|ruck, ack | 14:41 |
| rlandy|ruck | looking into the ci.centos thing more mow | 14:42 |
| rlandy|ruck | now | 14:42 |
| dviroel|ruck | ysandeep: not yet in criteria I think, the fix was merged, will rerun and add them | 14:42 |
| ysandeep | dviroel++ ack, please take your time.. just want to know status to report in EL9 mtg | 14:44 |
| dviroel|ruck | ysandeep: ack | 14:44 |
| rlandy|ruck | ysandeep: oh - and we're still waiting on one octavia patch for scenario-10-kvm | 14:51 |
| ysandeep | thanks! added that as well | 14:53 |
| *** akaha|rover is now known as akahat|dinner | 14:55 | |
| *** dviroel|ruck is now known as dviroel|ruck|lunch | 15:11 | |
| *** ysandeep is now known as ysandeep|dinner | 15:14 | |
| *** pojadhav is now known as pojadhav|dinner | 15:24 | |
| arxcruz | and i'm back | 15:33 |
| *** ysandeep|dinner is now known as ysandeep | 15:44 | |
| marios | rlandy|ruck: ysandeep: el9 meeting cancelled ? i don't see in calendar any more it was there earlier though | 15:45 |
| rlandy|ruck | marios: yep ... | 15:47 |
| rlandy|ruck | moving to CIX apparently | 15:47 |
| marios | rlandy|ruck: thanks | 15:47 |
| ysandeep | rlandy|ruck, did we agreed to moved to cix? | 15:47 |
| ysandeep | i thought that was just an idea | 15:47 |
| rlandy|ruck | the CIX call is going to become the only meeting you'll ever need | 15:48 |
| rlandy|ruck | all in 30 mins | 15:48 |
| marios | rlandy|ruck: in 10 mins more like | 15:50 |
| rlandy|ruck | ugh - one failure - rerunning periodic-tripleo-ci-centos-9-standalone-full-tempest-scenario-master | 15:54 |
| rlandy|ruck | fs002 | 15:55 |
| marios | rlandy|ruck: ah see what you meant now... cix replacing the c9 call | 15:55 |
| marios | ack | 15:55 |
| *** pojadhav|dinner is now known as pojadhav | 15:58 | |
| dasm | hey dviroel|ruck|lunch I'm trying to renew my kerberos ticket and it's failing. Can you see if that's working for you? | 16:00 |
| dasm | "not found in Kerberos database" | 16:02 |
| rlandy|ruck | dasm: wfm | 16:03 |
| rlandy|ruck | can you try again kinit username | 16:04 |
| *** dviroel|ruck|lunch is now known as dviroel|ruck | 16:06 | |
| dasm | :/ | 16:06 |
| dviroel|ruck | dasm: works for me too | 16:07 |
| dasm | tried few times already. i'll try resetting from scratch | 16:07 |
| dasm | ack | 16:07 |
| dviroel|ruck | rlandy|ruck: python-keystone-tests-tempest is the next one :) | 16:08 |
| rlandy|ruck | dviroel|ruck: woohoo - grab the popcorn | 16:08 |
| rlandy|ruck | dasm: did you prepare the right sacrifice for the kerb powers??? | 16:09 |
| dasm | rlandy|ruck: i knew i forgot about something! it's sacrifice | 16:10 |
| dviroel|ruck | rlandy|ruck: https://trunk.rdoproject.org/centos8-master/component/security/4e/ff/4eff632695fe79a5d78f400dca3ceab663c83788_5f1db43c/ | 16:13 |
| dviroel|ruck | rlandy|ruck: do you have the command to kick security in hands? | 16:13 |
| rlandy|ruck | dviroel|ruck: it's running now | 16:14 |
| rlandy|ruck | will kill and restart | 16:14 |
| dviroel|ruck | +1 | 16:14 |
| rlandy|ruck | done | 16:19 |
| dviroel|ruck | rlandy|ruck: ack | 16:20 |
| dviroel|ruck | rlandy|ruck: you already started to rerun master and wallaby jobs too - nice | 16:20 |
| rlandy|ruck | dviroel|ruck: yep | 16:20 |
| dviroel|ruck | featureset001-wallaby failed on the skipped tests, next run should work | 16:22 |
| rlandy|ruck | https://logserver.rdoproject.org/openstack-periodic-integration-stable1-cs9/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-wallaby/019fda2/logs/undercloud/var/log/tempest/stestr_results.html.gz | 16:22 |
| rlandy|ruck | yep | 16:22 |
| rlandy|ruck | rerun in progress | 16:22 |
| dviroel|ruck | fs035 was also faling in these tests, should be the same issue | 16:22 |
| rlandy|ruck | added to rerun testproject | 16:44 |
| *** jpena is now known as jpena|off | 17:04 | |
| *** akahat|dinner is now known as akahat|rover | 17:05 | |
| rlandy|ruck | dviroel|ruck: ok - I think I have all the failing tests in rerun | 17:05 |
| rlandy|ruck | feel free to edit that testproject if needed | 17:05 |
| rlandy|ruck | for c8 | 17:05 |
| rlandy|ruck | we may need the whole queue to clear | 17:06 |
| rlandy|ruck | before we get good results | 17:06 |
| rlandy|ruck | who knows what we are missing??? | 17:06 |
| rlandy|ruck | wallaby c8 is promoting now | 17:06 |
| dviroel|ruck | rlandy|ruck: ack - so, yeah, each test has a different failure atm | 17:07 |
| dviroel|ruck | each job* | 17:08 |
| rlandy|ruck | ysandeep: going to start reporting on rhos-17 on rhel-9 promotions in program call | 17:11 |
| rlandy|ruck | you'll make everyone happy | 17:12 |
| dviroel|ruck | rlandy|ruck: some component lines will continue to fail, because they need keystone-tempest fix | 17:16 |
| dviroel|ruck | rlandy|ruck: the best is to wait all commits in the queue | 17:16 |
| rlandy|ruck | dviroel|ruck: ack - it will shake out after we promote | 17:16 |
| rlandy|ruck | oh c8 | 17:17 |
| rlandy|ruck | yeah | 17:17 |
| rlandy|ruck | dviroel|ruck: for today, we should focus on c9 - master, wallaby promotions | 17:17 |
| rlandy|ruck | then rekick c8 master component jobs that need it | 17:17 |
| rlandy|ruck | promote tomorrow | 17:18 |
| *** sshnaidm is now known as sshnaidm|afk | 17:18 | |
| dviroel|ruck | +1 | 17:20 |
| *** ysandeep is now known as ysandeep|out | 17:21 | |
| dasm | ok. laptop reboot solved a problem with non-working kerberos creds | 17:25 |
| dasm | \o/ | 17:25 |
| rlandy|ruck | great | 17:36 |
| *** amoralej is now known as amoralej|off | 17:39 | |
| rlandy|ruck | bhagyashris: hi - can you send link for victoria promotion? | 18:05 |
| rlandy|ruck | it should be promoting now | 18:06 |
| bhagyashris | rlandy|ruck, http://10.0.148.74/promoter_logs/?C=M;O=D | 18:06 |
| bhagyashris | yeah it's promoting ... | 18:06 |
| rlandy|ruck | 2022-02-08 17:20:15,634 3585405 INFO promoter Running: env ANSIBLE_LOG_PATH=/home/promoter/web/promoter_logs/container-push/20220208-171924.log ANSIBLE_DEBUG=False ansible-playbook -v -e @/tmp/tmpqs3dryfc.yaml /home/promoter/ci-config/ci-scripts/container-push/container-push.yml | 18:06 |
| rlandy|ruck | ah - it is | 18:06 |
| rlandy|ruck | thank you | 18:06 |
| rlandy|ruck | ysandeep|out: sshnaidm|afk: arxcruz: pls review your instances on PSI internal | 18:41 |
| rlandy|ruck | we need to space to play there | 18:41 |
| rlandy|ruck | pls delete what is not in use | 18:41 |
| rlandy|ruck | akahat|rover: bhagyashris: ^^ two promoter servers there | 18:42 |
| rlandy|ruck | dviroel|ruck: fs002 on master | 18:51 |
| rlandy|ruck | looks like repeatable can;t delete stack | 18:52 |
| rlandy|ruck | if that is the only failure, would promote w/o that and bug it | 18:52 |
| dviroel|ruck | rlandy|ruck: +1, we can debug overcloud delete later - akahat|rover already fixed an issue there | 18:53 |
| rlandy|ruck | k | 18:53 |
| rlandy|ruck | let's see how the last few shake out | 18:54 |
| rlandy|ruck | also trying to promote 17 | 18:54 |
| dviroel|ruck | rlandy|ruck: found the commit that adds it https://opendev.org/openstack/tripleo-ansible/commit/2636e84c41f8be28c9f72e8ce126beb72b2cb32c | 18:59 |
| rlandy|ruck | ping fmount on #tripleo | 19:00 |
| rlandy|ruck | his commit | 19:00 |
| dviroel|ruck | rlandy|ruck: 8pm for him already | 19:07 |
| dviroel|ruck | no answers | 19:07 |
| rlandy|ruck | dviroel|ruck: try fultonj | 19:07 |
| rlandy|ruck | ceph friends | 19:08 |
| dviroel|ruck | yep | 19:13 |
| dviroel|ruck | but I think that they broke the vip delete logic - it is failing when we want to delete only using service_name | 19:13 |
| dviroel|ruck | rlandy|ruck: nothing that we will fix today right - you want me to open the bug? | 19:19 |
| rlandy|ruck | dviroel|ruck: ack pls | 19:20 |
| rlandy|ruck | we'll ping fmount | 19:20 |
| rlandy|ruck | if it's only fs002, let's promote w/o it | 19:20 |
| rlandy|ruck | if it's all ovb, we have a bigger issue | 19:20 |
| dviroel|ruck | rlandy|ruck: agree | 19:21 |
| rlandy|ruck | watching content provider c8 | 19:21 |
| rlandy|ruck | some gate failures | 19:21 |
| rlandy|ruck | let's see if there is a legit issue | 19:21 |
| rlandy|ruck | fs001 master passed | 19:23 |
| rlandy|ruck | fs035 failed | 19:23 |
| rlandy|ruck | checking logs there | 19:23 |
| dviroel|ruck | ok | 19:23 |
| rlandy|ruck | fa001 passed on both | 19:32 |
| rlandy|ruck | fs035 failed on both | 19:32 |
| dviroel|ruck | tempest? | 19:37 |
| dviroel|ruck | security OATH | 19:47 |
| dviroel|ruck | will investigate | 19:47 |
| rlandy|ruck | and we have a content provider issue | 19:52 |
| rlandy|ruck | looking | 19:52 |
| rlandy|ruck | ugh - I think I know | 19:54 |
| rlandy|ruck | hmmm ... no | 19:58 |
| rlandy|ruck | idk | 20:00 |
| rlandy|ruck | Stderr: 'level=debug msg="Pull Policy for pull [PullIfNewer]"\nerror building | 20:01 |
| dviroel|ruck | humm | 20:03 |
| rlandy|ruck | dviroel|ruck: hmmm ... https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-8-content-provider&skip=0 | 20:04 |
| rlandy|ruck | so we're definitely dying here | 20:04 |
| rlandy|ruck | and I thought it was https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/828223/1/roles/container-build/tasks/main.yaml | 20:04 |
| rlandy|ruck | but it's not | 20:04 |
| rlandy|ruck | dviroel|ruck: something that maybe got into current master c8 | 20:06 |
| rlandy|ruck | not a c9 thing | 20:06 |
| dviroel|ruck | https://746b9b3552a84dbbbf46-a133153af68a0459f51ed4b0ea995900.ssl.cf5.rackcdn.com/827518/2/gate/tripleo-ci-centos-8-content-provider/6129769/logs/container-builds/3f06dd55-19c5-46c5-96ad-0bdedb4db623/base/collectd/collectd-build.log | 20:06 |
| dviroel|ruck | dependencie issue? | 20:07 |
| dviroel|ruck | maybe something wrong with https://trunk.rdoproject.org/centos8-master/deps/collectd/ | 20:10 |
| rlandy|ruck | Error: Unable to find a match: collectd-libpod-stats collectd-sensubility python3-sqlalchemy-collectd | 20:10 |
| dviroel|ruck | oh, it is disabled | 20:11 |
| rlandy|ruck | wonder if that is messed up as well | 20:11 |
| rlandy|ruck | dviroel|ruck: let's ask on #rhos-ops | 20:11 |
| dviroel|ruck | rlandy|ruck: ok, but this repo is disabled (rdo one) | 20:12 |
| dviroel|ruck | https://746b9b3552a84dbbbf46-a133153af68a0459f51ed4b0ea995900.ssl.cf5.rackcdn.com/827518/2/gate/tripleo-ci-centos-8-content-provider/6129769/logs/undercloud/etc/yum.repos.d/quickstart-centos-opstools.repo | 20:12 |
| rlandy|ruck | baseurl: https://trunk.rdoproject.org/centos8-master/deps/collectd/ | 20:13 |
| dviroel|ruck | enabled=0 | 20:13 |
| rlandy|ruck | yea - that was a temp repo | 20:13 |
| rlandy|ruck | https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/CentOS-8/master.yml#L193 | 20:13 |
| dviroel|ruck | seems to be there | 20:14 |
| rlandy|ruck | https://github.com/openstack/tripleo-quickstart/commit/1ef5d08a82dfac3f245c8be0c1307d8c61fb83d7 | 20:14 |
| rlandy|ruck | why is it disabled? | 20:16 |
| dviroel|ruck | dont know | 20:16 |
| dviroel|ruck | https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/CentOS-8/master.yml#L203 | 20:16 |
| rlandy|ruck | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_059/828138/2/check/tripleo-ci-centos-8-content-provider/059c3bb/logs/undercloud/etc/yum.repos.d/quickstart-centos-opstools.repo | 20:17 |
| rlandy|ruck | ^^ passing job it's enabled | 20:17 |
| dviroel|ruck | on stable/train is | 20:17 |
| dviroel|ruck | look the one below | 20:17 |
| rlandy|ruck | https://opendev.org/openstack/tripleo-ci/src/branch/master/roles/tripleo-build-jobs-repos/tasks/load-vars.yaml#L16 | 20:20 |
| rlandy|ruck | dviroel|ruck: let's sync | 20:20 |
| rlandy|ruck | https://meet.google.com/zse-ryou-uod?pli=1&authuser=0 | 20:20 |
| rlandy|ruck | dviroel|ruck: sorry - out of meeting | 20:58 |
| dviroel|ruck | rlandy|ruck: just sent https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/828428 | 21:00 |
| * dviroel|ruck 3 bug reports in one day is my personal record | 21:01 | |
| rlandy|ruck | dviroel|ruck: amazing | 21:01 |
| rlandy|ruck | dviroel|ruck: ok - let's deal with these one at a time | 21:01 |
| rlandy|ruck | wallaby, master c9 promotions | 21:02 |
| dviroel|ruck | we can start a testproject with depends-on and see | 21:02 |
| rlandy|ruck | on fs035? | 21:02 |
| dviroel|ruck | yep | 21:02 |
| rlandy|ruck | yeah | 21:02 |
| rlandy|ruck | and then we will need to skip fs002 to promote | 21:03 |
| dviroel|ruck | yeah | 21:03 |
| rlandy|ruck | wrt content provider | 21:03 |
| rlandy|ruck | I'm going to propose a revert | 21:03 |
| rlandy|ruck | and add that as a depends on | 21:03 |
| rlandy|ruck | on a job in upstream | 21:04 |
| dviroel|ruck | ok | 21:04 |
| rlandy|ruck | if it gets by, we merge that revert | 21:04 |
| dviroel|ruck | will create the fs035 one | 21:04 |
| rlandy|ruck | idk if the depends on will take | 21:05 |
| rlandy|ruck | dviroel|ruck: other option is to force enable opstools in our repo | 21:06 |
| dviroel|ruck | rlandy|ruck: yes | 21:06 |
| dviroel|ruck | can be more tricky - because we will need to disable [centos-opstools] delorean-master-deps.repo and enable quickstart-centos-opstools | 21:19 |
| rlandy|ruck | really - if it's not ready, I would revert it | 21:29 |
| rlandy|ruck | dviroel|ruck: going to try a patch to remove that line | 21:30 |
| dviroel|ruck | which one? | 21:34 |
| rlandy|ruck | why are we disabling opstools? | 21:37 |
| rlandy|ruck | at the same time | 21:37 |
| rlandy|ruck | whether it's enabled or not, makes no diff | 21:37 |
| rlandy|ruck | it's referencing the dlrn one | 21:37 |
| dviroel|ruck | lol - don't know - don't have the background of this hac | 21:38 |
| dviroel|ruck | hack | 21:38 |
| rlandy|ruck | tripleo-ci-centos-8-content-provider pass on one job | 21:40 |
| rlandy|ruck | transient? | 21:40 |
| dviroel|ruck | rlandy|ruck: can be a mirror issue | 21:40 |
| dviroel|ruck | another one build atm: https://zuul.opendev.org/t/openstack/stream/9c0733c14f134ba793168fb8428989a5?logfile=console.log | 21:41 |
| rlandy|ruck | rechecking the failed gate jobs | 21:41 |
| dviroel|ruck | waiting to see | 21:41 |
| rlandy|ruck | maybe it's clearing | 21:41 |
| rlandy|ruck | dviroel|ruck: late for you | 21:49 |
| rlandy|ruck | putting in patch to take fs002 out of criteria | 21:50 |
| dviroel|ruck | rlandy|ruck: ack, i can vote | 21:51 |
| rlandy|ruck | dviroel|ruck: then you can go | 21:51 |
| rlandy|ruck | will watch the fs035 | 21:51 |
| rlandy|ruck | and the content provider mess | 21:51 |
| dviroel|ruck | rlandy|ruck: not too late, but I need to stay with the kid for a moment | 21:52 |
| rlandy|ruck | https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/39223 Temp remove fs002 from master c9 criteria | 21:55 |
| rlandy|ruck | dviroel|ruck: ^^ when back | 21:55 |
| dviroel|ruck | voted | 21:56 |
| dviroel|ruck | rlandy|ruck: going afk - o/ | 22:01 |
| rlandy|ruck | dviroel|ruck: sure - hope kid is ok | 22:01 |
| dviroel|ruck | rlandy|ruck: he is better now | 22:02 |
| dviroel|ruck | rlandy|ruck: thanks o/ | 22:02 |
| rlandy|ruck | :) | 22:02 |
| *** dviroel|ruck is now known as dviroel|ruck|afk | 22:02 | |
| rlandy|ruck | dasm: how goes uefi? | 22:16 |
| dasm | rlandy|ruck: surprisingly good. it started working without any intervention from my side. just checking if i missed anything | 22:18 |
| rlandy|ruck | wow | 22:18 |
| rlandy|ruck | you chatted with steve? | 22:18 |
| * rlandy|ruck checking hardware prov chat | 22:19 | |
| dasm | yes | 22:19 |
| rlandy|ruck | ok - let's chat tomorrow | 22:21 |
| dasm | k | 22:21 |
| rlandy|ruck | let me know what you found | 22:21 |
| dasm | atm -- nothing. | 22:21 |
| dasm | it seems to be alright now | 22:21 |
| dasm | and i'm not even sure, why it didn't work yesterday :/ | 22:22 |
| * dasm leaves... | 23:01 | |
| *** dasm is now known as dasm|off | 23:02 | |
| rlandy|ruck | amoralej|off: https://review.rdoproject.org/r/c/rdo-infra/ansible-role-dlrn/+/38804 | 23:21 |
| rlandy|ruck | failing content-provider jobs | 23:21 |
| *** rlandy|ruck is now known as rlandy|ruck|bbl | 23:24 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!