opendevreview | Brendan Shephard proposed openstack/python-tripleoclient master: Replace non-inclusive language https://review.opendev.org/c/openstack/python-tripleoclient/+/820078 | 00:01 |
---|---|---|
opendevreview | Brendan Shephard proposed openstack/python-tripleoclient master: Replace non-inclusive language https://review.opendev.org/c/openstack/python-tripleoclient/+/820078 | 00:02 |
opendevreview | Brendan Shephard proposed openstack/python-tripleoclient master: Replace non-inclusive language https://review.opendev.org/c/openstack/python-tripleoclient/+/820078 | 00:03 |
*** rlandy|bbl is now known as rlandy|out | 00:03 | |
opendevreview | Merged openstack/tripleo-ci master: Revert "Adds tripleo-repos/-operator-ansible collection push jobs" https://review.opendev.org/c/openstack/tripleo-ci/+/841223 | 00:03 |
opendevreview | Brendan Shephard proposed openstack/python-tripleoclient master: Replace non-inclusive language https://review.opendev.org/c/openstack/python-tripleoclient/+/820078 | 00:05 |
opendevreview | James Slagle proposed openstack/tripleo-ansible master: tripleo_keystone: Use tripleo_container_standalone https://review.opendev.org/c/openstack/tripleo-ansible/+/838906 | 00:11 |
opendevreview | James Slagle proposed openstack/tripleo-ansible master: Add tripleo_iscsid role https://review.opendev.org/c/openstack/tripleo-ansible/+/838907 | 00:11 |
opendevreview | James Slagle proposed openstack/tripleo-ansible master: Add tripleo_mysql_client role https://review.opendev.org/c/openstack/tripleo-ansible/+/840321 | 00:11 |
opendevreview | James Slagle proposed openstack/tripleo-ansible master: Add initial standalone playbooks and inventory for a compute node https://review.opendev.org/c/openstack/tripleo-ansible/+/840509 | 00:11 |
opendevreview | James Slagle proposed openstack/tripleo-ansible master: Add tripleo_bootstrap role to standlone install phase https://review.opendev.org/c/openstack/tripleo-ansible/+/840675 | 00:11 |
opendevreview | James Slagle proposed openstack/tripleo-ansible master: Add tripleo_ssh_known_hosts role to standalone configure phase https://review.opendev.org/c/openstack/tripleo-ansible/+/840676 | 00:11 |
opendevreview | James Slagle proposed openstack/tripleo-ansible master: Add standalone bootstrap phase and playbook https://review.opendev.org/c/openstack/tripleo-ansible/+/840677 | 00:11 |
opendevreview | James Slagle proposed openstack/tripleo-ansible master: Add pre-network and network phase and playbooks https://review.opendev.org/c/openstack/tripleo-ansible/+/840903 | 00:11 |
*** artom_ is now known as artom | 00:47 | |
*** ysandeep|out is now known as ysandeep|rover | 01:21 | |
ysandeep|rover | hjensas: i think https://opendev.org/openstack/tripleo-ansible/commit/b4e23529891eccd83e1e313e871e299b16ed93e7 only in master - I think because of this we are not seeing in wallaby. | 01:37 |
opendevreview | Steve Baker proposed openstack/tripleo-ansible master: Use inventory host for wait_for_connection https://review.opendev.org/c/openstack/tripleo-ansible/+/841360 | 01:38 |
opendevreview | Takashi Kajinami proposed openstack/tripleo-heat-templates master: Remove implementation for Nuage integration https://review.opendev.org/c/openstack/tripleo-heat-templates/+/837238 | 01:54 |
opendevreview | Takashi Kajinami proposed openstack/puppet-tripleo master: Remove implementation for Nuage integration https://review.opendev.org/c/openstack/puppet-tripleo/+/837240 | 01:55 |
opendevreview | Steve Baker proposed openstack/tripleo-ansible master: Use inventory host for wait_for_connection https://review.opendev.org/c/openstack/tripleo-ansible/+/841360 | 01:58 |
*** ysandeep|rover is now known as ysandeep|rover|bbl | 02:08 | |
opendevreview | Merged openstack/tripleo-heat-templates master: Add back FRR to Undercloud https://review.opendev.org/c/openstack/tripleo-heat-templates/+/841235 | 02:21 |
opendevreview | Takashi Kajinami proposed openstack/puppet-tripleo master: Redis: Share the same base class https://review.opendev.org/c/openstack/puppet-tripleo/+/841362 | 02:52 |
*** dasm|bbl is now known as dasm|off | 03:40 | |
*** bhagyashris|out is now known as bhagyashris | 03:58 | |
*** ysandeep|rover|bbl is now known as ysandeep|rover | 04:23 | |
opendevreview | Merged openstack/tripleo-heat-templates master: Add missing cert generation tasks to glance-api https://review.opendev.org/c/openstack/tripleo-heat-templates/+/840436 | 04:33 |
opendevreview | Merged openstack/tripleo-common master: Remove custom subclass to re-enable software deployment by Heat https://review.opendev.org/c/openstack/tripleo-common/+/839485 | 04:33 |
*** soniya29 is now known as soniya29|ruck | 04:51 | |
ysandeep|rover | marios, Tengu hjensas: please add in your review list: https://review.opendev.org/c/openstack/tripleo-ansible/+/841360 | 05:27 |
marios | ysandeep|rover: morning | 05:33 |
marios | ysandeep|rover: nice ... does it fix the ssh issue (that bug has been a pain for while) | 05:33 |
marios | problem with that one is it was inconsistent... so we won't know for sure until it runs for a while with this fix i gues... | 05:33 |
ysandeep|rover | marios: yes, it will fix the node provisioning issue | 05:33 |
marios | ysandeep|rover: yeah but https://review.opendev.org/c/openstack/tripleo-ansible/+/841360/2#message-fa9e548eb1647fdb084a54e257bc7bee86068a3a | 05:34 |
marios | hmm | 05:34 |
ysandeep|rover | marios, tested in my lab by killing one overcloud node - http://pastebin.test.redhat.com/1050919 | 05:34 |
ysandeep|rover | with steve patch it retries again and again on "wait for node to be provisioned" where earlier it was not waiting. | 05:35 |
ysandeep|rover | vexx nodes are definetely slow but this patch makes our code path much stable with slow nodes. | 05:37 |
marios | ysandeep|rover: ack ok lets see at least it makes sense anyway voted just now | 05:37 |
ysandeep|rover | marios: thanks! | 05:38 |
hjensas | ysandeep|rover: I approved the patch. | 05:48 |
ysandeep|rover | hjensas: thank you :) | 05:48 |
hjensas | stevebaker[m]++ nice catch! | 05:48 |
marios | np ysandeep|rover | 05:56 |
opendevreview | Takashi Kajinami proposed openstack/puppet-tripleo master: Redis: Share the same base class https://review.opendev.org/c/openstack/puppet-tripleo/+/841362 | 06:01 |
opendevreview | Sandeep Yadav proposed openstack/tripleo-heat-templates stable/wallaby: Switch to stestr https://review.opendev.org/c/openstack/tripleo-heat-templates/+/841280 | 06:05 |
opendevreview | Sofer Athlan-Guyot proposed openstack/tripleo-heat-templates stable/train: Ensure container's image get updated if their name stay the same. https://review.opendev.org/c/openstack/tripleo-heat-templates/+/841347 | 06:13 |
opendevreview | Sandeep Yadav proposed openstack/tripleo-heat-templates stable/wallaby: Switch to stestr https://review.opendev.org/c/openstack/tripleo-heat-templates/+/841280 | 06:15 |
opendevreview | Sandeep Yadav proposed openstack/tripleo-heat-templates stable/wallaby: Switch to stestr https://review.opendev.org/c/openstack/tripleo-heat-templates/+/841280 | 06:26 |
opendevreview | Sofer Athlan-Guyot proposed openstack/tripleo-heat-templates stable/train: Ensure container's image get updated if their name stay the same. https://review.opendev.org/c/openstack/tripleo-heat-templates/+/841347 | 06:33 |
opendevreview | Sofer Athlan-Guyot proposed openstack/tripleo-heat-templates stable/train: Ensure container's image get updated if their name stay the same. https://review.opendev.org/c/openstack/tripleo-heat-templates/+/841347 | 06:35 |
opendevreview | Jiri Podivin proposed openstack/tripleo-validations stable/train: Validate libvirtd is not running on the undercloud https://review.opendev.org/c/openstack/tripleo-validations/+/831761 | 06:58 |
opendevreview | Jiri Podivin proposed openstack/tripleo-validations stable/victoria: Validate libvirtd is not running on the undercloud https://review.opendev.org/c/openstack/tripleo-validations/+/831757 | 06:58 |
opendevreview | Rabi Mishra proposed openstack/tripleo-heat-templates stable/wallaby: Revert "Don't use upper-constraints for pep8 target" https://review.opendev.org/c/openstack/tripleo-heat-templates/+/841282 | 07:13 |
opendevreview | Rabi Mishra proposed openstack/tripleo-heat-templates stable/wallaby: Revert "Don't use upper-constraints for pep8 target" https://review.opendev.org/c/openstack/tripleo-heat-templates/+/841282 | 07:23 |
*** ysandeep|rover is now known as ysandeep|rover|brb | 07:29 | |
*** soniya is now known as soniya|ruck | 07:40 | |
*** ysandeep|rover|brb is now known as ysandeep|rover | 07:40 | |
opendevreview | Sandeep Yadav proposed openstack/tripleo-heat-templates stable/wallaby: Switch to stestr https://review.opendev.org/c/openstack/tripleo-heat-templates/+/841375 | 07:44 |
opendevreview | Sandeep Yadav proposed openstack/tripleo-heat-templates stable/wallaby: Switch to stestr https://review.opendev.org/c/openstack/tripleo-heat-templates/+/841375 | 07:45 |
*** soniya|ruck is now known as soniya|ruck|dinner | 07:51 | |
*** soniya|ruck|dinner is now known as soniya|ruck|lunch | 07:53 | |
ysandeep|rover | marios, Tengu need reviews to unblock gate: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/841282/ | 07:54 |
marios | ack ysandeep|rover | 07:56 |
ysandeep|rover | marios, thanks! | 07:57 |
*** ysandeep|rover is now known as ysandeep|rover|lunch | 08:01 | |
opendevreview | Jiri Podivin proposed openstack/tripleo-validations stable/train: Adding backup-and-restore validation group https://review.opendev.org/c/openstack/tripleo-validations/+/841378 | 08:07 |
opendevreview | Jiri Podivin proposed openstack/tripleo-validations stable/victoria: Adding backup-and-restore validation group https://review.opendev.org/c/openstack/tripleo-validations/+/841380 | 08:09 |
opendevreview | Merged openstack/tripleo-ansible master: Use inventory host for wait_for_connection https://review.opendev.org/c/openstack/tripleo-ansible/+/841360 | 08:23 |
opendevreview | Jakob Meng proposed openstack/tripleo-quickstart-extras master: Use openstack prefix only for CentOS 7 container images https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/841381 | 08:39 |
opendevreview | Marios Andreou proposed openstack/tripleo-ci master: Remove centos-7 job definitions and zuul layouts https://review.opendev.org/c/openstack/tripleo-ci/+/839518 | 08:49 |
*** soniya|ruck|lunch is now known as soniya|ruck | 08:56 | |
*** ysandeep|rover|lunch is now known as ysandeep|rover | 09:02 | |
*** jpena|off is now known as jpena | 09:39 | |
opendevreview | Jiri Podivin proposed openstack/validations-libs stable/1.6: Validation help improvement https://review.opendev.org/c/openstack/validations-libs/+/841392 | 09:57 |
opendevreview | Merged openstack/tripleo-ansible stable/wallaby: ReaR needs specific configuration in RHEL9 with LVM https://review.opendev.org/c/openstack/tripleo-ansible/+/840936 | 09:59 |
opendevreview | Jiri Podivin proposed openstack/validations-common stable/1.6: Removing references to Babel https://review.opendev.org/c/openstack/validations-common/+/841397 | 10:16 |
opendevreview | Jiri Podivin proposed openstack/validations-common stable/1.6: setup.cfg: Replace dashes by underscores https://review.opendev.org/c/openstack/validations-common/+/841398 | 10:16 |
opendevreview | Jiri Podivin proposed openstack/validations-common stable/1.6: Normalizing VF metadata https://review.opendev.org/c/openstack/validations-common/+/841399 | 10:16 |
opendevreview | chandan kumar proposed openstack/tripleo-ansible master: Rename jobs to centos-stream and use stream9 image as base https://review.opendev.org/c/openstack/tripleo-ansible/+/839688 | 11:01 |
*** bhagyashris_ is now known as bhagyashris | 11:03 | |
opendevreview | Jiri Podivin proposed openstack/validations-libs stable/1.6: Removing references to Babel https://review.opendev.org/c/openstack/validations-libs/+/841402 | 11:06 |
Tengu | slaweq: heya! fyi, I think I have something that really looks like a valid nftables ruleset for tripleo dedicated rules - it even creates dedicated chains in the different tables, and add the needed jump rule to forward packets in the custom chains. | 11:18 |
Tengu | and it also checks to ensure there isn't such rule already. | 11:19 |
*** rlandy|out is now known as rlandy | 11:21 | |
*** dviroel|out is now known as dviroel | 11:31 | |
*** ysandeep|rover is now known as ysandeep|rover|brb | 11:32 | |
*** ysandeep|rover|brb is now known as ysandeep|rover | 11:37 | |
*** artom_ is now known as artom | 11:42 | |
*** dasm|off is now known as dasm | 11:46 | |
opendevreview | chandan kumar proposed openstack/tripleo-quickstart-extras master: Use openstack prefix only for CentOS 7 container images https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/841381 | 11:49 |
*** ysandeep|rover is now known as ysandeep|rover|mtg | 11:55 | |
opendevreview | Merged openstack/tripleo-validations master: Adding roles.galaxy to the gitignore https://review.opendev.org/c/openstack/tripleo-validations/+/826038 | 11:57 |
opendevreview | Merged openstack/tripleo-validations master: Tests for the 'verify_profiles' module. https://review.opendev.org/c/openstack/tripleo-validations/+/795304 | 11:57 |
opendevreview | Merged openstack/tripleo-heat-templates stable/wallaby: Revert "Don't use upper-constraints for pep8 target" https://review.opendev.org/c/openstack/tripleo-heat-templates/+/841282 | 11:57 |
opendevreview | Cedric Jeanneret proposed openstack/tripleo-ansible master: WIP Supports nftables instead of iptables https://review.opendev.org/c/openstack/tripleo-ansible/+/841414 | 12:06 |
odyssey4me | hey folks - looks like https://review.opendev.org/c/openstack/tripleo-ansible/+/839738 failed the check pipeline and has been static for a week or so... are we waiting for something else, or is that ready for a recheck? | 12:14 |
opendevreview | Jiri Podivin proposed openstack/tripleo-validations master: Refactoring and improvement of check_ironic_boot_config tests https://review.opendev.org/c/openstack/tripleo-validations/+/781125 | 12:16 |
opendevreview | chandan kumar proposed openstack/tripleo-ansible master: Rename jobs to centos-stream and use stream9 image as base https://review.opendev.org/c/openstack/tripleo-ansible/+/839688 | 12:20 |
Tengu | slaweq: re-started the testproject run, adding a new depends-on that should solve RDO node provisioning issue. | 12:25 |
Tengu | let's see how it goes for the firewall now! | 12:25 |
Tengu | before breaking things down with my nftables thingy :] | 12:26 |
slaweq | Tengu: thx a lot | 12:33 |
slaweq | fingers crossed :) | 12:33 |
Tengu | yep :) | 12:34 |
Tengu | slaweq: in parallel, if you want to cry a bit, https://review.opendev.org/c/openstack/tripleo-ansible/+/841414 it's still heavily WIP, untested so far, but that's "the current state of nftables support in tripleo" | 12:35 |
slaweq | Tengu: I will take a look | 12:35 |
Tengu | I'll do some proper doc + examples, and push some molecule testing as well to ensure things are being generated correctly. | 12:36 |
*** ysandeep|rover|mtg is now known as ysandeep|rover | 12:37 | |
ysandeep|rover | hjensas, stevebaker[m] fyi.. saw this today , https://logserver.rdoproject.org/37/28537/40/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-tripleo-master/ff50ffc/logs/baremetal_40_28810_0-console.log kernel panic during boot - rerunning to confirm if its consistent. | 12:47 |
ysandeep|rover | rlandy, ^^ fyi.. | 12:47 |
rlandy | oh gee - it keeps going | 12:57 |
Tengu | erf | 12:58 |
Tengu | o_O I thought that disk uuid thing was solved... | 12:58 |
rlandy | a new thing every day - twice a day sometimes | 13:02 |
Tengu | weeee | 13:02 |
opendevreview | Bogdan Dobrelya proposed openstack/tripleo-heat-templates stable/wallaby: Add IPA client service to Cell ctrlr role https://review.opendev.org/c/openstack/tripleo-heat-templates/+/841284 | 13:04 |
Tengu | slaweq: tiny issue with the container tag - updated again. | 13:07 |
*** ysandeep|rover is now known as ysandeep|rover|brb | 13:21 | |
*** ysandeep|rover|brb is now known as ysandeep|rover | 13:31 | |
*** bhagyashris_ is now known as bhagyashris | 13:33 | |
cloudnull | rlandy have you seen the following error recently -- https://paste.opendev.org/show/bAHUG0E9VapxVTs3Iy7F/ -- running master (current-tripleo) | 13:55 |
cloudnull | running -- sudo dnf install https://trunk.rdoproject.org/centos9-master/component/tripleo/39/73/39731d9844391fa82aadfec48a45bdcb6b8b2056_399a8bbb/openstack-tripleo-common-16.4.1-0.20220502104410.ba2c1c5.el9.noarch.rpm -- even after cleaning up the dnf / rpm cache, seems to run up against the same error | 13:56 |
cloudnull | looks like its failing to unpack the rpm | 13:56 |
cloudnull | Error unpacking rpm package openstack-tripleo-common-16.4.1-0.20220502104410.ba2c1c5.el9.noarch | 13:56 |
rlandy | cloudnull: not that I have seen yet - we are out on promoting master by 4 days atm - lots of OVB issues | 13:57 |
rlandy | let me check other check jobs | 13:57 |
opendevreview | Jiri Podivin proposed openstack/tripleo-validations stable/wallaby: [Stable-Only] Redefining the irrelevant files list to ensure execution graph stability https://review.opendev.org/c/openstack/tripleo-validations/+/841431 | 13:57 |
cloudnull | ++ | 13:58 |
cloudnull | I ran into that , when performing a package update | 13:58 |
opendevreview | Jiri Podivin proposed openstack/tripleo-validations stable/wallaby: Removing leftover README docs from roles https://review.opendev.org/c/openstack/tripleo-validations/+/841432 | 13:58 |
cloudnull | fix was to remove /usr/share/openstack-tripleo-common/container-images and reinstall but its odd that it happened in the first place. | 13:59 |
cloudnull | we may not be seeing it in our normal day to day jobs. just curious if there were similar reports of issues going on | 13:59 |
rlandy | cloudnull: seen that more than once? on zuul or a personal env? | 14:02 |
rlandy | trying to track if mirrors are involved | 14:02 |
opendevreview | Jiri Podivin proposed openstack/tripleo-validations stable/wallaby: Adding roles.galaxy to the gitignore https://review.opendev.org/c/openstack/tripleo-validations/+/841433 | 14:03 |
opendevreview | Kevin Carter proposed openstack/python-tripleoclient stable/wallaby: Move Ansible imports to correct UX Warnings https://review.opendev.org/c/openstack/python-tripleoclient/+/841286 | 14:04 |
opendevreview | Jiri Podivin proposed openstack/tripleo-validations stable/wallaby: [Stable-Only] Redefining the irrelevant files list to ensure execution graph stability https://review.opendev.org/c/openstack/tripleo-validations/+/841431 | 14:04 |
opendevreview | Jiri Podivin proposed openstack/tripleo-validations stable/wallaby: Removing leftover README docs from roles https://review.opendev.org/c/openstack/tripleo-validations/+/841432 | 14:04 |
opendevreview | Jiri Podivin proposed openstack/tripleo-validations stable/wallaby: Adding roles.galaxy to the gitignore https://review.opendev.org/c/openstack/tripleo-validations/+/841433 | 14:04 |
cloudnull | rlandy I'm seeing this on my rolling home cloud | 14:05 |
rlandy | cloudnull: looks the same on other providers ie: the repos | 14:06 |
rlandy | but we don't have a trace of that in check | 14:06 |
cloudnull | ok | 14:06 |
rlandy | cloudnull: on a particular job? | 14:07 |
cloudnull | nope , running an update locally | 14:07 |
cloudnull | my home cloud runs the head of master | 14:07 |
opendevreview | Douglas Viroel proposed openstack/tripleo-quickstart master: Add fips env file if fips enabled https://review.opendev.org/c/openstack/tripleo-quickstart/+/815750 | 14:07 |
cloudnull | so updating that ran into the rpm issue | 14:07 |
opendevreview | Douglas Viroel proposed openstack/tripleo-ansible master: Modify cert gen to make it work under fips https://review.opendev.org/c/openstack/tripleo-ansible/+/830308 | 14:07 |
opendevreview | Douglas Viroel proposed openstack/tripleo-heat-templates master: Testing latest ceph-pacific-devel container daemon https://review.opendev.org/c/openstack/tripleo-heat-templates/+/833451 | 14:07 |
rlandy | cloudnull: so that's possible - if you are ahead of master | 14:08 |
rlandy | we'd only see that in tripleo component | 14:08 |
rlandy | or integration | 14:08 |
rlandy | it's not in intragration | 14:09 |
cloudnull | repos are master with current-tripleo | 14:09 |
rlandy | correct | 14:09 |
rlandy | "my home cloud runs the head of master" | 14:09 |
rlandy | ^^ | 14:09 |
cloudnull | ++ | 14:09 |
cloudnull | this environment is only ever running the head of master. | 14:09 |
rlandy | cloudnull: this would be current-tripleo with anything latest on tripleo ... https://review.rdoproject.org/zuul/builds?pipeline=openstack-component-tripleo&skip=0 | 14:14 |
rlandy | other than OVB joy - nothing obvious | 14:14 |
rlandy | https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-integration-main&skip=0 | 14:15 |
rlandy | and integration - so OVB disaster but not picking up other | 14:15 |
*** spotz_ is now known as spotz | 14:18 | |
hjensas | ysandeep|rover: Looking at the dracut issue. I see the UUID it fails to find in the image build log. Wonder if https://review.opendev.org/c/openstack/diskimage-builder/+/839830 can be what is needed. | 14:21 |
hjensas | ysandeep|rover: I'll try to reproduce locally as well. | 14:21 |
ysandeep|rover | hjensas++ thanks, we will report a bug as well if I see same issue in current run. | 14:22 |
cloudnull | rlandy ++ thanks for having a look | 14:24 |
rlandy | cloudnull: if you see that consistently ping again - we can recheck | 14:26 |
cloudnull | will do | 14:26 |
*** soniya|ruck is now known as soniya|out | 15:05 | |
*** dviroel is now known as dviroel|lunch | 15:09 | |
ysandeep|rover | hjensas: we hit the same issue again, we have reported: https://bugs.launchpad.net/tripleo/+bug/1973038 | 15:14 |
ysandeep|rover | hjensas: let me run a testproject with https://review.opendev.org/c/openstack/diskimage-builder/+/839830 as depends-on to see if that fixes the issue. | 15:14 |
ysandeep|rover | rlandy: ^^ fyi | 15:15 |
opendevreview | Cedric Jeanneret proposed openstack/tripleo-ansible master: WIP Supports nftables instead of iptables https://review.opendev.org/c/openstack/tripleo-ansible/+/841414 | 15:17 |
rlandy | ysandeep|rover: pls link testproject so I can follow results | 15:18 |
ysandeep|rover | hjensas, rlandy https://review.rdoproject.org/r/c/testproject/+/28537 | 15:18 |
rlandy | ty | 15:18 |
ysandeep|rover | I will comment about testproject on bug as well | 15:18 |
opendevreview | Takashi Kajinami proposed openstack/tripleo-heat-templates master: neutorn-ironic-agent: Use internal endpoint to query Neutron API https://review.opendev.org/c/openstack/tripleo-heat-templates/+/841443 | 15:23 |
*** ysandeep|rover is now known as ysandeep|rover|out | 15:26 | |
opendevreview | Cedric Jeanneret proposed openstack/tripleo-heat-templates master: WIP Add new parameter in order to switch firewall engine https://review.opendev.org/c/openstack/tripleo-heat-templates/+/841445 | 15:32 |
opendevreview | Merged openstack/tripleo-ci master: Remove centos-7 job definitions and zuul layouts https://review.opendev.org/c/openstack/tripleo-ci/+/839518 | 15:39 |
*** marios is now known as marios|out | 15:44 | |
rlandy | https://zuul.openstack.org/builds?job_name=tripleo-ci-centos-9-undercloud-upgrade&skip=0 ... possible new gate blocker | 15:55 |
rlandy | FYI ,, | 15:55 |
rlandy | will log after meetings | 15:55 |
rlandy | started today | 15:57 |
rlandy | jm1: dviroel|lunch: dasm: ^^ fyi | 15:57 |
rlandy | 2022-05-11 13:29:05 | Upgraded: | 15:59 |
rlandy | 2022-05-11 13:29:05 | openstack-tripleo-heat-templates-16.0.1-0.20220511043906.6025f9c.el9.noarch | 15:59 |
rlandy | 2022-05-11 13:29:05 | openstack-tripleo-validations-15.1.1-0.20220407201847.8681c04.el9.noarch | 15:59 |
rlandy | 2022-05-11 13:29:05 | tripleo-ansible-4.2.1-0.20220511082347.ba4e990.el9.noarch | 15:59 |
dasm | mhm | 15:59 |
*** dviroel|lunch is now known as dviroel | 16:03 | |
dasm | rlandy: fyi i just created it: https://bugs.launchpad.net/tripleo/+bug/1973043 | 16:06 |
rlandy | dasm++ thanks - was in progress of doing the same - going with yours | 16:07 |
dasm | added to rr hackmd too | 16:07 |
rlandy | cloudnull: slagle: Tengu: ^^ new gate blocker | 16:08 |
rlandy | we'll need to raise that on ML - will do so after meeting | 16:08 |
cloudnull | rlandy I saw that too https://paste.opendev.org/show/bGTp9D53akASe6oW3iz7/ -- thought it may have been related to the other package issue I was seeing. | 16:09 |
cloudnull | I had to sudo rpm -e --nodeps python3-gitdb; sudo rpm -e --nodeps python3-smmap - to overcome that | 16:10 |
cloudnull | maybe something wrong with our base image/the packages already installed ? | 16:10 |
cloudnull | I had encountered that when running `dnf upgrade` | 16:11 |
cloudnull | if we're seeing this in the gate, I wonder if we're also starting from an outdated image? | 16:15 |
rlandy | cloudnull: outdated centos 9 - that is possible | 16:18 |
* rlandy will check the current one in a few | 16:18 | |
rlandy | on meeting | 16:18 |
rlandy | https://github.com/openstack/tripleo-ci/blob/master/roles/oooci-build-images/vars/centos-9.yaml#L2 | 16:20 |
rlandy | that is on overcloud image | 16:20 |
rlandy | is the concern the container build | 16:20 |
rlandy | checking base container imahe | 16:23 |
rlandy | image | 16:23 |
rlandy | cloudnull: https://quay.io/repository/centos/centos?tab=tags&tag=stream9 - that is the base image | 16:28 |
rlandy | was updated two days ago | 16:28 |
rlandy | may be need a promo to get latest image | 16:28 |
cloudnull | ++ | 16:29 |
rlandy | cloudnull: here's the issue ... we have lots of OVB deploy bugs currently | 16:29 |
rlandy | ysandeep|rover> rlandy, fyi.. reporting new bug for boot issue now: https://logserver.rdoproject.org/37/28537/41/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-tripleo-master/21b13d8/logs/baremetal_41_49511_0-console.log | 16:30 |
rlandy | cloudnull: ^^ we got that one atm | 16:30 |
cloudnull | yuk | 16:30 |
rlandy | so if we promo, you'll get that in current-tripleo | 16:30 |
cloudnull | that sounds terrible | 16:30 |
rlandy | kind of rock-and-hard-place situation | 16:31 |
cloudnull | i guess we could do a work-around step to remove those packages in the initial deploy process | 16:31 |
cloudnull | just shell and run the rpm -e command | 16:31 |
rlandy | so far it's only showing up in zuul in the upgrade jobs | 16:31 |
cloudnull | which would ensure that neither of those packages are problematic before continuing ? | 16:31 |
* rlandy will report gate blocker on ML | 16:32 | |
cloudnull | ++ makes sense, thats where I saw it, running dnf upgrade on the undercloud | 16:32 |
rlandy | cloudnull: yeah - can we try that as a stop gap | 16:32 |
rlandy | otherwise we will need to go non-voting | 16:32 |
rlandy | which is worse | 16:32 |
rlandy | just writing some comments on the bug to explain before posting out to ML | 16:33 |
rlandy | cloudnull: are you working on a workaround patch or should I try something? | 16:39 |
rlandy | send notification to ML | 16:39 |
cloudnull | i dont have a work-around review. if you can point me at where we'd make such a change (quick start somewhere?) I'd be happy to do it | 16:40 |
rlandy | getting | 16:40 |
rlandy | https://github.com/openstack/tripleo-quickstart-extras/search?q=tripleo-modify-image | 16:43 |
rlandy | so those places show where we would modify an image we pulled | 16:44 |
rlandy | in a content provider job, we should build the image with changes | 16:44 |
rlandy | so upgrade is a wallaby to master situation | 16:46 |
rlandy | and it's only showing up in upgrade | 16:47 |
rlandy | not in regular master | 16:47 |
rlandy | cloudnull: let's chat so I get this right - have a few minutes? | 16:48 |
opendevreview | Brent Eagles proposed openstack/tripleo-ansible master: Designate: use extra IP for bind/unbound colocation on the bind9 backend https://review.opendev.org/c/openstack/tripleo-ansible/+/839973 | 16:51 |
opendevreview | Brent Eagles proposed openstack/tripleo-ansible master: Designate: remove unnecessary transitional code for moving extra IP https://review.opendev.org/c/openstack/tripleo-ansible/+/840451 | 16:51 |
opendevreview | Brent Eagles proposed openstack/tripleo-ansible master: Designate: specify source address when using rndc https://review.opendev.org/c/openstack/tripleo-ansible/+/841456 | 16:51 |
dviroel | rlandy: hum, according with https://opendev.org/openstack/requirements/src/branch/master/upper-constraints.txt - python3-gitdb-4.0.9 supports smmap 5.0.0 | 16:58 |
dviroel | rlandy: deps repo has smmap 5.0.0, but not gitdb-4.0.9 (only gitdb-4.0.5) | 16:59 |
dviroel | https://trunk.rdoproject.org/centos9-master/deps/latest/SRPMS/ - looking here | 16:59 |
dviroel | python-smmap-5.0.0-1.el9s.src.rpm2022-05-11 13:1032K | 16:59 |
rlandy | cannot install both python3-smmap-5.0.0-1.el9s.noarch and python3-smmap-3.0.1-4.el9s.noarch | 17:00 |
rlandy | dviroel: ^^ two diff versions requested | 17:00 |
rlandy | dviroel: only hits us upgrades | 17:00 |
rlandy | odyssey4me: chem: ^^ fyi - on current gate blocker | 17:00 |
chem | rlandy: o/ | 17:01 |
*** jpena is now known as jpena|off | 17:01 | |
rlandy | dviroel: let me see how far out we are from promoting walaby c9 | 17:02 |
rlandy | since it's only upgrades atm | 17:02 |
chem | rlandy: I'm a bit confused, what should I look into ? | 17:03 |
rlandy | shocker fs001 and fs035 | 17:03 |
rlandy | chem: nothing atm - jst FYI - we're following this gate blocker on upgrades | 17:03 |
rlandy | https://bugs.launchpad.net/tripleo/+bug/1973043 | 17:03 |
rlandy | chem: ^^ | 17:03 |
rlandy | suspicion is we need an updated centos 9 base image | 17:04 |
chem | ok, got it. thanks for leting us know | 17:04 |
rlandy | dviroel: fs001 and fs035 are in rerun in the line now | 17:08 |
rlandy | if we get one to pass or not a terrible tempest result, maybe we promote it to get updated containers | 17:08 |
dviroel | ack | 17:10 |
rlandy | python3-smmap.noarch 3.0.1-4.el9s @delorean-wallaby-testing | 17:11 |
opendevreview | Brent Eagles proposed openstack/tripleo-heat-templates master: Designate: configure collocation IP on bind and neutron dns integration https://review.opendev.org/c/openstack/tripleo-heat-templates/+/839974 | 17:11 |
opendevreview | Brent Eagles proposed openstack/tripleo-heat-templates master: Designate: clean up bind and worker rndc configuration https://review.opendev.org/c/openstack/tripleo-heat-templates/+/841457 | 17:11 |
rlandy | dviroel: python3-smmap.noarch 3.0.1-4.el9s @delorean-wallaby-testing | 17:11 |
dviroel | delorean-wallaby doesn't have smmap 5.0.0 | 17:12 |
dviroel | only master - which was added today | 17:12 |
dviroel | python-smmap-5.0.0-1.el9s.src.rpm2022-05-11 13:10 | 17:13 |
dviroel | so maybe trying to upgrade this package, breaks gitdb-4.0.5 requirement | 17:13 |
rlandy | it claims that that repo is origin of smmap | 17:14 |
rlandy | http://mirror.regionone.vexxhost-nodepool-tripleo.rdoproject.org:8080/rdo/centos9-wallaby/deps/latest/noarch/ | 17:14 |
rlandy | python3-smmap-3.0.1-4.el9s.noarch.rpm2021-12-14 15:52 46K | 17:14 |
rlandy | that package upgrade is the issue | 17:15 |
rlandy | so we'd either need an update | 17:15 |
dviroel | that what I understood | 17:15 |
rlandy | or delete it as a workaround before upgrading | 17:15 |
dviroel | and seems that we need gitdb-4.0.9 to install smmap 5.0.0 | 17:15 |
dviroel | which we don't have in master | 17:16 |
* dviroel according with openstack upper constraints | 17:16 | |
rlandy | dviroel: we're meeting in 15 let's discuss then | 17:17 |
dviroel | we need gitdb-4.0.9 or exclude smmap 5.0.0 | 17:17 |
dviroel | master-deps is not in sync with openstack-requirements | 17:17 |
dviroel | https://opendev.org/openstack/requirements/src/branch/master/upper-constraints.txt | 17:18 |
dviroel | smmap===5.0.0 | 17:18 |
dviroel | gitdb===4.0.9 | 17:18 |
cloudnull | rlandy sorry was off eating. I do have time. now? | 17:23 |
rlandy | cloudnull: just meeting with dviroel | 17:34 |
cloudnull | Ok | 17:36 |
cloudnull | I’m around if needed | 17:36 |
rlandy | cloudnull: pls join https://meet.google.com/uwj-ucmn-pty?authuser=0 | 17:38 |
opendevreview | Merged openstack/tripleo-validations master: Change the way the task 'Validation errors' prints the output messages in order to be more readable. https://review.opendev.org/c/openstack/tripleo-validations/+/834176 | 18:01 |
hjensas | rlandy: ysandeep|rover|out: re https://bugs.launchpad.net/tripleo/+bug/1973038, I think diskimage-builder used does not have https://opendev.org/openstack/diskimage-builder/commit/147641fc3e11602cf9eaf723a2b38f60f394ac0b | 18:17 |
rlandy | hjensas: so we're missing a component promo? | 18:23 |
* rlandy checks what version we have | 18:23 | |
rlandy | diskimage-builder.noarch 3.20.4-0.20220421140835.adc40db.el9 @delorean-component-common | 18:24 |
rlandy | hjensas: you are right tripleo-ci-testing has an earlier version | 18:26 |
rlandy | checking common component | 18:26 |
rlandy | for the one logged in the triple component | 18:29 |
rlandy | in tripleo-ci-testing we have diskimage-builder-3.21.1-0.20220509052906.6645f47.el9.noarch.rpm2022-05-09 05:35 722K | 18:29 |
rlandy | which is latest | 18:29 |
rlandy | 2022-05-11 12:31:12.657311 | primary | 2022-05-11 12:31:12 | Problem: package python3-gitdb-4.0.5-2.el9s.noarch requires (python3.9dist(smmap) < 4 with python3.9dist(smmap) >= 3.0.1), but none of the providers can be installed | 18:30 |
rlandy | 2022-05-11 12:31:12.657375 | primary | 2022-05-11 12:31:12 | - cannot install both python3-smmap-5.0.0-1.el9s.noarch and python3-smmap-3.0.1-4.el9s.noarch | 18:30 |
rlandy | 2022-05-11 12:31:12.657386 | primary | 2022-05-11 12:31:12 | - cannot install the best update candidate for package python3-smmap-3.0.1-4.el9s.noarch | 18:30 |
rlandy | 2022-05-11 12:31:12.657396 | primary | 2022-05-11 12:31:12 | - cannot install the best update candidate for package python3-gitdb-4.0.5-2.el9s.noarch | 18:30 |
rlandy | ha ha - that failed the issue cloudnull and dviroel and I were discussing above | 18:30 |
rlandy | hjensas: ^^ adding a workaround for this - then will retest | 18:30 |
hjensas | rlandy: Thanks, *fingers crossed* :) | 18:32 |
opendevreview | Ronelle Landy proposed openstack/tripleo-quickstart master: Exclude python3-smmap-5.* from master deps repo https://review.opendev.org/c/openstack/tripleo-quickstart/+/841464 | 18:44 |
rlandy | dviroel: cloudnull: ^^ testprojecting this | 18:44 |
cloudnull | ++ | 18:45 |
opendevreview | Alan Bishop proposed openstack/tripleo-heat-templates stable/wallaby: Manila: Deprecate ineffctive *DriverHandlesShareServers https://review.opendev.org/c/openstack/tripleo-heat-templates/+/840582 | 18:46 |
rlandy | https://review.rdoproject.org/r/c/testproject/+/36256 | 18:48 |
opendevreview | Denys Mishchenko proposed openstack/diskimage-builder master: Adopted dkms element to work on Ubuntu Jammy and nvidia drivers https://review.opendev.org/c/openstack/diskimage-builder/+/841465 | 19:13 |
dviroel | rlandy: still failing there https://logserver.rdoproject.org/56/36256/71/check/periodic-tripleo-centos-9-buildimage-ironic-python-agent-master/33990e1/job-output.txt | 19:16 |
dviroel | not sure why | 19:16 |
opendevreview | Denys Mishchenko proposed openstack/diskimage-builder master: Adopted dkms element to work on Ubuntu Jammy and nvidia drivers https://review.opendev.org/c/openstack/diskimage-builder/+/841465 | 19:17 |
dviroel | https://logserver.rdoproject.org/56/36256/71/check/periodic-tripleo-centos-9-buildimage-ironic-python-agent-master/33990e1/yum.repos.d/delorean-master-deps.repo | 19:19 |
gouthamr | any cores that can help with a +W here: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/840441 :) | 19:28 |
rlandy | looking | 19:33 |
dviroel | rlandy: repo_setup.sh.j2 does not handle exclude for repo.type == 'file' | 19:38 |
rlandy | I am checking the file | 19:40 |
rlandy | also | 19:40 |
rlandy | it may be on the imahe | 19:40 |
rlandy | image | 19:40 |
rlandy | sec- just getting off call | 19:40 |
rlandy | dviroel: we didn't lay this down: https://logserver.rdoproject.org/56/36256/71/check/periodic-tripleo-centos-9-buildimage-ironic-python-agent-master/33990e1/yum.repos.d/delorean-master-deps.repo | 19:55 |
rlandy | ie: per repo | 19:56 |
rlandy | so we'll need to edit the file | 19:56 |
rlandy | I think | 19:56 |
opendevreview | Ronelle Landy proposed openstack/tripleo-quickstart master: Exclude python3-smmap-5.* from master deps repo https://review.opendev.org/c/openstack/tripleo-quickstart/+/841464 | 20:05 |
opendevreview | Merged openstack/tripleo-ansible stable/wallaby: Add a new task file for masquerade https://review.opendev.org/c/openstack/tripleo-ansible/+/839737 | 20:11 |
lecris[m]1 | Where can I ask for help on deploying a tripleo overcloud? | 20:18 |
cloudnull | lecris[m]1 fire away. if we can help we'll be happy to | 20:32 |
opendevreview | David Hill proposed openstack/ansible-role-redhat-subscription master: Retry polling the satellite endpoint on failure https://review.opendev.org/c/openstack/ansible-role-redhat-subscription/+/839120 | 20:39 |
opendevreview | Merged openstack/ansible-role-redhat-subscription master: Retry polling the satellite endpoint on failure https://review.opendev.org/c/openstack/ansible-role-redhat-subscription/+/839120 | 20:52 |
*** dviroel is now known as dviroel|afk | 20:53 | |
*** dasm is now known as dasm|off | 21:02 | |
lecris[m]1 | So I've tried to follow along with the documentation guide, I've got up to making the baremetal nodes available, but I'm lost on how to configure for `overcloud deploy` | 21:10 |
lecris[m]1 | For example what is the minimum network configuration I can provision, as in everything is on the same virtual network with or without bridge to external one | 21:12 |
rlandy | dviroel|afk: cloudnull: going to merge https://review.opendev.org/c/openstack/tripleo-quickstart/+/841464 ... https://review.rdoproject.org/r/c/testproject/+/36256 passed | 21:25 |
rlandy | to clear gate blocker | 21:25 |
rlandy | tripleo-ci-centos-9-content-provider-wallaby failed | 21:26 |
rlandy | checking | 21:26 |
hjensas | lecris[m]: The minimal network config would be 1 flat network, the provisioning network. This is the default. | 21:55 |
lecris[m]1 | So if I try:... (full message at https://matrix.org/_matrix/media/r0/download/matrix.org/coUMORVaBhVWWBnjOYDqlaJf) | 22:01 |
lecris[m]1 | * So if I try:... (full message at https://matrix.org/_matrix/media/r0/download/matrix.org/eosYcShjHemEurCYuLRxVJcU) | 22:01 |
lecris[m]1 | I can run it again to get the specific error | 22:02 |
rlandy | fultonj: was there a change in quay.io/ceph? | 22:03 |
rlandy | content provider jobs are failing pulling those containers | 22:03 |
rlandy | 'Trying to pull quay.io/ceph/daemon:v6.0.7-stable-6.0-pacific-centos-stream8...\nGetting image source signatures\nCopying blob sha256:d13ff5a2a605033c67752125f9839801b0808ba29738d100a6f434f721ad92a2\nCopying blob | 22:03 |
rlandy | Failed to pull following containers: ['quay.ceph.io/prometheus/prometheus:v2.7.2', 'quay.ceph.io/prometheus/alertmanager:v0.16.2', 'quay.ceph.io/prometheus/node-exporter:v0.17.0', 'quay.ceph.io/app-sre/grafana:6.7.4']"} | 22:04 |
rlandy | not resolving for me | 22:04 |
rlandy | https://quay.ceph.io/ | 22:05 |
rlandy | dasm|off: ^^ fyi | 22:07 |
rlandy | ugh - I give up | 22:08 |
rlandy | back later | 22:08 |
*** rlandy is now known as rlandy|bbl | 22:08 | |
lecris[m]1 | > <@lecris:lecris.me> So if I try:... (full message at https://matrix.org/_matrix/media/r0/download/matrix.org/neBCJghyMRystfyxqSYkSIka) | 23:15 |
lecris[m]1 | * Here's the error:... (full message at https://matrix.org/_matrix/media/r0/download/matrix.org/BLReBuVlTCcBmepAynMdkbSD) | 23:15 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!