opendevreview | Takashi Kajinami proposed openstack/puppet-tripleo stable/wallaby: Replace deprecated is_string/is_array/is_hash method https://review.opendev.org/c/openstack/puppet-tripleo/+/804169 | 00:04 |
---|---|---|
opendevreview | Merged openstack/tripleo-ansible master: Convert all OS module imports to collections imports https://review.opendev.org/c/openstack/tripleo-ansible/+/803121 | 00:11 |
opendevreview | Merged openstack/python-tripleoclient master: Remove name parameter from cell export https://review.opendev.org/c/openstack/python-tripleoclient/+/803193 | 00:11 |
*** pmannidi is now known as pmannidi|AFK | 01:21 | |
opendevreview | Merged openstack/tripleo-heat-templates stable/victoria: nova-compute: Adding failed_when to nova-compute stop task https://review.opendev.org/c/openstack/tripleo-heat-templates/+/802871 | 01:38 |
opendevreview | Merged openstack/tripleo-heat-templates stable/ussuri: nova-compute: Adding failed_when to nova-compute stop task https://review.opendev.org/c/openstack/tripleo-heat-templates/+/802872 | 01:38 |
opendevreview | Merged openstack/tripleo-heat-templates stable/train: nova-compute: Adding failed_when to nova-compute stop task https://review.opendev.org/c/openstack/tripleo-heat-templates/+/802873 | 01:38 |
*** pmannidi|AFK is now known as pmannidi | 04:01 | |
*** pmannidi is now known as pmannidi|brb | 04:27 | |
*** ykarel|away is now known as ykarel | 04:57 | |
*** pmannidi|brb is now known as pmannidi | 05:07 | |
opendevreview | Martin Schuppert proposed openstack/python-tripleoclient stable/wallaby: Remove name parameter from cell export https://review.opendev.org/c/openstack/python-tripleoclient/+/804330 | 05:27 |
opendevreview | Noam Angel proposed openstack/python-tripleoclient master: fix openstack overcloud node configure removes kernel and ramdisk https://review.opendev.org/c/openstack/python-tripleoclient/+/804331 | 06:19 |
opendevreview | Noam Angel proposed openstack/python-tripleoclient master: fix openstack overcloud node configure removes kernel and ramdisk https://review.opendev.org/c/openstack/python-tripleoclient/+/804331 | 06:21 |
*** rpittau|afk is now known as rpittau | 06:22 | |
opendevreview | Rabi Mishra proposed openstack/tripleo-ansible master: Don't pass None to neutron for ipv6_address_mode/ipv6_ra_mode https://review.opendev.org/c/openstack/tripleo-ansible/+/804353 | 06:27 |
noam | ho | 06:43 |
noam | hi | 06:43 |
noam | can someone help me fix https://bugs.launchpad.net/tripleo/+bug/1939624 | 06:44 |
noam | i have pushed a commit https://review.opendev.org/c/openstack/python-tripleoclient/+/804331 | 06:44 |
noam | but it seems that i need to add change for the testing aswell | 06:44 |
noam | https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/tests/workflows/test_baremetal.py#L42 | 06:45 |
noam | can someone advise | 06:45 |
opendevreview | Noam Angel proposed openstack/python-tripleoclient master: fix openstack overcloud node configure removes kernel and ramdisk https://review.opendev.org/c/openstack/python-tripleoclient/+/804331 | 06:50 |
*** dpawlik6 is now known as dpawlik | 07:07 | |
opendevreview | mbu proposed openstack/validations-libs master: Add validation config file mechanism https://review.opendev.org/c/openstack/validations-libs/+/792460 | 07:19 |
*** holser is now known as holser_ | 07:32 | |
*** jpena|off is now known as jpena | 07:33 | |
opendevreview | mbu proposed openstack/validations-libs master: Add validation config file mechanism https://review.opendev.org/c/openstack/validations-libs/+/792460 | 07:50 |
*** ykarel is now known as ykarel|lunch | 08:27 | |
opendevreview | Luca Miccini proposed openstack/puppet-pacemaker master: Fix up cluster_setup_extras usage https://review.opendev.org/c/openstack/puppet-pacemaker/+/804363 | 08:39 |
opendevreview | Luca Miccini proposed openstack/puppet-pacemaker master: Fix up cluster_setup_extras usage https://review.opendev.org/c/openstack/puppet-pacemaker/+/804363 | 08:40 |
opendevreview | Merged openstack/puppet-tripleo stable/victoria: Allow tuning of Galera gcache size https://review.opendev.org/c/openstack/puppet-tripleo/+/804153 | 08:51 |
opendevreview | Takashi Kajinami proposed openstack/tripleo-heat-templates stable/wallaby: Compute HA: Remove workaround for Newton and older https://review.opendev.org/c/openstack/tripleo-heat-templates/+/804335 | 08:52 |
*** sshnaidm|afk is now known as sshnaidm | 08:55 | |
opendevreview | Sorin Sbârnea proposed openstack/tripleo-repos master: Fix tripleo.repos.get_hash module https://review.opendev.org/c/openstack/tripleo-repos/+/804221 | 08:57 |
opendevreview | Michele Baldessari proposed openstack/tripleo-heat-templates master: DNM WIP Test a puppet-pcmk change https://review.opendev.org/c/openstack/tripleo-heat-templates/+/804366 | 08:59 |
sshnaidm | noam, test passed, just recheck | 08:59 |
sshnaidm | noam, maybe stevebaker can help with review | 08:59 |
opendevreview | Michele Baldessari proposed openstack/puppet-tripleo stable/ussuri: Allow tuning of Galera gcache size https://review.opendev.org/c/openstack/puppet-tripleo/+/804154 | 09:00 |
opendevreview | Takashi Kajinami proposed openstack/tripleo-heat-templates master: Remove unnecessary version discovery of keystone API https://review.opendev.org/c/openstack/tripleo-heat-templates/+/804368 | 09:04 |
opendevreview | Takashi Kajinami proposed openstack/tripleo-heat-templates master: Compute HA: Remove version discovery of keystone API https://review.opendev.org/c/openstack/tripleo-heat-templates/+/804368 | 09:07 |
ramishra | Looks like tripleo-ci-centos-8-content-provider is failing consistently. Looks like mistral container build is failing. I did not find anything specific in the logs. FWIW https://bugs.launchpad.net/tripleo/+bug/1939674 | 09:32 |
sshnaidm | why do we build mistral | 09:39 |
sshnaidm | ykarel|lunch, jpena there is an error from ^^ : file /etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-release from install of containers-common-1:1.4.0-5.module_el8.5.0+878+851f435b.x86_64 conflicts with file from package redhat-release-8.4-0.6.el8.x86_6 | 09:41 |
jpena | that looks like a mistake in the containers-common package. I can't see why it should include that gpg key | 09:42 |
* jpena checks | 09:42 | |
sshnaidm | yeah, that's weird.. | 09:42 |
jpena | sshnaidm: do you have a list of repos for that install? | 09:46 |
jpena | in https://composes.stream.centos.org/production/latest-CentOS-Stream/compose/AppStream/x86_64/os/Packages/ I can only see containers-common 1.3.1-1 | 09:46 |
*** ykarel|lunch is now known as ykarel | 09:46 | |
sshnaidm | jpena, http://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_102/804331/3/check/tripleo-ci-centos-8-content-provider/102c8a9/logs/undercloud/home/zuul/workspace/logs/container-builds/d98a7d66-eb57-42b9-b48f-7c9ce123d6c2/base/os/mistral-base/mistral-base-build.log | 09:47 |
sshnaidm | containers-common x86_64 1:1.4.0-5.module_el8.5.0+878+851f435b quickstart-centos-appstreams 99 k | 09:48 |
sshnaidm | appstreams | 09:48 |
jpena | ah, silly me. That 8-stream, not 9-stream | 09:48 |
jpena | I was looking at the wrong repo | 09:48 |
sshnaidm | 2 stream distros at once, it will be fun in CI soon.. | 09:49 |
chandankumar | jpena: sshnaidm I am also seeing the same in master promoter line in container build job | 09:49 |
jpena | are you using an ubi8 base image for the build? | 09:51 |
chandankumar | jpena: yes https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-build-containers-ubi-8-push/6fae76a/logs/container-builds/b3808f9e-cff5-41cd-b767-17f6cf6ae14c/base/base-build.log | 09:51 |
chandankumar | ubi8:8.2 | 09:51 |
jpena | a-ha | 09:52 |
jpena | ok, I can confirm that containers-common-1.4.0 contains the redhat-release gpg key (which I think is a bug), but 1.3.1 doesn't | 09:53 |
opendevreview | Merged openstack/openstack-tempest-skiplist master: Update logic on allowed list https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/792575 | 09:53 |
opendevreview | Sorin Sbârnea proposed openstack/tripleo-repos master: Fix tripleo.repos.get_hash module https://review.opendev.org/c/openstack/tripleo-repos/+/804221 | 09:57 |
ykarel | jpena, yes correct https://git.centos.org/rpms/skopeo/c/6511ce724a043ebb934ab63a1d054090000157f0?branch=c8s-stream-rhel8 | 09:58 |
ykarel | but why using rhel8 stream in these jobs? | 09:59 |
ykarel | should be 3.0 | 09:59 |
opendevreview | Sorin Sbârnea proposed openstack/tripleo-repos master: Fix tripleo.repos.get_hash module https://review.opendev.org/c/openstack/tripleo-repos/+/804221 | 09:59 |
jpena | I fail to understand the rationale behind adding the gpg key in centos | 10:00 |
jpena | really weird | 10:00 |
sshnaidm | jpena, probably just mistake | 10:07 |
jpena | apparently it was done on purpose o_O: https://koji.mbox.centos.org/koji/buildinfo?buildID=18726 (see changelog entry for 1:1.4.0-1) | 10:08 |
sshnaidm | '..on non-RHEL and | 10:09 |
sshnaidm | CentOS distros. | 10:09 |
opendevreview | Takashi Kajinami proposed openstack/tripleo-heat-templates master: Nova: Add support for initial_*_allocation_ratio https://review.opendev.org/c/openstack/tripleo-heat-templates/+/803293 | 10:11 |
fultonj | marios: i put my own -w on https://review.opendev.org/c/openstack/tripleo-heat-templates/+/803861 | 10:14 |
fultonj | would you mind removing yours so that gfidente and i can merge it later today if you're out? | 10:14 |
fultonj | I promise not to merge this until 803859 and 803860 merge. | 10:14 |
fultonj | REPLY | 10:14 |
marios | fultonj: ack | 10:15 |
fultonj | thx | 10:15 |
marios | fultonj: :) going to do now | 10:15 |
ykarel | sshnaidm, jpena so seems either need to switch to c8stream base image or get rid of redhat-release rpm | 10:37 |
jpena | yes, agreed | 10:37 |
ykarel | we hit issue in past also when centos stream obsoleted redhat-release | 10:37 |
ykarel | and that resulted into https://github.com/openstack/tripleo-common/commit/568e40838d8076a997a9a140aa0d1e3bb83a216c workaround | 10:37 |
opendevreview | Shnaidman Sagi (Sergey) proposed openstack/tripleo-common master: Remove rehdat-release package from UBI8 image https://review.opendev.org/c/openstack/tripleo-common/+/804379 | 10:54 |
sshnaidm | ykarel, jpena let's try ^ | 10:55 |
sshnaidm | and hope it won't break everything | 10:55 |
ykarel | sshnaidm, no that will not work | 10:55 |
ykarel | as release packages are protected | 10:55 |
ykarel | by dnf | 10:55 |
ykarel | so need to download centos release package, install with rpm and remove redhat-release with rpm commands | 10:56 |
opendevreview | Shnaidman Sagi (Sergey) proposed openstack/tripleo-common master: Remove rehdat-release package from UBI8 image https://review.opendev.org/c/openstack/tripleo-common/+/804379 | 10:57 |
jpena | I still wonder if it's worth to do all sorts of workarounds just to keep using the ubi8 image + centos stream repos | 10:57 |
sshnaidm | ykarel, and so ^ ? | 10:57 |
sshnaidm | idk, probably need to discuss it | 10:58 |
sshnaidm | weshay|ruck, ^^ | 10:58 |
ykarel | in past reason was stated that to use same image for both downstream and upstream, don't know if that's still valid | 10:59 |
ykarel | sshnaidm, that also not work in my tests | 10:59 |
ykarel | sshnaidm, rm -f /etc/dnf/protected.d/redhat-release.conf && rpm -e --nodeps redhat-release works, but with centos-stream release rpms os specific info wipes | 11:01 |
ykarel | so would be better to install those if removing redhat-release | 11:02 |
sshnaidm | Removing dependent packages: setup shadow-utils | 11:02 |
sshnaidm | looks scary | 11:02 |
ykarel | sshnaidm, i meant something like dnf download centos*release && rpm -ivh --nodeps --replacefiles *.rpm && rm -rf *.rpm && rpm -e --nodeps redhat-release | 11:05 |
ykarel | but should be done only when tcib_distro is centos | 11:05 |
sshnaidm | ykarel, can you please update my patch with it? | 11:05 |
ykarel | ok sure | 11:05 |
sshnaidm | thanks | 11:06 |
sshnaidm | at least a workaround to keep ci running will we decide | 11:06 |
sshnaidm | s/will/till | 11:06 |
*** jcapitao is now known as jcapitao_lunch | 11:10 | |
opendevreview | yatin proposed openstack/tripleo-common master: Remove rehdat-release package from UBI8 image https://review.opendev.org/c/openstack/tripleo-common/+/804379 | 11:17 |
ykarel | sshnaidm, updated | 11:19 |
ykarel | not removing earlier workaround, that can be done as follow up if this get's accepted | 11:20 |
*** dviroel|ruck|out is now known as dviroel|ruck | 11:24 | |
bandini | ykarel: since you always know all the issues ;) is https://66a156d10835e9046ef1-fa02bede2ecdc79d66ce6b922331a4c1.ssl.cf1.rackcdn.com/804363/2/check/tripleo-ci-centos-8-scenario004-standalone/1a3121a/logs/undercloud/home/zuul/container_image_build.log exception while building containers a known one? | 11:27 |
ykarel | bandini, yes see above | 11:27 |
ykarel | just above | 11:27 |
ykarel | https://bugs.launchpad.net/tripleo/+bug/1939674 | 11:28 |
chandankumar | ykarel: we also need to but to backport it for wallaby | 11:28 |
ykarel | chandankumar, yes should be impact all c8-stream releases | 11:28 |
bandini | ykarel++ ah perfect, thanks | 11:29 |
*** jpena is now known as jpena|lunch | 11:33 | |
ykarel | jpena|lunch, seems due to https://git.centos.org/rpms/skopeo/blob/6511ce724a043ebb934ab63a1d054090000157f0/f/SOURCES/default-policy.json#_13 it's being shipped in centos | 11:35 |
*** beagles is now known as eagles | 11:35 | |
ykarel | for redhat container registry | 11:35 |
*** rlandy is now known as rlandy|rover | 11:41 | |
*** jcapitao_lunch is now known as jcapitao | 11:56 | |
noam | hi | 12:03 |
noam | i have the flowing task fail https://github.com/openstack/tripleo-ansible/blob/master/tripleo_ansible/roles/tripleo_network_config/tasks/os_net_config.yml#L47 | 12:03 |
noam | but i cannot see whats going there as no_log is set | 12:03 |
sshnaidm | noam, failing where? | 12:09 |
sshnaidm | you can set no_log to false | 12:10 |
weshay|ruck | sshnaidm++ | 12:14 |
weshay|ruck | https://review.opendev.org/c/openstack/tripleo-common/+/804379 | 12:14 |
noam | openstack overcloud node provision --stack overcloud --network-config --output ../templates/overcloud-baremetal-deployed.yaml ../templates/baremetal_deployment.yaml --overcloud-ssh-key ~/.ssh/id_rsa --overcloud-ssh-user stack | 12:20 |
noam | FATAL | Render network_config from template | controller-0 | error={"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} | 12:20 |
noam | all nodes fail | 12:21 |
noam | how can i set no_log false? | 12:21 |
*** jpena|lunch is now known as jpena | 12:24 | |
jpena | ykarel: ohhh, that makes sense | 12:24 |
*** jpena is now known as jpena|off | 12:33 | |
noam | is there a way to set "tripleo_network_config_hide_sensitive_logs" before running the command ? | 12:34 |
sshnaidm | noam, just for debug probably to hack: sed -i "s/tripleo_network_config_hide_sensitive_logs.*/tripleo_network_config_hide_sensitive_logs: false/" /usr/share/ansible/roles/tripleo_network_config/defaults/main.yml | 12:36 |
noam | ok cool | 12:42 |
noam | actually debug not give me much | 12:42 |
noam | "msg": "AnsibleUndefinedVariable: 'role_networks_lower' is undefined" | 12:42 |
noam | i dont know to what it reffer | 12:42 |
noam | https://paste.openstack.org/show/808030/ | 12:43 |
noam | this is my network template | 12:44 |
noam | i probably missing some step | 12:44 |
opendevreview | Sorin Sbârnea proposed openstack/tripleo-quickstart master: Install tripleo.repos collection https://review.opendev.org/c/openstack/tripleo-quickstart/+/801776 | 12:47 |
opendevreview | Sorin Sbârnea proposed openstack/tripleo-quickstart master: wire up tripleo_get_hash ansible module in repo-setup role https://review.opendev.org/c/openstack/tripleo-quickstart/+/791486 | 12:48 |
opendevreview | Sorin Sbârnea proposed openstack/tripleo-quickstart master: Use tripleo.repos.get_hash in repo-setup role https://review.opendev.org/c/openstack/tripleo-quickstart/+/791486 | 12:50 |
opendevreview | mbu proposed openstack/validations-libs master: Add validation config file mechanism https://review.opendev.org/c/openstack/validations-libs/+/792460 | 12:55 |
cloudnull | mornings | 13:07 |
opendevreview | Sorin Sbârnea proposed openstack/tripleo-quickstart master: Install tripleo.repos collection https://review.opendev.org/c/openstack/tripleo-quickstart/+/801776 | 13:16 |
*** ysandeep|PTO is now known as ysandeep | 13:26 | |
opendevreview | Marios Andreou proposed openstack/tripleo-repos master: Add connection and status code check for tripleo get hash https://review.opendev.org/c/openstack/tripleo-repos/+/804385 | 13:40 |
opendevreview | mbu proposed openstack/validations-libs master: Add validation config file mechanism https://review.opendev.org/c/openstack/validations-libs/+/792460 | 13:41 |
opendevreview | mbu proposed openstack/validations-libs master: Add validation config file mechanism https://review.opendev.org/c/openstack/validations-libs/+/792460 | 13:52 |
tkajinam | seems like content provider job is broken now ? https://zuul.opendev.org/t/openstack/build/c3f6978f29d8416a91d31812477886aa/log/job-output.txt#4865-4886 | 13:54 |
weshay|ruck | tkajinam, see the latest bugs in tripleo | 13:55 |
tkajinam | ok. I should have scrolled up to find past conversation | 13:55 |
weshay|ruck | tkajinam, filter tags for promotion-blocker | 13:55 |
weshay|ruck | and you'll be in the know :) | 13:55 |
weshay|ruck | or visit internal cix board | 13:56 |
opendevreview | Noam Angel proposed openstack/tripleo-heat-templates master: fix ComputeDVR role https://review.opendev.org/c/openstack/tripleo-heat-templates/+/804341 | 13:56 |
tkajinam | ahh https://bugs.launchpad.net/tripleo/+bug/1939674 | 13:56 |
tkajinam | weshay|ruck, thanks ! I was not aware of usage of that tag | 13:57 |
sshnaidm | ykarel, probably we'll need firstly to fix wallaby, because tripleo-ci-centos-8-content-provider-wallaby fails on your patch | 13:57 |
sshnaidm | it runs for upgrades | 13:58 |
ykarel | :( | 13:58 |
opendevreview | Shnaidman Sagi (Sergey) proposed openstack/tripleo-common stable/wallaby: Remove rehdat-release package from UBI8 image https://review.opendev.org/c/openstack/tripleo-common/+/804342 | 13:58 |
sshnaidm | ykarel, ^ | 13:58 |
ykarel | sshnaidm, but how to get both along | 13:58 |
sshnaidm | ykarel, firstly to merge wallaby | 13:58 |
sshnaidm | only then to run master | 13:59 |
sshnaidm | idk if there is other way.. | 13:59 |
ykarel | sshnaidm, releases before wallaby should also be impacted | 13:59 |
sshnaidm | well, then to make upgrades non voting.. | 13:59 |
opendevreview | amolkahat proposed openstack/tripleo-quickstart-extras master: Migrate overcloud-deploy.sh shell script to ansible roles part-1 https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/803627 | 14:00 |
sshnaidm | ykarel, we can not block this containers-common, right? | 14:00 |
sshnaidm | ykarel, or dnf update --exclude container-common maybe? | 14:00 |
sshnaidm | like we did with redhat-release | 14:01 |
sshnaidm | well, still need other releases | 14:01 |
ykarel | sshnaidm, actually container common is being installed, not updated | 14:01 |
sshnaidm | I see it only in mistral container (why do we need it?) | 14:01 |
sshnaidm | but maybe it just doesn't reach other steps | 14:01 |
sshnaidm | who does need this containers-common | 14:02 |
ykarel | no idea for why it's needed | 14:02 |
ykarel | also noticed containers-common is pulled from rhel8 stream | 14:03 |
ykarel | 3.0 stream should have been used | 14:03 |
opendevreview | chandan kumar proposed openstack/puppet-tripleo master: Revert "Set memcached server list from memcached_node_names" https://review.opendev.org/c/openstack/puppet-tripleo/+/804343 | 14:03 |
opendevreview | chandan kumar proposed openstack/puppet-tripleo stable/wallaby: Revert "Set memcached server list from memcached_node_names" https://review.opendev.org/c/openstack/puppet-tripleo/+/804344 | 14:03 |
ykarel | pinning to 3.0 stream should clear the blocker and then redhat-release patch can be picked | 14:04 |
ykarel | mmm but there too wallaby provider will fail | 14:04 |
opendevreview | Shnaidman Sagi (Sergey) proposed openstack/tripleo-common master: Remove rehdat-release package from UBI8 image https://review.opendev.org/c/openstack/tripleo-common/+/804379 | 14:06 |
sshnaidm | ykarel, ^ | 14:06 |
ykarel | sshnaidm, don't see any difference in update | 14:08 |
ykarel | apart from commit message | 14:08 |
sshnaidm | oops :) | 14:08 |
opendevreview | Shnaidman Sagi (Sergey) proposed openstack/tripleo-common master: Remove rehdat-release package from UBI8 image https://review.opendev.org/c/openstack/tripleo-common/+/804379 | 14:08 |
tkajinam | it turned out some notifications from lp was sent to spam folder and that's why I was not aware of that issue with content provider jobs ... | 14:09 |
*** holser is now known as holser_ | 14:11 | |
sshnaidm | well, it's not easy to put a fix for a bug in all branches | 14:12 |
ykarel | sshnaidm, btw is mistral still needed? | 14:14 |
sshnaidm | ykarel, I don't think so tbh | 14:14 |
ykarel | btw that containers-common comming via tripleo-common | 14:14 |
ykarel | atleast tripleo-common should be a dep now for mistral | 14:14 |
sshnaidm | cloudnull, mwhahaha do you know if we need mistral container for something? | 14:14 |
ykarel | i think all workbooks etc removed from there | 14:14 |
sshnaidm | ykarel, yeah, but I'm afraid it can be not only for mistral, worth to check' | 14:15 |
mwhahaha | no we dont' need it | 14:15 |
mwhahaha | since V? | 14:15 |
cloudnull | ^ | 14:15 |
mwhahaha | do we still have the mistral service files in THT? | 14:15 |
ykarel | mwhahaha, in deprecated in tht | 14:16 |
mwhahaha | you'd need to remove both at the same time | 14:16 |
mwhahaha | when did we deprecate? | 14:16 |
cloudnull | U it was deprecated ? | 14:17 |
cloudnull | removed in V | 14:17 |
cloudnull | i think | 14:17 |
mwhahaha | then they all likely can be removed in X | 14:17 |
ykarel | sshnaidm, yeap it's also in nova-scheduler | 14:17 |
ykarel | don't know why it there | 14:17 |
mwhahaha | because they do podman stuff | 14:18 |
sshnaidm | odd | 14:18 |
mwhahaha | in container | 14:18 |
mwhahaha | is not pretty | 14:18 |
sshnaidm | nova-scheduler runs podman?? | 14:18 |
mwhahaha | though have we filed a bug against containers-common or the ubi image? | 14:18 |
opendevreview | Victoria Martinez de la Cruz proposed openstack/tripleo-ansible master: Set cephfs-nfs container PidsLimit to unlimited https://review.opendev.org/c/openstack/tripleo-ansible/+/804390 | 14:18 |
mwhahaha | a libvirt wrapper thing | 14:19 |
sshnaidm | ykarel, maybe to switch to 3.0 module inside the container? | 14:20 |
mwhahaha | well i think we need rhel8 for W | 14:20 |
mwhahaha | because we don't know what is going to be shipped with 9 | 14:20 |
mwhahaha | so we kinda need to run the bleeding edge | 14:20 |
mwhahaha | this feels like it's a containers-common bz | 14:20 |
ykarel | sshnaidm, seems https://review.opendev.org/c/openstack/tripleo-common/+/747007 caused it | 14:20 |
mwhahaha | that landed a year ago | 14:21 |
ykarel | moving module enabled/disable to base image likely don't persist | 14:21 |
mwhahaha | it should but we dont' set those for upstream since T? | 14:21 |
ykarel | ahhk wasn't aware if was downstream only | 14:22 |
mwhahaha | we set it in stable branches | 14:22 |
mwhahaha | e.g. train should be 3.0 now because the future | 14:22 |
mwhahaha | but master should be rhel8 | 14:23 |
mwhahaha | we could pin 3.0 <master but we'll likely need to bump when we figure out what we get for c9 | 14:23 |
mwhahaha | either way, did we file a bz against containers-common? | 14:26 |
mwhahaha | it likely shouldn't be includeding that gpg key | 14:26 |
opendevreview | amolkahat proposed openstack/tripleo-quickstart-extras master: Migrate overcloud-deploy.sh shell script to ansible roles part-2 https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/804113 | 14:27 |
*** pmannidi is now known as pmannidi|AFK | 14:27 | |
opendevreview | amolkahat proposed openstack/tripleo-quickstart-extras master: Migrate overcloud-deploy.sh shell script to ansible roles part-3 https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/804117 | 14:28 |
ykarel | mwhahaha, i see train too failing so doesn't look that too pinned to 3.0 | 14:29 |
ykarel | https://logserver.rdoproject.org/openstack-periodic-integration-stable4/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-build-containers-ubi-8-push-train/6c98b7c/logs/container-builds/33de0403-829b-43ac-84a2-bcf71ffd3816/base/os/mistral-base/mistral-base-build.log | 14:29 |
ykarel | mwhahaha, no not created bug for containers-common | 14:29 |
mwhahaha | we should | 14:29 |
mwhahaha | i think they are providing it for container image signing | 14:29 |
ykarel | seems they added gpg for redhat registry | 14:29 |
ykarel | https://git.centos.org/rpms/skopeo/blob/6511ce724a043ebb934ab63a1d054090000157f0/f/SOURCES/default-policy.json#_13 | 14:29 |
mwhahaha | but it's a problem | 14:29 |
mwhahaha | yea that's for contianer image signing stuff | 14:30 |
mwhahaha | dat c8stream highlighting future problems | 14:30 |
mwhahaha | though i wonder how this was tested at all downstream | 14:30 |
ykarel | no idea | 14:31 |
opendevreview | mbu proposed openstack/validations-libs master: Expand validations_logs table with reason of failure https://review.opendev.org/c/openstack/validations-libs/+/804392 | 14:31 |
opendevreview | mbu proposed openstack/validations-libs master: Add validation config file mechanism https://review.opendev.org/c/openstack/validations-libs/+/792460 | 14:32 |
opendevreview | John Fulton proposed openstack/tripleo-heat-templates stable/victoria: Configure Ceph to not use separte db/wal LVs https://review.opendev.org/c/openstack/tripleo-heat-templates/+/803859 | 14:32 |
ramishra | noam: 'role_networks_lower' was dropped with https://review.opendev.org/c/openstack/tripleo-heat-templates/+/763379 use 'networks_lower' in your network config | 14:34 |
ramishra | noam: ex. https://github.com/openstack/tripleo-ansible/blob/master/tripleo_ansible/roles/tripleo_network_config/templates/multiple_nics_vlans/multiple_nics_vlans.j2#L16 | 14:34 |
mwhahaha | ykarel: i'll file the bz against containers-common | 14:35 |
ykarel | mwhahaha, okk | 14:35 |
mwhahaha | if i can figure out the component | 14:36 |
ykarel | mwhahaha, skopeo | 14:37 |
ykarel | containers-common is subpackage of ^ | 14:37 |
mwhahaha | no there's a new containers-common package | 14:37 |
mwhahaha | i guess they are splitting it out | 14:37 |
mwhahaha | it's brand new (as of yesterday) | 14:37 |
ykarel | ahhk | 14:38 |
mwhahaha | i can file against skopeo to start i guess | 14:38 |
rlandy|rover | ykarel: thanks for looking into the tempest slowdown ob fs035 | 14:39 |
ykarel | u welcome | 14:41 |
mwhahaha | https://bugzilla.redhat.com/show_bug.cgi?id=1993209 | 14:42 |
*** jpena|off is now known as jpena | 14:43 | |
ykarel | mwhahaha, shoudlnt version be centos stream? | 14:43 |
* mwhahaha shrugs | 14:44 | |
mwhahaha | i'll let them adjust it | 14:44 |
mwhahaha | or i can i guess | 14:44 |
mwhahaha | i mean it is an 8.5.0 issue | 14:44 |
ykarel | also the issue will be reproducable only with mixing ubi and c8 repos | 14:44 |
mwhahaha | ok i switched | 14:45 |
ykarel | in past i read someone that's not recommended | 14:45 |
mwhahaha | shouldn't matter, it's a problem | 14:45 |
mwhahaha | does centos not ship that file? | 14:45 |
opendevreview | mbu proposed openstack/validations-libs master: Add validation config file mechanism https://review.opendev.org/c/openstack/validations-libs/+/792460 | 14:46 |
mwhahaha | pinning to 3.0 everywhere should avoid it right? | 14:46 |
opendevreview | Arx Cruz proposed openstack/openstack-tempest-skiplist master: Add featureset001 group into tempest-allow https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/804396 | 14:49 |
opendevreview | Arx Cruz proposed openstack/tripleo-quickstart master: Run featureset001 job with tempest-allow https://review.opendev.org/c/openstack/tripleo-quickstart/+/804399 | 14:53 |
weshay|ruck | ya.. in the past we talked about swithing from ubi-8 to the centos stream ubi equiv.. because this shit is NOT universal | 14:55 |
weshay|ruck | I found there equiv at one point.. but looking through notes | 14:55 |
weshay|ruck | now | 14:55 |
weshay|ruck | think it was just this.. docker pull quay.io/centos/centos:stream8 | 15:02 |
weshay|ruck | docker pull quay.io/centos/centos:stream8 | 15:03 |
weshay|ruck | oops | 15:03 |
weshay|ruck | CentOS Stream Room, Feb 4, 4:38 AM | 15:03 |
weshay|ruck | Stephen: So there is a line in the CentOS wiki about UBI:8 to CentOS-Stream-8 https://wiki.centos.org/FAQ/CentOSStream | 15:03 |
weshay|ruck | Note: CentOS Stream does not include container images. The current recommendation is to use Red Hat Universal Base Image (UBI) and include centos-release-stream (link coming!). | 15:03 |
weshay|ruck | So some people have tried to do this in centos-devel and have found that it is 'broken' due to the protected nature of redhat-release. The issue seems to be impacting whether Kolla and some other openstack items will have a CentOS in it when it goes gold in April. [Not sure what can be done about that.] | 15:03 |
mwhahaha | we can change it to use centos:stream8 upstream, its configurable right? but it's still an issue given that both rpms provide the same file | 15:04 |
rlandy|rover | yes --base setting | 15:06 |
opendevreview | Slawek Kaplonski proposed openstack/tripleo-heat-templates master: Added support for Neutron loggings service plugin configuration https://review.opendev.org/c/openstack/tripleo-heat-templates/+/804223 | 15:09 |
*** mschuppert is now known as mschuppert|pto | 15:21 | |
sshnaidm | rlandy|rover, weshay|ruck updated the workaround: https://review.opendev.org/c/openstack/tripleo-common/+/804379 | 15:26 |
sshnaidm | had to disable upgrades | 15:27 |
rlandy|rover | sshnaidm: thanks - saw that | 15:28 |
rlandy|rover | we can re-enable after all the merges | 15:28 |
*** rpittau is now known as rpittau|afk | 15:31 | |
*** jpena is now known as jpena|off | 15:34 | |
weshay|ruck | jpodivin, fyi.. reminder to set the milestone https://bugs.launchpad.net/tripleo/+bug/1938266 | 15:53 |
weshay|ruck | jpodivin, is that bug still an issue? | 15:53 |
noam | finally getting to overcloud deployment first time with heat ephemeral | 15:56 |
noam | getting errors | 15:56 |
noam | :S | 15:56 |
noam | https://paste.openstack.org/show/808042/ | 15:56 |
noam | 2021-08-12 18:52:50.407 36359 ERROR tripleoclient.v1.overcloud_deploy.DeployOvercloud [-] Exception occured while running the command: subprocess.CalledProcessError: Command '['sudo', 'podman', 'play', 'kube', '/home/stack/overcloud-deploy/overcloud/heat-launcher/heat-pod.yaml']' returned non-zero exit status 125. | 15:57 |
opendevreview | Marios Andreou proposed openstack/puppet-tripleo stable/victoria: Bump metadata for new victoria branch release https://review.opendev.org/c/openstack/puppet-tripleo/+/804411 | 15:58 |
slagle | noam: the pod must already exist, but is not running. you can pass --rm-heat to have it cleaned up first, or rm it manually | 16:00 |
slagle | the error message ought to tell you to do that :) | 16:00 |
slagle | i'll add it | 16:00 |
marios | weshay|ruck: mwhahaha: please when you have time https://review.opendev.org/c/openstack/puppet-tripleo/+/804411 | 16:01 |
noam | it spouse to be exist if doing several deployments? | 16:02 |
noam | it not getting better | 16:07 |
noam | https://paste.openstack.org/show/808043/ | 16:07 |
*** marios is now known as marios|out | 16:08 | |
noam | ERRO[0001] Error adding network: unable to setup DNAT: running [/sbin/iptables -t nat -C CNI-DN-63f8cc48596bf11757a22 -p --dport 8006 -s 10.255.255.7 -j CNI-HOSTPORT-SETMARK --wait]: exit status 2: iptables v1.8.4 (nf_tables): unknown protocol "" specified | 16:08 |
*** ykarel is now known as ykarel|away | 16:31 | |
rlandy|rover | sshnaidm: https://review.opendev.org/c/openstack/tripleo-common/+/804342 | 16:47 |
opendevreview | Merged openstack/puppet-tripleo stable/victoria: Bump metadata for new victoria branch release https://review.opendev.org/c/openstack/puppet-tripleo/+/804411 | 16:47 |
rlandy|rover | we also need victoria, ussuri backports? | 16:47 |
noam | can anybody helps out seem like ephemeral-heat pod crash at the start of the deployment | 16:54 |
noam | ERRO[0000] Error adding network: unable to setup DNAT: running [/sbin/iptables -t nat -C CNI-DN-0ac84ed9a0b11f3c1d915 -p --dport 8006 -s 10.255.255.13 -j CNI-HOSTPORT-SETMARK --wait]: exit status 2: iptables v1.8.4 (nf_tables): unknown protocol "" specified | 16:54 |
mwhahaha | feels like a podman problem | 17:05 |
mwhahaha | did you specify container-tools:3.0 before installing? | 17:05 |
slagle | i think that is a container-tools:3.0 thing iirc | 17:07 |
mwhahaha | meaning you need to specify 3.0 or it's broken in 3.0? | 17:07 |
slagle | you need to install 3.0 | 17:08 |
mwhahaha | ah. we should make sure theres a podman bug somewhere | 17:08 |
noam | im using 3.0 | 17:12 |
opendevreview | Michele Baldessari proposed openstack/tripleo-heat-templates master: Support both frr 7.x and frr-8.0 concurrently https://review.opendev.org/c/openstack/tripleo-heat-templates/+/804110 | 17:15 |
weshay|ruck | mwhahaha, is cherry-picked from still required in the commit message? | 17:17 |
weshay|ruck | doesn't seem to add it automatically for you anymore | 17:18 |
weshay|ruck | unless I'm coocoo | 17:18 |
weshay|ruck | mwhahaha, nvrmind | 17:24 |
opendevreview | wes hayutin proposed openstack/tripleo-common stable/wallaby: Remove redhat-release package from UBI8 image https://review.opendev.org/c/openstack/tripleo-common/+/804342 | 17:25 |
opendevreview | wes hayutin proposed openstack/tripleo-common stable/victoria: Remove redhat-release package from UBI8 image https://review.opendev.org/c/openstack/tripleo-common/+/804421 | 17:36 |
opendevreview | wes hayutin proposed openstack/tripleo-common stable/ussuri: Remove redhat-release package from UBI8 image https://review.opendev.org/c/openstack/tripleo-common/+/804422 | 17:40 |
*** holser_ is now known as holser | 17:44 | |
opendevreview | wes hayutin proposed openstack/tripleo-common stable/train: Remove redhat-release package from UBI8 image https://review.opendev.org/c/openstack/tripleo-common/+/804423 | 17:44 |
mwhahaha | weshay|ruck: it only adds it once it's landed | 17:47 |
weshay|ruck | ah k.. worked fine w/ cli | 17:48 |
weshay|ruck | so.. just did that | 17:48 |
mwhahaha | yea git cherry-pick -x always adds it | 17:48 |
fultonj | I think gerrit's cherry-pick "button" used to -x it but no longer does AFAICT | 17:51 |
mwhahaha | it does if it's already landed unless that's changed in the last week | 17:52 |
fultonj | oh i see | 17:52 |
*** sshnaidm is now known as sshnaidm|afk | 17:55 | |
opendevreview | Shnaidman Sagi (Sergey) proposed openstack/tripleo-common stable/ussuri: Remove redhat-release package from UBI8 image https://review.opendev.org/c/openstack/tripleo-common/+/804422 | 17:57 |
fultonj | "This change depends on a change with an invalid configuration." | 17:58 |
opendevreview | Shnaidman Sagi (Sergey) proposed openstack/tripleo-common stable/ussuri: Remove redhat-release package from UBI8 image https://review.opendev.org/c/openstack/tripleo-common/+/804422 | 17:58 |
fultonj | https://review.opendev.org/c/openstack/tripleo-heat-templates/+/803859 | 17:58 |
fultonj | i added a depends-on https://review.opendev.org/c/openstack/tripleo-common/+/804421 | 17:58 |
fultonj | weshay|ruck: ^ i've ever seen gerrit say that. have you? | 17:58 |
mwhahaha | https://review.opendev.org/c/openstack/tripleo-common/+/804423/1/zuul.d/layout.yaml | 17:59 |
mwhahaha | probably that one? | 17:59 |
mwhahaha | don't know what ensure_global_symlinks: true but it's likely not supposed to be that in there | 17:59 |
fultonj | thanks for the tip mwhahaha | 18:01 |
fultonj | weshay|ruck: i made a note of that in the review, though I don't know the fix | 18:02 |
*** holser is now known as holser_ | 18:04 | |
opendevreview | Alex Schultz proposed openstack/tripleo-operator-ansible master: Add default stack to some roles https://review.opendev.org/c/openstack/tripleo-operator-ansible/+/804427 | 18:07 |
opendevreview | wes hayutin proposed openstack/tripleo-common stable/train: Remove redhat-release package from UBI8 image https://review.opendev.org/c/openstack/tripleo-common/+/804423 | 18:11 |
rlandy|rover | fultonj: ^^ fixed | 18:13 |
rlandy|rover | working from wes's terminal | 18:13 |
fultonj | thanks rlandy|rover | 18:13 |
opendevreview | Merged openstack/tripleo-common master: Remove rehdat-release package from UBI8 image https://review.opendev.org/c/openstack/tripleo-common/+/804379 | 19:41 |
weshay|ruck | MASTER should be unblocked | 19:47 |
opendevreview | Ronelle Landy proposed openstack/tripleo-common master: Replace upgrades template when providers run again https://review.opendev.org/c/openstack/tripleo-common/+/804461 | 21:11 |
*** dviroel|ruck is now known as dviroel|ruck|out | 21:51 | |
*** pmannidi|AFK is now known as pmannidi | 23:18 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!