openstackgerrit | Alan Bishop proposed openstack/puppet-tripleo stable/train: Add certmonger-etcd-refresh.sh script https://review.opendev.org/745255 | 00:15 |
---|---|---|
openstackgerrit | Alan Bishop proposed openstack/tripleo-heat-templates stable/train: Revamp how etcd's cert and key are handled in containers https://review.opendev.org/745256 | 00:16 |
*** ayoung has quit IRC | 00:26 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Pre-install python3 for CentOS https://review.opendev.org/741868 | 00:38 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Deprecate dib-python; remove from in-tree elements https://review.opendev.org/741877 | 00:38 |
*** ayoung has joined #tripleo | 00:38 | |
*** ayoung has quit IRC | 00:39 | |
*** rfolco has quit IRC | 01:02 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Remove glance-registry https://review.opendev.org/739796 | 01:43 |
openstackgerrit | Merged openstack/diskimage-builder master: Update the tox minversion parameter. https://review.opendev.org/738754 | 01:45 |
*** rlandy|bbl is now known as rlandy | 02:19 | |
openstackgerrit | Merged openstack/diskimage-builder master: Fixes DIB_IPA_CERT certificate copy issue https://review.opendev.org/741583 | 03:03 |
*** rh-jelabarre has quit IRC | 03:22 | |
*** ramishra has joined #tripleo | 03:24 | |
*** rlu has joined #tripleo | 03:31 | |
*** psachin has joined #tripleo | 03:32 | |
*** rlu has quit IRC | 03:35 | |
*** ekultails has quit IRC | 03:47 | |
*** skramaja has joined #tripleo | 03:57 | |
*** jmasud has quit IRC | 03:57 | |
*** jfrancoa has joined #tripleo | 04:04 | |
openstackgerrit | Saravanan KR proposed openstack/tripleo-heat-templates master: Reset sriov_numvfs to 0 before leapp upgrade https://review.opendev.org/745280 | 04:04 |
*** psahoo has joined #tripleo | 04:20 | |
*** ysandeep is now known as ysandeep|off | 04:24 | |
*** ratailor has joined #tripleo | 04:28 | |
*** raukadah is now known as chkumar|rover | 04:31 | |
*** evrardjp has quit IRC | 04:33 | |
*** evrardjp has joined #tripleo | 04:33 | |
*** ykarel|away has joined #tripleo | 04:43 | |
*** ykarel|away is now known as ykarel | 04:43 | |
*** ramishra has quit IRC | 04:50 | |
*** marios has joined #tripleo | 05:09 | |
*** marios is now known as marios|ruck | 05:09 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Fedora 32 support https://review.opendev.org/737217 | 05:13 |
*** marios|ruck has quit IRC | 05:15 | |
*** lmiccini has joined #tripleo | 05:16 | |
*** dmacpher has quit IRC | 05:17 | |
*** rlu has joined #tripleo | 05:19 | |
*** marios has joined #tripleo | 05:22 | |
*** Tengu has quit IRC | 05:22 | |
*** Tengu has joined #tripleo | 05:24 | |
*** udesale has joined #tripleo | 05:24 | |
*** tkajinam has quit IRC | 05:34 | |
*** tkajinam has joined #tripleo | 05:35 | |
*** psahoo has quit IRC | 05:38 | |
*** tkajinam has quit IRC | 05:50 | |
*** tkajinam has joined #tripleo | 05:51 | |
*** psahoo has joined #tripleo | 05:52 | |
*** saneax has joined #tripleo | 05:54 | |
*** psahoo has quit IRC | 05:57 | |
*** marbindrakon has quit IRC | 06:11 | |
*** shyamb has joined #tripleo | 06:14 | |
*** psahoo has joined #tripleo | 06:14 | |
openstackgerrit | Cédric Jeanneret (Tengu) proposed openstack/tripleo-heat-templates master: Modify how libvirt related containers use SELinux https://review.opendev.org/736173 | 06:23 |
Tengu | ykarel: -^ added depends-on your container-tools:2.0 patch | 06:23 |
ykarel | Tengu, ack, but 1.6.4-15 still not available in 2.0 stream | 06:24 |
Tengu | for master now, I'll update ussuri/train patches once we get the result | 06:24 |
Tengu | bleh | 06:24 |
Tengu | we'll see... | 06:24 |
Tengu | ykarel: btw - https://review.rdoproject.org/r/#/c/28888/ if you have a minute :) | 06:25 |
*** lmiccini has quit IRC | 06:29 | |
*** redrobot has quit IRC | 06:37 | |
*** lmiccini has joined #tripleo | 06:38 | |
*** ntt__ has joined #tripleo | 06:50 | |
ykarel | marios, chkumar|rover can u review https://review.opendev.org/#/q/topic:bug/1889219+(status:open+OR+status:merged) | 06:56 |
ykarel | some already reviewed but missing +W | 06:56 |
marios | ack will do ykarel | 06:58 |
*** jcapitao has joined #tripleo | 07:02 | |
*** shyam89 has joined #tripleo | 07:03 | |
*** shyam89 has joined #tripleo | 07:03 | |
*** shyamb has quit IRC | 07:06 | |
*** bhagyashris is now known as bhagyashris|off | 07:13 | |
openstackgerrit | Maciej Józefczyk proposed openstack/tripleo-ansible stable/ussuri: Set the OpenFlow protocol while upgrading OVS from 2.11 https://review.opendev.org/745295 | 07:15 |
openstackgerrit | Maciej Józefczyk proposed openstack/tripleo-ansible stable/train: Set the OpenFlow protocol while upgrading OVS from 2.11 https://review.opendev.org/745297 | 07:15 |
*** bogdando has joined #tripleo | 07:15 | |
chkumar|rover | ykarel: left few comments here https://review.opendev.org/#/c/743916/4 | 07:19 |
ykarel | chkumar|rover, okk looking | 07:25 |
ykarel | chkumar|rover, hmm got it, but can it be done as followup once we enable the ci.centos job, i wanted to avoid rebases | 07:29 |
ykarel | commented over review too | 07:31 |
*** jmasud has joined #tripleo | 07:35 | |
*** pkopec has joined #tripleo | 07:40 | |
openstackgerrit | Cédric Jeanneret (Tengu) proposed openstack/tripleo-validations master: Corrected work directory for validate-selinux https://review.opendev.org/745299 | 07:42 |
*** jpich has joined #tripleo | 07:47 | |
*** slaweq has joined #tripleo | 07:51 | |
openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: Set proper provider type for queens https://review.opendev.org/744447 | 07:51 |
*** jpena|off is now known as jpena | 07:51 | |
*** saneax has quit IRC | 07:54 | |
*** gfidente has joined #tripleo | 07:59 | |
*** tosky has joined #tripleo | 08:04 | |
*** shyam89 has quit IRC | 08:06 | |
*** dmellado has quit IRC | 08:09 | |
*** ramishra has joined #tripleo | 08:13 | |
*** dmellado has joined #tripleo | 08:14 | |
*** lucasagomes has joined #tripleo | 08:16 | |
*** sshnaidm|afk is now known as sshnaidm|off | 08:19 | |
*** saneax has joined #tripleo | 08:21 | |
*** ratailor has quit IRC | 08:21 | |
*** saneax has quit IRC | 08:27 | |
*** saneax has joined #tripleo | 08:39 | |
*** saneax has quit IRC | 08:40 | |
*** jpich has quit IRC | 08:44 | |
*** jpich has joined #tripleo | 08:45 | |
*** derekh has joined #tripleo | 08:52 | |
*** shyamb has joined #tripleo | 08:53 | |
*** pcaruana has quit IRC | 08:55 | |
*** pcaruana has joined #tripleo | 09:08 | |
*** tkajinam has quit IRC | 09:17 | |
openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Allow to override NeutronBridgeMappings for standalone deploy https://review.opendev.org/743913 | 09:24 |
*** ratailor has joined #tripleo | 09:24 | |
*** dtantsur|afk is now known as dtantsur | 09:30 | |
openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Add playbook to deploy standalone on virthost https://review.opendev.org/743916 | 09:32 |
*** ratailor_ has joined #tripleo | 09:32 | |
*** ratailor has quit IRC | 09:35 | |
*** shyam89 has joined #tripleo | 09:45 | |
openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: WIP: refactor nova db config https://review.opendev.org/718552 | 09:48 |
*** shyamb has quit IRC | 09:49 | |
openstackgerrit | Merged openstack/diskimage-builder master: Pre-install python3 for CentOS https://review.opendev.org/741868 | 09:53 |
openstackgerrit | Merged openstack/diskimage-builder master: Deprecate dib-python; remove from in-tree elements https://review.opendev.org/741877 | 09:57 |
openstackgerrit | Carlos Goncalves proposed openstack/diskimage-builder master: Add support for CentOS 8 Stream cloud image https://review.opendev.org/737245 | 10:02 |
owalsh | skramaja: hey, just noticed many of the sriov roles do not include OS::TripleoO::Services::Tuned, e.g roles/ComputeHCISriov.yaml. Is that intentional? | 10:04 |
skramaja | owalsh: i am not sure if it was intentional, but including the including is reduntant, because BootParams role itself will apply the tuned profile.. | 10:06 |
skramaja | so that cmdline args can be applied for reboot. | 10:06 |
skramaja | owalsh: https://github.com/openstack/tripleo-heat-templates/blob/master/deployment/kernel/kernel-boot-params-baremetal-ansible.yaml#L86 | 10:06 |
owalsh | skramaja: ah, ok, so if I add validation for this I should just check if either service is included, yes? | 10:10 |
owalsh | skramaja: or would it be safest to just include both in all roles? | 10:11 |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-common master: Remove check for ./puppet/services when filtering services https://review.opendev.org/745067 | 10:13 |
skramaja | owalsh: either ways it should be OK... if we want to keep uniform, then including both makes more meaningful. | 10:15 |
owalsh | skramaja: ack, thanks | 10:16 |
*** ykarel has quit IRC | 10:16 | |
*** ykarel has joined #tripleo | 10:16 | |
*** ykarel has quit IRC | 10:31 | |
*** ramishra has quit IRC | 10:31 | |
*** mcornea has joined #tripleo | 10:33 | |
*** ykarel has joined #tripleo | 10:35 | |
*** artom has quit IRC | 10:40 | |
*** shyam89 has quit IRC | 10:48 | |
*** ramishra has joined #tripleo | 10:53 | |
openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: Set proper provider type for queens https://review.opendev.org/744447 | 10:56 |
*** Tengu has quit IRC | 11:01 | |
*** Tengu has joined #tripleo | 11:03 | |
*** ykarel has quit IRC | 11:05 | |
*** ykarel has joined #tripleo | 11:05 | |
*** mcornea has quit IRC | 11:08 | |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-common master: Remove check for ./puppet/services when filtering services https://review.opendev.org/745067 | 11:09 |
*** ykarel has quit IRC | 11:10 | |
*** ykarel has joined #tripleo | 11:11 | |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ansible master: [tripleo-podman] Install specific version of buildah https://review.opendev.org/745311 | 11:17 |
*** psahoo has quit IRC | 11:31 | |
*** jpena is now known as jpena|lunch | 11:32 | |
*** cloudnull has quit IRC | 11:42 | |
*** cloudnull has joined #tripleo | 11:43 | |
*** artom has joined #tripleo | 11:43 | |
*** psahoo has joined #tripleo | 11:44 | |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/train: Remove ffwd-upgrade leftovers from THT. https://review.opendev.org/743725 | 11:45 |
*** jpich has quit IRC | 11:57 | |
*** jpich has joined #tripleo | 11:58 | |
*** rfolco has joined #tripleo | 12:00 | |
openstackgerrit | Merged openstack/tripleo-common master: Add exponential backoff to ratelimited requests https://review.opendev.org/745170 | 12:02 |
*** jcapitao is now known as jcapitao_lunch | 12:08 | |
*** rlandy has joined #tripleo | 12:16 | |
openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-heat-templates stable/train: [Train-only] Ensure arch-facilities is not present in cpu_map.xml https://review.opendev.org/745315 | 12:17 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates stable/queens: Add j2 per-role MetricsQdrNetwork https://review.opendev.org/745316 | 12:22 |
*** ykarel has quit IRC | 12:26 | |
*** rh-jelabarre has joined #tripleo | 12:30 | |
*** rcernin has quit IRC | 12:32 | |
*** jpena|lunch is now known as jpena | 12:36 | |
*** ratailor_ has quit IRC | 12:43 | |
*** udesale_ has joined #tripleo | 12:44 | |
*** udesale has quit IRC | 12:47 | |
rlandy | cloudnull: fyi ... https://bugzilla.redhat.com/show_bug.cgi?id=1867132 | 12:52 |
openstack | bugzilla.redhat.com bug 1867132 in distribution "Buildah package upgrade from 1.14.9 ->1.15.x for rhos-16.2-rhel-8-trunk-build" [Unspecified,New] - Assigned to lhh | 12:52 |
*** ekultails has joined #tripleo | 12:55 | |
openstackgerrit | Merged openstack/tripleo-validations stable/ussuri: Fix ceph-ansible permissions when checking the repo name https://review.opendev.org/739619 | 12:56 |
*** psahoo has quit IRC | 12:56 | |
openstackgerrit | yatin proposed openstack/tripleo-quickstart master: Switch Standalone environment to centos8 https://review.opendev.org/743919 | 12:56 |
openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-upgrade master: Evacuate computes before RHEL upgrade https://review.opendev.org/743951 | 13:01 |
openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-upgrade master: Refactor FFWD run to run on 1/3rd of controlplane https://review.opendev.org/743952 | 13:01 |
openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-upgrade master: FFWD upgrade converge cleanup https://review.opendev.org/744884 | 13:01 |
openstackgerrit | Lewis Denny proposed openstack/tripleo-heat-templates master: Remove remaining Skydive references https://review.opendev.org/745320 | 13:03 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-common stable/ussuri: Add exponential backoff to ratelimited requests https://review.opendev.org/745322 | 13:10 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-common stable/train: Add exponential backoff to ratelimited requests https://review.opendev.org/745323 | 13:10 |
*** dmacpher has joined #tripleo | 13:11 | |
*** psahoo has joined #tripleo | 13:12 | |
*** rh-jelabarre has quit IRC | 13:14 | |
*** jcapitao_lunch is now known as jcapitao | 13:16 | |
cloudnull | rlandy nice! | 13:18 |
cloudnull | -cc mwhahaha | 13:18 |
cloudnull | thank you rlandy | 13:18 |
mwhahaha | fun | 13:19 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: update centos-ci to centos8 https://review.opendev.org/745327 | 13:23 |
openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-upgrade master: Refactor FFWD run to run on 1/3rd of controlplane https://review.opendev.org/743952 | 13:28 |
openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-upgrade master: FFWD upgrade converge cleanup https://review.opendev.org/744884 | 13:28 |
*** chkumar|rover is now known as raukadah | 13:32 | |
dciabrin | cloudnull, mwhahaha hey guys I noticed that latest container images in master don't use kolla UID for service users like rabbitmq. I don't think that's expected? http://paste.openstack.org/show/796652/ | 13:52 |
openstackgerrit | Rafael Folco proposed openstack/tripleo-ci master: Enable py3 on dib release 7 https://review.opendev.org/733659 | 13:53 |
cloudnull | dciabrin yes, we've dropped kolla. | 13:54 |
cloudnull | on a new install it should be using the uid from the packages | 13:54 |
dciabrin | oh so that's expected.. | 13:54 |
cloudnull | indeed. are you seeing an issue with it ? | 13:55 |
cloudnull | other than the different uid/gid ? | 13:55 |
mwhahaha | wait we stopped the kolla uid/gid stuff? | 13:56 |
dciabrin | I have a rabbitmq container that doesn't restart after an upgrade ussuri->master, because the old config files are not regenerated and the initial perm are not reset with kolla_init_start when we start that container | 13:56 |
mwhahaha | that'll cause permission problems | 13:56 |
dciabrin | mwhahaha, right on :) | 13:56 |
cloudnull | were you able to reset the perms with kolla_init_start? maybe something that needs to be toggled in an upgrade task? | 13:58 |
dciabrin | cloudnull, i can do that yes. | 13:59 |
dciabrin | that fixes the issue for that specific container | 13:59 |
*** psahoo has quit IRC | 13:59 | |
openstackgerrit | yatin proposed openstack/tripleo-quickstart master: Switch Standalone environment to centos8 https://review.opendev.org/743919 | 14:00 |
cloudnull | ++ maybe a pattern we'll have to replicate w/ other services | 14:00 |
openstackgerrit | Merged openstack/tripleo-ansible stable/train: Set the OpenFlow protocol while upgrading OVS from 2.11 https://review.opendev.org/745297 | 14:01 |
*** ykarel has joined #tripleo | 14:02 | |
beagles | I sense a sidecar problem coming ... | 14:18 |
beagles | /var/lib/neutron will have the kolla neutron uid/gid | 14:18 |
mwhahaha | it's likely also a problem for customers who may already have these uid/gids | 14:18 |
mwhahaha | we need to put that back in | 14:18 |
mwhahaha | i thought we kept that | 14:19 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/ussuri: Update octavia playbooks parameters https://review.opendev.org/744183 | 14:29 |
openstackgerrit | Merged openstack/tripleo-upgrade stable/ussuri: Add BootParams service to all roles https://review.opendev.org/745060 | 14:29 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: openstack collections and operators are both in quickstart-extras-requirements https://review.opendev.org/745346 | 14:29 |
*** jpich has quit IRC | 14:29 | |
*** jpich has joined #tripleo | 14:29 | |
openstackgerrit | amolkahat proposed openstack/openstack-tempest-skiplist master: Adding ironic chassis_node_list test to skiplist. https://review.opendev.org/744882 | 14:33 |
ykarel | marios, i had replied to both https://review.opendev.org/#/q/branch:master+topic:bug/1889219+status:open, can u revisit | 14:33 |
marios | ykarel: ack will do | 14:36 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-ansible master: Create a role for network config https://review.opendev.org/744260 | 14:38 |
dciabrin | marios, ykarel if you have some time for https://review.opendev.org/#/c/725782/ as well. | 14:40 |
marios | dciabrin: adding to queue | 14:43 |
ykarel | dciabrin, ack | 14:45 |
*** ysandeep|off is now known as ysandeep | 14:51 | |
ykarel | Tengu, so container-tools:2.0 with podman-1.6.4-15 should be released today in some hours | 14:52 |
ykarel | and container-tools:rhel8 with podman-1.9.3 on Monday | 14:52 |
ykarel | so we need to switch to container-tools:2.0 to be prepared in case 1.9.3 is not good for CI | 14:53 |
ykarel | will revise my patch | 14:53 |
weshay|ruck | mwhahaha, we're doing something right :) master gate today has 70 jobs ran, 0 failures and ussuri is at 98% pass | 14:56 |
mwhahaha | cloudnull: https://review.opendev.org/#/c/744709/ | 14:56 |
mwhahaha | weshay|ruck: i think we're good on the 429 front for now | 14:57 |
weshay|ruck | +1 | 14:57 |
*** psachin has quit IRC | 14:58 | |
Tengu | ykarel: \o/ | 14:58 |
* cloudnull looking | 14:59 | |
cloudnull | +2 | 15:00 |
cloudnull | we'll need someone else to approve | 15:00 |
rlandy | cloudnull: mwhahaha: I still get the "error extracting layer" problem with buildah 1.15.0-1.module+el8.3.0+7084+c16098dd | 15:00 |
rlandy | what version did you try? | 15:00 |
mwhahaha | i wasn't able to reproduce my problem with layers with 1.15 but i didn't try a build | 15:01 |
mwhahaha | rlandy: can we re-run it with --debug on the buildah command so we can open an issue? | 15:01 |
cloudnull | oh, maybe different but similar issues? | 15:01 |
cloudnull | that would be fun | 15:02 |
openstackgerrit | yatin proposed openstack/tripleo-quickstart master: Use container-tools:2.0 instead of default rhel8 stream https://review.opendev.org/745173 | 15:03 |
rlandy | mwhahaha: cloudnull: well on the next run, we are switching to rhel 8.3 entirely so I want to see what works/fails there | 15:03 |
*** Guest7899 has joined #tripleo | 15:03 | |
rlandy | we just installed the builfah rpm from there | 15:03 |
mwhahaha | it'll probably fail, we should prepare running --debug | 15:03 |
mwhahaha | not certain if we support that in tripleoclient for that stuff | 15:03 |
rlandy | but ... https://sf.hosted.upshift.rdu2.redhat.com/logs/02/207802/30/check/tripleo-build-containers-ubi-8-internal-rhel-8-rhos-16.2/a6206ed/logs/build.log | 15:03 |
ykarel | weshay|ruck please check https://review.opendev.org/745173 | 15:04 |
weshay|ruck | k | 15:04 |
rlandy | mwhahaha: "not certain if we support that in tripleoclient for that stuff" what stuff is that? | 15:05 |
rlandy | 8.3 or mixed installs? | 15:05 |
mwhahaha | looks like it's tripleo-common | 15:05 |
mwhahaha | rlandy: the thing that invokes buildah | 15:05 |
mwhahaha | like i don't think we honor --debug all the way down | 15:05 |
rlandy | it is | 15:06 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: fix openstack collections in tq https://review.opendev.org/745346 | 15:06 |
mwhahaha | rlandy: no we need to have the buildah command run with --debug | 15:06 |
*** Guest7899 is now known as redrobot | 15:06 | |
*** pcaruana has quit IRC | 15:07 | |
mwhahaha | rlandy: tripleoclient calls code in tripleo-common that execs buildah, but we don't provide a --debug to it | 15:07 |
* mwhahaha patches | 15:07 | |
rlandy | I see | 15:07 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-common master: Add --debug for buildah builder https://review.opendev.org/745356 | 15:12 |
*** ramishra has quit IRC | 15:12 | |
*** yolanda has quit IRC | 15:12 | |
openstackgerrit | Saravanan KR proposed openstack/tripleo-heat-templates master: Reset sriov_numvfs to 0 before leapp upgrade https://review.opendev.org/745280 | 15:12 |
skramaja | jfrancoa: ^ | 15:13 |
*** yolanda has joined #tripleo | 15:13 | |
jfrancoa | skramaja: great! I'll add myself as reviewer and check it already next week, week is comming to an end | 15:13 |
jfrancoa | skramaja: have a nice weekend | 15:13 |
skramaja | u too. thanks. | 15:14 |
openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient master: Honor --debug for buildah builder https://review.opendev.org/745357 | 15:14 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-ansible master: Add role tripleo_stream_enable. https://review.opendev.org/745177 | 15:19 |
*** pcaruana has joined #tripleo | 15:19 | |
openstackgerrit | Oliver Walsh proposed openstack/tripleo-common master: Ensure tripleo ansible inventory file update is atomic https://review.opendev.org/745358 | 15:20 |
mwhahaha | rlandy: is it consistent the failure in that it always happens (but might be different containers)? | 15:21 |
mwhahaha | and do we not see this upstream? | 15:21 |
openstackgerrit | Merged openstack/tripleo-upgrade stable/train: Add BootParams service to all roles https://review.opendev.org/745061 | 15:22 |
openstackgerrit | Merged openstack/tripleo-upgrade master: Keep ceph-ansible 3 during whole FFU. https://review.opendev.org/744441 | 15:22 |
*** lmiccini has quit IRC | 15:28 | |
rlandy | mwhahaha: I have only seen the "error extracting layer" problem when testing containers for 16.2 | 15:29 |
mwhahaha | rlandy: do we have a centos-stream job anywhere? | 15:29 |
mwhahaha | 1.15 is in 8-stream but not 8 | 15:30 |
rlandy | mwhahaha: we don't but I can build one | 15:31 |
mwhahaha | yea we should have one, even it's just a standalone w/ container builds | 15:31 |
mwhahaha | it should hit this | 15:31 |
mwhahaha | meh getting freaking perl conflicts trying to switch to stream | 15:32 |
*** ykarel is now known as ykarel|away | 15:34 | |
rlandy | putting up a POC job | 15:35 |
*** jpich is now known as Chulp | 15:36 | |
*** Chulp is now known as jpich | 15:36 | |
openstackgerrit | Merged openstack/tripleo-common stable/ussuri: Revert "Add kolla template override to remove python3-networking-mlnx" https://review.opendev.org/734162 | 15:37 |
*** rlu_ has joined #tripleo | 15:42 | |
openstackgerrit | Merged openstack/tripleo-ansible stable/ussuri: Fix podman version https://review.opendev.org/745119 | 15:44 |
*** skramaja has quit IRC | 15:45 | |
*** rlu has quit IRC | 15:45 | |
*** rlu_ has quit IRC | 15:46 | |
*** marios is now known as marios|out | 15:59 | |
rlandy | mwhahaha: so, yes, stream gives us perl conflicts - but here are the testproject jobs ... https://review.rdoproject.org/r/#/c/21683/53/.zuul.yaml | 16:00 |
mwhahaha | yea i get that too | 16:00 |
*** lucasagomes has quit IRC | 16:01 | |
*** marios|out has quit IRC | 16:04 | |
*** dtantsur is now known as dtantsur|afk | 16:04 | |
*** ntt__ has quit IRC | 16:05 | |
ykarel|away | rlandy, for stream u could also check rdo-centos-stream node label, we running some packstack/puppet periodic jobs with stream | 16:07 |
ykarel|away | https://review.rdoproject.org/zuul/builds?job_name=periodic-victoria-packstack-scenario001-centos-stream | 16:07 |
ykarel|away | https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/weirdo-jobs.yaml#L695-L698 | 16:09 |
openstackgerrit | Merged openstack/python-tripleoclient stable/ussuri: Simplify error handling in tripleo_deploy https://review.opendev.org/744422 | 16:09 |
mwhahaha | rlandy: i'm trying the 8stream image to see if that fixes the perl conflict. going from 8 -> 8-stream ends up in conflicts for me | 16:10 |
*** jpena is now known as jpena|off | 16:10 | |
mwhahaha | and of course they prevent the buildah update which is weird | 16:11 |
*** dtantsur|afk has quit IRC | 16:11 | |
rlandy | those hobs are doing fine | 16:11 |
rlandy | jobs | 16:11 |
*** marbindrakon has joined #tripleo | 16:12 | |
*** alexmcleod has quit IRC | 16:13 | |
mwhahaha | eh still getting the perl error but i can install buildah now | 16:15 |
*** bogdando has quit IRC | 16:15 | |
mwhahaha | should we be setting container-tools:2.0 for stable branches rather than letting it add container-tools:rhel8? | 16:15 |
*** marbindrakon2 has joined #tripleo | 16:18 | |
mwhahaha | ugh stream gets python3.8 | 16:19 |
openstackgerrit | Merged openstack/tripleo-validations stable/train: Fix neutron_sanity_check for ML2/OVS overcloud https://review.opendev.org/744857 | 16:19 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: [Queens only] Clean yum metadata. https://review.opendev.org/736699 | 16:19 |
*** marbindrakon has quit IRC | 16:19 | |
*** ysandeep is now known as ysandeep|off | 16:19 | |
weshay|ruck | we mergin boy WE MERGIN | 16:21 |
*** jpich has quit IRC | 16:22 | |
rlandy | 16.1 is using container-tools:2.0 | 16:29 |
mwhahaha | right but we dont' specify module stuff | 16:29 |
mwhahaha | so we're getting container-tools:rhel8 | 16:29 |
rlandy | 16.2 is pulling container-tools:rhel8 | 16:30 |
rlandy | so the same | 16:30 |
rlandy | and using rel 8.3 gives us build errors | 16:31 |
rlandy | oh joy | 16:31 |
mwhahaha | container-tools:rhel8 on 8 is still 1.11.6 | 16:31 |
mwhahaha | on stream i finally got 1.15 so i'm going to try and build in a min | 16:32 |
mwhahaha | oh fun i get podman 2.0.0 too | 16:32 |
mwhahaha | Error: Failed to download metadata for repo 'Stream-AppStream': Cannot prepare internal mirrorlist: No URLs in mirrorlist | 16:38 |
mwhahaha | meh | 16:38 |
*** rlu has joined #tripleo | 16:41 | |
*** udesale_ has quit IRC | 16:41 | |
mwhahaha | cloudnull: is the yum repo mount dir configurable in the new build system? | 16:43 |
cloudnull | I think so? I think its just using the straight volume arg | 16:44 |
mwhahaha | ah yes via --volume | 16:44 |
* cloudnull goes to check | 16:44 | |
cloudnull | ++ | 16:44 |
cloudnull | I think the default points at /etc/yum/repos,d/ ... | 16:45 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: fix openstack collections in tq https://review.opendev.org/745346 | 16:45 |
cloudnull | ++ https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v2/tripleo_container_image.py#L188-L190 | 16:45 |
cloudnull | that's the default but it should be totally configurable | 16:45 |
mwhahaha | yea i got it | 16:47 |
mwhahaha | the stream repos appear not to be working correctly for some reason | 16:47 |
cloudnull | weird - centos8 stream ? | 16:47 |
mwhahaha | yea | 16:48 |
mwhahaha | the mirror list was failing | 16:48 |
* cloudnull never tried that as a build host, but probably makes sense we di | 16:48 | |
cloudnull | **do | 16:48 |
mwhahaha | now i'm getting failure trying to find python3/socat | 16:48 |
* mwhahaha flips tables | 16:48 | |
* cloudnull walks away slowly | 16:48 | |
mwhahaha | i will say a single cmd command is much nicer than the kolla config and all that other stuff we had to do previously :D | 16:49 |
weshay|ruck | every time a table flips an angel gets it's wings | 16:50 |
cloudnull | ROLF | 16:53 |
mwhahaha | building finally | 16:53 |
mwhahaha | had to remove the CentOS-Stream* repos | 16:53 |
cloudnull | I wonder if we should document what repos we require (generally) | 16:53 |
cloudnull | atm we just point at a repo dir and hope | 16:54 |
mwhahaha | i mean it's the base centos + tripleo-repos bits | 16:54 |
mwhahaha | the issue here is that the stream mirrorurl was erroring for some reason and i don't care enough to troubleshoot :D | 16:54 |
cloudnull | yeah i guess the expectation is the tripleo-repos was run and all is right with the world | 16:55 |
weshay|ruck | ya.. there's been enough network fun this week | 16:55 |
weshay|ruck | mwhahaha, rdo can carry the f.. package for some time for us.. or do yum modules f.. that up | 16:55 |
* cloudnull fair enough, goes back to hating YAQL | 16:55 | |
rlandy | weshay|ruck: well worked up another dependency job for stream | 16:55 |
mwhahaha | i was missing the centos8 appstream in my dir | 16:55 |
weshay|ruck | rlandy++ we'll need it | 16:55 |
mwhahaha | so it was my fault | 16:55 |
*** derekh has quit IRC | 17:01 | |
*** gfidente is now known as gfidente|afk | 17:04 | |
openstackgerrit | Merged openstack/tripleo-validations stable/ussuri: Fix neutron_sanity_check for ML2/OVS overcloud https://review.opendev.org/744856 | 17:11 |
weshay|ruck | the zuul gate is empty for tripleo :))) | 17:29 |
*** ayoung has joined #tripleo | 17:33 | |
*** ade_lee_ has quit IRC | 17:37 | |
*** ade_lee has joined #tripleo | 17:37 | |
*** ade_lee has quit IRC | 17:39 | |
*** ade_lee has joined #tripleo | 17:42 | |
lbragstad | o/ is anyone available for a quick tht review? https://review.opendev.org/#/c/744526/ it'll help us get CI passing for TLS-e environments | 18:15 |
*** ykarel|away has quit IRC | 18:19 | |
*** rlu_ has joined #tripleo | 18:24 | |
*** rlu has quit IRC | 18:27 | |
*** rlu_ has quit IRC | 18:31 | |
openstackgerrit | wes hayutin proposed openstack/ansible-role-collect-logs master: add build_id directly to the logs https://review.opendev.org/745385 | 18:31 |
openstackgerrit | Rajini Karthik proposed openstack/puppet-tripleo master: Deprecating VxFlex OS Volume Config https://review.opendev.org/745386 | 18:33 |
mwhahaha | cloudnull: so i reproduced it locally but it was trying to write out novajoin-base and novajoin-notifier at the same time. They shouldn't have been processing at the same time | 18:38 |
mwhahaha | erm maybe i'm misreading the output | 18:40 |
*** ykarel has joined #tripleo | 18:42 | |
openstackgerrit | Rajini Karthik proposed openstack/tripleo-heat-templates master: Deprecating VxFlex OS Cinder Config https://review.opendev.org/745390 | 18:45 |
ykarel | weshay|ruck, looks like train centos8 had false promotion, can u check | 18:53 |
ykarel | container images missing | 18:53 |
weshay|ruck | ykarel, where are you noticing containers are missing? | 18:54 |
ykarel | weshay|ruck, gate jobs | 18:54 |
ykarel | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_ab1/745173/2/check/tripleo-ci-centos-8-containers-multinode-train/ab18778/logs/undercloud/home/zuul/undercloud_install.log | 18:54 |
ykarel | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_b96/744861/2/check/tripleo-ci-centos-8-containers-multinode/b961de6/logs/undercloud/home/zuul/undercloud_install.log | 18:54 |
ykarel | atleast this is outdated https://hub.docker.com/r/tripleotraincentos8/centos-binary-neutron-server/tags | 18:54 |
weshay|ruck | ykarel, thanks.. | 18:59 |
*** ykarel is now known as ykarel|away | 19:00 | |
*** slaweq has quit IRC | 19:03 | |
cloudnull | mwhahaha were you able to repro the issue? | 19:06 |
mwhahaha | cloudnull: yea but i didn't see anything that stuck out | 19:06 |
cloudnull | even w/ 1.15? | 19:06 |
*** slaweq has joined #tripleo | 19:06 | |
mwhahaha | yea | 19:06 |
cloudnull | :'( | 19:06 |
mwhahaha | i'm rerunning to see if i can get more details | 19:06 |
mwhahaha | i think --debug with --logfile on buildah doesn't always put all the debug messages in the log file | 19:09 |
cloudnull | i reread your last sentance a couple times, i should post a pic of the face ive made trying to understand that | 19:11 |
cloudnull | like sometimes it just decides to omit messages? | 19:12 |
mwhahaha | some of --debug goes to stderr | 19:12 |
mwhahaha | but doesn't end up in the logfile | 19:12 |
cloudnull | weird | 19:13 |
mwhahaha | the error that gets spit out wasn't in the log file | 19:14 |
mwhahaha | so now i'm rerunning with tripleoclient --debug and buildah --debug | 19:14 |
openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: WIP: refactor nova db config https://review.opendev.org/718552 | 19:16 |
mwhahaha | next would be --log-level=trace | 19:18 |
mwhahaha | i love the fact that the error code is 125 which maps to -> ExecErrorCodeGeneric | 19:24 |
*** ykarel|away has quit IRC | 19:38 | |
*** gfidente|afk has quit IRC | 19:38 | |
*** pkopec has quit IRC | 19:41 | |
*** slaweq has quit IRC | 19:50 | |
*** slaweq has joined #tripleo | 19:58 | |
ade_lee | cloudnull, https://review.opendev.org/#/c/728561/ please | 19:59 |
*** slaweq has quit IRC | 20:15 | |
openstackgerrit | Merged openstack/tripleo-ansible stable/ussuri: Scan existing controllers on update to pick up existing certs/private keys https://review.opendev.org/744184 | 20:15 |
mwhahaha | rlandy, cloudnull: https://github.com/containers/buildah/issues/2521 | 20:17 |
mwhahaha | i filed a bug | 20:17 |
rlandy | mwhahaha: thanks | 20:24 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-ansible master: Add role tripleo_stream_enable. https://review.opendev.org/745177 | 20:27 |
openstackgerrit | Merged openstack/tripleo-docs master: Add missing FreeIPA install steps https://review.opendev.org/728561 | 20:28 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-ansible master: Add role tripleo_stream_enable. https://review.opendev.org/745177 | 20:30 |
cloudnull | mwhahaha ++ rlandy I guess we’ll need to lock down to 1.11 for the time being ? | 20:35 |
mwhahaha | seems like it | 20:35 |
cloudnull | at least we’re not dead in the water | 20:35 |
mwhahaha | the build process is something outside of the regular deployment/day2 stuff | 20:35 |
mwhahaha | so we should be able to just lock it for our builds | 20:35 |
cloudnull | agreed | 20:36 |
mwhahaha | the build+standalone job might be weird | 20:36 |
cloudnull | Meh. More of an edge case for the time being. | 20:37 |
cloudnull | I wonder if we can mitigate the issue by slowing our build process down? | 20:37 |
cloudnull | like adding an random sleep between builds ? | 20:38 |
rlandy | chandan put up this patch ... https://review.opendev.org/#/c/745311/ | 20:38 |
*** ekultails has quit IRC | 20:38 | |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Invoke tripleo-stream-enable for Upgrades and Updates. https://review.opendev.org/745213 | 20:38 |
cloudnull | when rlandy and I were testing we made some of the failed builds go manually. Which was done by hand and serially. | 20:38 |
cloudnull | so maybe it’s just an fs sync issue ? | 20:39 |
mwhahaha | i think it's something internally to the build | 20:39 |
cloudnull | more gifts from overlayfs? | 20:39 |
mwhahaha | because it's not failing on a shared layer | 20:39 |
cloudnull | fair | 20:39 |
*** jfrancoa has quit IRC | 20:39 | |
mwhahaha | at least i think it' snot | 20:39 |
mwhahaha | it was failign on the USER ceilometer line for me | 20:40 |
mwhahaha | like it's not even a good layer :D | 20:40 |
cloudnull | Hahaha | 20:40 |
mwhahaha | it also failed on a run mkdir layer | 20:42 |
mwhahaha | so it's not consistent on what it's failing on either | 20:42 |
cloudnull | Yeah we were seeing the same, inconsistent, behavior. | 20:45 |
cloudnull | Ok peoples. I’ve had enough cloud for the day. Have a great weekend all. | 20:46 |
mwhahaha | adios | 20:46 |
*** rfolco has quit IRC | 20:57 | |
*** maciejjozefczyk has quit IRC | 21:10 | |
*** rlandy has quit IRC | 21:18 | |
*** raildo has quit IRC | 21:21 | |
*** rcernin has joined #tripleo | 21:48 | |
openstackgerrit | Ade Lee proposed openstack/tripleo-docs master: Add TLS-E to the standalone deploy guide https://review.opendev.org/728581 | 21:53 |
openstackgerrit | wes hayutin proposed openstack/ansible-role-collect-logs master: add build_id directly to the logs https://review.opendev.org/745385 | 22:06 |
*** cfontain has joined #tripleo | 22:11 | |
*** rcernin has quit IRC | 22:26 | |
*** rcernin has joined #tripleo | 22:32 | |
*** stevebaker has quit IRC | 22:34 | |
*** ayoung has quit IRC | 22:44 | |
*** ayoung has joined #tripleo | 22:44 | |
*** tosky has quit IRC | 22:58 | |
*** artom has quit IRC | 23:00 | |
*** rcernin has quit IRC | 23:38 | |
*** rlu has joined #tripleo | 23:40 | |
*** rlu has quit IRC | 23:44 | |
openstackgerrit | Merged openstack/tripleo-common master: Ensure tripleo ansible inventory file update is atomic https://review.opendev.org/745358 | 23:49 |
*** ayoung has quit IRC | 23:52 | |
*** ayoung has joined #tripleo | 23:53 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!