*** dmacpher has joined #tripleo | 00:14 | |
*** dmacpher__ has quit IRC | 00:15 | |
*** dmacpher_ has joined #tripleo | 00:18 | |
*** ekultails has quit IRC | 00:18 | |
openstackgerrit | Takashi Kajinami proposed openstack/puppet-tripleo master: Include vendordata in nova-api and nova-metadata-api https://review.opendev.org/729074 | 00:19 |
---|---|---|
openstackgerrit | Takashi Kajinami proposed openstack/puppet-tripleo master: Include vendordata in nova-api and nova-metadata-api https://review.opendev.org/729074 | 00:19 |
*** dmacpher has quit IRC | 00:20 | |
*** jmasud has joined #tripleo | 00:21 | |
*** matbu has quit IRC | 00:21 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ci master: WIP - non-voting job for tripleo-build-containers-ubi-8 https://review.opendev.org/724193 | 00:22 |
openstackgerrit | Toure Dunnon proposed openstack/python-tripleoclient master: Add backup functionality to Openstack client for undercloud and overcloud. https://review.opendev.org/721333 | 00:23 |
*** slaweq has quit IRC | 00:26 | |
*** jmasud has quit IRC | 00:38 | |
*** EmilienM|off is now known as EmilienM | 00:46 | |
*** evrardjp has quit IRC | 00:52 | |
tonyb | stevebaker: Are you around for a tripleo+heat question | 00:52 |
*** jmasud has joined #tripleo | 00:54 | |
*** ramishra has joined #tripleo | 01:10 | |
*** gfidente|off has quit IRC | 01:10 | |
openstackgerrit | Lance Bragstad proposed openstack/tripleo-docs master: Introduce new TLS-e guide https://review.opendev.org/725607 | 01:19 |
openstackgerrit | Lance Bragstad proposed openstack/tripleo-docs master: Add documentation about cleaning up stacks with TLS-e https://review.opendev.org/726155 | 01:19 |
openstackgerrit | Lance Bragstad proposed openstack/tripleo-docs master: Add a separate guide for public TLS https://review.opendev.org/728972 | 01:19 |
openstackgerrit | Lance Bragstad proposed openstack/tripleo-docs master: Refactor TLS introduction https://review.opendev.org/729076 | 01:19 |
*** gfidente has joined #tripleo | 01:32 | |
*** gfidente has quit IRC | 01:39 | |
*** jmasud has quit IRC | 01:42 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Ensure that the playbooks and roles can display debug data when enabled https://review.opendev.org/715006 | 01:44 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ci master: WIP - non-voting job for tripleo-build-containers-ubi-8 https://review.opendev.org/724193 | 01:46 |
*** gfidente has joined #tripleo | 01:47 | |
*** yolanda has joined #tripleo | 01:52 | |
*** yolanda has quit IRC | 01:52 | |
*** yolanda has joined #tripleo | 01:53 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: [DNM] ussuri current tripleo fun https://review.opendev.org/728424 | 01:59 |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-heat-templates stable/train: Add cacert to clouds.yaml https://review.opendev.org/729090 | 02:34 |
*** d34dh0r53 has quit IRC | 02:59 | |
*** d34dh0r53 has joined #tripleo | 03:00 | |
*** jmasud has joined #tripleo | 03:08 | |
openstackgerrit | Merged openstack/tripleo-quickstart master: update ussuri container namespace to 'u' https://review.opendev.org/728196 | 03:10 |
openstackgerrit | Merged openstack/instack-undercloud stable/queens: Fix remove nova-cert during FFU https://review.opendev.org/727996 | 03:10 |
*** psachin has joined #tripleo | 03:40 | |
*** cdearborn has quit IRC | 03:55 | |
*** jmasud has quit IRC | 04:03 | |
*** threestrands has quit IRC | 04:15 | |
*** ratailor has joined #tripleo | 04:27 | |
*** udesale has joined #tripleo | 04:46 | |
openstackgerrit | Rabi Mishra proposed openstack/python-tripleoclient master: Bump hacking min version to 3.0.1 https://review.opendev.org/729104 | 04:53 |
openstackgerrit | Rabi Mishra proposed openstack/python-tripleoclient master: Remove shenanigans for stack event verbosity https://review.opendev.org/729105 | 04:53 |
*** ykarel|away is now known as ykarel | 04:57 | |
*** jmasud has joined #tripleo | 05:02 | |
*** bdodd has quit IRC | 05:07 | |
*** jmasud has quit IRC | 05:25 | |
*** bdodd has joined #tripleo | 05:27 | |
*** jmasud has joined #tripleo | 05:29 | |
*** skramaja has joined #tripleo | 05:32 | |
*** jmasud has quit IRC | 05:40 | |
*** ysandeep|away is now known as ysandeep | 05:46 | |
*** lmiccini has joined #tripleo | 05:48 | |
*** jmasud has joined #tripleo | 05:58 | |
openstackgerrit | Andreas Jaeger proposed openstack/python-tripleoclient master: Switch to newer openstackdocstheme and reno versions https://review.opendev.org/729112 | 06:00 |
*** dpawlik has joined #tripleo | 06:02 | |
*** matbu has joined #tripleo | 06:03 | |
*** bandini has joined #tripleo | 06:04 | |
*** marios has joined #tripleo | 06:05 | |
*** waleedm has joined #tripleo | 06:06 | |
*** shyamb has joined #tripleo | 06:11 | |
*** jfrancoa has joined #tripleo | 06:13 | |
*** jmasud has quit IRC | 06:18 | |
*** jmasud has joined #tripleo | 06:19 | |
*** jbadiapa has quit IRC | 06:23 | |
*** shyamb has quit IRC | 06:30 | |
*** ccamacho has joined #tripleo | 06:32 | |
openstackgerrit | Takashi Kajinami proposed openstack/puppet-tripleo master: Include vendordata in nova-api and nova-metadata-api https://review.opendev.org/729074 | 06:40 |
*** jmasud has quit IRC | 06:45 | |
*** shyamb has joined #tripleo | 06:45 | |
*** cfontain has joined #tripleo | 06:46 | |
*** slaweq has joined #tripleo | 06:47 | |
*** shyamb has quit IRC | 06:50 | |
*** rpittau|afk is now known as rpittau | 06:51 | |
*** shyamb has joined #tripleo | 06:56 | |
*** jbadiapa has joined #tripleo | 06:59 | |
openstackgerrit | Rabi Mishra proposed openstack/python-tripleoclient master: Don't set DeployIdentifier in tripleoclient https://review.opendev.org/729142 | 07:09 |
*** maciejjozefczyk has joined #tripleo | 07:10 | |
openstackgerrit | Masayuki Igawa proposed openstack/tripleo-common-tempest-plugin master: Remove .testr.conf https://review.opendev.org/729161 | 07:11 |
*** jcapitao has joined #tripleo | 07:12 | |
*** fmount has joined #tripleo | 07:13 | |
*** udesale has quit IRC | 07:15 | |
*** udesale has joined #tripleo | 07:15 | |
*** paramite has joined #tripleo | 07:19 | |
openstackgerrit | Simon Westphahl proposed openstack/diskimage-builder master: Use kpartx option to update partition mappings https://review.opendev.org/728824 | 07:21 |
*** ade_lee has quit IRC | 07:22 | |
*** ade_lee has joined #tripleo | 07:23 | |
*** mnasiadka has quit IRC | 07:25 | |
*** flaviof has quit IRC | 07:26 | |
*** flaviof has joined #tripleo | 07:26 | |
*** mnasiadka has joined #tripleo | 07:27 | |
ramishra | bandini: Hey! Does this look like the the same issue you're working on https://f68e92826c849d66705e-baf4f807d40559415da582760ebf9456.ssl.cf5.rackcdn.com/729105/1/check/tripleo-ci-centos-8-containers-multinode/c35c277/logs/undercloud/home/zuul/overcloud_deploy.log | 07:27 |
ramishra | https://bugs.launchpad.net/tripleo/+bug/1878405 ? | 07:28 |
openstack | Launchpad bug 1878405 in tripleo "tripleo ansible sometimes does not run certain containers" [High,Triaged] | 07:28 |
*** paramite has quit IRC | 07:29 | |
openstackgerrit | Matthias Runge proposed openstack/tripleo-heat-templates stable/train: Enable collectd-ceph plugin only where needed https://review.opendev.org/729165 | 07:30 |
ramishra | I don't see the rabbitmq_init_bundle container and it's logs | 07:30 |
*** evrardjp has joined #tripleo | 07:31 | |
*** evrardjp has quit IRC | 07:32 | |
bandini | ramishra: lemme see | 07:32 |
*** amoralej|off is now known as amoralej | 07:33 | |
*** xek has joined #tripleo | 07:33 | |
*** evrardjp has joined #tripleo | 07:34 | |
*** suuuper has joined #tripleo | 07:37 | |
ramishra | or possibly a new regression. May be related to https://github.com/openstack/tripleo-ansible/commit/504033868672580b3af2b9d1e5d771a8233add9d ? | 07:39 |
*** ccamacho has quit IRC | 07:40 | |
bandini | ramishra: so not sure. in my LP bug I never see any trace of the container being run at all. your failure tells us that rabbitmq_init_bundle run but failed although there is no trace of it | 07:45 |
*** pcaruana has quit IRC | 07:51 | |
*** florianf has joined #tripleo | 07:56 | |
*** tosky has joined #tripleo | 07:56 | |
*** jpena|off is now known as jpena | 07:57 | |
ramishra | bandini: ok thanks! Lemme see if I can dig little bit more.. | 07:58 |
*** jpich has joined #tripleo | 07:59 | |
*** drokath has joined #tripleo | 07:59 | |
bandini | maybe they are related after all, just the symptoms are slightly different | 07:59 |
*** bogdando has joined #tripleo | 08:00 | |
*** holser has joined #tripleo | 08:01 | |
*** tkajinam has quit IRC | 08:02 | |
*** abdysn has joined #tripleo | 08:09 | |
*** holser_ has joined #tripleo | 08:10 | |
*** holser has quit IRC | 08:10 | |
*** lucasagomes has joined #tripleo | 08:12 | |
*** paramite has joined #tripleo | 08:13 | |
*** ysandeep is now known as ysandeep|lunch | 08:21 | |
*** alexmcleod has joined #tripleo | 08:25 | |
ykarel | bandini, ramishra i also hit similar issue with mysql_init_bundle in a jenkins job https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-current-tripleo-delorean-minimal-732/overcloud-controller-0/var/log/extra/journal.txt | 08:26 |
ykarel | i noticed the process is stuck for some reason | 08:27 |
ykarel | 48617 | 08:27 |
ykarel | https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-current-tripleo-delorean-minimal-732/overcloud-controller-0/var/log/extra/pstree.txt | 08:27 |
openstackgerrit | Mikołaj Rządca proposed openstack/tripleo-ansible master: added mcelog and smdpd roles https://review.opendev.org/728125 | 08:27 |
ykarel | i see incomplete output in stdouts https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-current-tripleo-delorean-minimal-732/overcloud-controller-0/var/log/containers/stdouts/mysql_init_bundle.log | 08:28 |
ykarel | don't know if it's same as bug but looks similar | 08:28 |
bandini | yeah there is definitely a pattern there | 08:33 |
*** panda|off is now known as panda | 08:34 | |
openstackgerrit | Mikołaj Rządca proposed openstack/tripleo-heat-templates master: enable collectd mcelog and snmpd https://review.opendev.org/728132 | 08:34 |
*** shyamb has quit IRC | 08:40 | |
*** drokath has quit IRC | 08:56 | |
openstackgerrit | Noam Angel proposed openstack/tripleo-ansible master: Fix conditions tuned profile https://review.opendev.org/729181 | 08:56 |
openstackgerrit | Noam Angel proposed openstack/tripleo-ansible master: Fix conditions tuned profile https://review.opendev.org/729181 | 08:59 |
*** ykarel is now known as ykarel|lunch | 09:07 | |
*** florianf has quit IRC | 09:13 | |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-quickstart-extras master: Parameterize rdoinfo_repo_name for downstream https://review.opendev.org/727200 | 09:14 |
openstackgerrit | Mikołaj Rządca proposed openstack/tripleo-ansible master: added mcelog and smdpd roles https://review.opendev.org/728125 | 09:22 |
openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: Not load tempest_test_blacklist when tempest_run_skipped is true https://review.opendev.org/729185 | 09:26 |
*** paramite has quit IRC | 09:37 | |
openstackgerrit | Mikołaj Rządca proposed openstack/tripleo-ansible master: added mcelog role https://review.opendev.org/728125 | 09:38 |
*** sshnaidm|afk is now known as sshnaidm | 09:40 | |
*** shyamb has joined #tripleo | 09:43 | |
openstackgerrit | Mikołaj Rządca proposed openstack/tripleo-heat-templates master: collectd enable mcelog https://review.opendev.org/728132 | 09:46 |
openstackgerrit | Mikołaj Rządca proposed openstack/tripleo-heat-templates master: collectd enable mcelog https://review.opendev.org/728132 | 09:48 |
sshnaidm | stevebaker, hi, do you know what can cause "not enough ports" problem? https://logserver.rdoproject.org/88/726488/2/openstack-check/tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-vexxhost/0a25363/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 09:51 |
*** ysandeep|lunch is now known as ysandeep | 09:51 | |
Tengu | bhagyashris|ruck: heya! do you know anything about tripleo-build-containers-centos-7-buildah job? it's new right? is it know to work, or... ? never seen it before | 09:53 |
*** ykarel|lunch is now known as ykarel | 09:53 | |
Tengu | *known | 09:53 |
openstackgerrit | Mikołaj Rządca proposed openstack/tripleo-heat-templates master: enable dpdk plugin on neutron ovn and ovs https://review.opendev.org/729194 | 09:55 |
bhagyashris|ruck | Tengu, tbh i dont know much more about this job.... i see there is one bug reported on LP https://bugs.launchpad.net/tripleo/+bug/1879365 | 09:58 |
openstack | Launchpad bug 1879365 in tripleo "[container build] SystemError: The following jobs were incomplete: state=finished" [High,Incomplete] | 09:58 |
*** shyam89 has joined #tripleo | 10:03 | |
*** shyamb has quit IRC | 10:05 | |
*** derekh has joined #tripleo | 10:26 | |
*** jcapitao is now known as jcapitao_lunch | 10:27 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/tripleo-ansible master: Correctly match openvswitch package https://review.opendev.org/728906 | 10:30 |
*** tkajinam has joined #tripleo | 10:30 | |
*** rpittau is now known as rpittau|bbl | 10:31 | |
*** bandini has quit IRC | 10:38 | |
*** bandini has joined #tripleo | 10:38 | |
ykarel | sshnaidm, can u review https://review.opendev.org/#/c/728405/ | 10:48 |
sshnaidm | ykarel, +w | 10:49 |
ykarel | sshnaidm, Thanks | 10:49 |
*** paramite has joined #tripleo | 10:49 | |
openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-upgrade master: Cater to non-composable environments https://review.opendev.org/729203 | 10:50 |
*** bandini has quit IRC | 10:52 | |
*** bandini has joined #tripleo | 10:52 | |
*** jpich has quit IRC | 10:55 | |
*** jpich has joined #tripleo | 10:56 | |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-quickstart-extras master: Parameterize rdoinfo_repo_name for downstream https://review.opendev.org/727200 | 11:03 |
openstackgerrit | Merged openstack/tripleo-common stable/queens: Match hostname when doing node delete https://review.opendev.org/725620 | 11:04 |
openstackgerrit | John Fulton proposed openstack/tripleo-heat-templates master: Include copy-image for GlanceEnabledImportMethods for dch-hci https://review.opendev.org/729214 | 11:11 |
ykarel | sshnaidm, can u remove +W i realized atop not getting installed for some reason after this patch | 11:15 |
ykarel | https://review.opendev.org/#/c/728405/3 one | 11:15 |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-quickstart-extras master: Parameterize rdoinfo_repo_name for downstream https://review.opendev.org/727200 | 11:15 |
*** leanderthal has joined #tripleo | 11:22 | |
*** jpich has quit IRC | 11:25 | |
*** jpich has joined #tripleo | 11:26 | |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Expose grafana, dashboard and mgr port parameters https://review.opendev.org/726366 | 11:26 |
openstackgerrit | Merged openstack/tripleo-quickstart master: Add openstack-tempest-skiplist to list of requirements https://review.opendev.org/725220 | 11:28 |
sshnaidm | ykarel, do we have build-deps repo at all? | 11:28 |
ykarel | sshnaidm, yes it's there | 11:28 |
ykarel | https://logserver.rdoproject.org/05/728405/3/openstack-check/tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001/8d94219/logs/undercloud/etc/yum.repos.d/delorean-master-deps.repo.txt.gz | 11:29 |
openstackgerrit | Michele Baldessari proposed openstack/tripleo-quickstart-extras master: wip Pass proper VIPs on Standalone https://review.opendev.org/725782 | 11:29 |
openstackgerrit | Michele Baldessari proposed openstack/tripleo-ansible master: WIP Add tripleo_ha_wrapper role https://review.opendev.org/724817 | 11:30 |
*** jpena is now known as jpena|lunch | 11:33 | |
openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: haproxy bundle https://review.opendev.org/707953 | 11:33 |
openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: redis bundle https://review.opendev.org/707954 | 11:34 |
openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: mysql https://review.opendev.org/707955 | 11:34 |
openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: cinder backup/volume https://review.opendev.org/707956 | 11:35 |
openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: ovn dbs https://review.opendev.org/707957 | 11:35 |
openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: rabbitmq https://review.opendev.org/707958 | 11:36 |
openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: manila-share https://review.opendev.org/708357 | 11:36 |
*** aedc_ has joined #tripleo | 11:39 | |
openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: Not load tempest_test_blacklist when tempest_run_skipped is true https://review.opendev.org/729185 | 11:39 |
*** aedc has quit IRC | 11:41 | |
*** bandini has quit IRC | 11:41 | |
*** rfolco|rover|off has joined #tripleo | 11:42 | |
*** rfolco|rover|off is now known as rfolco|rover | 11:44 | |
hjensas | Hello, reviews on https://review.opendev.org/723898 please. :) | 11:45 |
*** aedc_ has quit IRC | 11:53 | |
*** waleedm has quit IRC | 11:54 | |
*** raildo has joined #tripleo | 11:57 | |
*** shyam89 has quit IRC | 11:57 | |
*** udesale_ has joined #tripleo | 12:00 | |
*** jcapitao_lunch is now known as jcapitao | 12:01 | |
*** udesale has quit IRC | 12:02 | |
*** rpittau|bbl is now known as rpittau | 12:04 | |
*** amoralej is now known as amoralej|lunch | 12:08 | |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Run all noop opeartions in molecule testing. https://review.opendev.org/698526 | 12:11 |
*** ccamacho has joined #tripleo | 12:18 | |
EmilienM | ramishra: could you take a look at my comment on https://review.opendev.org/#/c/723382 ? I'm not sure that back is really compatible with previous behavior, I suggested something | 12:21 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/train: Configure valid_exit_code for startup containers https://review.opendev.org/729234 | 12:26 |
*** rlandy has joined #tripleo | 12:28 | |
*** TrevorV has joined #tripleo | 12:30 | |
cloudnull | mornings | 12:30 |
*** artom has joined #tripleo | 12:33 | |
*** jpena|lunch is now known as jpena | 12:33 | |
*** ysandeep is now known as ysandeep|brb | 12:44 | |
openstackgerrit | Mihai Plasoianu proposed openstack/tripleo-heat-templates master: Fix node scaling https://review.opendev.org/723382 | 12:45 |
cloudnull | anyone around mind giving https://review.opendev.org/#/c/728273/ a nudge | 12:45 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: podman/create: do not include failed containers in containers_to_check https://review.opendev.org/729238 | 12:45 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Ensure that the playbooks and roles can display debug data when enabled https://review.opendev.org/715006 | 12:52 |
*** ratailor has quit IRC | 12:57 | |
*** derekh has quit IRC | 13:01 | |
cloudnull | this one could also use a push https://review.opendev.org/#/c/728538 | 13:01 |
*** derekh has joined #tripleo | 13:01 | |
cloudnull | simple little change | 13:01 |
cloudnull | example of it working https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_e6a/724193/33/check/tripleo-build-containers-ubi-8/e6a5809/logs/build.log | 13:02 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates stable/train: Make /var/lib/mistral traversable by all users https://review.opendev.org/725884 | 13:03 |
*** amoralej|lunch is now known as amoralej | 13:03 | |
*** abdysn has quit IRC | 13:04 | |
*** ekultails has joined #tripleo | 13:06 | |
*** Goneri has joined #tripleo | 13:09 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ci master: WIP - non-voting job for tripleo-build-containers-ubi-8 https://review.opendev.org/724193 | 13:10 |
openstackgerrit | Rabi Mishra proposed openstack/python-tripleoclient master: Don't run get_config() in upgrade prepare https://review.opendev.org/729251 | 13:11 |
*** ykarel is now known as ykarel|afk | 13:11 | |
*** holser_ has quit IRC | 13:14 | |
*** holser has joined #tripleo | 13:14 | |
mwhahaha | weshay|ruck: didn't we disable train undercloud-upgrades? https://review.opendev.org/#/c/728475/ or at least switch to NV | 13:18 |
* weshay|ruck thought we did too.. /me looks | 13:18 | |
openstackgerrit | Mikołaj Rządca proposed openstack/tripleo-ansible master: added mcelog role https://review.opendev.org/728125 | 13:18 |
weshay|ruck | mwhahaha, /me takes care of it | 13:19 |
openstackgerrit | Grzegorz Grasza proposed openstack/tripleo-heat-templates master: Change the :Z mount flag to :z https://review.opendev.org/729253 | 13:19 |
*** ysandeep|brb is now known as ysandeep | 13:22 | |
*** jdandrea has joined #tripleo | 13:23 | |
openstackgerrit | wes hayutin proposed openstack/paunch stable/train: remove centos-7-undercloud-upgrades from paunch layout https://review.opendev.org/729256 | 13:26 |
openstackgerrit | wes hayutin proposed openstack/paunch stable/train: Fix return results on cmd failure and error msgs https://review.opendev.org/728475 | 13:26 |
openstackgerrit | Lukas Bezdicka proposed openstack/python-tripleoclient master: WIP: Speed up plan operations by using a tarball in swift. https://review.opendev.org/581141 | 13:27 |
openstackgerrit | Rabi Mishra proposed openstack/python-tripleoclient master: Don't run get_config() in update/upgrade prepare https://review.opendev.org/729251 | 13:29 |
*** s8k has joined #tripleo | 13:34 | |
*** psachin has quit IRC | 13:35 | |
*** lbragstad_ has joined #tripleo | 13:36 | |
openstackgerrit | Rabi Mishra proposed openstack/python-tripleoclient master: Don't run get_config() in update/upgrade prepare https://review.opendev.org/729251 | 13:36 |
*** lbragstad has quit IRC | 13:38 | |
*** cdearborn has joined #tripleo | 13:40 | |
openstackgerrit | Bogdan Dobrelya (bogdando) proposed openstack/tripleo-ansible master: Aggregate stats for podman-managed containers https://review.opendev.org/729260 | 13:43 |
openstackgerrit | John Fulton proposed openstack/tripleo-ansible master: WIP Create derived parameters playbook, and role https://review.opendev.org/719466 | 13:49 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/tripleo-heat-templates master: Only enable leapp tasks when distribution is correct https://review.opendev.org/728390 | 13:50 |
openstackgerrit | Bogdan Dobrelya (bogdando) proposed openstack/tripleo-common master: Display custom stats (set via set_stats plugin) https://review.opendev.org/729267 | 13:55 |
*** pojadhav is now known as pojadhav|afk | 13:57 | |
openstackgerrit | Bogdan Dobrelya (bogdando) proposed openstack/tripleo-ansible master: Aggregate stats for podman-managed containers https://review.opendev.org/729260 | 14:01 |
weshay|ruck | #startmeeting tripleo | 14:01 |
weshay|ruck | #topic agenda | 14:01 |
weshay|ruck | * Review past action items | 14:01 |
weshay|ruck | * One off agenda items | 14:01 |
weshay|ruck | * Squad status | 14:01 |
openstack | Meeting started Tue May 19 14:01:57 2020 UTC and is due to finish in 60 minutes. The chair is weshay|ruck. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:01 |
weshay|ruck | * Bugs & Blueprints | 14:01 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:02 |
weshay|ruck | * Projects releases or stable backports | 14:02 |
*** openstack changes topic to " (Meeting topic: tripleo)" | 14:02 | |
weshay|ruck | * Specs | 14:02 |
openstack | The meeting name has been set to 'tripleo' | 14:02 |
*** openstack changes topic to "agenda (Meeting topic: tripleo)" | 14:02 | |
weshay|ruck | * open discussion | 14:02 |
weshay|ruck | Anyone can use the #link, #action and #info commands, not just the moderatorǃ | 14:02 |
beagles | o/ | 14:02 |
weshay|ruck | Hey folks! who's around? | 14:02 |
fultonj | o/ | 14:02 |
Tengu | \o/ | 14:02 |
tkajinam | o/ | 14:02 |
owalsh | o/ | 14:02 |
EmilienM | o/ | 14:02 |
marios | o/ | 14:02 |
rfolco|rover | o/ | 14:03 |
openstackgerrit | Alex Schultz proposed openstack/os-collect-config master: Stop testing python2.7 https://review.opendev.org/691638 | 14:04 |
cloudnull | o/ | 14:04 |
weshay|ruck | #topic review past action items | 14:04 |
weshay|ruck | http://eavesdrop.openstack.org/meetings/tripleo/2020/ | 14:04 |
*** openstack changes topic to "review past action items (Meeting topic: tripleo)" | 14:04 | |
weshay|ruck | nothing open from last week | 14:04 |
openstackgerrit | Alex Schultz proposed openstack/os-collect-config master: Stop testing python2.7 https://review.opendev.org/691638 | 14:04 |
weshay|ruck | #topic one off agenda items | 14:04 |
weshay|ruck | #link https://etherpad.openstack.org/p/tripleo-meeting-items | 14:04 |
*** openstack changes topic to "one off agenda items (Meeting topic: tripleo)" | 14:04 | |
openstackgerrit | Alex Schultz proposed openstack/os-collect-config master: Add tls proxy support for Zaqar https://review.opendev.org/726304 | 14:04 |
weshay|ruck | fultonj, asked about the ptg schedule | 14:05 |
fultonj | https://etherpad.opendev.org/p/tripleo-ptg-victoria | 14:05 |
weshay|ruck | they've locked the ethercalc so we'll have to use an ^ etherpad | 14:05 |
weshay|ruck | 1/2 hour slot per topic | 14:05 |
fultonj | what is the process by which a proposed topic gets assigned a slot? | 14:05 |
openstackgerrit | Alex Schultz proposed openstack/os-collect-config master: Stop testing python2.7 https://review.opendev.org/691638 | 14:05 |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Add option to set custom ceph parameters for containers https://review.opendev.org/728953 | 14:05 |
openstackgerrit | Alex Schultz proposed openstack/os-collect-config master: Add tls proxy support for Zaqar https://review.opendev.org/726304 | 14:06 |
weshay|ruck | fultonj, self sign up... I'll cross check what is not on the schedule and fit it in if we can | 14:06 |
fultonj | ok | 14:06 |
weshay|ruck | fultonj, I'll follow up w/ an email | 14:06 |
weshay|ruck | fultonj, thanks for the prompt | 14:06 |
fultonj | in previous PTGs we've started with retrospectives so we should probably leave that open for the PTL | 14:06 |
fultonj | (the first of the first) | 14:06 |
fultonj | thanks weshay|ruck | 14:06 |
weshay|ruck | aye.. | 14:06 |
weshay|ruck | regarding the release: targeting TripleO release 5/21, can slip through the to 27 and still be in the two week window. | 14:07 |
weshay|ruck | slip will depend on bugs, quality etc. | 14:07 |
weshay|ruck | patches are up w/ a -1 to branch and release.. | 14:07 |
weshay|ruck | there is currently still ci and packaging work on going | 14:08 |
weshay|ruck | amoralej, any comments on ussuri? | 14:08 |
amoralej | sorry, i'm in a call, reading back | 14:08 |
amoralej | ups, moving to 27th? | 14:08 |
weshay|ruck | reminder to everyone to stay in touch w/ their friends and family :) | 14:08 |
weshay|ruck | amoralej, still targeting this thrs, 21st.. but it may slip | 14:09 |
amoralej | ah, ok | 14:09 |
amoralej | we'd like to release in RDO before ptg | 14:09 |
*** rbrady has joined #tripleo | 14:09 | |
amoralej | so i think we are still on time | 14:09 |
weshay|ruck | amoralej, aye.. any major blockers in packaging at this time? | 14:09 |
amoralej | no so far | 14:10 |
amoralej | i've also asked kolla to branch and release something that we can build | 14:10 |
amoralej | as we need it also in GA | 14:10 |
weshay|ruck | k cool.. nothing major yet from CI.. seeing mixed results in upstream and third party checks | 14:10 |
weshay|ruck | amoralej, is that a hard dep? | 14:10 |
*** tkajinam has quit IRC | 14:11 | |
amoralej | well, i'd like to make container images build part of release criteria | 14:11 |
amoralej | and that requires kolla | 14:11 |
*** tkajinam has joined #tripleo | 14:11 | |
amoralej | so that, any user can create tripleo container images from cloudsig builds | 14:11 |
weshay|ruck | ok.. will be watching their projects in openstack/releases | 14:11 |
amoralej | thx | 14:11 |
weshay|ruck | looks like mark has started.. | 14:12 |
weshay|ruck | amoralej, thank you :) | 14:12 |
weshay|ruck | #topic Active Squad status | 14:13 |
weshay|ruck | ci | 14:13 |
weshay|ruck | #link https://hackmd.io/IhMCTNMBSF6xtqiEd9Z0Kw?both | 14:13 |
weshay|ruck | validations | 14:13 |
weshay|ruck | #link https://etherpad.openstack.org/p/tripleo-validations-squad-status | 14:13 |
weshay|ruck | ceph-integration | 14:13 |
*** openstack changes topic to "Active Squad status (Meeting topic: tripleo)" | 14:13 | |
weshay|ruck | #link https://etherpad.openstack.org/p/tripleo-integration-squad-status | 14:13 |
weshay|ruck | transformation | 14:13 |
weshay|ruck | #link https://etherpad.openstack.org/p/tripleo-ansible-agenda | 14:13 |
weshay|ruck | mistral-to-ansible | 14:13 |
weshay|ruck | #link https://etherpad.openstack.org/p/tripleo-mistral-to-ansible | 14:13 |
weshay|ruck | any of the squads have reviews that are needed, or anything for release? | 14:13 |
cloudnull | nothing major to report on the mistral to ansible front. | 14:13 |
cloudnull | progress is still being made with derived params | 14:14 |
weshay|ruck | k k | 14:14 |
fultonj | ack | 14:14 |
fultonj | slow going but i've mocked in more stuff | 14:14 |
cloudnull | couple of reviews could use some love https://review.opendev.org/#/q/topic:mistral_to_ansible+status:open+(project:openstack/python-tripleoclient+OR+project:openstack/tripleo-ansible) | 14:14 |
cloudnull | fultonj++ work in https://review.opendev.org/#/c/719466/ has been great | 14:14 |
fultonj | cloudnull++ did most of the work :) | 14:15 |
cloudnull | its a team effort | 14:15 |
weshay|ruck | GROUP HUG | 14:16 |
weshay|ruck | #topic Bugs & Blueprints | 14:16 |
weshay|ruck | #link https://launchpad.net/tripleo/+milestone/ussuri-rc3 | 14:16 |
*** openstack changes topic to "Bugs & Blueprints (Meeting topic: tripleo)" | 14:16 | |
openstackgerrit | Toure Dunnon proposed openstack/tripleo-ansible master: Adding playbook support for changes coming to python-tripleoclient. https://review.opendev.org/720087 | 14:16 |
weshay|ruck | Bugs: | 14:16 |
weshay|ruck | 4 New, 241 Incomplete, 8 Invalid, 4 Won't Fix, 4 Confirmed, 177 Triaged, 118 In Progress, 47 Fix Released | 14:16 |
weshay|ruck | Storyboard bugs. | 14:17 |
weshay|ruck | #link https://storyboard.openstack.org/#!/project_group/76 | 14:17 |
* weshay|ruck reminds self to triage story board | 14:17 | |
weshay|ruck | #topic specs | 14:17 |
weshay|ruck | #link https://review.openstack.org/#/q/project:openstack/tripleo-specs+status:open | 14:17 |
*** openstack changes topic to "specs (Meeting topic: tripleo)" | 14:17 | |
weshay|ruck | I'll email folks about specs and topics on openstack-discuss today | 14:18 |
weshay|ruck | again the topics look awesome, specs along w/ topics are ++ | 14:18 |
weshay|ruck | #topic open discussion | 14:18 |
weshay|ruck | Anything else that folks want to bring up to the meeting? | 14:18 |
*** openstack changes topic to "open discussion (Meeting topic: tripleo)" | 14:18 | |
weshay|ruck | Folks.. I do see getting patches merged over the last 1.5 weeks has been very hard.. | 14:19 |
weshay|ruck | sucks, I know and I also feel that pain.. | 14:19 |
weshay|ruck | things are slowly returning to a normal level of kind of annoying and mildly sucks vs. terrible | 14:20 |
EmilienM | the gate was very busy last week, due to the ussuri release | 14:20 |
EmilienM | it's always like this :) | 14:20 |
EmilienM | this week should be better | 14:20 |
weshay|ruck | it is.. | 14:20 |
weshay|ruck | so far this week is better | 14:20 |
* weshay|ruck notes.. I will quickly at PTG propsing a change to this meeting | 14:21 | |
*** leanderthal has quit IRC | 14:21 | |
weshay|ruck | so if you are here, thank you.. and think about suggestions for changing the format of this meeting, schedule.. etc.. etc | 14:21 |
weshay|ruck | thanks all 0/ | 14:22 |
weshay|ruck | #endmeeting tripleo | 14:22 |
*** openstack changes topic to "CI status: ORANGE: centos mirror failures | community irc meeting Tues@1400 UTC - tripleo-ci-community meeting Tues@1330 UTC | https://docs.openstack.org/tripleo-docs" | 14:22 | |
openstack | Meeting ended Tue May 19 14:22:08 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:22 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/tripleo/2020/tripleo.2020-05-19-14.01.html | 14:22 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tripleo/2020/tripleo.2020-05-19-14.01.txt | 14:22 |
openstack | Log: http://eavesdrop.openstack.org/meetings/tripleo/2020/tripleo.2020-05-19-14.01.log.html | 14:22 |
fultonj | o/\o <-- high five | 14:26 |
openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: Not load tempest_test_blacklist when tempest_run_skipped is true https://review.opendev.org/729185 | 14:27 |
*** amodi has joined #tripleo | 14:27 | |
openstackgerrit | Mihai Plasoianu proposed openstack/tripleo-heat-templates master: Fix node scaling https://review.opendev.org/723382 | 14:27 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Ensure that the playbooks and roles can display debug data when enabled https://review.opendev.org/715006 | 14:31 |
*** ykarel|afk is now known as ykarel | 14:43 | |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Deprecate service ipv6 params https://review.opendev.org/723898 | 15:00 |
*** leanderthal has joined #tripleo | 15:00 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: podman/create: do not include failed containers in containers_to_check https://review.opendev.org/729238 | 15:07 |
*** hamzy_ is now known as hamzy | 15:09 | |
*** skramaja has quit IRC | 15:17 | |
sshnaidm | is it known? Error: Facter: error while resolving custom fact "rabbitmq_nodename": undefined method `[]' for nil:NilClass https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_94c/726927/6/gate/tripleo-ci-centos-8-scenario002-standalone/94c8a1f/logs/undercloud/var/log/containers/stdouts/rabbitmq_init_bundle.log | 15:18 |
sshnaidm | rfolco|rover, bhagyashris|ruck ^ | 15:18 |
rfolco|rover | sshnaidm, https://bugs.launchpad.net/tripleo/+bug/1879292 | 15:19 |
openstack | Launchpad bug 1879292 in tripleo "ERROR paunch [ ] Error running ['podman', 'run', '--name', 'rabbitmq_init_bundle', '--label', 'config_id=tripleo_step2', '--label', 'container_name=rabbitmq_init_bundle' failing periodic tripleo-ci-centos-8 scenario004-standalone-train and ovb-1ctlr_1comp-featureset002-train" [Critical,Triaged] | 15:19 |
rfolco|rover | sshnaidm, trying to set up env to reproduce, check rabbit service, etc | 15:19 |
sshnaidm | rfolco|rover, ack, happens on master too | 15:20 |
sshnaidm | seems like puppet issue | 15:20 |
mwhahaha | nope | 15:23 |
mwhahaha | that error doesn't do anything | 15:23 |
mwhahaha | there's alreadya bug around the init bundle | 15:23 |
mwhahaha | also it seems like it might be related to the podman idempotency patch in tripleo-ansible from last week | 15:23 |
mwhahaha | EmilienM is looking into the issue today | 15:23 |
mwhahaha | https://bugs.launchpad.net/tripleo/+bug/1878405 | 15:24 |
openstack | Launchpad bug 1878405 in tripleo "tripleo ansible sometimes does not run certain containers" [High,Triaged] - Assigned to Emilien Macchi (emilienm) | 15:24 |
openstackgerrit | Bogdan Dobrelya (bogdando) proposed openstack/tripleo-ansible master: Aggregate stats for podman-managed containers https://review.opendev.org/729260 | 15:27 |
*** leanderthal has quit IRC | 15:32 | |
openstackgerrit | Rabi Mishra proposed openstack/python-tripleoclient stable/train: [stable/train] Revert "Remove download_ansible_playbooks" https://review.opendev.org/729301 | 15:32 |
*** lmiccini has quit IRC | 15:33 | |
*** karthiks has joined #tripleo | 15:34 | |
karthiks | dsneddon, can you please take a look at https://review.opendev.org/#/c/727215/ | 15:34 |
openstackgerrit | Merged openstack/tripleo-ansible master: Improve facter cache reliability https://review.opendev.org/727893 | 15:36 |
*** lbragstad_ is now known as lbragstad | 15:36 | |
*** hrw has joined #tripleo | 15:37 | |
hrw | morning | 15:37 |
hrw | https://review.opendev.org/#/c/728687/ anyone? | 15:37 |
*** ykarel is now known as ykarel|away | 15:38 | |
openstackgerrit | Alexey Stupnikov proposed openstack/tripleo-heat-templates master: Add an option to adjust help URL in horizon https://review.opendev.org/729303 | 15:41 |
lbragstad | has anyone noticed issues like this deploying overclouds recently? http://pastebin.test.redhat.com/866545 | 15:43 |
lbragstad | sorry - wrong paste | 15:43 |
openstackgerrit | Alexey Stupnikov proposed openstack/tripleo-heat-templates master: Add an option to adjust help URL in horizon https://review.opendev.org/729303 | 15:43 |
lbragstad | http://paste.openstack.org/raw/793776/ | 15:44 |
openstackgerrit | Toure Dunnon proposed openstack/python-tripleoclient master: Add backup functionality to Openstack client for undercloud and overcloud. https://review.opendev.org/721333 | 15:44 |
mwhahaha | seems like a cloudflare/docker.io problem | 15:44 |
lbragstad | yeah | 15:44 |
mwhahaha | not much we can do with that | 15:44 |
lbragstad | ok - just wanted to make sure i wasn't missing something | 15:44 |
mwhahaha | i did merge in a change to add some retries in to the initial pull | 15:44 |
mwhahaha | but not much we can do about that | 15:44 |
*** ysandeep is now known as ysandeep|afk | 15:45 | |
lbragstad | i would think this is impacting CI? | 15:46 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/tripleo-heat-templates stable/train: Add common_deploy_steps to post_upgrade_steps. https://review.opendev.org/728956 | 15:46 |
mwhahaha | we have some caching in upstream ci | 15:46 |
mwhahaha | so probably not as much | 15:46 |
lbragstad | ah - that makes sense | 15:46 |
*** toure has joined #tripleo | 15:47 | |
hrw | mwhahaha: thx | 15:49 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Ensure that the playbooks and roles can display debug data when enabled https://review.opendev.org/715006 | 15:53 |
mwhahaha | cloudnull: https://review.opendev.org/#/c/728687/ | 15:54 |
sshnaidm | EmilienM, cloudnull, hi, do you know about quay/RH infra mirrors maybe? there are questions about that in #opendev from clarkb, are we using them? | 15:54 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Add toggle for sensitive data within octavia https://review.opendev.org/723521 | 15:54 |
mwhahaha | we don't pull from quay? (also i hear it's down today?) | 15:54 |
cloudnull | sshnaidm what mwhahaha said, EmilienM and I have been working with quay for our new container builds and i think weshay|ruck has some test jobs using it but i dont think we're using it across the board at this point | 15:56 |
hrw | cloudnull: thanks | 15:56 |
sshnaidm | mwhahaha, yeah, it's full of 500s | 15:56 |
weshay|ruck | cloudnull, sshnaidm Evilien put in a request a while ago and got quay added to upstream mirrors afaik | 15:57 |
sshnaidm | cloudnull, ack, so we actually use them, sometimes | 15:57 |
mwhahaha | i wonder if we use it in molecule | 15:57 |
mwhahaha | because it's earlier in the search list for podman | 15:57 |
cloudnull | "Quay Container Registry is currently in read-only mode. Pulls and other read-only operations will succeed but all other operations are currently suspended." - :'( | 15:57 |
*** lucasagomes has quit IRC | 15:57 | |
mwhahaha | and i don't think molecule supports mirrors? | 15:57 |
sshnaidm | mwhahaha, it should | 15:58 |
sshnaidm | mwhahaha, at least I added mirrors there | 15:58 |
mwhahaha | k | 15:58 |
mwhahaha | then that's be the only place we might be using it | 15:58 |
mwhahaha | tripleo pulls from docker.io via mirrors | 15:58 |
*** jcapitao has quit IRC | 16:02 | |
*** bogdando has quit IRC | 16:05 | |
*** yolanda has quit IRC | 16:07 | |
*** jpich has quit IRC | 16:10 | |
*** jmasud has joined #tripleo | 16:12 | |
*** marios is now known as marios|out | 16:16 | |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Make user value for GlanceImageImportPlugin prevail on logic https://review.opendev.org/728506 | 16:17 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/tripleo-heat-templates master: Only enable leapp tasks when distribution is correct https://review.opendev.org/728390 | 16:21 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-ansible master: Implement run_once https://review.opendev.org/729320 | 16:22 |
*** rpittau is now known as rpittau|afk | 16:22 | |
*** udesale_ has quit IRC | 16:24 | |
*** marios|out has quit IRC | 16:25 | |
cloudnull | mwhahaha on the tripleo-free strategy, does run-once work with set facts? (re: https://review.opendev.org/#/c/729320) | 16:25 |
*** jmasud has quit IRC | 16:26 | |
mwhahaha | not likely | 16:27 |
cloudnull | we use run_once quite a bit with set_fact which has some internal magic which sets the fact on all nodes. | 16:27 |
mwhahaha | it seems to have no effect | 16:28 |
mwhahaha | of course that was before i implemented that | 16:28 |
mwhahaha | so it was always running | 16:28 |
mwhahaha | we likely will need to not do that anymore | 16:28 |
cloudnull | https://github.com/ansible/ansible/issues/47509#issuecomment-432278545 | 16:28 |
cloudnull | i dont think the "feature" is documented, but i guess thats the expected outcome | 16:29 |
cloudnull | re: run_once with set_fact | 16:29 |
mwhahaha | there's not a lot of testing in free upstream tbh | 16:29 |
mwhahaha | as i have found with my actual implementation :D | 16:29 |
cloudnull | i would guess that "not a lot" == NaN | 16:29 |
mwhahaha | oh there are a few unit tests | 16:29 |
mwhahaha | but nothing more than the basics | 16:30 |
*** gfidente is now known as gfidente|afk | 16:30 | |
*** jmasud has joined #tripleo | 16:31 | |
mwhahaha | right now i'm attempting to get timing on linear vs tripleo_free for 20 nodes. i'll test out the run_once stuff next and see where it fails hard | 16:31 |
openstackgerrit | John Fulton proposed openstack/tripleo-heat-templates master: Include copy-image for GlanceEnabledImportMethods for dch-hci https://review.opendev.org/729214 | 16:32 |
cloudnull | it doesn't look like the basic linear strategy touches set_facts, so maybe the magic is handled elsewhere. https://github.com/ansible/ansible/blob/devel/lib/ansible/plugins/strategy/linear.py | 16:33 |
mwhahaha | yea it's a task execution order thing | 16:34 |
mwhahaha | so run once just invokes it once but no other task will run | 16:34 |
mwhahaha | cloudnull: where do we run_once for set facts? | 16:35 |
*** dpawlik has quit IRC | 16:37 | |
cloudnull | mwhahaha https://pasted.tech/pastes/9eccd99988839b82f558217fd197646164fffa8e | 16:38 |
cloudnull | thats from tripleo-ansible | 16:38 |
cloudnull | I think its in a few places in tht too | 16:38 |
mwhahaha | so tripleo_free doesn't affect cli-* | 16:38 |
mwhahaha | it's only in the deployment playbooks | 16:38 |
mwhahaha | it'll be linear by default still, it's only the deploy steps | 16:38 |
cloudnull | ah ook , then maybe we're all good ? | 16:39 |
mwhahaha | specifically to avoid that kinda issue | 16:39 |
mwhahaha | i think so | 16:39 |
cloudnull | sweet! | 16:39 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates stable/train: Improve facter cache reliability https://review.opendev.org/729326 | 16:39 |
cloudnull | anyone around mind giving https://review.opendev.org/#/c/723665/ a look, do we think we're in a good enough place to ack/nack that spec? | 16:40 |
*** ysandeep|afk is now known as ysandeep | 16:43 | |
*** holser has quit IRC | 16:44 | |
*** holser has joined #tripleo | 16:46 | |
*** ayoung has joined #tripleo | 16:50 | |
*** karthiks has quit IRC | 16:51 | |
*** jmasud has quit IRC | 16:51 | |
weshay|ruck | cloudnull, ahh.. https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_7dd/724193/34/check/tripleo-build-containers-ubi-8/7ddefc4/ | 16:53 |
cloudnull | great success! | 16:53 |
cloudnull | the : | 16:55 |
cloudnull | 2020-05-19 14:04:06 | Expected................... | 16:55 |
cloudnull | 2020-05-19 14:04:06 | Built...................... 0 | 16:55 |
cloudnull | needs work | 16:55 |
cloudnull | but the tools seem to be doing what we expect | 16:55 |
*** udesale has joined #tripleo | 16:55 | |
weshay|ruck | cloudnull, ya.. we lost the /etc/yum.repos.d/ logging | 16:56 |
weshay|ruck | cloudnull, how did the right ops-tools get on there | 16:56 |
*** weshay|ruck changes topic to "CI status: GREENISH \0/| community irc meeting Tues@1400 UTC - tripleo-ci-community meeting Tues@1330 UTC | https://docs.openstack.org/tripleo-docs" | 16:57 | |
cloudnull | weshay|ruck https://review.opendev.org/#/c/724193/34/roles/tripleo-repos/tasks/main.yml | 16:58 |
*** derekh has quit IRC | 16:59 | |
*** udesale has quit IRC | 17:01 | |
*** pojadhav|afk is now known as pojadhav | 17:03 | |
*** amoralej is now known as amoralej|off | 17:03 | |
weshay|ruck | cloudnull, ya.. but it's not going to get the right url for ops-tools man :) | 17:04 |
*** jpena is now known as jpena|off | 17:04 | |
cloudnull | it seemed to work ? | 17:04 |
mwhahaha | *magic* | 17:05 |
openstackgerrit | Toure Dunnon proposed openstack/tripleo-ansible master: Adding playbook support for changes coming to python-tripleoclient. https://review.opendev.org/720087 | 17:06 |
mwhahaha | weshay|ruck: why does 3rd party complain about ansible/ansible https://review.opendev.org/#/c/729320/ | 17:14 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ci master: non-voting job for tripleo-build-containers-ubi-8 https://review.opendev.org/724193 | 17:14 |
mwhahaha | seems broken | 17:14 |
weshay|ruck | doh.. yes indeed | 17:15 |
weshay|ruck | haven't seen that | 17:15 |
mwhahaha | it's cause a depends-on to github.com/ansible/ansible | 17:15 |
mwhahaha | but that seems like it shouldn't fail like that | 17:15 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Enable ConfigDebug in CI https://review.opendev.org/728946 | 17:21 |
EmilienM | neutron_db_sync taking 8 min to finish | 17:24 |
EmilienM | https://2df35c0ce3acd81e8af6-e3638d6f93b7f404b738b516d37f0f7d.ssl.cf1.rackcdn.com/728946/1/check/tripleo-ci-centos-8-scenario010-standalone/1d221ec/logs/undercloud/var/log/containers/stdouts/neutron_db_sync.log | 17:24 |
EmilienM | does it ring a bell? | 17:24 |
weshay|ruck | mwhahaha, where / how is it depending on an ansible change | 17:24 |
EmilienM | weshay|ruck: he's lunching | 17:24 |
weshay|ruck | oh... lunch away | 17:24 |
EmilienM | weshay|ruck: a sec, I'll show you links | 17:25 |
EmilienM | weshay|ruck: https://review.opendev.org/#/c/724731/15//COMMIT_MSG | 17:25 |
EmilienM | Depends-On: https://github.com/ansible/ansible/pull/69498 | 17:25 |
EmilienM | Depends-On: https://github.com/ansible/ansible/pull/69524 | 17:25 |
weshay|ruck | HA.. scroll | 17:25 |
* weshay|ruck kills thyself | 17:25 | |
*** waleedm has joined #tripleo | 17:25 | |
EmilienM | it's because RDO zuul is not configured to have ansible/ansible in its cloned repos | 17:26 |
weshay|ruck | aye | 17:26 |
EmilienM | i can't recall where it's done, give me a min | 17:26 |
*** jmasud has joined #tripleo | 17:29 | |
*** jmasud has quit IRC | 17:31 | |
*** evrardjp has quit IRC | 17:32 | |
*** jmasud has joined #tripleo | 17:33 | |
*** evrardjp has joined #tripleo | 17:34 | |
EmilienM | weshay|ruck: I found it | 17:35 |
EmilienM | I think it is in https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/zuul/rdo.yaml#L1103 | 17:35 |
EmilienM | https://zuul-ci.org/docs/zuul/reference/glossary.html#term-untrusted-project | 17:36 |
EmilienM | and the problem is that zuul tries to checkout ansible from master | 17:37 |
EmilienM | while ansible doesn't have master branch but only devel | 17:37 |
*** waleedm_ has joined #tripleo | 17:37 | |
EmilienM | we should probably override it | 17:37 |
EmilienM | https://opendev.org/openstack/project-config/src/branch/master/zuul.d/projects.yaml#L29 | 17:39 |
EmilienM | openstack infra is doing that ^ | 17:39 |
*** waleedm has quit IRC | 17:40 | |
weshay|ruck | oh | 17:42 |
weshay|ruck | EmilienM, think we can override in a layout or something? | 17:43 |
weshay|ruck | is that what you mean | 17:44 |
weshay|ruck | we could just add a master branch to that | 17:44 |
weshay|ruck | zbr, infra question.. https://opendev.org/openstack/project-config/src/branch/master/zuul.d/projects.yaml#L29 | 17:44 |
weshay|ruck | can add a third-party-check w/ ansible master branch to ^ | 17:45 |
zbr | weshay|ruck: theoretically yes, practically we should not do anything until we address the libpod/ceph work. | 17:45 |
zbr | with ansible devel is not practical until they release 2.10 in particular, due to huge changes | 17:46 |
weshay|ruck | zbr, two diff topics https://opendev.org/openstack/project-config/src/branch/master/zuul.d/projects.yaml#L27-L47 | 17:46 |
weshay|ruck | zbr, trying to enable https://review.opendev.org/#/c/724731/15//COMMIT_MSG | 17:46 |
zbr | i do have this already implemented for molecule and ansible-lint, and it gets broken often. | 17:46 |
*** ayoung has quit IRC | 17:47 | |
zbr | for tripleo is not practical yet. | 17:47 |
zbr | after they release, we can aim to do this, but only after. | 17:47 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: increase timeout to 15min https://review.opendev.org/729337 | 17:47 |
zbr | using `strategy: free` is a brave initiative (yep, i used the British meaning....) | 17:49 |
EmilienM | it's a rewritten free | 17:49 |
EmilienM | adapted to our installer | 17:49 |
openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: Not load tempest_test_blacklist when tempest_run_skipped is true https://review.opendev.org/729185 | 17:51 |
*** ayoung has joined #tripleo | 17:51 | |
weshay|ruck | arxcruz, becareful w/ ^ .. that means we'll have to scrape all the zuul and fs files and make sure the blacklists are captured | 17:53 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: ovn dbs https://review.opendev.org/707957 | 17:54 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: rabbitmq https://review.opendev.org/707958 | 17:54 |
arxcruz | weshay|ruck: yes, i'm aware, it will not load only when tempest_run_skipped is set to true, the default is false | 17:54 |
weshay|ruck | zbr, so rdo-tox-molecule is also busted? | 17:58 |
weshay|ruck | yup.. same issue | 17:58 |
zbr | weshay|ruck: as I said, anything related to docker on centos-8 | 17:59 |
weshay|ruck | zbr, bugs works for notification :) | 17:59 |
* weshay|ruck channels EmilienM | 18:00 | |
weshay|ruck | but thanks for fixing it :) | 18:00 |
* weshay|ruck channels me | 18:01 | |
*** ayoung has quit IRC | 18:06 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ci master: non-voting job for tripleo-build-containers-ubi-8 https://review.opendev.org/724193 | 18:07 |
*** ayoung has joined #tripleo | 18:10 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: cinder backup/volume https://review.opendev.org/707956 | 18:12 |
*** ysandeep is now known as ysandeep|away | 18:13 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: manila-share https://review.opendev.org/708357 | 18:13 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: mysql https://review.opendev.org/707955 | 18:13 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: haproxy bundle https://review.opendev.org/707953 | 18:13 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: redis bundle https://review.opendev.org/707954 | 18:13 |
*** gfidente|afk is now known as gfidente | 18:16 | |
lbragstad | EmilienM do you have time for a quick puppet-keystone question? | 18:17 |
EmilienM | shoot | 18:18 |
lbragstad | EmilienM what's the difference between puppet and puppet_x? https://opendev.org/openstack/puppet-keystone/src/branch/master/lib | 18:18 |
EmilienM | it means we have providers/types which are extensions to the existing modules | 18:20 |
lbragstad | and the puppet_x bits are the extensions | 18:21 |
EmilienM | it uses the puppet_x library which contains Puppet extensions | 18:21 |
lbragstad | ok | 18:21 |
EmilienM | I think it's a ruby thing | 18:21 |
EmilienM | lbragstad: https://www.rubydoc.info/gems/puppet/PuppetX | 18:21 |
lbragstad | EmilienM ok - i'm porting a version of https://review.opendev.org/#/c/329991/5 to puppet-keystone so that we can use it for the trusted_dashboard config setting | 18:22 |
lbragstad | and i have something that looks right to me, but when i use it in a stack update, it doesn't seem to work (the update applies cleanly, but doesn't incorporate the multi-line behavior) | 18:22 |
EmilienM | you said a quick question | 18:23 |
EmilienM | now there are 2 questions | 18:23 |
EmilienM | are you tricking me? | 18:23 |
mwhahaha | so complainy | 18:23 |
lbragstad | is this a test? | 18:23 |
mwhahaha | everything is a test with EmilienM | 18:23 |
EmilienM | let me look at it | 18:24 |
EmilienM | lbragstad: did you push a patch already? | 18:24 |
lbragstad | i haven't | 18:24 |
lbragstad | but i can grab a diff | 18:24 |
EmilienM | lbragstad: send your draft, I'll review it | 18:24 |
lbragstad | http://paste.openstack.org/show/793784/ | 18:25 |
EmilienM | lbragstad: did you deploy the changes on the overcloud nodes I suppose? | 18:28 |
EmilienM | how did you test your changes, by running the overcloud deploy command again? | 18:29 |
lbragstad | oh - no... i deploy the change on the undercloud | 18:29 |
lbragstad | but i am testing by applying a minor update (overcloud deploy) | 18:29 |
EmilienM | ok let's ignore overcloud now | 18:29 |
EmilienM | you applied the changed on the undercloud | 18:29 |
lbragstad | yeah | 18:29 |
openstackgerrit | Luke Short proposed openstack/tripleo-heat-templates master: Remove deprecated files and parameters. https://review.opendev.org/724877 | 18:30 |
EmilienM | did you run "openstack undercloud install" again so the change is applied to the keystone container, | 18:30 |
EmilienM | ? | 18:30 |
lbragstad | i updated /usr/share/openstack-puppet/modules/keystone with the changes in http://paste.openstack.org/show/793784/ and re-ran openstack overcloud deploy | 18:31 |
EmilienM | this is not enough | 18:31 |
lbragstad | with a parameter that specifies multiple trusted_dashboards | 18:31 |
EmilienM | the Puppet modules are deployed on each overcloud node | 18:31 |
*** ayoung has quit IRC | 18:31 | |
lbragstad | ok - yeah, that makes snese | 18:31 |
EmilienM | Puppet is applied within a temporary container, on the overcloud nodes | 18:31 |
lbragstad | but it uses the puppet modules that are installed on the overcloud nodes, right? | 18:32 |
EmilienM | correct | 18:32 |
lbragstad | so if i update them, those changes should get applied | 18:32 |
EmilienM | and IIUC you didn't apply your change into them | 18:32 |
EmilienM | yes | 18:32 |
EmilienM | that was a third question btw | 18:32 |
lbragstad | right - i was thinking the puppet modules on the undercloud were re-used | 18:32 |
EmilienM | :D | 18:32 |
lbragstad | i'm on a roll | 18:32 |
EmilienM | they aren't. | 18:32 |
EmilienM | any 4th question ? | 18:33 |
* lbragstad thinks | 18:33 | |
EmilienM | too late | 18:33 |
* EmilienM disappears in smoke | 18:33 | |
mwhahaha | http://hardysteven.blogspot.com/2016/08/tripleo-deploy-artifacts-and-puppet.html | 18:33 |
*** ayoung has joined #tripleo | 18:33 | |
lbragstad | thanks for the help - i'll go give that a shot | 18:33 |
EmilienM | mwhahaha: does it still work? | 18:33 |
mwhahaha | in theory | 18:33 |
mwhahaha | yes | 18:33 |
EmilienM | let me rephrase : | 18:33 |
EmilienM | is it tested? | 18:33 |
mwhahaha | is anything really tested | 18:34 |
* EmilienM goes back to debugging containers | 18:34 | |
mwhahaha | schrodinger's feature | 18:34 |
*** rcernin has quit IRC | 18:34 | |
mwhahaha | also speaking of things that are tested yet still fail | 18:34 |
* mwhahaha runs away | 18:34 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Add option to set custom ceph parameters for containers https://review.opendev.org/728953 | 18:39 |
openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-heat-templates stable/train: Stop nova placement during upgrade data tranfer https://review.opendev.org/729352 | 18:39 |
openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-heat-templates stable/train: FFWD: Introducer hybrid state for nova compute https://review.opendev.org/729353 | 18:39 |
*** chandankumar is now known as raukadah | 18:48 | |
fultonj | cloudnull: question on https://review.opendev.org/#/c/714217 | 18:57 |
fultonj | the mistral-based derive params could get user_inputs from the deployment plan | 18:58 |
fultonj | e.g. https://github.com/openstack/tripleo-common/blob/master/workbooks/derive_params_formulas.yaml#L598 | 18:58 |
fultonj | in the ansible version, did you have any ideas in mind on how to get the same values? | 18:59 |
fultonj | i see in https://review.opendev.org/#/c/714217 that you have playbook_parameters and I'd like to use these in https://review.opendev.org/#/c/719466/ | 19:00 |
fultonj | i have two ideas... | 19:00 |
fultonj | 1. i add an ansible module to get it from the deployment plan | 19:00 |
fultonj | 2. cloudnull tells be aboue some magic i'm overlooking and it's just there if use playbook_parameters.hci_profile or something like that | 19:01 |
fultonj | i will mock it in for now, but do you agree i'll need a new ansible module? | 19:02 |
fultonj | (i've confirmed for certain that it is in the deployment plan) | 19:03 |
*** jmasud has quit IRC | 19:03 | |
*** raildo has quit IRC | 19:04 | |
*** jmasud has joined #tripleo | 19:04 | |
cloudnull | the current implementation will take user_inputs, like so https://review.opendev.org/#/c/714217/2/plan-samples/plan-environment-derived-params.yaml@16 the input becomes an extravar provided to the playbook / role at runtime. | 19:04 |
cloudnull | does that suit the need? | 19:04 |
cloudnull | or do we want something additional that can be passed via the CLI? | 19:05 |
*** suuuper has quit IRC | 19:06 | |
fultonj | becomes an extravar provided to the playbook / role at runtime. | 19:06 |
fultonj | ? | 19:06 |
fultonj | that's the magic i was hoping you'd say | 19:06 |
fultonj | let me confirm that works... | 19:06 |
fultonj | cloudnull: i'll still need to mock it in i think for molecule | 19:07 |
fultonj | let me try it in the real deployment first | 19:07 |
cloudnull | likely | 19:07 |
openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-heat-templates stable/train: FFWD: post Leapp package fixups https://review.opendev.org/729358 | 19:12 |
fultonj | cloudnull: yes, that suits the need very nicely. thank you | 19:15 |
fultonj | i will now mock it in. i just wanted to make sure i was mocking something that would work in the real world. | 19:15 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: podman/create: do not include failed containers in containers_to_check https://review.opendev.org/729238 | 19:16 |
weshay|ruck | cloudnull, ever see "2020-05-19 03:46:02 | /usr/lib64/python3.6/importlib/_bootstrap.py:219: ImportWarning: can't resolve package from __spec__ or __package__, falling back on __name__ and __path__ | 19:17 |
weshay|ruck | " | 19:17 |
*** raildo has joined #tripleo | 19:19 | |
mwhahaha | not related | 19:19 |
mwhahaha | openstackclient is doing that | 19:20 |
mwhahaha | i've seen it all week | 19:20 |
openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-heat-templates stable/train: FFWD: Introduce hybrid state for nova compute https://review.opendev.org/729353 | 19:21 |
openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-heat-templates stable/train: FFWD: post Leapp package fixups https://review.opendev.org/729358 | 19:21 |
cloudnull | fultonj ++ | 19:22 |
cloudnull | weshay|ruck nope, | 19:22 |
weshay|ruck | k k | 19:22 |
cloudnull | we seeing that when we run tripleoclient ? | 19:23 |
*** ayoung has quit IRC | 19:25 | |
*** ayoung has joined #tripleo | 19:29 | |
openstackgerrit | Merged openstack/tripleo-ansible master: Improve deployer UX by limiting failure output potential https://review.opendev.org/714985 | 19:44 |
EmilienM | weshay|ruck: do we have a bug report for scenario001 on queens? | 19:47 |
EmilienM | 2020-05-19 10:20:06.431 31211 INFO heat.engine.resource [req-2b567de2-4033-4b3a-915b-da3ba44a3ae0 - - - - -] CREATE: StructuredDeploymentGroup "ControllerDeployment_Step2" [b1ca3ad6-8779-4010-89de-6aa1d7b76ab5] Stack "overcloud-AllNodesDeploySteps-5y7ku6ockahr" [27e3bc3a-848b-4df2-abc4-98f1a63fa7af] | 19:47 |
EmilienM | it has been failing on that forever | 19:47 |
EmilienM | I wonder why we ignore (nv) it | 19:47 |
weshay|ruck | I'm looking at it now | 19:48 |
EmilienM | it was passing on March 16th | 19:48 |
weshay|ruck | EmilienM, ya.. I checked in about those scenarios being nv.. it's been nv since 2018, /me thought we dropped it is as criteria | 19:48 |
EmilienM | https://review.opendev.org/#/c/712721/ | 19:48 |
weshay|ruck | because it's multinode | 19:48 |
weshay|ruck | and likey to time out | 19:48 |
EmilienM | this isn't a timeout now | 19:48 |
weshay|ruck | and we only wanted to maintain one multinode job | 19:48 |
weshay|ruck | now it's failing in the stack | 19:48 |
weshay|ruck | at the least the log I'm looking at | 19:49 |
weshay|ruck | oh look at that | 19:49 |
weshay|ruck | https://review.opendev.org/#/c/712721/ | 19:49 |
weshay|ruck | working | 19:49 |
weshay|ruck | 9 weeks ago | 19:49 |
weshay|ruck | we should have flipped it voting | 19:49 |
weshay|ruck | EmilienM, we have to be careful w/ that much multinode | 19:50 |
EmilienM | i wanted to rpm diff with a job failing 3 days later but logs are gone | 19:50 |
EmilienM | so | 19:50 |
EmilienM | 🤷 | 19:50 |
weshay|ruck | fak | 19:50 |
* weshay|ruck checks what we have running in promotion | 19:51 | |
weshay|ruck | EmilienM, https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-wednesday-weekend | 19:52 |
weshay|ruck | they are running here | 19:53 |
weshay|ruck | EmilienM, I propose we remove them from check | 19:53 |
weshay|ruck | when there is an issue w/ scenario001 multinode in queens it lands on cix | 19:53 |
weshay|ruck | kicking 4-5 multinode jobs in check .. is not a recipe for success as we've seen | 19:53 |
weshay|ruck | Evilien? | 19:55 |
*** ayoung has quit IRC | 19:55 | |
EmilienM | 🤷 | 19:55 |
fultonj | it's not friday yet | 19:55 |
*** waleedm_ has quit IRC | 19:58 | |
*** TrevorV has quit IRC | 20:01 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ci master: non-voting job for tripleo-build-containers-ubi-8 https://review.opendev.org/724193 | 20:03 |
weshay|ruck | EmilienM, I'm putting up a patch to remove multinode-scenario jobs in queens and just let the promotion jobs catch things | 20:05 |
*** gfidente has quit IRC | 20:05 | |
EmilienM | weshay|ruck: you just saved the planet | 20:08 |
weshay|ruck | heh | 20:08 |
EmilienM | 🤯 | 20:08 |
openstackgerrit | Merged openstack/tripleo-validations master: Remove the useless pytest import. https://review.opendev.org/728401 | 20:18 |
openstackgerrit | Merged openstack/puppet-tripleo stable/queens: CephRgw healthcheck aligned with ceph-ansible https://review.opendev.org/725281 | 20:18 |
openstackgerrit | Merged openstack/python-tripleoclient master: Ensure playbook execution respects CLI ENV vars https://review.opendev.org/728273 | 20:18 |
EmilienM | weshay|ruck: qq | 20:19 |
EmilienM | weshay|ruck: https://review.opendev.org/#/c/724193/ seems to be passing and made good progress | 20:19 |
EmilienM | weshay|ruck: I wonder if we could start building these images beside current kolla images | 20:20 |
*** paramite has quit IRC | 20:20 | |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Simplify the puppet invocation a bit https://review.opendev.org/722109 | 20:20 |
weshay|ruck | EmilienM, ya.. totally. but I suspect tripleo-repos is not laying down the right opstools repo | 20:20 |
weshay|ruck | EmilienM, tripleo-repos does not yet support http://mirror.centos.org/centos/8/opstools/x86_64/collectd-5/ | 20:21 |
weshay|ruck | I have a patch up.. but it's not done.. | 20:21 |
EmilienM | weshay|ruck: which patch? | 20:22 |
weshay|ruck | EmilienM, so yes.. I saw it was working earlier.. and we can replace the current master jobs.. but let's release ussuri first | 20:22 |
weshay|ruck | EmilienM, she's ugly like all my patches | 20:22 |
* weshay|ruck gets | 20:22 | |
weshay|ruck | turned out we didn't need it.. because of kolla, but /me gets | 20:22 |
openstackgerrit | Merged openstack/tripleo-docs master: Add automatic image format conversion notes https://review.opendev.org/727890 | 20:22 |
weshay|ruck | EmilienM, https://review.opendev.org/#/c/723673/ | 20:23 |
openstackgerrit | Merged openstack/tripleo-docs master: Updates to Bare Metal States in provisioning https://review.opendev.org/722327 | 20:24 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ci master: non-voting job for tripleo-build-containers-ubi-8 https://review.opendev.org/724193 | 20:24 |
EmilienM | weshay|ruck: what are we waiting for ussuri? | 20:26 |
EmilienM | a specific patch to land or? | 20:26 |
openstackgerrit | Merged openstack/tripleo-operator-ansible master: Ensure we export result only if we have an stdout https://review.opendev.org/728451 | 20:27 |
weshay|ruck | EmilienM, just time on our side.. slammed atm | 20:28 |
weshay|ruck | everyone is slammed | 20:28 |
EmilienM | np | 20:28 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Enable ConfigDebug in CI https://review.opendev.org/728946 | 20:28 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: ovn dbs https://review.opendev.org/707957 | 20:29 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: rabbitmq https://review.opendev.org/707958 | 20:29 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: cinder backup/volume https://review.opendev.org/707956 | 20:29 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: manila-share https://review.opendev.org/708357 | 20:29 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: mysql https://review.opendev.org/707955 | 20:29 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: haproxy bundle https://review.opendev.org/707953 | 20:29 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: redis bundle https://review.opendev.org/707954 | 20:29 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Run all noop opeartions in molecule testing. https://review.opendev.org/698526 | 20:29 |
openstackgerrit | Merged openstack/tripleo-common master: Enhance error messages when building containers https://review.opendev.org/728538 | 20:32 |
openstackgerrit | Merged openstack/tripleo-common stable/train: [stable-only] check for stack status IN_PROGRESS to retry https://review.opendev.org/726066 | 20:34 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-common stable/train: Improve error reporting for not_done jobs in buildah https://review.opendev.org/729384 | 20:34 |
openstackgerrit | wes hayutin proposed openstack/tripleo-heat-templates stable/queens: multinode scenario001/002 are adequately covered in promotion jobs https://review.opendev.org/729385 | 20:36 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-common stable/train: Provide container name when raising exceptions https://review.opendev.org/729386 | 20:36 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-common stable/train: Enhance error messages when building containers https://review.opendev.org/729387 | 20:37 |
EmilienM | cloudnull: ^ did the backport chain to train | 20:37 |
EmilienM | (clean cherry picks) | 20:37 |
openstackgerrit | wes hayutin proposed openstack/puppet-tripleo stable/queens: remove scenario001-004 queens multinode jobs https://review.opendev.org/729388 | 20:39 |
openstackgerrit | wes hayutin proposed openstack/tripleo-ci master: drop multinode scenario jobs from queens https://review.opendev.org/729390 | 20:44 |
weshay|ruck | https://review.opendev.org/#/q/topic:drop-queens-scenario1-4+(status:open+OR+status:merged) | 20:46 |
weshay|ruck | EmilienM, mwhahaha fyi ^ | 20:46 |
openstackgerrit | Merged openstack/instack-undercloud stable/queens: Remove trove firewall rule https://review.opendev.org/718605 | 20:48 |
openstackgerrit | Slawek Kaplonski proposed openstack/tripleo-heat-templates master: Deprecate old NeutronFirewallDriver option https://review.opendev.org/728444 | 20:51 |
*** jmasud has quit IRC | 20:53 | |
lbragstad | has anyone else noticed issues with node introspection with ovb recently (using CentOS 8 and master RDO packages) | 20:56 |
* lbragstad is full of questions today | 20:56 | |
mwhahaha | nope | 20:56 |
mwhahaha | i have noticed that ironic will eventually fail to introspect | 20:57 |
mwhahaha | but there's an error in ironic-inspector | 20:57 |
mwhahaha | dnsmasq gets confused | 20:57 |
lbragstad | http://paste.openstack.org/show/793787/ | 20:57 |
mwhahaha | but i've been doing introspection all week | 20:57 |
lbragstad | ok | 20:57 |
mwhahaha | check ironic-inspector for error | 20:57 |
mwhahaha | i saw that after about the 100th's node introspection | 20:58 |
mwhahaha | systemctl restart tripleo_ironic* addressed it tho | 20:58 |
mwhahaha | have you built/rebuilt your ipxe image recently? | 20:58 |
mwhahaha | i just did a new one and it fixed most of my power cycling problems | 20:58 |
mwhahaha | which was the most common thing i found | 20:59 |
*** jmasud has joined #tripleo | 20:59 | |
lbragstad | i haven't rebuilt my ipxe image recently | 21:00 |
lbragstad | http://paste.openstack.org/show/793788/ | 21:00 |
lbragstad | that does pop up in ironic-inspector.log though | 21:00 |
lbragstad | and it does look related to power cycling | 21:00 |
mwhahaha | i saw something similar i think but i was also getting a dnsmasq err | 21:01 |
lbragstad | i kicked my undercloud ironic services, trying again | 21:02 |
*** Goneri has quit IRC | 21:03 | |
*** jdandrea has quit IRC | 21:05 | |
openstackgerrit | Merged openstack/tripleo-common master: Do not disable RabbitMQ and OpsTools repos. https://review.opendev.org/728687 | 21:08 |
*** ccamacho has quit IRC | 21:09 | |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/train: Make /var/lib/mistral traversable by all users https://review.opendev.org/725884 | 21:09 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/train: Add retries to initial image fetch https://review.opendev.org/728550 | 21:09 |
*** xek has quit IRC | 21:10 | |
*** jmasud has quit IRC | 21:12 | |
openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-ansible stable/train: Correctly match openvswitch package https://review.opendev.org/729396 | 21:15 |
*** Goneri has joined #tripleo | 21:20 | |
openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-heat-templates master: Only enable leapp tasks when distribution is correct https://review.opendev.org/728390 | 21:22 |
*** raildo has quit IRC | 21:24 | |
openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-heat-templates stable/train: Correctly match openvswitch package https://review.opendev.org/729400 | 21:26 |
*** maciejjozefczyk has quit IRC | 21:31 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: add helpful debug info when fetching images https://review.opendev.org/729404 | 21:41 |
*** slaweq has quit IRC | 21:41 | |
openstackgerrit | ada cui proposed openstack/tripleo-heat-templates master: Bump hacking min version to 3.1.0 https://review.opendev.org/729405 | 21:41 |
weshay|ruck | bfournie, incoming https://bugs.launchpad.net/tripleo/+bug/1879577 | 21:48 |
openstack | Launchpad bug 1879577 in tripleo "Ussuri ovb deployment hangs in introspection step. " [Critical,Triaged] | 21:48 |
*** Goneri has quit IRC | 21:48 | |
bfournie | weshay|ruck: did this just start? | 21:50 |
weshay|ruck | bfournie, ya.. so this is ussuri.. we've seen it for a few days but we we've validating our shit is right and fixing a few things.. but this issue remains | 21:51 |
weshay|ruck | bfournie, me notes it's ussuri.. which should be really close to master which is getting passed the introspection.. could be something isn't tagged right w/ ussuri packages.. | 21:51 |
weshay|ruck | etc.. | 21:51 |
bfournie | weshay|ruck: k will look | 21:52 |
weshay|ruck | https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-ussuri | 21:52 |
weshay|ruck | I'm a little suspicious of the image to be honest | 21:52 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-operator-ansible master: Add operator for tripleo container image build https://review.opendev.org/729408 | 21:59 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: WIP - fs052: add build_container_images https://review.opendev.org/729410 | 22:04 |
openstackgerrit | John Fulton proposed openstack/tripleo-ansible master: WIP Create derived parameters playbook, and role https://review.opendev.org/719466 | 22:07 |
*** jfrancoa has quit IRC | 22:12 | |
*** alexmcleod has quit IRC | 22:12 | |
*** jmasud has joined #tripleo | 22:20 | |
*** jmasud has quit IRC | 22:24 | |
*** holser has quit IRC | 22:31 | |
*** holser has joined #tripleo | 22:33 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-operator-ansible master: Add operator for tripleo container image build https://review.opendev.org/729408 | 22:41 |
openstackgerrit | Merged openstack/tripleo-ansible master: tripleo_container_manage: increase timeout to 15min https://review.opendev.org/729337 | 22:43 |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: DNM: Skip old-style interface/bridge config for new rhel/centos https://review.opendev.org/729415 | 22:50 |
openstackgerrit | Merged openstack/python-tripleoclient master: Fix some pep8 errors https://review.opendev.org/727651 | 22:56 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Split QDR environment from collectd https://review.opendev.org/722130 | 22:56 |
openstackgerrit | Merged openstack/python-tripleoclient master: Bump hacking min version to 3.0.1 https://review.opendev.org/729104 | 22:56 |
*** rcernin has joined #tripleo | 22:56 | |
*** jmasud has joined #tripleo | 23:00 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: DNM: Skip old-style interface/bridge config for new rhel/centos https://review.opendev.org/729415 | 23:05 |
weshay|ruck | hjensas, should we release an updated ovb? https://review.opendev.org/#/c/729420/ | 23:14 |
openstackgerrit | Merged openstack/tripleo-ansible master: Correctly match openvswitch package https://review.opendev.org/728906 | 23:16 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: DNM, test ovb master https://review.opendev.org/729422 | 23:17 |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: DNM: Skip old-style interface/bridge config for new rhel/centos https://review.opendev.org/729415 | 23:21 |
*** holser has quit IRC | 23:30 | |
*** ramishra has quit IRC | 23:32 | |
*** lbragstad has quit IRC | 23:38 | |
weshay|ruck | https://review.opendev.org/#/q/topic:remove_tripleo_jobs_occ+(status:open+OR+status:merged) | 23:41 |
weshay|ruck | mwhahaha, ^ | 23:41 |
hjensas | weshay|ruck: I'm not convinced it will help, I think these jobs use the image 'bmc-template' or something in rdocloud? We may want to get an updated version of that, with latest pyghmi etc. | 23:46 |
weshay|ruck | hjensas, aye.. agree | 23:46 |
weshay|ruck | it's pretty old | 23:46 |
mwhahaha | might also try updating the ipxe image with a new one | 23:47 |
mwhahaha | we added some fixes for that recently as well | 23:47 |
hjensas | ack, ipxe image would be good to update. | 23:47 |
mwhahaha | i appear to have just broken my ovb instance internally | 23:49 |
* mwhahaha gives up for the day and hopes the cloud is happier tomorrow | 23:49 | |
weshay|ruck | bmc-base bmc-template | 23:49 |
weshay|ruck | hjensas, it's working in master.. which is dam close to ussuri.. but still we can update them | 23:52 |
* weshay|ruck thinks it's something related to ussuri not specified.. but can't find shit | 23:52 | |
weshay|ruck | hjensas, the bmc logs are way off from each other | 23:52 |
hjensas | weshay|ruck: I wonder if the BMC log on ussuri is scrolling off buffer, the job does timeout and it's reporting "False" i.e "powered off" if I'm not mistaken. | 23:55 |
weshay|ruck | ah maybe | 23:55 |
hjensas | weshay|ruck: I can try the reproducer stuff tomorrow. I need to get to bed now, early dentist appointment tomorrow. | 23:55 |
weshay|ruck | 0/ | 23:56 |
weshay|ruck | thanks for the quick response | 23:56 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!