| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Set keystone notification topics if ceilometer is enabled https://review.openstack.org/519366 | 00:07 |
|---|---|---|
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731282 | 00:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731456 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731540 | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 00:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 00:10 |
| openstack | Launchpad bug 1731282 in tripleo "fs24 ovb jobs failing on overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 00:10 |
| openstack | Launchpad bug 1731456 in tripleo "Timed out CI jobs not collecting logs, "FAILED with status: 137"" [Critical,Triaged] | 00:10 |
| openstack | Launchpad bug 1731540 in tripleo "CI: Deployment times out because signal back to undercloud fails with a connection timed out" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 00:10 |
| *** achadha_ has quit IRC | 00:11 | |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Fix featureset024 to deploy Ceph not in containers via puppet-ceph https://review.openstack.org/519301 | 00:15 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Fix logrotate containers log https://review.openstack.org/519368 | 00:15 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-quickstart-extras master: Don't try to start docker for the UC https://review.openstack.org/519441 | 00:17 |
| *** myoung|bbl is now known as myoung | 00:20 | |
| *** gbarros has joined #tripleo | 00:27 | |
| *** rlandy|rover is now known as rlandy|rover|bbl | 00:30 | |
| *** Goneri has quit IRC | 00:31 | |
| *** gbarros has quit IRC | 00:32 | |
| *** dsneddon has quit IRC | 00:38 | |
| *** zshi has joined #tripleo | 00:41 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Enable horizon plugins by default in docker https://review.openstack.org/514421 | 00:48 |
| openstackgerrit | Merged openstack/os-net-config master: Add support for VPP Bond https://review.openstack.org/513972 | 00:48 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/newton: Drop extraconfig for nova-nuage https://review.openstack.org/503136 | 00:48 |
| openstackgerrit | Merged openstack/instack-undercloud master: Updated from global requirements https://review.openstack.org/519100 | 00:48 |
| openstackgerrit | Tom Barron proposed openstack/tripleo-heat-templates stable/pike: Enable horizon plugins by default in docker https://review.openstack.org/519445 | 00:59 |
| *** jkilpatr has quit IRC | 01:05 | |
| *** cshastri has joined #tripleo | 01:08 | |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731456 | 01:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731540 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 01:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 01:10 |
| openstack | Launchpad bug 1731456 in tripleo "Timed out CI jobs not collecting logs, "FAILED with status: 137"" [Critical,Triaged] | 01:10 |
| openstack | Launchpad bug 1731540 in tripleo "CI: Deployment times out because signal back to undercloud fails with a connection timed out" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 01:10 |
| *** moshele has joined #tripleo | 01:13 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Ensure that network.device type exists before using it https://review.openstack.org/508881 | 01:28 |
| *** ecerquei has joined #tripleo | 01:32 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Use 'NeutronTenantNetwork' instead of 'NeutronApiNetwork' for ovn-encap-ip https://review.openstack.org/519331 | 01:38 |
| *** rwsu has joined #tripleo | 01:39 | |
| EmilienM | mwhahaha: why do we have promotion blocker on https://bugs.launchpad.net/tripleo/+bug/1724328 ? | 01:43 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 01:43 |
| EmilienM | ah because it blocks stable/ocata gate? | 01:44 |
| mwhahaha | EmilienM: weshay added it because it blocks rdo adopting | 01:44 |
| mwhahaha | Rdo cloud adoption rather | 01:45 |
| EmilienM | mwhahaha: ok | 01:45 |
| EmilienM | mwhahaha: https://bugs.launchpad.net/tripleo/+bug/1731032 - do we have an e-r query? | 01:45 |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 01:45 |
| mwhahaha | Newton had a problem preventing ovb stuff | 01:45 |
| EmilienM | therve, zaneb : could you please review https://review.openstack.org/#/c/519417/ asap | 01:46 |
| mwhahaha | EmilienM: there's already one for the timeout I think. Of course e-r patches are stale | 01:46 |
| EmilienM | ok | 01:46 |
| EmilienM | mwhahaha: we need to ping pabelanger or clarkb | 01:46 |
| mwhahaha | EmilienM that is something we should document so that the ruck/rover can do it | 01:47 |
| EmilienM | ++ | 01:49 |
| *** moshele has quit IRC | 01:50 | |
| *** moshele has joined #tripleo | 01:56 | |
| *** artom_ has joined #tripleo | 02:01 | |
| *** moshele has quit IRC | 02:07 | |
| *** bfournie has joined #tripleo | 02:09 | |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731456 | 02:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731540 | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 02:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 02:10 |
| openstack | Launchpad bug 1731456 in tripleo "Timed out CI jobs not collecting logs, "FAILED with status: 137"" [Critical,Triaged] | 02:10 |
| openstack | Launchpad bug 1731540 in tripleo "CI: Deployment times out because signal back to undercloud fails with a connection timed out" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 02:10 |
| *** bfournie has left #tripleo | 02:11 | |
| *** links has joined #tripleo | 02:17 | |
| *** bfournie has joined #tripleo | 02:18 | |
| openstackgerrit | Remo Mattei proposed openstack/tripleo-docs master: Adding custom image steps by adding an example of dependency repo. https://review.openstack.org/519456 | 02:19 |
| *** rfolco has quit IRC | 02:19 | |
| *** gvrangan has joined #tripleo | 02:22 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-quickstart-extras master: Don't try to start docker for the UC https://review.openstack.org/519441 | 02:23 |
| *** bkopilov has quit IRC | 02:25 | |
| *** yamahata has quit IRC | 02:30 | |
| *** gvrangan has quit IRC | 02:49 | |
| *** rlandy|rover|bbl is now known as rlandy|rover | 02:51 | |
| *** gvrangan has joined #tripleo | 02:52 | |
| *** fzdarsky_ has joined #tripleo | 02:57 | |
| *** fzdarsky has quit IRC | 02:59 | |
| *** gvrangan has quit IRC | 03:02 | |
| *** fragatina has quit IRC | 03:03 | |
| *** fragatina has joined #tripleo | 03:03 | |
| *** fragatin_ has joined #tripleo | 03:07 | |
| *** fragatina has quit IRC | 03:07 | |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731456 | 03:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731540 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 03:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 03:10 |
| openstack | Launchpad bug 1731456 in tripleo "Timed out CI jobs not collecting logs, "FAILED with status: 137"" [Critical,Triaged] | 03:10 |
| openstack | Launchpad bug 1731540 in tripleo "CI: Deployment times out because signal back to undercloud fails with a connection timed out" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 03:10 |
| *** fragatin_ has quit IRC | 03:11 | |
| *** gbarros has joined #tripleo | 03:18 | |
| *** gvrangan has joined #tripleo | 03:19 | |
| *** bfournie has quit IRC | 03:20 | |
| *** bfournie has joined #tripleo | 03:20 | |
| *** itlinux has joined #tripleo | 03:23 | |
| *** bfournie has quit IRC | 03:23 | |
| itlinux | hello all I have created this section https://review.openstack.org/#/c/519456/ | 03:23 |
| *** fragatina has joined #tripleo | 03:25 | |
| *** fragatina has quit IRC | 03:29 | |
| itlinux | hello all.. I need to create multiple regions or have a few cells2 any tips on how to do it with OOO? | 03:32 |
| itlinux | guides..etc.. | 03:32 |
| *** rlandy|rover has quit IRC | 03:32 | |
| *** zshi has quit IRC | 03:34 | |
| *** zshi_ has joined #tripleo | 03:40 | |
| *** psahoo has joined #tripleo | 03:40 | |
| *** ramishra has joined #tripleo | 03:43 | |
| *** bkopilov has joined #tripleo | 03:48 | |
| *** ramishra_ has joined #tripleo | 04:01 | |
| *** itlinux has quit IRC | 04:03 | |
| *** gvrangan has quit IRC | 04:03 | |
| *** ramishra has quit IRC | 04:03 | |
| *** udesale has joined #tripleo | 04:04 | |
| *** itlinux has joined #tripleo | 04:04 | |
| *** gvrangan has joined #tripleo | 04:05 | |
| *** gvrangan has quit IRC | 04:07 | |
| *** cmyster has quit IRC | 04:07 | |
| *** itlinux has quit IRC | 04:09 | |
| *** gvrangan has joined #tripleo | 04:09 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731456 | 04:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731540 | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 04:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 04:10 |
| openstack | Launchpad bug 1731456 in tripleo "Timed out CI jobs not collecting logs, "FAILED with status: 137"" [Critical,Triaged] | 04:10 |
| openstack | Launchpad bug 1731540 in tripleo "CI: Deployment times out because signal back to undercloud fails with a connection timed out" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 04:10 |
| *** mdnadeem has joined #tripleo | 04:12 | |
| *** shreshtha has joined #tripleo | 04:17 | |
| *** ykarel has joined #tripleo | 04:18 | |
| openstackgerrit | Keith Schincke proposed openstack/puppet-tripleo master: Update cephx keys with ACLs for openstack services. https://review.openstack.org/519531 | 04:18 |
| *** psachin has joined #tripleo | 04:18 | |
| *** ecerquei has quit IRC | 04:19 | |
| openstackgerrit | Keith Schincke proposed openstack/tripleo-heat-templates master: Set restrictive file permissions on Ceph keyrings for non-containerized deployment https://review.openstack.org/509020 | 04:20 |
| *** itlinux has joined #tripleo | 04:20 | |
| *** dbecker has quit IRC | 04:23 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/519189 | 04:23 |
| colonwq | mwhahaha, I think 509020 and (the new) 519531 will work well for the ACL issue. It even fixes the satfacl typo. ... I hope. | 04:26 |
| mwhahaha | colonwq: ok I'll take a look | 04:26 |
| *** skramaja has joined #tripleo | 04:26 | |
| colonwq | mwhahaha, thanks. I'm calling it a day. See you all in the morning. | 04:27 |
| *** cylopez has quit IRC | 04:29 | |
| *** chlong has quit IRC | 04:37 | |
| *** dbecker has joined #tripleo | 04:38 | |
| *** psachin has quit IRC | 04:38 | |
| *** ramishra_ has quit IRC | 04:38 | |
| *** ramishra has joined #tripleo | 04:39 | |
| *** pdeore has joined #tripleo | 04:39 | |
| *** etingof has quit IRC | 04:40 | |
| *** gvrangan has quit IRC | 04:44 | |
| *** gvrangan has joined #tripleo | 04:44 | |
| *** psachin has joined #tripleo | 04:46 | |
| *** ramishra has quit IRC | 04:51 | |
| *** itlinux has quit IRC | 04:52 | |
| *** etingof has joined #tripleo | 04:53 | |
| *** ramishra has joined #tripleo | 04:53 | |
| *** gbarros has quit IRC | 04:55 | |
| *** gvrangan has quit IRC | 05:01 | |
| *** abregman has quit IRC | 05:07 | |
| *** gvrangan has joined #tripleo | 05:09 | |
| *** tzumainn has quit IRC | 05:10 | |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 05:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731456 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731540 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 05:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 05:10 |
| openstack | Launchpad bug 1731456 in tripleo "Timed out CI jobs not collecting logs, "FAILED with status: 137"" [Critical,Triaged] | 05:10 |
| openstack | Launchpad bug 1731540 in tripleo "CI: Deployment times out because signal back to undercloud fails with a connection timed out" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 05:10 |
| *** gvrangan has quit IRC | 05:13 | |
| *** jaganathan has joined #tripleo | 05:23 | |
| *** yamahata has joined #tripleo | 05:31 | |
| *** janki has joined #tripleo | 05:34 | |
| *** dpawar has joined #tripleo | 05:38 | |
| *** masco has joined #tripleo | 05:42 | |
| *** morazi has joined #tripleo | 05:51 | |
| *** moshele has joined #tripleo | 05:51 | |
| *** marios has joined #tripleo | 05:53 | |
| *** marios has quit IRC | 05:54 | |
| *** marios has joined #tripleo | 05:55 | |
| *** ratailor has joined #tripleo | 06:00 | |
| *** morazi has quit IRC | 06:04 | |
| *** janki has quit IRC | 06:05 | |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731456 | 06:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731540 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 06:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 06:10 |
| openstack | Launchpad bug 1731456 in tripleo "Timed out CI jobs not collecting logs, "FAILED with status: 137"" [Critical,Triaged] | 06:10 |
| openstack | Launchpad bug 1731540 in tripleo "CI: Deployment times out because signal back to undercloud fails with a connection timed out" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 06:10 |
| *** enrraja has joined #tripleo | 06:11 | |
| *** bfournie has joined #tripleo | 06:14 | |
| *** janki has joined #tripleo | 06:20 | |
| *** giulivo^3rd has joined #tripleo | 06:22 | |
| *** gfidente^2nd has quit IRC | 06:24 | |
| *** stendulker has joined #tripleo | 06:27 | |
| moshele | skramaja: hi | 06:30 |
| *** fzdarsky_ has quit IRC | 06:30 | |
| *** cmyster has joined #tripleo | 06:35 | |
| *** cmyster has quit IRC | 06:35 | |
| *** cmyster has joined #tripleo | 06:35 | |
| skramaja | moshele: hi | 06:38 |
| moshele | skramaja: we are trying to add ovs hw offload to tripleo and we have the following patches: https://review.openstack.org/#/c/518715/ https://review.openstack.org/#/c/518712/ | 06:39 |
| *** gfidente^2nd has joined #tripleo | 06:40 | |
| moshele | skramaja: it is almost working but we need to configure the compute with SR-IOV VFs | 06:40 |
| moshele | I added OS::TripleO::Services::NeutronSriovHostConfig: ../puppet/services/neutron-sriov-host-config.yaml and the NeutronSriovNumVFs but is not getting configure | 06:41 |
| skramaja | moshele: to which role? | 06:41 |
| moshele | skramaja: compute | 06:42 |
| skramaja | moshele: there is a ComputeSriov role added newly, you need to use it instead of regular compute | 06:42 |
| skramaja | moshele: https://github.com/openstack/tripleo-heat-templates/commit/739b05f52818028106fd1574be03a66a14c11153 | 06:42 |
| *** giulivo^3rd has quit IRC | 06:43 | |
| moshele | skramaja: but it is installing NeutronSriovAgent and I don't want it | 06:43 |
| moshele | skramaja: I just want to configure SR-IOV VF on the compute node | 06:43 |
| skramaja | NeutronSriovAgent will be enabled if you add nuetron-sriov.yaml environment file | 06:44 |
| skramaja | if you have ur env file which only maps NeutronSriovHostConfig, then it should work | 06:44 |
| moshele | skramaja: so I need to put the NeutronSriovNumVFs under ComputeSriov rule? | 06:45 |
| skramaja | moshele: in the latest, if you are using Compute, the sriov services are not added to it, either use ComputeSriov role or add sriov service to your roles_data.yaml | 06:45 |
| skramaja | yes moshele | 06:45 |
| moshele | skramaja: ok I will try it. thanks :) | 06:45 |
| skramaja | ok, let me know if you hit anything, could work it out. | 06:46 |
| moshele | skramaja: sure and thanks for the help | 06:46 |
| moshele | skramaja: so I guess I need to update this commit as well https://review.openstack.org/#/c/507401/9/environments/neutron-ovs-hw-offload.yaml right? | 06:47 |
| skramaja | yes moshele, correct. i missed it.. | 06:47 |
| moshele | skramaja: I will put it workflow -1 | 06:48 |
| openstackgerrit | Numan Siddique proposed openstack/tripleo-heat-templates master: OVN: Provide the option to define NeutronBridgeMappings as a role parameter https://review.openstack.org/518440 | 06:50 |
| *** florianf has joined #tripleo | 06:50 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: WIP Precreate /var/log/pacemaker/bundles https://review.openstack.org/519551 | 06:52 |
| openstackgerrit | Numan Siddique proposed openstack/tripleo-heat-templates stable/pike: Use 'NeutronTenantNetwork' instead of 'NeutronApiNetwork' for ovn-encap-ip https://review.openstack.org/519553 | 06:53 |
| *** dparkes has joined #tripleo | 06:54 | |
| jaosorior | bandini: jistr was doing this https://review.openstack.org/#/c/519419/ should then those entries change to use /var/log/containers/bundle ? | 06:54 |
| jaosorior | bandini: also this https://review.openstack.org/#/c/519418/ | 06:55 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor Loader component https://review.openstack.org/509181 | 06:55 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Layout components updates https://review.openstack.org/516361 | 06:55 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Modals with react-bootstrap https://review.openstack.org/516362 | 06:55 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Add/Update modal-related dependencies https://review.openstack.org/516363 | 06:55 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Rework ModalPanel to be based of react-overlays https://review.openstack.org/516364 | 06:55 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: ModalPanel vs Validations sidebar positioning https://review.openstack.org/516365 | 06:55 |
| *** cmyster has quit IRC | 06:56 | |
| jaosorior | cschwede: are you around? | 06:57 |
| bandini | jaosorior: I'll need to look at them a bit more in detail | 06:57 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-ui master: Imported Translations from Zanata https://review.openstack.org/519554 | 06:58 |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 07:00 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Remove httpd logs directory mounting from swift https://review.openstack.org/519556 | 07:00 |
| jaosorior | mandre: let me know when you're around | 07:01 |
| *** aditya_r has joined #tripleo | 07:01 | |
| *** rcernin has quit IRC | 07:02 | |
| *** pmannidi has quit IRC | 07:03 | |
| moshele | skramaja: another question to choose the compute sriov rule I need to update the profile:compute to profile:computesriov? | 07:05 |
| moshele | skramaja: in the ironic node I mean | 07:05 |
| skramaja | that is one way, other simpler would be adding OvercloudComputeSriovFlavor as 'compute' | 07:06 |
| skramaja | moshele: either ways it will work. | 07:07 |
| *** pgadiya has joined #tripleo | 07:08 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor Register nodes dialog to use redux-form https://review.openstack.org/504903 | 07:08 |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 07:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731456 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731540 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 07:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 07:10 |
| openstack | Launchpad bug 1731456 in tripleo "Timed out CI jobs not collecting logs, "FAILED with status: 137"" [Critical,Triaged] | 07:10 |
| openstack | Launchpad bug 1731540 in tripleo "CI: Deployment times out because signal back to undercloud fails with a connection timed out" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 07:10 |
| *** dparkes has quit IRC | 07:10 | |
| moshele | skramaja: so I can add OvercloudComputeSriovFlavor to the environments/neutron-opendaylight-hw-offload.yaml that I have created? | 07:11 |
| *** dparkes has joined #tripleo | 07:12 | |
| skramaja | moshele: this doesn't need to be added to the patch, only for your testing. your own env file. | 07:12 |
| moshele | skramaja: yes that what I meant | 07:12 |
| skramaja | ok. | 07:13 |
| *** aditya_r has quit IRC | 07:13 | |
| *** aditya_ra has joined #tripleo | 07:13 | |
| *** bfournie has quit IRC | 07:15 | |
| *** threestrands has quit IRC | 07:15 | |
| *** fragatina has joined #tripleo | 07:15 | |
| *** dparkes has quit IRC | 07:16 | |
| *** aditya_ra has quit IRC | 07:18 | |
| *** aditya_r has joined #tripleo | 07:19 | |
| *** fragatina has quit IRC | 07:20 | |
| *** fzdarsky has joined #tripleo | 07:27 | |
| jaosorior | mandre, bandini: is swift not containerized in CI? | 07:29 |
| openstackgerrit | Martin André proposed openstack/puppet-tripleo stable/pike: Fix logrotate containers log https://review.openstack.org/519564 | 07:31 |
| mandre | jaosorior: here | 07:31 |
| ratailor | https://review.openstack.org/#/c/511772/ | 07:32 |
| ratailor | https://review.openstack.org/#/c/511773/ | 07:32 |
| jaosorior | mandre: hey; was checking out how swift logs. And in CI I found something a bit strange. While in the manifests it's supposed to mount /var/log/containers/swift . I don't find that at all in the logs in CI http://logs.openstack.org/62/519362/3/check-tripleo/legacy-tripleo-ci-centos-7-ovb-containers-oooq/ff8ee18/logs/overcloud-controller-0/var/log/ it seems to use /var/log/swift instead. | 07:33 |
| ratailor | jaosorior, mandre Could you please review these pathces ^^. | 07:33 |
| *** ratailor is now known as ratailor|Lu | 07:33 | |
| *** ratailor|Lu is now known as ratailor|Lunch | 07:33 | |
| mandre | jaosorior: it seems you're right, swift is not containerized in CI | 07:33 |
| ratailor|Lunch | jaosorior, Thanks! | 07:34 |
| jaosorior | mandre: but, I'm a bit confused, since swift IS in docker.yaml. and the overcloud-deploy.sh has no indication of using another swift tempalte :/ | 07:34 |
| mandre | jaosorior: i was looking at the scenario jobs, apparently we need to explicitly enable containerized swift, let me check the ovb-containers-oooq job | 07:35 |
| jaosorior | oh | 07:36 |
| jaosorior | do we? | 07:36 |
| mandre | jaosorior: in the job you linked, swift runs in containers | 07:36 |
| mandre | jaosorior: http://logs.openstack.org/62/519362/3/check-tripleo/legacy-tripleo-ci-centos-7-ovb-containers-oooq/ff8ee18/logs/overcloud-controller-0/var/l | 07:36 |
| jaosorior | wha | 07:36 |
| mandre | http://logs.openstack.org/62/519362/3/check-tripleo/legacy-tripleo-ci-centos-7-ovb-containers-oooq/ff8ee18/logs/overcloud-controller-0/var/log/extra/docker/contain | 07:36 |
| flaper87 | mwhahaha: that was entirely my fault, I did it offline and I hadn't caught up with email. Sorry about that :) | 07:37 |
| jaosorior | mandre: does it? so why is swift logging there? O_o I also didn't find traces of the swift_proxy container actually being started in the messages log | 07:37 |
| *** ykarel is now known as ykarel|lunch | 07:37 | |
| jaosorior | mandre: you're right. the swift_proxy container is running. | 07:38 |
| jaosorior | mandre: and it mounts the right files and everything http://logs.openstack.org/62/519362/3/check-tripleo/legacy-tripleo-ci-centos-7-ovb-containers-oooq/ff8ee18/logs/overcloud-controller-0/var/log/extra/docker/containers/swift_proxy/docker_info.log.txt.gz what the hell | 07:39 |
| jaosorior | so where is /var/log/containers/swift O_o | 07:40 |
| *** jprovazn has joined #tripleo | 07:40 | |
| * mandre looking | 07:40 | |
| jaosorior | mandre: and here's the funkiest part. By default swift actually logs to syslog. So I don't even know where /var/log/swift comes from | 07:43 |
| *** yprokule has joined #tripleo | 07:46 | |
| *** ccamacho has quit IRC | 07:46 | |
| *** ccamacho has joined #tripleo | 07:46 | |
| mandre | jaosorior: hmm, could it be an issue with the log collection? I do not see a swift process running on the host, and everything in the containers point to /var/log/containers/swift | 07:46 |
| jaosorior | ok | 07:46 |
| jaosorior | mandre: it might be. I didn't find anything in tripleo-quickstart-extras though | 07:47 |
| mandre | and /var/log/containers/swift is missing... but it should really be created | 07:47 |
| mandre | weird | 07:47 |
| jaosorior | mandre: exactly | 07:47 |
| jaosorior | mandre: but, again, what confuses me the most is where these text logs are even coming from; since it should be logging to syslog | 07:48 |
| mandre | ¯\_(ツ)_/¯ | 07:49 |
| jaosorior | mandre: got it! | 07:50 |
| jaosorior | swift configures rsyslog from the host | 07:50 |
| bandini | mandre: https://review.openstack.org/#/c/519261/ if you have a min (simple one, promise ;) | 07:51 |
| jaosorior | and since swift logs to the host's /dev/log, rsyslog picks it up and logs everything to /var/log/swift | 07:51 |
| mandre | jaosorior: wow, that's not confusing at all | 07:52 |
| bandini | lol | 07:52 |
| jaosorior | mandre: lol it's really logical, right? | 07:52 |
| *** cylopez has joined #tripleo | 07:52 | |
| jaosorior | mandre: so basically what this means is that the bind-mounting of /var/log/containers/swift is useless | 07:52 |
| jaosorior | mandre: because of this http://logs.openstack.org/62/519362/3/check-tripleo/legacy-tripleo-ci-centos-7-ovb-containers-oooq/ff8ee18/logs/overcloud-controller-0/etc/rsyslog.d/openstack-swift.conf.txt.gz | 07:53 |
| *** ccamacho has quit IRC | 07:53 | |
| jaosorior | I'm guessing that comes from the swift's RPM | 07:53 |
| mandre | bandini: sure | 07:53 |
| *** dparkes has joined #tripleo | 07:54 | |
| *** mrch has joined #tripleo | 07:54 | |
| jaosorior | yep, sure does https://github.com/rdo-packages/swift-distgit/blob/110f4a22d45bf0ea2da85c67e04bb73f44fd49fc/openstack-swift.spec#L264 | 07:54 |
| mandre | jaosorior: yay for the snowflakes | 07:55 |
| jaosorior | snowflakes? | 07:56 |
| *** jfrancoa has joined #tripleo | 07:56 | |
| mandre | jaosorior: for swift being an exception | 07:57 |
| jaosorior | ah | 07:57 |
| mandre | so what should we do about it? symlink /var/log/swift to /var/log/containers/swift instead of creating the dir? | 07:57 |
| jaosorior | that would be an option | 07:57 |
| jaosorior | lets give it a try | 07:58 |
| jaosorior | mandre: I'll push a patch in a bit | 07:59 |
| mandre | jistr: ^^ containerized swift still logs to /var/log/swift on the host | 07:59 |
| jaosorior | jistr: I had +Aed your patches, but removed it so bandini could take a look before that. | 07:59 |
| marios | chem: o/ are we going to reinstate this i saw you rebased it https://review.openstack.org/#/c/495658/9 | 08:00 |
| *** mcornea has joined #tripleo | 08:01 | |
| jaosorior | mandre: is there an LP bug that I should link to in the commit? | 08:02 |
| openstackgerrit | Merged openstack/tripleo-docs master: Upgrades developer documentation layout. https://review.openstack.org/517916 | 08:03 |
| mandre | jaosorior: we'll need to create one | 08:05 |
| jaosorior | ok | 08:05 |
| jaosorior | cause we probably need to backport it | 08:05 |
| *** d0ugal has quit IRC | 08:06 | |
| *** ebarrera has joined #tripleo | 08:09 | |
| mandre | jaosorior: and I just checked, we *do* run containerized swift in scenario002-containers even if they're not explicitly enabled | 08:09 |
| jaosorior | mandre: right, it's part of docker.yaml | 08:09 |
| jaosorior | mandre: so it's always containerized if we enable containerized services. It was just confusing cause of the logging part. | 08:09 |
| mandre | yep | 08:10 |
| *** pcaruana has joined #tripleo | 08:10 | |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731456 | 08:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731540 | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 08:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 08:10 |
| openstack | Launchpad bug 1731456 in tripleo "Timed out CI jobs not collecting logs, "FAILED with status: 137"" [Critical,Triaged] | 08:10 |
| openstack | Launchpad bug 1731540 in tripleo "CI: Deployment times out because signal back to undercloud fails with a connection timed out" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 08:10 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Polish swift containers logging configuration https://review.openstack.org/519577 | 08:14 |
| jaosorior | mandre: what about this ^^ ?? | 08:14 |
| *** aufi has joined #tripleo | 08:14 | |
| *** tesseract has joined #tripleo | 08:15 | |
| jaosorior | mandre: or did you mean for the symlink to be the opposite? | 08:15 |
| *** paramite has joined #tripleo | 08:16 | |
| *** psahoo has quit IRC | 08:17 | |
| *** links has quit IRC | 08:17 | |
| *** cylopez has left #tripleo | 08:19 | |
| mandre | jaosorior: should be ok both ways | 08:21 |
| mandre | jaosorior: don't we collect the logs for the tls proxy? | 08:21 |
| *** marios has quit IRC | 08:23 | |
| jaosorior | mandre: apparently not | 08:23 |
| jaosorior | mandre: for any proxy it seems :/ | 08:23 |
| jaosorior | * the plot thickens * | 08:23 |
| *** marios has joined #tripleo | 08:25 | |
| mandre | bandini: can you check https://review.openstack.org/#/c/519418/ when you have time? | 08:27 |
| mandre | jaosorior: hmmf | 08:27 |
| mandre | jaosorior: while we're fixing logs, https://review.openstack.org/#/c/519564/ | 08:28 |
| jaosorior | done | 08:28 |
| jaosorior | testing the swift patch now | 08:28 |
| mandre | jaosorior: ack, I'll create a bug if you haven't done so already | 08:29 |
| jaosorior | I haven't | 08:29 |
| bandini | mandre: yep will do this morning | 08:29 |
| mandre | bandini: grazie | 08:30 |
| *** links has joined #tripleo | 08:31 | |
| *** shardy has joined #tripleo | 08:31 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/diskimage-builder master: elements: Respect devpts mount options https://review.openstack.org/518749 | 08:32 |
| *** psahoo has joined #tripleo | 08:33 | |
| *** fzdarsky has quit IRC | 08:38 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Polish swift containers logging configuration https://review.openstack.org/519577 | 08:40 |
| *** agurenko has joined #tripleo | 08:43 | |
| *** ykarel|lunch is now known as ykarel | 08:43 | |
| *** yamahata has quit IRC | 08:44 | |
| *** bogdando has joined #tripleo | 08:46 | |
| *** ratailor|Lunch is now known as ratailor | 08:48 | |
| *** amoralej|off is now known as amoralej | 08:50 | |
| *** jpena|off is now known as jpena | 08:52 | |
| jaosorior | mandre: worked. | 08:55 |
| mandre | jaosorior: I was thinking... if we remove the swift packages from the host, then we don't log to files anymore... | 08:56 |
| jaosorior | mandre: correct. | 08:57 |
| mandre | jaosorior: will your ryslog container help in that case? | 08:57 |
| *** jpich has joined #tripleo | 08:57 | |
| jaosorior | mandre: it might | 08:58 |
| jaosorior | mandre: we could actually use it and redirect all the output of it to swift.log | 08:58 |
| jaosorior | mandre: we could use this workaround for OSP12. and for OSP13 rely on the syslog container | 08:58 |
| mandre | yeah | 08:58 |
| jaosorior | mandre: did you create an LP bug? | 08:59 |
| mandre | jaosorior: doing it now | 08:59 |
| jaosorior | cool cool | 08:59 |
| *** fzdarsky has joined #tripleo | 09:00 | |
| Tengu | \o/ I think my apache base profile will merge in stale/pike in a few minutes \o/ | 09:02 |
| Tengu | it's a good day to merge. | 09:02 |
| mandre | jaosorior: https://bugs.launchpad.net/tripleo/+bug/1732107 | 09:04 |
| openstack | Launchpad bug 1732107 in tripleo "containerized swift still logs to /var/log/swift" [High,Triaged] | 09:04 |
| *** percevalbot has quit IRC | 09:05 | |
| *** psahoo has quit IRC | 09:06 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Polish swift containers logging configuration https://review.openstack.org/519577 | 09:07 |
| *** links has quit IRC | 09:07 | |
| jaosorior | mandre: thanks | 09:07 |
| *** percevalbot has joined #tripleo | 09:08 | |
| mandre | jaosorior: thanks to you! | 09:08 |
| jaosorior | mandre: could you check these out https://review.openstack.org/#/q/topic:bp/logging-stdout-rsyslog+status:open ? | 09:08 |
| openstackgerrit | Jose Luis Franco proposed openstack-infra/tripleo-ci master: WIP: Upgrade UC and OC using tripleo-upgrade role https://review.openstack.org/515643 | 09:08 |
| mandre | jaosorior: a little bit later, I promise :) | 09:09 |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731456 | 09:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731540 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 09:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 09:10 |
| openstack | Launchpad bug 1731456 in tripleo "Timed out CI jobs not collecting logs, "FAILED with status: 137"" [Critical,Triaged] | 09:10 |
| openstack | Launchpad bug 1731540 in tripleo "CI: Deployment times out because signal back to undercloud fails with a connection timed out" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 09:10 |
| *** aditya_r has quit IRC | 09:12 | |
| apetrich | tripleo-common tox is failing on master | 09:15 |
| *** cylopez has joined #tripleo | 09:18 | |
| *** ccamacho has joined #tripleo | 09:20 | |
| *** links has joined #tripleo | 09:21 | |
| gchamoul | /AAWAY AFK|DocAppointment | 09:21 |
| *** suuuper has joined #tripleo | 09:21 | |
| * gchamoul hides | 09:22 | |
| *** psahoo has joined #tripleo | 09:23 | |
| Tengu | :D | 09:23 |
| jistr | bandini: hi, i'm not very familiar with how the pacemaker bundles work. What would you suggest re https://review.openstack.org/#/c/519419/ ? Do you think it would be better to leave it as-is, at least for now? Mainly i'd like to get https://review.openstack.org/#/c/518584/ merged ASAP, i wanted to deal with the inconsistent locations first so that we don't have so many patches, but we can do the readme patch | 09:24 |
| jistr | first (which would mean skipping redis and galera). | 09:24 |
| * jistr leans towards switching the patch order indeed, getting the readme.txt patch merged today :) | 09:25 | |
| openstackgerrit | Martin André proposed openstack/tripleo-quickstart-extras master: Switch to tripleomaster registry by default https://review.openstack.org/519593 | 09:26 |
| *** tosky has joined #tripleo | 09:27 | |
| *** dsneddon has joined #tripleo | 09:27 | |
| bandini | jistr: agreed let's get the readme.txt merged first. about 519419, I'd like to think it through a bit more with dciabrin (we started this morning but need a bit more time) | 09:29 |
| jistr | bandini: sounds good, thanks :) | 09:29 |
| *** aditya_r has joined #tripleo | 09:30 | |
| bandini | thank you for fixing this stuff ;) | 09:30 |
| *** ffiore has joined #tripleo | 09:31 | |
| ratailor | https://review.openstack.org/#/c/511772/ | 09:33 |
| ratailor | https://review.openstack.org/#/c/511773/ | 09:33 |
| ratailor | jistr, marios pl review these ^^ one more +2 required. | 09:33 |
| *** derekh has joined #tripleo | 09:39 | |
| *** lucas-afk is now known as lucasagomes | 09:39 | |
| openstackgerrit | Or Idgar proposed openstack/tripleo-heat-templates master: Run Octavia configuration on the overcloud https://review.openstack.org/508195 | 09:39 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Write readme.txt into old log directories https://review.openstack.org/518584 | 09:39 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Create log directories for mysql and redis bundles https://review.openstack.org/519418 | 09:39 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Move logs to backup locations https://review.openstack.org/519342 | 09:39 |
| *** rfolco has joined #tripleo | 09:45 | |
| *** d0ugal has joined #tripleo | 09:46 | |
| openstackgerrit | Martin André proposed openstack/tripleo-quickstart-extras master: Switch to tripleomaster registry by default https://review.openstack.org/519593 | 09:46 |
| moshele | skramaja: hi | 09:47 |
| skramaja | yes moshele | 09:47 |
| moshele | skramaja: I am always getting warning that OvercloudComputeSriovFlavor is Defined and not used | 09:48 |
| moshele | skramaja: it for all ComputeSriov roles | 09:49 |
| moshele | skramaja: I can see the role in openstack overcloud role list | 09:49 |
| moshele | skramaja: what am I missing? | 09:50 |
| skramaja | moshele: you should have created your roles_data.yaml and provided via -r option, which should have ComputeSriov role | 09:50 |
| * skramaja looking for the command | 09:50 | |
| skramaja | moshele: openstack overcloud roles generate -o roles_data.yaml Controller ComputeSriov | 09:51 |
| *** d0ugal_ has joined #tripleo | 09:51 | |
| *** marios has quit IRC | 09:51 | |
| skramaja | mandre: this command will genereate the roles_data.yaml file which need to be provided as -r option with overcloud deploy command. | 09:51 |
| moshele | skramaja: haaa ok I will try it | 09:51 |
| skramaja | moshele: some samples - https://github.com/krsacme/tht-sriov/blob/master/lab-d/osp12/deploy.sh and https://github.com/krsacme/tht-sriov/blob/master/lab-d/osp12/roles_data.yaml | 09:52 |
| *** d0ugal has quit IRC | 09:52 | |
| *** marios has joined #tripleo | 09:53 | |
| moshele | skramaja: thanks | 09:54 |
| *** zaneb has quit IRC | 09:54 | |
| *** aufi has quit IRC | 09:55 | |
| jistr | jaosorior, mandre: can you re-vote @ https://review.openstack.org/#/c/518584/ when you have some bandwidth? I just removed pacemakerized redis and mysql from the patch, as that change could create upgrade issues, so we'll have to land those later. | 09:55 |
| *** cshastri has quit IRC | 09:55 | |
| *** aufi has joined #tripleo | 09:55 | |
| jpich | apetrich: It is failing for patches on gerrit as well, would you mind opening a bug if there isn't one already? | 09:58 |
| apetrich | jpich, trying to fix it if it's too much I will open a bug | 09:58 |
| jpich | apetrich: I'd open the bug anyway, it's useful for other people wondering what's going on and if it's just them | 09:59 |
| apetrich | jpich, true | 09:59 |
| jpich | I can do it tho | 09:59 |
| apetrich | jpich, no worries. I'm opening it | 10:00 |
| jpich | Thanks! | 10:00 |
| *** d0ugal_ is now known as dmatthew | 10:03 | |
| *** dmatthew has quit IRC | 10:03 | |
| openstackgerrit | Jose Luis Franco proposed openstack-infra/tripleo-ci master: WIP: Upgrade UC and OC using tripleo-upgrade role https://review.openstack.org/515643 | 10:03 |
| *** d0ugal has joined #tripleo | 10:04 | |
| jaosorior | jistr: done | 10:04 |
| jistr | jaosorior: thanks! | 10:04 |
| apetrich | jpich, done https://bugs.launchpad.net/tripleo/+bug/1732140 | 10:05 |
| openstack | Launchpad bug 1732140 in tripleo "Kolla tests failing for tripleo-common master" [Undecided,New] | 10:05 |
| *** sshnaidm is now known as sshnaidm|afk | 10:06 | |
| jaosorior | bogdando: hey, can you check this out https://review.openstack.org/#/c/519577/ ? | 10:07 |
| *** jfrancoa has quit IRC | 10:09 | |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731456 | 10:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731540 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 10:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 10:10 |
| openstack | Launchpad bug 1731456 in tripleo "Timed out CI jobs not collecting logs, "FAILED with status: 137"" [Critical,Triaged] | 10:10 |
| openstack | Launchpad bug 1731540 in tripleo "CI: Deployment times out because signal back to undercloud fails with a connection timed out" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 10:10 |
| *** aditya_r has quit IRC | 10:11 | |
| jpich | apetrich: Thanks! | 10:12 |
| openstackgerrit | Rajesh Tailor proposed openstack/tripleo-heat-templates master: Add ec2api to TLS everywhere services list https://review.openstack.org/519599 | 10:13 |
| *** hjensas has quit IRC | 10:13 | |
| *** hjensas has joined #tripleo | 10:14 | |
| *** aditya_r has joined #tripleo | 10:15 | |
| apetrich | jpich, thanks for triaging it | 10:15 |
| jpich | Np | 10:16 |
| *** oidgar has joined #tripleo | 10:17 | |
| *** salmankhan has joined #tripleo | 10:18 | |
| *** salmankhan has quit IRC | 10:26 | |
| *** ratailor has quit IRC | 10:26 | |
| *** ratailor_ has joined #tripleo | 10:26 | |
| *** aditya_r has quit IRC | 10:27 | |
| *** jfrancoa has joined #tripleo | 10:27 | |
| *** agurenko has quit IRC | 10:30 | |
| *** ykarel is now known as ykarel|afk | 10:31 | |
| openstackgerrit | Merged openstack/tripleo-ui master: Imported Translations from Zanata https://review.openstack.org/519554 | 10:32 |
| *** aditya_r has joined #tripleo | 10:33 | |
| shardy | jistr: Hey, good morning - I was going to take another look at https://review.openstack.org/#/c/516894/ w/keepalive but wanted to check that won't overlap with what you're working on? | 10:35 |
| jistr | shardy: thanks, feel free to go ahead, i was actually working on a BZ the last few days mainly. I plan to change my env back to k8s work shortly, hopefully tomorrow. I didn't get far on the external LB for k8s, just tried to deploy what you had but it didn't go all the way, and then i had to switch to the BZ.. | 10:37 |
| shardy | jistr: Ack ok I'll give it a try now and we can sync later | 10:38 |
| shardy | thanks | 10:38 |
| *** salmankhan has joined #tripleo | 10:39 | |
| *** skramaja has quit IRC | 10:40 | |
| *** salmankhan has quit IRC | 10:44 | |
| *** pblaho has quit IRC | 10:44 | |
| *** salmankhan has joined #tripleo | 10:44 | |
| *** d0ugal has quit IRC | 10:46 | |
| dpawar | Hi, for containerized Overcloud do i need to have containerized Undercloud? in other works, non-containerized Undercloud + containerized Overcloud - will this work ? | 10:47 |
| openstackgerrit | Rajesh Tailor proposed openstack/puppet-tripleo stable/pike: Add TLS for ec2api service https://review.openstack.org/519610 | 10:47 |
| shardy | dpawar: yes, that's the default setup, work on containerizing the undercloud is still in-progress | 10:47 |
| openstackgerrit | Rajesh Tailor proposed openstack/tripleo-heat-templates stable/pike: Enable TLS for ec2api service https://review.openstack.org/519611 | 10:47 |
| dpawar | shardy: Thanks for quick response ! | 10:48 |
| amoralej | we have updated openvswitch to 2.8 for master deps repo. We have run both tripleo and p-o-i jobs to test it but let us know if you observe any abnormal behaviour | 10:57 |
| *** jfrancoa has quit IRC | 11:00 | |
| *** udesale has quit IRC | 11:00 | |
| *** ratailor_ has quit IRC | 11:00 | |
| jpich | apetrich: Are you still looking into that bug? | 11:02 |
| *** pblaho has joined #tripleo | 11:04 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Enable in-cluster loadbalancing of kubernetes API https://review.openstack.org/518375 | 11:05 |
| apetrich | jpich, other than rename namespace to namespace1 I'm out of ideas. trying to figure out what caused it | 11:06 |
| jpich | apetrich: I updated the bug with what I found (new function 'namespace' added in Jinja2 2.10), I think renaming is the correct approach | 11:07 |
| *** aditya_ra has joined #tripleo | 11:07 | |
| apetrich | jpich, good. I will push a patch | 11:07 |
| jpich | If you have a patch ready, feel free to go for it, don't want to duplicate your work if that's the case :) | 11:07 |
| jpich | Great, cheers! | 11:08 |
| apetrich | %s/namespace/the_amazing_namespace/gi | 11:08 |
| jpich | le_namespace | 11:09 |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 11:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731456 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731540 | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 11:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 11:10 |
| openstack | Launchpad bug 1731456 in tripleo "Timed out CI jobs not collecting logs, "FAILED with status: 137"" [Critical,Triaged] | 11:10 |
| openstack | Launchpad bug 1731540 in tripleo "CI: Deployment times out because signal back to undercloud fails with a connection timed out" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 11:10 |
| *** aditya_r has quit IRC | 11:10 | |
| *** aditya_ra is now known as aditya_r | 11:12 | |
| *** aditya_r has quit IRC | 11:13 | |
| *** d0ugal has joined #tripleo | 11:15 | |
| *** jfrancoa has joined #tripleo | 11:15 | |
| jaosorior | mandre: weird; I would have though that /var/log/swift would be created as part of the swift package. It seems it's not: http://logs.openstack.org/77/519577/3/check/legacy-tripleo-ci-centos-7-scenario002-multinode-oooq-container/287dd94/logs/undercloud/var/log/postci.txt.gz works in some cases and not in others. Any suggestions? | 11:19 |
| *** dtantsur|afk is now known as dtantsur | 11:20 | |
| openstackgerrit | Adriano Petrich proposed openstack/tripleo-common master: Fix kolla tests https://review.openstack.org/519619 | 11:20 |
| shardy | jaosorior: in my environment it's owned by python-swift-2.15.2-0.20171102153831.449d83f.el7.centos.noarch | 11:21 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Polish swift containers logging configuration https://review.openstack.org/519577 | 11:21 |
| shardy | rpm -qf /var/log/swift | 11:21 |
| jaosorior | shardy: right, that's what I would have expected. For some reason, it failed cause the directory wasn't available. As you could see in the logs. | 11:22 |
| jaosorior | shardy: I addressed it by just making sure the directory's there in host_prep_tasks | 11:22 |
| shardy | jaosorior: is it because we've now cleaned up the overcloud-full image for container CI to not install the openstack service packages? | 11:23 |
| shardy | I know that was dicussed but I'm not sure if it happened yet | 11:23 |
| shardy | discussed | 11:23 |
| jaosorior | shardy: I didn't know it had happened actually | 11:23 |
| jaosorior | maybe? | 11:23 |
| shardy | jaosorior: ah, it's because we don't use overcloud-full for multinode jobs | 11:24 |
| shardy | and since puppet isn't installing swift on the baremetal anymore, there's no directory | 11:24 |
| jaosorior | shardy: oh! that makes sense. | 11:24 |
| d0ugal | apetrich: are you going to propose a lower upper constraint to requirements for jinja2? | 11:24 |
| jaosorior | shardy: well, then the patch is going in the right direction anyway | 11:24 |
| shardy | http://logs.openstack.org/77/519577/3/check/legacy-tripleo-ci-centos-7-scenario002-multinode-oooq-container/287dd94/logs/rpm-qa.txt.gz | 11:24 |
| d0ugal | apetrich: a quick search suggests this could be an issue in a few places. http://codesearch.openstack.org/?q=%7B%7B%20namespace&i=nope&files=&repos= (not all of these are relevant) | 11:25 |
| shardy | That has python-swift though, which is confusing | 11:25 |
| jaosorior | well, the long term goal is to stop using those packages in the host, so it's good :) | 11:25 |
| shardy | http://logs.openstack.org/77/519577/3/check/legacy-tripleo-ci-centos-7-scenario002-multinode-oooq-container/287dd94/logs/subnode-2/rpm-qa.txt.gz | 11:25 |
| shardy | Ah, that doesn't | 11:25 |
| shardy | the top level rpm -qa must be the undercloud | 11:26 |
| jaosorior | bandini: Hey, if you have a chance could you check these out https://review.openstack.org/#/q/topic:bp/logging-stdout-rsyslog+status:open ? | 11:26 |
| *** aditya_r has joined #tripleo | 11:26 | |
| jaosorior | jistr: ^^ | 11:27 |
| *** shreshtha has quit IRC | 11:29 | |
| d0ugal | apetrich: ah, I see my search is totally wrong | 11:29 |
| *** jaganathan has quit IRC | 11:32 | |
| *** pblaho has quit IRC | 11:33 | |
| *** sshnaidm|afk is now known as sshnaidm | 11:34 | |
| openstackgerrit | Numan Siddique proposed openstack/tripleo-quickstart master: Switch scenario007 to run Tempest https://review.openstack.org/494293 | 11:36 |
| *** dmacpher has joined #tripleo | 11:36 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: WIP: Convert tags to when statements for Q major upgrade workflow https://review.openstack.org/510902 | 11:37 |
| *** stendulker has quit IRC | 11:38 | |
| *** pdeore has quit IRC | 11:39 | |
| jaosorior | bandini: should I merge this https://review.openstack.org/#/c/516373/ ? | 11:41 |
| openstackgerrit | Anastasia Kravets proposed openstack/tripleo-heat-templates master: Merge from from Juniper THT for opencontrail https://review.openstack.org/516630 | 11:43 |
| *** pdeore has joined #tripleo | 11:43 | |
| bandini | jaosorior: I think we can now, yes (failures are unrelated) | 11:43 |
| openstackgerrit | Anastasia Kravets proposed openstack/tripleo-heat-templates master: Merge from from Juniper THT for opencontrail https://review.openstack.org/516630 | 11:43 |
| *** bkopilov has quit IRC | 11:44 | |
| *** aditya_ra has joined #tripleo | 11:46 | |
| *** aditya_r has quit IRC | 11:47 | |
| *** etingof has quit IRC | 11:51 | |
| dtantsur | morning folks, could you please approve this upgrade-critical backport https://review.openstack.org/#/c/519312/ | 11:53 |
| shardy | jistr: Hey did we pull in an ansible update which broke the inventory for kubespray? | 11:55 |
| *** d0ugal has quit IRC | 11:55 | |
| shardy | I updated my undercloud (now running ansible 2.4) and it's not working for me anymore, it's trying to parse the yaml inventory as ini | 11:55 |
| shardy | So yeah ansible got updated yesterday... | 11:56 |
| * shardy tries to fix it | 11:56 | |
| jistr | ouch | 11:56 |
| shardy | https://docs.ansible.com/ansible/2.4/porting_guide_2.4.html#inventory | 11:57 |
| shardy | "This change is mostly transparent to users." | 11:57 |
| shardy | lol :D | 11:57 |
| *** ykarel|afk is now known as ykarel | 11:58 | |
| *** aditya_ra has quit IRC | 11:59 | |
| *** aditya_r has joined #tripleo | 11:59 | |
| jistr | shardy: yea i'm just looking at those, looks like we'll need to explicitly enable some inventory plugins, probably 'script' and 'yaml' https://docs.ansible.com/ansible/devel/plugins/inventory.html#enabling-inventory-plugins | 11:59 |
| shardy | jistr: urgh, you'd think at least the yaml one would be enabled by default | 12:00 |
| *** ratailor has joined #tripleo | 12:00 | |
| shardy | Ok so I guess that may be a packaging bug then | 12:01 |
| jistr | shardy: looks like they should be enabled by default https://docs.ansible.com/ansible/devel/config.html#inventory-enabled | 12:01 |
| *** yprokule has quit IRC | 12:02 | |
| *** yprokule has joined #tripleo | 12:02 | |
| *** raildo has joined #tripleo | 12:02 | |
| shardy | Apparently "-" is now invalid in a group name | 12:03 |
| *** tosky_ has joined #tripleo | 12:05 | |
| *** lucasagomes is now known as lucas-hungry | 12:06 | |
| *** tosky has quit IRC | 12:06 | |
| *** udesale has joined #tripleo | 12:07 | |
| *** ramishra has quit IRC | 12:08 | |
| *** shardy is now known as shardy_lunch | 12:09 | |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 12:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731456 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731540 | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 12:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 12:10 |
| openstack | Launchpad bug 1731456 in tripleo "Timed out CI jobs not collecting logs, "FAILED with status: 137"" [Critical,Triaged] | 12:10 |
| openstack | Launchpad bug 1731540 in tripleo "CI: Deployment times out because signal back to undercloud fails with a connection timed out" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 12:10 |
| *** pblaho has joined #tripleo | 12:10 | |
| openstackgerrit | Merged openstack/tripleo-ui master: Refactor Loader component https://review.openstack.org/509181 | 12:12 |
| *** d0ugal has joined #tripleo | 12:12 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/instack-undercloud master: Support more hardware types and deprecate enabled_drivers https://review.openstack.org/519300 | 12:13 |
| d0ugal | jpich: did you see https://review.openstack.org/#/c/519619/ ? | 12:20 |
| *** atoth has joined #tripleo | 12:20 | |
| jpich | d0ugal: Yeah, was waiting for CI results and the like. Your comments are very relevant too, sounds like we might want to ask the containers squad for their input as well? | 12:21 |
| *** psahoo has quit IRC | 12:21 | |
| jpich | Wonder if it'd be possible to add {{ }} or something somewhere to force it to be interpreted as a variable, but I'm not familiar enough with Jinja and what we're doing with it here | 12:21 |
| *** aditya_ra has joined #tripleo | 12:22 | |
| *** tosky_ is now known as tosky | 12:23 | |
| d0ugal | jpich: Yeah, I was wondering about that too. Almost opened a jinja2 bug about it | 12:23 |
| *** ansmith_ has quit IRC | 12:24 | |
| *** ansmith has quit IRC | 12:24 | |
| *** aditya_r has quit IRC | 12:25 | |
| d0ugal | apetrich, jpich: http://git.openstack.org/cgit/openstack/python-tripleoclient/tree/tripleoclient/v1/container_image.py#n206 | 12:26 |
| d0ugal | I think it comes from there. | 12:26 |
| apetrich | d0ugal, brilliant I was still hunting for that | 12:26 |
| apetrich | thank you | 12:27 |
| d0ugal | np | 12:27 |
| *** agurenko has joined #tripleo | 12:27 | |
| d0ugal | apetrich: FWIW, this is how I found it: http://codesearch.openstack.org/?q=overcloud_containers.yaml.j2&i=nope&files=&repos= | 12:27 |
| openstackgerrit | Adriano Petrich proposed openstack/tripleo-common master: Fix kolla tests https://review.openstack.org/519619 | 12:28 |
| apetrich | d0ugal, anyidea what does metavar does? do I have to change that also? | 12:28 |
| d0ugal | apetrich: AFAIK, that is just how it is displayed in --help | 12:29 |
| jpich | I think so too | 12:29 |
| apetrich | d0ugal, cheers | 12:29 |
| d0ugal | https://docs.python.org/3/library/argparse.html#metavar | 12:29 |
| amoralej | hi, i've created https://bugs.launchpad.net/tripleo/+bug/1732174 to report current promotion-blocker | 12:30 |
| openstack | Launchpad bug 1732174 in tripleo "Tempest tests fail in featureset020 periodic job fails " [Critical,New] | 12:30 |
| d0ugal | apetrich: You are going to have a chicken and egg problem - I'd suggest updating tripleoclient to pass namespace and basenamespace. Then your patch can land, then you can remove namespace from tripleoclient | 12:30 |
| d0ugal | ... you may well be doing that already | 12:30 |
| *** sri_ has quit IRC | 12:31 | |
| apetrich | :) | 12:31 |
| * d0ugal is processing things slowly | 12:31 | |
| apetrich | d0ugal, although I'm not sure anything will pass as it is. | 12:32 |
| apetrich | d0ugal, the tripleo-common will pass with basenamespace but will not get that variable | 12:32 |
| *** pradk has joined #tripleo | 12:33 | |
| apetrich | if I just change to basenamespace as the var name not the parameter and fix the tests on python-tripleoclient it might pass | 12:33 |
| d0ugal | apetrich: the unit tests might, but will the containers ci jobs? | 12:33 |
| apetrich | I don't know if we do any integration on those | 12:33 |
| d0ugal | right | 12:33 |
| jaosorior | flaper87: you around? | 12:33 |
| apetrich | d0ugal, no idea but I'm doing the two variables for now and when that passes I'm merging them | 12:34 |
| apetrich | it is safer | 12:34 |
| d0ugal | apetrich: cool | 12:34 |
| d0ugal | apetrich: you could change it to basenamespace or namespace or "tripleoupstream" | 12:35 |
| d0ugal | apetrich: worst case we need to downgrade jinja2 while the change happens. | 12:35 |
| *** pgadiya has quit IRC | 12:35 | |
| *** ratailor has quit IRC | 12:35 | |
| d0ugal | apetrich: oh, if you are lucky the jinja2 rpm wont be updated yet :) | 12:35 |
| openstackgerrit | Pradeep Kilambi proposed openstack/instack-undercloud stable/pike: Fix the expirer cron task to run correctly https://review.openstack.org/519638 | 12:36 |
| openstackgerrit | Pradeep Kilambi proposed openstack/instack-undercloud stable/ocata: Fix the expirer cron task to run correctly https://review.openstack.org/519639 | 12:36 |
| *** sri_ has joined #tripleo | 12:40 | |
| *** paramite has quit IRC | 12:41 | |
| *** jkilpatr has joined #tripleo | 12:42 | |
| *** aditya_ra has quit IRC | 12:43 | |
| d0ugal | apetrich: you don't need to do anything | 12:44 |
| d0ugal | as mandre just pointed out on your review. | 12:44 |
| *** rcernin has joined #tripleo | 12:44 | |
| mandre | apetrich: yeah, sbaker had a pending change to move this jinja stuff to python, I figured it would be better to just roll with it since it's going to fix your issue | 12:45 |
| flaper87 | jaosorior: yep | 12:46 |
| d0ugal | +1 | 12:46 |
| apetrich | mandre, +1 | 12:46 |
| jpich | Awesome, thanks mandre | 12:46 |
| apetrich | mandre, cheers! | 12:46 |
| dtantsur | folks, is legacy-tripleo-ci-centos-7-undercloud-containers worth rechecking now? | 12:47 |
| mandre | apetrich: always a pleasure :) | 12:47 |
| dtantsur | I see this funny error http://logs.openstack.org/30/476130/6/check/legacy-tripleo-ci-centos-7-undercloud-containers/2916e7d/logs/undercloud/home/zuul/undercloud_install.log.txt.gz | 12:47 |
| * apetrich is happy to abandon it | 12:47 | |
| jaosorior | flaper87: how long did it take for the tripleo ansible roles for k8s to be part of the openstack umbrella? looking into doing something similar with another tripleo-related ansible role. | 12:50 |
| flaper87 | jaosorior: 1week, ish. Submit 2 patches to infra, then 1 to governance and that's it | 12:51 |
| *** bkopilov has joined #tripleo | 12:53 | |
| jaosorior | flaper87: sounds reasonable. Thanks | 12:54 |
| *** abishop has joined #tripleo | 12:55 | |
| *** lucas-hungry is now known as lucasagomes | 12:55 | |
| *** links has quit IRC | 12:56 | |
| *** morazi has joined #tripleo | 12:57 | |
| honza | jtomasek: Hey, I'm playing catch-up this morning. Did you already look into the npm-related issues in ci? If not, I can jump in. | 12:58 |
| *** tosky has quit IRC | 12:58 | |
| jtomasek | honza: hi, oh, I did not notice yet :) | 12:59 |
| *** tosky has joined #tripleo | 12:59 | |
| honza | :) | 12:59 |
| jtomasek | honza: I thought that failing tests in certain UI patches are caused by introducing another dependencies | 13:00 |
| *** bfournie has joined #tripleo | 13:01 | |
| honza | jtomasek: that's possible; i haven't looked yet | 13:01 |
| *** liverpooler has joined #tripleo | 13:04 | |
| honza | jtomasek: there are no new dependencies; multiple patches fail; it seems related to phantomjs http://logs.openstack.org/65/516365/2/check/legacy-tripleo-ui-nodejs6-npm-run-test/a11e27c/job-output.txt.gz#_2017-11-14_07_15_44_134846 | 13:06 |
| jtomasek | honza: hmm, we don't use it directly, I wonder where it is coming from | 13:06 |
| jtomasek | honza: it is not in shrinkwrap either | 13:07 |
| *** dprince has joined #tripleo | 13:07 | |
| honza | yeah | 13:07 |
| honza | I'll track it down. | 13:07 |
| *** ffiore has quit IRC | 13:07 | |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 13:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731456 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731540 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 13:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 13:10 |
| openstack | Launchpad bug 1731456 in tripleo "Timed out CI jobs not collecting logs, "FAILED with status: 137"" [Critical,Triaged] | 13:10 |
| openstack | Launchpad bug 1731540 in tripleo "CI: Deployment times out because signal back to undercloud fails with a connection timed out" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 13:10 |
| *** jpena is now known as jpena|lunch | 13:11 | |
| *** liverpooler has quit IRC | 13:12 | |
| *** trown|outtypewww is now known as trown | 13:12 | |
| *** liverpooler has joined #tripleo | 13:13 | |
| *** agurenko has quit IRC | 13:14 | |
| trown | gfidente[m]: have you ever hit an issue with ceph-ansible with containerized ceph where the /var/run file does not get created? https://paste.fedoraproject.org/paste/oBsMkQePJAl7x379W9PsnQ | 13:14 |
| *** amoralej is now known as amoralej|lunch | 13:16 | |
| *** masco has quit IRC | 13:19 | |
| *** artom_ has quit IRC | 13:24 | |
| *** shardy_lunch is now known as shardy | 13:25 | |
| *** ffiore has joined #tripleo | 13:26 | |
| *** ykarel has quit IRC | 13:26 | |
| *** ffiore has quit IRC | 13:26 | |
| *** ansmith has joined #tripleo | 13:27 | |
| *** ansmith has quit IRC | 13:27 | |
| *** jbadiapa_ has joined #tripleo | 13:27 | |
| openstackgerrit | Oliver Walsh proposed openstack/puppet-tripleo stable/pike: Fix libvirt exec deps for split-stack https://review.openstack.org/519652 | 13:27 |
| *** jbadiapa has quit IRC | 13:27 | |
| *** paramite has joined #tripleo | 13:28 | |
| *** rlandy has joined #tripleo | 13:28 | |
| *** rlandy is now known as rlandy|rover | 13:29 | |
| *** ansmith has joined #tripleo | 13:29 | |
| *** suuuper has quit IRC | 13:29 | |
| *** bfournie has quit IRC | 13:31 | |
| *** fragatina has joined #tripleo | 13:31 | |
| jaosorior | jistr: thanks for taking a look at the patches. | 13:32 |
| jistr | sure np :) | 13:32 |
| *** aditya_ra has joined #tripleo | 13:35 | |
| *** fragatina has quit IRC | 13:36 | |
| *** bfournie has joined #tripleo | 13:37 | |
| jistr | mandre: i'm not sure that the readme patch will make it in today... If this one merges, the readme fill fail gate on merge conflict. https://review.openstack.org/#/c/516231/ | 13:37 |
| *** links has joined #tripleo | 13:38 | |
| jistr | zuul shows it the patch as black dot in the queue now http://zuulv3.openstack.org/ | 13:38 |
| *** ramishra has joined #tripleo | 13:38 | |
| *** zshi_ has quit IRC | 13:39 | |
| *** sri_ has quit IRC | 13:39 | |
| weshay | rlandy|rover, adarazs|ruck looks like we'll get pike and master to promote once the mtu tempest test resolves | 13:40 |
| rlandy|rover | weshay: need to test with the fix to rdocloud settings - discussing with adarazs|ruck now | 13:41 |
| *** aditya_ra has quit IRC | 13:41 | |
| *** ffiore has joined #tripleo | 13:41 | |
| *** aditya_r has joined #tripleo | 13:41 | |
| weshay | rlandy|rover, you were correct https://bugs.launchpad.net/tripleo/+bug/1731997 was a dupe | 13:42 |
| openstack | Launchpad bug 1731282 in tripleo "duplicate for #1731997 fs24 ovb jobs failing on overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution" [Critical,Fix released] - Assigned to Giulio Fidente (gfidente) | 13:42 |
| *** abregman has joined #tripleo | 13:42 | |
| *** ecerquei has joined #tripleo | 13:44 | |
| mandre | jistr: oh crap, i'm sorry i shouldn't have approved https://review.openstack.org/#/c/516231/ | 13:46 |
| jaosorior | mandre: well, you could still remove the +A | 13:46 |
| jistr | mandre, jaosorior: no worries we can rebase, we'll just have to ajust the time expectations. Re removing +A, that will probably restart all the gate jobs after it, right? | 13:47 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Pass the CloudDomain parameter down to hiera on all nodes https://review.openstack.org/519261 | 13:47 |
| jaosorior | jistr: not sure | 13:47 |
| jaosorior | mayhaps? | 13:47 |
| jistr | if it did, it may be better to rebase after the merge... | 13:47 |
| mandre | zuul says there is 20 min left for the job | 13:48 |
| mandre | i don't want to risk resetting all the jobs if I can wait 20 min | 13:49 |
| jistr | +1 let's wait | 13:49 |
| jaosorior | ok | 13:49 |
| jaosorior | sounds legit | 13:49 |
| *** aputtur__ has joined #tripleo | 13:50 | |
| *** aputtur_ has joined #tripleo | 13:50 | |
| *** agurenko has joined #tripleo | 13:53 | |
| *** aputtur__ has quit IRC | 13:55 | |
| *** aputtur_ has quit IRC | 13:55 | |
| *** aputtur__ has joined #tripleo | 13:55 | |
| *** aputtur_ has joined #tripleo | 13:56 | |
| *** tzumainn has joined #tripleo | 13:56 | |
| mwhahaha | reminder meeting in ~4 mins https://etherpad.openstack.org/p/tripleo-meeting-items | 13:56 |
| openstackgerrit | Moshe Levi proposed openstack/tripleo-heat-templates master: Adds environment file for OVS Hardware Offload https://review.openstack.org/507401 | 13:57 |
| *** etingof has joined #tripleo | 13:59 | |
| mwhahaha | #startmeeting tripleo | 14:01 |
| mwhahaha | #topic agenda | 14:01 |
| mwhahaha | * Review past action items | 14:01 |
| mwhahaha | * One off agenda items | 14:01 |
| mwhahaha | * Squad status | 14:01 |
| mwhahaha | * Bugs & Blueprints | 14:01 |
| openstack | Meeting started Tue Nov 14 14:01:16 2017 UTC and is due to finish in 60 minutes. The chair is mwhahaha. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:01 |
| mwhahaha | * Projects releases or stable backports | 14:01 |
| mwhahaha | * Specs | 14:01 |
| mwhahaha | * open discussion | 14:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:01 |
| mwhahaha | Anyone can use the #link, #action and #info commands, not just the moderatorǃ | 14:01 |
| mwhahaha | Hi everyone! who is around today? | 14:01 |
| *** openstack changes topic to " (Meeting topic: tripleo)" | 14:01 | |
| openstack | The meeting name has been set to 'tripleo' | 14:01 |
| *** openstack changes topic to "agenda (Meeting topic: tripleo)" | 14:01 | |
| shardy | o/ | 14:01 |
| jtomasek | o/ | 14:01 |
| abishop | o/ | 14:01 |
| jaosorior | o/ | 14:01 |
| weshay | o/ | 14:02 |
| beagles | o/ | 14:02 |
| jfrancoa | o/ | 14:02 |
| fultonj | o/ | 14:02 |
| *** d0ugal_ has joined #tripleo | 14:02 | |
| marios | o/ | 14:02 |
| chem | o/ | 14:03 |
| openstackgerrit | Daniel Alvarez proposed openstack/puppet-tripleo master: Add support for OVN Metadata Agent https://review.openstack.org/502940 | 14:03 |
| d0ugal_ | o/ | 14:03 |
| *** d0ugal has quit IRC | 14:03 | |
| mwhahaha | ok let's start | 14:03 |
| matbu_ | o/ | 14:04 |
| mwhahaha | #topic review past action items | 14:04 |
| *** openstack changes topic to "review past action items (Meeting topic: tripleo)" | 14:04 | |
| *** d0ugal_ is now known as d0ugal | 14:04 | |
| mwhahaha | team to review upgrades developer docs https://review.openstack.org/#/c/517916/ | 14:04 |
| *** d0ugal has quit IRC | 14:04 | |
| mwhahaha | that review is just the structure | 14:04 |
| mwhahaha | we should get that in so we can start filling out the upgrade sections | 14:04 |
| mwhahaha | looks like it merged last night | 14:04 |
| gfidente^2nd | o/ | 14:04 |
| mwhahaha | so I look forward to seeing actual details :D | 14:04 |
| mwhahaha | gfidente to send a note requesting feedback on the ML about multiple service instances issues | 14:05 |
| jfrancoa | mwhahaha: yes, we'll try to split the work and start filling it in | 14:05 |
| ccamacho | sorry for the delay o/ | 14:05 |
| *** d0ugal has joined #tripleo | 14:05 | |
| oidgar | o/ | 14:05 |
| *** dmsimard|off is now known as dmsimard | 14:05 | |
| *** anilvenkata has quit IRC | 14:05 | |
| *** abregman is now known as abregman|mtg | 14:05 | |
| mwhahaha | gfidente^2nd: any chance to compile a list for the ML? | 14:05 |
| gfidente^2nd | mwhahaha I did not prepare that email for multiple clusters yet, sorry | 14:06 |
| *** etingof has quit IRC | 14:06 | |
| mwhahaha | k | 14:06 |
| gfidente^2nd | please keep the item for next wek | 14:06 |
| mwhahaha | #action gfidente to send a note requesting feedback on the ML about multiple service instances issues | 14:06 |
| mwhahaha | mwhahaha send a note about CI to ML and propsing no more merging of items not specifically critical CI bugs - DONE http://lists.openstack.org/pipermail/openstack-dev/2017-November/124294.html | 14:06 |
| *** vpickard_ is now known as vpickard | 14:06 | |
| openstackgerrit | Daniel Alvarez proposed openstack/tripleo-heat-templates master: Add support for OVN Metadata Agent https://review.openstack.org/502943 | 14:07 |
| mwhahaha | i've got an item to talk about what to do in the one off agenda | 14:07 |
| mwhahaha | so moving on to that | 14:07 |
| mwhahaha | #topic one off agenda items | 14:07 |
| *** openstack changes topic to "one off agenda items (Meeting topic: tripleo)" | 14:07 | |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-meeting-items | 14:07 |
| mwhahaha | (mwhahaha) scenario001 to non-voting? | 14:07 |
| mwhahaha | so basically https://bugs.launchpad.net/tripleo/+bug/1731063 makes scenario001 a major issue | 14:07 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 14:07 |
| *** Goneri has joined #tripleo | 14:07 | |
| *** gfidente^2nd is now known as gfidente | 14:07 | |
| mwhahaha | unless we have some movement on figuring out what is happening, i propose we switch scenario001 in master to non-voting so we can unblock everyone | 14:08 |
| mwhahaha | any thoughts or objections? | 14:08 |
| gfidente | well | 14:08 |
| gfidente | yes I have objections | 14:08 |
| *** jpena|lunch is now known as jpena | 14:08 | |
| mwhahaha | i don't like losing the coverage but we've been broken for over a wekk | 14:08 |
| gfidente | we're using ceph-ansible in scenario001 and scenario004, it's not clear to me why this should be happening only for one of the two | 14:09 |
| mwhahaha | gfidente: most likely because its not ceph related | 14:09 |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-heat-templates master: Add HostnameFormatDefault parameter to Block/Object/Ceph roles. https://review.openstack.org/519658 | 14:09 |
| fultonj | happens in non-containerized too | 14:09 |
| fultonj | comments in that bug indicate ceph is ok as per job logs | 14:09 |
| mwhahaha | yea so it's most likely a nova/cinder problem but without understanding what is happening we can't keep it in the gate | 14:09 |
| fultonj | who on the team knows tempest well? | 14:10 |
| gfidente | sshnaidm ^^ ? | 14:10 |
| ccamacho | dmellado ^ | 14:10 |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 14:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731456 | 14:10 |
| weshay | fultonj, arxcruz is our local guru | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731540 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 14:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 14:10 |
| openstack | Launchpad bug 1731456 in tripleo "Timed out CI jobs not collecting logs, "FAILED with status: 137"" [Critical,Triaged] | 14:10 |
| openstack | Launchpad bug 1731540 in tripleo "CI: Deployment times out because signal back to undercloud fails with a connection timed out" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 14:10 |
| gfidente | I volunteer to look into the issue | 14:10 |
| mwhahaha | gfidente: ok so we'll give it one more day | 14:10 |
| fultonj | arxcruz: do you think you could look into my question about adding a wait and retry? | 14:10 |
| fultonj | thanks gfidente | 14:10 |
| gfidente | mwhahaha ack | 14:11 |
| mwhahaha | but unless we can figure out what the cause is today, we need to switch it to non-voting tomorrow | 14:11 |
| weshay | gfidente thanks | 14:11 |
| adarazs|ruck | o/ | 14:11 |
| mwhahaha | anyway moving on | 14:11 |
| mwhahaha | (gfidente) help review ceph/luminous submission (passed CI) | 14:11 |
| gfidente | yeah this is basically a call for help with reviews as we submitted a few patches to use ceph luminous instead of jewel | 14:12 |
| gfidente | upstream CI seems happy | 14:12 |
| trown | gfidente fultonj could either of you look at a reproducer env for that job? I cant get deploy to work because an issue with ceph-mon var/run file | 14:12 |
| mwhahaha | gfidente: yea but we can't merge due to scenario001 flakyness | 14:12 |
| *** lblanchard has joined #tripleo | 14:12 | |
| gfidente | mwhahaha fwiw it passed https://review.openstack.org/#/c/510108/ | 14:12 |
| mwhahaha | i'm not against the switch as you're right ci is happy but we won't merge until we resolve the previous topic | 14:12 |
| mwhahaha | gfidente: yea i know the problem is that it could fail in the gate repeatedly | 14:12 |
| *** ebarrera has quit IRC | 14:12 | |
| gfidente | mwhahaha understood | 14:13 |
| mwhahaha | hence previous topic | 14:13 |
| gfidente | though reviews still helpful | 14:13 |
| mwhahaha | yup | 14:13 |
| *** lblanchard has quit IRC | 14:13 | |
| Tengu | hello ! small question: are there some issues with cinder on the CI for stable/pike, especially for the gate-tripleo-ci-centos-7-containers-multinode-upgrades-pike running on "RDO Third Party CI" ? | 14:13 |
| mwhahaha | Tengu: we can look into it after the moeeting | 14:13 |
| Tengu | oh, sorry, didn't check the topic | 14:14 |
| mwhahaha | gfidente: anything else about the ceph luminous switch? | 14:14 |
| gfidente | mwhahaha nah, it should be work on upgrade too | 14:14 |
| mwhahaha | ok sounds good | 14:15 |
| gfidente | ceph-ansible has a playbook | 14:15 |
| mwhahaha | (weshay) CI logging changes | 14:15 |
| gfidente | so testabe | 14:15 |
| gfidente | *testable | 14:15 |
| weshay | mwhahaha, ya.. just a FYI for general awareness and reviews | 14:15 |
| mwhahaha | #link https://review.openstack.org/#/c/511526/ | 14:16 |
| mwhahaha | weshay: does that improve the log capture time or anything? | 14:16 |
| *** bobh has joined #tripleo | 14:16 | |
| weshay | I need to check, I'll comment in the review | 14:16 |
| mwhahaha | k | 14:16 |
| mwhahaha | any other one off items folks would like to talk about? | 14:17 |
| openstackgerrit | Anastasia Kravets proposed openstack/puppet-tripleo master: Merge from from Juniper repo for opencontrail https://review.openstack.org/516651 | 14:17 |
| openstackgerrit | Anastasia Kravets proposed openstack/puppet-tripleo master: Merge from from Juniper repo for opencontrail https://review.openstack.org/516651 | 14:17 |
| *** cdearborn has joined #tripleo | 14:17 | |
| mwhahaha | sounds like nope | 14:17 |
| mwhahaha | status time | 14:17 |
| openstackgerrit | Carlos Camacho proposed openstack/python-tripleoclient master: Add openstack undercloud backup https://review.openstack.org/466213 | 14:18 |
| mwhahaha | #topic Squad status | 14:18 |
| mwhahaha | ci | 14:18 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-ci-squad-scrum | 14:18 |
| mwhahaha | upgrade | 14:18 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-upgrade-squad-status | 14:18 |
| mwhahaha | containers | 14:18 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-containers-squad-status | 14:18 |
| *** openstack changes topic to "Squad status (Meeting topic: tripleo)" | 14:18 | |
| mwhahaha | integration | 14:18 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-integration-squad-status | 14:18 |
| mwhahaha | ui/cli | 14:18 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-ui-cli-squad-status | 14:18 |
| mwhahaha | validations | 14:18 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-validations-squad-status | 14:18 |
| mwhahaha | networking | 14:18 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-networking-squad-status | 14:18 |
| mwhahaha | workflows | 14:18 |
| d0ugal | I'm in the process of setting up the Workflows meeting, finally :) - will send out a email to the list today with the first meeting details. No status otherwise. | 14:19 |
| mwhahaha | weshay, ci status seems missing | 14:19 |
| d0ugal | but there will be more soon! | 14:19 |
| mwhahaha | validations also missing status | 14:19 |
| mwhahaha | jrist: ui/cli status missing | 14:19 |
| weshay | mwhahaha, we'll have a sprint end, and planning update today | 14:19 |
| *** jmelvin has joined #tripleo | 14:19 | |
| weshay | arxcruz, ^ | 14:19 |
| mwhahaha | k | 14:19 |
| jrist | womp womp | 14:19 |
| jrist | mwhahaha: I'll chat with jtomasek to see what the update was | 14:20 |
| mwhahaha | jrist: thanks | 14:20 |
| *** etingof has joined #tripleo | 14:20 | |
| jtomasek | mwhahaha, jrist: I'll update it | 14:20 |
| mwhahaha | moving on to bugs | 14:21 |
| mwhahaha | #topic bugs & blueprints | 14:21 |
| mwhahaha | #link https://launchpad.net/tripleo/+milestone/queens-2 | 14:21 |
| mwhahaha | For Queens we currently have 70 (+0) blueprints and about 526 (+5) open bugs. 251 queens-2 and 275 queens-3. | 14:21 |
| *** openstack changes topic to "bugs & blueprints (Meeting topic: tripleo)" | 14:21 | |
| mwhahaha | please take a look at the critical bug list, i reported some yesterday for some failures in CI that aren't blocking but should get resolved | 14:21 |
| mwhahaha | for example, https://bugs.launchpad.net/tripleo/+bug/1732010 | 14:22 |
| openstack | Launchpad bug 1732010 in tripleo "CI: tripleoclient package build fails because unit tests fail because tmp file exists" [Critical,Triaged] | 14:22 |
| mwhahaha | anyway have any other bugs they wish to bring up? | 14:23 |
| mwhahaha | s/anyway/anyone | 14:23 |
| *** hamzy_ has quit IRC | 14:24 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-common master: WIP add UC backup actions https://review.openstack.org/517610 | 14:24 |
| mwhahaha | sounds like nope | 14:24 |
| adarazs|ruck | nope. just fix the critical ones quickly please, we need promotions :) | 14:24 |
| mwhahaha | indeed | 14:24 |
| mwhahaha | #topic projects releases or stable backports | 14:25 |
| jpich | Maybe also https://bugs.launchpad.net/tripleo/+bug/1732140 - a patch is merging that will fix it, tripleo-common master is broken until then | 14:25 |
| openstack | Launchpad bug 1732140 in tripleo "Kolla tests failing for tripleo-common master" [Critical,Invalid] - Assigned to Adriano Petrich (apetrich) | 14:25 |
| *** openstack changes topic to "projects releases or stable backports (Meeting topic: tripleo)" | 14:25 | |
| *** amoralej|lunch is now known as amoralej | 14:25 | |
| mwhahaha | jpich: thanks for pointing that out, looks like https://review.openstack.org/#/c/516136/ is in the gate so we'll keep an eye on it | 14:26 |
| mwhahaha | as for releases, I think EmilienM was working on getting a pike release cut. | 14:26 |
| *** rbrady-afk is now known as rbrady | 14:26 | |
| mwhahaha | reminder that queens-m2 is in ~3 weeks | 14:26 |
| weshay | dear lord | 14:27 |
| mwhahaha | so please make sure your blueprints are updated with their current status and please raise any issues that might prevent you from getting your feature merged before m2 (other than the known scenario001 problems) | 14:27 |
| mwhahaha | also along those lines | 14:28 |
| mwhahaha | #topic specs | 14:28 |
| mwhahaha | #link https://review.openstack.org/#/q/project:openstack/tripleo-specs+status:open | 14:28 |
| *** openstack changes topic to "specs (Meeting topic: tripleo)" | 14:28 | |
| mwhahaha | please review specs, they need to be merged before m2 | 14:28 |
| *** dansmith has joined #tripleo | 14:28 | |
| mwhahaha | #topic open discussion | 14:29 |
| *** openstack changes topic to "open discussion (Meeting topic: tripleo)" | 14:29 | |
| mwhahaha | any other business? | 14:29 |
| trown | gfidente fultonj could either of you help me with some ceph-ansible questions? | 14:31 |
| fultonj | trown: sure | 14:31 |
| *** gbarros has joined #tripleo | 14:31 | |
| openstackgerrit | Anastasia Kravets proposed openstack/tripleo-heat-templates master: Merge from from Juniper THT for opencontrail https://review.openstack.org/516630 | 14:31 |
| openstackgerrit | Liz Blanchard proposed openstack/tripleo-ui master: Add message to spinner on Deployment Config modal https://review.openstack.org/519478 | 14:32 |
| trown | fultonj: sweet... I have tracked down why multinode ceph jobs do not reproduce on rdocloud to this line https://github.com/ceph/ceph-ansible/blob/master/roles/ceph-mon/tasks/docker/main.yml#L10 | 14:32 |
| *** ebarrera has joined #tripleo | 14:32 | |
| trown | fultonj: the "monitor_name" var there is resolving to "subnode-1", but the var run file is actually created as "*subnode-1.rdocloud.asok" | 14:33 |
| *** enrraja has quit IRC | 14:33 | |
| mwhahaha | ok well sounds like no further items for the meeting | 14:33 |
| mwhahaha | #endmeeting | 14:33 |
| trown | fultonj: so the whole thing blows up waiting for the socket | 14:33 |
| *** openstack changes topic to "CI status: MASTER: REDish, STABLE/*: GREENish, For master jobs please do not approve patches with scenario jobs until the alerts are cleared (also see alerts and read ML). stable/* patches appear to be OK to merge for now | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest/" | 14:33 | |
| openstack | Meeting ended Tue Nov 14 14:33:15 2017 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:33 |
| mwhahaha | thanks everyone | 14:33 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/tripleo/2017/tripleo.2017-11-14-14.01.html | 14:33 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tripleo/2017/tripleo.2017-11-14-14.01.txt | 14:33 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/tripleo/2017/tripleo.2017-11-14-14.01.log.html | 14:33 |
| fultonj | trown: i see | 14:33 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-common master: Add rsyslog sidecar image for container image prepare https://review.openstack.org/515282 | 14:33 |
| jaosorior | jistr, bogdando had to rebase ^^ | 14:33 |
| mwhahaha | Tengu: which job failure are you seeing? i saw a failure on that stable/pike backport that seemed to be ceilometer | 14:33 |
| fultonj | trown: so it creaets a socket with a name it doesn't know to look at | 14:33 |
| trown | fultonj: how would I pass a different monitor_name? | 14:33 |
| trown | fultonj: ya | 14:33 |
| gfidente | trown fultonj known issues, sec | 14:33 |
| gfidente | https://bugzilla.redhat.com/show_bug.cgi?id=1507888#c5 | 14:34 |
| openstack | bugzilla.redhat.com bug 1507888 in ceph-ansible "Deployment with ceph and TLS everywhere fails with: "WorkflowTasks_Step2_Execution: ERROR "cannot stat '/var/run/ceph/ceph-mon.overcloud-controller-2.asok': No such file or directory""" [High,New] - Assigned to gfidente | 14:34 |
| gfidente | trown add mds_use_fqdn too | 14:34 |
| gfidente | in case you deploy MDS | 14:34 |
| gfidente | it's actually unrelated to TLS but triggered by CloudDomain customizations | 14:35 |
| *** akane has joined #tripleo | 14:35 | |
| gfidente | maybe we should open a bug in LP as well for it | 14:35 |
| openstackgerrit | Anastasia Kravets proposed openstack/puppet-tripleo master: Merge from from Juniper repo for opencontrail https://review.openstack.org/516651 | 14:35 |
| trown | gfidente: nice that looks promising | 14:36 |
| trown | gfidente: I will give that a go | 14:36 |
| gfidente | fingers crossed | 14:36 |
| gfidente | we should make tht switch and include those options basing on CloudName I think | 14:36 |
| fultonj | perhaps oooq can have it as a new default for this scenario | 14:36 |
| *** moshele has quit IRC | 14:36 | |
| trown | fultonj: ya if it works I will add it to the rdocloud environment overrides | 14:37 |
| gfidente | trown please comment on BZ as well! :D | 14:37 |
| fultonj | progress++ | 14:37 |
| trown | fultonj: gfidente: to be clear this is just running toci script from tripleo-ci on rdocloud nodes... so really shouldnt be any different | 14:38 |
| trown | fultonj: gfidente: I suspect the domain is coming from rdocloud side | 14:38 |
| shardy | sdoran: Hey, are you aware of the status of ansible 2.4 as packaged in Centos? | 14:38 |
| sdoran | Somewhat. | 14:38 |
| shardy | sdoran: yesterday I picked up an update to 2.4 and it's broken various things, for example: | 14:38 |
| gfidente | trown isn't it nova on undercloud setting the oc nodes domain? | 14:38 |
| sdoran | It's supposed to be in extras now. | 14:38 |
| gfidente | well, neutron in undercloud | 14:38 |
| trown | gfidente: not for multinode | 14:39 |
| sdoran | Not sure if it ever showed up. I got tired of waiting and switched to the Ansible repo for my CI testing. | 14:39 |
| gfidente | trown ah right | 14:39 |
| EmilienM | hi | 14:39 |
| gfidente | sigh | 14:39 |
| shardy | sdoran: https://github.com/ansible/ansible/pull/30730/commits/a51caf50a778b2491bd2b80e5a6473b48bd289f5 appears to have landed to the stable 2.4 branch, but it's missing in the package I have (2.4.0.0-5.el7) | 14:39 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Save oooq generated files https://review.openstack.org/517136 | 14:39 |
| gfidente | trown pls check if you're passing CloudDomain though, I am surprised how everything works when the two differ | 14:39 |
| shardy | sdoran: it breaks out current integration with kubespray, which uses group names like "kube-master" | 14:40 |
| openstackgerrit | Andy Smith proposed openstack/puppet-tripleo master: Support separate oslo.messaging services for RPC and Notifications https://review.openstack.org/510684 | 14:40 |
| shardy | we can probably fix it in kubespray I guess, but I wondered if we were pending an update to ansible in the packages | 14:40 |
| sdoran | shardy: So the RHEL team released 2.4.0.0-5 halfway between our 2.4.0 and 2.4.1 release. They got most of the fixes for 2.4.1 but not all of them. | 14:41 |
| shardy | sdoran: yeah it's in centos-extras now, which is where the update came from, it just doesn't seem to be latest 2.4 afaics | 14:41 |
| trown | gfidente: https://review.openstack.org/#/c/516795/8/roles/multinodes/templates/stack.yaml is the stack we are using to bring up the nodes... I dont see anything domain related | 14:41 |
| sdoran | Correct. It's a halfway release. They wouldn't wait another day. | 14:41 |
| trown | gfidente: in any case, seems likely your solution will work | 14:41 |
| shardy | sdoran: urgh Ok thanks for confirming - what's the best alternative repo for me to use? | 14:42 |
| shardy | sdoran: FWIW for me this does leave the centos packaged stuff pretty broken - there are other issues like the default ansible.cfg doesn't enable any inventory plugins | 14:43 |
| sdoran | shardy: Yes, it's not great. Really wish the RHEL team would have waited a day. | 14:43 |
| shardy | jistr: ^^ FYI | 14:43 |
| sdoran | shardy: Are your issues fixed in `stable-2.4`? | 14:43 |
| shardy | sdoran: looks like it, is it best to install from source or are there RPMs I can consume? | 14:44 |
| sdoran | We're about to cut the first RC for 2.4.2 tomorrow. | 14:44 |
| openstackgerrit | Andy Smith proposed openstack/tripleo-heat-templates master: Support separate oslo.messaging services for RPC and Notification https://review.openstack.org/507963 | 14:44 |
| * sdoran finding repo file | 14:46 | |
| slagle | jistr: marios : before i go and buy paint for the shed...can you agree on the name you want for the cli arg? and then i will just change it :) | 14:46 |
| *** dhill_ has quit IRC | 14:46 | |
| slagle | it seems the choices are --config-download, --with-config-download, --config-download-deploy | 14:46 |
| sdoran | shardy: https://github.com/samdoran/docker-centos7-ansible/blob/master/ansible.repo | 14:46 |
| sdoran | I switched to using that for CentOS 7 since the extras repo is so behind. | 14:47 |
| sdoran | I'm not sure what the lead time is for getting updates into CentOS 7 extras, but it seems to take a while _after_ it lands in RHEL extras. | 14:47 |
| jistr | slagle, marios: haha ;) i'm fine with current `deploy --config-download` state, `deploy --with-config-dowlooad` is fine too. Not too keen on `deploy --config-download-deploy` as it seems a bit repetetive. | 14:47 |
| *** chlong has joined #tripleo | 14:49 | |
| sdoran | shardy: Is the inventory plugins issue resolved in 2.4.1 or `stable-2.4`? | 14:50 |
| sdoran | Cuz if not, I could try to get it fixed before our RC tomorrow. | 14:50 |
| *** dhill_ has joined #tripleo | 14:51 | |
| *** arxcruz__ has joined #tripleo | 14:52 | |
| marios | slagle: jistr ack sounds like --with-config-download wins? | 14:52 |
| *** gbarros has quit IRC | 14:53 | |
| *** yamahata has joined #tripleo | 14:53 | |
| marios | slagle: or just --config-download doesn't look like jistr minds too much from his review comments i just checked so if the majority likes it keep it | 14:53 |
| *** jkilpatr has quit IRC | 14:53 | |
| *** ramishra has quit IRC | 14:54 | |
| shardy | sdoran: 2.4.1.0-1.el7 just got pushed to -extras so I'm re-testing with that now, will let you know | 14:56 |
| shardy | sdoran: thanks for the info :) | 14:56 |
| jistr | shardy: good catch :) | 14:56 |
| sdoran | shardy: Good to know. Keep me posted. | 14:57 |
| *** ramishra has joined #tripleo | 14:57 | |
| sdoran | Is that CentOS extras? I just checked and didn't see it. | 14:57 |
| *** zaneb has joined #tripleo | 14:58 | |
| shardy | sdoran: http://mirror.centos.org/centos/7/extras/x86_64/Packages/?C=M;O=D | 14:59 |
| shardy | sdoran: worth idling in #rdo as apevec just pointed me to that | 14:59 |
| jistr | mandre, jaosorior: so it failed... https://review.openstack.org/#/c/516231/ the readme patch went into gate jobs then :D | 14:59 |
| sdoran | I see it now. Had to turn off the mirrorlist. | 15:00 |
| sdoran | So it probably just hasn't replicated around. | 15:00 |
| shardy | yeah it only just landed | 15:00 |
| *** rcernin has quit IRC | 15:00 | |
| *** mcornea has quit IRC | 15:00 | |
| openstackgerrit | Luke Hinds proposed openstack/tripleo-heat-templates master: [WIP] Implements management of `/etc/login.defs` https://review.openstack.org/457985 | 15:01 |
| shardy | sdoran: Ok that works much better, thanks :) | 15:01 |
| sdoran | Ok. Glad to hear it. | 15:01 |
| *** mdnadeem has quit IRC | 15:01 | |
| jaosorior | jistr: uok, that makes it easier. | 15:04 |
| jistr | jaosorior: yea except all the jobs below got restarted indeed.. | 15:04 |
| cschwede | Hi! Can someone review/approve the following backport? patch 515448 | 15:05 |
| cschwede | https://review.openstack.org/#/c/515448/ | 15:05 |
| cschwede | That would be very welcome :) | 15:05 |
| *** ebarrera has quit IRC | 15:06 | |
| jaosorior | jistr: I had this patch https://review.openstack.org/#/c/519577/ I'll rebase it on top of your readme patch | 15:06 |
| Tengu | mwhahaha: sorry, was doing other things :). sooo. here's the issue: gate-tripleo-ci-centos-7-containers-multinode-upgrades-pike on the following review: https://review.openstack.org/#/c/519326/ | 15:06 |
| jaosorior | jistr: and I'll remove the readme from the swift services. | 15:06 |
| Tengu | mwhahaha: apparently, https://logs.rdoproject.org/26/519326/1/openstack-check/gate-tripleo-ci-centos-7-containers-multinode-upgrades-pike/Zd29dc140a229475dbf749a8e35306986/undercloud/home/jenkins/failed_upgrade.log.txt.gz shows the following error: "openstack-cinder-volume is not running anywhere and so cannot be restarted | 15:07 |
| Tengu | " | 15:07 |
| *** sgolovatiuk has joined #tripleo | 15:07 | |
| *** ykarel has joined #tripleo | 15:07 | |
| Tengu | mwhahaha: I don't think I saw that in the "critical errors" listed periodically on the channel | 15:07 |
| *** marrusl has quit IRC | 15:08 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Polish swift containers logging configuration https://review.openstack.org/519577 | 15:08 |
| jaosorior | jistr: done ^^ | 15:08 |
| jistr | jaosorior: thanks | 15:08 |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731456 | 15:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731540 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 15:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 15:10 |
| openstack | Launchpad bug 1731456 in tripleo "Timed out CI jobs not collecting logs, "FAILED with status: 137"" [Critical,Triaged] | 15:10 |
| openstack | Launchpad bug 1731540 in tripleo "CI: Deployment times out because signal back to undercloud fails with a connection timed out" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 15:10 |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: update the master tempest skip list, remove old bugs https://review.openstack.org/513820 | 15:10 |
| numans | shardy, hi, need your review on this patch back - https://review.openstack.org/#/c/518440/ :), lost your +2 because of rebase | 15:11 |
| mwhahaha | Tengu: not sure the upgrade job is functional yet | 15:11 |
| openstackgerrit | mathieu bultel proposed openstack/instack-undercloud master: Install ansible during the upgrade/update in the UC https://review.openstack.org/519663 | 15:11 |
| Tengu | mwhahaha: ah. oh well, that patch took a month before being merged in master, it may as well took some time before getting into pike ;). not a big deal, it's not that critical. | 15:12 |
| shardy | numans: ack, done! | 15:12 |
| Tengu | as I can't take it in our current infra because I don't have a lab in order to validate the upgrades… :) | 15:12 |
| mwhahaha | Tengu: well the failure on that one was ceilometer | 15:12 |
| mwhahaha | Tengu: http://logs.openstack.org/26/519326/1/gate/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container/6958904/logs/tempest.html.gz | 15:12 |
| numans | shardy, thanks | 15:12 |
| Tengu | mwhahaha: ah? oh. nothing to do with cinder then? | 15:12 |
| *** dhill_ has quit IRC | 15:13 | |
| mwhahaha | Tengu: no the rdo jobs aren't voting in terms of blocking things | 15:13 |
| mwhahaha | Tengu: it failed int he gate, i'm going to look at that error in a bit | 15:13 |
| *** dhill_ has joined #tripleo | 15:13 | |
| Tengu | aahhh. ook. would be nice to get that info (non-voting) then :/ | 15:14 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: CI: remove useless templates https://review.openstack.org/518423 | 15:14 |
| Tengu | mwhahaha: ok, so it's not yet out of the gate in fact. | 15:15 |
| Tengu | mwhahaha: don't do anything for now, we'll wait for the gate result. | 15:15 |
| EmilienM | slagle: hi! I think we can remove the mistral workaround here: https://review.openstack.org/#/c/516841/8/roles/overcloud-deploy/tasks/deploy-overcloud.yml since we got promotion, wdyt? | 15:15 |
| mwhahaha | Tengu: http://zuulv3.openstack.org/ yea | 15:15 |
| *** psachin has quit IRC | 15:16 | |
| Tengu | mwhahaha: sorry for the noise then ;). I'm not used to the whole CI processes for now. | 15:16 |
| Tengu | as there are many, I'm worried when I see a "not "non-voting" flagged" check that fails. | 15:17 |
| *** psachin has joined #tripleo | 15:17 | |
| *** mrch has quit IRC | 15:19 | |
| *** dhill_ has quit IRC | 15:19 | |
| *** ffiore has quit IRC | 15:19 | |
| *** dhill_ has joined #tripleo | 15:20 | |
| *** zaneb has quit IRC | 15:21 | |
| *** ebarrera has joined #tripleo | 15:22 | |
| dtantsur | dprince: hey! is it true that any change to instack-undercloud will not have to be copy-pasted to tripleoclient? :( | 15:23 |
| dtantsur | this sounds... annoying | 15:23 |
| dtantsur | and hard to test too, especially given the state of the undercloud-containers job | 15:24 |
| *** abregman|mtg is now known as abregman | 15:24 | |
| dprince | dtantsur: perhaps we could put the shared code into tripleoclient or tripleo-common then? | 15:25 |
| dtantsur | dprince: instack-undercloud imports neither | 15:25 |
| dprince | dtantsur: that said, we intend to cut over I hope | 15:25 |
| dtantsur | I was thinking about tripleo-common, but it's a new dependency (and will require global-requirements bump) | 15:25 |
| dprince | dtantsur: instack-undercloud has a bunch of requirements we don't want I think as an RPM | 15:25 |
| dtantsur | dprince: well, I can cargo-cult it to tripleoclient, when this patch is merged. I just hope to not do it forever :) | 15:26 |
| dprince | dtantsur: one of the benifits of the new installer is we'd ideally be able to remove those. Adding a dependencing on the thing we are replacing isn't great | 15:26 |
| dtantsur | ack, I get it.. | 15:26 |
| dprince | dtantsur: we won't do it forever I think. It is just where we are at... | 15:26 |
| dtantsur | dprince: ack. then I'd appreciate a review of this patch to not delay this work further ;) | 15:27 |
| *** ffiore has joined #tripleo | 15:27 | |
| dprince | dtantsur: sure, I'll try to jump on it | 15:28 |
| *** ramishra has quit IRC | 15:29 | |
| dtantsur | thnx | 15:29 |
| *** ramishra has joined #tripleo | 15:29 | |
| openstackgerrit | Jose Luis Franco proposed openstack-infra/tripleo-ci master: WIP: Upgrade UC and OC using tripleo-upgrade role https://review.openstack.org/515643 | 15:30 |
| *** dhill_ has quit IRC | 15:30 | |
| *** sgolovatiuk has quit IRC | 15:31 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: config-download: use workflow supported in Queens https://review.openstack.org/516841 | 15:32 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: config-download: use workflow supported in Queens https://review.openstack.org/516841 | 15:32 |
| *** yprokule has quit IRC | 15:32 | |
| chandankumar | EmilienM: mwhahaha https://review.openstack.org/#/c/519305/ and https://review.openstack.org/#/c/518942/ | 15:34 |
| dtantsur | folks, who here is familiar with OVB internals, except for bnemec-pto? EmilienM, mwhahaha? | 15:34 |
| mwhahaha | nope | 15:34 |
| dtantsur | we need to talk about migrating it to hardware types, I'm not sure I understand how | 15:34 |
| dtantsur | if nothing happens, we will break you in Rocky :) | 15:35 |
| mwhahaha | so business as usual? :D | 15:35 |
| *** ramishra has quit IRC | 15:35 | |
| mwhahaha | can't be a new cycle without breakages | 15:35 |
| * mwhahaha sighs and brushes up on ovb | 15:35 | |
| *** dhill_ has joined #tripleo | 15:35 | |
| openstackgerrit | Daniel Alvarez proposed openstack/tripleo-heat-templates stable/pike: OVN: Provide the option to define NeutronBridgeMappings as a role parameter https://review.openstack.org/519680 | 15:35 |
| mwhahaha | i'll take a look later | 15:35 |
| openstackgerrit | Or Idgar proposed openstack/tripleo-common master: Octavia post deployment mistral wrapper https://review.openstack.org/515402 | 15:36 |
| mwhahaha | dtantsur: is that related to your ML post about automatic migration? | 15:36 |
| dtantsur | mwhahaha: TL;DR this https://github.com/cybertron/openstack-virtual-baremetal/blob/master/openstack_virtual_baremetal/build_nodes_json.py#L121 has to become "ipmi" in Queens (and must in Rocky) | 15:36 |
| dtantsur | mwhahaha: yes, it's quite related | 15:36 |
| *** chandankumar is now known as chkumar|upgrade | 15:37 | |
| *** bkopilov has quit IRC | 15:37 | |
| mwhahaha | dtantsur: i think that's just the template for the inventory, we might be able to change it. i'll take a look | 15:37 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: fs010: use --config-download from tripleoclient https://review.openstack.org/514736 | 15:38 |
| dtantsur | mwhahaha: the last time I talked to bnemec-pto, the problem was that OVB is not release-aware | 15:38 |
| *** bkopilov has joined #tripleo | 15:38 | |
| mwhahaha | dtantsur: yea i could see that being a problem | 15:38 |
| dtantsur | and hardware types appeared in Ocata | 15:38 |
| mwhahaha | just means we need to make it either release aware or can you just make a mapping for historical ones | 15:38 |
| *** bkopilov has quit IRC | 15:38 | |
| *** janki has quit IRC | 15:39 | |
| mwhahaha | i personally think it's better for the end user if ironic handles that | 15:39 |
| *** bkopilov has joined #tripleo | 15:39 | |
| mwhahaha | but i don't know how much overhead that would be | 15:39 |
| openstackgerrit | Or Idgar proposed openstack/tripleo-heat-templates master: Run Octavia configuration on the overcloud https://review.openstack.org/508195 | 15:39 |
| mwhahaha | otherwise you break all tools and force complexity elsewhere | 15:39 |
| dtantsur | mwhahaha: ironic will probably handle it, but if OVB keeps generating instackenv.json mentioning the removed driver, it won't help | 15:39 |
| mwhahaha | dtantsur: yea this is the LTS problem | 15:40 |
| dtantsur | we can handle upgrades for existing nodes (please vote on the thread btw), but not newly enrolled nodes (I think) | 15:41 |
| mwhahaha | ok let me go eat breakfast and think on it | 15:41 |
| dtantsur | thanks! I'll leave for a walk, will be back in an hour or so | 15:42 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Add yml extension to kubespray inventory https://review.openstack.org/519682 | 15:43 |
| *** zaneb has joined #tripleo | 15:43 | |
| *** sgolovatiuk has joined #tripleo | 15:46 | |
| *** dtantsur is now known as dtantsur|brb | 15:46 | |
| *** aditya_r has quit IRC | 15:46 | |
| *** dsariel has joined #tripleo | 15:47 | |
| *** artom_ has joined #tripleo | 15:50 | |
| *** aditya_r has joined #tripleo | 15:51 | |
| *** moshele has joined #tripleo | 15:52 | |
| *** oidgar has quit IRC | 15:53 | |
| EmilienM | mwhahaha: I was looking at oooq and oooq-extras, since they aren't branched, we'll probably need to modify their CI jobs layout. For example, run pike/ocata/newton jobs (with release_name is jobname) deployed on baremetal and master (queens) jobs run on containers | 15:56 |
| *** aditya_r has quit IRC | 15:56 | |
| *** ratailor has joined #tripleo | 15:58 | |
| *** jkilpatr has joined #tripleo | 15:58 | |
| *** ecerquei_ has joined #tripleo | 15:59 | |
| *** janki has joined #tripleo | 15:59 | |
| *** links has quit IRC | 16:00 | |
| *** ecerquei has quit IRC | 16:01 | |
| *** ykarel has quit IRC | 16:02 | |
| *** itlinux has joined #tripleo | 16:05 | |
| *** jprovazn has quit IRC | 16:05 | |
| *** bdeschenes has joined #tripleo | 16:06 | |
| openstackgerrit | Keith Schincke proposed openstack/puppet-tripleo master: Update cephx keys with ACLs for openstack services. https://review.openstack.org/519531 | 16:09 |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731456 | 16:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731540 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 16:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 16:10 |
| openstack | Launchpad bug 1731456 in tripleo "Timed out CI jobs not collecting logs, "FAILED with status: 137"" [Critical,Triaged] | 16:10 |
| openstack | Launchpad bug 1731540 in tripleo "CI: Deployment times out because signal back to undercloud fails with a connection timed out" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 16:10 |
| *** abregman is now known as abregman|afk | 16:10 | |
| bdeschenes | hi guys, I'm trying to upgrade tripleo but the thing is we already upgraded ceph on the nodes (to ceph 2.3).. and tripleo upgrade still thinks the package is called "ceph" when it is now called "ceph-base".. any way to direct the heat scripts to try and install ceph-base instead of ceph? | 16:10 |
| *** gvrangan has joined #tripleo | 16:10 | |
| *** chkumar|upgrade is now known as chandankumar | 16:10 | |
| *** yprokule has joined #tripleo | 16:11 | |
| openstackgerrit | Liz Blanchard proposed openstack/tripleo-ui master: Add message to spinner on Deployment Config modal https://review.openstack.org/519478 | 16:12 |
| *** cdearborn_ has joined #tripleo | 16:13 | |
| *** cylopez has left #tripleo | 16:17 | |
| *** aufi has quit IRC | 16:17 | |
| mwhahaha | EmilienM: that's kinda why i'd like to see oooq-extras branched | 16:18 |
| *** eck` is now known as eck`gone | 16:19 | |
| *** dmarlin has joined #tripleo | 16:19 | |
| *** jkilpatr has quit IRC | 16:21 | |
| *** suuuper has joined #tripleo | 16:24 | |
| *** zaneb has quit IRC | 16:25 | |
| *** zaneb has joined #tripleo | 16:25 | |
| *** dparkes has quit IRC | 16:25 | |
| *** jkilpatr has joined #tripleo | 16:29 | |
| ratailor | EmilienM, mandre I already got 2 +2's, Could you pl set workflow on these patches. | 16:29 |
| ratailor | https://review.openstack.org/#/c/511772/ | 16:29 |
| ratailor | https://review.openstack.org/#/c/511773/ | 16:29 |
| *** cdearborn has quit IRC | 16:29 | |
| *** akane has quit IRC | 16:32 | |
| *** dpawar has quit IRC | 16:33 | |
| *** ebarrera has quit IRC | 16:33 | |
| ratailor | mwhahaha, ^^Can you set workflow on ^^ | 16:38 |
| *** ratailor has quit IRC | 16:40 | |
| *** psachin has quit IRC | 16:42 | |
| *** artom_ is now known as artom | 16:43 | |
| *** aditya_r has joined #tripleo | 16:44 | |
| *** pdeore has quit IRC | 16:44 | |
| *** itlinux has quit IRC | 16:45 | |
| *** jkilpatr has quit IRC | 16:46 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-common master: WIP add UC backup actions https://review.openstack.org/517610 | 16:47 |
| openstackgerrit | Carlos Camacho proposed openstack/python-tripleoclient master: Add openstack undercloud backup https://review.openstack.org/466213 | 16:48 |
| *** pcaruana has quit IRC | 16:48 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Enable ntp iburst https://review.openstack.org/519387 | 16:50 |
| *** sgolovatiuk has quit IRC | 16:54 | |
| *** mrunge has quit IRC | 16:54 | |
| *** fzdarsky is now known as fzdarsky|afk | 16:56 | |
| *** enrraja has joined #tripleo | 16:57 | |
| *** enrraja_ has joined #tripleo | 16:59 | |
| *** paramite has quit IRC | 17:00 | |
| *** marios has quit IRC | 17:01 | |
| *** itlinux has joined #tripleo | 17:01 | |
| *** enrraja has quit IRC | 17:02 | |
| *** jfrancoa has quit IRC | 17:04 | |
| *** rhallisey has quit IRC | 17:05 | |
| openstackgerrit | Merged openstack/puppet-tripleo stable/pike: Create dedicated "apache" base profile https://review.openstack.org/519326 | 17:07 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Update undercloud dependencies for containers https://review.openstack.org/519503 | 17:07 |
| *** arxcruz__ has quit IRC | 17:07 | |
| *** dougbtv__ has joined #tripleo | 17:08 | |
| *** gvrangan has quit IRC | 17:09 | |
| weshay | sshnaidm, legacy-tripleo-ci-centos-7-ovb-containers-oooq | 17:09 |
| weshay | and gate-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset022-master-nv | 17:09 |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 17:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731456 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731540 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 17:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 17:10 |
| openstack | Launchpad bug 1731456 in tripleo "Timed out CI jobs not collecting logs, "FAILED with status: 137"" [Critical,Triaged] | 17:10 |
| openstack | Launchpad bug 1731540 in tripleo "CI: Deployment times out because signal back to undercloud fails with a connection timed out" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 17:10 |
| *** holser__ has joined #tripleo | 17:10 | |
| *** oidgar has joined #tripleo | 17:10 | |
| *** janki has quit IRC | 17:10 | |
| *** udesale has quit IRC | 17:11 | |
| *** holser__ has quit IRC | 17:13 | |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Add lookup plugin for ironic nodes https://review.openstack.org/514308 | 17:13 |
| *** holser__ has joined #tripleo | 17:13 | |
| *** yamahata has quit IRC | 17:15 | |
| gfidente | trown did it work? | 17:16 |
| *** akane has joined #tripleo | 17:19 | |
| *** rlandy|rover is now known as rlandy|rover|brb | 17:19 | |
| *** lucasagomes is now known as lucas-afk | 17:19 | |
| *** florianf has quit IRC | 17:20 | |
| *** akane has quit IRC | 17:20 | |
| *** holser__ has quit IRC | 17:20 | |
| trown | gfidente: still working on trying it... not so easy to inject that | 17:20 |
| *** holser__ has joined #tripleo | 17:20 | |
| *** jpich has quit IRC | 17:21 | |
| *** moshele has quit IRC | 17:26 | |
| *** dpawar has joined #tripleo | 17:26 | |
| *** dtrainor has quit IRC | 17:26 | |
| *** dtrainor has joined #tripleo | 17:27 | |
| *** yprokule has quit IRC | 17:28 | |
| *** gvrangan has joined #tripleo | 17:28 | |
| *** eck`gone is now known as eck` | 17:31 | |
| *** akane has joined #tripleo | 17:32 | |
| *** rlandy|rover|brb is now known as rlandy|rover | 17:33 | |
| *** aditya_r has quit IRC | 17:34 | |
| *** suuuper has quit IRC | 17:36 | |
| *** fragatina has joined #tripleo | 17:37 | |
| *** fragatina has quit IRC | 17:37 | |
| *** fragatina has joined #tripleo | 17:38 | |
| *** tzumainn has quit IRC | 17:38 | |
| *** ecerquei__ has joined #tripleo | 17:38 | |
| *** dougbtv__ has quit IRC | 17:39 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Update ansible before the ansible upgrade tasks https://review.openstack.org/519348 | 17:39 |
| openstackgerrit | Merged openstack/instack-undercloud stable/pike: Wrap IPv6 addresses in square brackets https://review.openstack.org/513757 | 17:39 |
| openstackgerrit | Merged openstack/instack-undercloud stable/pike: Handle relative hieradata_override https://review.openstack.org/513759 | 17:39 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Update documentation around tripleo-inventory https://review.openstack.org/513175 | 17:39 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Revert "Revert "Set meta container-attribute-target=host attribute"" https://review.openstack.org/516373 | 17:39 |
| openstackgerrit | Merged openstack/instack-undercloud stable/pike: Fix fetching ironic nodes for updating resource classes on upgrade https://review.openstack.org/519312 | 17:39 |
| *** ecerquei_ has quit IRC | 17:40 | |
| *** gbarros has joined #tripleo | 17:43 | |
| *** akane has quit IRC | 17:44 | |
| *** akrivoka has joined #tripleo | 17:44 | |
| *** dsariel has quit IRC | 17:44 | |
| *** enrraja_ has quit IRC | 17:44 | |
| *** dougbtv__ has joined #tripleo | 17:45 | |
| *** dtantsur|brb is now known as dtantsur | 17:45 | |
| *** enrraja has joined #tripleo | 17:45 | |
| gfidente | pradk do you have any clue what this message means http://logs.openstack.org/79/516979/2/gate/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container/13841da/logs/subnode-2/var/log/containers/ceilometer/compute.log.txt.gz#_2017-11-08_21_17_08_630 ? | 17:48 |
| *** fragatina has quit IRC | 17:48 | |
| *** dougbtv_ has quit IRC | 17:48 | |
| *** ffiore has quit IRC | 17:48 | |
| openstackgerrit | Merged openstack/tripleo-puppet-elements master: Remove unused puppet-tempest module https://review.openstack.org/518942 | 17:51 |
| *** tzumainn has joined #tripleo | 17:52 | |
| pradk | gfidente, hmm probably if the volume is none for that instance.. should be benign, its just a warning and moves on it next resource | 17:53 |
| *** cylopez has joined #tripleo | 17:53 | |
| *** derekh has quit IRC | 17:54 | |
| gfidente | pradk hey thanks | 17:54 |
| gfidente | can you see if my comment in https://bugs.launchpad.net/tripleo/+bug/1731063/comments/17 makes sense to you? | 17:54 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 17:54 |
| gfidente | it looks like that particular job is hitting intermittent issues and we're trying to figure the root cause | 17:54 |
| gfidente | I have barely figured it is the only scenario where we deploy ComputeCeilometerAgent | 17:55 |
| gfidente | maybe you can review the logs of a failed job too to make sure ceilometer is not having issues | 17:55 |
| gfidente | ? | 17:55 |
| *** bogdando has quit IRC | 17:56 | |
| openstackgerrit | Liz Blanchard proposed openstack/tripleo-ui master: Add message to spinner on Deployment Config modal https://review.openstack.org/519478 | 17:56 |
| weshay | pradk, gfidente does this have any significance? http://logs.openstack.org/79/516979/2/gate/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container/13841da/logs/subnode-2/var/log/containers/ceilometer/compute.log.txt.gz#_2017-11-08_21_17_08_630 | 17:57 |
| weshay | ha..sorry double ping | 17:57 |
| *** fragatina has joined #tripleo | 17:58 | |
| *** yamahata has joined #tripleo | 17:58 | |
| *** dsariel has joined #tripleo | 17:59 | |
| *** akane has joined #tripleo | 18:02 | |
| *** fragatina has quit IRC | 18:04 | |
| *** akane has quit IRC | 18:05 | |
| openstackgerrit | Or Idgar proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia https://review.openstack.org/487450 | 18:08 |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 18:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731456 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731540 | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 18:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 18:10 |
| openstack | Launchpad bug 1731456 in tripleo "Timed out CI jobs not collecting logs, "FAILED with status: 137"" [Critical,Triaged] | 18:10 |
| openstack | Launchpad bug 1731540 in tripleo "CI: Deployment times out because signal back to undercloud fails with a connection timed out" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 18:10 |
| *** dsariel has quit IRC | 18:12 | |
| *** dougbtv__ has quit IRC | 18:12 | |
| *** etingof has quit IRC | 18:14 | |
| *** oidgar has quit IRC | 18:16 | |
| Tengu | mwhahaha: patch merged :). | 18:18 |
| Tengu | jaosorior: we can activate apache "status" listener in Pike with the next release :) | 18:18 |
| *** bobh has quit IRC | 18:19 | |
| EmilienM | weshay: is anyone working on moving zuul legacy jobs into in-tree and v3 format? | 18:19 |
| Tengu | btw jaosorior as you're already in oslo logging stuff, could you have a look at this patch? https://review.openstack.org/#/c/518695/ it should help debunking an issue with the instance migration. | 18:20 |
| gfidente | I will just mention that from now on people can harrass fultonj for +2 as well, not just me | 18:22 |
| *** fragatina has joined #tripleo | 18:22 | |
| Tengu | gfidente: :Þ noted | 18:22 |
| fultonj | thanks all! | 18:22 |
| Tengu | fultonj: congratulations :) | 18:22 |
| fultonj | thanks Tengu | 18:23 |
| *** holser__ has quit IRC | 18:23 | |
| *** gfidente is now known as gfidente|afk | 18:25 | |
| *** dpawar has quit IRC | 18:25 | |
| *** dsariel has joined #tripleo | 18:25 | |
| *** tosky has quit IRC | 18:26 | |
| *** bdeschenes has quit IRC | 18:28 | |
| weshay | EmilienM, /me looks I have a card on that.. you and dmsimard have the reviews out there | 18:28 |
| *** rhallisey has joined #tripleo | 18:28 | |
| weshay | EmilienM, https://trello.com/c/fOdHINjZ sshnaidm wanted to see that done up front in a proper sprint for it | 18:29 |
| *** dsariel has quit IRC | 18:30 | |
| EmilienM | weshay: ok | 18:30 |
| *** jkilpatr has joined #tripleo | 18:30 | |
| EmilienM | weshay: I think it will take more than a sprint, maybe different iterations | 18:31 |
| weshay | EmilienM, sshnaidm it would be interesting to spec out the work required in that card a bit | 18:31 |
| *** absubram has joined #tripleo | 18:31 | |
| weshay | at a high level | 18:31 |
| EmilienM | ok | 18:32 |
| rook | on the uc, should we run something to truncate journal? | 18:32 |
| rook | ie journalctl --vacuum-size=500M | 18:33 |
| *** dprince has quit IRC | 18:33 | |
| rook | I just saw a UC that journal grew to 5GB | 18:33 |
| EmilienM | weshay: will do today | 18:33 |
| *** oidgar has joined #tripleo | 18:34 | |
| *** dougbtv__ has joined #tripleo | 18:36 | |
| *** tesseract has quit IRC | 18:37 | |
| trown | gfidente|afk: fultonj ok that worked... now I have to figure out how to actually do that in a non-hacky way | 18:40 |
| fultonj | trown: ok, cool. | 18:41 |
| trown | weshay: I have a fs016 env we can run tempest on over and over... got it by big hacks though... will try to figure out a proper patch after lunch | 18:41 |
| weshay | trown++ | 18:41 |
| weshay | gfidente|afk, ^ | 18:41 |
| *** trown is now known as trown|lunch | 18:41 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: Don't try to start docker for the UC https://review.openstack.org/519441 | 18:44 |
| *** gfidente|afk is now known as gfidente | 18:48 | |
| *** etingof has joined #tripleo | 18:57 | |
| rook | any thoughts on having journal truncate on a interval? maybe keep a couple of days of log, but clean up anything > 5 days? | 18:58 |
| EmilienM | weshay: so https://trello.com/c/fOdHINjZ/410-zuul-v3-native-job-changes is for native ansible jobs | 18:58 |
| EmilienM | weshay: I think the first step is to move the jobs out of openstack-infra repos | 18:58 |
| *** amoralej is now known as amoralej|off | 18:58 | |
| EmilienM | so we have total governance | 18:58 |
| *** jpena is now known as jpena|off | 18:59 | |
| *** moshele has joined #tripleo | 18:59 | |
| weshay | EmilienM, that sounds awesome | 18:59 |
| EmilienM | weshay: I'll continue the work started with dmsimard, later this week. I'm trying to catch-up from PTO and look at alerts | 19:00 |
| EmilienM | weshay: do we actually need alert on https://bugs.launchpad.net/tripleo/+bug/1724328 ? | 19:01 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 19:01 |
| *** dparkes has joined #tripleo | 19:01 | |
| EmilienM | zaneb, therve: if you can review https://review.openstack.org/#/c/519417/ please | 19:02 |
| dmsimard | EmilienM, weshay: we landed a series of patches to help the migration | 19:03 |
| dmsimard | it cut out on a lot of code duplication and etc | 19:03 |
| EmilienM | dmsimard: can you give more details please? I plan to work on that this week again | 19:04 |
| dmsimard | EmilienM: the stack of patches from mnaser, I'd need to find it again.. but you reviewed it iirc | 19:04 |
| EmilienM | weshay: re: https://bugs.launchpad.net/tripleo/+bug/1731456 - do you think https://review.openstack.org/#/c/511526/ could help? | 19:04 |
| openstack | Launchpad bug 1731456 in tripleo "Timed out CI jobs not collecting logs, "FAILED with status: 137"" [Critical,Triaged] | 19:04 |
| mnaser | dmsimard: EmilienM https://review.openstack.org/#/q/topic:cleanup-zuul+project:openstack-infra/project-config | 19:05 |
| weshay | EmilienM, yes.. but give me a bit to review times from runs | 19:05 |
| mnaser | they've mostly been merged however (in tripleo world at least) | 19:05 |
| dmsimard | mnaser: yeah | 19:06 |
| EmilienM | ok let me look that | 19:06 |
| mnaser | the unmerged changes are unrelated to tripleo afaik | 19:06 |
| *** aputtur__ has quit IRC | 19:07 | |
| *** aputtur_ has quit IRC | 19:07 | |
| EmilienM | oh I see now | 19:07 |
| EmilienM | wow thanks mnaser | 19:07 |
| EmilienM | I missed some of them | 19:08 |
| *** aputtur_ has joined #tripleo | 19:08 | |
| EmilienM | https://review.openstack.org/#/c/515972/ was super useful | 19:08 |
| EmilienM | weshay: collect logs takes less than 3 min when things go well | 19:09 |
| EmilienM | weshay: longest task is "collect-logs : Gather the logs to /tmp ", 50 seconds | 19:09 |
| EmilienM | http://logs.openstack.org/26/511526/6/check/legacy-tripleo-ci-centos-7-scenario002-multinode-oooq-puppet/c8d4899/logs/ara_oooq/ | 19:09 |
| *** agurenko has quit IRC | 19:09 | |
| EmilienM | also "collect-logs : Call get_host_info script", 47 seconds | 19:09 |
| *** moshele has quit IRC | 19:10 | |
| *** oidgar has quit IRC | 19:10 | |
| EmilienM | other tasks are ~2 seconds | 19:10 |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 19:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731456 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731540 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 19:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 19:10 |
| openstack | Launchpad bug 1731456 in tripleo "Timed out CI jobs not collecting logs, "FAILED with status: 137"" [Critical,Triaged] | 19:10 |
| openstack | Launchpad bug 1731540 in tripleo "CI: Deployment times out because signal back to undercloud fails with a connection timed out" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 19:10 |
| EmilienM | weshay: so we should take a look at these 2 tasks and see if we can optimize them | 19:10 |
| EmilienM | weshay: note we'll reduce collect-logs when we'll switch our scenarios to single-node jobs | 19:10 |
| EmilienM | (with undercloud installer) | 19:10 |
| weshay | ya | 19:11 |
| EmilienM | weshay: who is working on https://bugs.launchpad.net/tripleo/+bug/1731456 ? | 19:11 |
| openstack | Launchpad bug 1731456 in tripleo "Timed out CI jobs not collecting logs, "FAILED with status: 137"" [Critical,Triaged] | 19:11 |
| *** tosky has joined #tripleo | 19:13 | |
| weshay | EmilienM, hrm.. gerrit is not updating bugs :( | 19:13 |
| *** salmankhan has quit IRC | 19:13 | |
| weshay | rlandy|rover, FYI https://bugs.launchpad.net/tripleo/+bug/1731456 | 19:13 |
| openstack | Launchpad bug 1731456 in tripleo "Timed out CI jobs not collecting logs, "FAILED with status: 137"" [Critical,Triaged] - Assigned to Ronelle Landy (rlandy) | 19:13 |
| EmilienM | gfidente: you still around? | 19:14 |
| weshay | EmilienM, mwhahaha /me looking for a tracking bug on the tripleo-common-tox-py27 failures | 19:14 |
| mwhahaha | weshay: that might be the one raised in the meeting earlier today | 19:15 |
| EmilienM | gfidente: see my comment on https://bugs.launchpad.net/tripleo/+bug/1731063/comments/18 | 19:15 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 19:15 |
| weshay | EmilienM, trown|lunch has a recreate of that env up | 19:15 |
| mwhahaha | https://bugs.launchpad.net/tripleo/+bug/1732140 | 19:15 |
| openstack | Launchpad bug 1732140 in tripleo "Kolla tests failing for tripleo-common master" [Critical,Invalid] - Assigned to Adriano Petrich (apetrich) | 19:15 |
| *** whewawal has joined #tripleo | 19:16 | |
| mwhahaha | weshay: is it that one -^ | 19:16 |
| weshay | checking | 19:16 |
| weshay | we're hitting that quite a bit | 19:17 |
| mwhahaha | https://review.openstack.org/#/c/516136/ alledgedly will resolve it | 19:17 |
| weshay | k.. see it | 19:17 |
| weshay | thanks | 19:17 |
| mwhahaha | weshay: i don't think invalid is the correctly status for that bug however | 19:17 |
| mwhahaha | cause it is valid, maybe it should be marked as a dupe | 19:18 |
| weshay | ya.. looks like it fixed it | 19:18 |
| weshay | mwhahaha, agree | 19:18 |
| weshay | mwhahaha, fixed | 19:20 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Install dstat when a ready undercloud image is not used. https://review.openstack.org/519725 | 19:20 |
| mwhahaha | weshay: thanks | 19:21 |
| weshay | rlandy|rover, I saw it ^ | 19:22 |
| *** dprince has joined #tripleo | 19:31 | |
| *** gbarros has quit IRC | 19:35 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/519189 | 19:35 |
| weshay | mwhahaha, EmilienM fyi.. log times https://bugs.launchpad.net/tripleo/+bug/1731456/comments/7 | 19:37 |
| openstack | Launchpad bug 1731456 in tripleo "Timed out CI jobs not collecting logs, "FAILED with status: 137"" [Critical,Triaged] - Assigned to Ronelle Landy (rlandy) | 19:37 |
| weshay | rlandy|rover, ^ | 19:37 |
| weshay | mwhahaha, EmilienM not sure if we're going to be able to make log collection much quicker | 19:38 |
| *** trown|lunch is now known as trown | 19:39 | |
| EmilienM | weshay: indeed | 19:41 |
| EmilienM | weshay: until we cut the jobs to 1 nodes | 19:41 |
| *** bobh has joined #tripleo | 19:41 | |
| weshay | removed alert | 19:41 |
| *** owalsh has quit IRC | 19:43 | |
| *** owalsh has joined #tripleo | 19:44 | |
| *** dtantsur is now known as dtantsur|afk | 19:45 | |
| *** arxcruz__ has joined #tripleo | 19:52 | |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: be more prescriptive in log collection https://review.openstack.org/511526 | 19:52 |
| weshay | rlandy|rover, agree.. going to close the bug w/ https://review.openstack.org/#/c/511526/ | 19:53 |
| EmilienM | weshay: i'm rebasing https://review.openstack.org/#/c/517445/ | 19:53 |
| rlandy|rover | weshay: ack - will keep a watch for any similar failures after that has merged | 19:54 |
| *** itlinux has quit IRC | 19:54 | |
| weshay | EmilienM, k k.. dprince and I are looking at https://review.openstack.org/#/c/519441/ | 19:56 |
| dprince | yes, waiting anxiously | 19:56 |
| EmilienM | ok | 19:57 |
| *** dhill_ has quit IRC | 19:57 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: DNM: Update undercloud install options for containers https://review.openstack.org/517445 | 19:57 |
| weshay | mwhahaha, EmilienM need review for this promotion blocker https://review.openstack.org/#/c/519486/ | 19:58 |
| EmilienM | weshay: just updated and cleaned some depends-on | 19:58 |
| EmilienM | looking | 19:58 |
| EmilienM | weshay: approved | 19:58 |
| weshay | thanks! rlandy|rover ^ | 19:58 |
| *** oidgar has joined #tripleo | 19:59 | |
| rlandy|rover | weshay: thanks - still running full tempest on that change to see if we fixed the other neutron related tempest errors in master: https://review.rdoproject.org/jenkins/job/gate-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master-nv/24/console | 20:00 |
| *** dhill_ has joined #tripleo | 20:03 | |
| *** arxcruz__ has quit IRC | 20:05 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras master: Allow using FQDN for ceph-mon setup https://review.openstack.org/519736 | 20:06 |
| *** shardy has quit IRC | 20:07 | |
| *** mrunge has joined #tripleo | 20:08 | |
| *** jmelvin has quit IRC | 20:08 | |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 20:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731540 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 20:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 20:10 |
| openstack | Launchpad bug 1731540 in tripleo "CI: Deployment times out because signal back to undercloud fails with a connection timed out" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 20:10 |
| *** pcaruana has joined #tripleo | 20:12 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Fix indentation for the OOOQ ASCII banner https://review.openstack.org/519739 | 20:12 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: WIP - Import TripleO legacy zuul jobs https://review.openstack.org/514793 | 20:14 |
| EmilienM | mnaser: could you take a look at ^ ? I'm afraid to screw something up during the rebase | 20:14 |
| EmilienM | mnaser: I probably missed your recent changes in project-config | 20:14 |
| *** rfolco has quit IRC | 20:14 | |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: Set ceph_use_fqdn for rdocloud https://review.openstack.org/519744 | 20:15 |
| mnaser | EmilienM: sure. Stuck in traffic. Mind adding me as a reviewer and I’ll look at it when I’m near a laptop | 20:15 |
| *** gvrangan has quit IRC | 20:15 | |
| EmilienM | mnaser: no problem, thanks | 20:15 |
| EmilienM | mnaser: I'll try to look myself again | 20:15 |
| EmilienM | mnaser: added to 3 patches | 20:16 |
| *** social has quit IRC | 20:17 | |
| *** toure is now known as toure_biab | 20:17 | |
| *** holser__ has joined #tripleo | 20:18 | |
| *** enrraja_ has joined #tripleo | 20:20 | |
| *** enrraja has quit IRC | 20:21 | |
| *** dparkes has quit IRC | 20:21 | |
| *** enrraja__ has joined #tripleo | 20:22 | |
| weshay | trown, you should probably leave that env up for gfidente to poke at | 20:24 |
| trown | weshay: ya will do, but if tempest keeps passing might not be much to look at :P | 20:24 |
| weshay | ya.. | 20:24 |
| *** enrraja_ has quit IRC | 20:25 | |
| weshay | trown, fultonj may also want to poke | 20:25 |
| weshay | fultonj, gfidente fyi.. trown has an environment up with legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container atm we're not able to see tempest fail | 20:25 |
| weshay | mwhahaha, ^ | 20:25 |
| fultonj | ok, cool let me check it out | 20:26 |
| fultonj | on a call at the moment | 20:26 |
| *** aputtur_ has quit IRC | 20:27 | |
| *** salmankhan has joined #tripleo | 20:27 | |
| weshay | rlandy|rover, k.. and that one failure is the mtu test? | 20:27 |
| rlandy|rover | weshay: yes - so that fix is not right or not complete | 20:28 |
| weshay | rlandy|rover, can you please add it to the skip list w/ a bug and we'll address | 20:28 |
| weshay | rlandy|rover, it's ok to promote w/ a tempest failure as long as we have a bug doc'd for it | 20:28 |
| weshay | rlandy|rover, are you running w/ my updated skip list? | 20:28 |
| rlandy|rover | weshay: the bigger question is if the fix does more harm than good - see the failure on fs021 | 20:29 |
| weshay | where? | 20:29 |
| rlandy|rover | I ma running with latest | 20:29 |
| rlandy|rover | weshay: btw: this is the bug for the 29 failures: https://bugs.launchpad.net/tripleo/+bug/1732174 | 20:30 |
| openstack | Launchpad bug 1732174 in tripleo "Tempest tests fail in featureset020 periodic job fails " [Critical,New] | 20:30 |
| rlandy|rover | weshay: this failure: https://logs.rdoproject.org/86/519486/1/openstack-experimental/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset021-master/Z8f4ab946b5ea4cfc9764ee721241536d/undercloud/home/jenkins/tempest_output.log.txt.gz | 20:31 |
| *** salmankhan has quit IRC | 20:31 | |
| rlandy|rover | run from the change to add mtus to overcloud | 20:31 |
| weshay | rlandy|rover, we need a bug on why this is not working in rdo sf.. btw https://logs.rdoproject.org/86/519486/1/openstack-experimental/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset021-master/Z8f4ab946b5ea4cfc9764ee721241536d/stackviz/#/stdin | 20:32 |
| rlandy|rover | weshay: there is a bug for that - adarazs|ruck opened a bug today and arxcruz already had one open | 20:33 |
| *** arxcruz__ has joined #tripleo | 20:33 | |
| weshay | rlandy|rover, ya.. I thought the patch merged though, because it's working upstream | 20:33 |
| rlandy|rover | arxcruz: ^^ | 20:34 |
| * rlandy|rover finds adarazs|ruck's bug | 20:34 | |
| arxcruz__ | rlandy|rover sorry, got dc, don't have logs, what's up ? | 20:35 |
| *** jmelvin has joined #tripleo | 20:35 | |
| *** rhallisey has quit IRC | 20:36 | |
| *** rhallisey has joined #tripleo | 20:36 | |
| rlandy|rover | arxcruz__: thanks ... weshay ... https://review.openstack.org/#/c/517906/ | 20:37 |
| rlandy|rover | not yet merged | 20:37 |
| openstackgerrit | Alan Bishop proposed openstack/tripleo-heat-templates master: CI: Test multi-rbd backend for cinder in scenario001 https://review.openstack.org/519749 | 20:39 |
| rlandy|rover | weshay: wrt mtu failure - I will add it to the skip list - and I'll try another run with the extras change also included this time | 20:39 |
| therve | EmilienM, commented, not sure mwhahaha is around | 20:40 |
| EmilienM | oh I'm sure he is :D | 20:40 |
| mwhahaha | i'm around | 20:40 |
| *** ccamacho has quit IRC | 20:40 | |
| therve | mwhahaha, So the server returns a 408 | 20:41 |
| therve | Shouldn't we handle that instead | 20:41 |
| mwhahaha | therve: no that was a different job | 20:41 |
| mwhahaha | therve: 408 is a client error | 20:41 |
| mwhahaha | meanning the client went away | 20:41 |
| mwhahaha | which the client interpreted as a connection failure | 20:41 |
| therve | Hum ok | 20:41 |
| rlandy|rover | weshay: also wrt tempest - this skip list change is till outstanding: https://review.openstack.org/#/c/513820/ | 20:42 |
| rlandy|rover | note the same failure here on fs021 | 20:42 |
| therve | mwhahaha, So how does request handle connection failure? as 5XX codes? | 20:42 |
| mwhahaha | therve: retry occurs for multiple reasons, connection failures, read failures or the 5xx codes provided | 20:42 |
| therve | OK | 20:43 |
| therve | mwhahaha, And do you have any indication that retrying would have worked here? | 20:43 |
| mwhahaha | therve: worked what | 20:44 |
| therve | mwhahaha, Is the issue solved by retrying? | 20:45 |
| mwhahaha | therve: if the cause is truely environmental, it would have likely improved the chances of it not failing completely | 20:45 |
| mwhahaha | therve: the problem is that the whole pull process breaks down if the signals get lost | 20:45 |
| mwhahaha | therve: it needs to be made more resiliant | 20:45 |
| therve | mwhahaha, Sure, I agree in principle, it should may not fix the issue | 20:47 |
| mwhahaha | in this case it would have retried and if it was temporary and environmetal it would have had an improved chance of success | 20:47 |
| mwhahaha | since it just failed hard | 20:47 |
| therve | mwhahaha, You have multiple "os-collect-config: HTTPConnectionPool(host='192.168.24.1', port=8080): Read timed out. (read timeout=10.0)" | 20:47 |
| *** nyechiel has joined #tripleo | 20:48 | |
| therve | Later on, on a different port ( swift?) | 20:48 |
| mwhahaha | let me take a look, i'm having a few conversations at once | 20:48 |
| therve | OK, bbiab | 20:48 |
| apetrich | mwhahaha, weshay the problem was that I didn't have the permissions to mark the https://bugs.launchpad.net/tripleo/+bug/1732140 as a duplicate. the best I could do was invalid | 20:50 |
| openstack | Launchpad bug 1727519 in tripleo "duplicate for #1732140 image prepare CLI commands maintains its own default argument values" [High,In progress] - Assigned to Steve Baker (steve-stevebaker) | 20:50 |
| mwhahaha | therve: where did you see the multiple timeouts? which log | 20:50 |
| *** jmelvin has quit IRC | 20:50 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: WIP - Import TripleO legacy zuul jobs https://review.openstack.org/514793 | 20:51 |
| *** jmelvin has joined #tripleo | 20:51 | |
| EmilienM | weshay: could you please review https://review.openstack.org/#/c/514793/ and tell which jobs we'll drop soon | 20:51 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Install dstat when a ready undercloud image is not used. https://review.openstack.org/519725 | 20:52 |
| weshay | EmilienM, sure.. sec | 20:52 |
| EmilienM | dmsimard: "Job dsvm-base not defined" in https://review.openstack.org/514793 - should I import dsvm-base as well? | 20:53 |
| weshay | EmilienM, here's what I was looking to drop, but unable to find the project config foo https://review.openstack.org/#/c/518405/ | 20:54 |
| *** nyechiel has quit IRC | 20:54 | |
| EmilienM | weshay: ah it's still not merged? :( | 20:54 |
| weshay | EmilienM, does anything ever merge? | 20:54 |
| EmilienM | Job legacy-tripleo-ci-centos-7-containers-multinode-upgrades not defined | 20:54 |
| EmilienM | yeah you missed project-config upodate | 20:55 |
| EmilienM | update* | 20:55 |
| dmsimard | EmilienM: Andreas already replied | 20:55 |
| EmilienM | ah | 20:56 |
| EmilienM | he's fast | 20:56 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: WIP - Import TripleO legacy zuul jobs https://review.openstack.org/514793 | 20:57 |
| EmilienM | weshay: have you asked for help on #openstack-infra? We need your patch asap imho | 20:57 |
| weshay | EmilienM, I | 20:57 |
| weshay | 'I'll go see if they can see it when I type | 20:57 |
| weshay | something is weird w/ my nick in that channel... | 20:58 |
| weshay | #iseeooopeople | 20:58 |
| EmilienM | maybe we can poke dmsimard on this patch | 20:58 |
| *** arxcruz__ has quit IRC | 20:58 | |
| EmilienM | about https://review.openstack.org/#/c/518405/ | 20:58 |
| fultonj | trown: does your env running running legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container without failures have a change relevant to ceph? | 21:01 |
| fultonj | without tempest* failures | 21:01 |
| trown | fultonj: no... even ci the tempest failures are racy | 21:01 |
| mwhahaha | therve: so you're right. So I guess my question what would have happend if os-collect-config had been able to talk to heat again. would it have resignaled or was it lost | 21:02 |
| *** ramishra has joined #tripleo | 21:03 | |
| therve | mwhahaha, From what I understand,heat didn't get anything? | 21:05 |
| *** moshele has joined #tripleo | 21:05 | |
| mwhahaha | therve: so it looks like the connectivity blue up during the signal | 21:05 |
| therve | So if it was able to connect again it would have worked | 21:05 |
| mwhahaha | therve: what would have happened on a subsequent run of os-collect-config | 21:05 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Set NeutronGlobalPhysnetMtu for default values https://review.openstack.org/519471 | 21:05 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Set NeutronGlobalPhysnetMtu for default values https://review.openstack.org/519471 | 21:05 |
| mwhahaha | ok so my patch would have just improved reliability for the initial run but in theory it should have been fine | 21:05 |
| *** whewawal has quit IRC | 21:05 | |
| mwhahaha | so it looks like the connectivity loss is more the cause | 21:05 |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Add MTU asjustment parameters to RDO Cloud settings https://review.openstack.org/519486 | 21:06 |
| mwhahaha | so perhaps the vxlan configuration failed between the cloud isntances | 21:06 |
| therve | So to get back on your patch | 21:07 |
| therve | Retrying is a good idea, but I think we lose the signal data if notify fails (would need to check) | 21:07 |
| fultonj | trown: i don't have the whole picture. my understanding is that we want to solve LP bug 1731063 and that you have an env running the same job but without the symptoms. is that right? | 21:08 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] https://launchpad.net/bugs/1731063 | 21:08 |
| therve | I'm a bit worried about handling 500, but that's minor | 21:08 |
| therve | I'm more worried about the lack of CI for heat-agents | 21:08 |
| trown | fultonj: correct | 21:08 |
| mwhahaha | therve: :D why the concern over 500? | 21:08 |
| therve | Wondering if you tested your patch manually | 21:08 |
| therve | mwhahaha, Well, not sure retrying 500 has any benefit | 21:08 |
| trown | fultonj: but symptom only occurs ~25% even in CI | 21:08 |
| mwhahaha | therve: so if someone screws up the apache config but it gets fixed while it's retrying it would work | 21:09 |
| *** holser__ has quit IRC | 21:09 | |
| therve | Fair | 21:09 |
| fultonj | trown: but there was no software change in your env, and for all we know you just go lucky? assuming the same failure rate you and CI could both me in the 75% | 21:09 |
| fultonj | got* | 21:09 |
| *** oidgar has quit IRC | 21:09 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: WIP - Import TripleO legacy zuul jobs https://review.openstack.org/514793 | 21:09 |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731540 | 21:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 21:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 21:10 |
| openstack | Launchpad bug 1731540 in tripleo "CI: Deployment times out because signal back to undercloud fails with a connection timed out" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 21:10 |
| trown | fultonj: ya... I have ran it about 10 times now... but ya | 21:12 |
| therve | mwhahaha, So yeah were you able to test it manually? :) | 21:12 |
| mwhahaha | therve: let me do a depends-on patch in tripleo just for giggles | 21:13 |
| therve | Not sure it works, but worth a try :) | 21:13 |
| mwhahaha | it should | 21:13 |
| therve | It's part of the image no? | 21:13 |
| therve | That'd be good to know | 21:14 |
| * therve off, thanks for the fix | 21:14 | |
| mwhahaha | therve: for multinode we don't use image | 21:14 |
| mwhahaha | therve: which is where this was found, but the dlrn build should inject it in the image | 21:14 |
| mwhahaha | we'll see :D | 21:14 |
| *** dparkes has joined #tripleo | 21:15 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: WIP - Import TripleO legacy zuul jobs https://review.openstack.org/514793 | 21:15 |
| *** zoli has quit IRC | 21:16 | |
| tonyb | If I need to add some pre-provisioned (split-stack) nodes into an running overcloud, how to I configure the mapping of IP -> role ? I can see DeployedServerPortMap but I'm not seeing the node to role mapping | 21:16 |
| tonyb | mwhahaha: Thanks again for your help the other day. I have a deployed overcloud now because of it \o/ | 21:17 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: DNM: Test heat-agents fix https://review.openstack.org/519756 | 21:17 |
| mwhahaha | tonyb: yay | 21:17 |
| *** holser__ has joined #tripleo | 21:17 | |
| *** zoli has joined #tripleo | 21:18 | |
| *** dparkes has quit IRC | 21:19 | |
| *** Goneri has quit IRC | 21:21 | |
| *** dparkes has joined #tripleo | 21:25 | |
| *** morazi has quit IRC | 21:25 | |
| *** dprince has quit IRC | 21:28 | |
| *** dparkes has quit IRC | 21:30 | |
| *** abishop has quit IRC | 21:30 | |
| *** dparkes has joined #tripleo | 21:33 | |
| *** dparkes has quit IRC | 21:37 | |
| *** myoung is now known as myoung|bbl | 21:39 | |
| *** ansmith has quit IRC | 21:42 | |
| *** dparkes has joined #tripleo | 21:43 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Consume TripleO CI zuul v3 jobs https://review.openstack.org/519761 | 21:43 |
| *** rcernin has joined #tripleo | 21:44 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras master: Allow using FQDN for ceph-mon setup https://review.openstack.org/519736 | 21:45 |
| *** artom has quit IRC | 21:53 | |
| EmilienM | mwhahaha, weshay: i'm about to create a spreadsheet for our zuul layout per project | 21:54 |
| EmilienM | so we can agree on the layout before i continue my progress on zuul v3 transition | 21:54 |
| EmilienM | I got something working today ^ need to know our layout now | 21:54 |
| *** holser__ has quit IRC | 21:56 | |
| *** trown is now known as trown|outtypewww | 21:56 | |
| weshay | EmilienM, ack thanks | 21:57 |
| *** cdearborn__ has joined #tripleo | 21:57 | |
| EmilienM | 2017, we do YAML and spreadsheets :D | 21:57 |
| *** raissa_ has joined #tripleo | 21:59 | |
| *** raissa has quit IRC | 21:59 | |
| *** Vijayendra has quit IRC | 21:59 | |
| *** Vijayendra_ has joined #tripleo | 21:59 | |
| *** cdearborn_ has quit IRC | 21:59 | |
| *** bandini has quit IRC | 22:01 | |
| *** pcaruana has quit IRC | 22:02 | |
| *** kbyrne has quit IRC | 22:03 | |
| *** bandini has joined #tripleo | 22:04 | |
| *** kbyrne has joined #tripleo | 22:04 | |
| *** pcaruana has joined #tripleo | 22:06 | |
| *** gfidente has quit IRC | 22:07 | |
| *** pcaruana has quit IRC | 22:07 | |
| *** ecerquei__ has quit IRC | 22:07 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Add test_mtu_sized_frames to the skip list during investigation https://review.openstack.org/519770 | 22:08 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Add test_mtu_sized_frames to the skip list during investigation https://review.openstack.org/519770 | 22:10 |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 22:10 |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 22:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 22:10 |
| *** threestrands has joined #tripleo | 22:12 | |
| *** threestrands has joined #tripleo | 22:12 | |
| *** enrraja__ has quit IRC | 22:13 | |
| *** morazi has joined #tripleo | 22:13 | |
| *** arxcruz__ has joined #tripleo | 22:19 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates stable/pike: Enable ntp iburst https://review.openstack.org/519779 | 22:21 |
| *** threestrands has quit IRC | 22:21 | |
| *** threestrands has joined #tripleo | 22:22 | |
| *** threestrands has joined #tripleo | 22:22 | |
| *** Goneri has joined #tripleo | 22:22 | |
| openstackgerrit | Merged openstack/instack-undercloud stable/ocata: Fix the expirer cron task to run correctly https://review.openstack.org/519639 | 22:23 |
| mwhahaha | EmilienM, weshay: isn't http://logs.openstack.org/40/518440/6/gate/legacy-tripleo-ci-centos-7-scenario007-multinode-oooq/b9c39a6/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-11-14_21_45_24 a known issue for that host and why we switched off of pingtest? | 22:24 |
| * EmilienM clicks | 22:24 | |
| EmilienM | mwhahaha: no it's not related to pingtest | 22:25 |
| mwhahaha | thought it was | 22:25 |
| EmilienM | it's a deployed-server thing AFIK | 22:25 |
| EmilienM | let me check | 22:25 |
| weshay | EmilienM, ya.. I have not see that trace at that part of the deployment | 22:25 |
| EmilienM | https://github.com/openstack/tripleo-heat-templates/blob/a425f1ce09ab60c19a1f74a981edcfeb46efe6a3/overcloud.j2.yaml#L482-L488 | 22:26 |
| EmilienM | https://github.com/openstack/tripleo-heat-templates/blob/a425f1ce09ab60c19a1f74a981edcfeb46efe6a3/overcloud.j2.yaml#L798-L809 | 22:26 |
| EmilienM | it's part of network validation when deploying an overcloud | 22:27 |
| EmilienM | it verifies nodes can be pinged before running os-collect-config | 22:27 |
| EmilienM | afik | 22:27 |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Add MTU adjustment parameters to RDO Cloud settings https://review.openstack.org/519486 | 22:27 |
| EmilienM | mwhahaha: if that fails^ it's a multinode networking issue | 22:29 |
| EmilienM | I think | 22:29 |
| mwhahaha | seems likely | 22:29 |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Add MTU adjustment parameters to RDO Cloud settings https://review.openstack.org/519486 | 22:32 |
| EmilienM | dmsimard: need your help | 22:33 |
| EmilienM | dmsimard: I'm trying to figure out why https://review.openstack.org/#/c/514793/ fails on tripleo-ci-centos-7-nonha-multinode-oooq (see zuul UI) | 22:33 |
| EmilienM | dmsimard: like the job doesn't exist, but it's in zuul.d/legacy-jobs.yaml | 22:33 |
| *** thrash is now known as thrash|g0ne | 22:34 | |
| *** pradk has quit IRC | 22:35 | |
| *** cdearborn__ has quit IRC | 22:38 | |
| *** jlabarre has quit IRC | 22:39 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/519189 | 22:40 |
| *** gbarros has joined #tripleo | 22:43 | |
| *** bobh has quit IRC | 22:46 | |
| weshay | EmilienM, I think he's on pto | 22:48 |
| EmilienM | ah oops | 22:48 |
| *** jjoyce has quit IRC | 22:50 | |
| *** jjoyce has joined #tripleo | 22:51 | |
| EmilienM | jrist: what value do we have to run legacy-tripleo-ci-centos-7-undercloud-oooq in tripleo-ui? | 22:54 |
| EmilienM | do we actually deploy & test UI in this job? | 22:54 |
| jrist | I have no idea, tbh | 22:54 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/519189 | 22:54 |
| EmilienM | k | 22:54 |
| EmilienM | no worries | 22:54 |
| jrist | EmilienM: I think it is sticking around from legacy | 22:54 |
| EmilienM | k | 22:55 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: Don't try to start docker for the UC https://review.openstack.org/519441 | 22:56 |
| openstackgerrit | Pradeep Kilambi proposed openstack/instack-undercloud stable/newton: Fix the expirer cron task to run correctly https://review.openstack.org/519824 | 22:58 |
| dmsimard | EmilienM: sorry I've been at the Montreal office today for things.. on my cellphone right now, not going to be able to look soon | 22:58 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ui master: Switch tripleo-ui to use zuul v3 jobs https://review.openstack.org/519826 | 23:03 |
| *** bfournie has quit IRC | 23:04 | |
| EmilienM | dmsimard: np | 23:07 |
| EmilienM | jrist: with that patch, tripleo-ui folks will be able to manage their own tests ^ | 23:07 |
| jrist | thanks | 23:08 |
| *** pmannidi has joined #tripleo | 23:08 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 23:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| *** cylopez has quit IRC | 23:10 | |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 23:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 23:10 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ui master: Switch tripleo-ui to use zuul v3 jobs https://review.openstack.org/519826 | 23:13 |
| *** ansmith has joined #tripleo | 23:16 | |
| *** dmacpher has quit IRC | 23:18 | |
| EmilienM | jrist: here | 23:22 |
| jrist | https://review.openstack.org/#/c/514795/ | 23:22 |
| jrist | EmilienM: ^ | 23:22 |
| * EmilienM clicks | 23:22 | |
| jrist | no one has looked at it :( | 23:22 |
| EmilienM | ok I'm doing a recheck | 23:23 |
| EmilienM | because last run is Oct 24 | 23:23 |
| EmilienM | and +2 | 23:23 |
| jrist | thanks! | 23:23 |
| EmilienM | what is that ?? https://review.openstack.org/#/c/514794/1/roles/validate-ui/.travis.yml | 23:23 |
| EmilienM | weshay: ^ | 23:24 |
| *** hjensas has quit IRC | 23:25 | |
| *** rlandy|rover is now known as rlandy|rover|afk | 23:29 | |
| *** ramishra has quit IRC | 23:30 | |
| *** gbarros has quit IRC | 23:35 | |
| *** gbarros has joined #tripleo | 23:36 | |
| mwhahaha | weshay: so we don't keep the host tar.gz files in upstream CI do we? | 23:41 |
| mwhahaha | nevermind, we don't generate them. rsync gathering is the long pole in log collection | 23:45 |
| *** dmarlin has quit IRC | 23:54 | |
| *** moshele has quit IRC | 23:56 | |
| *** Goneri has quit IRC | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!