openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/rocky: GATE CHECK for TripleO https://review.openstack.org/602247 | 00:00 |
---|---|---|
*** dpeacock has quit IRC | 00:03 | |
*** dpeacock has joined #tripleo | 00:07 | |
*** openstackgerrit has quit IRC | 00:09 | |
*** ooolpbot has joined #tripleo | 00:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 00:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 00:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 00:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 00:10 |
openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 00:10 |
*** ooolpbot has quit IRC | 00:10 | |
openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 00:10 |
openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 00:10 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 00:10 |
*** Chaserjim has quit IRC | 00:19 | |
*** Chaserjim has joined #tripleo | 00:21 | |
*** Chaserjim has quit IRC | 00:36 | |
*** Chaserjim has joined #tripleo | 00:37 | |
*** openstackgerrit has joined #tripleo | 00:41 | |
openstackgerrit | Feng Pan proposed openstack/tripleo-heat-templates master: Add containerized services for networking-vpp ML2 driver https://review.openstack.org/600582 | 00:41 |
*** ooolpbot has joined #tripleo | 01:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 01:10 |
openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 01:10 |
*** ooolpbot has quit IRC | 01:10 | |
openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 01:10 |
openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 01:10 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 01:10 |
*** Chaserjim has quit IRC | 01:16 | |
*** Chaserjim has joined #tripleo | 01:23 | |
*** Chaserjim has quit IRC | 01:37 | |
*** Chaserjim has joined #tripleo | 01:41 | |
*** mrsoul has quit IRC | 01:44 | |
*** mschuppert has quit IRC | 01:44 | |
*** Chaserjim has quit IRC | 01:45 | |
*** fpan has joined #tripleo | 01:45 | |
*** akrzos has quit IRC | 01:48 | |
*** haleyb has quit IRC | 01:48 | |
*** Chaserjim has joined #tripleo | 01:49 | |
*** Chaserjim has quit IRC | 01:58 | |
*** Chaserjim has joined #tripleo | 02:02 | |
*** ooolpbot has joined #tripleo | 02:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 02:10 |
openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 02:10 |
*** ooolpbot has quit IRC | 02:10 | |
openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 02:10 |
openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 02:10 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 02:10 |
*** Chaserjim has quit IRC | 02:10 | |
*** Chaserjim has joined #tripleo | 02:15 | |
*** Chaserjim has quit IRC | 02:23 | |
*** Chaserjim has joined #tripleo | 02:27 | |
*** Chaserjim has quit IRC | 02:42 | |
*** dxiri has joined #tripleo | 02:43 | |
*** Chaserjim has joined #tripleo | 02:47 | |
*** mrunge_ has joined #tripleo | 02:57 | |
*** mrunge has quit IRC | 02:57 | |
*** Chaserjim has quit IRC | 02:59 | |
*** Chaserjim has joined #tripleo | 03:03 | |
*** ooolpbot has joined #tripleo | 03:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 03:10 |
openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 03:10 |
*** ooolpbot has quit IRC | 03:10 | |
openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 03:10 |
openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 03:10 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 03:10 |
*** ykarel has joined #tripleo | 03:31 | |
*** udesale has joined #tripleo | 03:34 | |
*** skramaja has joined #tripleo | 03:37 | |
*** ramishra has joined #tripleo | 03:40 | |
*** Chaserjim has quit IRC | 03:57 | |
*** Chaserjim has joined #tripleo | 04:01 | |
*** udesale has quit IRC | 04:03 | |
*** ooolpbot has joined #tripleo | 04:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 04:10 |
openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 04:10 |
*** ooolpbot has quit IRC | 04:10 | |
openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 04:10 |
openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 04:10 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 04:10 |
*** udesale has joined #tripleo | 04:24 | |
*** udesale has quit IRC | 04:25 | |
*** udesale has joined #tripleo | 04:25 | |
*** khyr0n has joined #tripleo | 04:29 | |
*** Petersingh has joined #tripleo | 04:39 | |
*** Chaserjim has quit IRC | 04:39 | |
*** Chaserjim has joined #tripleo | 04:43 | |
*** Petersingh is now known as Petersingh|afk | 04:46 | |
*** yprokule has joined #tripleo | 04:49 | |
*** Chaserjim has quit IRC | 04:52 | |
*** Chaserjim has joined #tripleo | 04:56 | |
*** shyamb has joined #tripleo | 05:08 | |
shyamb | Hi | 05:09 |
*** ooolpbot has joined #tripleo | 05:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 05:10 |
openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 05:10 |
*** ooolpbot has quit IRC | 05:10 | |
openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 05:10 |
openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 05:10 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 05:10 |
*** Chaserjim has quit IRC | 05:13 | |
*** Petersingh|afk is now known as Petersingh | 05:17 | |
*** Chaserjim has joined #tripleo | 05:17 | |
shyamb | Hi, When should we use overclcoud deploy command and overcloud update command? | 05:18 |
shyamb | I know for a fresh deployment we need use overcloud deploy | 05:19 |
shyamb | and for further updates we need to use overcloud update run command | 05:19 |
shyamb | but I need more details regarding third party container's deployment and update | 05:20 |
*** ykarel has quit IRC | 05:22 | |
*** jbadiapa has joined #tripleo | 05:25 | |
*** shyamb has quit IRC | 05:27 | |
*** quique|rover|off is now known as quiquell|rover | 05:30 | |
*** janki has joined #tripleo | 05:32 | |
*** dxiri has quit IRC | 05:33 | |
*** jtomasek has joined #tripleo | 05:34 | |
*** ykarel has joined #tripleo | 05:42 | |
*** jtomasek has quit IRC | 05:44 | |
*** jtomasek has joined #tripleo | 05:45 | |
*** ksambor_ has joined #tripleo | 05:53 | |
*** saneax has joined #tripleo | 05:55 | |
*** quiquell|rover has quit IRC | 05:56 | |
*** quiquell has joined #tripleo | 05:56 | |
*** quiquell is now known as quiquell|rover | 05:56 | |
*** Chaserjim has quit IRC | 05:56 | |
*** shyamb has joined #tripleo | 06:00 | |
*** Chaserjim has joined #tripleo | 06:00 | |
*** quiquell|rover is now known as quique|rover | 06:01 | |
*** quique|rover is now known as quiquell|rover | 06:01 | |
*** holser|ptg has joined #tripleo | 06:03 | |
*** mschuppert has joined #tripleo | 06:03 | |
*** agurenko has joined #tripleo | 06:04 | |
*** holser|p_ has joined #tripleo | 06:05 | |
*** jfrancoa has joined #tripleo | 06:05 | |
*** holser|ptg has quit IRC | 06:05 | |
*** Chaserjim has quit IRC | 06:08 | |
*** Chaserjim has joined #tripleo | 06:09 | |
*** ooolpbot has joined #tripleo | 06:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 06:10 |
openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 06:10 |
*** ooolpbot has quit IRC | 06:10 | |
openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 06:10 |
openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 06:10 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 06:10 |
openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Triaged] - Assigned to Mehdi Abaakouk (sileht) | 06:10 |
*** jaganathan has joined #tripleo | 06:10 | |
*** Chaserjim has quit IRC | 06:16 | |
*** Chaserjim has joined #tripleo | 06:17 | |
*** rnoriega has quit IRC | 06:17 | |
*** cylopez has joined #tripleo | 06:18 | |
*** rdopiera has joined #tripleo | 06:18 | |
*** apetrich has joined #tripleo | 06:18 | |
*** yprokule has quit IRC | 06:20 | |
*** rnoriega has joined #tripleo | 06:20 | |
*** Chaserjim has quit IRC | 06:26 | |
*** aufi has joined #tripleo | 06:28 | |
*** dxiri has joined #tripleo | 06:30 | |
*** Chaserjim has joined #tripleo | 06:30 | |
*** hamdyk has joined #tripleo | 06:31 | |
*** yprokule has joined #tripleo | 06:31 | |
ykarel | jistr, re. https://bugs.launchpad.net/tripleo/+bug/1792560, do Depends-On on a project which are packaged used to work before on a upgrade job? i commented on the bug also | 06:32 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 06:32 |
*** quiquell|rover is now known as quique|rover|brb | 06:37 | |
*** udesale has quit IRC | 06:38 | |
mschuppert | quiquell|rover: hi, can we say when do we expect the queens promotion will happen? | 06:38 |
*** Chaserjim has quit IRC | 06:38 | |
chkumar|ruck | dtantsur|afk: Hello | 06:39 |
*** Chaserjim has joined #tripleo | 06:39 | |
chkumar|ruck | dtantsur|afk: when you are around please have a look at these two bugs https://bugs.launchpad.net/tripleo/+bug/1792870 and https://bugs.launchpad.net/tripleo/+bug/1792872 both seems to be related to ironic conductor causing faiure at overcloud prepare image step in rocy and queens | 06:39 |
openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] | 06:39 |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] | 06:39 |
*** udesale has joined #tripleo | 06:40 | |
*** hjensas has joined #tripleo | 06:40 | |
*** aufi has quit IRC | 06:41 | |
*** udesale has quit IRC | 06:45 | |
openstackgerrit | yatin proposed openstack/tripleo-quickstart-extras master: Build Packages for upgrade_release https://review.openstack.org/603026 | 06:46 |
openstackgerrit | yatin proposed openstack-infra/tripleo-ci master: Switch previous release of master from 'queens' to 'rocky' https://review.openstack.org/590774 | 06:47 |
ykarel | jistr, trying ^^ but is non containerized rocky undercloud upgrade to containerized master undercloud supported? | 06:51 |
*** Chaserjim has quit IRC | 06:53 | |
*** Chaserjim has joined #tripleo | 06:56 | |
*** slaweq has joined #tripleo | 07:00 | |
openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Enable support for running refstack tests in TQE https://review.openstack.org/570719 | 07:01 |
*** yprokule has quit IRC | 07:02 | |
*** saneax has quit IRC | 07:04 | |
*** quique|rover|brb is now known as quiquell|rover | 07:07 | |
*** ooolpbot has joined #tripleo | 07:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 07:10 |
openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 07:10 |
*** ooolpbot has quit IRC | 07:10 | |
openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 07:10 |
openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 07:10 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 07:10 |
openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Triaged] - Assigned to Mehdi Abaakouk (sileht) | 07:10 |
openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] | 07:10 |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] | 07:10 |
*** rcernin has quit IRC | 07:11 | |
*** amoralej has joined #tripleo | 07:11 | |
openstackgerrit | Florian Fuchs proposed openstack/tripleo-common stable/rocky: Fix validation runs in a containerized environment https://review.openstack.org/603031 | 07:11 |
*** shardy has joined #tripleo | 07:15 | |
*** cschwede has joined #tripleo | 07:16 | |
*** Chaserjim has quit IRC | 07:17 | |
*** Chaserjim has joined #tripleo | 07:18 | |
*** aufi has joined #tripleo | 07:24 | |
*** holser|p_ is now known as holser_ | 07:24 | |
*** khyr0n has quit IRC | 07:25 | |
*** Chaserjim has quit IRC | 07:26 | |
*** Chaserjim has joined #tripleo | 07:30 | |
*** assassin has joined #tripleo | 07:30 | |
*** dxiri has quit IRC | 07:33 | |
*** Chaserjim has quit IRC | 07:35 | |
*** Petersingh is now known as Petersingh|lunch | 07:38 | |
*** akrivoka has joined #tripleo | 07:39 | |
*** numans has joined #tripleo | 07:44 | |
*** ykarel is now known as ykarel|lunch | 07:45 | |
*** Ng__ has quit IRC | 07:48 | |
*** Ng__ has joined #tripleo | 07:49 | |
*** ChanServ sets mode: +v Ng__ | 07:49 | |
*** jpena|off is now known as jpena | 07:50 | |
*** kopecmartin has joined #tripleo | 07:52 | |
*** jpich has joined #tripleo | 07:52 | |
openstackgerrit | Kamil Sambor proposed openstack/python-tripleoclient master: Add fixture to replace multiple mocks https://review.openstack.org/600415 | 07:59 |
*** slaweq has quit IRC | 08:00 | |
*** dxiri has joined #tripleo | 08:00 | |
*** paramite has joined #tripleo | 08:01 | |
*** shyamb has quit IRC | 08:02 | |
*** florianf has quit IRC | 08:02 | |
*** slaweq has joined #tripleo | 08:03 | |
*** florianf has joined #tripleo | 08:04 | |
*** ooolpbot has joined #tripleo | 08:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 08:10 |
openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 08:10 |
*** ooolpbot has quit IRC | 08:10 | |
openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 08:10 |
openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 08:10 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 08:10 |
openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Triaged] - Assigned to Mehdi Abaakouk (sileht) | 08:10 |
openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 08:10 |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 08:10 |
*** Chaserjim has joined #tripleo | 08:13 | |
*** shyamb has joined #tripleo | 08:14 | |
*** Petersingh|lunch is now known as Petersingh | 08:21 | |
*** Chaserjim has quit IRC | 08:22 | |
*** udesale has joined #tripleo | 08:25 | |
*** Chaserjim has joined #tripleo | 08:26 | |
*** udesale has quit IRC | 08:27 | |
*** udesale has joined #tripleo | 08:28 | |
*** udesale has quit IRC | 08:29 | |
*** udesale has joined #tripleo | 08:29 | |
*** udesale has quit IRC | 08:29 | |
*** udesale has joined #tripleo | 08:30 | |
*** bogdando has joined #tripleo | 08:32 | |
*** dxiri has quit IRC | 08:33 | |
*** Chaserjim has quit IRC | 08:34 | |
*** saneax has joined #tripleo | 08:35 | |
jistr | ykarel|lunch: i don't know if it worked before on the undercloud job... On overcloud jobs it did work. Though you make a fair point that maybe we shouldn't support the undercloud non-containerized to containerized ugprade on Rocky -> master anyway. Maybe we should rather disable the job there. | 08:37 |
openstackgerrit | Martin André proposed openstack/tripleo-common master: Tag openshift images for Infra role https://review.openstack.org/603050 | 08:39 |
*** tosky has joined #tripleo | 08:41 | |
openstackgerrit | Martin André proposed openstack/tripleo-common master: Tag openshift images for Infra service https://review.openstack.org/603050 | 08:42 |
*** Chaserjim has joined #tripleo | 08:43 | |
openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-heat-templates stable/rocky: Fix typo in ansible's module name. https://review.openstack.org/603053 | 08:44 |
*** udesale has quit IRC | 08:47 | |
*** moguimar has joined #tripleo | 08:47 | |
*** iranzo has joined #tripleo | 08:48 | |
*** pvc has quit IRC | 08:49 | |
*** moguimar has quit IRC | 08:50 | |
*** Chaserjim has quit IRC | 08:51 | |
*** Chaserjim has joined #tripleo | 08:52 | |
*** udesale has joined #tripleo | 08:55 | |
*** shyamb has quit IRC | 08:56 | |
*** Chaserjim has quit IRC | 08:56 | |
*** dxiri has joined #tripleo | 09:00 | |
*** udesale has quit IRC | 09:01 | |
*** mschuppert has quit IRC | 09:02 | |
*** mrsoul has joined #tripleo | 09:02 | |
*** mschuppert has joined #tripleo | 09:03 | |
*** ooolpbot has joined #tripleo | 09:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 09:10 |
openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 09:10 |
*** ooolpbot has quit IRC | 09:10 | |
openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 09:10 |
*** Chaserjim has joined #tripleo | 09:10 | |
openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 09:10 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 09:10 |
openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Triaged] - Assigned to Mehdi Abaakouk (sileht) | 09:10 |
openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 09:10 |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 09:10 |
*** florianf has quit IRC | 09:11 | |
*** ykarel|lunch is now known as ykarel | 09:12 | |
openstackgerrit | Pablo Iranzo Gómez proposed openstack/tripleo-common master: Add bashate in gate jobs and fix existing errors https://review.openstack.org/603057 | 09:12 |
*** Chaserjim has quit IRC | 09:12 | |
openstackgerrit | Pablo Iranzo Gómez proposed openstack/tripleo-common master: Add bashate in gate jobs and fix existing errors https://review.openstack.org/603057 | 09:15 |
*** moguimar has joined #tripleo | 09:15 | |
ykarel | jistr, as per doc it seems still supported: https://docs.openstack.org/tripleo-docs/latest/install/installation/updating.html | 09:18 |
ykarel | Instack-undercloud is deprecated in Rocky cycle. Instack undercloud can only be upgraded to containerized undercloud. See Containers based Undercloud Deployment for backward compatibility related information. | 09:18 |
*** dxiri has quit IRC | 09:18 | |
*** owalsh_ is now known as owalsh | 09:18 | |
jistr | ykarel: but below "The undercloud is containerized by default as of Rocky. Therefore, an undercloud deployed on Queens (non-containerized) will be upgraded to a containerized undercloud on Rocky, by default. To upgrade with instack undercloud, you’ll need to upgrade with –use-heat=False option. Note this isn’t tested and not supported." | 09:19 |
ykarel | jistr, hmm ack | 09:20 |
jistr | ykarel: we may want to check with mwhahaha or EmilienM in the afternoon. The job could be running containerized->containerized upgrade in Rocky->master though. | 09:21 |
jistr | that would still be useful | 09:21 |
ykarel | jistr, i think that job is already runnin | 09:21 |
jistr | then we should probably keep it and fix it :) | 09:21 |
* jistr curious about the results with the upgrade_release dlrn build added as depends-on | 09:22 | |
ykarel | i checked package got build, but it's failing even before | 09:22 |
ykarel | at undercloud_validate step | 09:22 |
ykarel | may be some other reason, checking | 09:23 |
ykarel | jistr, undercloud validate failed with: 2018-09-17 07:46:07 | Message: Minimum required for /: 25G - volume free space: 25.1 | 09:23 |
jistr | ouch :D | 09:24 |
*** gfidente has joined #tripleo | 09:28 | |
*** florianf has joined #tripleo | 09:30 | |
ykarel | in job: /dev/xvda1 38G 12G 25G 33% / | 09:30 |
ykarel | in last run: /dev/vda1 75G 27G 46G 38% / | 09:30 |
ykarel | so seems infra related | 09:30 |
*** yprokule has joined #tripleo | 09:30 | |
*** shyamb has joined #tripleo | 09:31 | |
quiquell|rover | jfrancoa: please +1w disabling some tempest at pike, it's a no brainer https://review.openstack.org/#/c/601522/ | 09:35 |
jistr | ykarel: yea but still i wonder if we should lower that requirement in general, or have it lowered at least in CI | 09:35 |
quiquell|rover | jistr: ^ ? | 09:36 |
ykarel | jistr, not sure, in last run in last run: /dev/vda1 75G 27G 46G 38% / | 09:36 |
ykarel | 27G was used | 09:36 |
ykarel | may be that's after the validation is done | 09:37 |
ykarel | so lowering the minimum should be fine, but how much? | 09:37 |
ykarel | that needs to be find out | 09:37 |
openstackgerrit | Pablo Iranzo Gómez proposed openstack/tripleo-common master: Add bashate in gate jobs and fix existing errors https://review.openstack.org/603057 | 09:37 |
jistr | ykarel: also i think in Rocky we don't install that many packages on the undercloud, because it's containerized. I think that's also the reason why the patch switching upgrades to R->master was failing. The upgrade tasks assumed that xinetd is installed on bare metal undercloud, which worked in Queens but not in Rocky. | 09:38 |
jistr | cc Tengu re lowering minimum disk space for undercloud ^ | 09:38 |
ykarel | jistr, yes correct | 09:38 |
chkumar|ruck | quiquell|rover: tripleo-ci-centos-7-containerized-undercloud-upgrades is failing on above manila tempest tests review | 09:38 |
*** udesale has joined #tripleo | 09:38 | |
quiquell|rover | chkumar|ruck: chep check pipelines are blocked there http://logs.openstack.org/45/560445/143/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/cc887f6/logs/undercloud/home/zuul/undercloud_upgrade.log.txt.gz#_2018-09-17_00_49_32 | 09:39 |
quiquell|rover | chkumar|ruck: noop is failing too | 09:39 |
jistr | ykarel, Tengu: i'd lower it to 20G for now. That's what the pre-upgrade validation requires too. | 09:39 |
jistr | ykarel, Tengu: i can post a patch | 09:40 |
quiquell|rover | jfrancoa, jistr: The ansible used by mistral is the same version as the one installed ? | 09:40 |
chkumar|ruck | jistr: ykarel is http://logs.openstack.org/22/601522/4/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/afb75fd/logs/undercloud/home/zuul/undercloud_upgrade.log.txt.gz#_2018-09-16_11_16_55 failure related to this bug https://bugs.launchpad.net/tripleo/+bug/1792560 ? | 09:41 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 09:41 |
ykarel | jistr, ack | 09:41 |
jistr | chkumar|ruck, quiquell|rover: maybe it would get fixed "by accident" if we switched to the correct release, but i don't think they're very related in terms of root cause | 09:42 |
quiquell|rover | jistr: this is the bug https://bugs.launchpad.net/tripleo/+bug/1792892 | 09:42 |
openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,New] - Assigned to Quique Llorente (quiquell) | 09:42 |
*** Chaserjim has joined #tripleo | 09:42 | |
quiquell|rover | jistr: ack, let me dig deeper, could be related to ansible version ? | 09:43 |
quiquell|rover | jistr: looks like 2.5.7 is installed so looks ok, don't know it heat+mistral is using another | 09:43 |
ykarel | chkumar|ruck, yes seems different | 09:43 |
chkumar|ruck | ack | 09:44 |
jistr | quiquell|rover: they'd be using the system one before containerized, container one after containerized | 09:44 |
quiquell|rover | So this is an undercloud upgrade | 09:44 |
quiquell|rover | On master | 09:44 |
chkumar|ruck | on rocky it is passingf | 09:45 |
quiquell|rover | with means rocky->master, or it's broken and we doo queens->master ? | 09:45 |
jistr | quiquell|rover: i think it's broken and we do q->master | 09:45 |
quiquell|rover | jistr: I see... we are testing ffu :-) | 09:45 |
quiquell|rover | jistr: yep, release file is bad https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset050-upgrades-master/c4a79bb/logs/releases.sh | 09:46 |
quiquell|rover | jistr, ykarel: The patch for rocky->master is wrong, we now use releases.sh to get release correct per playbook so we don't need to read UPGRADE_RELEASE | 09:49 |
jistr | ykarel: i wonder how the depends-on will work there... because we need the validation change on rocky, not on master... it will be interesting :) | 09:49 |
chkumar|ruck | quiquell|rover: https://logs.rdoproject.org/openstack-periodic-24hr/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens/a7c7c52/job-output.txt.gz#_2018-09-17_06_36_54_622545 here it is looking weired | 09:49 |
jistr | quiquell|rover: i'll add one more depends-on and then feel free to edit it | 09:49 |
chkumar|ruck | the deployment step got lost during deploy the overcloud | 09:49 |
quiquell|rover | jistr: going to edit the review, need work in the new stuff we did for upgrades | 09:50 |
*** Chaserjim has quit IRC | 09:51 | |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-validations master: Lower disk space requirement for undercloud https://review.openstack.org/603063 | 09:51 |
ykarel | jistr, Depends-On should not work in that case :) i think build-test-packages is run once only | 09:51 |
ykarel | and will build packages for only one release | 09:52 |
quiquell|rover | jistr, ykarel: I am going to add some work in the review | 09:52 |
ykarel | quiquell|rover, ack | 09:52 |
jistr | ykarel, quiquell|rover: so we'll probably need to merge https://review.openstack.org/603063 and its backport before we can fix the release? | 09:53 |
quiquell|rover | jistr, ykarel: Let's go step by step, first make the job do the proper thing | 09:53 |
quiquell|rover | jistr, ykarel: Then fix the legit errors | 09:54 |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-validations stable/rocky: Lower disk space requirement for undercloud https://review.openstack.org/603065 | 09:54 |
quiquell|rover | not related to CI | 09:54 |
ykarel | quiquell|rover, ack | 09:54 |
jistr | ack | 09:54 |
ykarel | jistr, can't we just skip those validation in case of reinstall | 09:55 |
ykarel | i think that would make more sense | 09:55 |
*** Chaserjim has joined #tripleo | 09:55 | |
jistr | ykarel: maybe if the CLI supports it | 09:55 |
ykarel | :) /me not sure about that | 09:55 |
jistr | ykarel: i didn't even know we're doing the reinstall until now | 09:55 |
ykarel | i have seen in some jobs it's done | 09:56 |
jistr | ykarel: looking now, it's an idempotency check... maybe we could do that in deploy jobs only instead of upgrade jobs too | 09:58 |
* jistr digging through featuresets | 09:58 | |
*** cameron_chuang has joined #tripleo | 09:59 | |
*** Petersingh is now known as Petersingh|afk | 09:59 | |
jistr | ykarel: but if it works in normal deploy jobs, it should work in upgrade job too... | 10:01 |
ykarel | quiquell|rover, about UPGRADE_RELEASE usage, afair the releases.sh is applicable to only few featuresets currently | 10:01 |
quiquell|rover | ykarel: those are upgrade featuresets, the only ones that use UPGRADE_RELEASE too | 10:02 |
quiquell|rover | ykarel: So we don't need the change | 10:02 |
ykarel | :( quiquell|rover what about fs047 | 10:02 |
quiquell|rover | ykarel: If it's not in the if statement then it's broken | 10:02 |
chkumar|ruck | ykarel: https://logs.rdoproject.org/24/567224/107/openstack-check/legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens/f98b8bf/job-output.txt.gz#_2018-09-17_01_18_32_099933 the after deploy the overcloud step task got vanished | 10:02 |
ykarel | chkumar|ruck, Timeout | 10:03 |
chkumar|ruck | ykarel: but the status is showing failed | 10:03 |
jfrancoa | quiquell|rover: jistr ykarel for what I can see in python-tripleoclient, if we run the reinstall with -no-validations should skip the validations | 10:03 |
ykarel | quiquell|rover, okk then good to fix the if statement too | 10:03 |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-quickstart master: Don't check idempotency in undercloud upgrade job https://review.openstack.org/603067 | 10:03 |
jfrancoa | I'll add some flag in tripleo-upgrade to add it depending on it | 10:04 |
chkumar|ruck | ykarel: https://review.openstack.org/#/c/567224/ see RDO third party jobs | 10:04 |
quiquell|rover | ykarel: agree | 10:04 |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-quickstart master: Don't check idempotency in undercloud upgrade job https://review.openstack.org/603067 | 10:04 |
ykarel | jistr, yes it should work, but that seems infra related, as in the job that failed disk size was: 38GB, while in passed job it was 70+ | 10:04 |
jfrancoa | jistr: this way we don't need to decrease the validation threshold | 10:04 |
ykarel | jfrancoa, okk cool | 10:05 |
ykarel | jistr, but still if reinstall is not needed in overcloud job, good to remove that to save some CI time | 10:05 |
ykarel | sorry upgrade job | 10:05 |
ykarel | jfrancoa, ack | 10:06 |
jistr | ykarel, jfrancoa: yea i'm not sure how much it's needed. So now we have 3 solution ideas 1) lower requirement, 2) don't reinstall in upgrade job, 3) reinstall without validations | 10:06 |
jistr | ykarel, jfrancoa: or it was an infra issue :) | 10:07 |
*** Chaserjim has quit IRC | 10:07 | |
quiquell|rover | jistr, ykarel: ffu are still only supported newton->queens ? | 10:07 |
quiquell|rover | jistr, ykarel: Or do we have tu support ocata->rocky now ? | 10:07 |
ykarel | chkumar|ruck, shouldn't that show failed in case of timeout? sorry i didn't understood | 10:08 |
jistr | quiquell|rover: i think n->q is the only we really test in practice, for now | 10:08 |
quiquell|rover | jistr: ack | 10:08 |
ykarel | jistr, 2 and 3 looks more correct, 1 is at least priority | 10:09 |
*** ooolpbot has joined #tripleo | 10:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 10:10 |
openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 10:10 |
openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 10:10 |
*** ooolpbot has quit IRC | 10:10 | |
openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 10:10 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 10:10 |
openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Triaged] - Assigned to Mehdi Abaakouk (sileht) | 10:10 |
openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 10:10 |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 10:10 |
openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 10:10 |
jistr | ykarel, jfrancoa: so i guess ideally we'd figure out if we're getting smaller nodes than we should have, in which case we can probably don't need to do anything, or maybe our expectations are too high, in which case we should probably do 3 because i assume 2 would only fix it for upgrade, but we do the reinstall also in deploy jobs | 10:11 |
*** arxcruz|ptg is now known as arxcruz | 10:11 | |
jistr | so if a deploy job gets a smaller node too, it would break too i think | 10:11 |
jfrancoa | jistr: ok, now I understand your second point. it's true that we're reinstalling to check the idempotency. However, won't this validation fail in the next step when trying to run the undercloud upgrade? it seems it's trying to run them too | 10:12 |
jistr | jfrancoa: the upgrade validation is slightly different, it requires 20G instead of 25G | 10:12 |
jistr | jfrancoa, ykarel: should i post a patch for 3) too? | 10:13 |
openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Switch previous release of master from 'queens' to 'rocky' https://review.openstack.org/590774 | 10:13 |
jfrancoa | jistr: aha...I see... I would go then for reinstalling without validations | 10:14 |
ykarel | jistr, ack for 3 | 10:14 |
*** kopecmartin has quit IRC | 10:15 | |
openstackgerrit | Janki Chhatbar proposed openstack/puppet-tripleo master: Set OVS local ip through OVS ODL class https://review.openstack.org/597007 | 10:15 |
openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Switch previous release of master from 'queens' to 'rocky' https://review.openstack.org/590774 | 10:15 |
quiquell|rover | jistr, ykarel: ^ added the missing pieces | 10:18 |
*** dtantsur|afk is now known as dtantsur | 10:18 | |
quiquell|rover | jistr: Do we need to exercise it with at THT patch over releases ? | 10:18 |
ykarel | ack | 10:18 |
*** quiquell|rover is now known as quique|rover|afk | 10:19 | |
dtantsur | chkumar|ruck: re https://bugs.launchpad.net/tripleo/+bug/1792870 we usually cannot do much if IPMI does not behave. It can be bad credentials or OVB IPMI server not working or whatever | 10:19 |
openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 10:19 |
*** shyamb has quit IRC | 10:20 | |
jistr | thanks quique|rover|afk | 10:20 |
quique|rover|afk | jistr: Let's see the results, this stuff if really delicate | 10:20 |
jistr | quique|rover|afk: not sure i understand your last question | 10:20 |
quique|rover|afk | jistr: Nah forget about it we are changing only stuff regarding 'master' upgrades | 10:21 |
jistr | ack | 10:21 |
quique|rover|afk | jistr: we are good with the current runing jobs in the review | 10:21 |
quique|rover|afk | argg tox failing... | 10:21 |
dtantsur | chkumar|ruck, quique|rover|afk, how persistent is https://bugs.launchpad.net/tripleo/+bug/1792872 ? | 10:22 |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 10:22 |
*** shyamb has joined #tripleo | 10:23 | |
quique|rover|afk | dtantsur, chkumar|ruck: kforde found some issues at some matchines, queens has pass now, and we are testing rocky | 10:23 |
quique|rover|afk | dtantsur: I think we can forget about it for now | 10:23 |
dtantsur | quique|rover|afk: oh, I like when problems solve themselves :D Ping me if you need moar help. | 10:24 |
quique|rover|afk | dtantsur: But let's keep the bug open until we are sure RDO nodepool is ok | 10:24 |
quique|rover|afk | dtantsur: Will do thanks | 10:24 |
dtantsur | okie | 10:24 |
*** paramite|clone has joined #tripleo | 10:27 | |
*** paramite has quit IRC | 10:29 | |
*** Chaserjim has joined #tripleo | 10:29 | |
openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart master: Inject undercloud user into the cloud image https://review.openstack.org/603069 | 10:31 |
openstackgerrit | Christian Schwede proposed openstack/tripleo-heat-templates stable/queens: Fix Swift storage device setup https://review.openstack.org/603070 | 10:32 |
ykarel | quique|rover|afk, don't those ovb jobs ^^ runs in openstack-nodepool? | 10:32 |
ykarel | not sure if those jobs suffered same nested virt issue as seen in packstack | 10:33 |
openstackgerrit | Christian Schwede proposed openstack/tripleo-heat-templates stable/pike: Fix Swift storage device setup https://review.openstack.org/603071 | 10:33 |
*** jfrancoa has quit IRC | 10:35 | |
*** jfrancoa has joined #tripleo | 10:36 | |
openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart master: Inject undercloud user into the cloud image https://review.openstack.org/603069 | 10:37 |
*** Chaserjim has quit IRC | 10:37 | |
*** Chaserjim has joined #tripleo | 10:41 | |
*** rh-jelabarre has joined #tripleo | 10:43 | |
*** quique|rover|afk is now known as quiquell|rover | 10:49 | |
quiquell|rover | ykarel: what jobs ? | 10:50 |
ykarel | quiquell|rover, we were seeing some nested virt issues like https://centos.logs.rdoproject.org/weirdo-generic-packstack-scenario001/3295/weirdo-project/logs/libvirt/qemu/instance-00000001.log.txt.gz | 10:51 |
ykarel | in packstack, but not sure if similar issue were affecting ironic error u were discussion above | 10:51 |
quiquell|rover | ykarel: kforde found some issues at a pair of nodes at nodepool | 10:51 |
quiquell|rover | ykarel: Ahh wait this is centos | 10:52 |
quiquell|rover | ykarel: I cannot see this is stuff, this is host info at RDO for the other jobs | 10:52 |
rnoriega | hjensas, ping | 10:53 |
*** Chaserjim has quit IRC | 10:53 | |
openstackgerrit | Merged openstack/tripleo-common stable/rocky: Disable external plugins in rabbitmq container https://review.openstack.org/601074 | 10:55 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: [Queens] Don't stop docker on config changes https://review.openstack.org/601590 | 10:55 |
*** panda has joined #tripleo | 10:58 | |
*** Chaserjim has joined #tripleo | 10:58 | |
*** shyamb has quit IRC | 10:59 | |
*** shyamb has joined #tripleo | 11:05 | |
*** Chaserjim has quit IRC | 11:09 | |
openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Switch previous release of master from 'queens' to 'rocky' https://review.openstack.org/590774 | 11:09 |
*** Chaserjim has joined #tripleo | 11:09 | |
*** ooolpbot has joined #tripleo | 11:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 11:10 |
openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 11:10 |
openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 11:10 |
*** ooolpbot has quit IRC | 11:10 | |
openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 11:10 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 11:10 |
openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Triaged] - Assigned to Mehdi Abaakouk (sileht) | 11:10 |
openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 11:10 |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 11:10 |
openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 11:10 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor workflow actions https://review.openstack.org/603080 | 11:14 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: convert PlansActions to named exports to avoid using 'this' in thunks https://review.openstack.org/603081 | 11:14 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Convert NodesActions to named expoers to avoid using 'this' in thunks https://review.openstack.org/603082 | 11:14 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Convert ValidationsActions to named exports to avoid using 'this' in thunks https://review.openstack.org/603083 | 11:14 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Convert WorkflowExecutionsActions to named exports to avoid using 'this' in thunks https://review.openstack.org/603084 | 11:14 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Convert CurrentPlanActions to named exports to avoid using 'this' in thunks https://review.openstack.org/603085 | 11:14 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Convert FlavorsActions to named exports to avoid using 'this' in thunks https://review.openstack.org/603086 | 11:14 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Convert I18nActions to named exports to avoid using 'this' in thunks https://review.openstack.org/603087 | 11:14 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Convert LoggerActions to named exports to avoid using 'this' in thunks https://review.openstack.org/603088 | 11:14 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Convert LoginActions to named exports to avoid using 'this' in thunks https://review.openstack.org/603089 | 11:14 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Convert NetworksActions to named exports to avoid using 'this' in thunks https://review.openstack.org/603090 | 11:14 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Convert EnvironmentConfigurationActions to named exports to avoid using 'this' in thunks https://review.openstack.org/603091 | 11:14 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Convert NotificationActions to named exports to avoid using 'this' in thunks https://review.openstack.org/603092 | 11:14 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Convert ParametersActions to named exports to avoid using 'this' in thunks https://review.openstack.org/603093 | 11:14 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Convert RegisterNodesActions to named exports to avoid using 'this' in thunks https://review.openstack.org/603094 | 11:14 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Convert RolesActions to named exports to avoid using 'this' in thunks https://review.openstack.org/603095 | 11:14 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Convert StacksActions to named exports to avoid using 'this' in thunk https://review.openstack.org/603096 | 11:14 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Convert ZaqarActions to named exports to avoid using 'this' in thunk https://review.openstack.org/603097 | 11:14 |
*** kopecmartin has joined #tripleo | 11:15 | |
quiquell|rover | ykarel, jistr: I have found this https://review.openstack.org/#/c/592365 | 11:16 |
quiquell|rover | ykarel, jistr: Do we have the rocky repo in place ? | 11:16 |
ykarel | quiquell|rover, yes they are ready | 11:16 |
ykarel | so we can remove that hack | 11:16 |
quiquell|rover | ykarel: ack, will do in the the patch | 11:17 |
ykarel | we shouldn't have missed that | 11:17 |
shyamb | Hi | 11:17 |
shyamb | owalsh: | 11:17 |
*** Chaserjim has quit IRC | 11:18 | |
*** kopecmartin has quit IRC | 11:19 | |
*** jpena is now known as jpena|lunch | 11:20 | |
*** fultonj has joined #tripleo | 11:20 | |
*** Chaserjim has joined #tripleo | 11:22 | |
openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Switch previous release of master from 'queens' to 'rocky' https://review.openstack.org/590774 | 11:23 |
quiquell|rover | jistr, ykarel: Now we are good | 11:23 |
*** fultonj has joined #tripleo | 11:25 | |
ykarel | quiquell|rover, ack will check a little later | 11:25 |
openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Switch previous release of master from 'queens' to 'rocky' https://review.openstack.org/590774 | 11:26 |
*** Chaserjim has quit IRC | 11:26 | |
*** two_oes has joined #tripleo | 11:30 | |
*** Chaserjim has joined #tripleo | 11:31 | |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Use swiftUrl as a base for exported plan download URL https://review.openstack.org/599974 | 11:33 |
dtantsur | FYI folks, https://review.openstack.org/#/c/603102/ deprecates something we rely on heavily for profile matching and precise node placement | 11:33 |
dtantsur | while we can fix the former (with a lot of work), I dunno about the latter. switching to metalsmith may be the lesser evil. | 11:34 |
*** kopecmartin has joined #tripleo | 11:34 | |
dtantsur | shardy, mwhahaha, EmilienM and whoever cares ^^^ | 11:34 |
rnoriega | hjensas, could you please check this error?? http://paste.openstack.org/show/730177/ I really don't know why it's failing.. | 11:38 |
*** bfournie has quit IRC | 11:42 | |
*** iranzo has quit IRC | 11:43 | |
*** psachin has joined #tripleo | 11:44 | |
*** zul has joined #tripleo | 11:46 | |
*** amoralej is now known as amoralej|lunch | 11:47 | |
chkumar|ruck | EmilienM: Do we configure os-profiler in tripleo in any featureset? | 11:49 |
chkumar|ruck | tempest is getting support of os-profiler | 11:49 |
*** kopecmartin has quit IRC | 11:51 | |
*** ansmith has quit IRC | 11:53 | |
*** Petersingh|afk is now known as Petersingh | 11:53 | |
shyamb | Hi Tengu: | 11:54 |
shyamb | you there? | 11:55 |
*** dhill_ has joined #tripleo | 11:57 | |
shardy | dtantsur: since we use a tripleo specific filter I'm not sure if that will break us or not ref https://github.com/openstack/tripleo-common/blob/master/tripleo_common/filters/capabilities_filter.py#L22 | 11:59 |
* shardy looks to check if BaseHostFilter still exists | 11:59 | |
dtantsur | shardy: yeah, right, the precise scheduling is probably fine. the profile matching is not. | 12:00 |
*** dprince has joined #tripleo | 12:00 | |
*** panda has quit IRC | 12:00 | |
dtantsur | we should either switch to traits or move the profile logic to our custom filter | 12:00 |
*** rfolco has joined #tripleo | 12:01 | |
*** Chaserjim has quit IRC | 12:01 | |
EmilienM | dtantsur: ack | 12:01 |
shardy | dtantsur: ack yeah - thanks for raising this | 12:01 |
EmilienM | chkumar|ruck: no idea | 12:01 |
shardy | seems like the quickest short-term fix is to copy the deprecated code, but I'm unclear if there's already a drop-in traits based replacement from nova? | 12:02 |
EmilienM | jistr: what's up? | 12:02 |
dtantsur | shardy: it's not really drop in. traits are binary, they don't have values. | 12:03 |
dtantsur | but yes, we can create custom traits, like CUSTOM_PROFILE_COMPUTE, CUSTOM_PROFILE_CONTROL and use them | 12:03 |
shardy | dtantsur: ack, it's not really made clear in the commit message and I'm not familiar with trats | 12:03 |
shardy | traits | 12:03 |
dtantsur | the up/downside is that a node can have several profiles | 12:03 |
*** raildo has joined #tripleo | 12:03 | |
dtantsur | dunno if it's good or not | 12:03 |
jistr | EmilienM: TL;DR we're trying to switch the "previous-release-from" logic so that we run P->master upgrades rather than Q->master, which is outdated. the undercloud upgrade blocked it on a few levels already, we have some fixes posted, waiting for CI results | 12:03 |
shardy | I think having potentially multiple profiles would be OK | 12:03 |
jistr | EmilienM: https://review.openstack.org/#/c/602550/ | 12:04 |
shardy | provided we still have the option of specifying only one | 12:04 |
jistr | EmilienM: and this one, though we probably will not land it https://review.openstack.org/#/c/603063/ | 12:04 |
dtantsur | shardy: they we better switch to traits. any custom filter will complicate the move to metalsmith | 12:04 |
jistr | EmilienM: we should probably not run the validations during idempotency check | 12:04 |
dtantsur | shardy: yep, this works similar to capabilities | 12:04 |
shardy | dtantsur: Ok - would you mind raising a bug explaining how the traits approach will work, then perhaps we can raise this in the weekly meeting? | 12:05 |
shardy | I'm travelling this week so may not be able to follow up on it for a few days | 12:05 |
dtantsur | shardy: an extreme option is to switch to metalsmith right away :) it supports both capabilities and traits. | 12:05 |
dtantsur | sure, will do | 12:05 |
EmilienM | jistr: can I approve https://review.openstack.org/#/c/602550/ ? | 12:06 |
*** shyamb has quit IRC | 12:06 | |
shardy | dtantsur: Yeah we did have discussion re metalsmith at the PTG, and while folks are interested I think we agreed to try to get it working this cycle as a preview feature, then we can work out how to handle the upgrade aspects of any switch to it by default | 12:06 |
shardy | so probably we need an interim solution w/nova | 12:06 |
*** trown|outtypewww is now known as trown | 12:06 | |
dtantsur | shardy: right. though the capabilities removal from nova won't happen overnight as well. | 12:06 |
mandre | EmilienM, bogdando: hi, do you have an idea what could cause mistral to fail to run docker? i thought we mounted the socket in mistral-executor and added mistral to the docker group in the container... | 12:07 |
shardy | dtantsur: yeah - I'm thinking of the OpenShift installer use-case, where it may be easier to use Nova, at least initially | 12:07 |
dtantsur | shardy: well, I disagree with that. | 12:07 |
shardy | dtantsur: if you could raise a bug outlining the options that would be really helpful :) | 12:07 |
jistr | EmilienM: looks like CI isn't testing it properly so we may want to wait until ykarel's patch lands https://review.openstack.org/#/c/603026/ | 12:07 |
dtantsur | I mean, whatever, if you don't come to our team complaining about 'no valid hosts found' too often :D | 12:07 |
EmilienM | mandre: did you file a bug? | 12:08 |
shardy | dtantsur: heh, yeah I'm well aware of the advantages, but the fact is there is already a terraform provider that talks to Nova | 12:08 |
shardy | we can write another one, but nobody has looked at that yet | 12:08 |
mandre | EmilienM: not yet, I first wanted to confirm I didn't miss a step | 12:08 |
mandre | EmilienM: I'm trying to use a docker command to run the openshift installer, it fails with http://logs.openstack.org/68/583868/6/check/tripleo-ci-centos-7-scenario009-multinode-oooq/3a56901/logs/undercloud/var/lib/mistral/overcloud/ansible.log.txt.gz#_2018-09-14_14_52_39_005 | 12:09 |
*** Chaserjim has joined #tripleo | 12:09 | |
*** ooolpbot has joined #tripleo | 12:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 12:10 |
openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 12:10 |
openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 12:10 |
*** ooolpbot has quit IRC | 12:10 | |
openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 12:10 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 12:10 |
openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Triaged] - Assigned to Mehdi Abaakouk (sileht) | 12:10 |
openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 12:10 |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 12:10 |
openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 12:10 |
EmilienM | mandre: I wonder if it's selinux | 12:10 |
mandre | EmilienM: ahh, I didn't think of selinux... could be | 12:11 |
EmilienM | mandre: selinux is enabled on the undercloud until we merge https://review.openstack.org/#/c/602703/ | 12:11 |
EmilienM | mandre: try depends-on ^ | 12:11 |
*** rook has joined #tripleo | 12:12 | |
rook | With Rocky on the undercloud, should I be able to do docker image list and see the containers I have locally for my OC deployment? | 12:13 |
*** skramaja has quit IRC | 12:13 | |
openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Refactor openshift services for composable roles https://review.openstack.org/599618 | 12:14 |
openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Fix openshift new node detection https://review.openstack.org/600012 | 12:14 |
openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Clean up previous osa inventory dir before deployment https://review.openstack.org/600028 | 12:14 |
openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Configure haproxy for openshift infra https://review.openstack.org/601241 | 12:14 |
openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Use openshift_cockpit_deployer_image directly https://review.openstack.org/602074 | 12:14 |
openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Use openshift-ansible container instead of RPMs https://review.openstack.org/583868 | 12:14 |
*** akrzos has joined #tripleo | 12:14 | |
mandre | sorry trown, didn't mean to rebase your patch :-/ | 12:15 |
trown | mandre: haha was just about to tell you I got the validation patch to pass | 12:15 |
trown | mandre: quite a few patches needed though | 12:16 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Use swiftUrl as a base for exported plan download URL https://review.openstack.org/599974 | 12:16 |
mandre | trown: yeah, we should shorten that patch series | 12:16 |
mandre | trown: where you testing the validation patch on top of https://review.openstack.org/#/c/601241/ ? | 12:17 |
openstackgerrit | Emilien Macchi proposed openstack/ansible-role-tripleo-modify-image master: Remove compare_host_packages strategy https://review.openstack.org/600273 | 12:17 |
trown | mandre: I will rebase the series so the validation patch is on bottom... that patch should be good to go at this point (just needs a bunch of other patches merged to fix the openshift deploy) | 12:17 |
*** bfournie has joined #tripleo | 12:18 | |
trown | mandre: no I had it based on just the cockpit tag fix | 12:18 |
trown | mandre: I can fix up the series to have those two on bottom if that is ok | 12:19 |
EmilienM | rook: I replied to the bug - please try with "openstack tripleo container image prepare" | 12:20 |
mandre | trown: sounds good, FYI I've done tens of deployment with the rest of the patches, I'd be surprised if they break anything | 12:20 |
EmilienM | mandre: let me know if it's still not working with selinux permissive | 12:20 |
mandre | EmilienM: sure, thanks for the lead... I'll keep you posted | 12:20 |
trown | mandre: cool, btw the docker-registry container issue is fixed be the tripleo-common patch that adds the master role, but it was still failing in CI (and reproducer), because we were not updating undercloud containers https://review.openstack.org/#/c/602802/ | 12:22 |
*** jpena|lunch is now known as jpena | 12:22 | |
trown | mandre: downside of that patch is it makes the job take 30minutes longer :( | 12:22 |
openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Enable support for running refstack tests in TQE https://review.openstack.org/570719 | 12:24 |
mandre | trown: wait, we were not using containerized undercloud for scenario009? | 12:24 |
mandre | i thought it was the default these days | 12:25 |
trown | mandre: well... we were not setting the var... it is the default | 12:25 |
*** janki has quit IRC | 12:25 | |
trown | mandre: so we had containers for the undercloud, but without the var set, we dont update them | 12:25 |
*** Chaserjim has quit IRC | 12:27 | |
trown | mandre: https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/undercloud-deploy/templates/undercloud.conf.j2#L276-L282 | 12:27 |
mandre | trown: hmm ok, but if containerized_undercloud is the default in quickstart, why do we need to set the variable again? | 12:27 |
mandre | seems to me https://review.openstack.org/#/c/602802/3/config/general_config/featureset033.yml is not the right fix, it highlights an issue in quickstart | 12:28 |
trown | mandre: it is how it is elsewhere https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset001.yml#L22-L27 | 12:29 |
trown | mandre: it is just that did not make it into our featureset | 12:29 |
*** athomas has joined #tripleo | 12:29 | |
trown | mandre: I didnt put the conditional in the patch for fs033 because it is not supported on the older releases that didnt have containerized undercloud | 12:30 |
mandre | trown: alright, I was under the assumption the default was changed in quickstart... apparently it's per job | 12:31 |
*** rlandy has joined #tripleo | 12:33 | |
trown | mandre: ya... I kind of think there is still a subtle quickstart bug, introduced by https://github.com/openstack/tripleo-quickstart-extras/commit/b3794ff03ab841bbbc15a339e35a7ec02b193111#diff-5c64cb986d5b51682f68a7b95bcca79f ... but im not 100% sure of the best fix | 12:33 |
*** quiquell|rover is now known as quique|rover|lch | 12:33 | |
trown | mandre: to get validation on openshift deploy, I think it is ok to match our featureset to the others | 12:34 |
mandre | does it make sense to keep the default for containerized_(under|over)cloud to false? https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/extras-common/defaults/main.yml#L5 | 12:35 |
*** boazel has quit IRC | 12:35 | |
trown | mandre: well I think to change it there requires conditional logic on release... which we dont have in any of those common defaults | 12:37 |
openstackgerrit | mathieu bultel proposed openstack/tripleo-heat-templates master: DNM -- CI Test https://review.openstack.org/603116 | 12:37 |
*** Chaserjim has joined #tripleo | 12:38 | |
trown | mandre: I think eventually the default in the common defaults would be changed, but that would require extensive testing to make sure we have conditionals everywhere for the releases that do not have containerized undercloud supported ... I assume that is why that it is overridden via featureset | 12:39 |
*** two_oes has quit IRC | 12:41 | |
*** Chaserjim has quit IRC | 12:42 | |
openstackgerrit | Sorin Sbarnea proposed openstack-infra/tripleo-ci master: Remove timeout logic https://review.openstack.org/589068 | 12:43 |
openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Switch previous release of master from 'queens' to 'rocky' https://review.openstack.org/590774 | 12:44 |
*** raildo has quit IRC | 12:45 | |
*** raildo has joined #tripleo | 12:45 | |
mandre | trown: yeah it got me confused | 12:46 |
*** Chaserjim has joined #tripleo | 12:47 | |
trown | mandre: it had me very confused... I couldnt figure out why running the prepare command manually pulled the docker registry container, but the prepare in deploy didnt | 12:47 |
trown | mandre: it was because tripleo-common package on the undercloud included the fix, but not tripleo-common in the mistral container | 12:47 |
*** tzumainn has joined #tripleo | 12:48 | |
*** two_oes has joined #tripleo | 12:50 | |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: Enable yamllint to avoid future key duplications https://review.openstack.org/597581 | 12:53 |
*** udesale has quit IRC | 12:54 | |
*** kopecmartin has joined #tripleo | 12:55 | |
*** kopecmartin has joined #tripleo | 12:55 | |
*** kopecmartin has joined #tripleo | 12:56 | |
*** amoralej|lunch is now known as amoralej | 12:58 | |
*** eggmaster has joined #tripleo | 12:58 | |
*** toure|gone is now known as toure | 13:03 | |
*** mjturek has joined #tripleo | 13:05 | |
*** quique|rover|lch is now known as quiquell|rover | 13:05 | |
*** morazi has joined #tripleo | 13:06 | |
*** ansmith has joined #tripleo | 13:07 | |
*** athomas has quit IRC | 13:07 | |
*** ooolpbot has joined #tripleo | 13:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 13:10 |
openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 13:10 |
openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 13:10 |
*** ooolpbot has quit IRC | 13:10 | |
openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 13:10 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 13:10 |
openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Triaged] - Assigned to Mehdi Abaakouk (sileht) | 13:10 |
openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 13:10 |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 13:10 |
openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 13:10 |
openstackgerrit | Emilien Macchi proposed openstack/paunch master: switch documentation job to new PTI https://review.openstack.org/596042 | 13:11 |
openstackgerrit | Emilien Macchi proposed openstack/paunch master: add python 3.6 unit test job https://review.openstack.org/596043 | 13:11 |
*** mjturek has quit IRC | 13:11 | |
*** thrash|g0ne is now known as thrash | 13:12 | |
openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates master: Don't merge /etc/collectd.d https://review.openstack.org/603123 | 13:13 |
mandre | EmilienM: it's odd, I can reproduce the same issue with mistral failing to run docker locally, but if I shell in the mistral_executor container and run the same command it works :-/ | 13:15 |
EmilienM | mandre: selinux permissive, right? | 13:15 |
mandre | yes | 13:15 |
EmilienM | mandre: that's weird, we already have some workflows running under this user | 13:16 |
mandre | right, and a quick look inside the container confirms it has access to the docker socket | 13:17 |
EmilienM | mandre: did you do the correct bind mounts? | 13:17 |
mandre | it's the mistral_executor container that runs docker, correct? | 13:17 |
EmilienM | oh that's the mistral executor container, so it should be fine | 13:17 |
EmilienM | mandre: yes | 13:17 |
*** nhicher has joined #tripleo | 13:18 | |
mandre | EmilienM: I left the mistral executor container untouched, no modifications | 13:18 |
*** nhicher has quit IRC | 13:20 | |
EmilienM | mandre: what's your error look like? | 13:20 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-heat-templates master: Refactor openshift services for composable roles https://review.openstack.org/599618 | 13:21 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-heat-templates master: Fix openshift new node detection https://review.openstack.org/600012 | 13:21 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-heat-templates master: Clean up previous osa inventory dir before deployment https://review.openstack.org/600028 | 13:21 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-heat-templates master: Configure haproxy for openshift infra https://review.openstack.org/601241 | 13:21 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-heat-templates master: Use openshift-ansible container instead of RPMs https://review.openstack.org/583868 | 13:21 |
openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Te-broker: save all nodes console to html log dir https://review.openstack.org/588488 | 13:22 |
trown | mandre: those are rebased on top of the validation patches now ^ | 13:22 |
*** nhicher has joined #tripleo | 13:22 | |
*** vinaykns has joined #tripleo | 13:23 | |
*** sri_ has joined #tripleo | 13:25 | |
openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Te-broker: save all nodes console to html log dir https://review.openstack.org/588488 | 13:26 |
*** Chaserjim has quit IRC | 13:26 | |
openstackgerrit | John Trowbridge proposed openstack/tripleo-heat-templates master: Add simple validation that OpenShift is deployed https://review.openstack.org/600067 | 13:26 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-heat-templates master: Refactor openshift services for composable roles https://review.openstack.org/599618 | 13:26 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-heat-templates master: Fix openshift new node detection https://review.openstack.org/600012 | 13:26 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-heat-templates master: Clean up previous osa inventory dir before deployment https://review.openstack.org/600028 | 13:26 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-heat-templates master: Configure haproxy for openshift infra https://review.openstack.org/601241 | 13:26 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-heat-templates master: Use openshift-ansible container instead of RPMs https://review.openstack.org/583868 | 13:26 |
mandre | EmilienM: same as before, can't connect to the docker daemon, http://paste.openstack.org/show/730181/ | 13:26 |
trown | ugg... the bottom patch is not correct still | 13:28 |
EmilienM | mandre: FWIW it works with podman :P | 13:28 |
*** lblanchard has joined #tripleo | 13:28 | |
* EmilienM runs away | 13:28 | |
mandre | EmilienM: good to know :D I'll wait a couple of month and try again | 13:28 |
EmilienM | mandre: I deployed my overcloud with an undercloud on podman, yesterday | 13:29 |
EmilienM | and it worked | 13:29 |
*** panda has joined #tripleo | 13:29 | |
mandre | yay! | 13:29 |
mandre | nice work | 13:29 |
*** psachin has quit IRC | 13:29 | |
EmilienM | mandre: idk I wonder if a bind mount is missing | 13:29 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-heat-templates master: Use openshift_cockpit_deployer_image directly https://review.openstack.org/602074 | 13:29 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-heat-templates master: Add simple validation that OpenShift is deployed https://review.openstack.org/600067 | 13:29 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-heat-templates master: Refactor openshift services for composable roles https://review.openstack.org/599618 | 13:29 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-heat-templates master: Fix openshift new node detection https://review.openstack.org/600012 | 13:29 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-heat-templates master: Clean up previous osa inventory dir before deployment https://review.openstack.org/600028 | 13:29 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-heat-templates master: Configure haproxy for openshift infra https://review.openstack.org/601241 | 13:30 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-heat-templates master: Use openshift-ansible container instead of RPMs https://review.openstack.org/583868 | 13:30 |
*** mcornea has joined #tripleo | 13:30 | |
*** Chaserjim has joined #tripleo | 13:30 | |
EmilienM | mandre: can you strace maybe? | 13:30 |
EmilienM | and paste it somewhere | 13:30 |
mandre | EmilienM: http://paste.openstack.org/show/730182/ | 13:32 |
EmilienM | mandre: I would try to manually run the "docker run "command from the container | 13:34 |
EmilienM | like ansible would do | 13:34 |
EmilienM | (from mistral user) | 13:34 |
EmilienM | and see how that works (and strace if that fails) | 13:34 |
mandre | EmilienM: that's what I did, and in this case it works... that's why I'm very confused | 13:35 |
*** jcoufal has joined #tripleo | 13:35 | |
mandre | EmilienM: bah I'll keep digging, thanks for the help | 13:36 |
*** Chaserjim has quit IRC | 13:38 | |
*** Chaserjim has joined #tripleo | 13:38 | |
openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: Enable featureset override https://review.openstack.org/594511 | 13:39 |
*** bdodd has joined #tripleo | 13:42 | |
*** ramishra has quit IRC | 13:44 | |
*** Chaserjim has quit IRC | 13:47 | |
slagle | quiquell|rover: do you have an environment for https://bugs.launchpad.net/tripleo/+bug/1792343? | 13:48 |
openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 13:48 |
*** Petersingh has quit IRC | 13:48 | |
slagle | quiquell|rover: the upstream revert failed during introspection, so it didn't get far enough to test if the revert fixed the issue | 13:48 |
quiquell|rover | slagle: nope... | 13:48 |
honza | florianf: could you push this across the finish line? https://review.openstack.org/#/c/601626/ | 13:49 |
quiquell|rover | slagle: I can try a reproducer, but we haven't see the issue again, don't know if it will appear | 13:49 |
quiquell|rover | rascasoft: It's trying to have one for phase2 | 13:49 |
slagle | quiquell|rover: alright well let me know if you hit the issue with the reproducer and would like me to take a look | 13:49 |
quiquell|rover | slagle: question, even with the revert wi are still parallelizing at every include per role (Compute, Controller) | 13:50 |
quiquell|rover | ? | 13:50 |
*** Chaserjim has joined #tripleo | 13:50 | |
quiquell|rover | slagle: Will do thanks | 13:50 |
slagle | quiquell|rover: it's parallelized per host, but each host should be applying everything serially | 13:50 |
slagle | quiquell|rover: that's why i don't think the revert will fix the issue, but i could be wrong | 13:51 |
*** ade_lee has joined #tripleo | 13:51 | |
*** boazel has joined #tripleo | 13:51 | |
*** ade_lee has left #tripleo | 13:52 | |
quiquell|rover | slagle: I see, na it was just trying to find something, we will poke you if we see it again | 13:52 |
*** ade_lee has joined #tripleo | 13:52 | |
slagle | ok thanks | 13:53 |
florianf | honza: yup | 13:56 |
EmilienM | mandre: did you really run the playbook from mistral user? mhhhh | 13:56 |
*** agopi is now known as agopi|afk|ncsu|c | 13:58 | |
*** agopi|afk|ncsu|c is now known as agopi|afk|car-fa | 13:58 | |
*** agopi|afk|car-fa is now known as agopi|afk | 13:58 | |
openstackgerrit | Juan Badia Payno proposed openstack/tripleo-heat-templates master: WIP-Telemetry Framework https://review.openstack.org/603137 | 13:59 |
*** gbarros has quit IRC | 14:01 | |
honza | florianf: thanks | 14:01 |
*** two_oes has quit IRC | 14:02 | |
openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Te-broker: save all nodes console to html log dir https://review.openstack.org/588488 | 14:09 |
*** Chaserjim has quit IRC | 14:10 | |
*** ooolpbot has joined #tripleo | 14:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 14:10 |
openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 14:10 |
openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 14:10 |
*** ooolpbot has quit IRC | 14:10 | |
openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 14:10 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 14:10 |
openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Triaged] - Assigned to Mehdi Abaakouk (sileht) | 14:10 |
openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 14:10 |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 14:10 |
openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 14:10 |
openstackgerrit | Juan Badia Payno proposed openstack/tripleo-heat-templates master: WIP-Telemetry Framework https://review.openstack.org/603137 | 14:12 |
*** Chaserjim has joined #tripleo | 14:13 | |
weshay | jfrancoa, | 14:15 |
weshay | legacy-tripleo-ci-centos-7-containers-multinode-upgrades-pike-branchFAILURE in 24m 46s (non-voting) | 14:15 |
weshay | legacy-tripleo-ci-centos-7-multinode-1ctlr-featureset037-updates-masterFAILURE in 2h 06m 10s (non-voting) | 14:15 |
weshay | legacy-tripleo-ci-centos-7-container-to-container-upgrades-masterFAILURE in 24m 35s (non-voting) | 14:15 |
weshay | jistr, mandre ^ | 14:16 |
weshay | mandre.. sorry. meant marios | 14:16 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/rocky: Fix typo in ansible's module name. https://review.openstack.org/603053 | 14:20 |
chkumar|ruck | weshay: panda please have a look at this one https://review.openstack.org/602347 | 14:20 |
rook | Anyone ever seen this with preparing the images : https://gist.github.com/jtaleric/e9e5322db7deb37d5aa9a1ce59ff52e5 | 14:20 |
*** quiquell|rover is now known as quique|rover|off | 14:22 | |
*** Chaserjim has quit IRC | 14:22 | |
weshay | rlandy, ok.. we can ignore the 3rd party upgrade results | 14:22 |
mandre | EmilienM: hmm, I rebooted my undercloud and now it goes on with the deployment | 14:24 |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart-extras master: Improve output of vxlan networking tasks https://review.openstack.org/600039 | 14:24 |
openstackgerrit | wes hayutin proposed openstack/tripleo-heat-templates master: DNM, test change injection into image https://review.openstack.org/582735 | 14:24 |
openstackgerrit | wes hayutin proposed openstack/tripleo-heat-templates master: DNM, test change injection into image https://review.openstack.org/582735 | 14:25 |
numans | With the latest upstream, the file containers-prepare-parameter.yaml looks totally different. Can some one point me to any documentation on what changed ? | 14:25 |
openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Move toci BASH variables to ansible https://review.openstack.org/589448 | 14:25 |
rlandy | ^^ commit message updated | 14:25 |
weshay | quique|rover|off, do we have a test review in tht for rocky? | 14:25 |
rook | mcornea: hey - any thoughts on : https://gist.github.com/jtaleric/e9e5322db7deb37d5aa9a1ce59ff52e5 | 14:26 |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart-extras master: Improve output of Verify Sphinx build task https://review.openstack.org/600403 | 14:27 |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart-extras master: Improve output of Verify Sphinx build task https://review.openstack.org/600403 | 14:27 |
mandre | numans: it's now using a mistral workflow as part of the deployment, see https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/container_image_prepare.html#prepare-environment-containers | 14:27 |
numans | mandre, thank you :). I will have a look. | 14:28 |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart-extras master: Avoid spamming console with ara JSON output https://review.openstack.org/599594 | 14:28 |
mcornea | rook: what's inside ~/templates/overcloud_containers.yaml ? | 14:28 |
*** dxiri has joined #tripleo | 14:28 | |
rook | https://gist.github.com/jtaleric/e73367561f901080f1488470059fe285 mcornea | 14:29 |
mcornea | rook: namespace: registry.access.redhat.com/rhosp14 - that doesn't exist | 14:30 |
*** dtrainor has joined #tripleo | 14:30 | |
*** Chaserjim has joined #tripleo | 14:30 | |
rook | mcornea: oh, ok | 14:30 |
openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade master: Configure undercloud for containerized upgrade. https://review.openstack.org/603151 | 14:30 |
rook | well... that is what i got with default | 14:30 |
rook | :/ | 14:30 |
rook | updated the namespace mcornea | 14:32 |
*** ykarel is now known as ykarel|away | 14:33 | |
rook | mcornea: so why do I just get this : | 14:34 |
rook | https://gist.github.com/jtaleric/177844b4e55aafa460f3d2be4cca7873 | 14:34 |
rook | I was expecting to see all container images + ovn containres | 14:34 |
*** ksambor_ has quit IRC | 14:34 | |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: Avoid silent parsing failure of provisioned.csv https://review.openstack.org/595795 | 14:35 |
*** aufi has quit IRC | 14:37 | |
mcornea | rook: I think you need to pass the roles_data as well --roles-file /usr/share/openstack-tripleo-heat-templates/roles_data.yaml | 14:39 |
rook | mcornea: if i pass nothing i get all the contianers | 14:41 |
rook | let me try w/ roles_data | 14:41 |
rook | :/ nope | 14:42 |
mcornea | rook: try only the roles_data without -e | 14:42 |
mcornea | rook: that should get you all the containers | 14:42 |
rook | I won't get OVN | 14:43 |
numans | rook, i think you can first generate without passing ovn env | 14:43 |
numans | save that file | 14:43 |
numans | rook, and then run with -e ovn env | 14:43 |
numans | save this second file | 14:43 |
numans | rook, pass both the env files during deploy | 14:43 |
openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade master: Enhance undercloud reboot procedure for baremetal https://review.openstack.org/603155 | 14:44 |
*** artom has joined #tripleo | 14:45 | |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Use swiftUrl as a base for exported plan download URL https://review.openstack.org/599974 | 14:46 |
*** Chaserjim has quit IRC | 14:49 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-heat-templates stable/pike: DNM, wes testing https://review.openstack.org/587676 | 14:49 |
openstackgerrit | wes hayutin proposed openstack/tripleo-heat-templates stable/pike: DNM, wes testing https://review.openstack.org/587676 | 14:50 |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart-extras master: Display output of package install in case of failure https://review.openstack.org/595576 | 14:50 |
*** Chaserjim has joined #tripleo | 14:50 | |
chkumar|ruck | panda: I need some help on this review https://review.openstack.org/602583 to move ahead | 14:52 |
chkumar|ruck | changes are not picked by build test packages reole | 14:52 |
chkumar|ruck | or the zuul_deps scripts are not used? | 14:52 |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart-extras master: Run bashate via pre-commit https://review.openstack.org/583984 | 14:53 |
*** ykarel|away has quit IRC | 14:53 | |
*** hamdyk has quit IRC | 14:57 | |
panda | chkumar|ruck: it's complicated | 14:57 |
panda | chkumar|ruck: we need https://review.openstack.org/602456 first to make it work | 14:58 |
*** janki has joined #tripleo | 14:58 | |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: WIP: Remove ProcessTemplatesAction as base class https://review.openstack.org/599188 | 14:58 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: WIP: Use process-templates.py and cache templates to speed up plan ops. https://review.openstack.org/581153 | 14:58 |
chkumar|ruck | panda: thanks, takin a look | 14:58 |
openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart master: Fix .bashrc path for XDG exports https://review.openstack.org/593103 | 14:58 |
panda | chkumar|ruck: currently we are relying on ZUUL_CHANGES env var, which carries no information on the host | 14:58 |
*** bnemec has joined #tripleo | 14:59 | |
panda | chkumar|ruck: so basically we are assuming everything comes from openstack | 14:59 |
weshay | panda, are you logging the zuul vars? | 15:00 |
weshay | dumping them to tripleo_root | 15:00 |
*** agurenko has quit IRC | 15:00 | |
chkumar|ruck | if zuul provided some plugin based architecture we should have enjected it here directly https://github.com/openstack-infra/zuul/blob/master/zuul/lib/dependson.py | 15:00 |
weshay | panda, w/ regards to https://review.openstack.org/#/c/602673/ | 15:01 |
chkumar|ruck | or somehow tweaked it | 15:01 |
openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/python-tripleoclient master: Add some client libraries as requirements https://review.openstack.org/603162 | 15:01 |
*** aufi has joined #tripleo | 15:01 | |
*** betherly has quit IRC | 15:03 | |
*** mjturek has joined #tripleo | 15:04 | |
*** Chaserjim has quit IRC | 15:04 | |
panda | weshay: no, not logging | 15:06 |
chkumar|ruck | panda: weshay https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/build-test-packages/library/jenkins_deps.py are these files used in ci now a days after zuulv3? | 15:07 |
panda | chkumar|ruck: for ci.centos | 15:08 |
*** Chaserjim has joined #tripleo | 15:08 | |
weshay | chkumar|ruck, some folks wanted to see it stay for changes from non-openstack projects | 15:08 |
chkumar|ruck | panda: can we convince them to move to zuulv3? | 15:08 |
chkumar|ruck | better to zuulify everywhere | 15:09 |
*** ooolpbot has joined #tripleo | 15:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 15:10 |
openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 15:10 |
*** ooolpbot has quit IRC | 15:10 | |
openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 15:10 |
openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 15:10 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 15:10 |
openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Triaged] - Assigned to Mehdi Abaakouk (sileht) | 15:10 |
openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 15:10 |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 15:10 |
openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 15:10 |
panda | chkumar|ruck: I don't think it's in their roadmap. We are trying to fake a zuul environment when possibile, but we'll still get change info from jenkins for ci.centos | 15:10 |
weshay | holy fak | 15:10 |
chkumar|ruck | panda: sure, thanks :-) | 15:12 |
EmilienM | bogdando: please backport https://review.openstack.org/#/c/596274/ to rocky too, and not just queens | 15:14 |
*** morazi has quit IRC | 15:15 | |
*** Chaserjim has quit IRC | 15:16 | |
*** thrash has quit IRC | 15:20 | |
openstackgerrit | Merged openstack/tripleo-common stable/rocky: Fix available roles listing https://review.openstack.org/602371 | 15:21 |
openstackgerrit | Merged openstack/os-apply-config stable/ocata: import zuul job settings from project-config https://review.openstack.org/596087 | 15:21 |
*** Chaserjim has joined #tripleo | 15:21 | |
*** jcoufal has quit IRC | 15:21 | |
*** thrash has joined #tripleo | 15:22 | |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: Dump zuul variables to file https://review.openstack.org/602673 | 15:28 |
*** Chaserjim has quit IRC | 15:30 | |
*** artom has quit IRC | 15:30 | |
*** Chaserjim has joined #tripleo | 15:34 | |
bogdando | is it a known issue http://logs.openstack.org/55/594055/7/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/2115ede/logs/undercloud/home/zuul/undercloud_upgrade.log.txt.gz#_2018-09-17_09_46_09 ? | 15:42 |
bogdando | jistr: ^^ | 15:42 |
bogdando | quique|rover|off: ^^ | 15:43 |
jistr | bogdando: yes | 15:43 |
bogdando | ack, thanks | 15:44 |
*** Chaserjim has quit IRC | 15:44 | |
jistr | bogdando: see oolpbot above | 15:44 |
bogdando | no rechecking then... | 15:44 |
bogdando | ok | 15:44 |
*** Chaserjim has joined #tripleo | 15:44 | |
bogdando | jistr: I normally do, cannot recall something related the last time I checked this morning tho | 15:45 |
bogdando | jistr: or was it https://launchpad.net/bugs/1792560 ? | 15:46 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 15:46 |
*** marrusl has quit IRC | 15:47 | |
jistr | bogdando: https://bugs.launchpad.net/tripleo/+bug/1792892 | 15:47 |
openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 15:47 |
*** pvc has joined #tripleo | 15:50 | |
pvc | Hi | 15:50 |
pvc | Anyone not busy here? | 15:50 |
openstackgerrit | Merged openstack/tripleo-validations stable/queens: Add validation for checking baremetal boot images https://review.openstack.org/595800 | 15:50 |
openstackgerrit | Merged openstack/tripleo-ui master: Upgrade webpack toolchain https://review.openstack.org/601626 | 15:50 |
pvc | Why introspection node not working on my env? It seems it cannot boot the baremetal | 15:50 |
bogdando | EmilienM: will do, the queens backport still waits for the master first | 15:51 |
bogdando | once merged https://review.openstack.org/#/c/596275/, will unblock and create backports for pike and rocky | 15:51 |
pvc | bogdando hi | 15:52 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add host_routes to port_from_pool.j2 https://review.openstack.org/603172 | 15:52 |
pvc | May I know if I can ask? | 15:52 |
bogdando | pvc shoot | 15:52 |
*** Chaserjim has quit IRC | 15:53 | |
pvc | Im on the part of deploying the overcloud. Ipmi connection is fine, it can get the chasis status but there is no chance that the state will become available or the instrospection command will be successful? May i know if i miss something? Im using pxe_ipmitool type | 15:54 |
*** vinaykns has quit IRC | 15:55 | |
*** saneax has quit IRC | 15:56 | |
*** morazi has joined #tripleo | 15:57 | |
*** Chaserjim has joined #tripleo | 15:57 | |
bogdando | pvc is it libvirt VMs? | 15:57 |
pvc | No it is a baremetal server | 15:57 |
bogdando | do you have your provisioning interface included into undercloud's br-ctlplane? | 15:58 |
pvc | What part is that? | 15:58 |
pvc | I just follow the tripleo docs | 15:58 |
bogdando | it should be shown as a port in the ovs-vsctl show outputs | 15:58 |
pvc | I can import the node using instackenv.jl | 15:58 |
*** ykarel has joined #tripleo | 15:59 | |
pvc | But i always stays in manageable state and power on | 15:59 |
pvc | What part will i do that? | 15:59 |
bogdando | my question is only to know if there is no issues with passing dhcp traffic | 15:59 |
openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO https://review.openstack.org/567224 | 16:00 |
openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/rocky: GATE CHECK for TripleO https://review.openstack.org/602247 | 16:00 |
pvc | I think that is the issue my node doesnt get the dhcp | 16:00 |
bogdando | can you see it with tcpdump running in the br-ctlplane? | 16:00 |
pvc | I will comeback to you tomorrow im in the house actually and a bit curios about my issue | 16:01 |
*** jpich has quit IRC | 16:01 | |
bogdando | pvc, you can also file a bug at LP | 16:01 |
bogdando | and give some details, like the deployment command and the tarball that undercloud install creates | 16:01 |
pvc | I see thank you so much | 16:01 |
openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-common stable/queens: Add container runtime packages for cron image https://review.openstack.org/601558 | 16:04 |
*** Chaserjim has quit IRC | 16:04 | |
openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: Add ERL args parameter for rabbit and set the busy wait threshold to none https://review.openstack.org/602082 | 16:05 |
*** pvc has quit IRC | 16:05 | |
*** aufi has quit IRC | 16:06 | |
*** Chaserjim has joined #tripleo | 16:08 | |
*** ooolpbot has joined #tripleo | 16:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 16:10 |
openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 16:10 |
openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 16:10 |
*** ooolpbot has quit IRC | 16:10 | |
openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 16:10 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 16:10 |
openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Triaged] - Assigned to Mehdi Abaakouk (sileht) | 16:10 |
openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 16:10 |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 16:10 |
openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 16:10 |
mwhahaha | so many bugs | 16:10 |
*** thrash is now known as thrash|biab | 16:11 | |
*** yprokule has quit IRC | 16:11 | |
*** marios is now known as marios|hometime | 16:12 | |
*** marios|hometime is now known as marios | 16:13 | |
*** holser_ has quit IRC | 16:14 | |
weshay | mwhahaha, srsly | 16:16 |
weshay | mwhahaha, https://review.openstack.org/#/c/602550/ | 16:17 |
weshay | ykarel, panda rlandy we're probably -1 on https://review.openstack.org/#/c/603026/ | 16:18 |
weshay | right.. because there should *NOT* be more than one release variable used in upgrade jobs | 16:18 |
weshay | just multiple invocations of ansible-playbook and when the upgrade playbook is executed.. it just uses release | 16:19 |
*** Chaserjim has quit IRC | 16:19 | |
ykarel | 2018-09-17 07:57:32 | ERROR! Invalid callback for stdout specified: yaml | 16:20 |
*** artom has joined #tripleo | 16:20 | |
weshay | ykarel, what log? | 16:20 |
ykarel | weshay, http://logs.openstack.org/26/603026/1/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/da915e5/logs/undercloud/home/zuul/undercloud_upgrade.log.txt.gz#_2018-09-17_07_57_32 | 16:20 |
mwhahaha | i wondered if that patch (https://review.openstack.org/#/c/599204/) would cause problems | 16:21 |
rlandy | weshay: ack - -1 - upgrade_release should not be a deciding var | 16:21 |
ykarel | possibly that seems caused the issue | 16:21 |
mwhahaha | is it because we're on the old version of ansible? | 16:22 |
mwhahaha | when we go to run the upgrade | 16:22 |
panda | ansible 2.5 is needed for the yaml callback to work | 16:24 |
openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart master: Fix .bashrc path for XDG exports https://review.openstack.org/593103 | 16:24 |
*** Chaserjim has joined #tripleo | 16:24 | |
openstackgerrit | Numan Siddique proposed openstack/tripleo-heat-templates master: Delete the stale and incorrect ovn environment files https://review.openstack.org/592299 | 16:25 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - data + env (1/3) https://review.openstack.org/582180 | 16:26 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - network.j2 (2/3) https://review.openstack.org/582181 | 16:26 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - subnet fixed_ips (3/3) https://review.openstack.org/582301 | 16:26 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Allow enabling routed networks on undercloud update|upgrade https://review.openstack.org/601369 | 16:27 |
openstackgerrit | Harald Jensås proposed openstack/python-tripleoclient master: Validate routed networks enabled if multiple subnets in conf https://review.openstack.org/600414 | 16:27 |
openstackgerrit | Harald Jensås proposed openstack/python-tripleoclient master: Only validate admin and public host in local_subnet cidr https://review.openstack.org/600439 | 16:27 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add MTU to neutron networks and nic-config templates https://review.openstack.org/599593 | 16:28 |
*** psachin has joined #tripleo | 16:28 | |
*** jfrancoa has quit IRC | 16:30 | |
mwhahaha | ykarel: do you have a bug for that upgrade problem and do we need to revert https://review.openstack.org/#/c/599204/? | 16:30 |
openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Remove roles blocking zuulv3 transition https://review.openstack.org/602445 | 16:31 |
ykarel | mwhahaha, nope i am not aware of bug for that issue, other issue a bug is there https://bugs.launchpad.net/tripleo/+bug/1792560 may be that can hide that issue | 16:32 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 16:32 |
ykarel | as release bumped to rocky | 16:32 |
mwhahaha | we haven't officially released rocky | 16:32 |
* mwhahaha shrugs | 16:33 | |
mwhahaha | ok well i'm filing a bug for the containerized undercloud thing and reverting | 16:33 |
EmilienM | wfm | 16:33 |
mwhahaha | oh look it's lready reported | 16:34 |
mwhahaha | bug 1792892 | 16:34 |
openstack | bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] https://launchpad.net/bugs/1792892 - Assigned to Quique Llorente (quiquell) | 16:34 |
mwhahaha | i' | 16:35 |
mwhahaha | i'd like to know how that passed the upgrades CI job | 16:35 |
mwhahaha | yet is now broken | 16:35 |
mwhahaha | we have an older version of ansible 2.5.2 | 16:37 |
mwhahaha | they must have added it later | 16:37 |
*** Chaserjim has quit IRC | 16:37 | |
openstackgerrit | Alex Schultz proposed openstack/tripleo-common master: Revert "Use YAML output of ansible instead of JSON" https://review.openstack.org/603181 | 16:37 |
*** dxiri has quit IRC | 16:38 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: Do not enforce libguestfs emulation mode https://review.openstack.org/595566 | 16:39 |
mwhahaha | so turns out, the yaml patch wasn't actually tested in ci | 16:43 |
*** psachin has quit IRC | 16:43 | |
jistr | hm yea we hit it in a different context too, this doesn't look like it's being tested either https://review.openstack.org/#/c/602550/ | 16:44 |
mwhahaha | that wouldn't get tested until we switch r->m | 16:46 |
mwhahaha | cause q will still have the package/service | 16:46 |
*** paramite|clone has quit IRC | 16:46 | |
jistr | yea but if the upgrade goes Q->m, it should be using the docker variant tasks | 16:46 |
jistr | it's the "upgraded to" rather than "upgraded from" release which should matter here | 16:47 |
jistr | mwhahaha: ^ | 16:47 |
mwhahaha | yes it will | 16:47 |
mwhahaha | because q is non-containerized | 16:47 |
*** bogdando has quit IRC | 16:48 | |
openstackgerrit | Yael Azulay proposed openstack/puppet-tripleo master: Changes are needed for performance and stability at large intervals https://review.openstack.org/603183 | 16:48 |
mwhahaha | that one worked fine, http://logs.openstack.org/50/602550/1/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/9cc7da8/logs/undercloud/home/zuul/undercloud_upgrade.log.txt.gz#_2018-09-14_08_57_14 | 16:49 |
*** psachin has joined #tripleo | 16:49 | |
mwhahaha | the bug would only be seen once we switch R->m because R would not have xinetd | 16:49 |
mwhahaha | where as q does | 16:49 |
*** ykarel is now known as ykarel|away | 16:50 | |
jistr | mwhahaha: ah right i noticed the patch was green (i know it only affects r->m), but i thought the patch wasn't tested on q->m at all, but in fact it was (gotta fix my ctrl+f skills). so all's fine, thanks :) | 16:51 |
rnoriega | hjensas, ping | 16:51 |
*** kopecmartin has quit IRC | 16:51 | |
weshay | EmilienM, have you looked into https://bugs.launchpad.net/tripleo/+bug/1786764 today? | 16:52 |
openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 16:52 |
* jistr -> home o/ | 16:52 | |
hjensas | rnoriega: pong | 16:53 |
rnoriega | hjensas, hi! do you have a minute re: https://review.openstack.org/#/c/580236/?? | 16:53 |
hjensas | rnoriega: yes | 16:54 |
rnoriega | hjensas, in OPNFV Apex, we got an error due to these new parameters, so I'm adding those to our "default" templates | 16:54 |
*** dtantsur is now known as dtantsur|afk | 16:54 | |
rnoriega | hjensas, with little success xD | 16:54 |
rnoriega | hjensas, https://gerrit.opnfv.org/gerrit/#/c/62113/ | 16:54 |
rnoriega | hjensas, if you see the nics-templates.yaml.jinja2 | 16:55 |
rnoriega | hjensas, I've added the routes parameters | 16:55 |
rnoriega | hjensas, but os-net-config is always giving me some kind of errors. | 16:56 |
rnoriega | hjensas, If you check the previous patchset, https://gerrit.opnfv.org/gerrit/#/c/62113/6/build/nics-template.yaml.jinja2 | 16:56 |
hjensas | rnoriega: ack, without them you get " Unknown Property %%network_name%%InterfaceRoutes ". | 16:56 |
rnoriega | hjensas, yes, that's right | 16:57 |
rnoriega | hjensas, in the previous patchset, I used the exact same syntax as your patch, with the list_concat_unique format... but still, it always complain | 16:57 |
hjensas | rnoriega: ok, so you are passed that but os-net-config then errors. | 16:57 |
rnoriega | hjensas, yep | 16:57 |
rnoriega | hjensas, like: http://paste.openstack.org/show/730198/ | 16:58 |
rnoriega | hjensas, (that error is from the latest patchset, rerunning os-net-config on one of the nodes) | 16:58 |
weshay | most likely RED | 16:59 |
weshay | lolz | 16:59 |
rnoriega | hjensas, I really don't know what to add/remove/change... I've tried everything | 16:59 |
*** rdopiera has quit IRC | 17:00 | |
hjensas | rnoriega: do you have this os-net-config change - https://review.openstack.org/579842 ? | 17:00 |
weshay | clear the gate for https://review.openstack.org/#/c/602550/ ? | 17:01 |
*** Chaserjim has joined #tripleo | 17:01 | |
*** mrunge has joined #tripleo | 17:01 | |
dsneddon | rnoriega, You can run "./tools/process-templates.py -n <network_data.yaml> -r <roles_data.yaml> -o <output_dir>" from the tripleo-heat-templates directory, which will produce examples from the network/config/* directory with all the parameters needed. | 17:01 |
rnoriega | hjensas, in one of my iterations, I got this error: os_net_config.objects.InvalidConfigException: Route JSON objects require next_hop or nexthop to be configured. | 17:02 |
rnoriega | hjensas, so I guess, os-net-config already supports nexthop in the routes object | 17:02 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart-extras master: Fix repo_built variable logic https://review.openstack.org/603185 | 17:02 |
*** lblanchard has quit IRC | 17:02 | |
rnoriega | dsneddon, mmmm... that sounds... like worth trying :-) | 17:02 |
*** mrunge_ has quit IRC | 17:03 | |
rnoriega | dsneddon, thanks buddy! | 17:03 |
hjensas | rnoriega: hmm, then it's there. :) list_of_route has minItems: 1. But you (me ass well?) give it [] which would fail. | 17:03 |
rnoriega | hjensas, you ass well?? xD xD (I'm laughing a lot right now!!) | 17:04 |
rnoriega | sorry! hahah | 17:04 |
*** artom has quit IRC | 17:04 | |
*** artom has joined #tripleo | 17:05 | |
*** boazel has quit IRC | 17:07 | |
hjensas | rnoriega: :) laughing is ok. :D It's been a while. I might never have tested it with [] ... | 17:08 |
rnoriega | dsneddon, hjensas, ok, running the process_templates stuff I got this (for multiple nics): https://curldu.mp/8d590a856ed32ee1bc1a36665bc1dac078d9a863 | 17:08 |
rnoriega | hjensas, dsneddon, and this is the nic config that is failing right now: https://curldu.mp/4098899ca8add1af1458bf99c108c5d12aab9786 | 17:09 |
*** Chaserjim has quit IRC | 17:10 | |
*** ooolpbot has joined #tripleo | 17:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 17:10 |
openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 17:10 |
*** ooolpbot has quit IRC | 17:10 | |
openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 17:10 |
openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 17:10 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 17:10 |
openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Triaged] - Assigned to Mehdi Abaakouk (sileht) | 17:10 |
openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 17:10 |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 17:10 |
openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 17:10 |
*** vinaykns has joined #tripleo | 17:10 | |
*** amoralej is now known as amoralej|off | 17:10 | |
hjensas | rnoriega: what if you change https://github.com/openstack/os-net-config/blob/master/os_net_config/schema.yaml#L157 to have 'minItems: 0' instad of 1? | 17:11 |
*** jpena is now known as jpena|off | 17:11 | |
rnoriega | hjensas, is this parameter optional? | 17:12 |
*** dxiri has joined #tripleo | 17:12 | |
hjensas | rnoriega: if you don't have routes you can keep the parameters in parameters section, and drop the changes in the resources section of your nic templates. | 17:12 |
*** dxiri has quit IRC | 17:13 | |
hjensas | rnoriega: then it won't pass the empty list to os-net-config and it will work. | 17:13 |
*** dxiri has joined #tripleo | 17:13 | |
*** Chaserjim has joined #tripleo | 17:14 | |
openstackgerrit | Alex Schultz proposed openstack-infra/tripleo-ci master: Switch containerized undercloud job to nv https://review.openstack.org/603187 | 17:14 |
rnoriega | hjensas, ok, let me try that | 17:14 |
mwhahaha | EmilienM, weshay -^ we'll need to switch it to nonvoting | 17:14 |
weshay | mwhahaha, the tht patch doesnt get it done? | 17:15 |
mwhahaha | weshay: it's tripleo-common and its not getting applied correctly in the mistral container (that's how we got here in the first place) | 17:15 |
*** artom has quit IRC | 17:15 | |
EmilienM | mwhahaha: approved but the container should have been updated | 17:15 |
mwhahaha | weshay: possibly because of https://review.openstack.org/#/c/602751/ but i think the results were prior to that so i'm not completely sure how it didn't work | 17:16 |
mwhahaha | i think we trust the package building/updating a bit too much in CI | 17:16 |
rnoriega | hjensas, thanks!! I'll get back to you with the result! :-) | 17:16 |
weshay | OK.. you heard it here first... EVERYONE, STOP WRITING CODE | 17:17 |
weshay | :P | 17:17 |
mwhahaha | pretty sure we need some sanity checks in the process to ensure that packages are getting where they are supposed to be | 17:17 |
weshay | +10000 | 17:17 |
hjensas | rnoriega: thanks for reaching out. I think you might have found a bug, that I should fix. :) | 17:17 |
*** trown is now known as trown|lunch | 17:18 | |
rnoriega | hjensas, no worries! :-) | 17:18 |
*** thrash|biab is now known as thrash | 17:21 | |
*** boazel has joined #tripleo | 17:21 | |
*** Chaserjim has quit IRC | 17:22 | |
*** med_ has joined #tripleo | 17:24 | |
*** Chaserjim has joined #tripleo | 17:27 | |
openstackgerrit | Alex Schultz proposed openstack/tripleo-common master: Revert "Use YAML output of ansible instead of JSON" https://review.openstack.org/603181 | 17:27 |
*** dsneddon has quit IRC | 17:30 | |
*** dsneddon has joined #tripleo | 17:30 | |
*** Chaserjim has quit IRC | 17:35 | |
*** Chaserjim has joined #tripleo | 17:39 | |
*** psachin has quit IRC | 17:40 | |
*** tbarron_ is now known as tbarron | 17:41 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: libvirt standalone deployment https://review.openstack.org/591077 | 17:43 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: enable fedora-28 for the reproducer https://review.openstack.org/602492 | 17:44 |
openstackgerrit | Harald Jensås proposed openstack/os-net-config master: Allow list_of_routes to be [] in config https://review.openstack.org/603192 | 17:45 |
*** shardy has quit IRC | 17:46 | |
*** Chaserjim has quit IRC | 17:47 | |
*** Chaserjim has joined #tripleo | 17:48 | |
openstackgerrit | James Slagle proposed openstack/tripleo-common master: Don't fail tripleo-bootstrap on package installs https://review.openstack.org/603196 | 17:53 |
*** lblanchard has joined #tripleo | 18:01 | |
*** janki has quit IRC | 18:04 | |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add MTU to neutron networks and nic-config templates https://review.openstack.org/599593 | 18:06 |
*** artom has joined #tripleo | 18:06 | |
*** artom has quit IRC | 18:07 | |
*** artom has joined #tripleo | 18:07 | |
*** openstackgerrit has quit IRC | 18:10 | |
*** ooolpbot has joined #tripleo | 18:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 18:10 |
openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 18:10 |
openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 18:10 |
*** ooolpbot has quit IRC | 18:10 | |
openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 18:10 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 18:10 |
openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Triaged] - Assigned to Mehdi Abaakouk (sileht) | 18:10 |
openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 18:10 |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 18:10 |
openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 18:10 |
*** leanderthal has quit IRC | 18:17 | |
*** openstackgerrit has joined #tripleo | 18:21 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Resolve get_build_command output before container_build_id https://review.openstack.org/602734 | 18:21 |
*** Chaserjim has quit IRC | 18:31 | |
*** trown|lunch is now known as trown | 18:32 | |
*** Chaserjim has joined #tripleo | 18:42 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Resolve get_build_command output before container_build_id https://review.openstack.org/602734 | 18:47 |
*** Chaserjim has quit IRC | 18:47 | |
openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Remove roles blocking zuulv3 transition https://review.openstack.org/602445 | 18:52 |
rnoriega | hjensas, need to confirm in a latest run, but even removing all the routes in the resource definition, the undercloud contains a route that causes the failure re: minItems | 18:52 |
openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Remove roles blocking zuulv3 transition https://review.openstack.org/602445 | 18:53 |
rnoriega | hjensas, so we better have a look to double check it's a bug :-) | 18:53 |
openstackgerrit | Nicolas Hicher proposed openstack-infra/tripleo-ci master: provider: Add vexxhost https://review.openstack.org/596432 | 18:53 |
*** ykarel|away has quit IRC | 18:53 | |
weshay | mwhahaha, may I -2 patches and clear the gate? | 18:54 |
mwhahaha | won't help | 18:54 |
mwhahaha | also not all patches may be affected | 18:55 |
weshay | k | 18:55 |
mwhahaha | has the non-voting/revert made it to the gate yet? | 18:55 |
* weshay looks | 18:59 | |
hjensas | rnoriega: I proposed https://review.openstack.org/603192 earlier. | 19:00 |
weshay | mwhahaha, no | 19:01 |
*** Chaserjim has joined #tripleo | 19:04 | |
*** zul has quit IRC | 19:08 | |
*** Chaserjim has quit IRC | 19:09 | |
*** ooolpbot has joined #tripleo | 19:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 19:10 |
openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 19:10 |
openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 19:10 |
*** ooolpbot has quit IRC | 19:10 | |
openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 19:10 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 19:10 |
openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Triaged] - Assigned to Mehdi Abaakouk (sileht) | 19:10 |
openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 19:10 |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 19:10 |
openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 19:10 |
*** Chaserjim has joined #tripleo | 19:12 | |
*** dxiri has quit IRC | 19:16 | |
*** dxiri has joined #tripleo | 19:16 | |
*** jtomasek has quit IRC | 19:17 | |
*** jtomasek has joined #tripleo | 19:20 | |
*** Chaserjim has quit IRC | 19:24 | |
*** Chaserjim has joined #tripleo | 19:24 | |
*** zul has joined #tripleo | 19:25 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Resolve get_build_command output before container_build_id https://review.openstack.org/602734 | 19:29 |
*** assassin has quit IRC | 19:29 | |
*** Chaserjim has quit IRC | 19:33 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: tripleo-ci/master: add virt7-container-common-candidate https://review.openstack.org/602973 | 19:33 |
*** jtomasek has quit IRC | 19:37 | |
*** jtomasek has joined #tripleo | 19:40 | |
rook | weshay: hey man do yall have any OSP14 + OVN jobs running? | 19:41 |
mwhahaha | scenario008 maybe? | 19:44 |
mwhahaha | 007 | 19:44 |
weshay | rook, the neutron guys are putting changes to change all the upstream jobs to ovn.. they are working but not merged | 19:44 |
weshay | nothing shall merge hence force | 19:44 |
mwhahaha | rook: https://github.com/openstack/tripleo-heat-templates/blob/master/README.rst#service-testing-matrix | 19:44 |
weshay | forth | 19:44 |
rook | weshay: ack - i just tried OVN with OSP14 and it failed miserably . | 19:45 |
rook | OVSML2 all day | 19:45 |
rook | mwhahaha: ack | 19:45 |
*** haleyb has joined #tripleo | 19:45 | |
rook | s/OSP14/Rocky | 19:45 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-common master: Add httpd and mod_ssl packages to octavia api image https://review.openstack.org/603220 | 19:48 |
*** mjturek has quit IRC | 19:49 | |
*** mjturek has joined #tripleo | 19:52 | |
*** Chaserjim has joined #tripleo | 19:57 | |
openstackgerrit | Merged openstack/instack-undercloud stable/rocky: Add start/stop command for ironic-inspector-dnsmasq https://review.openstack.org/598228 | 19:57 |
mwhahaha | weshay: looks like the virt7-container-common-candidate stuff is really hosing all the jobs | 19:59 |
weshay | too many issues atm | 20:00 |
weshay | sec | 20:00 |
mwhahaha | it's going to be one of those weeks | 20:00 |
*** med_ has quit IRC | 20:01 | |
*** akrivoka has quit IRC | 20:04 | |
*** Chaserjim has quit IRC | 20:06 | |
*** boazel has quit IRC | 20:08 | |
*** ooolpbot has joined #tripleo | 20:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 20:10 |
openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 20:10 |
openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 20:10 |
*** Chaserjim has joined #tripleo | 20:10 | |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 20:10 |
*** ooolpbot has quit IRC | 20:10 | |
openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 20:10 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 20:10 |
openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Triaged] - Assigned to Mehdi Abaakouk (sileht) | 20:10 |
openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 20:10 |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 20:10 |
openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 20:10 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: WIP - Switch fs027 to deploy with podman https://review.openstack.org/600517 | 20:12 |
*** rh-jelabarre has quit IRC | 20:18 | |
*** boazel has joined #tripleo | 20:21 | |
*** jtomasek has quit IRC | 20:22 | |
*** rh-jelabarre has joined #tripleo | 20:24 | |
gfidente | EmilienM you might now, is the containerized undercloud reusing the tht services we deploy in the overcloud unmodified? | 20:25 |
gfidente | EmilienM we were thinking about a small change which would only be necessary for the mistral service in the undercloud | 20:25 |
*** dprince has quit IRC | 20:25 | |
EmilienM | gfidente: yes | 20:27 |
EmilienM | gfidente: in /usr/share/openstack-tripleo-heat-templates | 20:27 |
gfidente | EmilienM so if I wanted to make a change which should only be used when the service is deployed in the undecloud, how could I? | 20:27 |
EmilienM | gfidente: you can override the dir to use in undercloud.conf with "templates" parameter | 20:31 |
EmilienM | so you would git clone wherever you want, do your changes, and update undercloud.conf to point templates to this dir | 20:31 |
gfidente | EmilienM oh please :D | 20:31 |
gfidente | that's not what I was asking :D | 20:32 |
EmilienM | however I suspect the mistral container would have to be rebuilt | 20:32 |
gfidente | EmilienM sorry what I meant is that I want to make a change in the code for the mistral container to mount the ceph-ansible playbooks dir, but it only applies when the service is deployed in the undercloud | 20:32 |
EmilienM | ah ok, sorry | 20:32 |
*** zul has quit IRC | 20:32 | |
EmilienM | I would use environment/undercloud.yaml then | 20:33 |
gfidente | so I was wondering if anybody else got into a similar situation and has suggestions on how to discern the scenarios? | 20:33 |
EmilienM | yes we have this situation for Heat for example | 20:33 |
gfidente | EmilienM great so a param to change the behavior | 20:33 |
gfidente | great | 20:33 |
gfidente | EmilienM thanks :D | 20:33 |
EmilienM | where we configure it differently from overcloud | 20:33 |
EmilienM | sorry if I didn't get it the first time | 20:33 |
*** Chaserjim has quit IRC | 20:34 | |
*** Chaserjim has joined #tripleo | 20:38 | |
*** ansmith has quit IRC | 20:38 | |
openstackgerrit | John Fulton proposed openstack/tripleo-heat-templates master: Add CephOSD service to roles/Standalone.yaml https://review.openstack.org/603227 | 20:45 |
openstackgerrit | Brent Eagles proposed openstack/puppet-tripleo master: Enable TLS in the internal network for Octavia API https://review.openstack.org/597038 | 20:45 |
*** lblanchard has quit IRC | 20:48 | |
*** artom has quit IRC | 20:48 | |
*** med_ has joined #tripleo | 20:49 | |
*** med_ has quit IRC | 20:50 | |
*** Chaserjim has quit IRC | 20:51 | |
openstackgerrit | John Fulton proposed openstack/tripleo-docs master: WIP/DNM: Update standalone documentation to include steps for Ceph https://review.openstack.org/602710 | 20:52 |
*** agopi|afk is now known as agopi | 21:06 | |
*** trown is now known as trown|outtypewww | 21:07 | |
*** mjturek has quit IRC | 21:08 | |
*** bfournie has quit IRC | 21:09 | |
*** ooolpbot has joined #tripleo | 21:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 21:10 |
openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 21:10 |
*** ooolpbot has quit IRC | 21:10 | |
openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 21:10 |
openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 21:10 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 21:10 |
openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Triaged] - Assigned to Mehdi Abaakouk (sileht) | 21:10 |
openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 21:10 |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 21:10 |
openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 21:10 |
*** cylopez has quit IRC | 21:25 | |
openstackgerrit | Merged openstack/instack-undercloud stable/queens: Add start/stop command for ironic-inspector-dnsmasq https://review.openstack.org/598229 | 21:25 |
*** raildo has quit IRC | 21:28 | |
openstackgerrit | John Fulton proposed openstack/tripleo-docs master: Update standalone documentation to include steps for Ceph https://review.openstack.org/602710 | 21:32 |
*** boazel has quit IRC | 21:45 | |
*** Chaserjim has joined #tripleo | 21:45 | |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Run online data migrations https://review.openstack.org/601521 | 21:45 |
*** Chaserjim has quit IRC | 21:54 | |
*** gfidente has quit IRC | 21:57 | |
*** bdodd has quit IRC | 22:00 | |
*** Chaserjim has joined #tripleo | 22:03 | |
openstackgerrit | Jill Rouleau proposed openstack/python-tripleoclient master: [WIP] Export overcloud config to container https://review.openstack.org/600895 | 22:08 |
*** rcernin has joined #tripleo | 22:08 | |
*** slaweq has quit IRC | 22:09 | |
*** Chaserjim has quit IRC | 22:11 | |
*** slaweq has joined #tripleo | 22:11 | |
*** ooolpbot has joined #tripleo | 22:12 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:13 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 22:13 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 22:13 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 22:13 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 22:13 |
openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 22:13 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 22:13 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 22:13 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 22:14 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 22:14 |
*** ooolpbot has quit IRC | 22:14 | |
openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 22:14 |
openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 22:14 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 22:14 |
openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Triaged] - Assigned to Mehdi Abaakouk (sileht) | 22:14 |
openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 22:14 |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 22:14 |
openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 22:14 |
*** thrash is now known as thrash|g0ne | 22:14 | |
*** slaweq has quit IRC | 22:15 | |
openstackgerrit | Jill Rouleau proposed openstack/python-tripleoclient master: [WIP] Export overcloud config to container https://review.openstack.org/600895 | 22:34 |
*** vinaykns has quit IRC | 22:34 | |
*** fpan has quit IRC | 22:36 | |
openstackgerrit | Jill Rouleau proposed openstack/ansible-role-tripleo-qdrouterd master: Add required role repo contents https://review.openstack.org/585097 | 22:39 |
*** fpan has joined #tripleo | 22:39 | |
*** Chaserjim has joined #tripleo | 22:40 | |
*** rlandy is now known as rlandy|bbl | 22:50 | |
*** Chaserjim has quit IRC | 22:51 | |
*** Chaserjim has joined #tripleo | 22:52 | |
*** Chaserjim has quit IRC | 23:00 | |
EmilienM | 'error pulling image "192.168.24.1:8787/tripleomaster/centos-binary-ironic-api:current-tripleo-updated-20180917201914": unable to pull 192.168.24.1:8787/tripleomaster/centos-binary-ironic-api:current-tripleo-updated-20180917201914: unable to pull image: Error determining manifest MIME type for docker://192.168.24.1:8787/tripleomaster/centos-binary-ironic-api:current-tripleo-updated-20180917201914: pinging | 23:00 |
EmilienM | docker registry returned: Get https://192.168.24.1:8787/v2/: http: server gave HTTP response to HTTPS client' | 23:00 |
EmilienM | stevebaker, mwhahaha ^ have you seen that before? (trying to enable podman in cont uc job) | 23:01 |
* EmilienM wanders off | 23:03 | |
*** ooolpbot has joined #tripleo | 23:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 23:10 |
openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 23:10 |
openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 23:10 |
*** ooolpbot has quit IRC | 23:10 | |
openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 23:10 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 23:10 |
openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Triaged] - Assigned to Mehdi Abaakouk (sileht) | 23:10 |
openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 23:10 |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 23:10 |
openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 23:10 |
*** slaweq has joined #tripleo | 23:11 | |
*** dxiri has quit IRC | 23:12 | |
EmilienM | weshay: you around? | 23:14 |
EmilienM | I'm wondering how can I add a repo when generating these images: https://images.rdoproject.org/master/rdo_trunk/tripleo-ci-testing/ | 23:14 |
*** slaweq has quit IRC | 23:16 | |
*** Chaserjim has joined #tripleo | 23:22 | |
*** tosky has quit IRC | 23:23 | |
*** Chaserjim has quit IRC | 23:35 | |
*** Chaserjim has joined #tripleo | 23:39 | |
*** Chaserjim has quit IRC | 23:47 | |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Tag step plays https://review.openstack.org/599072 | 23:48 |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Remove "when failed" from debug task names https://review.openstack.org/598221 | 23:48 |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Tag tasks in in common tasks https://review.openstack.org/603250 | 23:48 |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Convert with_dict tasks to use loop and be less chatty https://review.openstack.org/603251 | 23:48 |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: check mode: puppet host https://review.openstack.org/603252 | 23:48 |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: check mode: docker_puppet https://review.openstack.org/603253 | 23:48 |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: check mode: docker_puppet_tasks https://review.openstack.org/603254 | 23:48 |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: check mode: paunch configs https://review.openstack.org/603255 | 23:48 |
*** dsneddon has quit IRC | 23:52 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!