| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO https://review.openstack.org/567224 | 00:00 |
|---|---|---|
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/pike: GATE CHECK for TripleO https://review.openstack.org/564285 | 00:00 |
| *** mcornea has quit IRC | 00:02 | |
| *** artom has joined #tripleo | 00:03 | |
| *** khyr0n has quit IRC | 00:05 | |
| *** mcornea has joined #tripleo | 00:06 | |
| *** lifeless has quit IRC | 00:09 | |
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 00:10 |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| *** yamahata has joined #tripleo | 00:14 | |
| *** liverpooler has joined #tripleo | 00:29 | |
| *** psahoo has joined #tripleo | 00:36 | |
| *** kbyrne has quit IRC | 00:38 | |
| *** kbyrne has joined #tripleo | 00:41 | |
| *** ccamacho has quit IRC | 00:43 | |
| *** waleedm has joined #tripleo | 00:48 | |
| *** limao has joined #tripleo | 00:53 | |
| *** khyr0n has joined #tripleo | 01:02 | |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] | 01:10 |
| *** waleedm has quit IRC | 01:12 | |
| *** mdnadeem has joined #tripleo | 01:13 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: use fs config to assign standalone role, tests https://review.openstack.org/572830 | 01:14 |
| *** psahoo has quit IRC | 01:18 | |
| *** artom has quit IRC | 01:18 | |
| *** mdnadeem has quit IRC | 01:20 | |
| *** Petersingh has joined #tripleo | 01:21 | |
| *** sri_ has quit IRC | 01:21 | |
| *** sri_ has joined #tripleo | 01:23 | |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder master: uncap networkx to match global-requirements. https://review.openstack.org/574503 | 01:25 |
| *** mcornea has quit IRC | 01:26 | |
| *** psahoo has joined #tripleo | 01:28 | |
| *** limao has quit IRC | 01:29 | |
| *** rh-jelabarre has quit IRC | 01:32 | |
| *** mdnadeem has joined #tripleo | 01:33 | |
| *** psahoo has quit IRC | 01:33 | |
| *** lifeless has joined #tripleo | 01:41 | |
| *** limao has joined #tripleo | 01:45 | |
| *** psahoo has joined #tripleo | 01:45 | |
| *** limao has quit IRC | 01:46 | |
| *** limao has joined #tripleo | 01:47 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Update my blog feed https://review.openstack.org/572733 | 01:49 |
| *** Petersingh is now known as Petersingh|afk | 02:02 | |
| *** rlandy|rover|bbl is now known as rlandy|rover | 02:08 | |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 02:10 |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| *** Petersingh|afk is now known as Petersingh | 02:10 | |
| *** ipsecguy has quit IRC | 02:13 | |
| *** ipsecguy has joined #tripleo | 02:15 | |
| *** yamahata has quit IRC | 02:17 | |
| *** ccamacho has joined #tripleo | 02:17 | |
| openstackgerrit | Sai Sindhur Malleni proposed openstack/tripleo-validations master: Check baremetal flavors for custom resource class https://review.openstack.org/574419 | 02:27 |
| *** psachin has joined #tripleo | 02:32 | |
| *** lifeless has quit IRC | 02:32 | |
| *** lifeless has joined #tripleo | 02:33 | |
| *** rcernin is now known as rcernin|lunch | 02:35 | |
| *** yamahata has joined #tripleo | 02:46 | |
| *** rlandy|rover has quit IRC | 02:49 | |
| *** lblanchard has joined #tripleo | 02:49 | |
| *** mdnadeem has quit IRC | 02:53 | |
| *** lblanchard has quit IRC | 02:53 | |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] | 03:10 |
| *** etingof has quit IRC | 03:13 | |
| *** ccamacho has quit IRC | 03:13 | |
| *** itlinux has joined #tripleo | 03:15 | |
| *** skramaja has joined #tripleo | 03:18 | |
| *** etingof has joined #tripleo | 03:26 | |
| *** agopi has joined #tripleo | 03:30 | |
| chandankumar | mwhahaha: in long run it will be replaced in mistral workflow to generate a tempest.conf for that | 03:34 |
| chandankumar | in place of tempest deployer input conf | 03:34 |
| *** gvrangan has joined #tripleo | 03:36 | |
| openstackgerrit | baiwenteng proposed openstack/tripleo-heat-templates master: Fix typo https://review.openstack.org/574538 | 03:37 |
| *** gvrangan has quit IRC | 03:39 | |
| *** agopi has quit IRC | 03:40 | |
| *** gvrangan has joined #tripleo | 03:42 | |
| *** gvrangan has quit IRC | 03:43 | |
| *** Petersingh is now known as Petersingh|afk | 03:43 | |
| *** gvrangan has joined #tripleo | 03:44 | |
| *** moshele has joined #tripleo | 03:46 | |
| *** gvrangan has quit IRC | 03:47 | |
| *** gvrangan has joined #tripleo | 03:47 | |
| *** gvrangan has quit IRC | 03:49 | |
| *** gvrangan has joined #tripleo | 03:49 | |
| *** udesale has joined #tripleo | 03:52 | |
| *** moshele has quit IRC | 03:52 | |
| openstackgerrit | baiwenteng proposed openstack/tripleo-heat-templates master: Fix typo https://review.openstack.org/574538 | 03:53 |
| *** limao has quit IRC | 03:54 | |
| *** gvrangan has quit IRC | 03:54 | |
| *** limao has joined #tripleo | 03:54 | |
| *** agopi has joined #tripleo | 03:57 | |
| *** limao has quit IRC | 03:58 | |
| *** mdnadeem has joined #tripleo | 03:59 | |
| *** mdnadeem has quit IRC | 04:00 | |
| *** mdnadeem has joined #tripleo | 04:00 | |
| *** mdnadeem has quit IRC | 04:08 | |
| *** agopi has quit IRC | 04:08 | |
| *** ykarel|away has joined #tripleo | 04:09 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 04:10 |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| *** ramishra has joined #tripleo | 04:10 | |
| *** mdnadeem has joined #tripleo | 04:11 | |
| *** stendulker has joined #tripleo | 04:13 | |
| *** itlinux has quit IRC | 04:19 | |
| *** ykarel_ has joined #tripleo | 04:21 | |
| *** ykarel|away has quit IRC | 04:23 | |
| *** radeks has joined #tripleo | 04:24 | |
| *** shreshtha has joined #tripleo | 04:24 | |
| *** pdeore has joined #tripleo | 04:26 | |
| *** rajinir has quit IRC | 04:30 | |
| *** ffiore has joined #tripleo | 04:33 | |
| *** cshastri has joined #tripleo | 04:36 | |
| openstackgerrit | yatin proposed openstack/tripleo-quickstart-extras master: Fix yum contentdir var for non altarch https://review.openstack.org/574238 | 04:38 |
| *** stendulker_ has joined #tripleo | 04:47 | |
| *** pgadiya has joined #tripleo | 04:48 | |
| *** stendulker has quit IRC | 04:49 | |
| *** ffiore_ has joined #tripleo | 04:52 | |
| *** ffiore has quit IRC | 04:52 | |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: use upstream git url instead of github https://review.openstack.org/572347 | 04:54 |
| *** ffiore has joined #tripleo | 04:56 | |
| *** ffiore_ has quit IRC | 04:57 | |
| *** mdnadeem has quit IRC | 04:57 | |
| *** mdnadeem has joined #tripleo | 04:58 | |
| *** ffiore_ has joined #tripleo | 04:59 | |
| *** limao has joined #tripleo | 05:00 | |
| *** ffiore has quit IRC | 05:00 | |
| *** ffiore has joined #tripleo | 05:03 | |
| *** ffiore_ has quit IRC | 05:04 | |
| *** Petersingh|afk is now known as Petersingh | 05:05 | |
| *** radeks has quit IRC | 05:05 | |
| *** ffiore_ has joined #tripleo | 05:06 | |
| *** ffiore has quit IRC | 05:07 | |
| *** ffiore has joined #tripleo | 05:10 | |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 05:10 |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| *** hewbrocca_afk has quit IRC | 05:10 | |
| *** pliu has quit IRC | 05:10 | |
| *** toure has quit IRC | 05:10 | |
| *** ffiore_ has quit IRC | 05:11 | |
| *** pliu has joined #tripleo | 05:11 | |
| *** akrzos has quit IRC | 05:11 | |
| *** vkhanna has quit IRC | 05:11 | |
| *** rasca has quit IRC | 05:11 | |
| *** vkhanna has joined #tripleo | 05:11 | |
| *** hewbrocca_afk has joined #tripleo | 05:11 | |
| *** myoung|off has quit IRC | 05:11 | |
| *** faceman has quit IRC | 05:11 | |
| *** lucasagomes has quit IRC | 05:11 | |
| *** rnoriega has quit IRC | 05:11 | |
| *** lhinds has quit IRC | 05:11 | |
| *** akrzos has joined #tripleo | 05:12 | |
| *** toure has joined #tripleo | 05:12 | |
| *** lhinds has joined #tripleo | 05:12 | |
| *** faceman has joined #tripleo | 05:13 | |
| *** ffiore has quit IRC | 05:14 | |
| *** rnoriega has joined #tripleo | 05:14 | |
| *** rasca has joined #tripleo | 05:14 | |
| *** lucasagomes has joined #tripleo | 05:16 | |
| *** myoung has joined #tripleo | 05:17 | |
| *** ffiore has joined #tripleo | 05:23 | |
| *** pcaruana has quit IRC | 05:24 | |
| *** ffiore_ has joined #tripleo | 05:26 | |
| *** ffiore has quit IRC | 05:28 | |
| *** cshastri has quit IRC | 05:30 | |
| *** ffiore_ has quit IRC | 05:31 | |
| *** quiquell|off is now known as quiquell | 05:32 | |
| bandini | any takers for two queens backports: https://review.openstack.org/574263 and https://review.openstack.org/574264 ? | 05:33 |
| *** stendulker has joined #tripleo | 05:34 | |
| *** sudhirag098 has joined #tripleo | 05:35 | |
| *** ratailor has joined #tripleo | 05:36 | |
| sudhirag098 | hi...can anyone help me with dvr in openstack queens | 05:37 |
| *** radeks has joined #tripleo | 05:37 | |
| *** stendulker_ has quit IRC | 05:38 | |
| *** ffiore_ has joined #tripleo | 05:40 | |
| *** sudlaw has joined #tripleo | 05:41 | |
| *** sudhirag098 has quit IRC | 05:42 | |
| *** ffiore_ has quit IRC | 05:45 | |
| *** cshastri has joined #tripleo | 05:46 | |
| *** dxiri has quit IRC | 05:47 | |
| *** ffiore_ has joined #tripleo | 05:47 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Add a role for the standalone deployment https://review.openstack.org/572220 | 05:49 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Introduce tripleo-ci-centos-7-standalone non-voting job https://review.openstack.org/572217 | 05:49 |
| *** radeks has quit IRC | 05:50 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-upgrade stable/queens: Add keystone only job for queens https://review.openstack.org/574218 | 05:50 |
| *** ffiore_ has quit IRC | 05:51 | |
| *** cshastri has quit IRC | 05:52 | |
| *** cshastri has joined #tripleo | 05:52 | |
| *** zzzeek has quit IRC | 05:54 | |
| *** ffiore_ has joined #tripleo | 05:54 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Add a way to override base path when file driver is used https://review.openstack.org/570226 | 05:54 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/queens: Add keystone only job for queens https://review.openstack.org/572308 | 05:54 |
| *** zzzeek has joined #tripleo | 05:58 | |
| *** ffiore_ has quit IRC | 05:59 | |
| *** tcw has quit IRC | 06:03 | |
| *** ffiore has joined #tripleo | 06:04 | |
| *** ffiore_ has joined #tripleo | 06:07 | |
| *** ffiore has quit IRC | 06:09 | |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] | 06:10 |
| *** jtomasek has joined #tripleo | 06:11 | |
| *** jtomasek has quit IRC | 06:11 | |
| *** mschuppert has joined #tripleo | 06:11 | |
| *** ffiore_ has quit IRC | 06:12 | |
| *** tcw has joined #tripleo | 06:12 | |
| *** jtomasek_ has joined #tripleo | 06:13 | |
| *** sudlaw has quit IRC | 06:14 | |
| *** jtomasek_ has quit IRC | 06:16 | |
| *** udesale has quit IRC | 06:18 | |
| *** udesale has joined #tripleo | 06:18 | |
| *** pcaruana has joined #tripleo | 06:27 | |
| *** dparkes has joined #tripleo | 06:27 | |
| *** saneax has joined #tripleo | 06:29 | |
| openstackgerrit | Martin André proposed openstack/tripleo-quickstart-extras master: [WIP] Add dirty hack until openshift-ansible catches up https://review.openstack.org/574290 | 06:30 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Add logic/tests for n->n+1 upgrades https://review.openstack.org/572420 | 06:30 |
| *** florianf has joined #tripleo | 06:34 | |
| *** jtomasek has joined #tripleo | 06:37 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [DNM] Test n -> n + delta https://review.openstack.org/574134 | 06:38 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [DNM] Test n -> n + delta https://review.openstack.org/574134 | 06:38 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: [DNM][WIP] Add release to gating repo https://review.openstack.org/572736 | 06:39 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [DNM] Activate queens for fs050 https://review.openstack.org/574581 | 06:42 |
| *** bogdando has joined #tripleo | 06:43 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-heat-templates stable/queens: DMN: Testing tripleo-ci upgrade logic (sprint 14) (queens) https://review.openstack.org/572937 | 06:45 |
| *** stendulker_ has joined #tripleo | 06:46 | |
| openstackgerrit | XiaojueGuan proposed openstack/tripleo-ui master: Update links in README https://review.openstack.org/574584 | 06:47 |
| michchap | sudlaw | 06:49 |
| *** stendulker has quit IRC | 06:50 | |
| *** waleedm has joined #tripleo | 06:55 | |
| *** cshastri_ has joined #tripleo | 06:57 | |
| *** ledo_ has joined #tripleo | 06:57 | |
| *** cshastri has quit IRC | 06:59 | |
| *** waleedm has quit IRC | 07:00 | |
| *** waleedm has joined #tripleo | 07:04 | |
| *** ledo_ has quit IRC | 07:04 | |
| *** bogdando has quit IRC | 07:06 | |
| *** tosky has joined #tripleo | 07:07 | |
| *** cylopez has joined #tripleo | 07:09 | |
| *** nyechiel has joined #tripleo | 07:09 | |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] | 07:10 |
| *** cylopez has joined #tripleo | 07:10 | |
| *** slaweq has joined #tripleo | 07:11 | |
| *** amoralej|off is now known as amoralej | 07:11 | |
| *** masco has quit IRC | 07:12 | |
| *** bogdando has joined #tripleo | 07:12 | |
| *** kopecmartin has joined #tripleo | 07:12 | |
| *** rcernin|lunch has quit IRC | 07:13 | |
| *** moshele has joined #tripleo | 07:15 | |
| *** stendulker has joined #tripleo | 07:15 | |
| *** ykarel_ is now known as ykarel | 07:15 | |
| *** gkadam has joined #tripleo | 07:15 | |
| *** radeks has joined #tripleo | 07:16 | |
| *** florianf has quit IRC | 07:18 | |
| *** stendulker_ has quit IRC | 07:18 | |
| *** florianf has joined #tripleo | 07:18 | |
| *** ccamacho has joined #tripleo | 07:25 | |
| *** avivgt has joined #tripleo | 07:29 | |
| *** redrobot has quit IRC | 07:33 | |
| *** pcaruana has quit IRC | 07:34 | |
| *** jpena|off is now known as jpena | 07:35 | |
| *** holser__ has joined #tripleo | 07:37 | |
| *** lifeless has quit IRC | 07:39 | |
| *** lifeless has joined #tripleo | 07:39 | |
| *** redrobot has joined #tripleo | 07:39 | |
| cgoncalves | could someone please review https://review.openstack.org/#/c/555252/? it's been there for a while, needs +W | 07:40 |
| *** chem has joined #tripleo | 07:42 | |
| *** slaweq has quit IRC | 07:43 | |
| *** chem has quit IRC | 07:44 | |
| *** moshele has quit IRC | 07:44 | |
| *** chem has joined #tripleo | 07:45 | |
| *** Petersingh is now known as Petersingh|lunch | 07:48 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient master: Align roles file to become a normalized path https://review.openstack.org/572404 | 07:49 |
| *** pcaruana has joined #tripleo | 07:49 | |
| *** shardy has joined #tripleo | 07:51 | |
| *** rodolof has joined #tripleo | 07:54 | |
| *** jpich has joined #tripleo | 07:55 | |
| *** lvdombrkr has joined #tripleo | 07:55 | |
| openstackgerrit | Michele Baldessari proposed openstack/python-tripleoclient master: WIP fix overcloud delete command https://review.openstack.org/574623 | 07:55 |
| *** janki has joined #tripleo | 07:57 | |
| mandre | shardy, bogdando, bandini, jaosorior: Hi, good morning. Can one of you do a quick review on https://review.openstack.org/#/c/573699/ ? I just need to collect some +2 so we can merge the rdo change that will make the CI go green :) | 07:58 |
| *** pcaruana has quit IRC | 07:59 | |
| *** holser__ has quit IRC | 08:00 | |
| *** jbadiapa_ is now known as jbadiapa | 08:00 | |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/560445 | 08:00 |
| *** holser__ has joined #tripleo | 08:00 | |
| mandre | thanks jaosorior | 08:00 |
| mandre | and bandini :) | 08:01 |
| bandini | I aim to please | 08:02 |
| mandre | I wish it was always that simple to collect +2s | 08:03 |
| *** stendulker_ has joined #tripleo | 08:05 | |
| *** yprokule has joined #tripleo | 08:05 | |
| shardy | mandre: hey good morning, sounds like I'm too late but looking :) | 08:06 |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-heat-templates stable/queens: Match only haproxy for docker ps and skipp all *-haproxy occurences https://review.openstack.org/574624 | 08:08 |
| *** nyechiel_ has joined #tripleo | 08:09 | |
| *** stendulker has quit IRC | 08:09 | |
| *** nyechiel has quit IRC | 08:10 | |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] | 08:10 |
| mandre | thanks guys, we now have enough votes on https://review.openstack.org/#/c/573699/ -- rdo change is about to merge | 08:12 |
| *** pcaruana has joined #tripleo | 08:15 | |
| *** suuuper has joined #tripleo | 08:15 | |
| matbu | jaosorior: Hey o/ regarding: https://review.openstack.org/#/c/574173/ | 08:15 |
| jaosorior | matbu: sup | 08:15 |
| matbu | jaosorior: what is the string for the haproxy/pacemaker ? | 08:15 |
| jaosorior | I don't have an environment running at the moment, but it's something like haproxy-bundle-<something> | 08:16 |
| openstackgerrit | XiaojueGuan proposed openstack/tripleo-image-elements master: Update links in README https://review.openstack.org/574630 | 08:16 |
| *** chem` has joined #tripleo | 08:16 | |
| *** rodolof has quit IRC | 08:16 | |
| matbu | jaosorior: it should match then | 08:16 |
| *** chem has quit IRC | 08:16 | |
| *** chem` is now known as chem | 08:17 | |
| matbu | jaosorior: the issue is when the command return multiple lines | 08:17 |
| jistr | bogdando: please check the upgrade job results before giving +2, the failure is caused by the patch at https://review.openstack.org/#/c/574474 | 08:17 |
| *** derekh has joined #tripleo | 08:17 | |
| jaosorior | matbu: actually you're right | 08:17 |
| matbu | jaosorior: hehe | 08:17 |
| bogdando | jistr, I didn't expect upgrade impact for the unrelated (should be by design) pre post deploy tasks tbh... | 08:18 |
| bogdando | I think we did something very wrong if deploy tasks impact upgrade... | 08:18 |
| bogdando | ideally, upgrade vs deploy tasks should not overlap like this, jistr am I right? | 08:20 |
| bogdando | that's why I didn't check that job failure, mea culpa :) | 08:20 |
| jistr | bogdando: no, we do run deploy tasks on upgrade on purpose. We reuse them to start services. Upgrade tasks typically just stop the services, then deploy tasks bring them back again. | 08:20 |
| bogdando | we prolly need to redesign | 08:21 |
| *** ykarel_ has joined #tripleo | 08:21 | |
| jistr | no i think that's a good pattern. We want upgrade and fresh deploy to be as close as we can get them IMO | 08:21 |
| shardy | bogdando: why? The upgrade process is to prepare for the upgrade, then re-run the deploy steps | 08:21 |
| bogdando | would be really nice to have deployment related things parallelized w/o being crippled by implicit upgrade cases | 08:21 |
| jistr | that's at least my view right now | 08:21 |
| shardy | there's no reason to change that IMO, starting the services in the right order and with the correct configuration is exactly the same for deploy, update and upgrade IMHO | 08:22 |
| shardy | bogdando: how can we parallelize things when there are implicit dependencies between services? | 08:22 |
| jistr | bogdando: i'm always willing to be persuaded otherwise but i think so far the pattern has been working well. It feels like we get more predictability/consistency when upgrade essentially repeats what deployment does. | 08:22 |
| bogdando | shardy: but please read that slagle describes for the pre/post tasks shardy | 08:22 |
| shardy | bogdando: sorry missing context, got a link? | 08:23 |
| bogdando | shardy: https://review.openstack.org/#/c/574474 | 08:23 |
| bogdando | pre/post are special | 08:23 |
| *** ykarel has quit IRC | 08:23 | |
| bogdando | would be wise to split upgrade cases off them IMO | 08:23 |
| bogdando | and split the graphs | 08:23 |
| shardy | jistr: +1, also it means that half of the upgrade process is already tested | 08:24 |
| shardy | vs some kind of special-case for upgrade that's similar but not quite the same as deploy | 08:24 |
| *** rodolof has joined #tripleo | 08:24 | |
| bogdando | well, for maintenance/upgrade, the serial / 1 by 1 is valid | 08:24 |
| bogdando | while doing role be role for a basic deployment preps would be a timewaste | 08:24 |
| shardy | bogdando: why can't those tasks be run in parallel during the upgrade, except for computes etc where we know we need to do a rolling upgrade? | 08:25 |
| jistr | shardy, bogdando: FWIW i think it should be possible to do what slagle wants without breaking the upgrade. The error is something like "cannot find lookup plugin 'vars'" or something like that | 08:25 |
| bogdando | we merged those cases and now will suffer :) | 08:25 |
| shardy | for the control-plane the upgrade is the same as deploy | 08:25 |
| jistr | so IMO it's more about ironing things out rather than some conceptual collision | 08:25 |
| shardy | bogdando: yeah but the way the tasks are defined is the same, on upgrade we can use --limit to do things step by step, and just no --limit on deploy | 08:26 |
| shardy | AFAIK that's the way upgrades have always worked since we switched to ansible anyway | 08:26 |
| shardy | jistr: yeah I agree, the patch from slagle seems compatible with the current upgrade approach I think | 08:26 |
| openstackgerrit | XiaojueGuan proposed openstack/os-apply-config master: Update links in README https://review.openstack.org/574638 | 08:26 |
| shardy | perhaps there are some issues we need to fix but I agree the concept is fine | 08:27 |
| bogdando | I think there should be independed from upgrade cases pre/post dpeloy tasks | 08:28 |
| bogdando | so we could parallelize them w/o additional pain | 08:28 |
| *** ykarel_ is now known as ykarel | 08:28 | |
| shardy | bogdando: I think we're saying we can parallelize them, why do you think it's going to cause pain? | 08:31 |
| shardy | I'm not clear on the specific problem here tbh | 08:31 |
| shardy | On upgrade we can use serial and/or limit to control parallelizm | 08:31 |
| shardy | but that doesn't impact the deploy AFAICS | 08:32 |
| shardy | the tasks are the same | 08:32 |
| bogdando | shardy: an implicit upgrade impact when looking onto https://review.openstack.org/#/c/574474/2/common/deploy-steps.j2 is the pain :) | 08:33 |
| bogdando | the code has nothing to upgrades, right? it says deployment.yaml, not upgrade.yaml | 08:33 |
| shardy | bogdando: we run the deploy steps on upgrade, as just said | 08:34 |
| bogdando | I know things are shared but, that looks definitley like pain | 08:34 |
| bogdando | well right, though deploy steps (in general) are not the same as pre/post tasks | 08:34 |
| shardy | lets look at fixing the issue with that patch - I think the concept is clear, on upgrade we run some tasks to prepare for the upgrade, then run the normal deploy tasks/steps | 08:35 |
| shardy | bogdando: what if the pre/post tasks change and are needed on upgrade? | 08:35 |
| shardy | we have a flag that tells us if it's an upgrade or deploy, so we can use conditionals if new pre/post tasks are added that don't apply on upgrade | 08:35 |
| shardy | maybe I'm missing something, I need to get coffee and look closer at the CI error | 08:36 |
| bogdando | shardy: I think the most confusing is this https://review.openstack.org/#/c/574474/2/common/deploy-steps.j2@450 | 08:37 |
| bogdando | we have to manipulate with the 'deplloyments' entity when we want only change pre/post behavior | 08:37 |
| *** mhenkel_ has joined #tripleo | 08:37 | |
| *** mhenkel_ has left #tripleo | 08:37 | |
| *** mhenkel_ has joined #tripleo | 08:37 | |
| bogdando | why those cannot be separated in playbooks? | 08:38 |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade master: Pass stack's name with variable overcloud_stack_name https://review.openstack.org/574646 | 08:38 |
| shardy | bogdando: I think those are the heat deployments that get run via an ansible->heat-config shim? | 08:38 |
| shardy | IMHO we should move away from those then yes we could have playbooks | 08:38 |
| shardy | but right now it's difficult because that stuff is generated from heat | 08:39 |
| mhenkel_ | Hi all. I just updated my osp13-beta setup and it looks like the internal_vip address is not assigned to the interface anymore. Mysql cannot start due to this. I that a known issue? | 08:39 |
| shardy | mhenkel_: not a known issue AFAIK but if you can provide more details we can try to help | 08:39 |
| mhenkel_ | shardy: I'm just bringing the environment back to the faulty state and will ping then with more information | 08:40 |
| bogdando | shardy, jistr: we really need to linearize the graph and inlcude tasks the less opaque way IMO... that's impossible to follow as is | 08:41 |
| bogdando | slagle: ^^ | 08:41 |
| *** owalsh_ has joined #tripleo | 08:41 | |
| bogdando | I just give up reviewing changes to deploy steps :) | 08:41 |
| bogdando | pre_upgrade -> pre_update -> pre_deploy -> .... post_* -> post_* , or something easy to see in code | 08:42 |
| shardy | bogdando: the deploy steps themself are very simple, but yes I agree that stuff to bridge ansible to heat-config isn't ideal | 08:42 |
| bogdando | and to not break so easy | 08:42 |
| shardy | it's just significant work to move away from it | 08:43 |
| *** owalsh has quit IRC | 08:44 | |
| jistr | bogdando: i think we now diverged the dicsussion into several topics though? One is clarity in the config-download mechanisms, and the other is whether we should or shouldn't reuse the deployment "workflow" as part of the upgrade. | 08:46 |
| jistr | i don't think those are affecting each other much necessarily | 08:46 |
| bogdando | I'd like to emphasize on the final goal instead, lower entry barrier for those reviewing code in deploy steps | 08:47 |
| bogdando | less implicit and coupled things reused for different cases | 08:48 |
| bogdando | more playbooks to invoke explicitley in a linear fashin, allowing parallelization w/o breaking implicit/copled thinbgs | 08:48 |
| bogdando | whatever is needed to be done in order to achieve this goal | 08:49 |
| bogdando | and basically reviewing == developing ... | 08:49 |
| bogdando | and maintaining, yo know all of that | 08:49 |
| jistr | bogdando: FWIW that's precisely what we do for major upgrade. We re-run the deployment playbook exactly the same way as on normal deploy. Multiple linearly executed playbooks, as you say. | 08:49 |
| bogdando | jistr: why this is not clear from the patch code?.. I just do not get it, sorry | 08:50 |
| jistr | bogdando: for minor updates this is unfortunately more difficult. We need to execute everything with `serial: 1` | 08:50 |
| jistr | update_tasks on node A, then deploy tasks on node A, then update on B, then deploy on B, and so on... | 08:50 |
| jistr | this means we cannot make update and deploy 2 different playbooks | 08:50 |
| jistr | we need to pull in the tasks directly | 08:51 |
| bogdando | note, reusing bits is absolutely fine, just concerned the way we invoke them | 08:51 |
| *** moguimar has quit IRC | 08:51 | |
| jistr | (unless we emulating `serial: 1` on client level rather than on Ansible level) | 08:51 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [DNM][WIP] Add fs050 job to test from-release-upgrades https://review.openstack.org/574656 | 08:51 |
| jistr | *we start emulating | 08:51 |
| jistr | bogdando: https://github.com/openstack/python-tripleoclient/blob/74abcc35595d92c39c18d3008ac8df043eff16b6/tripleoclient/constants.py#L53-L55 | 08:52 |
| jistr | bogdando: the minor update part is a bug https://github.com/openstack/python-tripleoclient/blob/74abcc35595d92c39c18d3008ac8df043eff16b6/tripleoclient/constants.py#L50-L51 | 08:52 |
| jistr | i have a fix here https://review.openstack.org/#/c/574230/1 | 08:52 |
| jistr | will un-WIP it shortly as it appears to have worked fine | 08:52 |
| jistr | just going through the CI logs | 08:52 |
| bogdando | jistr: I'm not saying let's dup tasks and split for upgrades vs deploy, instead I'm saying let's please invoke them as a separated plays | 08:53 |
| bogdando | in deploy steps | 08:53 |
| bogdando | with explicit serial:1 when it is needed to be ran the same things serialized | 08:54 |
| jistr | bogdando: we don't run serial: 1 for upgrades | 08:54 |
| *** gfidente has joined #tripleo | 08:54 | |
| *** gfidente has quit IRC | 08:54 | |
| *** gfidente has joined #tripleo | 08:54 | |
| bogdando | it's not about upgrades, or something but the way we call playbooks | 08:54 |
| bogdando | please do not merge separate cases, like it seems it is done here https://review.openstack.org/#/c/574474/2/common/deploy-steps.j2@450 | 08:55 |
| bogdando | it's really hard to maintain and code review, like I illustrated with my +2 :) | 08:55 |
| jistr | bogdando: here's how we pull it in for updates with `serial: 1` currently https://github.com/openstack/tripleo-heat-templates/blob/master/common/deploy-steps.j2#L581-L588 | 08:55 |
| jistr | it might have to change with config-download, we didn't get to investigate that yet | 08:56 |
| jistr | bogdando: i'm not sure what you mean by "merge separate cases"? | 08:56 |
| bogdando | jistr: - include: {{role.name}}/deployments.yaml is merged with upgrades | 08:57 |
| bogdando | as we change it for pre/post tasks changes, upgrades now failing | 08:57 |
| bogdando | if split into separate ansible plays, it wouldn't | 08:57 |
| bogdando | IIUC | 08:58 |
| *** ffiore has joined #tripleo | 08:58 | |
| *** Petersingh|lunch is now known as Petersingh | 08:58 | |
| bogdando | so there should have been a few includes instead | 08:59 |
| bogdando | one for upgrade case, one for deploys, or even more | 08:59 |
| *** salmankhan has joined #tripleo | 08:59 | |
| bogdando | while still sharing the same roles/tasks whatever | 09:00 |
| bogdando | jistr, shardy: I hope I understand it right :) | 09:00 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Uses new format for CephX keys caps https://review.openstack.org/574664 | 09:01 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [DNM][WIP] Add fs050 job to test from-release-upgrades https://review.openstack.org/574665 | 09:01 |
| jistr | bogdando: well i think the way we've been designing the upgrades/updates is based on slightly different understanding. We made deployment a subset of upgrades. Whenever we make a change to deployment, it will always have the potential to affect/break updates and upgrades. It makes things DRY, consistent, predictable. As reviewers we should be aware that changes to deployment affect updates/upgrades too, at | 09:03 |
| jistr | least that's my 2 cents. | 09:03 |
| shardy | jistr: +1 | 09:05 |
| bogdando | jistr, shardy, slagle: the code with linearized unmerged cases might look like https://pastebin.com/R5FmyUKC or something | 09:06 |
| bogdando | and the same approach for everything | 09:06 |
| bogdando | whatever it is roles based vs generic, updates vs upgrades vs deployments | 09:06 |
| bogdando | just split it into explicit plays | 09:06 |
| bogdando | jistr: this example way, you can introduce changes into deployments w/o affecting anything else | 09:08 |
| bogdando | unless you changed the tasks being included | 09:08 |
| bogdando | and not the way those *invoked* | 09:08 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-heat-templates stable/queens: [DNM] To test fs050 from-release-upgrades job https://review.openstack.org/574671 | 09:09 |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] | 09:10 |
| *** ffiore has quit IRC | 09:10 | |
| *** dbecker has quit IRC | 09:11 | |
| *** dbecker has joined #tripleo | 09:11 | |
| bogdando | jistr: so that's ok to have tasks/roles changes to deployment affect updates/upgrades too. While I disagree any changes to the invocation methods of those should impact all the cases - deployments and upgrades/updates | 09:13 |
| openstackgerrit | yolanda.robla proposed openstack/tripleo-docs master: Add Fast Forward Upgrade docs https://review.openstack.org/549892 | 09:14 |
| mhenkel_ | shardy: here is a full description of the environment: http://paste.openstack.org/show/723281/ | 09:14 |
| *** ffiore has joined #tripleo | 09:15 | |
| mhenkel_ | the stack creation is currently at step 2 but there is the internal_api_vip address is not assigned to the internal_api nic | 09:15 |
| jistr | bogdando: so far we've designed for not just the tasks being the same, but also the invocation methods being the same when possible. (It's possible for upgrades, not so much for updates.) Why would you want to split the invocation method between deployment and upgrade? I think we'd want them the same -- why repeat something if we can reuse it? | 09:15 |
| mhenkel_ | and it will fail eventually in step 3 | 09:15 |
| shardy | mhenkel_: Ok, so to clarify it should be pointing to the VIP for the internal api network on the loadbalancer, and there's a separate internal API address for each node e.g the bind IP for each service | 09:16 |
| bogdando | jistr: > Why would you want to split the invocation method between deployment and upgrade? | 09:16 |
| bogdando | to have the former parralilizable, while another case might want it serial/batched? | 09:16 |
| bogdando | same things, but ran differently | 09:17 |
| shardy | wanted to confirm it's definitely the vip hieradata vs the *_ip | 09:17 |
| bogdando | with an easy to bring changes deploy-steps framework | 09:17 |
| bogdando | and for better vizualization of deployment graph depicting the place upgrade/update things take | 09:17 |
| mhenkel_ | shardy: I just saw that the internal_api vip now got assigned | 09:18 |
| jistr | bogdando: but we don't want it serial/batched for upgrades, we want it the same :) And we do want it serial/batched for updates, and it already is done like you say in the code. | 09:18 |
| shardy | mhenkel_: Ok that's weird as it should be configured before any deploy steps happen | 09:18 |
| mhenkel_ | the difference to the previous attempt is that I didn't set -e tripleo-heat-templates/docker.yaml | 09:18 |
| bogdando | jistr: ok then | 09:18 |
| bogdando | I prolly just do not understand that code | 09:18 |
| mhenkel_ | I will wait for step3 and see if it disappears again | 09:18 |
| shardy | mhenkel_: Ah you shouldn't need to include that or docker-ha in downstream builds IIRC | 09:19 |
| shardy | and including them can cause problems due to ordering of the -e options | 09:19 |
| bogdando | though I can see a simple change into deployments invocation (not the tasks) breaks upgrades as well | 09:19 |
| bogdando | while ideally, it shouldn't | 09:19 |
| bogdando | unless we changed the tasks itself | 09:19 |
| jistr | bogdando: upgrades runs the deployment playbook exactly as it is. Updates doesn't, instead it pulls the deployment tasks into the update playbook, so that we have control over `serial`: https://github.com/openstack/tripleo-heat-templates/blob/a151ed15e8b9ace769c6fcd1d7873275d4bdaa97/common/deploy-steps.j2#L581-L588 | 09:19 |
| mhenkel_ | shardy: I found that in a BZ (https://bugzilla.redhat.com/show_bug.cgi?id=1538015) but previously it worked with -e docker.yaml | 09:20 |
| openstack | bugzilla.redhat.com bug 1538015 in openstack-tripleo-heat-templates "Include docker.yaml and docker-ha.yaml environment files by default" [Urgent,Verified] - Assigned to emacchi | 09:20 |
| jistr | bogdando: https://github.com/openstack/tripleo-heat-templates/blob/a151ed15e8b9ace769c6fcd1d7873275d4bdaa97/common/deploy-steps.j2#L633-L637 | 09:20 |
| bogdando | jistr: sigh, so why it breaks upgrades?.. | 09:20 |
| mhenkel_ | for upstream we still need to include it? | 09:20 |
| jistr | bogdando: http://logs.openstack.org/74/574474/2/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/df3e82c/logs/undercloud/home/zuul/overcloud_upgrade_run_Controller.log.txt.gz | 09:21 |
| bogdando | that https://review.openstack.org/#/c/574474/2/common/deploy-steps.j2@450 guy? | 09:21 |
| jistr | bogdando: as i said earlier, it's just missing some lookup plugin" u'fatal: [centos-7-inap-mtl01-0000048497]: FAILED! => {"failed": true, "msg": "lookup plugin (vars) not found"}', | 09:21 |
| *** nyechiel_ has quit IRC | 09:22 | |
| *** stendulker has joined #tripleo | 09:22 | |
| bogdando | jistr: then why it worked for deployments? :) | 09:22 |
| *** limao has quit IRC | 09:23 | |
| jistr | bogdando: i don't know but it's probably something simple like outdated ansible in the N-1 image or so... | 09:24 |
| *** chem has quit IRC | 09:24 | |
| *** liverpooler has quit IRC | 09:24 | |
| *** chem has joined #tripleo | 09:25 | |
| *** stendulker_ has quit IRC | 09:25 | |
| openstackgerrit | Martin André proposed openstack/tripleo-common master: Add dbus-python to overcloud-full image https://review.openstack.org/574674 | 09:25 |
| mhenkel_ | shardy: it passed step4 now. So including docker.yaml was bad | 09:27 |
| shardy | mhenkel_: Ok, good news | 09:28 |
| shardy | mhenkel_: I think the issue is if you only include docker.yaml, it overrides the docker-ha.yaml pacemaker bits | 09:28 |
| shardy | so including them both would be OK, and just not including either (for downstream builds) is also OK | 09:28 |
| mhenkel_ | yes, looks like. | 09:29 |
| mhenkel_ | I just want to keep the procedure for upstream and downstream as similar as possible | 09:29 |
| openstackgerrit | Rajesh Tailor proposed openstack/tripleo-heat-templates master: Enable secure TUNNELLED mode for NFS https://review.openstack.org/574675 | 09:29 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Update for openshift 3.9 https://review.openstack.org/574233 | 09:31 |
| *** slaweq has joined #tripleo | 09:32 | |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates master: QDR for metrics collection purposes https://review.openstack.org/572312 | 09:32 |
| *** moguimar has joined #tripleo | 09:33 | |
| jistr | bogdando: moving back here from pvt chat just in case others are interested. bogdando found that there are no package updates in yum log on overcloud | 09:33 |
| jistr | http://logs.openstack.org/74/574474/2/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/df3e82c/logs/subnode-2/var/log/yum.log.txt.gz | 09:33 |
| *** akrivoka has joined #tripleo | 09:34 | |
| jistr | so indeed it looks like outdated ansible, and the almost-root cause is that we don't seem to be running package update on major upgrade, even though we should. Root cause could either be non-configured repos, or service list, or something like that. | 09:34 |
| jistr | i can help with this after i address but in minor updates that i'm looking into presently | 09:35 |
| openstackgerrit | Luke Hinds proposed openstack/tripleo-docs master: Fix YAML Example for aide.yaml https://review.openstack.org/574191 | 09:35 |
| jistr | s/but/bug/ | 09:35 |
| openstackgerrit | Martin Mágr proposed openstack/puppet-tripleo master: Add QDR profile for metrics purposes. https://review.openstack.org/571743 | 09:35 |
| *** dtantsur|afk is now known as dtantsur | 09:35 | |
| jistr | bogdando: ^ | 09:36 |
| *** stendulker_ has joined #tripleo | 09:39 | |
| *** stendulker has quit IRC | 09:41 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [DNM][WIP] Add fs050 job to test from-release-upgrades https://review.openstack.org/574665 | 09:42 |
| *** akrivoka has quit IRC | 09:42 | |
| jistr | bogdando, shardy: slightly related to our previous discussion, this cuts down the keystone-only update job update phase from 13 to 9 minutes, reportedly in complex deployments the errorneous re-execution of deploy tasks could have added 40 minutes or so | 09:43 |
| jistr | https://review.openstack.org/#/c/574230/ | 09:43 |
| jistr | social: ^^ that's the patch | 09:43 |
| *** stendulker_ has quit IRC | 09:44 | |
| *** radeks has quit IRC | 09:46 | |
| *** slaweq has quit IRC | 09:47 | |
| *** morazi has quit IRC | 09:50 | |
| *** Petersingh has quit IRC | 09:51 | |
| *** akrivoka has joined #tripleo | 09:52 | |
| *** radeks has joined #tripleo | 09:55 | |
| *** moshele has joined #tripleo | 09:55 | |
| *** akrivoka_ has joined #tripleo | 09:57 | |
| *** akrivoka has quit IRC | 09:58 | |
| *** lifeless has quit IRC | 09:59 | |
| *** lvdombrkr has quit IRC | 10:00 | |
| *** nyechiel_ has joined #tripleo | 10:02 | |
| bogdando | jistr: nice! | 10:02 |
| *** moshele has quit IRC | 10:02 | |
| *** leanderthal has joined #tripleo | 10:06 | |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] | 10:10 |
| *** khyr0n has quit IRC | 10:14 | |
| *** zoli is now known as zoli|lunch | 10:15 | |
| *** salmankhan has quit IRC | 10:15 | |
| *** salmankhan has joined #tripleo | 10:15 | |
| bogdando | jistr: it seems that http://git.openstack.org/cgit/openstack/tripleo-upgrade/tree/templates/overcloud_upgrade_run.sh.j2#n73 is missing yum update ansible before? | 10:16 |
| jistr | bogdando: it should be done during `upgrade prepare` via https://github.com/openstack/tripleo-heat-templates/blob/master/environments/lifecycle/upgrade-prepare.yaml#L18 | 10:19 |
| jistr | bogdando: thanks for looking into this, i might be able to join the effort but not just yet | 10:19 |
| *** slaweq has joined #tripleo | 10:20 | |
| bogdando | interesting why it didn't make it, while it is there... not sure I can help with that bug jistr :) | 10:20 |
| bogdando | just grepped for yum updates around... | 10:20 |
| *** psahoo has quit IRC | 10:20 | |
| *** assassin has quit IRC | 10:21 | |
| jistr | bogdando: ack i'll try to carve out time in the afternoon | 10:22 |
| *** holser__ has quit IRC | 10:23 | |
| openstackgerrit | Daniel Alvarez proposed openstack/tripleo-heat-templates master: Support enabling Debug in OVN metadata agent https://review.openstack.org/574472 | 10:23 |
| *** holser__ has joined #tripleo | 10:24 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [DNM][WIP] Add fs050 job to test from-release-upgrades https://review.openstack.org/574665 | 10:30 |
| *** moshele has joined #tripleo | 10:32 | |
| *** lvdombrkr has joined #tripleo | 10:34 | |
| *** slaweq has quit IRC | 10:34 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-docs master: Add Fast Forward Upgrade docs https://review.openstack.org/549892 | 10:35 |
| *** lvdombrkr89 has joined #tripleo | 10:35 | |
| *** bogdando has quit IRC | 10:37 | |
| *** lvdombrkr has quit IRC | 10:38 | |
| *** psahoo has joined #tripleo | 10:43 | |
| *** ffiore has quit IRC | 10:45 | |
| *** aufi has joined #tripleo | 10:46 | |
| *** ffiore has joined #tripleo | 10:47 | |
| *** quiquell has quit IRC | 10:48 | |
| openstackgerrit | Michele Baldessari proposed openstack/python-tripleoclient master: Fix overcloud delete command https://review.openstack.org/574623 | 10:49 |
| *** mdnadeem has quit IRC | 10:51 | |
| *** pkovar has joined #tripleo | 10:59 | |
| *** gfidente has quit IRC | 11:02 | |
| *** slaweq has joined #tripleo | 11:02 | |
| *** lifeless has joined #tripleo | 11:03 | |
| *** jpena is now known as jpena|lunch | 11:04 | |
| openstackgerrit | Merged openstack/tripleo-common stable/queens: Pass container and queue_name inputs to the list_available_roles workflow https://review.openstack.org/574214 | 11:06 |
| openstackgerrit | Merged openstack/tripleo-common master: Remove the output from the heat.stacks_get action result https://review.openstack.org/572396 | 11:06 |
| openstackgerrit | Merged openstack/tripleo-common master: Use the standard messaging in the swift_rings_backup workbook https://review.openstack.org/572343 | 11:06 |
| openstackgerrit | Merged openstack/tripleo-common master: Use the standard messaging in the validations workbook https://review.openstack.org/572340 | 11:06 |
| *** slaweq has quit IRC | 11:06 | |
| *** ffiore has quit IRC | 11:07 | |
| *** waleedm has quit IRC | 11:07 | |
| *** waleedm has joined #tripleo | 11:07 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Add keystone only job for queens https://review.openstack.org/572297 | 11:07 |
| openstackgerrit | Merged openstack/tripleo-common stable/queens: Add keystone only job for queens https://review.openstack.org/572306 | 11:07 |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade master: Add split-stack environment support. https://review.openstack.org/572778 | 11:09 |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] | 11:10 |
| *** moshele has quit IRC | 11:11 | |
| florianf | d0ugal: Hi! I ran into something strange with zaqar/mistral and am wondering if I'm very dumb or if this in fact sounds familiar to a professional :) Do you have a minute? | 11:12 |
| *** lifeless has quit IRC | 11:13 | |
| *** lifeless has joined #tripleo | 11:13 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: Add ability to upgrade FROM change under test https://review.openstack.org/572419 | 11:14 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: Add logic/tests for n->n+1 upgrades https://review.openstack.org/572420 | 11:14 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [DNM][WIP] Add fs050 job to test from-release-upgrades https://review.openstack.org/574665 | 11:14 |
| *** slaweq has joined #tripleo | 11:14 | |
| d0ugal | florianf: I have about 5 minutes - then I need to go out for ~20 mins. Then I'll have many minutes! | 11:15 |
| *** slaweq has quit IRC | 11:16 | |
| florianf | d0ugal: OK, maybe <=5 is enough! What I'm seeing is this: I'm getting a zaqar msg for a workflow execution that shows the execution in status "SUCCESS". I then immediately use the execution ID from the zaqar message to call the execution via the mistral client. Which strangely shows the execution in status "running". If I delay the second call by a second, it shows the execution with status "SUCCESS" | 11:17 |
| d0ugal | florianf: Which workflow? | 11:18 |
| florianf | in my case it's a validation run | 11:18 |
| florianf | d0ugal: ^ | 11:18 |
| d0ugal | florianf: right, so you are essentially hitting a race condition | 11:18 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [DNM][WIP] Add fs050 job to test from-release-upgrades https://review.openstack.org/574665 | 11:18 |
| florianf | d0ugal: yep. looks like it | 11:19 |
| d0ugal | florianf: well, kind-of a race condition | 11:19 |
| d0ugal | florianf: really the confusion is that we have two different statuses. | 11:19 |
| florianf | d0ugal: Is it possible that zaqar sends out success before the execution record has been updated? | 11:19 |
| d0ugal | florianf: there is the status that the workflow itself manages, and these are hard-coded: https://github.com/openstack/tripleo-common/blob/master/workbooks/validations.yaml#L37 | 11:19 |
| d0ugal | florianf: so when that SUCCESS is sent, the workflow is still running. Sending the message is part of the workflow. | 11:20 |
| d0ugal | florianf: then there is a different execution status that Mistral manages | 11:20 |
| florianf | d0ugal: Oh! | 11:20 |
| d0ugal | Mistral will run the last task, then there will be a short delay before it marks the execution as completed | 11:21 |
| florianf | d0ugal: I feel enlightened! Thanks! | 11:21 |
| d0ugal | florianf: so... tl;dr - the zaqar status != the execution status. | 11:21 |
| d0ugal | np | 11:21 |
| florianf | d0ugal: So I guess I'll solve it with a depressingly dumb delay in my code execution, I guess. | 11:21 |
| florianf | :-) | 11:21 |
| d0ugal | but the statuses should match up, eventually :) | 11:22 |
| d0ugal | florianf: yeah, I guess so - sorry! | 11:22 |
| d0ugal | florianf: Why do you need to fetch the execution anyway? | 11:22 |
| florianf | d0ugal: to get the full output | 11:22 |
| d0ugal | florianf: Shouldn't we just include all the information you need in the zaqar message? | 11:22 |
| d0ugal | or maybe it is huge? | 11:22 |
| florianf | d0ugal: I think for parameters the zaqar message shows the new status, but not the full output | 11:22 |
| florianf | d0ugal: exactly | 11:22 |
| d0ugal | Right | 11:22 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [DNM][WIP] Add fs050 job to test from-release-upgrades https://review.openstack.org/574665 | 11:23 |
| *** artom has joined #tripleo | 11:23 | |
| d0ugal | florianf: so yeah, a short delay and then a re-fetch based on the execution status is probably best | 11:23 |
| florianf | d0ugal: Cool, thanks for the help! Enjoy your lunch! :) | 11:23 |
| d0ugal | florianf: if you really want it to be faster we could probably figure something out - you could get the output from the mistral task - but we would need to add the task ID to the zaqar message. | 11:23 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-heat-templates stable/queens: [DNM] To test fs050 from-release-upgrades job https://review.openstack.org/574671 | 11:23 |
| d0ugal | florianf: I need more than 20 mins for lunch ;) this is just a chore! | 11:24 |
| florianf | d0ugal: oh right. well then... good luck...? :-) | 11:24 |
| d0ugal | :) | 11:24 |
| *** ansmith has quit IRC | 11:25 | |
| *** bfournie has quit IRC | 11:30 | |
| *** quiquell has joined #tripleo | 11:31 | |
| *** quiquell is now known as quiquell|lunch | 11:31 | |
| *** zoli|lunch is now known as zoli | 11:32 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: [DellEMC]Update Manila VNX driver https://review.openstack.org/566384 | 11:33 |
| *** pradk has joined #tripleo | 11:34 | |
| *** quiquell|lunch has quit IRC | 11:36 | |
| *** abishop has joined #tripleo | 11:38 | |
| *** cylopez1 has joined #tripleo | 11:39 | |
| *** gfidente has joined #tripleo | 11:39 | |
| *** gfidente has quit IRC | 11:39 | |
| *** gfidente has joined #tripleo | 11:39 | |
| *** cylopez has quit IRC | 11:40 | |
| *** cylopez1 has quit IRC | 11:40 | |
| *** cylopez has joined #tripleo | 11:42 | |
| *** cylopez has joined #tripleo | 11:43 | |
| *** cylopez has left #tripleo | 11:43 | |
| *** amoralej is now known as amoralej|lunch | 11:48 | |
| bandini | jaosorior: https://review.openstack.org/574264 and https://review.openstack.org/574263 the backports about that config restart thing, if you have some time | 11:48 |
| *** rh-jelabarre has joined #tripleo | 11:49 | |
| *** rh-jelabarre has quit IRC | 11:50 | |
| openstackgerrit | Rajesh Tailor proposed openstack/tripleo-heat-templates master: Enable secure TUNNELLED mode for NFS https://review.openstack.org/574675 | 11:51 |
| *** raildo has joined #tripleo | 11:54 | |
| openstackgerrit | Rajesh Tailor proposed openstack/tripleo-heat-templates master: Enable secure TUNNELLED mode for NFS https://review.openstack.org/574675 | 11:54 |
| openstackgerrit | Merged openstack/instack-undercloud stable/queens: Fix duplicate entries in /etc/sysconfig/iptables https://review.openstack.org/571222 | 11:54 |
| openstackgerrit | Merged openstack/instack-undercloud stable/ocata: Stop creating duplicate cell_v2 cells in N->O upgrade https://review.openstack.org/570081 | 11:54 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Use /usr/bin/env python to autodetect python https://review.openstack.org/572068 | 11:54 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Reset Cinder RPC versions after upgrade https://review.openstack.org/572112 | 11:54 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/queens: Neutron sidecar wrappers use netns they were invoked with https://review.openstack.org/571484 | 11:54 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Fix version checking https://review.openstack.org/574270 | 11:54 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Match Net:SoftwareConfig resource in scenario000 to other scenarios https://review.openstack.org/559152 | 11:54 |
| *** shreshtha has quit IRC | 11:55 | |
| *** ffiore has joined #tripleo | 11:56 | |
| *** liverpooler has joined #tripleo | 11:57 | |
| *** jpena|lunch is now known as jpena | 11:58 | |
| *** lblanchard has joined #tripleo | 12:00 | |
| *** morazi has joined #tripleo | 12:00 | |
| *** moshele has joined #tripleo | 12:01 | |
| *** ffiore has quit IRC | 12:01 | |
| *** liverpooler has quit IRC | 12:03 | |
| *** edmondsw has joined #tripleo | 12:03 | |
| *** liverpooler has joined #tripleo | 12:03 | |
| *** moshele has quit IRC | 12:07 | |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] | 12:10 |
| *** bfournie has joined #tripleo | 12:12 | |
| *** rlandy has joined #tripleo | 12:12 | |
| *** rlandy is now known as rlandy|rover | 12:12 | |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-common master: Add health checks for Swift services https://review.openstack.org/559737 | 12:18 |
| *** ratailor has quit IRC | 12:19 | |
| *** salmankhan has quit IRC | 12:21 | |
| *** ykarel_ has joined #tripleo | 12:21 | |
| *** trown|outtypewww is now known as trown | 12:21 | |
| fultonj | would someone mind reviewing https://review.openstack.org/#/c/567782 ? | 12:22 |
| *** aufi has quit IRC | 12:23 | |
| fultonj | jistr d0ugal rbrady ^ ? :) | 12:23 |
| openstackgerrit | Alan Bishop proposed openstack/puppet-tripleo stable/queens: Add NFS backend for cinder-backup service https://review.openstack.org/574707 | 12:23 |
| *** ykarel has quit IRC | 12:24 | |
| openstackgerrit | Alan Bishop proposed openstack/tripleo-heat-templates stable/queens: Add nfs as a cinder backup driver option to CinderBackupBackend https://review.openstack.org/574708 | 12:24 |
| *** waleedm has quit IRC | 12:26 | |
| *** ykarel_ is now known as ykarel | 12:26 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Use UpgradeInitCommonCommand with deployed-server too https://review.openstack.org/574709 | 12:27 |
| d0ugal | fultonj: looking. | 12:28 |
| fultonj | d0ugal: thank you | 12:28 |
| arxcruz|ruck | mwhahaha: EmilienM ykarel FYI the queue is too large, perhaps it's time to kill some... | 12:29 |
| *** tzumainn has joined #tripleo | 12:29 | |
| openstackgerrit | Merged openstack/puppet-tripleo stable/ocata: Add missing nfs_mount_options for Cinder Netapp backend https://review.openstack.org/572372 | 12:29 |
| mwhahaha | arxcruz|ruck: what's failing? | 12:29 |
| arxcruz|ruck | mwhahaha: nothing is failing at the moment, but it's 27+ hours | 12:30 |
| mwhahaha | arxcruz|ruck are you refering to the rdo queue? | 12:30 |
| arxcruz|ruck | mwhahaha: yes | 12:30 |
| mwhahaha | arxcruz|ruck: i see the upstream queue is at 16 hours which indicates failing stuff in the gate | 12:30 |
| mwhahaha | arxcruz|ruck: we can't kill the rdo queue stuff, why is it so backed up? is there perf problems in rdo cloud? | 12:31 |
| arxcruz|ruck | mwhahaha: we had some failures yesterday on master periodic job, not sure if affect, also on queens | 12:31 |
| ykarel | mwhahaha, arxcruz|ruck yesterday there was outage in rdo-cloud for around 14 hours, which resulted in large queues | 12:32 |
| ykarel | and it's still recovering | 12:32 |
| ykarel | also promotion jobs are on priority, so other jobs enqueus | 12:32 |
| arxcruz|ruck | ykarel: oh yeah, forgot about that, you reported it on cix | 12:32 |
| ykarel | yes | 12:32 |
| d0ugal | fultonj: any chance of some tests? :) | 12:33 |
| mwhahaha | if it's not decreasing it might be a good idea to purge the queue | 12:33 |
| fultonj | d0ugal: sure, i can do that | 12:34 |
| fultonj | d0ugal: you want mock tests for all new python functions? | 12:34 |
| fultonj | e.g. extract_tarball | 12:35 |
| d0ugal | fultonj: yeah, that'd be good. I'll comment on the review. | 12:35 |
| fultonj | d0ugal: ok, thanks | 12:35 |
| *** leanderthal has quit IRC | 12:35 | |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Update for openshift 3.9 https://review.openstack.org/574233 | 12:35 |
| *** salmankhan has joined #tripleo | 12:37 | |
| sshnaidm | weshay, can you +2 please? https://review.openstack.org/#/c/572798/ | 12:38 |
| *** leanderthal has joined #tripleo | 12:41 | |
| *** ansmith has joined #tripleo | 12:43 | |
| openstackgerrit | Merged openstack/python-tripleoclient master: Don't use deprecated exception.message in tripleo_deploy https://review.openstack.org/573690 | 12:44 |
| fultonj | jistr: thanks for the review, i will revise | 12:51 |
| *** mcornea has joined #tripleo | 12:53 | |
| slagle | jistr: for https://review.openstack.org/#/c/574709/, the patch looks ok, but I wonder if it fixes the issue. it's ansible on the undercloud that would need to get updated so that lookup('vars') works, ansible version on the overcloud nodes shouldn't matter | 12:53 |
| *** raildo has quit IRC | 12:53 | |
| *** raildo has joined #tripleo | 12:55 | |
| *** pradk has quit IRC | 12:55 | |
| jistr | fultonj: thanks | 12:55 |
| jistr | slagle: hm right, we used to execute some things from the overcloud but that's no longer the case with config-download, right? | 12:58 |
| slagle | jistr: right | 12:58 |
| jistr | interesting | 12:58 |
| *** quiquell has joined #tripleo | 12:58 | |
| *** akrivoka_ has quit IRC | 12:59 | |
| slagle | jistr: ansible-2.4 is still on the undercloud | 12:59 |
| shardy | unless the ansible->heat-config hook is running heat-config-ansible ... | 12:59 |
| shardy | did we miss disabling anything perhaps? | 12:59 |
| jistr | slagle: and we need newer or is that ok? | 12:59 |
| * jistr looks at other logs | 12:59 | |
| slagle | let me double check | 13:00 |
| *** tcw has quit IRC | 13:00 | |
| *** pcaruana has quit IRC | 13:00 | |
| jistr | containers-multinode has ansible-2.5.2 | 13:00 |
| slagle | yea i'm pretty sure we need 2.5 | 13:01 |
| slagle | the undercloud should be updated to latest before starting the upgrade shouldn't it? | 13:01 |
| *** amoralej|lunch is now known as amoralej | 13:02 | |
| openstackgerrit | Martin André proposed openstack/tripleo-common master: Write to /etc/ssh with super user privileges https://review.openstack.org/574721 | 13:02 |
| *** tcw has joined #tripleo | 13:03 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [DNM][WIP] Add fs050 job to test from-release-upgrades https://review.openstack.org/574665 | 13:05 |
| *** ansmith has quit IRC | 13:05 | |
| jistr | slagle: it should be on latest before starting the deploy. In the mixed upgrade job there's no undercloud upgrade. But not sure how come we end up on older undercloud packages than a regular deploy job. | 13:06 |
| jistr | looking at | 13:06 |
| jistr | https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/master.yml | 13:06 |
| jistr | vs | 13:06 |
| jistr | https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/master-undercloud-queens-overcloud.yml | 13:06 |
| jistr | i wonder if it has something to do with "devmode: true" | 13:07 |
| jistr | that's always been somewhat mysterious variable for me :D | 13:07 |
| slagle | yea maybe it's different from cimode :) | 13:07 |
| jistr | slagle: right, in which case it's a bit suspicious that it runs in CI :) | 13:08 |
| *** ffiore has joined #tripleo | 13:08 | |
| jistr | sshnaidm, trown, panda: can you help maybe? ^^ | 13:08 |
| *** whooligan has joined #tripleo | 13:09 | |
| jistr | TLDR: with master-undercloud-queens-overcloud.yml we get older *undercloud* packages than in master.yml. That's not the intention, ideally in both of those releases the undercloud would be the same, only overcloud should differ. | 13:09 |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] | 13:10 |
| *** slaweq has joined #tripleo | 13:10 | |
| slagle | shardy: yea that's true, in that case ansible on the managed node would get used. but it's not the case for this particular patch we're looking at :) | 13:10 |
| slagle | https://review.openstack.org/574474 fyi | 13:11 |
| *** whooligan has quit IRC | 13:11 | |
| weshay | sshnaidm, done | 13:11 |
| openstackgerrit | Merged openstack/python-tripleoclient master: tripleo deploy accept plan environment https://review.openstack.org/573691 | 13:13 |
| *** slaweq_ has joined #tripleo | 13:13 | |
| *** skramaja has quit IRC | 13:13 | |
| *** psahoo has quit IRC | 13:13 | |
| slagle | shardy: related...i'd like to figure out how to do a similar thing for parallelization for host_prep_tasks, but that will be a bit more involved as the tasks file itself for host_prep_tasks is different per role | 13:13 |
| *** whooligan has joined #tripleo | 13:13 | |
| beagles | I have a question about what happens with containers and container images in updates in queens, who's a good one to talk to about that? | 13:15 |
| *** psachin has quit IRC | 13:15 | |
| beagles | well actually questions :) | 13:15 |
| jistr | slagle: also this one could be it -- it's also different between the release files https://github.com/openstack/tripleo-quickstart/blob/ed89f066a5840409c96aad29ba1315010705e321/roles/common/defaults/main.yml#L24-L27 | 13:15 |
| beagles | bandini: are you one of those guys ^ ;) | 13:15 |
| *** slaweq has quit IRC | 13:16 | |
| morazi | michchap, I think you had some questions re: oooq-ifying a bit of your recent work. Coudl I suggest you reach out to weshay as a starting point? | 13:16 |
| jistr | slagle, sshnaidm, trown, panda: maybe we have a stale undercloud.qcow2? | 13:16 |
| jistr | oh wait it's multinode, we don't use those images at all | 13:17 |
| weshay | jistr, yup | 13:17 |
| * weshay reads | 13:17 | |
| weshay | jistr, what are you running or are you looking at a particular job? | 13:17 |
| jistr | TLDR: with master-undercloud-queens-overcloud.yml we get older *undercloud* packages than in master.yml. That's not the intention, ideally in both of those releases the undercloud would be the same, only overcloud should differ. | 13:18 |
| jistr | weshay: we're looking at this one https://review.openstack.org/#/c/574474/ | 13:18 |
| jistr | weshay: containers-multinode has newer undercloud (Ansible 2.5 for example) than scenario000-multinode-oooq-container-upgrades (Ansible 2.4) | 13:19 |
| trown | jistr: https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/master-undercloud-queens-overcloud.yml#L86-L89 needs to be updated to master... | 13:19 |
| *** kopecmartin has quit IRC | 13:19 | |
| jistr | trown: ouch! thanks :) | 13:19 |
| jistr | trown++ | 13:19 |
| *** akrivoka has joined #tripleo | 13:19 | |
| trown | jistr: very soon we will not need these double release files... at least there is that :P | 13:19 |
| openstackgerrit | Daniel Alvarez proposed openstack/tripleo-heat-templates master: Generate and mount wrappers for haproxy in OVN metadata agent https://review.openstack.org/571130 | 13:20 |
| jistr | trown: yea nice :) So i'll post a patch to update it to master. /cc slagle | 13:20 |
| jistr | thanks trown | 13:20 |
| *** kopecmartin has joined #tripleo | 13:20 | |
| *** ansmith has joined #tripleo | 13:21 | |
| bandini | beagles: sort of :) (in a call right now, will take a bit) | 13:21 |
| *** psahoo has joined #tripleo | 13:22 | |
| openstackgerrit | Bob Fournier proposed openstack/tripleo-docs master: Document how to use a composable network with Ironic in Overcloud https://review.openstack.org/570437 | 13:24 |
| beagles | bandini: cool ping me when you have a couple of minutes | 13:24 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-quickstart master: Fix deps repo in master-undercloud-queens-overcloud.yml https://review.openstack.org/574724 | 13:24 |
| *** artom has quit IRC | 13:24 | |
| jistr | trown slagle ^ copied from master.yml | 13:24 |
| *** mdnadeem has joined #tripleo | 13:28 | |
| *** Goneri has joined #tripleo | 13:29 | |
| openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-heat-templates stable/pike: Refactor get-occ-config.sh https://review.openstack.org/574727 | 13:29 |
| openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-heat-templates stable/pike: get-occ-config.sh: fix handling multiple nodes in a role https://review.openstack.org/574728 | 13:29 |
| openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-heat-templates stable/pike: Introduce wait_backoff, fail_if_empty wrappers https://review.openstack.org/574729 | 13:29 |
| openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-heat-templates stable/pike: Fix fail_if_empty invocation with pipes https://review.openstack.org/574730 | 13:29 |
| mhenkel_ | quick question: is there a more elegant way to deal with different NIC layouts besides using one role per layout? | 13:30 |
| michchap | weshay: we're doing some work on a new ml2 driver that employs ansible-networking to set vlans on switchports. We're using this to do segmented baremetal tenant networking in the overcloud. Right now, our dev environment is pretty customized, with a vagrant vm running a switch appliance (juniper) and the undercloud + overcloud using that switch as their provisioning network. They're connected using UDP tunnels to act kind of like | 13:32 |
| michchap | patches. I was hoping to defer this for a while, but most of the team learnt tripleo via quickstart instead of the bespoke tooling, so I might need to move things into oooq earlier than I had expected. | 13:32 |
| gfidente | jistr your comment https://review.openstack.org/#/c/567782/7/tripleo_common/actions/files.py, I am not sure I get why you suggest a generic name? | 13:32 |
| openstackgerrit | Adriano Petrich proposed openstack/tripleo-quickstart-extras master: Fix iteritems for dictionary https://review.openstack.org/574731 | 13:32 |
| michchap | weshay: I did a little work ages ago that modified libvirt networking to support ovs, and had trouble with review because there's not too many people familiar with that piece. I'm hoping to find someone I can work with to get support for the above going in a sensible way, since it's going to be more difficult. | 13:33 |
| gfidente | jistr ah to keep the action generic | 13:33 |
| gfidente | jistr right | 13:33 |
| jistr | gfidente: yup | 13:33 |
| *** salmankhan has quit IRC | 13:36 | |
| *** ansmith has quit IRC | 13:36 | |
| *** aufi has joined #tripleo | 13:37 | |
| *** salmankhan has joined #tripleo | 13:38 | |
| *** bogdando has joined #tripleo | 13:41 | |
| EmilienM | mwhahaha, arxcruz|ruck : do we have any patch that needs to be merged *now* to help the gate? If not, no need to reset the gate, but rather find out why it's unstable | 13:41 |
| *** leanderthal has quit IRC | 13:42 | |
| EmilienM | note that I come back from pto and haven't followed everything so I probably missed something | 13:42 |
| mwhahaha | i'm not aware of any consistent failures | 13:42 |
| arxcruz|ruck | EmilienM: not that i'm aware :) | 13:42 |
| mwhahaha | i saw some infra timeouts yesterday, not sure if consistent | 13:42 |
| EmilienM | I'm seeing some networking issues as well | 13:43 |
| openstackgerrit | Martin André proposed openstack/tripleo-common master: Write to /etc/ssh with super user privileges https://review.openstack.org/574721 | 13:43 |
| EmilienM | like subnode unreachable during deployment | 13:43 |
| *** atoth has joined #tripleo | 13:43 | |
| *** pcaruana has joined #tripleo | 13:46 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Fix for the manila backend configuration errors https://review.openstack.org/570958 | 13:47 |
| openstackgerrit | Merged openstack/tripleo-upgrade master: Add log artifacts for upgrade steps https://review.openstack.org/544696 | 13:47 |
| openstackgerrit | Merged openstack/tripleo-upgrade master: Move scenario000-multinode-oooq-container-upgrades to check https://review.openstack.org/573457 | 13:47 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: tqe is running tripleo-multinode-container-full, not minimal https://review.openstack.org/573844 | 13:47 |
| openstackgerrit | Damien Ciabrini proposed openstack/puppet-tripleo master: HA overcloud: wait for db before running grant commands https://review.openstack.org/574732 | 13:48 |
| *** bogdando has quit IRC | 13:48 | |
| slagle | jtomasek: any status updates in regards to config-download and the ui? | 13:49 |
| jtomasek | slagle: yes, do you have a link to etherpad handy please? | 13:50 |
| *** kopecmartin has quit IRC | 13:50 | |
| slagle | BOOM https://etherpad.openstack.org/p/tripleo-config-download-squad-status | 13:50 |
| weshay | michchap, ok.. makes sense. So figuring out how to get it working w/ libvirt is one thing, however ideally we start w/ nodepool nodes first | 13:50 |
| weshay | and how to see your work running upstream | 13:51 |
| *** shreshtha has joined #tripleo | 13:51 | |
| jtomasek | slagle: things are currently blocked on undeploy wotkflow which needs fixes | 13:51 |
| jtomasek | slagle: thanks | 13:51 |
| chem | jistr: hey, do you have a log of what is supposed to be fixed with adding the upgradeinitcommandcommon from https://review.openstack.org/#/c/574709/1/deployed-server/deployed-server.yaml | 13:51 |
| weshay | michchap, I can go ask around and see who from the ci team can help you on this task | 13:51 |
| michchap | weshay: I was going to stay away from trying to get this running in the gate for now. Running on a dedicated box with brand new hardware the deploy can take about 3.5 hours because the virtual switch appliance has to pass the image traffic, and they're slow | 13:51 |
| chem | jistr: wouldn't want to duplicate work here, even if I think I got another error altogether | 13:51 |
| weshay | michchap, one thing that also may help.. is we have a reproducer script that is emulating nodepool nodes on libvirt | 13:52 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade master: Fix docker images validation script https://review.openstack.org/574345 | 13:52 |
| michchap | weshay: I don't have a solution for that right now, some of the emulators are better than others. The juniper one is passing enough to work in 3.5h, the arista one is so slow it won't work at all. | 13:52 |
| weshay | michchap, can you chat for a sec? | 13:52 |
| michchap | weshay: sure | 13:52 |
| weshay | https://bluejeans.com/u/whayutin/ | 13:53 |
| *** leanderthal has joined #tripleo | 13:53 | |
| EmilienM | tripleo meeting in ~7 minutes, feel free to add topics to the agenda: https://etherpad.openstack.org/p/tripleo-meeting-items | 13:53 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade master: Fix docker images validation script https://review.openstack.org/574345 | 13:53 |
| slagle | d0ugal: do you have further feedback on https://review.openstack.org/#/c/566246/ ? i saw your comment that you were going to do some testing | 13:55 |
| chem | weshay: hi, I can't find scenario000 upgrade jobs in http://cistatus.tripleo.org/, am I missing something | 13:55 |
| larsks | Hey folks; I'm trying to figure out why installing onto pre-provisioned hosts with neutron lbaas enabled is not installing the required packages. tripleo::packages::enable_install is true, and the default behavior of puppet-neutron seems to be to install packages. Any thoughts? | 13:55 |
| slagle | larsks: did you check to make sure the package manifest actually installs the needed packages? | 13:56 |
| slagle | larsks: i found several bugs like that when i first developed this | 13:56 |
| *** pradk has joined #tripleo | 13:56 | |
| slagle | *the puppet manifest | 13:57 |
| larsks | slagle: It looks as if it should? https://github.com/openstack/puppet-neutron/blob/master/manifests/agents/lbaas.pp#L88 | 13:57 |
| *** slaweq_ has quit IRC | 13:57 | |
| larsks | (and it sets the package name correctly: https://github.com/openstack/puppet-neutron/blob/master/manifests/params.pp#L73) | 13:57 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [DNM][WIP] Add fs050 job to test from-release-upgrades https://review.openstack.org/574665 | 13:58 |
| slagle | larsks: ok. then i don't know | 13:58 |
| larsks | Yeah, it's a mystery. | 13:58 |
| *** ansmith has joined #tripleo | 13:59 | |
| weshay | chem, ask sshnaidm | 13:59 |
| EmilienM | #startmeeting tripleo | 14:00 |
| openstack | Meeting started Tue Jun 12 14:00:16 2018 UTC and is due to finish in 60 minutes. The chair is EmilienM. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
| *** openstack changes topic to " (Meeting topic: tripleo)" | 14:00 | |
| openstack | The meeting name has been set to 'tripleo' | 14:00 |
| chem | sshnaidm: hi, I can't find scenario000 upgrade jobs in http://cistatus.tripleo.org/, am I missing something | 14:00 |
| EmilienM | #topic agenda | 14:00 |
| chem | weshay: ack | 14:00 |
| *** bogdando has joined #tripleo | 14:00 | |
| *** openstack changes topic to "agenda (Meeting topic: tripleo)" | 14:00 | |
| EmilienM | * Review past action items | 14:00 |
| EmilienM | * One off agenda items | 14:00 |
| EmilienM | * Squad status | 14:00 |
| EmilienM | * Bugs & Blueprints | 14:00 |
| EmilienM | * Projects releases or stable backports | 14:00 |
| EmilienM | * Specs | 14:00 |
| EmilienM | * Open discussion | 14:00 |
| EmilienM | Anyone can use the #link, #action and #info commands, not just the moderatorǃ | 14:00 |
| EmilienM | hello, who is around today? | 14:00 |
| *** aufi has quit IRC | 14:00 | |
| fultonj | o/ | 14:00 |
| chem | o/ | 14:00 |
| jpich | o/ | 14:00 |
| beagles | o/ | 14:00 |
| ccamacho | hi! | 14:00 |
| dpeacock | o/ | 14:00 |
| abishop | o/ | 14:00 |
| bogdando | o/ | 14:01 |
| panda | o | 14:01 |
| jistr | \o/ | 14:01 |
| jtomasek | o/ | 14:01 |
| marios | o/ | 14:01 |
| EmilienM | #topic review past action items | 14:02 |
| *** openstack changes topic to "review past action items (Meeting topic: tripleo)" | 14:02 | |
| weshay | 0/ | 14:02 |
| slagle | hi | 14:02 |
| EmilienM | no actions were recorded, we can move | 14:02 |
| EmilienM | #topic one off agenda items | 14:02 |
| *** openstack changes topic to "one off agenda items (Meeting topic: tripleo)" | 14:02 | |
| myoung | o/ | 14:02 |
| EmilienM | #link https://etherpad.openstack.org/p/tripleo-meeting-items | 14:02 |
| EmilienM | any one-off items we want to discuss this week? | 14:02 |
| *** kopecmartin has joined #tripleo | 14:02 | |
| *** ffiore has quit IRC | 14:03 | |
| EmilienM | myoung: go ahead | 14:03 |
| myoung | EmilienM: it's always the same :) | 14:03 |
| myoung | (myoung) CI Community Meeting starts immediately upon this meeting closing @ https://bluejeans.com/7050859455. All are welcome, ask/discuss anything. Add to agenda (or just join): https://etherpad.openstack.org/p/tripleo-ci-squad-meeting | 14:03 |
| EmilienM | good | 14:04 |
| myoung | The intent is just open office hours for the CI team | 14:04 |
| EmilienM | anything else before squads status? | 14:04 |
| EmilienM | #topic Squad status | 14:04 |
| *** openstack changes topic to "Squad status (Meeting topic: tripleo)" | 14:04 | |
| EmilienM | ci | 14:05 |
| EmilienM | #link https://etherpad.openstack.org/p/tripleo-ci-squad-meeting | 14:05 |
| EmilienM | upgrade | 14:05 |
| EmilienM | #link https://etherpad.openstack.org/p/tripleo-upgrade-squad-status | 14:05 |
| EmilienM | containers | 14:05 |
| EmilienM | #link https://etherpad.openstack.org/p/tripleo-containers-squad-status | 14:05 |
| EmilienM | config-download | 14:05 |
| EmilienM | #link https://etherpad.openstack.org/p/tripleo-config-download-squad-status | 14:05 |
| EmilienM | integration | 14:05 |
| EmilienM | #link https://etherpad.openstack.org/p/tripleo-integration-squad-status | 14:05 |
| EmilienM | ui/cli | 14:05 |
| EmilienM | #link https://etherpad.openstack.org/p/tripleo-ui-cli-squad-status | 14:05 |
| EmilienM | validations | 14:05 |
| EmilienM | #link https://etherpad.openstack.org/p/tripleo-validations-squad-status | 14:05 |
| EmilienM | networking | 14:05 |
| EmilienM | #link https://etherpad.openstack.org/p/tripleo-networking-squad-status | 14:05 |
| EmilienM | workflows | 14:05 |
| EmilienM | #link https://etherpad.openstack.org/p/tripleo-workflows-squad-status | 14:05 |
| EmilienM | security | 14:05 |
| EmilienM | #link https://etherpad.openstack.org/p/tripleo-security-squad | 14:05 |
| EmilienM | if you haven't yet, please take time to update the etherpads | 14:05 |
| EmilienM | anything specific the squads want to announce this week? | 14:05 |
| EmilienM | announce/discuss | 14:05 |
| *** ksambor has joined #tripleo | 14:06 | |
| *** ffiore has joined #tripleo | 14:06 | |
| EmilienM | alright, moving on | 14:06 |
| EmilienM | #topic bugs & blueprints | 14:06 |
| *** openstack changes topic to "bugs & blueprints (Meeting topic: tripleo)" | 14:07 | |
| EmilienM | #link https://launchpad.net/tripleo/+milestone/rocky-3 | 14:07 |
| EmilienM | #link https://storyboard.openstack.org/#!/project_group/76 | 14:07 |
| *** kopecmartin has quit IRC | 14:07 | |
| *** kopecmartin has joined #tripleo | 14:07 | |
| EmilienM | Alex and I moved remaining bugs and blueprints to rocky-3 - please let us know any mistake on the blueprints | 14:07 |
| *** kopecmartin has quit IRC | 14:07 | |
| EmilienM | (I sent individual emails but got only a few replies so...) | 14:07 |
| *** kopecmartin has joined #tripleo | 14:08 | |
| EmilienM | any specific bug we need to discuss this week? anything critical that we should know? | 14:08 |
| EmilienM | (/me still catching up from pto) | 14:09 |
| EmilienM | I see https://bugs.launchpad.net/tripleo/+bug/1776301 in alert | 14:09 |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] | 14:09 |
| EmilienM | without assignment, arxcruz|ruck ^ who is on it? | 14:10 |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| arxcruz|ruck | EmilienM: chandankumar | 14:11 |
| arxcruz|ruck | update the bug | 14:11 |
| EmilienM | ok, please update it | 14:11 |
| EmilienM | moving on | 14:11 |
| EmilienM | #topic projects releases or stable backports | 14:11 |
| *** openstack changes topic to "projects releases or stable backports (Meeting topic: tripleo)" | 14:11 | |
| EmilienM | so we released rocky milestone 2 last week, congrats everyone | 14:11 |
| EmilienM | Rocky milestone 3 is targeted for the Jul 23 - Jul 27 week | 14:11 |
| EmilienM | #link https://releases.openstack.org/rocky/schedule.html | 14:11 |
| EmilienM | which is a bit less than 1.5 month | 14:12 |
| *** artom has joined #tripleo | 14:12 | |
| EmilienM | which would let us a bit more than 1 month of release candidates | 14:12 |
| *** artom has quit IRC | 14:12 | |
| *** artom has joined #tripleo | 14:13 | |
| EmilienM | moving on | 14:13 |
| EmilienM | #topic specs | 14:13 |
| *** openstack changes topic to "specs (Meeting topic: tripleo)" | 14:13 | |
| EmilienM | #link https://review.openstack.org/#/q/project:openstack/tripleo-specs+status:open | 14:13 |
| EmilienM | any spec we would like to discuss? | 14:13 |
| EmilienM | at this point, I would move the spec proposals to Stein | 14:14 |
| EmilienM | #topic open discussion | 14:14 |
| *** openstack changes topic to "open discussion (Meeting topic: tripleo)" | 14:14 | |
| EmilienM | last chance to ask anything or discuss about a topic | 14:14 |
| EmilienM | thanks everyone | 14:15 |
| EmilienM | #endmeeting | 14:15 |
| *** openstack changes topic to "Welcome to Rocky. CI status: GREEN as in Green Day | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest" | 14:15 | |
| openstack | Meeting ended Tue Jun 12 14:15:33 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:15 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/tripleo/2018/tripleo.2018-06-12-14.00.html | 14:15 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tripleo/2018/tripleo.2018-06-12-14.00.txt | 14:15 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/tripleo/2018/tripleo.2018-06-12-14.00.log.html | 14:15 |
| fultonj | thanks EmilienM | 14:15 |
| sshnaidm | chem, checking.. | 14:15 |
| dpeacock | speedrecord meeting eh | 14:16 |
| openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient master: tripleo deploy add test coverage for non default plan https://review.openstack.org/574740 | 14:17 |
| openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient master: Enable relative paths for tripleo deploy roles data https://review.openstack.org/574741 | 14:17 |
| openstackgerrit | Ana Krivokapic proposed openstack/tripleo-common master: Add support for custom validations https://review.openstack.org/569513 | 14:19 |
| *** ccamacho has quit IRC | 14:20 | |
| *** ccamacho has joined #tripleo | 14:20 | |
| *** quiquell is now known as quiquell|off | 14:22 | |
| chem | sshnaidm: thanks | 14:22 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: [DNM] Testing ffu and queens upgrade. https://review.openstack.org/563680 | 14:22 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: [DNM] Testing ffu and queens upgrade. https://review.openstack.org/563680 | 14:22 |
| *** psahoo has quit IRC | 14:23 | |
| *** psahoo has joined #tripleo | 14:25 | |
| *** arxcruz|ruck is now known as arxcruz|brb | 14:25 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-upgrade master: DNM: Testing master upgrade/update. https://review.openstack.org/574742 | 14:27 |
| *** slaweq has joined #tripleo | 14:29 | |
| *** cshastri_ has quit IRC | 14:30 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: DNM: test if container is updated https://review.openstack.org/574744 | 14:31 |
| EmilienM | stevebaker: FYI https://review.openstack.org/574744 | 14:31 |
| *** ramishra has quit IRC | 14:32 | |
| *** rajinir has joined #tripleo | 14:36 | |
| *** slaweq has quit IRC | 14:36 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Revert "Revert "Deploy container-multinode (fs010) with a containerized undercloud"" https://review.openstack.org/560264 | 14:39 |
| *** slaweq has joined #tripleo | 14:45 | |
| *** aufi has joined #tripleo | 14:46 | |
| *** mdnadeem has quit IRC | 14:49 | |
| *** rpioso|afk is now known as rpioso | 14:56 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: WIP enable decoupled plan-samples e.g for OpenShift https://review.openstack.org/574753 | 14:56 |
| shardy | mandre, jtomasek: ^^ is a first pass at what we discussed last week, not yet working but the related tripleoclient patches landed | 14:57 |
| shardy | planning to iterate on it, but feedback welcome! | 14:57 |
| shardy | One open question is how to handle the paths in plan-environment and capabilities-map when they don't live in the root of the plan directory structure | 14:57 |
| *** rfolco has quit IRC | 14:58 | |
| shardy | particularly since atm plan-environment is handled by the client by overwriting the default | 14:58 |
| shardy | unlike e.g the environments | 14:58 |
| *** rfolco has joined #tripleo | 14:58 | |
| *** slaweq has quit IRC | 14:59 | |
| shardy | mwhahaha, EmilienM: ^^ also interested in your feedback - the idea is to make using a non-default plan-environment easier, and also to make better use of the environments list, vs one huge openstack specific default environment-resource-registry-puppet | 15:00 |
| shardy | for the default case nothing should really change except some environment names | 15:01 |
| mwhahaha | pathing makes me sad | 15:01 |
| *** radeks has quit IRC | 15:01 | |
| mwhahaha | i would prefer that make it a requirement that the live in the root | 15:01 |
| shardy | mwhahaha: well we could just look for the path from the root of the plan container if it's not found on the pwd | 15:02 |
| shardy | mwhahaha: Ok, so have multiple plan-environment-foo files in the root of t-h-t? | 15:02 |
| shardy | I as trying to avoid that to keep things tidy, and also to make the options more discoverable for the UI | 15:02 |
| shardy | we could have multiple files with some manifest file though | 15:02 |
| mwhahaha | well it all operates on the container | 15:02 |
| *** trown is now known as trown|lunch | 15:02 | |
| mwhahaha | so it doesn't have to live in the root of THT, but when we process it it has to be in the root | 15:03 |
| shardy | mwhahaha: yeah for plan-environment I think that already happens | 15:03 |
| shardy | it just looks a bit weird when editing it in e.g plan-samples/openshift/ | 15:03 |
| shardy | happy to consider other ideas - the motivation was to streamline the (huge) heat environment for openshift deployed by tripleo, and also to make it possible to have a separate capabilities-map file, as currently there's a bazillion unrelated OpenStack config options we can't easily hide | 15:04 |
| mwhahaha | so it's one of those thigns where user provides -p foo-plan.yaml and it just replaces plan-environment.yaml and we always assume it ends up in the root of the plan container | 15:05 |
| shardy | ideally it'll make things more generally pluggable and useful for generic provisioning things tho | 15:05 |
| mwhahaha | similar to roles/network data | 15:05 |
| shardy | mwhahaha: yeah, I think as posted you could do -p plan-samples/openshift/plan-environment.yaml | 15:05 |
| shardy | and it'll get copied over the default | 15:05 |
| mwhahaha | yea | 15:05 |
| shardy | we may need something similar for capabilities-map tho | 15:05 |
| mwhahaha | and we just need to document that any relative paths are related to the overall container constrcut | 15:06 |
| shardy | Ok that sounds fine to me, will add a README | 15:06 |
| mwhahaha | and not where it lives on a filesystem | 15:06 |
| shardy | thanks for the feedback :) | 15:06 |
| mwhahaha | that's what i was trying to do for the standalone as well | 15:06 |
| mwhahaha | where user provided env files just get dropped in the root because we can't maintain relative pathing | 15:06 |
| shardy | mwhahaha: ack, yeah I was playing with tripleo deploy trying to figure this out and noticed a few things related to alternate plans | 15:06 |
| mwhahaha | and we end up just operating on a single container that has the THT structure | 15:07 |
| mwhahaha | it's not great but i don't want to add a bunch of complexity in for handling that unless there's a really good reason | 15:07 |
| shardy | it'd be cool if you could pick from one of several plan-samples/ reference architectures, which already have the list of needed environments in the plan-environment file | 15:07 |
| shardy | I was thinking that could be a nicer solution to the -e -e -e and environments-dir thing | 15:08 |
| mwhahaha | yea | 15:08 |
| shardy | Ok sounds like it's worth iterating a bit more on this approach, will try some local testing - thanks! :) | 15:08 |
| shardy | mwhahaha: re standalone - I was thinking we should drop the user provided files in a subdirectory, as it's be pretty concievable a user provided name could clobber a default in t-h-t? | 15:09 |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 15:10 |
| mwhahaha | shardy: no it throws an error | 15:10 |
| shardy | in https://review.openstack.org/#/c/448209/ I moved them to <plan>/user-environments and rewrote the paths relative to that | 15:10 |
| shardy | mwhahaha: Ah Ok must have missed that | 15:10 |
| mwhahaha | shardy: also i did that because for containerized undercloud we're copying some files that have to be in the root | 15:10 |
| openstackgerrit | Merged openstack/puppet-pacemaker master: Fix a small race window when setting up pcmk remotes https://review.openstack.org/569565 | 15:10 |
| shardy | mwhahaha: Ok thanks for the info | 15:10 |
| mwhahaha | shardy: https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/tripleo_deploy.py#L443 | 15:11 |
| *** artom has quit IRC | 15:11 | |
| shardy | mwhahaha: ack thanks for the link | 15:11 |
| * jtomasek reads back | 15:12 | |
| bogdando | mwhahaha, shardy: jfyi there is an associated tech debt or bug maybe https://bugs.launchpad.net/tripleo/+bug/1776412 | 15:13 |
| openstack | Launchpad bug 1776412 in tripleo "[Undercloud/Standalone] User env files copied into templates dir w/o paths rewritten for resource registries" [High,Triaged] | 15:13 |
| mwhahaha | yea that's the one i was talking about but i don't think we should fix that | 15:13 |
| mwhahaha | just document it | 15:13 |
| bogdando | we have to rewrite resource registries when flattening down | 15:13 |
| shardy | bogdando: Ok thanks will check it out - FWIW my (stalled) tripleoclient patch did attempt to rewrite the paths | 15:14 |
| *** ccamacho has quit IRC | 15:14 | |
| shardy | so I can revive/refactor that if it's something we want to do | 15:14 |
| *** dxiri has joined #tripleo | 15:14 | |
| bogdando | we already do the same elsewhere, there is path altering and rewriting | 15:14 |
| slagle | jistr: do you think the upgrades failure here is related to the patch? https://review.openstack.org/#/c/569418/ | 15:14 |
| bogdando | I moved it to utils IIRC | 15:14 |
| openstackgerrit | Ryan Brady proposed openstack/python-tripleoclient master: Changes Creation Of overcloudrc File to Call Workflow https://review.openstack.org/545351 | 15:14 |
| *** lvdombrkr89 has quit IRC | 15:15 | |
| bogdando | mwhahaha, shardy: http://git.openstack.org/cgit/openstack/python-tripleoclient/tree/tripleoclient/utils.py#n933 | 15:16 |
| shardy | bogdando: yeah, but my patch also fixes the relative path issue (or tries to) that you mention in the bug | 15:16 |
| shardy | I copy user referenced files into the plan under user-files, then rewrite the paths relative to the environments in user-environments | 15:16 |
| bogdando | oh, would be nice to have it fixed in the utils and shared for undercloud/standalone | 15:16 |
| shardy | sounds like the same thing you describe in the bug | 15:17 |
| bogdando | and overcloud | 15:17 |
| bogdando | btw, wrt leacky abstractions :D | 15:17 |
| mwhahaha | i was looking at the function when i was trying to handle the user env stuff | 15:17 |
| shardy | bogdando: well the overcloud works because we merge the environment in the client, which is what I was trying to stop | 15:17 |
| shardy | https://review.openstack.org/#/c/448209/10/tripleoclient/v1/overcloud_deploy.py | 15:17 |
| *** lvdombrkr has joined #tripleo | 15:17 | |
| mwhahaha | yea i wasn't sure we wanted to continue with that logic for the standalone bits as well | 15:17 |
| shardy | I spent a while figuring it out, and at one point that worked ;) | 15:17 |
| bogdando | shall I rewrite that https://review.openstack.org/#/c/572404/ to utility and abandon my OOP failures? | 15:18 |
| shardy | mwhahaha: yeah it's been a giant pain in tripleoclient so I'd be fine to say we have to pass an explicit user-files dir or something | 15:18 |
| shardy | but for the overcloud that ship has sailed sadly | 15:18 |
| mwhahaha | yea relative paths would only work for --environment-dir or something | 15:19 |
| *** lvdombrkr has quit IRC | 15:19 | |
| shardy | I'll try to revive that patch, but I hit issues before as we ran into the post size limit for heat | 15:19 |
| *** lvdombrkr has joined #tripleo | 15:19 | |
| mwhahaha | if you use -e it just gets put in $location and we just document it | 15:19 |
| shardy | mwhahaha: yeah that would make the mess in tripleoclient *so* much simpler | 15:19 |
| mwhahaha | that's my preference | 15:19 |
| *** gfidente has quit IRC | 15:20 | |
| *** mhenkel_ has quit IRC | 15:21 | |
| bogdando | shardy: we have clients side merging now copied from overcloud to undercloud and standalone, right?.. | 15:21 |
| mwhahaha | no | 15:21 |
| mwhahaha | we didn't copy that into the udnercloud/standalone | 15:21 |
| bogdando | oh ok then | 15:21 |
| *** ykarel is now known as ykarel|away | 15:22 | |
| bogdando | cuz I almost became frightened :D | 15:22 |
| mwhahaha | that's what i was trying to avoid | 15:22 |
| mwhahaha | by just copying the user env stuff to the root of the computed tht | 15:22 |
| openstackgerrit | Merged openstack/puppet-pacemaker master: fix tox python3 overrides https://review.openstack.org/573567 | 15:24 |
| shardy | https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/tripleo_deploy.py#L575 | 15:24 |
| shardy | no we still do the client side merging | 15:24 |
| shardy | any locally referenced files will end up in env_files | 15:24 |
| jistr | slagle: actually probably not, it's just a message for UI purposes, right honza? | 15:24 |
| shardy | and you can't use heat's parameter_merge_strategies because of that | 15:24 |
| shardy | e,g env is already merged so heat can't un-merge it | 15:25 |
| shardy | mwhahaha, bogdando: ^^ | 15:25 |
| shardy | the point of my previous attempt at fixing this was to instead pass a list of enabled environments to heat, then let it merge it | 15:25 |
| shardy | maybe tripleo deploy can be a good place to incubate that since we've not yet released the final interfaces? | 15:25 |
| mwhahaha | :( | 15:25 |
| bogdando | mwhahaha, shardy: though I'm afraid we do still have it processed the client side here http://git.openstack.org/cgit/openstack/python-tripleoclient/tree/tripleoclient/utils.py#n933 and this utility is shared with undercloud deploy | 15:25 |
| jistr | slagle, honza: i removed my -1 | 15:26 |
| weshay | mwhahaha, EmilienM fyi.. zuul/rdo-cloud perf issues are causing check jobs to starve in rdo-cloud, rlandy|rover will be opening an alert bug to track the issue | 15:26 |
| weshay | noting this for folks waiting on feedback from ovb jobs | 15:26 |
| EmilienM | yeah | 15:26 |
| EmilienM | we probably want to go ORANGE | 15:26 |
| *** weshay changes topic to "Welcome to Rocky. CI status: ORANGE, rdo-cloud/zuul issues causing delays in third party | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest" | 15:27 | |
| shardy | mwhahaha: maybe we should add a new --environment-files option to both standalone and overcloud, but switch to the "new" behavior for overcloud only when it's selected | 15:27 |
| EmilienM | weshay: thx | 15:27 |
| shardy | but then communicate that it's going to be the required way in future | 15:27 |
| mwhahaha | that'd be ideal, not sure impact on upgrades tho | 15:28 |
| shardy | I'll try to spend some time on it unless anyone else plans to pick it up | 15:28 |
| *** ksambor has quit IRC | 15:28 | |
| shardy | mwhahaha: yeah we'd need to be careful on upgrade but by that point any user referenced files are already stored in heat | 15:28 |
| shardy | so mostly it'll be careful validation on the client side to ensure no stray get_file: /tmp/foo.sh etc | 15:28 |
| shardy | probably need to change heatclient so it can be forced to resolve files from a specific directory | 15:29 |
| bogdando | shardy, mwhahaha: https://trello.com/c/QDEWQ723/117-leverage-heat-server-sided-user-files-merging | 15:29 |
| *** ksambor has joined #tripleo | 15:30 | |
| bogdando | now we can clone that to standalone as well. See how nice tech debt multiplies itself? :D | 15:30 |
| bogdando | nicely* | 15:30 |
| shardy | meh we just need a common solution, I'm not sure we've really multiplied anything | 15:30 |
| shardy | happy to try and help time permitting | 15:30 |
| *** mcornea has quit IRC | 15:32 | |
| *** mcornea has joined #tripleo | 15:33 | |
| rlandy|rover | weshay: mwhahaha: EmilienM: tracker bug for the RDO Cloud long running jobs ... https://bugs.launchpad.net/tripleo/+bug/1776503 | 15:35 |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 15:35 |
| *** lvdombrkr has quit IRC | 15:35 | |
| *** saneax has quit IRC | 15:36 | |
| jtomasek | shardy: I've added comments into the patch. I'll be back in a few hours in case the discussion continues:) | 15:37 |
| *** jtomasek is now known as jtomasek|bbl | 15:37 | |
| *** vpickard is now known as vpickard_ | 15:38 | |
| shardy | jtomasek|bbl: thanks for the feedback, will respond on the review | 15:40 |
| openstackgerrit | Ade Lee proposed openstack/tripleo-common master: WIP - Add mistral job to rotate passwords https://review.openstack.org/574782 | 15:40 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: added cjeanner blog feed https://review.openstack.org/572739 | 15:42 |
| *** artom has joined #tripleo | 15:43 | |
| *** bogdando has quit IRC | 15:43 | |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: add fs051 to use emit_releases_file.py https://review.openstack.org/574417 | 15:45 |
| *** itlinux has joined #tripleo | 15:48 | |
| *** hamzy has quit IRC | 15:48 | |
| *** aufi has quit IRC | 15:56 | |
| *** ffiore has quit IRC | 15:57 | |
| *** ffiore has joined #tripleo | 15:58 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-common master: Remove container registry param from package_update_plan workflow https://review.openstack.org/571186 | 15:58 |
| openstackgerrit | Marios Andreou proposed openstack/python-tripleoclient master: Remove --container-registry-file parameter from * upgrade clis https://review.openstack.org/570893 | 15:58 |
| *** stendulker has joined #tripleo | 15:59 | |
| *** rodolof has quit IRC | 15:59 | |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO https://review.openstack.org/567224 | 16:00 |
| *** kopecmartin has quit IRC | 16:02 | |
| chandankumar | EmilienM: we need feedback on healthcheck api python-tempestconf https://review.openstack.org/568869 please have a look | 16:02 |
| *** yamahata has quit IRC | 16:03 | |
| *** slaweq has joined #tripleo | 16:05 | |
| weshay | jistr, you around to chat about the scen000 upgrade job? | 16:06 |
| *** csmart has quit IRC | 16:08 | |
| *** wilken[m] has quit IRC | 16:08 | |
| *** bkopilov has quit IRC | 16:09 | |
| *** dparkes has quit IRC | 16:09 | |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 16:10 |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 16:10 |
| openstackgerrit | Raoul Scarazzini proposed openstack/tripleo-ha-utils master: Split heat stack creation in modules https://review.openstack.org/574791 | 16:11 |
| *** shardy has quit IRC | 16:14 | |
| *** zoli is now known as zoli|gone | 16:14 | |
| *** zoli|gone is now known as zoli | 16:15 | |
| *** trown|lunch is now known as trown | 16:15 | |
| *** nyechiel_ has quit IRC | 16:16 | |
| *** avivgt has quit IRC | 16:19 | |
| *** agopi has joined #tripleo | 16:20 | |
| *** bkopilov has joined #tripleo | 16:21 | |
| *** ykarel_ has joined #tripleo | 16:22 | |
| *** pradk has quit IRC | 16:22 | |
| *** ykarel|away has quit IRC | 16:24 | |
| *** shreshtha has quit IRC | 16:24 | |
| *** slaweq has quit IRC | 16:26 | |
| *** yprokule has quit IRC | 16:27 | |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: remove the pike->queens upgrade job https://review.openstack.org/574794 | 16:28 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Use wait_for_connection module instead of local action for reboot wait https://review.openstack.org/572345 | 16:29 |
| openstackgerrit | Merged openstack/tripleo-common master: Don't return image tags during dry_run=True https://review.openstack.org/573062 | 16:29 |
| *** aufi has joined #tripleo | 16:29 | |
| *** yamahata has joined #tripleo | 16:29 | |
| openstackgerrit | Raoul Scarazzini proposed openstack/tripleo-ha-utils master: Split heat stack creation in modules https://review.openstack.org/574791 | 16:32 |
| *** salmankhan has quit IRC | 16:33 | |
| *** csmart has joined #tripleo | 16:34 | |
| *** jpich has quit IRC | 16:35 | |
| *** salmankhan has joined #tripleo | 16:35 | |
| *** suuuper has quit IRC | 16:39 | |
| *** pradk has joined #tripleo | 16:39 | |
| *** dtantsur is now known as dtantsur|afk | 16:41 | |
| *** salmankhan has quit IRC | 16:42 | |
| *** salmankhan has joined #tripleo | 16:46 | |
| *** mhenkel_ has joined #tripleo | 16:46 | |
| *** pdeore has quit IRC | 16:47 | |
| *** psahoo has quit IRC | 16:49 | |
| *** mhenkel_ has quit IRC | 16:50 | |
| *** salmankhan has quit IRC | 16:53 | |
| *** wilken[m] has joined #tripleo | 16:53 | |
| *** radeks has joined #tripleo | 16:54 | |
| *** udesale has quit IRC | 16:55 | |
| *** salmankhan has joined #tripleo | 16:56 | |
| *** ykarel_ is now known as ykarel|away | 16:56 | |
| *** derekh has quit IRC | 17:00 | |
| *** mhenkel_ has joined #tripleo | 17:00 | |
| *** ykarel|away has quit IRC | 17:05 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates stable/queens: Add a way to override base path when file driver is used https://review.openstack.org/574812 | 17:05 |
| *** holser__ has quit IRC | 17:06 | |
| *** khyr0n has joined #tripleo | 17:08 | |
| *** hamzy has joined #tripleo | 17:09 | |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 17:10 |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 17:10 |
| *** ffiore has quit IRC | 17:11 | |
| *** lifeless_ has joined #tripleo | 17:15 | |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-quickstart master: Run Designate tempest test in scenario003 https://review.openstack.org/571321 | 17:15 |
| *** lifeless has quit IRC | 17:16 | |
| *** amoralej is now known as amoralej|off | 17:22 | |
| *** jpena is now known as jpena|off | 17:24 | |
| openstackgerrit | Jill Rouleau proposed openstack/tripleo-heat-templates master: Migrate Octavia to external_deploy_task https://review.openstack.org/559374 | 17:26 |
| *** holser__ has joined #tripleo | 17:34 | |
| *** holser___ has joined #tripleo | 17:36 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: WIP Fix logrotate_crond issues https://review.openstack.org/574835 | 17:37 |
| *** salmankhan has quit IRC | 17:38 | |
| *** holser__ has quit IRC | 17:40 | |
| *** janki has quit IRC | 17:43 | |
| *** pradk has quit IRC | 17:45 | |
| *** akrivoka has quit IRC | 17:45 | |
| *** pradk has joined #tripleo | 17:47 | |
| *** akrivoka has joined #tripleo | 17:48 | |
| *** marios has quit IRC | 17:49 | |
| *** marios has joined #tripleo | 17:49 | |
| weshay | michchap, hey | 17:50 |
| *** stendulker has quit IRC | 17:50 | |
| michchap | weshay: o/ | 17:50 |
| weshay | michchap, want to sync up ? | 17:50 |
| michchap | weshay: sure | 17:51 |
| weshay | https://bluejeans.com/u/whayutin/ | 17:51 |
| larsks | EmilienM: do you have a second for a tripleo + puppet (+ keystone) question? | 17:52 |
| EmilienM | larsks: shoot | 17:53 |
| larsks | I want to enable the keystone openidc federation support (https://github.com/openstack/puppet-keystone/blob/master/manifests/federation/openidc.pp). Is the only way to do this by patching the puppet-tripleo keystone manifest? The openidc stuff relies on concat::fragment to add stanzas to the keystone wsgi configuration. | 17:54 |
| larsks | I was hoping for a less monolithic solution, but it looks like that may be my only choice. Looking for a sanity check. | 17:54 |
| EmilienM | larsks: yes I think the best way to enable it is to create a parameter in THT, EnableKeystoneOpenIdc, transform into hieradata and include the class if true in puppet-tripleo | 17:56 |
| larsks | EmilienM: Darn. :) But thanks for confirming. | 17:56 |
| EmilienM | larsks: then in THT/puppet/service/keystone.yaml, handle hieradata for https://github.com/openstack/puppet-keystone/blob/master/manifests/federation/openidc.pp parameters | 17:56 |
| larsks | Right. | 17:57 |
| EmilienM | larsks: it's not that complex, it can be done in 2 patches (one in puppet-tripleo and one in THT) | 17:57 |
| EmilienM | larsks: let me show you how I would do, give me a sec | 17:57 |
| larsks | Sure, although I think I have an idea... | 17:57 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade master: Set docker environment files during ffu prepare and converge https://review.openstack.org/573850 | 18:01 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Enable OpenIDC for Keystone service https://review.openstack.org/574838 | 18:01 |
| *** radeks has quit IRC | 18:01 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: WIP - Enable OpenIDC for Keystone service https://review.openstack.org/574840 | 18:04 |
| EmilienM | larsks: something like this ^ | 18:04 |
| EmilienM | larsks: feel free to duplicate my patches, I'll abandon them now | 18:04 |
| larsks | EmilienM: like which? | 18:04 |
| larsks | I don't see a link :) | 18:04 |
| EmilienM | https://review.openstack.org/574838 and https://review.openstack.org/574840 | 18:04 |
| larsks | Thanks. | 18:04 |
| EmilienM | larsks: so really no big deal here | 18:05 |
| larsks | EmilienM: why a preference for using hiera(...) in the manifest, rather than just setting tripleo::profile::base::keystone::keystone_enable_openidc in config_settings? | 18:06 |
| EmilienM | larsks: both work | 18:06 |
| EmilienM | larsks: it's just the way to do | 18:06 |
| larsks | Sure, I was just curious about code style preferences. | 18:07 |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 18:10 |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 18:10 |
| *** agopi has quit IRC | 18:15 | |
| openstackgerrit | Sai Sindhur Malleni proposed openstack/tripleo-validations master: Check baremetal flavors for custom resource class https://review.openstack.org/574419 | 18:16 |
| openstackgerrit | Sai Sindhur Malleni proposed openstack/tripleo-validations master: Check baremetal flavors for custom resource class https://review.openstack.org/574419 | 18:19 |
| EmilienM | stevebaker: when you're up, I think we have chicken/egg problem on https://review.openstack.org/#/c/574101/ | 18:20 |
| *** slaweq has joined #tripleo | 18:21 | |
| weshay | ur a chicken | 18:25 |
| EmilienM | :-o | 18:30 |
| *** holser__ has joined #tripleo | 18:33 | |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: [DNM][WIP] Add fs050 job to test from-release-upgrades https://review.openstack.org/574665 | 18:35 |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: Add fs050 job to test from-release-upgrades https://review.openstack.org/574665 | 18:36 |
| *** pkovar has quit IRC | 18:36 | |
| *** holser___ has quit IRC | 18:36 | |
| *** jtomasek|bbl is now known as jtomasek | 18:37 | |
| *** leanderthal has quit IRC | 18:38 | |
| *** cylopez has joined #tripleo | 18:41 | |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/puppet-tripleo master: enable support for openidc federation in keystone https://review.openstack.org/574851 | 18:44 |
| *** ksambor has quit IRC | 18:47 | |
| *** ksambor has joined #tripleo | 18:48 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: use fs config to assign standalone role, tests https://review.openstack.org/572830 | 18:49 |
| *** aufi has quit IRC | 18:50 | |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-heat-templates master: enable support for openidc federation in keystone https://review.openstack.org/574855 | 18:51 |
| *** agopi has joined #tripleo | 18:53 | |
| *** itlinux has quit IRC | 18:54 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP - add missing services for upgrade cleanup https://review.openstack.org/570283 | 18:58 |
| *** aufi has joined #tripleo | 19:03 | |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 19:10 |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 19:10 |
| *** atoth has quit IRC | 19:21 | |
| *** slaweq has quit IRC | 19:22 | |
| *** dparkes has joined #tripleo | 19:30 | |
| *** salmankhan has joined #tripleo | 19:30 | |
| *** lifeless_ has quit IRC | 19:31 | |
| *** salmankhan has quit IRC | 19:34 | |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: undercloud-upgrade job is stable, move to vote https://review.openstack.org/574868 | 19:41 |
| EmilienM | weshay: how come we have to do this^ ? | 19:42 |
| EmilienM | weshay: the job was already in gate | 19:42 |
| EmilienM | when a job moves to gate, it HAS to be voting | 19:42 |
| weshay | https://review.openstack.org/#/c/574868/ | 19:42 |
| *** raildo has quit IRC | 19:42 | |
| EmilienM | it makes no sense to have non voting jobs | 19:42 |
| weshay | EmilienM, I just caught that myself | 19:42 |
| EmilienM | it makes no sense to have non voting jobs in gate | 19:42 |
| EmilienM | ok | 19:42 |
| weshay | yes | 19:42 |
| weshay | EmilienM, and get the f out of my head | 19:43 |
| EmilienM | weshay: chicken | 19:43 |
| weshay | making me write gerrit reviews telepathically | 19:44 |
| weshay | Evilien | 19:44 |
| *** moshele has joined #tripleo | 19:45 | |
| *** lifeless has joined #tripleo | 19:49 | |
| *** moshele has quit IRC | 19:51 | |
| openstackgerrit | Alan Bishop proposed openstack/puppet-tripleo master: Handle renaming of Cinder VNX backend parameter https://review.openstack.org/574873 | 19:53 |
| *** cylopez has quit IRC | 19:54 | |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Add dry run option to toci_quickstart - playbook order in tact https://review.openstack.org/570694 | 19:55 |
| abishop | EmilienM, mwhahaha: my ^^ puppet-tripleo patch hopes to fix breakage introduced by puppet-cinder patch, https://review.openstack.org/572720 | 19:59 |
| openstackgerrit | Merged openstack/tripleo-common master: UpdatePlanEnvironmentAction enable overwrite or merge https://review.openstack.org/560312 | 19:59 |
| *** moshele has joined #tripleo | 20:01 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-common master: enable the update job on scripts/* changes https://review.openstack.org/574876 | 20:03 |
| *** moshele has quit IRC | 20:04 | |
| openstackgerrit | Ryan Brady proposed openstack/python-tripleoclient master: Changes Creation Of overcloudrc File to Call Workflow https://review.openstack.org/545351 | 20:04 |
| openstackgerrit | Damien Ciabrini proposed openstack/puppet-tripleo master: HA overcloud: wait for db before running grant commands https://review.openstack.org/574732 | 20:05 |
| *** rfolco is now known as rfolco_doctor | 20:05 | |
| *** cylopez has joined #tripleo | 20:06 | |
| EmilienM | abishop: ack, will look at it | 20:06 |
| *** morazi has quit IRC | 20:06 | |
| *** cylopez has quit IRC | 20:07 | |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 20:10 |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 20:10 |
| *** kmy has joined #tripleo | 20:16 | |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Fix logs by setting defaults for tempest_format https://review.openstack.org/574164 | 20:17 |
| openstackgerrit | Matt Young proposed openstack/tripleo-quickstart-extras master: Add upgrade logs to logstash indexing https://review.openstack.org/570896 | 20:17 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/queens: Remove the --container-registry-file parameter from upgrade clis https://review.openstack.org/573856 | 20:17 |
| *** kmy has quit IRC | 20:20 | |
| *** slaweq has joined #tripleo | 20:22 | |
| *** slaweq has quit IRC | 20:22 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: WIP Fix logrotate_crond issues https://review.openstack.org/574835 | 20:23 |
| *** itlinux has joined #tripleo | 20:24 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: undercloud: add missing services for upgrade cleanup https://review.openstack.org/570283 | 20:26 |
| *** itlinux has quit IRC | 20:28 | |
| openstackgerrit | Matt Young proposed openstack/tripleo-quickstart-extras master: Add upgrade and update logs to logstash indexing https://review.openstack.org/570896 | 20:32 |
| *** ansmith has quit IRC | 20:36 | |
| weshay | EmilienM, tripleo-validations is not installed https://github.com/openstack/tripleo-validations/blob/master/scripts/tripleo-ansible-inventory | 20:38 |
| *** brault has quit IRC | 20:39 | |
| weshay | EmilienM, http://git.openstack.org/cgit/openstack/tripleo-validations/tree/setup.cfg#n25 | 20:39 |
| weshay | mwhahaha, should python-tripleoclient install tripleo-validations? | 20:42 |
| *** gkadam has quit IRC | 20:42 | |
| mwhahaha | maybe? | 20:42 |
| weshay | mwhahaha, it's either a project or ci thang | 20:43 |
| weshay | mwhahaha, I know you love that question | 20:43 |
| mwhahaha | it's likely that it should but that's probably a question for someone more familar with the actual problem at hand | 20:44 |
| mwhahaha | i don't think we need it for the client? | 20:44 |
| mwhahaha | or is there an action that we can execute that assumes something from validations is available | 20:44 |
| weshay | http://logs.openstack.org/15/572215/4/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/24301a6/job-output.txt.gz#_2018-06-12_01_14_00_842854 | 20:44 |
| weshay | tripleo-upgrade ci calls it | 20:44 |
| mwhahaha | so tripleo-upgrade should include it | 20:45 |
| weshay | mwhahaha, you | 20:45 |
| *** hamzy has quit IRC | 20:45 | |
| mwhahaha | is the tripleo-upgrade role from tripleo-upgrade or is it a oooq-extras role? | 20:46 |
| *** csmart has quit IRC | 20:49 | |
| *** bandini has quit IRC | 20:52 | |
| stevebaker | morning | 20:53 |
| stevebaker | EmilienM: morning | 20:53 |
| *** wilken[m] has quit IRC | 20:53 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-upgrade master: before executing tripleo-inventory esure it's installed https://review.openstack.org/574884 | 20:53 |
| *** bandini has joined #tripleo | 20:54 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: Switch more promotion jobs to containerized undercloud https://review.openstack.org/572215 | 20:54 |
| weshay | rfolco_doctor, FYI https://review.openstack.org/574884 https://review.openstack.org/#/c/572215/ | 20:55 |
| weshay | EmilienM, ^ | 20:55 |
| *** oneswig has joined #tripleo | 20:55 | |
| *** abishop has quit IRC | 20:57 | |
| *** trown is now known as trown|outtypewww | 20:57 | |
| openstackgerrit | Matt Young proposed openstack/tripleo-upgrade master: Add timestamps to update log files https://review.openstack.org/574886 | 20:58 |
| openstackgerrit | Matt Young proposed openstack/tripleo-quickstart-extras master: Add upgrade and update logs to logstash indexing https://review.openstack.org/570896 | 21:00 |
| *** leanderthal has joined #tripleo | 21:03 | |
| *** pcaruana has quit IRC | 21:04 | |
| openstackgerrit | Matt Young proposed openstack/tripleo-upgrade master: Add timestamps to update log files https://review.openstack.org/574886 | 21:04 |
| *** csmart has joined #tripleo | 21:08 | |
| *** bfournie has quit IRC | 21:09 | |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 21:10 |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 21:10 |
| *** aufi has quit IRC | 21:10 | |
| openstackgerrit | Matt Young proposed openstack/tripleo-heat-templates master: DMN: Testing tripleo-ci upgrade logic (sprint 14) https://review.openstack.org/572933 | 21:11 |
| *** mhenkel_ has quit IRC | 21:13 | |
| *** lifeless has quit IRC | 21:21 | |
| *** tosky has quit IRC | 21:25 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Define a 'baremetal' file for nodes config https://review.openstack.org/553465 | 21:25 |
| *** moshele has joined #tripleo | 21:26 | |
| *** leanderthal has quit IRC | 21:26 | |
| *** leanderthal has joined #tripleo | 21:27 | |
| *** chem has quit IRC | 21:27 | |
| *** moshele has quit IRC | 21:29 | |
| *** lifeless has joined #tripleo | 21:29 | |
| *** jrthms has joined #tripleo | 21:29 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-upgrade master: Add timestamps to logs of upgrade tasks https://review.openstack.org/574892 | 21:31 |
| sshnaidm | myoung, ^^ | 21:32 |
| EmilienM | weshay: why do we manage this package in quickstart? | 21:34 |
| EmilienM | for https://review.openstack.org/#/c/574884/ | 21:34 |
| *** lblanchard has quit IRC | 21:35 | |
| EmilienM | weshay: I guess it's fine since it's used by quickstart later to do things | 21:35 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Add barematal-specific nodes files with toplogy https://review.openstack.org/574894 | 21:37 |
| *** paramite has quit IRC | 21:38 | |
| *** pradk has quit IRC | 21:38 | |
| myoung | sshnaidm: ok...are you going to handle it there then instead of https://review.openstack.org/#/c/574886 ? | 21:39 |
| myoung | sshnaidm: also use used wildcards here to simplify... https://review.openstack.org/#/c/570896/4/roles/collect-logs/defaults/main.yml | 21:40 |
| sshnaidm | myoung, it's an addition, not instead | 21:41 |
| *** slaweq has joined #tripleo | 21:43 | |
| *** sai_p has joined #tripleo | 21:46 | |
| sai_p | Hi, can someone review this commit https://review.openstack.org/#/c/572653/ ? | 21:47 |
| sai_p | Thanks | 21:47 |
| *** slaweq has quit IRC | 21:48 | |
| *** agopi has quit IRC | 21:52 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Add environments/net-noop.yaml https://review.openstack.org/550072 | 21:52 |
| *** rodolof has joined #tripleo | 21:55 | |
| *** jbadiapa has quit IRC | 21:55 | |
| *** leanderthal has quit IRC | 21:55 | |
| *** Goneri has quit IRC | 21:56 | |
| *** leanderthal has joined #tripleo | 21:57 | |
| *** agopi has joined #tripleo | 22:02 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-heat-templates master: Allow a containerized mistral-executor to access docker https://review.openstack.org/574905 | 22:04 |
| *** leanderthal has quit IRC | 22:05 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Switch to workflow driven image prepare https://review.openstack.org/573476 | 22:05 |
| *** myoung is now known as myoung|bbl | 22:07 | |
| EmilienM | stevebaker: I think we need to remove a depends-on in https://review.openstack.org/#/c/571631/ | 22:08 |
| EmilienM | the one that points to https://review.openstack.org/#/c/574101/ | 22:08 |
| EmilienM | and we should do the other way around, https://review.openstack.org/#/c/574101/ with Depends-On https://review.openstack.org/#/c/571631/ | 22:08 |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 22:10 |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 22:10 |
| *** akrivoka has quit IRC | 22:10 | |
| stevebaker | EmilienM: ok, I'll give it a crack | 22:10 |
| *** holser__ has quit IRC | 22:11 | |
| openstackgerrit | Steve Baker proposed openstack-infra/tripleo-ci master: Set update_containers for containerized_undercloud https://review.openstack.org/574101 | 22:12 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Use role tripleo-modify-image to update containers https://review.openstack.org/571631 | 22:12 |
| EmilienM | stevebaker: good, let's see how that works, since it already had 2 +2, I'll wait for CI to finish and if green we can land it | 22:13 |
| stevebaker | ok | 22:13 |
| openstackgerrit | Sai Sindhur Malleni proposed openstack/tripleo-validations master: Check baremetal flavors for custom resource class https://review.openstack.org/574419 | 22:14 |
| *** leanderthal has joined #tripleo | 22:16 | |
| *** jrthms has quit IRC | 22:17 | |
| *** limao has joined #tripleo | 22:19 | |
| *** oneswig has quit IRC | 22:19 | |
| *** edmondsw has quit IRC | 22:26 | |
| *** edmondsw has joined #tripleo | 22:26 | |
| *** edmondsw has quit IRC | 22:31 | |
| *** holser__ has joined #tripleo | 22:31 | |
| *** leanderthal has quit IRC | 22:34 | |
| *** florianf has quit IRC | 22:36 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Match only haproxy for docker ps and skipp all *-haproxy occurences https://review.openstack.org/574173 | 22:36 |
| openstackgerrit | Merged openstack/tripleo-upgrade master: Pass custom roles_data during minor update https://review.openstack.org/574478 | 22:38 |
| *** bfournie has joined #tripleo | 22:43 | |
| *** rcernin has joined #tripleo | 22:44 | |
| *** bfournie has quit IRC | 22:44 | |
| *** bfournie has joined #tripleo | 22:44 | |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade stable/queens: Pass custom roles_data during minor update https://review.openstack.org/574910 | 22:46 |
| *** rodolof has quit IRC | 22:48 | |
| *** limao_ has joined #tripleo | 22:50 | |
| *** dtrainor has quit IRC | 22:52 | |
| *** limao has quit IRC | 22:53 | |
| *** holser__ has quit IRC | 22:54 | |
| *** rpioso is now known as rpioso|afk | 23:00 | |
| *** limao_ has quit IRC | 23:04 | |
| *** limao has joined #tripleo | 23:05 | |
| *** leanderthal has joined #tripleo | 23:05 | |
| *** limao has quit IRC | 23:07 | |
| *** limao has joined #tripleo | 23:08 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776301 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1776503 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1776301 in tripleo "[master promotion] Tempest is failing with " KeyError: 'resources' "errors - Connection refused" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 23:10 |
| openstack | Launchpad bug 1776503 in tripleo "rdocloud outage recovery - contention for resources and jobs showing long wait times" [Critical,Triaged] | 23:10 |
| *** leanderthal has quit IRC | 23:11 | |
| *** hamzy has joined #tripleo | 23:11 | |
| *** leanderthal has joined #tripleo | 23:12 | |
| *** limao_ has joined #tripleo | 23:15 | |
| *** csmart has quit IRC | 23:15 | |
| *** limao has quit IRC | 23:16 | |
| *** leanderthal has quit IRC | 23:19 | |
| *** leanderthal has joined #tripleo | 23:22 | |
| *** rajinir has quit IRC | 23:24 | |
| *** limao_ has quit IRC | 23:26 | |
| *** mhenkel_ has joined #tripleo | 23:31 | |
| *** csmart has joined #tripleo | 23:34 | |
| *** mhenkel_ has quit IRC | 23:35 | |
| *** leanderthal has quit IRC | 23:35 | |
| *** threestrands has joined #tripleo | 23:36 | |
| *** khyr0n has quit IRC | 23:45 | |
| *** dougbtv_ has joined #tripleo | 23:45 | |
| *** dougbtv_ has quit IRC | 23:48 | |
| *** leanderthal has joined #tripleo | 23:49 | |
| *** wilken[m] has joined #tripleo | 23:53 | |
| *** ansmith has joined #tripleo | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!