| *** ansmith has quit IRC | 00:05 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-common: add mandre's pull puppet modules scripts that pulls the latest puppet src https://review.openstack.org/416355 | 00:07 |
|---|---|---|
| *** jrist_ has joined #tripleo | 00:09 | |
| *** jrist has quit IRC | 00:10 | |
| *** ooolpbot has joined #tripleo | 00:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1653735 | 00:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654032 | 00:11 |
| *** ooolpbot has quit IRC | 00:11 | |
| openstack | Launchpad bug 1653735 in tripleo "OVB updates job timing out consistently" [Critical,In progress] - Assigned to Carlos Camacho (ccamacho) | 00:11 |
| openstack | Launchpad bug 1654032 in tripleo "HA job ping test unstable" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 00:11 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-common: Add support workflows https://review.openstack.org/405002 | 00:13 |
| openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient: Add overcloud support report command https://review.openstack.org/405001 | 00:14 |
| *** absubram has quit IRC | 00:20 | |
| *** palmertime has quit IRC | 00:37 | |
| *** pabelanger has left #tripleo | 00:39 | |
| *** limao has joined #tripleo | 00:52 | |
| *** rlandy has quit IRC | 00:53 | |
| *** dsneddon has quit IRC | 00:54 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: TripleO containers job with quickstart https://review.openstack.org/416259 | 00:58 |
| *** dsariel has quit IRC | 01:05 | |
| *** spredzy has quit IRC | 01:07 | |
| *** ooolpbot has joined #tripleo | 01:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1653735 | 01:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654032 | 01:11 |
| *** ooolpbot has quit IRC | 01:11 | |
| openstack | Launchpad bug 1653735 in tripleo "OVB updates job timing out consistently" [Critical,In progress] - Assigned to Carlos Camacho (ccamacho) | 01:11 |
| openstack | Launchpad bug 1654032 in tripleo "HA job ping test unstable" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 01:11 |
| *** limao has quit IRC | 01:12 | |
| *** fultonj has quit IRC | 01:14 | |
| *** limao has joined #tripleo | 01:16 | |
| *** beagles_biab is now known as beagles | 01:26 | |
| openstackgerrit | Merged openstack/tripleo-puppet-elements: Add rbd-mirror to the overcloud-controller element https://review.openstack.org/414346 | 01:27 |
| openstackgerrit | Merged openstack/tripleo-puppet-elements: Install Curator from RPM in MidoNet element https://review.openstack.org/410301 | 01:27 |
| *** bana_k has quit IRC | 01:31 | |
| *** bkopilov has quit IRC | 01:41 | |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 01:46 |
| *** bkopilov has joined #tripleo | 01:52 | |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 02:01 |
| *** ooolpbot has joined #tripleo | 02:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1653735 | 02:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654032 | 02:11 |
| *** ooolpbot has quit IRC | 02:11 | |
| openstack | Launchpad bug 1653735 in tripleo "OVB updates job timing out consistently" [Critical,In progress] - Assigned to Carlos Camacho (ccamacho) | 02:11 |
| openstack | Launchpad bug 1654032 in tripleo "HA job ping test unstable" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 02:11 |
| *** social has quit IRC | 02:41 | |
| *** social has joined #tripleo | 02:46 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: docker: eliminate copy-json.py in favor of json-file https://review.openstack.org/416420 | 02:58 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: docker: new hybrid deployment architecture and configuration https://review.openstack.org/416421 | 02:58 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Add docker glance service https://review.openstack.org/416616 | 02:58 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Add docker keystone service https://review.openstack.org/416605 | 02:58 |
| *** chem has quit IRC | 02:59 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: docker: new hybrid deployment architecture and configuration https://review.openstack.org/416421 | 03:02 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Add docker glance service https://review.openstack.org/416616 | 03:02 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Add docker keystone service https://review.openstack.org/416605 | 03:02 |
| *** bkopilov has quit IRC | 03:04 | |
| *** yolanda has quit IRC | 03:05 | |
| *** george_goh has quit IRC | 03:05 | |
| *** yolanda has joined #tripleo | 03:05 | |
| *** george_goh has joined #tripleo | 03:06 | |
| *** ramishra has quit IRC | 03:10 | |
| *** ooolpbot has joined #tripleo | 03:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1653735 | 03:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654032 | 03:11 |
| *** ooolpbot has quit IRC | 03:11 | |
| openstack | Launchpad bug 1653735 in tripleo "OVB updates job timing out consistently" [Critical,In progress] - Assigned to Carlos Camacho (ccamacho) | 03:11 |
| openstack | Launchpad bug 1654032 in tripleo "HA job ping test unstable" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 03:11 |
| *** ramishra has joined #tripleo | 03:12 | |
| *** yamahata has quit IRC | 03:22 | |
| *** sudipto_ has joined #tripleo | 03:24 | |
| *** sudipto has joined #tripleo | 03:24 | |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates: GATE TEST, please ignore https://review.openstack.org/365449 | 03:30 |
| *** udesale has joined #tripleo | 03:31 | |
| *** links has joined #tripleo | 03:40 | |
| *** nmathew has joined #tripleo | 03:50 | |
| *** bkero has quit IRC | 03:56 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: firewall: manage ipv6 rules automatically https://review.openstack.org/416706 | 03:58 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: firewall: manage ipv6 rules automatically https://review.openstack.org/416706 | 03:58 |
| EmilienM | bnemec, mwhahaha ^ covering pre/post rules also | 04:01 |
| *** Vijayendra__ has quit IRC | 04:10 | |
| *** ooolpbot has joined #tripleo | 04:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1653735 | 04:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654032 | 04:11 |
| *** ooolpbot has quit IRC | 04:11 | |
| openstack | Launchpad bug 1653735 in tripleo "OVB updates job timing out consistently" [Critical,In progress] - Assigned to Carlos Camacho (ccamacho) | 04:11 |
| openstack | Launchpad bug 1654032 in tripleo "HA job ping test unstable" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 04:11 |
| openstackgerrit | Keith Schincke proposed openstack/puppet-tripleo: Add support for not using admin_token in Ceph/RGW https://review.openstack.org/405567 | 04:25 |
| *** bkopilov has joined #tripleo | 04:30 | |
| openstackgerrit | Keith Schincke proposed openstack/puppet-tripleo: Add support for not using admin_token in Ceph/RGW https://review.openstack.org/405567 | 04:47 |
| *** sudipto has quit IRC | 05:02 | |
| *** sudipto_ has quit IRC | 05:02 | |
| *** ooolpbot has joined #tripleo | 05:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1653735 | 05:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654032 | 05:11 |
| *** ooolpbot has quit IRC | 05:11 | |
| openstack | Launchpad bug 1653735 in tripleo "OVB updates job timing out consistently" [Critical,In progress] - Assigned to Carlos Camacho (ccamacho) | 05:11 |
| *** nmathew has quit IRC | 05:11 | |
| openstack | Launchpad bug 1654032 in tripleo "HA job ping test unstable" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 05:11 |
| *** limao has quit IRC | 05:11 | |
| *** limao has joined #tripleo | 05:12 | |
| *** skramaja|afk is now known as skramaja | 05:17 | |
| *** bkero has joined #tripleo | 05:26 | |
| *** sudipto has joined #tripleo | 05:27 | |
| *** sudipto_ has joined #tripleo | 05:27 | |
| *** prateek has joined #tripleo | 05:28 | |
| *** prateek has quit IRC | 05:30 | |
| *** prateek has joined #tripleo | 05:30 | |
| *** tzumainn has quit IRC | 05:40 | |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 05:41 |
| *** masco has joined #tripleo | 05:55 | |
| *** skramaja has quit IRC | 06:05 | |
| *** skramaja has joined #tripleo | 06:05 | |
| *** spredzy has joined #tripleo | 06:10 | |
| *** ooolpbot has joined #tripleo | 06:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1653735 | 06:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654032 | 06:11 |
| *** ooolpbot has quit IRC | 06:11 | |
| openstack | Launchpad bug 1653735 in tripleo "OVB updates job timing out consistently" [Critical,In progress] - Assigned to Carlos Camacho (ccamacho) | 06:11 |
| openstack | Launchpad bug 1654032 in tripleo "HA job ping test unstable" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 06:11 |
| *** Vijayendra has joined #tripleo | 06:13 | |
| *** nyechiel has joined #tripleo | 06:15 | |
| openstackgerrit | Cao Xuan Hoang proposed openstack/tripleo-heat-templates: Fix a typo in deployed-server/README.rst https://review.openstack.org/416851 | 06:29 |
| openstackgerrit | Cao Xuan Hoang proposed openstack/puppet-tripleo: Fix a typo in mysql.pp https://review.openstack.org/416855 | 06:33 |
| *** bana_k has joined #tripleo | 06:53 | |
| *** pgadiya has joined #tripleo | 06:54 | |
| *** pcaruana has joined #tripleo | 07:05 | |
| *** tesseract has joined #tripleo | 07:09 | |
| *** ooolpbot has joined #tripleo | 07:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1653735 | 07:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654032 | 07:11 |
| *** ooolpbot has quit IRC | 07:11 | |
| openstack | Launchpad bug 1653735 in tripleo "OVB updates job timing out consistently" [Critical,In progress] - Assigned to Carlos Camacho (ccamacho) | 07:11 |
| openstack | Launchpad bug 1654032 in tripleo "HA job ping test unstable" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 07:11 |
| *** rcernin has joined #tripleo | 07:17 | |
| *** pgadiya has quit IRC | 07:19 | |
| *** pgadiya has joined #tripleo | 07:20 | |
| *** jprovazn has joined #tripleo | 07:21 | |
| *** bana_k has quit IRC | 07:31 | |
| *** rasca has joined #tripleo | 07:35 | |
| rasca | Morning guys! | 07:35 |
| marios | \o | 07:39 |
| *** yamahata has joined #tripleo | 07:39 | |
| matbu | o/ | 07:45 |
| *** yprokule has joined #tripleo | 07:48 | |
| *** aufi has joined #tripleo | 07:50 | |
| *** openstackgerrit has quit IRC | 07:50 | |
| *** mcornea has joined #tripleo | 07:52 | |
| cmyster | INDEED | 07:52 |
| cmyster | oops caps | 07:52 |
| *** eggmaster has quit IRC | 07:56 | |
| *** eggmaste` has joined #tripleo | 07:56 | |
| *** abehl has joined #tripleo | 07:58 | |
| *** cylopez has joined #tripleo | 08:00 | |
| *** openstackgerrit has joined #tripleo | 08:04 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-quickstart: Add composable deployment config files and mixed release https://review.openstack.org/410831 | 08:04 |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder: Docker matrix build https://review.openstack.org/414347 | 08:06 |
| *** fzdarsky|afk has joined #tripleo | 08:08 | |
| *** fzdarsky|afk is now known as fzdarsky | 08:09 | |
| *** chem has joined #tripleo | 08:10 | |
| *** ooolpbot has joined #tripleo | 08:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1653735 | 08:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654032 | 08:11 |
| *** ooolpbot has quit IRC | 08:11 | |
| openstack | Launchpad bug 1653735 in tripleo "OVB updates job timing out consistently" [Critical,In progress] - Assigned to Carlos Camacho (ccamacho) | 08:11 |
| openstack | Launchpad bug 1654032 in tripleo "HA job ping test unstable" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 08:11 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates: Containerized Glance https://review.openstack.org/400870 | 08:11 |
| *** zoli|gone is now known as zoli | 08:11 | |
| *** zoli is now known as zoliXXL | 08:11 | |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates: Containerized Glance https://review.openstack.org/400870 | 08:13 |
| *** ebarrera has joined #tripleo | 08:13 | |
| *** chem has quit IRC | 08:14 | |
| *** jlinkes has joined #tripleo | 08:14 | |
| *** chem has joined #tripleo | 08:14 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-quickstart: Add composable deployment config files and mixed release https://review.openstack.org/410831 | 08:18 |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-quickstart: Add composable deployment config files and mixed release https://review.openstack.org/410831 | 08:19 |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-quickstart-extras: Add composable upgrade workflow for tripleo-quickstart https://review.openstack.org/416480 | 08:21 |
| *** athomas has joined #tripleo | 08:27 | |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 08:30 |
| *** rasca has quit IRC | 08:32 | |
| *** openstackgerrit has quit IRC | 08:33 | |
| *** rasca has joined #tripleo | 08:34 | |
| *** shardy has joined #tripleo | 08:35 | |
| *** rasca has quit IRC | 08:40 | |
| *** jpich has joined #tripleo | 08:41 | |
| *** saneax-_-|AFK is now known as saneax | 08:46 | |
| *** rasca has joined #tripleo | 08:47 | |
| *** dsariel has joined #tripleo | 08:47 | |
| *** saneax is now known as saneax-_-|AFK | 08:47 | |
| *** saneax-_-|AFK is now known as saneax | 08:50 | |
| *** openstackgerrit has joined #tripleo | 08:51 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-quickstart-extras: Add composable upgrade workflow for tripleo-quickstart https://review.openstack.org/416480 | 08:51 |
| *** pmannidi has quit IRC | 08:57 | |
| therve | sshnaidm, You around? I have a small nit about http://status-tripleoci.rhcloud.com/ | 08:58 |
| *** jtomasek has quit IRC | 08:58 | |
| *** zzzeek has quit IRC | 09:00 | |
| *** zoliXXL is now known as zoli|brb | 09:00 | |
| *** ohamada has joined #tripleo | 09:03 | |
| *** pgadiya has quit IRC | 09:03 | |
| *** zzzeek has joined #tripleo | 09:03 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-quickstart-extras: Add composable upgrade workflow for tripleo-quickstart https://review.openstack.org/416480 | 09:03 |
| *** jtomasek has joined #tripleo | 09:05 | |
| *** pmannidi has joined #tripleo | 09:09 | |
| *** ealcaniz has joined #tripleo | 09:10 | |
| *** ooolpbot has joined #tripleo | 09:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1653735 | 09:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654032 | 09:11 |
| *** ooolpbot has quit IRC | 09:11 | |
| openstack | Launchpad bug 1653735 in tripleo "OVB updates job timing out consistently" [Critical,In progress] - Assigned to Carlos Camacho (ccamacho) | 09:11 |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata https://review.openstack.org/404831 | 09:11 |
| openstack | Launchpad bug 1654032 in tripleo "HA job ping test unstable" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 09:11 |
| *** pmannidi has quit IRC | 09:13 | |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 09:14 |
| *** milan has joined #tripleo | 09:15 | |
| *** bvandenh has joined #tripleo | 09:15 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-quickstart-extras: Add composable upgrade workflow for tripleo-quickstart https://review.openstack.org/416480 | 09:17 |
| *** pgadiya has joined #tripleo | 09:18 | |
| *** pmannidi has joined #tripleo | 09:18 | |
| *** hewbrocca_afk is now known as hewbrocca | 09:21 | |
| *** pmannidi has quit IRC | 09:22 | |
| *** lucas-afk is now known as lucasagomes | 09:24 | |
| dciabrin | morning | 09:27 |
| dciabrin | matbu, ping | 09:28 |
| jprovazn | Hi, it seems it's not possible to define multiple backends of the same type for a service (for example multiple netapp backends for cinder), correct? It seems this BP is related https://blueprints.launchpad.net/tripleo/+spec/cinder-multi-external-ceph (though only for ceph). Do you know if this topic was touched recently? | 09:28 |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 09:28 |
| *** jlinkes has quit IRC | 09:30 | |
| *** jlinkes has joined #tripleo | 09:30 | |
| *** anton has joined #tripleo | 09:30 | |
| *** pmannidi has joined #tripleo | 09:33 | |
| *** jtomasek has quit IRC | 09:33 | |
| *** openstackgerrit has quit IRC | 09:33 | |
| *** yamahata has quit IRC | 09:34 | |
| *** flepied has quit IRC | 09:36 | |
| *** jtomasek has joined #tripleo | 09:36 | |
| *** ebarrera has quit IRC | 09:37 | |
| *** pmannidi has quit IRC | 09:37 | |
| *** openstackgerrit has joined #tripleo | 09:38 | |
| openstackgerrit | Frank Zdarsky proposed openstack/os-net-config: Make os-net-config pass tox py3 tests https://review.openstack.org/416905 | 09:38 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates: Containerized Glance https://review.openstack.org/400870 | 09:40 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates: docker: eliminate copy-json.py in favor of json-file https://review.openstack.org/416420 | 09:40 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates: docker: new hybrid deployment architecture and configuration https://review.openstack.org/416421 | 09:40 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates: Add docker keystone service https://review.openstack.org/416605 | 09:40 |
| *** zoli|brb is now known as zoli | 09:41 | |
| *** zoli is now known as zoliXXL | 09:41 | |
| matbu | dciabrin: oops hello | 09:41 |
| matbu | dciabrin: i missed your ping | 09:42 |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 09:42 |
| *** saneax is now known as saneax-_-|AFK | 09:43 | |
| dciabrin | matbu, hey no worries :) I had a question regarding mariadb upgrade and https://review.openstack.org/#/c/403397/ | 09:43 |
| matbu | dciabrin: yep | 09:44 |
| dciabrin | matbu, do we consider case where all the mariadb cluster need to be stopped and specific database migration need to take place, like we do currently on non composable upgrade? | 09:44 |
| *** dbecker has joined #tripleo | 09:45 | |
| matbu | dciabrin: hmm afaik we haven't start to implement that yet | 09:46 |
| matbu | marios: ^ | 09:46 |
| *** derekh has joined #tripleo | 09:47 | |
| marios | matbu: dciabrin so we do things in steps. if we need particular thing to happen at particular time we can reshuffle things as necesssary | 09:47 |
| sshnaidm | therve, hi | 09:47 |
| sshnaidm | therve, which nit? | 09:47 |
| *** saneax-_-|AFK is now known as saneax | 09:47 | |
| marios | matbu: dciabrin that being said, perhaps step0 for something like this (this is to happen before any other op where we do things like check the cluster is healthy before doing anything upgrades related) | 09:47 |
| therve | sshnaidm, The bar charts is not sorted properly, january appears before december | 09:48 |
| therve | sshnaidm, It'll disappear in a few days though :) | 09:48 |
| hewbrocca | January *is* before December | 09:48 |
| hewbrocca | ... by 11 months | 09:48 |
| dciabrin | marios, and those steps are not related to t-h-t steps, am I correct? | 09:48 |
| hewbrocca | :D | 09:48 |
| sshnaidm | therve, yeah, I know :) | 09:48 |
| marios | matbu: dciabrin i wasn't aware of a particular migration we needed to handle yet, dciabrin are you saying there is a mariadb issue here? or was hypothetical for if we have a migration | 09:48 |
| marios | dciabrin: no they are separate.. those normal config steps are actually nooped here during the upgrade | 09:48 |
| sshnaidm | therve, it's easier to wait 3 days, then fix it :)) | 09:48 |
| therve | Fair enough :) | 09:49 |
| dciabrin | marios, we need a particular step when mariadb major version is updated during an upgrade. | 09:50 |
| dciabrin | marios, in case the update skips major version (like 5.5 -> 10.1), the step requires to stop the entire galera cluster, and update the databse format on disk. | 09:51 |
| marios | dciabrin: ack yeah i recall the backup and update step ... we have yet to migrate that actually it is still in teh bash. i briefly poked at was actually thinking about re-using it if possible (but didnt work out how to call it from ansible) | 09:51 |
| *** ebarrera has joined #tripleo | 09:51 | |
| matbu | marios: dciabrin some part could be done by ansible itself | 09:52 |
| openstackgerrit | Merged openstack/python-tripleoclient: Simplify Fetching the passwords from Mistral https://review.openstack.org/409791 | 09:54 |
| matbu | there is already some set of modules for managing mysql | 09:54 |
| dciabrin | marios, ok great. i'm a noob at ansible but I'd like to help testing this upgrade path as much as I can, as we need to switch mariadb version downstream. | 09:55 |
| dciabrin | matbu, good to know for the dump/restore part. for the HA use case, we still need to hook into pacemaker to stop galera and restart it though. | 09:56 |
| matbu | dciabrin: yep, i have built a small module for ansible for pacemaker resources | 09:57 |
| matbu | dciabrin: it would be a nice start use case :) | 09:57 |
| marios | dciabrin: cool ansible is new for me too but easy enough to start playing with | 09:58 |
| openstackgerrit | Merged openstack/instack-undercloud: export OS_BAREMETAL_API_VERSION in stackrc https://review.openstack.org/413740 | 09:59 |
| *** gkadam has joined #tripleo | 10:01 | |
| lucasagomes | hi all, is there a policy in place about deleting diskimage-builder elements ? | 10:02 |
| *** limao has quit IRC | 10:03 | |
| *** limao has joined #tripleo | 10:03 | |
| *** flepied has joined #tripleo | 10:04 | |
| *** paramite has joined #tripleo | 10:05 | |
| *** limao has quit IRC | 10:08 | |
| *** ooolpbot has joined #tripleo | 10:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1653735 | 10:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654032 | 10:11 |
| *** ooolpbot has quit IRC | 10:11 | |
| openstack | Launchpad bug 1653735 in tripleo "OVB updates job timing out consistently" [Critical,In progress] - Assigned to Carlos Camacho (ccamacho) | 10:11 |
| openstack | Launchpad bug 1654032 in tripleo "HA job ping test unstable" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 10:11 |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 10:12 |
| *** openstackstatus has quit IRC | 10:13 | |
| *** openstack has joined #tripleo | 10:14 | |
| *** openstackstatus has joined #tripleo | 10:16 | |
| *** ChanServ sets mode: +v openstackstatus | 10:16 | |
| *** sudipto_ has quit IRC | 10:16 | |
| *** sudipto has quit IRC | 10:16 | |
| shinobu___ | undercloud based on newton release has capability of ldap/ad integration with keystone? | 10:17 |
| *** ebarrera has quit IRC | 10:17 | |
| *** limao has joined #tripleo | 10:17 | |
| *** tosky has joined #tripleo | 10:21 | |
| *** limao has quit IRC | 10:21 | |
| *** udesale has quit IRC | 10:28 | |
| *** ebarrera has joined #tripleo | 10:31 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras: Support a custom virthost key and update README https://review.openstack.org/414002 | 10:32 |
| *** pblaho has quit IRC | 10:33 | |
| *** pblaho has joined #tripleo | 10:34 | |
| skramaja | shardy: i want to put my view on why role.j2.yam is needed for review, https://review.openstack.org/#/c/411797/6/environments/host-config-pre-network.j2.yaml@6 | 10:35 |
| skramaja | shardy: i have 2 usecases i want to consider.. | 10:36 |
| *** udesale has joined #tripleo | 10:36 | |
| skramaja | shardy: 1) for nfv cluster, it is required to deploy a cluster with 2 different compute foles - ComputeOvsDpdk and ComputeSriov role | 10:37 |
| skramaja | shardy: in the same cluster, both the compute roles should be dployed with different first boot parameters | 10:37 |
| skramaja | shardy: 2) if a cluster has heterogenous nodes, like HP and DELL machines, in order to deploy, we can use differnt roles - ComputeHpDpdk and ComputeDellDpdk | 10:38 |
| skramaja | shardy: both will have different set of first boot parameters, this was the thought process behind deciding role.j2.yaml | 10:39 |
| *** flepied has quit IRC | 10:40 | |
| shardy | skramaja: Ok, I see - that makes sense, thanks for clarifying | 10:56 |
| *** flepied has joined #tripleo | 10:56 | |
| skramaja | thanks shardy.. i will update it in the review for future reference. | 10:56 |
| *** aufi has quit IRC | 10:57 | |
| shardy | skramaja: I think the j2_excludes and config_then_reboot comments are still valid though? | 10:57 |
| *** aufi has joined #tripleo | 10:58 | |
| skramaja | shardy: i wanted to target only Compute nodes.. thats y, in the environemt i have added - if "Compute" in role.name", so that it is applied for all compute only nodes. | 10:58 |
| skramaja | we generally dont have much usecases to set kernel args for controller or storage | 10:58 |
| skramaja | thats y i have added in excludes. | 10:58 |
| skramaja | shardy: config_then_reboot - yes, i can keep it as is for example. since i am creating the working one, i thuoght an example is not necessary. but it is always good to have a simple example.. | 11:00 |
| *** sudipto has joined #tripleo | 11:00 | |
| *** sudipto_ has joined #tripleo | 11:01 | |
| shardy | skramaja: Yeah I'd prefer to keep the simple example I think | 11:02 |
| shardy | skramaja: Ok perhaps you could add a comment to the excludes file, as normally we only use that for when t-h-t contains a file | 11:02 |
| shardy | and we want to avoid overwriting it | 11:02 |
| shardy | I'd probably just remove the excludes and accept there's some unused files rendered | 11:03 |
| shardy | skramaja: e.g what if someone wanted to test an all-in-one deployment with DPDK? | 11:03 |
| skramaja | shardy: ok ok.. i got the purpose now.. it make sense to remove the excludes. | 11:03 |
| *** thrash|g0ne is now known as thrash | 11:06 | |
| *** cylopez has quit IRC | 11:08 | |
| *** ooolpbot has joined #tripleo | 11:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1653735 | 11:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654032 | 11:11 |
| *** ooolpbot has quit IRC | 11:11 | |
| openstack | Launchpad bug 1653735 in tripleo "OVB updates job timing out consistently" [Critical,In progress] - Assigned to Carlos Camacho (ccamacho) | 11:11 |
| openstack | Launchpad bug 1654032 in tripleo "HA job ping test unstable" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 11:11 |
| *** udesale has quit IRC | 11:12 | |
| *** arxcruz has quit IRC | 11:15 | |
| *** ansmith has joined #tripleo | 11:16 | |
| *** sudipto_ has quit IRC | 11:16 | |
| *** sudipto has quit IRC | 11:16 | |
| *** arxcruz has joined #tripleo | 11:26 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-quickstart-extras: Add composable upgrade workflow for tripleo-quickstart https://review.openstack.org/416480 | 11:28 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras: Execute ping test role at the end of the upgrade https://review.openstack.org/409815 | 11:29 |
| *** milan is now known as lunch|milan | 11:31 | |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata https://review.openstack.org/404831 | 11:31 |
| *** akrivoka has joined #tripleo | 11:33 | |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-heat-templates: Configure Kernel Args and Tuned and then reboot for Compute https://review.openstack.org/411797 | 11:33 |
| *** salmankhan has joined #tripleo | 11:34 | |
| shardy | matbu: Hey, have you been debugging https://review.openstack.org/404831 ? | 11:34 |
| *** Vijayendra has quit IRC | 11:35 | |
| shardy | I was about to look into it - seems it got stuck at step for of the upgrade but I'm not sure why yet | 11:35 |
| shardy | it still works fine for me locally | 11:35 |
| *** pkovar has joined #tripleo | 11:36 | |
| matbu | shardy: the first issue i see is the upgrade command which is wrong | 11:37 |
| matbu | shardy: i'm not sure if the timeout is due to that, i rekicked the experimental job to see | 11:38 |
| shardy | matbu: Ok I'll follow progress on that and run deploy.sh locally | 11:38 |
| matbu | shardy: the upgrade command use the ~/new/newton/tht templates | 11:39 |
| matbu | shardy: and yep it works locally too (but not the exact multinode settings) | 11:39 |
| shardy | matbu: ack, I've also tested non-multinode, but am about to test with the full multinode bootstrap and deploy.sh | 11:40 |
| matbu | shardy: nice, on a local box ? | 11:41 |
| shardy | matbu: Yeah, I'll share notes when I've got it fully proven | 11:41 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras: Remove redundant settings from containers https://review.openstack.org/416941 | 11:41 |
| cmyster | shardy: general question, the scripts used here (tripleo.sh etc') is this sh or bash ? | 11:42 |
| shardy | cmyster: #!/bin/bash | 11:43 |
| cmyster | hmmm | 11:43 |
| cmyster | I guess to each his own writing style | 11:43 |
| matbu | shardy: great | 11:43 |
| *** zoliXXL is now known as zoli|lunch | 11:43 | |
| *** ansmith has quit IRC | 11:44 | |
| cmyster | shardy: will using a conf file for all those hard coded values be something we can implement here or... | 11:45 |
| shardy | cmyster: what hard coded values? | 11:45 |
| openstackgerrit | Merged openstack/tripleo-puppet-elements: Add ipa-admintools package to the overcloud. https://review.openstack.org/412542 | 11:45 |
| cmyster | for instance, in deploy.sh line 98-102 you have CIDR and ranges | 11:46 |
| shardy | cmyster: most things are configurable via environment variables, and in CI we use a deploy.env file containing the configuration | 11:46 |
| shardy | http://logs.openstack.org/30/414630/4/check/gate-tripleo-ci-centos-7-nonha-multinode/9e66108/logs/deploy.env | 11:46 |
| *** pmannidi has joined #tripleo | 11:46 | |
| cmyster | ack | 11:46 |
| cmyster | that was the missing link | 11:47 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras: Create tasks to install, run stackviz and collect logs https://review.openstack.org/400782 | 11:47 |
| shardy | cmyster: yeah, deploy.sh is more specific to CI, but we could make things into variables if needed | 11:47 |
| cmyster | again to each his own writing style... | 11:48 |
| * cmyster shudderes at the if statements | 11:48 | |
| *** social is now known as coffee_addict | 11:48 | |
| shardy | meh, patches welcome ;) | 11:48 |
| shardy | much of this will go away when things convert to OOOQ anyway I guess | 11:48 |
| cmyster | +1 | 11:49 |
| *** salmankhan has quit IRC | 11:49 | |
| *** salmankhan has joined #tripleo | 11:49 | |
| skramaja | shardy: another thing which i want to discuss is, regarding the complexity of deriving the DPDK parameters from introspected data. i have detailed it in the mail and given a proposal to automate to certain extent - http://lists.openstack.org/pipermail/openstack-dev/2017-January/109600.html, your comments will guide us in the right direction.. | 11:50 |
| thrash | can I get another +2 here? https://review.openstack.org/#/c/398422/ | 11:51 |
| *** pmannidi has quit IRC | 11:54 | |
| *** derekh has quit IRC | 11:55 | |
| *** dciabrin has quit IRC | 11:55 | |
| *** afazekas has quit IRC | 11:55 | |
| *** bandini has quit IRC | 11:55 | |
| *** SlickNik has quit IRC | 11:55 | |
| *** r2bit has quit IRC | 11:55 | |
| *** r2bit has joined #tripleo | 11:55 | |
| *** bandini has joined #tripleo | 11:55 | |
| *** afazekas has joined #tripleo | 11:55 | |
| *** derekh has joined #tripleo | 11:56 | |
| *** SlickNik has joined #tripleo | 11:57 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras: Look for success message in logs when check status https://review.openstack.org/405392 | 12:02 |
| *** jkilpatr has joined #tripleo | 12:04 | |
| *** lucasagomes is now known as lucas-hungry | 12:05 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: TripleO containers job with quickstart https://review.openstack.org/416259 | 12:07 |
| openstackgerrit | Christian Schwede proposed openstack/tripleo-common: Create temporary Swift URLs before deployment https://review.openstack.org/413229 | 12:09 |
| openstackgerrit | Frank Zdarsky proposed openstack/os-net-config: Add check that ovs_extra is passed as list https://review.openstack.org/416955 | 12:09 |
| openstackgerrit | Christian Schwede proposed openstack/tripleo-heat-templates: Automatically backup and restore Swift rings from the undercloud https://review.openstack.org/414460 | 12:10 |
| *** Vijayendra has joined #tripleo | 12:11 | |
| *** saneax is now known as saneax-_-|AFK | 12:11 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras: Update Liberty related documentation throughout roles https://review.openstack.org/404381 | 12:11 |
| *** links has quit IRC | 12:13 | |
| EmilienM | hello | 12:16 |
| *** bkopilov has quit IRC | 12:20 | |
| *** masco has quit IRC | 12:21 | |
| openstackgerrit | Jan Provaznik proposed openstack/puppet-tripleo: Set manila default_share_type config option https://review.openstack.org/416958 | 12:22 |
| openstackgerrit | Jan Provaznik proposed openstack/puppet-tripleo: Set manila default_share_type config option https://review.openstack.org/416958 | 12:23 |
| *** links has joined #tripleo | 12:25 | |
| openstackgerrit | Jan Provaznik proposed openstack/tripleo-heat-templates: Set manila default_share_type config option https://review.openstack.org/416960 | 12:28 |
| skramaja | EmilienM: did you happen to have a look at https://review.openstack.org/#/c/402061/? | 12:29 |
| colonwq | EmilienM, Good morning. Can you review 405567 today? I could not get the hiera data to load so I extended the service profile. | 12:29 |
| *** rain has joined #tripleo | 12:31 | |
| *** rain is now known as leanderthal | 12:31 | |
| *** dougbtv has joined #tripleo | 12:33 | |
| *** chem has quit IRC | 12:37 | |
| *** gkadam has quit IRC | 12:44 | |
| openstackgerrit | Andrey Shestakov proposed openstack/diskimage-builder: Add DIB_IPA_COMPRESS_CMD option https://review.openstack.org/416593 | 12:44 |
| *** salmankhan has quit IRC | 12:44 | |
| *** salmankhan has joined #tripleo | 12:45 | |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras: Enable cinder-backup service https://review.openstack.org/400787 | 12:45 |
| *** bfournie has quit IRC | 12:50 | |
| *** chem has joined #tripleo | 12:51 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-quickstart-extras: Add composable upgrade workflow for tripleo-quickstart https://review.openstack.org/416480 | 12:52 |
| *** links has quit IRC | 12:55 | |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras: Expose the tempest results to the top level of the collected logs https://review.openstack.org/404710 | 12:55 |
| *** pradk has joined #tripleo | 12:58 | |
| *** zoli|lunch is now known as zoli | 12:58 | |
| *** zoli is now known as zoliXXL | 12:58 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: firewall: manage ipv6 rules automatically https://review.openstack.org/416706 | 13:01 |
| *** shardy has quit IRC | 13:02 | |
| *** dprince has joined #tripleo | 13:02 | |
| dprince | EmilienM: a quick one https://review.openstack.org/#/c/416770/ | 13:02 |
| *** salmankhan has quit IRC | 13:03 | |
| EmilienM | dprince: done. I also have some patches please: https://review.openstack.org/#/c/416719/ https://review.openstack.org/#/c/416723/ https://review.openstack.org/#/c/416724/ https://review.openstack.org/#/c/416725/ - it's really cosmetic things but we need it | 13:03 |
| *** salmankhan has joined #tripleo | 13:03 | |
| openstackgerrit | Merged openstack/tripleo-common: Add support for initial state to the register_or_update workflow https://review.openstack.org/398422 | 13:04 |
| *** sudipto_ has joined #tripleo | 13:04 | |
| *** sudipto has joined #tripleo | 13:04 | |
| dprince | EmilienM: what is this 4 for 1 deal :) | 13:04 |
| EmilienM | dprince: it's boxing day here | 13:05 |
| dprince | EmilienM: +2 on all of your cleanups | 13:06 |
| *** links has joined #tripleo | 13:07 | |
| dprince | dtantsur: per your dislike of my parameter here https://review.openstack.org/#/c/416579/, what would you like the description to say | 13:07 |
| EmilienM | dprince: merci | 13:07 |
| dprince | dtantsur: if you tell me I might even fix it in puppet-ironic for you | 13:08 |
| *** salmankhan has quit IRC | 13:08 | |
| *** dougbtv has quit IRC | 13:09 | |
| *** fultonj has joined #tripleo | 13:10 | |
| *** trown|outtypewww is now known as trown | 13:11 | |
| *** ansmith has joined #tripleo | 13:12 | |
| *** ealcaniz has quit IRC | 13:14 | |
| *** dougbtv has joined #tripleo | 13:14 | |
| *** flepied has quit IRC | 13:20 | |
| *** prateek has quit IRC | 13:21 | |
| *** flepied has joined #tripleo | 13:21 | |
| *** bfournie has joined #tripleo | 13:22 | |
| *** pradk has quit IRC | 13:23 | |
| *** dciabrin_ has joined #tripleo | 13:23 | |
| *** dciabrin_ is now known as dciabrin | 13:23 | |
| *** morazi has joined #tripleo | 13:23 | |
| *** dciabrin has quit IRC | 13:24 | |
| *** dciabrin has joined #tripleo | 13:24 | |
| *** pradk has joined #tripleo | 13:24 | |
| *** lunch|milan is now known as milan | 13:26 | |
| *** karimb has joined #tripleo | 13:26 | |
| *** lucas-hungry is now known as lucasagomes | 13:27 | |
| *** jprovazn has quit IRC | 13:31 | |
| *** udesale has joined #tripleo | 13:31 | |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 13:31 |
| *** ooolpbot has joined #tripleo | 13:32 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:32 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1653735 | 13:32 |
| openstack | Launchpad bug 1653735 in tripleo "OVB updates job timing out consistently" [Critical,In progress] - Assigned to Carlos Camacho (ccamacho) | 13:32 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654032 | 13:32 |
| *** ooolpbot has quit IRC | 13:32 | |
| openstack | Launchpad bug 1654032 in tripleo "HA job ping test unstable" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 13:32 |
| *** pradk has quit IRC | 13:33 | |
| EmilienM | bnemec: i'm proposing a temprevert of the neutron patch | 13:34 |
| *** d0ugal has quit IRC | 13:34 | |
| *** d0ugal has joined #tripleo | 13:35 | |
| *** matbu has quit IRC | 13:37 | |
| openstackgerrit | Brad P. Crochet proposed openstack/python-tripleoclient: Migrate overcloud update to a mistral workflow https://review.openstack.org/381351 | 13:38 |
| *** rhallisey has joined #tripleo | 13:39 | |
| *** zoliXXL is now known as zoli|brb | 13:39 | |
| thrash | could use another +2 here: https://review.openstack.org/#/c/407740/ | 13:39 |
| *** mbu has joined #tripleo | 13:39 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: temprevert neutron "Don't create HA resources until needed" patch https://review.openstack.org/416974 | 13:39 |
| EmilienM | bnemec: ^ | 13:39 |
| *** mbu is now known as matbu | 13:41 | |
| *** rlandy has joined #tripleo | 13:42 | |
| *** salmankhan has joined #tripleo | 13:42 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras: Parametrize containers compute DNS https://review.openstack.org/416976 | 13:47 |
| sshnaidm | weshay, ^^ | 13:47 |
| *** pradk has joined #tripleo | 13:51 | |
| *** liverpooler has quit IRC | 13:51 | |
| weshay | sshnaidm, bah ya I should have made that a variable good call.. the default should be what works with the base use case for oooq which is a virthost install I think | 13:51 |
| sshnaidm | weshay, I think we need to reconsider what is base case for oooq :) | 13:52 |
| weshay | sshnaidm, we could | 13:52 |
| sshnaidm | weshay, maybe it's better to put it in containers_minimal..? I'm not sure | 13:53 |
| weshay | sshnaidm, isn't there a separate config file for ovb? | 13:53 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras: Add generic undercloud setup role https://review.openstack.org/406324 | 13:53 |
| weshay | sshnaidm, ya.. we should def have it in the config | 13:54 |
| *** jprovazn has joined #tripleo | 13:54 | |
| weshay | sshnaidm, the config for containers in now in extras/config | 13:55 |
| weshay | so we can add it to this change | 13:55 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras: Modify OVB role to work with non-ready undercloud images https://review.openstack.org/412567 | 13:56 |
| *** agurenko has quit IRC | 13:56 | |
| coffee_addict | EmilienM: I have interesting race in puppet-tripleo - I'm doing ipv6 setup on master and from time to time interface_for_ip returns empty interface even though it's set up correctly | 14:00 |
| EmilienM | coffee_addict: you might want to check with dsneddon_afk when he's back online | 14:01 |
| *** links has quit IRC | 14:02 | |
| openstackgerrit | Julie Pichon proposed openstack-infra/tripleo-ci: Use the Newton node management commands https://review.openstack.org/416982 | 14:04 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart: Remove --release argument from the OVB stack cleanup script https://review.openstack.org/416322 | 14:07 |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-quickstart-extras: Add composable upgrade workflow for tripleo-quickstart https://review.openstack.org/416480 | 14:07 |
| coffee_addict | EmilienM: I'll try to reproduce and trace logs | 14:07 |
| *** salmankhan has quit IRC | 14:08 | |
| *** pgadiya has quit IRC | 14:09 | |
| *** bkopilov has joined #tripleo | 14:10 | |
| openstackgerrit | Julie Pichon proposed openstack/python-tripleoclient: Deprecate legacy 'baremetal' commands https://review.openstack.org/416229 | 14:10 |
| *** ooolpbot has joined #tripleo | 14:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1653735 | 14:11 |
| openstack | Launchpad bug 1653735 in tripleo "OVB updates job timing out consistently" [Critical,In progress] - Assigned to Carlos Camacho (ccamacho) | 14:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654032 | 14:11 |
| *** ooolpbot has quit IRC | 14:11 | |
| openstack | Launchpad bug 1654032 in tripleo "HA job ping test unstable" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 14:11 |
| *** limao has joined #tripleo | 14:12 | |
| *** limao_ has joined #tripleo | 14:16 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: puppet/role.role.j2.yaml has invalid get_resource reference https://review.openstack.org/416770 | 14:16 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Configure Heat engine metadata URL's https://review.openstack.org/416573 | 14:17 |
| *** limao has quit IRC | 14:17 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: nova-api: also include hiera for new apache_api class https://review.openstack.org/416723 | 14:17 |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 14:19 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: get_host_info: also save ip6tables https://review.openstack.org/416719 | 14:20 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras: Add composable upgrade workflow for tripleo-quickstart https://review.openstack.org/416480 | 14:25 |
| openstackgerrit | Dan Prince proposed openstack/python-tripleoclient: Deploy the undercloud with Heat https://review.openstack.org/351351 | 14:26 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras: Enable cinder-backup service https://review.openstack.org/400787 | 14:28 |
| *** shardy has joined #tripleo | 14:28 | |
| *** Vijayendra has quit IRC | 14:31 | |
| *** zoli|brb is now known as zoli | 14:32 | |
| *** zoli is now known as zoliXXL | 14:33 | |
| *** ealcaniz has joined #tripleo | 14:33 | |
| *** lblanchard has joined #tripleo | 14:33 | |
| *** ealcaniz has quit IRC | 14:35 | |
| *** jcoufal has joined #tripleo | 14:35 | |
| *** ealcaniz has joined #tripleo | 14:35 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras: Parametrize containers compute DNS https://review.openstack.org/416988 | 14:37 |
| *** Goneri has joined #tripleo | 14:38 | |
| *** liverpooler has joined #tripleo | 14:39 | |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart-extras: Revert "Replace hardcoded stack user by ansible_user" https://review.openstack.org/416989 | 14:44 |
| openstackgerrit | Dimitri Savineau proposed openstack/puppet-tripleo: Cinder: Add NexentaStor Support https://review.openstack.org/370956 | 14:45 |
| openstackgerrit | Merged openstack/python-tripleoclient: Remove separate call to provide workflow https://review.openstack.org/398423 | 14:48 |
| openstackgerrit | Merged openstack/tripleo-common: Add utility workflow to wait for stack COMPLETE or FAILED https://review.openstack.org/407740 | 14:48 |
| openstackgerrit | Merged openstack/tripleo-common: Block the scale down workflow until the stack is COMPLETE or FAILED https://review.openstack.org/407741 | 14:48 |
| *** tzumainn has joined #tripleo | 14:48 | |
| *** anton has quit IRC | 14:52 | |
| dtantsur | dprince, I don't want it as a parameter that users might dare change, that's it | 14:55 |
| dtantsur | disabling cleaning is not a mode of operation ironic upstream approves of or actively supports | 14:55 |
| dtantsur | I don't even guarantee we don't deprecate it one rainy day | 14:55 |
| dtantsur | dprince, so if you need to change it for undercloud - fine, you have hiera. I'm not sure you need it as a parameter for heat templates though. | 14:56 |
| *** palmertime has joined #tripleo | 14:56 | |
| dtantsur | if you do, then the description should be like "Disables cleaning. Do not change, unless you understand what you're doing really well." | 14:56 |
| dprince | dtantsur: I get you. I don't think removing that option is good, but I can edit python files if you remove it | 14:57 |
| dprince | dtantsur: I'll update the comment with something meaninful in puppet-ironic then | 14:58 |
| shardy | Hey dprince, so ideally we should revert https://review.openstack.org/#/c/416573 and figure another way for the heat endpoint to get passed in | 14:58 |
| dtantsur | dprince, well, you can imagine the level of supportability of hacking python code... | 14:58 |
| dtantsur | dprince, why puppet-ironic? I was objecting to offering an option in THT | 14:58 |
| dprince | dtantsur: then don't remove the option :) | 14:58 |
| shardy | heat creates those URLs automatically now, based on the service catalog entry | 14:58 |
| shardy | dprince: fine if it's needed as a stopgap, but I did remove them deliberately a while back | 14:58 |
| *** absubram has joined #tripleo | 14:58 | |
| *** adarazs is now known as adarazs_brb | 14:58 | |
| dprince | http://git.openstack.org/cgit/openstack/puppet-ironic/tree/manifests/conductor.pp#n54 | 14:59 |
| dprince | dtantsur: ^^ | 14:59 |
| dtantsur | dprince, yeah, this should be a bit more scary, I guess | 14:59 |
| shardy | https://github.com/openstack/heat/blob/master/heat/engine/clients/os/heat_plugin.py#L81 | 15:00 |
| dprince | dtantsur: that was my only concern, I can live w/ hiera I guess, but please do keep the option :) | 15:00 |
| dtantsur | dprince, I don't have plans to remove it right now, but fwiw my hope is to re-enable cleaning for undercloud | 15:00 |
| shardy | dprince: that's where we set it - in theory the config isn't needed provided you have a service catalog entry for the heat CFN service | 15:00 |
| *** adarazs_brb is now known as adarazs | 15:00 | |
| dprince | shardy: perhaps we are missing an entry for that in the undercloud | 15:00 |
| *** limao_ has quit IRC | 15:01 | |
| dprince | shardy: sorry I missed this | 15:04 |
| *** ealcaniz has quit IRC | 15:04 | |
| *** anton has joined #tripleo | 15:04 | |
| dprince | shardy: FWIW, what I did was to make the config match what we do today in the undercloud | 15:05 |
| shardy | dprince: no worries, adding it back doesn't harm anything, just a bit cleaner if we don't have to :) | 15:05 |
| dprince | shardy: yep, but the good news here is we won't need to backport this | 15:05 |
| *** chlong has joined #tripleo | 15:05 | |
| *** udesale has quit IRC | 15:07 | |
| *** ooolpbot has joined #tripleo | 15:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1653735 | 15:11 |
| openstack | Launchpad bug 1653735 in tripleo "OVB updates job timing out consistently" [Critical,In progress] - Assigned to Carlos Camacho (ccamacho) | 15:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654032 | 15:11 |
| *** ooolpbot has quit IRC | 15:11 | |
| openstack | Launchpad bug 1654032 in tripleo "HA job ping test unstable" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 15:11 |
| *** prateek has joined #tripleo | 15:13 | |
| *** cylopez has joined #tripleo | 15:13 | |
| *** yprokule_ has joined #tripleo | 15:15 | |
| *** yprokule has quit IRC | 15:15 | |
| *** yprokule_ is now known as yprokule | 15:15 | |
| EmilienM | radez: https://review.openstack.org/#/c/413881/ | 15:15 |
| EmilienM | which congress module do you use? | 15:16 |
| *** abehl has quit IRC | 15:18 | |
| flaper87 | weshay: dmsimard hey, I just talked to dougbtv and leifmadsen and they are interested in helping with the CI work for tripleo+containers and the work for building the RDO CI and pipeline for containers. I just wanted to introduce you all on IRC. Will let you figure out the details | 15:18 |
| flaper87 | EmilienM: ^ | 15:19 |
| leifmadsen | o/ | 15:19 |
| leifmadsen | ohai again :D | 15:19 |
| radez | EmilienM: replied, will get it updated | 15:19 |
| dougbtv | o/ | 15:19 |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart-extras: Ensure extras-common depends on common https://review.openstack.org/417008 | 15:19 |
| EmilienM | radez: cool. | 15:21 |
| EmilienM | flaper87, leifmadsen, dougbtv: cool, welcome. I think at this point, weshay and sshnaidm are driving the work on $topic. | 15:22 |
| leifmadsen | sweet | 15:22 |
| openstackgerrit | Dan Radez proposed openstack/puppet-tripleo: Adding congress service https://review.openstack.org/413881 | 15:22 |
| leifmadsen | we got access to the trello yesterday, so at this point it's a matter of catching up and figuring things out so that we could be useful | 15:22 |
| dougbtv | +1 | 15:22 |
| leifmadsen | it'll be mostly dougbtv driving the work part, and I'll jump in where I can | 15:22 |
| *** tdasilva- is now known as tdasilva | 15:23 | |
| *** prateek has quit IRC | 15:24 | |
| *** salmankhan has joined #tripleo | 15:25 | |
| openstackgerrit | Tim Rozet proposed openstack/puppet-tripleo: Fixes missing haproxy firewall rules for OpenDaylight https://review.openstack.org/417013 | 15:27 |
| *** ealcaniz has joined #tripleo | 15:27 | |
| openstackgerrit | Tim Rozet proposed openstack/tripleo-heat-templates: Adds missing firewall rules for OpenDaylight API service https://review.openstack.org/417015 | 15:28 |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-quickstart-extras: Add composable upgrade workflow for tripleo-quickstart https://review.openstack.org/416480 | 15:28 |
| dmsimard | leifmadsen, dougbtv: maybe I can get you up to speed on bluejeans or something today, where I am and where I'm going and we can go from there | 15:29 |
| leifmadsen | dmsimard: that would be awesome -- other than my 1pm, I'm totally open today and tomorrows | 15:29 |
| dougbtv | I'd appreciate too, for sure | 15:30 |
| *** prateek has joined #tripleo | 15:30 | |
| dmsimard | k let me book something | 15:30 |
| *** salmankhan has quit IRC | 15:31 | |
| leifmadsen | yea my calendar is up to date, so feel free to just pick something | 15:31 |
| *** prateek has quit IRC | 15:31 | |
| EmilienM | bnemec: thx for https://review.openstack.org/#/c/416974/ - TIL | 15:32 |
| *** prateek has joined #tripleo | 15:32 | |
| EmilienM | bnemec: looking at zuul now, it's running pingtest; we'll know if a few if it's working | 15:32 |
| bnemec | EmilienM: Cool. I've added a todo to document temprevert and friends. | 15:33 |
| EmilienM | yeah! | 15:33 |
| bnemec | Back before we pinned repos we had to do it a lot more so there was more tribal knowledge about it. :-) | 15:33 |
| dmsimard | leifmadsen, dougbtv: 2:30pm EST ok? | 15:34 |
| leifmadsen | +1 | 15:34 |
| EmilienM | bnemec: sounds like it failed | 15:35 |
| openstackgerrit | Tim Rozet proposed openstack/puppet-tripleo: Decouples neutron services from OpenDaylight API service https://review.openstack.org/417019 | 15:35 |
| bnemec | EmilienM: :-( | 15:35 |
| openstackgerrit | Tim Rozet proposed openstack/tripleo-heat-templates: Adds missing OpenDaylight username/password from ODL OVS service https://review.openstack.org/417020 | 15:36 |
| EmilienM | bnemec: ERROR: <html><body><h1>504 Gateway Time-out</h1> | 15:36 |
| EmilienM | bnemec: doing recheck | 15:37 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: temprevert neutron "Don't create HA resources until needed" patch https://review.openstack.org/416974 | 15:37 |
| *** ealcaniz has quit IRC | 15:38 | |
| bnemec | EmilienM: Damn, I guess that problem still exists too then. | 15:38 |
| *** d0ugal has quit IRC | 15:38 | |
| EmilienM | bnemec: well, it's not the same error | 15:39 |
| EmilienM | bnemec: it didn't reach the same step | 15:39 |
| EmilienM | bnemec: in the latest case, vm didn't create | 15:39 |
| bnemec | EmilienM: Yeah, but that one's been around for a while too. | 15:39 |
| EmilienM | wasn't created* | 15:39 |
| EmilienM | yeah? | 15:39 |
| EmilienM | do we track it somewhere? | 15:39 |
| bnemec | I even had a logstash query for it: http://logstash.openstack.org/#dashboard/file/logstash.json?query=build_name%3A%20*tripleo-ci*%20AND%20build_status%3A%20FAILURE%20AND%20message%3A%20%5C%22504%20Gateway%20Time-out%5C%22 | 15:39 |
| bnemec | Looks like it killed four other jobs in the past 24 hours too. | 15:40 |
| bnemec | All ha jobs. | 15:40 |
| dougbtv | dmsimard, that works for me 2:30pm EST perfect | 15:40 |
| EmilienM | bnemec: damn, I hope it's not another regression | 15:41 |
| EmilienM | but it shouldn't, as we haven't promoted for 2 days | 15:41 |
| *** d0ugal has joined #tripleo | 15:41 | |
| bnemec | EmilienM: Which, coincidentally(?), is when we started seeing these timeouts. | 15:43 |
| openstackgerrit | Merged openstack/puppet-tripleo: nova-api: switch to new wsgi class https://review.openstack.org/416724 | 15:43 |
| bnemec | Setting logstash for the past 30 days, I only see it happening yesterday and today. | 15:44 |
| EmilienM | mhh ok | 15:44 |
| EmilienM | ok another bug to investigate | 15:44 |
| EmilienM | let me look in a few | 15:44 |
| EmilienM | it might be something in nova | 15:44 |
| EmilienM | bnemec: hum. It sounds like it started yesterday. | 15:45 |
| EmilienM | and there are "only" 5 occurences in 2 days | 15:46 |
| EmilienM | which is not much comparing to all other problems we have | 15:46 |
| *** ealcaniz has joined #tripleo | 15:46 | |
| *** ealcaniz is now known as ealcaniz|contrai | 15:46 | |
| *** ealcaniz|contrai has quit IRC | 15:53 | |
| bnemec | Hey tripleo cores, it would be nice to merge https://review.openstack.org/#/c/414342/ so we stop eating up ~3 hours per mitaka job. | 15:59 |
| *** aufi has quit IRC | 16:00 | |
| trown | adarazs: I moved you from volunteer to actual liaison :) https://etherpad.openstack.org/p/tripleo-squads | 16:01 |
| adarazs | trown: yay :) | 16:03 |
| adarazs | EmilienM: we were wondering how much an IRC meeting is a requirement/recommended for these squads vs. bluejeans. | 16:04 |
| hewbrocca | adarazs: I think IRC meetings are strongly encouraged | 16:05 |
| adarazs | hewbrocca: okay, that could work. we'll have to find a different meeting to keep up with how people are growing their winter beard then. ;) | 16:06 |
| trown | lol | 16:07 |
| *** salmankhan has joined #tripleo | 16:07 | |
| *** rcernin has quit IRC | 16:07 | |
| *** mcornea has quit IRC | 16:09 | |
| *** mcornea has joined #tripleo | 16:10 | |
| *** ooolpbot has joined #tripleo | 16:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1653735 | 16:11 |
| openstack | Launchpad bug 1653735 in tripleo "OVB updates job timing out consistently" [Critical,In progress] - Assigned to Carlos Camacho (ccamacho) | 16:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654032 | 16:11 |
| *** ooolpbot has quit IRC | 16:11 | |
| openstack | Launchpad bug 1654032 in tripleo "HA job ping test unstable" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 16:11 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras: Add generic undercloud setup role https://review.openstack.org/406324 | 16:11 |
| hewbrocca | There's nothing that says you can't look at each other on bluejeans while you type on IRC :) | 16:11 |
| matbu | hewbrocca: lol | 16:14 |
| *** ealcaniz has joined #tripleo | 16:17 | |
| openstackgerrit | Merged openstack/puppet-tripleo: Adds a profile for the Ceph MDS service https://review.openstack.org/402386 | 16:18 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras: Modify OVB role to work with non-ready undercloud images https://review.openstack.org/412567 | 16:19 |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci: Fail multinode-oooq job fast until it is ready https://review.openstack.org/417032 | 16:20 |
| *** tesseract has quit IRC | 16:21 | |
| trown | sshnaidm: ^ that will save some infra resources on quickstart/extras patches until we get the job functional | 16:21 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras: Modify OVB role to work with non-ready undercloud images https://review.openstack.org/412567 | 16:22 |
| sshnaidm | trown, great, thanks | 16:23 |
| *** myoung|afk is now known as myoung | 16:23 | |
| openstackgerrit | Ben Kero proposed openstack/tripleo-quickstart-extras: undercloud-setup: Add 'become' to necessary roles https://review.openstack.org/417034 | 16:27 |
| openstackgerrit | Ana Krivokapic proposed openstack/tripleo-common: Add utility functions for deleting/emptying swift containers https://review.openstack.org/409315 | 16:32 |
| *** jprovazn has quit IRC | 16:32 | |
| openstackgerrit | Ben Kero proposed openstack/tripleo-quickstart-extras: undercloud-setup: Add SSH arguments to multinode vxlan subnode setup https://review.openstack.org/417040 | 16:35 |
| *** mcornea has quit IRC | 16:35 | |
| *** weshay is now known as weshay_errand | 16:37 | |
| *** rhallisey has quit IRC | 16:39 | |
| *** ebarrera has quit IRC | 16:39 | |
| EmilienM | adarazs: thereis no official requirement | 16:40 |
| EmilienM | adarazs: it's up to folks to decide how they work together | 16:40 |
| EmilienM | if they don't need meeting and prefer async emails, it works too | 16:40 |
| EmilienM | as long as people work together, I think we can be happy :) | 16:41 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras: undercloud-setup: Add SSH arguments to multinode vxlan subnode setup https://review.openstack.org/417040 | 16:41 |
| *** ealcaniz has quit IRC | 16:42 | |
| openstackgerrit | John Schwarz proposed openstack/tripleo-heat-templates: DNM: debug for ha failures https://review.openstack.org/417086 | 16:44 |
| *** prateek_ has joined #tripleo | 16:46 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-quickstart-extras: Add composable upgrade workflow for tripleo-quickstart https://review.openstack.org/416480 | 16:48 |
| *** artom has joined #tripleo | 16:49 | |
| *** saneax-_-|AFK is now known as saneax | 16:49 | |
| *** prateek has quit IRC | 16:49 | |
| *** coffee_addict is now known as social | 16:49 | |
| openstackgerrit | Ben Kero proposed openstack/tripleo-quickstart-extras: undercloud-setup: Add 'become' to necessary roles https://review.openstack.org/417034 | 16:50 |
| *** salmankhan has quit IRC | 16:51 | |
| openstackgerrit | Ben Kero proposed openstack/tripleo-quickstart-extras: undercloud-setup: Add 'sudo' to commands in necessary tasks https://review.openstack.org/417034 | 16:52 |
| openstackgerrit | Ben Kero proposed openstack/tripleo-quickstart-extras: undercloud-setup: Add 'sudo' to commands in necessary tasks https://review.openstack.org/417034 | 16:53 |
| *** liverpooler has quit IRC | 16:55 | |
| bnemec | EmilienM: When you +1'd https://review.openstack.org/#/c/414113/ were you aware that that job isn't even passing in experimental? | 16:55 |
| bnemec | I think we should revert that change. | 16:55 |
| bnemec | It's just burning ovb testenvs for no reason. | 16:55 |
| EmilienM | what? | 16:56 |
| EmilienM | I trusted them to have it passing first | 16:56 |
| EmilienM | bkero: ^ | 16:56 |
| EmilienM | sshnaidm, bkero: are the jobs supposed to pass? | 16:56 |
| bnemec | EmilienM: Yeah, it's not. :-( | 16:56 |
| EmilienM | if not, we need to rever it. | 16:56 |
| EmilienM | revert* | 16:56 |
| bkero | EmilienM: I don't know about the containers job. | 16:56 |
| bnemec | It's literally exit 1 in toci_gate_test. | 16:57 |
| sshnaidm | EmilienM, the containers job doesn't pass, but will be very soon | 16:57 |
| sshnaidm | EmilienM, the multinode job is in development yet | 16:57 |
| EmilienM | sshnaidm: why did you move it to check then? | 16:58 |
| bnemec | EmilienM: https://review.openstack.org/#/c/417095/ | 16:58 |
| *** pcaruana has quit IRC | 16:58 | |
| bnemec | sshnaidm: It needs to pass in the experimental queue before it gets moved to check. | 16:58 |
| bnemec | Furthermore, we do not have enough resources to run four ovb jobs. | 16:58 |
| EmilienM | yeah, that's the goal of experimental pipeline | 16:58 |
| bnemec | If we're going to swap in containers, it needs to replace one of the other jobs. | 16:59 |
| bnemec | Even with three jobs we're queuing pretty badly most days, and this is a pretty quiet time. | 16:59 |
| bnemec | Closer to release we're going to struggle to clear the queue overnight, I suspect. | 16:59 |
| *** liverpooler has joined #tripleo | 17:00 | |
| sshnaidm | EmilienM, bnemec, I see, I think I understood you wrong | 17:00 |
| sshnaidm | EmilienM, multinode is in experimental afaik | 17:00 |
| trown | ya multinode is in experimental, but also in the check queue for quickstart/extras | 17:01 |
| trown | hence https://review.openstack.org/417032 to save resources for quickstart/extras patches until experimental is passing | 17:01 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras: undercloud-setup: Add SSH arguments to multinode vxlan subnode setup https://review.openstack.org/417040 | 17:02 |
| *** bana_k has joined #tripleo | 17:04 | |
| *** salmankhan has joined #tripleo | 17:05 | |
| sshnaidm | EmilienM, bnemec about containers - no problem to move it to experimental or I can noop it, just not to take space now. | 17:05 |
| sshnaidm | EmilienM, bnemec but if we don't have space to run it at all, let's decide what do we need first | 17:06 |
| EmilienM | bnemec: another topic / ipv6: http://paste.openstack.org/show/QrEPUN2hn9suUeZPIQui/ - is it better? | 17:06 |
| EmilienM | sshnaidm: I agree | 17:06 |
| EmilienM | bnemec: I updated https://review.openstack.org/#/c/416706/ last night btw | 17:08 |
| *** salmankhan has quit IRC | 17:08 | |
| *** salmankhan has joined #tripleo | 17:09 | |
| bnemec | sshnaidm: It's already noop'd. That's part of the problem - it's just burning a testenv to run "exit 1". | 17:10 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: nova-api: legacy cleanup with old wsgi params https://review.openstack.org/416725 | 17:10 |
| bnemec | There's no point in having a job like that in check. | 17:10 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: glance/api: cleanup on dbsync https://review.openstack.org/417101 | 17:10 |
| bnemec | EmilienM: I saw that, thanks. | 17:10 |
| *** arxcruz has quit IRC | 17:10 | |
| *** ooolpbot has joined #tripleo | 17:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1653735 | 17:11 |
| openstack | Launchpad bug 1653735 in tripleo "OVB updates job timing out consistently" [Critical,In progress] - Assigned to Carlos Camacho (ccamacho) | 17:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654032 | 17:11 |
| *** ooolpbot has quit IRC | 17:11 | |
| openstack | Launchpad bug 1654032 in tripleo "HA job ping test unstable" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 17:11 |
| EmilienM | flaper87: looking at https://review.openstack.org/#/c/408471/ -- why not removing Glance Registry at all directly? What is the use case to keep it? | 17:11 |
| openstackgerrit | Ben Kero proposed openstack/tripleo-quickstart-extras: undercloud-setup: Add a timeout to the SSH connection for vxlan setup https://review.openstack.org/417103 | 17:11 |
| bnemec | EmilienM: http://paste.openstack.org/show/QrEPUN2hn9suUeZPIQui/ still looks like it's missing the rules to allow service ports. | 17:12 |
| openstackgerrit | Ben Kero proposed openstack/tripleo-quickstart-extras: undercloud-setup: Add a timeout to SSH for multinode vxlan setup https://review.openstack.org/417103 | 17:12 |
| *** lucasagomes is now known as lucas-afk | 17:12 | |
| *** derekh has quit IRC | 17:12 | |
| sshnaidm | bnemec, sorry, what does mean "burning testenv"? It doesn't reach testenv stage, just exits and doesn't take any ovb resources | 17:13 |
| openstackgerrit | Ben Kero proposed openstack/tripleo-quickstart-extras: undercloud-setup: Add a timeout to SSH for multinode vxlan setup https://review.openstack.org/417103 | 17:13 |
| EmilienM | bnemec: indeed, I'll investigate | 17:13 |
| *** jpich has quit IRC | 17:14 | |
| *** hewbrocca is now known as hewbrocca_afk | 17:16 | |
| *** yamahata has joined #tripleo | 17:16 | |
| *** zoliXXL is now known as zoli|gone | 17:16 | |
| shardy | sshnaidm: for the OVB joba a worker VM (testenv) has to be allocated for the script to run, only to exit 1 | 17:16 |
| *** jlinkes has quit IRC | 17:17 | |
| bnemec | sshnaidm: Okay, that's true. It's still tying up a potential testenv for the duration of the job, and the check queue is not the place to get new jobs working. | 17:17 |
| sshnaidm | shardy, it exits before | 17:17 |
| *** dbecker has quit IRC | 17:18 | |
| openstackgerrit | Ben Kero proposed openstack/tripleo-quickstart-extras: repo_setup: Add sudo to specific commands for non-root running https://review.openstack.org/417107 | 17:19 |
| *** athomas has quit IRC | 17:20 | |
| openstackgerrit | Ben Kero proposed openstack/tripleo-quickstart-extras: repo_setup: Add sudo to specific commands for non-root running https://review.openstack.org/417107 | 17:20 |
| openstackgerrit | Ana Krivokapic proposed openstack/tripleo-common: Add utility functions for deleting/emptying swift containers https://review.openstack.org/409315 | 17:21 |
| sshnaidm | bnemec, do you mean limit by 60(?) jobs that it takes place there? I'm not sure I understand | 17:21 |
| sshnaidm | where is this RDO cloud when we need it so much | 17:22 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Remove Glance Registry service https://review.openstack.org/417109 | 17:22 |
| EmilienM | flaper87: ^ this is what I'm thinking | 17:22 |
| mandre | EmilienM, mwhahaha: I need to submit a problem to my puppet experts | 17:23 |
| openstackgerrit | Ben Kero proposed openstack/tripleo-quickstart-extras: repo_setup: Add sudo to specific commands for non-root running https://review.openstack.org/417107 | 17:23 |
| mandre | EmilienM, mwhahaha: so apparently, docker-registry is now obsoleted by the docker-distribution rpm | 17:24 |
| *** prateek_ has quit IRC | 17:24 | |
| mandre | and this puppet code cause problems, https://github.com/openstack/instack-undercloud/blob/master/elements/puppet-stack-config/puppet-stack-config.pp#L469-L499 | 17:24 |
| *** jd__ has quit IRC | 17:24 | |
| *** trown is now known as trown|lunch | 17:25 | |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 17:25 |
| EmilienM | mandre: how can I help? | 17:26 |
| mandre | EmilienM: the docker-distribution rpm is selected instead of docker-registry, so the assumption that docker-registry service is available on like 489 is not true anymore | 17:27 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Merge mysql service_config_settings for nova https://review.openstack.org/416726 | 17:28 |
| EmilienM | mandre: I need to brb lunch now, let me know how can I help | 17:28 |
| *** bana_k has quit IRC | 17:28 | |
| slagle | shardy: can you review https://review.openstack.org/#/c/416726/? i'm not honestly sure i'm doing the right thing | 17:29 |
| sshnaidm | bnemec, could you please explain - do you still see the problem with containers job? Should we move it to experimental again or not? Because I see it finishes within 5 min right now, not sure it takes any significant resources | 17:30 |
| shardy | slagle: sure, looking | 17:31 |
| mwhahaha | mandre: so what's the fix? just switch the package name? | 17:31 |
| sshnaidm | bnemec, but we definitely increased ovb usage because of running oooq ovb jobs on each oooq patch, although I think we can compromise on 1 job (ha) instead of two there - trown? | 17:31 |
| bnemec | sshnaidm: It's not passing. It shouldn't have been moved to the check queue. Period. | 17:33 |
| *** cylopez has quit IRC | 17:33 | |
| shardy | slagle: looks fine to me | 17:33 |
| slagle | shardy: ok, thanks | 17:33 |
| sshnaidm | bnemec, ok, let's move it to experimental | 17:33 |
| mandre | mwhahaha: assuming we do not need to be backward compatible with docker-registry, I suppose changing the package name could work, although the configuration file format changed too | 17:34 |
| mandre | mwhahaha: I don't know if all the supported distros provide docker-distribution already | 17:35 |
| mwhahaha | mandre: well the undercloud only supports rhel anyway | 17:36 |
| mwhahaha | mandre: so i'm not sure what you're looking for us to do on that issue. if you have questions about how to change it we can help. other than that not sure what you're looking for | 17:37 |
| sshnaidm | EmilienM, bnemec https://review.openstack.org/#/c/417117/ | 17:38 |
| *** fpan has joined #tripleo | 17:38 | |
| bnemec | sshnaidm: https://review.openstack.org/#/c/417095/ | 17:38 |
| sshnaidm | bnemec, but it doesn't solve problem with overload that was mentioned | 17:40 |
| bnemec | sshnaidm: Yes it does. That takes us back to 3 jobs. When the containers job is working, we can discuss what to do with it. | 17:42 |
| openstackgerrit | Ben Kero proposed openstack/tripleo-quickstart-extras: undercloud-setup: Add SSH arguments to multinode vxlan subnode setup https://review.openstack.org/417040 | 17:43 |
| openstackgerrit | Ben Kero proposed openstack/tripleo-quickstart-extras: undercloud-setup: Add a timeout to SSH for multinode vxlan setup https://review.openstack.org/417103 | 17:43 |
| openstackgerrit | Ben Kero proposed openstack/tripleo-quickstart-extras: repo_setup: Add sudo to specific commands for non-root running https://review.openstack.org/417107 | 17:43 |
| mandre | mwhahaha: I first wanted to make the puppet code work with both docker-registry or docker-distribute, but I suppose it's fine to have it only setup docker-distribute | 17:44 |
| *** jd__ has joined #tripleo | 17:44 | |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 17:44 |
| mandre | mwhahaha: just to confirm, you mean RHEL >= 7.3 ? | 17:44 |
| *** ohamada has quit IRC | 17:44 | |
| mwhahaha | mandre: since this is tripleo, current version of centos but yea redhat family | 17:45 |
| palmertime | After deploying Newton stable, i get a 504 error. ERROR (GatewayTimeout): Gateway Timeout (HTTP 504) | 17:45 |
| mandre | mwhahaha: right, but nothing older than 7.3 that is? | 17:45 |
| mwhahaha | mandre: i think so but EmilienM might be the better person to ask about the minimum versions | 17:46 |
| palmertime | I get this error from the dashboard and even nova list command | 17:46 |
| mwhahaha | mandre: the reality is right now it's 7.3, but your update might have upgrade implications | 17:46 |
| shardy | mandre: I think 7.3 for ocata is fine, and given container support is only a preview feature so far, it's probably fine to just switch to the new thing | 17:46 |
| shardy | if it were something TripleO fully supported we'd have to deal with data migration between the two services, but I think we can just document it somewhere, e.g a release note would be a good idea | 17:47 |
| mandre | mwhahaha: hmm, I think the rpm packaging should take care of the update problem, shouldn't it? | 17:48 |
| shardy | mandre: the upgrade problem is what happens to the images in the registry if there's now a new service | 17:48 |
| shardy | rpm packaging won't solve that | 17:48 |
| mwhahaha | i also mean undercloud upgrade | 17:48 |
| mwhahaha | i'm just pointing out you might need to chat with the lifecycle folks about the impact the packagename/config changes may have | 17:49 |
| *** dtantsur is now known as dtantsur|afk | 17:50 | |
| shardy | mwhahaha: Yeah it's a good point - I think we probably have some flexibility because of the status of container support in TripleO, but it would certainly be wise to ensure version to version upgrades don't completely break because of this | 17:50 |
| shardy | even if we can't maintain the images over the upgrade | 17:50 |
| mandre | shardy: I may be wrong here, but I thought that an rpm that obsoletes another one should run an upgrade script to migrate the data when applicable | 17:50 |
| mwhahaha | depends on the package, i'm not aware of such things | 17:51 |
| mwhahaha | that's a question for the docker package maintainer i guess | 17:51 |
| shardy | mandre: I doubt a package would do data migrations in most cases, as it'd normally need credentials for DB access etc | 17:51 |
| shardy | normally that's left as a config management problem | 17:52 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras: Define status code when success https://review.openstack.org/417122 | 17:52 |
| sshnaidm | trown|lunch, sorry ^^ | 17:52 |
| shardy | the pre/post scripts might perhaps move or copy files tho I guess, check out the RPMs to find out :) | 17:52 |
| mandre | alright, thanks for the help mwhahaha and shardy | 17:53 |
| *** saneax is now known as saneax-_-|AFK | 17:53 | |
| *** sanagikoki has joined #tripleo | 17:53 | |
| *** liverpooler has quit IRC | 17:56 | |
| *** yprokule has quit IRC | 17:56 | |
| shardy | mandre: docker-distribution doesn't obsolete docker-registry, and the scripts don't to anything at all to migrate or disable docker-registry | 17:57 |
| shardy | http://paste.openstack.org/show/594034/ | 17:57 |
| shardy | so you'll need to handle that via puppet | 17:57 |
| *** liverpooler has joined #tripleo | 17:58 | |
| *** yamahata has quit IRC | 17:58 | |
| *** yamahata has joined #tripleo | 17:59 | |
| *** jkilpatr has quit IRC | 18:01 | |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 18:02 |
| *** rbrady is now known as rbrady-afk | 18:03 | |
| *** b00tcat has joined #tripleo | 18:05 | |
| *** b00tcat has joined #tripleo | 18:05 | |
| *** jmelvin has quit IRC | 18:09 | |
| *** ooolpbot has joined #tripleo | 18:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1653735 | 18:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654032 | 18:11 |
| *** ooolpbot has quit IRC | 18:11 | |
| openstack | Launchpad bug 1653735 in tripleo "OVB updates job timing out consistently" [Critical,In progress] - Assigned to Carlos Camacho (ccamacho) | 18:11 |
| openstack | Launchpad bug 1654032 in tripleo "HA job ping test unstable" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 18:11 |
| *** flepied has quit IRC | 18:11 | |
| sanagikoki | Hi, Could someone review this ? https://review.openstack.org/#/c/404897/ | 18:12 |
| *** jd__ has quit IRC | 18:12 | |
| shardy | sanagikoki: Hi! | 18:15 |
| shardy | sanagikoki: I've just taken a look and will comment, one issue is it's using the ExtraConfigPre interface, but we moved away from that during newton to a new "composable services" interface | 18:16 |
| shardy | the old interface still works, but compare https://review.openstack.org/#/c/405385/ patchset 2 | 18:16 |
| shardy | with the latest | 18:16 |
| shardy | I made the same comment there, and it was pretty easy to rework to align with the new interface | 18:16 |
| *** weshay_errand is now known as weshay | 18:17 | |
| *** jkilpatr has joined #tripleo | 18:17 | |
| *** jd__ has joined #tripleo | 18:18 | |
| sanagikoki | shardy: Thanks! I'll make it align with new interfarce. | 18:18 |
| shardy | sanagikoki: thanks! Sorry we missed the review on that patch, please feel free to ping me when you're ready for another review | 18:20 |
| sanagikoki | shardy: I will. Thanks! | 18:21 |
| *** palmertime1 has joined #tripleo | 18:22 | |
| *** LiberalCarrot has joined #tripleo | 18:22 | |
| *** LiberalCarrot has left #tripleo | 18:22 | |
| *** pkovar has quit IRC | 18:23 | |
| *** palmertime has quit IRC | 18:24 | |
| *** trown|lunch is now known as trown | 18:24 | |
| EmilienM | bnemec: ok, pingtest fails again on the temprevert, for yet another error | 18:29 |
| EmilienM | http://logs.openstack.org/74/416974/2/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/6f2c9a7/console.html#_2017-01-05_17_28_02_435537 | 18:29 |
| bnemec | EmilienM: That's not the failure though: http://logs.openstack.org/74/416974/2/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/6f2c9a7/console.html#_2017-01-05_17_30_08_670065 | 18:29 |
| EmilienM | ah indeed | 18:30 |
| bnemec | That error message is just because we're trying to clean something that doesn't exist. | 18:30 |
| bnemec | I have no such easy explanation for the glance error though. :-( | 18:30 |
| EmilienM | bnemec: http://logs.openstack.org/74/416974/2/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/6f2c9a7/logs/overcloud-controller-0/var/log/glance/api.txt.gz#_2017-01-05_17_30_11_334 | 18:31 |
| *** salmankhan has quit IRC | 18:31 | |
| EmilienM | IOError: unexpected end of file while parsing chunked data | 18:31 |
| EmilienM | it sounds related to a problem Fuel had in the past | 18:32 |
| EmilienM | https://bugs.launchpad.net/fuel/+bug/1375596 | 18:32 |
| openstack | Launchpad bug 1375596 in Fuel for OpenStack "Swift: errors during large file upload. Need to change 'node_timeout' parameter" [High,Fix released] - Assigned to Alexander Tivelkov (ativelkov) | 18:32 |
| EmilienM | they did that https://review.openstack.org/#/c/155487 | 18:32 |
| EmilienM | it also sounds related to https://bugs.launchpad.net/tripleo/+bug/1646750 | 18:32 |
| openstack | Launchpad bug 1646750 in tripleo "CI: periodic jobs fail to upload test image to overcloud glance" [Critical,Fix released] | 18:32 |
| EmilienM | I'm re-open it ^ | 18:33 |
| bnemec | http://logs.openstack.org/74/416974/2/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/6f2c9a7/logs/overcloud-controller-0/var/log/swift/swift.txt.gz#_Jan__5_17_30_11 | 18:33 |
| EmilienM | timestamps are same, so yeah it's the root cause | 18:34 |
| EmilienM | could be a timeout, right? | 18:35 |
| EmilienM | SwiftProxyNodeTimeout is default to 60 in tripleo | 18:36 |
| bnemec | EmilienM: This is a tiny image though. :-/ | 18:36 |
| EmilienM | they had 90 in Fuel | 18:36 |
| EmilienM | yeah | 18:36 |
| EmilienM | I'm jumping on #openstack-swift ! | 18:36 |
| bnemec | I find five instances of this failure over the past three days: http://logstash.openstack.org/#/dashboard/file/logstash.json?query=build_name:%20*tripleo-ci*%20AND%20build_status:%20FAILURE%20AND%20message:%20%5C%22504%20Gateway%20Time-out%5C%22 | 18:38 |
| bnemec | Wait, that's not the right link. | 18:38 |
| * bnemec tries again | 18:38 | |
| *** bana_k has joined #tripleo | 18:38 | |
| bnemec | http://logstash.openstack.org/#dashboard/file/logstash.json?query=build_name%3A%20*tripleo-ci*%20AND%20build_status%3A%20FAILURE%20AND%20message%3A%20%5C%22Error%20finding%20address%20for%5C%22 | 18:38 |
| EmilienM | bnemec: I raised it on #openstack-swift, waiting for experts to help a bit. If nothing, i'll raise it in launchpad/swift | 18:41 |
| bnemec | Add it to the growing pile of random bugs. | 18:42 |
| EmilienM | :) | 18:42 |
| EmilienM | bnemec: logstash is pretty clear: it says it appears on a promotion again | 18:44 |
| * bnemec headdesk | 18:44 | |
| EmilienM | bnemec: what was the time window I said yesterday? was it 25th december? | 18:46 |
| EmilienM | when things were stable | 18:46 |
| EmilienM | maybe 23 | 18:46 |
| bnemec | The 23rd is when the updates job broke. | 18:46 |
| EmilienM | yeah | 18:46 |
| EmilienM | ok | 18:46 |
| bnemec | ha was recent | 18:46 |
| bnemec | Like the 3rd | 18:46 |
| *** b00tcat has quit IRC | 18:47 | |
| leifmadsen | Would love to get a +workflow on this :) https://review.openstack.org/#/c/411442/ | 18:55 |
| leifmadsen | same with this: https://review.openstack.org/#/c/387671/ | 18:55 |
| *** b00tcat has joined #tripleo | 18:59 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: DNM: add --debug to glance image upload https://review.openstack.org/417134 | 18:59 |
| EmilienM | bnemec: ^ swift folks needs to know if glanceclient is adding an extra line somehow | 19:00 |
| EmilienM | they were helpful, let's work with them | 19:00 |
| EmilienM | bnemec: I hope we'll hit it :( | 19:01 |
| bnemec | EmilienM: "they were helpful, let's work with them" If only I could apply that logic all the time. | 19:01 |
| *** jkilpatr_ has joined #tripleo | 19:01 | |
| EmilienM | :D | 19:01 |
| EmilienM | let me be positive :) | 19:01 |
| *** egafford has quit IRC | 19:02 | |
| bnemec | You were helpful, I will work with you. You were not helpful, I will not work with you. :-) | 19:02 |
| EmilienM | bnemec: you just found out how I work i guess :P | 19:02 |
| *** egafford has joined #tripleo | 19:03 | |
| *** egafford has left #tripleo | 19:03 | |
| *** fzdarsky is now known as fzdarsky|afk | 19:03 | |
| bnemec | EmilienM: Well, that's one mystery solved. Only 372 heisenbugs to go. ;-) | 19:04 |
| *** jkilpatr has quit IRC | 19:05 | |
| bnemec | EmilienM: I think I also just figured out why we're only getting ipv4 addresses from your patch: https://github.com/openstack/puppet-tripleo/blob/master/manifests/firewall/rule.pp#L73 | 19:07 |
| bnemec | We default to an ipv4 source. :-/ | 19:07 |
| *** milan has quit IRC | 19:08 | |
| *** rhallisey has joined #tripleo | 19:08 | |
| EmilienM | ah indeed | 19:08 |
| EmilienM | bnemec: i'll think about it in a sec | 19:08 |
| EmilienM | we can easily convert it to :: address | 19:08 |
| *** paramite has quit IRC | 19:10 | |
| *** ooolpbot has joined #tripleo | 19:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1646750 | 19:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1653735 | 19:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654032 | 19:11 |
| *** ooolpbot has quit IRC | 19:11 | |
| openstack | Launchpad bug 1646750 in tripleo "CI: periodic jobs fail to upload test image to overcloud glance" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 19:11 |
| openstack | Launchpad bug 1653735 in tripleo "OVB updates job timing out consistently" [Critical,In progress] - Assigned to Carlos Camacho (ccamacho) | 19:11 |
| openstack | Launchpad bug 1654032 in tripleo "HA job ping test unstable" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 19:11 |
| *** rcernin has joined #tripleo | 19:11 | |
| *** dsneddon_afk is now known as dsneddon | 19:16 | |
| *** dsariel has quit IRC | 19:19 | |
| *** sudipto_ has quit IRC | 19:21 | |
| *** sudipto has quit IRC | 19:21 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo: WIP DO NOT MERGE test moving mysql under tripleo::haproxy::endpoint https://review.openstack.org/417138 | 19:23 |
| *** jmelvin has joined #tripleo | 19:25 | |
| palmertime1 | I just deployed a small Newton overcloud and i'm getting 504 errors everywhere.  re-starting haproxy on the controller helps for a time then comes back again.  I have increased maxconn for the mysql  in haproxy.cfg but still will get 504 errors after a while. | 19:27 |
| dmsimard | leifmadsen, dougbtv: I need to relocate in another room real quick be right there | 19:30 |
| dougbtv | no prob dmsimard catch you in a few | 19:31 |
| leifmadsen | np, thanks for reminding me :) | 19:31 |
| * leifmadsen had spaced on the date... | 19:31 | |
| *** fpan has quit IRC | 19:32 | |
| *** yamahata has quit IRC | 19:32 | |
| bnemec | EmilienM: I think we can just change the $source default to undef. | 19:32 |
| bnemec | It has the same effect as 0/0, but makes the logic easier to write. | 19:32 |
| EmilienM | bnemec: that's something possible, indeed | 19:37 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo: WIP Add haproxy firewall rules for galera and redis https://review.openstack.org/417164 | 19:37 |
| EmilienM | bnemec: I was writting complex logic, but your idea might be simpler indeed | 19:37 |
| bnemec | EmilienM: Yeah, I was testing it locally, and after screwing up the logic twice I decided there had to be a better way. :-) | 19:38 |
| *** fpan has joined #tripleo | 19:38 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras: undercloud-setup: Add SSH arguments to multinode vxlan subnode setup https://review.openstack.org/417040 | 19:38 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras: undercloud-setup: Add a timeout to SSH for multinode vxlan setup https://review.openstack.org/417103 | 19:38 |
| *** flepied has joined #tripleo | 19:38 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras: repo_setup: Add sudo to specific commands for non-root running https://review.openstack.org/417107 | 19:38 |
| bnemec | My deploy just started step 4, so I should know if this fixes ipv6 deployments shortly. | 19:39 |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 19:41 |
| openstackgerrit | Feng Pan proposed openstack/tripleo-heat-templates: Adds etcd service https://review.openstack.org/414751 | 19:42 |
| openstackgerrit | Feng Pan proposed openstack/tripleo-heat-templates: Adds etcd composable service https://review.openstack.org/414751 | 19:43 |
| openstackgerrit | Feng Pan proposed openstack/puppet-tripleo: Adds etcd https://review.openstack.org/414730 | 19:44 |
| *** dsariel has joined #tripleo | 19:44 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: firewall: manage ipv6 rules automatically https://review.openstack.org/416706 | 19:45 |
| EmilienM | bnemec: ok this one could be better ^ | 19:45 |
| EmilienM | I need to update commit message but let's see how CI works | 19:45 |
| bnemec | EmilienM: That's working for me locally. nova-compute was able to connect to rabbit properly. | 19:51 |
| EmilienM | woot | 19:52 |
| openstackgerrit | Alejandro Andreu proposed openstack/tripleo-heat-templates: Create MidoNet services https://review.openstack.org/396692 | 19:59 |
| EmilienM | can someone review this easy one ? https://review.openstack.org/#/c/417101/ | 20:03 |
| *** chlong has quit IRC | 20:03 | |
| *** b00tcat has quit IRC | 20:08 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras: Remove redundant settings from containers https://review.openstack.org/416941 | 20:10 |
| *** yamahata has joined #tripleo | 20:10 | |
| *** rbrady-afk is now known as rbrady | 20:10 | |
| *** ooolpbot has joined #tripleo | 20:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1646750 | 20:11 |
| openstack | Launchpad bug 1646750 in tripleo "CI: periodic jobs fail to upload test image to overcloud glance" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 20:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1653735 | 20:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654032 | 20:11 |
| *** ooolpbot has quit IRC | 20:11 | |
| openstack | Launchpad bug 1653735 in tripleo "OVB updates job timing out consistently" [Critical,In progress] - Assigned to Carlos Camacho (ccamacho) | 20:11 |
| openstack | Launchpad bug 1654032 in tripleo "HA job ping test unstable" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 20:11 |
| EmilienM | bnemec: I think carlos is on pto, we probably assign the bug to someone else :D | 20:11 |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 20:12 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-pacemaker: WIP Do not operate on the live CIB with pcs commands https://review.openstack.org/417171 | 20:13 |
| jidar | is stdout not captured for commands that completed successfully in PostConfiguration? | 20:13 |
| jidar | I'm getting a bunch of : {u'deploy_stderrs': None, u'deploy_stdouts': None, u'deploy_status_codes': None} | 20:14 |
| jidar | when I know there was output | 20:14 |
| jidar | ie: puppet runs even on success output something | 20:14 |
| jidar | failures seem to populate these fields, but it's a chore to investigate this stuff | 20:15 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Nova Placement API composable service https://review.openstack.org/406397 | 20:16 |
| jidar | ie: stack failures list | 20:16 |
| *** bfournie has quit IRC | 20:16 | |
| EmilienM | slagle: I'm having some issues because https://github.com/openstack-infra/tripleo-ci/blob/master/test-environments/multinode.yaml and other multinode are in tripleo-ci and not in THT with other scenarios | 20:19 |
| openstackgerrit | Merged openstack/instack-undercloud: Explicitly open port 443 for the TripleO UI https://review.openstack.org/416246 | 20:20 |
| EmilienM | slagle: for ex, i'm trying to remove Glance Registry service but I can't without patching first tripleo-ci with some hacks in the template. | 20:20 |
| openstackgerrit | Merged openstack/instack-undercloud: H803 hacking have been deprecated https://review.openstack.org/413925 | 20:20 |
| EmilienM | slagle: what do you think if I try to move them to tht? | 20:20 |
| dmsimard | EmilienM: this ends up in a couple places, amongst which is tripleo -- do you know why ? It looks like that ends up configuring the default eth0 MTU inside virtual machines to 1400 ? | 20:20 |
| dmsimard | http://codesearch.openstack.org/?q=dhcp-option-force%3D26%2C1400&i=nope&files=&repos= | 20:20 |
| EmilienM | slagle: in https://github.com/openstack/tripleo-heat-templates/tree/master/ci/environments | 20:20 |
| EmilienM | dmsimard: GRE overhead when running virtual baremetal i think | 20:21 |
| dmsimard | I just figured out a weird MTU-related issue when doing SSL transactions inside docker (kolla) containers | 20:21 |
| dmsimard | because the host is at 1500, the vm is at 1400 and the container inside the vm is by default at 1500 | 20:21 |
| dmsimard | I can work around the issue by setting the docker container MTU to 1200 or something | 20:22 |
| EmilienM | most of switches (physical or virtual) are limited to 1500 bytes but since we're using VXLAN or GRE for encapsulation, we need to reduce the MTU | 20:22 |
| dmsimard | well yeah unless you're using 9000 (jumbo frames) | 20:23 |
| dmsimard | okay.. I'll work with a smaller MTU inside containers for the time being | 20:23 |
| dmsimard | I'm curious how the nova compute tripleo container is working right now | 20:23 |
| slagle | EmilienM: i'm indifferent really. i wasnt thrilled with moving ci things to tht in the first place | 20:23 |
| EmilienM | 50 bytes should be enough | 20:23 |
| dmsimard | mandre: are you around ? | 20:23 |
| EmilienM | but IIRC people put 100 in case | 20:23 |
| dmsimard | rhallisey: or maybe you are around? :) | 20:23 |
| EmilienM | https://keepingitclassless.net/2014/03/mtu-considerations-vxlan/ | 20:23 |
| slagle | EmilienM: so do what you have to do | 20:23 |
| EmilienM | slagle: ack | 20:24 |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 20:24 |
| EmilienM | slagle: can you explain why we have a firewall rule in multinode-core.yaml ? | 20:26 |
| EmilienM | slagle: this firewall rule is managed in tripleo services, isn't? | 20:26 |
| EmilienM | is it required at an early step? | 20:26 |
| slagle | yes no maybe so? | 20:27 |
| *** bvandenh has quit IRC | 20:27 | |
| EmilienM | I'm curious why it's there | 20:27 |
| *** rasca has quit IRC | 20:28 | |
| slagle | it's for the vxlan tunnels | 20:28 |
| *** shinobu___ has quit IRC | 20:29 | |
| slagle | for the private networking setup | 20:29 |
| slagle | that is a CI thing, so i don't know why we would have it in tripleo-heat-templates | 20:29 |
| slagle | but i don't think i necessary understand tripleo-ci vs tripleo-heat-templates | 20:30 |
| *** pabelanger has joined #tripleo | 20:31 | |
| EmilienM | slagle: if you look at this patch: https://review.openstack.org/#/c/417109/ - I'm trying to remove Glance Registry and it fails because the multinode scenario (in tripleo-ci) is using this service. So I need to do some magic in tripleo-ci multinode scenario instead of just patching the file in-tree, like I did for scenario001,002, etc | 20:31 |
| pabelanger | Where can I find the logs for diskimage-builder in http://logs.openstack.org/68/413868/9/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/eb55a4f/console.html.gz ? | 20:32 |
| pabelanger | disk-image-create failed, and I need to debug why | 20:32 |
| EmilienM | pabelanger: here? http://logs.openstack.org/68/413868/9/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/eb55a4f/logs/undercloud/var/log/image_build.txt.gz | 20:33 |
| slagle | EmilienM: this firewall rule doesn't have anything to do with glance registry | 20:33 |
| slagle | i dont think you need to change this | 20:33 |
| EmilienM | slagle: right. I guess I'll just move the other envs, that contain services, like GlanceRegistry, etc | 20:33 |
| pabelanger | EmilienM: Do you know where the output of diskimage-builder is logged? Need to find out the reason for exit status 126 | 20:34 |
| EmilienM | pabelanger: I don't :( | 20:34 |
| slagle | EmilienM: ok. wfm | 20:36 |
| ansiwen | EmilienM: thanks for the review | 20:37 |
| ansiwen | EmilienM: did you see the comments regarding metadata as a separate service before? | 20:38 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Add custom roles data for deployed-server https://review.openstack.org/410390 | 20:38 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Set rabbitmq package_provider to yum https://review.openstack.org/411471 | 20:38 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Deployed server bootstrap via Heat https://review.openstack.org/411445 | 20:38 |
| EmilienM | ansiwen: no | 20:38 |
| ansiwen | EmilienM: andrey pavlov confirmed, that it makes no sense to ever run these services separately, that's why I didn't do it. shardy was commenting on it as well... so, I can do it of course... just wanted to mention it was a topic before | 20:41 |
| ansiwen | EmilienM: also there is tester commit... so it is actually tested already... and failing... trying to understand that now | 20:41 |
| EmilienM | ansiwen: it sounds weird though, in a container world where 1 container & 1 app | 20:42 |
| *** dbecker has joined #tripleo | 20:42 | |
| ansiwen | that's the tester: https://review.openstack.org/#/c/406167 | 20:42 |
| *** bvandenh has joined #tripleo | 20:43 | |
| ansiwen | EmilienM: sure... if that's the intention, to let it run in separate containers, then I completely agreee.... | 20:43 |
| ansiwen | EmilienM: you probably immediately have an idea what's wrong: Ec2api::Db::Sync/Exec[ec2api_db_sync]/returns: ERROR: (sqlite3.OperationalError) unable to open database file | 20:46 |
| jidar | hurm, can't filter on stack_name | 20:47 |
| ansiwen | EmilienM: http://logs.openstack.org/67/406167/5/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/722011e/logs/postci.txt.gz#_2017-01-03_17_49_29_000 | 20:47 |
| *** bvandenh has quit IRC | 20:48 | |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates: Remove unused pacemaker profiles https://review.openstack.org/412214 | 20:48 |
| ansiwen | mwhahaha: didn't you add that sync? so it only creates the schema, but not the database itself? I probably have to add the creation somewhere as well... | 20:48 |
| *** bfournie has joined #tripleo | 20:49 | |
| mwhahaha | ansiwen: https://github.com/openstack/puppet-ec2api/blob/master/manifests/db/mysql.pp creates the db (and user) | 20:49 |
| mwhahaha | ansiwen: also if you notice that's a sqlite error, so that means it didn't get the mysql configuration | 20:50 |
| ansiwen | mwhahaha: so, is there a dependency missing? to make sure the mysql stuff is in place? | 20:51 |
| mwhahaha | ansiwen: well that error indicates you didn't configure the mysql connection information correctly in the sync | 20:52 |
| *** flepied has quit IRC | 20:52 | |
| mwhahaha | ansiwen: so i think you're missing something in the ec2-api.yaml | 20:53 |
| *** dbecker has quit IRC | 20:55 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras: Parametrize containers compute DNS https://review.openstack.org/416988 | 20:57 |
| ansiwen | mwhahaha: you mean in the service_config_settings section? | 20:57 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras: undercloud-setup: Add SSH arguments to multinode vxlan subnode setup https://review.openstack.org/417040 | 20:58 |
| mwhahaha | ansiwen: possibly, not sure I haven't looked too hard but the error indicates that it's falling back to the defaults of a sqlite backend for ec2api. So you still need something to write out the configuration on the database system to make sure it knows how to sync. | 20:58 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras: undercloud-setup: Add a timeout to SSH for multinode vxlan setup https://review.openstack.org/417103 | 20:59 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras: repo_setup: Add sudo to specific commands for non-root running https://review.openstack.org/417107 | 20:59 |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 21:00 |
| EmilienM | bnemec: http://logs.openstack.org/06/416706/8/check/gate-tripleo-ci-centos-7-nonha-multinode/d78c6ee/logs/subnode-2/var/log/host_info.txt.gz | 21:00 |
| EmilienM | better :D | 21:00 |
| EmilienM | look ip6tables | 21:01 |
| *** lblanchard has quit IRC | 21:01 | |
| EmilienM | bnemec: I have a last patchset for cleanup & we should we ready | 21:02 |
| *** nyechiel has quit IRC | 21:02 | |
| bnemec | EmilienM: Cool. It got my local ipv6 deployment to finish too. | 21:03 |
| *** nyechiel has joined #tripleo | 21:04 | |
| openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates: Create NIC templates for Neutron Networker composable role https://review.openstack.org/400390 | 21:07 |
| *** bvandenh has joined #tripleo | 21:07 | |
| *** ooolpbot has joined #tripleo | 21:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1646750 | 21:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1653735 | 21:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654032 | 21:11 |
| *** ooolpbot has quit IRC | 21:11 | |
| openstack | Launchpad bug 1646750 in tripleo "CI: periodic jobs fail to upload test image to overcloud glance" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 21:11 |
| openstack | Launchpad bug 1653735 in tripleo "OVB updates job timing out consistently" [Critical,In progress] - Assigned to Carlos Camacho (ccamacho) | 21:11 |
| openstack | Launchpad bug 1654032 in tripleo "HA job ping test unstable" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 21:11 |
| *** nyechiel has quit IRC | 21:13 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: firewall: add IPv6 support https://review.openstack.org/416706 | 21:14 |
| EmilienM | bnemec: et voilà ^ | 21:14 |
| bnemec | EmilienM: You just killed the ovb updates job on the previous patch set. :-/ | 21:15 |
| EmilienM | bnemec: oops | 21:17 |
| bnemec | EmilienM: Also, does this still handle the pre and post rules? | 21:17 |
| bnemec | I guess this one is different enough that it's probably worth CI'ing in its own right anyway. | 21:18 |
| ansiwen | what is the difference between service_config and service_config_settings again? what has to go into the second? | 21:18 |
| EmilienM | bnemec: yeah I removed useless stuffs | 21:18 |
| EmilienM | bnemec: thanks to your idea of undefing | 21:18 |
| bnemec | EmilienM: Okay, will await the CI results. This should fix the updates job. | 21:19 |
| EmilienM | bnemec: should we approve https://review.openstack.org/#/c/416974/2 so we theorically remove one blocker? | 21:19 |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-quickstart-extras: Add composable upgrade workflow for tripleo-quickstart https://review.openstack.org/416480 | 21:20 |
| bnemec | EmilienM: FFS, that patch failed on the 504 again. >:-( | 21:21 |
| EmilienM | bnemec: yeah I don't know what is this 504 thing | 21:22 |
| EmilienM | bnemec: i'm wondering if we should add --debug to all cli things we do in pingtest | 21:22 |
| EmilienM | these things are usually hard to debug tbh | 21:22 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras: ensure that each role in extras has a dependency on extras-common https://review.openstack.org/413800 | 21:22 |
| bnemec | EmilienM: On the other hand, https://review.openstack.org/#/c/416716/ passed the ha job at least twice so we know the revert helps. | 21:22 |
| bnemec | pabelanger: It's a bug. We're getting no image build output right now: https://bugs.launchpad.net/tripleo/+bug/1653768 | 21:24 |
| openstack | Launchpad bug 1653768 in tripleo "tripleoclient not logging image build output" [High,Triaged] | 21:24 |
| bnemec | I've been too busy chasing crits this week to look further into it. | 21:24 |
| bnemec | I _believe_ I pointed that out on the original patch to switch to yaml image building and was told it would be looked in to. | 21:24 |
| pabelanger | bnemec: ty ty | 21:25 |
| bnemec | I don't have a workaround at this point either, which is unfortunate because I too have an image related patch that's failing to build. | 21:26 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras: ensure extras-common depends on tq common https://review.openstack.org/417195 | 21:26 |
| EmilienM | right, if someone can approve https://review.openstack.org/#/c/416974 -- it would help | 21:27 |
| *** jkilpatr_ has quit IRC | 21:27 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras: ensure that each role in extras has a dependency on extras-common https://review.openstack.org/413800 | 21:28 |
| EmilienM | dprince, slagle, thrash ^ fyi | 21:30 |
| dprince | EmilienM: https://review.openstack.org/#/c/416974/2 +2 | 21:32 |
| dprince | EmilienM: fire when ready | 21:32 |
| EmilienM | ok, firing it now, so we can "remove" one of our blockers | 21:32 |
| EmilienM | neutron folks are working on the bug anyway | 21:33 |
| *** akrivoka has quit IRC | 21:34 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Nova Placement API composable service https://review.openstack.org/406397 | 21:36 |
| openstackgerrit | Merged openstack/tripleo-docs: Add swift-recon example for Swift https://review.openstack.org/389999 | 21:37 |
| *** bvandenh has quit IRC | 21:37 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-common: add mandre's pull puppet modules scripts that pulls the latest puppet src https://review.openstack.org/416355 | 21:40 |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 21:41 |
| *** ansmith has quit IRC | 21:42 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras: undercloud-setup: Add SSH arguments to multinode vxlan subnode setup https://review.openstack.org/417040 | 21:42 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras: undercloud-setup: Add a timeout to SSH for multinode vxlan setup https://review.openstack.org/417103 | 21:43 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras: repo_setup: Add sudo to specific commands for non-root running https://review.openstack.org/417107 | 21:43 |
| *** shinobu_ has quit IRC | 21:47 | |
| openstackgerrit | Merged openstack/tripleo-docs: Update basic deployment commands for Newton https://review.openstack.org/387671 | 21:48 |
| openstackgerrit | Sven Anderson proposed openstack/tripleo-heat-templates: Add ec2-api service https://review.openstack.org/398634 | 21:48 |
| openstackgerrit | Sven Anderson proposed openstack/tripleo-heat-templates: DON'T MERGE - tester for I2510fd4ed935d8423216fff9ce3adf2d69c9c804 https://review.openstack.org/406167 | 21:48 |
| EmilienM | weshay, mandre, dprince: what is that https://review.openstack.org/#/c/416355/ ? I think it's terrible to hardcode the name of the modules. | 21:48 |
| weshay | EmilienM, you can pass it as well | 21:48 |
| weshay | EmilienM, what you like to see? | 21:48 |
| EmilienM | weshay: why not pulling rpms? | 21:49 |
| *** leanderthal has quit IRC | 21:49 | |
| dprince | EmilienM: RPM don't give developers git history | 21:49 |
| dprince | EmilienM: I already have my own version of this locally. | 21:49 |
| EmilienM | well, the commit message doesn't explain the motivation of such a patch | 21:50 |
| dprince | EmilienM: what mandre has here is more generic and could be shared by developers who prefer to follow "the edge" of puppet development w/ TripleO | 21:50 |
| dprince | EmilienM: I like it | 21:50 |
| dmsimard | sounds to me like r10k and Puppetfile already solves that problem and it didn't need to be written in bash but /me shrugs | 21:50 |
| EmilienM | dprince: you might like it but it's not obvious what it does | 21:50 |
| EmilienM | weshay: be more specific in your commit message, it would help! | 21:50 |
| dprince | dmsimard: if there are packages for those, then the script could use that | 21:51 |
| EmilienM | weshay: also, why tripleo-common? | 21:51 |
| dprince | dmsimard: I don't really care, but given the lay of the land Shell scripts work just as well I think without pullet down extra deps | 21:51 |
| *** liverpooler has quit IRC | 21:51 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add gate-tripleo-ci-centos-7-3nodes-multinode-nv ci status page https://review.openstack.org/417203 | 21:51 |
| dprince | EmilienM: tripleo-common because that is where upload-puppet-modules is I think | 21:51 |
| EmilienM | and haven't you found a way to pull all puppet modules? | 21:52 |
| EmilienM | instead of hardcoding them | 21:52 |
| dmsimard | dprince: I don't have a strong opinion, just saying that bash script is basically r10k+Puppetfile rewritten in bash | 21:52 |
| weshay | EmilienM, it sits right next to the upload puppet module script that is already in tripleo-common | 21:52 |
| EmilienM | fair enough. ok. Just don't hardcode the modules | 21:52 |
| dprince | EmilienM: regardless of tooling we have to have a list of the puppet modules we use somewhere | 21:53 |
| dprince | EmilienM: if you have a better place for that then I think making the script use it would be easy enough now or in a follow up patch | 21:53 |
| EmilienM | dprince: we already have that list | 21:53 |
| EmilienM | https://github.com/openstack/puppet-openstack-integration/blob/master/openstack_modules.txt | 21:53 |
| EmilienM | this list is always updated, versus your list that is not | 21:53 |
| dprince | EmilienM: that isn't TripleO | 21:53 |
| dprince | EmilienM: mandre's list is for TripleO | 21:53 |
| weshay | EmilienM, perfect.. I'll use that | 21:53 |
| EmilienM | cool. | 21:54 |
| EmilienM | dprince: not a big deal, worst case you'll have more modules | 21:54 |
| EmilienM | dprince: look at the list | 21:54 |
| dprince | weshay: do note my comment about that file not matching TripleO's list puppet modules | 21:54 |
| dprince | weshay: the extra bloat might not be a good thing for some | 21:54 |
| *** thrash has quit IRC | 21:55 | |
| weshay | ok.. I could have a switch on which list to use | 21:55 |
| weshay | atm you can use the default, or pass a list | 21:55 |
| * weshay looks at it a bit more | 21:55 | |
| ansiwen | mwhahaha: indeed I didn't set ec2api::db::database_connection | 21:55 |
| mwhahaha | ansiwen: that'd do it | 21:55 |
| *** shinobu_ has joined #tripleo | 21:56 | |
| weshay | EmilienM, my motivation for checking this into tripleo-common was that it's part of the container setup in some scenarios and included in the ci. So I wanted to take out the pull from mandres personal git repo and get it into the tripleo-common rpm | 21:57 |
| EmilienM | weshay: cool, wfm. Just use https://github.com/openstack/puppet-openstack-integration/blob/master/openstack_modules.txt and I'm fine | 21:57 |
| EmilienM | I don't support the idea of maintaining yet another list | 21:57 |
| *** trown is now known as trown|outtypewww | 21:57 | |
| *** dprince has quit IRC | 21:58 | |
| mandre | EmilienM: that makes sense, but what about a list modules we want to exclude from the maintained openstack_modules.txt list? | 21:59 |
| mandre | dmsimard: here now | 22:00 |
| dmsimard | mandre: all good, figured it out in the meantime | 22:00 |
| dmsimard | mandre: see my last comment in the kolla/RDO card if you're curious what it was about :) | 22:00 |
| mandre | dmsimard: cool, all you had to do is give it more time :) | 22:01 |
| *** thrash has joined #tripleo | 22:01 | |
| *** thrash has quit IRC | 22:01 | |
| *** thrash has joined #tripleo | 22:01 | |
| dmsimard | Spent way too much time on that though :( | 22:01 |
| EmilienM | mandre: feel free to maintain your own list... it's just useless. | 22:02 |
| mandre | dmsimard: ohhhhh MTU | 22:02 |
| dmsimard | ohhhhhhhh :P | 22:02 |
| EmilienM | you'll save 3 seconds on cloning a few more modules and what? | 22:02 |
| EmilienM | you'll save breakages etc in using our list | 22:02 |
| EmilienM | at the time we add more service in tripleo, your script will be broken | 22:02 |
| EmilienM | you choose what? | 22:02 |
| *** dbecker has joined #tripleo | 22:03 | |
| mandre | EmilienM: your list is fine :) I admit I didn't know about it when I originally wrote my script | 22:04 |
| EmilienM | no worries | 22:04 |
| EmilienM | I'm trying to help you to save time here | 22:04 |
| EmilienM | and the "extras bloat" that dprince was saying is really low. | 22:05 |
| EmilienM | it's a matter or 5 git repos | 22:05 |
| EmilienM | s/or/of/ | 22:05 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: multinode: remove Glance registry service deployment https://review.openstack.org/417212 | 22:06 |
| weshay | I'm taking care of it :) | 22:09 |
| *** saneax-_-|AFK is now known as saneax | 22:09 | |
| *** jkilpatr_ has joined #tripleo | 22:10 | |
| *** ooolpbot has joined #tripleo | 22:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1646750 | 22:11 |
| openstack | Launchpad bug 1646750 in tripleo "CI: periodic jobs fail to upload test image to overcloud glance" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 22:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1653735 | 22:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654032 | 22:11 |
| *** ooolpbot has quit IRC | 22:11 | |
| openstack | Launchpad bug 1653735 in tripleo "OVB updates job timing out consistently" [Critical,In progress] - Assigned to Carlos Camacho (ccamacho) | 22:11 |
| openstack | Launchpad bug 1654032 in tripleo "HA job ping test unstable" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 22:11 |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: Remove Glance Registry from undercloud https://review.openstack.org/417214 | 22:12 |
| *** fultonj has quit IRC | 22:16 | |
| *** Goneri has quit IRC | 22:21 | |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata https://review.openstack.org/404831 | 22:23 |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci: Fix REPO_PREFIX handling of ceph repos https://review.openstack.org/409814 | 22:23 |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci: Collect the deploy.env with the logs and add some data https://review.openstack.org/417218 | 22:23 |
| EmilienM | bnemec: http://logs.openstack.org/09/417109/1/check/gate-tripleo-ci-centos-7-scenario001-multinode/bad2459/console.html#_2017-01-05_18_14_06_198687 | 22:25 |
| EmilienM | do you think this error happens when deploying the heat template (pingtest) or osc? | 22:26 |
| EmilienM | it sounds like heat | 22:26 |
| *** saneax is now known as saneax-_-|AFK | 22:26 | |
| bnemec | EmilienM: That's interesting. I don't think I've seen that one before. | 22:26 |
| bnemec | Picked an appropriate short uuid though: bad2459 | 22:27 |
| EmilienM | bnemec: it's related to my work on removing glance registry | 22:27 |
| *** shardy_ has joined #tripleo | 22:27 | |
| EmilienM | bnemec: https://review.openstack.org/#/c/417109/1 | 22:27 |
| bnemec | EmilienM: Is it possible that heat is still using glance v1? | 22:27 |
| EmilienM | I would be surprised | 22:28 |
| EmilienM | bnemec: but do you know if what happens on this line is on a heat stack create or glance image-create? | 22:28 |
| *** shardy_ has quit IRC | 22:28 | |
| EmilienM | to me it sounds like heat tries to boot an image from volume and can't reach Glance | 22:28 |
| slagle | EmilienM: fyi, the 3 nodes is currently red, but this patch fixes it: https://review.openstack.org/#/c/416726/ | 22:28 |
| EmilienM | and sounds like it tries to reach v1 (that i'm trying to remove) | 22:29 |
| slagle | you already reviewed it, but just fyi | 22:29 |
| bnemec | EmilienM: Should be in heat, since it's right after the "tripleo.sh -- Overcloud pingtest, creating tenant-stack heat stack:" log message. | 22:29 |
| shardy | slagle: sanity check https://github.com/openstack-infra/tripleo-ci/blob/master/toci_instack_osinfra.sh#L98 | 22:29 |
| EmilienM | slagle: thx for the heads up, approving it now. | 22:29 |
| shardy | shouldn't that be --multinode-setup ? | 22:29 |
| slagle | insane | 22:29 |
| bnemec | EmilienM: Maybe cinder is using the old api. | 22:30 |
| EmilienM | bnemec: yeah | 22:30 |
| slagle | shardy: yea...but i've noticed that getopt doesnt seem to care! | 22:30 |
| * EmilienM investigates | 22:30 | |
| shardy | slagle: weird, it doesn't work for me locally | 22:30 |
| shardy | slagle: I'll push a patch which aligns it | 22:30 |
| EmilienM | where are cinder logs? http://logs.openstack.org/09/417109/1/check/gate-tripleo-ci-centos-7-scenario001-multinode/bad2459/logs/var/log/ | 22:30 |
| slagle | shardy: odd, it does for me | 22:31 |
| EmilienM | bnemec: oh we don't have it. Wth | 22:31 |
| bnemec | EmilienM: Something definitely requested v1: HEAD /v1/images/pingtest_image HTTP/1.1 | 22:31 |
| bnemec | http://logs.openstack.org/09/417109/1/check/gate-tripleo-ci-centos-7-scenario001-multinode/bad2459/logs/subnode-2/var/log/glance/api.txt.gz#_2017-01-05_18_14_06_182 | 22:31 |
| EmilienM | bnemec: nevermind, we do have it. Doc is wrong | 22:31 |
| EmilienM | yeah | 22:32 |
| bnemec | I'm not sure where the cinder api logs are though. That's very strange. | 22:32 |
| EmilienM | yep | 22:32 |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci: Correct tripleo.sh --multinode-setup syntax https://review.openstack.org/417223 | 22:32 |
| shardy | slagle: oh wait, you're right, it does work, the error I was seeing wasn't related | 22:33 |
| shardy | anyway, would be good to align as it made my grep-fu fail :) | 22:34 |
| *** saneax-_-|AFK is now known as saneax | 22:34 | |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci: Correct tripleo.sh --multinode-setup syntax https://review.openstack.org/417223 | 22:35 |
| EmilienM | bnemec: glance_api_version is set to 2 in cinder.conf | 22:36 |
| openstackgerrit | Merged openstack/instack-undercloud: Install also Cinder V2 and V3 endpoints when Cinder is enabled https://review.openstack.org/416680 | 22:36 |
| openstackgerrit | Feng Pan proposed openstack/puppet-tripleo: Adds etcd https://review.openstack.org/414730 | 22:37 |
| EmilienM | bnemec: cinder api logs are in apache | 22:40 |
| EmilienM | and there is nothing useful :( | 22:40 |
| slagle | shardy: getopt is really weird. it seems it autocompletes partial option names for you | 22:41 |
| EmilienM | mwhahaha, bnemec: found it I think, it's in heat engine | 22:42 |
| slagle | --overcloud-d will do --overcloud-deploy, etc | 22:42 |
| slagle | /shrug | 22:42 |
| EmilienM | mwhahaha, bnemec: it sounds like heat engine use glance v1 in volume resource (to create a volume from an image here: https://github.com/openstack-infra/tripleo-ci/blob/master/templates/tenantvm_floatingip.yaml#L82) | 22:44 |
| mwhahaha | that's annoying | 22:44 |
| bnemec | slagle: argparse does too. That's why our image build broke for a while when another project added an option that was a substring of one of ours. | 22:45 |
| EmilienM | bnemec, mwhahaha: http://logs.openstack.org/09/417109/1/check/gate-tripleo-ci-centos-7-scenario001-multinode/bad2459/logs/subnode-2/var/log/heat/heat-api.txt.gz#_2017-01-05_18_14_06_189 | 22:45 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-common: add mandre's pull puppet modules scripts that pulls the latest puppet src https://review.openstack.org/416355 | 22:47 |
| *** Vijayendra has joined #tripleo | 22:52 | |
| EmilienM | shardy: if you're still around, do you know if heat tries to use v1 api in glance when creating a volume from an image? | 22:53 |
| EmilienM | shardy: I looked in code and failed to find out | 22:53 |
| EmilienM | it's pretty clear heat engine tries v1: http://logs.openstack.org/09/417109/1/check/gate-tripleo-ci-centos-7-scenario001-multinode/bad2459/logs/subnode-2/var/log/heat/heat-engine.txt.gz#_2017-01-05_18_14_06_183 | 22:54 |
| *** saneax is now known as saneax-_-|AFK | 22:54 | |
| EmilienM | I found out that GlanceClientPlugin class has default_version = V1 | 22:55 |
| *** jcoufal has quit IRC | 22:56 | |
| EmilienM | zaneb: any idea ^? | 22:56 |
| shardy | EmilienM: yeah IIRC we got stuck with v1 because glance did some backwards incompatible things which meant we'd break existing templates if we switched to v2 by default | 22:56 |
| * shardy finds links | 22:57 | |
| EmilienM | ok so I'm not crazy. pingtest was using v1 | 22:57 |
| EmilienM | https://blueprints.launchpad.net/heat/+spec/migrate-to-glance-v2 | 22:57 |
| EmilienM | still under discussion | 22:57 |
| EmilienM | v1 is deprecated! | 22:57 |
| shardy | https://review.openstack.org/#/c/240450/ | 22:57 |
| shardy | Yeah I'm not sure what the current status is tbh | 22:58 |
| shardy | therve or ramishra may know | 22:58 |
| EmilienM | ok it means we need to remove this resource from the pingtest or we'll never be able to remove glance v1 | 22:58 |
| EmilienM | the intent is to remove glance registry from tripleo, a request from container folks | 22:59 |
| shardy | EmilienM: Ok, we can just use the CLI to manage the image and pass the ID into the pingtest stack | 22:59 |
| EmilienM | shardy: problem is that not all scenarios have cinder | 22:59 |
| EmilienM | that's why having all things in the pingtest was nice | 22:59 |
| EmilienM | remember, each scenario has its own pingtest | 22:59 |
| EmilienM | so we might need to hack something :( | 22:59 |
| *** pmannidi has joined #tripleo | 23:00 | |
| EmilienM | http://developer.openstack.org/api-ref/image/v1/index.html is deprecated in Newton FYI | 23:03 |
| shardy | Yeah sounds like we'll have to fix it in heat this cycle one way or another | 23:04 |
| *** saneax-_-|AFK is now known as saneax | 23:05 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Allow all tcp ports at the end of postci https://review.openstack.org/414342 | 23:07 |
| EmilienM | shardy: I asked on ML the status | 23:08 |
| shardy | EmilienM: ack, sounds good, thanks! | 23:09 |
| EmilienM | shardy: thanks to you! | 23:09 |
| *** ooolpbot has joined #tripleo | 23:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1646750 | 23:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1653735 | 23:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1654032 | 23:11 |
| *** ooolpbot has quit IRC | 23:11 | |
| openstack | Launchpad bug 1646750 in tripleo "CI: periodic jobs fail to upload test image to overcloud glance" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 23:11 |
| openstack | Launchpad bug 1653735 in tripleo "OVB updates job timing out consistently" [Critical,In progress] - Assigned to Carlos Camacho (ccamacho) | 23:11 |
| openstack | Launchpad bug 1654032 in tripleo "HA job ping test unstable" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 23:11 |
| *** saneax is now known as saneax-_-|AFK | 23:16 | |
| *** iranzo has quit IRC | 23:17 | |
| dmsimard | leifmadsen: containers are finally building, I have to head out before I digest myself | 23:20 |
| *** saneax-_-|AFK is now known as saneax | 23:26 | |
| leifmadsen | dmsimard: great plan! | 23:26 |
| leifmadsen | I finally have my browbeat+oooq remote deploy running | 23:26 |
| leifmadsen | and I scheduled time for kolla building tomorrow | 23:27 |
| *** absubram has quit IRC | 23:28 | |
| *** shardy has quit IRC | 23:34 | |
| dmsimard | leifmadsen: http://paste.openstack.org/show/594074/ | 23:36 |
| dmsimard | (what's built so far) | 23:36 |
| dmsimard | looks like I'm going to have to filter the list of containers that I build, most of those aren't relevant to us, at least for the time being | 23:37 |
| leifmadsen | dmsimard: a mapping of containers to available RPMs / projects in RDO might be neat :) | 23:37 |
| dmsimard | I don't follow | 23:38 |
| dmsimard | but my food's ready, talk to you later :P | 23:39 |
| dhill_ | foood | 23:39 |
| dhill_ | hmmmm | 23:39 |
| *** chem has quit IRC | 23:40 | |
| EmilienM | bnemec: Overcloud pingtest SUCCEEDED | 23:40 |
| EmilienM | bnemec: on update job :) | 23:40 |
| EmilienM | at least something that works | 23:40 |
| EmilienM | mwhahaha: when you have some time, please look https://review.openstack.org/#/c/416706/ | 23:41 |
| dhill_ | https://bugs.launchpad.net/tripleo/+bug/1649124 | 23:42 |
| openstack | Launchpad bug 1649124 in tripleo "Failure to launch neutron-openvswitch-agent after tripleo deployment" [Undecided,New] | 23:42 |
| dhill_ | It's starting | 23:42 |
| dhill_ | but it dies | 23:42 |
| dhill_ | and I found a "patch" that bring me farther but then we die on selinux ... | 23:42 |
| *** saneax is now known as saneax-_-|AFK | 23:43 | |
| dhill_ | that I've patched too | 23:43 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Merge mysql service_config_settings for nova https://review.openstack.org/416726 | 23:51 |
| *** saneax-_-|AFK is now known as saneax | 23:54 | |
| jidar | baremetal configure boot knocks off the properties/capabilities profile? | 23:57 |
| jidar | :( | 23:57 |
| dhill_ | jidar I'm pretty sure it does | 23:58 |
| jidar | that's a pain, especially considering the server uuid already has what it needs there | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!