| *** gbarros has joined #tripleo | 00:01 | |
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
|---|---|---|
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721366 | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1721366 in tripleo "Keystone v2.0 APIs have been removed, TripleO config is incomplete" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles) | 00:10 |
| *** bfournie has joined #tripleo | 00:10 | |
| *** bfournie has quit IRC | 00:11 | |
| *** ecerquei has joined #tripleo | 00:15 | |
| *** raildo has joined #tripleo | 00:23 | |
| *** achadha_ has joined #tripleo | 00:29 | |
| *** raildo has quit IRC | 00:30 | |
| *** achadha has quit IRC | 00:32 | |
| *** achadha_ has quit IRC | 00:33 | |
| *** achadha has joined #tripleo | 00:49 | |
| *** achadha has quit IRC | 00:53 | |
| *** tzumainn has quit IRC | 01:04 | |
| *** jkilpatr has quit IRC | 01:06 | |
| *** raildo has joined #tripleo | 01:06 | |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721366 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1721366 in tripleo "Keystone v2.0 APIs have been removed, TripleO config is incomplete" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles) | 01:10 |
| *** openstackstatus has quit IRC | 01:14 | |
| *** openstackstatus has joined #tripleo | 01:17 | |
| *** ChanServ sets mode: +v openstackstatus | 01:17 | |
| *** achadha has joined #tripleo | 01:19 | |
| *** achadha has quit IRC | 01:23 | |
| *** achadha has joined #tripleo | 01:23 | |
| *** adarazs has quit IRC | 01:25 | |
| *** adarazs has joined #tripleo | 01:26 | |
| *** achadha has quit IRC | 01:28 | |
| *** achadha has joined #tripleo | 01:29 | |
| *** achadha has quit IRC | 01:30 | |
| *** achadha has joined #tripleo | 01:30 | |
| *** dmacpher has joined #tripleo | 01:33 | |
| *** achadha has quit IRC | 01:35 | |
| *** d0ugal has quit IRC | 01:45 | |
| *** d0ugal has joined #tripleo | 01:46 | |
| *** tongl has quit IRC | 01:54 | |
| *** yamahata has quit IRC | 01:55 | |
| *** portdirect has quit IRC | 02:04 | |
| *** sdake has quit IRC | 02:04 | |
| *** portdirect has joined #tripleo | 02:05 | |
| *** threestrands_ has joined #tripleo | 02:05 | |
| *** apetrich has quit IRC | 02:06 | |
| *** lyarwood has quit IRC | 02:06 | |
| *** bandini has quit IRC | 02:08 | |
| *** lyarwood has joined #tripleo | 02:08 | |
| *** threestrands has quit IRC | 02:08 | |
| *** jistr has quit IRC | 02:08 | |
| *** assassin has quit IRC | 02:09 | |
| *** leseb has quit IRC | 02:09 | |
| *** leseb has joined #tripleo | 02:09 | |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721366 | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1721366 in tripleo "Keystone v2.0 APIs have been removed, TripleO config is incomplete" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles) | 02:10 |
| *** jistr has joined #tripleo | 02:10 | |
| *** bandini has joined #tripleo | 02:10 | |
| *** assassin has joined #tripleo | 02:10 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Collect mistral-ansible execution files from /tmp https://review.openstack.org/483867 | 02:11 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: ovn: Provide the option to configure the integration bridge https://review.openstack.org/508118 | 02:12 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Make the convert-image role more generic https://review.openstack.org/508868 | 02:12 |
| openstackgerrit | Merged openstack/instack-undercloud master: Revert "Configure all OpenStack services with default domain" https://review.openstack.org/509837 | 02:12 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: add pike release https://review.openstack.org/508198 | 02:12 |
| openstackgerrit | Merged openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/503679 | 02:12 |
| *** kambiz has quit IRC | 02:12 | |
| openstackgerrit | Merged openstack/instack-undercloud stable/pike: Explicitly set event publishers to panko and gnocchi https://review.openstack.org/509499 | 02:12 |
| *** sdake has joined #tripleo | 02:13 | |
| *** sdake is now known as Guest2849 | 02:13 | |
| *** kambiz has joined #tripleo | 02:14 | |
| *** bandini has quit IRC | 02:15 | |
| *** assassin has quit IRC | 02:15 | |
| *** apetrich has joined #tripleo | 02:15 | |
| *** bandini has joined #tripleo | 02:17 | |
| *** assassin has joined #tripleo | 02:17 | |
| *** achadha has joined #tripleo | 02:20 | |
| *** mgagne has quit IRC | 02:23 | |
| *** mgagne has joined #tripleo | 02:24 | |
| *** mgagne is now known as Guest66098 | 02:24 | |
| *** achadha has quit IRC | 02:25 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: Work with containers across builds https://review.openstack.org/509232 | 02:29 |
| *** sc has quit IRC | 02:35 | |
| *** mrunge has quit IRC | 02:38 | |
| *** sc has joined #tripleo | 02:38 | |
| *** sc is now known as Guest54207 | 02:38 | |
| *** assassin has quit IRC | 02:39 | |
| *** bandini has quit IRC | 02:39 | |
| *** mhenkel has quit IRC | 02:39 | |
| *** mhenkel has joined #tripleo | 02:40 | |
| *** bandini has joined #tripleo | 02:41 | |
| *** assassin has joined #tripleo | 02:41 | |
| *** mrunge has joined #tripleo | 02:41 | |
| *** jappleii__ has joined #tripleo | 02:54 | |
| *** threestrands_ has quit IRC | 02:57 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Create tempest role Member and creator https://review.openstack.org/507829 | 02:58 |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721366 | 03:10 |
| openstack | Launchpad bug 1721366 in tripleo "Keystone v2.0 APIs have been removed, TripleO config is incomplete" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles) | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| *** morazi has quit IRC | 03:10 | |
| *** snecklifter has joined #tripleo | 03:22 | |
| *** links has joined #tripleo | 03:32 | |
| EmilienM | mwhahaha: I'm still debugging v2/v3 thing | 03:34 |
| EmilienM | mwhahaha: I think mistral doesn't work | 03:34 |
| EmilienM | http://logs.openstack.org/41/509841/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq/11f0681/logs/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2017-10-05_21_45_51 | 03:35 |
| EmilienM | ERROR: Remote error: BadRequest need one of hex, bytes, bytes_le, fields, or int (HTTP 400) | 03:35 |
| EmilienM | mwhahaha: yeah found it, it's mistral for sure | 03:37 |
| EmilienM | http://logs.openstack.org/41/509841/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq/11f0681/logs/undercloud/var/log/mistral/executor.log.txt.gz#_2017-10-05_21_45_50_994 | 03:37 |
| EmilienM | something for thrash | 03:38 |
| *** udesale has joined #tripleo | 03:38 | |
| *** udesale has quit IRC | 03:38 | |
| EmilienM | still using v2 api | 03:38 |
| EmilienM | ok I think I got it | 03:39 |
| EmilienM | stupid typo, my fault | 03:41 |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud master: (retry) configure all OpenStack services with default domain https://review.openstack.org/509841 | 03:41 |
| * EmilienM blames himself | 03:41 | |
| *** snecklifter has quit IRC | 03:41 | |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud master: (retry) configure all OpenStack services with default domain https://review.openstack.org/509841 | 03:41 |
| *** pdeore has joined #tripleo | 03:42 | |
| *** udesale has joined #tripleo | 03:42 | |
| *** dpawar has joined #tripleo | 03:46 | |
| *** dbecker has quit IRC | 03:53 | |
| *** gbarros has quit IRC | 03:53 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: Config download support for all deployments https://review.openstack.org/508189 | 03:55 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: fs10: deploy steps with ansible https://review.openstack.org/508307 | 03:55 |
| *** gkadam has joined #tripleo | 04:01 | |
| *** ykarel has joined #tripleo | 04:02 | |
| *** dbecker has joined #tripleo | 04:08 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721366 | 04:10 |
| openstack | Launchpad bug 1721366 in tripleo "Keystone v2.0 APIs have been removed, TripleO config is incomplete" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| *** shreshtha has joined #tripleo | 04:11 | |
| *** tongl has joined #tripleo | 04:15 | |
| *** bnemec has quit IRC | 04:16 | |
| *** yamahata has joined #tripleo | 04:19 | |
| *** jaosorior has joined #tripleo | 04:21 | |
| *** Pranav has joined #tripleo | 04:28 | |
| *** _cairo has quit IRC | 04:29 | |
| *** ramishra has quit IRC | 04:35 | |
| *** ramishra has joined #tripleo | 04:36 | |
| *** skramaja has joined #tripleo | 04:48 | |
| *** udesale has quit IRC | 04:55 | |
| *** ecerquei has quit IRC | 04:58 | |
| *** pdeore_ has joined #tripleo | 05:02 | |
| *** pdeore has quit IRC | 05:04 | |
| *** psachin has joined #tripleo | 05:05 | |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721366 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1721366 in tripleo "Keystone v2.0 APIs have been removed, TripleO config is incomplete" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 05:10 |
| *** masco has quit IRC | 05:13 | |
| *** ratailor has joined #tripleo | 05:16 | |
| *** marios has joined #tripleo | 05:17 | |
| *** udesale has joined #tripleo | 05:18 | |
| *** yprokule has joined #tripleo | 05:24 | |
| *** masco has joined #tripleo | 05:25 | |
| *** masco has quit IRC | 05:26 | |
| *** masco has joined #tripleo | 05:26 | |
| *** jprovazn has joined #tripleo | 05:29 | |
| *** jbadiapa has joined #tripleo | 05:32 | |
| *** masco has quit IRC | 05:35 | |
| *** psahoo has joined #tripleo | 05:36 | |
| *** ykarel_ has joined #tripleo | 05:38 | |
| *** pdeore has joined #tripleo | 05:39 | |
| *** pdeore_ has quit IRC | 05:40 | |
| *** ykarel has quit IRC | 05:41 | |
| *** aditya_r has joined #tripleo | 05:42 | |
| *** pdeore_ has joined #tripleo | 05:46 | |
| *** raildo has quit IRC | 05:47 | |
| *** masco has joined #tripleo | 05:48 | |
| *** pdeore has quit IRC | 05:49 | |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-quickstart-extras master: WIP Initial autofencing support https://review.openstack.org/502297 | 05:54 |
| jaosorior | bandini: could you check this out https://review.openstack.org/#/c/509841/ | 05:55 |
| *** spectr has joined #tripleo | 05:56 | |
| *** dmacpher has quit IRC | 05:57 | |
| *** jaganathan has joined #tripleo | 05:57 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 06:00 |
| *** dparkes has joined #tripleo | 06:03 | |
| *** aditya_ra has joined #tripleo | 06:07 | |
| openstackgerrit | Merged openstack/python-tripleoclient master: Add undercloud hostname. https://review.openstack.org/508618 | 06:09 |
| *** mdnadeem has joined #tripleo | 06:09 | |
| *** janki has joined #tripleo | 06:09 | |
| *** aditya_r has quit IRC | 06:10 | |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721366 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1721366 in tripleo "Keystone v2.0 APIs have been removed, TripleO config is incomplete" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 06:10 |
| *** ykarel__ has joined #tripleo | 06:16 | |
| *** rcernin has joined #tripleo | 06:17 | |
| *** ykarel_ has quit IRC | 06:20 | |
| *** jappleii__ has quit IRC | 06:24 | |
| *** pcaruana has joined #tripleo | 06:24 | |
| *** akrivoka has joined #tripleo | 06:27 | |
| *** pgadiya has joined #tripleo | 06:27 | |
| *** karthiks has joined #tripleo | 06:28 | |
| *** aditya_ra has quit IRC | 06:28 | |
| *** aditya_r has joined #tripleo | 06:28 | |
| *** udesale has quit IRC | 06:31 | |
| *** dpawar has quit IRC | 06:32 | |
| *** udesale has joined #tripleo | 06:33 | |
| openstackgerrit | Cédric Jeanneret proposed openstack/puppet-tripleo master: Allow to override HAProxy global options. https://review.openstack.org/509397 | 06:35 |
| *** stendulker has joined #tripleo | 06:35 | |
| *** suuuper has joined #tripleo | 06:37 | |
| Tengu | (rebased repository) | 06:38 |
| *** dtantsur|afk has quit IRC | 06:40 | |
| *** dpawar has joined #tripleo | 06:40 | |
| *** dtantsur has joined #tripleo | 06:40 | |
| *** rcernin has quit IRC | 06:41 | |
| *** links has quit IRC | 06:42 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-pacemaker master: Add fence_compute stonith manifest https://review.openstack.org/506916 | 06:42 |
| *** rcernin has joined #tripleo | 06:44 | |
| openstackgerrit | Numan Siddique proposed openstack/tripleo-heat-templates master: TESTING ONLY... PLZ IGNORE https://review.openstack.org/509981 | 06:47 |
| *** tongl has quit IRC | 06:48 | |
| mandre | weshay: we're missing the fluentd image in tripleomaster registry, http://logs.openstack.org/72/507572/1/check/gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container/e0fbeb9/logs/undercloud/home/jenkins/overcloud_prep_containers.log.txt.gz#_2017-10-05_17_03_21 | 06:48 |
| mandre | trown|outtypewww: what do we need to do to get the fluentd image in the registry? how do you selectively build images ^^ | 06:51 |
| *** mandre is now known as mandre_afk | 06:51 | |
| *** Pranav has quit IRC | 06:55 | |
| Tengu | erf… | 06:56 |
| Tengu | http://logs.openstack.org/97/509397/3/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/d67f8e5/console.html#_2017-10-06_06_52_33_436723 apparently there's some DNS issue in the CI now. | 06:57 |
| *** links has joined #tripleo | 06:58 | |
| *** jtomasek has joined #tripleo | 06:59 | |
| *** ebarrera has joined #tripleo | 07:01 | |
| *** aditya_r has quit IRC | 07:02 | |
| *** aufi has joined #tripleo | 07:05 | |
| *** ebarrera has quit IRC | 07:07 | |
| *** ebarrera has joined #tripleo | 07:07 | |
| *** cylopez has joined #tripleo | 07:08 | |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721366 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1721366 in tripleo "Keystone v2.0 APIs have been removed, TripleO config is incomplete" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 07:10 |
| *** ffiore has joined #tripleo | 07:13 | |
| *** agurenko has joined #tripleo | 07:14 | |
| *** aditya_r has joined #tripleo | 07:15 | |
| *** jlinkes has joined #tripleo | 07:17 | |
| *** amoralej|off is now known as amoralej | 07:18 | |
| *** ccamacho has joined #tripleo | 07:20 | |
| *** gfidente has joined #tripleo | 07:21 | |
| *** tesseract has joined #tripleo | 07:25 | |
| openstackgerrit | Dougal Matthews proposed openstack/instack-undercloud master: Increase the Mistral RPC timeout https://review.openstack.org/509811 | 07:26 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui stable/pike: Make the Nodes dropdown actions truly disabled https://review.openstack.org/509995 | 07:31 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor Loader component https://review.openstack.org/509181 | 07:36 |
| *** ffiore has quit IRC | 07:37 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-specs master: Add blueprint for Logging to stdout and rsyslog https://review.openstack.org/510001 | 07:42 |
| jaosorior | jbadiapa: first draft ^^ | 07:42 |
| jaosorior | larsks: ^^ | 07:42 |
| *** ffiore has joined #tripleo | 07:42 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add validation to logging templates https://review.openstack.org/509486 | 07:43 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for keystone containers to log to stdout/stderr https://review.openstack.org/508517 | 07:43 |
| *** sid1 has joined #tripleo | 07:43 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for keystone containers to log to stdout/stderr https://review.openstack.org/508517 | 07:43 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova containers to log to stdout/stderr https://review.openstack.org/509157 | 07:43 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova containers to log to stdout/stderr https://review.openstack.org/509157 | 07:44 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/paunch master: Add log_tag option to container definition https://review.openstack.org/509698 | 07:45 |
| *** marios has quit IRC | 07:45 | |
| *** links has quit IRC | 07:46 | |
| openstackgerrit | Damien Ciabrini proposed openstack/tripleo-quickstart master: Disable cloud-init for IPA supplemental VM https://review.openstack.org/510007 | 07:46 |
| *** marios has joined #tripleo | 07:46 | |
| *** ykarel__ is now known as ykarel | 07:47 | |
| *** jpena|off is now known as jpena | 07:50 | |
| openstackgerrit | Markus Zoeller (markus_z) proposed openstack/tripleo-docs master: docs: remove ALL the unnecessary blockquotes https://review.openstack.org/504518 | 07:54 |
| *** florianf has joined #tripleo | 07:56 | |
| openstackgerrit | Merged openstack/instack-undercloud master: (retry) configure all OpenStack services with default domain https://review.openstack.org/509841 | 07:57 |
| *** links has joined #tripleo | 07:58 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor services/utils into selectors https://review.openstack.org/506661 | 07:59 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor Ironic and Ironic Inspector services https://review.openstack.org/506662 | 07:59 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor ZaqarWebSocketService functions into thunks https://review.openstack.org/506667 | 07:59 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor KeystoneApiService into thunks https://review.openstack.org/506663 | 07:59 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor MistralApiService to thunks https://review.openstack.org/506664 | 07:59 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor HeatApiService to thunks https://review.openstack.org/506665 | 07:59 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor SwiftApiService into thunks https://review.openstack.org/506666 | 07:59 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Delete services/utils https://review.openstack.org/508466 | 07:59 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Remove unnecessary store imports from tests https://review.openstack.org/508467 | 07:59 |
| openstackgerrit | Damien Ciabrini proposed openstack/tripleo-quickstart master: Node config for HA overcloud and FreeIPA node https://review.openstack.org/510012 | 08:03 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Use uuid instead of deprecated node-uuid https://review.openstack.org/508493 | 08:04 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Remove node-uuid dependency https://review.openstack.org/508494 | 08:04 |
| *** egonzalez has joined #tripleo | 08:06 | |
| *** dbecker has quit IRC | 08:12 | |
| *** dbecker has joined #tripleo | 08:12 | |
| *** mandre_afk is now known as mandre | 08:17 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor Register nodes dialog to use redux-form https://review.openstack.org/504903 | 08:18 |
| *** Guest54207 is now known as sc | 08:24 | |
| *** lucas-afk is now known as lucasagomes | 08:29 | |
| *** aditya_r has quit IRC | 08:33 | |
| *** psachin has quit IRC | 08:34 | |
| *** daidv has quit IRC | 08:38 | |
| *** ebarrera has quit IRC | 08:42 | |
| *** ebarrera has joined #tripleo | 08:42 | |
| *** derekh has joined #tripleo | 08:46 | |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Temporarily fallback to BM fluentd https://review.openstack.org/510018 | 08:47 |
| mandre | jistr, weshay, trown|outtypewww: ^^ this should fix gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container until we have the fluentd image in tripleomaster | 08:48 |
| jistr | are you sure we don't want to revert to the freshly built tripleoupstream? (just kidding ;) +2) | 08:50 |
| *** dsariel has joined #tripleo | 08:51 | |
| *** salmankhan has joined #tripleo | 08:52 | |
| gfidente | mandre I think I hit that in one of the jobs | 08:58 |
| gfidente | fluentd missing | 08:58 |
| mandre | jistr: lol, I though you were being serious | 09:03 |
| *** mcornea has joined #tripleo | 09:04 | |
| *** pdeore_ has quit IRC | 09:08 | |
| openstackgerrit | Merged openstack/tripleo-common stable/pike: Fixup upgrade-non-controller to also accept IP address https://review.openstack.org/509797 | 09:08 |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721723 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1721723 in tripleo "fluentd image missing from tripleomaster registry" [Critical,Confirmed] - Assigned to John Trowbridge (trown) | 09:10 |
| *** pdeore has joined #tripleo | 09:10 | |
| mandre | jistr: hmm I'm perplex, looks like we've not completely fixed https://bugs.launchpad.net/tripleo/+bug/1721497, I'm still seeing it happening in scenario004 | 09:10 |
| openstack | Launchpad bug 1721497 in tripleo "galera(galera)[34]: ERROR: Could not determine galera name from pacemaker node <galera-bundle-0>" [Critical,Fix released] - Assigned to John Trowbridge (trown) | 09:10 |
| mandre | jistr: here https://review.openstack.org/#/c/462975/ | 09:10 |
| bandini | go 29 | 09:11 |
| dciabrin | damned | 09:12 |
| dciabrin | looking | 09:12 |
| mandre | (ToT) | 09:12 |
| *** ykarel is now known as ykarel|lunch | 09:12 | |
| jistr | hm yea and it used the tripleomaster images already http://logs.openstack.org/75/462975/17/gate/gate-tripleo-ci-centos-7-scenario004-multinode-oooq-container/55c64de/logs/subnode-2/var/log/extra/docker/containers/galera-bundle-docker-0/docker_info.log.txt.gz | 09:14 |
| *** tosky has joined #tripleo | 09:15 | |
| mandre | yep, so we may need to revert after all :-/ | 09:16 |
| *** leseb has quit IRC | 09:17 | |
| jistr | mandre: i'm not sure if that'll fix it though? /cc bandini dciabrin | 09:17 |
| jistr | i think bandini said the packages are ok in the tripleomaster images | 09:17 |
| jistr | so reverting might not give us any bonus | 09:18 |
| bandini | jistr, mandre: let me take a look w/ dciabrin. yeah the packages were fine | 09:18 |
| *** psachin has joined #tripleo | 09:19 | |
| openstackgerrit | Honza Pokorny proposed openstack/puppet-tripleo stable/pike: Add a new configuration option for GUI loggers https://review.openstack.org/510025 | 09:20 |
| *** jpich has joined #tripleo | 09:21 | |
| jtomasek | mwhahaha: Hi, can I get your opinion on this https://review.openstack.org/#/c/509832/4/tripleo_common/actions/plan.py please? | 09:22 |
| mandre | bandini: ack, I've reopened https://bugs.launchpad.net/tripleo/+bug/1721497 FYI | 09:23 |
| openstack | Launchpad bug 1721497 in tripleo "galera(galera)[34]: ERROR: Could not determine galera name from pacemaker node <galera-bundle-0>" [Critical,Confirmed] - Assigned to John Trowbridge (trown) | 09:23 |
| bandini | mandre: ack | 09:23 |
| matbu | shardy: hello, quick question, the unit tests is failling on https://review.openstack.org/#/c/487488 due to the config download patch that have been merged 1 or 2 days ago | 09:25 |
| *** dparkes has quit IRC | 09:25 | |
| matbu | shardy: but do we need to make a release, to make them green ? | 09:25 |
| matbu | shardy: i mean ooo-common release (the requierements force the ooo-common release) | 09:26 |
| *** spectr has quit IRC | 09:26 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Deploy kubernetes using TripleO on the overcloud https://review.openstack.org/471759 | 09:27 |
| bandini | jistr, mandre: ok so the packages were only correct in passed-ci-test (and I had not even noticed there is a passed-ci tag) -> https://paste.fedoraproject.org/paste/LZhZ8iTthzpHdlOgYFfIBw | 09:28 |
| shardy | matbu: Hi, no we should use tripleo-common from master | 09:28 |
| shardy | https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/master.yml#L65 | 09:28 |
| shardy | matbu: unless something is messed up with the priorities (again) | 09:28 |
| shardy | matbu: let me take a look at the CI results | 09:28 |
| matbu | shardy: yep if you look here (in the py27 log) http://logs.openstack.org/88/487488/29/check/gate-python-tripleoclient-python27-ubuntu-xenial/92eaead/console.html#_2017-10-05_08_21_56_855123 | 09:29 |
| bandini | jistr, mandre: should be an easy fix/rebuild? | 09:29 |
| matbu | shardy: it grab the 7.6.0 | 09:29 |
| jistr | bandini, mandre: ok then reverting might help... We might also promote passed-ci-test -> passed-ci but we'd have to sync w/ weshay trown|outtypewww about this, i don't know what's involved. | 09:29 |
| mandre | bandini: jeez passed-ci is 22 days old | 09:29 |
| shardy | matbu: yeah I think the unit tests do install the tox venv from pypi but the functional tests should all use delorean master packages | 09:30 |
| shardy | matbu: do the unit tests depend on the tripleo-common change? | 09:30 |
| *** dparkes has joined #tripleo | 09:30 | |
| matbu | shardy: yep | 09:30 |
| matbu | shardy: the failure on import config is related | 09:31 |
| shardy | matbu: can you link to where/why? That sounds wrong, can't we just stub the tests to decouple the client tests from -common? | 09:31 |
| shardy | Oh I see | 09:31 |
| shardy | we're importing from -common | 09:31 |
| shardy | I guess we'll need to release then | 09:31 |
| matbu | shardy: i previously ask on #os-infra | 09:31 |
| shardy | matbu: I think the tox jobs are working as expected, so yes we'll need to tag a release I think | 09:32 |
| matbu | shardy: ack, this is what someone told me on #openstack-infra : current tox jobs install what is in your requiremnts files, optionally with constraints applied. This isn't currently compatible with depends-on | 09:32 |
| shardy | unless you can temporarily stub the tests as a workaround | 09:32 |
| shardy | matbu: yeah, but the multinode jobs should use master as we use packages and not pip install | 09:32 |
| matbu | shardy: idk how, without making something hacky | 09:32 |
| shardy | matbu: Ok I guess we can just propose the release, maybe confirm with mwhahaha how he'd prefer to handle it | 09:33 |
| matbu | shardy: but pipy install what is in the requirements to run the tests | 09:33 |
| matbu | shardy: ack, i'll ack him | 09:34 |
| *** spectr has joined #tripleo | 09:34 | |
| matbu | shardy: thank you | 09:34 |
| mandre | jistr, bandini: I'm tempted to use the passed-ci-test tag in ci see what happens | 09:34 |
| *** spectr has quit IRC | 09:34 | |
| jistr | mandre, bandini: we could try that but it should be do-not-merge | 09:36 |
| *** spectr has joined #tripleo | 09:36 | |
| jistr | if it works ok then we should promote that to passed-ci | 09:36 |
| *** spectr has quit IRC | 09:36 | |
| jistr | (maybe manually if there's no other way) | 09:36 |
| bandini | mandre, jistr: ack sounds like a good test | 09:36 |
| jistr | but we probably shouldn't really change CI to use passed-ci-test always | 09:36 |
| bandini | indeed yeah. let's do a test just to be sure and then maybe see if we can promote passed-ci-test to passed-ci ? | 09:37 |
| *** spectr has joined #tripleo | 09:37 | |
| mandre | ok let's do it | 09:37 |
| *** spectr has quit IRC | 09:38 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-ui master: Imported Translations from Zanata https://review.openstack.org/510035 | 09:38 |
| *** dsariel has quit IRC | 09:39 | |
| *** spectr has joined #tripleo | 09:40 | |
| openstackgerrit | Martin André proposed openstack/tripleo-quickstart master: DO NOT MERGE Testing newer container images https://review.openstack.org/510036 | 09:40 |
| *** spectr has quit IRC | 09:40 | |
| *** spectr has joined #tripleo | 09:41 | |
| *** ykarel|lunch is now known as ykarel | 09:42 | |
| mandre | jistr, bandini: do you know if we have a DNM patch that triggers all of the scenario jobs? I want to add a Depends-On the quickstart patch | 09:43 |
| *** spectr has quit IRC | 09:43 | |
| *** spectr has joined #tripleo | 09:43 | |
| bandini | hohum. no idea there :/ | 09:44 |
| *** cylopez has quit IRC | 09:47 | |
| *** yprokule has quit IRC | 09:47 | |
| *** yprokule_ has joined #tripleo | 09:47 | |
| *** agurenko has quit IRC | 09:47 | |
| *** yprokule_ is now known as yprokule | 09:48 | |
| openstackgerrit | Merged openstack/tripleo-validations stable/pike: Exclude byte code files from tht lookup https://review.openstack.org/509472 | 09:49 |
| *** chem has quit IRC | 09:50 | |
| *** panda|off is now known as panda | 09:50 | |
| *** chem has joined #tripleo | 09:51 | |
| jistr | mandre: yea we may not have one yet | 09:53 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: DO NOT MERGE testing containerized scenarios https://review.openstack.org/510040 | 09:53 |
| mandre | jistr: right, I couldn't find one so ^ | 09:53 |
| *** spectr has quit IRC | 09:56 | |
| *** spectr has joined #tripleo | 09:57 | |
| *** jprovazn has quit IRC | 09:57 | |
| *** spectr has quit IRC | 09:57 | |
| openstackgerrit | Merged openstack/tripleo-validations master: Remove syntax warnings for when statements https://review.openstack.org/484867 | 09:58 |
| *** spectr has joined #tripleo | 09:58 | |
| *** cylopez has joined #tripleo | 10:04 | |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations stable/pike: Remove syntax warnings for when statements https://review.openstack.org/510042 | 10:05 |
| *** fzdarsky has joined #tripleo | 10:08 | |
| *** marios has quit IRC | 10:08 | |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721497 | 10:10 |
| openstack | Launchpad bug 1721497 in tripleo "galera(galera)[34]: ERROR: Could not determine galera name from pacemaker node <galera-bundle-0>" [Critical,Confirmed] - Assigned to John Trowbridge (trown) | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721723 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1721723 in tripleo "fluentd image missing from tripleomaster registry" [Critical,Confirmed] - Assigned to John Trowbridge (trown) | 10:10 |
| *** ykarel_ has joined #tripleo | 10:16 | |
| *** ykarel has quit IRC | 10:18 | |
| *** ffiore has quit IRC | 10:20 | |
| *** leseb has joined #tripleo | 10:20 | |
| *** ykarel__ has joined #tripleo | 10:21 | |
| *** ykarel__ is now known as ykarel | 10:21 | |
| *** ykarel_ has quit IRC | 10:22 | |
| *** fzdarsky has quit IRC | 10:27 | |
| *** dsneddon has quit IRC | 10:31 | |
| *** mrch has quit IRC | 10:32 | |
| *** mrch has joined #tripleo | 10:32 | |
| *** Dinesh_Bhor has quit IRC | 10:35 | |
| openstackgerrit | Merged openstack/tripleo-docs master: docs: remove ALL the unnecessary blockquotes https://review.openstack.org/504518 | 10:36 |
| *** ffiore has joined #tripleo | 10:43 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Use sub_nodes_private file for getting IP of multinode https://review.openstack.org/508800 | 10:43 |
| openstackgerrit | Javier Peña proposed openstack/tripleo-quickstart-extras master: Revert "latest version of DLRN breaks CI" https://review.openstack.org/510056 | 10:44 |
| *** stendulker has quit IRC | 10:46 | |
| *** salmankhan has quit IRC | 10:47 | |
| *** abregman has joined #tripleo | 10:48 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart master: DNM. test ansible 2.4 https://review.openstack.org/510059 | 10:51 |
| *** abregman is now known as abregman|afk | 10:52 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-heat-templates master: DONT REVIEW: this is dependency patch https://review.openstack.org/446592 | 10:54 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Add a GetNetworksAction https://review.openstack.org/509419 | 10:54 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-common master: DONT REVIEW: used for testing only https://review.openstack.org/447276 | 10:54 |
| *** aufi has quit IRC | 10:54 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM. test ansible 2.4 with tht https://review.openstack.org/510061 | 10:57 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM. test ansible 2.4 with image build https://review.openstack.org/510062 | 10:59 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart master: DNM. test ansible 2.4 https://review.openstack.org/510059 | 11:02 |
| *** jkilpatr has joined #tripleo | 11:03 | |
| *** dpawar has quit IRC | 11:05 | |
| *** marios has joined #tripleo | 11:06 | |
| *** sid1 has quit IRC | 11:07 | |
| *** masco has quit IRC | 11:08 | |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721497 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721723 | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1721497 in tripleo "galera(galera)[34]: ERROR: Could not determine galera name from pacemaker node <galera-bundle-0>" [Critical,Confirmed] - Assigned to John Trowbridge (trown) | 11:10 |
| openstack | Launchpad bug 1721723 in tripleo "fluentd image missing from tripleomaster registry" [Critical,Confirmed] - Assigned to John Trowbridge (trown) | 11:10 |
| *** salmankhan has joined #tripleo | 11:10 | |
| *** aufi has joined #tripleo | 11:13 | |
| *** Pranav has joined #tripleo | 11:13 | |
| *** jkilpatr has quit IRC | 11:16 | |
| *** jkilpatr has joined #tripleo | 11:18 | |
| *** masco has joined #tripleo | 11:20 | |
| *** sid1 has joined #tripleo | 11:24 | |
| *** amoralej is now known as amoralej|away | 11:25 | |
| openstackgerrit | Toure Dunnon proposed openstack/python-tripleoclient master: [WIP] Tripleoclient unified queue name. https://review.openstack.org/509902 | 11:26 |
| openstackgerrit | Toure Dunnon proposed openstack/python-tripleoclient master: Tripleoclient unified queue name. https://review.openstack.org/509902 | 11:26 |
| openstackgerrit | Toure Dunnon proposed openstack/python-tripleoclient master: Tripleoclient unified queue name. https://review.openstack.org/509902 | 11:29 |
| *** pkovar has joined #tripleo | 11:29 | |
| dtantsur | hi, can I get W+1 on https://review.openstack.org/#/c/508865/ please? has 2x +2 already | 11:29 |
| *** dpawar has joined #tripleo | 11:30 | |
| *** ffiore has quit IRC | 11:31 | |
| openstackgerrit | Ana Krivokapic proposed openstack/tripleo-validations master: Add Ansible specific files to .gitignore https://review.openstack.org/510078 | 11:32 |
| Tengu | can anyone have a small look at that issue and tell me if my proposal makes any sens? https://bugs.launchpad.net/tripleo/+bug/1721728 | 11:32 |
| openstack | Launchpad bug 1721728 in tripleo "Allow to activate logs in HAProxy" [Undecided,New] | 11:32 |
| *** morazi has joined #tripleo | 11:33 | |
| *** jprovazn has joined #tripleo | 11:35 | |
| jaosorior | Tengu: checking it out. | 11:41 |
| jaosorior | Tengu: so... you want to pass a generic "listener options" hash? | 11:41 |
| Tengu | jaosorior: yup | 11:41 |
| jaosorior | Tengu: you could also be really specific and just allow setting up logging values. | 11:42 |
| Tengu | jaosorior: an alternative would be to allow only logging stuff, yes | 11:42 |
| jaosorior | folks would probably be more comfortable with that | 11:42 |
| Tengu | do you think so? not a big deal for me | 11:42 |
| *** milan has joined #tripleo | 11:42 | |
| *** apevec has joined #tripleo | 11:42 | |
| Tengu | I was pretty sure a broader application would meet a better success, but if you think they'd prefer a limited thing, no problem. | 11:43 |
| Tengu | as long as we can add a "option httplog" or "tcplog" when/where we need it… :) | 11:43 |
| *** artom has quit IRC | 11:43 | |
| apevec | can some with privs please restore Status: Invalid in https://bugs.launchpad.net/tripleo/+bug/1720458 ? | 11:44 |
| openstack | Launchpad bug 1720458 in tripleo "Lastest delorean pip package causes error in autodoc" [Low,Fix released] - Assigned to wes hayutin (weshayutin) | 11:44 |
| jaosorior | Tengu: let me think about it | 11:44 |
| apevec | merged patch is incorrectly including Closes-Bug | 11:44 |
| Tengu | jaosorior: thanks :). that was the point of opening an issue for that feature instead of pushing a review out of nothing :) | 11:44 |
| *** fzdarsky has joined #tripleo | 11:44 | |
| apevec | imho that dlrn pin is not justified, but whatever... | 11:45 |
| jaosorior | apevec: done | 11:45 |
| apevec | thanks! | 11:45 |
| jaosorior | Tengu: lets go for the specific one for logging. I think it would be quite beneficial for folks. | 11:47 |
| Tengu | jaosorior: care to comment on the issue so that there can be a follow-up later? I'll probably provide a patch by next Monday. | 11:48 |
| jaosorior | Tengu: also, being a more specific use-case, we won't get funky error reports due to incorrect specification of that hash :D | 11:48 |
| jaosorior | sure | 11:48 |
| jaosorior | lets do that | 11:48 |
| Tengu | jaosorior: I think I'll stick with the hash though, in order to avoid having to add 10'000 new params. | 11:48 |
| jaosorior | Tengu: no biggie, as long as there's some validation in place. | 11:49 |
| Tengu | good :) | 11:49 |
| Tengu | hopefully the CI will be stable by then. | 11:49 |
| Tengu | for now I'm pretty out of luck | 11:49 |
| openstackgerrit | Merged openstack/tripleo-ui master: Refactor services/utils into selectors https://review.openstack.org/506661 | 11:50 |
| apevec | jaosorior, BTW is https://bugs.launchpad.net/tripleo/+bug/1721366 all good now i.e. do you have successfull run now? | 11:50 |
| openstack | Launchpad bug 1721366 in tripleo "Keystone v2.0 APIs have been removed, TripleO config is incomplete" [Critical,Fix released] - Assigned to Emilien Macchi (emilienm) | 11:50 |
| jaosorior | apevec: seems so :D | 11:51 |
| * Tengu crosses his fingers with his current run on zuul | 11:52 | |
| *** abishop has joined #tripleo | 11:52 | |
| *** jprovazn has quit IRC | 11:54 | |
| *** jprovazn has joined #tripleo | 11:55 | |
| Tengu | it's funny to see issues assigned to me on such a bit project :). | 11:55 |
| Tengu | jaosorior: in order to avoir multiple ppl working on my proposal, I just attributed it to me. Cleaner. | 11:55 |
| jaosorior | awesome | 11:55 |
| jaosorior | Tengu: your input is really appreciated :D and thanks for working on this as well | 11:56 |
| *** lucasagomes is now known as lucas-hungry | 11:56 | |
| Tengu | jaosorior: well, we love logs and metrics where I work, soooo ;) | 11:56 |
| *** ansmith has quit IRC | 11:56 | |
| Tengu | jaosorior: I also had to open a new port in the firewall in order to allow prometheus to access collectd exporters, and we will probably add some new exporters for haproxy metrics and so on. | 11:57 |
| *** ansmith_ has quit IRC | 11:57 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/instack-undercloud master: Drop legacy ceilometer collector https://review.openstack.org/507917 | 11:57 |
| Tengu | jaosorior: as well as, probably, apache status things, and so on. | 11:57 |
| Tengu | so I might push some other things in this scope ;). | 11:57 |
| jaosorior | Tengu: gonna work a bit on logging myself https://review.openstack.org/#/c/510001/1/specs/queens/logging-stdout.rst | 11:58 |
| *** jprovazn_ has joined #tripleo | 11:58 | |
| Tengu | btw, opening the firewall is probably the easiest thing I have done in tripleo :D | 11:58 |
| Tengu | jaosorior: yep, I saw that, that's why I opened the issue in order to ensure we won't collide :) | 11:58 |
| Tengu | jaosorior: this logging is for containers right? so that an rsyslog/fluentd on the baremetal can access them easily and send them to a collector ? | 11:58 |
| jaosorior | Tengu: right | 11:59 |
| *** aditya_r has joined #tripleo | 11:59 | |
| *** jprovazn has quit IRC | 11:59 | |
| Tengu | we already have one that in our rancher infrastructures :) | 11:59 |
| jaosorior | Tengu: probably the only thing that I will do with HAProxy is stop bind-mounting the host's /dev/log and redirect those logs to stdout with a sidecar container. | 11:59 |
| Tengu | hmmm | 12:00 |
| openstackgerrit | Lukas Bezdicka proposed openstack/python-tripleoclient stable/pike: Fix error handling for actions https://review.openstack.org/510080 | 12:00 |
| Tengu | jaosorior: do you want I ask a colleague in here how he did all the logging part in our ranchers ? | 12:00 |
| jaosorior | Tengu: that would be great! | 12:00 |
| Tengu | as we have pretty large websites hosted with that, with a lot of visitors, I'm pretty confident our setup will cope with openstack traffic. | 12:01 |
| *** pdeore has quit IRC | 12:01 | |
| *** spectr has quit IRC | 12:02 | |
| *** spectr has joined #tripleo | 12:03 | |
| Tengu | jaosorior: hmm, in our case we actually have two containers for haproxy, one with the daemon, one as a "side-kick" called only when we want to reload the configuration - that prevents and downtime, instead of redeploying a new container. Meaning: service runs with a share mount from another container containing only configuration and reload script. First thing. | 12:03 |
| *** dprince has joined #tripleo | 12:03 | |
| jaosorior | dciabrin: is that something we could do with pacemaker? ^^ | 12:04 |
| *** toure|gone is now known as toure | 12:04 | |
| Tengu | jaosorior: second thing, we apparently still use the /dev/log in the configuration, and we eat the logs through journald. | 12:04 |
| Tengu | journald -> sent to a remote location via rsyslog, ELK, and so on. | 12:04 |
| jaosorior | Tengu: right, and that's not a big deal; but I want journald to properly populate the container related metadata entries. Which it doesn't do currently cause of mounting /dev/log | 12:05 |
| Tengu | we also have a prometheus exporter attached to the haproxy socket in order to get internal stats. | 12:05 |
| *** jpena is now known as jpena|lunch | 12:05 | |
| openstackgerrit | Ana Krivokapic proposed openstack/tripleo-validations master: ctlplane-ip-range: Verify lower IP bound is smaller than upper https://review.openstack.org/510082 | 12:06 |
| * dciabrin reads backlog | 12:06 | |
| Tengu | jaosorior: oh, sorry, /dev/log isn't really used in fact, apparently we rely on env variable that HAProxy can understand, with a LOG_TAG and LOG_TARGET (sorry, my colleague is out of reach, I'm reading the docker-compose and docker-file…) | 12:08 |
| jaosorior | Tengu: how does LOG_TAG and LOG_TARGET work? | 12:09 |
| openstackgerrit | Merged openstack/tripleo-ui master: Imported Translations from Zanata https://review.openstack.org/510035 | 12:09 |
| Tengu | jaosorior: digging. | 12:10 |
| *** trown|outtypewww is now known as trown | 12:10 | |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721497 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721723 | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1721497 in tripleo "galera(galera)[34]: ERROR: Could not determine galera name from pacemaker node <galera-bundle-0>" [Critical,Confirmed] - Assigned to John Trowbridge (trown) | 12:10 |
| openstack | Launchpad bug 1721723 in tripleo "fluentd image missing from tripleomaster registry" [Critical,Confirmed] - Assigned to John Trowbridge (trown) | 12:10 |
| *** leitan has joined #tripleo | 12:10 | |
| *** fzdarsky has quit IRC | 12:11 | |
| Tengu | jaosorior: I think haproxy will take that env var as a configuration one and use it like that. I remember my colleague talking about that capacity. But I think it won't work with the old haproxy currently used in Pike (1.5.18) | 12:12 |
| jaosorior | :( | 12:12 |
| *** aditya_r has quit IRC | 12:12 | |
| *** raildo has joined #tripleo | 12:12 | |
| dciabrin | jaosorior, Tengu I'm not sure it would be benefitial to let pacemaker drive such a complex reload. pacemaker can start a resource when another stop, but we implemented the haproxy reload via haproxy-systemd-wrapper. | 12:13 |
| Tengu | jaosorior: we're based on haproxy:1.7 in our infra - that one offers a lot more information/metrics and facilities for configuration. | 12:13 |
| trown | panda: I think your passed-ci-test containers are confusing folks https://bugs.launchpad.net/tripleo/+bug/1721497 | 12:13 |
| openstack | Launchpad bug 1721497 in tripleo "galera(galera)[34]: ERROR: Could not determine galera name from pacemaker node <galera-bundle-0>" [Critical,Confirmed] - Assigned to John Trowbridge (trown) | 12:13 |
| Tengu | dciabrin: aggreed. pacemaker isn't good with complex tasks, unfortunately. | 12:14 |
| panda | trown: I'll remove the tags | 12:14 |
| mandre | jaosorior: hey, can you help me figure out if the gate-tripleo-ci-centos-7-containers-multinode failure is related to https://bugs.launchpad.net/tripleo/+bug/1721366? | 12:15 |
| openstack | Launchpad bug 1721366 in tripleo "Keystone v2.0 APIs have been removed, TripleO config is incomplete" [Critical,Fix released] - Assigned to Emilien Macchi (emilienm) | 12:15 |
| jaosorior | mandre: | 12:15 |
| jaosorior | no | 12:15 |
| jaosorior | nah just kidding | 12:15 |
| trown | panda: do we have a full set of new containers to manually push that passed some CI? seems both the alerts are releated to old/missing containers | 12:15 |
| jaosorior | lets see | 12:15 |
| jaosorior | mandre: which failure? | 12:15 |
| mandre | jaosorior: haha | 12:15 |
| mandre | it fails in tempest, http://logs.openstack.org/36/510036/1/check/gate-tripleo-ci-centos-7-containers-multinode/00e0e74/logs/undercloud/home/jenkins/tempest_output.log.txt.gz#_2017-10-06_11_16_09 | 12:15 |
| *** salmankhan has quit IRC | 12:15 | |
| *** d0ugal has quit IRC | 12:15 | |
| mandre | jaosorior: 404 GET http://192.168.24.14:35357/v2.0/tenants makes me think it's related | 12:16 |
| jaosorior | mandre: is sure seems related; the issue we fixed was for the undercloud. Now it seems tempest is using keystone v2 in the overcloud for some reason :/ | 12:16 |
| panda | trown: adarazs has a script that finds the last hash that passed CI | 12:17 |
| mandre | jaosorior: hmm, the first line says source /home/jenkins/overcloudrc.v3 | 12:17 |
| jaosorior | mandre: might be an issue in tempest itself or in tempest-conf? | 12:18 |
| adarazs | panda, trown: https://review.rdoproject.org/r/9859 | 12:18 |
| tosky | jaosorior: the last patch in tempestconf should have switched to v3 | 12:18 |
| tosky | jaosorior: but of course if overcloudrc.v3 is used | 12:19 |
| *** ffiore has joined #tripleo | 12:19 | |
| mandre | tosky: which tempest patch is it? | 12:20 |
| tosky | mandre: tempestconf, not tempest | 12:20 |
| tosky | mandre: the last two commits: https://github.com/redhat-openstack/python-tempestconf/commits/master | 12:20 |
| jaosorior | tosky: makes no sense either... I see in the logs that we're using v3 | 12:21 |
| jaosorior | Setting [identity] auth_version = v3 | 12:21 |
| mandre | tosky: ack, this is the tempest.conf that was used http://logs.openstack.org/36/510036/1/check/gate-tripleo-ci-centos-7-containers-multinode/00e0e74/logs/undercloud/home/jenkins/tempest/etc/tempest.conf.txt.gz | 12:21 |
| *** MVenesio has joined #tripleo | 12:21 | |
| jaosorior | and then it tries to use v2 | 12:21 |
| jaosorior | tempest/lib/services/identity/v2 | 12:21 |
| jaosorior | wtf | 12:21 |
| tosky | jaosorior: which overcloudrc is sourced? | 12:21 |
| tosky | jaosorior: and laos: jaosorior: python2-tempestconf-1.1.3-0.20170815153107.f16daec.el7.centos.noarch | 12:21 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: WIP DNR Instance HA POC https://review.openstack.org/506922 | 12:21 |
| *** lblanchard has joined #tripleo | 12:22 | |
| tosky | jaosorior: you need a newer version of tempestconf | 12:22 |
| mandre | tosky: sorry, here is the correct link http://logs.openstack.org/36/510036/1/check/gate-tripleo-ci-centos-7-containers-multinode/00e0e74/logs/undercloud/home/jenkins/tempest/etc/default-overrides.conf.txt.gz | 12:22 |
| tosky | mandre: that's not relevant | 12:22 |
| mandre | dang! | 12:22 |
| tosky | the first line says: 2017-10-06 11:15:04 | + source /home/jenkins/overcloudrc.v3 | 12:23 |
| tosky | so the right overcloudrc.v3 is sourced, but tempestconf is old | 12:23 |
| tosky | that's it | 12:23 |
| jaosorior | tosky: so we need a newer one from RDO then? | 12:23 |
| tosky | jaosorior: which versions of RDO packages are used for that job? RDO official from cbs or RDO trunk-from-each-commit? | 12:24 |
| jaosorior | tosky: not sure, but this is the list http://logs.openstack.org/36/510036/1/check/gate-tripleo-ci-centos-7-containers-multinode/00e0e74/logs/rpm-qa.txt.gz | 12:25 |
| *** pchavva has joined #tripleo | 12:25 | |
| Tengu | grmbl. | 12:27 |
| *** bfournie has joined #tripleo | 12:27 | |
| *** spectr has quit IRC | 12:28 | |
| *** achadha has joined #tripleo | 12:29 | |
| Tengu | erf… ok, now I hit the missing fluentd container image. anyway. will try again next week for the reviews. | 12:30 |
| tosky | jaosorior: I'm trying to find where the repository are configured, but I can't find it | 12:30 |
| tosky | and /etc/yum.repos.d is not saved | 12:30 |
| *** adarazs is now known as adarazs_brb | 12:32 | |
| *** achadha has quit IRC | 12:33 | |
| tosky | ok, this is the mirror that was used: http://mirror.dfw.rax.openstack.org:8080/rdo/centos7/f4/42/f442a3aa35981c3d6d7e312599dde2a1b1d202c9_0468cca4/?C=M;O=A | 12:35 |
| *** ratailor has quit IRC | 12:38 | |
| *** spectr has joined #tripleo | 12:39 | |
| jaosorior | panda: ^^ | 12:40 |
| panda | jaosorior: what's the question ? | 12:42 |
| jaosorior | panda: oh, nevermind, tosky already found his answer | 12:42 |
| tosky | but then the answer is: why that specific hash? Because a newer one was not promoted? I always forget this part | 12:42 |
| jaosorior | I think that's why | 12:44 |
| openstackgerrit | John Trowbridge proposed openstack/puppet-tripleo master: Revert "Set meta container-attribute-target=host attribute" https://review.openstack.org/510094 | 12:44 |
| *** adarazs_brb is now known as adarazs | 12:44 | |
| openstackgerrit | John Trowbridge proposed openstack/puppet-tripleo master: Revert "Set meta container-attribute-target=host attribute" https://review.openstack.org/510094 | 12:44 |
| tosky | sooo... what can we do? | 12:45 |
| *** ansmith has joined #tripleo | 12:45 | |
| *** ansmith_ has joined #tripleo | 12:46 | |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-common master: Make validation inputs configurable via Mistral https://review.openstack.org/383763 | 12:47 |
| *** jmelvin has joined #tripleo | 12:48 | |
| openstackgerrit | John Eckersberg proposed openstack/tripleo-heat-templates master: rabbitmq: set cluster_partition_handling to 'ignore' https://review.openstack.org/510097 | 12:51 |
| *** ecerquei has joined #tripleo | 12:54 | |
| *** bobh has joined #tripleo | 12:58 | |
| *** tzumainn has joined #tripleo | 12:59 | |
| *** jpena|lunch is now known as jpena | 13:00 | |
| *** shreshtha has quit IRC | 13:01 | |
| *** pblaho1 has joined #tripleo | 13:01 | |
| *** rmascena has joined #tripleo | 13:02 | |
| openstackgerrit | John Trowbridge proposed openstack/puppet-tripleo master: Revert "Set meta container-attribute-target=host attribute" https://review.openstack.org/510094 | 13:03 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: Remove Heat Cloudwatch API during upgrade and disable by default https://review.openstack.org/510101 | 13:03 |
| openstackgerrit | John Eckersberg proposed openstack/tripleo-heat-templates master: RabbitMQ should use net_ticktime https://review.openstack.org/503788 | 13:03 |
| *** pblaho has quit IRC | 13:03 | |
| *** salmankhan has joined #tripleo | 13:04 | |
| *** raildo has quit IRC | 13:05 | |
| *** psachin has quit IRC | 13:05 | |
| *** athomas has quit IRC | 13:05 | |
| *** udesale has quit IRC | 13:05 | |
| matbu | mwhahaha: hellow | 13:09 |
| Tengu | jaosorior: sooo. I could get some info regarding logging haproxy inside docker. Apparently, using stdout + journald/docker + rsyslog plugin can crash badly when there are a lot of lines (i.e. access to haproxy). But it's a specific corner case I think, and it's pretty sure openstack won't have such bursts. | 13:09 |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721497 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721723 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1721497 in tripleo "galera(galera)[34]: ERROR: Could not determine galera name from pacemaker node <galera-bundle-0>" [Critical,In progress] - Assigned to John Trowbridge (trown) | 13:10 |
| openstack | Launchpad bug 1721723 in tripleo "fluentd image missing from tripleomaster registry" [Critical,Confirmed] - Assigned to John Trowbridge (trown) | 13:10 |
| Tengu | jaosorior: so for now we have a weird setup, using LOG_TARGET as env var for haproxy and it sends its logs in clear using UDP. Not the best, because in clear, and because log lines get truncated. | 13:10 |
| Tengu | jaosorior: that said, it's pretty sure using stdout in docker for haproxy will be OK. | 13:11 |
| Tengu | jaosorior: hope this helps :). I have to go now. see you! | 13:11 |
| jaosorior | thanks! | 13:11 |
| *** bnemec has joined #tripleo | 13:12 | |
| *** noslzzp has joined #tripleo | 13:13 | |
| lvdombrkr | folks i tried deploy controller on baremetal 8gb ram and it fails with: Failed to call refresh: Cannot allocate memory - fork(2), can i assign this node as compute, or its also will fail? | 13:14 |
| jaosorior | lvdombrkr: it depends on how many services are you adding on that node. Also, you could use swap, it'll get REALLY slow, but it'll get it working. | 13:14 |
| openstackgerrit | Martin André proposed openstack/tripleo-common master: [WIP] Switch to ceph luminous https://review.openstack.org/510108 | 13:16 |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-common master: Add module_path as option for ansible-playbook action https://review.openstack.org/510109 | 13:17 |
| *** gkadam has quit IRC | 13:18 | |
| *** skramaja has quit IRC | 13:18 | |
| lvdombrkr | jaosorior: i use default services list, nothing add or remove, i want deploy 3 controllers to test pacemaker | 13:18 |
| EmilienM | hi | 13:21 |
| EmilienM | weshay: https://review.openstack.org/#/c/509841/ merged, please try again | 13:21 |
| *** gbarros has joined #tripleo | 13:21 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart master: Change the tripleo-ci-testing image paths https://review.openstack.org/510112 | 13:22 |
| weshay | EmilienM, ya.. it failed in the overcloud deployment now | 13:23 |
| *** cylopez has quit IRC | 13:23 | |
| weshay | https://logs.rdoproject.org/53/509853/1/openstack-experimental/gate-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master-nv/Za3c0303f520646378c6277273c451f25/ | 13:23 |
| weshay | https://logs.rdoproject.org/53/509853/1/openstack-experimental/gate-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master-nv/Za3c0303f520646378c6277273c451f25/undercloud/home/jenkins/failed_deployment_list.log.txt.gz | 13:24 |
| weshay | brb | 13:24 |
| *** jprovazn_ has quit IRC | 13:26 | |
| *** jprovazn has joined #tripleo | 13:27 | |
| jaosorior | Slower: do you do paunch reviews? | 13:27 |
| *** dansmith is now known as superdan | 13:28 | |
| *** Pranav has quit IRC | 13:33 | |
| openstackgerrit | Janki Chhatbar proposed openstack/tripleo-common master: Make docker.yaml and docker-ha.yaml default env file https://review.openstack.org/510115 | 13:34 |
| weshay | mandre, ping.. you are looking for fluentd for master, or master and pike? | 13:34 |
| weshay | re: https://bugs.launchpad.net/tripleo/+bug/1721723 | 13:34 |
| openstack | Launchpad bug 1721723 in tripleo "fluentd image missing from tripleomaster registry" [Critical,Confirmed] - Assigned to John Trowbridge (trown) | 13:34 |
| *** spectr has quit IRC | 13:35 | |
| *** Goneri has joined #tripleo | 13:35 | |
| mandre | weshay: we need it for both I think | 13:36 |
| *** spectr has joined #tripleo | 13:36 | |
| weshay | mandre, I don't see it being built for both | 13:37 |
| mandre | weshay: exactly, that's the issue | 13:37 |
| weshay | mandre, only master.. maybe we need to backport a change to the config | 13:37 |
| weshay | mandre, the bug is written for master | 13:37 |
| mandre | weshay: uh, is it really built for master? | 13:37 |
| *** trown is now known as trown|brb | 13:37 | |
| *** artom has joined #tripleo | 13:38 | |
| weshay | mandre, https://console.registry.rdoproject.org/registry#/images/master/centos-binary-fluentd | 13:38 |
| mandre | weshay: yeah, we need it for pike, https://review.openstack.org/#/c/507518/ | 13:38 |
| weshay | trown|brb, panda ^ | 13:38 |
| mandre | weshay: I don't have access to the registry console | 13:39 |
| *** artom_ has joined #tripleo | 13:39 | |
| weshay | mandre, you bug is blocked on that review afaict | 13:39 |
| panda | mandre: the bug refers to tripleomaster | 13:40 |
| *** pblaho has joined #tripleo | 13:40 | |
| *** ykarel is now known as ykarel|afk | 13:41 | |
| mandre | weshay: the review is blocked on the bug, so we have a problem it seems | 13:41 |
| weshay | mandre, fyi.. master builds have been blocked for 25 or so days | 13:41 |
| EmilienM | weshay: give me some time to debug | 13:41 |
| *** janki has quit IRC | 13:41 | |
| EmilienM | weshay: I'll look at that shortly | 13:41 |
| *** artom has quit IRC | 13:42 | |
| *** pblaho1 has quit IRC | 13:44 | |
| *** shardy has quit IRC | 13:44 | |
| *** lucas-hungry is now known as lucasagomes | 13:44 | |
| *** aputtur has joined #tripleo | 13:44 | |
| EmilienM | weshay: found it https://logs.rdoproject.org/53/509853/1/openstack-experimental/gate-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master-nv/Za3c0303f520646378c6277273c451f25/overcloud-controller-0/var/log/messages.txt.gz#_Oct__6_12_53_35 | 13:45 |
| EmilienM | weshay: now let me RCA | 13:45 |
| *** psahoo has quit IRC | 13:48 | |
| mandre | panda: I "fixed" the bug report to mention tripleopike too | 13:48 |
| *** links has quit IRC | 13:48 | |
| EmilienM | weshay: I think it's puppet-rabbitmq (again) - I'm on it | 13:48 |
| mandre | panda: do we have an idea why the image is missing from tripleomaster if it was built correctly? | 13:50 |
| weshay | mandre, that first batch was uploaded by hand, we're turning on the auto upload on the 10th | 13:51 |
| EmilienM | grrrbllrrr it's maybe not puppet-rabbitmq | 13:51 |
| weshay | mandre, however the upload would be gated by a promotion | 13:51 |
| openstackgerrit | Merged openstack/tripleo-specs master: Add Rocky spec directory https://review.openstack.org/509895 | 13:51 |
| weshay | which we have NOT seen in master yet | 13:51 |
| weshay | mandre, so technically you are blocked by master not promoting | 13:51 |
| EmilienM | "Error: Evaluation Error: Error while evaluating a Type-Name, Could not autoload puppet/type/archive: Could not autoload puppet/provider/archive/curl: Could not find parent provider ruby of curl at /etc/puppet/modules/rabbitmq/manifests/install/rabbitmqadmin.pp:10:31 on node overcloud-controller-0.localdomain" | 13:52 |
| *** myoung|afk is now known as myoung | 13:52 | |
| mwhahaha | so we packaged puppet-archive but puppet-archive must have another dep we missed | 13:52 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Support global deployment tasks executed on undercloud https://review.openstack.org/510122 | 13:53 |
| *** ecerquei_ has joined #tripleo | 13:53 | |
| mwhahaha | nope it doesn't have any more deps | 13:53 |
| mwhahaha | maybe it just doesn't work | 13:53 |
| mandre | weshay: ack, does a promotion == new passed-ci tag or new passed-ci-test? | 13:53 |
| mwhahaha | :o | 13:53 |
| EmilienM | mwhahaha: I'm investigating | 13:54 |
| openstackgerrit | ShangXiao proposed openstack/tripleo-common master: Update and replace http with https for doc links https://review.openstack.org/504869 | 13:54 |
| *** trown|brb is now known as trown | 13:55 | |
| *** jcoufal has joined #tripleo | 13:55 | |
| weshay | mandre, panda I think you mean "tripleo-ci-testing" which would refer to the containers being tested by https://review.rdoproject.org/zuul/ in the 4hr queue | 13:55 |
| *** ecerquei has quit IRC | 13:55 | |
| panda | those shouldn't be uploaded in dockerhub anymore, the testing images should remain in rdo registry | 13:56 |
| *** psahoo has joined #tripleo | 13:57 | |
| EmilienM | mwhahaha: yeah i wonder if we are missing the curl gem | 13:57 |
| EmilienM | mwhahaha: or if it's embedded somewhere | 13:58 |
| *** aputtur_ has joined #tripleo | 13:59 | |
| *** aputtur_ has quit IRC | 13:59 | |
| EmilienM | mwhahaha: my issue is the version of puppet-rabbitmq is the same in gate and in promotion pipeline, which means no change | 13:59 |
| openstackgerrit | Ryan Brady proposed openstack/tripleo-common master: [WIP] Adds Action to List Available Roles https://review.openstack.org/509832 | 13:59 |
| EmilienM | mwhahaha: https://www.diffchecker.com/un0vghqe | 13:59 |
| EmilienM | mwhahaha: on the left, promotion job, failing, on the right, gate, working | 13:59 |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 14:00 |
| mandre | weshay: the tags are a bit confusing, can you explain what each of them tag mean? | 14:00 |
| *** ratailor has joined #tripleo | 14:00 | |
| mandre | weshay: trown used passed-ci in https://github.com/openstack/tripleo-quickstart/commit/64cfd451383d868d98957061a8954f3154c6717c | 14:00 |
| *** d0ugal has joined #tripleo | 14:01 | |
| mwhahaha | EmilienM: usually those errors are a provider loading problem (ie missing requires or ordering) | 14:01 |
| mwhahaha | but they are also really hard to debug :( | 14:01 |
| EmilienM | yeah | 14:02 |
| EmilienM | mwhahaha: i'm redoing the pkg diff, I have a doubt | 14:02 |
| mwhahaha | the archive module provides the curl provider so it would seem odd to be missing | 14:02 |
| weshay | mandre, how late are you on today.. we're going to walk EmilienM and mwhahaha through that pipeline today. you are welcome to join | 14:03 |
| *** aputtur has quit IRC | 14:03 | |
| EmilienM | mwhahaha: ok I re-did the diff | 14:04 |
| EmilienM | https://www.diffchecker.com/ClzO7ZpU | 14:04 |
| EmilienM | I think it's clear this time :D | 14:04 |
| *** aputtur has joined #tripleo | 14:04 | |
| mandre | weshay: I'm here for about two more hours or so | 14:04 |
| EmilienM | oh they pushed a new release | 14:04 |
| *** catintheroof has joined #tripleo | 14:05 | |
| mwhahaha | who? | 14:05 |
| trown | mandre: the passed-ci-test tag was never meant for anything other than panda's testing of the automation, it has been removed from dockerhub | 14:05 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Enhances Roles List https://review.openstack.org/508514 | 14:05 |
| weshay | mandre, EmilienM mwhahaha trown would 2:30 utc work for the tripleo promotion pipeline discussion work? | 14:05 |
| trown | weshay: in 30 min? fine by me | 14:06 |
| weshay | an hour? | 14:06 |
| weshay | oh I mean 3 | 14:06 |
| weshay | sorry | 14:06 |
| panda | weshay: do you accept other guests ? (not me) | 14:06 |
| weshay | panda, sure | 14:06 |
| *** catinthe_ has joined #tripleo | 14:06 | |
| *** catintheroof has quit IRC | 14:07 | |
| *** aputtur has quit IRC | 14:07 | |
| mandre | trown: too bad, I was expecting it would be newer images, cf https://review.openstack.org/#/c/510036/ and related bug | 14:07 |
| EmilienM | weshay: in 3h? | 14:07 |
| *** aputtur has joined #tripleo | 14:07 | |
| EmilienM | I would have to check with bnemec - he knows why | 14:07 |
| weshay | 3pm utc | 14:07 |
| mwhahaha | that's not 3pm utc | 14:08 |
| EmilienM | the issue in weshay's job is weird, it's deploying the exact same packages as our gate | 14:08 |
| EmilienM | I compared puppet-mysql, https://github.com/puppetlabs/puppetlabs-mysql/compare/8d11960...8fe8e24 | 14:08 |
| EmilienM | nothing changed | 14:08 |
| trown | mandre: fwiw, I think the correct fix for the galera issue is to revert the change that broke things... but I get that is not ideal | 14:09 |
| EmilienM | weshay: can you hold a node so we can live debug? sorry I can't reproduce | 14:09 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Pin scenario001-multinode-containers to earlier ceph docker container https://review.openstack.org/509722 | 14:09 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Temporarily fallback to BM fluentd https://review.openstack.org/510018 | 14:09 |
| bnemec | EmilienM: What do I know? | 14:09 |
| *** archit has joined #tripleo | 14:09 | |
| EmilienM | bnemec: the meeting we had :-) | 14:09 |
| trown | weshay: EmilienM mwhahaha, 3pm utc is an hour from now, are we moving our meeting to an hour from now? | 14:10 |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721497 | 14:10 |
| openstack | Launchpad bug 1721497 in tripleo "galera(galera)[34]: ERROR: Could not determine galera name from pacemaker node <galera-bundle-0>" [Critical,In progress] - Assigned to John Trowbridge (trown) | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721723 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1721723 in tripleo "fluentd image missing from tripleomaster/tripleopike registry" [Critical,Confirmed] - Assigned to John Trowbridge (trown) | 14:10 |
| mwhahaha | i'm open if we want to | 14:10 |
| EmilienM | same | 14:11 |
| bnemec | EmilienM: Oh, I get it now. | 14:11 |
| *** bnemec is now known as beekneemech | 14:11 | |
| EmilienM | :) | 14:11 |
| *** amoralej|away is now known as amoralej | 14:11 | |
| beekneemech | It's been a long week. :-) | 14:11 |
| *** spectr has quit IRC | 14:11 | |
| *** aputtur has quit IRC | 14:12 | |
| *** aputtur has joined #tripleo | 14:12 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-common master: Fix step_config output which is str not list https://review.openstack.org/510131 | 14:12 |
| *** psahoo has quit IRC | 14:14 | |
| derekh | weshay: mind if I sit in on your pipeline discussion, /me is trying to get back get vaguely familiar with how things work these days | 14:14 |
| weshay | derekh, will add you.. note folks I have not changed the time yet | 14:15 |
| *** d0ugal has quit IRC | 14:15 | |
| derekh | weshay: thanks | 14:15 |
| *** aputtur_ has joined #tripleo | 14:15 | |
| *** aputtur has quit IRC | 14:16 | |
| *** ykarel|afk has quit IRC | 14:17 | |
| *** aputtur has joined #tripleo | 14:17 | |
| *** ebarrera has quit IRC | 14:20 | |
| gfidente | jistr mandre I was going through the minor update process with matbu and marios | 14:21 |
| gfidente | it came up at some point that paunch might be pulling a new image for ceph out of overcloud-container.j2 | 14:21 |
| gfidente | and even restart the ceph containers? | 14:21 |
| gfidente | have pointers to the code driving this process? | 14:22 |
| gfidente | specifically I wasn't expecting paunch to do this but only ceph-ansible to have ownership | 14:22 |
| jistr | well they aren't managed by paunch, no? | 14:22 |
| EmilienM | weshay, mwhahaha: I have no clue for rabbit/curl thing - now I'm reproducing the featureset in my env and debug from there | 14:22 |
| jistr | so i think paunch shouldn't touch them... | 14:22 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras master: Work with containers across builds https://review.openstack.org/509232 | 14:23 |
| gfidente | jistr yeah those were my expectations as well | 14:23 |
| gfidente | I just wanted to make sure from code | 14:23 |
| *** ebarrera has joined #tripleo | 14:23 | |
| trown | weshay: need to adjust the osp config to use those vars ^, but that is how we would set the ceph vars in the j2 with the prepare commands | 14:23 |
| *** dpawar has quit IRC | 14:24 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras master: Work with containers across builds https://review.openstack.org/509232 | 14:24 |
| *** artom_ is now known as artom | 14:25 | |
| weshay | trown, oh I see.. thanks that was kind of hidden | 14:25 |
| weshay | you'd have to know what the src template looks like to set ceph correctly from the cli | 14:25 |
| weshay | or am i crazy? | 14:25 |
| EmilienM | weshay: so when do we meet? I'm lost now | 14:25 |
| weshay | can you meet early? | 14:25 |
| weshay | 3pm utc | 14:25 |
| weshay | others want to join as well | 14:26 |
| jistr | gfidente, matbu, marios: i didn't actually test this, but i think paunch doesn't touch the containers managed by pacemaker, so i don't expect it to touch the ceph-ansible ones either. Is there a reason to suspect otherwise? stevebaker would probably know this, but we can do a short code search right now | 14:26 |
| weshay | that don't live in C eh N eh D eh | 14:26 |
| trown | weshay: ya you would, since those variables are not exposed on the cli directly, but have to use --set | 14:26 |
| weshay | trown, k.. thanks | 14:26 |
| EmilienM | weshay: please update calendar or I'll miss it | 14:27 |
| mandre | gfidente: check the labels on your ceph containers, normally it shouldn't have 'managed_by=paunch' | 14:28 |
| gfidente | mandre right they don't | 14:28 |
| *** paramite has quit IRC | 14:28 | |
| gfidente | jistr I think social saw the wrong image pulled after an update | 14:28 |
| mandre | so paunch should be ignoring them, are you sure it's paunch that restart them? | 14:28 |
| gfidente | not sure the root cause was paunch, guess we'll need to reproduce it | 14:29 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: add config to set neutron mtu in undercloud/overcloud https://review.openstack.org/509660 | 14:29 |
| gfidente | and see if it wasn't collateral effect | 14:29 |
| gfidente | of something else | 14:29 |
| gfidente | though +1 on pulling the image | 14:29 |
| jistr | https://github.com/openstack/paunch/blob/d11e04548e43c0ad099910cfacdb02d43e8a3a7c/paunch/cmd.py#L155-L161 | 14:31 |
| jistr | https://github.com/openstack/paunch/blob/d11e04548e43c0ad099910cfacdb02d43e8a3a7c/paunch/runner.py#L83-L101 | 14:31 |
| *** dmarlin has joined #tripleo | 14:31 | |
| jistr | as far as existing containers go, it should only look at containers with a desired value in `managed_by` label | 14:32 |
| jistr | defaulting to `paunch` | 14:32 |
| *** d0ugal has joined #tripleo | 14:32 | |
| gfidente | yeah thanks | 14:32 |
| *** dpawar has joined #tripleo | 14:34 | |
| *** dsariel has joined #tripleo | 14:35 | |
| EmilienM | hrybacki, jaosorior: thanks | 14:35 |
| hrybacki | EmilienM++ | 14:36 |
| jistr | gfidente: btw i'm starting to prototype the mechanism that could be used to install kubernetes and ceph going forward (the ansible way) https://review.openstack.org/#/c/510122/ | 14:38 |
| gfidente | yay | 14:39 |
| *** beekneemech has quit IRC | 14:40 | |
| *** rmascena is now known as raildo | 14:41 | |
| *** bnemec has joined #tripleo | 14:42 | |
| *** vpickard has quit IRC | 14:43 | |
| numans | EmilienM, Hi, when you get some time can you please take a look into it - https://review.openstack.org/#/c/502899/ and provide your comments | 14:43 |
| *** dpawar has quit IRC | 14:44 | |
| derekh | is gate-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024 broken on stable/pike ? | 14:46 |
| *** suuuper has quit IRC | 14:46 | |
| openstackgerrit | Toure Dunnon proposed openstack/python-tripleoclient master: Tripleoclient unified queue name. https://review.openstack.org/509902 | 14:46 |
| *** jprovazn has quit IRC | 14:47 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras master: Make sure ansible_distribution is defined https://review.openstack.org/510146 | 14:50 |
| *** vpickard has joined #tripleo | 14:51 | |
| *** ecerquei has joined #tripleo | 14:52 | |
| *** ecerquei has quit IRC | 14:52 | |
| *** ecerquei_ has quit IRC | 14:52 | |
| *** dparkes has quit IRC | 14:54 | |
| *** ecerquei has joined #tripleo | 14:54 | |
| EmilienM | numans: ok I will | 14:55 |
| numans | EmilienM, thanks | 14:55 |
| mwhahaha | weshay: so we doing the meeting now or later? | 14:55 |
| EmilienM | derekh: yes | 14:55 |
| EmilienM | derekh: let me show you the bug report, tl;dr it's in heat and it's about to be fixed | 14:56 |
| weshay | mwhahaha, EmilienM derekh trown can you guys meet in 5? | 14:56 |
| weshay | minutes | 14:56 |
| weshay | 4 min | 14:56 |
| mwhahaha | yes | 14:56 |
| *** mdnadeem has quit IRC | 14:56 | |
| EmilienM | derekh: https://review.openstack.org/#/c/509227/ | 14:56 |
| trown | 3.5 | 14:56 |
| weshay | ok.. I'm getting on blue | 14:57 |
| openstackgerrit | Justin Kilpatrick proposed openstack/tripleo-quickstart-extras master: Disruption detection and some stack update roles https://review.openstack.org/497950 | 14:57 |
| weshay | when did a pop up browser window become an app | 14:58 |
| EmilienM | numans: can you show me logs of a recent job where it worked? | 14:58 |
| weshay | stupid bluejeans | 14:58 |
| weshay | mwhahaha, EmilienM derekh trown panda https://bluejeans.com/288609679/browser | 14:58 |
| mwhahaha | i find the app works better | 14:58 |
| *** shreshtha has joined #tripleo | 14:58 | |
| EmilienM | dmsimard: why so much complicated here: https://review.openstack.org/#/c/502899/4/zuul.d/projects.yaml | 14:58 |
| weshay | fair enough | 14:58 |
| numans | EmilienM, you mean adding this patch https://review.openstack.org/#/c/502899/ as Depends-On and test it ? | 14:59 |
| weshay | mandre, https://bluejeans.com/288609679/browser | 14:59 |
| mandre | weshay: ack, joining | 14:59 |
| dmsimard | EmilienM: I don't understand the question | 14:59 |
| numans | EmilienM, basically this patch - https://review.openstack.org/#/c/502542/ needs the on the project-config patch. I can update this patch with depends-on. | 15:00 |
| EmilienM | dmsimard: the zuul layout is more complicated now, we duplicate all the things | 15:00 |
| EmilienM | numans: yes | 15:00 |
| openstackgerrit | Pradeep Kilambi proposed openstack/instack-undercloud master: Remove legacy ceilometer api from undercloud https://review.openstack.org/507936 | 15:00 |
| dmsimard | EmilienM: no kidding it's more complicated, it's not meant to be maintained or maintainable that way | 15:01 |
| EmilienM | numans: basically I'm asking for the proof of the job being green | 15:01 |
| openstackgerrit | Pradeep Kilambi proposed openstack/instack-undercloud master: Remove legacy ceilometer api from undercloud https://review.openstack.org/507936 | 15:01 |
| numans | EmilienM, ack. I will do that. concern in the project-config patch is the lot of duplicate code. And I am not sure how to resolve it :) | 15:01 |
| EmilienM | numans: and stable | 15:01 |
| dmsimard | EmilienM: you are supposed to move stuff to in-repo zuul.yaml job/layout asap | 15:01 |
| EmilienM | dmsimard: I haven't taken time to look at it | 15:01 |
| *** egonzalez has quit IRC | 15:03 | |
| openstackgerrit | Numan Siddique proposed openstack/tripleo-heat-templates master: Add trunk service plugin to OVN environment files https://review.openstack.org/502542 | 15:03 |
| *** spectr has joined #tripleo | 15:04 | |
| *** spectr has quit IRC | 15:04 | |
| hrybacki | EmilienM: okay, several libraries had already ported to using 'Default' I think I've got the rest up now. I saw yatin also posted up reviews for the ec2-api and zaqar libraries this morning | 15:04 |
| tosky | hrybacki: thanks for the Sahara patch | 15:06 |
| dmsimard | EmilienM: mnaser's https://github.com/openstack/puppet-openstack-integration/blob/master/.zuul.yaml is infinitely simpler than what the legacy jobs and the legacy layout provided | 15:06 |
| *** links has joined #tripleo | 15:07 | |
| EmilienM | dmsimard: I'll look at that as soon as I can unless someone else already started it | 15:07 |
| openstackgerrit | Numan Siddique proposed openstack/tripleo-heat-templates stable/pike: TESTING ONLY.. TESTING THE PROJECT-CONFIG PATCH FOR OVN https://review.openstack.org/510156 | 15:08 |
| *** bnemec has quit IRC | 15:08 | |
| hrybacki | tosky++ | 15:09 |
| *** ratailor has quit IRC | 15:09 | |
| *** bnemec has joined #tripleo | 15:09 | |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721497 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721723 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1721497 in tripleo "galera(galera)[34]: ERROR: Could not determine galera name from pacemaker node <galera-bundle-0>" [Critical,In progress] - Assigned to John Trowbridge (trown) | 15:10 |
| openstack | Launchpad bug 1721723 in tripleo "fluentd image missing from tripleomaster/tripleopike registry" [Critical,Confirmed] - Assigned to John Trowbridge (trown) | 15:10 |
| *** noslzzp has quit IRC | 15:11 | |
| EmilienM | numans: what I'm asking for https://review.openstack.org/#/c/502899/ is that you provide me a link of an experimental job that passed on this scenario, so I can know it actually work | 15:12 |
| numans | EmilienM, oh ok. one sec - https://review.openstack.org/#/c/509981/ - http://logs.openstack.org/81/509981/1/experimental/gate-tripleo-ci-centos-7-scenario007-multinode-oooq-container-nv/7b71552/ | 15:13 |
| numans | EmilienM, the job failed though for some other unrelated reason. | 15:13 |
| EmilienM | numans: and we want it voting? | 15:13 |
| EmilienM | I want to see a successful job before we make it voting | 15:13 |
| numans | EmilienM, yes. that's what you had suggested | 15:13 |
| numans | EmilienM, https://review.openstack.org/#/c/468860/ if you see this patch | 15:14 |
| numans | EmilienM, the experimental job was successful and hence the patch (which adds ovn container support ) was also merged | 15:14 |
| EmilienM | numans: Aug 23 is a bit old | 15:14 |
| EmilienM | a lot happened in 45 days | 15:15 |
| numans | EmilienM, ok. got it | 15:15 |
| numans | EmilienM, let me make this job https://review.openstack.org/#/c/509981/ successful and i will let you know once done | 15:15 |
| *** MVenesio has quit IRC | 15:16 | |
| EmilienM | numans: cool | 15:17 |
| numans | EmilienM, the project-config patch - https://review.openstack.org/#/c/502899/ does 2 things. 1. it adds the environment/neutron-ovn* files to the list of files so that scenario007 job gets triggered when the ovn environment files are modified. 2. Makes scenario007-container job voting. Probably i shouldn't have done this. I will submit 2 separate patches | 15:17 |
| EmilienM | numans: wfm | 15:18 |
| *** vpickard has quit IRC | 15:18 | |
| EmilienM | numans: make it non voting until we know it works and it's stable | 15:18 |
| numans | EmilienM, ack. | 15:18 |
| *** rcernin has quit IRC | 15:19 | |
| *** dsariel has quit IRC | 15:20 | |
| *** vpickard has joined #tripleo | 15:20 | |
| EmilienM | numans: thanks for this work! | 15:20 |
| numans | EmilienM, thanks. | 15:21 |
| *** jlinkes has quit IRC | 15:21 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart master: Change image paths to the images server https://review.openstack.org/510112 | 15:22 |
| EmilienM | dmsimard: so I'm supposed to open this 38592 LOC file and take out the tripleo bits and put it somewhere | 15:22 |
| EmilienM | dmsimard: could we maybe pair on this one (share screen + bluejeans) for one project so I can do all the rest myself | 15:23 |
| *** jaosorior has quit IRC | 15:24 | |
| bandini | trown: do we have a rough ETA for fixing up the containers with those packages? | 15:24 |
| *** vpickard has quit IRC | 15:30 | |
| *** vpickard has joined #tripleo | 15:30 | |
| trown | panda: bandini we decided to just push new (unverified) containers? | 15:33 |
| bandini | trown: no no, I think we will land the revert. am just wondering about roughly when we can land the patch again (i.e. when the containers will have the right packages) | 15:34 |
| derekh | weshay: about resources, its also worth noting that rh2 is still a thing, I think a few people are using it but they should probably move to rdo-cloud and you could take that hardware back, (or it could be maybe added to rdo-cloud) | 15:35 |
| trown | bandini: ah that depends on promotion... we have gone 25+ days without promotion, so it is critical and being worked on | 15:35 |
| weshay | derekh, cool thanks. I'll check to see if that's been allocated or not. | 15:36 |
| trown | bandini: but it is not really easy to say when we will get all the issues fixed (without being hit by new ones in the process) | 15:36 |
| bandini | trown: got it. if we see that we're still stuck for another week or so on promotion, would it be reasonable to go for an exception for those three containers? | 15:37 |
| *** ffiore has quit IRC | 15:37 | |
| trown | bandini: seems reasonable to me ... mandre wdyt? | 15:37 |
| mandre | trown, bandini: fine with me, remember how it was the far west with tripleoupstream | 15:38 |
| *** akrivoka has quit IRC | 15:38 | |
| *** tongl has joined #tripleo | 15:39 | |
| trown | mandre: bandini, ok, especially given that we are really just now trying to tame the container build/test process I would be ok setting a week deadline for promote (or we do a manual upload for this issu) | 15:39 |
| trown | issue | 15:39 |
| bandini | mandre, trown: ack, thanks | 15:39 |
| trown | and only manually upload the affected containers, not all of them | 15:39 |
| *** sid1 has quit IRC | 15:40 | |
| trown | all of them has a pretty high chance to just break us worse | 15:40 |
| bandini | agreed | 15:40 |
| dmsimard | EmilienM: it's not necessarily straightforward, for example we needed to change some things in both packstack https://review.openstack.org/#/c/508434/ and puppet-openstack https://review.openstack.org/#/c/508296/ | 15:40 |
| bandini | yeah it is really only those three that need updated pcmk + resource-agents | 15:40 |
| *** jmelvin has quit IRC | 15:43 | |
| *** lucasagomes is now known as lucas-afk | 15:44 | |
| *** dtantsur is now known as dtantsur|afk | 15:44 | |
| *** yamahata has quit IRC | 15:46 | |
| *** aufi has quit IRC | 15:47 | |
| *** morazi has quit IRC | 15:47 | |
| *** mrch has quit IRC | 15:52 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-pacemaker master: WIP Implement stonith levels resource https://review.openstack.org/508678 | 15:55 |
| EmilienM | weshay, mwhahaha: do we have ongoing efforts to migrate our layouts to zuul v3 as it's documented here: https://docs.openstack.org/infra/manual/zuulv3.html ? (puppet-openstack and packstack moved already) | 15:56 |
| *** sid1 has joined #tripleo | 15:57 | |
| *** ffiore has joined #tripleo | 15:57 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: Remove Heat Cloudwatch API during upgrade and disable by default https://review.openstack.org/510101 | 16:00 |
| *** thrash is now known as thrash|biab | 16:02 | |
| mwhahaha | EmilienM: not that i'm aware of, probably should get added to the ci squad board for a sprint | 16:05 |
| matbu | mwhahaha: EmilienM hey, i wanted to ask, if it possible to make a ooo-common release ? i have patch in the cli that needs a ooo-common release to gets the unit tests green | 16:05 |
| EmilienM | matbu: go ahead, ping me if you need help | 16:05 |
| EmilienM | matbu: you can submit a patch in openstack/releases | 16:06 |
| matbu | EmilienM: you think i can do it by myself ? | 16:06 |
| EmilienM | oh yeah | 16:06 |
| matbu | EmilienM: hmm oki nice | 16:06 |
| EmilienM | anyone can submit a release | 16:06 |
| matbu | i didn't know | 16:06 |
| EmilienM | it has to have +1 from my or mwhahaha or shardy | 16:06 |
| matbu | ack | 16:06 |
| EmilienM | and approved by OpenStack release-managers, available on #openstack-release | 16:06 |
| EmilienM | matbu: wait wait | 16:06 |
| EmilienM | you know YAML ? :) | 16:06 |
| EmilienM | coz you need to know yaml | 16:07 |
| matbu | EmilienM: more or less :D | 16:07 |
| EmilienM | lol | 16:07 |
| mwhahaha | actually you shouldn't need to know yaml | 16:07 |
| mwhahaha | you can just use the relase tools | 16:07 |
| matbu | ha yep looks like there is a script :) | 16:08 |
| mwhahaha | tox -e venv -- new-release <some random args> or something | 16:08 |
| *** bnemec has quit IRC | 16:08 | |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721497 | 16:10 |
| openstack | Launchpad bug 1721497 in tripleo "galera(galera)[34]: ERROR: Could not determine galera name from pacemaker node <galera-bundle-0>" [Critical,In progress] - Assigned to John Trowbridge (trown) | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721723 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1721723 in tripleo "fluentd image missing from tripleomaster/tripleopike registry" [Critical,Confirmed] - Assigned to John Trowbridge (trown) | 16:10 |
| EmilienM | mwhahaha: good point | 16:10 |
| *** jaganathan has quit IRC | 16:10 | |
| *** shreshtha_ has joined #tripleo | 16:10 | |
| *** shreshtha has quit IRC | 16:11 | |
| mwhahaha | tox -e venv -- new-release queens tripleo-common i think | 16:11 |
| *** ffiore has quit IRC | 16:12 | |
| *** pcaruana has quit IRC | 16:13 | |
| *** tongl has quit IRC | 16:18 | |
| *** tongl has joined #tripleo | 16:18 | |
| *** panda is now known as panda|bbl | 16:19 | |
| *** achadha has joined #tripleo | 16:25 | |
| *** tosky has quit IRC | 16:26 | |
| *** jpich has quit IRC | 16:27 | |
| *** ebarrera has quit IRC | 16:27 | |
| *** morazi has joined #tripleo | 16:34 | |
| EmilienM | weshay: hey quick question | 16:38 |
| EmilienM | weshay: I'm trying to reproduce the periodic job issue | 16:38 |
| EmilienM | I'm looking at https://logs.rdoproject.org/53/509853/1/openstack-experimental/gate-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master-nv/Za3c0303f520646378c6277273c451f25/undercloud/etc/yum.repos.d/ | 16:38 |
| EmilienM | is the repo I should test is https://logs.rdoproject.org/53/509853/1/openstack-experimental/gate-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master-nv/Za3c0303f520646378c6277273c451f25/undercloud/etc/yum.repos.d/delorean.repo.txt.gz ? | 16:39 |
| EmilienM | like f4/42/f442a3aa35981c3d6d7e312599dde2a1b1d202c9_0468cca4 is the failing hash? | 16:39 |
| weshay | EmilienM, ya.. overrite your release config to point to that | 16:39 |
| weshay | and use master-tripleo-ci | 16:39 |
| EmilienM | weshay: weird, I deployed fs004 in traas and I already had this repo | 16:40 |
| EmilienM | and it deployed fine | 16:40 |
| weshay | EmilienM, traas just happened to pick up that hash? | 16:41 |
| weshay | no way | 16:41 |
| *** marios has quit IRC | 16:41 | |
| EmilienM | yea | 16:41 |
| EmilienM | let me triple check again | 16:41 |
| EmilienM | I have /f4/42/f442a3aa35981c3d6d7e312599dde2a1b1d202c9_0468cca4 | 16:42 |
| EmilienM | which is the same hash as https://logs.rdoproject.org/53/509853/1/openstack-experimental/gate-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master-nv/Za3c0303f520646378c6277273c451f25/undercloud/etc/yum.repos.d/delorean.repo.txt.gz | 16:42 |
| EmilienM | weird uh? | 16:42 |
| *** milan has quit IRC | 16:42 | |
| EmilienM | delorean-current.repo was different though | 16:42 |
| EmilienM | and I know we use delorean-current.repo for deploying puppet modules | 16:43 |
| EmilienM | but still my deployment is super fresh and it worked | 16:43 |
| EmilienM | weshay: can you trick to kick off a job on your side as well, and replicate what is deployed in rdo ci? | 16:44 |
| weshay | EmilienM, yes I will shortly.. closing out an ocata thing, need 5 min | 16:45 |
| *** trown is now known as trown|lunch | 16:45 | |
| EmilienM | k | 16:47 |
| *** derekh has quit IRC | 16:52 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: Add custom options support for sosreport command https://review.openstack.org/506211 | 16:56 |
| rook | Is there any RFEs for tracking container logging? | 16:57 |
| rook | *is/are | 16:57 |
| EmilienM | rook: https://blueprints.launchpad.net/tripleo/+spec/containerized-services-logs | 16:58 |
| EmilienM | rook: you can find rfes on https://launchpad.net/tripleo/+milestone/queens-1 https://launchpad.net/tripleo/+milestone/queens-2 https://launchpad.net/tripleo/+milestone/queens-3 | 16:58 |
| rook | EmilienM: yeah, I was searching, but this blueprint is the ticket. | 16:58 |
| rook | EmilienM: any of this work going to be backportable to Pike? | 16:58 |
| EmilienM | rook: we don't backport features | 16:59 |
| *** bnemec has joined #tripleo | 16:59 | |
| EmilienM | we backport bugfixes only | 16:59 |
| rook | :) logs are a feature ehh? | 16:59 |
| rook | news to me. | 16:59 |
| * rook is somewhat kidding | 16:59 | |
| *** gbarros has quit IRC | 16:59 | |
| EmilienM | but I agree logs is super important | 16:59 |
| EmilienM | and we might consider some backports if possible | 16:59 |
| mwhahaha | not having any logging -> bug | 17:00 |
| mwhahaha | improvement to logging -> feature | 17:00 |
| rook | I mean we have logs right, from a operational standpoint, it s a noop... | 17:00 |
| mwhahaha | not having any logging would also mean that the feature wasn't complete and shouldn't have been marked ready for pike | 17:01 |
| rook | jump to the controller, then determine which specific log you are interested in, find the container, jump in the container, go to the logs. | 17:01 |
| mwhahaha | logging probably should have been one of those up front items that would be accounted for early in the feature planning (but it never is) | 17:01 |
| *** ramishra has quit IRC | 17:02 | |
| rook | mwhahaha: agreed. | 17:02 |
| *** sid1 has quit IRC | 17:02 | |
| *** melwitt is now known as jgwentworth | 17:02 | |
| Tengu | hello! small question regarding the haproxy stuff on the controllers: I'd like to add a new backend or, at least, allow ppl to add new backend - I suspect you'd be happy if I make some PR in that direction? | 17:03 |
| rook | mwhahaha just playing with this stuff at scale, and it is quite frustrating to debug any issues that creep up. | 17:03 |
| rook | mwhahaha like for example, i deployed ceph (with ceph-ansible) with 800+ OSDs (deployment succeeded yaya!), but the osd+journal was collocated.... but to determine that, I had to jump in the OSD container, and look at the configuration. | 17:04 |
| mwhahaha | so if it's not exposed externally in /var/log/containers, that's a bug | 17:05 |
| mwhahaha | and you should ping the ceph folks on that one | 17:05 |
| *** openstackstatus has quit IRC | 17:05 | |
| *** openstack has joined #tripleo | 17:06 | |
| *** ChanServ sets mode: +o openstack | 17:06 | |
| EmilienM | rook: ping fultonj or gfidente about that | 17:07 |
| rook | oh EmilienM fultonj knows my pain :D | 17:07 |
| fultonj | hi | 17:07 |
| mwhahaha | so yea if that gets fixed, we should back port that because that's a bug | 17:07 |
| *** openstackstatus has joined #tripleo | 17:08 | |
| *** ChanServ sets mode: +v openstackstatus | 17:08 | |
| * fultonj reading up | 17:08 | |
| fultonj | colocation is fixed | 17:09 |
| rook | fultonj in tripleo? | 17:09 |
| rook | or just pull the latest bits and it is good to go? | 17:09 |
| rook | fultonj the converstaion is really about logging, not colocation not working. | 17:10 |
| rook | i was using that as a example. | 17:10 |
| fultonj | tripleo will deploy correct colocation via ceph-ansible | 17:10 |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721497 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721723 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| fultonj | provided it's the new one | 17:10 |
| fultonj | which is on its way provided https://review.openstack.org/#/c/501810 passes | 17:10 |
| fultonj | on itsw ay to promotion | 17:10 |
| fultonj | yes logs... | 17:10 |
| *** Goneri has quit IRC | 17:10 | |
| rook | saying logs is like a bad thing :D | 17:10 |
| openstack | Launchpad bug 1721497 in tripleo "galera(galera)[34]: ERROR: Could not determine galera name from pacemaker node <galera-bundle-0>" [Critical,In progress] - Assigned to John Trowbridge (trown) | 17:12 |
| openstack | Launchpad bug 1721723 in tripleo "fluentd image missing from tripleomaster/tripleopike registry" [Critical,Confirmed] - Assigned to John Trowbridge (trown) | 17:12 |
| openstackgerrit | Merged openstack/tripleo-common stable/pike: Execute minor update via ansible on mistral https://review.openstack.org/509707 | 17:12 |
| *** yamahata has joined #tripleo | 17:13 | |
| *** mcornea has quit IRC | 17:13 | |
| Tengu | Anyone involved in HAproxy integration interested in commenting this issue? https://bugs.launchpad.net/tripleo/+bug/1721832 - I'd like to have some feedback on my implementation proposal before doing any dev :). | 17:13 |
| openstack | Launchpad bug 1721832 in tripleo "Allow to add custom backends in HAProxy" [Undecided,New] | 17:13 |
| fultonj | rook: one sec, let me make sure i follow and then i'll file bug | 17:13 |
| gfidente | EmilienM mwhahaha fultonj so I think newer build will log into journal only | 17:14 |
| gfidente | is that fair? | 17:14 |
| fultonj | gfidente ^ | 17:15 |
| * mwhahaha is unsure our logging strategy | 17:15 | |
| atoth | mwhahaha, so I've verified that featureset007 does not pass post newton release. Unless you want me to punt on it for now, I'll add the lbaas test to it but won't be able to verify it. | 17:16 |
| mwhahaha | atoth: why newton? | 17:16 |
| mwhahaha | oh sorry post newton | 17:16 |
| mwhahaha | seems like that needs to get fixed | 17:17 |
| mwhahaha | why doesnt it pass | 17:17 |
| fultonj | so we have ceph container logs, i think it's a matter of where they are | 17:17 |
| atoth | mwhahaha, have looked into it, just veriying base functionality before adding update | 17:18 |
| gfidente | fultonj they are in host journal | 17:18 |
| mwhahaha | k | 17:18 |
| atoth | mwhahaha, haven't | 17:18 |
| gfidente | well they will be there only | 17:18 |
| gfidente | with the newer builds | 17:18 |
| * gfidente going afk for dinner | 17:18 | |
| *** jpena is now known as jpena|off | 17:19 | |
| mwhahaha | they reallistically should be in the same place as everything else | 17:19 |
| * mwhahaha notes a lack of consistency is a pet peeve of his | 17:20 | |
| *** bnemec is now known as beekneemech | 17:20 | |
| *** thrash|biab is now known as thrash | 17:20 | |
| atoth | mwhahaha, I'll be away next week but aputtur says he'll give debugging it a shot, but he's new to it all and will probably need some guidance | 17:25 |
| thrash | mwhahaha: you have any objection to me putting a W+1 on this? https://review.openstack.org/#/c/508165/ | 17:25 |
| thrash | mwhahaha: need to backport it to pike | 17:26 |
| *** Goneri has joined #tripleo | 17:26 | |
| mwhahaha | thrash: let me look | 17:26 |
| mwhahaha | thrash: approved | 17:27 |
| thrash | mwhahaha: danke | 17:27 |
| thrash | mwhahaha: i figured the one job that failed passed on the zuulv3 side. :D | 17:27 |
| mwhahaha | and an ovb timeout | 17:28 |
| thrash | yah | 17:28 |
| *** links has quit IRC | 17:32 | |
| openstackgerrit | Dan Williams proposed openstack/puppet-pacemaker master: All more than one order rule between two resources. https://review.openstack.org/510196 | 17:33 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: overcloud-deploy: add config-download + ansible run feature https://review.openstack.org/508306 | 17:35 |
| *** salmankhan has quit IRC | 17:35 | |
| mwhahaha | dmsimard: do you know how to fix the unbound.log cause its empty. Paul was looking at it a few weeks ago but we keep randomly having dns timeouts https://bugs.launchpad.net/tripleo/+bug/1721702 | 17:39 |
| openstack | Launchpad bug 1721702 in tripleo "Possible DNS issue in the CI" [Undecided,New] | 17:39 |
| dmsimard | mwhahaha: unbound is set up by nodepool, maybe search there | 17:39 |
| dmsimard | oh, wait | 17:39 |
| mwhahaha | it's there, just empty | 17:39 |
| mwhahaha | he said he had to fix it in the dib or something | 17:39 |
| mwhahaha | maybe it was perms | 17:40 |
| * mwhahaha forgets and paul isn't here | 17:40 | |
| dmsimard | mwhahaha: there is some amount of unbound configuration happening here: https://github.com/openstack-infra/project-config/blob/master/nodepool/scripts/configure_mirror.sh | 17:40 |
| dmsimard | HOWEVER, that script is not used in zuul v3 | 17:40 |
| *** MVenesio has joined #tripleo | 17:40 | |
| mwhahaha | yea this is v2 | 17:40 |
| dmsimard | I don't believe we have something for setting up unbound on zuul v3, so let's leave that for later for now | 17:40 |
| mwhahaha | http://logs.openstack.org/97/509397/3/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/d67f8e5/console.html#_2017-10-06_06_52_33_436723 | 17:41 |
| mwhahaha | http://logs.openstack.org/97/509397/3/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/d67f8e5/logs/unbound_log.txt.gz | 17:41 |
| openstackgerrit | Dan Williams proposed openstack/puppet-pacemaker master: Allow more than one order rule between two resources. https://review.openstack.org/510196 | 17:42 |
| dmsimard | mwhahaha: hang on. | 17:43 |
| *** masco has quit IRC | 17:44 | |
| *** MVenesio has quit IRC | 17:45 | |
| dmsimard | mwhahaha: the default config looks like this: http://paste.openstack.org/raw/622868/ | 17:45 |
| *** pkovar has quit IRC | 17:45 | |
| mwhahaha | clearly no one ever looks at this log file | 17:45 |
| dmsimard | mwhahaha: however I don't see any particular config in syslog for this | 17:46 |
| gfidente | have good we tripleo | 17:46 |
| dmsimard | mwhahaha: perms look okay -rw-r--r--. 1 unbound root 0 Oct 5 19:00 unbound.log | 17:46 |
| mwhahaha | today is dealing with crappy logging day | 17:47 |
| dmsimard | mwhahaha: oh, journalctl has things http://paste.openstack.org/raw/622869/ | 17:47 |
| dmsimard | Oct 06 16:57:44 upstream-centos-7-rdo-cloud-tripleo-14922 unbound[1191]: Oct 06 16:57:44 unbound[1191:0] error: Could not open logfile /var/log/unbound.log: Permission denied | 17:47 |
| dmsimard | mwhahaha: http://paste.openstack.org/raw/622870/ | 17:47 |
| mwhahaha | wait why are we running enforcing? | 17:48 |
| mwhahaha | or are you looking downstream | 17:48 |
| dmsimard | this is review.rdo which should fairly well represent the same thing as upstream | 17:49 |
| dmsimard | the images start out as enforcing | 17:49 |
| dmsimard | afaik | 17:50 |
| dmsimard | mwhahaha: I think this is the problem https://github.com/openstack-infra/project-config/blob/master/nodepool/elements/nodepool-base/finalise.d/89-unbound#L64-L65 | 17:50 |
| dmsimard | let me test | 17:50 |
| *** gfidente is now known as gfidente|afk | 17:50 | |
| mwhahaha | i bet it works in devstack (on ubuntu) | 17:50 |
| mwhahaha | which is why no one ever noticed | 17:50 |
| fultonj | tripleo pike ceph logging bug coming up... | 17:51 |
| *** ecerquei has quit IRC | 17:52 | |
| dmsimard | mwhahaha: it works after setting chcon -t named_log_t /var/log/unbound.log | 17:55 |
| *** leitan has quit IRC | 17:55 | |
| *** leitan has joined #tripleo | 17:55 | |
| dmsimard | I'll comment on the bug and send a patch later, getting sidetracked from what I was already on | 17:58 |
| mwhahaha | dmsimard: thanks if i get time i'll send a patch myself. sorry to distract you | 17:59 |
| mwhahaha | carry on :D | 17:59 |
| * mwhahaha goes to lunch | 17:59 | |
| *** cylopez has joined #tripleo | 18:00 | |
| dmsimard | mwhahaha: https://bugs.launchpad.net/tripleo/+bug/1721702/comments/2 | 18:01 |
| openstack | Launchpad bug 1721702 in tripleo "Possible DNS issue in the CI" [Medium,Triaged] | 18:01 |
| dmsimard | pabelanger: ^ fyi | 18:01 |
| pabelanger | dmsimard: that would be fixed, we should have moved logs to /var/lib/unbound | 18:02 |
| *** gbarros has joined #tripleo | 18:03 | |
| dmsimard | pabelanger: ah, perhaps we are not up to date in review.rdo but mwhahaha was mentioning that unbound logs are empty upstream http://logs.openstack.org/97/509397/3/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/d67f8e5/logs/unbound_log.txt.gz | 18:03 |
| pabelanger | dmsimard: ya, you are likley collecting an empty file now | 18:04 |
| *** cylopez has quit IRC | 18:04 | |
| dmsimard | pabelanger: ah I see the switch here http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/elements/nodepool-base/finalise.d/89-unbound#n41 | 18:05 |
| dmsimard | pabelanger: we need to fix devstack then ? http://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/functions.sh#n808 | 18:05 |
| dmsimard | well, devstack for non-ubuntu | 18:06 |
| pabelanger | ya, looks like it | 18:06 |
| dmsimard | checking how tripleo collects that .. | 18:06 |
| dmsimard | pabelanger: should probably touch $LOG_FILE instead of /var/log/unbound.log so we don't needlessly collect an empty file -- then again, tripleo just gets /var/log/** | 18:08 |
| openstackgerrit | David Moreau Simard proposed openstack/tripleo-quickstart-extras master: Recover the /var/lib/unbound/unbound.log file https://review.openstack.org/510202 | 18:10 |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721497 | 18:10 |
| openstack | Launchpad bug 1721497 in tripleo "galera(galera)[34]: ERROR: Could not determine galera name from pacemaker node <galera-bundle-0>" [Critical,In progress] - Assigned to John Trowbridge (trown) | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721723 | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| dmsimard | mwhahaha: ^ | 18:10 |
| openstack | Launchpad bug 1721723 in tripleo "fluentd image missing from tripleomaster/tripleopike registry" [Critical,Confirmed] - Assigned to John Trowbridge (trown) | 18:10 |
| *** amoralej is now known as amoralej|off | 18:13 | |
| fultonj | https://bugs.launchpad.net/tripleo/+bug/1721841 | 18:15 |
| openstack | Launchpad bug 1721841 in tripleo "ceph docker containers do not log to /var/log/containers" [High,Triaged] - Assigned to John Fulton (jfulton-org) | 18:15 |
| fultonj | mwhahaha rook EmilienM ^ | 18:15 |
| fultonj | gfidente|afk: ^ | 18:15 |
| *** dmarlin has quit IRC | 18:16 | |
| *** gfidente|afk has quit IRC | 18:16 | |
| *** dmarlin has joined #tripleo | 18:20 | |
| *** trown|lunch is now known as trown | 18:25 | |
| *** psachin has joined #tripleo | 18:29 | |
| openstackgerrit | Dan Prince proposed openstack/os-net-config master: Allow dns_servers to be an empty array https://review.openstack.org/510207 | 18:30 |
| *** tosky has joined #tripleo | 18:32 | |
| openstackgerrit | Moshe Levi proposed openstack/tripleo-specs master: tripleo-ovs-hw-offload https://review.openstack.org/502313 | 18:48 |
| *** toure is now known as toure_biab | 18:50 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: our undercloud default nic should be eth1(nic2) https://review.openstack.org/510212 | 18:56 |
| Tengu | mwhahaha: heya! thanks for the comment regarding the already-running haproxy refactoring. I'll check with Juan if he needs any help, but apparently it's on good track :). | 19:00 |
| mwhahaha | Tengu: sure. he might like some help keeping it up to date and fixing bugs as Juan is a very busy man. But those patches should do what you're looking for | 19:01 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo stable/pike: Allow to configure snmpd_config https://review.openstack.org/510214 | 19:01 |
| *** pchavva has quit IRC | 19:01 | |
| dprince | EmilienM, mwhahaha thanks for the fast reviews there | 19:03 |
| *** aputtur has quit IRC | 19:03 | |
| EmilienM | dprince: cool | 19:04 |
| dprince | EmilienM, mwhahaha also sort related (a different regression)https://review.openstack.org/#/c/510207/ | 19:04 |
| Tengu | mwhahaha: yep, I'm checking them right now, and indeed, they look like what I need :). Any chance they get merged in Pike? | 19:04 |
| dprince | all simple fixes | 19:04 |
| EmilienM | dprince: +2 | 19:04 |
| dprince | boom | 19:05 |
| dprince | EmilienM: this is like the best Friday ever | 19:05 |
| *** chlong has joined #tripleo | 19:06 | |
| EmilienM | lol | 19:07 |
| EmilienM | dprince: talk for you | 19:07 |
| EmilienM | zuul v3 thing is terrible at us | 19:07 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/ocata: snmp: add SnmpdBindHost parameter https://review.openstack.org/510215 | 19:08 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo stable/ocata: Allow to configure snmpd_config https://review.openstack.org/510216 | 19:08 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/newton: snmp: add SnmpdBindHost parameter https://review.openstack.org/510217 | 19:09 |
| Tengu | mwhahaha: another question: what's the state of the CI? is it stabilized? or EmilienM maybe? | 19:09 |
| EmilienM | I don't have words :) | 19:09 |
| mwhahaha | Tengu: 2 scenarios are still failing | 19:09 |
| mwhahaha | pending merges of stuff | 19:09 |
| Tengu | :'( | 19:09 |
| Tengu | ah, ok | 19:09 |
| thrash | Hard to stabilize EmilienM | 19:09 |
| EmilienM | :-O | 19:10 |
| Tengu | guess it's hard to correct, with all the changes made with the containers ;) | 19:10 |
| EmilienM | thrash: that was free | 19:10 |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721497 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721723 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1721497 in tripleo "galera(galera)[34]: ERROR: Could not determine galera name from pacemaker node <galera-bundle-0>" [Critical,In progress] - Assigned to John Trowbridge (trown) | 19:10 |
| Tengu | thrash: :Þ | 19:10 |
| openstack | Launchpad bug 1721723 in tripleo "fluentd image missing from tripleomaster/tripleopike registry" [Critical,Confirmed] - Assigned to John Trowbridge (trown) | 19:10 |
| *** dparkes has joined #tripleo | 19:10 | |
| Tengu | ah, fluentd still there and galera. oook. | 19:10 |
| Tengu | so I'll wait before re-submitting my review to the ci ;). | 19:10 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo stable/newton: Allow to configure snmpd_config https://review.openstack.org/510218 | 19:11 |
| Tengu | oh. snmpd_config? that seems pretty nice in order to get network stats/infos. | 19:11 |
| Tengu | EmilienM: there's a typo in the release file for your latest patch | 19:12 |
| mwhahaha | i <3 typos | 19:13 |
| EmilienM | Tengu: link it to me | 19:13 |
| Tengu | EmilienM: commented out | 19:13 |
| EmilienM | it's a release note | 19:13 |
| Tengu | https://review.openstack.org/#/c/510218/1/releasenotes/notes/snmdd_config-db21f3175967be4a.yaml | 19:13 |
| Tengu | yup | 19:13 |
| Tengu | sorry, but I stumbled on it :) | 19:13 |
| EmilienM | Tengu: I don't see your comment | 19:14 |
| Tengu | oh ? | 19:14 |
| Tengu | hmm. the "definded" | 19:15 |
| EmilienM | did you press submit? | 19:15 |
| EmilienM | ok | 19:15 |
| EmilienM | we'll survive (I can fix it on master and backpor tthe fix, later) | 19:15 |
| Tengu | hmmm, were's that submit button o_O | 19:15 |
| Tengu | weird.... "save" saves it as draft, but I don't see any submit. | 19:16 |
| Tengu | anyway. it's not a big deal. | 19:17 |
| *** gbarros_ has joined #tripleo | 19:17 | |
| EmilienM | Tengu: well, if you can't use gerrit it's kind of a big deal | 19:17 |
| EmilienM | can you click on "Reply" and "Post" | 19:17 |
| EmilienM | your comment would be published. | 19:17 |
| Tengu | EmilienM: ah, ok, on the main interface. I was looking on the patch content itself. | 19:19 |
| *** gbarros has quit IRC | 19:19 | |
| Tengu | I've also found another thing in the puppet code, apparently you dropped the "agentaddress" ? | 19:19 |
| EmilienM | Tengu: yeah see the Depends-On | 19:21 |
| *** jmelvin has joined #tripleo | 19:21 | |
| EmilienM | we use hiera now | 19:21 |
| EmilienM | Tengu: but thanks for the review | 19:22 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add subnet property to ctlplane network for server resources https://review.openstack.org/473817 | 19:22 |
| Tengu | ah, better with hiera indeed. | 19:22 |
| EmilienM | yup | 19:22 |
| Tengu | hiera is really, really convenient for that kind of thing :). so, nothing more :). | 19:23 |
| Tengu | and now I know a bit more about gerrit. | 19:23 |
| EmilienM | Tengu: if you like terminal tools, I wrote a blog post about using Gertty http://my1.fr/blog/reviewing-puppet-openstack-patches/ | 19:25 |
| Tengu | oohhh | 19:25 |
| EmilienM | it's a bit old | 19:25 |
| EmilienM | but you get the concept | 19:26 |
| Tengu | thanks! I'll read that tomorrow, as now it's a bit late in here and I need some sleep. I keep the link :) | 19:26 |
| EmilienM | cool, good night | 19:26 |
| EmilienM | hey can I go to bed too? | 19:27 |
| Tengu | thank you :). Good luck with the CI :) | 19:27 |
| * EmilienM asks mwhahaha | 19:27 | |
| Tengu | EmilienM: once the CI is working :Þ | 19:27 |
| * Tengu runs away | 19:27 | |
| mwhahaha | YOU SHALL NOT SLEEP | 19:27 |
| Tengu | \o/ | 19:27 |
| beekneemech | EmilienM: Isn't it still like 6 AM where you are? :-P | 19:28 |
| * beekneemech feels like it is always 6 AM on the west coast | 19:29 | |
| Tengu | :Þ | 19:29 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: chmod +x setup.py https://review.openstack.org/510221 | 19:29 |
| openstackgerrit | John Fulton proposed openstack/tripleo-heat-templates master: WIP: Set file mode permission for Ceph keyrings in containers https://review.openstack.org/508975 | 19:30 |
| *** tesseract has quit IRC | 19:31 | |
| *** achadha_ has joined #tripleo | 19:31 | |
| *** gbarros has joined #tripleo | 19:32 | |
| trown | EmilienM: mwhahaha can we go ahead and merge the revert? https://review.openstack.org/#/c/510094/ | 19:33 |
| EmilienM | trown: bandini is ok? | 19:33 |
| EmilienM | I hate to see bandini sad | 19:34 |
| mwhahaha | i don't mind, so i'll merge it :D | 19:34 |
| EmilienM | lol | 19:34 |
| EmilienM | approved | 19:34 |
| EmilienM | bandini: sorry | 19:34 |
| trown | EmilienM: ya we agreed to manually upload just the updated ha containers if we dont get a promote in a week | 19:34 |
| mwhahaha | just a week? | 19:35 |
| *** gbarros_ has quit IRC | 19:35 | |
| *** achadha has quit IRC | 19:35 | |
| mwhahaha | not 27 days or whatever we're up to | 19:35 |
| trown | mwhahaha: well it is 27 days plus a week :P | 19:35 |
| mwhahaha | :D | 19:35 |
| *** achadha_ has quit IRC | 19:35 | |
| Tengu | gertty is nice :). thanks EmilienM - I'll probably break my F1 key though :] | 19:38 |
| *** pblaho has quit IRC | 19:39 | |
| bandini | EmilienM: ahaha no it is fine, let's just hope we can fix up those containers soon enough | 19:41 |
| apevec | EmilienM, is https://bugs.launchpad.net/tripleo/+bug/1721366 still "alert" after the latest fix? | 19:42 |
| openstack | Launchpad bug 1721366 in tripleo "Keystone v2.0 APIs have been removed, TripleO config is incomplete" [Critical,Fix released] - Assigned to Emilien Macchi (emilienm) | 19:42 |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-common stable/pike: Fix chown command in sudoers file https://review.openstack.org/509712 | 19:42 |
| weshay | EmilienM, ok.. ready | 19:42 |
| apevec | i.e. do you have job log evindence it works now? | 19:42 |
| apevec | weshay, ^ do you know? | 19:42 |
| apevec | would be nice to get at least that one out of the alert list... | 19:43 |
| * weshay reads | 19:43 | |
| *** yprokule has quit IRC | 19:44 | |
| EmilienM | Tengu: cool | 19:45 |
| apevec | weshay, tl;dr keystone v2 | 19:45 |
| EmilienM | bandini: ok thx | 19:45 |
| EmilienM | apevec: no, fixed | 19:45 |
| weshay | apevec, that a master job w/ v2 works? | 19:45 |
| weshay | or worked | 19:45 |
| weshay | apevec, well the original blockage was on tempest.. tempest was the first to hit the diff | 19:46 |
| weshay | but the deployment *was* working | 19:46 |
| weshay | in that it finished | 19:46 |
| apevec | ok, so UC is good ? | 19:48 |
| weshay | apevec, it appeared to be after EmilienM's last patch | 19:49 |
| apevec | so we keep this open for all remaining v2 leftovers? | 19:49 |
| *** Slower has quit IRC | 19:49 | |
| apevec | which job triggers tempest failures? | 19:49 |
| apevec | in UC I assume? | 19:49 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: our undercloud default nic should be eth1 https://review.openstack.org/510212 | 19:54 |
| apevec | weshay, is it in periodic-* only? | 19:54 |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-quickstart-extras master: Autofencing support https://review.openstack.org/502297 | 19:54 |
| *** jcoufal has quit IRC | 19:56 | |
| *** zaneb has quit IRC | 19:58 | |
| *** raildo has quit IRC | 20:01 | |
| *** ansmith has quit IRC | 20:06 | |
| *** ansmith_ has quit IRC | 20:07 | |
| *** jtomasek has quit IRC | 20:08 | |
| *** leitan has quit IRC | 20:09 | |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721497 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1721497 in tripleo "galera(galera)[34]: ERROR: Could not determine galera name from pacemaker node <galera-bundle-0>" [Critical,In progress] - Assigned to John Trowbridge (trown) | 20:10 |
| *** leitan has joined #tripleo | 20:10 | |
| *** leitan has quit IRC | 20:14 | |
| *** achadha has joined #tripleo | 20:16 | |
| *** leitan has joined #tripleo | 20:17 | |
| *** achadha has quit IRC | 20:20 | |
| *** artom has quit IRC | 20:24 | |
| *** catinthe_ has quit IRC | 20:28 | |
| *** Slower has joined #tripleo | 20:31 | |
| *** spectr has joined #tripleo | 20:34 | |
| *** spectr has quit IRC | 20:36 | |
| *** trown is now known as trown|outtypewww | 20:39 | |
| *** achadha has joined #tripleo | 20:42 | |
| *** beekneemech has quit IRC | 20:45 | |
| *** chem has quit IRC | 20:45 | |
| *** leitan has quit IRC | 20:46 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-common master: WIP: ceph-ansible invocation w/ ANSIBLE_STDOUT_CALLBACK=debug https://review.openstack.org/510230 | 20:47 |
| *** archit has quit IRC | 20:47 | |
| *** dsneddon_ has joined #tripleo | 20:50 | |
| *** apevec has quit IRC | 20:56 | |
| *** abishop has quit IRC | 20:58 | |
| *** lblanchard has quit IRC | 21:05 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: Fix standalone ControllerOpenstack vars https://review.openstack.org/510233 | 21:05 |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721497 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1721497 in tripleo "galera(galera)[34]: ERROR: Could not determine galera name from pacemaker node <galera-bundle-0>" [Critical,In progress] - Assigned to John Trowbridge (trown) | 21:10 |
| bandini | EmilienM: https://review.openstack.org/#/c/506916/ simple one. promise ;) | 21:19 |
| *** dprince has quit IRC | 21:25 | |
| *** gbarros has quit IRC | 21:31 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: overcloud-deploy: add config-download + ansible run feature https://review.openstack.org/508306 | 21:33 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: overcloud-deploy: add config-download + ansible run feature https://review.openstack.org/508306 | 21:33 |
| EmilienM | bandini: ack | 21:34 |
| *** ccamacho has quit IRC | 21:34 | |
| EmilienM | bandini: how to say no | 21:34 |
| EmilienM | bandini: it's all green and code is good | 21:34 |
| openstackgerrit | Merged openstack/puppet-pacemaker master: Add fence_compute stonith manifest https://review.openstack.org/506916 | 21:47 |
| *** jmelvin has quit IRC | 21:52 | |
| *** bobh has quit IRC | 21:54 | |
| *** pradk has quit IRC | 21:57 | |
| openstackgerrit | Ian Main proposed openstack/python-tripleoclient master: Don't install packages as part of undercloud deploy. https://review.openstack.org/510239 | 21:58 |
| openstackgerrit | Merged openstack/python-tripleoclient stable/pike: Fix error handling for actions https://review.openstack.org/510080 | 22:01 |
| openstackgerrit | Ian Main proposed openstack/python-tripleoclient master: Make heat container remove silent. https://review.openstack.org/510240 | 22:02 |
| *** jgwentworth is now known as melwitt | 22:08 | |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721497 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1721497 in tripleo "galera(galera)[34]: ERROR: Could not determine galera name from pacemaker node <galera-bundle-0>" [Critical,In progress] - Assigned to John Trowbridge (trown) | 22:10 |
| *** thrash is now known as thrash|g0ne | 22:14 | |
| *** chlong has quit IRC | 22:14 | |
| *** achadha_ has joined #tripleo | 22:26 | |
| *** achadha has quit IRC | 22:30 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Adds pacemaker update_tasks for Pike minor update workflow https://review.openstack.org/486567 | 22:31 |
| *** achadha_ has quit IRC | 22:31 | |
| *** achadha has joined #tripleo | 22:33 | |
| *** achadha_ has joined #tripleo | 22:47 | |
| *** achadha has quit IRC | 22:50 | |
| *** gbarros has joined #tripleo | 22:51 | |
| *** achadha_ has quit IRC | 22:52 | |
| openstackgerrit | Merged openstack/tripleo-validations stable/pike: Remove syntax warnings for when statements https://review.openstack.org/510042 | 22:55 |
| *** gbarros has quit IRC | 23:04 | |
| *** achadha has joined #tripleo | 23:06 | |
| *** achadha has quit IRC | 23:08 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721497 | 23:10 |
| openstack | Launchpad bug 1721497 in tripleo "galera(galera)[34]: ERROR: Could not determine galera name from pacemaker node <galera-bundle-0>" [Critical,In progress] - Assigned to John Trowbridge (trown) | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| *** tosky has quit IRC | 23:15 | |
| *** bobh has joined #tripleo | 23:17 | |
| *** artom has joined #tripleo | 23:21 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!