| *** dmacpher has joined #tripleo | 00:09 | |
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
|---|---|---|
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729352 | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Alan Bishop (alan-bishop) | 00:10 |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 00:10 |
| openstack | Launchpad bug 1729352 in tripleo "CinderCronDbPurgeUser is set to 'keystone' by default" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 00:10 |
| *** zshi has joined #tripleo | 00:13 | |
| *** itlinux has joined #tripleo | 00:16 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/newton: Make UpdateDeployment depend on NetworkDeployment https://review.openstack.org/513755 | 00:18 |
| *** rhallisey has quit IRC | 00:19 | |
| *** rhallisey has joined #tripleo | 00:20 | |
| *** moshele has joined #tripleo | 00:21 | |
| *** rbrady has quit IRC | 00:24 | |
| *** rhallisey has quit IRC | 00:32 | |
| *** moshele has quit IRC | 00:37 | |
| *** rbrady has joined #tripleo | 00:37 | |
| *** psahoo has joined #tripleo | 00:41 | |
| *** moshele has joined #tripleo | 00:42 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT REVIEW: save oooq logs https://review.openstack.org/517136 | 00:42 |
| *** moshele has quit IRC | 00:48 | |
| openstackgerrit | Merged openstack/tripleo-common master: Adds detection for legacy API network resource https://review.openstack.org/512395 | 00:48 |
| openstackgerrit | Tuan Luong-Anh proposed openstack/tripleo-docs master: Using --option ARGUMENT https://review.openstack.org/516244 | 00:50 |
| *** itlinux has quit IRC | 00:55 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: RHSM: do not use retry to deploy katello-agent https://review.openstack.org/516337 | 00:58 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Upgrade rhel_reg_sat_repo to 6.2 https://review.openstack.org/516360 | 00:58 |
| openstackgerrit | Merged openstack/tripleo-common master: Accept glance image ID in addition to name https://review.openstack.org/498978 | 00:58 |
| *** liverpooler has joined #tripleo | 00:58 | |
| *** bobh has joined #tripleo | 00:59 | |
| *** rwsu has joined #tripleo | 01:00 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Upgrade rhel_reg_sat_repo to 6.2 https://review.openstack.org/517138 | 01:01 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/ocata: Upgrade rhel_reg_sat_repo to 6.2 https://review.openstack.org/517139 | 01:01 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/newton: Upgrade rhel_reg_sat_repo to 6.2 https://review.openstack.org/517140 | 01:01 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: RHSM: do not use retry to deploy katello-agent https://review.openstack.org/517142 | 01:02 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/ocata: RHSM: do not use retry to deploy katello-agent https://review.openstack.org/517143 | 01:02 |
| *** brault has joined #tripleo | 01:02 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/newton: RHSM: do not use retry to deploy katello-agent https://review.openstack.org/517144 | 01:02 |
| *** rwsu_ has joined #tripleo | 01:03 | |
| *** yamahata has quit IRC | 01:04 | |
| *** brault has quit IRC | 01:06 | |
| *** bobh has quit IRC | 01:07 | |
| EmilienM | mwhahaha: https://github.com/voxpupuli/puppet-collectd/commit/15a028feb63f64444ce837c3f7397c46d219d13e might have broken us | 01:08 |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 01:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Alan Bishop (alan-bishop) | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729352 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 01:10 |
| openstack | Launchpad bug 1729352 in tripleo "CinderCronDbPurgeUser is set to 'keystone' by default" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 01:10 |
| *** moshele has joined #tripleo | 01:13 | |
| *** fragatina has quit IRC | 01:15 | |
| *** fragatina has joined #tripleo | 01:16 | |
| mwhahaha | EmilienM: meh Puppet 4 typing | 01:16 |
| EmilienM | mwhahaha: I'm looking for a fix | 01:16 |
| EmilienM | mwhahaha: because it's already a string in THT | 01:17 |
| EmilienM | it seems | 01:17 |
| EmilienM | let me show | 01:17 |
| *** fragatin_ has joined #tripleo | 01:17 | |
| *** rlandy|afk is now known as rlandy | 01:17 | |
| EmilienM | mwhahaha: https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/nova-compute.yaml#L213 | 01:17 |
| EmilienM | I wonder if the hieradata is well placed | 01:18 |
| EmilienM | because it got undef | 01:18 |
| EmilienM | also I don't understand how it worked before | 01:19 |
| EmilienM | if we got undef now, why didn't we get it before | 01:19 |
| *** fragatina has quit IRC | 01:20 | |
| mwhahaha | Sounds like we aren't properly including/excluding he plugin | 01:20 |
| EmilienM | oh I found it | 01:21 |
| mwhahaha | EmilienM, file a bug and poke the opstools guys | 01:21 |
| EmilienM | it's collectd::plugin::virt | 01:21 |
| EmilienM | not collectd::plugins::virt | 01:21 |
| EmilienM | the hieradata was wrong | 01:21 |
| *** fragatin_ has quit IRC | 01:21 | |
| * mwhahaha facepalms | 01:21 | |
| EmilienM | mwhahaha: I'm fixing it now, it's really easy. no worries | 01:21 |
| mwhahaha | Dat testing | 01:21 |
| *** abishop has quit IRC | 01:22 | |
| mwhahaha | We write all this code yet these issues in longstanding code keep creeping up | 01:22 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Fix nova-cpu/collectd hieradata https://review.openstack.org/517147 | 01:23 |
| *** rbrady has quit IRC | 01:23 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: fs10: deploy steps with ansible https://review.openstack.org/508307 | 01:25 |
| * weshay checks in w/ the zuul queue | 01:27 | |
| weshay | oy | 01:27 |
| weshay | hrm.. second time I've seen this | 01:29 |
| weshay | http://logs.openstack.org/37/490037/2/check/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-puppet/a970753/logs/undercloud/home/zuul/failed_deployment_list.log.txt.gz | 01:29 |
| weshay | elastic rc query hits 0 | 01:29 |
| weshay | wth is this? http://logs.openstack.org/54/513654/1/check/legacy-tripleo-ci-centos-7-scenario003-multinode-oooq/2aaf25a/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-10-20_10_03_21 | 01:31 |
| weshay | oops | 01:31 |
| weshay | The disable_upgrade_deployment flag is not set in the roles file. This flag is expected when you have a nova-compute or swift-storage role. Please check the contents of the roles file: [{'networks': ['External', 'InternalApi', 'Storage', 'StorageMgmt', 'Tenant'], 'CountDefault': 1, 'name': 'Controller', 'tags': ['primary', 'controller']}] | 01:32 |
| EmilienM | I'm out now | 01:33 |
| *** moshele has quit IRC | 01:34 | |
| *** rbrady has joined #tripleo | 01:37 | |
| *** rbrady has joined #tripleo | 01:37 | |
| *** psachin has joined #tripleo | 01:45 | |
| *** itlinux has joined #tripleo | 01:46 | |
| *** artom has joined #tripleo | 02:02 | |
| *** itlinux has quit IRC | 02:05 | |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729352 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729479 | 02:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Alan Bishop (alan-bishop) | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 02:10 |
| openstack | Launchpad bug 1729352 in tripleo "CinderCronDbPurgeUser is set to 'keystone' by default" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 02:10 |
| openstack | Launchpad bug 1729479 in tripleo "puppet-collectd change on datatype" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 02:10 |
| *** rlandy has quit IRC | 02:11 | |
| *** itlinux has joined #tripleo | 02:11 | |
| *** fragatina has joined #tripleo | 02:26 | |
| *** ykarel|afk has joined #tripleo | 02:31 | |
| *** fragatina has quit IRC | 02:31 | |
| *** itlinux has quit IRC | 02:32 | |
| *** noslzzp has joined #tripleo | 02:39 | |
| *** ykarel|afk has quit IRC | 02:42 | |
| *** tzumainn has quit IRC | 02:49 | |
| *** artom has quit IRC | 03:00 | |
| *** rwsu_ has quit IRC | 03:06 | |
| *** rwsu has quit IRC | 03:06 | |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729352 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729479 | 03:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Alan Bishop (alan-bishop) | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 03:10 |
| openstack | Launchpad bug 1729352 in tripleo "CinderCronDbPurgeUser is set to 'keystone' by default" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 03:10 |
| openstack | Launchpad bug 1729479 in tripleo "puppet-collectd change on datatype" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 03:10 |
| *** liverpooler has quit IRC | 03:11 | |
| *** udesale has joined #tripleo | 03:16 | |
| *** anilvenkata has joined #tripleo | 03:25 | |
| *** threestrands has quit IRC | 03:29 | |
| *** jistr has quit IRC | 03:42 | |
| *** jistr has joined #tripleo | 03:43 | |
| *** shreshtha has joined #tripleo | 03:55 | |
| *** shreshtha has quit IRC | 03:56 | |
| *** shreshtha has joined #tripleo | 03:56 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729352 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729479 | 04:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Alan Bishop (alan-bishop) | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 04:10 |
| openstack | Launchpad bug 1729352 in tripleo "CinderCronDbPurgeUser is set to 'keystone' by default" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 04:10 |
| openstack | Launchpad bug 1729479 in tripleo "puppet-collectd change on datatype" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 04:10 |
| *** rwsu_ has joined #tripleo | 04:13 | |
| *** rwsu has joined #tripleo | 04:13 | |
| *** stendulker has joined #tripleo | 04:19 | |
| *** gkadam_ has joined #tripleo | 04:21 | |
| *** gkadam_ has quit IRC | 04:22 | |
| *** gkadam_ has joined #tripleo | 04:22 | |
| *** gkadam_ is now known as gkadam | 04:23 | |
| *** achadha has joined #tripleo | 04:26 | |
| *** achadha has quit IRC | 04:30 | |
| *** skramaja has joined #tripleo | 04:32 | |
| *** pdeore has joined #tripleo | 04:37 | |
| *** gvrangan_ has joined #tripleo | 04:43 | |
| *** ykarel has joined #tripleo | 04:48 | |
| *** ramishra has joined #tripleo | 04:54 | |
| *** gvrangan_ has quit IRC | 04:55 | |
| openstackgerrit | Merged openstack/puppet-tripleo master: Switch to Zuul v3 testing https://review.openstack.org/515251 | 04:56 |
| *** ramishra has quit IRC | 05:01 | |
| *** ramishra has joined #tripleo | 05:03 | |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 05:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Alan Bishop (alan-bishop) | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729352 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729479 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 05:10 |
| openstack | Launchpad bug 1729352 in tripleo "CinderCronDbPurgeUser is set to 'keystone' by default" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 05:10 |
| openstack | Launchpad bug 1729479 in tripleo "puppet-collectd change on datatype" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 05:10 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: cinder: switch CinderCronDbPurgeUser to 'cinder' https://review.openstack.org/516994 | 05:19 |
| *** abregman has joined #tripleo | 05:21 | |
| *** janki has joined #tripleo | 05:27 | |
| *** ramishra has quit IRC | 05:28 | |
| *** fragatina has joined #tripleo | 05:28 | |
| *** ramishra has joined #tripleo | 05:29 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Set ipc=host for services attaching encrypted volumes https://review.openstack.org/517096 | 05:33 |
| *** fragatina has quit IRC | 05:33 | |
| *** ramishra has quit IRC | 05:34 | |
| *** moshele has joined #tripleo | 05:35 | |
| *** ramishra has joined #tripleo | 05:36 | |
| jaosorior | EmilienM: why is ipc host needed there? | 05:39 |
| *** anshul has joined #tripleo | 05:41 | |
| *** ratailor has joined #tripleo | 05:41 | |
| *** moshele has quit IRC | 05:42 | |
| *** ramishra has quit IRC | 05:49 | |
| *** cshastri has joined #tripleo | 05:50 | |
| *** ramishra has joined #tripleo | 05:51 | |
| Tengu | hi there :) | 05:51 |
| *** jbadiapa has joined #tripleo | 05:52 | |
| *** rwsu_ has quit IRC | 05:55 | |
| *** rwsu has quit IRC | 05:55 | |
| *** rwsu has joined #tripleo | 05:56 | |
| jaosorior | good morning! | 05:57 |
| *** pcaruana has joined #tripleo | 05:58 | |
| Tengu | how are you doing today, jaosorior ? | 06:03 |
| jaosorior | I'm alirhg | 06:08 |
| jaosorior | *alright | 06:08 |
| jaosorior | obviously lacking caffeine haha | 06:08 |
| jaosorior | gonna bew some in a bit | 06:08 |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729352 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729479 | 06:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Alan Bishop (alan-bishop) | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 06:10 |
| openstack | Launchpad bug 1729352 in tripleo "CinderCronDbPurgeUser is set to 'keystone' by default" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 06:10 |
| openstack | Launchpad bug 1729479 in tripleo "puppet-collectd change on datatype" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 06:10 |
| openstackgerrit | Ade Lee proposed openstack/tripleo-heat-templates master: Add option for barbican API container to log to stdout/stderr https://review.openstack.org/516730 | 06:12 |
| *** marios has joined #tripleo | 06:13 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: HAProxy: Mount the CA certificate if TLS everywhere is enabled https://review.openstack.org/517172 | 06:13 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Only mount Haproxy TLS if contents are set https://review.openstack.org/517173 | 06:13 |
| *** jaganathan has joined #tripleo | 06:29 | |
| *** fragatina has joined #tripleo | 06:30 | |
| *** dparkes has quit IRC | 06:32 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Rely on container setup for haproxy's certificate user and group https://review.openstack.org/517176 | 06:32 |
| *** fragatina has quit IRC | 06:34 | |
| *** yprokule has joined #tripleo | 06:38 | |
| jaosorior | ratailor: so you tested out yesterday's patches for the TLS everywhere stuff. Right? Is there something missing from the patches you set up? I saw you have them with -W still | 06:39 |
| ratailor | jaosorior, I need to test with metadata as well, I am trying to test that. | 06:39 |
| ratailor | jaosorior, I will go now, the alarm has rung. Has to go now. :( | 06:40 |
| jaosorior | oh O_o | 06:40 |
| ratailor | jaosorior, It might be a drill, dont know. | 06:40 |
| *** ratailor is now known as ratailor|afk | 06:40 | |
| jaosorior | hopefully | 06:40 |
| jaosorior | ttyl | 06:40 |
| ratailor|afk | jaosorior, some work was going on, and the alarm was activated because of dust. | 06:45 |
| *** ratailor|afk is now known as ratailor | 06:45 | |
| jaosorior | aah, good to know :) | 06:45 |
| ratailor | jaosorior, :) | 06:45 |
| ratailor | jaosorior, I will test ec2api metadata today, then will address your comment, before removing WIP flags. | 06:46 |
| jaosorior | awesome | 06:47 |
| *** moshele has joined #tripleo | 06:51 | |
| *** dsariel__ has joined #tripleo | 06:52 | |
| Tengu | hmm. not many reaction to my logging email. well, will wait a bit more I guess ;) | 06:53 |
| Tengu | or was the content too long maybe? | 06:53 |
| jaosorior | Tengu: I haven't had a chance to look at it yet. Got it open in a tab and will go through it today. | 06:55 |
| Tengu | cool :) | 06:55 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-ui stable/pike: Imported Translations from Zanata https://review.openstack.org/515990 | 06:55 |
| Tengu | wasn't really sure how to introduce the question. | 06:55 |
| *** iranzo has joined #tripleo | 07:04 | |
| jaosorior | mandre: well, configuring memcached verbosity isn't really critical. So I could abandon that backport. | 07:04 |
| *** dparkes has joined #tripleo | 07:04 | |
| *** iranzo has quit IRC | 07:04 | |
| *** iranzo has joined #tripleo | 07:04 | |
| *** iranzo has quit IRC | 07:09 | |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729352 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729479 | 07:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Alan Bishop (alan-bishop) | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 07:10 |
| openstack | Launchpad bug 1729352 in tripleo "CinderCronDbPurgeUser is set to 'keystone' by default" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 07:10 |
| openstack | Launchpad bug 1729479 in tripleo "puppet-collectd change on datatype" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 07:10 |
| skramaja | moshele: ping | 07:14 |
| *** jprovazn has joined #tripleo | 07:19 | |
| *** adac has joined #tripleo | 07:23 | |
| *** dmacpher has quit IRC | 07:26 | |
| *** agurenko has joined #tripleo | 07:27 | |
| *** rcernin has quit IRC | 07:27 | |
| *** etingof has quit IRC | 07:31 | |
| yolanda | hi, good morning | 07:31 |
| yolanda | question about upgrades | 07:31 |
| yolanda | i have a customer that is still on the OSP 8 - 9 upgrade. They are trying to go in the major-upgrade-aodh step | 07:32 |
| yolanda | and they hit errors on neutron | 07:32 |
| yolanda | why is neutron being used on that step? | 07:32 |
| yolanda | errors like DELETE_FAILED Conflict: resources.StorageMgmtSubnet: Unable to complete operation on subnet c7a20f11-5154-4224-8cd5-4ae8de4b06ca: One or more ports have an IP | 07:32 |
| yolanda | allocation from this subnet. | 07:32 |
| jaosorior | weird, I wouldn't expect the upgrade to try to delete a subnet :/ | 07:33 |
| yolanda | yep.. they claim they use the same deploy command , but adding --force-postconfig, and the aodh environment | 07:34 |
| jaosorior | did they try to delete that subnet before hand or something? | 07:34 |
| yolanda | no, the errors come from heat | 07:34 |
| yolanda | jaosorior, do you want the logs? | 07:34 |
| *** rdopiera has quit IRC | 07:35 | |
| moshele | skramaja: hi | 07:35 |
| moshele | skramaja: I didn't understand how to do you comment in https://review.openstack.org/#/c/507401/ | 07:36 |
| jaosorior | yolanda: I could take a look but honestly I don't have a lot of experience with major upgrades. So I'm not sure if I would be much help. | 07:36 |
| skramaja | moshele: yes. we wanted to apply this parameter only on the compute node.. | 07:36 |
| moshele | skramaja: I got that, but I didn't understand how to do in tripleO | 07:37 |
| skramaja | moshele: but the service will be enabled in controller also where this parameter should be disabled. we cant control that directly but we can do it via role-specific params | 07:37 |
| yolanda | jaosorior, http://paste.openstack.org/show/625309/ | 07:37 |
| yolanda | or any people related to upgrades? | 07:37 |
| *** brault has joined #tripleo | 07:37 | |
| skramaja | moshele: https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/role_specific_parameters.html | 07:37 |
| jaosorior | marios: maybe? ^^ | 07:37 |
| skramaja | moshele: with this merging, we can provide the parmeter like http://paste.openstack.org/show/625310/ | 07:38 |
| skramaja | moshele: the format of "ComputeParameters" is like <RoleName>Parameters | 07:39 |
| skramaja | moshele: but it requires a specific merging in the service template for a parameter, as explained in the doc.. | 07:40 |
| skramaja | moshele: back in 20mins, out for lunch.. | 07:41 |
| *** jfrancoa has joined #tripleo | 07:50 | |
| *** aufi has joined #tripleo | 07:51 | |
| *** etingof has joined #tripleo | 07:52 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Enable neutron-lbaasv2 UI in Horizon https://review.openstack.org/515329 | 07:53 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/511633 | 07:53 |
| marios | yolanda: it sounds like they specified different network environment on the upgrade compared to what they had deployed | 07:54 |
| marios | yolanda: so heat tries to delete those resources to re-create them (network resources) | 07:54 |
| marios | yolanda: if it is indeed this, then the only way back is restore undercloud backup (mainly for the heat db) | 07:54 |
| marios | yolanda: it sounds like it is the first step of the upgrade? (migration aodh) | 07:55 |
| marios | yolanda: so the overcloud env itself should be untouched (at least no config is applied during this stage, except aodh, but it may not even have gotten that far cant tell without looking) | 07:55 |
| yolanda | marios, they claimed they used the same files, i already asked for that | 07:56 |
| Tengu | oh. | 07:56 |
| Tengu | VICTORY ! | 07:56 |
| yolanda | marios, can some config done in their OSP 8 also be interfering with it? | 07:56 |
| Tengu | my patch has been merged \o/ | 07:56 |
| yolanda | they just deploy with --templates, using a local dir where they have all their custom environment files, and they said me they haven't touched it | 07:57 |
| marios | yolanda: then the next thing I'd do is to compare them (ask for the env/files from deploy vs upgrade and try to spot the diff). if there is BZ attach there. Otherwise there isn't something in the upgrade workflow generally, and especially in this aodh step, which touches the network config. | 07:57 |
| yolanda | marios, ok thanks | 07:58 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/511633 | 07:58 |
| Slower | marios! | 08:00 |
| marios | Slower: ! | 08:02 |
| marios | yolanda: np, sorry for no better answer but if it is deleting networks, 9/10 it was this (can't even think of an example for the other 1/10 :)) | 08:03 |
| *** ebarrera has joined #tripleo | 08:03 | |
| mandre | jaosorior: hey! agreed on abandoning https://review.openstack.org/#/c/516521/, it falls more in the feature than in the bugfix category | 08:08 |
| mandre | jaosorior: sorry, wrong link | 08:09 |
| mandre | jaosorior: this one https://review.openstack.org/#/c/516875/ | 08:09 |
| *** tesseract has joined #tripleo | 08:10 | |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729352 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729479 | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Alan Bishop (alan-bishop) | 08:10 |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 08:10 |
| openstack | Launchpad bug 1729352 in tripleo "CinderCronDbPurgeUser is set to 'keystone' by default" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 08:10 |
| openstack | Launchpad bug 1729479 in tripleo "puppet-collectd change on datatype" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 08:10 |
| *** bogdando has joined #tripleo | 08:13 | |
| jaosorior | therve: is it possible to do nested ifs in heat? | 08:13 |
| jaosorior | therve: something like here in line 177 https://review.openstack.org/#/c/516732/3/puppet/services/barbican-api.yaml | 08:13 |
| *** shardy has joined #tripleo | 08:16 | |
| jaosorior | shardy: is it possible to do nested ifs in heat? something like here in line 177 https://review.openstack.org/#/c/516732/3/puppet/services/barbican-api.yaml | 08:17 |
| shardy | jaosorior: you can nest intrinsic functions so yes I think it should work, but I've not tested it | 08:18 |
| shardy | jaosorior: probably worth trying a minimal example and/or checking if we cover that specific case in the unit tests | 08:19 |
| jaosorior | shardy: well, what I tried didn't work out :( | 08:20 |
| jaosorior | u'message': u'Failed to run action [action_ex_id=6d129dc6-b6b7-4b36-b180-40014c6bd36e, action_cls=\'<class \'mistral.actions.action_factory.DeployStackAction\'>\', attributes=\'{}\', params=\'{u\'skip_deploy_identifier\': False, u\'container\': u\'overcloud\', u\'timeout\': 90}\']\n ERROR: | 08:20 |
| jaosorior | resources.ControllerServiceChain<https://192.168.24.2:13808/v1/AUTH_37d0887420e3449fb7a853f9fde6f447/overcloud/common/services.yaml>.resources.ServiceChain<nested_stack>.resources.1<https://192.168.24.2:13808/v1/AUTH_37d0887420e3449fb7a853f9fde6f447/overcloud/puppet/services/barbican-api.yaml>.outputs.role_data.value.config_settings.map_merge[2].if.if: : Arguments to "if" must be of the form: | 08:20 |
| jaosorior | [condition_name, value_if_true, value_if_false]' | 08:20 |
| shardy | jaosorior: Ok that's likely a heat bug then | 08:20 |
| jaosorior | oh wait | 08:20 |
| *** oidgar has joined #tripleo | 08:21 | |
| jaosorior | mayeb it isn't. found a bug in the code | 08:21 |
| jaosorior | *the template | 08:21 |
| shardy | jaosorior: ah, well it would probably be worth adding a test to be sure anyway, I don't think we cover it atm: | 08:22 |
| shardy | https://github.com/openstack/heat/blob/master/heat/tests/test_hot.py#L1385 | 08:22 |
| moshele | skramaja: so I need to change this https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/neutron-ovs-agent.yaml ? | 08:24 |
| *** rcernin has joined #tripleo | 08:26 | |
| moshele | skramaja: should it be something like this http://paste.openstack.org/show/625318/? | 08:27 |
| mandre | bandini, dciabrin: hey, I'm looking at jaosorior's patch at https://review.openstack.org/517172 and wanted to check how we do in the pacemaker's case, but now I have a question about how the tripleo::profile::pacemaker::haproxy_bundle::tls_mapping is used... | 08:30 |
| mandre | https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/pacemaker/haproxy.yaml#L86 | 08:30 |
| openstackgerrit | Ade Lee proposed openstack/tripleo-heat-templates master: Add option for barbican API container to log to stdout/stderr https://review.openstack.org/516730 | 08:30 |
| *** oanson has quit IRC | 08:30 | |
| mandre | seems like puppet-tripleo doesn't consume it | 08:30 |
| *** paramite has joined #tripleo | 08:30 | |
| *** oanson has joined #tripleo | 08:31 | |
| jaosorior | mandre: not sure if it's being consumed at all. But this is the relevant functionality https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/pacemaker/haproxy_bundle.pp#L183 | 08:31 |
| *** fragatina has joined #tripleo | 08:31 | |
| jaosorior | mandre: yep, seems the t-h-t parameter is not being used | 08:32 |
| *** ffiore has joined #tripleo | 08:32 | |
| *** jpena|off is now known as jpena | 08:33 | |
| *** gfidente has joined #tripleo | 08:33 | |
| *** gfidente has quit IRC | 08:33 | |
| *** gfidente has joined #tripleo | 08:33 | |
| mandre | jaosorior: yeah, that yaml structure is being used though, referenced in the volumes for the puppet_config, so I guess that's where it is used | 08:34 |
| *** gkadam has quit IRC | 08:34 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-quickstart master: WIP: Use tripleo-upgrade role in CI https://review.openstack.org/513382 | 08:35 |
| jaosorior | mandre: oh, right | 08:35 |
| *** gkadam has joined #tripleo | 08:35 | |
| *** fragatina has quit IRC | 08:36 | |
| *** spectr has joined #tripleo | 08:36 | |
| *** ykarel is now known as ykarel|lunch | 08:37 | |
| mandre | jaosorior: but still, where is /etc/ipa/ca.crt being mounted in the pacemaker haproxy service? | 08:37 |
| *** iranzo has joined #tripleo | 08:38 | |
| anilvenkata | skramaja, jenkins is passing for https://review.openstack.org/#/c/516614/ do u want to set workflow for it? | 08:39 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient master: Add missing puppet configuration to undercloud deploy https://review.openstack.org/513774 | 08:39 |
| moshele | skramaja: also can you review https://review.openstack.org/#/c/507100/ | 08:40 |
| mandre | jaosorior: found it, https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/haproxy.yaml#L126 | 08:40 |
| jaosorior | mandre: good find. I was still searching :/ | 08:41 |
| jaosorior | the haproxy bundle got quite confusing | 08:41 |
| mandre | jaosorior: is this candidate for a backport? | 08:41 |
| jaosorior | mandre: what is? | 08:42 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Add NetIpMap to hieradata for *ExtraConfig overrides https://review.openstack.org/514707 | 08:42 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Force memcached container log to file https://review.openstack.org/516876 | 08:42 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Switch RabbitFDLimit to a Puppet integer https://review.openstack.org/512278 | 08:42 |
| openstackgerrit | Merged openstack/tripleo-common stable/pike: Get a static inventory for upgrade-non-controller ansible runs https://review.openstack.org/514951 | 08:42 |
| mandre | jaosorior: https://review.openstack.org/#/c/517172/, if so probably we'll want to track it in a lp bug | 08:42 |
| jaosorior | mandre: maybe? I don't think folks really use that one in production. It's mostly for devs AFAIU | 08:43 |
| mandre | ok | 08:44 |
| *** iranzo has quit IRC | 08:44 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates stable/pike: Set ipc=host for services attaching encrypted volumes https://review.openstack.org/517209 | 08:44 |
| jaosorior | mandre: or what do you think? | 08:45 |
| jaosorior | mandre: honestly I'm flexible | 08:45 |
| *** oanson has quit IRC | 08:45 | |
| *** cylopez has joined #tripleo | 08:46 | |
| *** oanson has joined #tripleo | 08:46 | |
| *** ukalifon has joined #tripleo | 08:46 | |
| mandre | jaosorior: I think we shouldn't try to backport all fixes | 08:46 |
| jaosorior | right | 08:47 |
| jaosorior | I'm fine if we don't backport it | 08:47 |
| cschwede | Hi! Can someone please have a look at the backported patch 504886 ? It got one +2 already, needs another one/+A. | 08:47 |
| skramaja | moshele: yes, it will be like the pasted content, need to add merging of the values to config_settings , like https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/neutron-ovs-dpdk-agent.yaml#L95 | 08:58 |
| *** lucas-afk is now known as lucasagomes | 08:59 | |
| cschwede | jaosorior: thx :) | 08:59 |
| skramaja | moshele: i will review the puppet-tripleo patch too (note that i should only +1 it) | 09:00 |
| skramaja | anilvenkata: ack. will do. | 09:00 |
| anilvenkata | skramaja, thanks | 09:00 |
| *** ykarel|lunch is now known as ykarel | 09:01 | |
| *** jpich has joined #tripleo | 09:02 | |
| *** mcornea has joined #tripleo | 09:03 | |
| *** dtantsur|afk is now known as dtantsur | 09:04 | |
| shardy | jistr: Hey when you get a moment I'd like to discuss your approach to hostvars for the "inner" inventory for kubespray | 09:04 |
| *** amoralej|off is now known as amoralej | 09:04 | |
| shardy | jistr: having some trouble figuring out how I can reference per-node data from tripleo-ansible-inventory there, e.g | 09:04 |
| shardy | https://paste.fedoraproject.org/paste/rFKjFNHdkan9Cmo7oGk5kQ | 09:04 |
| shardy | I added *_ip to e.g overcloud-worker-0 on line 357-366, but can I then map those into the inner inventory? | 09:05 |
| shardy | its a bit confusing since we don't consume tripleo-ansible-inventory directly | 09:05 |
| openstackgerrit | Lee Yarwood proposed openstack/tripleo-quickstart master: Allow the confgiuration of virtualbmc on Newton https://review.openstack.org/509219 | 09:07 |
| openstackgerrit | Lee Yarwood proposed openstack/tripleo-quickstart-extras master: Allow the configuration of virtualbmc on Newton https://review.openstack.org/509218 | 09:07 |
| dciabrin | mandre jaosorior hi gents, reading backlog atm. is everything clear with haproxy_bundle.pp? | 09:07 |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 09:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Alan Bishop (alan-bishop) | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729352 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729479 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 09:10 |
| openstack | Launchpad bug 1729352 in tripleo "CinderCronDbPurgeUser is set to 'keystone' by default" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 09:10 |
| openstack | Launchpad bug 1729479 in tripleo "puppet-collectd change on datatype" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 09:10 |
| jaosorior | dciabrin: yep | 09:13 |
| sri_ | shardy: hi , quick question , does cinder support activte/passive volumes in tripleo ? when I have three nodes for block storage !! | 09:13 |
| *** jaosorior has quit IRC | 09:15 | |
| *** sshnaidm|afk is now known as sshnaidm | 09:16 | |
| shardy | sri_: yes if you deploy with pacemaker enabled cinder-volume and cinder-backup are managed by pacemaker | 09:16 |
| sri_ | shardy: cool, thanks | 09:17 |
| openstackgerrit | Martin André proposed openstack/puppet-tripleo master: Fix bind mounts for cinder-volume https://review.openstack.org/517221 | 09:19 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Fix cinder-volume container with pacemaker https://review.openstack.org/517222 | 09:23 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Containerize cinder services under pacemaker in CI https://review.openstack.org/517038 | 09:24 |
| mandre | dciabrin, bandini: can you take a look at https://review.openstack.org/#/c/517221/ and https://review.openstack.org/#/c/517222/ see if I'm not forgetting something? | 09:26 |
| dciabrin | mandre, /me looks, bandini is PTO until mon | 09:26 |
| bogdando | jfyo folks http://lists.openstack.org/pipermail/openstack-dev/2017-November/124181.html | 09:30 |
| bogdando | bandini: dciabrin: hi! could you please comment http://lists.openstack.org/pipermail/openstack-dev/2017-November/124176.html | 09:30 |
| bogdando | just to make sure I've got the case right | 09:31 |
| bogdando | or not | 09:31 |
| bogdando | oops, not bandini then! :) | 09:31 |
| *** pdeore has quit IRC | 09:32 | |
| *** psahoo has quit IRC | 09:35 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-common master: Fail ceph-ansible workflow if there is stale puppet-ceph hieradata https://review.openstack.org/511474 | 09:36 |
| *** pdeore has joined #tripleo | 09:38 | |
| dciabrin | bogdando, will look at it. It seems sufficiently complex that I don't answer right away :) | 09:40 |
| bogdando | dciabrin: yeah, it's quite complex. Just wanted to make sure using pacemaker bundles for ironic is a good idea | 09:44 |
| mandre | thx for the reviews dciabrin and bogdando | 09:44 |
| bogdando | might be* | 09:44 |
| bogdando | mandre: urw! | 09:44 |
| *** links has quit IRC | 09:44 | |
| * mandre goes afk for a moment | 09:44 | |
| jistr | shardy: the ansible_user and ansible_host that we're setting there are essentially hostvars too | 09:45 |
| shardy | jistr: ack, so I'm trying to set access_ip in a similar way now | 09:45 |
| shardy | so we can set the bind ip per host and per network based on what's in tripleo-ansible-inventory | 09:46 |
| jistr | shardy: right, you could use the same approach: access_ip: {{ hostvars.raw_get(host)['internal_ip'] }} | 09:47 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Enable loadbalancer for kubernetes masters https://review.openstack.org/516894 | 09:47 |
| shardy | jistr: thanks for confirming testing ^^ now | 09:47 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT REVIEW: save oooq logs https://review.openstack.org/517136 | 09:48 |
| *** pgadiya has joined #tripleo | 09:49 | |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-heat-templates master: WIP: Add a tag to all the role specific parameters to identify and validate https://review.openstack.org/517231 | 09:51 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-heat-templates master: Update ansible before the ansible upgrade tasks https://review.openstack.org/517025 | 09:53 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-heat-templates master: Update ansible before the ansible upgrade tasks https://review.openstack.org/517025 | 09:54 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-common master: Fail ceph-ansible workflow if there is stale puppet-ceph hieradata https://review.openstack.org/511474 | 09:54 |
| *** panda|ruck|off is now known as panda|ruck | 09:54 | |
| Tengu | small question: is the configuration of OVS compatible with collectd new module "ovs_stats"? | 09:55 |
| Tengu | I stumbled on a redhat bug but I don't really understand the status: https://bugzilla.redhat.com/show_bug.cgi?id=1409860 | 09:56 |
| openstack | bugzilla.redhat.com bug 1409860 in collectd "[Intel OSP12] Open vSwitch Stats Plugin" [Medium,New] - Assigned to mrunge | 09:56 |
| shardy | mrunge: ^^ | 09:56 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-docs master: Update upgrade documentation with the Ceph related steps https://review.openstack.org/511635 | 09:57 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Revert "Revert "Tag workflows created by the templates"" https://review.openstack.org/503762 | 09:58 |
| mrunge | Tengu, IMHO they don't have anything in common | 10:02 |
| *** chem has joined #tripleo | 10:02 | |
| Tengu | mrunge: hmm, the issue is for the collectd update apparently. have to dig a bit more in order to check if OVS is properly configured with tripleO deploy | 10:02 |
| Tengu | mrunge: would be cool if collectd could… err… collect data from ovs directly, without the snmp layer. | 10:03 |
| mrunge | Tengu, yes, that's a feature request for collectd | 10:03 |
| Tengu | … but apparently, 0 doc on that plugin | 10:03 |
| mrunge | there is a plugin, but there were a few corrections and it might be available in collectd 5.8, which is not released yet | 10:03 |
| Tengu | we have our own package for collectd in fact (a colleague is a contributor, that helps). | 10:04 |
| openstackgerrit | Or Idgar proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia https://review.openstack.org/487450 | 10:04 |
| Tengu | so the collectd part isn't a big issue on our end. more the OVS part. | 10:04 |
| Tengu | hmmm | 10:05 |
| Tengu | apparently, the plugin just connects to the ovs interface and socket. that's all. | 10:06 |
| mrunge | right | 10:06 |
| Tengu | so, apparently, as soon as I get the compiled package, I get stats. | 10:06 |
| Tengu | https://github.com/collectd/collectd/pull/2137/files#diff-3d1a1cbe3136771247d8d5651551d682R1006 easy. | 10:06 |
| Tengu | so nothing to do on neutron-openvswitch part. | 10:06 |
| mrunge | I don't recall out of my head, if you need a newer ovs library or so | 10:07 |
| Tengu | we'll try and see what happens. | 10:07 |
| mrunge | you should probably take a snapshot from 5.8 branch | 10:07 |
| Tengu | I'll let my colleague manage the packaging ;) | 10:08 |
| *** dparkes has quit IRC | 10:08 | |
| mrunge | Tengu, just a pointer https://github.com/centos-opstools/collectd/blob/master/collectd.spec | 10:09 |
| Tengu | thanks. pretty sure my colleague has all the cards. I was really just worried about the ovs config part, didn't really know what was involved. | 10:10 |
| *** dparkes has joined #tripleo | 10:10 | |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 10:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729352 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729479 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 10:10 |
| Tengu | i.e. if something was to be enabled in addition, that kind of things. | 10:10 |
| openstack | Launchpad bug 1729352 in tripleo "CinderCronDbPurgeUser is set to 'keystone' by default" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 10:10 |
| openstack | Launchpad bug 1729479 in tripleo "puppet-collectd change on datatype" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 10:10 |
| *** bogdando has quit IRC | 10:12 | |
| *** bogdando_ has joined #tripleo | 10:12 | |
| lyarwood | Any tripleo-quickstart users/devs able to help with my release config repo question on the ML? http://lists.openstack.org/pipermail/openstack-dev/2017-November/124162.html | 10:12 |
| *** bogdando_ has quit IRC | 10:13 | |
| openstackgerrit | Merged openstack/tripleo-ui stable/pike: Imported Translations from Zanata https://review.openstack.org/515990 | 10:15 |
| *** anilvenkata has quit IRC | 10:16 | |
| *** salmankhan has joined #tripleo | 10:20 | |
| *** derekh has joined #tripleo | 10:20 | |
| shardy | lyarwood: not really a quickstart expert, but can you narrow it down by checking if the overcloud-full image is modified to update the packages, or if it's happening at deploy time? | 10:22 |
| shardy | e.g via virt-inspector or something - there are roles in tripleo-quickstart-extras which modify the downloaded images, but I'm not super familiar with the details tbh | 10:23 |
| lyarwood | shardy: so I've used virt-cat to confirm that the overcloud-full.qcow2 file on the undercloud has been edited | 10:30 |
| lyarwood | shardy: the file on the virthost has not | 10:30 |
| lyarwood | shardy: assumed it was repo-setup using the default repos vars but it doesn't appear to be running in my deployment so I'm a little confused :) | 10:31 |
| *** fragatina has joined #tripleo | 10:34 | |
| *** iranzo has joined #tripleo | 10:34 | |
| *** iranzo has joined #tripleo | 10:34 | |
| *** iranzo has quit IRC | 10:36 | |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations master: Add new nova-event-callback validation https://review.openstack.org/513333 | 10:38 |
| *** fragatina has quit IRC | 10:38 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Speed up deployment by reusing facts https://review.openstack.org/514945 | 10:42 |
| *** pdeore has quit IRC | 10:47 | |
| amoralej | is someone checking at issue with swift in periodic jobs? | 10:48 |
| amoralej | https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/a58f160/overcloud-controller-0/var/log/messages.txt.gz#_Nov__2_05_36_57 | 10:48 |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: Fix overcloud-prep-network when overcloud_nodes is None https://review.openstack.org/517261 | 10:49 |
| *** bogdando has joined #tripleo | 10:50 | |
| *** ffiore has quit IRC | 10:52 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates stable/pike: Add NetIpMap to hieradata for *ExtraConfig overrides https://review.openstack.org/517264 | 10:58 |
| ykarel | amoralej, same issue is in puppet promotion jobs also | 10:59 |
| amoralej | ykarel, where? | 10:59 |
| ykarel | amoralej, have you seen it | 10:59 |
| ykarel | https://trello.com/c/gwdmYDFB/310-glance-poi-scenaro-002-deployment-failing-in-1st-puppet-run-during-image-create-with-error-503 | 10:59 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Fix standalone ControllerOpenstack vars https://review.openstack.org/512466 | 11:00 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Ironic] https://review.openstack.org/517265 | 11:00 |
| *** marios has quit IRC | 11:00 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Octavia] https://review.openstack.org/517266 | 11:00 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Sahara] https://review.openstack.org/517267 | 11:01 |
| *** ffiore has joined #tripleo | 11:02 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Fix Validations progress https://review.openstack.org/517270 | 11:05 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations master: Fix include action DEPRECATION WARNING (Ansible >2.4) https://review.openstack.org/517272 | 11:07 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Allow installing multiple-node Kubernetes https://review.openstack.org/514730 | 11:07 |
| jistr | shardy: all working! see the paste at https://review.openstack.org/#/c/514730/5/extraconfig/services/kubernetes-worker.yaml | 11:09 |
| jistr | i used this to test https://kubernetes.io/docs/tasks/access-application-cluster/service-access-application-cluster/ | 11:09 |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729352 | 11:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729479 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729569 | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 11:10 |
| openstack | Launchpad bug 1729352 in tripleo "CinderCronDbPurgeUser is set to 'keystone' by default" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 11:10 |
| openstack | Launchpad bug 1729479 in tripleo "puppet-collectd change on datatype" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 11:10 |
| openstack | Launchpad bug 1729569 in tripleo "Periodic jobs using swift as glance backend failing" [Critical,Triaged] | 11:10 |
| *** hewbrocca_afk is now known as hewbrocca | 11:12 | |
| *** fultonj has quit IRC | 11:12 | |
| *** jaganathan has quit IRC | 11:12 | |
| shardy | jistr: nice work! lgtm but will re-test later | 11:13 |
| *** jaganathan has joined #tripleo | 11:13 | |
| jistr | shardy: ack thanks | 11:13 |
| shardy | jistr: I'm still working on the LB config, after that we should be able to test deploying apb's via external tasks | 11:13 |
| *** stendulker has quit IRC | 11:13 | |
| jistr | cool :) | 11:15 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/instack-undercloud stable/newton: WIP: Ensure proper permission on /var/log/ironic/ironic-dbsync.log https://review.openstack.org/517275 | 11:22 |
| *** jaganathan has quit IRC | 11:23 | |
| openstackgerrit | Merged openstack/puppet-tripleo stable/pike: Allow 'cinder' as a backend for Glance https://review.openstack.org/513202 | 11:27 |
| *** dparkes has quit IRC | 11:33 | |
| *** dparkes has joined #tripleo | 11:34 | |
| openstackgerrit | Or Idgar proposed openstack/tripleo-common master: Octavia post deployment mistral wrapper https://review.openstack.org/515402 | 11:34 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Migrates storage-environment.yaml to ceph-ansible https://review.openstack.org/512569 | 11:41 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-quickstart-extras master: Switch to RDO Queens baseurl in overcloud upgrade https://review.openstack.org/517280 | 11:41 |
| *** jaosorior has joined #tripleo | 11:42 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-quickstart-extras master: Include 'queens' as target version for upgrade. https://review.openstack.org/516647 | 11:43 |
| *** anilvenkata has joined #tripleo | 11:43 | |
| jaosorior | bandini, shardy could you check this out https://review.openstack.org/#/c/516989/ ? | 11:43 |
| *** zshi has quit IRC | 11:44 | |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-heat-templates master: WIP: Add a tag to all the role specific parameters to identify and validate https://review.openstack.org/517231 | 11:44 |
| *** zshi has joined #tripleo | 11:45 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-common master: Fail ceph-ansible workflow if there is stale puppet-ceph hieradata https://review.openstack.org/511474 | 11:47 |
| openstackgerrit | Or Idgar proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia https://review.openstack.org/487450 | 11:47 |
| jaosorior | shardy, jistr: Do you guys guys happen to know how other components handle backends/plugins in tripleo? Working on enabling plugin configurations for barbican and was wondering how other components do it. | 11:47 |
| *** pgadiya has quit IRC | 11:48 | |
| *** fultonj has joined #tripleo | 11:50 | |
| *** jlabarre has joined #tripleo | 11:51 | |
| yolanda | hi, question... i want to launch some deploy, but without external network, in quickstart. Is is enough to take the sample of controller-no-external? is there any other config needed? | 11:51 |
| shardy | jaosorior: In general the approach has been to create a new composable "service" for each different backend | 11:51 |
| *** dsariel__ has quit IRC | 11:51 | |
| shardy | jaosorior: the service just applies the config needed to enable the backed, e.g for cinder or neutron | 11:52 |
| shardy | check puppet/services/cinder-backend* for example | 11:52 |
| jaosorior | shardy: was thinking about doing that or just handling it via heat conditionals. is composable "services" considered a best practice? | 11:52 |
| shardy | jaosorior: yeah I think in general we've tried to use composable services instead of lots of EnableFoo booleans | 11:53 |
| jaosorior | shardy: the only con I see from doing it as a composable service is that we need to make sure that folks have it in their roles data yaml file. | 11:53 |
| jaosorior | but ok, if that's the way to do it, I'll do that then. | 11:53 |
| shardy | jaosorior: it's potentially more flexible, e.g a boolean is global so you can't have a different backend per role | 11:53 |
| shardy | jaosorior: yeah we've worked around that by putting all the things into roles_data then disabling them by default with OS::Heat::None | 11:54 |
| shardy | jaosorior: then an environments/enable-backend-foo.yaml enables the actual service templates | 11:54 |
| jaosorior | that sounds reasonable | 11:54 |
| shardy | jaosorior: it's kinda an ugly pattern tbh but it's needed until we fix bug #1635409 | 11:54 |
| openstack | bug 1635409 in tripleo "parameter_merge_strategies: merge behaves like overwrite" [High,In progress] https://launchpad.net/bugs/1635409 - Assigned to Steven Hardy (shardy) | 11:54 |
| jaosorior | shardy: thanks for the advice. I'll start coding based on that. | 11:54 |
| shardy | if/when we fix that the environments could append to the *Services list, which would potentially clean up the roles_data | 11:55 |
| jaosorior | how would appending to the *Services list look like? | 11:56 |
| *** rcernin has quit IRC | 11:56 | |
| *** fandrieu has joined #tripleo | 11:56 | |
| shardy | https://github.com/openstack/tripleo-heat-templates/commit/2a7e0445187df045d61b6b34b6943a3c6a448308#diff-560cc89636fe23230dafe53d7bd6c7e2 | 11:57 |
| shardy | jaosorior: ^^ shows how it's supposed to work, but we do a bunch of things in tripleoclient and tripleo-common which mean it doesn't work | 11:58 |
| shardy | I've been poking at fixing it for a while, but it's really hard, I'll try to revisit it | 11:58 |
| *** cylopez has quit IRC | 11:58 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates stable/pike: Set metric procssing delay for metricd https://review.openstack.org/515684 | 11:59 |
| *** jpena is now known as jpena|lunch | 11:59 | |
| *** shardy is now known as shardy_lunch | 12:01 | |
| jaosorior | pradk: hey, could you check this out https://review.openstack.org/#/c/516989/ ? | 12:03 |
| *** dparkes has quit IRC | 12:03 | |
| pradk | jaosorior, done | 12:03 |
| *** dparkes has joined #tripleo | 12:04 | |
| jaosorior | pradk: by the way, these are most of the commits that resulted from yesterday's session https://review.openstack.org/#/q/topic:undercloud-containers-tls+status:open | 12:05 |
| *** amoralej is now known as amoralej|lunch | 12:06 | |
| pradk | jaosorior, yea i'll +2 them.. all these are working as we moved past in the deploy. We need to figure out the connection failures to https endpoints which is in post | 12:06 |
| jaosorior | we could open a tmate session again | 12:06 |
| jaosorior | but it would take me half an hour | 12:06 |
| jaosorior | is that alright? | 12:07 |
| jaosorior | or are you busy with meetings? | 12:07 |
| jaosorior | brb | 12:08 |
| *** jaosorior has quit IRC | 12:08 | |
| pradk | jaosorior, yea i'm in meeting till noon.. not a good morning :/ .. we can do tomorrow. I'm mostly free tomorrow morning | 12:08 |
| *** eck` is now known as eck`gone | 12:08 | |
| *** salmankhan has quit IRC | 12:10 | |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729352 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729479 | 12:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729569 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 12:10 |
| openstack | Launchpad bug 1729352 in tripleo "CinderCronDbPurgeUser is set to 'keystone' by default" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 12:10 |
| openstack | Launchpad bug 1729479 in tripleo "puppet-collectd change on datatype" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 12:10 |
| openstack | Launchpad bug 1729569 in tripleo "Periodic jobs using swift as glance backend failing" [Critical,Triaged] | 12:10 |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Confirmed] - Assigned to Gabriele Cerami (gcerami) | 12:10 |
| *** artom has joined #tripleo | 12:11 | |
| *** abishop has joined #tripleo | 12:11 | |
| pradk | can someone merge this please https://review.openstack.org/#/c/514809/ | 12:12 |
| *** ansmith has joined #tripleo | 12:13 | |
| *** marios has joined #tripleo | 12:14 | |
| *** salmankhan has joined #tripleo | 12:14 | |
| *** ratailor has quit IRC | 12:15 | |
| *** pkovar has joined #tripleo | 12:15 | |
| *** jkilpatr has joined #tripleo | 12:16 | |
| *** dparkes has quit IRC | 12:19 | |
| *** vpickard_ is now known as vpickard | 12:19 | |
| *** rhallisey has joined #tripleo | 12:21 | |
| karthiks | EmilienM, mwhahaha when is the EOL for newton ? | 12:21 |
| *** dparkes has joined #tripleo | 12:21 | |
| *** trown|outtypewww is now known as trown | 12:22 | |
| *** ccamacho has joined #tripleo | 12:22 | |
| *** raildo has joined #tripleo | 12:22 | |
| *** lucasagomes is now known as lucas-hungry | 12:23 | |
| *** bogdando has quit IRC | 12:24 | |
| *** abregman is now known as abregman|afk | 12:25 | |
| *** oidgar has quit IRC | 12:25 | |
| *** dsariel__ has joined #tripleo | 12:26 | |
| openstackgerrit | Martin André proposed openstack/puppet-tripleo master: Fix bind mounts for cinder-{backup,volume} https://review.openstack.org/517221 | 12:26 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Fix cinder-{backup,volume} container with pacemaker https://review.openstack.org/517222 | 12:27 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Containerize cinder services under pacemaker in CI https://review.openstack.org/517038 | 12:27 |
| *** jcoufal has joined #tripleo | 12:28 | |
| *** rlandy has joined #tripleo | 12:30 | |
| *** pradk has quit IRC | 12:30 | |
| *** gkadam has quit IRC | 12:30 | |
| *** udesale has quit IRC | 12:33 | |
| *** mrunge has quit IRC | 12:33 | |
| *** jaosorior has joined #tripleo | 12:34 | |
| *** catintheroof has joined #tripleo | 12:34 | |
| *** fragatina has joined #tripleo | 12:36 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Disable MongoDB in scenario002 https://review.openstack.org/514727 | 12:37 |
| *** shreshtha has quit IRC | 12:38 | |
| *** leitan has joined #tripleo | 12:38 | |
| *** fragatina has quit IRC | 12:40 | |
| *** dparkes has quit IRC | 12:44 | |
| openstackgerrit | Moshe Levi proposed openstack/tripleo-heat-templates master: Adds environment file for OVS Hardware Offload https://review.openstack.org/507401 | 12:45 |
| *** dparkes has joined #tripleo | 12:45 | |
| *** dtantsur is now known as dtantsur|bbl | 12:45 | |
| *** skramaja has quit IRC | 12:46 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: Fix overcloud-prep-network when overcloud_nodes is None https://review.openstack.org/517261 | 12:46 |
| abishop | mandre: hey, question about our cinder/pacemaker patches (thanks, btw) | 12:47 |
| abishop | mandre: I see you rebased my patch for the CI jobs, which is great | 12:47 |
| abishop | are you able to determine the CI jobs will then pass? i.e. validate your patches to the container configs? | 12:47 |
| *** aputtur_ has joined #tripleo | 12:48 | |
| *** jmelvin has joined #tripleo | 12:48 | |
| *** dmacpher has joined #tripleo | 12:49 | |
| mandre | abishop: not at all, I'm flying blind here, I don't have an environment locally to test the changes | 12:51 |
| mandre | abishop: I'll monitor the CI jobs on you patch | 12:52 |
| jistr | shardy_lunch: if you have some issues in testing -- i noticed the generated endpoint map has wrong port number https://review.openstack.org/#/c/516894/3/network/endpoints/endpoint_map.yaml | 12:52 |
| abishop | mandre: ok, we'll monitor and update as necessary | 12:53 |
| abishop | mandre: we can use the CI results of my patch to validate yours | 12:54 |
| EmilienM | hi | 12:57 |
| EmilienM | karthiks: still under discussion | 12:57 |
| *** ecerquei has joined #tripleo | 12:57 | |
| *** eck`gone is now known as eck` | 12:58 | |
| karthiks | EmilienM, I would like to backport a sample environment file to newton. Will it be taken ? | 12:58 |
| EmilienM | you can always try, we'll see | 12:59 |
| EmilienM | if it's backward compatible and brings value yeah sure | 12:59 |
| *** lucas-hungry is now known as lucasagomes | 12:59 | |
| *** jcoufal_ has joined #tripleo | 12:59 | |
| *** jcoufal has quit IRC | 12:59 | |
| weshay | mwhahaha, https://bluejeans.com/680187811 | 13:01 |
| *** sshnaidm has quit IRC | 13:02 | |
| *** sshnaidm has joined #tripleo | 13:03 | |
| *** ccamacho has quit IRC | 13:04 | |
| *** ccamacho has joined #tripleo | 13:04 | |
| *** ffiore has quit IRC | 13:06 | |
| weshay | https://etherpad.openstack.org/p/tripleo-ci-squad-meeting | 13:08 |
| *** abregman|afk is now known as abregman | 13:08 | |
| ykarel | lyarwood, can you try with update_images=True? | 13:09 |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 13:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729352 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729479 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729569 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 13:10 |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1729352 in tripleo "CinderCronDbPurgeUser is set to 'keystone' by default" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 13:10 |
| openstack | Launchpad bug 1729479 in tripleo "puppet-collectd change on datatype" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 13:10 |
| openstack | Launchpad bug 1729569 in tripleo "Periodic jobs using swift as glance backend failing" [Critical,Triaged] | 13:10 |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Confirmed] - Assigned to Gabriele Cerami (gcerami) | 13:10 |
| *** aufi has quit IRC | 13:11 | |
| *** liverpooler has joined #tripleo | 13:12 | |
| *** aufi has joined #tripleo | 13:13 | |
| *** toure_biab is now known as toure | 13:14 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-common master: Fail ceph-ansible workflow if there is stale puppet-ceph hieradata https://review.openstack.org/511474 | 13:14 |
| *** bobh has joined #tripleo | 13:15 | |
| *** cylopez has joined #tripleo | 13:17 | |
| *** cdearborn has joined #tripleo | 13:21 | |
| *** shardy_lunch is now known as shardy | 13:25 | |
| *** pradk has joined #tripleo | 13:25 | |
| openstackgerrit | Luke Hinds proposed openstack/puppet-tripleo master: [WIP] Implements AIDE Intrusion Detection System https://review.openstack.org/483025 | 13:25 |
| *** mrunge has joined #tripleo | 13:27 | |
| openstackgerrit | Luke Hinds proposed openstack/tripleo-heat-templates master: [WIP] Implements AIDE Intrusion Detection System https://review.openstack.org/483028 | 13:27 |
| *** thrash is now known as thrash|biab | 13:29 | |
| *** dparkes has quit IRC | 13:29 | |
| dmsimard | EmilienM: do you know what ended up fixing the iptables thing ? | 13:31 |
| dmsimard | EmilienM: or did it just fix itself ? | 13:31 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-common stable/pike: Add retry loop for docker pull https://review.openstack.org/517305 | 13:31 |
| *** ffiore has joined #tripleo | 13:31 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci master: Nothing to see here https://review.openstack.org/111011 | 13:31 |
| EmilienM | dmsimard: no idea | 13:31 |
| *** amoralej|lunch is now known as amoralej | 13:32 | |
| EmilienM | dmsimard: we actually wondered and asked on infra channel | 13:32 |
| EmilienM | dmsimard: no reply | 13:32 |
| EmilienM | dmsimard: it's weird, for the amount of time spent on debugging this one :( | 13:32 |
| *** jpena|lunch is now known as jpena | 13:34 | |
| *** jprovazn has quit IRC | 13:34 | |
| dmsimard | EmilienM: we merged the iptables persistence like yesterday fwiw | 13:35 |
| EmilienM | dmsimard: weird | 13:35 |
| *** bogdando has joined #tripleo | 13:37 | |
| bogdando | folks PTAL https://review.openstack.org/#/c/513774/ | 13:38 |
| *** lblanchard has joined #tripleo | 13:39 | |
| *** zshi has quit IRC | 13:40 | |
| *** eck` is now known as eck`gone | 13:41 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-quickstart-extras master: Switch to RDO Queens baseurl in overcloud upgrade https://review.openstack.org/517280 | 13:42 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-quickstart-extras master: Switch to RDO Queens baseurl in overcloud upgrade https://review.openstack.org/517280 | 13:44 |
| *** abregman has quit IRC | 13:45 | |
| *** dparkes has joined #tripleo | 13:45 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add capability to configure simple-crypto backend for barbican https://review.openstack.org/517312 | 13:45 |
| *** abregman has joined #tripleo | 13:46 | |
| slagle | thrash|biab: d0ugal : what do you think about a common mistral work dir, e.g. /var/lib/mistral? | 13:52 |
| slagle | i'd like to get away from using /tmp, as we can't really download ansible playbooks and save them there | 13:52 |
| slagle | it's a security problem, and we want them persisted across reboots | 13:53 |
| slagle | jistr: shardy : thoughts? | 13:53 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Barbican: Add ability to specify KEK for simple crypto plugin https://review.openstack.org/516732 | 13:56 |
| rbrady | slagle: +1 for moving away from /tmp | 13:57 |
| dmsimard | EmilienM, mwhahaha, sshnaidm: Someone posted a link to this on the bj: http://logs.openstack.org/25/517025/4/check/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq/22ac324/zuul-info/inventory.yaml | 13:58 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Barbican: Add ability to specify KEK for simple crypto plugin https://review.openstack.org/516732 | 13:58 |
| dmsimard | if you look at the _projects key, you'll see a lot of projects defined there | 13:58 |
| dmsimard | those are "required-projects" in zuul v3 job definitions | 13:59 |
| jistr | slagle: i think a common dir would be fine, if we ensure that there won't be storage collisions between different workflows (e.g. in "multiple overclouds" kind of scenarios...) | 13:59 |
| dmsimard | It would be worthwhile to double check if you need all of those (I see a lot of puppet modules) | 13:59 |
| slagle | jistr: i'm thinking /var/lib/mistral/<workflow-uuid> | 13:59 |
| dmsimard | EmilienM, mwhahaha, sshnaidm: looking at http://logs.openstack.org/25/517025/4/check/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq/22ac324/ara/ -- the first pre playbook runs the "zuul cloner" and it takes up a significant amount of time to prepare all the repositories | 14:00 |
| jistr | slagle: yea that looks nice. Btw is there a reason for wanting them persisted across reboots beyond wanting to inspect/use them manually? | 14:00 |
| dmsimard | ~6 minutes in your case | 14:00 |
| slagle | jistr: troubleshooting, reproducability | 14:00 |
| slagle | jistr: and support, we will want to know exactly what was used if it failed | 14:00 |
| *** thrash|biab is now known as thrash | 14:01 | |
| slagle | having to regenerate that through heat means it might have changed | 14:01 |
| slagle | jistr: also predictability. /var/lib/mistral/uuid can be determined, whereas random tmpdir can not | 14:02 |
| jistr | slagle: right, good point re support and history tracking. (FWIW i think well created tmp dir shouldn't be a security issue (?), but anyway the history tracking is beneficial IMO so +1 from me) | 14:03 |
| mwhahaha | karthiks: we delayed it a bit, not sure on the exact date at the moment | 14:04 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/511633 | 14:04 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Barbican: Add ability to specify KEK for simple crypto plugin https://review.openstack.org/516732 | 14:05 |
| openstackgerrit | Steven Hardy proposed openstack/puppet-tripleo master: Add kubernetes API to haproxy LB configuration https://review.openstack.org/516407 | 14:06 |
| *** dmarlin has joined #tripleo | 14:06 | |
| *** jkilpatr has quit IRC | 14:06 | |
| jistr | slagle: wondering now if we should also think about cleaning up the directories at some point.. | 14:07 |
| slagle | jistr: yea, i hear you about /tmp. but we've gotten dinged on that before. security folks love to jump on that. i think they get a bounty per CVE or something :) | 14:08 |
| jistr | haha :) | 14:08 |
| lyarwood | ykarel: ops sorry missed your suggestion, yeah I'll give that a go, would that be set in the release config, general config or does that not really matter? | 14:09 |
| *** dparkes has quit IRC | 14:09 | |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729352 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729479 | 14:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729569 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 14:10 |
| openstack | Launchpad bug 1729352 in tripleo "CinderCronDbPurgeUser is set to 'keystone' by default" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 14:10 |
| openstack | Launchpad bug 1729479 in tripleo "puppet-collectd change on datatype" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 14:10 |
| openstack | Launchpad bug 1729569 in tripleo "Periodic jobs using swift as glance backend failing" [Critical,Triaged] | 14:10 |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 14:10 |
| ykarel | lyarwood, i think it should work anywhere, try it in release one for which you have patch | 14:11 |
| *** dparkes has joined #tripleo | 14:11 | |
| *** janki has quit IRC | 14:12 | |
| *** ccamacho has quit IRC | 14:12 | |
| *** ccamacho has joined #tripleo | 14:13 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Allow containerized undercloud deploy with SELinux https://review.openstack.org/513669 | 14:15 |
| *** liverpooler has quit IRC | 14:19 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Use -t devpts for /dev/pts mounts https://review.openstack.org/514043 | 14:20 |
| openstackgerrit | Merged openstack/instack-undercloud master: Only enable keystone notifications if telemetry is enabled https://review.openstack.org/516989 | 14:20 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/instack-undercloud stable/pike: Only enable keystone notifications if telemetry is enabled https://review.openstack.org/517324 | 14:21 |
| mwhahaha | bnemec: EmilienM: weshay: https://github.com/openstack/tripleo-quickstart/blob/155677ab2e73e3edd771ec51382279173a67898b/config/release/tripleo-ci/master.yml#L66 so it does look like we are whitelisting the puppet modules, i really don't want to put projects back into the queue since i think we have a better turn around time on fixes for those | 14:22 |
| mwhahaha | weshay: EmilienM: it looks like we managed to split out tripleoclident/instack-undercloud from the tripleo queue (this is bad) | 14:23 |
| weshay | ugh | 14:24 |
| social | guys can I get reviews here? https://review.openstack.org/#/c/496954/ | 14:24 |
| *** jkilpatr has joined #tripleo | 14:24 | |
| *** liverpooler has joined #tripleo | 14:25 | |
| *** jcoufal_ has quit IRC | 14:27 | |
| *** rbowen has quit IRC | 14:27 | |
| *** jcoufal has joined #tripleo | 14:28 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Manila] https://review.openstack.org/517325 | 14:28 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Ovn] https://review.openstack.org/517326 | 14:29 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Swift] https://review.openstack.org/517327 | 14:29 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Mixed-2] https://review.openstack.org/517328 | 14:29 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Mixed-3] https://review.openstack.org/517329 | 14:29 |
| *** spectr-RH has joined #tripleo | 14:30 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add capability to configure simple-crypto backend for barbican https://review.openstack.org/517312 | 14:31 |
| *** spectr has quit IRC | 14:33 | |
| *** jprovazn has joined #tripleo | 14:35 | |
| *** eck`gone is now known as eck` | 14:36 | |
| *** janki has joined #tripleo | 14:38 | |
| *** cshastri has quit IRC | 14:41 | |
| *** thrash is now known as thrash|biab | 14:41 | |
| *** jcoufal_ has joined #tripleo | 14:42 | |
| *** jcoufal has quit IRC | 14:45 | |
| *** akane has joined #tripleo | 14:47 | |
| openstackgerrit | Ade Lee proposed openstack/tripleo-common master: Add Barbican worker and keystone notifier images https://review.openstack.org/517076 | 14:53 |
| mandre | abishop: looks like we fixed containerized cinder \o/ | 14:54 |
| abishop | mandre: nice! I just started looking at some results, focused on a failure, and found it's a known issue | 14:55 |
| *** sshnaidm is now known as sshnaidm|afk | 14:55 | |
| abishop | mandre: will keep analyzing, but good to know things are looking up! | 14:56 |
| EmilienM | mandre: which patch? | 14:56 |
| abishop | EmilienM: https://review.openstack.org/517221 | 14:57 |
| EmilienM | abishop: thx | 14:57 |
| abishop | EmilienM: and https://review.openstack.org/517222, https://review.openstack.org/517038 | 14:58 |
| *** thrash|biab is now known as thrash | 14:58 | |
| mandre | EmilienM: there is also https://review.openstack.org/#/c/517038/ and https://review.openstack.org/#/c/517222/ | 14:58 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Enable loadbalancer for kubernetes masters https://review.openstack.org/516894 | 14:58 |
| *** aufi has quit IRC | 14:58 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: DNM - WIP testing OVB job speed improvements https://review.openstack.org/500942 | 14:59 |
| EmilienM | mandre: +2 | 14:59 |
| *** brault has quit IRC | 14:59 | |
| akane | Hi> I am stuck with irnic nodes in active state. Tried to set Provisioning State property of nodes to available. But state ain't changing. So I am unable to bring the nodes in available state for deployment. How should I clean up the states? | 15:00 |
| *** akrivoka has joined #tripleo | 15:00 | |
| mandre | thanks EmilienM | 15:00 |
| *** brault has joined #tripleo | 15:00 | |
| abishop | mandre: and thanks to you | 15:00 |
| EmilienM | yeah cool work | 15:01 |
| mandre | abishop: np, I'm glad we're finally re-enabling all of cinder | 15:01 |
| dmsimard | mwhahaha, EmilienM: do you really want to merge this now ? https://review.openstack.org/#/c/517335/ | 15:02 |
| dmsimard | or wait until the tripleo gate queue has settled down ? | 15:02 |
| dmsimard | it looks like there's a batch of changes that are on the verge of merging, I wouldn't want to jinx our chances | 15:02 |
| mwhahaha | dmsimard: there aren't a whole bunch of patches pending for those other jobs but maybe we can merge it in a bit | 15:03 |
| EmilienM | we can merge it now | 15:03 |
| mwhahaha | it shouldn't break any pending | 15:03 |
| mandre | wow, even the upgrade scenarios are green on https://review.openstack.org/#/c/517038/, unbelievable | 15:03 |
| mandre | I should play the lottery today | 15:04 |
| dmsimard | There's really a large batch of jobs that are green and everything is looking good, I -W'd until that batch finishes and I'll merge it after | 15:04 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Allow containerized undercloud deploy with SELinux https://review.openstack.org/513669 | 15:04 |
| dmsimard | It should be clear within 30 minutes or so at this rate | 15:04 |
| *** mwhahaha changes topic to "CI status: YELLOWish - gate queue is kinda long but things are merging so far | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest/" | 15:04 | |
| *** lvdombrkr has quit IRC | 15:05 | |
| *** ukalifon has quit IRC | 15:05 | |
| *** janki has quit IRC | 15:07 | |
| *** aditya_r has joined #tripleo | 15:09 | |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729352 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729479 | 15:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 15:10 |
| openstack | Launchpad bug 1729352 in tripleo "CinderCronDbPurgeUser is set to 'keystone' by default" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 15:10 |
| openstack | Launchpad bug 1729479 in tripleo "puppet-collectd change on datatype" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 15:10 |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 15:10 |
| *** salmankhan has quit IRC | 15:11 | |
| *** ramishra has quit IRC | 15:11 | |
| EmilienM | larsks: you around? | 15:12 |
| larsks | EmilienM: I am. | 15:12 |
| EmilienM | larsks: I don't think someone tested collectd on compute nodes, https://review.openstack.org/#/c/517147/ | 15:13 |
| * larsks looks. | 15:14 | |
| *** lvdombrkr has joined #tripleo | 15:14 | |
| larsks | Yeah, looks that way. I will ping lesik to make sure that gets included in our testing. | 15:14 |
| *** sshnaidm|afk is now known as sshnaidm | 15:15 | |
| EmilienM | larsks: good | 15:15 |
| *** itlinux has joined #tripleo | 15:16 | |
| *** fragatina has joined #tripleo | 15:18 | |
| *** fragatina has quit IRC | 15:18 | |
| *** fragatina has joined #tripleo | 15:19 | |
| *** newmember has joined #tripleo | 15:19 | |
| *** salmankhan has joined #tripleo | 15:23 | |
| *** dparkes has quit IRC | 15:23 | |
| *** gkadam has joined #tripleo | 15:23 | |
| *** janki has joined #tripleo | 15:26 | |
| openstackgerrit | Keith Schincke proposed openstack/puppet-tripleo master: Set ACLs on ceph client keyrings https://review.openstack.org/517347 | 15:26 |
| *** ecerquei has quit IRC | 15:27 | |
| *** dparkes has joined #tripleo | 15:29 | |
| openstackgerrit | Ade Lee proposed openstack/tripleo-heat-templates master: Barbican: Add ability to specify KEK for simple crypto plugin https://review.openstack.org/516732 | 15:30 |
| openstackgerrit | Ade Lee proposed openstack/tripleo-heat-templates master: Add containerized barbican environment https://review.openstack.org/517349 | 15:30 |
| openstackgerrit | Ade Lee proposed openstack/tripleo-heat-templates master: Add containerized barbican environment https://review.openstack.org/517349 | 15:31 |
| openstackgerrit | Ade Lee proposed openstack/tripleo-heat-templates master: Barbican: Add ability to specify KEK for simple crypto plugin https://review.openstack.org/516732 | 15:31 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Fix nova-cpu/collectd hieradata https://review.openstack.org/517147 | 15:34 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: fs10: deploy steps with ansible https://review.openstack.org/508307 | 15:34 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/newton: RHSM: do not use retry to deploy katello-agent https://review.openstack.org/517144 | 15:34 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/ocata: RHSM: do not use retry to deploy katello-agent https://review.openstack.org/517143 | 15:34 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/newton: Upgrade rhel_reg_sat_repo to 6.2 https://review.openstack.org/517140 | 15:34 |
| *** akane has quit IRC | 15:36 | |
| EmilienM | wow | 15:37 |
| EmilienM | slagle: ^ merged \o/ | 15:37 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Fix nova-cpu/collectd hieradata https://review.openstack.org/517352 | 15:38 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/ocata: Fix nova-cpu/collectd hieradata https://review.openstack.org/517353 | 15:38 |
| *** thrash is now known as thrash|biab | 15:38 | |
| EmilienM | larsks: ^ backports - sounds like even ocata has wrong code :) | 15:38 |
| *** agurenko has quit IRC | 15:40 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add capability to configure simple-crypto backend for barbican https://review.openstack.org/517312 | 15:40 |
| *** spectr has joined #tripleo | 15:41 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Allow containerized undercloud deploy with SELinux https://review.openstack.org/513669 | 15:42 |
| *** rbowen has joined #tripleo | 15:42 | |
| openstackgerrit | Alan Bishop proposed openstack/tripleo-heat-templates stable/pike: Set ipc=host for services attaching encrypted volumes https://review.openstack.org/517209 | 15:43 |
| *** spectr-RH has quit IRC | 15:44 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/ocata: Upgrade rhel_reg_sat_repo to 6.2 https://review.openstack.org/517139 | 15:47 |
| slagle | EmilienM: snap, guess it's official now | 15:48 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates stable/pike: Add all services to container scenarios https://review.openstack.org/512305 | 15:49 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: config-download: use workflow supported in Queens https://review.openstack.org/516841 | 15:49 |
| EmilienM | slagle: so I rebased https://review.openstack.org/#/c/516841/ on master and iiuc it will fail (since https://review.openstack.org/508307 merged) - right? | 15:49 |
| slagle | EmilienM: yes, i guess that one on its own would fail | 15:50 |
| EmilienM | slagle: right because we need https://review.openstack.org/#/c/514736/ | 15:50 |
| slagle | EmilienM: what you could do is add a new var that defaults to not using the workflow | 15:50 |
| dmsimard | Seeing a lot of things merging, yay | 15:50 |
| EmilienM | slagle: that's the chichen/egg issue I was mentioning | 15:50 |
| slagle | EmilienM: then, in the oooq patch, set the var to use the workflow | 15:50 |
| EmilienM | slagle: yeah I'll do that. | 15:50 |
| EmilienM | ok | 15:50 |
| slagle | then have another patch to clean up oooq-extras | 15:51 |
| EmilienM | yep | 15:51 |
| *** yprokule has quit IRC | 15:51 | |
| dmsimard | weshay, adarazs|rover: failure in gate queue http://logs.openstack.org/96/517096/2/gate/legacy-tripleo-ci-centos-7-scenario002-multinode-oooq/8e265db/ | 15:51 |
| slagle | this is what I call "hacking CI" | 15:51 |
| weshay | dmsimard, thanks | 15:51 |
| dmsimard | weshay, adarazs|rover: https://review.openstack.org/#/c/517096/ | 15:51 |
| *** janki has quit IRC | 15:51 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Switch pacemakerized Cinder services to containerized variants in scenarios https://review.openstack.org/512320 | 15:51 |
| *** gbarros has joined #tripleo | 15:52 | |
| openstackgerrit | Bob Fournier proposed openstack/instack-undercloud stable/newton: undercloud/upgrade: change ownership for ironic-dbsync.log https://review.openstack.org/517356 | 15:52 |
| EmilienM | bfournie: sorry if I missed newton back in August. I thought I didn't need it. | 15:53 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates stable/pike: Add all services to container scenarios https://review.openstack.org/512305 | 15:53 |
| *** gbarros has quit IRC | 15:53 | |
| *** rbowen has quit IRC | 15:54 | |
| *** gbarros has joined #tripleo | 15:54 | |
| openstackgerrit | Ryan Brady proposed openstack/tripleo-common master: Adds Workflow to List Available Roles https://review.openstack.org/509832 | 15:55 |
| *** spectr has quit IRC | 15:55 | |
| bfournie | EmilienM: hey, no problem! note newton doesn't have support for the upgrade flag in undercloud.py | 15:55 |
| EmilienM | bfournie: oops | 15:56 |
| bfournie | EmilienM: so we will chown all the time, which is not a problem | 15:57 |
| EmilienM | bfournie: right. | 15:57 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Allow containerized undercloud deploy with SELinux https://review.openstack.org/513669 | 15:58 |
| *** shardy has quit IRC | 15:59 | |
| *** moshele has quit IRC | 15:59 | |
| *** ykarel is now known as ykarel|away | 16:00 | |
| *** anshul has quit IRC | 16:00 | |
| *** pkovar has quit IRC | 16:01 | |
| *** ecerquei has joined #tripleo | 16:02 | |
| *** aditya_r has quit IRC | 16:03 | |
| *** aditya_r has joined #tripleo | 16:04 | |
| mwhahaha | failure in the gate | 16:05 |
| mwhahaha | http://logs.openstack.org/96/517096/2/gate/legacy-tripleo-ci-centos-7-scenario002-multinode-oooq/8e265db/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-11-02_15_37_40 | 16:06 |
| mwhahaha | looks like create_Failed timedout | 16:06 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Move instackenv.json copy to ovb-create-stack task https://review.openstack.org/517026 | 16:06 |
| *** newmember has quit IRC | 16:06 | |
| *** mcornea has quit IRC | 16:07 | |
| *** newmember has joined #tripleo | 16:07 | |
| openstackgerrit | Merged openstack/python-tripleoclient master: Add missing puppet configuration to undercloud deploy https://review.openstack.org/513774 | 16:08 |
| *** jaosorior has quit IRC | 16:08 | |
| *** psachin has quit IRC | 16:09 | |
| *** links has joined #tripleo | 16:09 | |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729352 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 16:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 16:10 |
| openstack | Launchpad bug 1729352 in tripleo "CinderCronDbPurgeUser is set to 'keystone' by default" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 16:10 |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 16:10 |
| *** etingof has quit IRC | 16:12 | |
| slagle | EmilienM: fyi, i remembered i still need to clean this up in the client side: | 16:12 |
| slagle | https://review.openstack.org/#/c/514701/1/tripleoclient/workflows/deployment.py | 16:12 |
| *** etingof has joined #tripleo | 16:13 | |
| slagle | for deployed-server, we've got to pass our own ssh key | 16:13 |
| slagle | i guess i'll need to add another cli arg | 16:13 |
| EmilienM | oh right | 16:13 |
| *** morazi has quit IRC | 16:14 | |
| *** gvrangan has joined #tripleo | 16:15 | |
| *** agurenko has joined #tripleo | 16:16 | |
| mandre | jistr: sorry I missed your change at https://review.openstack.org/#/c/512320/ :-/ | 16:17 |
| *** dmacpher has quit IRC | 16:17 | |
| *** etingof has quit IRC | 16:17 | |
| *** achadha has joined #tripleo | 16:17 | |
| *** achadha has quit IRC | 16:18 | |
| *** achadha has joined #tripleo | 16:18 | |
| jistr | mandre: haha that's fine :) | 16:19 |
| *** dsariel__ has quit IRC | 16:19 | |
| mandre | jistr: well... the good new is we have cinder fully working in containers :) | 16:19 |
| openstackgerrit | Derek Higgins proposed openstack/tripleo-quickstart-extras master: Nothing to see here https://review.openstack.org/517368 | 16:20 |
| jistr | yea :) we just need to get it throught he sc001 job :) | 16:20 |
| openstackgerrit | Jose Luis Franco proposed openstack-infra/tripleo-ci master: WIP: Upgrade UC and OC using tripleo-upgrade role https://review.openstack.org/515643 | 16:21 |
| *** aufi has joined #tripleo | 16:22 | |
| *** hewbrocca is now known as hewbrocca_afk | 16:25 | |
| *** newmember has quit IRC | 16:26 | |
| *** catintheroof has quit IRC | 16:26 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Upgrade rhel_reg_sat_repo to 6.2 https://review.openstack.org/517138 | 16:26 |
| *** newmember has joined #tripleo | 16:27 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Add --detailed-exitcodes when running puppet via ansible https://review.openstack.org/517022 | 16:27 |
| jistr | slagle: for deployed server we should use mistral's internal key + tripleo-admin user. We already have that. We should not pass user's own private key to mistral. I just hardened enable-ssh-admin.sh script a while ago for this. | 16:29 |
| *** etingof has joined #tripleo | 16:29 | |
| jistr | slagle: https://github.com/openstack/tripleo-heat-templates/blob/master/deployed-server/scripts/enable-ssh-admin.sh | 16:29 |
| *** catintheroof has joined #tripleo | 16:30 | |
| *** dmacpher has joined #tripleo | 16:30 | |
| EmilienM | jistr, bogdando : I see you approved https://review.openstack.org/#/c/514730/ | 16:31 |
| EmilienM | but where is it tested? | 16:31 |
| EmilienM | scenario006 didn't run | 16:31 |
| EmilienM | are we merging untested code? | 16:31 |
| *** yamahata has joined #tripleo | 16:31 | |
| *** trown is now known as trown|lunch | 16:31 | |
| slagle | jistr: ok...hadn't seen that. what calls this script? | 16:32 |
| jistr | slagle: so for split stack where the servers are still managed by Nova, one can just call this workflow w/o any params and the access will be enabled via os-collect-config https://github.com/openstack/tripleo-common/blob/master/workbooks/access.yaml#L8 | 16:33 |
| *** cylopez has quit IRC | 16:33 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-puppet-elements master: Do not rely on openstack-puppet-modules https://review.openstack.org/512780 | 16:34 |
| jistr | slagle: for full deployed server environment w/o nova, user has to call that script manually. Until then, there's nothing "automatic" that could happen. Basically before that point Mistral or anything else has no credentials to the deployed servers. That script is the "first point of contact" :) | 16:34 |
| *** noslzzp has quit IRC | 16:35 | |
| slagle | jistr: ok. so basically, i was doing the same as this script in tripleoclient | 16:35 |
| slagle | jistr: by passing in ssh user and key | 16:35 |
| *** links has quit IRC | 16:35 | |
| *** pkovar has joined #tripleo | 16:35 | |
| slagle | which then gets passed to mistral, which runs the enable_ssh_admin | 16:36 |
| fultonj | any cores what to review https://review.openstack.org/#/c/516224 ? | 16:36 |
| *** gbarros_ has joined #tripleo | 16:36 | |
| *** fragatina has quit IRC | 16:36 | |
| slagle | jistr: i can't make use of that script, b/c I want everything to happen in a single workflow: https://review.openstack.org/#/c/512876/ | 16:36 |
| *** gbarros has quit IRC | 16:37 | |
| jistr | slagle: well the key difference is "gets passed to mistral". I don't think we want mistral to be able to read operator's private ssh key, which they might use for much more than just managing overcloud. Essentially it should be viewed as operator's personal identity proof, not an overcloud access token that can be passed around. | 16:37 |
| *** aditya_r has quit IRC | 16:38 | |
| *** aditya_r has joined #tripleo | 16:38 | |
| jistr | slagle: so what that script does is create and authorize a *temporary* ssh key on the overcloud, which is then passed to mistral as a temporary auth mechanism to create the persistent auth mechanism. So operator's private ssh key is never exposed to mistral. | 16:39 |
| slagle | jistr: hmm, right. i'll have to think of a way to do this then. | 16:39 |
| slagle | jistr: i could have tripleoclient implement the temporary ssh key approach as well | 16:40 |
| slagle | then do a separate workflow for enable_ssh_admin | 16:40 |
| *** dtantsur|bbl is now known as dtantsur | 16:41 | |
| *** rwsu has quit IRC | 16:41 | |
| *** marios has quit IRC | 16:42 | |
| jistr | slagle: right, if we do that in tripleoclient, then we could probably just drop the script... | 16:42 |
| jistr | slagle: though i still wonder if we should have a completely separate CLI command to do this. It's useful outside config download as well... | 16:43 |
| jistr | slagle: e.g. currently there's no way to run validations on Deployed Server, as the validation workflow uses the key injection via Nova, which won't work with deployed server | 16:44 |
| slagle | true. i'll see what simple approach i can come up with first | 16:44 |
| jistr | slagle: ack | 16:44 |
| jistr | EmilienM: sorry for the delay, yes we work on un-CI'd code. We test manually for now which i agree is suboptimal. I think we got far enough now that we can take another attempt at deploying with sc006 for Kubespray. | 16:45 |
| *** rwsu has joined #tripleo | 16:47 | |
| *** fandrieu has left #tripleo | 16:47 | |
| EmilienM | jistr: that would be awesome! let me know if I can help in any way | 16:48 |
| jistr | EmilienM: me and shardy test manually so it's at least double tested :) but i've made a note to try and get sc006 up as the next thing, thanks for brigning it up | 16:48 |
| EmilienM | jistr: I'm wondering why the scenario didn't run | 16:48 |
| EmilienM | jistr: awesome²! thx for the update | 16:48 |
| jistr | EmilienM: ack thanks. It's experimental and AFAIK we never saw it pass. I'll see how far we can get now. | 16:49 |
| EmilienM | ok | 16:50 |
| *** aditya_r has quit IRC | 16:58 | |
| jistr | EmilienM, slagle: i just realized CI for Kubespray depends on CI for deployed server. It only works with deployed server. | 17:00 |
| jistr | EmilienM, slagle: err, i mean *config download*, not deployed server :D | 17:01 |
| EmilienM | oh right | 17:01 |
| slagle | well, it's in progress | 17:03 |
| *** jfrancoa has quit IRC | 17:04 | |
| jistr | EmilienM, slagle: cool :) as soon as we have it working i'll implement the sc006 job for Kubespray | 17:05 |
| slagle | jistr: we just landed using tripleo-config-download, and then running ansible-playbook locally | 17:06 |
| EmilienM | ++ | 17:06 |
| slagle | and plan to move that to using the workflow | 17:06 |
| EmilienM | I'm now working on testing this new workflow with oooq | 17:06 |
| EmilienM | (even if it will fail, but having the pieces ready) | 17:06 |
| *** pkovar has quit IRC | 17:07 | |
| jistr | EmilienM: great we'll definitely use that in the kubespray job | 17:08 |
| EmilienM | ack | 17:08 |
| openstackgerrit | Christian Schwede proposed openstack/puppet-tripleo master: Create Swift directory d1 if needed https://review.openstack.org/517373 | 17:08 |
| *** ffiore has quit IRC | 17:09 | |
| openstackgerrit | Christian Schwede proposed openstack/tripleo-heat-templates master: Create Swift directory d1 if required https://review.openstack.org/517374 | 17:09 |
| jistr | slagle: nice :) i can stop using patched tripleo-common then :) | 17:09 |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729352 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 17:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 17:10 |
| openstack | Launchpad bug 1729352 in tripleo "CinderCronDbPurgeUser is set to 'keystone' by default" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 17:10 |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 17:10 |
| *** dparkes has quit IRC | 17:11 | |
| *** gvrangan has quit IRC | 17:12 | |
| *** fragatina has joined #tripleo | 17:13 | |
| *** gvrangan has joined #tripleo | 17:14 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: config-download: use workflow supported in Queens https://review.openstack.org/516841 | 17:16 |
| *** thrash|biab is now known as thrash | 17:16 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: config-download: use workflow supported in Queens https://review.openstack.org/516841 | 17:18 |
| *** gvrangan has quit IRC | 17:18 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: fs010: use --config-download from tripleoclient https://review.openstack.org/514736 | 17:19 |
| EmilienM | slagle: I think I got it: https://review.openstack.org/#/q/topic:bp/ansible-config-download+owner:%22Emilien+Macchi+%253Cemilien%2540redhat.com%253E%22+status:open | 17:20 |
| EmilienM | slagle: testing on my env now | 17:20 |
| *** jfrancoa has joined #tripleo | 17:21 | |
| *** lucasagomes is now known as lucas-afk | 17:22 | |
| *** itlinux has quit IRC | 17:23 | |
| *** myoung is now known as myoung|lunch | 17:27 | |
| *** cylopez has joined #tripleo | 17:29 | |
| *** ebarrera has quit IRC | 17:29 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Allow SELinux shared context for containers state https://review.openstack.org/517383 | 17:31 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Allow SELinux shared context for containers state https://review.openstack.org/517383 | 17:35 |
| *** fultonj has quit IRC | 17:39 | |
| *** moshele has joined #tripleo | 17:40 | |
| *** gfidente has quit IRC | 17:41 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Test containers with SELinux Enforcing https://review.openstack.org/517384 | 17:43 |
| *** trown|lunch is now known as trown | 17:44 | |
| *** akrivoka has quit IRC | 17:48 | |
| *** akrivoka has joined #tripleo | 17:48 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Multinode provision role https://review.openstack.org/516795 | 17:49 |
| sshnaidm | trown, ^^ | 17:49 |
| *** moshele has quit IRC | 17:51 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Multinode provision role https://review.openstack.org/516795 | 17:52 |
| trown | sshnaidm: sweet will give that a go | 17:52 |
| trown | sshnaidm: looks good at a glance though | 17:52 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Move instackenv.json copy to ovb-create-stack task https://review.openstack.org/517026 | 17:53 |
| openstackgerrit | Pradeep Kilambi proposed openstack/instack-undercloud master: Fix the expirer cron task to run correctly https://review.openstack.org/517385 | 17:53 |
| abishop | hey folks, hoping another core can look at https://review.openstack.org/506715 | 17:55 |
| *** bogdando has quit IRC | 17:56 | |
| *** jpich has quit IRC | 17:57 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/instack-undercloud master: Fix the expirer cron task to run correctly https://review.openstack.org/517385 | 17:57 |
| trown | sshnaidm: works quite nice now :) | 17:58 |
| sshnaidm | \o/ | 17:59 |
| trown | sshnaidm: host file works | 17:59 |
| *** derekh has quit IRC | 17:59 | |
| *** anilvenkata has quit IRC | 18:02 | |
| *** chlong has quit IRC | 18:02 | |
| *** gkadam has quit IRC | 18:08 | |
| *** abregman is now known as abregman|afk | 18:09 | |
| *** gkadam has joined #tripleo | 18:09 | |
| *** chlong has joined #tripleo | 18:10 | |
| *** pcaruana has quit IRC | 18:10 | |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729352 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 18:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 18:10 |
| openstack | Launchpad bug 1729352 in tripleo "CinderCronDbPurgeUser is set to 'keystone' by default" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 18:10 |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 18:10 |
| *** itlinux has joined #tripleo | 18:11 | |
| *** fultonj has joined #tripleo | 18:14 | |
| *** cylopez has quit IRC | 18:16 | |
| *** bfournie has quit IRC | 18:16 | |
| *** bfournie has joined #tripleo | 18:17 | |
| *** bfournie has quit IRC | 18:21 | |
| *** gbarros_ has quit IRC | 18:22 | |
| *** rakhmerov has quit IRC | 18:23 | |
| *** jfrancoa has quit IRC | 18:25 | |
| *** tesseract has quit IRC | 18:25 | |
| openstackgerrit | Or Idgar proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia https://review.openstack.org/487450 | 18:26 |
| *** gbarros has joined #tripleo | 18:27 | |
| *** jcoufal_ has quit IRC | 18:27 | |
| *** dparkes has joined #tripleo | 18:27 | |
| *** jcoufal has joined #tripleo | 18:28 | |
| *** rakhmerov has joined #tripleo | 18:28 | |
| *** jpena is now known as jpena|off | 18:34 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: RHSM: do not use retry to deploy katello-agent https://review.openstack.org/517142 | 18:34 |
| dmsimard | sshnaidm, bnemec: is RH1 healthy right now ? Saw four node failures for a code review | 18:37 |
| sshnaidm | dmsimard, are they new? | 18:38 |
| dmsimard | sshnaidm: what new ? | 18:38 |
| sshnaidm | dmsimard, the failures. Because there was problem with rh1 recently | 18:39 |
| sshnaidm | dmsimard, but they are gone | 18:39 |
| sshnaidm | I see jobs running there | 18:39 |
| dmsimard | sshnaidm: recently like... today ? | 18:39 |
| sshnaidm | dmsimard, no, today should be ok afaik, bnemec, panda|ruck, adarazs|rover - right? | 18:40 |
| dmsimard | sshnaidm: those four node failures were like ~3 hours ago | 18:40 |
| *** dtrainor has quit IRC | 18:41 | |
| *** myoung|lunch is now known as myoung | 18:41 | |
| bnemec | My guess would be that corresponds to when the new infra image was uploaded, which then causes a bunch of node creation failures because it takes too long for us to distribute the image to compute nodes. | 18:41 |
| bnemec | For some reason it seems that zuulv3 doesn't retry if that happens either. | 18:42 |
| bnemec | Unless I'm mistaken about what a node_failure result means, which is entirely possible. | 18:42 |
| *** dtantsur is now known as dtantsur|afk | 18:44 | |
| *** aufi has quit IRC | 18:47 | |
| *** pradk has quit IRC | 18:48 | |
| *** dtrainor has joined #tripleo | 18:49 | |
| *** sshnaidm is now known as sshnaidm|off | 18:49 | |
| dmsimard | bnemec: we're getting someone from infra to look on their end but I was interested in seeing if there was something on the other end too, thanks | 18:50 |
| *** bkopilov has quit IRC | 18:51 | |
| *** toure is now known as toure_biab | 18:52 | |
| bnemec | dmsimard: np, I should note that we're spectacularly slow in this regard because our controller is running on a single spindle, which bottlenecks the image transfers. I doubt any of the other clouds have this issue. | 18:52 |
| bnemec | dmsimard: Other than that rh1 is pretty healthy. Our heat stacks are creating in about as short a time as I can remember seeing. | 18:53 |
| *** gbarros has quit IRC | 18:56 | |
| *** agurenko has quit IRC | 18:58 | |
| *** itlinux has quit IRC | 19:00 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: cinder: switch CinderCronDbPurgeUser to 'cinder' https://review.openstack.org/516994 | 19:08 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Fix iptables rules override bug in clustercheck docker service https://review.openstack.org/516649 | 19:08 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras master: Add role to setup any centos vm to look like nodepool vm https://review.openstack.org/517411 | 19:09 |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 19:10 |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 19:10 |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 19:10 |
| *** gbarros has joined #tripleo | 19:10 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: cinder: switch CinderCronDbPurgeUser to 'cinder' https://review.openstack.org/517412 | 19:11 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/ocata: cinder: switch CinderCronDbPurgeUser to 'cinder' https://review.openstack.org/517413 | 19:11 |
| EmilienM | what are our blockers to promote at this stage? | 19:12 |
| weshay | EmilienM, question to anyone? | 19:13 |
| EmilienM | I suppose yeah | 19:13 |
| weshay | for master I assume | 19:13 |
| EmilienM | yeah | 19:13 |
| weshay | sec /me gets some info | 19:13 |
| *** liverpooler has quit IRC | 19:14 | |
| Slower | slagle: ping | 19:15 |
| weshay | EmilienM, after a quick meeting w/ apevec and amoralej we decided to try and promote the following hash that was messed up when a manual queue was kicked | 19:15 |
| weshay | https://review.rdoproject.org/r/#/c/10387/ | 19:15 |
| weshay | we're skipping the containers build for these runs as they are already in the registry https://review.rdoproject.org/r/#/c/10389/ | 19:16 |
| slagle | Slower: hey | 19:16 |
| weshay | EmilienM, so the next few runs of master will run against the same hash | 19:16 |
| EmilienM | weshay: nice | 19:16 |
| weshay | once that passes, we'll unpin | 19:17 |
| weshay | or if it has legit errors, we'll unpin | 19:17 |
| Slower | slagle: so we've been using the undercloud ansible stuff no problem | 19:17 |
| Slower | slagle: get it going in CI and I get a new error | 19:17 |
| Slower | which I'll find for you.. sec :) | 19:18 |
| Slower | slagle: http://logs.openstack.org/67/515967/8/check/legacy-tripleo-ci-centos-7-undercloud-containers/69f8a34/job-output.txt.gz#_2017-11-01_23_22_05_619723 | 19:19 |
| *** amoralej is now known as amoralej|off | 19:19 | |
| Slower | that's from this patch: https://review.openstack.org/#/c/515967/ | 19:20 |
| Slower | woops | 19:20 |
| Slower | https://review.openstack.org/#/c/515967/ | 19:20 |
| Slower | unfortunately we can't see the ansible it produced | 19:20 |
| Slower | CI doesn't collect that | 19:21 |
| slagle | Slower: yea, you need to fix that first | 19:21 |
| slagle | usually it's collected under /home/zuul, but I guess since you sudo, it's under root | 19:21 |
| Slower | correct | 19:21 |
| Slower | ok | 19:22 |
| slagle | Slower: i would guess it has something to do with the undercloud external tasks support that was added to t-h-t | 19:22 |
| Slower | hmmm | 19:23 |
| Slower | it's been working locally | 19:23 |
| Slower | did this just land? | 19:23 |
| *** akrivoka has quit IRC | 19:23 | |
| slagle | new'ish | 19:23 |
| Slower | I wonder if its this? https://review.openstack.org/#/c/513449/ | 19:23 |
| Slower | shardy put in a depends on for it.. | 19:23 |
| slagle | https://review.openstack.org/#/c/510122/ | 19:24 |
| slagle | the error is pointing at lines that would be generated by that chagne ^ | 19:24 |
| Slower | hmm | 19:25 |
| Slower | ok I'm going to respin locally and see if its broken | 19:25 |
| slagle | Slower: it may also have to do with your inventory if you have a group called [undercloud] there | 19:26 |
| slagle | you should add collecting that to the job logs as well | 19:26 |
| Slower | I will | 19:26 |
| Slower | once I figure out how :) | 19:27 |
| *** rhallisey has quit IRC | 19:28 | |
| *** dprince has joined #tripleo | 19:28 | |
| *** gbarros has quit IRC | 19:28 | |
| *** liverpooler has joined #tripleo | 19:30 | |
| slagle | Slower: see collect-logs role in oooq or oooq-extras | 19:31 |
| slagle | or something like that anyway | 19:31 |
| *** aputtur_ has quit IRC | 19:33 | |
| slagle | Slower: it could be caused by https://review.openstack.org/#/c/513449, based on the comments | 19:33 |
| slagle | i haven't tried shardy's patch. i figured he did :) | 19:34 |
| *** akrivoka has joined #tripleo | 19:34 | |
| *** liverpooler has quit IRC | 19:35 | |
| *** brault has quit IRC | 19:37 | |
| *** brault has joined #tripleo | 19:37 | |
| *** gbarros has joined #tripleo | 19:40 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/511633 | 19:41 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Add the option to run the container-check script https://review.openstack.org/501028 | 19:48 |
| *** salmankhan has quit IRC | 19:48 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/511633 | 19:50 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Add container update to feature set files https://review.openstack.org/514435 | 19:51 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-heat-templates stable/pike: DNM, TESTING ONLY https://review.openstack.org/514465 | 19:51 |
| *** brault has quit IRC | 19:52 | |
| *** gkadam has quit IRC | 19:54 | |
| openstackgerrit | Ian Main proposed openstack/python-tripleoclient master: Refactor undercloud deploy to use Ansible. https://review.openstack.org/515967 | 19:55 |
| *** achadha has quit IRC | 19:57 | |
| abishop | mwhahaha: would a cinder backend driver added in pike be suitable for proposing to stable/ocata? | 19:59 |
| *** itlinux has joined #tripleo | 20:00 | |
| *** gbarros has quit IRC | 20:00 | |
| *** lblanchard has quit IRC | 20:01 | |
| *** jcoufal has quit IRC | 20:02 | |
| *** jcoufal has joined #tripleo | 20:02 | |
| *** achadha has joined #tripleo | 20:03 | |
| *** achadha_ has joined #tripleo | 20:07 | |
| *** dprince has quit IRC | 20:08 | |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 20:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 20:10 |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 20:10 |
| *** achadha has quit IRC | 20:10 | |
| Slower | slagle: I was able to reproduce locally.. | 20:11 |
| slagle | Slower: i think it's shardy's patch | 20:13 |
| slagle | honestly, i'm not sure you need a depends-on for that | 20:13 |
| Slower | slagle: I tried without it and got the same result | 20:13 |
| Slower | let me double check that though | 20:13 |
| *** dprince has joined #tripleo | 20:14 | |
| slagle | Slower: let's have a look at the playbook | 20:14 |
| Slower | slagle: no the code was still there, I'll rerun | 20:14 |
| Slower | slagle: how do you want to do that? | 20:15 |
| Slower | tmate? | 20:15 |
| Slower | slagle: the sense I got is shardy wanted to see if it broke it or not :) | 20:16 |
| mwhahaha | abishop: if it's needed i guess | 20:16 |
| *** atoth has quit IRC | 20:16 | |
| *** liverpooler has joined #tripleo | 20:16 | |
| *** jcoufal_ has joined #tripleo | 20:16 | |
| *** dprince has quit IRC | 20:17 | |
| *** dprince has joined #tripleo | 20:17 | |
| *** raildo has quit IRC | 20:18 | |
| Slower | slagle: yep! it's shardy's patch.. | 20:19 |
| abishop | mwhahaha: yeah, customer ask, and downstream back to newton | 20:19 |
| *** jcoufal has quit IRC | 20:19 | |
| *** jcoufal has joined #tripleo | 20:20 | |
| abishop | rajinir: ^^ this is the VMAX driver | 20:20 |
| *** slagle has quit IRC | 20:20 | |
| *** eck` is now known as eck`gone | 20:21 | |
| openstackgerrit | Ian Main proposed openstack/python-tripleoclient master: Refactor undercloud deploy to use Ansible. https://review.openstack.org/515967 | 20:22 |
| *** jcoufal_ has quit IRC | 20:22 | |
| *** slagle has joined #tripleo | 20:23 | |
| slagle | Slower: sorry got disconnected | 20:23 |
| *** jcoufal_ has joined #tripleo | 20:24 | |
| slagle | tubes are clogged out in the woods | 20:24 |
| openstackgerrit | Ian Main proposed openstack/python-tripleoclient master: Mount a tmpfs filesystem for heat tmpfiles https://review.openstack.org/508558 | 20:25 |
| rook | bnemec: saw your message about logging... Could we have the undercloud launch a elk instance on the UC :D | 20:26 |
| Slower | slagle: ya it's shardy's patch | 20:26 |
| rajinir | abishop: +VMAX Driver +1 | 20:26 |
| rook | IMHO rsyslog+omelastic -> elk is the logging future! | 20:26 |
| *** jcoufal has quit IRC | 20:27 | |
| Slower | slagle: squirrels chewing on your wires? | 20:27 |
| bnemec | rook: I'm sure we could, but it would increase the requirements for the undercloud by a _lot_, and make the undercloud a SPOF. | 20:28 |
| bnemec | Although I assume from the :D that you're joking. :-) | 20:29 |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: fix the undercloud-oooq job's subunit failures https://review.openstack.org/517428 | 20:31 |
| openstackgerrit | Keith Schincke proposed openstack/puppet-tripleo master: Set ACLs on ceph client keyrings https://review.openstack.org/517347 | 20:31 |
| weshay | mwhahaha, https://review.openstack.org/#/c/517428/ FYI.. fixes tripleo-ui jobs | 20:32 |
| *** ansmith has quit IRC | 20:32 | |
| *** newmember has quit IRC | 20:34 | |
| *** newmember has joined #tripleo | 20:34 | |
| *** ecerquei has quit IRC | 20:36 | |
| *** akrivoka has quit IRC | 20:36 | |
| *** brault has joined #tripleo | 20:39 | |
| *** brault has quit IRC | 20:44 | |
| *** rhallisey has joined #tripleo | 20:44 | |
| *** jprovazn has quit IRC | 20:46 | |
| *** achadha_ has quit IRC | 20:47 | |
| *** achadha has joined #tripleo | 20:48 | |
| *** trown is now known as trown|outtypewww | 20:49 | |
| *** brault has joined #tripleo | 20:49 | |
| *** myoung is now known as myoung|afk | 20:51 | |
| *** adac has quit IRC | 20:51 | |
| *** myoung|afk is now known as myoung | 20:53 | |
| *** dprince has quit IRC | 20:54 | |
| *** adac has joined #tripleo | 20:55 | |
| *** myoung is now known as myoung|bbl | 20:56 | |
| *** brault has quit IRC | 20:57 | |
| *** abishop has quit IRC | 20:59 | |
| *** rhallisey has quit IRC | 21:01 | |
| *** liverpooler has quit IRC | 21:03 | |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 21:10 |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 21:10 |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 21:10 |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: fix the undercloud-oooq job's subunit failures https://review.openstack.org/517428 | 21:11 |
| EmilienM | slagle: just FYI - with the current state of things, it fails here: http://logs.openstack.org/36/514736/4/check/legacy-tripleo-ci-centos-7-containers-multinode/c7721b0/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-11-02_19_24_05 | 21:16 |
| *** itlinux has quit IRC | 21:18 | |
| slagle | EmilienM: did you see my message earlier? | 21:19 |
| slagle | EmilienM: about the ssh key? | 21:19 |
| EmilienM | slagle: I'm not sure | 21:19 |
| EmilienM | slagle: I probably missed it | 21:19 |
| slagle | EmilienM: where I told you it wasn't going to work yet | 21:19 |
| EmilienM | ok | 21:19 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-heat-templates stable/pike: DNM, TESTING ONLY https://review.openstack.org/514465 | 21:19 |
| *** itlinux has joined #tripleo | 21:24 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: cinder: switch CinderCronDbPurgeUser to 'cinder' https://review.openstack.org/517412 | 21:28 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Add --detailed-exitcodes when running puppet via ansible https://review.openstack.org/517022 | 21:29 |
| *** salmankhan has joined #tripleo | 21:30 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: DNM - Test Puppet exit code in Pike https://review.openstack.org/517440 | 21:31 |
| *** ccamacho has quit IRC | 21:33 | |
| *** jtomasek has quit IRC | 21:35 | |
| *** salmankhan has quit IRC | 21:35 | |
| openstackgerrit | Merged openstack/tripleo-common stable/newton: Fix using old Swift rings when creating a new stack https://review.openstack.org/504886 | 21:40 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/newton: os-net-config not run when conf is empty and re-introduce exception. https://review.openstack.org/516614 | 21:40 |
| *** d0ugal has quit IRC | 21:40 | |
| openstackgerrit | Merged openstack/tripleo-common master: Fix typos in container_images_prepare failure task names https://review.openstack.org/516720 | 21:42 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Expose role tags via heat RoleTags output https://review.openstack.org/516626 | 21:42 |
| *** ansmith has joined #tripleo | 21:43 | |
| *** d0ugal has joined #tripleo | 21:47 | |
| openstackgerrit | Vincent S. Cojot proposed openstack/tripleo-heat-templates stable/newton: RHSM: when using proxy, test its connectivity first https://review.openstack.org/517442 | 21:48 |
| *** itlinux has quit IRC | 21:48 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/newton: Make nova patching parameters configurable in Nuage https://review.openstack.org/504134 | 21:48 |
| openstackgerrit | Vincent S. Cojot proposed openstack/tripleo-heat-templates stable/pike: RHSM: when using proxy, test its connectivity first https://review.openstack.org/517443 | 21:49 |
| *** leitan has quit IRC | 21:52 | |
| *** catintheroof has quit IRC | 21:53 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: DNM, update the undercloud install for containers https://review.openstack.org/517444 | 21:55 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: DNM, update undercloud install options for containers https://review.openstack.org/517445 | 21:56 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: DNM, update undercloud install options for containers https://review.openstack.org/517445 | 21:56 |
| *** bobh has quit IRC | 21:58 | |
| *** etingof has quit IRC | 21:59 | |
| *** rcernin has joined #tripleo | 22:01 | |
| *** rbowen has joined #tripleo | 22:02 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/newton: FQDN validation https://review.openstack.org/517446 | 22:04 |
| *** jmelvin has quit IRC | 22:04 | |
| *** ffiore has joined #tripleo | 22:05 | |
| *** cdearborn has quit IRC | 22:06 | |
| openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: Add --config-download https://review.openstack.org/514701 | 22:07 |
| openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: Add --output-dir https://review.openstack.org/514789 | 22:07 |
| rook | bnemec: totally joking | 22:07 |
| rook | bnemec why not just launch it in a container #ContainersCanFixAnything | 22:07 |
| rook | :D | 22:07 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Add workflow for deployment via config-download https://review.openstack.org/512876 | 22:07 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Log Ansible actions to ansible.log https://review.openstack.org/514783 | 22:07 |
| slagle | EmilienM: ok, there's a start ^^. working'ish for me locally | 22:08 |
| slagle | EmilienM: it all depends on that packaging change though, so will probably fail in CI | 22:08 |
| slagle | EmilienM: i guess we could hack that until that lands and we promote | 22:08 |
| bnemec | rook: Just think how lightweight it will be! | 22:09 |
| *** threestrands has joined #tripleo | 22:10 | |
| *** threestrands has joined #tripleo | 22:10 | |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 22:10 |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 22:10 |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 22:10 |
| EmilienM | slagle: no need promotion | 22:10 |
| EmilienM | slagle: I can land it now, let me a min | 22:10 |
| EmilienM | slagle: you're right we need promotion. My bad. | 22:11 |
| rook | bnemec: for real, just throw a jvm in a container, what could go wrong. | 22:11 |
| * tonyb is stumped | 22:12 | |
| rook | bnemec anyway- I think the idea of elk for logs is becoming less of a "nice to have" and more of a req. | 22:12 |
| rook | Too much noise | 22:12 |
| rook | Especially in CI... | 22:12 |
| tonyb | If I read my plan files correctly mysql should be runing in a docker container but it seems to want to be runing under pacemaker? and how does it get its IP? | 22:12 |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: Call undercloud install for containerized CI job https://review.openstack.org/517447 | 22:13 |
| mwhahaha | (╯°□°)╯︵ sǝɹuʃıɐɟ ǝʇɐƃ | 22:15 |
| *** rbowen has quit IRC | 22:15 | |
| rook | tonyb on my pike deployment, mariadb is in a container and managed by pacemaker : Docker container set: galera-bundle [**/rhosp12/openstack-mariadb-docker:pcmklatest] | 22:16 |
| tonyb | rook: okay. If I check docker ps and pcs status neitehr thinks it has any thing running | 22:17 |
| rook | interesting. | 22:17 |
| rook | and it was a successful deployment/. | 22:17 |
| rook | and you are running as root? | 22:17 |
| tonyb | rook: which seems to be the reason that neutron fails to start (can't find mysql_ | 22:17 |
| tonyb | rook: No the deployment is failing and I'm tryign to work out what I've done wrong to cause it ;P | 22:18 |
| rook | ah, anything in os-collect-config? | 22:18 |
| rook | journalctl -u os-collect-config | 22:18 |
| rook | any hints? | 22:18 |
| *** akrivoka has joined #tripleo | 22:18 | |
| bnemec | rook: I don't disagree, and I think if you're doing HA at scale it would be insane to try to manage it without ELK. | 22:18 |
| tonyb | rook: Not that I can see but it's a little like looking for a needle in a hay stack ;P | 22:19 |
| bnemec | But we also have people who want to deploy on the absolute minimum hardware possible, and requiring an ELK node becomes problematic for them. | 22:19 |
| *** ffiore has quit IRC | 22:19 | |
| tonyb | rook: I'm just rebuilding my test environment so I can't check right now | 22:19 |
| rook | bnemec it is becoming less of a scale issue... the chattyness(sp?) of these services...and all these inter-dependencies (pacemaker, haproxy, docker) make the debugging even harder. | 22:19 |
| tonyb | rook: and yup I did the docker ps and pcs status as root | 22:19 |
| *** adac has quit IRC | 22:20 | |
| rook | bnemec right, POC clouds, no need for ELK for logging. | 22:21 |
| rook | IMHO development doesn't need it... | 22:21 |
| rook | people are typically focused in one area. | 22:21 |
| rook | unless you are mwhahaha | 22:21 |
| mwhahaha | pffft logging | 22:22 |
| rook | tonyb hm, no clues in os-collect-config? That is my crutch. | 22:22 |
| rook | see | 22:22 |
| rook | that guy. | 22:22 |
| rook | I am sure he is the reason for logs looking like googly eyes. | 22:22 |
| rook | some over here... some over there.. zero consistency. | 22:22 |
| tonyb | rook: I'll look again after this deploy fails ;P | 22:23 |
| mwhahaha | so pessimistic :D | 22:23 |
| mwhahaha | it might pass | 22:23 |
| rook | tonyb haha - yeah... the logs of os-collect-config should reveal something | 22:23 |
| tonyb | rook: okay I'll look there again ;P | 22:23 |
| rook | haha tonyb | 22:23 |
| * rook hopes you get lucky | 22:23 | |
| tonyb | mwhahaha: I'm really good at makign it fail ;P | 22:23 |
| * bnemec likes mwhahaha's table flip smiley | 22:23 | |
| mwhahaha | tonyb: what was the exact error? | 22:23 |
| rook | may the owls be on your side | 22:24 |
| tonyb | :) | 22:24 |
| bnemec | May the owls be ever in your favor. | 22:24 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/ocata: Workaround for RHEL registration as "localhost" https://review.openstack.org/495451 | 22:25 |
| rook | bnemec I am seeing some odd/bad overcloud image issues in ocata in my RDU lab... Image gets written, however the host just sits there, never reboots. If I am not babysitting things, i hit the timeout. | 22:25 |
| rook | to proceed, I simply issue a nova reboot <uuid> -- and that unwedges things. must be a ironic issue? | 22:25 |
| rook | I saw this previously with OSP8 and 9... Not with 10... | 22:26 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/ocata: RHSM: when using proxy, test its connectivity first https://review.openstack.org/517448 | 22:26 |
| *** etingof has joined #tripleo | 22:28 | |
| bnemec | rook: Yeah, sounds like an Ironic issue. | 22:28 |
| openstackgerrit | Ian Main proposed openstack/python-tripleoclient master: Support to drive undercloud deploy via undercloud.conf https://review.openstack.org/511350 | 22:28 |
| *** moshele has joined #tripleo | 22:31 | |
| *** agopi has joined #tripleo | 22:41 | |
| *** moshele has quit IRC | 22:41 | |
| *** rlandy is now known as rlandy|afk | 22:43 | |
| *** vpickard is now known as vpickard_ | 22:48 | |
| agopi | is there a workaround to deploy using tripleo-quickstart on rhel-6? | 23:01 |
| *** akrivoka has quit IRC | 23:01 | |
| *** paramite has quit IRC | 23:02 | |
| *** morazi has joined #tripleo | 23:06 | |
| mwhahaha | two undercloud container jobs failures in the gate | 23:08 |
| mwhahaha | http://logs.openstack.org/23/517023/2/gate/legacy-tripleo-ci-centos-7-undercloud-containers/d3d02fb/job-output.txt.gz#_2017-11-02_22_59_12_050026 | 23:08 |
| mwhahaha | http://logs.openstack.org/76/514576/1/gate/legacy-tripleo-ci-centos-7-undercloud-containers/7f6cd10/job-output.txt.gz#_2017-11-02_22_27_36_688475 | 23:08 |
| *** salmankhan has joined #tripleo | 23:10 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 23:10 |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 23:10 |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 23:10 |
| mwhahaha | and of course it seems we don't capture the logs correctly for the undercloud containers job so there's nothing really to look at | 23:11 |
| mwhahaha | lol wat the undercloud-containers job is non voting but in the cate? | 23:13 |
| mwhahaha | weshay, EmilienM, adarazs|rover, panda|ruck: https://review.openstack.org/#/c/517023/ undercloud-containers was non-voting in check but voting in gate? | 23:13 |
| mwhahaha | weshay, EmilienM, adarazs|rover, panda|ruck: see also https://review.openstack.org/#/c/514576/ | 23:14 |
| * mwhahaha gives up | 23:14 | |
| *** salmankhan has quit IRC | 23:14 | |
| *** bobh has joined #tripleo | 23:16 | |
| *** bobh has quit IRC | 23:16 | |
| *** rcernin has quit IRC | 23:17 | |
| tonyb | Ah ok I've foud at least one problem, Unable to find image 'docker-registry.engineering.redhat.com/rhosp12/opensatack-gnocchi-api-docker:20171101.2' locally" | 23:20 |
| tonyb | but I *thught* I'd said to use the images from the director node | 23:21 |
| *** bobh has joined #tripleo | 23:23 | |
| tonyb | How do I double check I've told it to use the right thing and/or work out why it can't get to docker-registry.engineering.redhat.com | 23:23 |
| tonyb | Also why didn't that cause a hard fail? | 23:23 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/511633 | 23:30 |
| weshay | mwhahaha, ugh.. k | 23:33 |
| *** moshele has joined #tripleo | 23:36 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test repositories https://review.openstack.org/517130 | 23:40 |
| *** agopi_ has joined #tripleo | 23:40 | |
| *** jcoufal has joined #tripleo | 23:41 | |
| *** jcoufal_ has quit IRC | 23:43 | |
| mwhahaha | tonyb: opensatack? | 23:43 |
| *** agopi has quit IRC | 23:43 | |
| weshay | mwhahaha, I don't see that it should be gating in the project config https://github.com/openstack-infra/project-config/blob/master/zuul.d/projects.yaml#L20228-L20452 | 23:44 |
| *** links has joined #tripleo | 23:44 | |
| tonyb | mwhahaha: as in "why didn't that cause a hard fail?" == "'Cause OpenStack That's why" | 23:44 |
| mwhahaha | tonyb: also I don't think we do a predeploy check so it fails when we go to pull it down. We should really run some sort of preflight on the docker image info but that won't be in pike (would be a good rfe) | 23:45 |
| mwhahaha | tonyb: no what you pasted had opensatack not openstack | 23:45 |
| mwhahaha | 5:20 PM <tonyb> Ah ok I've foud at least one problem, Unable to find image 'docker-registry.engineering.redhat.com/rhosp12/opensatack-gnocchi-api-docker:20171101.2' locally" | 23:46 |
| tonyb | mwhahaha: Oh huh. That's kinda intersting | 23:46 |
| mwhahaha | Dat typo | 23:47 |
| mwhahaha | Spell check for all | 23:47 |
| tonyb | mwhahaha: That's what I get for copying instructions from an etherpad | 23:47 |
| mwhahaha | tonyb: this is why we need automated stuff and less copy pasta :D | 23:47 |
| mwhahaha | weshay: I thought we recently switched it to voting, seems odd | 23:48 |
| tonyb | mwhahaha: Yeah. | 23:48 |
| tonyb | Let me try with the correct prefix and namespace and see if that makes a difference | 23:48 |
| *** agopi_ has quit IRC | 23:52 | |
| weshay | mwhahaha, I'm still poking | 23:52 |
| * weshay hates project.config | 23:52 | |
| mwhahaha | weshay: maybe this one is a poke infra folks one | 23:52 |
| tonyb | weshay: project-confg? 'sup? | 23:53 |
| weshay | https://github.com/openstack-infra/project-config/blob/master/zuul.d/projects.yaml#L20228-L20452 | 23:53 |
| weshay | trying to reconcile the config w/ | 23:54 |
| weshay | https://review.openstack.org/#/c/517023/ | 23:54 |
| weshay | https://review.openstack.org/#/c/514576/ | 23:54 |
| weshay | legacy-tripleo-ci-centos-7-undercloud-containers failing in the gate | 23:54 |
| weshay | I have not yet found where it's configured to run in the gate | 23:54 |
| weshay | tonyb, thanks for raising your hand btw :)) | 23:55 |
| * mwhahaha runs away | 23:56 | |
| tonyb | weshay: np I kinda sort grok infra | 23:56 |
| tonyb | weshay: When you say gate to do mean run in CI or run in the gate pipeline? | 23:57 |
| weshay | Zuul gate (1 rechecks)Oct 30 4:07 PM | 23:58 |
| *** noslzzp has joined #tripleo | 23:59 | |
| tonyb | weshay: okay ... master? | 23:59 |
| weshay | aye | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!